Professional Documents
Culture Documents
Unknown
Unknown
SPIEDigitalLibrary.org/conference-proceedings-of-spie
Luigi Enrico Guzzetti, Livio Busnelli, "EF2000 PIRATE test flights campaign,"
Proc. SPIE 7109, Image and Signal Processing for Remote Sensing XIV,
71090N (10 October 2008); doi: 10.1117/12.799656
ABSTRACT
The PIRATE, short for Passive Infra Red Airborne Tracking Equipment, multi mode Infrared Sensor, has been
developed and manufactured by the Eurofirst consortium. The consortium is led by SELEX Galileo, contract award since
1992, from Italy, and includes THALES UK, and TECNOBIT from Spain.
At the end of the development phase, a three years flight test campaign has started in 2005, and has been carried out
involving Eurofighter partner companies, as flight trials responsible, like ALENIA in Turin (FLIR flight testing leading
company), BAE SYSTEM in Warton, and EADS in Manching, highlighting the functionality and the performance of the
unit, when operating in real scenarios, with cooperative target and TOO (target of opportunity), across different weather
conditions, like clean sky, but also misty and cloudy weather, haze and hail, generally not ideal to the infrared
wavelength operation, either during tracking or imaging.
Keywords: IRST, Infra Red Search Track, FLIR, Forward Looking Infra Red
1. SCOPE
This paper briefly reports about the PIRATE (Passive Infra Red Airborne Tracking Equipment -- herein called ‘
FLIR ’ for brevity), flight trials development and testing campaign, carried out on the Eurofighter (EF2000 Typhoon)
aircraft.
2. A BIT OF HISTORY
The FLIR has been developed through a period spanning between 1992 and 2007. A huge effort of the partner
companies has been necessary to handle such a complex project, either from a technical and programmatic point of view.
As in any other Eurofighter programme, the unit is the result of a joint effort of different companies from different
nations, which work-share is balanced among them according to the main investment coming from the customer nations.
The partner companies are TECNOBIT, from Spain, THALES from UK, and SELEX GALIEO from Italy (leading
company / contract award). These three companies are joint in the Eurofirst consortium.
The unit has been developed substantially starting form scratch, as the Eurofighter programme is very demanding in
terms of development of new technology, even if always keeping an eye on other typical aspects of the avionic defence
market, like reliability, affordability, secure second source components rather than efficient logistic support.
Nowadays, while the qualification phase of the equipment is almost over, either in the laboratory, on the purchaser
avionic RIG reproducing the functional operating condition, and on field, i.e. during the flight trials campaign performed
by Eurofighter, under the supervision of the final customer, the programme is in a well established production phase;
almost a hundred of AC delivered to the Air Forces of UK, Spain and Italy, are equipped with the FLIR, while the
German set up is still without the FLIR unit, because of a decision of their government.
Everything written here is taken from the experience of the flight trials as seen by the supplier, i.e. stressing topics
like the discovery and fixing of problems or algorithms improvement, possibly not giving the right evidence to other
issues much more related to the aircraft functions in its operative environment.
The FLIR is a multi role sensor, able to supply tracking and imaging modes. It is based on a focal plane array
detector, on which the incoming radiation is focalised through an optical path. The detector elements are made of CMT
(Cadmium Mercury Telluride), sensitive to the far IR radiation (8 – 14 µ). The real bandwidth used inside the sensor is
further optimised to maximise the performance in terms of detections of small thermal spots.
The incoming radiation is conveyed onto the FPA (Focal Plane Array) detector, through an optical path composed
of different kind of lenses working in the IR bandwidth, like germanium, gallium arsenide, KR5 and similar, for a total
of more than 90 reflecting surfaces, containing the overall attenuation of the input radiation. The main window facing the
external world, is made of Zinc Sulphide coated by a protective layer with a further durable coating on top of it, to resist
the environment, the pressure, the erosion and the ram air.
A sealed optical module
HEAD
SCAN FPA contains such components. It is
MIRROR DETECTOR
plugged inside the main box,
installed on the Aircraft on the left
side of the fuselage. The optical
module allows the selection of two
different FOVs (Field of View), for
the imaging and for the tracking
INPUT IR
operation. The scanning can be
WINDOW executed by an head mirror mounted
on a two axes gimbals, located right
IMAGER inside the main entrance dome, in
DEROTATION
PRISM
tracking modes, or by a flapping
AFOCAL
TELESCOPE mirror that can be synchronised to a
U
common video frequency, allowing
operation in imaging mode.
VIDEO
FOLDING SCANNING
MIRROR MIRROR
.fl
.=?= •-/
The gold flashed heading mirror reflects the radiation directly inside the afocal telescope, after which a folding
mirror directs the IR rays inside a derotation prism, enable to compensate the periscopic effect during the scanning of the
FOR(Field Of Regard), and to rotate the detector array onto the scenario permitting different stabilisation of the scanning
in inertial space with respect to the aircraft attitude. A flapping mirror permits the scanning at video frequency, while the
subsequent imager mechanism gives the final focalisation onto the detector array. A Stirling cycle cryogenic cooler
allows the detector to cool down at 70K, where the material is sensitive to the thermal radiation.
The optical module is fully interchangeable, being provided with strictly controlled mechanical alignments
reference points, and a set of parameters, factory setup, taking into account of all the opto-mechanical differences to the
nominal design, to real time compensate the pointing and the distortion, and also data correcting the non uniformity of
the detector elements responsivity, used for the correction of the picture, and, generally, the IR stream.
The main head mirror can be driven to perform a scan of the external world in
a sequence of constant elevation bars, stabilised in the Aircraft inertial system, or
to follow a single hot spot when in single target tracking rather than slaved to
external sources like the pilot direct control or the input from its head position
when the FLIR image is projected onto the HMD (Helmet Mounted Display) worn
by the pilot itself.
A sophisticated Servo Loop system is running to provide all the kind of
stabilisations and the proper pointing accuracy.
An auto-focus mechanism is continuously operating, detecting the
temperature of the optical components and re–calculating the optimum focus and
focal length of the system, fine adjusting the position of a telescope lens, and
redefining in real time the angular sub-tense of the detector elements, giving the
right geometry to the video processing in order to properly compensate for the
distortion and apply the right magnification to the picture, and to the data
processor to give it the correct information, to permit the proper tracking of
subsequent detections and the definition of their exact position.
A gyroscope based system, is installed inside the unit to increase the
accuracy of the stabilisation, especially detecting the high frequency disturbance,
out of the bandwidth of the incoming aircraft inertial data, at the location where the
FLIR is installed. Such data are combined (blended) with the inertial AC data,
Figure 4:Head Mirror on the gimbals. providing a real internal accurate inertial navigation system.
Such data are real time distributed to all the processors. The IR signal coming
out from the detector through its low noise proximity electronics, is converted into a 14 bit digital stream, giving an
overall bandwidth of up to 400 MHz in the most demanding mode. The actuators and moving mechanism inside the
optical module are operated by the Sensor Head Electronics Assembly that is supplying power and controls to all the
movable parts.
This is where the detection and tracking of the targets is carried out.
The MTT (Multi target Tracking), is a search mode, where the system is able to follow a number of targets not very
close to the ownship. Extremely low level thermal radiation (signature) objects, can be kept under track at the same time,
while the coverage of the external scenario can be up to the maximum extension of the FOR. When a target gets closer to
the ownship, other modes can be engaged, like STT (Single Target Tracking), where a target can be followed and locked
down to very close distance. A picture of the scene can be displayed while in STT, giving the possibility for the
identification of the threat. SACQ (Slaved acquisition) is another Tracking mode, where the pilot directly selects an area
of interest, as seen through the HUD, and can immediately lock on the target.
Algorithms and techniques like auto-thresholding, together with a sophisticated classification and features
extraction of the detected signatures, limits the number of false alarms, especially in presence of noisy clutter inside the
FOR, like clouds glints, forest, or city urban agglomerate.
The Data Processor, takes the blended inertial data as a navigation data source for the calculation of the target
position in an inertial system, either referred to the aircraft or to the local geographical coordinates.
The position of the targets are finally supplied to the avionic BUS of the Aircraft, specifically to the ATTACK
BUS. Other than the angular position and the range of the targets, information on the signature and the characteristic of
the detected threats are supplied, together with details on the dynamics and the achieved accuracy of the output FLIR
parameters, like the instantaneous angular accuracy.
Other information are exchanged through the high speed bus, the basic commands like the mode changes or the
attitude data coming from the inertial sensors of the aircraft, or information about the health of the unit, useful for a fast
and efficient repair in case of failures.
4. INSTALLATION ON THE AC
The unit is installed in the fuselage of the Eurofighter Aircraft, on the left side, in an advantageous position that is
not confining the functionality to air to air or to ground operation only. Both of them are permitted, with the only
limitation is that part of the bottom right side of the Field of Regard, i.e. the area the FLIR is able to cover during the
scanning, is obscured by the Aircraft nose. This is not, anyway, very significant, so that the installation permits to cover
a wide area during the tracking modes, while, when in imaging modes, the FOV is practically not obscured at all. The
front window protrudes outboard of the envelope of the fuselage as it were looking for a better position to look at the
external scenario.
'
;40•
Figure 7: Installation
5. TESTING
During the development and the prototyping phases, the unit has been widely and thoroughly tested in a laboratory
environment, reproducing most of the conditions encountered during the real operation.
The avionic system of the aircraft is completely reproduced in the RIG, based at the Purchaser premises, where all
the sensors can be exercised through simulations of real missions. Data are injected and different scenarios are
reproduced in real time, according to the input dictated by the main computer, driving the testing sequence, in terms of
number and dynamics of the simulated tracks. A unit, acting as a RSE (Rig Support Equipment), for every sensors,
creates the commanded scenario translating it into the appropriate stream of data for the specific sensor, according to its
physics. In the case of the FLIR, the RSE is represented by the IRDG (Infra Red Data Generator), that is able to real time
supply a stream of digital data, up to the maximum frequency, containing all the features as they were directly derived
from a scanning of the external scene.
6. FLIGHT TRIALS
The first tracking trial was performed by ALENIA, with some success, i.e. keeping a target revealed by the RADAR
as well, in STT, for around 200 seconds. This was in 2004, where the FLIR SW and algorithms were not mature enough,
especially in tracking. Imaging trials were performed even before that, since 2001 on, especially by ALENIA, during
ferry flights between Turin and Sardinia.
More than a hundred hours of flights have been carried out, on the development Eurofighter aircrafts, by three of the
Eurofighter partner companies, i.e. BAES, EADS and ALENIA, being ALENIA the responsible for the final assessment
as far as the FLIR was concerned. Data form the Avionic Bus have been recorded, as well as the video images supplied
to the displays, to make the full representation of the mission available for evaluation and data analysis. Very often, co-
operative targets were flown, to exercise the FLIR across simulations of real missions, with typical manoeuvres, to test
the behaviour of the FLIR, especially in the tracking functionality. Furthermore, a number of ride along flights have been
executed, for example during the transfer flights, and, even if data where not recorded, the pilots experienced the
capability of the FLIR, looking at the picture, or noticing the tracking of TOOs (Target Of Opportunity), like common
airline aircrafts.
The picture of the FLIR can be either displayed on the MHDD, or projected onto the HUD. In the latter situation the
image is overlaid to the external world. An initial assessment of the alignment of the FLIR picture has been carried out,
successfully, exploring the capability to trim the picture shape in terms of dimensions and centring, to take into account
for the positions of the pilot’s head with respect to the display, compensating for the specific pilot posture, and
minimising the parallax error.
The image has been initially evaluated on ground, the compensation of the distortion, electronically achieved inside
the FLIR, as well as the compensation for the magnification variation with the temperature of the optics was assessed.
During the first flights, the image was judged too faint, especially when looking at uniform backgrounds. The image
processing algorithms were modified, optimising the area where the coefficients for the compensation were taken from,
trying to include, in typical situations like level flights, all the ground area, where the FLIR is supposed to optimise the
picture, but also a conspicuous part of the sky, generally more uniform than the ground, so that all the grey levels in the
scenario have representation in the final histogram equalisation.
The trimming of the boundaries of such an area, was directly possible in flight, by means of a piece of test SW,
giving the possibility to modify the area shape, and have immediate feedback to either the pilot for its satisfaction and to
the designer for the algorithm fixing.
OO:I73775
1
Figure 8: HUD and MHDD (right), white hot/black hot (left)
, S
The air to air primary role of the FLIR, is mainly represented by the MTT (Multi Target Tracking) mode, in which
the FLIR (here fully engaged in its IRST functionality), is supposed to follow a number of targets inside a specific FOR,
the so called scan volume, defined by the avionic and scanned by the Head mirror, in inertial space, as a number of
contiguous constant elevation bars.
Tests have been done starting from the simple tracking without cooperative targets, just to open the door of the
FLIR IR path to the external world and see what was going to happen.
By that time, i.e. the beginning of the flight trials, the literature and the experience on similar tracking missions,
employing Infra Red based tracking sensors, was indeed very poor.
Two things, the first as a consequence of the other, were immediately noticed, i.e. the absolute preference to look up
scenarios, and the high amount of declared targets together with their short duration.
The look down scenarios could likely include terrain background, hence clutter, and consequent increase of declared
false alarms, even if not precluding the possibility to track aircrafts with an altitude lower than the ownship, and
consequently appearing below the horizon, or helicopters flying in front of woody hills. The look up scenarios appeared
as a reasonable first step.
This is a sub-function where imaging and tracking are joint. Ground targets are highlighted through simbology
superimposed on the picture projected onto the HUD. It is a real air to surface mode, and, despite being a sub-mode, this
has been widely exercised and tested attracting the attentions of the pilots. The scanning is carried out by the small
flapping mirror at video frequency, so that, the data processor can refresh the scenario information very rapidly. The
a a
Figure 11: TC in Black/Hot and White/Hot.
The STT is clearly one of the most important functionality. Transition to STT can be obtained after a previous phase
in MTT, where one of the tracked target can be selected, or through another primary mode called SACQ (SLAVED
ACQUISITION) where the pilots manually search for an area of interest, moving the centre of the scan of the flapping
mirror where he thinks the threat is. When a target is identified, the system immediately locks on it and turns to STT.
Obviously, rejection of non wanted targets is always possible.
The pointing accuracy was shown to be comparable to what expected, while the tracking stability, here as well,
shown some malfunctions in terms of unwanted lost of the lock, even if rather infrequent, indeed. The final judgement of
the pilots was substantially positive, especially about the transition from SACQ to STT.
Another very interesting sub-function of this mode is the identification, i.e. the possibility to superimpose a real
picture of the scanned area, permitting to identify the kind of threat.
The domino and striping effects were initially devastating to the displayed picture quality. An image process,
similar to the one undertaken for the imaging, is carried out, with some differences; for example the gain and offset
compensation function removes the central area from the calculation of the compensation coefficients. This, because it is
supposed that, during successful STT, the threat is clearly lying there, and becomes bigger and bigger as it gets closer to
the ownship, increasing its contrast to the background as well.
The quality of the picture and of the overall functionality was judged very good. The possibility to recognise a
target is effectively there. Of course, the pilot knows about the co-operative targets during the test flights, but when
showing in flight recorded pictures to other pilots, they never failed in the identification.
Black Hot and White Hot, the digital magnification of the image, together with its freezing function, were widely
exercised and experimented.
7. RELIABILITY
Up to five FLIR units have been flying at the same time in Warton, Manching and Turin. Only really few HW
failure has presented, and this can be considered down to the physiological level, also bearing in mind that development
units suffered of the lack of the full product engineerisation. Such a surprising level of reliability, allowed to concentrate
on the main effort, the fix of the SW and the tuning of the algorithms without worrying too much about other noisy
things.
8. CLEARANCE.
Despite of the initial diffidence on the functionality, detailed reports have been issued by all the test flights
companies, and especially by the FLIR flight trials responsible, i.e. ALENIA, giving a general positive judgement, and
not preventing the utilisation of any of the described modes. It is one of the first IR system, with either imaging and
search and track functionality’s, successfully installed on a fully operating Aircraft.
9. ACKNOWLEDGEMENT
Quite a number of people contributed to the success, but among the Eurofigther community, three people, Leander
Arnold and Manfred Scheuer from EADS MANCHING, Germany, Purchaser FLIR team, and Roberto Lucherino from
ALENIA CASELLE, Italy, Flight Trials Test Department, have to be mentioned, that supported the activity because of
they role in the programme, but offering efforts and showing enthusiasm well above the boundary of the tasks they were
committed to, across the whole flight trials campaign.