You are on page 1of 8

REAL TIME PASSIVE MILLIMETER-WAVE IMAGING FROM A

HELICOPTER PLATFORM
Christopher Martin, John Lovberg, Stuart Clark, Joe Galliano, Trex Enterprises, San Diego, CA

Abstract typically use wavelengths equal to or longer than


Real time passive millimeter-wave imaging millimeter-waves and thus, also penetrate
systems have a wide variety of uses from aircraft obscurants. However, radar systems' ability to map
navigation and landing in fog to detection of ground features can be limited by multi-path
concealed weapons. A useful imaging system for reflections and range-angle calculations that present
flight platforms requires a large number of pixels distorted images of three-dimensional targets.
and a high frame rate combined with a small Millimeter-wave imagers present the user with a
antenna volume and a low cost. We present a true representation of the scene without computer
millimeter-wave imaging system which uses 32 interpretation. Additionally, the passive imager has
MMIC low noise amplifiers to display a 60 x 75 the military advantage of being nearly electronically
pixel image at a 30 Hz frame rate. The system's silent.
pupil-plane phased array architecture allows for a
relatively thin large aperture antenna. A remotely The source of the millimeter-waves received
located processor utilizes microwave guiding circuit by the imager is blackbody radiation, which is
boards to perform phase and frequency energy radiated by all objects based upon their
discrimination on the radiation received by the temperature and composition. Infrared cameras
antenna array. exploit blackbody radiation to form images based
upon the heat given off by targets in the form of
The imaging system was mounted on a infrared radiation. Millimeter-wave imagers
helicopter platform and used to gather real-time operate on the same principle as infrared cameras,
imagery of a variety of targets. Targets include but the phenomenology of millimeter-wave imagers
improved and unimproved runways, roadways, can be very different. Objects tend to be more
vehicles on roadways, and power lines. We present reflective in the millimeter-wave portion of the
video-rate millimeter-wave imagery of ground spectrum than the infrared, and metal objects, even
features which are obscured from visible and when painted, are totally reflective. As a result, the
infrared sensors by fog. The helicopter is shown to contrast in millimeter-waveimages depends as
be able to follow and navigate ground features much on the composition of the objects being
while travelling above a layer of fog using only the imaged as the object temperature. For instance, an
millimeter-wave imagery. asphalt runway contrasts the surrounding dirt
because it is more reflective then the dirt, even
Introduction though the physical temperature may be the same.
The primary source of contrast in millimeter-wave
Passive millimeter-wave imaging is widely imagery taken from an aircraft is the sky, which can
recognized as a potentially powerful tool for have a radiometric temperature of as low as 80 K on
navigating and landing aircraft in low visibility a clear, dry day. Metal objects which reflect the sky
conditions. Millimeter-wavelengths pass through will then have a temperature differential of up to
obscurants such as clouds, smoke, and fog, which 220 K from their surroundings. Other objects
scatter shorter wavelength radiation such as which partially reflect the sky will also display a
infrared, typically imaged at 3-5 pm or 8-12 pm, greater temperature differential than their physical
and visible light (0.4-0.7 pm). Radar systems temperatures would indicate. Thus millimeter-wave
imagers can differentiate between many objects

0-7803-6395-7/00/$10.0002000 IEEE 2.B.1-1

Authorized licensed use limited to: UNIVERSITY OF BIRMINGHAM. Downloaded on December 15,2022 at 08:25:46 UTC from IEEE Xplore. Restrictions apply.
despite having relatively poor temperature processor, the frequency processors, and the
sensitivities compared to infrared imagers. computer. Each element and its contribution to the
The advantages of passive millimeter-wave system operation is described below.
imaging have been proven through years of remote
sensing on satellites and airborne platforms. But Antenna and Front End
the use of millimeter-wave imagers for aircraft The PMC antenna is comprised of an array of
navigation has been limited by drawbacks including 32 frequency scanned antenna elements. Each
low frame rate, narrow field of view, large size and antenna element is a three foot (91 cm) length of
weight, and high cost. Trex Enterprises' passive slotted W-band waveguide with a feed on one end
millimeter-wave camera (PMC) uses a novel and a load on the other end. The 600 regularly
architecture to overcome these traditional spaced slots couple energy incident on the antenna
drawbacks. The PMC images radiation from 90.6 element into a travelling wave inside the
to 96.6 GHz over a 6" x 8" (V x H) field of view waveguide. Based upon the slot spacing and the
comprised of 60 x 75 pixels. The approximately 90 propagation speed in the waveguide, there is a
cm x 80 cm aperture gives the system a 0.20" x correspondence between angle of incidence of
0.23" spatial resolution, or 30 x 35 real beamwidths incoming energy and the frequency at which the
in the field-of-view. The higher pixel count makes energy will efficiently couple to the waveguide,
the system approximately twice over-sampled in resulting in frequency scanned antennas. The
either direction. The PMC is a true staring array, frequency at which any broadband source couples
which produces imagery at 30 frames per second to the antenna will be determined by the sources
without any mechanical scanning, collecting relative position to the antenna. The PMC antenna
135,000 pixels per second. While many staring elements scan at approximately 1 "/GHz over the
systems require one receiver per pixel, the PMC operating range.
accomplishes this using only 32 low noise MMIC
receivers in the system front end by employing The 32 antenna elements are arrayed with a
pupil plane architecture. The PMC antenna is a linearly increasing spacing over 80.6 cm. Radiation
frequency-scanned phased array made up of thirty- incident on the array is transmitted to the array
two elements, each with a low noise amplifier. The elements with a unique phase relationship which
pixel information is frequency multiplexed by each depends upon the angle of incidence with respect to
antenna stick and phase-encoded by the array. A the array direction. As the array direction is
remote millimeter-wave processor performs phase orthogonal to the element scan direction, the source
and frequency processing on the signals before position of incoming radiation is encoded in the
routing the energy to diode detectors. This phase and frequency of the signals in the antenna
architecture allows for a flat antenna which has a elements. Note that the array of 32 elements over
large area for high spatial resolution, but is both 80.6 cm results in a fill factor of only 6%, resulting
thin and light. This antenna can be mounted at an in a low efficiency array pattern. The main beam
appropriate location for navigation, and the bulkier efficiency of the array is only 40%, but the irregular
processor can be located at a more convenient element spacing results in low grating lobe levels at
location in the aircraft interior. The use of any specific angle.
relatively few MMIC receivers reduces the cost of The feeds of the antenna elements are attached
the system and is not directly linked to number of to femte circulator switches which allow for
pixels or field of view. With the high performance switching between the antennas and fixed
levels achieved with this cheaper and more compact temperature loads. The array is Dicke switched at a
architecture, the PMC is a millimeter-wave imager 3.84 k.Hz rate to maintain system calibration. W-
appropriate for aircraft use. band MMIC amplifiers located after the switches
set the system noise figure of 10.5 dB, including the
System Description antenna and switch losses. The MMIC amplifier is
followed by a downconversion stage where mixers
The PMC is composed of four main elements: fed by a doubled 42 GHz local oscillator, divided
the antenna and front end amplifiers, the phase 32 ways, shifts the signals down to 6.6 to 12.6 GHz.

2.B.1-2

Authorized licensed use limited to: UNIVERSITY OF BIRMINGHAM. Downloaded on December 15,2022 at 08:25:46 UTC from IEEE Xplore. Restrictions apply.
The signals are then amplified again and fed to the equal frequency intervals. The frequency processor
phase processor unit. The phased array system has a resolution from 100 MHz at 6.6 GHz to 195
must maintain phase matching between all 32 MHz at 12.6 GHz. In all cases, the resolution is
elements from antenna to phase processor. Care is better than the diffraction limited resolution of the
taken to match the phase lengths of all components antenna.
in this path. Residual phase errors are corrected by Immediately following each output port on the
shifting the signal from the local oscillator before it processor is a zero-bias detector diode. Each diode
reaches the individual mixers, and by employing correspondsto one pixel in the final millimeter-
adjustable length line stretchers in the signal path. wave image. The voltage generated by the diodes is
read out by a detector chip which integrates the data
Phase Processor over a 1/30-second period while also subtracting off
The phase processor serves to unfold the phase the reference signal provided by the Dicke switch.
information collected by the antenna array and The chip then amplifies the voltage and bursts the
output signals correspondingto columns of pixels data to the system computer.
in the final image. Operationally, the processor is The diodes and read-out chips are located on
equivalent to a microwave lens. Microwaves from the surface of the frequency processor board, which
the thirty-two array elements are launched into the is a 22-inch square sheet. The seventy-five
processor with a spacing proportional to the antenna frequency processors are assembled in a single
array spacing. Each of the seventy-five output ports "stack" with a height of 22 inches including
from the phase processor correspond to a particular spacers.
azimuthal angle imaged by the antenna array.
The PMC phase processor is a 22-inch square System computer
sheet mounted behind the antenna support plate.
The system computer, a commercially
Also mounted to this support plate are the MMIC available quad-processormachine with dual PCI
amplifiers, mixers, and associated electronics. The buses, captures the pixel data values from a custom
entire structure is less than 20 cm thick. Up to the
interface board and displays the information as an
phase processor, all signal path lengths have been
image. The computer performs a number of image
short to preserve phase matching and to limit loss in
processing tasks on the data in real time, including
the W-band sections. With the phase processing
gain and offset corrections for each pixel. The
complete and the signals converted to lower computer can also perform temporal and spatial
frequencies, the signals output from the phase
filtering on the data to increase contrast.
processor are launched onto seventy-five co-axial
cables which are routed to a remotely located In addition to being processed and displayed,
frequency processor and system computer. image data from the PMC is saved in real-time to
the computer memory and occasionally transferred
to hard drive as the memory fills. During the PMC
Frequency processor flight tests, the computer also displays and saves
After an amplification stage to compensate for data from two other video sources, a visible and an
losses in the processors, each of the seventy-five infrared camera. All data is saved as raw data so
signals is fed into a frequency processor unit. The that signal filtering routines can be changed during
frequency processor performs a real-time spectrum subsequent data replay.
analysis on the 6 GHz bandwidth signals, sorting
them into sixty separate 100 MHz frequency bins.
This effectively reverses the operation of the PMC performance specifications
frequency scanned antenna, with each bin The system described above has a spatial
corresponding to an elevation angle from which the resolution of 0.20" x 0.23" over a 6" x 8" field-of-
antenna received a signal. The frequency processor view. The system displays 60 x 75 pixels, which
steers a signal according to its frequency to one or are approximately twice oversampled relative to the
more of the sixty output ports, which are spaced at antenna beamwidth. Each pixel has a temperature
resolution of 6 to 8 K depending upon its position in

2.B.1-3

Authorized licensed use limited to: UNIVERSITY OF BIRMINGHAM. Downloaded on December 15,2022 at 08:25:46 UTC from IEEE Xplore. Restrictions apply.
the field-of-view. This sensitivity figure includes bottom of the antenna assembly. Two sets of bars
the loss due to the sparse antenna array and is based were made which pointed the antenna to either 10"
on a 1/60-second integration time. The system uses or 40" below the horizon. Sets of co-axial cables
a 3.84 kHz Dicke switch as its front end for carrying signal from the phase processor to the
calibration and displays images at a 30 Hz rate. frequency processors and sets of wires carrying
This rate is not dictated by hardware and can be power to the antenna assembly both pass through a
increased or decreased to affect temperature hole in the nose assembly to the interior. The racks
sensitivity. containing the frequency processor and the
computer system were mounted in the aft portion of
the cabin to maintain balance of the aircraft.
Configuration For Airborne Data
Gathering The antenna itself was protected by a Rexolite
The high frame rate of the PMC system along lens which increased the system's depth of a focus
with the antenna's small form factor allowed for to a range of 600' to infinity. Between the lens and
integration into an airborne platform for real-time the antenna, space was reserved for a polarization
imaging. A UH-1H "Huey" helicopter was selected twister. The slotted antenna normally receives
as the platform for its cargo carrying ability and vertically polarized radiation, but the polarization
flexibility to perform a number of flight scenarios. twister rotates the polarization of incoming
The antenna assembly was mounted to the nose of millimeter-waves by 90", allowing the antenna to
the helicopter and the frequency processor stack, view horizontally polarized radiation. A visible
computer rack, and power supplies and sources light CCD camera and a ferroelectric infrared
were mounted in the passenger compartment. camera were mounted atop and boresighted with the
(Figure 1) antenna. The in-flight imagery from these cameras
was saved to the computer alongside the millimeter-
The antenna assembly, including MMIC LNAs
wave imagery.
and the phase processor, was contained in a
Vibration control for the flight testing was
fiberglass environmental enclosure held by a
entirely passive. Rubber bushings at the pivot rod
support fork. The support fork attached to a pivot
damped vibrations from the helicopter to the
rod which mounted to hard points on the helicopter
antenna assembly. The frequency processor and
nose through a custom fiberglass nose panel. The
computer racks were mounted to the helicopter
pivot rod allowed the antenna assembly to be
floor on inflatable air shocks. No temperature
rotated through a range of elevation angles. The
control was used for the system other than two
look angle of the antenna was fixed by a set of bars
cooling fans that circulated air through the antenna
anchored to the bottom of the helicopter and the

Figure I . PMC-I mounted on helicopter.

2.B.1-4

Authorized licensed use limited to: UNIVERSITY OF BIRMINGHAM. Downloaded on December 15,2022 at 08:25:46 UTC from IEEE Xplore. Restrictions apply.
assembly enclosure and cooling fans for the power PMC System Set-Up
amplifiers and power supplies. Before each flight, the system was configured
Power for the system was supplied by series in either the 40" or 10" look down position and for
pairs of 12 V deep cycle marine batteries. The either horizontal or vertical polarization. When
original intent was to power all systems off the multiple configurations were desired, the system
helicopter's DC generator, but the helicopter power could be changed in the field during a brief landing.
proved too noisy for some of the system's low noise The system was also calibrated before or after each
components. Most electronic components were flight by taking 1000-frame(33-second)images of
driven from DC to DC converters directly from the both the sky and absorptive foam. Due to
batteries' 24 V. An inverter provided AC power for differences between conditions at the airfield and in
two low-noise AC to DC supplies. The computer the air over targets, these calibrations were found to
system was also powered by AC from the inverter be imprecise. In many cases, new calibrations were
through a U P S with battery back up. The created for the data files by examining in-flight
electronics for the antenna enclosure and frequency imagery. But in all cases, the original calibrations
processor required approximately 700 W, and the were adequate for finding targets and navigation.
computer and accessories including the cameras and
back up VCRs required 750 W. This total of 1450 Navigation by Ground Features in Low
W includes conversion losses and all fan motors. Visibility Conditions
Three pairs of batteries provided power for over
two hours of data collection time. On December 14, 1999, the PMC flew over the
Tehachapi Valley in the early morning. A low,
Total system hardware weight in flight thick layer of fog was advancing over the valley.
configuration is 1320 pounds. The nose mounted The helicopter flew at an altitude of 1400 to 1500,
antenna enclosure with Rexolite lens is 200 pounds while the fog rose to approximately 300. With the
plus 50 pounds for the support structure and PMC in the 40" look down configuration sensing
cameras. The frequency processor rack assembly horizontally polarized radiation, the system was
including power supplies weighs 350 pounds, and able to image ground features in the valley through
the computer rack including monitor, UPS,and the fog. In particular, the flight demonstrated the
inverter weighs 360 pounds. The batteries ability to navigate in the low visibility conditions by
contribute 360 pounds of weight, and the balance of following a highway for several minutes using only
the weight is made up of cables and power wires. the PMC. Hwy 58 was visually acquired in a
This weight represents lab equipment with section of valley not yet covered by fog. Following
additional hardware and systems added for the highway north, it disappeared into the fog on
flightworthiness. first the visible and then the infrared camera. The
PMC continued to display a clear image that was
used to navigate the helicopter over the highway.
Airborne Millimeter-WaveImaging At ranges of 2300' it was possible to see both sides
Between November 5,1999 and January 19, of the highway, exit and entrance ramps, and
2000, the PMC flew on twelve data gathering overpasses. It was also possible to clearly detect
helicopter flights, varying in duration from one hour vehicles moving on the road below. Additionally,
to four hours in the air. The base of operations for the system detected bodies of water and large
these flights was Mojave Airport in Mojave, CA. A structures hidden in the fog. (Figure 2)
wide variety of targets were imaged from various
altitudes and speeds and in varying visibility. The
targets were selected to demonstratethe abilities of On January 12,2000, the PMC made another
passive millimeter-wave imaging in flight flight over the Tehachapi Valley in foggy
scenarios. The highlights of these data collection conditions. At this time, the fog was much higher,
flights are described below. Examples of the actual forcing the helicopter to fly at an altitude of 4000.
data on videotape or CD may be requested from the With the PMC in the same configuration, the
Army Research Laboratory, Adelphi, MD.

2.B.1-5

Authorized licensed use limited to: UNIVERSITY OF BIRMINGHAM. Downloaded on December 15,2022 at 08:25:46 UTC from IEEE Xplore. Restrictions apply.
VISIBLE PMC IR

Fipure 2. 1mape.v nf Hwv. .%? thrnuph fnp.

system was still able to identify and follow the polarization was found to provide better
highway in the fog. However, at the range of 6000, information.
the highway onIy appeared as a single line, and
Flights in the GormadQuail Lake area
details seen in the previous flight were absent.
demonstrated navigation using a variety of ground
Navigation was confused by other roads, which also
features including lakeshore, aqueduct, landing
appeared as lines in the image. Large structures and
strips, and roadways. Flights along Interstate 5 and
bodies of water were still identifiable.
Hwy 138 were undertaken at an altitude of 500
with a slant range of over '/2 a mile. The 11'
Navigation By Ground Features in Look resolution (6' pixels) at this range enabled the
Forward Mode imager to discern both sides of the freeway and the
Flights in foggy conditions were conducted exit and entrance ramps needed for navigation.
with the PMC pointed at 40" down to avoid flying Flights along an aqueduct at a 500 altitude were
the helicopter itself through the fog. However, real easily able to track the aqueduct and to identify
world navigation is more likely to occur with the bridges crossing the aqueduct. Passes over larger
imager looking forward to allow the aircraft to look targets such as the landing strip, lakeshore, and a
further ahead. Navigation by ground features in wider aqueduct were undertaken at a 1OOO' altitude,
clear weather was demonstrated with the PMC producing a slant range of one mile and 23'
looking only 10" below horizon. The flights resolution. All targets were easily identified and
collected both horizontal and vertical polarization followed. Further navigation capabilities were
data, but at these grazing angles, horizontal demonstrated in 10 minute data runs where the
helicopter navigated between Quail Lake and

2.B.1-6

Authorized licensed use limited to: UNIVERSITY OF BIRMINGHAM. Downloaded on December 15,2022 at 08:25:46 UTC from IEEE Xplore. Restrictions apply.
Figure 3. Dirt and gravel run way (horizontal polarization).
Trapezoid in visible image indicates system field-of-view.

Pyramid Lake by following an aqueduct and Military Targets


Interstate 5. The helicopter mounted PMC made a number
of passes over the Marine Corps Supply Center at
Aircrafi Landing Yermo, CA, to image military vehicles. Various
The helicopter mounted PMC was used to trucks, multi-wheeled vehicles, engineering
simulate landings on unimproved runways in a vehicles, and some M1 Abrams tanks were located
series of approaches and fly-overs of Mountain in fenced yards at the supply center. The helicopter
Valley Airport in Tehachapi. This 4900 long, 50 flew at altitudes of 500 and 1000 at a speed of 50
wide runway has two asphalt sections and a dirt and knots with the PMC in the 40" look down
gravel section framed by dirt, grass, and scrub configuration collecting horizontally polarized
vegetation. The helicopter took several low speed radiation. The vehicles were easily discriminated at
runs over the runway at an altitude of 200 with the this range and individual targets were
PMC looking 10" down from the horizon at an distinguishable even when the vehicles were packed
1100 slant range. Data was gathered in both closely together. The targets were not classifiable,
polarizations. (Figure 3). though, other than by general size. For instance, the
barrels on the tank targets were not distinguishable
Both the asphalt and dirt sections of the and truck cabs were not distinguished from their
runway were visible when viewed in the horizontal trailers.
polarization, with the asphalt appearing colder than
the dirt, and both sections appearing colder than the
surrounding terrain. The dirt section was difficult Wire Detection
to see in the vertical polarization, although the The PMC demonstratedthe ability to detect
asphalt section was visible. In order to improve the power lines at close range despite the sub-pixel
contrast of the runway, various enhancements were nature of the wires. For safety reasons, the
added for some data runs. In one case, a series of helicopter was not flown at the power lines.
18" x 24" metal targets angled at 45" lined both Instead, the helicopter was flown above and along
sides of the runway at separations of 200 ft. These the power lines at an altitude of 500 with the PMC
targets were visible at the 1100' range, and provided in the 40" look down configuration. The range to
some added contrast. A W-band source was also the power lines was approximately 600', assuming
employed in some runs as an active beacon at the the power lines ran loo' above the ground. The
end of the runway, which was easily seen by the power lines imaged were groups of three high 1

PMC. voltage power lines estimated at 1" diameter each.

2.B.1-7

Authorized licensed use limited to: UNIVERSITY OF BIRMINGHAM. Downloaded on December 15,2022 at 08:25:46 UTC from IEEE Xplore. Restrictions apply.
Figure 4. Group of three power lines imaged at 600fl. range.

Three of these groups were strung between Conclusions


large metal towers. The three arcs of the wire Trex Enterprises has demonstrated a passive
groups are seen in contrast to the desert floor in the millimeter-wave imaging system capable of real-
millimeter-wave imagery. (Figure 4). time imagery. The pupil-plane system architecture
Although the wires are considerably smaller allows the system to be easily fitted to and flown on
than the PMC's pixel size at this range, radiometers airborne platforms.. Helicopter flights have shown
the system to be useful for navigation in low-
have shown the ability to detect sub-pixel targets if
the temperature contrast is high enough. The visibility conditions. The system is also capable of
imaging runways, ground terrain, military vehicles,
system resolution is only 30" at a range of 600', and
the wires can be assumed to fill about 3" of that and some sub-pixel targets such as power lines.
beam in one dimension and the entire beam in the
other dimension. In this case, the wires would have Acknowledgements
about 10% of the contrast expected of a metal target
The Passive Millimeter-Wave Camera was
filling the entire beam. With a typical contrast of
developed under contracts DAAL02-92-C-0057 and
200 K between metal and the desert floor, the wires
DAALO1-94-C-0100 with Army Research
might have a contrast of about 20 K, which is better
Laboratory, Sensors and Electronic Devices
than the PMC temperature sensitivity of 6 to 8 K.
Directorate. Army Research Laboratory also
When the helicopter altitude was increased to 1000,
sponsored much of the flight-testing described
and the range to the wires was increased to 1400',
above.
the wires disappeared into the system noise.

2.B.1-8

Authorized licensed use limited to: UNIVERSITY OF BIRMINGHAM. Downloaded on December 15,2022 at 08:25:46 UTC from IEEE Xplore. Restrictions apply.

You might also like