You are on page 1of 4

MICROFABRICATED FLIPPING GLASS DISC FOR

STEREO IMAGING IN ENDOSCOPIC VISUAL INSPECTION


Wook Choi1, Minoo Akbarian2, Vladimir Rubtsov2 and Chang-Jin “CJ” Kim1
1
Mechanical and Aerospace Engineering Department, University of California, Los Angeles (UCLA)
2
Intelligent Optical Systems, Inc. (IOS), Torrance, CA, U.S.A.

ABSTRACT
In many fields, including medical and manufacturing, (a) (b) (c)
endoscopy is a powerful tool for remote visual inspection.
However, images obtained by an endoscope are mostly
planar and provide no accurate size or distance information
about the object of interest. Use of stereo images to solve
these problems greatly increases the performance of such
inspection tools due to its three dimensional measurability.
In this study, a method to obtain stereo images using a
single “flipping” glass disc device for endoscopic
applications, and its realization into a miniaturized device
are presented. Figure 2: Demonstration of how to measure the distance
from image shift. A 14 cm-long pen and a 4.5 cm-long
1. INTRODUCTION AAA battery are seen through a 2.5 cm-thick Plexiglas®
Endoscopy is a powerful tool for remote visual plate. (a) When the plate is still. (b) When the plate tilts
inspection in difficult-to-access areas and widely used in forward, and (c) when the plate tilts backward. As the
industrial and medical fields. It is mainly used for transparent plate tilts, the image of the closer object
non-destructive inspection of machinery or minimally shifts more.
invasive diagnosis on body organs. However, most of such
endoscopes, e.g., endoscopic crack inspection tools for
clockwise, the image of an object shifts up or down,
quality assurance in industry, are able to obtain only planar
respectively, due to the refraction of light when passing
images, with which size and distance information of
through the tilted plate. The amount of the image shift is
objects of interest cannot be read easily. To overcome such
determined by the index of refraction, tilting angle and
limitations and improve the overall optical inspection
thickness of the transparent plate, and can be calculated by
performances of the endoscopic tools, stereo imaging
methods using single lens [1]-[4] and multiple lens systems
[5]-[7] have been introduced with more accurate evaluation ⎛ ⎞
⎜ ⎟
capabilities. Such stereo images are used for precise ⎜ 1 − sin 2 θ ⎟
measurement and three dimensional reconstruction of the ΔL = t sin θ ⎜1 − 2
⎟ (1)
object of interest using various triangulation techniques, ⎜ ⎛ n2 ⎞ ⎟
which is never possible with the planar images. ⎜⎜ ⎜⎜ ⎟⎟ − sin θ ⎟2

⎝ n1 ⎠ ⎟
In this study, a stereo imaging method using a single ⎝ ⎠
electrostatically “flipping” transparent plate is introduced
for endoscopic applications. Design, fabrication, and where t is the thickness of the tilting plate, θ is the tilting
operation of the microdevice that implements the imaging angle, and n1 and n2 are refractive indexes of surrounding
method are reported. media and the tilting plate material, respectively.
Figure 2 demonstrates how the distance between the
2. PRINCIPLE object and the observer can be evaluated from image shift
The proposed stereo image generation utilizes by plate tilting. A 14 cm-long pen and a 4.5 cm-long AAA
refraction of light when the light passes through two battery at different distances are seen through a 2.5
different media, explained by Snell’s law. Figure 1 cm-thick Plexiglas® plate. Although smaller, the battery
illustrates the stereo image generation by a single appears the same in size as the pen because it is closer to
transparent flipping plate without using multiple lenses, as the observer, illustrating that size and distance cannot be
in [3]. As the transparent plate tilts counterclockwise or read from the planar image. Conventional endoscopic
devices using a single camera setup can only generate
planar images in which operators sometimes cannot
evaluate the right size or distance of the object of interest.
When the plate tilts forward (Figure 2b) and backward
(Figure 2c), the images of the objects shift up and down,
respectively, as a result. What can be used at this point to
evaluate the distance information is the fact that each
object image shows a different shifting amount with
Figure 1: Image shift achieved by plate tilting. Due to
respect to the distances. When the plate tilts, an object
the refraction of light, the image of an object shifts up or
closer to the observer generates a larger image shift than an
down by tilting the transparent plate.
object further away due to the difference in distance; the

978-1-4244-2978-3/09/$25.00 ©2009 IEEE 160


battery closer to the observer shifts more than the pen in the
back. By using this difference in image shift, the distance ®
Silicon Oxide Pyrex
and size of each object can be evaluated, once the image
shift at a certain working distance is calibrated. (a)

3. DESIGN AND FABRICATION


(b)

Flipping
®
Pyrex disc
(c)

Figure 3: Schematic of the flipping disc device. (Left) (d)


Perspective view. (Right) Cut-out view showing the glass
disc in the middle and the ring frame.

Device design (e)


Figure 3 is a schematic drawing of the microfabricated
flipping disc device (not to scale). A 420 µm-thick
transparent disc 1300 µm in diameter is attached to a 40
µm-thick silicon layer with a 1000 µm-diameter opening in (f)
the center to expose the glass, and suspended by two 10 ×
40 × 800 µm torsion bridges. The disc is electrostatically
actuated (i.e., flipped) by two interdigitated sets of silicon (g)
comb drives. While photosensitive polymers (e.g., SU-8)
are widely used to make lenses in optical MEMS field
[8]-[10], Pyrex® is chosen as the transparent disc material
due to its much higher resistance to degradation over time (h)
and discoloration during high temperature fabrication
processes than the photosensitive polymers. To achieve
the required shapes of the transparent disc and the (i)
surrounding structures without using expensive and time
consuming glass machining methods, glass molding [11] is
used at an elevated temperature (> 800ºC), reflowing Ring frame Flipping disc Ring frame
Pyrex® into a patterned silicon mold.
Figure 4: Process flow for tilting glass plate device; (a)
Fabrication process SOI wafer as starting material, (b) device layer etch and
The process flow for the flipping disc device is shown exposed oxide removal, (c) anodic bonding of Pyrex®
in Figure 4. A silicon-on-insulator (SOI) wafer with wafer to patterned SOI wafer, (d) glass molding into the
heavily doped device layer is used as the starting material Si mold followed by 2nd anodic bonding, (e) glass
(Figure 4a). The wafer has 100 µm-thick device layer, 1 removal and polishing by CMP, (f) topside Si layer
µm-thick buried oxide, and 500 µm-thick handling layer. thinning by DRIE, (g) oxide deposition on top and
The handling layer of the wafer with polished surface is patterning, (h) backside Si removal, and (i) comb
patterned and etched down to the oxide layer using deep patterning by DRIE, releasing the device at the same
reactive ion etching (DRIE) to make a mold for glass filling, time, followed by oxide mask removal
and the exposed oxide is removed (Figure 4b). The
patterned SOI wafer is anodically bonded with a Pyrex® transparency of the glass structures. The device layer is
wafer in vacuum (Figure 4c). then thinned down to 40 µm using DRIE (Figure 4f)
The bonded wafers are thermally annealed at 850°C followed by oxide masking layer deposition and patterning
(above the glass transition temperature of the Pyrex®) so on the thinned Si surface (Figure 4g). After the Si mold in
that the Pyrex® flows to fill in the Si mold (Figure 4d) [11], the handling layer is removed (Figure 4h), the device layer
followed by additional anodic bonding to ensure the strong is patterned using DRIE to form comb drive structures and
bond between the filled Pyrex® and the Si device layer. torsion springs, releasing the device at the same time. The
Because of the vacuum state inside the cavities, the Si mold fabrication is completed by removing the oxide mask on
is filled by melted Pyrex® using the atmospheric process the device layer (Figure 4i).
pressure in the heating chamber without any external force Figure 5 shows the fabricated flipping disc device,
applied during the molding process. Unfilled Pyrex® is showing the 1.3 mm-diameter Pyrex® disc suspended by
then removed by chemical mechanical polishing (CMP) two torsion springs. Instead of using additional metal
revealing the Si / Pyrex® surface (Figure 4e). The surface wires, the patterned silicon device layer of the SOI wafer is
is additionally polished for smoothness to ensure used as electrodes for device operations.

161
Flipping disc
Comb drive actuator
Flipping disc
suspended by two
torsion springs
Silicon electrodes
attached to outer
glass ring frame

Time period
Figure 5: Fabricated flipping disc device.
Figure 6: Cross section of the flipping disc (Top), and the
corresponding driving signal (Bottom). A rectangular
wave signal with a duty cycle of 50% at twice the flipping
4. DEVICE TEST AND RESULT disc’s mechanical resonant frequency is applied to both
The suspended Pyrex® disc is driven by two sets of comb drives.
interdigitated comb drives at resonant frequency. The
actuation is similar to [12]-[14] and occurs through
fringe-field electrostatic attraction vertical to the silicon
layer. A rectangular pulse with a duty cycle of 50% at
twice the mechanical resonant frequency of the flipping
disc is used for the tilting. Figure 6 shows the cross section
of the flipping disc and the corresponding driving signal.
Initial excitation for device operation is achieved either by
having asymmetric disc shape for small initial deflection
[13] or by utilizing fabrication induced asymmetry [12].
Figure 7 is the experimental result using the fabricated disc
device with 20 V applied to the comb drives in an open lab
environment (1 atm). Driving signal is swept up and down
by increments of 1 Hz to find the optimum driving
frequencies. The maximum tilting is observed when the
signal frequency is swept down to 994 Hz with 7º of total
tilting, which is equivalent to the disc’s mechanical
resonant frequency of 497 Hz. With the disc thickness of
420 µm, the image shift with 7º tilting is measured to be
16.2 µm by image analysis. Figure 7: Dynamic characterization of the flipping disc
A schematic of the experiment setup for stereo image by frequency sweeping using 20 VAC of rectangular
generation is shown in Figure 8. The fabricated Pyrex® waveform with 50% duty cycle. A total tilting angle of 7°
disc device flips back and forth by electrostatic actuation, has been obtained at 994 Hz in 1 atm air.
and the resulting shift of the images are observed through
the disc by a camera connected to a microscope and
illuminating lights. The camera records image shifts at 300 Microscope
frames per second to obtain overlapped images showing
the image shifting distance. Figure 9 is the computer
screen image of a cross-shaped pattern captured by the Disc flipping
camera. The pattern is 180 µm (wide) × 180 µm (high) in
size, and 3 mm in front of the flipping disc. From the
grabbed image, the shifting distance can be read on the
screen (as in Figure 9) and defined as “D”. The relative
distance D on the screen represents the already measured Shift of image
real image shifting distance of 16.2 µm. That is, the
distance D on the screen can be used as a reference for
objects at 3 mm distance. If the same disc and test setup is
used, various distances of different objects can be
estimated by comparing the relative distance on the screen Figure 8: Schematic of image shift experiment using the
with the distance D. If an observed image shift on the flipping disc.
screen is larger or smaller than this value D, it means that
the object lies closer or farther to the flipping disc than the the object size can be calculated by comparing the size of
reference distance of 3 mm. In this way, size information the objects on the screen with D. For example, the height
can also be obtained without knowing the real size of of the cross pattern on the screen (as in Figure 9) is
viewed objects. Because the distance D on the screen is approximately 11 times D, which means that the height of
already known to be 16.2 µm in real dimensions, the cross pattern is in fact 180 µm.
162
[2] C. Gao and N. Ahuja, “Single camera stereo using
planar parallel plate,” Proc. Int. Conf. Pattern
Recognition, vol. 4, pp. 108-111, 2004.
[3] Y. Nishimoto and Y. Shirai, “A feature-based stereo
model using small disparities,” Proc. Computer
Vision and Pattern Recognition, pp. 192-196, 1987.
[4] A. Goshtasby and W. A. Gruver, “Design of a
single-lens stereo camera system,” Pattern
Recognition, vol. 26, pp. 923–937, 1993.
[5] Example of stereo inspection systems found and
accessed on 10 Oct 2008 at http://rvi.olympus-global
.com/en/special/iplexfx.
[6] A. F. Durrani and G. M. Preminger,
Figure 9: Image shift captured through the flipping disc. "Three-dimensional video imaging for endoscopic
A 180 µm (wide) × 180 µm (high) cross pattern at 3 mm surgery," Comput. Biol. Med., vol. 25, pp. 237-247,
distance makes a vertical image shift of “D” on the 1995.
screen which is equivalent to 16.2 µm of measured image [7] H. Becker, A. Melzer, M. O. Schurr, and G. Buess,
shift. The size of the cross pattern on the screen is about "3-D video techniques in endoscopic surgery,"
Endosc. Surg. Allied Technol., vol. 1, pp. 40-46,
11דD”, equivalent to 180 µm of real pattern height.
1993.
[8] S. Moon, N. Lee, and S. Kang, “Fabrication of
microlens array using micro-compression molding
5. CONCLUSION
with electroformed mold insert,” J. Micromech.
Use of stereo images greatly increases the
Microeng., vol. 13, pp. 98–103, 2003
performance of endoscopic devices by its
[9] A. Tuantranont, V. M. Bright, J. Zhang, W. Zhang, J.
three-dimensional measurement capabilities. This paper
A. Neff, and Y. C. Lee, “Optical beam steering using
presented a stereo imaging method using a single
MEMS-controllable microlens array,” Sensors and
transparent flipping disc miniaturized and operated by
Actuators A, vol. 91, pp. 363-372, 2001.
MEMS technologies. The developed transparent flipping
[10] R. Yang and W. Wang, “Out-of-plane polymer
disc device has confirmed the feasibility of being used in
refractive microlens fabricated based direct
front of single-lens endoscopic devices to generate such
lithography of SU-8,” Sensors and Actuators A, vol.
stereo images for non-contact dimensional measurements
113, pp. 71–77, 2004.
in difficult-to-access areas, minimizing the complexity of
[11] P. Merz, H. J. Quenzer, H. Bernt, B. Wagner, and M.
the overall device setup.
Zoberbier, “A novel micromachining technology for
structuring borosilicate glass substrates,”
6. ACKNOWLEDGEMENT Transducers, vol. 1, pp. 258–261, 2003.
The authors would like to thank Dr. Igor Ternovskiy at [12] H. Schenk, P. Durr, T. Haase, D. Kunze, U. Sobe, H.
Intelligent Optical Systems (IOS) for his help measuring Lakner, and H. Kuck, “Large deflection
and confirming the image shift using his image analysis micromechanical scanning mirrors for linear scans
software. The work was partially supported by the and pattern generation,” J. Select. Topics Quantum
National Science Foundation (NSF) Small Business Electron., vol. 6, pp. 715–722, 2000.
Innovative Research (SBIR) program. [13] K. N. Lee, Y. H. Jang, H. Kim, Y. S. Lee, and Y. K.
Kim, “Monolithic fabrication of optical benches and
7. REFERENCES scanning mirror using silicon micromachining,” J.
[1] W. Teoh and X. D. Zhang, “An inexpensive Micromech. Microeng., vol. 15, pp. 747–755, 2005.
stereoscopic vision system for robots,” Proc. Int. [14] C. Lee, "Design and fabrication of epitaxial silicon
Conf. Robotics and Automation, vol. 1, pp. 186-189, micromirror devices," Sensors and Actuators A, vol.
1984. 115, pp. 581–90, 2004.

163

You might also like