Professional Documents
Culture Documents
ABSTRACT
In many fields, including medical and manufacturing, (a) (b) (c)
endoscopy is a powerful tool for remote visual inspection.
However, images obtained by an endoscope are mostly
planar and provide no accurate size or distance information
about the object of interest. Use of stereo images to solve
these problems greatly increases the performance of such
inspection tools due to its three dimensional measurability.
In this study, a method to obtain stereo images using a
single “flipping” glass disc device for endoscopic
applications, and its realization into a miniaturized device
are presented. Figure 2: Demonstration of how to measure the distance
from image shift. A 14 cm-long pen and a 4.5 cm-long
1. INTRODUCTION AAA battery are seen through a 2.5 cm-thick Plexiglas®
Endoscopy is a powerful tool for remote visual plate. (a) When the plate is still. (b) When the plate tilts
inspection in difficult-to-access areas and widely used in forward, and (c) when the plate tilts backward. As the
industrial and medical fields. It is mainly used for transparent plate tilts, the image of the closer object
non-destructive inspection of machinery or minimally shifts more.
invasive diagnosis on body organs. However, most of such
endoscopes, e.g., endoscopic crack inspection tools for
clockwise, the image of an object shifts up or down,
quality assurance in industry, are able to obtain only planar
respectively, due to the refraction of light when passing
images, with which size and distance information of
through the tilted plate. The amount of the image shift is
objects of interest cannot be read easily. To overcome such
determined by the index of refraction, tilting angle and
limitations and improve the overall optical inspection
thickness of the transparent plate, and can be calculated by
performances of the endoscopic tools, stereo imaging
methods using single lens [1]-[4] and multiple lens systems
[5]-[7] have been introduced with more accurate evaluation ⎛ ⎞
⎜ ⎟
capabilities. Such stereo images are used for precise ⎜ 1 − sin 2 θ ⎟
measurement and three dimensional reconstruction of the ΔL = t sin θ ⎜1 − 2
⎟ (1)
object of interest using various triangulation techniques, ⎜ ⎛ n2 ⎞ ⎟
which is never possible with the planar images. ⎜⎜ ⎜⎜ ⎟⎟ − sin θ ⎟2
⎝ n1 ⎠ ⎟
In this study, a stereo imaging method using a single ⎝ ⎠
electrostatically “flipping” transparent plate is introduced
for endoscopic applications. Design, fabrication, and where t is the thickness of the tilting plate, θ is the tilting
operation of the microdevice that implements the imaging angle, and n1 and n2 are refractive indexes of surrounding
method are reported. media and the tilting plate material, respectively.
Figure 2 demonstrates how the distance between the
2. PRINCIPLE object and the observer can be evaluated from image shift
The proposed stereo image generation utilizes by plate tilting. A 14 cm-long pen and a 4.5 cm-long AAA
refraction of light when the light passes through two battery at different distances are seen through a 2.5
different media, explained by Snell’s law. Figure 1 cm-thick Plexiglas® plate. Although smaller, the battery
illustrates the stereo image generation by a single appears the same in size as the pen because it is closer to
transparent flipping plate without using multiple lenses, as the observer, illustrating that size and distance cannot be
in [3]. As the transparent plate tilts counterclockwise or read from the planar image. Conventional endoscopic
devices using a single camera setup can only generate
planar images in which operators sometimes cannot
evaluate the right size or distance of the object of interest.
When the plate tilts forward (Figure 2b) and backward
(Figure 2c), the images of the objects shift up and down,
respectively, as a result. What can be used at this point to
evaluate the distance information is the fact that each
object image shows a different shifting amount with
Figure 1: Image shift achieved by plate tilting. Due to
respect to the distances. When the plate tilts, an object
the refraction of light, the image of an object shifts up or
closer to the observer generates a larger image shift than an
down by tilting the transparent plate.
object further away due to the difference in distance; the
Flipping
®
Pyrex disc
(c)
161
Flipping disc
Comb drive actuator
Flipping disc
suspended by two
torsion springs
Silicon electrodes
attached to outer
glass ring frame
Time period
Figure 5: Fabricated flipping disc device.
Figure 6: Cross section of the flipping disc (Top), and the
corresponding driving signal (Bottom). A rectangular
wave signal with a duty cycle of 50% at twice the flipping
4. DEVICE TEST AND RESULT disc’s mechanical resonant frequency is applied to both
The suspended Pyrex® disc is driven by two sets of comb drives.
interdigitated comb drives at resonant frequency. The
actuation is similar to [12]-[14] and occurs through
fringe-field electrostatic attraction vertical to the silicon
layer. A rectangular pulse with a duty cycle of 50% at
twice the mechanical resonant frequency of the flipping
disc is used for the tilting. Figure 6 shows the cross section
of the flipping disc and the corresponding driving signal.
Initial excitation for device operation is achieved either by
having asymmetric disc shape for small initial deflection
[13] or by utilizing fabrication induced asymmetry [12].
Figure 7 is the experimental result using the fabricated disc
device with 20 V applied to the comb drives in an open lab
environment (1 atm). Driving signal is swept up and down
by increments of 1 Hz to find the optimum driving
frequencies. The maximum tilting is observed when the
signal frequency is swept down to 994 Hz with 7º of total
tilting, which is equivalent to the disc’s mechanical
resonant frequency of 497 Hz. With the disc thickness of
420 µm, the image shift with 7º tilting is measured to be
16.2 µm by image analysis. Figure 7: Dynamic characterization of the flipping disc
A schematic of the experiment setup for stereo image by frequency sweeping using 20 VAC of rectangular
generation is shown in Figure 8. The fabricated Pyrex® waveform with 50% duty cycle. A total tilting angle of 7°
disc device flips back and forth by electrostatic actuation, has been obtained at 994 Hz in 1 atm air.
and the resulting shift of the images are observed through
the disc by a camera connected to a microscope and
illuminating lights. The camera records image shifts at 300 Microscope
frames per second to obtain overlapped images showing
the image shifting distance. Figure 9 is the computer
screen image of a cross-shaped pattern captured by the Disc flipping
camera. The pattern is 180 µm (wide) × 180 µm (high) in
size, and 3 mm in front of the flipping disc. From the
grabbed image, the shifting distance can be read on the
screen (as in Figure 9) and defined as “D”. The relative
distance D on the screen represents the already measured Shift of image
real image shifting distance of 16.2 µm. That is, the
distance D on the screen can be used as a reference for
objects at 3 mm distance. If the same disc and test setup is
used, various distances of different objects can be
estimated by comparing the relative distance on the screen Figure 8: Schematic of image shift experiment using the
with the distance D. If an observed image shift on the flipping disc.
screen is larger or smaller than this value D, it means that
the object lies closer or farther to the flipping disc than the the object size can be calculated by comparing the size of
reference distance of 3 mm. In this way, size information the objects on the screen with D. For example, the height
can also be obtained without knowing the real size of of the cross pattern on the screen (as in Figure 9) is
viewed objects. Because the distance D on the screen is approximately 11 times D, which means that the height of
already known to be 16.2 µm in real dimensions, the cross pattern is in fact 180 µm.
162
[2] C. Gao and N. Ahuja, “Single camera stereo using
planar parallel plate,” Proc. Int. Conf. Pattern
Recognition, vol. 4, pp. 108-111, 2004.
[3] Y. Nishimoto and Y. Shirai, “A feature-based stereo
model using small disparities,” Proc. Computer
Vision and Pattern Recognition, pp. 192-196, 1987.
[4] A. Goshtasby and W. A. Gruver, “Design of a
single-lens stereo camera system,” Pattern
Recognition, vol. 26, pp. 923–937, 1993.
[5] Example of stereo inspection systems found and
accessed on 10 Oct 2008 at http://rvi.olympus-global
.com/en/special/iplexfx.
[6] A. F. Durrani and G. M. Preminger,
Figure 9: Image shift captured through the flipping disc. "Three-dimensional video imaging for endoscopic
A 180 µm (wide) × 180 µm (high) cross pattern at 3 mm surgery," Comput. Biol. Med., vol. 25, pp. 237-247,
distance makes a vertical image shift of “D” on the 1995.
screen which is equivalent to 16.2 µm of measured image [7] H. Becker, A. Melzer, M. O. Schurr, and G. Buess,
shift. The size of the cross pattern on the screen is about "3-D video techniques in endoscopic surgery,"
Endosc. Surg. Allied Technol., vol. 1, pp. 40-46,
11דD”, equivalent to 180 µm of real pattern height.
1993.
[8] S. Moon, N. Lee, and S. Kang, “Fabrication of
microlens array using micro-compression molding
5. CONCLUSION
with electroformed mold insert,” J. Micromech.
Use of stereo images greatly increases the
Microeng., vol. 13, pp. 98–103, 2003
performance of endoscopic devices by its
[9] A. Tuantranont, V. M. Bright, J. Zhang, W. Zhang, J.
three-dimensional measurement capabilities. This paper
A. Neff, and Y. C. Lee, “Optical beam steering using
presented a stereo imaging method using a single
MEMS-controllable microlens array,” Sensors and
transparent flipping disc miniaturized and operated by
Actuators A, vol. 91, pp. 363-372, 2001.
MEMS technologies. The developed transparent flipping
[10] R. Yang and W. Wang, “Out-of-plane polymer
disc device has confirmed the feasibility of being used in
refractive microlens fabricated based direct
front of single-lens endoscopic devices to generate such
lithography of SU-8,” Sensors and Actuators A, vol.
stereo images for non-contact dimensional measurements
113, pp. 71–77, 2004.
in difficult-to-access areas, minimizing the complexity of
[11] P. Merz, H. J. Quenzer, H. Bernt, B. Wagner, and M.
the overall device setup.
Zoberbier, “A novel micromachining technology for
structuring borosilicate glass substrates,”
6. ACKNOWLEDGEMENT Transducers, vol. 1, pp. 258–261, 2003.
The authors would like to thank Dr. Igor Ternovskiy at [12] H. Schenk, P. Durr, T. Haase, D. Kunze, U. Sobe, H.
Intelligent Optical Systems (IOS) for his help measuring Lakner, and H. Kuck, “Large deflection
and confirming the image shift using his image analysis micromechanical scanning mirrors for linear scans
software. The work was partially supported by the and pattern generation,” J. Select. Topics Quantum
National Science Foundation (NSF) Small Business Electron., vol. 6, pp. 715–722, 2000.
Innovative Research (SBIR) program. [13] K. N. Lee, Y. H. Jang, H. Kim, Y. S. Lee, and Y. K.
Kim, “Monolithic fabrication of optical benches and
7. REFERENCES scanning mirror using silicon micromachining,” J.
[1] W. Teoh and X. D. Zhang, “An inexpensive Micromech. Microeng., vol. 15, pp. 747–755, 2005.
stereoscopic vision system for robots,” Proc. Int. [14] C. Lee, "Design and fabrication of epitaxial silicon
Conf. Robotics and Automation, vol. 1, pp. 186-189, micromirror devices," Sensors and Actuators A, vol.
1984. 115, pp. 581–90, 2004.
163