Professional Documents
Culture Documents
Tec Report AR
Tec Report AR
net/publication/277287908
CITATIONS READS
87 27,482
3 authors, including:
Some of the authors of this publication are also working on these related projects:
All content following this page was uploaded by Rodrigo L. S. Silva on 02 August 2017.
ABSTRACT
This paper presents an overview of basic aspects of Augmented Reality (AR) and the main
concepts of this technology. It describes the main fields in which AR is applied nowadays
and important AR devices. Some characteristics of Augmented Reality systems will be
discussed and this paper will provide an overview of them. Future directions are discussed.
1 INTRODUCTION
1
VR and telepresence. While in VR the envi- 2 AR Components
ronment is completely synthetic and in telep-
resence it is completely real, in AR the user 2.1 Scene Generator
sees the real world augmented with virtual
objects. The scene generator is the device or software
responsible for rendering the scene. Render-
ing is not currently one of the major problems
When designing an AR system, three aspects in AR, because a few virtual objects need to
must be in mind: (1) Combination of real and be drawn, and they often do not necessarily
virtual worlds; (2) Interactivity in real time; have to be realistically rendered in order to
(3) Registration in 3D. serve the purposes of the application [4].
2
3 AR Devices
3
This technology has many potential applica- worlds is much easier. There are a variety of
tions, from head-mounted displays (HMDs) solutions available including chroma-key and
for military/aerospace applications to medi- depth mapping. Mixed Reality Systems Lab
cal purposes. (MRSL) of Japan presented a stereo video
see-through HMD at ISAR 2000. This de-
The VRD projects a modulated beam of light vice addresses some of the parallax related
(from an electronic source) directly onto the to location of the cameras vs eyes.
retina of the eye producing a rasterized im-
age (Figure 6). The viewer has the illusion
of seeing the source image as if he/she stands
two feet away in front of a 14-inch monitor.
In reality, the image is on the retina of its eye
and not on a screen. The quality of the im-
age he/she sees is excellent with stereo view,
full color, wide field of view and no flickering
characteristics [13][24].
4
Figure 9: Monitor Based Scheme.
4.1 Medical
5
the images at this point will enhance the
performance of the surgical team and elim-
inate the need for the painful and cumber-
some stereotactic frames that are currently
used for registration [15].
6
4.3 Military Training real model in the augmented display that the
designers are using. Or perhaps in an ear-
The military has been using displays in cock- lier stage of the design, before a prototype
pits that present information to the pilot on is built, the view in each conference room is
the windshield of the cockpit or the visor of augmented with a computer generated image
the flight helmet (Figure 18). This is a form of the current design built from the CAD files
of augmented reality display. describing it [1] (Figure 19).
7
Figure 22: AR used to aid mechanical work.
harnesses [29].
4.7 Collaborative AR
Figure 21: Robotics using AR for re- AR addresses two major issues with collab-
mote medical operation. oration: seamless integration with existing
tools and practices, and enhancing practice
by supporting remote and co-located activi-
4.6 Manufacturing, Maintenance and ties that would otherwise be impossible.
Repair
Collaborative AR systems have been built us-
When the maintenance technician ap- ing projectors, hand-held and head-worn dis-
proaches a new or unfamiliar piece of plays. By using projectors to augment the
equipment instead of opening several repair surfaces in a collaborative environment, users
manuals they could put on an augmented are unencumbered, can see each others eyes,
reality display. In this display the image of and are guaranteed to see the same augmen-
the equipment would be augmented with tations [6].
annotations and information pertinent to the
repair. For example, the location of fasteners Examples of collaborative AR systems using
and attachment hardware that must be see-through displays include both those that
removed would be highlighted (Figure 22). use see-through handheld displays and see-
through head-worn displays [14] (Figure 24).
Boing made an experimental system, where
the technicians are guided by the augmented
display that shows the routing of the cables 5 Visualization Issues
on a generic frame used for all harnesses (Fig-
ure 23). The augmented display allows a sin- Researchers have begun to address problems
gle fixture to be used for making the multiple in displaying information in AR, caused by
8
through silhouettes is found in [18]. This en-
ables the insertion of virtual objects and dele-
tion of real objects without an explicit 3D re-
construction of the environment (Figure 25).
9
Ubiquitous tracking and system portabil- within a pregnant patient. Proceedings
ity: Several impressive AR demonstra- of IEEE Visualization, 17-21, 1993.
tions have generated compelling environ-
ments with nearly pixel-accurate registra- [3] R. Azuma. Tracking requirements for
tion. However, such demonstrations work augmented reality. Communications of
only inside restricted, carefully prepared en- the ACM, 36(7):50-51, 1993.
vironments. The ultimate goal is a tracking [4] R. Azuma. A survey of augmented real-
system that supports accurate registration in ity. ACM SIGGRAPH, 1-38, 1997.
any arbitrary unprepared environment, in-
doors or outdoors. Allowing AR systems to [5] M. Billinghurst, S. Baldis, E. Miller, and
go anywhere also requires portable and wear- S. Weghorst. Shared space: Collabora-
able systems that are comfortable and unob- tive information spaces. Proc. of HCI
trusive. International, 7-10, 1997.
Photorealistic and advanced rendering: Al- [8] D. Cobzas, K. Yerex, and M. Jager-
though many AR applications only need sim- sand. Editing real world scenes: Aug-
ple graphics such as wireframe outlines and mented reality with image-based render-
text labels, the ultimate goal is to render the ing. Proc. of IEEE Virtual Reality, 291-
virtual objects to be indistinguishable from 292, 2003.
the real ones. This must be done in real time,
[9] A. Van Dam, A. Forsberg, D. Laid-
without the manual intervention of artists
law, J. LaViola, and R. Simpson. Im-
or programmers. New techniques in image
mersive VR for scientific visualization:
based rendering must be considered in order
A progress report. IEEE Computer
to accomplish this task [7].
Graphics and Applications, 20(6): 26-
52, 2000.
AR in all senses: Researchers have fo-
cused primarily on augmenting the visual [10] P. du Pont. Building complex virtual
sense. Eventually, compelling AR environ- worlds without programming. EURO-
ments may require engaging other senses as GRAPHICS’95 State Of The Art Re-
well (touch, hearing, etc.). ports, 61–70, 1995.
10
View publication stats
[14] Z. Szalavri et. al. Studierstube: An envi- [23] Ryutarou Ohbuchi, David Chen, and
ronment for collaboration in augmented Henry Fuchs. Incremental volume re-
reality. Virtual Reality Systems, Devel- construction and rendering for 3D ul-
opment and Application, 3 (1): 37-48, trasound imaging. Visualization in
1998. Biomedical Computing, 1808: 312-323,
1992.
[15] W. Grimson, G. Ettinger, T. Kapur,
M. Leventon, W. Wells, and R. Kikinis. [24] H.L. Pryor, T.A. Furness, and E. Vi-
Utilizing segmented MRI data in image- irre. The virtual retinal display: A new
guided surgery. International Journal of display technology using scanned laser
Pattern Recognition and Artificial Intel- light. Proc. 42nd Human Factors Er-
ligence, 11(8):1367-97, 1998. gonomics Society, pp. 1149, 1998.
[16] Richard Lee Holloway. Registration er- [25] F. Sauer, A. Khamene, B. Bascle,
rors in augmented reality systems. Tech- L. Schimmang, F. Wenzel, and S. Vogt.
nical Report TR95-016, The University Augmented reality visualization of ultra-
of North Carolina, 1 1995. sound images: System description, cal-
ibration and features. IEEE and ACM
[17] W. S. Kim and P. Schenker. An ad- International Symposium on Augmented
vanced operator interface design with Reality, 30-39, 2001.
preview/predictive displays for ground-
controlled space telerobotic servicing. [26] T.B. Sheridan. Musing on telepres-
Proceedings of SPIE Vol. 2057: Telema- ence and virtual presence. Presence,
nipulator Technology and Space Teler- 1(1):120-125, 1992.
obotics, 96-107, 1993. [27] W. Sherman and A. Craig. Understand-
[18] V. Lepetit and M. Berger. Handling ing Virtual Reality: Interface, Applica-
occlusions in augmented reality sys- tions and Design. Morgan Kaufmann
tems: A semi-automatic method. Proc. Publishers, 2003.
Int.l Symp. Augmented Reality, 137-146, [28] R. Silva and G. Giraldi. Introduction
2000. to virtual reality. Technical Report:
06/2003, LNCC, Brazil, 2003.
[19] B. MacIntyre and E. Coelho. Adapt-
ing to dynamic registration errors using [29] D. Sims. New realities in aircraft de-
level of error (loe) filtering. Proc. Int.l sign and manufacture. IEEE Computer
Symp. Augmented Reality, 85-88, 2000. Graphics and Applications, 14 (2): 91,
1994.
[20] P. Milgram and F. Kishino. A taxon-
omy of mixed reality visual displays. IE- [30] J. Stauder. Augmented reality with au-
ICE Transactions on Information Sys- tomatic illumination control incorporat-
tems, E77-D (12): 1321-1329, 1994. ing ellipsoidal models. IEEE Trans.
Multimedia, 1 (2): 136-143, 1999.
[21] P. Milgram and S. Zhai. Applications
of augmented reality for human-robot [31] Z. Szalavri, E. Eckstein, and M. Ger-
communications. Proceedings of 1993 vautz. Collaborative gaming in aug-
IEEE/RSJ International Conference on mented reality. VRST, Taipei, Taiwan,
Intelligent Robots and Systems, 1467- 195–204, 1998.
1476, 1993.
[32] E. Urban. The information warrior.
[22] Y. Mukaigawa, S. Mihashi, and IEEE Spectrum, 32 (11): 66-70, 1995.
T. Shakunaga. Photometric image- [33] D. Weimer. Frontiers of Scientific Visu-
based rendering for virtual lighting alization, chapter 9, ”Brave New Virtual
image synthesis. Proc. 2nd Int.l Work- Worlds”., pages 245–278. John Wiley
shop Augmented Reality (IWAR ’99), and Sons, Inc., 1994.
115-124, 1999.
11