See discussions, stats, and author profiles for this publication at: https://www.researchgate.

net/publication/315701832

Classifying different types of augmented reality technology

Article  in  Annual Review of CyberTherapy and Telemedicine · January 2016

CITATIONS READS
6 7,819

3 authors:

Amanda Edwards-Stewart Tim Hoyt

PHCoE Defense Health Agency
38 PUBLICATIONS   240 CITATIONS    62 PUBLICATIONS   700 CITATIONS   

SEE PROFILE SEE PROFILE

Greg Reger
VA Puget Sound Health Care System, Seattle, Washington
85 PUBLICATIONS   2,312 CITATIONS   

SEE PROFILE

Some of the authors of this publication are also working on these related projects:

FMBB100100810: Prototype Generic Behavior Change Coach Application for Weight Loss, Smoking Cessation, and Medication Management Using Transtheoretical Change
Model. View project

All content following this page was uploaded by Amanda Edwards-Stewart on 13 December 2017.

The user has requested enhancement of the downloaded file.

 Classifying Different Types of Augmented
Reality Technology
Amanda EDWARDS-STEWART a,1, Tim HOYT a, and Greg M. REGER b
a
National Center for Telehealth & Technology, U.S. Defense Health Agency
b
Veterans Health Administration, Puget Sound Health Care System

Abstract. Augmented reality (AR) is defined as “…a live direct or an indirect

view of a physical, real-world environment whose elements are augmented by
computer-generated sensory input…” [1]. AR is often considered a type of virtual
reality (VR), but could also be considered two distinct technologies and be
classified separately. Furthermore, applications referred to as AR can be distinct
from one another and it is useful to define different categories and types. This
paper identifies Triggered AR technologies, which include four types: Marker-
based, Location-based, Dynamic Augmentation, and Complex Augmentation.
View-based AR is also discussed, which includes Indirect Augmentation and Non-
specific Digital Augmentation. Examples and characteristics of each type are
identified. Lastly, this paper summarizes research using different types of AR in
behavioral healthcare and discusses future applications.

Keywords. Augmented reality, virtual reality, innovative technology, behavioral

health

1. Introduction

AR technology input can be audio or visual. AR enhances perception of the user’s

world. Though AR is often considered a type of virtual reality, it is a technology with
unique characteristics and a different purpose. Virtual Reality typically replaces the real
world with a simulated one, immersing users in a reproduced or alternative reality.
Augmented reality enhances the current environment, creating a mixed reality instead
of replacing that reality. Previous typologies of AR have tended to focus on technical
aspects of the approaches [2]. However, applications of AR to behavioral health may
also be assisted by classifications based on functional characteristics of various
applications. Such classifications can help researchers consider appropriate problem
areas that may fit with certain AR types.
AR has six different types that fall under two overarching categories. These
include triggered versus view-based augmentation. Triggers are stimuli or
characteristics that initiate or “trigger” the augmentation. Triggers can be paper or
object markers, GPS location, dynamic augmentations of objects, as well as a
combination of dynamic object recognition with GPS location that is classified as a
Complex Augmentation. Other forms of AR are view-based, which includes either

1
Corresponding author, National Center for Telehealth and Technology, 9933 West Hayes Street, Box
339500 MS 34, Joint Base Lewis-McChord, WA 98433-9500; E-mail: amanda.e.stewart7.civ@mail.mil
digitized augmentations without reference to what is in view or augmentation of a
stored/static view. See Table 1 for a concise summary of the AR types.

2. Triggered augmented reality technologies

Among triggered AR technologies, four types exist. First, Marker-based AR requires a

marker to activate an augmentation. Such markers can be paper-based or physical
objects that exist in the real world. Augmentations related to the marker enhance the
image or object, though some are only a means to access digital content. For example,
the app Aurasma’s augments the appearance of a real-world $20 bill, which morphs
into an entertaining, patriotic animation. This example takes an object-marker and
providers a meaningful augmentation of the trigger stimulus.
Location is another form of trigger. Location-based AR uses the device’s GPS
location as a trigger to pair dynamic location with points of interest in order to provide
relevant data or information (e.g., restaurants in Yelp’s monocle view).
A third type of triggered AR is Dynamic Augmentation, which is responsive to the
view of the object as it changes. Dynamic Augmentation with motion tracking can also
scale the augmentation to fit the identified object. For example, Swivel is a shopping
application that allows users to try on clothing and accessories digitally.
Finally, Complex Augmentation pair a real, dynamic view of the world with digital
information typically accessed via the Internet. It is a combination of Marker/Location-
based AR and Dynamic Augmentation. This can be seen in the original concept for
Google Glass, wherein users see information about local sites based on their GPS
location. Objects in the user’s field of vision are presented with helpful information
about their surroundings from an internet backend.

3. Indirect and non-specific digital augmentation

The second category of AR includes Indirect Augmentation and Non-Specific Digital

Augmentation. Indirect Augmentation intelligently augments a static view of the world.
This often involves augmenting images. An example of this category includes
applications that allow users to take a picture of a room and then change the wall color
of that room. The application identifies the wall from other objects and augments only
the wall. Non-Specific Digital Augmentation digitizes a dynamic view of the world
without reference to what is being viewed. This is common in mobile games. The user
interacts with the augmentation, such as tapping the augmentation when it comes into
view but without reference to the user’s environment.

4. Applications of augmented reality in behavioral health

The ability to digitally augment real world settings may have a range of applications to
support the psychological health of individuals. Available literature on the use of AR to
support psychological health is limited but concepts appear promising. Marker-based
AR has been used with small animal phobias [3,4], as well as in improving emotion
facial recognition with autism spectrum disorders [5]. Location-based AR has been
 paired with pleasant event scheduling [6] and Dynamic Augmentation was found
helpful with visually impaired older drivers [7].
Future AR applications include advances in Location-based AR with geo-fencing
and Dynamic Augmentation (e.g., HoloLens). Current pilot work using Location-based
AR with blue tooth sensor to help patients navigate large military hospitals is underway.
Dynamic Augmentations to support exposure therapy are also being explored.
AR is a popular technology with continual development. For example, a new tool
to assist blood draw, AccuVein, is considered AR. AccuVein provides a light that
contrasts veins from surrounding tissue to improve the accuracy of blood draws. This
form of AR does not clearly fit into the types identified above. As a result, the current
typology may need to be augmented to accommodate developing technologies.

Table 1. Summary of augmented reality categories and types.

Category Type Examples Characteristics
1a. Marker-based: String (string.co) Paper marker activates
Paper Blippar (blippar.com) stimuli.
1b. Marker-based: Aurasma (aurasma.com) Most objects can be made
Object into markers.
2. Location-based Yelp (yelp.com) Overlay of digital
PAJ (t2health.dcoe.mil/ information on a map or
positiveactivityjackpot) live camera view. GPS may
Instagram (instagram.com) activate stimuli.
Triggered
3. Dynamic Video Painter Meaningful, interactive
Augmentation (itunes.apple.com/us/app/video- augmentation with possible
painter/id581539953?mt=8) object recognition and/or
Swivel (Motion; facecake.com) motion tracking.
4. Complex Google Glass Augment dynamic view and
Augmentation (google.com/glass) pull internet information
based on location, markers,
or object recognition.
5. Indirect Wall Painter Image of the real world
Augmentation (itunes.apple.com/us/app/wall- augmented intelligently.
painter/id396799182?my=8)
View-Based
6. Non-specific Swat the Fly Augmentation of any
Digital Augmentation (inengy.com/swatthefly) camera view regardless of
Bubbles (virtualpopgames.com) location.

References

[1] What is Augmented Reality (AR)? In IGI-Global’s online dictionary. Retrieved from http://www.igi-
global.com/dictionary/augmented-reality-ar/1859, n.d.
[2] J. Normand, M. Serviéres, & G. Moreau. A new typology of augmented reality applications. AH’12
Proceedings of the 3rd Augmented Human International Conference 18 (2012).
[3] C. Botella, M.C. Juan, R.M. Baños, M. Alcañiz, V. Guillen, & B. Rey. Mixing realities? An application of
augmented reality for the treatment of cockroach phobia. Cyberpsychology & Behavior 8 (2005), 162-171.
[4] M.C. Juan, & D. Joele. A comparative study of the sense of presence and anxiety in an invisible marker
versus a marker augmented reality system for the treatment of phobia towards small animals.
International Journal of Human-Computer Studies 69 (2011), 440-453.
[5] C. Chen, I. Lee, & L. Lin. Augmented reality-based self-facial modeling to promote the emotional
expression and social skills of adolescents with autism spectrum disorders. Research in Developmental
Disabilities 36 (2015), 396-403.
[6] A. Edwards-Stewart. Using technology to enhance empirically supported psychological treatments: Positive
activity jackpot. Archives of Medical Psychology 3 (2012), 60-66.
[7] M.L. Rusch, M.C. Schall, J.D. Lee, J.D. Dawson, & M. Rizzo. Augmented reality cues to assist older drivers
with gap estimation for left-turns. Accident Analysis and Prevention 71 (2014), 210-221.

View publication stats