Augmented & Virtual Reality 2

Augmented &
Virtual Reality
AR/VR
Chapter 5
Augmented & Virtual Reality
Table of Contents
History of AR/VR 2
What is AR/VR/MR? 4
Augmented Reality (AR) 5
Virtual Reality (VR): 6
Mixed Reality (MR): 7
Comparison 1: AR vs. VR 8
Comparison 2: AR vs. MR 9
Statistics About AR/VR 10
Applications of AR/VR 11
Case Study: Human Body: 12
How Does VR Technology Work? 13
Hardware (VR Devices): 13
VR Software: 15
How Does AR/MR Technology Work? 16
AR Hardware: 17
AR Software: 18
Advantages of AR/VR 19
Disadvantages of AR/VR 21
Challenges of AR/VR 22
VR Dubai Park 24
Page 1
History of AR/VR
Page 2
Page 3
What is AR/VR/MR?
You can put any text here
Page 4
Augmented Reality (AR):

- It is a technology that layers computer-generated enhancements over an existing reality in
order to make it more meaningful through the ability to interact with it.
- It is the technology that expands our physical world by adding layers of digital information
onto it.
- AR overlay is executed immediately with the input received from a camera or another input
device like smart glasses. Hence, AR technology brings virtual objects into the surrounding
environment.
- AR combines real and computer-based spectacle and pictures to transfer a uni ed but
enhanced view of the world.
- AR encompasses computerized techniques and simulations like animation, text to speech
recognition and handheld devices or powered display environments to overlay virtual objects
over real-world environments. Examples: Snapchat lenses / The game Pokemon Go.
Page 5
Virtual Reality (VR):

It is de ned as: “A realistic and immersive simulation of a three-dimensional environment,
created using interactive software and hardware, and experienced or controlled by the
movement of the body”.
- It is an “immersive, interactive experience generated by a computer.”
- VR is the use of computer technology to create a simulated environment. Unlike traditional
user interfaces, it places the user inside an experience and instead of viewing a screen in front of
them, users are immersed with 3D worlds.
Page 6
Mixed Reality (MR):

- In MR environments, users seem to navigate through both real and virtual spaces at the same
time instead of residing in an entirely virtual world.
- Virtual objects are hooked into the user’s real world and augment their real environment,
making virtual interactions appearing to be real.
- MR brings the best of both worlds and attempts to combine Virtual and Augmented Reality.
- When both real and arti cial worlds are merged together, an entirely new environment and
visualization become possible wherein physical and digital objects co-exist and interact in real
time.
Example: Microsoft’s Hololens Microsoft brought disruption in the MR space with their
Hololens. Is a self-contained holographic computer that enables users to interact with digital
content around them. According to Microsoft, interacting with holograms in MR enables users
to visualize and work with their digital content as a part of their real world.
Page 7
Comparison 1: AR vs. VR
AR:
Adds to your eld of vision and only show up on your smartphone or tablet screen. Delivers
virtual elements as an overlay to the real world.
Use your phone's camera to watch a view of the real world in front of you, then put a layer of
information, including text and/or images, on top of that view.
VR:
O ers a digital recreation of a real-life setting.
Completely covers and replaces your eld of vision (completely virtual).
With VR you can move around and look in every direction -- up, down, sideways and behind
you, as if you were physically there.
What is the Di erence between AR & VR?
- AR uses a real-world setting while VR is completely virtual.
- AR users can control their presence in the real world; VR users are controlled by the system.
- AR apps can show up on and can be accessed with a smartphone or tablet while VR mostly
requires a headset device.
- AR enhances both the virtual and real world while VR only enhances a ctional reality.
Page 8
Comparison 2: AR vs. MR
In AR, like Google Glass, the visible real environment is overlaid with a layer of digital content.
Just displaying simple images.
- MR takes the best qualities of AR and VR to create an immersive interface that overlays upon
the user’s reality. MR can be mentioned as an enhanced form of AR.
- In MR, virtual objects are integrated into and responsive to the real world and can be
manipulated by the user. MR strives to put fully digital objects that are traceable and intractable
in the user’s environment. For instance, a virtual ball under your desk would be blocked from a
user’s view (invisible) unless he bends down to look at it.
- In MR users can actually v iew and manipulate things from di erent angles which is as
complex as an anatomy model. This type of rendering demands more processing power than AR.
High processing power is one main reason that MR applications and devices are still in the
proof-of-concept phase and far from consumer availability.
Page 9
Statistics About AR/VR
Sectors using AR/VR:
Video games sector is the highest, followed by Education & Healthcare sector.
Page 10
Applications of AR/VR
Medicine:
It can be used in medical studies to enable students to
know the human body structure. It can be used in
scienti c research laboratories so that scientist can
easily research on a speci c topic.
Training Applications:
It can be used in military training for the soldiers to get
familiar with di erent areas in the battle eld. It can be
used in driving schools as it give a real look of roads and
tra c.
Education:
Can be used as Apps for kids. Children can use an
iOS or Android device to scan the globe and view
animations and educational content such as
animals, monuments, and food.
Development Work (e.g., City Planning):

Urban planners could use AR to place bridges, view tra c
intersections up for redevelopment or get visuals on how wind
may impact building development and pedestrian movement
on a street.
Page 11
Case Study: Human Body:

James Tromans (A primary School teacher in UK) Decided to give one of the science lessons to
his students using VR technology.
The lesson was about the human body. The children were using the VR headsets. The teacher
used the human Anatomy Playlist to explain di erent sections of the body.
Then children wrote down many facts and questions about what they had experienced.
This experience gave the children chance to explore the human body, which was a good starting
for the lesson. Also, it had a big positive e ect on their understanding.
Page 12
How Does VR Technology Work?

The VR systems work by simulating as many senses as possible to trick the human brain into
perceiving the virtual environment as reality.
To accomplish this, the process combines hardware and software to create immersive
experiences that “fool” the eye and brain.
The hardware supports sensory stimulation such as sounds, touch, smell or heat intensity.
The software creates the rendered virtual environment.
This is a text placeholder - click this text to edit.
Hardware (VR Devices):

The hardware products that facilitate the VR technology.
They include:
A personal computer:
Which is used to process inputs and outputs from and to users, consoles, and smartphones.
The computer must be able to render high-quality graphics and usually employs Graphics
Processing Units (GPUs) for speeding up computations.
The GPU is an electronic unit on a card used to accelerate the creation and displaying of images.
Input devices:
These help users to navigate the 3D worlds.
Include keyboards, mouse, VR controllers,
balls or tracking balls, controller wands, data
gloves, trackpads, on-device control buttons,
motion trackers, bodysuits.
https://linuxhint.com/best_vr_bodysuits/
Page 13
Output devices:
Include the visual and auditory like haptic displays and head mounted displays HMD (headsets)
which simulate a sense organ and present the VR content or environment to the users to
generate a feeling.
Also, Headphones with spatial audio which provide an audio landscape that matches the visuals
from HMD.
Modern VR headset displays are based on technology developed for smartphones including:
- Motion sensors: for tracking head, hand, and body positions.
- Small HD screens for stereoscopic displays.
- Small, lightweight and fast processors.
These components led to relative a ordability for independent VR developers.
Page 14
VR Software:
The hardware is driven by a compatible software.
The software creates a new world by:
- Creating the content which needs an understanding of Computer Vision & Computer Graphics.
- Developing 3D objects that exist in a virtual 3D space.
- Manages the VR input/output devices, analyzes the incoming data, generate proper feedback.
The inputs to the VR software must be on time and the output response from it should be prompt
(real time).
Software: (Old Methods)

The Virtual Reality Modelling Language (VRML), without dependency on headsets.
The Web3D consortium standards for web-based 3D graphics.
The consortium subsequently developed X3D from the VRML framework as an archival, open-
source standard for web-based distribution of VR content.
Web VR is a JavaScript application programming interface (API) that makes it possible to
experience VR in your browser.
It provides support for various VR devices, such as the HTC Vive, Oculus Rift, Google Cardboard
or OSVR, in a web browser.
Software: (New Methods)
Currently, developers use various software to build VR. They include:
- VR Software Development Kits (SDKs).
- VR Game Engines. VR Content Creation.
- VR Visualization Software.
- VR Training Simulators.
Page 15
How Does AR/MR Technology Work?

Components of AR System:
An AR system captures a part of the environment using a camera on a smartphone, tablet, or
head-mounted display (HMD).
Then it scans the captured piece of the environment to identify a location where to overlay
additional information using markers or trackers like GPS or sensors.
Once the additional information is generated, the AR system forms a complete image consisting
of the real-world background and overlaid AR graphical data.

As in VR systems, to accomplish these steps hardware and software are need.
Page 16
AR Hardware:
Sensors:
-Collect data from the physical environment and then transmit them to an AR app (software).
-Modern mobile computing devices like smartphones and tablets contain a camera, GPS
and MEMS (Micro Electro Mechanical Systems) sensors such as accelerometer, gyroscope
and solid state compass, making them suitable AR platforms
Examples:
AR Smart Glasses:
Are wearable computer-capable glasses that add
extra information, ideally 3D images, animations
and videos, to the user’s real-world scenes by
overlaying the computer-generated or digital
information on the user’s real-world.
It can retrieve information from computers,
smartphones, or other devices and can support
Wi-Fi, Bluetooth, and GPS.
Example: Google Glass Explorer Edition and

Microsoft HoloLens.
Most popular AR Smart Glasses and their prices:
Page 17
AR Software:
Developers of AR Apps usually use Apple ARKit and Google ARCore Software Development Kits
(SDKs) from Apple and Google.
These SDKs allow developers to quickly and easily create AR apps for iOS- or Android-based
smartphone and tablet devices accordingly.
Page 18
Advantages of AR/VR
In Training:
When applied in training like in military or driving
schools, VR provide ways of modeling complex task-
performance behaviors, many of which carry life-or-
death risks in real-world learning.

In Education:
When applied to education, VR makes learning easier, interesting and more comfortable.
In Entertainment and Gaming:
Goggles and headsets can insert participants into imagined worlds, turning a watching screen
into living an experience.
In Help & Healing:

- VR can assist in treating phobias, especially those that involve
handling or being near speci c animals, environments or objects.
- VR holds promise in physical rehabilitation, providing patients
with opportunities to re ne ambulatory or other skills in a clinic
setting before moving on to the real-life equivalent.
- Simulating traumatic events can help military service members
work through some of the e ects of post traumatic stress disorder
that result from combat.
- When VR places military service members into settings that
match actual circumstances and gradually enables them to tolerate
disabling stressors.
Page 19
In Architecture & Planning:
- Applying VR technology to architectural design and urban planning helps decision makers
visualize the outcomes of proposed development and renewal.
- Understand space management in a better way.
- Using of VR combined computer-aided design with geographic information systems to
produce a virtual world in a Web browser, so it saves communication time between designer and
client.
- A personalized experience for the client. Best for training purposes for new Architects.
Page 20
Disadvantages of AR/VR
Loss of Spatial Awareness:
The problem is that, once you’ve been in VR for to long (more than 30
minutes), a lot of people tend to forget about these little objects that
might cause them to fall over or wave a hand against a ceiling fan.
Eye Soreness:
Just as watching too much TV or staring at a computer
screen, short-term eye strain is normal in VR.
Seizures:
People that are susceptible to seizures should just stay away of
VR because the technology may invoke a response.
It is not good either for the elderly people, pregnant women’s and young children. There is No
child safety settings.
Nausea, Dizziness and Disorientation:

- In traditional motion sickness, the mismatch occurs because you feel
movement in your muscles and joints as well as in the intricate coils of your
inner ear, but you do not see it. That is why getting up on the deck of a ship
and looking at the horizon helps you feel better.
- With “Cybersickness” , digital motion sickness, it is the opposite. You see
movement — like the turns and twists shown in a movie or video game car
chase — that you do not feel. The result is the same: You may have sensory
con ict causing nausea, sweating, dizziness and headache.
- People prone to motion sickness and unsteadiness are not going to be on a
good foundation going into the world of VR. Even if you aren’t prone to these
unpleasantries, you might still come about if you are in VR too long.
Page 21
Challenges of AR/VR
Price is Too High:
- The majority of engaged audience can’t a ord buying VR gear.
- On the other hand - industry players can’t a ord lowering price to a reasonable level.
Content is Lacking:
Industry is still waiting for its killer app.
Lack of Viable Business Models:

- There are no viable cost-e ective business models for VR-oriented companies. There is no
vision that could drive an industry.
- On the other hand, its future is highly questionable on the business side of things.
Health E ects:
- Currently, there is uncertainty about possible e ects on health of the users.
- If there is even the slightest possibility that VR somehow harmful for their users, the industry will
be resisted by public opinion and subsequently by legislation.
- Long term e ects of VR-use are barely explored.
VR Perceived as Gimmick:
- VR lacks acceptance from anyone beyond tech fans and early adopters.
- Majority of the public perceives it as an expensive gimmick designed for
video games.
Ethical Issues:
- VR developers should be spending more time navigating these all-
too-important ethical dilemmas.
- There are some issues that are most pressing and that we need to
resolve as soon as possible: pornography, user isolation and social
e ects, users physical and digital protection.
Page 22
Social Impact:
There is high level of concern over the negative in uences of interactive VR environments
towards social implications. The users who are engage in violence VR video games and TV in the
virtual world may become desensitized to their violent virtual actions and mimic that behavior
in real world. There are other issues like people turning their backs on the real world and wander
around the synthetic worlds that ful ll their whims.
Page 23
VR Dubai Park
Page 24
Revision:
1. Virtual Reality (VR):
• A realistic and immersive simulation of a three-dimensional environment, created using
interactive software and hardware and experienced or controlled by movement of the body
(immersive, interactive experience generated by a computer).
• The use of computer technology to create a simulated environment. Unlike traditional user
interfaces, VR places the user inside an experience (interacting with 3-D worlds).
2. Augmented Reality (AR):
• A technology that layers computer-generated enhancements over an existing reality in order
to make it more meaningful through the ability to interact with it
• The technology that expands our physical world, adding layers of digital information onto it
(combines real and computer-based spectacle and pictures to transfer a uni ed but enhanced
view of the world).
3. Mixed Reality:
It brings the best of both worlds and attempts to combine Virtual and Augmented Reality. When
both real and arti cial worlds are merged together, an entirely new environment and
visualization become possible wherein physical and digital objects co-exist and interact in real-
time.
4. Microsoft’s Hololens:
A self-contained holographic computer that enables users to interact with digital content around
them. According to Microsoft, interacting with holograms in mixed reality enables users to
visualize and work with their digital content as a part of their reality creating a wrapper that
simpli es all connected devices to make the most out of them by simplifying the process.
Page 25
1. VR/AR Applications: 2. VR components:

a. Marketing a. Hardware
b. Medicine b. Personal Computers (PCs)/smartphones
c. Research c. Input devices
d. Commercial d. Output Devices
e. Military Application e. Software
f. Entertainment f. Audio
g. Development works g. Human Perception
h. City planning
i. Driving schools…..
3. AR components:
a. Cameras and sensors
b. Processing
c. Projection
4. VR technical parts:
d. Re ection
a. Software:
• The Virtual Reality Modelling Language (VRML), without dependency on
headsets.
• The Web3D consortium was standards for web-based 3D graphics.
• The consortium subsequently developed X3D from the VRML framework as an
archival, open-source standard for web-based distribution of VR content.
• Web VR is an experimental JavaScript application programming interface (API)
that provides support for various virtual reality devices, such as the HTC Vive,
Oculus Rift, Google Cardboard or OSVR, in a web browser
b. Hardware:
• Motion sensors for tracking head, hand, and body positions
• Small HD screens for stereoscopic displays
• Small, lightweight and fast computer processors
Page 26
5. AR technical parts:
a. Hardware:
• Processor, display, sensors, and input devices.
• Modern mobile computing devices like smartphones and tablet computers contain these
elements which often include a camera and MEMS sensors such as accelerometer, GPS, and
solid state compass, making them suitable AR platforms
b. Software:
• A key measure of AR systems is how realistically they integrate augmentations with the real
world.
• The software must derive real-world coordinates, independent from the camera, from camera
images. That process is called image registration
6. AR/VR advantages: 7. AR/VR disadvantages:

a. Loss of Spatial Awareness
a. Training and Education
b. Dizziness and Disorientation
b. Entertainment and Gaming
c. Seizures
c. Help and Healing
d. Eye Soreness
d. Architecture and Planning
e. Nausea
f. It is not good either for the elderly people,
pregnant women and young children (no child
safety setting)
8. AR/VR challenges:
a. The price is too high i. There is a high level of concern over the negative
b. The content is lacking in uences of interactive VR environments towards
c. Lack of viable business models social implications.
d. Health e ects j. There are other issues like people turning their backs
e. VR perceived as a gimmick on the real world and wander around the synthetic
f. Human Sensory Limitations worlds that ful ll their whims.
g. Ethical issues h. Social Impact
Page 27
Augmented & Virtual
Reality
Fourth Industrial Revolution Course Materials Reference Book: Schwab,
K. with Davis, N. (2017). The Fourth Industrial Revolution. Currency.
Publisher: Currency (2017) ISBN: 9781524758868 Course Materials
Preparation: Lecture notes, videos, class discussions, student activities,
case studies, and project guidelines for the Fourth Industrial Revolution
course were prepared and edited by :
Dr. Khaled Hamdan (khamdan@uaeu.ac.ae), Dr. Nabeel Al-Qirim
(nalqirim@uaeu.ac.ae).
PDF le Content Contributor: Dr. Asmaa Hosni: asmaaf@uaeu.ac.ae
Reviewed by: Mr. Marwan Fayyad (marwan.fayyad@uaeu.ac.ae) Graphic
Designed by: Basheir Al-Rei (balrei@uaeu.ac.ae)
Schwab (2017). The Fourth Industrial Revolution. Publisher: Currency
(January 3, 2017), ISBN-10: 9781524758868; ISBN-13: 978-
1524758868; ASIN: 1524758868 Mitchell, L., & Groenewald, G. (2010).
The pre-industrial cape in the twenty- rst century. South African
Historical Journal, 62(3), 435–443.

Augmented &amp; Virtual Reality 2

Uploaded by

Document Information

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

Augmented &amp; Virtual Reality 2

Uploaded by

Copyright:

Available Formats

Augmented &

You can put any text here

Augmented Reality (AR):

enhanced view of the world.

- AR encompasses computerized techniques and simulations like animation, text to speech

You can put any text here

Virtual Reality (VR):

movement of the body”.

- It is an “immersive, interactive experience generated by a computer.”

- VR is the use of computer technology to create a simulated environment. Unlike traditional

them, users are immersed with 3D worlds.

Mixed Reality (MR):

time instead of residing in an entirely virtual world.

making virtual interactions appearing to be real.

You can put any text here

virtual elements as an overlay to the real world.

information, including text and/or images, on top of that view.

O ers a digital recreation of a real-life setting.

Completely covers and replaces your eld of vision (completely virtual).

you, as if you were physically there.

What is the Di erence between AR & VR?

- AR uses a real-world setting while VR is completely virtual.

requires a headset device.

Just displaying simple images.

the user’s reality. MR can be mentioned as an enhanced form of AR.

user’s view (invisible) unless he bends down to look at it.

proof-of-concept phase and far from consumer availability.

You can put any text here

Statistics About AR/VR

Sectors using AR/VR:

know the human body structure. It can be used in

scienti c research laboratories so that scientist can

easily research on a speci c topic.

familiar with di erent areas in the battle eld. It can be

used in driving schools as it give a real look of roads and

iOS or Android device to scan the globe and view

animations and educational content such as

animals, monuments, and food.

Development Work (e.g., City Planning):

intersections up for redevelopment or get visuals on how wind

may impact building development and pedestrian movement

Case Study: Human Body:

his students using VR technology.

How Does VR Technology Work?

perceiving the virtual environment as reality.

experiences that “fool” the eye and brain.

The software creates the rendered virtual environment.

This is a text placeholder - click this text to edit.

Hardware (VR Devices):

Processing Units (GPUs) for speeding up computations.

Include keyboards, mouse, VR controllers,

balls or tracking balls, controller wands, data

gloves, trackpads, on-device control buttons,

motion trackers, bodysuits.

- Motion sensors: for tracking head, hand, and body positions.

- Small HD screens for stereoscopic displays.

- Small, lightweight and fast processors.

These components led to relative a ordability for independent VR developers.

The software creates a new world by:

- Developing 3D objects that exist in a virtual 3D space.

Software: (Old Methods)

The Web3D consortium standards for web-based 3D graphics.

source standard for web-based distribution of VR content.

Web VR is a JavaScript application programming interface (API) that makes it possible to

Augmented & Virtual Reality 2

Augmented & Virtual Reality 2