EMERGING TECHNOLOGIES

(CPE0051)
 Module 7
Virtual Reality
1. Introduce the concept of virtual reality.
2. Introduce the concept of augmented reality.
3. Identify the applications for virtual reality.
4. Identify the applications for augmented reality.
What is Virtual Reality?

Virtual Reality (VR) is the use of computer technology to

create a simulated environment. Unlike traditional user
interfaces, VR places the user inside an experience. Instead
of viewing a screen in front of them, users are immersed and
able to interact with 3D worlds.
By simulating as many senses as possible, such as vision,
hearing, touch, even smell, the computer is transformed into
a gatekeeper to this artificial world. The only limits to near-
real VR experiences are the availability of content and
cheap computing power.
What’s the difference Between Virtual Reality and Augmented
Reality?

Virtual Reality and Augmented Reality are two sides of the

same coin. You could think of Augmented Reality as VR with
one foot in the real world: Augmented Reality simulates
artificial objects in the real environment; Virtual Reality
creates an artificial environment to inhabit.
In Augmented Reality, the computer uses sensors and
algorithms to determine the position and orientation of a
camera. AR technology then renders the 3D graphics as they
would appear from the viewpoint of the camera,
superimposing the computer-generated images over a user’s
view of the real world.
In Virtual Reality, the computer uses similar sensors and
math. However, rather than locating a real camera within a
physical environment, the position of the user’s eyes are
located within the simulated environment. If the user’s head
turns, the graphics react accordingly. Rather than
compositing virtual objects and a real scene, VR technology
creates a convincing, interactive world for the user.
Virtual Reality technology

Virtual Reality’s most immediately-recognizable component is

the head-mounted display (HMD). Human beings are visual
creatures, and display technology is often the single biggest
difference between immersive Virtual Reality systems and
traditional user interfaces.
For instance, CAVE automatic virtual environments actively
display virtual content onto room-sized screens. While they
are fun for people in universities and big labs, consumer and
industrial wearables are the wild west.
With a multiplicity of emerging hardware and software
options, the future of wearables is unfolding but yet unknown.
Concepts such as the HTC Vive Pro Eye, Oculus Quest and
Playstation VR are leading the way, but there are also
players like Google, Apple, Samsung, Lenovo and others
who may surprise the industry with new levels of immersion
and usability.
Whomever comes out ahead, the simplicity of buying a
helmet-sized device that can work in a living-room, office, or
factory floor has made HMDs center stage when it comes to
Virtual Reality technologies.
Virtual Reality and the importance of audio

Convincing Virtual Reality applications require more than just

graphics. Both hearing and vision are central to a person’s
sense of space. In fact, human beings react more quickly to
audio cues than to visual cues.
In order to create truly immersive Virtual Reality experiences,
accurate environmental sounds and spatial characteristics
are a must. These lend a powerful sense of presence to a
virtual world. To experience the binaural audio details that go
into a Virtual Reality experience, put on some headphones
and tinker with this audio infographic published by The Verge.
While audio-visual information is most easily replicated in
Virtual Reality, active research and development efforts are
still being conducted into the other senses. Tactile inputs
such as omnidirectional treadmills allow users to feel as
though they’re actually walking through a simulation, rather
than sitting in a chair or on a couch.
Haptic technologies, also known as kinesthetic or touch
feedback tech, have progressed from simple spinning-weight
“rumble” motors to futuristic ultrasound technology. It is now
possible to hear and feel true-to-life sensations along with
visual VR experiences.
Major players in Virtual Reality: Oculus, HTC, Sony

As of the end of 2018, the three best selling Virtual Reality

headsets were Sony’s PlayStation VR (PSVR), Facebook’s
Oculus Rift and the HTC Vive. This was not a surprise,
seeing as the same three HMDs had also been best sellers in
2017.
2019 sees the VR landscape broadening with Google, HP,
Lenovo, and others looking to grab a piece of the still-
burgeoning market.

Here’s a look at 2019’s major VR hardware manufacturers

and the devices they are manufacturing:
Oculus Rift, Oculus Rift S, Oculus Go, Oculus Quest

Originally funded as a Kickstarter project in 2012, and

engineered with the help of John Carmack (founder of Id
Software, of Doom and Quake fame), Oculus became the
early leader in Virtual Reality hardware for video games.
Facebook bought Oculus in 2014, and brought the
company’s high-end VR HMD to market for consumers. More
recently, Oculus has seen success with the lower-price,
lower-powered Oculus Go, and 2019 will see the release of
multiple new iterations on the hardware, including the
tethered Rift S and the stand-alone Oculus Quest.
HTC Vive, HTC Vive Pro Eye, HTC Cosmos, HTC Focus,
HTC Plus

The HTC Vive has been one of the best VR HMDs on the
market since its consumer release back in 2016.
Manufactured by HTC, the Vive was the first VR HMD to
support SteamVR. The Vive has been locked in fierce
competition with the Oculus Rift since release, as both
headsets aimed at the same top end of the VR enthusiast
market.
The Vive has proven itself a durable workhorse for enterprise
solutions, while also delivering one of the best consumer VR
experiences available. The Vive was first released back in
2016, and has gone through several iterations, with the
addition of a wireless module. The Vive Pro came out in 2018
and the Vive Pro Eye and the HTC Vive Cosmos are both
slated for release in the second half of 2019.
HMD + Smartphone Virtual Reality

There’s a second class of Virtual Reality HMD that is really

just a shell with special lens that pairs with a smartphone to
deliver a VR experience. These devices can sell for almost
nothing (and are often given away free), and deliver a scaled
down VR experience that still approaches the immersive
experiences generated by much-more expensive hardware.
Applications of Virtual
Reality
How Virtual Reality is being used today

Unsurprisingly, the video games industry is one of the largest

proponents of Virtual Reality. Support for the Oculus Rift
headsets has already been jerry-rigged into games like
Skyrim and Grand Theft Auto, but newer games like Elite:
Dangerous come with headset support built right in.
Many tried-and-true user interface metaphors in gaming have
to be adjusted for VR (after all, who wants to have to pick
items out of a menu that takes up your entire field of vision?),
but the industry has been quick to adapt as the hardware for
true Virtual Reality gaming has become more widely
available.
Virtual Reality and data visualization

Scientific and engineering data visualization has benefited for

years from Virtual Reality, although recent innovation in
display technology has generated interest in everything
from molecular visualization to architecture to weather
models.
VR for aviation, medicine, and the military

In aviation, medicine, and the military, Virtual Reality training

is an attractive alternative to live training with expensive
equipment, dangerous situations, or sensitive technology.
Commercial pilots can use realistic cockpits with VR
technology in holistic training programs that incorporate
virtual flight and live instruction.
Surgeons can train with virtual tools and patients, and
transfer their virtual skills into the operating room, and studies
have already begun to show that such training leads to faster
doctors who make fewer mistakes. Police and soldiers are
able to conduct virtual raids that avoid putting lives at risk.
Virtual Reality and the treatment of mental illness

Speaking of medicine, the treatment of mental illness,

including post-traumatic stress disorder, stands to benefit
from the application of Virtual Reality technology to ongoing
therapy programs.
Whether it’s allowing veterans to confront challenges in a
controlled environment, or overcoming phobias in
combination with behavioral therapy, VR has
a potential beyond gaming, industrial and marketing
applications to help people heal from, reconcile
and understand real-world experiences.
How Virtual Reality
Works
Virtual reality is a way to create a computer-generated
environment that immerses the user into a virtual world.
When we put on a VR headset it takes us to a simulated set-
up making us completely aloof from the actual surroundings.
If you ever have put on one you would know exactly what I
am talking about.
While from an experiential perspective we do understand the
concept but what about the technical backend that goes into
making it all possible. Do you really know how virtual reality
works? In this blog, we will understand the technology behind
virtual reality and the basic terminology surrounding the
development of a simulated ecosystem for a head-mounted
display (VR headset).
The Basics of How VR Works:

The primary subject of virtual reality is simulating the vision.

Every headset aims to perfect their approach to creating an
immersive 3D environment. Each VR headset puts up a
screen (or two – one for each eye) in front of eyes thus,
eliminating any interaction with the real world.
Two autofocus lenses are generally placed between the
screen and the eyes that adjust based on individual eye
movement and positioning. The visuals on the screen are
rendered either by using a mobile phone or HDMI cable
connected to a PC.
To create a truly immersive virtual reality there are certain
prerequisites – a frame rate of minimum 60fps, an equally
competent refresh rate and minimum 100-degree field of view
(FOV) (though 180 degrees is ideal). The frame rate is the
rate at which the GPU can process the images per second,
screen refresh rate is the pace of the display to render
images, and FOV is the extent to which the display can
support eye and head movement.
If either of these doesn’t work as per the standards the user
can experience latency i.e. too much time gap between their
actions and the response from the screen. We need the
response to be less than 20 milliseconds to trick the brain
which is achieved by combining all the above factors in the
right proportion.
Another issue that needs to be catered here is to prevent
tearing (cybersickness) resulting due to the inconsistency
between the frame rate and refresh rate. If the GPU’s fps is
more than the screen refresh rate then the image can
become distorted. To counter this issue, we limit the
framerate to the monitor’s refresh rate this done using a tech
called Vertical Sync (VSync).
Among the major headsets available today, Vive and Rift both
have 110-degree FOVs, Google Cardboard has 90, the
GearVR has 96 and the new Google Daydream offers up to
120 degrees. As for frame rate, both HTC Vive and Oculus
Rift come with 90hz displays, while the PlayStation VR offers
a 60hz display.
Other Elements of the VR Technology:

The Impact of Sound:

Sound effects, when synced with the visuals, can create very
engaging effects. By using a headphone and 3D sound
effects the user’s belief in the virtual environment can be
reassured.
While crafting sound effects due care needs to be taken
about the consistency between the graphics and the sound. If
you start playing horror music in the background of a fairy
tale movie it will just put the user off.
Eye and Head Tracking:

Eye and head tracking can be ensured using laser pointers,

led lights or mobile sensors. In mobile, we use the
accelerometer to detect three-dimensional movement,
gyroscope for angular movement and magnetometer to
identify the position relative to the Earth.
If we need to achieve a very high accuracy then cameras and
sensors can be installed in the room where you would use
the headset. Although this is a much costlier setup as
compared to using basic phone sensors.
 source
Augmented Reality
What is Augmented Reality?

Augmented reality is the technology that expands our

physical world, adding layers of digital information onto it.
Unlike Virtual Reality (VR), AR does not create the whole
artificial environments to replace real with a virtual one. AR
appears in direct view of an existing environment and
adds sounds, videos, graphics to it.
A view of the physical real-world environment with
superimposed computer-generated images, thus changing
the perception of reality, is the AR.
The term itself was coined back in 1990, and one of the first
commercial uses were in television and military. With the rise
of the Internet and smartphones, AR rolled out its second
wave and nowadays is mostly related to the interactive
concept. 3D models are directly projected onto physical
things or fused together in real-time, various augmented
reality apps impact our habits, social life, and the
entertainment industry.
AR apps typically connect digital animation to a special
‘marker’, or with the help of GPS in phones pinpoint the
location. Augmentation is happening in real time and within
the context of the environment, for example, overlaying
scores to a live feed sport events.
Four Types of AR
Marker-based AR.

Some also call it to image recognition, as it requires a special

visual object and a camera to scan it. It may be anything,
from a printed QR code to special signs. The AR device also
calculates the position and orientation of a marker to position
the content, in some cases. Thus, a marker initiates digital
animations for users to view, and so images in a magazine
may turn into 3D models.
Markerless AR.

A.k.a. location-based or position-based augmented reality,

that utilizes a GPS, a compass, a gyroscope, and an
accelerometer to provide data based on user’s location. This
data then determines what AR content you find or get in a
certain area.
With the availability of smartphones this type of AR typically
produces maps and directions, nearby businesses info.
Applications include events and information, business ads
pop-ups, navigation support.
Projection-based AR.

Projecting synthetic light to physical surfaces, and in some

cases allows to interact with it. These are the holograms we
have all seen in sci-fi movies like Star Wars. It detects user
interaction with a projection by its alterations.
Superimposition-based AR.

Replaces the original view with an augmented, fully or

partially. Object recognition plays a key role, without it the
whole concept is simply impossible. We’ve all seen the
example of superimposed augmented reality in IKEA Catalog
app, that allows users to place virtual items of their furniture
catalog in their rooms.
 Applications of
Augmented Reality
1. Medical Training

From operating MRI equipment to performing complex

surgeries, AR tech holds the potential to boost the depth and
effectiveness of medical training in many areas. Students at
the Cleveland Clinic at Case Western Reserve University, for
example, will now learn anatomy utilizing an AR
headset allowing them to delve into the human body in an
interactive 3D format.
2. Retail

In today's physical retail environment, shoppers are using

their smartphones more than ever to compare prices or look
up additional information on products they're browsing. World
famous motorcycle brand Harley Davidson is one great
instance of a brand making the most of this trend,
by developing an an AR app that shoppers can use in-store.
Users can view a motorcycle they might be interesting in
buying in the showroom, and customize it using the app to
see which colors and features they might like.
3. Repair & Maintenance

One of the biggest industrial use cases of AR is for repair and

maintenance of complex equipment. Whether it's a car motor
or an MRI machine, repair and maintenance staff are
beginning to use AR headsets and glasses while they
perform their jobs to provide them with useful information on
the spot, suggest potential fixes, and point out potential
trouble areas.
This use case will only continue to get stronger as machine-
to-machine IoT technology grows and can feed information
directly to AR headsets.
4. Design & Modeling

From interior design to architecture and construction, AR is

helping professionals visualize their final products during the
creative process. Use of headsets enables architects,
engineers, and design professionals step directly into their
buildings and spaces to see how their designs might look,
and even make virtual on the spot changes.
Urban planners can even model how entire city layouts might
look using AR headset visualization. Any design or modeling
jobs that involve spatial relationships are a perfect use case
for AR tech.
5. Business Logistics

AR presents a variety of opportunities to increase efficiency

and cost savings across many areas of business logistics.
This includes transportation, warehousing, and route-
optimization.
Shipping company DHL has already implemented smart AR
glasses in some of its warehouses, where lenses display to
workers the shortest route within a warehouse to locate and
pick a certain item that needs to be shipping. Providing
workers with more efficient ways to go about their job is one
of the best ROI use cases in today's business environment.
6. Tourism Industry

Technology has gone a long way towards advancing the

tourism industry in recent years, from review sites like
TripAdvisor to informative website like Lonely Planet. But AR
presents a huge opportunity for travel brands and agents to
give potential tourists an even more immersive experience
before they travel.
Imagine taking a virtual "Walkabout" Australia before on AR
glasses before booking a ticket to Sydney, or a leisurely stroll
around Paris to see what museums or cafes you might like to
visit. AR promises to make selling trips, travel, and vacations
a whole lot easier in the future.
7. Classroom Education

While technology like tablets have become widespread in

many schools and classrooms, teachers and educators are
now ramping up student's learning experience with AR. The
Aurasma app, for example, is already being used in
classrooms so that students can view their classes via a
smartphone or tablet for a more rich learning environment.
Students learning about astronomy might see a full map of
the solar system, or those in a music class might be able to
see musical notes in real time as they learn to play an
instrument.
8. Field Service

Whether it's something as small as an air conditioner, or as

large as a wind turbine, every day field service technicians
get dispatched to repair a piece of mission critical equipment
that needs to get up and running as soon as possible. Today,
these technicians can arrive on-site with AR glasses or
headsets and view whatever they're repairing to more quickly
diagnose - and fix - the problem.
And instead of having to thumb through a repair manual,
technicians can go about their business hands-free to get in
and out faster than ever.
9. Entertainment Properties

In the entertainment industry, it's all about building a strong

relationship with your branded characters and the audience.
Properties like Harry Potter are immensely successful
because readers of the books and watchers of the movies
feel like they know the characters, and are hungry for
additional content.
Entertainment brands are now seeing AR as a great
marketing opportunity to build deeper bonds between their
characters and audience. As a matter of fact, the makers of
AR sensation Pokemon Go are soon planning to release
a Harry Potter-themed AR game that fans can interact with
day in and day out.
10. Public Safety

In the event of an emergency today, people will immediately

reach for their smartphone to find out what's going on, where
to go, and whether their loved ones are safe. Moreover, first
responders arrive on the scene of a fire or earthquake trying
to figure out who needs help, and the best way to get them to
safety. AR is showing promise in solving both pieces of the
public safety puzzle.
First responders wearing AR glasses can be alerted to
danger areas, and show in real-time individuals that need
assistance while enabling to still be aware of their
surroundings. For those in need, geolocation enabled AR can
show them directions, and the best route to, safe zones and
areas with firefighters or medics.
https://www.marxentlabs.com/what-is-virtual-reality/
https://www.inc.com/james-paine/10-real-use-cases-for-
augmented-reality.html
https://thinkmobiles.com/blog/what-is-augmented-reality/
https://www.newgenapps.com/blog/how-vr-works-
technology-behind-virtual-reality/