MDT Learning Diary
08
Virtual, Augmented and Mixed Reality
Nov 2019
History
Morton Heilig invented Virtual
reality technology in 1957. His
multimedia device called the
Sensorama is considered one of
the earliest VR systems.
However, the term ‘virtual
reality’ was coined much later,
after 30 years, in 1987 by
researcher Jaron Lanier.
A science fiction author Stanley
Weinbaum wrote Pygmalion’s
Spectacles in 1935,. In this
fictional short story, the main
character met a professor who
invented a pair of goggles that
allowed him to view a movie
with sight, sound, taste, smell,
and touch. This was first time,
someone actually imagined
about virtual reality.
The oncept of Mixed Reality can
be traced back to 1994. It was
first mentioned in a research
paper written by Paul Milgram
and Fumio Kishino. Paul and
Fumio define Mixed Reality as “a
particular subclass of Virtual
Reality related technologies that
consists of the merging of real
and virtual worlds.”
On
Rajan Kumar
PGP09019
Overview
What are VR, AR and MR?
Virtual reality (VR) Places users in a fully
artificial virtual environment.
Augmented reality (AR) places virtual objects
on the real-world environment to interact.
Mixed reality (MR) not just overlays objects
but interact with virtual objects in the real
world and vice versa.
Differences among them in detail?
Virtual Reality:
Virtual reality place users in a completely
digital environment that is generated by a
mobile/computer. Users can move/interact
in a digital environment and listen sounds.
Moreover, special handheld devices can be
used to enhance VR experiences.
Most VR devices are connected to a
computer (Oculus Rift) or a gaming platform
(PlayStation VR) but there are standalone
devices such as Google Cardboard is among
the most popular as well.
Have you ever noticed a small cardboard icon
while watching YouTube videos? Clicking on
it will enable the 360-degree mode that can
be experienced with the help of a VR headset.
In this Article
History
Overview
Mixed Reality in Detail
Applications of Reality
Technologies
The future
Key Players
Few words of Advice
Augmented Trends
Reality & New Software P.4
In augmented reality, users can see and
interact with the real world objects and
virtual objects can be added to it. Pokemon
Go is the most vivid example of augmented
reality.
There is a different kind of experience with
augmented reality through special AR
devices, such as Google Glass, where digital
contents/objects is displayed on a digital
screen in front of a viewer’s eye.
Mixed reality
Mixed reality (MR) is a simulated user
environment in which Human, virtual
contents and surrounding environment are
combined in a way that enables interaction
among real-world and virtual objects
In mixed reality, virtual objects are not just
placed in the real world but users can interact
with it. User remains in the real-world
environment while virtual objects is added to
it. In this case, a user can interact with virtual
objects in real world or virtual world.
The Future
Right now, VR is mainly used
for gaming experience but
Mixed Reality: This is
there is huge future the most advanced
potential of Reality and recent
technology for different kind
of applications. Mixed reality
development in reality
experiences, or interactive technology
experiences that are part of
augmented reality or part of
virtual reality, provide a nice
gateway into full VR One of the best memories that I vividly remember and cherish is the bed time stories that my dad used to
tell me and my cousins. In one story, A good Prince X was attacked by an evil prince Y. Prince X was about
adoption.
to lose the war. A lot of things and plans were going on his mind, but he had no time for testing and
The upcoming future of preparing his strategies and plan. He slept in night. During sleep, he saw a dream in which he implemented
virtual reality predictions and tested all the plans virtually i.e. how he could make good use of his armies to defeat the enemy and
next day, he won the battle. I was surprised how someone can do so before he actually does.
may include:
Is it possible to create new things before we actually create them? So, the answer is yes. It might not have
 AR & VR will merge to
been possible 15 years ago. This was the reason that I was unable to digest the story told by my father. But
create a new type of the advancement in technology has made such things possible. Here, I am talking about Mixed Reality which
experience allows us to merge the actual reality and the virtual reality.
 Nowdays, we are talking
I would like to state two simple examples here. Suppose you are manager of a newly opened retail store.
about XR.
You are trying to find best layout for your products in the store that can maximize the sales. But you are
 Advanced virtual social not going to try different layouts by placing products physically. So, how will you do?
interactions will be
In second case, you are event head of an event management company. You have got a contract to organise
introduced
a business event in a big hall. Now you are worried about arrangements for event. You want to try different
 VR interaction will occur
arrangements and then find best one for your event. How will you do?
through handhelds.
 VR headsets will slim
down to look more like
sunglasses.
 Applications of VR in
Automated Car and
Production automation

loquor dolus lor secundum erat neo

adsum multo comveo feugiat

Answer lies in Mixed Reality. It has enabled to visualize our work before we do, new way to collaborate and
explore the things/places we never have been, new way to share ideas with each other and new way to
teach and learn.

Key Players
Nearly 50 years ago, There was
no virtual reality technology.
Now, all the big giants are
competing fo the market share.
Followig players are in Market:
Sony: They are implementing
reality technologies mainly in
Gaming. They have closed
platform and niche market
HTC: HTC is in mainly VR
headsets for mobile market.
HTC VIVE is an example.
VIVE X, a VR/AR accelerator
program, through which it
invests in startups with
potential to add value and
innovation to this field.
Google: Company is developing
general purposes VR/AR apps
using open platform. Google
Glass and Google cardboard are
examples. Google is also
developing devices for health,
Automobiles and militray
Facebook:Company is
developing general purposes VR
apps. Oculus Rift and Facebook
spaces are examples. Facebook
is trying to improve social media
experiences for users
Microsoft: Company is
developing general purposes VR
apps. It incorporates VR, AR and
MR in games and apps. Example
is well-known messaging service
Skype for HoloLens.
The upcoming years will be
interesting to see who is going
to win.
With the help of the technology, we have moved from VR (Virtual reality) to AR (Augmented reality) and
now we are moving from AR to MR. Example of AR is Pokémon Go. This game is a blending of virtual reality
and environment where you are catching Pokémon inside your home, below your bed and behind your
room door. Mixed reality is a more immersive and interactive version of augmented reality. Here, human
touch, real and virtual worlds are merged together, coexist and interact in real time.
If interacting with virtual environment sounds confusing, let me take an example again. Imagine you were
alone in room, getting bored. You remembered that you had got a gadget from Doraemon. Now You
created a new virtual world inside your room and interacting with a completely digital environment. You
are also able to track the real world and adjust the virtual environment accordingly. Now, you are happy.
This kind of things are possible with mixed reality.
Now, I am coming to two examples stated in start of article. In both cases, Mixed reality can help to create
optimal solution.
Now, let talk about the applications Mixed Reality. What can industries gain from it?
Applications of Reality Technologies
Mixed reality is widely used across a lot of spheres and is increasingly entering into the world of
businesses, manufacturing and education. Some such new applications are:
Simulation based learning (SBL): Simulation technique was extended to a lot of learning fields like health
wherein more comprehensive full body mannequin simulators were used than what was used before for
better learning. Simulation learning has now been extended to a lot of fields like obstetrics and internal
medicine. There has been a move from e-learning to s-learning involving use of interactive experimental
learning. This provides better learning experiences and helps people better understand what they’re
studying.
Military training: Combat reality is simulated and tested in complex layered data with the help of HMD.
Manufacturing: Mixed reality is helpful in manufacturing processes by providing workers with real-time
assistance. Workers can see instructions on display right in front of their eyes, so they always know what
to do. This reduces the probable risk of human errors and also improves quality. MR is also helpful in
repairs and maintenance, particularly in industries that require expertise and high precision.
Communications: MR technology can enable immersive communication experiences that can help people
working remotely, to collaborate more efficiently. Employees can use this technology for meetings,
Presentations and collaborating with remote project team without being blocked off from the real world.
If you can’t imagine how this works, you can read about Microsoft HoloLens.
Aviation: Before getting plans to factory, scientists and engineers can use models to interact with possible
future failures. These models provide the opportunity to have an intuitive understanding of the exact
product, including constructions details and real size that allow a manufacturer to have a closer inspection
of interior parts. These models can also be used to find different issues before hand and save money and
time.
Few words of Advice
It is said that if we can change the way we see the world, we can change the world we see. Mixed reality
is going to change the way we perceive and interpret the world. But the cost and complexity associated
with this are major challenges. Companies harnessing this technology must spend more in research
programme to make this technology more efficient and cost effective.
References:
https://learn.g2.com/history-of-virtual-reality

https://www.forbes.com/sites/quora/2018/02/02/the-difference-between-virtual-reality-augmented-reality-and-mixed-
reality/#3f6f72c12d07

https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2966567/

http://www.chronicloop.com/mixed-reality-applications/

https://www.eventmanagerblog.com/10-applications-of-mixed-reality

https://docs.microsoft.com/en-us/windows/mixed-reality/mixed-reality

https://www.youtube.com/watch?v=qym11JnFQBM

https://rubygarage.org/blog/difference-between-ar-vr-mr

https://www.forbes.com/sites/alicebonasio/2018/07/26/university-of-hull-opens-world-first-mixed-reality-
accelerator/#635c864e259a