UX

TRENDS
Mixed Reality

Ryan Soni Nithin G.Z

1134 1106
 Mixed Reality

About

Mind map

Evolution of MR
CONTENTS
Applications of MR

Problems

Solution
 MIXED REALITY

Mixed Reality is the mixture of the real world and the virtual world,
so that one understands the other. This creates an experience
that cannot happen anywhere else, it is often referred to as hybrid
reality. In this environment physical and digital objects co-exist and
interact in real time.
 Easy Collaboration

Remote Training

VR communication

Easier international
business

Airbus

Business
Ford

Therapy
Audi Healthcare institutions

Remote Surgery
Businessmen Medical Schools

Hands on Training
Employees Medical students

VR Medical Training
Faster work flow Doctors

UCLA
Easy Better practice

Doctors Medicine
Risk free

Simulation Based
Patients
Learning (SBL) Easy to master skill

Training new pilots

Nurses
less tension

Aviation schools
Safer Training
Trainees

Students
Safer Learning
Cheap

Teachers
Visual Learning
Aviation Fine tune skills

Instructors
Improved problem
solving and decision
Safe
making skills

Soldiers might get too

No risk
Face to face dependant on
communication simulations
Faster Learning

Better connection Sharpen skills

Realtime Communication Easier training

Visual+Kinesthetic Recruits
Building Plans
+Auditary

Military personnels
Visualization Military
Immersive
Training
Risk free
Interior designers

Accident free
Architects

DARPA
Contractors
Construction

Military contractors
Businessmen

Piloting drones and

Easy to visualize
UAVs
MIXED REALITY
Better understanding
Space management

Understand spacing
Interior decorating
better
Designers
Architectoral planning

Architects Design RAVE(Real Asset

Virtualization Architects
Environment)
Artists Understand in detail
Interior Designers

MINDMAP
Visual Learning
Easy

Immersive Classroom
Less effort

Biology
Remote Working

Art
Healthcare

Geography
Gaming
Doctors

Math Education
Music
Recruits

Physics
Movies
Students

Students
Sports
Designers

Teachers
Theme parks
Contractors

Faster learning
TV
Developers

Easier understanding
Online
Therapists

Hands on learning
Mobile
Next step in evolution
Combined with IOT
in Human, computer
Entertainment every interaction will be
and Environment
Gaming platforms at your fingertips
interaction

Costly Improved immersion

Mental Problems Simpler

Accident prone

Intuitive
Complete immersion

Realtime
Better enjoyment

Entertaining
Better experience

Better Experience
Remote online
multiplayer

User customization Epilepsy

Personalization Expensive

AR stores Bulky

Lowe's Holoroom Physical Health issues

Shiseido makeup mirror Shopping Accident prone

Smartphones Treat Autism

Hackers (IOT)

Kiosks Treat PTSD

Seizures

Customers Fear of flying

Tracking Issues

Users can try products Stress management

Interaction Issues

Treat phobias

Substance abuse

VR Exposure Treatment Therapy

Project Bravemind

Veterans

Autistic people

Medical officers

Cheap

Effective
 Paul Milgram introduced the concept of Mixed Reality
alongside AR and VR in his paper in 1994.

1968 1994 2000

Ivan Sutherland developed the first head mounted display Hirokazu Kato created the
Julie Martin creates the first augmented reality theater
system. The system used computer generated graphics to ARToolkit, an open source
which featured acrobats dancing around virtual objects
show simple wireframe drawings. library that uses video
on physical stage.
tracking to overlay
computer graphics on a
video camera.

Print media tries out AR for

the first time. Magazine promts
readers to scan the cover page.
2013 2009
Car manufacturing begins to use augmented
reality as he new age vehicle service manuals. ... ARToolkit brings
(Volkswagen MARTA app) ... augmented reality to web
browsers.

Google announces the release

of Google Glass.
2014 2016 2017
Magic Leap announces the largest
AR investment to date.
Microsoft Hololens developer kit and the AxonVR builds haptic technology that
Meta 2 Developer kit is set to release. enables realistic feeling in virtual reality
for the first time. HaptX Skin is a haptic
Google releases the tilt brush, a textile that simulates lifelike touch,
room scale 3D virtualreality application. allowing you to feel everthing.
Business

Virtual reality has become big business, and its mainstream availability is one of
those rare, genuinely exciting developments that cant help but spark the
imagination.

VR Remote Training Employees

Mixed Reality Data Organization
Virtual Reality Communication and Collaboration

Communication

One of the many world-changing aspects of the Internet is the way it makes
global communications trivially simple for the ordinary user. Using freely available
software, organizing in a conference with multiple people in multiple other
countries is nearly as easy as striking up a chat with your next door neighbor.

AltSpaceVR is a virtual environment where people can interact with other people
using avatars.
 c
+
Education
4 Z The education industry has historically been a little slow to embrace new

A
technologies. MR is making inroads into every aspect of education. From
the top levels of higher education to amateur video tutorials, MR is quickly
B a vital component of how we learn.
EON Reality allows user to place a 3D model in the environment and interact
with them and learn how to make them.
Remote Learning

Entertainment
For most people, the first thing that comes to mind is entertainment.
Entertainment is often built on bringing the impossible to life. MR offers both
a massive technology upgrade and a massive cost savings over simulating exotic
environments in the real world.
VR theme parks
Design
Like so many other industries, virtual reality, augmented reality, and mixed reality
are taking the world of design by storm. From architecture to interior home
design, VR and related technologies are changing the way we create the places
we work, live, and play.
SmartReality app is a fascinating convergence of smartphone, virtual reality, and
augmented reality. Designed for architectural professionals, users upload their plans
to the service to be converted into SmartReality-compatible files.
Virtual Reality in Professional Interior Home Design
IKEA Catalog MR App

Gaming
Gaming is one of the most immediately apparent applications for mixed reality.
After all, both of the current major players in the consumer VR space, Oculus and
HTC, have their roots in the video games industry. For the avid gamer, nothing
could be more exciting than the prospect of being literally transported inside the
game, battling demons, aliens, and spies, exploring amazing environments
beyond imagination.

The VOID
 Aviation

Health care

Manufacturing
Other upcoming applications Shopping

Sports

Travel

Therapy
Drawbacks
Drawbacks of MR/Technology/size

?
Atom MR device

Prostethic hand

From time immemorial humans have an insatiable hunger towards minimalism and efficiency,
How best can something be minimalised and still solve its purpose?

MR devices at present, offer poor peripheral scope of vision.

They also are a tad too big and prove to provide discomfort to some users.

With the advent of the single atmoic layered prosthetic hand developed by Prof. Dahiya,
We might soon see MR devices going into microscopic levels in the near future.
Drawbacks of MR/Monetary and content issues

Consumers

o o
Money MR device kits x x

Developer

A Mixed reality device is as good as the content it has to display.

MR devices at present, are extremely costly .

With only developer kits being exported at the moment.
So if a consumer were to get one of the kits, he would be in jeapordy
as he would have access to very limited content.
Drawbacks of MR/HCI/Tracking and interaction issues

Text based interactions

Bad user experience

User

Leapmotion

Good interactions equate to good user experience.

MR devices facilitate poor interactions.

Gestures recognised are very minimal and faulty.
Leapmotion does correct this to some extent but is still unsatisfactory.

Text based interactions are tedious as the user has to select each letter,
sometimes clicking on the wrong letter (blame the tracking quality).
Drawbacks of MR/Health and safety

Brain
(on try hard mode)
User
User (not my cup of tea.)

MR promises to be highly immersive, but is it safe ?

Many people have had various experiences of feeling nauseas while

trying out MR.
This happens due to only visual stimulus being sent to the brain.
The brain cant simulate the other senses without being told to do so.
Epilepsy is also prominant in core gaming MR.
A gamified future?
The GZR
question reality.
How it works

The GZR captures and emulates stimulus and

sends it to the parietal lobe
in the brain via neurons .

The parietal lobe gives a sense of me.

The parietal lobe figures out the messages you

recieve from the five senses and tells the brain,
what is part of the body and what is part
of the outside world.

With the help of the GZR, a user

would be able to augment, virtual
content on the go in real time.

The GZR also translates speech instantly into

your choice of language rather than showing
you annotations of whats being spoken.
Vegetable ninja?

If youre trying to learn some-

thing.

The GZR will have an app

ready for you, to have a mixed
reality integrated learning
session.

In this example, the user is

learning how to chop vegeta-
bles.

The system makes the user

learn it in a fun way by intro-
ducing points for cutting it
perfectly.
 Life is a game. 16
Might rain in a bit.

Play Cloud draw?

Play games whenever and

wherever.

GZR uses high end IOT to

visually map information
for you.

In this example, it collects data

about the weather and
displays it to you.

It also suggests playing a mini

game suitable for that infor-
mation, here Cloud draw,
enabling the user to draw
images using clouds.

Fun? oh yes.
 O x 16

x
A new friend? Might rain in a bit.

Play Cloud draw?

Your personal companion by

your side always. ! O
The GZR augments an
assistant for you to interact
with.

The assistant helps you with

your daily interactions in the
mixed reality world.

In this example, the assistant

has an exclamation mark
suggesting notifications.

The user can also augment

mini games such as x and os
on your desired platform.
Hardcore gamer?

If minigames are not your

type, or you find them
extremely easy.

Then weve got some hard-

core games for you to enjoy.

The GZR augments your

physical environment into the
desired game environment.

In this example the user in

seen playing superhot in his
drawing room.
It cant get any safer.
To do
1) buy vegetables from the grocery
The GZR is always on the
lookout for obstacles during
store.
your amazing Mixed reality
journey. 2) Play Superhot in the park today.
In this example while the user
is going throug his daily task 3) Go for a haircut.
feed, the GZR prompts a
human who is in front of you
by creating a brief heatmap 4) Take Natasha out for dinner.
out of him.

The GZRs assistant immediet- 5) Make a presentation for UX trends.

ly stops your mixed reality
display if theres an imminent 6) Sleep by 10 pm.
threat to your safety .