Augmented Reality

Virtual Reality

Virtual and Augmented Reality Introduction

BYRON ALFONSO PÉREZ-GUTIÉRREZ

Virtual Reality Center

Universidad Militar Nueva Granada
byron.perez@unimilitar.edu.co

February 2019

Byron Alfonso Pérez-Gutiérrez Virtual and Augmented Reality Introduction

 Augmented Reality
Virtual Reality

Outline I

1 Augmented Reality

2 Virtual Reality

Byron Alfonso Pérez-Gutiérrez Virtual and Augmented Reality Introduction

 Augmented Reality
Virtual Reality

Augmented Reality

Byron Alfonso Pérez-Gutiérrez Virtual and Augmented Reality Introduction

 Augmented Reality
Virtual Reality

Virtual Reality vs Augmented Reality

Augmented Reality (AR) and Virtual Reality (VR) are often part of
the same conversation, though there are significant differences
between the two technologies.

www.masteryield.com/inicio/avada-vr-man1/
www.newscientist.com/article/2130678-augmented-reality-goggles-give-surgeons-x-ray-vision/

Byron Alfonso Pérez-Gutiérrez Virtual and Augmented Reality Introduction

 Augmented Reality
Virtual Reality

Augmented Reality

¿What is Augmented Reality?

Is a general term applied to a variety of display technologies
capable of overlaying or combining alphanumeric, symbolic, or
graphical information with a user’s view of the real world.

Byron Alfonso Pérez-Gutiérrez Virtual and Augmented Reality Introduction

 Augmented Reality
Virtual Reality

AR - Display types

Optical see-through HMD - Video see-through HMD

Byron Alfonso Pérez-Gutiérrez Virtual and Augmented Reality Introduction

 Augmented Reality
Virtual Reality

AR - Displays

Sir Howard Grubb. A New Collimating-telescope Gun-sight for

Large and Small Ordnance. R. Dublin Soc., 1901 - 9 pages. Patent
No.12108

Byron Alfonso Pérez-Gutiérrez Virtual and Augmented Reality Introduction

 Augmented Reality
Virtual Reality

AR - HUD (Heads Up Display) in a aircraft

Transparent display mounted in front of the pilot that enables viewing
with the head positioned "up" (or heads-up) and looking forward, instead
of looking angled down, looking at instruments lower in the cockpit

http://www.esacademic.com/dic.nsf/eswiki/563390
Because the information projected onto the HUD is collimated (parallel light rays) and focused on
infinity, the pilot’s eyes do not need to refocus to view the scene beyond the display outside of the
aircraft.
Byron Alfonso Pérez-Gutiérrez Virtual and Augmented Reality Introduction
 Augmented Reality
Virtual Reality

AR - HUD in a car

https://www.bmw.es/es/footer/footer-section/glosario-bmw/bmw-head-up-display.html

Byron Alfonso Pérez-Gutiérrez Virtual and Augmented Reality Introduction

 Augmented Reality
Virtual Reality

AR - Microsoft Hololens 1/3

https://www.microsoft.com/en-us/hololens

Byron Alfonso Pérez-Gutiérrez Virtual and Augmented Reality Introduction

 Augmented Reality
Virtual Reality

Ar - Microsoft Hololens 2/3

https://www.microsoft.com/en-us/hololens

Byron Alfonso Pérez-Gutiérrez Virtual and Augmented Reality Introduction

 Augmented Reality
Virtual Reality

AR - Microsoft Hololens 3/3

https://www.microsoft.com/en-us/hololens

Byron Alfonso Pérez-Gutiérrez Virtual and Augmented Reality Introduction

 Augmented Reality
Virtual Reality

AR - Mobile devices 1/2

Location of places of interest

https://cdn-images-1.medium.com/max/1600/1*K4v3T5GcJVDAxm3IOJ9mQw.jpeg

Byron Alfonso Pérez-Gutiérrez Virtual and Augmented Reality Introduction

 Augmented Reality
Virtual Reality

AR - Mobile devices 2/2

IKEA product catalog.

https://www.ikea.com/gb/en/customer-service/ikea-apps/

Byron Alfonso Pérez-Gutiérrez Virtual and Augmented Reality Introduction

 Augmented Reality
Virtual Reality

AR - CAD
Computer Aided Design (CAD) with AR

https://blog.metavision.com/meta-announces-new-augmented-reality-integration-with-solidworks
Byron Alfonso Pérez-Gutiérrez Virtual and Augmented Reality Introduction
 Augmented Reality
Virtual Reality

AR - Robotics

Industrial robot programming with AR.

Araque, D., Díaz, R., Pérez-Gutiérrez, B., Uribe, A. J. (2011, March). Augmented reality motion-based
robotics off-line programming. In Virtual Reality Conference (VR), 2011 IEEE (pp. 191-192). IEEE.

Byron Alfonso Pérez-Gutiérrez Virtual and Augmented Reality Introduction

 Augmented Reality
Virtual Reality

Virtual Reality

Byron Alfonso Pérez-Gutiérrez Virtual and Augmented Reality Introduction

 Augmented Reality
Virtual Reality

Virtual Reality (VR)

¿What is Virtual Reality?

“A high-end user-computer interface that involves real-time
simulation and interaction through multiple sensorial channels.”
(vision, sound, touch, smell, taste)” - Burdea 2003

http://conferences.computer.org/vr/2010/

Byron Alfonso Pérez-Gutiérrez Virtual and Augmented Reality Introduction

 Augmented Reality
Virtual Reality

Morton Heilig’s Sensorama - 1962

3D movie
Smell
Stereo sound
Seat vibrations
Wind

http://www.mortonheilig.com/
Video: https://www.youtube.com/watch?v=vSINEBZNCks

Byron Alfonso Pérez-Gutiérrez Virtual and Augmented Reality Introduction

 Augmented Reality
Virtual Reality

Reality - Virtuality

From physical reality to virtual reality through imagination.

http://www.osmifw.com/arthroscopy/knee-surgeon-fort-worth/
https://openclipart.org/detail/279682/thinking-v1-animation
Rasool S., Sourin A. Image-driven virtual simulation of arthroscopy, The Visual Computer, Springer,
29(5): 333-355, 2013.
Video: https://www.youtube.com/watch?v=PZjC5P_gPRE

Byron Alfonso Pérez-Gutiérrez Virtual and Augmented Reality Introduction

 Augmented Reality
Virtual Reality

Surgery simulator

S. Ullrich, T. Kuhlen. Haptic Palpation for Medical Simulation in

Virtual Environments. Best paper IEEE Virtual Reality 2012
Video: https://www.youtube.com/watch?v=M0YpjNUBOY4

Byron Alfonso Pérez-Gutiérrez Virtual and Augmented Reality Introduction

 Augmented Reality
Virtual Reality

Blocks of a VR Systems

Virtual Input / Output

Reality
Engine Devices

Software
& User
Databases

Tasks

Byron Alfonso Pérez-Gutiérrez Virtual and Augmented Reality Introduction

 Augmented Reality
Virtual Reality

Virtual Reality components

Byron Alfonso Pérez-Gutiérrez Virtual and Augmented Reality Introduction

 Augmented Reality
Virtual Reality

The 3 I’s of Virtual Reality

Burdea 2003. Virtual Reality Technology

Byron Alfonso Pérez-Gutiérrez Virtual and Augmented Reality Introduction

 Augmented Reality
Virtual Reality

Human body senses and VR systems

Main senses:
Sight: 3D vision; VR helmets, 3D screens and glasses, CAVE
Touch: Haptic devices; force and touch feedback
Hearing: 3D sound; stereo, binaural and 5.1 systems
Smell: Olfactory displays
Taste: Gustatory displays
Otro sentido:
Proprioception: sense of movement and position of our limbs
and muscles

Byron Alfonso Pérez-Gutiérrez Virtual and Augmented Reality Introduction

 Augmented Reality
Virtual Reality

Proprioception - Degrees of Freedom

Translations and rotations

Tx , Ty , Tz , Rx , Ry , Rz

Byron Alfonso Pérez-Gutiérrez Virtual and Augmented Reality Introduction

 Augmented Reality
Virtual Reality

Proprioception - Complete body interaction

Tuukka M. Takala, Mikael Matveinen. (2014). Full Body Interaction in Virtual Reality with Affordable
Hardware.
Video: https://youtu.be/wMEaJWsowfQ

Byron Alfonso Pérez-Gutiérrez Virtual and Augmented Reality Introduction

 Augmented Reality
Virtual Reality

Sense of sight - Oculus

Head Mounted Display - HMD: Oculus Rift

https://i.blogs.es/ae761a/oculus/450_1000.jpg
https://www.oculus.com
Byron Alfonso Pérez-Gutiérrez Virtual and Augmented Reality Introduction
 Augmented Reality
Virtual Reality

Sense of sight - HTC Vive

https://www.vive.com

Byron Alfonso Pérez-Gutiérrez Virtual and Augmented Reality Introduction

 Augmented Reality
Virtual Reality

Sense of sight - Oculus Gear VR

https://www.oculus.com

Byron Alfonso Pérez-Gutiérrez Virtual and Augmented Reality Introduction

 Augmented Reality
Virtual Reality

Sense of sight - Google Cardboard

https://vr.google.com/cardboard/

Byron Alfonso Pérez-Gutiérrez Virtual and Augmented Reality Introduction

 Augmented Reality
Virtual Reality

Sense of sight- VR Box

Byron Alfonso Pérez-Gutiérrez Virtual and Augmented Reality Introduction

 Augmented Reality
Virtual Reality

Touch - Haptic and power information flow

Srinivasan, M. A., & Basdogan, C. (1997). Haptics in virtual environments: Taxonomy, research status,
and challenges. Computers & Graphics, 21(4), 393-404.

Byron Alfonso Pérez-Gutiérrez Virtual and Augmented Reality Introduction

 Augmented Reality
Virtual Reality

Touch and sight - CAVE with haptics

Pitstop Simulator was created by Clarté and Haption with 3DVIA

Virtools and showcased at Laval Virtual 2008
Video: https://www.youtube.com/watch?v=dCNw_e_zx-c

Byron Alfonso Pérez-Gutiérrez Virtual and Augmented Reality Introduction

 Augmented Reality
Virtual Reality

Sense of touch - Myo

Electromyography sensor
9-axis inertial measurement unit: 3-axis gyroscope 3-axis
accelerometer 3-axis magnetometer
Processor ARM Cortex M4 and bluetooth

Byron Alfonso Pérez-Gutiérrez Virtual and Augmented Reality Introduction

 Augmented Reality
Virtual Reality

Sense of touch - Leap motion

https://www.leapmotion.com/

Byron Alfonso Pérez-Gutiérrez Virtual and Augmented Reality Introduction

 Augmented Reality
Virtual Reality

Sense of touch - Myocardium palpation

L. Vega-Medina. Prototipo de simulador de corazón basado en miocardio humano para educación

médica. Universidad Antonio Nariño. 2017

Byron Alfonso Pérez-Gutiérrez Virtual and Augmented Reality Introduction

 Augmented Reality
Virtual Reality

Sense of hearing - 3D Audio

Burdea 2003. Virtual Reality Technology

Byron Alfonso Pérez-Gutiérrez Virtual and Augmented Reality Introduction

 Augmented Reality
Virtual Reality

Sense of smell

Nakamoto, Otaguro. Cooking up an interactive olfactory game

display. Tokio Institute of Technology. 2008.

Byron Alfonso Pérez-Gutiérrez Virtual and Augmented Reality Introduction

 Augmented Reality
Virtual Reality

Sense of smell - Nosulus Rift

Ubisoft. Nosulus Rift. http://nosulusrift.ubisoft.com/

Byron Alfonso Pérez-Gutiérrez Virtual and Augmented Reality Introduction

 Augmented Reality
Virtual Reality

Sense of taste

http://nimesha.info/
Nimesha Ranasinghe, Ryohei Nakatsu, Nii Hideaki, and Ponnampalam Gopalakrishnakone.Tongue
Mounted Interface for Digitally Actuating the Sense of Taste, in Proceedings of the 16th IEEE
International Symposium on Wearable Computers (ISWC), June 2012, pp. 80-87. DOI: 10.1109
ISWC.2012.16, ISSN: 1550-4816.

Byron Alfonso Pérez-Gutiérrez Virtual and Augmented Reality Introduction

 Augmented Reality
Virtual Reality

Applications
Industry, Medicine, Architecture, Biology, Astronomy, Education,
Entertainment ....

Byron Alfonso Pérez-Gutiérrez Virtual and Augmented Reality Introduction

 Augmented Reality
Virtual Reality

Questions?

EALIDA
ER D
D

V
O

IR
CENTR

T UA L
U.M .G.
.N

Byron Alfonso Pérez-Gutiérrez Virtual and Augmented Reality Introduction