Lecture5

Give AR characteristics?

 Real and virtual environment combined in Real-Time

 The combination “matches” perfectly
 Interaction with virtual elements in real-time

Give the different AR incarnations?

 Hand held
 Spatial
 Head worn

What is AR according to Azuma?

He defines AR as systems with three characteristics:

 Combines real and virtual world

 Is interactive in real time
 Is registered in 3 dimensions

According to Milgram et al. give the definition of mixed reality?

What is AV in mixed reality?

Real elements added to virtual world

What is AR in mixed reality?

Virtual elements added to real world

What are the main problems in Milgram’s definition?

 Multimodality?
 Application/usage?
 Multi-users

Give an example where for two different systems that are at the same spot on the
continuum the user experience would differ a lot?

Head mounted display, handheld display with same visuals and audio and everything exactly
the same. However, phone vs head mounted display are completely different in terms of
user experience.

Exam based: know what type of AR we can create with each incarnation?
What is the AR interaction loop?

Calibration, registration & tracking>>>>simulation>>>> Feedback>>>>>Control.

What is important in head tracking of AR?

 Head orientation (for correct perspective)

 Real-world information (for accurate placement)

Analyze calibration, registration and tracking?

 Registration : alignment of spatial properties (basically align objects of virtual and

real world)
 Calibration : offline adjustment of measurements (to check and adjust a sensors
accuracy)
 Tracking (continuous update in real time of position and orientation of ar display to
real objects)

VR/AR comparison :

 AR need less rendering (only parts of the world)

 Accurate visualization is much harder than VR (real world influence occlusion)
 Tracking and sensing is usually much harder (needs high precision)

Key notes:

AR: know what to use when and what you can or cant do given certain circumstances and
goals

Differences between ar & vr

Which characteristics do sensors have that are used for tracking in AR?

 Sensors that gives numbe of DOF

 Global vs local (sensor to understand changes in AR enviroment)
 Absolute vs Relative (sensor that gives this information)

What are the requirements for successful tracking in AR?

 High accuracy and precision, no jitter (noise, instability)

 Low latency (delay)
 High resolution and high update (min. 10fps)
 Low price

Name the tracking approaches in AR?

 Sensor based (GPS tracking using accelometers and gyroscopes)

 Optical (computer vision needed to see the enviroment)
 Other (tracking via markers)

What is the use of an accelerometer?

It measures acceleration of rotation in respect to gravity.

What is the use of a gyroscope?

Measures rotation rate of rotation better than accelerometers but drift over time.

What is the use of magnetometer?

Measures strength and direction of earths magnetic field

Marker tracking vs natural tracking in optical tracking?

Markers: must be installed, must be fully visible

Natural tracking : must be partly visible, natural features must be known

(((((Marker tracking usually uses black and white features cause of contrast () while in
natural tracking you need texture and when some amount of the same texture appears over
the screen the object is recognized as a flat surface ))))))

What are the issues of marker and natural tracing?

They don’t adapt well in size/distance and angle changes and they have high latency.

Which are the most common forms of tracking in AR?

 Inertial (gyroscope,accelometer)
 Optical (marker based, natural feature based)
 Structured light cameras
 others