Mixed

Reality with Microsoft HoloLens

Philipp Bauknecht, 11/15/2016
goto; conference Berlin
Image: microsoft.com/hololens
Philipp Bauknecht
Founder & CEO
medialesson GmbH
@GrillPhil

4x
AR vs. VR vs. MR
Virtual Reality Augmented Reality Mixed Reality
Virtual Reality Augmented Reality Mixed Reality

Image: gospelherald.com Image: parenting.blog.austin360.com Image: littleover.derby.sch.uk

Virtual Reality Augmented Reality Mixed Reality

Immersion Immersion Immersion

Comfort Comfort Comfort

Collaboration Collaboration Collaboration

Mobility Mobility Mobility

Holograms
What is a Hologram?
• A hologram is an object like any other object in the real world, with
only one difference: instead of being made of physical matter, a
hologram is made entirely of light.

• Holographic objects can be viewed from different angles and

distances, just like physical objects.

• Holograms do not offer any physical resistance when touched or

pushed because the don‘t have any mass.
Image: Lucasfilm
Image: Marvel/Paramount Pictures
Microsoft HoloLens
Mixed Reality + Virtual Reality

Spatial Mapping

Fully unthered

Runs Windows 10

Interaction using gaze, gestures

and voice
 Volume up/down

Brightness up/down

Build-in speakers
Spatial audio
Intel Atom CPU
Custom-build Holographic
Processing Unit (HPU)
Battery 2-3 hours of active use
579g Fully functional when charging
Passively cooled (no fans)
64GB Flash
2GB RAM See-through holographic lenses (waveguides)
2 HD (720p) 16:9 light engines
Wi-Fi 802.11ac Automatic pupillary distance calibration
Bluetooth 4.1 LE Image: microsoft.com
 4 Environment understanding cameras

2MP photo& HD video camera

depth camera

Micro USB 2.0

Audio 3.5mm jack

4 Microphones
Ambient light sensor
Image: microsoft.com
Use scenarios
 Marketing

Image: microsoft.com
 Product Design

Image: microsoft.com
 Education

Image: microsoft.com
 Architecture

Image: microsoft.com
 Remote Services

Image: microsoft.com
 Research & Science

Image: microsoft.com
 Games & Entertainment

Image: microsoft.com
 Semi-virtual
Construction

Image: microsoft.com
Current Projects
Live Demo
Development
Tooling
• Visual Studio 2015 with Update 3 (free as Community Edition)
Pro tip: Make sure to pick Tools (1.4) and SDK (10.0.10586) of the Universal Windows App Development Tools when
doing a custom install.

• HoloLens Emulator

• Unity 5.5.0b11 (as of November 9th)

Pro tip: Do not use the HoloLens Technical Preview builds of Unity as they are outdated and broken.
Framework options
• All apps are Universal Windows Platform (UWP) apps

• Raw power: DirectX 11 using C++ or C# with SharpDX

• Easy to prototype and build: Unity using C#
 App view options

Holographic View 2D View

Image: microsoft.com Image: microsoft.com
 App view options
Holographic View 2D View
• Creates holograms • Renders on a slate
• No other app can draw at the same • Slates are world-locked and can be
time adjusted in size and position by the
• Can render world-locked holograms user
• Shell does not render at the same time • Apps resolution stays fixed
• App is responsible to handle all user • Apps have to switch into 2D view for
input. keyboard entry
• All UWP apps run in 2D view without
modifications

Image: microsoft.com Image: microsoft.com

Development workflow using Unity
1. Use Unity to layout your scenes, place holograms, camera and light
2. Develop components using Visual Studio.
3. Export the project from Unity as Visual Studio Solution. You will
still be able to modify scripts but not a scene.
4. Deploy app to the Emulator or your real device.
Demo Workflow
Where to start
1. Grab the tools
2. Attend the free Holographic Academy online
https://developer.microsoft.com/EN-
US/WINDOWS/HOLOGRAPHIC/ACADEMY
3. Deep dive into the Holographic App Development documentation
https://developer.microsoft.com/en-
us/windows/holographic/documentation
4. Check you open source Galaxy Explorer app on GitHub
https://github.com/Microsoft/GalaxyExplorer
5. Submit your first app to the Windows Store
How to buy
Availabily Order online at microsoftstore.com
• Australia
• Canada Developer Edition
• Ireland 3.299 EUR incl. VAT
• France
• Germany
Commercial Suite
• New Zealand
5.489 EUR incl. VAT
• United Kingdom
• United States
Thanks. Questions?