Intel® RealsensE™

Depth Camera technology

Machine Vision Technology Forum 2017
Miro Mlejnek
Technical Sales Manager, New Technology Group, Intel® Corporation
Legal Disclaimer
INFORMATION IN THIS DOCUMENT IS PROVIDED IN CONNECTION WITH INTEL PRODUCTS. NO LICENSE, EXPRESS OR IMPLIED, BY ESTOPPEL OR
OTHERWISE, TO ANY INTELLECTUAL PROPERTY RIGHTS IS GRANTED BY THIS DOCUMENT. EXCEPT AS PROVIDED IN INTEL'S TERMS AND CONDITIONS OF
SALE FOR SUCH PRODUCTS, INTEL ASSUMES NO LIABILITY WHATSOEVER AND INTEL DISCLAIMS ANY EXPRESS OR IMPLIED WARRANTY, RELATING TO SALE
AND/OR USE OF INTEL PRODUCTS INCLUDING LIABILITY OR WARRANTIES RELATING TO FITNESS FOR A PARTICULAR PURPOSE, MERCHANTABILITY, OR
INFRINGEMENT OF ANY PATENT, COPYRIGHT OR OTHER INTELLECTUAL PROPERTY RIGHT.
A "Mission Critical Application" is any application in which failure of the Intel Product could result, directly or indirectly, in personal injury or death. SHOULD
YOU PURCHASE OR USE INTEL'S PRODUCTS FOR ANY SUCH MISSION CRITICAL APPLICATION, YOU SHALL INDEMNIFY AND HOLD INTEL AND ITS
SUBSIDIARIES, SUBCONTRACTORS AND AFFILIATES, AND THE DIRECTORS, OFFICERS, AND EMPLOYEES OF EACH, HARMLESS AGAINST ALL CLAIMS COSTS,
DAMAGES, AND EXPENSES AND REASONABLE ATTORNEYS' FEES ARISING OUT OF, DIRECTLY OR INDIRECTLY, ANY CLAIM OF PRODUCT LIABILITY,
PERSONAL INJURY, OR DEATH ARISING IN ANY WAY OUT OF SUCH MISSION CRITICAL APPLICATION, WHETHER OR NOT INTEL OR ITS SUBCONTRACTOR
WAS NEGLIGENT IN THE DESIGN, MANUFACTURE, OR WARNING OF THE INTEL PRODUCT OR ANY OF ITS PARTS.
Intel may make changes to specifications and product descriptions at any time, without notice. Designers must not rely on the absence or characteristics of any
features or instructions marked "reserved" or "undefined". Intel reserves these for future definition and shall have no responsibility whatsoever for conflicts or
incompatibilities arising from future changes to them. The information here is subject to change without notice. Do not finalize a design with this information.
The products described in this document may contain design defects or errors known as errata which may cause the product to deviate from published
specifications. Current characterized errata are available on request.
Contact your local Intel sales office or your distributor to obtain the latest specifications and before placing your product order.
Code names featured are used internally within Intel to identify products that are in development and not yet publicly announced for release. Customers,
licensees and other third parties are not authorized by Intel to use code names in advertising, promotion or marketing of any product or services and any such
use of Intel's internal code names is at the sole risk of the user.

*Other names and brands may be claimed as the property of others.

Copyright © 2017, Intel Corporation. All rights reserved.

2
Content
• Intel® RealSense™ Technology
 Introduce
 Market Focus
 D400 Series of Products
• Intel® RealSense™ Depth Cameras
 Overview and Positioning
 Product Brief
 Software
 Roadmap
• Product Briefs

3
 Intel® RealSense™
Technology
Intel® RealSense™ Technology is a leader in
bringing human like depth sensing and
intelligence to devices and machines

4
 Stereo Matching

• Triangulation reveals depth:

 Internal geometric calibration

 Relative orientation calibration

 Pixel matching

5
WHAT IS DEPTH?
Color Image from a Color Camera: Depth Image from a Depth Camera:
Each PIXEL has a Color (Red-Green-Blue) Value Each PIXEL has a Depth (distance from camera) Value

The Depth Map conveys the distance information between points on an object's surface and the camera

6
HOW CAN THIS DATA BE USED?

Sense and Capture Visualize & Process Integrate into

Applications & Products

SDK Tools for Intelligence

prototyping from depth Devices and applications that
Raw Depth Map information can use this data – Ex. Robots,
Samples Codes & APIs 3D Scans/ Models,
for applications Person/Object tracking,
background segmentation,
Design & Validation Collision Avoidance etc.

Enhanced Depth perception enables smarter devices and applications across multiple
target markets
7
 Market Focus

Mobile Phones Robotics Broad Market

Virtual Reality Drones Autonomous Driving

8
Intel® RealSense™ D400 Series Value Proposition

Integrate Enhanced Depth Perception

Vision Libraries for intelligence

Intel® RealSense SDK 2.0 and
into products

Intel® RealSense™
Make Smart Devices Smarter with
Vision Processor D400 Series

Bolster your Prototype with D400

Intel® RealSense™ Depth Series Computer Vision
Modules D400 Series

Develop Applications with Ease

Intel® RealSense™ Depth

Cameras D400 Series
9
Intel® RealSense™ D400 Family Solutions
Intel® RealSense™ Depth Camera Intel® RealSense™ Depth Module D400 Series with
Intel® RealSense™ Vision Processor D4 based card

Recommended for: Recommended for:

Academia, Makers, Enthusiasts, System Integrators, Customers that need tight integration, but are not
Product integration for <10K units designing a custom board

Intel® RealSense™ Depth Module D400 Series with Intel® RealSense™ Vision Processor D4
Intel® RealSense™ Vision Processor D4

Recommended for: Recommended for:

Customers that need tight integration and are designing Custom designs and those with experience building
their own board for maximum efficiency camera modules

10
Introducing the New D400 Series Depth Cameras
Intro
Our new generation depth
cameras brings superior
capabilities – better algorithms,
wider range of lighting, better
use of visible light, higher
accuracy depth
Intel® RealSense™ Depth Cameras
D415/D435
Intel® RealSense™
Depth Camera D415/D435 • The two cameras are supersets of the
functionality of our offered modules
• Higher resolution depth of up to
1280x720
• Frame rates up to 90 FPS
• Improved range (10m+)*
D400 Series
• High accuracy & large Field of View
• Best performance in sunlight &
outdoor environments
D400 Series
* Varies depending on performance accuracy, scene and light conditions
11
 Providing a path to System Integration
Modules Intel® RealSense™ Depth Camera D415
Intel® RealSense™
Module
Description Intel® RealSense™ Depth Camera D435
The Intel® RealSense™ Depth Camera D415
D400 Series and D435 Differences:
D400 Passive, Stereo, Rolling Shutter
Depth Field of View
• D415 (H x V x D) 69.4 x 42.5 x 77
D400 Series • D435 (H x V x D) 91.2 x 65.5 x 100.6
D410 Active, Stereo, Rolling Shutter Intel® RealSense™ Shutter Technology

D400 Series Camera D415 • D415 has rolling shutter

• D435 has a global shutter
D415 Active, Stereo, Rolling Shutter + RGB (D4 vision Processor + D415 Module)
Pricing
• D415 $TBD Retail
• D435 $TBD Retail
D400 Series
D420 Passive, Wide Stereo, Global Shutter
Application
• D415 general all around depth camera
• D435 provides wider field of view and better
D400 Series high speed image capture
D430 Active, Wide Stereo, Global Shutter
Intel® RealSense™
Camera D435
(D4 Vision Processor + D430 Module + RGB Camera)

* Photo from FLIR Website

12
Two Form Factors for Series D400 Depth Camera
Boxed Camera
Developer/starter kit
Single Box Camera
USB cable, Mount accessories included
Developer toolkit:
• Broad API support, sample codes
• Broad SW framework support
Boxed camera shortens development timeline
Developers, makers/enthusiasts,
academia
Camera to be packaged as single
unit for development or in bulk
for product integration
Value Prop
Target Audience
Bundled Cameras
System Integration
Bulk packaging (MOQ of 30)
No accessories
Same form factor as single box kit but at
lower per cost per unit
Ideal to embed into designs
Bulk Pack camera provides easy migration
from prototype to production
Start-ups, system integrators
13
 Intel® RealSense™ SDK 2.0 Coming Soon

 Open Source, Cross Platform support for rapid development

 Intel® RealSense™ Vision Libraries & Apps
 Available on GitHub and release.intel.com/develop
Tools Examples
Intel® RealSense™ Viewer

Intel® RealSense™ Depth Quality Test Tool

for Intel RealSense Camera
Capture, PointCloud Depth color
Debug Tools Multi Cam Alignment

3rd Party Wrappers* Intel® RealSense™ Dynamic Calibration

Calibration Read/Write Data guidance
Device Firmware update tool for Intel®
RealSense™ Technology

* Some/all 3rd party wrappers may not be available at the same time. Please check GitHub for availability

Intel® RealSense™ SDK 2.0 enables rapid prototyping & application development
14
* Other names and brands may be claimed as the property of others
Intel® RealSense™ SDK 2.0 – Tools
Intel® RealSense™ Depth Quality Test Debug Tools
Viewer tool for Intel®
RealSense™ camera

Capture, View and Test Setup with camera

Manipulate Depth Streams position and target Data Collection

Playback/Record Control settings– resolution, FW logger

gain, exposure, distance to
3D PointCloud target, error etc. Terminal access

Presets, Filtering, Optical Calculate z-accuracy, Camera Enumeration

Power standard deviation

Interact and Process your data seamlessly

15
* Other names and brands may be claimed as the property of others
Intel® RealSenseTM sdk 2.0 - EXAMPLES
Librealsense/examples:
rs-capture  Access multiple streams – left & right imagers, depth and RGB
rs-multicam  Run multiple cameras
rs-capture-2disk  Dynamic and Fixed Range
Capture  Capture frames and write last frame to disk

Librealsense/examples:
rs-pointcloud  View, Manipulate Pointcloud, add texture, color overlays

PointCloud

Librealsense/examples/  2 depth levels for background replacement

depth-color-alignment

Depth Color
Alignment

Librealsense/examples/  Acquire, Display Color frame, Display IR frame

opencv

Embed Sample codes into your Applications with Ease

16
Intel® RealSense™ SDK 2.0 – 3rd party API Wrappers
 Intel® RealSense™ wrappers supporting sample apps for Example-displaying IR frame
capturing, viewing and manipulating depth & RGB streams
1 Code snippet from IR_sample.cpp
 All RealSense APIs will be supported for platforms below

Programming Lang/ Wrappers

2 Compile and run

3 Result

Access RealSense APIs on the framework of your choice

17
* Other names and brands may be claimed as the property of others
 Available, Sell Now

Segment roadmap - Hardware POR, Not Launched

2017 2018
Q1 Q2 Q3 Q4 Q1 Q2 Q3 Q4

RealSense™ Camera SR300

Creative SR300 Dev Kit

RealSense™ Camera R200 RealSense™ Depth Camera D400 series

Creative R200 Dev Kit
Intel® RealSense™ Depth Camera D415*
Intel R200 Dev Kit
Intel® RealSense™ Depth Camera D435*
Aaeon Robotic Dev Kit
RealSense™ Camera ZR300

ZR300 Dev Kit*

RealSense™ AIO Device based on LR200 and TM1 non-POR variants

Euclid

*Depth Cameras D415 and D435 will replace all current SKUs from previous generations.

18
Intel® RealSense™ Depth Camera D415 Camera Features
Use Environment Indoor/Outdoor
Depth Technology Active IR Stereo (Rolling Shutter)
Depth FOV (H x V x D) 69.4 x 42.5 x 77
Depth Output Resolution & Up to 1280x720
Frame Rate Up to 90fps
Minimum Depth Distance (Min-Z) 0.3m
10m+. Varies depending on performance accuracy,
Maximum Range
scene and light conditions
RGB Resolution 1080p @ 30fps

Major Components
Camera Module Intel® RealSense™ Module D415
Product Description
Vision Processor Card Intel® RealSense™ Vision Processor D4
The Intel® RealSenseTM Depth Camera D415 is an USB-powered camera that
includes depth sensors and a RGB sensor. It is ideal for makers, educators,
Physical
hardware prototyping and software development. The camera is designed for ease
of setup and portability. This camera is designed for to cover a wide range of uses Form Factor Camera Peripheral
including indoor/outdoor. It is ideal if you are wanting to add depth to your Connectors USB3.0
product or try it for the first time!
Product Dimension Length x
99mm x 20mm x 23mm
Depth x Height.
The Intel® RealSenseTM Depth Camera D415 comes with the Intel® RealSense™ SDK
2.0 enabling multiple computing languages and wrappers, sample code and tools. Target Applications
Getting Started Scanning Object or People tracking
To buy: Please contact Intel® Authorized Distributor. Robotics Control via Motion
• MM#: 961443 Single Units with camera, cable and tripod (ship to 55 countries)
Depth Capture Object avoidance
• MM# 962304 Bulk Packs of just the camera (MOQ 30)
To develop: Quick prototyping with depth Availability to embed into your product
• Intel® RealSense™ SDK 2.0 (https://github.com/IntelRealSense)

20
Intel® RealSense™ Depth Camera D435 Camera Features
Use Environment Indoor/Outdoor
Depth Technology Active IR Stereo (Global Shutter)
Product Description Depth FOV (H x V x D) 91.2 x 65.5 x 100.6
The Intel® RealSenseTM Depth Camera D435 is an
USB-powered camera that includes wider field of Depth Output Resolution & Up to 1280x720
Frame Rate Up to 90fps
view depth sensors and a RGB sensor. It is ideal
for makers, educators, hardware prototyping and Minimum Depth Distance (Min-Z) 0.2m
software development. The camera is designed 10m+. Varies depending on performance accuracy,
Maximum Range
for ease of setup and portability. Perfect if you scene and light conditions
are doing capture with fast motion – global RGB Resolution 1080p @ 30fps
shutter allows for this. Virtual Reality is a good
example. Major Components
The Intel®RealSenseTM Depth Camera D435 comes Intel® RealSense™ SDK 2.0 Camera Module Intel® RealSense™ Module D430 + RGB Camera
enabling multiple computing languages and wrappers, sample code and tools. Vision Processor Card Intel® RealSense™ Vision Processor D4

D435 compared to D415 Physical

The D435 is different from the
D415 in it has global shutter IR Form Factor Camera Peripheral
cameras for better capture of fast Connectors USB3.0
moving scenes. It also has an Product Dimension Length x
additional 20⁰ depth field of view to 90mm x 25mm x 25mm
Depth x Height.
capture more of the environment.
* Photo from FLIR Website
Target Applications
Getting Started Scanning/Depth Capture Object or People tracking
To buy: Please contact Intel® Authorized Distributor.
• MM#: 961448 Single Units with camera, cable and tripod (ship to 55 countries) Robotics Control via Motion
• MM# 962305 Bulk Packs of just the camera (MOQ 30) to develop Virtual reality Object avoidance
To develop:
• Intel® RealSense™ SDK 2.0 (https://github.com/IntelRealSense) Quick prototyping with depth Availability to embed into your product

* Other names and brands may be claimed as the property of others

21
* Other names and brands may be claimed as the property of others
 Intel® RealSense™ Development Kit sR300
Camera Features
Use Environment Indoor
Depth Technology Coded Light
Depth Resolution & Frame Rate VGA @ 60 fps
Depth FOV (D×V×H) 90x59x73
Depth Output Resolution &
Up to 640×480 @ 60 fps
Frame Rate
Minimum Depth Distance (Min-Z) 0.2m
Maximum Range 1.5m. Varies depending on light conditions
RGB Resolution 1080p @ 30fps
Product Description
The Intel® RealSenseTM Development Kit SR300 is a USB-powered camera that
includes a depth sensor and an RGB sensor. It is ideal for makers, educators, Major Components
hardware prototyping and software development. The development kit is
designed for ease of setup and portability. Camera Module Intel RealSense camera SR300
Interposer board Enable connection to host platform
The Intel® RealSense™ SR300 Development Kit comes with Intel® RealSense™
Software Development Kit (SDK) for Windows
Physical
Getting Started Form Factor Camera Peripheral
To buy: Please contact Intel® Authorized Distributor.
• MM#: 945581 (ship to 55 countries) Connectors USB3.0 Micro type B connector on peripheral
To develop: Box Dimension 103mm x 50mm x 156mm
• Win: https://software.intel.com/sites/default/files/Getting_Started_0.pdf
• Linux: https://github.com/IntelRealSense/librealsense

22
* Other names and brands may be claimed as the property of others
23