You are on page 1of 21

LiDAR Technology

An in-depth look at the remote sensing technology


LiDAR in the autonomous vehicle sector.
Introduction

Self-driving cars are poised to revolutionize the


transportation industry. At the heart of autonomous
technology is LiDAR (light detection and ranging), a vehicle-
vision system that measures distance by illuminating
a target using light and lasers as its primary sensor;
automotive LiDAR sensors are what allow driverless cars to
see. The LiDAR market size is projected to grow from USD
844 million in 2019 to USD 2,273 million by 2024, at a CAGR
of 18.5 percent from 2019 to 2024.

Some researchers claim that, without LiDAR’s capabilities,


self-driving vehicles could not progress much further than
what the Society of Automotive Engineers (SAE) terms
Autonomy Level 3 capabilities. General Motors, Ford, Audi,
Porsche, Volvo, Google’s subsidiary Waymo and many many
more vehicle manufacturers have integrated or invested
in LiDAR. However, not everyone is convinced that LiDAR
is the superior technology for providing self-driving cars a
360-view. Tesla’s well-known founder Elon Musk has said
that “Anyone relying on LiDAR is doomed.” And he’s backed
up by Tesla’s AI guru Andrej Karpathy who claims that “LiDAR
is a shortcut.”

This eBook provides an in-depth description of LiDAR


technology and its applications. It also lists the leading
LiDAR companies worldwide and looks at what vehicle
manufacturers have invested in or integrated LiDAR.
Furthermore, this eBook provides insights into where the
Automotive LiDAR industry is headed.

LiDAR | 2
Table of Content

4 What is LiDAR, and how does it work?

7 Why LiDAR is superior to other technologies

10 LiDAR is getting cheaper—but it’s still too


expensive for production vehicles

13 Top LiDAR companies in the automotive


industry

17 Snapshot: Japanese LiDAR supplier Pioneer

20 Looking ahead

LiDAR | 3
What is LiDAR,
and how does it work?

As cars begin to drive on their own, obstacle detection


and avoidance remain critical technical hurdles standing
in the way of fully autonomous operation. LiDAR is one
technology that can enable this, but the development of
low-cost LiDAR systems is still in its infancy.

LiDAR | 4
LiDAR is a remote sensing technology that uses light pulses to detect sudden changes in its
surrounding environment. It enables autonomous vehicles to travel smoothly and avoid collisions.

Similar to radar, LiDAR is a driving cars. In fact, it’s likely that


measurement and range finding without LiDAR’s capabilities, self-
technique originally developed in driving vehicles could not progress
the 1960s. Useful for military and much further than what the Society
aerospace applications where precise of Automotive Engineers (SAE) terms
accuracy over long distances was Autonomy Level 3 capabilities, or
needed, this technology ultimately limited “eyes-off driving.”
found its way into meteorology and
robotics. How it works
LiDAR is a combination of laser
But LiDAR’s potential application scanning and 3D imaging. Car-based
in vehicles portends a much larger LiDAR systems make use of invisible,
marketplace that could be worth as eye-safe laser beams (low-power
much as $2.5 billion on its own by ones, like those used at grocery
2030. store checkout counters). These are
emitted from transmitters attached
Where does the word LiDAR to a vehicle and bounce off all objects
originate? located within a maximum of 500
LiDAR stands for Light Detection and meters. Such objects can be either
Ranging; originally, the word was a stationary or moving.
portmanteau of the words “light” and
“radar.” LiDAR has many applications, A typical system, such as those
but it’s particularly applicable to self- supplied by industry vendor Velodyne,

LiDAR | 5
uses between eight and 128 individual By getting distance data for every
laser beams to perform this function. surrounding object, a LiDAR system
can detect if a collision is imminent
Processors on the vehicle time how and warn a vehicle’s driver as early as
long the beams take to reflect off possible. In the near future, signals
the objects and return to the LiDAR’s could be sent to autonomous driving
sensors. Then, the system uses systems to automatically activate
formulas to calculate how far the steering, braking, acceleration,
objects are away from the vehicle. and other mechanisms. Thus, a
vehicle could intelligently navigate
By emitting many beams and around obstacles and/or forestall
constantly scanning the surrounding collisions. Even if objects are moving
environment in 360 degrees, one or (pedestrians or other vehicles, for
more LiDAR sensors can compile a 3D instance), their speed and trajectories
image of everything surrounding the can be calculated and taken into
vehicle they’re attached to. account.

Sensors are being widely used in the autonomous vehicles to control braking, speeding,
and safety systems in response to changes in the external environment.

LiDAR | 6
Why LiDAR is superior
to other technologies

Lidar is the preferred technology of Waymo, one of the


heavy-hitters in self-driving cars. “LiDAR bounces a laser
off an object at an extremely high rate—millions of pulses
every second—and measures how long the laser takes to
reflect off that surface. This generates a precise, three-
dimensional image of the object, whether a person,
vehicle, aircraft, cloud, or mountain,” says Waymo’s lidar
fact sheet.

LiDAR | 7
In March 2019, Waymo started selling standalone LiDAR sensors.

Because of the way it functions, A third reason for LiDAR’s superiority


LiDAR is often seen as superior to is that, depending on how advanced
other environmental sensor systems it is, it can work at night or under
that rely on video cameras or radar. harsh weather and environmental
Both of these latter methods are used conditions, such as snow, rain, hail,
for autonomous Advanced Driver- fog, smoke, etc.
Assistance Systems (ADAS) functions,
including adaptive cruise control, lane- Essentially, the combination of LiDAR
keeping, and parking. sensing and intelligent decision-
making approximates how the
One reason for this superiority is human brain processes locomotion.
because both cameras and radar still Regardless of whether a person is a
have blind spots. Another reason driver in a vehicle, a rider on a bicycle,
LiDAR can be better is that it scans at or simply a pedestrian on foot, the
extremely high resolution, and with brain is constantly taking in visual
decent computing intelligence, it can information and cues and reassessing
potentially identify numerous short- risks from external objects and
range objects. obstacles. It then tells the body to
take proactive or reactive action as
This identification can filter disparate necessary to maintain safety while it
objects into those that might pose a continues to move forward.
threat (such as anything moving, for
instance) and those that are simply Most people probably take for granted
part of the surrounding landscape. how much sensory information

LiDAR | 8
the brain processes and how many piece of garbage blowing across the
separate decisions are involved in daily road, is critical. LiDAR’s high resolution
navigation, but it’s a lot in each case. combined with the intelligence of a
microprocessor can not only protect
Examples of where LiDAR is the life of a vehicle’s driver, but it
beneficial can also safeguard the lives of those
persons traveling or navigating nearby.
The faster a vehicle is moving—and
the faster other moving objects are
Another instance where LiDAR could
approaching—the more valuable a
be beneficial would be changing
computer-assisted system like LiDAR
lanes or passing other vehicles on a
becomes. An extreme example of this
road. Although these processes seem
is a highway interchange or four-way
simple, the amount of “processing” the
intersection where other vehicles are
brain does to be able to affect these
approaching, often at high speed and
actions is substantial. Judging the
from multiple directions.
distance and speed of other moving
vehicles is critical to timing steering,
In situations like this, the ability
braking, and acceleration correctly.
to differentiate between, say, a
motorcycle with a rider and a large

Waymo has developed three LiDAR sensors. The company has been using a medium-range
LiDAR, which is located on top of the car, since the early days of its project. Engineers
there developed a short-range and a long-range LiDAR.

LiDAR | 9
LiDAR is getting cheaper—
but it’s still too expensive
for production vehicles

LiDAR is quickly becoming a “must-have” technology for


self-driving vehicles. Until now, a large footprint, high
cost, and other limitations have prevented LiDAR from
being easily integrated into production autos. But all this is
about to change as industry players make deals with each
other and rapidly release new products.

LiDAR | 10
The high costs and low durability of the existing LiDAR technology are the major
factors plaguing the development of the automotive LiDAR market.

This chapters details price points bringing autonomous vehicles to the


and specifics of LiDAR integration mainstream has been the lack of a
as well as going over who the major high-performance and low-cost LiDAR
industry players are and a timeline of that can scale to millions of units per
commercial announcements. year,” says Soroush Salehian, the co-
founder of LiDAR sensor maker Aeva.
Pricing LiDAR Until recently, LiDAR sensors and
Although LiDAR has come a long way systems were priced in the thousands
since its beginnings in the 1960s, it or even tens of thousands of dollars.
is not yet a mature, low-cost, or truly
tiny-footprint technology. However, these price points are
beginning to be broken. In 2016,
It’s true that the bulky, roof-mounted Canadian supplier LeddarTech
LiDAR sensors seen on early self- released an automotive LiDAR sensor
driving car prototypes such as those that sold for below $500, a significant
from Google or Apple are slowly giving industry first at the time. In 2020,
way to low-profile sensors that are Velodyne announced it would be
mountable on a car’s hood, fenders, or introducing a $100 LiDAR sensor
front grille. applicable for use in cars.

But the high cost of LiDAR remains a Integration of LiDAR


major obstacle to mass integration. But sensors are only part of a
“One of the biggest roadblocks to complete LiDAR system. Hardware and

LiDAR | 11
software are still needed to process Advanced Technologies Group (ATG)
the data LiDAR sensors receive. instead of trucks. In 2019, Waymo
began selling its $7,500 LiDar sensor,
Largely because of its high cost, named the Laser Bear Honeycomb,
fleets of so-called “robo-taxis” have to other companies, providing that
been seen as potential first mass- they promised not to compete with
scale adopters of LiDAR, rather Waymo’s robo-taxi service.
than production vehicles meant for
consumers. Irish LiDAR vendor Aptiv, Beyond cost, however, it’s almost a
for instance, is currently helping to certainty that as it advances, LiDAR
operate a 30-car autonomous taxi will be proven technically superior
fleet in Las Vegas in partnership with to radar and video cameras for
ride-sharing firm Lyft. autonomous driving.

In Phoenix, Arizona, Alphabet (Google) Yet self-driving vehicles of the future


subsidiary Waymo operates a (those functioning at SAE Autonomy
driverless autonomous ride-sharing Levels 3 and above) will likely fuse
service that residents can order via a data from all three systems. Why?
smartphone app. Fusion brings two benefits. The first
is that a richer, more diverse set of
Waymo claims to have reduced the data sources will produce greater
cost of LiDAR systems for its vehicles navigation accuracy. The second is
by 90 percent by developing its own that multiple systems provide safety
proprietary hardware. Previously, redundancy should any one of them
it had purchased Velodyne LiDAR have an error or an outage.
systems for its cars at a cost of
$75,000 per unit. In 2016, Uber decided to shift from using Ford
Fusion cars to Volvo XC90s for its self-driving
In 2016, ride-sharing company Uber car program.
acquired autonomous truck startup
Otto, co-founded by former Waymo
employee Anthony Levandowski in
2016. In 2017, Waymo sued Uber,
claiming that Levandowski had stolen
trade secrets related to autonomous
driving and Waymo’s proprietary
LiDAR.

In 2018, Uber shut down Otto to focus


on building self-driving cars within its

LiDAR | 12
Top LiDAR companies in
the automotive industry

Consumption of LiDARs are mainly dominated by


Automotive sectors, especially the recent pool of
investment flowed-in self-driving/autonomous cars
has increased the demand three-fold. Competition is
becoming more and more intense with new product
launch and a lot of new announcements and takeovers are
happening around the world. The LiDAR market in 2018 was
valued between USD 1.30 to USD 1.35 billion which could
reach USD 5.5 billion by 2024.

LiDAR | 13
Automotive LiDAR Market size was estimated to be over 35,000 units with the market size of over USD
150 million in 2017. The market is anticipated to reach 3 billion in 2024.

A number of firms make automotive Companies producing software


LiDAR equipment. and other components needed
to effect obstacle detection and
Companies producing avoidance include:
automotive LiDAR sensors • Autonomous Solutions (United
include:
States)
• Velodyne (United States)
• Aptiv (Ireland)
• Ouster (United States)
• Aeva (United States) Companies integrating all of the
• Luminar (United States) above into complete solutions
• Baraja (Australia) include:
• Innoviz (Isreal) • Xenomatix (Belgium)
• Valeo (France) • Ibeo (Germany)
• Sick (Germany) • ContinentalContinental (Germany)
• Infineon (Germany) • LeddarTech (Canada)
• Benewake (China) • Quanergy (United States)
• Livox (China) • AEye (United States)
• Denso (Japan) • Robosense (China)
• Hokuyo (Japan) • Hesai (China)
• Pioneer (Japan)

LiDAR | 14
Future players in the growing Model S’s Autopilot systems have been
automotive LIDAR marketplace upgraded since then, this test showed
may include: off marked fallibility of the car’s 2D
Mobileye electronic vision system. This
• First Sensor (Germany) demonstrates why 3D sensing systems
• Bosch (Germany) such as LiDAR may be better suited to
• Sony (Japan) govern self-driving vehicles’ speed.
• Phantom Intelligence (Canada)
• BorgWarner (formerly Delphi) Like Tesla, carmaker Nissan—still
smarting from a financial scandal
(United States)
involving its former chairman Carlos
• Intel/Mobileye (United States) Ghosn—has taken an anti-LiDAR
• Lumotive (United States) stance, choosing to incorporate sonar
• Sense Photonics (United States) in addition to radar and cameras for
• Garmin (United States) navigation. “It would be fantastic if
LiDAR technology was at the level that
• Apple (United States)
we could use it in our systems, but it’s
not. There’s an imbalance between its
It’s notable that as recently as 2019, cost and its capabilities,” said Tetsuya
Elon Musk, the founder of electric car Iijima of Nissan’s automated driving
company Tesla, had shied away from technology group.
LiDAR, instead of focusing on “2D”
camera technology for his company’s
self-driving cars and prototypes.
Many industry observers, including
auto research firm Navigant, believe Elon Musk has said:
this approach is wrong and may
“Anyone relying on LIDAR is
compromise passenger safety.
doomed. Doomed. [LiDAR is]
In mid-2019, researchers from expensive sensors that are
cybersecurity firm McAfee’s Advanced unnecessary. It’s like having
Threat Research division used black a whole bunch of expensive
tape to deface a highway speed
sign. They distorted the posted
appendices. In cars, [LiDAR]
35 mph speed limit to convince an is freaking stupid… as [Tesla
approaching pre-2017 Tesla Model S AI director] Andrej [Karpathy]
vehicle into thinking the speed limit was saying, once you solve
was 85 mph. This caused the Tesla vision, it’s worthless.”
vehicle’s Autopilot to attempt to
speed up by 50 mph. Although the

LiDAR | 15
What vehicle manufacturers In 2018, Swedish carmaker Volvo
have integrated or invested in (owned by Chinese concern Geely
LiDAR? Holding Group) made a major
investment in Luminar, which has
In 2016, General Motors acquired also partnered with Japanese
autonomous car firm Cruise, which manufacturer Toyota on autonomous
then purchased LiDAR startup venture test vehicles.
Strobe.
Aurora, a self-driving car startup
In 2017, Detroit automaker Ford funded by online retailer Amazon,
acquired autonomous driving startup acquired LiDAR vendor Blackmore in
Argo AI, which itself bought LiDAR 2019.
startup firm Princeton Lightwave. Ford
also has given financial support to BMW has said it aims to launch
LiDAR industry leader Velodyne. self-driving cars in 2021 with LiDAR
systems supplied by Isreal’s Innoviz.
In late 2017, carmaker Audi (owned
by Volkswagen, the world’s largest Waymo, the Alphabet subsidiary with
automotive company) released a its own LiDAR hardware, has hinted
partially autonomous version of its strongly that one of its goals is to
model A8 vehicle, making it the first ultimately sell self-driving passenger
production car to integrate a form of vehicles to the public. Still, so far, it
LiDAR. has not done so. In the meantime,
the Russian search engine company
In 2018 and 2019, respectively, Audi’s Yandex has its own autonomous
Autonomous Intelligent Driving (AID) vehicle project that is said to include
division partnered with American an internal LiDAR team.
LiDAR vendors Luminar and Aeva
for autonomous vehicles currently Other companies that have either
undergoing testing in Munich, talked about integrating LiDAR or
Germany. shown off LiDAR-equipped prototype
vehicles include China’s Pony.ai and
In December 2019, Porsche (a Baidu , Germany’s Daimle, and the
major shareholder of Volkswagen) U.S.’s Zoox and Nuro.
announced it had invested in LiDAR
vendor Aeva, with the hope of
integrating its products into some
Volkswagen vehicles, beginning with
the ID Buzz AV minivan.

LiDAR | 16
Focus on Japanese
LiDAR supplier Pioneer

Japanese electronics company Pioneer has big plans


for electronics in autonomous vehicles. The firm has
set up a dedicated new venture, Pioneer Smart Sensing
Innovations, to concentrate on this specific marketplace.

LiDAR | 17
the worldwide web didn’t exist at the
time, the company put its map data
on CD- and DVD-ROMs that could be
swapped in and out of Carrozzeria
players.
By the 1970s, the company had Very rapidly, Carrozzeria equipment
established a respectable reputation became more sophisticated. It began
as a manufacturer of high-fidelity to get traffic data from a Japan-
audio and video components. At the wide broadcast service called VICS
same time, the firm added automotive created specifically for this purpose.
electronics to its portfolio, initially Voice commands enabled control
under its own brand, but eventually and destination setting. Data that it
under a separate sub-label known as learned from congestion and traffic
Carrozzeria. jams drivers encountered was shared
and merged to make Pioneer’s map
Carrozzeria is a word borrowed from datasets richer and more accurate.
the Italian language used to describe
auto-body styling businesses such as In 2009, Carrozzeria navigation
the widely known firms of Pininfarina, components began to get local
Bertone, and ItalDesign/Giugiaro. information via cellular connections
These firms were responsible for (what Pioneer termed “Air Navi”). In
crafting the bodies of some of the 2011, front-facing car cameras enabled
most famous sports cars in the Carrozzeria screens to display images
world by automakers such as Ferrari, enhanced by augmented reality (AR)
Lamborghini, Maserati, Alfa Romeo, graphics. In 2012, Pioneer took its AR
etc. system and applied it to a heads-up
display (HUD) that overlaid the interior
portion of cars’ windshields.
The beginning of map-based car
navigation Needless to say, these systems were
Starting in 1990, Pioneer’s Carrozzeria among the most sophisticated car
components were the first devices to navigation electronics one could buy
enable electronic street navigation by at the time they were released. Initially
making use of GPS and LCD screens available only in Japan, Pioneer
to present visual maps to drivers. expanded its street and location data
These maps were created by another collection to include many other parts
Pioneer division called Increment of the world. It soon started selling a
P Corporation for use in major wider range of its car electronics in
metropolitan areas of Japan. Because Europe and the United States.

LiDAR | 18
Pioneer entered the LiDAR with Pioneer’s LiDAR drive, they’ll
market constantly capture new street and
environmental information that will be
As automakers began to experiment
fused with Increment P Corporation’s
with autonomous vehicles, Pioneer
existing datasets. This will create
sought to leverage its Carrozzeria
a continuously updating data
experience for the development of
ecosystem.
self-driving car navigation systems.
The process of creating environmental
Pioneer had already produced laser
and positioning data on the fly is
modules and tracking hardware for
known as simultaneous localization
high-quality LaserDisc, CD, and DVD
and mapping, or SLAM. (Pioneer’s
players for decades. Therefore, a move
version of it is called Super Fusion
into developing laser light detection
VSLAM, where the “V” stands for
and ranging (LiDAR) systems for cars
visual.)
was a logical progression.

In 2019, Pioneer committed to Autonomous shuttle bus equipped


partnering with Japanese camera with Pioneer’s 3D-LiDAR sensor.
equipment maker Canon to develop
what it terms “3D” LiDAR. To Pioneer’s
rich experience in laser components,
car electronics, and navigation
systems, Canon adds extensive
optical expertise that strengthens this
partnership.

For mapping in new parts of the world,


Pioneer has teamed up with Dutch
enterprise HERE Technologies, which
has map data for up to 80 percent of
North America and Europe. Pioneer
has invested in both HERE and
Japanese firm Dynamic Map Platform
Co., Ltd. to access optimal navigation
datasets for its future LiDAR products.

But the company’s quest for the


best mapping doesn’t end there.
As autonomous cars equipped

LiDAR | 19
LiDAR—looking ahead

In the coming years, more automakers are expected to


start ordering LiDAR systems in bulk as their vehicles meet
and surpass the capabilities of the Society of Automotive
Engineers (SAE) Autonomy Level 4+ prototype cars now
being demonstrated and tested by Apple, Alphabet, Tesla,
and others. Until then, lower-cost LiDAR components
are expected to substantially enhance Advanced
Driver-Assistance Systems (ADAS) functionality in new
production cars.

LiDAR | 20
The swift development of the autonomous vehicles has developed numerous opportunities
for the growth of the automotive LiDAR sensors.

In short, there’s no doubt that LiDAR North America to lead LiDAR


will play a crucial role in autonomous market this decade
vehicles of the future. The LiDAR
By region, North America is expected
market size is projected to grow from
to dominate the LiDAR market in the
USD 844 million in 2019 to USD 2,273
forseable future. The growth of the
million by 2024, at a CAGR of 18.5
North American market is attributed
percent from 2019 to 2024.
to the use of LiDAR in ADAS and
autonomous vehicles.
In the coming years, more automakers
are expected to start ordering LiDAR
As LiDAR technology matures, it will
systems in bulk as their vehicles meet
continue to get smaller, cheaper, and
and surpass the capabilities of the
ever more powerful. Some industry
Society of Automotive Engineers
players are now developing solid-
(SAE) Autonomy Level 4+ prototype
state single or array “on-a-chip” LiDAR
cars now being demonstrated and
emitters that feature few or no moving
tested by Apple, Alphabet, Tesla,
parts, whereas current systems rely
and others. Until then, lower-cost
on rotating pieces to move their units’
LiDAR components are expected
lasers around. It’s likely that this newer
to substantially enhance Advanced
solid-state form of LiDAR will supplant
Driver-Assistance Systems (ADAS)
the rotating kind and continue to drive
functionality in new production cars.
costs down.

LiDAR | 21

You might also like