Professional Documents
Culture Documents
Editorial Notes
2
University of Liverpool | Ghost Autonomy | Stanford Center for AI Safety |
Nvidia | Alliance for Automotive Innovation | Stellantis | Can AI in Autos Be Trusted
© Shuo | stock.adobe.com
Can AI be trusted or will it be a bad choice for car makers as responsible operation might not always be given –
explainable AI will be a key demand from regulators point of view
A few months ago, there was an explosion of news tions. My concern is mainly on whether AI has Among AI applications, autonomous driving
about the dangers posed by artificial intelligence been r igorously engineered to ensure its safety stands out as the one with the greatest poten-
(AI) following an open letter signed by thousands and trustworthiness. The engineering p rocess tial for harm, and there is much to be concerned
of experts, who warned that AI technologies such would normally include falsification, v erification, about, according to the experts. As with the large
as GPT-4 present “profound risks to society and explanation, v alidation, and runtime monitoring. language models, the main issue is that nobody
humanity.” GPT-4 is a large language model that The key c hallenge will be how to organize these knows for certain how safe they are. Millions of
lets you have human-like interactions with a com- sub-processes to showcase to regulators and ADAS-equipped vehicles are already operating
puter. It can answer questions, compose emails, consumers AI’s safety and trustworthiness.” on the roads today as well as thousands of self-
write reports, and even software code. The worry, AI use in cars began more than 20 years ago driving vehicles under test. A number of these
according to the letter’s organizers: “AI systems are with speech systems. From there, machine lear vehicles have crashed, some causing fatalities.
growing ever more powerful – and we don’t know ning has been applied to ADAS and, more recently, And while the number of accidents and the resul
their upper bound. Malicious actors can use these to autonomous driving systems. These systems ting loss of life haven’t yet risen to a level that
systems to do bad things, and regular consumers employ AI-enabled perception systems trained to would cause outrage, there is no certainty that
might be misled, or worse, by their output.” That recognize patterns from cameras, ultrasonic sen- they won’t. A surge in terrible accidents with loss
made me curious about what risks AI poses to sors, radar and lidar. High-definition maps, needed of life caused by AI-powered machines will put
people in cars. Xiaowei Huang, director of the for autonomous driving, also benefit from machine a chill into the commercialization of autonomous
Trustworthy Autonomous Cyber-Physical S ystems learning. Driver monitoring in support of the user driving technology.
Lab at the University of Liverpool, is among a experience is yet another application of AI. Large Par Botes is chief product officer at Ghost
small group of people from the auto industry who language models such as GPT-4 will likely be ap Autonomy. He warned, “The biggest risk with
signed the letter. In an email, he wrote that his plied here, allowing the driver and passengers statistical machine learning systems is they
concerns about AI extend to the auto industry. to engage in natural-language conversations could encounter things they haven’t been trained
“We aren’t sure if AI will run within our expecta- with computers. for and suggest maneuvers that are completely
3
THE HANSEN REP ORT On Automotiv e El ectronic s
wrong.” It is impossible to train a neural network Regulations that would lead to commercia s takeholder is pushing for regulation.” While
on everything it might encounter on the road, in lization of AI-based L3 and L4 systems are that may be true for now, it won’t be true in the
every rotation, in every color, in every lighting and not nearly ready. Discussions about AI within future if AI is implicated in a spate of fatal cra
weather condition. Ghost Autonomy is developing UNECE WP.29’s Working Party on Automated/ shes involving autonomous vehicles currently
next-generation AI solutions that don’t rely on Autonomous and Connected Vehicles (GRVA) under test on public roads.
statistical learning, so-called autocoded genera- began in late 2020. Barnaby Simkin, who works Assuming that AI regulations of some sort
tive models. An autoencoder is a type of artificial for Nvidia, has been an active participant in those are eventually established, automotive industry
neural network used to learn efficient data encod- discussions. In an email he wrote: “GRVA is inter- executives want those regulations to be harmo-
ings in an unsupervised manner. According to the ested in having an open dialogue to learn from nized g lobally and technology neutral. In a panel
Human-Centered Artificial Intelligence Research the industry and evaluate the need, if any, to put discussion on AI organized earlier this year by
Institute at Stanford University, AI is used to simu- specific horizontal requirements for AI-based the Alliance for Automotive Innovation, Neda
late real-world conditions to safety-test autono- systems in place.” He pointed to two ongoing Cvijetic put her thoughts on regulation this
mous vehicles, but work remains. “Our main chal- initiatives, ISO/PAS 8800 (for road vehicles) and way: “We need a regulation that will ensure
lenge as a field is how do we guarantee that these ISO/IEC TR 5469 (a general framework), both of safe and responsible operation without stifling
amazing capabilities of AI systems are safe before which cover the trustworthy AI principles including innovation within this technically complex and
we deploy them in places where human lives are at transparency, safety, p rivacy, and explainability. not fully understood field of AI.” Cvijetic is
stake?” said Anthony Corso, executive director of In Simkin’s view, “the industry is not in need of senior vice president, head of AI and autono-
the Stanford Center for AI Safety. specific AI regulation,” and that “no particular mous driving at Stellantis.
4
© Mercedes-Benz
Mercedes-Benz User Experience (MBUX) Zero Layer: the feature developed for EQS was deployed into S- and C-Class via OTA
an additional 3,000 software developers. One standardize. There is potential here to go more A few days later I have the first software version
thousand would be assigned to its Electric Soft- boldly into the free and open-source community.” in a test vehicle.”
ware Hub in Sindelfingen, Germany; 2,000 more Moreover, in the future as Mercedes increasingly
would be assigned to global tech hubs in Berlin, relies on standard software, Hafner expects out- Role Changes for Tier-1s
Tel Aviv, Seattle, Sunnyvale, Beijing, Tokyo and sourcing of software to grow. “There are oppor- Tier-1 suppliers have been responsible for whole
Bangalore. That staffing is nearly complete. tunities to standardize both at the platform level systems, both hardware and software. As car-
According to the carmaker, by mid-decade, and at the applications,” he said. “For example, makers bring software development and inte-
25 % of Mercedes-Benz’s R&D budget will tuner software could be standard.” gration in house, the tier ones will be asked to
be devoted to software. Within MB.OS, Mercedes standardized do less. “In the past, we would develop a com-
each of its five hardware base-layer clusters, plete system with a supplier. If we wanted to go
Software Driven including microcontroller: one cluster for each to a different supplier for the next-vehicle gen-
Hafner outlined some of what it means to be domain, plus the connectivity module. The car- eration, we’d have to start from scratch, even if
software driven: “You are able to deliver s oft- maker teamed with Vector Informatik to jointly there were only incremental changes. That was
ware-based innovations at very high speeds, develop standard middleware for the base soft- a waste of resources,” said Hafner. Mercedes
independent of the hardware. Your software ware layer. The work with Vector is based on will continue to purchase hardware from the tier
developers are very iterative and agile. Data Adaptive and Classic Autosar and the Autosar ones, along with the software that is closely
plays a huge role. And you are providing the right Runtime Environment. “MB.OS will take a lot of coupled with hardware. It would also like to
software development tool set.” Mercedes is on a complexity out of the system and make us fas involve tier-1s in the development of complete
path to develop most of the software it needs in ter,” Hafner asserted, “We also take software stacks that Mercedes and the supplier would
house. “As a luxury carmaker, we must differen- integration into our own hands. Two years ago, co-own. That would let the carmaker and the
tiate, noted Hafner. “We need to own the soft- if I had an idea, I would have delivered a written supplier reuse parts of the stack as needed:
ware that makes us unique.” We are taking the specification to a supplier, asked for an offering, “We want to focus on standardization and open
domains of our MB.OS in house. That includes negotiated for a while, and then waited until source for the things where we don’t differenti-
infotainment, ADAS, body and comfort, and inte- they brought in what I wanted. That was the old ate from our competitors. Joint development
rior functions, followed by driving and charging.” world. In the new world, if I have an idea, I talk projects such as these would promote standard-
He added: “Where we don’t differentiate, we can to my colleagues, and they start working on it. ization to the benefit of everyone.”
5
Enabling the Software-Defined Vehicle
Vector supports vehicle manufacturers and suppliers on their way towards the Software-
Defined Vehicle with professional tools, embedded software and services.
Let Vector show you how a powerful software platform and ecosystem works and what a
modern and comprehensive Vehicle Operating System for the SDV can look like.
vector.com/sdv