You are on page 1of 12

See discussions, stats, and author profiles for this publication at: https://www.researchgate.

net/publication/336613232

Autonowashing: The Greenwashing of Vehicle Automation

Preprint · October 2019


DOI: 10.13140/RG.2.2.19836.69761

CITATIONS READS
0 846

1 author:

Liza Dixon
Hochschule Rhein-Waal
2 PUBLICATIONS   0 CITATIONS   

SEE PROFILE

Some of the authors of this publication are also working on these related projects:

Trust in Automation View project

Autonowashing View project

All content following this page was uploaded by Liza Dixon on 18 October 2019.

The user has requested enhancement of the downloaded file.


Autonowashing: The Greenwashing of Vehicle Automation

Liza Dixon
Kamp-Lintfort, Germany
email: lizadixon@gmail.com

Abstract—The presence of automation is growing in the vehicle automation, a great irony exists in the way that the
domains of our homes, workplaces and roadways. Vehicle technology is being promoted.
automation in particular is raising critical human factors issues Unfortunately, like the greenwashing of the sustainability
which directly impact human-machine interaction and road movement [4], the capabilities of vehicle automation are
safety. It is especially important that users of partial and semi- commonly inflated. A corporation—eager to profit in the
autonomous systems in safety-critical contexts understand the short-term—might exaggerate the capabilities of a product’s
limitations of the technology, in order to ensure appropriate automation in marketing verbiage. This is a substantial risk,
reliance. Studies indicate that the language used to describe
as users’ ideas about automated systems are formulated long
vehicle automation in marketing and in the media effect user
before their first contact with a system, and these ideas
perceptions of the system’s capabilities, and later their
interaction with the system. Much like “greenwashing”, the influence how they later interact with the system [5]. A user
capabilities of automation are often overstated. The lack of that believes a system is more capable i.e. more autonomous
public awareness of this issue is one of the most critical problems than it really is, is more likely to overtrust and misuse the
impacting trust calibration and the safe use of vehicle system [6], increasing their risk for an accident. News reports
automation. Yet, it has gone unnamed and continues to affect of human fatality and severe injury in association with
the public understanding of the technology. Hence, the case for partially automated driving systems condensate a dark cloud
the use of the term “autonowashing” to describe the gap in the over the technology, increasing customer wariness about its
presentation of automation and the actual system capabilities is reliability. In the long-term, this may hinder acceptance and
put forth. This paper presents case studies and discusses key “…can reduce or even nullify the economic or other benefits
issues in autonowashing, a term/concept that influences or that automation can provide” [7].
relates to public perceptions of vehicle automation. Therefore, using transparent language in the marketing
and promotion vehicle automation which clearly describes its
Keywords—Autonowashing; Trust; Automation; Human- abilities and the limitations is critical to safe use, acceptance,
Machine Interaction; Autonomous Vehicles. and scaled adoption of vehicle automation [8].
In this paper, the concept/term of autonowashing is
I. INTRODUCTION proposed to describe the gap between the way automation
capabilities are described to users and the system’s actual
The promises of automated technologies — from robotic technical capabilities. The key concepts of greenwashing, the
assistants to self-driving cars — to improve our safety and current state of vehicle autonomy, and trust in automation are
quality of life are seemingly boundless. Fantasies of the presented. In order to better understand what autonowashing
future, in which road deaths are virtually eradicated and looks like in practice, media headlines and automakers’
mundane tasks are removed from human concern, freeing us approach marketing vehicle automation are examined as case
to enjoy greater independence and personal autonomy, are not studies. The five signs of autonowashing, the consequences of
guaranteed. To make these visions a reality, automated autonowashing and what might be done to alleviate its effects
systems must not only be functional, reliable, and trustworthy; are also presented. The following questions are addressed:
they must be mindfully introduced to the humans they intend
to support. Q1: What is autonowashing and why does it occur?
However, terms like “automation”, “intelligent systems”, Q2: When, where, and how does autonowashing occur?
and “artificial intelligence” are used loosely to describe Q3: What are the effects of autonowashing and how might
everything from a smartphone’s autocorrect feature to a they be mitigated?
safety-critical application such as an Advanced Driver
Assistance System (ADAS). As marketing buzzwords, their A. Greenwashing
meaning is becoming increasingly diluted. The Over the past few decades, the need for more sustainable
misinterpretation of AI and automation in the media is lifestyle choices and business practices has been brought into
confusing the public and is considered to be an economic and public awareness. With this awareness, so came the
humanitarian issue [1]. Economic, because the corporations opportunity for businesses to adopt a “socially responsible”
investing billions of dollars into the development of image, aligned with the concerns of their customers, hence,
automated systems [2] are counting on the return on corporate social responsibility (CSR) was born. CSR is “the
investment, and humanitarian because the misuse of idea that a company should be interested in willing to help
automated systems can be deadly [3]. Yet, in the case of society and the environment as well as be concerned about the
products and profits it makes” [9]. CSR has proven to be so
effective, that claims of social responsibility have become 71% of those surveyed believed it was possible to purchase a
increasingly stretched and exaggerated. Corporations—freely “self-driving car” today [14].
using “green” terms and labels as needed—have elegantly Issues surrounding the language used to describe vehicle
mislead customers into thinking they were purchasing more automation are noted in scientific literature [8] and in the
environmentally friendly goods than they actually were; media [15]. A study by Beller, Heesen, & Vollrath [16]
essentially, preying upon the uniformed. This practice of confirms that a user with a false understanding of system
exaggerating the “naturalness” or “eco-friendliness” of infallibility, “can lead to severe consequences in the case of
products and services grew so widespread, was given a name: automation failure.”
greenwashing.
Greenwashing was coined by environmentalist Jay C. Trust in Automation
Westerveld in 1986 [10] and is defined as “the practice of When automation (autopilot) was first introduced to the
making an unsubstantiated or misleading claim about the aviation industry, it helped pilots evade many common
environmental benefits of a product, service, technology or accident scenarios; simultaneously, new kinds of accidents
company practice” [4]. Greenwashing illuminates the emerged. It was not until pilot education about the automation
disconnect between a marketed image of corporate social and "the concept of the human-automation team” was
responsibility (CSR) and the reality of a corporation, product introduced, that the benefits of the autopilot system were fully
or service’s contribution to the sustainability movement. Over realized, supporting the aviation industry with the extremely
the years, greenwashing has become more sophisticated; low accident rates of today [17]. In truth, “…one cannot
spawning the development of frameworks for identifying remove human error from the system simply by removing the
greenwashing in practice (see the “Six Sins of Greenwashing” human operator” [7].
[11]). A key component in the acceptance of automation is an
attitude of trust in the system [6]. Trust in automation (in the
B. State of Commercial Vehicle Automation & Marketing context of automated driving systems) is defined by Körber
Presently, the highest level of vehicle automation in as, “The attitude of a user to be willing to be vulnerable to the
production vehicles on-road today is Level 2 automation [12]. actions of an automated system based on the expectation that
The levels of vehicle automation, as defined by the Society of it will perform a particular action important to the user,
Automotive Engineers (SAE), extend from Level 0 or “no irrespective of the ability to monitor or to intervene” [18].
automation” to Level 5 or “full automation” [13]. Level 1 Trust is not only critical for acceptance, but also for safety.
automation describes traditional cruise control systems (speed Both an overtrust in automation as well as a distrust in
maintenance) and Level 2 describes “partial automation” or automation create problems in human-automation interaction.
Adaptive Cruise Control Systems (ACC) in which the vehicle The goal then, is calibrated trust [19], or a level of user trust
is able to maintain speed, accelerate, decelerate and in some in the system which matches the automation capabilities of the
cases light steering for lane maintenance. However, Level 2 system in use [6] (see Figure 1).
systems require full driver supervision at all times. Level 3 Trust in partially automated vehicles begins “long before
systems are described as “semi-autonomous” or “conditional a driver’s first experience with the system, and continues long
automation”; the driver is not required to supervise the system thereafter” [5]. Multiple studies have confirmed that the
in specific scenarios (e.g. in a traffic jam) but may be called branded terms (e.g. Tesla’s “Autopilot”, Audi’s “Traffic Jam
upon by the system to take back control of the vehicle should Pilot”) used to describe vehicle technology influence
conditions change. Level 4 and Level 5 automation (“full perceptions of the technology and “name alone is not enough
automation”, “self-driving”, “autonomous”) are similar, with to appropriately orient drivers to system limitations” [8].
the exception that Level 4 automation is geofenced i.e. limited Stories about automation in the media, in advertising, and
to specific geographic areas, while Level 5 automation is those heard by word of mouth have an effect on trust [5], [8].
theoretically fully autonomous, requiring no human Further, unrealistic expectations of assistive and self-driving
supervision or presence and can operate in all conditions. technologies could be a barrier to acceptance [20]. Initial
According to a recent study, “automated driving hype is acceptance may be increased if the driver’s expectations of the
dangerously confusing customers”, and further, “Some system are unrealistically high. However, after practical
carmakers are designing and marketing vehicles in such a way experience with the automation which reveals its
that drivers believe they can relinquish control” [14]. Because shortcomings, “trust and acceptance may be irreparably
there is no regulating body overseeing the language used to harmed” [20]. Therefore, supporting drivers with realistic
describe assistive systems, automakers, also known as original expectations regarding the capabilities of automation is
equipment manufacturers (OEMs) have been unchecked in important for acceptance in the long-term [21].
their use of branded terms.
OEMs offering driver assistance systems as options in II. AUTONOWASHING
their vehicles (i.e. Audi, Ford, Tesla), use a wide vocabulary Adapted for automation [4], autonowashing is defined as
to describe these options and their abilities. The motivations the practice of making unverified or misleading claims which
for this are clear: “Carmakers want to gain competitive edge misrepresent the appropriate level of human supervision
by referring to ‘self-driving’ or ‘semi-autonomous’ capability required by a partially or semi-autonomous product, service,
in their marketing…” [14]. As a result, a recent survey of or technology. Autonowashing may also be extended to fully
1,567 car owners across seven different countries found that autonomous systems, in cases where system capabilities are
exaggerated beyond what can be performed reliably. [15], [22]–[24] is discussed in numerous studies [8], [17], [20]
Autonowashing makes something appear to be more and the subject of multiple lawsuits [25]–[27].
autonomous than it really is.
The objective of autonowashing is to differentiate and/or B. Case Study: Headlines
offer a competitive advantage to an entity, through the use of Over the past decade terms such as “autonomous”,
superficial verbiage meant to convey a level of system “driverless”, and “self-driving” have made increasing
competence that is misaligned with the technical appearances in media headlines. These buzzwords are often
specifications of the system. Autonowashing may also occur used by outlets and publications to describe all levels of
inadvertently, when one unknowingly repeats erroneous vehicle automation, baiting interest, sales and “driving traffic”
information about the capabilities of an automated system to to their respective sites. It is not uncommon to come across an
another. Autonowashing is a form of disinformation; it is, in a article discussing Level 2 automation as “autonomous” or a
sense, viral. testing vehicle as “driverless”, even though there is a human
safety driver monitoring the vehicle and the environment at all
A. Effects of Autonowashing times (see Table 1).
The results of autonowashing are, but not limited to:
misuse of a system due to inappropriate reliance, leading to TABLE I. AUTONOWASHED HEADLINES & CONTRADICTIONS
disuse of a system due to performance concerns. Headline Contradiction
Autonowashing does not support calibrated trust in “Joshua Brown, Who Died in Self- Not “self-driving”—this Tesla had
automation and increases the likelihood that a user will Driving Accident, Tested Limits Autopilot (Level 2, ADAS) which
overtrust a system (see Figure 1) [6]. of his Tesla” – The New York requires full driver supervison
Those who have been autonowashed believe that an Times [28] [29].
“Volvo puts 100 British families in Not “driverless”—all vehicles
automated system is more capable than it really is, and hence driverless cars” – Financial Times have professional safety drivers,
may be confused about how much supervision the system monitoring the the driving
requires from a driver. They may refer to an ADAS as “self- environment, ready to intervene
driving” or “autonomous” and be more inclined to engage in [30].
risky misuse, such as removing their hands from the wheel or “Tesla Has Begun Making All Its Not “self-driving”—Tesla
looking away from the road ahead, increasing the risk of New Cars Self-Driving” – NPR reportedly upgraded the hardware
[31] systems in their vehicles, which
accident. (according to Tesla) could one day
make the vehicles “fully self-
driving” [32].
“Elon Musk Defends Tesla Not “self-driving”—Tesla has
Following Latest Self-Driving Autopilot (Level 2, ADAS) which
Accident” – Adweek [33] requires full driver supervison
[29].
“Fully driverless cars are on Not “fully driverless”—modified
public roads in Texas: [subhead] vehicle with professional safety
Drive.ai is the second company to driver in passenger seat,
remove the safety driver from its monitoring the driving
autonomous vehicles” – The Verge environment, ready to intervene
[34].
“Shocking moment a Tesla driver Not a “self-driving” vehicle—this
is filmed ASLEEP behind the Tesla has Autopilot (Level 2,
wheel as his self-driving car ADAS) which is being
travels at high speeds on the “successfully” (without incident)
California interstate” misused as it requires full driver
supervison [35].
Table 1. Examples of autonowashed headlines; verbiage
which gives the reader the impression that the vehicle
being described is more autonomous than it really is. The
Figure 1. Illustration of the relationship between trust, technical contradiction to the headline is presented.
automation capability, overtrust, distrust, calibrated trust
and autonowashing [adapted from 6]. Autonowashing
affects trust, resulting in a tendency to overtrust, increasing C. Case Study: Tesla Autopilot & Full Self-Driving
the risk of system misuse. A recoverable or “safe” margin of In 2014, Tesla introduced its first iteration of a Level 2,
error (light gray) in trust calibration is to be expected in Advanced Driver Assistance System called “Autopilot” [36].
use. However, autonowashing may push the user beyond The term autopilot as defined by the Cambridge English
this margin, into a situation where an accident is more Dictionary [37] is, “a device that keeps aircraft, spacecraft,
likely. and ships moving in a particular direction without human
involvement.” The choice to name an ADAS “Autopilot”,
Although the term is not directly mentioned, the concept which requires constant human supervision has been criticized
of autonowashing has been receiving media attention [12], by experts, several organizations and government entities. In
a letter to Tesla, the German government (Federal Motor
Transport Authority) wrote: “In order to prevent Tesla’s CEO Elon Musk has promoted “Full Self-Driving
misunderstanding and incorrect customers’ expectations, we Capability” on his personal Twitter account, in one case
demand that the misleading term Autopilot is no longer used stating “Tesla drives itself (no human input at all) thru urban
in advertising the system.” [22]. streets to highway to streets, then finds a parking spot”
Since its initial release, Autopilot has received hardware without clarifying that this feature is not yet enabled [43].
updates in newer vehicle models and continues to receive Further, Musk has been seen in multiple TV interviews [23],
software updates over the air [29]. These updates have [44], [45], removing his hands from the wheel with Autopilot
improved the reliability of the system under certain conditions active. In one of these examples, he did so and stated, “See?
but have not yet made the system “more autonomous”— It’s on full Autopilot right now. No hands, no feet, nothing,”
Autopilot remains a Level 2 system as the same level of driver as he demonstrates the system to the interviewer, who is
attention is required to operate the system safely. It is sitting in the passenger seat (Figure 3) [45]. This behavior is
explicitly stated on the Tesla website and in the vehicle at odds with appropriate use, and is explicitly warned against
owner’s manual in multiple instances that the driver must keep in the Tesla Owner’s Manual [29].
their hands on the wheel and their attention on the road ahead
[29], [36]. Despite these statements, Tesla is the only OEM
currently marketing Level 2, ADAS equipped vehicles as
“self-driving” [38].
In October 2016, Tesla announced that “all Tesla vehicles
produced in our factory…will have the hardware needed for
full self-driving capability at a safety level substantially
greater than that of a human driver” [32] (see Figure 2). This
announcement also came with the sale of a new Autopilot
option called “Full Self-Driving Capability” (FSD). Tesla
stated that customers who purchased the FSD upgrade would
not experience any new features initially but that in the future,
this upgrade would enable the vehicle to be “fully self-
driving” [39]. This option was later removed, but then
subsequently reintroduced for sale in February of 2019.

Figure 3. Elon Musk removing his hands from the wheel


with Autopilot engaged during an interview [45].

a) Legal & Regulatory Troubles


While marketing Full Self-Driving in 2017, a class action
lawsuit was filed against Tesla, alleging that Tesla had
“mislead customers” about its “Enhanced Autopilot” option,
having stated that it would “improve safety and reduce the
possibility of collisions.” Upon release after significant delay,
it was found to be “essentially unusable and demonstrably
dangerous” [46]. The initial complaint stated: “Contrary to
what Tesla represented to them, buyers of affected vehicles
have become beta testers of half-baked software that renders
Figure 2. Tesla.com homepage promoting “Full Self-Driving Tesla vehicles dangerous if engaged”. Tesla later settled [47].
capability” upgrade after its first release in October 2016 National Transportation Safety Board (NTSB)
[40]. investigations have found that Tesla Autopilot was active
during multiple fatal accidents [12]. Tesla is currently in
Along with FSD, Tesla released a series of promotional litigation with the families of multiple individuals who have
videos [41], showing one of its vehicles navigating through died while using Autopilot; they claim that the system is
intersections, stop signs, highway on ramps, off ramps, etc. “defective” [26], [27] and that Tesla “had specific knowledge
without any human intervention [32]. The steering wheel is of numerous prior incidents and accidents in which its safety
seen moving independently and the driver’s hands are seen systems on Tesla vehicles completely failed causing
resting in their lap, left off of the steering wheel. The European significant property damage, severe injury, and catastrophic
New Car Assessment Program responded to these videos in a death to its occupants” [26]. A recent lawsuit stated that one
2018 report, stating that Tesla had released videos which are of Autopilot’s late users, believed his Model 3 “was safer than
“confusing consumers about the actual capabilities of the a human-operated vehicle because Defendant, Tesla claimed
Autopilot system” [42]. superiority regarding the vehicle’s Autopilot system,
including Tesla’s 'full self-driving capability’…”. The driver
believed that the system would "prevent fatal injury resulting that consumers were being misled about the car’s self-driving
from driving into obstacles and/or vehicles in the path of the capabilities” [50]. The campaign was later pulled by
subject Tesla vehicle” [48]. Mercedes [51].
In a 2018 accident in which a driver using Tesla Autopilot
struck the back of a fire truck, the NTSB concluded the E. Mitigating Autonowashing
accident was: “…due to his inattention and overreliance on the How then, might we ease the effects of autonowashing?
car’s advanced driver assistance system, Tesla’s ‘Autopilot’ What steps might be taken to support autonowashed drivers in
design which permitted the driver to disengage from the calibrating their trust and ensuring their safe use of vehicle
driving task, and the driver’s use of the system in ways automation? Specifically, partial (Level 2) and conditional
inconsistent with guidance and warnings from Tesla” [49]. In automation (Level 3)?
another crash involving Autopilot which injured a driver, a 1) Identification
legal complaint stated that the driver was told by a Tesla The first step in the mitigation of autonowashing is being
salesperson that, “she could drive in autopilot mode and just able to identify what it looks like in the real world. Like The
touch the steering wheel occasionally” and “that touching the Six Sins of Greenwashing [11], autonowashing can take
steering wheel to maintain autopilot mode was demonstrated several forms. The signs of autonowashing can be grouped
to [her]” [25] which is misaligned with the Tesla manual into five categories: vague language, no proof/fibbing, false
guidelines for safe use [29]. idols, autonoporn, and the hidden trade-off (see Table 2).
D. Case Study: Mercedes-Benz E-Class TABLE II. FIVE SIGNS OF AUTONOWASHING
In 2016, Mercedes-Benz launched a new advertising Sign Description Example
campaign called “The Future” in order to promote the new Vague A term or claim that is poorly “Autopilot”
automated features launching in its E-Class sedan. The language defined or broad that its real
campaign stated: meaning is likely to be
misunderstood by the user.
“Is the world truly ready for a vehicle No proof/ Deceitfully making a claim “Full-Self Driving
Fibbing about a system’s capabilities; capability”
that can drive itself? An autonomous- Claiming to have autonomous
thinking automobile that protects those capabilites which have not been
inside and outside. Ready or not, the verified by a third party.
future is here. The all new E-Class: False idols When inappropriate Tesla CEO’s
reliance/system misuse is interactions with
self-braking, self-correcting, self- modeled to an audience by a Autopilot during
parking. A Mercedes-Benz concept figure of influence or authority. multiple televised
that’s already a reality.” [50] interviews [23],
[44], [45] (see
The headline of one of the ads read, “Introducing a self- Figure 3).
driving car from a very self-driven company.” [51]. Followed Autonoporn Media of demonstrations which Video footage of
by a paragraph describing the vehicles new convenience and feature idealized functionality steering wheels
of automated systems operating moving
safety systems (Figure 4). successfully with little to no independently,
human supervision or photos of users
interaction. Typically, a vertical reading books or
prototype not meant to be watching a movie
generalized. in the driver’s seat
[41].
Hidden Focusing attention on one “Driver assistance
trade-off particular attribute, concealing systems make
some crucial information, driving safer”
especially from the human […provided they
supervision point of view. are appropriately
supervised].
Adapted for autonowashing from [11]
Table 2. The Five Signs of Autonowashing, their description,
Figure 4. Copy in a retracted 2016 print advertisement and an example of their application in the real world.
promoting Mercedes-Benz’s 2017 E-Class [51].
The presence of a sign of autonowashing does not
Coincidentally, this campaign launched following a fatal necessarily mean that autonowashing is taking place. For
accident in which Tesla’s Autopilot was in use. This prompted example, a company may run an ad of autonopornographic
further scrutiny from consumer groups, who alerted the footage of technical projects in their pipeline, however it is
Federal Trade Commission (FTC) to the campaign, over explicitly stated that these systems or features are futuristic
concern that the vehicle’s assistive features being presented as and are not available for purchase.
“self-driving” were deceptive and misleading customers. 2) Federal Trade Commission Act, Section 5
However, Mercedes-Benz defended itself against “allegations
Under Section 5 of the Federal Trade Commission Act aim to educate the public about how self-driving technology
[52], consumers are protected against “unfair or deceptive acts works, how it can improve safety and how it might change our
or practices” by corporations. Autonowashing may be in in roadways in the future [54]. Mass media campaigns are
violation this act as, 1) autonowashing is “unfair” and “causes suggested as a means to educate society and promote a
or is likely to cause substantial injury to consumers”, 2) “baseline level of understanding” of automation and
autonowashing is “deceptive” because it “misleads or is likely intelligent systems, supporting the calibration of trust via the
to mislead the consumer”. Further, Section 5 also states that understanding of system limitations [55].
fine print may not be used to “correct potentially misleading The point of sale is another vital touchpoint for supporting
headlines” [52], a marketing tactic which is often used in calibrated trust in automation. In a survey, 52% of drivers
instances of autonowashing in order to “protect” the company responded that they would prefer to be educated about their
behind the promotion. Consumer advocate groups are calling new car at the dealership [56]. Yet, “…new vehicle customers
for the FTC to investigate instances of this [38]. Enforcement are not offered additional training in relation to the use of
of Section 5 in relation to severe instances of autonowashing automated vehicle subsystems at point of sale” [57]. While
not only protects consumers (drivers) and roadways but could many salespersons may be willing to assist customers with
also support the industry in the safe deployment of vehicle this training, it is generally the responsibility of the customer
autonomy. to recognize the need for it and request it. Additionally, the
3) Terminology quality of the training the customer receives may vary greatly
Autonowashing often begins when vague language is used [58]. Furthermore, vehicles can now be purchased online and
to describe automation. A review by the American delivered to home address without any opportunity for in-
Automobile Association (AAA) found that “ the National person, expert training. It is also possible that a driver might
Highway Traffic Safety Administration (NHTSA), Insurance be given a rental vehicle equipped with an ADAS and is 1) not
Institute for Highway Safety (IIHS), Society of Automotive aware the vehicle has such a system 2) has had no training on
Engineers (SAE) and other regulatory and research how the system works, safe conditions for use or what the
organizations have all used different technology names to system limitations are.
describe systems with the same underlying technology” [24]. Casner & Hutchins have presented a preliminary set of
The SAE levels [13], designed by and for engineers, are standards for driver education prior to the use of partially
internationally accepted as the standard for vehicle autonomy. automated vehicles [17]. In the future, these standards might
However, the SAE levels are often misinterpreted by the be adapted for showroom and rental salespeople, as well as
media and consumers. There is currently no standardized vehicle delivery professionals in their training, as these
vocabulary for vehicle automation that is designed to be individuals are a critical point of contact for first-time users.
consumer-facing; a critically missing piece for supporting 5) Driver Monitoring Systems
drivers’ appropriate reliance [15]. A foundational heuristic of the ergonomics of human-
Therefore, the AAA has put forth a recommendation of system interaction as defined by ISO 9241:110 is error
proposed terminology to describe vehicle automation features. tolerance. A dialogue (“interaction between a user and an
AAA encourages automakers “to include the common naming interactive system”) is error tolerant if it supports the user in
for advanced safety systems on the window sticker, owner’s achieving their intended results with the system, despite errors
manual, and other collateral materials so consumers can more in input. It is achieved by means of error control, correction
clearly understand what technology is present [in] the and management [59]. In the context of vehicle automation, a
vehicle.” They also acknowledge that automakers may wish key part of designing for error tolerance is closing the human-
to continue to use their branded terms for assistive systems, in automation feedback loop by means of a driver monitoring
tandem with their suggested terms [24]. Industry experts have system (DMS).
suggested that multiple levels is not efficient for public use A DMS “monitors driver condition by various means to
and that the classification of vehicle automation should detect drowsiness or lack of attention” [24] and is especially
instead be divided into two categories: useful in the context of Level 2/3 automation [60]. There are
Geotonomous/Geotonomy (full automation limited only by three types of DMSs used in vehicles with partial automation
geography) and Human-Assisted System (HAS) (all systems on-road today: 1) head & eye tracking (e.g. Cadillac
which require human supervision, e.g. ADAS) [15]. SuperCruise [61]), 2) steering wheel capacitive sensors (hand
4) Driver Education detection, e.g. BMW Traffic Jam Assist [62]), 3) steering
Public awareness self-driving technologies and driver wheel torque sensors (assistive steering resistance detection,
assistance systems are an essential part of shaping safe e.g. Tesla Autopilot [29]). However, the robustness and cost
interactions. There are organizations such as the Partners for of these driver monitoring systems varies. Capacitive sensors,
Automated Vehicle Education (PAVE), a collective of head and eye trackers or some combination of sensors is the
OEMS, self-driving companies, academics, and government most reliable solution, while torque sensors are the least
organizations whose aim is to “inform and educate the public effective (especially on straight, flat roads where drivers are
and policymakers on the facts regarding automated vehicles” more likely to become inattentive) [62]. A reliable DMS
[53]. Let’s Talk Self-Driving is another group, led by self- assists the driver in proper system use by curbing misuse and
driving company Waymo and partnered with groups such as supporting trust calibration. Autonowashing leads to
AAA, the National Safety Council, and other national and overtrust, which then leads to misuse [6]; therefore, a DMS is
community organizations supporting safer roadways. They the final line of defense in curbing misuse and preventing
Figure 5. Effects of Autonowashing and the critical role of a Driver Monitoring System (DMS) in ensuring the return on
investment (ROI) in vehicle autonomy. Autonowashing leads to overtrust, which leads to misuse. If a DMS is unable to assist
the user in error prevention, accident, injury or death may occur. This results in negative media coverage which can then
stir public distrust in vehicle automation, threatening ROI (ROI refers to both economic and humanitarian returns).
accident, injury and/or death due to autonowashing (see shown leads to confusion about the amount of human
Figure 5). supervision required to safely operate the system (vague
`language, Table 2) [12].
III. DISCUSSION A system that knows the state of its operator is better able
Acts of greenwashing have effectively stalled meaningful to support them in meeting their goals. Driver state monitoring
progress towards the development of more sustainable is a vital part of the human-automation team, completing the
societies. Ironic, of course, as this is the goal which it appears feedback loop necessary for safe use. Autopilot is not
to represent. The development of the term greenwashing supported by robust a DMS [62], as Tesla employs neither
captured the essence of the problem that is corporations capacitive hand detection nor head and eye tracking sensors in
masquerading their products and services as “eco-friendly”. their vehicles; either of which are key supporting/backup
Greenwashing has been functional in building consensus and systems for ensuring appropriate reliance and road safety. The
has helped to raise public awareness of the misleading tactics failure to implement existing technologies to build an error
being used by companies against consumers. The awareness tolerant system is a lapse in systems design principles [59] and
of greenwashing as an issue has inspired individuals to inform a failure of corporate social responsibility.
themselves and begin to ask the questions necessary to close Further, false idols (see Table 2) which model
the gap toward the truth. inappropriate reliance support the improper use of the system.
As autonomy evolves and its presence in our everyday As for the on-camera behavior of Tesla’s CEO, Elon Musk,
lives grows, so do the human factors challenges it puts forth. subject matter experts have called this out as abusive and at
Inconsistencies between users’ expectation of a system’s risk for “widening the gap between what the car seems to do
capabilities, and the system’s technical capabilities create and what it actually does” [63]. Musk’s behavior and words
challenges in the calibration of user trust. This gap—between are acts of autonowashing, when he makes Autopilot appear
the system functionality and the user’s expectation—formed to be more autonomous than it really is. Autonowashed
by misleading information in the media and marketing portrayals of vehicle automation such as this encourage
promotions is the result of autonowashing unrealistic expectations of the technology, which are
The conversation about automation will continue to be bi- counterproductive to its acceptance and adoption.
level—experts require a vocabulary that allows them to OEMs must take responsibility for their role in calibrating
address technical challenges, while users simultaneously trust in vehicle automation. Trust cannot be an afterthought,
require their own vocabulary, able to support even novices in left for human factors professionals to tackle in summative
appropriate, safe interactions with automation. Yet, neither of evaluations. It must be positioned by OEMs as a core principle
these conversations happens in a vacuum; hence, the fuzzy in the functional design of systems, their testing and
semantics of automation are of no surprise. Because research evaluation. The systems must further be deployed with
shows that trust calibration begins before users’ first contact thoughtful, trustworthy marketing promotions, taking into
with vehicle automation, and is influenced by the media & account the limitations of the system. A worthy cause, as
advertisements, a standardized terminology is an essential first companies which prioritize trustworthy marketing in long-
step in alleviating autonowashing. term secure reduced customer acquisition costs, higher profit
The current state of vehicle autonomy on-road (Level 2) margins, growth and a competitive advantage [64].
requires the full attention and monitoring by a human driver Organizations such as the PAVE Campaign and Let’s Talk
at all times. Although Tesla is not the only automaker guilty Self-Driving are needed to raise public awareness around the
of autonowashing, Tesla is the only OEM currently marketing current state of vehicle automation. These groups will be
Level 2 vehicles as “self-driving” [38]; for this reason, Tesla important touchpoints between the industry and the consumer,
is predominately featured as a case study in this paper. and can help to prime users via advertisements and
Furthermore, the name of Tesla’s ADAS, Autopilot, implies educational materials about where vehicle autonomy is today,
an unspecified level of human inattention, which studies have
where it is going next, and the goals and benefits of such Canada Int. Humanit. Technol. Conf., pp. 197–201,
technology. 2017.
Further, Casner & Hutchins’ [17] standards may be used [2] C. Kerry and J. Karsten, “Gauging investment in
as a foundation to build a standard protocol for dealerships or self-driving cars,” The Brookings Institution, 2017.
vehicle rental agencies selling/lending vehicles equipped with [Online]. Available:
Level 2/3 systems. In the future, regulation may perhaps https://www.brookings.edu/research/gauging-
prohibit the handover (sale/rental) of the vehicle to a driver investment-in-self-driving-cars/. [Accessed: 09-Oct-
that has not been briefed on the systems capabilities and 2019].
limitations. [3] B. Brown and E. Laurier, “The trouble with
The effects of autonowashing on vehicle automation are
autopilots : Assisted and autonomous driving on the
varied, and therefore must be mitigated by a multifaceted
approach. Improvements in the areas of a standardized social road,” Conf. Comput. Interact., pp. 416–429,
terminology, systems design, and driver education all support 2017.
the easing of the negative impacts of autonowashing. In the [4] M. Rouse, “What is greenwashing?,” WhatIs.com,
case of automated driving, delays in the advancement, release, 2007. [Online]. Available:
and acceptance of this technology are costly—for companies, https://searchcrm.techtarget.com/definition/greenwa
their investors and for anyone who uses public roadways, at shing. [Accessed: 09-Sep-2019].
risk of being one of the 1.35 million people who will die this [5] F. Ekman, M. Johansson, and J. Sochor, “Creating
year in auto accidents, internationally [65]. Appropriate Trust for Autonomous Vehicle
Systems: A Framework for Human-Machine
IV. CONCLUSION Interaction Design,” 95th Annu. Meet. Transp. Res.
Automation, in vehicles and beyond, possesses a powerful Board, pp. 1–7, 2017.
potential for good; but with great power comes great social [6] J. Lee and K. See, “Trust in Automation: Designing
responsibility. To realize the full benefits of automation in the for Appropriate Reliance,” Hum. Factors J. Hum.
long-term, systems firstly must be designed in a way that is Factors Ergon. Soc., vol. 46, no. 1, pp. 50–80, 2004.
human-centered; then, in order to support appropriate reliance [7] R. Parasuraman and V. Riley, “Humans and
from the beginning, they must be carefully introduced to Automation: Use, Misuse, Disuse, Abuse,” Hum.
users. Factors J. Hum. Factors, 1997.
Despite the prevalence of the concept, autonowashing has [8] H. Abraham, B. Seppelt, B. Mehler, and B. Reimer,
not been given a formal name until now. The contribution of “What’s in a Name : Vehicle Technology Branding
this paper is the offering of a unified term to build consensus & Consumer Expectations for Automation,” Proc.
around this issue. While this paper primarily addresses 9th ACM Int. Conf. Automot. User Interfaces
autonowashing in the context of partially/semi-autonomous
Interact. Veh. Appl. (AutomotiveUI ’17), pp. 226–
vehicles, this term extends into other contexts where
automation is used, particularly those in which the 234, 2017.
consequences of misuse are heightened and/or safety critical. [9] Cambridge English Dictionary, “Definition:
Supporting the proper adoption of automation is an effort Corporate Social Responsbility,” Cambridge
to improve the quality of life for the humans it serves. Giving University Press, 2019. [Online]. Available:
this problem a name and identifying autonowashing for what https://dictionary.cambridge.org/dictionary/english/
it is, allows us to tackle the challenges it presents, head-on. corporate-social-responsibility. [Accessed: 26-Sep-
2019].
ACKNOWLEDGMENTS [10] B. Watson, “The troubling evolution of corporate
Special thanks to Prof. Dr. Karsten Nebe, Prof. Dr. greenwashing,” The Gaurdian, 2016. [Online].
William M. Megill, and Mr. Amrith Shanbhag for their Available:
guidance and support. https://www.theguardian.com/sustainable-
business/2016/aug/20/greenwashing-
FUNDING & CONFLICTS OF INTEREST environmentalism-lies-companies. [Accessed: 12-
This research was completed independently and did not Sep-2019].
receive any specific grant from funding agencies in the public, [11] TerraChoice Environmental Marketing Inc., “The
commercial, or not-for-profit sectors. The author is ‘Six Sins of Greenwashing’ A Study of
unaffiliated with any automotive company or institution, by Environmental Claims in North American
means of employment, investment or otherwise. Consumer Markets,” 2007.
[12] The Insurance Institute for Highway Safety, “New
REFERENCES
studies highlight driver confusion about automated
[1] K. Shahriari and M. Shahriari, “IEEE standard systems,” IIHS Research Report, 2019. [Online].
review — Ethically aligned design: A vision for Available: https://www.iihs.org/news/detail/new-
prioritizing human wellbeing with artificial studies-highlight-driver-confusion-about-
intelligence and autonomous systems,” 2017 IEEE automated-systems. [Accessed: 06-Sep-2019].
[13] Society of Automotive Engineers (SAE) 2019.
International, “Taxonomy and Definitions for Terms [25] Lommatzsch v. Tesla, Inc. d/b/a Tesla Motors Inc.
Related to Driving Automation Systems for On- Case No. 2:2018cv00775, in the Third District
Road Motor Vehicles: J3016_201806,” 2018. Court For the State of Utah, Salt Lake. 2018.
[14] Thatcham Research, “Automated Driving hype is [26] Sz Hua Huang et al. v. Tesla, Inc. d/b/a Tesla
dangerously confusing drivers, study reveals,” 2018. Motors Inc. Case No. 19CV346663, in the Superior
[Online]. Available: Court of the State of California, Santa Clara. 2019.
https://news.thatcham.org/pressreleases/autonomous [27] Banner v. Tesla, Inc. d/b/a Tesla Motors Inc. Case
-driving-hype-is-dangerously-confusing-drivers- No. 50-2019-CA-009962, in the Circuit Court of the
study-reveals-2767283. [Accessed: 19-Sep-2019]. 15th Judicial Circuit, Palm Beach County Florida.
[15] A. Roy, “The Language of Self-Driving Cars Is 2019.
Dangerous—Here’s How To Fix It,” The Drive, [28] R. Abrams and A. Kurtz, “Joshua Brown, Who Died
2018. [Online]. Available: in Self-Driving Accident, Tested Limits of His
https://www.thedrive.com/tech/20553/the-language- Tesla,” The New York Times, 2016. [Online].
of-self-driving-cars-is-dangerous-heres-how-to-fix- Available:
it. [Accessed: 09-Sep-2019]. https://www.nytimes.com/2016/07/02/business/josh
[16] J. Beller, M. Heesen, and M. Vollrath, “Improving ua-brown-technology-enthusiast-tested-the-limits-
the driver-automation interaction: An approach of-his-tesla.html. [Accessed: 07-Oct-2019].
using automation uncertainty,” Hum. Factors, vol. [29] Tesla, Model S Owner’s Manual, 2019.16.1. 2019.
55, no. 6, pp. 1130–1141, 2013. [30] P. Campbell, “Volvo to put 100 British families in
[17] S. M. Casner and E. L. Hutchins, “What Do We Tell driverless cars,” Financial Times, 2017. [Online].
the Drivers? Toward Minimum Driver Training Available: https://www.ft.com/content/5b76aba2-
Standards for Partially Automated Cars,” J. Cogn. 0bc4-11e6-9456-444ab5211a2f#axzz470yNP3TA.
Eng. Decis. Mak., 2019. [Accessed: 25-Sep-2019].
[18] M. Körber, “Theoretical considerations and [31] S. Glinton, “Tesla Has Begun Making All Its New
development of a questionnaire to measure trust in Cars Self-Driving : The Two-Way : NPR,” NPR,
automation,” in 20th Triennial Congress of the IEA, 2016. [Online]. Available:
2018. https://www.npr.org/sections/thetwo-
[19] B. M. Muir, “Trust in automation: Part I. way/2016/10/20/498753508/tesla-has-begun-
Theoretical issues in the study of trust and human making-all-its-new-cars-self-driving. [Accessed: 07-
intervention in automated systems,” Ergonomics, Oct-2019].
vol. 37, no. 11, pp. 1905–1922, 1994. [32] Tesla Inc., “All Tesla Cars Being Produced Now
[20] M. Beggiato and J. F. Krems, “The evolution of Have Full Self-Driving Hardware,” Tesla Blog,
mental model, trust and acceptance of adaptive 2016. [Online]. Available:
cruise control in relation to initial information,” https://www.tesla.com/de_DE/blog/all-tesla-cars-
Transp. Res. Part F Traffic Psychol. Behav., vol. 18, being-produced-now-have-full-self-driving-
pp. 47–57, 2013. hardware. [Accessed: 21-Sep-2019].
[21] M. Nees, “Acceptance of Self-driving Cars: An [33] A. Fleck, “Elon Musk Defends Tesla Following
Examination of Idealized versus Realistic Portrayals Latest Self-Driving Accident,” Adweek, 2018.
with a Self- driving Car Acceptance Scale,” Proc. [Online]. Available:
Hum. Factors Ergon. Soc. Annu. Meet., vol. 60, no. https://www.adweek.com/digital/elon-musk-
1, pp. 1449–1453, 2016. defends-tesla-following-latest-self-driving-
[22] V. Eckert, “Germany says Tesla should not use accident/. [Accessed: 07-Oct-2019].
‘Autopilot’ in advertising,” Reuters, 2016. [Online]. [34] A. J. Hawkins, “Fully driverless cars are on public
Available: https://www.reuters.com/article/us-tesla- roads in Texas,” The Verge, 2018. [Online].
germany/germany-says-tesla-should-not-use- Available:
autopilot-in-advertising-idUSKBN12G0KS. https://www.theverge.com/2018/5/17/17365188/dri
[Accessed: 21-Sep-2019]. ve-ai-driverless-self-driving-car-texas. [Accessed:
[23] J. McPherson, “In His 60 Minutes Appearance, Elon 25-Sep-2019].
Musk Was Not On The Level(s),” Forbes.com, 11- [35] J. Saunders, “Shocking moment a Tesla driver is
Dec-2018. [Online]. Available: filmed ASLEEP behind the wheel as his self-driving
https://www.forbes.com/sites/jimmcpherson/2018/1 car travels at high speeds on the California
2/11/in-his-60-minutes-appearance-elon-musk-was- interstate,” MailOnline, 2019. [Online]. Available:
not-on-the-levels/. [Accessed: 19-Sep-2019]. https://www.dailymail.co.uk/news/article-
[24] American Automobile Association, “Advanced 7387827/Tesla-driver-filmed-ASLEEP-wheel-self-
Driver Assistance Technology Names,” p. 21p, driving-car-travels-high-speeds-LA.html.
[Accessed: 25-Sep-2019]. Autopilot claims for $5M | TechCrunch,”
[36] Tesla, “Support: Autopilot,” 2019. [Online]. TechCrunch.com, 2018. [Online]. Available:
Available: https://www.tesla.com/support/autopilot. https://techcrunch.com/2018/05/25/tesla-settles-
[Accessed: 18-Sep-2019]. class-action-suit-over-autopilot-claims-for-5m/.
[37] Cambridge English Dictionary, “Definition: [Accessed: 22-Sep-2019].
Autopilot,” Cambridge University Press, 2019. [48] S. Youn, “Tesla sued for ‘defective’ Autopilot in
[Online]. Available: wrongful death suit of Florida driver who crashed
https://dictionary.cambridge.org/dictionary/english/ into tractor trailer,” ABC News, 2019. [Online].
autopilot. [Accessed: 18-Sep-2019]. Available:
[38] The Center for Auto Safety and Consumer https://abcnews.go.com/Technology/tesla-sued-
Watchdog, “Request for Investigation of Deceptive defective-autopilot-wrongful-death-suit-
and Unfair Practices in Advertising and Marketing florida/story?id=64706707. [Accessed: 06-Sep-
of the ‘Autopilot’ Feature Offered in Tesla Motor 2019].
Vehicles.” 2018. [49] National Transportation Safety Board, “Driver
[39] T. B. Lee, “Elon Musk announces another price hike Errors, Advanced Driver Assistance System Design,
for ‘full self-driving’ package,” ArsTechnica.com, Led to Highway Crash,” 2019. [Online]. Available:
2019. [Online]. Available: https://www.ntsb.gov/news/press-
https://arstechnica.com/cars/2019/07/elon-musk- releases/Pages/NR20190904.aspx. [Accessed: 22-
announces-another-price-hike-for-full-self-driving- Sep-2019].
package/. [Accessed: 21-Sep-2019]. [50] E. Taylor, “Mercedes rejects claims about
[40] T. B. Lee, “People who paid Tesla $3,000 for full ‘misleading’ self-driving car ads,” Reuters, 2016.
self-driving might be out of luck,” Ars Technica, [Online]. Available:
2018. [Online]. Available: https://www.reuters.com/article/us-mercedes-
https://arstechnica.com/cars/2018/04/why-selling- marketing/mercedes-rejects-claims-about-
full-self-driving-before-its-ready-could-backfire- misleading-self-driving-car-ads-idUSKCN1081VV.
for-tesla/2/. [Accessed: 07-Oct-2019]. [Accessed: 09-Oct-2019].
[41] Tesla Inc., “Full Self-Driving Hardware on All [51] F. Lambert, “Mercedes pulls ‘self-driving car’
Teslas | Tesla,” Tesla Videos, 2016. [Online]. advert following concerns over Tesla’s use of
Available: https://www.tesla.com/videos/full-self- ‘Autopilot,’” Electrek, 2016. [Online]. Available:
driving-hardware-all-tesla-cars. [Accessed: 07-Oct- https://electrek.co/2016/07/29/mercedes-pull-self-
2019]. driving-car-claim-advert-tesla-autopilot/. [Accessed:
[42] Euro NCAP, “AUTOMATED DRIVING 2018, 09-Oct-2019].
Tesla Model S Highway Assist System,” 2018. [52] Federal Trade Commission, “Federal Trade
[43] @elonmusk, “Elon Musk on Twitter: ‘Tesla drives Commission Act, Section 5: Unfair or Deceptive
itself (no human input at all) thru urban streets to Acts or Practices Background,” 2019.
highway to streets, then finds a parking spot,’” [53] Partners for Automated Vehicle Education, “About |
Twitter, 2016. [Online]. Available: PAVE Campaign,” 2019. [Online]. Available:
https://twitter.com/elonmusk/status/7890191458535 https://pavecampaign.org/about/. [Accessed: 27-
13729. [Accessed: 07-Oct-2019]. Sep-2019].
[44] CBS News, “Tesla CEO Elon Musk addresses [54] “Let’s Talk Self-Driving,” Waymo, LLC, 2019.
autopilot system safety concerns: ‘We’ll never be [Online]. Available: https://letstalkselfdriving.com/.
perfect,’” CBS Interactive Inc., 2018. [Online]. [Accessed: 03-Oct-2019].
Available: https://www.cbsnews.com/news/tesla- [55] IEEE, “A Vision for Prioritizing Human Well-being
ceo-elon-musk-addresses-autopilot-safety- with Autonomous and Intelligent Systems, First
concerns/. [Accessed: 19-Sep-2019]. Edition,” IEEE Glob. Initiat. Ethics Auton. Intell.
[45] Bloomberg, “Tesla Test Drive: Model P85D, Syst., p. 292, 2019.
Autopilot, Zero to 60,” Bloomberg L.P., 2014. [56] C. Mullen, “Reaching Zero Crashes: A Dialogue on
[Online]. Available: the Role of Current Advanced Driver Assistance
https://www.bloomberg.com/news/videos/2014-10- Systems,” in National Transportation Safety Board,
10/driving-tesla-with-musk-zero-to-60-and-testing- 2016.
autopilot. [Accessed: 19-Sep-2019]. [57] V. A. Banks, A. Eriksson, J. O’Donoghue, and N.
[46] Dean Sheikh et al. v. Tesla Inc. d/b/a Tesla Motors A. Stanton, “Is partially automated driving a bad
Inc. Case No. 5:17-cv-02193, in the U.S. District idea? Observations from an on-road study,” Appl.
Court for the Northern District of California, San Ergon., no. 68, pp. 138–145, 2018.
Jose Division. 2017. [58] H. Abraham, H. McAnulty, B. Mehler, and B.
[47] D. Coldewey, “Tesla settles class action suit over Reimer, “Case Study of today’s automotive
dealerships: Introduction and delivery of advanced [62] T. Mousel, A. Treis, and IEE S.A., “Hands Off
driver assistance systems,” Transp. Res. Rec., vol. Detection Requirements for UN R79 Regulated
2660, no. August, pp. 7–14, 2017. Lane Keeping Assist Systems,” 2017.
[59] International Organization for Standardization, “ISO [63] J. Stewart, “Elon Musk Abuses Tesla Autopilot on
9241-110:2006 Ergonomics of human-system 60 Minutes,” Wired.com, 2018. [Online]. Available:
interaction — Part 110: Dialogue principles.” https://www.wired.com/story/elon-musk-tesla-
International Standards Organization, p. 22, 2006. autopilot-60-minutes-interview/. [Accessed: 22-Sep-
[60] Society of Automotive Engineers (SAE) 2019].
International, “SAE International Releases Updated [64] G. L. Urban, “The Trust Imperative,” 2003.
Visual Chart for Its ‘Levels of Driving Automation’ [65] World Health Organization, “Global status report on
Standard for Self-Driving Vehicles,” SAE.org, 2018. road safety 2018,” World Health Organization,
[61] Cadillac, “CT6 Owner’s Manual.” 2019. 2019.

View publication stats

You might also like