Professional Documents
Culture Documents
What Can Machine Learning Do - Workforce Implications - Science
What Can Machine Learning Do - Workforce Implications - Science
TECHNOLOGY AND THE ECONOMY (SML), other tasks within these same jobs do
not fit the criteria for ML well; hence, effects
What can machine learning on employment are more complex than the
simple replacement and substitution story
emphasized by some. Although economic ef-
do? Workforce implications fects of ML are relatively limited today, and
we are not facing the imminent “end of work”
as is sometimes proclaimed, the implications
Profound change is coming, but roles for humans remain for the economy and the workforce going for-
ward are profound.
By Erik Brynjolfsson1,2 and Tom Mitchell3 engine and electricity, which spawns a pleth- Any discussion of what ML can and cannot
ora of additional innovations and capabilities do, and how this might affect the economy,
ILLUSTRATION: DAVIDE BONAZZI/@SALZMANART
D
igital computers have transformed (2), there is no widely shared agreement on should first recognize two broad, underly-
work in almost every sector of the the tasks where ML systems excel, and thus ing considerations. We remain very far from
economy over the past several decades little agreement on the specific expected im- artificial general intelligence (3). Machines
(1). We are now at the beginning of pacts on the workforce and on the economy cannot do the full range of tasks that humans
an even larger and more rapid trans- more broadly. We discuss what we see to be can do (4). In addition, although innovations
formation due to recent advances in key implications for the workforce, drawing
machine learning (ML), which is capable of on our rubric of what the current generation 1
Sloan School of Management, Massachussetts Institute of
accelerating the pace of automation itself. of ML systems can and cannot do [see the Technology, Cambridge, MA 02139, USA. 2National Bureau
of Economic Research, Cambridge, MA 02138, USA.
However, although it is clear that ML is a supplementary materials (SM)]. Although 3
Carnegie Mellon University, Pittsburgh, PA 15213, USA.
“general purpose technology,” like the steam parts of many jobs may be “suitable for ML” Email: erikb@ mit.edu
Published by AAAS
become more valuable. In other cases, ma- rithms. When large enough training data sets
chines will augment human capabilities and are available, ML can sometimes produce
make possible entirely new products, ser- computer programs that outperform the best
vices, and processes. Therefore, the net effect humans at the task (e.g., dermatology diag-
on the demand for labor, even within jobs nosis, the game of Go, detecting potential
that are partially automated, can be either credit card fraud).
negative or positive. Although broader eco- Also critical to ML progress has been the
nomic effects can be complex, labor demand combination of improved algorithms, in-
is more likely to fall for tasks that are close cluding deep neural networks (DNNs) and
substitutes for capabilities of ML, whereas it considerably faster computer hardware. For
is more likely to increase for tasks that are example, Facebook switched from phrase-
complements for these systems. Each time based machine translation models to DNNs
an ML system crosses the threshold where it for more than 4.5 billion language transla-
becomes more cost-effective than humans on tions each day. DNNs for image recognition
a task, profit-maximizing entrepreneurs and have driven error rates on ImageNet, a large
managers will increasingly seek to substitute data set of more than 10,000 labeled images
machines for people. This can have effects (7), down from more than 30% in 2010 to less
throughout the economy, boosting productiv- than 3% today. Similarly, DNNs have helped
ity, lowering prices, shifting labor demand, improve error rates from 8.4% to 4.9% in
and restructuring industries. voice recognition since July 2016. The 5%
human worker, while also learning by ob- able, the more accurate the learning. 4. No long chains of logic or reasoning that
serving the human’s decisions and captur- One of the remarkable characteristics depend on diverse background knowledge
ing these as additional training examples. of DNNs is that performance in many or common sense
This approach has led to new kinds of busi- domains does not seem to asymptote ML systems are very strong at learning
ness models. after a certain number of examples empirical associations in data but are
Training a learning apprentice to mimic (10). It is especially important that less effective when the task requires
human-generated decisions offers the poten- all of the relevant input features be long chains of reasoning or complex
tial for machines to learn from the combined captured in the training data. Although planning that rely on common sense
data of multiple people it assists, perhaps in principle any arbitrary function can or background knowledge unknown to
leading to outperforming each individual on be represented by a DNN (11), comput- the computer. Ng’s “one-second rule” (4)
the team that trains it. Still, its learned exper- ers are vulnerable to mimicking and suggests that ML will do well on video
tise may be limited by the skill level of the perpetuating unwanted biases present games that require quick reaction and
human team and by the online availability of in the training data and to missing provide instantaneous feedback but
relevant decision variables. However, in cases regularities that involve variables that less well on games where choosing the
where the computer can also access indepen- they cannot observe. Digital data can optimal action depends on remembering
dent data to determine the optimal decision often be created by monitoring existing previous events distant in time and on
(ground truth), it may be possible to improve processes and customer interactions, by unknown background knowledge about
on human decisions and then to help the hu- hiring humans to explicitly tag or label the world (e.g., knowing where in the
man improve their own performance. For portions of the data or create entirely room a newly introduced item is likely
example, in medical diagnosis of skin cancer new data sets, or by simulating the to be found) (12). Exceptions to this are
standard for the ML system. ML is par- do. While work is under way on explain-
2. Large (digital) data sets exist or can be ticularly powerful when training data are able AI systems (13), current systems are
created containing input-output pairs labeled according to such gold standards, relatively weak in this area. For example,
The more training examples are avail- thereby defining the desired goals. whereas computers can diagnose certain
Published by AAAS
types of cancer or pneumonia as well as data reveal regularities that entail a strategy. objects like the heat exchanger (see photo)
or better than expert doctors, their ability Although the framework of routine versus that meet all the requirements (e.g., weight,
to explain why or how they came up with nonroutine tasks did a very effective job of strength, and cooling rate) more effectively
the diagnosis is poor when compared describing tasks suitable for the last wave of than anything designed by a human, and
with human doctors. For many percep- automation (14), the set of SML tasks is of- with a very different look and feel (18).
tual tasks, humans are also poor at ex- ten very different. Thus, simply extrapolating Is it “creative”? That depends on what
plaining, for example, how they recognize past trends will be misleading, and a new definition one uses. But some “creative” tasks
words from the sounds they hear. framework is needed. that were previously reserved for humans
Jobs typically consist of a number of dis- will be increasingly automatable in the com-
6. A tolerance for error and no need for tinct but interrelated tasks. In most cases, ing years. This approach works well when
provably correct or optimal solutions only some of these tasks are likely to be suit- the final goal can be well specified and the
Nearly all ML algorithms derive their able for ML, and they are not necessarily the solutions can be automatically evaluated as
solutions statistically and probabilisti- ones that were easy to automate with previ- clearly right or wrong, or at least better or
cally. As a result, it is rarely possible to ous technologies. For instance, when we ap- worse. As a result, we can expect such tasks
train them to 100% accuracy. Even the ply our 21-question SML rubric to various to be increasingly subject to automation. At
best speech, object recognition, and occupations, we find that a ML system can the same time, the role of humans in more
clinical diagnosis computer systems be trained to help lawyers classify potentially clearly defining goals will become more im-
make errors (as do the best humans). relevant documents for a case but would have portant, suggesting an increased role for
Therefore, tolerance to errors of the a much harder time interviewing potential scientists, entrepreneurs, and those making
learned system is an important crite- witnesses or developing a winning legal strat- a contribution by asking the right questions,
4. Income elasticity dimensions will tend to take longer to af- in skills, resources, and infrastructure—
Automation may change the total fect the economy and workforce than those thrived as a result, whereas others not only
income for some individuals or the that require less redesign of existing sys- failed to participate in the full benefits but in
broader population. If income elastic- tems. For instance, integration of autono- some cases were made worse off. Thus, a bet-
ity for a good is nonzero, this will in mous trucks onto city streets might require ter understanding of the precise applicability
turn change demand for some types of changes in traffic laws, liability rules, in- of each type of ML and its implications for
goods and the derived demand for the surance regulations, traffic flow, and the specific tasks is critical for understanding its
tasks needed to produce those goods. By like, whereas the switch from talking to a likely economic impact. j
analogy, as total income has increased, human assistant to a virtual assistant in
RE FERENCES AND NOT ES
Americans have spent more of their a call center might require relatively little
1. National Academies of Sciences, Engineering, and
income on restaurant meals. redesign of other aspects of the business Medicine, Information Technology and the U.S. Workforce:
process or customer experience. Where Are We and Where Do We Go from Here? (National
5. Elasticity of labor supply Over time, another factor becomes increas- Academies Press, Washington, DC, 2017).
2. E. Brynjolfsson, D. Rock, C. Syverson, “Artificial
As wages change, the number of people ingly important: New goods, services, tasks, Intelligence and the Modern Productivity Paradox: A
working on the task will respond. If and processes are always being invented. Class of Expectations and Statistics,” NBER Working
there are many people who already have These inventions can lead to the creation of Paper 24001 (National Bureau of Economic Research,
Cambridge, MA, 2017).
the requisite skills (for example, driving altogether new tasks and jobs (23) and thus 3. S. Legg, M. Hutter, Frontiers in Artificial Intelligence and
a car for a ride-hailing service), then can change the magnitudes and signs of the Applications 157, 17 (2007).
supply will be fairly elastic and wages above relationships. Historically, as some 4. A. Ng, What artificial intelligence can and can’t do right
now, Harvard Business Rev. (9 November 2016).
will not rise (or fall) much, if at all, even tasks have been automated, the freed-up la-
Published by AAAS
What can machine learning do? Workforce implications
Erik Brynjolfsson and Tom Mitchell
REFERENCES This article cites 8 articles, 0 of which you can access for free
http://science.sciencemag.org/content/358/6370/1530#BIBL
PERMISSIONS http://www.sciencemag.org/help/reprints-and-permissions
Science (print ISSN 0036-8075; online ISSN 1095-9203) is published by the American Association for the Advancement of
Science, 1200 New York Avenue NW, Washington, DC 20005. 2017 © The Authors, some rights reserved; exclusive
licensee American Association for the Advancement of Science. No claim to original U.S. Government Works. The title
Science is a registered trademark of AAAS.