Machine Behavior Needs to Be an Academic Discipline

What if physiologists were the only people who study human behavior at all scales: from how the human body functions, to how social norms emerge, to how the stock market functions, to how we create, share, and consume culture? What if neuroscientists were the only people tasked with studying criminal behavior, designing educational curricula, and devising policies to fight tax evasion?

Despite their growing influence on our lives, our study of AI agents is conducted this way—by a very specific group of people. Those scientists who create AI agents—namely, computer scientists and roboticists—are almost exclusively the same scientists who study the behavior of AI agents.

We cannot certify that an AI agent is ethical by looking at its source code, any more than we can certify that humans are good by scanning their brains.

As these computer scientists and roboticists create their agents to solve particular tasks—no small feat—they most often focus on ensuring that their agents fulfill their intended function. For this, they use a variety of benchmark datasets and tasks that make it possible to compare different algorithms objectively and consistently. For example, email classification programs

You're reading a preview, sign up to read more.

More from Nautilus

Nautilus9 min read
Homo Narrativus And The Trouble With Fame: We think that fame is deserved. We are wrong.
Our understanding of fame is critical to how we see each other and our society. But it is also badly wrong. Let me tell you why. We humans are storytelling and story-finding machines: homo narrativus, if you will. In making sense of the world, we loo
Nautilus14 min read
Language Both Enraptures and Deceives Us: An interview with linguist and writer Julie Sedivy.
The purpose of language is to reveal the contents of our minds, says Julie Sedivy. It’s a simple and profound insight. We are social animals and language is what springs us from our isolated selves and connects us with others. Sedivy has taught lingu
Nautilus4 min readScience
Mind the Gap Between Science and Religion
Have you heard that we may be living in a computer simulation? Or that our universe is only one of infinitely many parallel worlds in which you live every possible variation of your life? Or that the laws of nature derive from a beautiful, higher-dim