Nautilus

We Need to Save Ignorance From AI

After the fall of the Berlin Wall, East German citizens were offered the chance to read the files kept on them by the Stasi, the much-feared Communist-era secret police service. To date, it is estimated that only 10 percent have taken the opportunity.

In 2007, James Watson, the co-discoverer of the structure of DNA, asked that he not be given any information about his APOE gene, one allele of which is a known risk factor for Alzheimer’s disease.

Most people tell pollsters that, given the choice, they would prefer not to know the date of their own death—or even the future dates of happy events.

Each of these is an example of willful ignorance. Socrates may have made the case that the unexamined life is not worth living, and Hobbes may have argued that curiosity is mankind’s primary passion, but many of our oldest stories actually describe the dangers of knowing too much. From Adam and Eve and the tree of knowledge to Prometheus stealing the secret of fire, they teach us that real-life decisions need to strike a delicate balance between choosing to know, and choosing not to.

Move slower?: Silicon Valley culture celebrates fast experimentation, which may not be what we want for our personal data.Frederic Legrand - COMEO / Shutterstock.com

But what if a technology came along that shifted this balance unpredictably, complicating how we make decisions about when to remain ignorant? That technology is here: It’s called artificial intelligence.

You're reading a preview, sign up to read more.

More from Nautilus

Nautilus9 min readPsychology
Our Brains Tell Stories So We Can Live: Without inner narratives we would be lost in a chaotic world.
We are all storytellers; we make sense out of the world by telling stories. And science is a great source of stories. Not so, you might argue. Science is an objective collection and interpretation of data. I completely agree. At the level of the stud
Nautilus9 min readRelationships & Parenting
Families of Choice Are Remaking America: Through their networks of friends, singles are strengthening society’s social bonds.
When Dan Scheffey turned 50, he threw himself a party. About 100 people packed into his Manhattan apartment, which occupies the third floor of a brick townhouse in the island’s vibrant East Village. His parents, siblings, and an in-law were there, an
Nautilus6 min read
The Big Bang Is Hard Science. It Is Also a Creation Story.: Even with its explanatory power, Big Bang theory takes its place in a long line of myths.
In some ways, the history of science is the history of a philosophical resistance to mythical explanations of reality. In the ancient world, when we asked “Where did the world come from?” we were told creation myths. In the modern world, we are inste