Professional Documents
Culture Documents
Followthesespecialmen
394,313 35,451
108,768
Join501,839otherhumansand
TheAIRevolution:TheRoadto
havenewpostsemailedtoyou
Superintelligence
Email Address
January22,2015 ByTimUrban
Followthesespecialmen
PDF:WemadeafancyPDFofthispostforprintingandofflineviewing.Buyithere.(Orseeapreview.) 35,451
394,313 108,768
Note:ThereasonthisposttookthreeweekstofinishisthatasIdugintoresearchonArtificial
Intelligence,IcouldnotbelievewhatIwasreading.Ithitmeprettyquicklythatwhatshappeningin
theworldofAIisnotjustanimportanttopic,butbyfarTHEmostimportanttopicforourfuture.SoI
wantedtolearnasmuchasIcouldaboutit,andonceIdidthat,IwantedtomakesureIwroteapost
thatreallyexplainedthiswholesituationandwhyitmatterssomuch.Notshockingly,thatbecame
outrageouslylong,soIbrokeitintotwoparts.ThisisPart1Part2ishere.
_______________
WeareontheedgeofchangecomparabletotheriseofhumanlifeonEarth.VernorVinge
Whatdoesitfeelliketostandhere?
PopularPosts
TheAIRevolution
854
WhyProcrastinators
Procrastinate
354
Itseemslikeaprettyintenseplacetobestandingbutthenyouhavetoremembersomethingabout
TheFermiParadox
whatitsliketostandonatimegraph:youcantseewhatstoyourright.Sohereshowitactuallyfeels
tostandthere: 893
TheElonMuskSeries
394
HowtoPickaLifePartner
148
WhyGenYYuppiesAre
Unhappy
http://waitbutwhy.com/2015/01/articial-intelligence-revolution-1.html 1/14
20/03/2017 The Articial Intelligence Revolution: Part 1 - Wait But Why
993
Followthesespecialmen
7WaystobeInsufferable
394,313 onFacebook 35,451
108,768
679
PuttingTimeIn
Perspective
270.5k 462
HowtoNameaBaby
248
WhyYouShouldStop
CaringWhatOther
PeopleThink
Whichprobablyfeelsprettynormal
194
_______________
TheFarFutureComingSoon Religionforthe
Nonreligious
Imaginetakingatimemachinebackto1750atimewhentheworldwasinapermanentpower 528
outage,long-distancecommunicationmeanteitheryellingloudlyorfiringacannonintheair,andall
transportationranonhay.Whenyougetthere,youretrieveadude,bringhimto2015,andthenwalk 10Typesof30-Year-Old
SingleGuys
himaroundandwatchhimreacttoeverything.Itsimpossibleforustounderstandwhatitwouldbe
likeforhimtoseeshinycapsulesracingbyonahighway,talktopeoplewhohadbeenontheotherside 321
oftheoceanearlierintheday,watchsportsthatwerebeingplayed1,000milesaway,hearamusical
performancethathappened50yearsago,andplaywithmymagicalwizardrectanglethathecoulduse TheTailEnd
tocaptureareal-lifeimageorrecordalivingmoment,generateamapwithaparanormalmovingblue
150
dotthatshowshimwhereheis,lookatsomeonesfaceandchatwiththemeventhoughtheyreonthe
othersideofthecountry,andworldsofotherinconceivablesorcery.Thisisallbeforeyoushowhimthe
internetorexplainthingsliketheInternationalSpaceStation,theLargeHadronCollider,nuclear
weapons,orgeneralrelativity.
Thisexperienceforhimwouldntbesurprisingorshockingorevenmind-blowingthosewordsarent
bigenough.Hemightactuallydie.
Butherestheinterestingthingifhethenwentbackto1750andgotjealousthatwegottoseehis
reactionanddecidedhewantedtotrythesamething,hedtakethetimemachineandgobackthe
samedistance,getsomeonefromaroundtheyear1500,bringhimto1750,andshowhimeverything.
Andthe1500guywouldbeshockedbyalotofthingsbuthewouldntdie.Itwouldbefarlessofan
insaneexperienceforhim,becausewhile1500and1750wereverydifferent,theyweremuchless
differentthan1750to2015.The1500guywouldlearnsomemind-bendingshitaboutspaceand
physics,hedbeimpressedwithhowcommittedEuropeturnedouttobewiththatnewimperialismfad,
andhedhavetodosomemajorrevisionsofhisworldmapconception.Butwatchingeverydaylifego
byin1750transportation,communication,etc.definitelywouldntmakehimdie.
No,inorderforthe1750guytohaveasmuchfunaswehadwithhim,hedhavetogomuchfarther
backmaybeallthewaybacktoabout12,000BC,beforetheFirstAgriculturalRevolutiongaveriseto
thefirstcitiesandtotheconceptofcivilization.Ifsomeonefromapurelyhunter-gathererworldfrom
atimewhenhumanswere,moreorless,justanotheranimalspeciessawthevasthumanempiresof
1750withtheirtoweringchurches,theirocean-crossingships,theirconceptofbeinginside,andtheir
enormousmountainofcollective,accumulatedhumanknowledgeanddiscoveryhedlikelydie.
Andthenwhatif,afterdying,hegotjealousandwantedtodothesamething.Ifhewentback12,000
yearsto24,000BCandgotaguyandbroughthimto12,000BC,hedshowtheguyeverythingandthe
guywouldbelike,Okaywhatsyourpointwhocares.Forthe12,000BCguytohavethesamefun,
hedhavetogobackover100,000yearsandgetsomeonehecouldshowfireandlanguagetoforthe
firsttime.
Inorderforsomeonetobetransportedintothefutureanddiefromthelevelofshocktheyd
experience,theyhavetogoenoughyearsaheadthatadielevelofprogress,oraDieProgressUnit
(DPU)hasbeenachieved.SoaDPUtookover100,000yearsinhunter-gatherertimes,butatthepost-
AgriculturalRevolutionrate,itonlytookabout12,000years.Thepost-IndustrialRevolutionworldhas
movedsoquicklythata1750persononlyneedstogoforwardacouplehundredyearsforaDPUto
havehappened.
http://waitbutwhy.com/2015/01/articial-intelligence-revolution-1.html 2/14
20/03/2017 The Articial Intelligence Revolution: Part 1 - Wait But Why
ThispatternhumanprogressmovingquickerandquickerastimegoesoniswhatfuturistRay
KurzweilcallshumanhistorysLawofAcceleratingReturns.Thishappensbecausemoreadvanced
Followthesespecialmen
societieshavetheabilitytoprogressatafasterratethanlessadvancedsocietiesbecausetheyre
moreadvanced.19thcenturyhumanityknewmoreandhadbettertechnologythan15thcentury 394,313 35,451
108,768
humanity,soitsnosurprisethathumanitymadefarmoreadvancesinthe19thcenturythaninthe
15thcentury15thcenturyhumanitywasnomatchfor19thcenturyhumanity. 1 1 openthese
Thisworksonsmallerscalestoo.ThemovieBacktotheFuturecameoutin1985,andthepasttook
placein1955.Inthemovie,whenMichaelJ.Foxwentbackto1955,hewascaughtoff-guardbythe
270.5knewnessofTVs,thepricesofsoda,thelackofloveforshrillelectricguitar,andthevariationinslang.It
wasadifferentworld,yesbutifthemovieweremadetodayandthepasttookplacein1985,the
moviecouldhavehadmuchmorefunwithmuchbiggerdifferences.Thecharacterwouldbeinatime
beforepersonalcomputers,internet,orcellphonestodaysMartyMcFly,ateenagerborninthelate
90s,wouldbemuchmoreoutofplacein1985thanthemoviesMartyMcFlywasin1955.
ThisisforthesamereasonwejustdiscussedtheLawofAcceleratingReturns.Theaveragerateof
advancementbetween1985and2015washigherthantheratebetween1955and1985becausethe
formerwasamoreadvancedworldsomuchmorechangehappenedinthemostrecent30yearsthan
intheprior30.
Soadvancesaregettingbiggerandbiggerandhappeningmoreandmorequickly.Thissuggests
someprettyintensethingsaboutourfuture,right?
Kurzweilsuggeststhattheprogressoftheentire20thcenturywouldhavebeenachievedinonly20
yearsattherateofadvancementintheyear2000inotherwords,by2000,therateofprogresswas
fivetimesfasterthantheaveragerateofprogressduringthe20thcentury.Hebelievesanother20th
centurysworthofprogresshappenedbetween2000and2014andthatanother20thcenturysworth
ofprogresswillhappenby2021,inonlysevenyears.Acoupledecadeslater,hebelievesa20th
centurysworthofprogresswillhappenmultipletimesinthesameyear,andevenlater,inlessthan
onemonth.Allinall,becauseoftheLawofAcceleratingReturns,Kurzweilbelievesthatthe21stcentury
willachieve1,000timestheprogressofthe20thcentury.
2
IfKurzweilandotherswhoagreewithhimarecorrect,thenwemaybeasblownawayby2030asour
1750guywasby2015i.e.thenextDPUmightonlytakeacoupledecadesandtheworldin2050
mightbesovastlydifferentthantodaysworldthatwewouldbarelyrecognizeit.
Thisisntsciencefiction.ItswhatmanyscientistssmarterandmoreknowledgeablethanyouorIfirmly
believeandifyoulookathistory,itswhatweshouldlogicallypredict.
Sothenwhy,whenyouhearmesaysomethingliketheworld35yearsfromnowmightbetotally
unrecognizable,areyouthinking,Cool.butnahhhhhhh?Threereasonswereskepticalof
outlandishforecastsofthefuture:
1)Whenitcomestohistory,wethinkinstraightlines.Whenweimaginetheprogressofthenext30
years,welookbacktotheprogressoftheprevious30asanindicatorofhowmuchwilllikelyhappen.
Whenwethinkabouttheextenttowhichtheworldwillchangeinthe21stcentury,wejusttakethe
20thcenturyprogressandaddittotheyear2000.Thiswasthesamemistakeour1750guymadewhen
hegotsomeonefrom1500andexpectedtoblowhismindasmuchashisownwasblowngoingthe
samedistanceahead.Itsmostintuitiveforustothinklinearly,whenweshouldbethinking
exponentially.Ifsomeoneisbeingmorecleveraboutit,theymightpredicttheadvancesofthenext30
yearsnotbylookingattheprevious30years,butbytakingthecurrentrateofprogressandjudging
basedonthat.Theydbemoreaccurate,butstillwayoff.Inordertothinkaboutthefuturecorrectly,
youneedtoimaginethingsmovingatamuchfasterratethantheyremovingnow.
http://waitbutwhy.com/2015/01/articial-intelligence-revolution-1.html 3/14
20/03/2017 The Articial Intelligence Revolution: Part 1 - Wait But Why
Followthesespecialmen
394,313 35,451
108,768
270.5k
2)Thetrajectoryofveryrecenthistoryoftentellsadistortedstory.First,evenasteepexponential
curveseemslinearwhenyouonlylookatatinysliceofit,thesamewayifyoulookatalittlesegmentof
ahugecircleupclose,itlooksalmostlikeastraightline.Second,exponentialgrowthisnttotally
smoothanduniform.KurzweilexplainsthatprogresshappensinS-curves:
AnSiscreatedbythewaveofprogresswhenanewparadigmsweepstheworld.Thecurvegoes
throughthreephases:
1.Slowgrowth(theearlyphaseofexponentialgrowth)
2.Rapidgrowth(thelate,explosivephaseofexponentialgrowth)
3.Alevelingoffastheparticularparadigmmatures 3
Ifyoulookonlyatveryrecenthistory,thepartoftheS-curveyoureonatthemomentcanobscureyour
perceptionofhowfastthingsareadvancing.Thechunkoftimebetween1995and2007sawthe
explosionoftheinternet,theintroductionofMicrosoft,Google,andFacebookintothepublic
consciousness,thebirthofsocialnetworking,andtheintroductionofcellphonesandthensmart
phones.ThatwasPhase2:thegrowthspurtpartoftheS.But2008to2015hasbeenless
groundbreaking,atleastonthetechnologicalfront.Someonethinkingaboutthefuturetodaymight
examinethelastfewyearstogaugethecurrentrateofadvancement,butthatsmissingthebigger
picture.Infact,anew,hugePhase2growthspurtmightbebrewingrightnow.
3)Ourownexperiencemakesusstubbornoldmenaboutthefuture.Webaseourideasaboutthe
worldonourpersonalexperience,andthatexperiencehasingrainedtherateofgrowthoftherecent
pastinourheadsasthewaythingshappen.Werealsolimitedbyourimagination,whichtakesour
experienceandusesittoconjurefuturepredictionsbutoften,whatweknowsimplydoesntgiveus
thetoolstothinkaccuratelyaboutthefuture. Whenwehearapredictionaboutthefuturethat
2
contradictsourexperience-basednotionofhowthingswork,ourinstinctisthatthepredictionmustbe
naive.IfItellyou,laterinthispost,thatyoumaylivetobe150,or250,ornotdieatall,yourinstinctwill
be,ThatsstupidiftheresonethingIknowfromhistory,itsthateverybodydies.Andyes,noonein
thepasthasnotdied.Butnooneflewairplanesbeforeairplaneswereinventedeither.
http://waitbutwhy.com/2015/01/articial-intelligence-revolution-1.html 4/14
20/03/2017 The Articial Intelligence Revolution: Part 1 - Wait But Why
Sowhilenahhhhhmightfeelrightasyoureadthispost,itsprobablyactuallywrong.Thefactis,if
werebeingtrulylogicalandexpectinghistoricalpatternstocontinue,weshouldconcludethatmuch,
Followthesespecialmen
much,muchmoreshouldchangeinthecomingdecadesthanweintuitivelyexpect.Logicalsosuggests
thatifthemostadvancedspeciesonaplanetkeepsmakinglargerandlargerleapsforwardatanever- 394,313 35,451
108,768
fasterrate,atsomepoint,theyllmakealeapsogreatthatitcompletelyalterslifeastheyknowitand
theperceptiontheyhaveofwhatitmeanstobeahumankindoflikehowevolutionkeptmaking
greatleapstowardintelligenceuntilfinallyitmadesuchalargeleaptothehumanbeingthatit
completelyalteredwhatitmeantforanycreaturetoliveonplanetEarth.Andifyouspendsometime
readingaboutwhatsgoingontodayinscienceandtechnology,youstarttoseealotofsignsquietly
270.5khintingthatlifeaswecurrentlyknowitcannotwithstandtheleapthatscomingnext.
_______________
TheRoadtoSuperintelligence
WhatIsAI?
Ifyourelikeme,youusedtothinkArtificialIntelligencewasasillysci-ficoncept,butlatelyyouvebeen
hearingitmentionedbyseriouspeople,andyoudontreallyquitegetit.
TherearethreereasonsalotofpeopleareconfusedaboutthetermAI:
1)WeassociateAIwithmovies.StarWars.Terminator.2001:ASpaceOdyssey.EventheJetsons.And
thosearefiction,asaretherobotcharacters.SoitmakesAIsoundalittlefictionaltous.
2)AIisabroadtopic.Itrangesfromyourphonescalculatortoself-drivingcarstosomethinginthe
futurethatmightchangetheworlddramatically.AIreferstoallofthesethings,whichisconfusing.
3)WeuseAIallthetimeinourdailylives,butweoftendontrealizeitsAI.JohnMcCarthy,who
coinedthetermArtificialIntelligencein1956,complainedthatassoonasitworks,noonecallsitAI
anymore. Becauseofthisphenomenon,AIoftensoundslikeamythicalfuturepredictionmorethan
4
areality.Atthesametime,itmakesitsoundlikeapopconceptfromthepastthatnevercameto
fruition.RayKurzweilsayshehearspeoplesaythatAIwitheredinthe1980s,whichhecomparesto
insistingthattheInternetdiedinthedot-combustoftheearly2000s.
5
Soletsclearthingsup.First,stopthinkingofrobots.ArobotisacontainerforAI,sometimesmimicking
thehumanform,sometimesnotbuttheAIitselfisthecomputerinsidetherobot.AIisthebrain,and
therobotisitsbodyifitevenhasabody.Forexample,thesoftwareanddatabehindSiriisAI,the
womansvoicewehearisapersonificationofthatAI,andtheresnorobotinvolvedatall.
Secondly,youveprobablyheardthetermsingularityortechnologicalsingularity.Thistermhas
beenusedinmathtodescribeanasymptote-likesituationwherenormalrulesnolongerapply.Its
beenusedinphysicstodescribeaphenomenonlikeaninfinitelysmall,denseblackholeorthepoint
wewereallsquishedintorightbeforetheBigBang.Again,situationswheretheusualrulesdontapply.
In1993,VernorVingewroteafamousessayinwhichheappliedthetermtothemomentinthefuture
whenourtechnologysintelligenceexceedsourownamomentforhimwhenlifeasweknowitwillbe
foreverchangedandnormalruleswillnolongerapply.RayKurzweilthenmuddledthingsabitby
definingthesingularityasthetimewhentheLawofAcceleratingReturnshasreachedsuchanextreme
pacethattechnologicalprogressishappeningataseemingly-infinitepace,andafterwhichwellbe
livinginawholenewworld.IfoundthatmanyoftodaysAIthinkershavestoppedusingtheterm,and
itsconfusinganyway,soIwontuseitmuchhere(eventhoughwellbefocusingonthatidea
throughout).
Finally,whiletherearemanydifferenttypesorformsofAIsinceAIisabroadconcept,thecritical
categoriesweneedtothinkaboutarebasedonanAIscaliber.TherearethreemajorAIcaliber
categories:
AICaliber1)ArtificialNarrowIntelligence(ANI):SometimesreferredtoasWeakAI,ArtificialNarrow
IntelligenceisAIthatspecializesinonearea.TheresAIthatcanbeattheworldchesschampionin
chess,butthatstheonlythingitdoes.Askittofigureoutabetterwaytostoredataonaharddrive,
anditlllookatyoublankly.
AICaliber2)ArtificialGeneralIntelligence(AGI):SometimesreferredtoasStrongAI,orHuman-
LevelAI,ArtificialGeneralIntelligencereferstoacomputerthatisassmartasahumanacrossthe
boardamachinethatcanperformanyintellectualtaskthatahumanbeingcan.CreatingAGIisa
muchhardertaskthancreatingANI,andwereyettodoit.ProfessorLindaGottfredsondescribes
intelligenceasaverygeneralmentalcapabilitythat,amongotherthings,involvestheabilitytoreason,
plan,solveproblems,thinkabstractly,comprehendcomplexideas,learnquickly,andlearnfrom
experience.AGIwouldbeabletodoallofthosethingsaseasilyasyoucan.
http://waitbutwhy.com/2015/01/articial-intelligence-revolution-1.html 5/14
20/03/2017 The Articial Intelligence Revolution: Part 1 - Wait But Why
AICaliber3)ArtificialSuperintelligence(ASI):OxfordphilosopherandleadingAIthinkerNick
Bostromdefinessuperintelligenceasanintellectthatismuchsmarterthanthebesthumanbrainsin
Followthesespecialmen
practicallyeveryfield,includingscientificcreativity,generalwisdomandsocialskills.Artificial
Superintelligencerangesfromacomputerthatsjustalittlesmarterthanahumantoonethats 394,313 35,451
108,768
trillionsoftimessmarteracrosstheboard.ASIisthereasonthetopicofAIissuchaspicymeatball
andwhythewordsimmortalityandextinctionwillbothappearinthesepostsmultipletimes.
Asofnow,humanshaveconqueredthelowestcaliberofAIANIinmanyways,anditseverywhere.
TheAIRevolutionistheroadfromANI,throughAGI,toASIaroadwemayormaynotsurvivebutthat,
270.5keitherway,willchangeeverything.
Letstakeacloselookatwhattheleadingthinkersinthefieldbelievethisroadlookslikeandwhythis
revolutionmighthappenwaysoonerthanyoumightthink:
WhereWeAreCurrentlyAWorldRunningonANI
ArtificialNarrowIntelligenceismachineintelligencethatequalsorexceedshumanintelligenceor
efficiencyataspecificthing.Afewexamples:
CarsarefullofANIsystems,fromthecomputerthatfiguresoutwhentheanti-lockbrakesshould
kickintothecomputerthattunestheparametersofthefuelinjectionsystems.Googlesself-
drivingcar,whichisbeingtestednow,willcontainrobustANIsystemsthatallowittoperceiveand
reacttotheworldaroundit.
YourphoneisalittleANIfactory.Whenyounavigateusingyourmapapp,receivetailoredmusic
recommendationsfromPandora,checktomorrowsweather,talktoSiri,ordozensofother
everydayactivities,youreusingANI.
YouremailspamfilterisaclassictypeofANIitstartsoffloadedwithintelligenceabouthowto
figureoutwhatsspamandwhatsnot,andthenitlearnsandtailorsitsintelligencetoyouasit
getsexperiencewithyourparticularpreferences.TheNestThermostatdoesthesamethingasit
startstofigureoutyourtypicalroutineandactaccordingly.
YouknowthewholecreepythingthatgoesonwhenyousearchforaproductonAmazonand
thenyouseethatasarecommendedforyouproductonadifferentsite,orwhenFacebook
somehowknowswhoitmakessenseforyoutoaddasafriend?ThatsanetworkofANIsystems,
workingtogethertoinformeachotheraboutwhoyouareandwhatyoulikeandthenusingthat
informationtodecidewhattoshowyou.SamegoesforAmazonsPeoplewhoboughtthisalso
boughtthingthatsanANIsystemwhosejobitistogatherinfofromthebehaviorofmillions
ofcustomersandsynthesizethatinfotocleverlyupsellyousoyoullbuymorethings.
GoogleTranslateisanotherclassicANIsystemimpressivelygoodatonenarrowtask.Voice
recognitionisanother,andthereareabunchofappsthatusethosetwoANIsasatagteam,
allowingyoutospeakasentenceinonelanguageandhavethephonespitoutthesamesentence
inanother.
Whenyourplanelands,itsnotahumanthatdecideswhichgateitshouldgoto.Justlikeitsnota
humanthatdeterminedthepriceofyourticket.
TheworldsbestCheckers,Chess,Scrabble,Backgammon,andOthelloplayersarenowallANI
systems.
GooglesearchisonelargeANIbrainwithincrediblysophisticatedmethodsforrankingpagesand
figuringoutwhattoshowyouinparticular.SamegoesforFacebooksNewsfeed.
Andthosearejustintheconsumerworld.SophisticatedANIsystemsarewidelyusedinsectors
andindustrieslikemilitary,manufacturing,andfinance(algorithmichigh-frequencyAItraders
accountformorethanhalfofequitysharestradedonUSmarkets ),andinexpertsystemslike
6
thosethathelpdoctorsmakediagnosesand,mostfamously,IBMsWatson,whocontained
enoughfactsandunderstoodcoyTrebek-speakwellenoughtosoundlybeatthemostprolific
Jeopardychampions.
ANIsystemsastheyarenowarentespeciallyscary.Atworst,aglitchyorbadly-programmedANIcan
causeanisolatedcatastrophelikeknockingoutapowergrid,causingaharmfulnuclearpowerplant
malfunction,ortriggeringafinancialmarketsdisaster(likethe2010FlashCrashwhenanANIprogram
reactedthewrongwaytoanunexpectedsituationandcausedthestockmarkettobrieflyplummet,
taking$1trillionofmarketvaluewithit,onlypartofwhichwasrecoveredwhenthemistakewas
corrected).
ButwhileANIdoesnthavethecapabilitytocauseanexistentialthreat,weshouldseethisincreasingly
largeandcomplexecosystemofrelatively-harmlessANIasaprecursoroftheworld-alteringhurricane
thatsontheway.EachnewANIinnovationquietlyaddsanotherbrickontotheroadtoAGIandASI.Or
asAaronSaenzseesit,ourworldsANIsystemsareliketheaminoacidsintheearlyEarthsprimordial
oozetheinanimatestuffoflifethat,oneunexpectedday,wokeup.
TheRoadFromANItoAGI
http://waitbutwhy.com/2015/01/articial-intelligence-revolution-1.html 6/14
20/03/2017 The Articial Intelligence Revolution: Part 1 - Wait But Why
TheRoadFromANItoAGI
Followthesespecialmen
WhyItsSoHard
394,313 35,451
108,768
Nothingwillmakeyouappreciatehumanintelligencelikelearningabouthowunbelievablychallenging
itistotrytocreateacomputerassmartasweare.Buildingskyscrapers,puttinghumansinspace,
figuringoutthedetailsofhowtheBigBangwentdownallfareasierthanunderstandingourown
brainorhowtomakesomethingascoolasit.Asofnow,thehumanbrainisthemostcomplexobjectin
theknownuniverse.
270.5k
WhatsinterestingisthatthehardpartsoftryingtobuildAGI(acomputerassmartashumansin
general,notjustatonenarrowspecialty)arenotintuitivelywhatyoudthinktheyare.Buildacomputer
thatcanmultiplytwoten-digitnumbersinasplitsecondincrediblyeasy.Buildonethatcanlookata
dogandanswerwhetheritsadogoracatspectacularlydifficult.MakeAIthatcanbeatanyhumanin
chess?Done.Makeonethatcanreadaparagraphfromasix-year-oldspicturebookandnotjust
recognizethewordsbutunderstandthemeaningofthem?Googleiscurrentlyspendingbillionsof
dollarstryingtodoit.Hardthingslikecalculus,financialmarketstrategy,andlanguagetranslation
aremind-numbinglyeasyforacomputer,whileeasythingslikevision,motion,movement,and
perceptionareinsanelyhardforit.Or,ascomputerscientistDonaldKnuthputsit,AIhasbynow
succeededindoingessentiallyeverythingthatrequiresthinkingbuthasfailedtodomostofwhat
peopleandanimalsdowithoutthinking.' 7
Whatyouquicklyrealizewhenyouthinkaboutthisisthatthosethingsthatseemeasytousareactually
unbelievablycomplicated,andtheyonlyseemeasybecausethoseskillshavebeenoptimizedinus(and
mostanimals)byhundredsofmillionsofyearsofanimalevolution.Whenyoureachyourhandup
towardanobject,themuscles,tendons,andbonesinyourshoulder,elbow,andwristinstantlyperform
alongseriesofphysicsoperations,inconjunctionwithyoureyes,toallowyoutomoveyourhandina
straightlinethroughthreedimensions.Itseemseffortlesstoyoubecauseyouhaveperfectedsoftware
inyourbrainfordoingit.Sameideagoesforwhyitsnotthatmalwareisdumbfornotbeingableto
figureouttheslantywordrecognitiontestwhenyousignupforanewaccountonasiteitsthatyour
brainissuperimpressiveforbeingableto.
Ontheotherhand,multiplyingbignumbersorplayingchessarenewactivitiesforbiologicalcreatures
andwehaventhadanytimetoevolveaproficiencyatthem,soacomputerdoesntneedtoworktoo
hardtobeatus.Thinkaboutitwhichwouldyouratherdo,buildaprogramthatcouldmultiplybig
numbersoronethatcouldunderstandtheessenceofaBwellenoughthatyoucouldshowitaBinany
oneofthousandsofunpredictablefontsorhandwritinganditcouldinstantlyknowitwasaB?
Onefunexamplewhenyoulookatthis,youandacomputerbothcanfigureoutthatitsarectangle
withtwodistinctshades,alternating:
Tiedsofar.Butifyoupickuptheblackandrevealthewholeimage
http://waitbutwhy.com/2015/01/articial-intelligence-revolution-1.html 7/14
20/03/2017 The Articial Intelligence Revolution: Part 1 - Wait But Why
Followthesespecialmen
394,313 35,451
108,768
270.5k
youhavenoproblemgivingafulldescriptionofthevariousopaqueandtranslucentcylinders,slats,
and3-Dcorners,butthecomputerwouldfailmiserably.Itwoulddescribewhatitseesavarietyof
two-dimensionalshapesinseveraldifferentshadeswhichisactuallywhatsthere.Yourbrainisdoing
atonoffancyshittointerprettheimplieddepth,shade-mixing,androomlightingthepictureistrying
toportray. Andlookingatthepicturebelow,acomputerseesatwo-dimensionalwhite,black,and
8
graycollage,whileyoueasilyseewhatitreallyisaphotoofanentirely-black,3-Drock:
Credit:MatthewLloyd
Andeverythingwejustmentionedisstillonlytakinginstagnantinformationandprocessingit.Tobe
human-levelintelligent,acomputerwouldhavetounderstandthingslikethedifferencebetweensubtle
facialexpressions,thedistinctionbetweenbeingpleased,relieved,content,satisfied,andglad,andwhy
BraveheartwasgreatbutThePatriotwasterrible.
Daunting.
Sohowdowegetthere?
FirstKeytoCreatingAGI:IncreasingComputationalPower
OnethingthatdefinitelyneedstohappenforAGItobeapossibilityisanincreaseinthepowerof
computerhardware.IfanAIsystemisgoingtobeasintelligentasthebrain,itllneedtoequalthe
brainsrawcomputingcapacity.
Onewaytoexpressthiscapacityisinthetotalcalculationspersecond(cps)thebraincouldmanage,
andyoucouldcometothisnumberbyfiguringoutthemaximumcpsofeachstructureinthebrainand
thenaddingthemalltogether.
RayKurzweilcameupwithashortcutbytakingsomeonesprofessionalestimateforthecpsofone
structureandthatstructuresweightcomparedtothatofthewholebrainandthenmultiplying
proportionallytogetanestimateforthetotal.Soundsalittleiffy,buthedidthisabunchoftimeswith
variousprofessionalestimatesofdifferentregions,andthetotalalwaysarrivedinthesameballpark
around1016,or10quadrillioncps.
Currently,theworldsfastestsupercomputer,ChinasTianhe-2,hasactuallybeatenthatnumber,
clockinginatabout34quadrillioncps.ButTianhe-2isalsoadick,takingup720squaremetersofspace,
using24megawattsofpower(thebrainrunsonjust20watts),andcosting$390milliontobuild.Not
especiallyapplicabletowideusage,orevenmostcommercialorindustrialusageyet.
Kurzweilsuggeststhatwethinkaboutthestateofcomputersbylookingathowmanycpsyoucanbuy
for$1,000.Whenthatnumberreacheshuman-level10quadrillioncpsthenthatllmeanAGIcould
http://waitbutwhy.com/2015/01/articial-intelligence-revolution-1.html 8/14
20/03/2017 The Articial Intelligence Revolution: Part 1 - Wait But Why
becomeaveryrealpartoflife.
MooresLawisahistorically-reliablerulethattheworldsmaximumcomputingpowerdoubles Followthesespecialmen
approximatelyeverytwoyears,meaningcomputerhardwareadvancement,likegeneralhuman 35,451
394,313 108,768
advancementthroughhistory,growsexponentially.LookingathowthisrelatestoKurzweilscps/$1,000
metric,werecurrentlyatabout10trillioncps/$1,000,rightonpacewiththisgraphspredicted
trajectory:
9
270.5k
Sotheworlds$1,000computersarenowbeatingthemousebrainandtheyreataboutathousandth
ofhumanlevel.Thisdoesntsoundlikemuchuntilyourememberthatwewereataboutatrillionthof
humanlevelin1985,abillionthin1995,andamillionthin2005.Beingatathousandthin2015putsus
rightonpacetogettoanaffordablecomputerby2025thatrivalsthepowerofthebrain.
Soonthehardwareside,therawpowerneededforAGIistechnicallyavailablenow,inChina,andwell
bereadyforaffordable,widespreadAGI-caliberhardwarewithin10years.Butrawcomputational
poweralonedoesntmakeacomputergenerallyintelligentthenextquestionis,howdowebring
human-levelintelligencetoallthatpower?
SecondKeytoCreatingAGI:MakingItSmart
Thisistheickypart.Thetruthis,noonereallyknowshowtomakeitsmartwerestilldebatinghowto
makeacomputerhuman-levelintelligentandcapableofknowingwhatadogandaweird-writtenBand
amediocremovieis.Butthereareabunchoffar-fetchedstrategiesoutthereandatsomepoint,oneof
themwillwork.HerearethethreemostcommonstrategiesIcameacross:
1)Plagiarizethebrain.
Thisislikescientiststoilingoverhowthatkidwhositsnexttotheminclassissosmartandkeepsdoing
sowellonthetests,andeventhoughtheykeepstudyingdiligently,theycantdonearlyaswellasthat
kid,andthentheyfinallydecidekfuckitImjustgonnacopythatkidsanswers.Itmakessense
werestumpedtryingtobuildasuper-complexcomputer,andtherehappenstobeaperfectprototype
foroneineachofourheads.
Thescienceworldisworkinghardonreverseengineeringthebraintofigureouthowevolutionmade
sucharadthingoptimisticestimatessaywecandothisby2030.Oncewedothat,wellknowallthe
secretsofhowthebrainrunssopowerfullyandefficientlyandwecandrawinspirationfromitandsteal
itsinnovations.Oneexampleofcomputerarchitecturethatmimicsthebrainistheartificialneural
network.Itstartsoutasanetworkoftransistorneurons,connectedtoeachotherwithinputsand
outputs,anditknowsnothinglikeaninfantbrain.Thewayitlearnsisittriestodoatask,say
handwritingrecognition,andatfirst,itsneuralfiringsandsubsequentguessesatdecipheringeach
letterwillbecompletelyrandom.Butwhenitstolditgotsomethingright,thetransistorconnectionsin
thefiringpathwaysthathappenedtocreatethatanswerarestrengthened;whenitstolditwaswrong,
thosepathwaysconnectionsareweakened.Afteralotofthistrialandfeedback,thenetworkhas,by
itself,formedsmartneuralpathwaysandthemachinehasbecomeoptimizedforthetask.Thebrain
http://waitbutwhy.com/2015/01/articial-intelligence-revolution-1.html 9/14
20/03/2017 The Articial Intelligence Revolution: Part 1 - Wait But Why
learnsabitlikethisbutinamoresophisticatedway,andaswecontinuetostudythebrain,were
discoveringingeniousnewwaystotakeadvantageofneuralcircuitry.
Followthesespecialmen
Moreextremeplagiarisminvolvesastrategycalledwholebrainemulation,wherethegoalistoslicea 35,451
394,313 108,768
realbrainintothinlayers,scaneachone,usesoftwaretoassembleanaccuratereconstructed3-D
model,andthenimplementthemodelonapowerfulcomputer.Wedthenhaveacomputerofficially
capableofeverythingthebrainiscapableofitwouldjustneedtolearnandgatherinformation.If
engineersgetreallygood,theydbeabletoemulatearealbrainwithsuchexactaccuracythatthe
brainsfullpersonalityandmemorywouldbeintactoncethebrainarchitecturehasbeenuploadedtoa
270.5kcomputer.IfthebrainbelongedtoJimrightbeforehepassedaway,thecomputerwouldnowwakeup
asJim(?),whichwouldbearobusthuman-levelAGI,andwecouldnowworkonturningJimintoan
unimaginablysmartASI,whichhedprobablybereallyexcitedabout.
Howfararewefromachievingwholebrainemulation?Wellsofar,wevenotyetjustrecentlybeenable
toemulatea1mm-longflatwormbrain,whichconsistsofjust302totalneurons.Thehumanbrain
contains100billion.Ifthatmakesitseemlikeahopelessproject,rememberthepowerofexponential
progressnowthatweveconqueredthetinywormbrain,anantmighthappenbeforetoolong,
followedbyamouse,andsuddenlythiswillseemmuchmoreplausible.
2)Trytomakeevolutiondowhatitdidbeforebutforusthistime.
Soifwedecidethesmartkidstestistoohardtocopy,wecantrytocopythewayhestudiesforthe
testsinstead.
Heressomethingweknow.Buildingacomputeraspowerfulasthebrainispossibleourownbrains
evolutionisproof.Andifthebrainisjusttoocomplexforustoemulate,wecouldtrytoemulate
evolutioninstead.Thefactis,evenifwecanemulateabrain,thatmightbeliketryingtobuildan
airplanebycopyingabirdswing-flappingmotionsoften,machinesarebestdesignedusingafresh,
machine-orientedapproach,notbymimickingbiologyexactly.
SohowcanwesimulateevolutiontobuildAGI?Themethod,calledgeneticalgorithms,wouldwork
somethinglikethis:therewouldbeaperformance-and-evaluationprocessthatwouldhappenagain
andagain(thesamewaybiologicalcreaturesperformbylivinglifeandareevaluatedbywhether
theymanagetoreproduceornot).Agroupofcomputerswouldtrytodotasks,andthemostsuccessful
oneswouldbebredwitheachotherbyhavinghalfofeachoftheirprogrammingmergedtogetherinto
anewcomputer.Thelesssuccessfuloneswouldbeeliminated.Overmany,manyiterations,this
naturalselectionprocesswouldproducebetterandbettercomputers.Thechallengewouldbecreating
anautomatedevaluationandbreedingcyclesothisevolutionprocesscouldrunonitsown.
Thedownsideofcopyingevolutionisthatevolutionlikestotakeabillionyearstodothingsandwe
wanttodothisinafewdecades.
Butwehavealotofadvantagesoverevolution.First,evolutionhasnoforesightandworksrandomly
itproducesmoreunhelpfulmutationsthanhelpfulones,butwewouldcontroltheprocesssoitwould
onlybedrivenbybeneficialglitchesandtargetedtweaks.Secondly,evolutiondoesntaimforanything,
includingintelligencesometimesanenvironmentmightevenselectagainsthigherintelligence(since
itusesalotofenergy).We,ontheotherhand,couldspecificallydirectthisevolutionaryprocesstoward
increasingintelligence.Third,toselectforintelligence,evolutionhastoinnovateinabunchofother
waystofacilitateintelligencelikerevampingthewayscellsproduceenergywhenwecanremove
thoseextraburdensandusethingslikeelectricity.Itsnodoubtwedbemuch,muchfasterthan
evolutionbutitsstillnotclearwhetherwellbeabletoimproveuponevolutionenoughtomakethisa
viablestrategy.
3)Makethiswholethingthecomputersproblem,notours.
Thisiswhenscientistsgetdesperateandtrytoprogramthetesttotakeitself.Butitmightbethemost
promisingmethodwehave.
TheideaisthatwedbuildacomputerwhosetwomajorskillswouldbedoingresearchonAIand
codingchangesintoitselfallowingittonotonlylearnbuttoimproveitsownarchitecture.Wedteach
computerstobecomputerscientistssotheycouldbootstraptheirowndevelopment.Andthatwould
betheirmainjobfiguringouthowtomakethemselvessmarter.Moreonthislater.
AllofThisCouldHappenSoon
Rapidadvancementsinhardwareandinnovativeexperimentationwithsoftwarearehappening
simultaneously,andAGIcouldcreepuponusquicklyandunexpectedlyfortwomainreasons:
1)Exponentialgrowthisintenseandwhatseemslikeasnailspaceofadvancementcanquicklyrace
upwardsthisGIFillustratesthisconceptnicely:
http://waitbutwhy.com/2015/01/articial-intelligence-revolution-1.html 10/14
20/03/2017 The Articial Intelligence Revolution: Part 1 - Wait But Why
Followthesespecialmen
394,313 35,451
108,768
270.5k
Source
2)Whenitcomestosoftware,progresscanseemslow,butthenoneepiphanycaninstantlychangethe
rateofadvancement(kindoflikethewayscience,duringthetimehumansthoughttheuniversewas
geocentric,washavingdifficultycalculatinghowtheuniverseworked,butthenthediscoverythatitwas
heliocentricsuddenlymadeeverythingmucheasier).Or,whenitcomestosomethinglikeacomputer
thatimprovesitself,wemightseemfarawaybutactuallybejustonetweakofthesystemawayfrom
havingitbecome1,000timesmoreeffectiveandzoomingupwardtohuman-levelintelligence.
TheRoadFromAGItoASI
Atsomepoint,wellhaveachievedAGIcomputerswithhuman-levelgeneralintelligence.Justabunch
ofpeopleandcomputerslivingtogetherinequality.
Ohactuallynotatall.
Thethingis,AGIwithanidenticallevelofintelligenceandcomputationalcapacityasahumanwould
stillhavesignificantadvantagesoverhumans.Like:
Hardware:
Speed.Thebrainsneuronsmaxoutataround200Hz,whiletodaysmicroprocessors(whichare
muchslowerthantheywillbewhenwereachAGI)runat2GHz,or10milliontimesfasterthanour
neurons.Andthebrainsinternalcommunications,whichcanmoveatabout120m/s,arehorribly
outmatchedbyacomputersabilitytocommunicateopticallyatthespeedoflight.
Sizeandstorage.Thebrainislockedintoitssizebytheshapeofourskulls,anditcouldntget
muchbiggeranyway,orthe120m/sinternalcommunicationswouldtaketoolongtogetfrom
onebrainstructuretoanother.Computerscanexpandtoanyphysicalsize,allowingfarmore
hardwaretobeputtowork,amuchlargerworkingmemory(RAM),andalongtermmemory(hard
drivestorage)thathasbothfargreatercapacityandprecisionthanourown.
Reliabilityanddurability.Itsnotonlythememoriesofacomputerthatwouldbemoreprecise.
Computertransistorsaremoreaccuratethanbiologicalneurons,andtheyrelesslikelyto
deteriorate(andcanberepairedorreplacediftheydo).Humanbrainsalsogetfatiguedeasily,
whilecomputerscanrunnonstop,atpeakperformance,24/7.
Software:
Editability,upgradability,andawiderbreadthofpossibility.Unlikethehumanbrain,
computersoftwarecanreceiveupdatesandfixesandcanbeeasilyexperimentedon.The
upgradescouldalsospantoareaswherehumanbrainsareweak.Humanvisionsoftwareis
superblyadvanced,whileitscomplexengineeringcapabilityisprettylow-grade.Computerscould
matchthehumanonvisionsoftwarebutcouldalsobecomeequallyoptimizedinengineeringand
anyotherarea.
Collectivecapability.Humanscrushallotherspeciesatbuildingavastcollectiveintelligence.
Beginningwiththedevelopmentoflanguageandtheformingoflarge,densecommunities,
advancingthroughtheinventionsofwritingandprinting,andnowintensifiedthroughtoolslike
theinternet,humanityscollectiveintelligenceisoneofthemajorreasonswevebeenabletoget
sofaraheadofallotherspecies.Andcomputerswillbewaybetteratitthanweare.Aworldwide
networkofAIrunningaparticularprogramcouldregularlysyncwithitselfsothatanythingany
onecomputerlearnedwouldbeinstantlyuploadedtoallothercomputers.Thegroupcouldalso
takeononegoalasaunit,becausetherewouldntnecessarilybedissentingopinionsand
motivationsandself-interest,likewehavewithinthehumanpopulation. 10
http://waitbutwhy.com/2015/01/articial-intelligence-revolution-1.html 11/14
20/03/2017 The Articial Intelligence Revolution: Part 1 - Wait But Why
AI,whichwilllikelygettoAGIbybeingprogrammedtoself-improve,wouldntseehuman-level
intelligenceassomeimportantmilestoneitsonlyarelevantmarkerfromourpointofviewand
Followthesespecialmen
wouldnthaveanyreasontostopatourlevel.Andgiventheadvantagesoverusthatevenhuman
intelligence-equivalentAGIwouldhave,itsprettyobviousthatitwouldonlyhithumanintelligencefor 394,313 35,451
108,768
abriefinstantbeforeracingonwardstotherealmofsuperior-to-humanintelligence.
Thismayshocktheshitoutofuswhenithappens.Thereasonisthatfromourperspective,A)whilethe
intelligenceofdifferentkindsofanimalsvaries,themaincharacteristicwereawareofaboutany
animalsintelligenceisthatitsfarlowerthanours,andB)weviewthesmartesthumansasWAY
270.5ksmarterthanthedumbesthumans.Kindoflikethis:
SoasAIzoomsupwardinintelligencetowardus,wellseeitassimplybecomingsmarter,forananimal.
Then,whenithitsthelowestcapacityofhumanityNickBostromusesthetermthevillageidiot
wellbelike,Ohwow,itslikeadumbhuman.Cute!Theonlythingis,inthegrandspectrumof
intelligence,allhumans,fromthevillageidiottoEinstein,arewithinaverysmallrangesojustafter
hittingvillageidiotlevelandbeingdeclaredtobeAGI,itllsuddenlybesmarterthanEinsteinandwe
wontknowwhathitus:
Andwhathappensafterthat?
AnIntelligenceExplosion
Ihopeyouenjoyednormaltime,becausethisiswhenthistopicgetsunnormalandscary,andits
gonnastaythatwayfromhereforward.IwanttopauseheretoremindyouthateverysinglethingIm
goingtosayisrealrealscienceandrealforecastsofthefuturefromalargearrayofthemost
respectedthinkersandscientists.Justkeeprememberingthat.
http://waitbutwhy.com/2015/01/articial-intelligence-revolution-1.html 12/14
20/03/2017 The Articial Intelligence Revolution: Part 1 - Wait But Why
Anyway,asIsaidabove,mostofourcurrentmodelsforgettingtoAGIinvolvetheAIgettingthereby
self-improvement.AndonceitgetstoAGI,evensystemsthatformedandgrewthroughmethodsthat
Followthesespecialmen
didntinvolveself-improvementwouldnowbesmartenoughtobeginself-improvingiftheywantedto.
3
394,313 35,451
108,768
Andhereswherewegettoanintenseconcept:recursiveself-improvement.Itworkslikethis
AnAIsystematacertainlevelletssayhumanvillageidiotisprogrammedwiththegoalof
improvingitsownintelligence.Onceitdoes,itssmartermaybeatthispointitsatEinsteinslevelso
nowwhenitworkstoimproveitsintelligence,withanEinstein-levelintellect,ithasaneasiertimeandit
270.5k
canmakebiggerleaps.Theseleapsmakeitmuchsmarterthananyhuman,allowingittomakeeven
biggerleaps.Astheleapsgrowlargerandhappenmorerapidly,theAGIsoarsupwardsinintelligence
andsoonreachesthesuperintelligentlevelofanASIsystem.ThisiscalledanIntelligenceExplosion,
11
anditstheultimateexampleofTheLawofAcceleratingReturns.
ThereissomedebateabouthowsoonAIwillreachhuman-levelgeneralintelligence.Themedianyear
onasurveyofhundredsofscientistsaboutwhentheybelievedwedbemorelikelythannottohave
reachedAGIwas2040 12 thatsonly25yearsfromnow,whichdoesntsoundthathugeuntilyou
considerthatmanyofthethinkersinthisfieldthinkitslikelythattheprogressionfromAGItoASI
happensveryquickly.Likethiscouldhappen:
IttakesdecadesforthefirstAIsystemtoreachlow-levelgeneralintelligence,butitfinallyhappens.A
computerisabletounderstandtheworldarounditaswellasahumanfour-year-old.Suddenly,within
anhourofhittingthatmilestone,thesystempumpsoutthegrandtheoryofphysicsthatunifies
generalrelativityandquantummechanics,somethingnohumanhasbeenabletodefinitivelydo.90
minutesafterthat,theAIhasbecomeanASI,170,000timesmoreintelligentthanahuman.
Superintelligenceofthatmagnitudeisnotsomethingwecanremotelygrasp,anymorethana
bumblebeecanwrapitsheadaroundKeynesianEconomics.Inourworld,smartmeansa130IQand
stupidmeansan85IQwedonthaveawordforanIQof12,952.
WhatwedoknowisthathumansutterdominanceonthisEarthsuggestsaclearrule:withintelligence
comespower.WhichmeansanASI,whenwecreateit,willbethemostpowerfulbeinginthehistoryof
lifeonEarth,andalllivingthings,includinghumans,willbeentirelyatitswhimandthismighthappen
inthenextfewdecades.
Ifourmeagerbrainswereabletoinventwifi,thensomething100or1,000or1billiontimessmarter
thanweareshouldhavenoproblemcontrollingthepositioningofeachandeveryatomintheworldin
anywayitlikes,atanytimeeverythingweconsidermagic,everypowerweimagineasupremeGodto
havewillbeasmundaneanactivityfortheASIasflippingonalightswitchisforus.Creatingthe
technologytoreversehumanaging,curingdiseaseandhungerandevenmortality,reprogrammingthe
weathertoprotectthefutureoflifeonEarthallsuddenlypossible.Alsopossibleistheimmediateend
ofalllifeonEarth.Asfaraswereconcerned,ifanASIcomestobeing,thereisnowanomnipotentGod
onEarthandtheall-importantquestionforusis:
WillitbeaniceGod?
ThatsthetopicofPart2ofthispost.
___________
SourcesatthebottomofPart2.
RelatedWaitButWhyPosts
TheFermiParadoxWhydontweseeanysignsofalienlife?
How(andWhy)SpaceXWillColonizeMarsApostIgottoworkonwithElonMuskandonethat
reframedmymentalpictureofthefuture.
Orforsomethingtotallydifferentandyetsomehowrelated,WhyProcrastinatorsProcrastinate
AndheresYear1ofWaitButWhyonanebook.
http://waitbutwhy.com/2015/01/articial-intelligence-revolution-1.html 13/14
20/03/2017 The Articial Intelligence Revolution: Part 1 - Wait But Why
Followthesespecialmen
Like 188K Share 7points 383 61,604
StumbleUpon 394,313 35,451
108,768
270.5k
PreviousPost NextPost
RECOMMENDEDPOSTS
Add a comment...
Home Archive
WaitButWhy2017
Contact PartnerWithUs
PrivacyPolicy
http://waitbutwhy.com/2015/01/articial-intelligence-revolution-1.html 14/14