CS 416

Artificial Intelligence
Lecture
Lecture 11
Introduction
Introduction
I Cannot Add Students to Course
Unfortunately,
Unfortunately, this
this class
class is
is oversubscribed
oversubscribed
II cannot
cannot add
add new
new students
students to
to the
the course
course
•• Potential
Potential exception
exception for
for 44thth-year
-year CS
CS Majors
Majors

Feel
Feel free
free to
to stay
stay through
through end
end of
of course
course today
today
Textbook
This
This is
is aa great
great book
book
•• 22nd
nd edition
edition released
released one
one month
month ago
ago
•• Most
Most widely
widely used
used in
in U.S.
U.S. universities
universities
•• It’s
It’s so
so good….
good….
–– I’m
I’m going
going to
to make
make you
you read
read it!
it!

Homework
Homework
•• Read
Read chapters
chapters 11 and
and 22
Syllabus
Instructor
Instructor
•• David
David Brogan
Brogan
Olsson
Olsson 217
217
982-2211
982-2211
dbrogan@cs.virginia.edu
dbrogan@cs.virginia.edu
–– Office
Office hours:
hours: Wednesday
Wednesday 1:30
1:30 –– 3:00
3:00

TA
TA
•• Ben
Ben Hocking
Hocking
–– Office
Office hours:
hours: TBA
TBA
Syllabus
Class
Class web
web page:
page:
•• Soon
Soon to
to be
be at:
at: http://www.cs.virginia.edu/~cs416
http://www.cs.virginia.edu/~cs416

Grading
Grading
•• 33 (perhaps
(perhaps 4)
4) programming
programming assignments
assignments (40%)
(40%)
•• A
A couple
couple homework
homework assignments
assignments (10%)
(10%)
•• Midterm
Midterm and
and Final
Final (25%
(25% for
for each)
each)
What is AI?
Discussion
Discussion exercise
exercise for
for class
class

•• Think
Think of
of example
example AI
AI systems
systems (applications
(applications that
that are
are intelligent)
intelligent)

•• Think
Think of
of example
example AI
AI Techniques
Techniques
AI Systems
•• Thermostat
Thermostat
•• Tic-Tac-Toe
Tic-Tac-Toe
•• Your
Your car
car
•• Chess
Chess
•• Google
Google
•• Babblefish
Babblefish
•• This
This thing
thing
––Asimo
Asimo
AI Techniques
•• Rule-based
Rule-based
•• Fuzzy
Fuzzy Logic
Logic
•• Neural
Neural Networks
Networks
•• Genetic
Genetic Algorithms
Algorithms
How to Categorize These Systems
Systems
Systems that
that think
think like
like humans
humans
Systems
Systems that
that act
act like
like humans
humans

Systems
Systems that
that think
think rationally
rationally
Systems
Systems that
that act
act rationally
rationally
Distinctions
How
How one
one thinks
thinks vs.
vs. How
How one
one acts
acts
•• How
How can
can II know
know how
how you
you think?
think?
–– For
For the
the most
most part,
part, you
you are
are aa “black
“black box”
box”
–– Cognitive
Cognitive Science
Science
•• How
How can
can II know
know how
how you
you act?
act?
–– Observation
Observation
–– Turing
Turing Test
Test
Alan Turing – “Building a Brain”
World
World War
War IIII motivated
motivated computer
computer advances
advances
•• Code
Code breaking
breaking (Colossus)
(Colossus)
•• Computing
Computing missile
missile trajectories
trajectories (Mark
(Mark I)I)
•• Electronic
Electronic Numerical
Numerical Integrator
Integrator and
and Computer
Computer (ENIAC)
(ENIAC)

Turing
Turing greatly
greatly involved
involved with
with British
British efforts
efforts to
to build
build
computers
computers and
and crack
crack codes
codes (Bletchley
(Bletchley Park)
Park)
•• Arrested
Arrested for
for being
being aa homosexual
homosexual in
in 1952
1952 and
and denied
denied security
security clearance
clearance
•• Committed
Committed suicide
suicide in
in 1954
1954
Rational vs. Human
Thinking/acting
Thinking/acting rationally
rationally vs.
vs.
Thinking/acting
Thinking/acting like
like aa human
human
•• Rely
Rely on
on logic
logic rather
rather than
than human
human to
to measure
measure correctness
correctness
•• Thinking
Thinking rationally
rationally (logically)
(logically)
–– Socrates
Socrates is
is aa human;
human; All
All humans
humans are
are mortal;
mortal; Socrates
Socrates is
is mortal
mortal
–– Logic
Logic formulas
formulas for
for synthesizing
synthesizing outcomes
outcomes
•• Acting
Acting rationally
rationally (logically)
(logically)
–– Even
Even ifif method
method is
is illogical,
illogical, the
the observed
observed behavior
behavior must
must be
be rational
rational
Perspective of this Course
We
We will
will investigate
investigate the
the general
general principles
principles of
of
rational
rational agents
agents
•• Not
Not restricted
restricted to
to human
human actions
actions and
and human
human environments
environments
•• Not
Not restricted
restricted to
to human
human thought
thought
•• Not
Not confined
confined to
to only
only using
using laws
laws of
of logic
logic

•• Anything
Anything goes
goes so
so long
long as
as itit produces
produces rational
rational behavior
behavior
What is AI?
The
The use
use of
of computers
computers toto solve
solve problems
problems that that
previously
previously could
could only
only be
be solved
solved by
by applying
applying human
human
intelligence….
intelligence…. thus
thus something
something can
can fit
fit this
this definition
definition
today,
today, but,
but, once
once we
we see
see how
how the
the program
program worksworks and and
understand
understand thethe problem,
problem, we
we will
will not
not think
think ofof itit as
as AI
AI
anymore
anymore (David
(David Parnas)
Parnas)
Foundations - Philosophy
•• Aristotle
Aristotle (384
(384 B.C.E.)
B.C.E.) –– Author
Author of
of logical
logical syllogisms
syllogisms
•• da
da Vinci
Vinci (1452)
(1452) –– designed,
designed, but
but didn’t
didn’t build,
build, first
first mechanical
mechanical
calculator
calculator
•• Descartes
Descartes (1596)
(1596) –– can
can human
human free
free will
will be
be captured
captured by
by aa
machine?
machine? IsIs animal
animal behavior
behavior more
more mechanistic?
mechanistic?
•• Necessary
Necessary connection
connection between
between logic
logic and
and action
action is
is
discovered
discovered
Foundations - Mathematics
•• More
More formal
formal logical
logical methods
methods
–– Boolean
Boolean logic
logic (Boole,
(Boole, 1847)
1847)
•• Analysis
Analysis ofof limits
limits to
to what
what can
can be
be computed
computed
–– Intractability
Intractability (1965)
(1965) –– time
time required
required to
to solve
solve problem
problem scales
scales
exponentially
exponentially with
with the
the size
size of
of problem
problem instance
instance
–– NP-complete
NP-complete (1971)
(1971) –– Formal
Formal classification
classification of
of problems
problems as
as
intractable
intractable
•• Uncertainty
Uncertainty (Cardano
(Cardano 1501)
1501)
–– The
The basis
basis for
for most
most modern
modern approaches
approaches to to AI
AI
–– Uncertainty
Uncertainty can
can still
still be
be used
used in
in logical
logical analyses
analyses
Foundations - Economics
•• Humans
Humans are
are peculiar
peculiar so
so define
define generic
generic happiness
happiness term:
term: utility
utility
•• Game
Game Theory
Theory –– study
study of
of rational
rational behavior
behavior in
in small
small games
games
•• Operations
Operations Research
Research –– study
study of
of rational
rational behavior
behavior in
in
complex
complex systems
systems
•• Herbert
Herbert Simon
Simon (1916
(1916 –– 2001)
2001) –– AI
AI researcher
researcher who
who received
received
Nobel
Nobel Prize
Prize in
in Economics
Economics forfor showing
showing people
people accomplish
accomplish
satisficing
satisficing solutions,
solutions, those
those that
that are
are good
good enough
enough
Foundations - Neuroscience
How
How do
do brains
brains work?
work?
•• Early
Early studies
studies (1824)
(1824) relied
relied on
on injured
injured and
and abnormal
abnormal people
people to
to understand
understand what
what
parts
parts of
of brain
brain do
do
•• More
More recent
recent studies
studies use
use accurate
accurate sensors
sensors to
to correlate
correlate brain
brain activity
activity to
to human
human
thought
thought
–– By
By monitoring
monitoring individual
individual neurons,
neurons, monkeys
monkeys can
can now
now control
control aa computer
computer
mouse
mouse using
using thought
thought alone
alone
•• Moore’s
Moore’s law
law states
states computers
computers will
will have
have as
as many
many gates
gates as
as humans
humans have
have
neurons
neurons in
in 2020
2020
•• How
How close
close are
are we
we to
to having
having aa mechanical
mechanical brain?
brain?
–– Parallel
Parallel computation,
computation, remapping,
remapping, interconnections,
interconnections, binary
binary vs.
vs. gradient…
gradient…
Foundations - Psychology
•• Helmholtz
Helmholtz and
and Wundt
Wundt (1821)
(1821) –– started
started to
to make
make psychology
psychology aa
science
science by
by carefully
carefully controlling
controlling experiments
experiments
•• The
The brain
brain processes
processes information
information (1842)
(1842)
–– stimulus
stimulus converted
converted into
into mental
mental representation
representation
–– cognitive
cognitive processes
processes manipulate
manipulate representation
representation to
to build
build
new
new representations
representations
–– new
new representations
representations are
are used
used to
to generate
generate actions
actions
•• Cognitive
Cognitive science
science started
started atat aa MIT
MIT workshop
workshop in
in 1956
1956 with
with the
the
publication
publication three
three very
very influential
influential papers
papers
Foundations – Control Theory
•• Machines
Machines can
can modify
modify their
their behavior
behavior in
in response
response to
to the
the
environment
environment (sense
(sense // action
action loop)
loop)
–– Water-flow
Water-flow regulator
regulator (250
(250 B.C.E),
B.C.E), steam
steam engine
engine governor,
governor,
thermostat
thermostat
•• The
The theory
theory of
of stable
stable feedback
feedback systems
systems (1894)
(1894)
–– Build
Build systems
systems that
that transition
transition from
from initial
initial
state
state to
to goal
goal state
state with
with minimum
minimum energy
energy
–– In
In 1950,
1950, control
control theory
theory could
could only
only describe
describe
linear
linear systems
systems and
and AI
AI largely
largely rose
rose as
as aa
response
response toto this
this shortcoming
shortcoming
Foundations - Linguistics
Speech
Speech demonstrates
demonstrates so
so much
much of
of human
human
intelligence
intelligence
•• Analysis
Analysis of
of human
human language
language reveals
reveals thought
thought taking
taking place
place in
in
ways
ways not
not understood
understood in
in other
other settings
settings
–– Children
Children can
can create
create sentences
sentences they
they have
have never
never heard
heard
before
before
–– Language
Language and
and thought
thought are
are believed
believed to
to be
be tightly
tightly
intertwined
intertwined
History of AI
Read
Read the
the complete
complete story
story in
in text
text
•• Alan
Alan Turing
Turing (1950)
(1950) did
did much
much to
to define
define the
the problems
problems and
and
techniques
techniques
•• John
John McCarthy
McCarthy helped
helped coordinate
coordinate the
the players
players (1956)
(1956)
•• Alan
Alan Newell
Newell and
and Herbert
Herbert Simon
Simon (1956)
(1956) did
did much
much to
to
demonstrate
demonstrate first
first solutions
solutions
•• Marvin
Marvin Minsky
Minsky (student
(student of
of von
von Neumann)
Neumann) built
built aa neural
neural
network
network (1951)
(1951) from
from 3000
3000 vacuum
vacuum tubes
tubes and
and the
the “autopilot”
“autopilot”
from
from aa B-24
B-24 bomber
bomber
Why is AI in Computer Science?
•• Uses
Uses computer
computer asas aa tool
tool more
more than
than psychologists,
psychologists,
mathematicians
mathematicians (operations
(operations research),
research), or
or mechanical
mechanical
engineers
engineers (control
(control theory)
theory)
History of AI: 1952- 1969
Great
Great successes!
successes!
•• Logic
Logic programs
programs were
were replicating
replicating human
human logic
logic in
in many
many cases
cases
–– Solving
Solving hard
hard math
math problems
problems
–– game
game playing
playing
•• LISP
LISP was
was invented
invented by
by McCarthy
McCarthy (1958)
(1958)
–– second
second oldest
oldest language
language in
in existence
existence
–– could
could accept
accept new
new axioms
axioms at
at runtime
runtime
•• McCarthy
McCarthy went
went to
to MIT
MIT and
and Marvin
Marvin Minsky
Minsky started
started lab
lab at
at Stanford
Stanford
–– Both
Both powerhouses
powerhouses in
in AI
AI to
to this
this day
day
History of AI: 1966 - 1973
A
A dose
dose of
of reality
reality –– Overhyped
Overhyped
•• Systems
Systems fail
fail to
to play
play chess
chess and
and translate
translate Russian
Russian
–– Computers
Computers were
were ignorant
ignorant to
to context
context of
of their
their logic
logic
–– Problems
Problems were
were intractable
intractable
 algorithms
algorithms that
that work
work in
in principle
principle may
may not
not work
work in
in practice
practice
 Combinatorial
Combinatorial Explosion
Explosion // Curse
Curse of
of Dimensionality
Dimensionality
–– Fatal
Fatal flaw
flaw in
in neural
neural networks
networks was
was exposed
exposed
 though
though flaw
flaw was
was first
first resolved
resolved in
in 1969,
1969, neural
neural networks
networks did
did not
not
return
return to
to vogue
vogue until
until late
late 1980s
1980s
AI History: 1969 - 1979
Knowledge-based
Knowledge-based Systems
Systems
•• Previous
Previous systems
systems knocked
knocked because
because general
general logical
logical
algorithms
algorithms could
could not
not be
be applied
applied to
to realistic
realistic problems
problems
•• Answer:
Answer: accumulate
accumulate specific
specific logical
logical algorithms
algorithms
–– DENDRAL
DENDRAL –– infer
infer chemical
chemical structure
structure
–– knowledge
knowledge of
of scientists
scientists boiled
boiled down
down to
to cookbook
cookbook logic
logic
–– large
large number
number of
of special
special purpose
purpose rules
rules worked
worked well
well
•• Researchers
Researchers work
work on
on ways
ways to
to accumulate
accumulate and
and store
store facts
facts for
for
expert
expert systems
systems
AI History: 1980 - present
Let
Let the
the good
good times
times roll
roll
•• The
The demonstrated
demonstrated success
success of
of AI
AI invited
invited investments
investments
•• from
from millions
millions to
to billions
billions of
of dollars
dollars in
in 10
10 years
years
•• extravagant
extravagant AI
AI promises
promises again
again led
led to
to “AI
“AI Winter”
Winter” when
when
investments
investments in
in technology
technology dropped
dropped (1988)
(1988)
Neural
Neural Networks
Networks come
come back
back from
from the
the dead
dead (1986)
(1986)
AI History: 1987 - present
AI
AI becomes
becomes aa science
science
•• More
More repeatability
repeatability of
of experiments
experiments
•• More
More development
development of
of mathematical
mathematical underpinnings
underpinnings
•• Reuse
Reuse of
of time-tested
time-tested models
models
Intelligent
Intelligent Agents
Agents (1994)
(1994)
•• AI
AI systems
systems exist
exist in
in real
real environments
environments with
with real
real sensory
sensory inputs
inputs
•• Niches
Niches of
of AI
AI need
need to
to be
be reorganized
reorganized
AI History: Where are We Now?
•• Autonomous
Autonomous planning:
planning: scheduling
scheduling operations
operations aboard
aboard aa
spacecraft
spacecraft
–– Dante
Dante falls
falls in
in an
an ice
ice crater
crater after
after one
one step
step
–– Mars
Mars Rover
Rover never
never deploys
deploys
•• Game
Game playing:
playing: Kasparov
Kasparov lost
lost to
to IBM’s
IBM’s Big
Big Blue
Blue in
in chess
chess
–– Rules
Rules were
were changed
changed toto prevent
prevent computer
computer from
from retraining
retraining
over
over night
night and
and to
to provide
provide human
human players
players with
with more
more
examples
examples ofof computerized
computerized play
play
AI History: Where are We Now?
•• Autonomous
Autonomous Control:
Control: CMU’s
CMU’s NAVLAB
NAVLAB drove
drove from
from Pittsburgh
Pittsburgh
to
to San
San Francisco
Francisco under
under computer
computer control
control 98%
98% of
of time
time
•• Logistics:
Logistics: deployment
deployment of
of troops
troops to
to Iraq
Iraq
•• Robotics:
Robotics: remote
remote heart
heart operations
operations
•• human
human genome,
genome, protein
protein folding,
folding, drug
drug discovery
discovery
•• stock
stock market
market