Professional Documents
Culture Documents
1 The Concept
Syllabus
Fhatis Al?: The Al Problems, The Underlying Assumption, What is an AI Techniques, The Level
of The Model, Criteria For Success, Some General References, One Final Word.
Contents
1.1 The Concept of Artificial Intelligence (Al) . Winter-12,14,16,17,19,
Summer-18, 20 . Marks 7
1.2 Al Problem
Winter-12 Marks 7
1.3 The Undertying Assumption
1.4 What is an Al Technique ?
1.5 The Level of the Model.. . . Winter-19,
Marks 3
1.6 Criteria for Success
1.7 Some General References
1.8 AI Tems
1.9 The Environments
.Winter-18,19,Summer-19 Marks 3
1.10 Different Types of Agents
1.11 Designing an Agent System
1.12 One Final Word
1.13 University Questions with Answers
1-2 Artificial Intelligence 1-3
(AI) Artificial Intelligence The Concept
Intelligence
G T U :Winter-12,14,16,1
4,16.17,19. Summer-r-18,20 10. "The study of the
A r t i f c i a lI n t o l l i g e n c e
of
Artificlal
(Winston - 1992)
computations that make it possible to perceive, reason and act".
C o n c e p t
The
1.1
11. Systems that act rationally
working 12. "Computational intelligence
c o m p u t e r
mental
activities
such
as
commonsense
reasoning,
understanding
u n d e r
languages
to demand "intelli
to dem
et al 1998)
said
13. "AI is
concerned with
Many
human
engaging
in
an
automobile
are
task
pertorm tasks such
perform
e" intelligent behaviour
in artifacts". (Nilsson
1998)
can
c an These definitions vary
alorng two main dimensions. First dimension is the
mathematics,
built that
driving that
out
interpreting
it,
even
have
been
bult
that "How
"How to think" which we call rationality. A intelligence,
all such
systems
systems is OR system is rational if it does the "right thing" given
saythat
and
what it knows.
.We can
such
all think".
activities
ofthinking
thi has various steps like Historically, there are four approaches that are followed in AL
central point of These four approaches are
The process
The
make system a w o r l d that is
mnade
ade
up of tiny Acting Humanly, Thinking Humanly, Thinking
rather
"How to
predict
and
manipulate
Rationally and Acting Rationally. Let us consider four approaches in detail.
understand,
preceive, 1) Acting Humanly
things or
situations.
but it builds intelliger
Turing
understand
complex
of Al not just attempts
to
Test: For testing
intelligence Alan Turing (1950) proposed a test called as
T h e field Turing test. He suggested a test based on common
features that can match with
entities. the most intelligent
entity human beings. -
8.
Systems that think rationally.
to
manipulate objects.
9. The niak 2) Thinklng Humanly
study of mental faculties
and McDermott 1985) through the use of computational n As we are
saying that the given program thinks like human it we should know
that how human thinks. For that, the
theory of human minds needs to be
TECHNICAL PUBLICATIONS An up thrust
TECH
for knowledge
Artificial inteingence - The
The Concept
explored.
mechani
as
mechanisms
our
own
thoughts
I/0
and
timing
of the
program's
could als gives information which
is related to brain processing which helps
programs,
some
of cognitive
science Neuroscience
bings
that field
computer can sayi n t e r d e s c i p l i n a r y theories.
f
that is,
we techniques from AI to develope date processing
behaviours,
operating
in
human.
The
from
AI
and
experimental
of the
workings es
PSycho
of human
of
mind
chology Phychology provides strong concepts
of how humans and animals think
and actions.
and act
together
computer
and
testable
which helps
precise
toconstruct
approach"
that try
the
"Maws of thought
by
Aristotle.
This idea provided
This i
1.1.4 The Strong and Weak AI
proposed
Rationally was
correct conch
conclusions now let
vielded that contribute towards AI,
correct
For example,
men are
mortal, 1.1.4.1 Strong AI
"All
"Minds, Brains
This concept was put forward John Searle in 1980 in his article,
by
"Ram is mortal in
operation
the operation in the mind; their theories for developing some form of
min.
systems.
Strong AI can be categorized as,
4) Acting Rationaly and much like a
program thinks
reasons
that acts. But computer agents are
do) is something
Human-like AI In which the computer
-
TECHNICAL PUBLICATIONS
-
An up thrust for knowledge
TECHNICAL PUBLICATIONS An up thrust
for knowledge
Artiicia toigE
noept
Artimicial Inteligence Artificial Inteiligerce The Concapt
Artici inteligece
the first
on-board
autonomous
rem
pianrning computer program which expert in solving crossword puzzles
1151
Autonomous
became
spacecraft. Such
Such remote agents It make
Remote Agent
program
of operations
for spacecraft.
problens
problems as they
can use
of constraints or
possible word fillers, a
large database of past
NASA
control
the
scheduling
and
recovering
from
puzzles and variety of information sources
including dictionaries and online
to
progTam
detecting.
diagnosing
databases Such as a list of movies and the actors that appears in them.
of
can do task
AI does not generate magic or science fiction but rather it can
Orurred develops science,
engineering and mathematics system.
defeated
1152 Game Plaeytng named as Deep
Blue
wori
chess Recent progress in
by IBM in 1997 Such type of gaming understanding the theoretical basis for intelligence has gone
A computer chess program in match in
hand in hand with
Garry Kasparov
exhibition
improvements in the capabilities of real systems. The subfields
champion Al techniques. of AI have became more integrated and AI has found common
can be developed
using ground with other
programs
disciplines.
1.15.3 Autonomous Control
keep to it f o l l e i
vision system
w a s trained
to stear car
wing 1.1.6 Human Vs Machine
The ALVINN computer miles in which
98 % ot the time contro was
2850
a lane. It
was made to travel
human n took over. Al ccan
took a n give
over.
give more 1161 WiIl Machine behave Exactly as Human ?
and only 2 % of the time
with the system Here are the considerable
theories to develop
such systems. difference between human and machine.
1) Machines do not have life, as they are mechanical. On the
other hand, humans
are made of flesh and
154 Diagnosls blood; life is not mechanical for humans.
where leading expert on lymph node
2) Humans have
Heckerman (1991) describes a case a
software
distinction
can be made
brain or GTU : Winter-12
6) No hardware
1 . 2 Al Problem
mind. logic gates.
than
electrical
formal tasks, such as game playing and
complex work in AI focused on
Synapses are far more
are performed by
by the same Much of the early theorist was an early attempt to
playing, logic
management
memory chess
machine, processing and theorem proving. For example the
8) Unlike theorems. Game playing and theorem proving share
mathematical
the brain. prove considered to be displaying
components in do them well are
who
organizing system. property that people
9The brain is a self
than any lcurrent] machin.
the brain is
much, much digger intelligence.
well at those tasks by being
10) Brain have bodies, Despite this it appeared that computers could perform
Field then selecting the best one.
Influential in AI fast at exploring a large number of solution paths and
Systems combinatorial explosion generated
1.1.7 List of Expert But no computer is fast enough to o v e r c o m e the
6. Exper Tax -
Tax minimisation advice. A s AI research progressed and techniques for handling larger amounts of world
knowledge were developed in dealing with problem solving in specialized
7. XSEL Computer sales. domains such as medical diagnosis and chemical analysis.
data as potential evidence for mineral
8. PROSPECTOR Interpreted geological Perception (vision and speech) is another area for AI problems. Natural language
deposits. (Duda, Hart, in 1976).
9 NAVEX Monitored radar data and estimated the velocity and position of the understanding and problem solving in specialized domain are other areas related
to AI problems. The problem of understanding spoken language is perceptual
space shuttle. (Marsh, 1984) problem and is hard to solve from the fact that it is more analog related than
the basis of customer's digital related. Many people can perform one or may be more specialized tasks in
10. RI/XCON -
in
hospital. 2. Formal tasks Games (Chess, etc.), Mathematics
14. CROP
(Geometry, Logic, Integral
ADVISOR Developed by ICI to advise cereal
-
calculus, etc.)
fertilizers and pesticides for their
grain farmers on appropriae
farms. 3. Expert tasks Engineering (Design, Fault finding,
15. Manufacturing planning),
OPTIMUM - AV -
is a
planner used by the European Space Agency to neip n the
Scientific analysis, Medical diagnosis, Financial analysis
assembly, integration and verification of
spacecraft
TECHNICAL TECHNICAL PUBLICATIONS An up thrust for knowledge
PUBLICATIONs- An up thrust for
knowledge
Artificial Intelligenc
nce The Conceni
1-10
Artificial Intelligence
from several of th
the Artificial Intelligence-
The Concept
A person
who
knows how
to pertorm
skills
tasks
are acquired.
Earlier skils
Sier such expressions are
the positions of all the pieces o n the
engineering,
medicine, or
finance
computerized
duplication
than the later, mOr
re and tru
specialized The physical symbol system
hypothesis claims
human thoughts
that both of these
a r e the symbols
that a r e encoded
to in Al work was con.
amenable
Intelligent of
initial work mental operations
physical symbol systems.
more
a r e the
much of the The processes
For this reason
practi
thoe in o u r brains. The expressions
are thoughts.
The problems
areas
where now Al is flourishing
zed expertise
only specialized discipline expressions are more data and
the processes a r e programs
is twofold. It
is significant
orams) winOWthoutare e
require
that
domains system hypothesis
The importance of the physical symbol that it is
the
primarily systems (AI programe basis of the belief
knowledge. Expert and it forms the
assistance of
commonsense
of human intelligernce
aim at solving part, or perhaps all. tn theory of the nature intelligent tasks which are currently
tasks that that can perform
for day-to-day high human expertise. possible to build programs
that previously required
significant problem performed by people.
following questions need to he
be consideret
a expert system,
When one is building is an Al Technique ?
further: 1.4 What
before one can progress but knowledge possesses
less desirable properties
about intelligence ? Intelligence requires knowledge
What are the underlying assumptions difficult to characterize accurately. 3. It is constantly
such as, 1. It is voluminous. 2. It is that corresponds to its
will be useful for solving AI problems? data by being organised in a way
What kinds oftechniques ?
changing. 4. It differs from
human intelligence be modelled application.
A t what level if at all can
that is represented so that the
intelligent program has been built ? An AI technique is a method that exploits knowledge share
.When will it be realised when an generalizations and situations that properties which can be
knowledge captures
rather than being allowed separate representation. It can be
Underlying Assumption grouped together,
1.3 The understood by people who must provide the knowledge; although for many programs
A physical symbol system consists of a set of entities called symbols which the bulk of the data may come automatically, such as from readings.
form the
components of another entity called an expression At In many AI domains people must supply the knowledge to programs in a
patterns that can occur as
an instant the system will contain a collection of these symbol structures people understand and in a form that is acceptable to the program. Knowledge can be
easily modified to correct errors and reflect changes in real conditions. Knowledge can
addition the system also contains a collection of processes that operate on
be widely used even if it is incomplete or inaccurate. Knowledge can be used to helpP
expressions to produae other expressions processes of creation, modification,
overcome its own sheer bulk by helping to narrow the range of possibilities that must
reproduction and destruction. A physical symbol system is a machine that be usually considered.
produces through time an evolving collection of symbol structures. Such a system
Following are three important AI techniques
is machine that produces through time an evolving collection of symbol structures
Search Provides a way of solving problems for which no more direct approach is
Following are the examples of physical systems -
available.
Formal logie : The symbols are words like "and", "or", "not", "for all
The expressions are statements in formal
and x so U s e ofknowledge - Provides a way of solving complex problems by exploiting the
logic which can be true or false. The structures of the objects that are involved.
processes are the rules of logical deduction.
Algebra: The symbols are "+", '*, "x", "y", "1", "2", "3",
Abstraction- Provides a way of separating important features and variations from
etc. The expressions ae the many unimportant ones that would otherwise overwhelm any process.
equations. The processes are the rules of algebra, that allow
mathematical expression and retain its truth.
you to
manipulate 1.5 The Level of the Model GTU: Winter-19
A digital computer: The symbols are zeros and ones
of computer me ory, the Before starting doing something, it is good idea to decide exactly what one is trying
processes are the operations of the CPU that to do. One should ask
following questions for self analysis
change memory.
TECHNICAL PUBLICATIONS An up thrust for knowledge
TECHNICAL PUBLICATIONS An up thrust for knowledge
Artificial inegeiCe Ihe COn.
- 12 Concept 1-13
Artificial Intelligence The Concept
Artificiel Intelligence
do the tasks the
Artificial Intelligence
programs
that
same way this, then we will
machine succeeds at
it is the person. If the
produce
to
What is the 80al
in tying believing that
think.
people do? that
do the
tasks the same
tasks
wav
y
ople do ? conclude that the machine can
programs
ply the task
do the
do in
whatever
simply
Are we trying to produce
to produce
programs
that
way Some General References
Or are
we trying do can be di as AI was done in
the period
appears easiest tasks the way people The early work that is now generally recognized men McCulloch and
perform that do w e r e formally put by
not
Efforts to build
program
that
two classes.
The first one are
that computer fall m
that fall
that e
more
class of in the brain), secondly formal analysis of
of Al ie. problems
those
that do things
clearly phsycology (the function n e u r o n s
our
definition
human
perforrmance
are
not trivial he com
for the computer. propositional logic and third was Turing's theory
of computation.
things that
are
to model do
attempt
of Ai tasks; they updating rule for modifying the
definition kind of tasks Later Donald Hebb in 1949 demonstrated simple
within o u r for these Hebbian learning
performance rule called
connection strengths between n e u r o n s . His
human now
T o test psychological theories of human pertomance. E-g FARRY programsimulate
Reasons for modeling
e which is considered to be influencial model in AI.
great
of human paranoid behaviour to
model
work that can be recognized as AI but Alan Turing
a
which exploited
for this reason,
paranoid person.
There were huge early day
b e h a v i o u r of a
named "Computing
the
conversational
For example, for a
who first articulated a complete vision of AI in his 1950 article
to
understand human reasoning.
question, such
comput
"qATter Machinery and Intelligence".
T o enable computer answer as
and then did
story held workshop on automata
to be able to
read a n e w s paper Real AI birth year is 1956 where in John McCarthy
Ravana lose the game? theory, neural nets and study of intelligencewhere other researchers also
in many cases Deani.
computer reasoning. their papers and they out with new field in computer science
to understand
re presented come
To enable people unless they can understand w the
reluctant to rely on
the output of computer called AL.
centntra
come
without being
reprogrammed.
Artificial Inteligence
and reasoning AI has finally
representation of methodolo8y
Prncples of knowledge terms Hidden
of McCulloch In based on
on the
neural
showed how.a
networks
and Pitts d I n 1990s Al emerged
as a
science.
In
approaches
recent years
field. This
model is
Early work building
method.
and Cowan (1963) la scientific
the the AI
flourished. The work of
Winogard individual Conge ge nur firmly
under
(HMMS) have
come to
dominate
and second is,
an model theory
of could
elements
collectively
represent
Hebb's lean
ept, with Markov Models
one
mathematical
is igorous corpus
real
a large
and parallelism. two aspects of training
on
robustness
Wi 8 based on
dro, 1962),ethods
in process
corresponding
increase
(Widrow Hoff, and 1960; models are generated by a
these
by Bernie Widrow
Frank Rosenblatt (1962) with
hihis 62) to a n e w
ep who
enhanced
were speech data. Systems led
called his
Rosenblatt
networks
of a
showing thas
perception to matrh
perceptrons Judea Pearl's
(1988)
Probabilistic
probability theory
Reasoning
in
in Intelligent
AL. Later Bayesian
network w a s
invented
the connection
strengths acceptance of with reasoning support.
algorithm ould adjust uncertain knowledge along
can represent
which the idea of
in 1986 promoted
existed.
a match
data, provided such to Eric Hovitz and
David Hackerman of decision
appeared conduct the laws
ELIZA program Judea Pearl, according to
1965,
Weizenbaum's
serious that can act rationally
In
conversation on any topic by
basically borrowing
and m a n i n .
theory.
expert systems
vision and
given by a human.
ad ocurred in robotics, computer
sentences
called weak' methods. Researcha Similar but slow
revolution have
and were
complicated,realized
domain knowledge
complex knowledge for mo
more knowledge representation. Allan
that it was necessary
to use more
larget architecture called SOAR was work out by
reasoning tasks. In 1987 a complete agent were developed
to
and Paul Rosenbloom. Many such agents
Buchanan in 1969 and was:
was based on Newell, John Laired in web
developed by "Internet". AI systems have
become so common
The DENDRAL program was domain. used work in big environment
program that effectively " bot" sufix has entered in everyday language.
these principles.
knowledge
It was a unique
in problem solving. In the mid-1970's, MYCIN, a program deva specifc
eloped based applications that the
4) Agent Program
we need to tabulate
1. Agent contents
program functions
file
packet. want develop a agent
to lead to infinite
When w e This can practically
Keystrokes,
Sensors
network
agent. need to
files, describes any given that we
writing functions that of percept sequence
Screen,
bound o n the length action will be
external
Actuator
Internet shopping agent hence w e need to put sequences
and
script) of percept
graphics This table of functions function for an intelligent agent
2. Agent pages (text consider.
internally agent
of the agent where
DHTML, as
H T M L , follow URL characteristics
Sensors user,
agent program.
displayto implement by an
Forms,
will be
Actuators
Note
Terminology abstract mathematical description.
AI function is an
1.8.2 The Agent on the agent architecture.
at any given i.
implementation, running
1) Percept perceptual
inputs instant. Agent program is a concrete
the agent's
refers to
percept
The term
1.8.3 Architecture of Agent
in the sky "through
"thro eyes and takes its which is called the
Examples "Bird fAying snan runs on some sort of computing device,
percepts The agent program
that the architecture will
human agent
architecture. The program we choose
has to be one
1) A sensors available to
(photograph) of a boiler through neras and takes
canmer
agent to know
percept sequence
how temperature
for controlling temperature. Tmints
Actuator
3) Agent Function
function which maps each and every possible perogt
(Action
It is defined as mathematical
action.
sequence to a possible
and it gives output as action.
This function has input as percept sequence
can be represented in a tabular form.
Agent function Fig. 1.8.1 Agent and its environment
Example
ATM machine is a agent, it display menu for withdrawing money, when ATM can
1.8.4 Schematic of Ar's Agent
Performing Action
inserted. When provided with percept sequence (1) A transaction type and Following diagram illustrates the agent's action process,
number, then only user gets cash. architecture. This can be also termed as
as
specified by
agene's structure.
Implements
system that has the following properties
Agent function
1] Autonomy
Maps have control over their
without direct intervention of humans and
Agents operate
Perception
actions and internal state.
Leads to
Action 2] Soclal ablity
action process communication
1.8.2 Agent's Agents interact with other agents (and possibly humans) via an agent
Flg.
language.
Program
1.8.5 Role of An Agent 3] Reactivity
is internally environment and respond in timely and rational fashion to
agent program An agent program Agents perceive their
An
Input (Agent function) Output
implemented as agent
function.
(Curent percepts (Action made changes that occur in it.
from sensors) through actuators)
takes input
An agent program 4] Pro activeness
from the Fia. 1.8.3 Role of an agent program in agent
as the curent percept architecture Agents do not simply act in response to their environment, they
are capable of taking8
action to
sensor and return an
the initiative, generate their owm goals and act to achieve them.
the effectors (Actuators).
Tabulation of a Agent
1.8.7.2 Strong Agent
for
1.86 Simple Example A stronger nation says that an agent has mental properties, such as knowledge, belief,
internet called as bot.
A shopping agent on
intention, obligation. In addition and agent has other properties such as:
Agent
Tabulation of percepts and action mapping 1. Mobility: Agents can move around from one machine to another and across
different system architectures and platforms.
Sequence of Percepts Actions
St. No. 2. Veracity: Agents do not knowingly communicate false information.
mygreeting.com Display website.
[Type URL of greeting 3. Rationality: Agents will try to achieve their goals and not acts in such a way that
[Navigation and observation of greetings to Clicks on the link. would prevent their goals from being achieved.
be purchased] Strong AI is associated with human traits such as consciousness, sentience, sapience,
To get details of greeting (which is Form filling. self-awareness
purchased}, in terms of a formj
1. Conciousness To have subjective experience and thought.
[To perceive completion of process Receiving recept u
awwawwwwwww.wwwww.wwwwww
2. Selfawareness To be aware of oneself as a separate individual, especially to be
aware of one's own thoughts.
1.8.7 The Weak and Strong Agent
3. Sentience The ability to feel perceptions and emotions subjectively.
An agent is anything that can be viewed its environment
perceiving
as through 4. Sapience The capacity for wisdom.
sensors and
acting upon that environment through effectors/actuators.
The
1) The performance measure that defines the criterion of success. Irational behaviour
4) The agent's percept sequence til current date 1.8.8.3 Omniscience, Leaming and Autonomy
outcome of its actions and can act
Based on above 4 statements rational agent can be defined as follows A n omniscient agent knows the actual
For each possible percept sequence, a rational agent should select an action that is accordingly, but in reality omniscience impossible.
is
RelationshipP
Figure Depicting rationality and Omniscience
Action
Expected Percept Sequence
Sequence Rationality performance
Ball Right
of percept Depends Maximizes IL1, No Black
on Pick
as L1, More Black Balls1
same
is not
function for the black ball essentially a problem to which agent is a solution.
Following is the partial tabulation of a simple agent
picker. The range of task environments that might arise in Al is obviously vast. We can,
however, identify a fairly small number of dimensions along which task
environments can be categorized. These dimensions determine, to a large extent,
the appropriate agent design and the applicability of each of the principle families
of techniques for agent implementation.
Fig. 1.8.8 Black ball picker world with two buckets at two locations
Observable
1.9.2.1 Fully Observable Vs Partialy Examples
percept of the image,
current
agent can
the whatever is
If an agent's sensors give it the to
access
complete state
state of the Deterministic: In image analysis of image
based on current
knowledge.
observable.
environment is partially
may current state agent
decides next state
action except
for
More examples
Example
Video analysis. 2) Trading agent. the next driving does
1) stochastic
environment as
in
Fully Observable Stochastic : Boat driving agent is and from all current and
In fact it has to
see the goal
current state.
The puzzle game environment is fully observable where agent can see all tho not based on
the aspects, needs to take
action.
that are surrounding it. That is agent can see all the squares of the
the previous percepts agent
with values (if any added) in them.
puzzle
puzzle
game along More examples
Robot firing in crowd.
1) Car driving 2)
More examples
1) Image analysis. 1.9.2.3 Eplsodic Vs Sequential is divided into atomic episodes such
The pocker game environment is partially observable. Game of pocker is a card itself, previous
decision could affect all
the other hand, the
current
game environment on
that shares betting rule; and usually (but not always) hand rankings. In this game In sequential
agent future decision.
is not able to perceive other player's betting the
environments are more simpler than sequential environments because
Also agent cannot see other player's card. It has .Episodic
to play with reference to its own
N not need to think ahead.
cards and with current betting knowledge. agent does
More Examples
1.9.2.2 Deterministic Vs Stochastic
1) Blood testing for patient. 2) Card games.
I f from current state of environment and the action, agent can deduce the next
state of environment then, it is deterministic environment otherwise it is stochastic Sequential Environment: A game of chess
is sequential environment where agent
takes action based on all previous decisions.
environment.
More examples -
. I f the environment is deterministic except for the actions of other agents, we say
1) Chess with a clock. 2) Refinery controller.
that the environment is strategic.
around (as it will not change) while taking actions. changes and acts
be various agents or
there can
various group of agents
.Where as continuous environment is not stable at any given point of time andit 1927 Complexty Comparlson of Task Environment
changes randomly thereby making agent to learn continuously, so as to male the rising order of complexity of various task environment.
Following is
decisions.
Low-
Rising order oHigh
complexity
Example:
Discrete: A game of tic-tac toe depicts discrete environment where every state is
stable and it associated percept and it is outcome of some action. Observable Partially observable
More examples . Determiristic Stochastic
1) 8- queen puzzle. 2) Crossword puzzle. Episodic quenti
Continuous: A boat driving environment is continuous where the state changes are Static Dynamic
continuous, and agent needs to perceive continuously. Discrete Continuous
More examples Single agent Muitiple agents.
wwwwww.wwwwwnin vwwme wvv
1) Part Picking Robot. 2) Flight Controller.
Agent monitoring
incoming people only and Engineering Task Environment
Example 11) Sclentific
:
2) Time Constrained
Environment
the move should be d develop to design
environment
where
clock
Chess with a Task Environment
Example : 12) Biological
of time. helpful for
for of chemical component
specified amount Example: Agent working design some
Environment medicine.
Decision Making
3) of a organization, Can
Example: The
executive agent who
is monitoring profit help 13) Space Task
Environment
take decision.
to environment and
top level management Example: Agent that is working in space for observing space
Process Based
Environment recording details about it.
4) take input and synthesize ittto
who can
Example The image processing agent 14) Research Task
Environment
and details about the image.
produce required output, in research lab where it is made to grasp (learm)
Example: Agent working a
User Environment knowledge and represent it and drawing conclusions from it, which will helps
5) Personal or
assistance who can helh researcher for further study.
agent which can be used as personal
Example: A small scale
notifications about work etc.
to remember daily task, who can give 15) Network Task Environment
6) Buying Environment Example: An agent developed to automatically carry data over a computer network
based on certain conditions like time limit or data size limit in same network (same type
Example: A online book shopping bot (agent) who buys book online as per user of agent can be developed for physically transferring items or mails) over same network.
requirements.
16) Repository Task Environment
7) Automated Task Environment
Example If a data repository is to be maintained then agent can be developed to
firm can use a agent who automates complete
Example A cadburry manufacturing arrange data based on criterias which will be helphul for searching later on.
procedure of cadburry making.
1.10 Different Types of Agents
8) Industrlal Task Environment
Example: An agent developed to make architecture of a building or layout of 1.10.1 Intelligent Agent
building. "Intelligent agent is an intelligent actor, who observe and act upon an
environmene"
9) Leaming Task Environment (Educational) Intelligent agent is magnum opus.
Example: We can have a agent who is learning some act or some theories presented
to if and later it can play it back which will be helpful for others to learn that act or
theories.
percept history.
An entity
which perfom?
1. Perception Sensor
2. Action What the
wortd is like
now?
Fig. 1.10.2 Intelligent Agent
What actOn
Example: Conditon action rulee I shoukd do
now?
1) A robotic agent (Cameras, Infrared range finders).
Characteristics of
Intelligent Agent (LA)
1) The IA leam and improve through interaction with the environment.
must
Flg. 1.10.3 Slmple reflex agent
2) The LA must adapt online and in the real
time situation.
Property: is limited.
but their intelligence Forexample:
) T h e s e are very simple
be made on the basis of onlv
which maintains its own internal state and then take action as
if correct
decision can
the A car driving agernt
2) They will work only environment is fully observable.
environment appears to it.
current percept- that
is only if the
serious trouble.
can cause
3) A little bit of unobservability then, it
observable environment can
works in partially lead Sensor
4) f simple reflex agent
to infinite loops. State
reflex agent try can out possible
Infinite loops be avoided if simplex
can
ach.
tions Whatthe wortd
5) Howthe wortd
randomize the actions.
evolves? is like now?
ie can
money. Environment
REFLEX AGENT
Procedure: SIMPLE
-
Input: Percept
Fig. 1.10.4 Model based reflex agent
Output: An action.
action rules. Procedure : REFLEX-AGENT-WITH-STATE
Static: Rules, a set of condition -
2) Its internal state is updated continuously which can be shown as: Property
Old Internal state 1) Goal based agent works simply towards achieving goal.
+ Current percept =Update state. 2) For tricky goals it needs searching and planning.
What action I
should do now?
Property: 3) Critic I t tells how agent is doing and determines how the performance element
function maps a state to real number, which describes the associated
1) Utility on a should be modified to do better in the future.
degree of best performance. It is responsible for suggesting actions that will lead to new
4) Problem Generator -
36
Artificial Intelligence 1-37 Artificial Intelligence The Concept
Artificial Intelligence
ough
thro.
earning
pertormance
their
improve
can
seen
More Types of Agents
All four type
ypes agent
we
have
1.10.4
and there by become learning agernt do classification of agents based on various like
We can aspects -
ment
from environment and
For example which
continuously
learns
then do 1) Task they perform. 2) Their various control architecture.
agent
roplane driving
Aerop 3) Depending on sensitivity of their sensors, and effectiveness of their action and
safe plane driving internal states they possess.
of Learming Agent
1.10.3.1 Components basic knowledge and learm Following are various types of agents, based on above classification criteria
Base/Learner/Learming
element-It holds ngs
1) environment.
1. Physical Agents: A physical agent is an entity which perceives through sensors
unfamiliar
from the Capable system is and acts through actuators.
system/Performing elements
is the actual
respo S16le
2) Capable/Efficient actions.
Performance element
agent. It 2. Temporal Agents A temporal agent may use time based stored information to
external
for selecting
actions. offer instructions or data acts to a computer program or human being and takes
and decides
perceives
feedback. It reflects fault and analyze cor program inputs percepts to adjust its next behaviour.
3)
It
gives
Faultreflector element maximum success.
orrective 3. Spatial Agents That relate to the physical real-world.
actions in order to get
element -
It generate new and informative experi 4. Processing Agents -
That solve a problem like speech recognition.
4) New problem generator t
suggests new actions. 5. Input Agents That process and make sense of sensor inputs- eg. neural
makes difference between incoming percept as a network based agents.
The performance standard reward
ree
knowledge
Artificial Intelligence 1-38 Artificial lIntelligence.
The Concp Artificial
intelligence
The Concept
[Slen
Slensors) description. atom, Industrlal
Business
Purpose
Sensors
Actuators
) Environment
Designing an Agent Performance
in
1.11.1 The Steps
Sr. No.
Agent Type Measure
Display product Keyboard,
task environment) in complete
area (i.e. mouse.
1) Define problem automated taxi a Secure reliable, E-commerce lists with price,
automated face recognitiorn,
human
System
fast business
websites,
system.
forms.
processing8
tabulate PEAS.
(customer).
Define Temperature,
2) or
and action. Values, pumps,
uence and
functions (i.e. percept sequence action
column) Refinery, pressure
If system is multiagents
then we
co-operation No.
Correct image
Downlink from Display
categorization
of
Color pixel
arrays.
agents.
strategies among multiple
satelite.
Satellite image orbiting
analysis system. categorization
scere
Thelr PEAS Description Knowledge
Types and
resuit
Agent of lab Recording database of
Examples
1.11.2 According
****
A chemistry of reaction
Correct chemicals and
to Their Uses Chemical
recording
of where
e a c t i o n analyzer instruments, their
reaction.
for common man) in chemistry chemicais are
characteristics.
Secure, reliabie
ATM machine, Display
ATM system human system
menu/screer
No. Measure
Sensor
required
to support sequence of perception
are
sensor
events.
for providing input
Interactive
English tutor.
Maximize
s t u d e n t ' s sCore
Set of students,
testing agency.
Display exercises
sugEestions,
corrections.
Keyboard entry.
Keyboard
1) Keyboard
for GUI
interface.
Mouse
on test 2) audio recording.
and mike for
Group of
learner Display of each Inputs from 3) Headphone for listening
A casio teacher. Learmer should
be able to play or a single note,
presentation of
learner, trom Video/web camera's for video shooting
specific musical learner. mouse or 4)
pieces. playing a key,
sample music keyboard and One Final Word
database ot casio 1.12 c a n be s e e n
that goal
pieces details. its related work it
******
I1) The [E]nvironment: study some of the basic but major topics related to AL.
has following properties
In InteractiveEnglish Tutor agent system environment Answer in Brief
and 1Q (Intellectual Quotient).
1) All the students having different grasping power
demonstration. 1. Define Al. (Refer section 1.1)
2) Software modules which gives
2. What is AI ? (Refer section 1.1)
I) The [A]ctuators (Actions) 3. What is meant by robotic agent ? (Refer section 1.1)
architecture. (ie.
The software model (agent program) will be executed on the agent What are adoantages one can infer when machines perform intelligently ? (Refer section 1.1)
interactive english tutor are, 5. Define an agent. (Refer section 1.8)
operating system). The actions performed by
6. What is role of an agent program ? (Refer section 1.8)
1) Audio / video demonstration on different topics.
7. Define rotational agent. (Refer section 1.8)
2) Practical assignment on verbal written skills, report generation, letter writing,etc
8. List down the characteristics of intelligemt agent. (Refer section 1.10)
Monitoring and inspection (ie. checking) of the practical assignment provide 9. Give general model of learning agent. (Refer section 1.10)
10. Explain in detail the history of Al. (Refer section 1.
with suggestions and corrections, to students.
11. What are various domains of AI ? (Refer section 1.1)
4) Online test conduction and result analysis.
12. Discuss in detail the structure
5) Student's of agent with suitable diagram. (Refer section 1.8)
speech and video recording.
TECHNICAL PUBLICATIONS An up thrust for knowledge
41
(Refer section 1.9)
test. (Refer section 1.1)
Discuss Turning
W h a t are requirements of intelligent agents ? (Refer section 1.10) Q.5
(Refer section 1.10) Winter- 18
17. Discuss model based agents and goals based agents. wmww.d
with goals. (Refer section 1.10)
18. Give the structure of a n agent discuss different task domain of artificial intelligence. 31
their PEAS. (Refer section 1.11) Q.6 Define and
19. List few agent types and describe (Refer section 1.9)
section 1.11)
20. What is meant by PEAS ? (Refer
Summer 19
how a n Al system is diferent from
a cornvolutional! computing
computing system.
s
21. What is AI ? Explain
(Refer section 1.1) (Refer section 1.9) 141
words in the context of AI: Intelligence
characteristics of Al. (Refer section 1.1) Q.7 Define the following
22. What is Al ? State various
23. Explain the nature and scope of AlL. Why game playing problems are considered Al vrohi Winter 19
lems ?
(Refer section 1.1)
how AI techniques improve
the term "Artificial Intelligence". Explain
24. What a r e Al techniques? (Refer
section 14) Q.8 Define 1.1 and 1.4)
25. Define AI and justify with suitable example how does conventional computing diflerent
real-world problem solving. (Refer sections
the What is the significance of the Turing Test" in Al : Explain how it is performed.
section 1.1)
intelligent computing. (Refer Q.9 41
26. Explan desirable properties of Al internal representation and Al softoare. (Refer section 1
(Refer section 1.1)
1.1)
a.10 Enlist and discuss the major task domains of Artificial Intelligence.
Questions with Answers (Refer section 1.9)
1.13 University nwww.wwwwnw
Winter 12 Summer-20
wwwww.w
wwww.w wi
What is intelligence Discuss types of problems requiring intelligence to solbe it. Q.11 Define the following wods in the contert of Al:
Q.1
i) Intelligence. (Refer section 1.1)
Define Al.(Refer sections 1.1.2 and 1.2)
TECHNICAL PUBLICATIONS -
An up thrust for knowledge
An up thrust for
knowledge
TECHNICAL PUBLICATIONS -
Knowledge Representation
4 IssuesS
Syllabus
a l Agents: Knowledge-based agents, The Wumpus world, Logic,
onsitional theorem proving. Efective propositional model checking,Propositional
Agents basedlogic,
on
Pro
propositional logic.
et Order Logic: Representation Revisited, Syntax and Semantics of First Order logic, Using First
Orderlogic
Contents
Representation and Mappings... .. Winter- 14, 18, 19,
Summer- 16,18,20
.
Marks 7
computer
since the early 1970s has been based on #h
aradigm
for Choosi ng
the
Granularit
13 within.
encountered is
knowledge
that
bandJohn Zom,Naked City) solve a complex problems manipulating
AI used to means
of
DE well as some
as
TECHNICAL O Knowledge thrust for knowledge
PUBLICATIONS An up thrust for knowledge TECHNICAL
PUBLICATIONS
An up
A r t i h c i a li n t e l l g e n c e 4 5
Artificial Intelligence 4-4 Knowledge Representetion lssue
sues Knowledge Representation Issues
nsider example of the dtilated
required so as to create solutions for new problems. In the representation there
here are two board from which h two
squares, in
Checkerbo Problem. onsider a normal
different entities that must be considered checker
exactiy with
donimoes, each of which covers
task
No overlapping either of dominoes on
Representation of facts in some chosen formalism. These are things that
squares
the boundary
actually be manipulated.
be done in two levels
over
7"
Structuring of these entities can
explained below. Using the deductiverepresentation of the fact: all dogs have talls a
Partial covernng
Cover fieds on the board
new
representation object. Usingg an mechanisms of the logic, we may generaecould he
then generate the appropriate backward mapping Flg. 4.1.3 Observation
4-7
which enforces
the number of black squarres to coincide Knowledge Represental Issues
ror the number of white fields, 2) Inherltable knowledge
the inter play befween covered sa
with the white squares, when
investigated uares on the edge is
Relational knowledge made up of
object
in the partial covering associativity like
board and dominoes contained values attribute.
co-relation associated
Representation
to Knowledge All data shoule be organised into
42 Approaches GTU: Summer-15 17, 18, 20, Winter
a
hierarchy of classes.
18 Inherit values from being all members of class.
of knowledge in a particularparticular domai
domain shoulad
A good system for the representation Class must be arranged in a generalization.
possess the following Pproperties individual frame can represent the
the ability to represent all of #h Cuery
collection
Representational adequacy It is kinds of associated with a individual node.
of attribute and its
value
that domain.
knowledge that are needed in
I t is the to manipulate the representational
Inferential adequacy ability ct
Player
in such a way as to derive new structures corresponding to new knowl.
inferred from old.
ledge Sa
TECHNICA
TECHNICAL PUBLICATIONS. n tn thou
4-8
Knowledge kepresentation A r t f i c i e lI n t e l l i g e n c e 4- 9
Artificial Intelligence ISsues Knowled Representation
tail, otherwise go
not then
arams rely
Many programs rely on more than one technique
Otherwise look value of instance,
if
found, report it. Otherwise.
node and srstem - They are used
used in
attribute, if one
is
Database system representing Simple
find a value for the
ISA, found for
the attribute. there which declarative facts and can be said as a set of
Relation Knowledge
is no value search using relations of the
Aatabase systems. Fig. 4.2.2 shows an same sort
example of such systems.
4.2.1 Inferential Knowledge
Player Height Weight
is very useful form of inference, represent the kno..
Bats-Thrown
property
When inheritance
as a formal logic.
ledge Ram 6-0 180
Right-Right
tail (n) Shyam 5-10 170
All cat have tails tx: dog (x)> has a
Right-Right
Veer 6-2 215 Left-Left
Set of rules 6-3
Tarun 205
1) Define require fact.
www.ww..a niivnwe nwnmnt
Left-Right
Semantic nets Semantic nets are useful for
2) Additional statement is varified, true or false. representing inheritable knowledge.
Tnheritable knowledge is the most useful for property inheritance, in which elements
3) Logic provides a powerful structure in relationships.
of specific classes inherits attributes and values from more general classes in which
4.2.2 Procedural Knowledge they are included. Frames also do play a big role in representing this knowledge.
In order to support property inheritance, objects must be organized into classes
Procedural different-different way in program.
knowledge can
explain and classes must be arranged in a generalization hierarchy. Fig. 4.2.2 below shows
Procedural knowiedge clearly differs from propositional knowledge. some additional baseball knowledge inserted into a structure that is so arranged.
:
height of Three-Finger
height of Three-Finger
178
Brown is cm. 1he structure
semantic network
shown in the
or
deduction
Fig 422
19a
Musician
be also called
collection
a
1S a slot-and-filler
structure. It may Isa
frames.
values.
It can be combined with some other powerful description language with Miles Davis John Zom
hierarchy. bands bands
Production rules
Production rules are useful in representing procedural knowledge. Miles Davis Group Naked City
Miles Davis Quintet Massada
Procedural knowledge is form of operational knowledge which specifies what to
do when. 4.2.3 Property inheritance hierarchy
Flg.
such LISP.
Previously it was done using programming language as
fail.
Otherwise look for a value of instance if none
However it was hard to reasoning with this method hence in AA progra 3.
then report it.
find a value for the attribute and
is represented using production rules. 4. Otherwise go to that node and
procedural knowledge for the attribute.
isa until a value is found
5. Otherwise search through using
Inheritable knowiedge is an important issue
in computer science in
Relational knowledge is made up of objects consisting of Knowledge Representation (KR) for building intelligent
"The dominant paradigm
general and in AI in particular. on the premise
that inteligence
Attributes 1970s has been based
systems since the early in the system's
Corresponding associated values. knowledge is represented
presupposes knowledge. Generally, In addition, the
structures and programs.
We extend the base more by allowing inference mechanisms consists of data
knowledge base, which called an inference engine
that
is expected to have
a program
current Al
Property inheritance ntegent system
necessary
for the task at hand.
Thus
Elements inherit values from being members of a class. piements the reasoning patterns based, consistent
systems be knowledge
Data must be organised into a hierarchy of classes (Fig. 4.2.3). and practice dictate that intelligent This emphasis
EOry architecture.
base plus inference engine
i s simple knowledge
Boxed nodes called applied
objects and values of attributes of objects. has led to suggestions
that AI can be arguably
Values can be objects with attributes and so on. Knowledge
Arrows - point from object to its value.
epistemology be termed the
symbol-manipulation approacn.
neural
eapproach described above may of work in
which another approach,
h i s structure is known slot and filler structure, semantic out non-symbolic
as a newo ically, however, AI grew distributed processing
or
PUBLICATIONS-
An up
thrust for knowledge
TECHNICAL
The basic
idea may
based orn of
repetitions of similar
sim stimulia knowled base with its Kramer and Mylopoulos, 1992, p. 746).
empiricism. learning
stimuli-processes,
why or view the most imDor
result of point
association.
From our
co issye b) Semantlc networks
Symbol representation declarative and the procedural extremes, while "others have argued that semantic
to knowledge representation
in AL which
networks offer a fundamentally different representational paradigm that object
can : is
There are several approaches be
dOe-up-of a-player-in
Market
mortal" using mathematical logic. "A major advantage of many logics adopted for
knowledge representation is that they are sound and complete, which means that
derivability and provability lead to the same set of consequences, given a carries
Retailer
knowledge base. It has however turned out to be difficult to find logics that is em
both expressively adequate for knowledge representation and also computationally
the attributes
s
knowledge base. The second approach redefines the provability relation or na
first-order logic to make it
computational tractable. S Size
Relational databases.. . widely used to
represent "simple" facts, such
peop as
is-a Category
information, for
kindstoofuse
instance,
definitional and descriptive informatio and in this
how the frame. Frames are supposed to capture the essence af.concep
view, involves large, complex structures of symbols, defined and assembled by
or
for dinner, by clustering all
for example going out hand. This approach to Al essentially derives from a line of philosophical thought
stereotypical situations, This means, in particular, that
vant
information for these situations together. running from Descartes through Leibniz, Frege, and Russel. In the late 1980s and
(whatever that may be) of organised knowledge structures. What I will do is place examination, that the knowledge quotation:
"More
uncovered by the following
may be
doubts on the explanatory value of concepts as frames, conventions, scripts and so perspective that are missing level has relativistic properties.
that the knowledge observer's
there are structures like frames and scripts, recently, Clancey (1991) argues n v i r o n m e n t . It is
an
on...
Even if are they relatively easy description is of an agent in its
e
studied" (Clancey,
1992,
for people to override. People can still use arbitrary knowledge of the world to A knowledge-level the agent being
possessed by level (or
representations
system's knowledge
understand sentences and scenes: you cannot exclude
any part of the knowledge theory, not
description of an agent's or a
has relative properties
and implies
base in advance, using some general prestructuring of that knowledge. 743). Yes! The
Thereroe generalized: a description of its knowledge)
perspectives.
This is a basic point
the content of such structures as frames and
scripts must themnselves be Dos t or system
from specific
but it has yet
to be fully
analyzable and subject to reasoning by their users, which puts us back a i o the theory of the agent
understanding
of knowledge
where we started. What we have gained is a summary of the agere in pragmatic
the representation. much
theories of knowledge there has not been
implemented in
regularities frequently or typically, exhibited. The structures themselves te epistemology theories and
recognition
of AI as applied hand
epistemological
nothing about people's cognitive capacities, only about what are probably n spite of the between on
the one
This is odd,
because
ephemeral habits of thought which people can change. In terms of Bilg (1987) systematically
investigation
of knowledge
representation.
theory
of knowledge
theories and any
frames and other hand
scrips lack any kind of 'witcraft. Frames, scripts and relatea Onthe
theory ofknowledge
summarize some of the patterms that emerge when people don't bother to ** is the knowledge.
PIstemology a theory of
be based
on
must
(Vliet, 1992) epresentation
knowtedge
thrust for
A n up
PUBLICATIONS
TECHNICAL
4- 19
Knowledge Representation Issues
A r t i c i e lI n t e l l i g e n c e
4-18
owledge Representatio Issues
Artificia! Intelligence nresent. In large corpora of texts
voice present.
(such as Davis, 2001
and Kramer many voices are present (what kind
representation
in Al
has been es varies accordin8 to how the text corpus is of
n overviews of knowledge and
rationalism
cted as
voice
or scholarly papers).
selected, e.g. if it consists of
Mylopoulos,
1992) only
empiricism
to expand
such overviews b newspapers
and need
There is an
obvious Large corpora of texts onsist of documents each of
which is itself a
approaches.
different
epistemological
positions.
arguments and
knowledge claims. We are now in the realm of Library system of
cOverage of feld of A, first and fore
oremost by and
Hermeneutics has been regarded in the
contributions nclude Mallery, Hu
include
ormation Science (LIS) rather than in computer science in a narrow
sense. What
Winograd &Flores
(1987).
Additional
and Martin (2005). There seems
Tepresented
are
in LIS are
representations of documents
representing
knowledge
and Fonseca
Chalmers (1999) (thus meta-representations). If, tor example, the text
corpus is an academic corpus
Duffy (1992);
bee a need for a
more direct application
ot
eutical/pragmati
historicist/hermeneutical/prao
Contents
7.1 Acting Under Uncertainty
7.2 Utility Theory
7.3 The Basic Probability Notation. Winter-18, . Marks 4
(7-1)
Artificial Intelligence 7-2
Uncertainty
7.1 Acting Under Uncertainty
Introduction
A agent working in real world environment almost has
never access to whole + th
about its environment. Therefore, agent needs to work under uncertainity.
Earlier agents we have seen make the epistemological commitment that
either the
facts (expressed as propositions) are true, false or else they are unkrnown.
When an
agent knows enough facts about its environment, the logical approach enables it t
derive plans, which are guaranteed to work.
But when agent works with uncertain knowledge then it might be impossible to
construct a
complete and correct description of how its actions will work. If a
logical
agent can not conclude that any
perticular course of action achieves its
goal, then it will
be unable to act.
The right thing logical agent can do is, take a rational decision. The rational decision
depends on following things:
The relative importance
of various goals.
The likelihood and the degree to
An agent would
which, goals will be achieved.
possess some early basic knowledge of the world (Assume that
knowledge represented in first order logic sentence). Using first order logic to handle
is
real word problem domains fails for three main reasons
as discussed below
1)Laziness
It is too much work to list the
complete set of arntecedents or
consequents needed to
ensure an
exceptionless rule and too hard to use such rules.
2) Theoretical ignorance
A perticular
problem may not have complete theory for the domain.
3) Practical ignorance:
Even if all the rules are known,
perticular aspects of problem are not checked yet or
some details are not considered at all
(missing out the details).
The agene's knowledge can
provide it with a degree of belief with relevent sentences.
To this degree of belief
probability theory
is applied. Probability assigrns a numerical
degree of belief between 0 and 1 to each sentence.
Probability provides a way of summarizing the uncertainity that comes from our
laziness and ignorance.
helief saying that the sentence is true. Probabilities between 0 and 1 correspond to
intermediate degree of belief in the truth of the sentence.
knowledge
All probability statements must therefore, indicate the evidence with respect to which
the probability is being assessed. As the agent receives new percepts, its probability
assessments are updated to reflect the new evidence. Before the evidence is obtained, we
talk about prior or unconditional probability; after the evidence is obtained, we talk
about posterior or conditional probability. In most cases, an agent will have some
evidence from its percepts and will be interested in computing the posterior probabilities
of the outcomes it cares about.
time an agent can have various available decisions, from which it has to
perticular
make a choice. To make such choices an agent must have a preferences between the
different possible outcomes, of the various plans.
A perticular outcome is completely specified state, along with the expected factors
For example : Consider a car driving agent who wants to reach at airport by a
Decision theory
combined with probabilities for making
Preterences as expressed by utilities are
called as decision theory.
rational decisions. This theory, of rational decision making is
Decision theory can be summarized as,
Decision theory =Probability theory + Utility theory.
The principle of Maximum Expected Utility (MEU): that
Decisiontheory rational if and
says that the agent is
only if it chooses the action
all the possible outcomes of the action.
yields highest expected utility, averaged over
select actions.
The algorithm
Function : DT-AGENT (percept) returns an action.
Static belief-state, probabilistic beliefs about the current state of the world.
expressivness.
The probability theory uses represent prior probability statements, which apply betore
any evidence is obtained. The probability theory uses conditional probability statemernts
which include the evidence explicitly.
7.3.1 Propositions
1) The propositions (assertions) are attached with the degree of belief.
i)Boolean random variables These are random variables that can take up
only boolean values.
it takes value either true or false.
For example Cavity,
:
iii) Continuous random variables : They take values from real numhers
domain can be either entire real line or subset of it like intervalc Ihe
2, 3)
that X has exact value 4.14
For example : X = 4.14 asserts
Propositions having continuous random variable can have inequalitioc
like
X 4.14.
2) They are represented as variables. These variables are assigned values from the
real world.
For example If the world is consists of cavity and Toothache then there are four
distinct atomic events,
equivalent to true.
falsehood of evey
ii) Any particular atomic event entails the truth or
3) It is written as P(a).
For example: The probability that, Ram has cavity = 0.1, then prior probability
equations
P (Weather = Sunny) = 0.7
TECHNICA"
3LICATIONS - An up thrust for knowledge
Artificial Intelligence 7-8
Pla/b)=Planb)
,
P(b) it holds whenever P(b) > 0 .(7.3.1)
The above
equation can also be written as,
Pla a
b) =
P(a |b) P(b)
This is called as
product rule. In other words it says, for we
need 'b' to be true and we need a to 'a' and b' to be rue
be true given b. It
can be also written
Pa b)= P(b|a) P(a). a
TECHNICAL PUBLICATIONS -
An up thrust for
knowledge
Artificial Intelligence 7-9 Uncertainty
time.
This axiom connects the probabilities of logically related propositions. This rule
states that, the cases where a' holds, together with the cases where 'b' holds,
cover all the causes where 'avb holds;
but summing the two sets of
certainly
cases counts their intersection twice, so we need to subtract P(a ab).
Note The axioms deal only with prior probabilities rather than conditional
Then,PD =
d;) =1.
i=1
Toothache Toothache
Catch Catch Catch -Catch
than 'cavity' (that is whose probability is being counted) are summed out
.The general marginalization rule is as follows,
For any sets of variables Y and Z,
P) = P(Y, z) . (7.3.3)
It indicates that distribution Y can be obtained by summing out all the other
variables from any joint distribution X containing Y.
.Variant of above example of general marginalization rule involved the conditional
probabilities using product rule.
P(Y) P(Y|2)P(e) . (7.3.4)
P(Cavity Toothache) =
P(Cavity nToothache) 0.108+0.012
0.6
P(Toothache) 0.108+0.012 +0.016+0.064
Normalization constant : It is variable that remains constant for the distribution,
which ensures that it adds in to 1. a is used to denote such constant.
For example : We can compute the probability of a cavity, given evidence of a
toothache, as follows
Cavity Toothache)
P(Cavity |Toothache) =
P(Toothache)
0.108+0.012
0.6
0.108+0.012+0016+0.064
Just to check we can also compute the probability that there is no cavity given a
toothache
0.016+0.064
0.4
0.108+0.012+0.016+ 0.064
Notice that in these two calculations the term 1/P (toothache) remains constant, no
matter which value of cavity we calculate. With this notation we can write above two
equations in one.
P(Cavity | Toothache) =« P(Cavity, Toothache)
a [PCavity, Toothache, Catch) + P(Cavity, Toothache,- Catch)]
=
a [< 0.108, 0.016> + <0.012, 0.064>]
7.3.7 Independance
It is a relationship between two different sets of full joint distributions. It is also
called as marginal or absolute independance of the variables. Independence indicates
that whether the two full joint distributions affects probability of each other.
.For example : The weather is independant of once dental problem. Which can be
shown as below equation.
PToothache, Catch, Cavity, Weather) = P(Toothache, Catch, Cavity) P(Weather).
Pba) P(a|b)P(b)
P(a)
This equation is called as Bayes' rule or Bayes' theorem or Bayes' law. This rule is
very useful in probabilistic inferences.
Generalized Bayes' rule is,
P(YIX)= X|Y P(Y)
PX)
(where P has same meanings)
We can have more general version, conditionalized on some
background evidence e.
PX|Y,e) P(Y|e)
P(Y |X, e) =
P(Xe)
General form of Bays' rule with normalization's
P(ylx) = a P(x|y) P(y).
Then we have,
P(s |m) = 0.5
P(m) = 1|50000
P(s)= 1|20
TECHNICAL PUBLICATIONS An up thrust for knowledge
Artificial Intelligence 7-14
Uncertainty
P(s |m)P(m)
P(ms)= P(s)
0.5x1|50000
1 20
= 0.0002
That is, we can expect that 1 in 5000 with high B.P. will has low sugar.
. (7.3.8)
For this reformulation to work, we need to know the conditional probabilities of the
conjunction Toothache a Catch for each value of Cavity. That might be feasible for just
two evidence variables, but again it will not scale up.
If there are n possible evidence variable (Xrays, diet, oral hygiene, etc.), then there
are 2" possible combinations of observed values for which we would need to know
conditional probabilities.
The notion of independence can be used here. These variables are independent,
however, given the presence or the absence of a cavity. Each is directly caused by the
cavity, but neither has a direct effect on the other. Toothache depends on the state of the
nerves in the tooth, where as the probe's accuracy depends on the dentist's skill, to
which the toothache is irrelevant.
Mathematically, this property is written as,
P(Toothache A Catch| Cavity) = P(Toothache | Cavity) P(Catch | Cavity) .(7.3.9)
This equation expresses the conditional independence of toothache and catch, given
cavity.
Substitute equation (7.3.3) into (7.3.4) to obtain the probability of a cavity
P (Cavity | Toothache n Catch) = a P (Toothache| Cavity) P (Catch| Cavity) P (Cavity)
Now, the information requirement are the same as for inference using each piece
evidence separately the prior probability P(Cavity) for the query variable and the
conditional probability of each effect, given its cause.
number of
Consider dentistry example, single cause, directly influences
in which a
a
Answer in Brief
1. Explain the process of inference using full joint distribution with example.
Rather than computing the probability of a proposition, it computes the probability the
evidence that supports the proposition.
3. Define: Baye's theorem.
called
In probability theory and applications, Baye's theorem (alternatively
as
Ans.:
its inverse.
Baye's law or Bayes rule) links a conditional probability to
P(a b) P(b)
Pba) P (a)
degree", but
Default reasoning treats conclusions not as "believed to a certain
as
TECHNICAL PUBLICATIONS -
An up thust for
knowledge
Artificial Intelligence 7-17 Uncertainty
1) A set of random variables makes up the nodes of the network. Variables may be
discrete or continuous.
2) A set of directed links or arrows connects pairs of nodes. If there is an arrow from
node X to node Y, then X is said to be a parent of Y.
3) Each node X, has a conditional probability distribution P(X; |Parents(Xi)) that
quantifies the effect of the parents on the node.
4) The graph has no directed cycles (and hence is a directed, acyclic graph, or DAG).
The set of nodes and links is called as topology of the network.
Winter 188