Soft Computing
Neuro-Fuzzy and Soft Computing
chapter 1
1
Soft Computing
What is covered in this class?
We will teach techniques useful in creating
intelligent software systems that can deal with
the uncertainty and imprecision of real world
problems
Some components of Intelligent systems are
• human-like - they possess human-like expertise
within a specific domain,
• adaptable - they adapt themselves and learn to
do better in a changing environment, and
• explanations - they explain how they make
decisions or take actions
2
Soft Computing
How will we teach the techniques?
We will present
• multiple techniques from Soft Computing +,
• when each technique is applicable
• examples of industrial applications
“If the only tool you have is a hammer, then
every problem looks like a nail”
- anonymous
3
Soft Computing
What is Soft Computing?
Soft Computing is a field that currently includes
Fuzzy Logic
Neural Networks
Probabilistic Reasoning(Genetic Algorithms, BBN), and
Other related methodologies
• Case-Based Reasoning
Soft Computing combines knowledge, techniques,
and methodologies from the sources above to
create intelligent systems
4
Soft Computing
Why is this important?
Farming
The information revolution
corn & cows
going on is allowing us to
Industrial automate information
Revolution processing tasks which require
Manufacturing intelligence much like the
chairs & cars industrial revolution automated
manufacturing tasks
Information
“Soft Computing” techniques
Revolution
have already been applied
Service successfully.
content and code
5
Soft Computing
Soft Computing
“The essence of soft computing is that
unlike the traditional, hard computing,
soft computing is aimed at an
accommodation with the pervasive
imprecision of the real world. Thus, the
guiding principle of soft computing is
to exploit the tolerance for imprecision,
uncertainty, and partial truth to achieve
tractability, robustness, low solution
cost, and better rapport with reality”
- Lotfi Zadeh
6
Soft Computing
Fuzzy Logic
Sets with fuzzy boundaries
A = Set of tall people
Crisp set A Fuzzy set A
1.0 1.0
.9
.5 Membership
function
170 Heights 170 180 Heights
(cm) (cm)
7
Soft Computing
Fuzzy Set Theory
Fuzzy set theory provides a systematic calculus
to deal with imprecise or incomplete information
Fuzzy if-then rules are used in fuzzy inference
systems
If <1> is tall and <1> is athletic then <1> is good
basketball player.
A A’ B B’ T-norm C
w
Z
X Y
8
Soft Computing
Neural Networks
Pattern matching technique where input patterns
are matched with a specific output pattern. Modeled
after the neurons in the brain.
Network architecture
Weights on the links
x1
y1
x2 y2
9
Soft Computing
Genetic Algorithms
An optimization technique
10010110 10010110
01100010 Elitism 01100010
10100100 10100100
10011001 10011101
01111101 Selection Crossover Mutation 01111001
... ...
... ...
... ...
... ...
Current Next
generation generation
10
Soft Computing
Other Techniques
Bayesian belief networks
represent and reason with probabilistic knowledge
Decision Trees
classification using tree structure
Least-squares estimator
statistical regression
Hybrid approaches
use multiple techniques
11
Soft Computing
Soft Computing is a Hybrid Method
Neural
Character
x1 y1 dog Animal? Knowledge
x2 y2
Recognizer dag base
dog
12
Soft Computing
How does SC Relate to Other Fields
What is AI?
“AI is the study of agents that exist in an environment
and perceive and act.” (S. Russell and P. Norvig)
“AI is the art of making computers do smart things.” (Waldrop)
“AI is a programming style, where programs operate on data
according to rules in order to accomplish goals.” (W. A. Taylor)
“AI is the activity of providing such machines as computers
with the ability to display behavior that would be regarded as
intelligent if it were observed in humans.” (R. McLoed)
13
Soft Computing
How does SC Relate to Other Fields
What is AI? (Jang)
The long term goal of AI research is the
Broad creation and understanding of machine
Definition intelligence
Conventional AI research focuses on an
Narrow
attempt to mimic human intelligent behavior
Definition
by expressing it in symbolic rules
14
Soft Computing
How does SC Relate to Other Fields
What is an Expert System (ES)?
Questions Inference
Engine
Responses
User
KB
rules
Knowledge facts
Acquisition
Knowledge
Engineer
15
Soft Computing
How does SC relate to other fields?
symbolic automatic
manipulation Machine improvement
AI with
Learning experience
Cognitive Soft Computing
Psychology Statistics
Study of the mind Probability
(not possibility)
uncertainty and imprecision
16
Soft Computing
Soft Computing Characteristics
Human Expertise (if-then rules, cases, conventional
knowledge representations)
Biologically inspired computing models (NN)
New optimization techniques (GA, simulated annealing)
Model-free learning (NN, CBR)
Fault tolerance (deletion of neuron, rule, or case)
Real-world applications (large scale with uncertainties)
17
Soft Computing
The end
18