Applied Artificial Intelligence

Lecture 11
Integrate & Conquer
Arthur Kordon
Kordon Consulting LLC
Lecture 11 agenda

Kordon Consulting LLC 2

Lecture 11 agenda

Kordon Consulting LLC 3

 The nasty reality of real-world applications

One method is NOT enough

Kordon Consulting LLC 4

Benefits of integration

Kordon Consulting LLC 5

 The price of integration

A good integration is when we have British

Police, German Mechanics, French
Cuisine, Swiss Banking and Italian Love.
But integrating British Cuisine, German
Police, French Mechanics, Italian
Banking, and Swiss Love is a disaster”.
Lotfi Zadeh

Kordon Consulting LLC 6

Lecture 11 agenda

Kordon Consulting LLC 7

Integration between AI methods: balancing method’s capabilities with integration

Added interpretability

Hyperparameters
optimization

Kordon Consulting LLC 8

 Integration between genetic algorithms and neural networks

Evolution of neural networks Kordon Consulting LLC 9

 Neuroevolution principles

Evolution of neural networks Kordon Consulting LLC 10

 Neuroevolution (EvoAI) for automatic deep neural networks design

Evolution of neural networks Kordon Consulting LLC 11

 Integration between AI methods and first-principles models

Accelerated first-principles model Emulators of first principles models

development by genetic programming
Data

Empirical proto-models
x2 x6 x8
y  3.45  5.67e 5 *
x5
y  a  [b x1  c log(x2 )] e  d x5
kx3

First-principles model

Kordon Consulting LLC 12

Integration between AI methods and statistical models

Kordon Consulting LLC 13

Synergetic benefits

14
 GP and Design Of Experiments (DOE)
Models Showing Lack of Fit
Situations of Lack of Fit
1. Simple factorial DOE 2. A response surface DOE
Enough experiments to fit first order already had all experiments to fit
model second order model
k k
y  β o   β i xi   βi j xi x j S k   o   i xi   ii xi2   i j xi x j
i 1 i j i 1 i j

Classical approach if LOF Classical approach if LOF

add experiments to fit second order no alternative (use model as it is)
model
k
S k   o   i xi   ii xi2   i j xi x j
i 1 i j

Suggested approach:
More costly experiments Use GP to transform inputs
1. Generate GP models 2. Generate input transforms

Selected solution 3. Fit response surface model in

transformed variables
4 4
S k   o    i Z i    i j Z i Z j    ii Z i2
i 1 i j i 1

Source DF Sum of Square Mean Square F Ratio

Lack of Fit 2 0.00049190 0.000246 2.2554

Pure Error 2 0.00021810 0.000109 Prob > F

Total Error 2 0.00071000 0.3072

No Lack Of Fit
Max RSq
(p=0.3037)
0.9999
Lecture 11 agenda

Kordon Consulting LLC 17

Key steps in methods selection and integration process

Kordon Consulting LLC 18

Link between solution types and method’s capabilities

Appropriate AI methods for different

real-world problems solutions

Vs.

Kordon Consulting LLC 19

Lecture 11 agenda

Kordon Consulting LLC 20

Lecture 11 “Integrate & Conquer” Summary

• It is difficult to solve real-world problems with one method only

• Methods integration improves model development, increases credibility, broadens
solution acceptability, and reduces cost
• Integrating AI methods principle is balancing their strengths and weaknesses
• Neuroevolution (EvoAI) is the leading integration methodology
• Integrating AI methods with first-principles models accelerates model development
and applicability in real-time
• Integrating AI methods with statistical models resolves some of their limitations

The Bottom Line

Integrate modeling methods and conquer real-world problems

Kordon Consulting LLC 21

Details on this topic are given in the following chapters of “Applying
Data Science” book:
Chapter 4, pp.123-159

Kordon Consulting LLC 22

Lecture 11 agenda

Kordon Consulting LLC 23

What we have covered

Objective 1
Explain the capabilities of AI to solve real-world
problems

Understanding and communicating

Kordon Consulting LLC 24

 Relationship between key buzzwords

Understanding technological
landscape Kordon Consulting LLC 25
 Two types of applied AI Augmented Intelligence (AI)
AI REPLACES human intelligence AI ENHANCES human intelligence

AI systems that imitate AI systems that improve human

successfully human intelligence intelligence through machine learning
in specific tasks. and discovery of new patterns, features,
and relationships in data.

Understanding
two types of
AI

Competitor Amplifier
Good Old AI (GOAI) Computational Intelligence (CI)
Kordon Consulting LLC 26
Applied AI definition

Real-world Artificial Smart Value

problems Intelligence solutions

Applied AI creates value by solving real-world problems with AI-based methods

Understanding the meaning

of applied AI Kordon Consulting LLC 27
 Business advantages of applied AI

Proof for business

advantages of applied AI

Businesses using AI have a 3 – 15% higher profit margin

McKinsey Global Institute, AI: The next Digital Frontier, 2017
Kordon Consulting LLC 28
Key AI methods
Patterns

Complex patterns

Classifiers

Decisions

Novelty

Optimization

Emergent behavior
Understanding
applied AI forest Kordon Consulting LLC 29
What are we aware about each AI method (example with swarm intelligence)?

Understanding AI methods
from technical point of view

Kordon Consulting LLC 30

How to communicate each AI method (example with swarm intelligence)?

Your mother-in-law

After Lecture1 After Lecture5 After Lecture10

Examples how to communicate AI

methods to non-technical audience

Kordon Consulting LLC 31

What next?

Kordon Consulting LLC 32

 Next Module delivers Objective 2

Objective 2
Describe the applicability of AI in different areas

Kordon Consulting LLC 33