Professional Documents
Culture Documents
Lec 8 Cmu Gen Algo
Lec 8 Cmu Gen Algo
Genetic algorithms
History
History of GAs
• As early as 1962, John Holland's work on
adaptive systems laid the foundation for later
developments.
No convergence rule
or guarantee!
Vocabulary
11
Example (initialization)
We toss a fair coin 60 times and get the
following initial population:
s1 = 1111010101 f (s1) = 7
s2 = 0111000101 f (s2) = 5
s3 = 1110110101 f (s3) = 7
s4 = 0100010011 f (s4) = 4
s5 = 1110111101 f (s5) = 8
s6 = 0100110000 f (s6) = 3
12
Step 1: Selection
We randomly (using a biased coin) select a subset of
the individuals based on their fitness:
Individual i will have a f (i )
1 Area is
2
n Proportional
to fitness
value
3
13
Selected set
Suppose that, after performing selection, we get
the following population:
14
Step 2: crossover
15
Crossover result
Before crossover:
s1` = 1111010101 s2` = 1110110101
After crossover:
s1`` = 1110110101 s2`` = 1111010101
16
Step 3: mutations
The final step is to apply random mutations: for each bit that we are to copy to
the new population we allow a small probability of error (for instance 0.1)
17
And now, iterate …
3 01000 64 5.5
Cross point
• Two point crossover (Multi point crossover)
Uniform crossover
• A random subset is chosen
• The subset is taken from parent 1 and the other bits from parent 2.
A (slightly more involved)
example
The Traveling Salesman Problem:
CityList1 (3 5 7 2 1 6 4 8)
CityList2 (2 5 7 6 8 1 3 4)
Crossover
Crossover combines inversion and recombination:
* *
Parent1 (3 5 7 2 1 6 4 8)
Parent2 (2 5 7 6 8 1 3 4)
Child (5 8 7 2 1 6 3 4)
* *
Before: (5 8 7 2 1 6 3 4)
After: (5 8 6 2 1 7 3 4)
TSP Example: 30 Cities
120
100
80
y 60
40
20
0
0 10 20 30 40 50 60 70 80 90 100
x
Solution i (Distance = 941)
TSP30 (Performance = 941)
120
100
80
y 60
40
20
0
0 10 20 30 40 50 60 70 80 90 100
x
Solution j(Distance = 800)
44
62 TSP30 (Performance = 800)
69
67 120
78
64 100
62
54
80
42
50
40 y 60
40
38 40
21
35
20
67
60
60 0
40 0 10 20 30 40 50 60 70 80 90 100
42 x
50
99
Solution k(Distance = 652)
TSP30 (Performance = 652)
120
100
80
y 60
40
20
0
0 10 20 30 40 50 60 70 80 90 100
x
Best Solution (Distance = 420)
42
38 TSP30 Solution (Performance = 420)
35
120
26
21
35 100
32
7 80
38
46
44 y 60
58
60 40
69
76
20
78
71
69 0
67 0 10 20 30 40 50 60 70 80 90 100
62 x
84
94
GA Applications
Domain Application Type
Nature 2000