Professional Documents
Culture Documents
SEDP(Continued)
SEDP(Continued)
SEDP(Continued)
Optimization
Unconstrained Constrained
Continuous
Discrete
Smooth
Optimization (continued)
Search
Gradient Based
Tree-Based
Stochastic
Heuristic
Gradient Based
Tree-Based
Stochastic
Heuristic
Optimization
Min f(x) f() continuous and differentiable scalar function X real variable Stationarity condition df/dx=0 For min d2f/dx2>0 max df/dx=0
df/dx=0
Lambda-iteration method
Lambda-iteration method
Gradient method
Gradient method
Newtons method
Dynamic Programming
DP Advantage
Genetic Algorithm
GAs work with a coding of the parameter set, not the parameters themselves. GAs search from a population of points, not a single point. GAs use payoff information, not derivatives or auxiliary knowldege. GAs use probablistic transition rules, not deterministic rules.
Vocabulary
Gene An single encoding of part of the solution space. Chromosome A string of Genes that represents a solution. Population - The number of Chromosomes available to test.
Simple Example
f(x) = {MAX(x2): 0 <= x <= 32 } Encode Solution: Just use 5 bits (1 or 0). Generate initial population.
A 0 B 1 C 0 D 1 1 1 1 0 1 0 0 0 0 0 0 1 1 0 0 1
N-point Crossover
Choose n random crossover points Split along those points Glue parts, alternating between parents Generalisation of 1 point (still some positional bias)
GA operators: mutation
Alter each gene independently with a probability pm pm is called the mutation rate Typically between 1/pop_size and 1/ chromosome_length
A
3/6 = 50%
2/6 = 33%
Thanks