Professional Documents
Culture Documents
First of all, I would like to thank AFOSR for their support to the research presented in this talk.
I will present an overview of two different methods for analyzing the behavior of dynamical systems,
which have theoretical grounding in operator theory of dynamical systems, and, in particular, the
Koopman operator.
Research was done by our group, in collaboration with Clarence Rowley, Andrzej Banaszuk, Yoshihiko
Susuki, Umesh Vaidya, and others - full list of references at the end.
Operator Theory and Dynamical Systems
Friday, July 2, 2010 Marko Budišić: Analysis of Dynamical Systems Using the Koopman Operator Formalism 2
The more common, geometric, analysis of dynamical systems focuses on change of objects IN the
state space. The operator-theoretic approach focuses on change of objects ON the state space.
Koopman operator tells us what happens to an observable one step in future – composition of
observable with the action of the dynamical system.
Unitarity on attractor enables the study of the operator through spectral decomposition.
The methods are based on:
1) Analysis of eigenfunctions
2) Analysis of expansions of observables into eigenfunctions
Time-averaging and invariant sets
(x, y) ∈ T2 , ε ∈ [0, 1)
Time-averaged Functions (TAF)
x+ = x + ε sin 2πy
0
PT f = f˜ U f˜ = f˜ y + = x + y + ε sin 2πy
N
! −1
1
f˜(x) := lim f (T (x)) n
N →∞ N
n=0
N
! −1
1
f˜(x) := lim f (T (x)) n
N →∞ N
n=0
Perturbation:
Friday, July 2, 2010 Marko Budišić: Analysis of Dynamical Systems Using the Koopman Operator Formalism 5
Dynamical system model of a ring of power generators and their deviation from the rest of the power
grid (the infinite bus).
Delta is the average deviation of the rotor position from the infinite bus. Blue dot is the normal
operating condition, the system is hit by a perturbation, which might induce the instability in the
system.
Size of invariant set denotes the size of deviation resulting from perturbation.
This analysis could be performed on a full scale model (or experimental data), just using the particular
observable.
Segue: In this case, a single observable sufficed for the analysis. What happens when we have multiple
observables?
Mesochronic Scatter Plots (MSP)
f1 (x, y) = cos(2πx + 7πy)
0.6
0.4
0.2
f2∗
0
f2∗
-0.2
-0.4
-0.6
-0.8
f2 (x, y) = cos(9πx + πy) -0.5 0 0.5
f1∗
f1∗ [Levnajić, Mezić, 2010]
Friday, July 2, 2010 Marko Budišić: Analysis of Dynamical Systems Using the Koopman Operator Formalism 6
0.6
0.4
0.2
f2∗
0
f2∗
-0.2
-0.4
-0.6
-0.8
f2 (x, y) = cos(9πx + πy) -0.5 0 0.5
f1∗
f1∗ [Levnajić, Mezić, 2010]
Friday, July 2, 2010 Marko Budišić: Analysis of Dynamical Systems Using the Koopman Operator Formalism 6
0.6
0.4
0.2
f2∗
0
f2∗
-0.2
-0.4
-0.6
-0.8
f2 (x, y) = cos(9πx + πy) -0.5 0 0.5
f1∗
f1∗ [Levnajić, Mezić, 2010]
Friday, July 2, 2010 Marko Budišić: Analysis of Dynamical Systems Using the Koopman Operator Formalism 6
0.6
0.4
0.2
f2∗
0
f2∗
-0.2
-0.4
-0.6
-0.8
f2 (x, y) = cos(9πx + πy) -0.5 0 0.5
f1∗
f1∗ [Levnajić, Mezić, 2010]
Friday, July 2, 2010 Marko Budišić: Analysis of Dynamical Systems Using the Koopman Operator Formalism 6
0.6
0.4
0.2
f2∗
0
f2∗
-0.2
-0.4
-0.6
-0.8
f2 (x, y) = cos(9πx + πy) -0.5 0 0.5
f1∗
f1∗ [Levnajić, Mezić, 2010]
Friday, July 2, 2010 Marko Budišić: Analysis of Dynamical Systems Using the Koopman Operator Formalism 6
Metrization of EQS:
1 Observables span the space of
ϕk (x) = e2πi k·x
, k ∈ Zd
(2π)d/2 functions.
! "T
x !→ . . . ϕ̃k (x) ... Initial conditions are mapped
to sequences of time averages.
Φ̃ : M → hs (Zd , "."s )
! |ϕ̃k (x)|2 Negative-Sobolev norm
!Φ̃(x)!2s = " #s ,
k∈Zd 1 + (2π!k!2 )
2 (low-pass filter!)
[Budišić, Mezić, 2009]
Friday, July 2, 2010 Marko Budišić: Analysis of Dynamical Systems Using the Koopman Operator Formalism 7
If we would construct the MSP for a countably dense set of observables, we would obtain the Ergodic
Quotient Space.
A point in Ergodic Quotient Space corresponds to an ergodic set in the state space.
Collection of ergodic sets is the Ergodic Partition - the finest invariant partition, i.e., every other
invariant partition can be constructed by unions of ergodic sets.
If we start with a Fourier basis of observables, the EQS is isomorphic to a multisequence space.
We can endow this space with a weighted L2 norm, which corresponds to a negative Sobolev space
norm - it has a dynamical meaning.
NSN metric is equivalent to Empirical Distance that measures how long two trajectories stay close, on
average.
Segue: This is an infinite-dim space, however, as we have seen, structures might be remarkably low-
dimensional.
Ergodic Partition and Quotient Space
Ergodic Quotient Space: Limiting structure of the MSP.
Distinct ergodic sets mapped to distinct points in EQS.
Refining partitions by Properties of Ergodic Partition:
averaging more observables • Dynamics is ergodic on elements.
limits to the Ergodic Partition. • The finest invariant partition.
If we would construct the MSP for a countably dense set of observables, we would obtain the Ergodic
Quotient Space.
A point in Ergodic Quotient Space corresponds to an ergodic set in the state space.
Collection of ergodic sets is the Ergodic Partition - the finest invariant partition, i.e., every other
invariant partition can be constructed by unions of ergodic sets.
If we start with a Fourier basis of observables, the EQS is isomorphic to a multisequence space.
We can endow this space with a weighted L2 norm, which corresponds to a negative Sobolev space
norm - it has a dynamical meaning.
NSN metric is equivalent to Empirical Distance that measures how long two trajectories stay close, on
average.
Segue: This is an infinite-dim space, however, as we have seen, structures might be remarkably low-
dimensional.
Heat Diffusion as Surveying on EQS
0.02
0.015
0.01
0.005
χ(2)
-0.005
-0.01
-0.015
-0.02
Friday, July 2, 2010 Marko Budišić: Analysis of Dynamical Systems Using the Koopman Operator Formalism 9
Goal for visualization of invariant partition is to achieve large variation of color in nearby ergodic sets.
Ergodic coordinate show multiscale property - first coordinates vary across large-scale features, while
later coordinates vary across smaller scale features. The more similar two coordinates are on larger
scales, the more similar first N coordinates they will have.
They have an effect of “unraveling” and straightening the EQS/MSP.
Potential application:
a) analysis of hi-dim systems with lo-dim ergodic partition
b) control design?
c) observable design?
Segue: Ergodic Coordinates have a particularly strong significance in “white box” cases -- we have
access to (a lot) of states, but don’t know what observables are relevant.
Ergodic Coordinate Embedding
Ergodic Coordinate Embedding Second ergodic coordinate
0.025
0.02
0.015
0.01
0.005
χ(2)
-0.005
-0.01
-0.015
-0.02
Friday, July 2, 2010 Marko Budišić: Analysis of Dynamical Systems Using the Koopman Operator Formalism 9
Goal for visualization of invariant partition is to achieve large variation of color in nearby ergodic sets.
Ergodic coordinate show multiscale property - first coordinates vary across large-scale features, while
later coordinates vary across smaller scale features. The more similar two coordinates are on larger
scales, the more similar first N coordinates they will have.
They have an effect of “unraveling” and straightening the EQS/MSP.
Potential application:
a) analysis of hi-dim systems with lo-dim ergodic partition
b) control design?
c) observable design?
Segue: Ergodic Coordinates have a particularly strong significance in “white box” cases -- we have
access to (a lot) of states, but don’t know what observables are relevant.
Application: Perturbed Spherical Hill Vortex
ε = 0.01 ε = 0.35
State space contains a positively-invariant torus. Images show Theta=0 section through that torus.
System was studied as an example of a KAM-type system, but at higher perturbations new invariant
structures were uncovered, without particular design of observable.
Segue: For the final part of this talk, we will shift our attention from analysis of eigenfunctions to
analysis of expansions INTO eigenfunctions.
Koopman Modes
Evolution of a g : M → CJ
v.v. observable g(xn ) = g(T n x) = U n g(x)
Efunction expansion
.. ..
U ϕk = λ k ϕ k . ' ∞
.
g(x) =
gj (x) =
vj ϕk (x)
.. k=1 ..
. . k
Koopman modes .. ..
. ' ∞
. n
preserved during g(xn ) = gj (x n )= vj λk ϕk (x)
the time evolution .. k=1 ..
. . k
Koopman Modes are a part of analysis of the observables. Understand the evolution of the observable
through coefficients of expansion in eigenfunctions of the Koopman.
Each KM corresponds to one eigenfunction of the Koopman operator.
For a single observable, KM is just the coefficient of expansion.
For a vector-valued observable, KM is a vector of such coefficients.
KM can be computed using Arnoldi algorithm.
Application: Jet in the Crossflow
Mixing by injection of fluid through a
hole into a steady cross-flow.
• DNS
• Flow vel. field is the observable
• 256 X 201 X 144 gridpoints
• 250 time snapshots
(a)
Methods • identifying
invariant sets by averaging of observables
• Ergodic Quotient Space and ergodic coordinates
• Koopman mode analysis
Koopman Analysis
Familiar linear algorithms can be harnessed
to uncover features in full nonlinear
dynamics.
Friday, July 2, 2010 Marko Budišić: Analysis of Dynamical Systems Using the Koopman Operator Formalism 13
References
Mezić and Banaszuk. Comparison of systems with complex behavior. Physica D (2004)
Susuki and Mezić. Ergodic Partition of Phase Space in Continuous Dynamical Systems.
Proc. 48th IEEE CDC, Shanghai, China (2009)
Budišić and Mezić. An Approximate Parametrization of the Ergodic Partition using Time
Averaged Observables. Proc. 48th IEEE CDC, Shanghai, China (2009)
Rowley, Mezić et al. Spectral analysis of nonlinear flows. Journal of Fluid Mechanics
(2009)
Friday, July 2, 2010 Marko Budišić: Analysis of Dynamical Systems Using the Koopman Operator Formalism 14