You are on page 1of 15

SICE Journal of Control, Measurement, and System

Integration

ISSN: 1882-4889 (Print) 1884-9970 (Online) Journal homepage: https://www.tandfonline.com/loi/tmsi20

Economic and Distributed Model Predictive


Control: Recent Developments in Optimization-
Based Control

Matthias A. Müller & Frank Allgöwer

To cite this article: Matthias A. Müller & Frank Allgöwer (2017) Economic and
Distributed Model Predictive Control: Recent Developments in Optimization-Based Control, SICE
Journal of Control, Measurement, and System Integration, 10:2, 39-52, DOI: 10.9746/jcmsi.10.39

To link to this article: https://doi.org/10.9746/jcmsi.10.39

Published online: 18 Jan 2021.

Submit your article to this journal

Article views: 77

View related articles

View Crossmark data

Citing articles: 20 View citing articles

Full Terms & Conditions of access and use can be found at


https://www.tandfonline.com/action/journalInformation?journalCode=tmsi20
SICE Journal of Control, Measurement, and System Integration, Vol. 10, No. 2, pp. 039–052, March 2017

Economic and Distributed Model Predictive Control: Recent Developments


in Optimization-Based Control

Matthias A. MÜLLER ∗ and Frank ALLGÖWER ∗

Abstract : The goal of this paper is to give an overview of some recent developments in the field of model predictive
control. After a brief introduction to the basic concepts and available stability results, we in particular set our focus
on the areas of distributed and economic model predictive control, where more general control objectives than setpoint
stabilization are typically of interest.

Key Words : model predictive control, distributed MPC, economic MPC, nonlinear systems.

1. Introduction mization of the achievable profit in general. While the former


Model predictive control (MPC), also called receding hori- setting can be handled within a suitable distributed MPC frame-
zon control, is a very successful modern control technology. Its work, the latter is the distinctive feature of so-called economic
basic idea is as follows: at each sampling instant, the future be- MPC schemes.
havior of the system is predicted over some finite time horizon When considering large-scale systems, the development of a
using some prediction model, and an open-loop optimal control single (centralized) model predictive controller for the overall
problem is solved to determine the optimal input trajectory over system is in general not possible or not desirable, since, e.g.,
this horizon. Then, the first part of this optimal input is applied such a central control entity having enough computational re-
to the system until the next sampling instant, at which the hori- sources is not available, such an approach is not scalable, or
zon is shifted and the whole procedure is repeated again. The the information/communication flow between the systems is re-
main advantages of MPC and the reasons for its widespread stricted to a certain (given) communication topology. Hence, in
success include (i) guarantees for closed-loop satisfaction of distributed MPC, the main challenge is how the repeated online
hard input and state constraints, (ii) the possibility to directly optimization can be performed in a distributed fashion such that
include the optimization of some performance criterion in the for the overall closed-loop system, desired guarantees such as
controller design, and (iii) its applicability to nonlinear systems constraint satisfaction, stability, or achievement of the cooper-
with possibly multiple inputs. In the last decades, a very rich ative control objective can still be established. To this end, var-
body of literature has emerged discussing both various theoret- ious solution approaches suitable for different system classes
ical issues such as stability and robustness as well as successful and interconnection structures have been proposed; Section 3
applications in many industrial fields, see, e.g., the books and provides an overview of some of these approaches.
survey articles [1]–[9] and the references therein. As motivated above, in economic MPC some general cost
Besides a brief introduction to the basic concepts and avail- function is used for controller design, which is not necessarily
able stability results in MPC (see Section 2), the main focus positive definite with respect to some setpoint to be stabilized.
of this review article are the areas of distributed and economic This results in the fact that the closed-loop system might not
model predictive control, which have both received a signif- converge to some steady-state, since the optimal behavior of
icant amount of attention in recent years. One unifying fea- the system can be more complex (e.g., periodic), depending on
ture of the underlying control tasks in both these areas is that the system dynamics, the cost function and the constraints. Im-
typically more general objectives than the classical goal of set- portant questions in such a setting are in particular the classifi-
point stabilization are considered. For example, in a typical dis- cation of the optimal operating behavior as well as establishing
tributed cooperative control task, multiple dynamical systems desired closed-loop performance and convergence guarantees.
have to achieve some common cooperative goal such as multi- These issues will be discussed in Section 4.
vehicle platooning and formation stabilization, or distributed We close this section by noting that the goal of this article is
power generation. In other situations, some general objective not to give an exhaustive overview of all the available results
is considered which is possibly related to the economics of the in the above areas, which by the immense number of existing
system, such as maximization of a certain product in the pro- publications is almost impossible. Rather, we attempt to sum-
cess industry, minimization of energy consumption, or maxi- marize the main ideas in a coherent fashion such as to provide
the reader a concise introduction to the field of model predictive
∗ control in general, and in particular to the areas of distributed
Institute for Systems Theory and Automatic Control, University
of Stuttgart, 70550 Stuttgart, Germany
and economic MPC. The exposition will be done for discrete-
E-mail: matthias.mueller@ist.uni-stuttgart.de, time systems, as is the case in most of the available results in
frank.allgower@ist.uni-stuttgart.de the literature. Nevertheless, the same (or similar) results are
(Received November 28, 2016) typically also available for continuous-time systems.
(Revised December 22, 2016)

JCMSI 0002/17/1002–0039 
c 2016 SICE
40 SICE JCMSI, Vol. 10, No. 2, March 2017

1.1 Notation done in industrial practice. Under some mild technical condi-
Let I[a,b] denote the set of integers in the interval [a, b] ⊆ R, tions (such as continuity of the involved functions and com-
and I≥a the set of integers greater than or equal to a. Boldface pactness/closedness of the involved sets), Problem 1 is either
symbols denote finite sequences v : I[0,N] → Rn for N ∈ I≥0 , infeasible or a (possibly non-unique) minimizer exists, which is
or infinite sequences v : I≥0 → Rn , i.e., v = {v(0), . . . , v(N)} or denoted by u0 (t) := {u0 (0|t), . . . , u0 (N − 1|t)} and in which case
v = {v(0), v(1), . . . }, respectively. x0 (t) := {x0 (0|t), . . . , x0 (N|t)} and JN0 (x(t)) := JN (x(t), u0 (t))
denote the corresponding optimal state sequence and optimal
2. MPC - Basic Principle and Stability value function, respectively. A standard model predictive con-
In this section, we give a brief introduction to the basic prin- troller is now defined by the following algorithm.
ciple of MPC and available stability results. In the following,
Algorithm 1 Consider system (1). At each time t ∈ I≥0 , mea-
the system dynamics are given by a nonlinear difference equa-
sure the state x(t), solve Problem 1 and apply the control input
tion of the form
u MPC (x(t)) := u0 (0|t).
x(t + 1) = f (x(t), u(t)), x(0) = x0 , (1) Algorithm 1 results in the closed-loop system
where f : Rn × Rm → Rn , x(t) ∈ Rn and u(t) ∈ Rm are the x(t + 1) = f (x(t), u MPC (x(t))), x(0) = x0 . (5)
system state and the control input, respectively, at time t ∈ I≥0 ,
and x0 ∈ Rn is the initial condition. The system has to satisfy In the following, we discuss how desired guarantees for this
pointwise-in-time state and input constraints closed-loop system can be derived. The classical control objec-
tive, which is considered in most of the available MPC litera-
x(t) ∈ X, u(t) ∈ U (2) ture, is to asymptotically stabilize a given equilibrium setpoint
of system (1), which without loss of generality is assumed to
for all t ∈ I≥0 , where X ⊆ Rn and U ⊆ Rm are the state and be the origin. In this case, a positive definite stage cost func-
input constraint sets, respectively1 . In order to define the model tion  needs to be chosen, i.e., (0, 0) = 0 and (x, u) > 0 for all
predictive control law, at each time t ∈ I≥0 with measured state (x, u)  0. However, in general the closed loop (5) is not neces-
x(t), for a given prediction horizon N ∈ I≥1 the following opti- sarily asymptotically stable if Problem 1 is not designed prop-
mization problem is solved: erly. In fact, it is rather easy to construct examples where this is
the case; for an experimental study of this fact, see, e.g., [10].
Problem 1
In the literature, two main approaches can be found how stabil-
ity in MPC can be established. One uses a suitable choice of
minimize JN (x(t), u(t))
u(t) the terminal region and cost, while the other establishes stabil-
ity without these ingredients by a suitable (long enough) choice
subject to
of the prediction horizon N.
x(k + 1|t) = f (x(k|t), u(k|t)), k ∈ I[0,N−1] , (3a) 2.1 Stability in MPC with Additional (Terminal) Con-
x(0|t) = x(t), (3b) straints
x(k|t) ∈ X, u(k|t) ∈ U, k ∈ I[0,N−1] , (3c) When using a framework with a terminal constraint (3d) and
x(N|t) ∈ X ,f
(3d) a terminal cost function, the main assumptions to ensure stabil-
ity are as follows.
where
Assumption 1 There exists a local auxiliary control law u =

N−1 κ f (x) such that the following is satisfied inside the terminal re-
JN (x(t), u(t)) := (x(k|t), u(k|t)) + V f (x(N|t)). (4) gion, i.e., for all x ∈ X f :
k=0
i) κ f (x) ∈ U,
In this problem, u(t) := {u(0|t), . . . , u(N − 1|t)} and x(t) :=
{x(0|t), . . . , x(N|t)} are input and corresponding state sequences ii) f (x, κ f (x)) ∈ X f ,
predicted at time t over the prediction horizon N. The con-
iii) V f ( f (x, κ f (x))) − V f (x) ≤ −(x, κ f (x)).
straints (3) ensure that predicted states and inputs have to obey
the system model (1) and satisfy the given state and input con- Assumption 1 means that the local auxiliary controller satis-
straints, and that the final predicted state is contained in the fies the input constraints (when applied inside the terminal re-
terminal region X f ⊆ X. Furthermore, the stage cost function gion), that the terminal region is invariant under application of
 : X × U → R specifies the considered performance crite- the local auxiliary controller, and that the terminal cost serves
rion, and V f : X f → R is the terminal cost function. The as a control Lyapunov function inside the terminal region. Note
terminal constraint (3d) and the terminal cost V f are used in that the auxiliary local controller is never applied to the system,
various schemes in the literature in order to guarantee closed- but is only needed in order to properly design the terminal re-
loop stability (cf. Subsection 2.1); other approaches omit these gion X f and the terminal cost V f . If Assumption 1 (and some
additional ingredients (cf. Subsection 2.2), as is also typically additional, nonrestrictive technical assumptions) are satisfied,
1
Instead of decoupled state and input constraints, also more gen- one can show that (i) Problem 1 is feasible for all t ∈ I≥0 if it is
eral (possibly coupled) constraints of the form (x(t), u(t)) ∈ Z ⊆ initially feasible (i.e., for t = 0) and (ii) the origin is an asymp-
Rn × Rm for all t ∈ I≥0 can be considered. totically stable equilibrium for the closed-loop system (5). A
SICE JCMSI, Vol. 10, No. 2, March 2017 41

proof of this result was first obtained in [11] for continuous- holds:
time systems (compare also [3],[12]); for the discrete-time set-
ting, see, e.g., [2],[4],[5]. The survey paper [2] also gives a JN0 (x) ≤ LN · inf (x, u). (6)
u∈U
good overview on the historical development of stability results
in MPC. The main idea in order to prove the above result on Assumption 2 can, e.g., be verified using certain asymptotic
recursive feasibility and asymptotic stability is to construct a or exponential controllability conditions, although this can be
feasible candidate solution to Problem 1 at time t + 1 from a difficult task in general. Using Assumption 2, one can
the optimal solution at time t. In particular, such a feasible show that there exists a number α(N) such that the relaxed
candidate solution ũ(t + 1) is given by appending the tail of dynamic programming inequality JN0 (x(t + 1)) ≤ JN0 (x(t)) −
the previously optimal solution by the local control law, i.e., α(N)(x(t), u MPC (t)) holds. In case that α(N) > 0, again asymp-
ũ(t + 1) = {u0 (1|t), . . . , u0 (N − 1|t), κ f (x0 (N|t))}. Feasibility of totic stability follows.
this candidate solution follows from feasibility of the optimal Furthermore, α(N) provides a suboptimality estimate for
solution u0 (t) at time t and properties i) and ii) of Assumption 1. the resulting MPC closed-loop cost compared to the in-
MPC
Given this feasible candidate solution and the assumption of finite horizon optimal cost. Namely, let J∞ (x0 ) :=
∞
t=0 (x(t), u
MPC
initial feasibility, recursive feasibility can easily be established (x(t))) denote the closed-loop cost resulting
by induction. Furthermore, one can use the optimal value func- from application of Algorithm 1 (with prediction horizon N),
tion JN0 as a Lyapunov function for the closed-loop system (5). and J∞ 0
(x0 ) be the infinite horizon optimal cost. Then from
In particular, the above defined feasible (but in general subop- the relaxed dynamic programming inequality it follows that
timal) candidate solution ũ results in a cost decrease given by α(N)J∞ MPC
(x0 ) ≤ J∞0
(x0 ) for all x0 ∈ X. In [5],[20], a detailed
JN0 (x(t + 1)) ≤ JN (x(t + 1), ũ(t + 1)) ≤ JN0 (x(t)) − (x(t), u MPC (t)), analysis can be found how α(N) can be obtained using Assump-
from which asymptotic stability can be concluded. tion 2 (see also the continuous-time version [21]). In particular,
A constructive method how to compute X f , V f and κ f such one can show that α(N) → 1 for N → ∞. This implies that (i)
that Assumption 1 is satisfied was first proposed in [11] (for closed-loop stability is guaranteed for a large enough prediction
continuous-time systems). This procedure is based on the as- horizon N (since for such N, α(N) > 0) and (ii) for N → ∞, the
sumption that the linearization of system (1) at the origin is MPC closed loop recovers infinite horizon optimality.
stabilizable and considers the case where the stage cost func-
tion  is quadratic. The local auxiliary controller is chosen as a 2.3 Discussion and Further Results
linear control law κ f (x) = K x which stabilizes the linearization. We now briefly discuss some of the advantages and disad-
Then, a quadratic terminal cost V f is computed such that con- vantages of the above described methods to establish stability
dition iii) of Assumption 1 is satisfied for the linearized system in MPC. The main benefits of the framework of Subsection 2.1
by solving a Lyapunov equation, and the terminal region X f with terminal constraints and a terminal cost are that a shorter
is chosen as a sublevel set of V f . Since the linearization error prediction horizon than in a setting without terminal constraints
consists of quadratic (and higher order) terms, one can show might be sufficient to ensure closed-loop stability, and that a
that condition iii) of Assumption 1 is also satisfied for the orig- systematic procedure how to satisfy the crucial Assumption 1
inal nonlinear system if a small enough sublevel set is chosen is available for a large class of systems (in particular, in case
as terminal region. Furthermore, by assuming that 0 is con- that the linearization is stabilizable as described above). Fur-
tained in the input constraint set U, it follows that condition i) thermore, this assumption allows to establish recursive feasi-
is also satisfied for X f small enough. Finally, condition ii) fol- bility of the repeatedly solved optimization problem as well as
lows from satisfaction of iii) and the fact that X f is a sublevel closed-loop stability in a straightforward manner. On the other
set of V f . A discrete-time version of this procedure can, e.g., hand, adding a terminal constraint might be restrictive and the
be found in [4]; also, various different approaches and gener- feasible set (i.e., the set of states for which a solution to Prob-
alizations to obtain possibly larger terminal sets are available, lem 1 exists) might be unnecessarily small, depending on the
see, e.g., [12]–[14]. size of the terminal region. Also, the computational complex-
ity is increased through the additional terminal constraint. The
2.2 Stability in MPC without Terminal Constraints approach of Subsection 2.2 does not exhibit these drawbacks
The second main approach to ensure stability omits the use through omitting the use of a terminal constraint, resulting in a
of a terminal constraint (3d) and a terminal cost in (4). In- simpler optimization problem and a possibly larger feasible re-
stead, closed-loop stability is typically shown by choosing the gion. On the other hand, recursive feasibility is not as straight-
prediction horizon N large enough, given that some controlla- forward, but requires additional assumptions and/or arguments,
bility condition is satisfied. While early results showed that un- see, e.g., [5],[15],[22]. Furthermore, the required controllabil-
der certain conditions, such a large enough prediction horizon ity condition (Assumption 2) can be difficult to verify, and for
exists (see, e.g., [15],[16]), more recent publications also give general nonlinear systems, no systematic procedure exists to
constructive (although possibly conservative) estimates for the this end. An additional advantage of MPC without terminal
required prediction horizon length using a suitable controlla- constraints is that closed-loop performance estimates can be
bility condition [5],[17]–[21]. This controllability condition is given via the suboptimality index α(N). When using the set-
typically formulated as the existence of a suitable upper bound ting of Subsection 2.1, the establishment of such closed-loop
on the optimal value function: performance estimates is not as straightforward and in general
depends on properties of the terminal cost V f . Certain subopti-
Assumption 2 There exist L > 0 and numbers 0 ≤ LN ≤ L, mality estimates can be established if the terminal cost is a good
such that for all x ∈ X and all N ∈ I≥0 , the following inequality approximation of the infinite horizon optimal cost, see, e.g., [5].
42 SICE JCMSI, Vol. 10, No. 2, March 2017

In conclusion, each of the two presented schemes has its advan- This is typically the case in multi-agent settings such as multi-
tages and disadvantages, and the choice of a suitable stabilizing robot coordination or formation flight. Second, couplings be-
MPC scheme depends on the considered application. tween the subsystems can stem from coupling constraints. Typ-
An alternative to the two stabilizing MPC approaches de- ical examples include collision avoidance or connectivity main-
scribed above are Lyapunov-based MPC methods (see, e.g., tenance constraints. Third, a common objective is another
[23]). Here, a (global) control Lyapunov function is assumed source of coupling between subsystems, resulting in couplings
to be known, and instead of terminal constraints, a constraint in the cost functions Ji,N of the individual subsystems. In the
requiring a certain decrease of the control Lyapunov function above mentioned examples, this could be a system-wide perfor-
is included into Problem 1. Furthermore, the basic stabilizing mance optimization of a chemical plant or a certain cooperative
MPC approaches discussed in this section have been extended task such as formation flight. Finally, the available communi-
in many different ways. For example, output feedback MPC cation topology, i.e., which systems can exchange information
schemes, the stabilization of more general sets and trajectory with each other, is crucial for the selection of a suitable dis-
tracking problems have been studied, as well as MPC schemes tributed MPC scheme. In general, the graph representing this
for different system classes such as hybrid, periodic, or time- communication topology need not be the same as the one result-
delay systems. Also, important issues concerning robustness in ing from the three sources of couplings between the subsystems
the presence of uncertainties and disturbances have been inves- discussed above. However, in many of the available results, it
tigated both in a deterministic and a stochastic framework. All is assumed that each system can (at least) communicate with
these areas are currently still very active fields of research, and every other system to which it is coupled. A distinctive fea-
it is well beyond the scope of this article to discuss all these ture of distributed MPC compared to other distributed control
approaches in detail; a recent survey summarizing some of the methods is that the information, which is exchanged between
existing results (with a particular focus on MPC for uncertain subsystems, typically consists of predicted state and/or input
systems) can be found in [9]. trajectories (compared to, e.g., only the current state), which
allows satisfaction of constraints despite couplings and allows
3. Distributed MPC for improved performance.
When considering large-scale systems, the development of The existing types of coupling between the subsystems as
a single (centralized) model predictive controller, i.e., repeat- well as the available communication infrastructure are crucial
edly solving Problem 1 for the overall system, is in general for designing suitable optimization problems (similar to Prob-
not possible or not desirable. This can be due to several rea- lem 1) for each of the subsystems and for developing suitable
sons. For example, such a central entity having enough compu- algorithms for a distributed solution. In recent years, a large
tational power might not be available. In other situations, the body of literature with hundreds of papers has been developed
communication infrastructure is such that information can only for various different settings including different types of sys-
be shared locally between subsystems, but not with some cen- tem dynamics, couplings, and control objectives and using dif-
tral coordinating unit. Furthermore, in a competitive setting, ferent distributed solution methods, see, e.g., the survey arti-
systems might not want to share all available information with cles [24],[25] and the edited volume [26], which presents 35
everyone due to privacy issues. In such cases, distributed MPC distributed MPC approaches using a unified notation. In the
schemes are of interest. Here, the main challenge is how to de- following, we do not attempt to provide an exhaustive survey
sign suitable optimization problems (similar to Problem 1) and of all available distributed MPC results, but rather give a brief
how to develop suitable algorithms for a distributed solution, overview of how the different approaches can be classified in
such that guarantees for the overall closed-loop system can be terms of the employed solution strategies (see Subsection 3.1).
given. Furthermore, in contrast to the above mentioned existing sur-
In such a distributed setting, coupling/interactions between veys, we put a particular focus on distributed MPC schemes
subsystems can be of different nature. First, physical couplings which have been developed for more general cooperative con-
can exist, i.e., the dynamics of the individual subsystems are trol tasks than setpoint stabilization (see Subsection 3.2).
coupled. This means that the dynamics of the individual sub-
systems depend on other subsystems’ states and/or inputs, i.e., 3.1 Solution Approaches in Distributed MPC
the dynamics of each subsystem i is given by One possibility to classify distributed MPC schemes is ac-
cording to the employed solution strategy, i.e., how the dis-
xi (t + 1) = fi (x(t), u(t)), (7) tributed MPC problem is formulated and solved, and what
the main distinctive feature is regarding the establishment of
where x denotes the state of the overall system x = [x1T . . . xTP ]T closed-loop guarantees. In the following, we discuss four dif-
and P is the number of subsystems, and similarly u denotes the ferent classes, to which most of the existing distributed MPC
input of the overall system. Such couplings appear in many schemes can be allocated. First, we consider iterative schemes,
applications such as, e.g., large chemical plants consisting of where some sort of distributed optimization algorithm is used.
multiple interconnected reactors, in electrical grids, or in cou- After that, in non-iterative schemes, we distinguish between se-
pled mechanical systems. In other settings, the overall system quential approaches, schemes based on robustness considera-
is composed of a team of dynamically independent subsystems tions, and methods using additional consistency constraints. Fi-
whose dynamics only depend on the own system state and in- nally, we discuss various advantages and disadvantages of the
put, i.e., different schemes.
Iterative methods. Many distributed MPC schemes use iter-
xi (t + 1) = fi (xi (t), ui (t)). (8) ative methods. Here, in each time step the optimization prob-
SICE JCMSI, Vol. 10, No. 2, March 2017 43

lem for the overall system, i.e., Problem 1, is solved by some Approaches based on robustness considerations. Another
sort of distributed optimization algorithm. This means that at class of distributed MPC schemes is based on robustness con-
each time t, all subsystems iteratively solve an optimization siderations. Here, the influences of neighboring subsystems are
problem (in parallel) and exchange information multiple times (partially) treated as unknown disturbances, and certain con-
such that the solutions converge to the solution of the central- cepts for the analysis and controller design of uncertain sys-
ized, overall optimization problem. Distributed MPC schemes tems are employed either within the analysis of the resulting
belonging to this category can, e.g., be found in [27]–[29] using closed-loop system, or already in the design of the optimiza-
a Jacobi method or in [30],[31] based on dual decomposition. tion problems in the distributed MPC scheme. For example,
The alternating direction method of multipliers (ADMM) was in [46] the authors show for nonlinear subsystems coupled by
employed in [32], whereas in [33] and [34] the authors use a a common objective that each subsystem is input-to-state sta-
sensitivity-based coordination scheme and a block-coordinate ble (ISS) with respect to the “disturbance” being composed
descend method, respectively. In [35], the authors present of the influences of neighboring subsystems, and by a small
a framework for the distributed synthesis of suitable termi- gain argument that in turn also the overall closed-loop system
nal regions and terminal cost functions, which can then be is asymptotically stable. In [47], a tube-based robust MPC ap-
used for distributed MPC using suitable distributed optimiza- proach is utilized. Each subsystem assumes that trajectories of
tion algorithms. Finally, Lyapunov-based techniques are used neighboring subsystems are contained within a tube around a
in [36],[37]. communicated nominal trajectory, and ensures that its own tra-
Most of the existing iterative distributed MPC schemes are jectory is contained in such a tube. This design can be used
designed for linear systems and the obtained results build on in order to show asymptotic stability of the resulting overall
convexity of the problem (which is in particular needed for closed-loop system. In the distributed MPC scheme presented
convergence of the distributed optimization algorithms); there in [48], subsystems exchange a sequence of sets (called “con-
are few exceptions which also treat nonlinear systems such tracts”), in which predicted trajectories are guaranteed to be
as [28],[36]. Some of the available schemes need the require- contained. For the resulting closed-loop system, ISS with re-
ment that the distributed optimization algorithm converges at spect to the “contract size” can be established. While in the
each time t, which might be impractical since a large number above references, predicted trajectories (and/or tubes contain-
of iterations might be necessary. Other schemes provide fea- ing them) are exchanged between the subsystems, the idea of
sibility and stability already for a finite number of iterations, treating influences of neighboring subsystems as disturbances
some even for the case of only one iteration. Ensuring satis- can also be employed in an even simpler, yet more conserva-
faction of coupling constraints is typically difficult, at least in tive, setting, where no communication between the subsystems
case of a finite number of iterations; a notable exception can be takes place. Such schemes are typically referred to as decen-
found in [31]. tralized MPC schemes, see, e.g., [49],[50], where min-max or
Sequential methods. A different approach to distributed again tube-based MPC techniques, respectively, are employed.
MPC are sequential methods. Here, the distinctive feature is Methods employing consistency constraints. Finally, some
that the subsystems do not solve their optimization problems distributed MPC approaches impose additional constraints on
in parallel but sequentially, i.e., only one subsystem optimizes predicted state and/or input sequences in order to establish de-
while all subsystems keep their predicted trajectories fixed. Us- sired closed-loop properties. One typical form of such con-
ing such a strategy allows to establish feasibility and fulfillment straints is to require predicted trajectories to be close enough to
of coupling constraints in a rather straightforward fashion. A previously communicated ones, see, e.g., [51]–[53]. This en-
first sequential distributed MPC scheme of this type appeared sures that at each time t, the new optimal trajectory computed
in [38], where only couplings due to constraints were consid- by each subsystem i is close enough to what the other subsys-
ered. These ideas were subsequently extended to more general tems assumed for this subsystem, which is why such constraints
settings, including other cooperative control tasks than stabi- are sometimes called “consistency constraints” or “compatibil-
lization and uncertain system dynamics, see, e.g., [39]–[43]. A ity constraints” in the literature. A similar approach was taken
benefit of such sequential schemes is that they easily carry over in [54], where overall closed-loop stability was shown if a cer-
to nonlinear systems and also coupling constraints can be taken tain compatibility condition is satisfied. A different approach
into account in a straightforward fashion. On the other hand, is taken in [55] and [56] for systems only coupled via a com-
such approaches are typically not well scalable if all subsystems mon objective, where a constraint tightening on predicted in-
solve their optimization problem at each time t in a sequential puts and states, respectively, is employed in order to obtain de-
order, or the performance might be compromised if only one (or sired closed-loop guarantees.
few) subsystems are allowed to optimize at each time t, while Discussion. We now briefly compare the above distin-
the other subsystems follow their previously computed trajec- guished classes of distributed MPC schemes. In general, the
tories. Depending on the interconnection structure, this draw- best system-wide performance will be obtained by iterative
back can be overcome since subsystems which are not coupled schemes. As indicated above, for enough iterations the per-
to each other can optimize in parallel without compromising formance will converge to that of a centralized MPC approach;
the theoretical feasibility and stability guarantees. The above this is typically not the case in the other distributed MPC frame-
schemes were developed for settings where no couplings in the works. Hence if both enough communication and computa-
dynamics are present. If this is the case, further negotiation be- tional capacity are available for possibly multiple iterations per
tween the systems [44] or a special system structure [36],[45] time instant, iterative schemes can be well suited. On the other
are necessary in order to establish closed-loop guarantees. hand, they might not be applicable when considering nonlin-
ear systems or if coupling constraints are present. Sequen-
44 SICE JCMSI, Vol. 10, No. 2, March 2017

tial schemes have the advantage that possibly less communi- properties of the system trajectories resulting from the rather
cation (typically only once per time instant) is needed, and also simple dynamics. Reaching consensus via distributed MPC is
coupling constraints as well as nonlinear system dynamics can also considered in [59] for single integrators, for double inte-
be taken into account in a fairly straightforward fashion. On grators [60], for scalar linear systems [61], and for general lin-
the other hand, couplings in the dynamics might be difficult ear systems [62]. Here, the closed-loop analysis is based on the
to consider, and there is also a potential scalability problem explicit solution to the respective optimization problems, which
as discussed above. Approaches based on robustness consid- is characterized for the case that no constraints are present. A
eration also need less communication than iterative schemes, similar approach is taken in [63], where consensus for double-
and compared to sequential schemes, they might be better scal- integrators is shown in the presence of input constraints which
able (depending on the system structure) and also couplings are active only a finite number of times, and in [64], where
in the system dynamics can be considered. However, such flocking of double-integrators is considered. In [65], for gen-
schemes can be quite conservative and hence might only work eral linear systems, the authors calculate an optimal consensus
if the coupling strength is rather weak. Similar considerations point at each time step by iteratively solving a centralized op-
also hold for methods based on additional (consistency) con- timization problem, where this point is used as setpoint in the
straints. Namely, while they potentially share similar advan- MPC formulation. A theoretical analysis of this scheme was
tages as robustness-based approaches compared to iterative and done in [66], where convergence to a common consensus point
sequential schemes, the degrees of freedom within the opti- corresponding to an equilibrium of the system is established,
mization might be quite small, depending on the exact formu- both for the case where the negotiations about the optimal con-
lation of the consistency constraints, resulting in a quite con- sensus point have converged in each time step, as well as when
servative solution with diminished performance. In summary, this negotiation is terminated prior to convergence. In [67], a
each of the different classes of distributed MPC schemes has its consensus problem is solved for linear systems using standard
own advantages and disadvantages, and the choice of a suitable methods, and then the resulting solution is used as a reference
distributed MPC algorithm heavily depends on the properties signal in a tracking MPC framework. Furthermore, in [68] the
of the considered application, i.e., on the considered system authors propose a robust distributed MPC scheme for linear
class, the types of couplings, and the available computational time-varying uncertain systems to achieve practical consensus.
resources and communication infrastructure. The sequential distributed MPC scheme in [40] is designed
for general cooperative control tasks which can be formulated
3.2 Distributed MPC for General Cooperative Control as the stabilization of some (possibly non-compact) set, which
Tasks includes consensus/synchronization as a special case. Conver-
The vast majority of existing distributed MPC schemes, in- gence to the desired set, i.e., fulfillment of the cooperative con-
cluding most of those referenced above, consider the classical trol task, is shown for nonlinear systems including coupling
control objective of stabilizing the overall system at some (a constraints under suitable assumptions on the terminal regions
priori given) setpoint. However, when considering typical co- and terminal cost functions. Furthermore, it is shown how these
operative control problems, often different, more general, con- conditions can be satisfied for the special cooperative control
trol objectives are of interest. This is in particular the case in task of consensus/synchronization. Distributed MPC for vehi-
settings where a team of dynamically independent subsystems cle platooning is considered in [69]. Stability and string sta-
has to pursue a common, cooperative task such as vehicle pla- bility for the resulting closed-loop system is achieved by pe-
tooning or formation flight, corresponding to couplings in con- nalizing deviations from previously communicated trajectories
straints and cost functions. Cooperative control tasks of par- in the cost function. In [70], the authors consider distributed
ticular importance, which have received significant attention MPC for two single-integrator systems with a possibly com-
in recent years, are consensus and synchronization problems, petitive objective, such as different desired distances to each
where the systems have to agree on an a priori unknown state other. Finally, also the framework of economic MPC (compare
(or output) value or trajectory. These type of problems appear in Section 4), where some general performance criterion is con-
many applications such as multi-vehicle platooning and forma- sidered, can be exploited for certain cooperative control prob-
tion stabilization, distributed sensor fusion, the synchronization lems. To this end, recently some first distributed economic
of coupled oscillators and others (see, e.g., [57]). When con- MPC schemes have been proposed in the literature, which will
sidering such general cooperative control objectives, typically be discussed at the end of Section 4.
different methods have to be used for the MPC design and/or
closed-loop analysis compared to the case where a setpoint (or 4. Economic MPC
trajectory) to be stabilized is known a priori. For example, the Economic MPC is a variant of MPC where compared to the
design of suitable terminal cost functions and terminal regions classical stabilizing MPC setting as in Section 2, some more
has to be suitably adapted to such a setting. Furthermore, while general performance criterion is considered. The motivation
some approaches still use the optimal value function as a Lya- (and also the naming) for this more general MPC formulation
punov function for convergence analysis, others rather exploit came from the process industry. There, the classical approach
certain geometric properties of the resulting closed-loop dy- is to apply a two-layer control structure, where at the upper
namics. In the following, we briefly review some distributed layer the so-called real-time optimization (RTO) determines
MPC schemes which were specifically developed for such more economically optimal setpoints or trajectories for the system,
general control objectives than setpoint stabilization. which are then tracked by a controller on the lower level, see,
In [58], consensus for single and double integrators subject e.g., [71]–[74] and the references therein. However, it was
to input constraints is considered, exploiting certain geometric noticed that the performance can possibly be significantly im-
SICE JCMSI, Vol. 10, No. 2, March 2017 45

proved if the economic cost function is directly incorporated cost when operating the system at the optimal steady-state x∗ .
into the lower level MPC controller [73],[75],[76]. On a tech- In order to study optimal steady-state operation of a system, a
nical level, the only difference of economic MPC compared to certain dissipativity condition has turned out to play a crucial
standard stabilizing MPC is that the stage cost function  in role. The concept of dissipativity dates back to Willems [78]
Problem 1 is not chosen to be positive definite with respect (see also [79] for a discrete time version) and is as follows.
to an a priori given setpoint as in Section 2, but can be some
general function (possibly related to the economics of the con- Definition 4 The system (1) is dissipative with respect to the
sidered system). This results in the fact that the closed-loop supply rate s : Rn ×Rm → R if there exists a storage function λ :
system might not converge to some equilibrium setpoint, since Rn → R≥0 such that the following inequality is satisfied for all
other trajectories (e.g., periodic) exist resulting in a better per- (x, u) ∈ Rn × Rm :
formance. Important questions in this context are (i) how to λ( f (x, u)) − λ(x) ≤ s(x, u). (13)
classify the optimal operating behavior, (ii) whether the closed-
loop system “finds” the optimal operating behavior (i.e., con- If there exists ρ ∈ K∞ such that for all (x, u) ∈ Rn × Rm
verges there), and (iii) what statements about closed-loop per-
formance can be made. These issues will be discussed in the λ( f (x, u)) − λ(x) ≤ −ρ(|x − x∗ |) + s(x, u), (14)
following subsections. then system (1) is strictly dissipative.
4.1 Classifying Optimal Operating Behaviors If the dissipation inequality (13) is only satisfied on some
In general, the optimal operating behavior depends on the set W ⊆ Rn × Rm , we say that system (1) is dissipative on W.
given system dynamics f , the stage cost function , and the in- Given the above notation and definitions, it was shown in [75]
put and state constraint sets U and X. The most simple case (see also [80] for a continuous-time version) that if system (1)
is when steady-state operation is optimal, i.e., the optimal op- is dissipative on Z0 with respect to the supply rate s(x, u) =
erating behavior is to stay at the best steady-state. This is the (x, u) − (x∗ , u∗ ), then it is optimally operated at steady-state2 .
best studied case in the literature, which we also first discuss Furthermore, if system (1) is strictly dissipative with respect
in the following. We then mention possible extensions to more to this supply rate, a slightly stronger property than optimal
general cases (such as optimal periodic operation). steady-state operation is satisfied, which was termed (uniform)
Let Z0 denote the largest forward invariant set contained suboptimal operation off steady-state [75],[81]. In the most
in X × U, i.e., the set which contains all elements in X × U general case, the converse result is not true, which was shown
which are part of a feasible state/input sequence pair: by two counterexamples in [82]. However, under suitable con-
 trollability conditions, necessity of dissipativity for optimal
Z0 := (x, u) ∈ X × U : ∃v : I≥0 → U s.t. steady-state operation can indeed be established. Namely, if
(z(0), v(0)) = (x, u), z(t + 1) = f (z(t), v(t)), system (1) is optimally operated at steady-state, it is dissipative
 with respect to the supply rate s(x, u) = (x, u) − (x∗ , u∗ ) on the
(z(t), v(t)) ∈ X × U ∀t ∈ I≥0 , ⊆ X × U. (9) intersection of the M-step controllable and M-step reachable
set, for arbitrary M ∈ I≥1 (cf. [83] for a more precise statement
Furthermore, let S be defined as the set of all feasible
of this result). Furthermore, if system (1) is uniformly subop-
state/input equilibrium pairs of system (1), i.e.,
timally operated off steady-state and locally controllable at x∗ ,
S := {(x, u) : x ∈ X, u ∈ U, x = f (x, u)} ⊆ Z0 , (10) then it is strictly dissipative on Z0 [81]. In summary, dissipa-
tivity with respect to the supply rate s(x, u) = (x, u) − (x∗ , u∗ )
which is assumed to be non-empty. Under some mild technical serves as an (almost) equivalent characterization of the property
conditions (such as, e.g., continuity of f and  and compact- of optimal steady-state operation.
ness of X and U), existence of a (possibly non-unique) optimal The more general case where the system is optimally op-
state/input equilibrium pair (x∗ , u∗ ) is guaranteed, i.e., (x∗ , u∗ ) erated at a periodic orbit can be treated in a similar fashion.
satisfies Namely, one can define optimal operation of system (1) at a P-
periodic orbit Π analogously to Definition 3, but with (x∗ , u∗ )
(x∗ , u∗ ) = inf (x, u). (11) on the right hand side of (12) replaced by the average cost
(x,u)∈S
of the P-periodic orbit Π. Then, a suitable cyclic dissipativ-
Optimal steady-state operation can now been defined as fol- ity condition or a dissipativity condition for a suitably defined
lows [75],[77]. P-step system can be used as a sufficient and necessary con-
dition (the latter again under a suitable controllability assump-
Definition 3 The system (1) is optimally operated at steady- tion) for optimal P-periodic operation [81],[84]–[86]. Further-
state, if for each solution satisfying (x(t), u(t)) ∈ X × U for all more, a (partial) generalization of the above results to the case
t ∈ I≥0 the following holds: of time-varying systems and cost functions is available [87],
T where again a suitable dissipativity condition is used as a suf-
(x(t), u(t))
lim inf t=0
≥ (x∗ , u∗ ). (12) ficient condition to establish optimal operation of the system at
T →∞ T +1
some optimal time-varying trajectory.
The definition of optimal operation at steady-state is such that 2
We remark that in the stabilizing MPC setting of Section 2, i.e.,
no feasible solution to system (1) leads to an average perfor- with positive definite stage cost , strict dissipativity with re-
mance (measured in terms of the stage cost ) which is better spect to the supply rate s(x, u) = (x, u) − (x∗ , u∗ ) trivially fol-
than the optimal steady-state cost (x∗ , u∗ ), which is the average lows with λ ≡ 0.
46 SICE JCMSI, Vol. 10, No. 2, March 2017

4.2 Closed-Loop Convergence horizon N. In [94],[95], it was shown that strict dissipativity
Having established a systems-theoretic characterization of with respect to the supply rate s(x, u) = (x, u) − (x∗ , u∗ ) to-
optimal operating behaviors, we now discuss whether the gether with suitable controllability assumptions implies such a
closed-loop system (5) resulting from application of an eco- turnpike behavior (see also [80] for a continuous-time version);
nomic MPC scheme (Algorithm 1) converges to the optimal op- converse statements were recently studied in [96]. Using this
erating behavior. Again, the exposition follows the basic case turnpike property, (practical) asymptotic stability of the optimal
where steady-state operation is optimal, and we subsequently steady-state x∗ for the closed-loop system (5) is shown in [97],
discuss available extensions to more general cases. using again the optimal value function of a suitably modified
In case that steady-state operation is optimal, it is desirable optimization problem as a (practical) Lyapunov function (see
that the closed-loop system converges to the optimal steady- also [98] for a continuous-time version). Here, the size of the
state x∗ . Again, different economic MPC schemes are available neighborhood into which the closed loop converges depends on
in the literature, in particular again with and without an ad- the prediction horizon N, and goes to zero as N → ∞. Inter-
ditional terminal constraint and/or terminal cost in Problem 1. estingly, a candidate solution ũ(t + 1) for the next time instant
The main difficulty in both approaches is the following: since t +1 is constructed by appending an additional control value not
the stage cost  is in general not positive definite with re- necessarily at the end as described in Subsection 2.1 (and as is
spect to x∗ , the optimal value function JN0 might increase along also the case in economic MPC with terminal constraints), but
closed-loop trajectories and can therefore not be used as a Lya- at some point where the optimal open-loop trajectory predicted
punov function, as was done in Section 2. Convergence to the at time t, x0 (t), is close to x∗ . Existence of such a time point is
optimal steady-state was first established in [88] for linear sys- guaranteed by the turnpike property.
tems and strictly convex cost functions, by using convexity ar- Similar to Subsection 4.1, generalizations of the above re-
guments. A major step forward in the general nonlinear case sults are available to cases where different operating behaviors
was done in [89] under a strong duality condition, which was than steady-state operation are optimal. In case of optimal peri-
later generalized in [75] to a strict dissipativity condition, both odic operation, closed-loop convergence to the optimal periodic
using a terminal equality constraint (i.e., X f = {x∗ }). Namely, orbit was established in [85],[99]–[102] using suitable (peri-
in these references the rotated cost function odic) terminal constraints and in [86] without such additional
constraints exploiting a certain periodic turnpike property. Fur-
L(x, u) := (x, u) − (x∗ , u∗ ) + λ(x) − λ( f (x, u)) (15)
thermore, in the case of time-varying systems and cost func-
is considered. Under the assumption that system (1) is strictly tions, closed-loop convergence to some optimal time-varying
dissipative with respect to the supply rate s(x, u) = (x, u) − optimal trajectory is established in [87] using again a suitable
(x∗ , u∗ ), from (14) it directly follows that the rotated stage time-varying dissipativity condition and suitable time-varying
cost L is positive definite with respect to x∗ . Furthermore, it terminal constraints.
can be shown that when replacing the cost function  in (4)
by the rotated cost L, for this modified optimization problem 4.3 Closed-Loop Performance
one still obtains the same solution as for the original optimiza- As discussed above, the primary objective in economic MPC
tion problem. This is due to the fact that the constraints are is not the stabilization of an a priori given setpoint (or trajec-
the same, and one can show that thanks to the terminal equal- tory), but rather the optimization of some general performance
ity constraint, the cost functions only differ by a constant term. criterion. Hence closed-loop performance guarantees are of
This implies that for the convergence analysis, the modified op- particular interest. The first such result was obtained for a set-
timization problem using the rotated stage cost function L can ting with terminal (equality) constraint [75]. Namely, there it
be used. But since L is positive definite as discussed above, re- was shown that when using the optimal steady-state x∗ as a ter-
sults from standard stabilizing MPC can be used in order to minal equality constraint, the asymptotic average performance
establish closed-loop asymptotic convergence to the optimal of the resulting closed-loop system (5) is better than or equal to
steady-state x∗ . In case that a (nontrivial) terminal region in- the optimal steady-state cost, i.e.,
stead of a terminal equality constraint shall be used, again As- T
(x(t), u MPC (x(t)))
sumption 1 (with −(x, κ f (x)) on the right hand side of iii) re- lim sup t=0 ≤ (x∗ , u∗ ). (16)
T →∞ T +1
placed by −(x, κ f (x)) + (x∗ , u∗ )) has to be satisfied. Again,
since  is in general not positive definite with respect to x∗ , a This result was extended in [90] to a setting using a terminal
different procedure than the one described in Subsection 2.1 region instead of a terminal equality constraint. Furthermore,
has to be used to calculate a suitable terminal region and termi- in [75] it was also shown that when using an arbitrary periodic
nal cost satisfying Assumption 1 as shown in [90] (see also [87] orbit as a periodic terminal constraint, again (16) is satisfied
for a continuous-time version). with (x∗ , u∗ ) on the right hand side replaced by the average
In economic MPC schemes without terminal constraints, the cost along this periodic orbit. The proof of (16) uses the same
main insight employed in order to establish closed-loop con- candidate input sequence ũ(t+1) as defined in Subsection 2.1 to
vergence to x∗ is that the optimal solutions to Problem 1 exhibit show that JN0 (x(t + 1)) ≤ JN0 (x(t)) − (x(t), u MPC (t)) + (x∗ , u∗ ),
a certain turnpike behavior. Here, turnpike behavior [91]–[93] from which under some mild technical assumptions (16) fol-
means that the open-loop optimal trajectories x0 resulting from lows. In case that steady-state operation is optimal (compare
application of optimal solutions u0 to Problem 1 spend most Subsection 4.1), (12) together with (16) implies that the closed-
of the time in a neighborhood E of x∗ , where (an upper bound loop exhibits optimal asymptotic average performance. Simi-
on) the number of time instants outside this neighborhood de- lar results are also available for economic MPC schemes with-
pends on the size of E, but is independent of the prediction out terminal constraints. Namely, for both the cases of opti-
SICE JCMSI, Vol. 10, No. 2, March 2017 47

mal steady-state [94] and optimal periodic operation [86], the the assumption that an optimal solution to Problem 1 can be
same conditions which allow to conclude practical convergence found, which might not be the case in the general nonlinear
to the optimal operating behavior (see Subsection 4.2) also al- (nonconvex) case.
low to conclude that the closed-loop asymptotic average perfor-
mance is approximately optimal (with vanishing error term as 4.5 Further Results
N → ∞). We now briefly discuss some further available results in
While asymptotic average performance results allow for the field of economic MPC. Lyapunov-based economic MPC
statements about the long-term behavior of the closed-loop sys- schemes are, e.g., developed in [104],[106],[107]. Here, con-
tem, they do not allow for statements about transient (finite- straints based on a known control Lyapunov function are added
time) performance. Transient performance estimates were ob- to the repeatedly solved optimization problem to ensure that
tained for the case where steady-state operation is optimal for the system stays within a certain stability region or converges
both settings with [103] and without [97] terminal constraints. there. Economic MPC using a generalized terminal constraint
Namely, there it was shown that among all trajectories which was, e.g., considered in [101],[108]–[111]. Here, the predicted
steer the system into a certain neighborhood of the optimal terminal state is not required to be equal to the optimal steady-
steady-state in a certain number of steps K, the closed-loop (5) state or periodic orbit, but only to some (arbitrary) steady-
yields the best performance over this time interval up to an error state [108]–[110] or periodic orbit [101],[111]. Advantages
term depending on K and N (see [97],[103] for a more precise compared to ”standard“ terminal constraints are that the opti-
statement). This means that the closed-loop also exhibits an mal steady-state/periodic orbit need not be known a priori, and
approximately optimal transient performance. The generaliza- the feasible set can be larger. Closed-loop performance and
tion of this result to the case where steady-state operation is not convergence guarantees can again be established under suit-
optimal is still open. A different finite-time performance esti- able conditions. Generalizations of some of the above results to
mate was obtained in [104]. There, the authors establish that time-varying cost functions, systems, and/or constraints were,
the finite-time performance of a certain shrinking-horizon eco- e.g., developed in [87],[107],[109],[112],[113]. Besides stan-
nomic MPC scheme is at least as good as the one of a certain dard pointwise-in-time constraints (2), also (less restrictive)
stabilizing MPC controller. average constraints can be of interest in economic MPC. In
[75],[114],[115] it was shown how Problem 1 can be modified
4.4 Discussion such that the resulting closed-loop system satisfies these con-
The results of the preceding subsections show that dissipa- straints. The articles [116],[117] consider combined economic
tivity plays a crucial role in the context of economic MPC. and tracking cost functions and establish closed-loop conver-
Namely, certain (strict) dissipativity conditions can both be gence or ultimate boundedness depending on how the economic
used to classify different optimal operating behaviors as well and tracking part are weighted. For the case where steady-state
as to show that the closed loop converges there as desired. operation is optimal, a tracking MPC problem is formulated
In [89],[95], it is shown that a linear system with a strictly con- in [118],[119] which is shown to be (locally) equivalent to eco-
vex stage cost  subject to convex constraints (with nonempty nomic MPC.
interior) is strictly dissipative with respect to the supply rate The above results have been developed for nominal systems,
s(x, u) = (x, u) − (x∗ , u∗ ) (using a linear storage function λ) i.e., without uncertainties or disturbances. As was discussed
and hence optimally operated at steady-state. For general non- in [120], just transferring robust MPC approaches from a sta-
linear systems, computing a suitable storage function λ in or- bilizing to an economic context might not result in an opti-
der to verify the above dissipativity conditions can be a diffi- mal performance, and hence novel approaches have to be de-
cult task, and systematic approaches are only available for cer- veloped. Some robust and stochastic economic MPC schemes
tain special system classes such as, e.g., sum of squares tech- can, e.g., be found in [111],[120]–[126]. Some of these ref-
niques for polynomial systems [105]. On the other hand, ex- erences focus on applications, while others establish theoret-
plicit knowledge of a storage function λ is not necessary for the ical properties such as closed-loop performance and conver-
implementation of economic MPC, and the results of the pre- gence guarantees in the presence of disturbances. Concern-
vious subsections also allow (at least partially) to conclude a ing applications, economic MPC schemes have successfully
desired closed-loop behavior without having to verify the strict been applied in many different fields, and it is well beyond the
dissipation inequality (14). Namely, if the optimal operating scope of this article to mention all of these. Examples include,
behavior for a system is steady-state or periodic operation (in among others, the process industry [106],[127], building cli-
its strict form), then the corresponding strict dissipativity con- mate control [128], the control of wind turbines [129], supply
dition is satisfied (cf. Subsection 4.1), which in turn can be used chain management [130], refrigeration systems [131], power
to conclude that the closed-loop system converges to the opti- systems [132], and the development of sustainable climate poli-
mal steady-state / periodic orbit (cf. Subsection 4.2). Loosely cies [133].
speaking, this means that the closed-loop system ”does the right Finally, concerning distributed economic MPC, there are
thing“, i.e., it ”finds“ the optimal operating behavior. How- only few theoretical results available in the literature. In
ever, in a setting with terminal constraints, these conclusions [134],[135], the approach of [27] was extended to a setting with
are limited to the case where the optimal steady-state / periodic 3
If a ”wrong“ terminal constraint is used (e.g., the optimal
orbit is known a priori, since it has to be used as a terminal steady-state x∗ is used as terminal constraint even though
constraint3 . This is not the case when using an economic MPC steady-state operation is not optimal), closed-loop convergence
scheme without terminal constraints; here, however, the closed- to the optimal operating behavior cannot be guaranteed. Never-
loop convergence results of Subsection 4.2 crucially depend on theless, the asymptotic average performance result (16) holds.
48 SICE JCMSI, Vol. 10, No. 2, March 2017

economic objective function. A distributed economic MPC [8] M.L. Darby and M. Nikolaou: MPC: Current practice and
scheme for output stabilization in a network of competing sys- challenges, Control Engineering Practice, Vol. 20, No. 4,
tems was proposed in [136]. Furthermore, the distributed im- pp. 328–342, 2012.
plementation of a Lyapunov-based economic MPC scheme is [9] D.Q. Mayne: Model predictive control: Recent developments
and future promise, Automatica, Vol. 50, No. 12, pp. 2967–
considered in [137], and a hierarchical structure is proposed
2986, 2014.
in [138], where a centralized economic MPC problem is solved [10] T. Raff, S. Huber, Z.K. Nagy, and F. Allgöwer: Nonlinear
on the upper level on a slow time scale, while a distributed model predictive control of a four tank system: An experi-
controller on the lower level is implemented on a faster time mental stability study, Proceedings of the IEEE Conference
scale to react on disturbances. Finally, in [139],[140] a dis- on Control Applications, pp. 237–242, 2006.
tributed economic MPC scheme is considered for a setting of [11] H. Chen and F. Allgöwer: A quasi-infinite horizon nonlin-
self-interested systems which have to satisfy some cooperative ear model predictive control scheme with guaranteed stability,
Automatica, Vol. 34, No. 10, pp. 1205–1217, 1998.
task, where the overall optimal steady-state is not known a pri-
[12] F.A.C.C. Fontes: A general framework to design stabiliz-
ori, but negotiated online while the systems already take control ing nonlinear model predictive controllers, Systems & Control
actions. Letters, Vol. 42, No. 2, pp. 127–143, 2001.
[13] W.H. Chen, J. O’Reilly, and D.J. Ballance: On the termi-
5. Conclusions nal region of model predictive control for non-linear systems
This paper is intended to give an overview of recent devel- with input/state constraints, International Journal of Adaptive
opments in the field of model predictive control. A particular Control and Signal Processing, Vol. 17, No. 3, pp. 195–207,
focus was set on the areas of distributed and economic MPC, 2003.
[14] S. Yu, H. Chen, C. Böhm, and F. Allgöwer: Enlarging the
where typically more general control objectives than setpoint
terminal region of NMPC with parameter-dependent terminal
stabilization are of interest. In conclusion, both areas have seen control law, Nonlinear Model Predictive Control - Towards
significant progress within the last years and various important New Challenging Applications, ser. Lecture Notes in Control
results have been obtained regarding the design and the anal- and Information Sciences, L. Magni, D.M. Raimondo, and F.
ysis of suitable MPC schemes for such settings. Furthermore, Allgöwer, Eds., pp. 69–78, Springer, 2009.
an ever-growing number of successful implementations of both [15] J.A. Primbs and V. Nevistić: Feasibility and stability of con-
distributed and economic MPC schemes in a multitude of dif- strained finite receding horizon control, Automatica, Vol. 36,
No. 7, pp. 965–971, 2000.
ferent application areas has been reported in the literature.
[16] A. Jadbabaie and J. Hauser: On the stability of receding hori-
Both fields of distributed and economic MPC are currently zon control with a general terminal cost, IEEE Transactions
still very active fields of research, and many interesting issues on Automatic Control, Vol. 50, No. 5, pp. 674–678, 2005.
deserve further attention in the future. For example, further re- [17] G. Grimm, M.J. Messina, S.E. Tuna, and A.R. Teel: Model
search is needed in both distributed and economic MPC in the predictive control: For want of a local control lyapunov func-
context of uncertain systems or in a time-varying and/or adap- tion, all is not lost, IEEE Transactions on Automatic Control,
tive setting. Also, the presented results at the intersection of Vol. 50, No. 5, pp. 546–558, 2005.
distributed and economic MPC only constitute a first step on [18] S.E. Tuna, M.J. Messina, and A.R. Teel: Shorter horizons for
model predictive control, Proceedings of the American Con-
the way towards a general cooperative control and coordination
trol Conference, pp. 863–868, June 2006.
framework for multi-agent systems, especially in a dynamic [19] L. Grüne and A. Rantzer: On the infinite horizon performance
setting where the optimal operating behavior of the overall sys- of receding horizon controllers, IEEE Transactions on Auto-
tem is unknown a priori and may also change online, e.g., due matic Control, Vol. 53, No. 9, pp. 2100–2111, 2008.
to alterations in the number or interconnection structure of the [20] L. Grüne: Analysis and design of unconstrained nonlinear
single subsystems. Finally, a further development of efficient MPC schemes for finite and infinite dimensional systems,
algorithms for real-time implementation of both distributed and SIAM Journal on Control and Optimization, Vol. 48, No. 2,
pp. 1206–1228, 2009.
economic MPC schemes in challenging applications is needed.
[21] M. Reble and F. Allgöwer: Unconstrained model predictive
References control and suboptimality estimates for nonlinear continuous-
time systems, Automatica, Vol. 48, No. 8, pp. 1812–1817,
[1] J.M. Maciejowski: Predictive control with constraints, Pear-
2012.
son Education, 2002.
[22] A. Boccia, L. Grüne, and K. Worthmann: Stability and fea-
[2] D.Q. Mayne, J.B. Rawlings, C.V. Rao, and P.O.M. Scokaert:
sibility of state constrained MPC without stabilizing terminal
Constrained model predictive control: Stability and optimal-
constraints, Systems & Control Letters, Vol. 72, pp. 14–21,
ity, Automatica, Vol. 36, No. 6, pp. 789–814, 2000.
2014.
[3] R. Findeisen, L. Imsland, F. Allgöwer, and B.A. Foss: State
[23] P. Mhaskar, N.H. El-Farra, and P.D. Christofides: Stabiliza-
and output feedback nonlinear model predictive control: An
tion of nonlinear systems with state and control constraints
overview, European Journal of Control, Vol. 9, No. 2-3,
using Lyapunov-based predictive control, Systems & Control
pp. 190–206, 2003.
Letters, Vol. 55, No. 8, pp. 650–659, 2006.
[4] J.B. Rawlings and D.Q. Mayne: Model Predictive Control:
[24] R. Scattolini: Architectures for distributed and hierarchical
Theory and Design, Madison, WI: Nob Hill Publishing, 2009.
model predictive control - a review, Journal of Process Con-
[5] L. Grüne and J. Pannek: Nonlinear Model Predictive Control.
trol, Vol. 19, No. 5, pp. 723–731, 2009.
Theory and Algorithms, London: Springer, 2011.
[25] P.D. Christofides, R. Scattolini, D. Muñoz de la Peña, and J.
[6] E.F. Camacho and C. Bordons: Model Predictive Control,
Liu: Distributed model predictive control: A tutorial review
London: Springer, 2004.
and future research directions, Computers & Chemical Engi-
[7] S.J. Qin and T.A. Badgwell: A survey of industrial model
neering, Vol. 51, pp. 21–41, 2013.
predictive control technology, Control Engineering Practice,
[26] J.M. Maestre and R.R. Negenborn, Eds.: Distributed Model
Vol. 11, No. 7, pp. 733–764, 2003.
SICE JCMSI, Vol. 10, No. 2, March 2017 49

Predictive Control Made Easy, Springer, 2014. trol Conference, pp. 2795–2800, 2013.
[27] B.T. Stewart, A.N. Venkat, J.B. Rawlings, S.J. Wright, and [44] J.M. Maestre, D. Muñoz de la Peña, E.F. Camacho, and
G. Pannocchia: Cooperative distributed model predictive con- T. Alamo: Distributed model predictive control based on
trol, Systems & Control Letters, Vol. 59, No. 8, pp. 460–469, agent negotiation, Journal of Process Control, Vol. 21, No. 5,
2010. pp. 685–697, 2011.
[28] B.T. Stewart, S.J. Wright, and J.B. Rawlings: Cooperative dis- [45] P. Varutti, B. Kern, and R. Findeisen: Dissipativity-based dis-
tributed model predictive control for nonlinear systems, Jour- tributed nonlinear predictive control for cascaded systems,
nal of Process Control, Vol. 21, No. 5, pp. 698–704, 2011. Proceedings of the 8th IFAC Symposium on Advanced Con-
[29] D. Groß and O. Stursberg: On the convergence rate of a trol of Chemical Processes, pp. 439–444, 2012.
Jacobi algorithm for cooperative distributed MPC, Proceed- [46] E. Franco, L. Magni, T. Parisini, M.M. Polycarpou, and
ings of the 52nd IEEE Conference on Decision and Control, D.M. Raimondo: Cooperative constrained control of dis-
pp. 1508–1513, 2013. tributed agents with nonlinear dynamics and delayed infor-
[30] P. Giselsson and A. Rantzer: On feasibility, stability and per- mation exchange: A stabilizing receding-horizon approach,
formance in distributed model predictive control, IEEE Trans- IEEE Transactions on Automatic Control, Vol. 53, No. 1,
actions on Automatic Control, Vol. 59, No. 4, pp. 1031–1036, pp. 324–338, 2008.
2014. [47] M. Farina and R. Scattolini: Distributed predictive control:
[31] M.D. Doan, T. Keviczky, and B. De Schutter: A dual A non-cooperative algorithm with neighbor-to-neighbor com-
decomposition-based optimization method with guaranteed munication for linear systems, Automatica, Vol. 48, No. 6,
primal feasibility for hierarchical MPC problems, Proceed- pp. 1088–1096, 2012.
ings of the 18th IFAC World Congress, pp. 392–397, 2011. [48] S. Lucia, M. Kögel, and R. Findeisen: Contract-based predic-
[32] M. Kögel and R. Findeisen: Cooperative distributed MPC us- tive control of distributed systems with plug and play capabil-
ing the alternating direction multiplier method, Proceedings ities, Proceedings of the 5th IFAC Conference on Nonlinear
of the 8th IFAC Symposium on Advanced Control of Chemical Model Predictive Control, pp. 205–211, 2015.
Processes, pp. 445–450, 2012. [49] D.M. Raimondo, L. Magni, and R. Scattolini: Decentralized
[33] H. Scheu and W. Marquardt: Sensitivity-based coordination MPC of nonlinear systems: An input-to-state stability ap-
in distributed model predictive control, Journal of Process proach, International Journal of Robust and Nonlinear Con-
Control, Vol. 21, No. 5, pp. 715–728, 2011. trol, Vol. 17, No. 17, pp. 1651–1667, 2007.
[34] I. Necoara: Suboptimal distributed MPC based on a block- [50] S. Riverso, M. Farina, and G. Ferrari-Trecate: Plug-and-
coordinate descent method with feasibility and stability guar- play decentralized model predictive control for linear systems,
antees, Proceedings of the 51st IEEE Conference on Decision IEEE Transactions on Automatic Control, Vol. 58, No. 10,
and Control, pp. 4480–4485, 2012. pp. 2608–2614, 2013.
[35] C. Conte, C.N. Jones, M. Morari, and M.N. Zeilinger: Dis- [51] W.B. Dunbar and R.M. Murray: Distributed receding horizon
tributed synthesis and stability of cooperative distributed control for multi-vehicle formation stabilization, Automatica,
model predictive control for linear systems, Automatica, Vol. 42, No. 4, pp. 549–558, 2006.
Vol. 69, pp. 117–125, 2016. [52] W.B. Dunbar: Distributed receding horizon control of dynam-
[36] J. Liu, X. Chen, D. Muñoz de la Peña, and P.D. Christofides: ically coupled nonlinear systems, IEEE Transactions on Au-
Sequential and iterative architectures for distributed model tomatic Control, Vol. 52, No. 7, pp. 1249–1263, 2007.
predictive control of nonlinear process systems, AIChE Jour- [53] M. Zhao and B. Ding: Distributed model predictive control
nal, Vol. 56, No. 8, pp. 2137–2149, 2010. for constrained nonlinear systems with decoupled local dy-
[37] J. Liu, X. Chen, D. Muñoz de la Peña, and P.D. Christofides: namics, ISA Transactions, Vol. 55, pp. 1–12, 2015.
Iterative distributed model predictive control of nonlinear sys- [54] T. Keviczky, F. Borrelli, and G.J. Balas: Decentralized reced-
tems: Handling asynchronous, delayed measurements, IEEE ing horizon control for large scale dynamically decoupled sys-
Transactions on Automatic Control, Vol. 57, No. 2, pp. 528– tems, Automatica, Vol. 42, No. 12, pp. 2105–2115, 2006.
534, 2012. [55] C. Wang and C.-J. Ong: Distributed model predictive control
[38] A. Richards and J.P. How: Robust distributed model predic- of dynamically decoupled systems with coupled cost, Auto-
tive control, International Journal of Control, Vol. 80, No. 9, matica, Vol. 46, No. 12, pp. 2053–2058, 2010.
pp. 1517–1531, 2007. [56] H. Li and Y. Shi: Robust distributed model predictive control
[39] L. Grüne and K. Worthmann: A distributed NMPC scheme of constrained continuous-time nonlinear systems: A robust-
without stabilizing terminal constraints, Distributed Decision ness constraint approach, IEEE Transactions on Automatic
Making and Control, ser. Lecture Notes in Control and Infor- Control, Vol. 59, No. 6, pp. 1673–1678, 2014.
mation Sciences, R. Johansson and A. Rantzer, Eds., Vol. 417, [57] R. Olfati-Saber, J.A. Fax, and R.M. Murray: Consensus and
pp. 261–287, Springer, 2012. cooperation in networked multi-agent systems, Proceedings
[40] M.A. Müller, M. Reble, and F. Allgöwer: Cooperative con- of the IEEE, Vol. 95, No. 1, pp. 215–233, 2007.
trol of dynamically decoupled systems via distributed model [58] G. Ferrari-Trecate, L. Galbusera, M.P.E. Marciandi, and R.
predictive control, International Journal of Robust and Non- Scattolini: Model predictive control schemes for consensus
linear Control, Vol. 22, No. 12, pp. 1376–1397, 2012. in multi-agent systems with single- and double-integrator dy-
[41] P. Trodden and A. Richards: Distributed model predictive namics, IEEE Transactions on Automatic Control, Vol. 54,
control of linear systems with persistent disturbances, Inter- No. 11, pp. 2560–2572, 2009.
national Journal of Control, Vol. 83, No. 8, pp. 1653–1663, [59] J. Zhan and X. Li: Consensus of sampled-data multi-agent
2010. networking systems via model predictive control, Automatica,
[42] M.A. Müller, B. Schürmann, and F. Allgöwer: Robust co- Vol. 49, No. 8, pp. 2502–2507, 2013.
operative control of dynamically decoupled systems via dis- [60] L. Zhou and S. Li: Distributed model predictive control for
tributed MPC, Proceedings of the 4th IFAC Nonlinear Model consensus of sampled-data multi-agent systems with double-
Predictive Control Conference, pp. 412–417, 2012. integrator dynamics, IET Control Theory Applications, Vol. 9,
[43] M. Bürger, G. Notarstefano, and F. Allgöwer: From non- No. 12, pp. 1774–1780, 2015.
cooperative to cooperative distributed MPC: A simplicial ap- [61] H. Li, Y. Shi, and W. Yan: On neighbor information utilization
proximation perspective, Proceedings of the European Con- in distributed receding horizon control for consensus-seeking,
50 SICE JCMSI, Vol. 10, No. 2, March 2017

IEEE Transactions on Cybernetics, Vol. 46, No. 9, pp. 2019– theory, Archive for Rational Mechanics and Analysis, Vol. 45,
2027, 2016. No. 5, pp. 321–351, 1972.
[62] H. Li and W. Yan: Receding horizon control based consen- [79] C.I. Byrnes and W. Lin: Losslessness, feedback equiva-
sus scheme in general linear multi-agent systems, Automatica, lence, and the global stabilization of discrete-time nonlinear
Vol. 56, pp. 12–18, 2015. systems, IEEE Transactions on Automatic Control, Vol. 39,
[63] Z. Cheng, H.T. Zhang, M.C. Fan, and G. Chen: Distributed No. 1, pp. 83–98, 1994.
consensus of multi-agent systems with input constraints: A [80] T. Faulwasser, M. Korda, C.N. Jones, and D. Bonvin: Turn-
model predictive control approach, IEEE Transactions on Cir- pike and dissipativity properties in dynamic real-time opti-
cuits and Systems I: Regular Papers, Vol. 62, No. 3, pp. 825– mization and economic MPC, Proceedings of the 53rd IEEE
834, 2015. Conference on Decision and Control, pp. 2734–2739, 2014.
[64] L. Zhou and S. Li: Distributed model predictive control [81] M.A. Müller, L. Grüne, and F. Allgöwer: On the role of dis-
for multi-agent flocking via neighbor screening optimiza- sipativity in economic model predictive control, Proceedings
tion, International Journal of Robust and Nonlinear Control, of the 5th IFAC Conference on Nonlinear Model Predictive
RNC3606, 2016. Control, pp. 110–116, 2015.
[65] B.J. Johansson, A. Speranzon, M. Johansson, and K.H. [82] M.A. Müller, D. Angeli, and F. Allgöwer: On convergence of
Johansson: Distributed model predictive consensus, Proceed- averagely constrained economic MPC and necessity of dissi-
ings of the 17th International Symposium on Mathematical pativity for optimal steady-state operation, Proceedings of the
Theory of Networks and Systems, pp. 2438–2444, 2006. American Control Conference, pp. 3147–3152, 2013.
[66] T. Keviczky and K.H. Johansson: A study on distributed [83] M.A. Müller, D. Angeli, and F. Allgöwer: On necessity and
model predictive consensus, Proceedings of the 17th IFAC robustness of dissipativity in economic model predictive con-
World Congress, pp. 1516–1521, 2008. trol, IEEE Transactions on Automatic Control, Vol. 60, No. 6,
[67] J. Lee, J.-S. Kim, H. Song, and H. Shim: A constrained con- pp. 1671–1676, 2015.
sensus problem using MPC, International Journal of Control, [84] L. Grüne and M. Zanon: Periodic optimal control, dissipa-
Automation and Systems, Vol. 9, No. 5, pp. 952–957, 2011. tivity and MPC, Proceedings of the 21st International Sym-
[68] A. Gautam, Y.-C. Chu, and Y.C. Soh: Robust H∞ receding posium on Mathematical Theory of Networks and Systems,
horizon control for a class of coordinated control problems pp. 1804–1807, 2014.
involving dynamically decoupled subsystems, IEEE Transac- [85] M. Zanon, L. Grüne, and M. Diehl: Periodic optimal control,
tions on Automatic Control, Vol. 59, No. 1, pp. 134–149, Jan. dissipativity and MPC, IEEE Transactions on Automatic Con-
2014. trol, 2017, to appear.
[69] W.B. Dunbar and D.S. Caveney: Distributed receding horizon [86] M.A. Müller and L. Grüne: Economic model predictive con-
control of vehicle platoons: Stability and string stability, IEEE trol without terminal constraints for optimal periodic behav-
Transactions on Automatic Control, Vol. 57, No. 3, pp. 620– ior, Automatica, Vol. 70, pp. 128–139, 2016.
633, 2012. [87] A. Alessandretti, A.P. Aguiar, and C.N. Jones: On conver-
[70] A. Carron and E. Franco: Receding horizon control of a two- gence and performance certification of a continuous-time eco-
agent system with competitive objectives, Proceedings of the nomic model predictive control scheme with time-varying
American Control Conference, pp. 2533–2538, 2013. performance index, Automatica, Vol. 68, pp. 305–313, 2016.
[71] T. Backx, O. Bosgra, and W. Marquardt: Integration of model [88] J.B. Rawlings, D. Bonné, J.B. Jørgensen, A.N. Venkat, and
predictive control and optimization of processes, Proceedings S.B. Jørgensen: Unreachable setpoints in model predictive
of the IFAC Symposium on Advanced Control of Chemical control, IEEE Transactions on Automatic Control, Vol. 53,
Processes, pp. 249–260, 2000. No. 9, pp. 2209–2215, 2008.
[72] S. Engell: Feedback control for optimal process operation, [89] M. Diehl, R. Amrit, and J.B. Rawlings: A Lyapunov func-
Journal of Process Control, Vol. 17, No. 3, pp. 203–219, tion for economic optimizing model predictive control, IEEE
2007. Transactions on Automatic Control, Vol. 56, No. 3, pp. 703–
[73] J.B. Rawlings and R. Amrit: Optimizing process economic 707, 2011.
performance using model predictive control, Nonlinear Model [90] R. Amrit, J.B. Rawlings, and D. Angeli: Economic optimiza-
Predictive Control - Towards New Challenging Applications, tion using model predictive control with a terminal cost, An-
ser. Lecture Notes in Control and Information Sciences, L. nual Reviews in Control, Vol. 35, No. 2, pp. 178–186, 2011.
Magni, D.M. Raimondo, and F. Allgöwer, Eds., pp. 119–138, [91] R. Dorfman, P.A. Samuelson, and R.M. Solow: Linear Pro-
Springer, 2009. gramming and Economic Analysis, New York: Dover Publi-
[74] J.V. Kadam and W. Marquardt: Integration of economical op- cations, 1987 reprint of the 1958 original.
timization and control for intentionally transient process oper- [92] A.J. Zaslavski: Turnpike Properties in the Calculus of Varia-
ation, Assessment and Future Directions of Nonlinear Model tions and Optimal Control, New York: Springer, 2006.
Predictive Control, ser. Lecture Notes in Control and Infor- [93] E. Trélat and E. Zuazua: The turnpike property in finite-
mation Sciences, R. Findeisen, F. Allgöwer, and L.T. Biegler, dimensional nonlinear optimal control, Journal of Differential
Eds., pp. 419–434, Springer, 2007. Equations, Vol. 258, No. 1, pp. 81–114, 2015.
[75] D. Angeli, R. Amrit, and J.B. Rawlings: On average per- [94] L. Grüne: Economic receding horizon control without ter-
formance and stability of economic model predictive con- minal constraints, Automatica, Vol. 49, No. 3, pp. 725–734,
trol, IEEE Transactions on Automatic Control, Vol. 57, No. 7, 2013.
pp. 1615–1626, 2012. [95] T. Damm, L. Grüne, M. Stieler, and K. Worthmann: An expo-
[76] M. Ellis, H. Durand, and P.D. Christofides: A tutorial review nential turnpike theorem for dissipative discrete time optimal
of economic model predictive control methods, Journal of control problems, SIAM Journal on Control and Optimization,
Process Control, Vol. 24, No. 8, pp. 1156–1178, 2014. Vol. 52, No. 3, pp. 1935–1957, 2014.
[77] D. Angeli and J.B. Rawlings: Receding horizon cost op- [96] L. Grüne and M.A. Müller: On the relation between strict dis-
timization and control for nonlinear plants, Proceedings of sipativity and turnpike properties, System & Control Letters,
the 8th IFAC Symposium on Nonlinear Control Systems, Vol. 90, pp. 45–53, 2016.
pp. 1217–1223, 2010. [97] L. Grüne and M. Stieler: Asymptotic stability and transient
[78] J.C. Willems: Dissipative dynamical systems - part i: General optimality of economic MPC without terminal constraints,
SICE JCMSI, Vol. 10, No. 2, March 2017 51

Journal of Process Control, Vol. 24, No. 8, pp. 1187–1196, Vol. 50, No. 11, pp. 2943–2950, 2014.
2014. [116] A. Alessandretti, A.P. Aguiar, and C.N. Jones: A model pre-
[98] T. Faulwasser and D. Bonvin: On the design of economic dictive control scheme with ultimate bound for economic op-
NMPC based on approximate turnpike properties, Proceed- timization, Proceedings of the American Control Conference,
ings of the 54th IEEE Conference on Decision and Control, pp. 1653–1658, July 2015.
pp. 4964–4970, 2015. [117] J.P. Maree and L. Imsland: Combined economic and regu-
[99] R. Huang, E. Harinath, and L.T. Biegler: Lyapunov stability latory predictive control, Automatica, Vol. 69, pp. 342–347,
of economically oriented NMPC for cyclic processes, Journal 2016.
of Process Control, Vol. 21, No. 4, pp. 501–509, 2011. [118] M. Zanon, S. Gros, and M. Diehl: Indefinite linear MPC and
[100] M. Zanon, S. Gros, and M. Diehl: A Lyapunov function for approximated economic MPC for nonlinear systems, Journal
periodic economic optimizing model predictive control, Pro- of Process Control, Vol. 24, No. 8, pp. 1273–1281, 2014.
ceedings of the 52nd IEEE Conference on Decision and Con- [119] M. Zanon, S. Gros, and M. Diehl: A tracking MPC formu-
trol, pp. 5107–5112, 2013. lation that is locally equivalent to economic MPC, Journal of
[101] D. Limon, M. Pereira, D. Muñoz de la Peña, T. Alamo, and Process Control, Vol. 45, pp. 30–42, 2016.
J.M. Grosso: Single-layer economic model predictive control [120] F.A. Bayer, M.A. Müller, and F. Allgöwer: Tube-based ro-
for periodic operation, Journal of Process Control, Vol. 24, bust economic model predictive control, Journal of Process
No. 8, pp. 1207–1224, 2014. Control, Vol. 24, No. 8, pp. 1237–1246, 2014.
[102] B. Houska: Enforcing asymptotic orbital stability of eco- [121] F.A. Bayer, M. Lorenzen, M.A. Müller, and F. Allgöwer: Ro-
nomic model predictive control, Automatica, Vol. 57, pp. 45– bust economic model predictive control using stochastic in-
50, 2015. formation, Automatica, Vol. 74, pp. 151–161, 2016.
[103] L. Grüne and A. Panin: On non-averaged performance of eco- [122] T.G. Hovgaard, L.F.S. Larsen, and J.B. Jørgensen: Robust
nomic MPC with terminal conditions, Proceedings of the 54th economic MPC for a power management scenario with un-
IEEE Conference on Decision and Control, pp. 4332–4337, certainties, Proceedings of the 50th IEEE Conference on
Dec. 2015. Decision and Control and European Control Conference,
[104] M. Ellis and P.D. Christofides: On finite-time and infinite- pp. 1515–1520, 2011.
time cost improvement of economic model predictive control [123] R. Huang, L.T. Biegler, and E. Harinath: Robust stability
for nonlinear systems, Automatica, Vol. 50, No. 10, pp. 2561– of economically oriented infinite horizon NMPC that include
2569, 2014. cyclic processes, Journal of Process Control, Vol. 22, No. 1,
[105] C. Ebenbauer and F. Allgöwer: Analysis and design of poly- pp. 51–59, 2012.
nomial control systems using dissipation inequalities and sum [124] L.E. Sokoler, B. Dammann, H. Madsen, and J.B. Jørgensen:
of squares, Computers & Chemical Engineering, Vol. 30, A mean-variance criterion for economic model predictive
No. 10-12, pp. 1590–1602, 2006. control of stochastic linear systems, Proceedings of the 53rd
[106] M. Heidarinejad, J. Liu, and P.D. Christofides: Economic Conference on Decision and Control, pp. 5907–5914, 2014.
model predictive control of nonlinear process systems us- [125] S. Lucia, J.A.E. Andersson, H. Brandt, M. Diehl, and S.
ing Lyapunov techniques, AIChE Journal, Vol. 58, No. 3, Engell: Handling uncertainty in economic nonlinear model
pp. 855–870, 2012. predictive control: A comparative case study, Journal of Pro-
[107] M. Ellis and P.D. Christofides: Economic model predictive cess Control, Vol. 24, No. 8, pp. 1247–1259, 2014.
control with time-varying objective function for nonlinear [126] A. Marquez, J. Patiño, and J. Espinosa: Min-max economic
process systems, AIChE Journal, Vol. 60, No. 2, pp. 507–519, model predictive control, Proceedings of the 53rd IEEE Con-
2014. ference on Decision and Control, pp. 4410–4415, Dec. 2014.
[108] L. Fagiano and A.R. Teel: Generalized terminal state con- [127] R. Amrit, J.B. Rawlings, and L.T. Biegler: Optimizing pro-
straint for model predictive control, Automatica, Vol. 49, cess economics online using model predictive control, Com-
No. 9, pp. 2622–2631, 2013. puters & Chemical Engineering, Vol. 58, pp. 334–343, 2013.
[109] A. Ferramosca, D. Limon, and E.F. Camacho: Economic [128] D.I. Mendoza-Serrano and D.J. Chmielewski: Smart grid co-
MPC for a changing economic criterion for linear systems, ordination in building HVAC systems: EMPC and the impact
IEEE Transactions on Automatic Control, Vol. 59, No. 10, of forecasting, Journal of Process Control, Vol. 24, No. 8,
pp. 2657–2667, 2014. pp. 1301–1310, 2014.
[110] M.A. Müller, D. Angeli, and F. Allgöwer: Economic model [129] S. Gros: An economic NMPC formulation for wind turbine
predictive control with self-tuning terminal cost, European control, Proceedings of the 52nd IEEE Conference on Deci-
Journal of Control, Vol. 19, No. 5, pp. 408–416, 2013. sion and Control, pp. 1001–1006, 2013.
[111] T.J. Broomhead, C. Manzie, R.C. Shekhar, and P. Hield: Ro- [130] K. Subramanian, J.B. Rawlings, and C.T. Maravelias: Eco-
bust periodic economic MPC for linear systems, Automatica, nomic model predictive control for inventory management in
Vol. 60, pp. 30–37, 2015. supply chains, Computers & Chemical Engineering, Vol. 64,
[112] D. Angeli, A. Casavola, and F. Tedesco: On average per- pp. 71–80, 2014.
formance of economic model predictive control with time- [131] T.G. Hovgaard, L.F.S. Larsen, K. Edlund, and J.B. Jørgensen:
varying cost and terminal constraints, Proceedings of the Model predictive control technologies for efficient and flex-
American Control Conference, pp. 2974–2979, July 2015. ible power consumption in refrigeration systems, Energy,
[113] D. Angeli, A. Casavola, and F. Tedesco: Economic model Vol. 44, No. 1, pp. 105–116, 2012.
predictive control with parameter-varying cost and guaranteed [132] L.E. Sokoler, K. Edlund, and J.B. Jørgensen: Application of
average performance, Proceedings of the 54th IEEE Confer- economic MPC to frequency control in a single-area power
ence on Decision and Control, pp. 4314–4319, 2015. system, Proceedings of the 54th IEEE Conference on Deci-
[114] M.A. Müller, D. Angeli, F. Allgöwer, R. Amrit, and J.B. sion and Control, pp. 2635–2642. 2015.
Rawlings: Convergence in economic model predictive con- [133] B. Chu, S. Duncan, A. Papachristodoulou, and C. Hepburn:
trol with average constraints, Automatica, Vol. 50, No. 12, Using economic model predictive control to design sustain-
pp. 3100–3111, 2014. able policies for mitigating climate change, Proceedings of
[115] M.A. Müller, D. Angeli, and F. Allgöwer: Transient average the 51st IEEE Conference on Decision and Control, pp. 406–
constraints in economic model predictive control, Automatica, 411, 2012.
52 SICE JCMSI, Vol. 10, No. 2, March 2017

[134] J. Lee and D. Angeli: Cooperative distributed model pre-


dictive control for linear plants subject to convex economic
objectives, Proceedings of the 50th IEEE Conference on
Decision and Control and European Control Conference,
pp. 3434–3439, 2011.
[135] J. Lee and D. Angeli: Distributed cooperative nonlinear eco-
nomic MPC, Proceedings of the 20th International Sympo-
sium on Mathematical Theory of Networks and Systems, 2012.
[136] P.A.A. Driessen, R.M. Hermans, and P.P.J. van den Bosch:
Distributed economic model predictive control of networks in
competitive environments, Proceedings of the 51st IEEE Con-
ference on Decision and Control, pp. 266–271, 2012.
[137] X. Chen, M. Heidarinejad, J. Liu, and P.D. Christofides: Dis-
tributed economic MPC: Application to a nonlinear chemical
process network, Journal of Process Control, Vol. 22, No. 4,
pp. 689–699, 2012.
[138] I.J. Wolf, H. Scheu, and W. Marquardt: A hierarchical dis-
tributed economic NMPC architecture based on neighboring-
extremal updates, Proceedings of the American Control Con-
ference, pp. 4155–4160, 2012.
[139] M.A. Müller and F. Allgöwer: Distributed economic MPC: A
framework for cooperative control problems, Proceedings of
the 19th IFAC World Congress, pp. 1029–1034, 2014.
[140] P.N. Köhler, M.A. Müller, and F. Allgöwer: A distributed
economic MPC scheme for coordination of self-interested
systems, Proceedings of the American Control Conference,
pp. 889–894, 2016.

Matthias A. MÜLLER
He received a Diploma degree in Engineering Cyber-
netics from the University of Stuttgart, Germany, and an
M.S. in Electrical and Computer Engineering from the
University of Illinois at Urbana-Champaign, US, both in
2009. In 2014, he obtained a Ph.D. in Mechanical Engi-
neering, also from the University of Stuttgart, Germany,
for which he received the 2015 European Ph.D. award
on control for complex and heterogeneous systems. He is currently work-
ing as a lecturer and postdoctoral researcher (Akademischer Rat) at the
Institute for Systems Theory and Automatic Control at the University of
Stuttgart. In 2012, he was a visiting researcher at the Imperial College,
London, UK. He is a member of the Eliteprogram for PostDocs of the
Baden-Württemberg Foundation and was a semi-plenary speaker at the 5th
IFAC Conference on Nonlinear Model Predictive Control 2015. His re-
search interests include nonlinear control and estimation, model predictive
control, distributed control and switched systems.

Frank ALLGÖWER
He studied Engineering Cybernetics and Applied
Mathematics in Stuttgart and at the University of Cali-
fornia, Los Angeles (UCLA), respectively, and received
his Ph.D. degree from the University of Stuttgart in Ger-
many. He is the Director of the Institute for Systems The-
ory and Automatic Control and Executive Director of the
Stuttgart Research Centre Systems Biology at the Univer-
sity of Stuttgart. His research interests include cooperative control, predic-
tive control, and nonlinear control with application to a wide range of fields
including systems biology. At present he is President Elect of the Interna-
tional Federation of Automatic Control IFAC and serves as Vice President
of the German Research Foundation DFG.

You might also like