Stability of Model Predictive Control -...

22
Stability of Model Predictive Control Riccardo Scattolini Riccardo Scattolini Dipartimento di Elettronica e Informazione

Transcript of Stability of Model Predictive Control -...

Page 1: Stability of Model Predictive Control - Uniudusers.dimi.uniud.it/~franco.blanchini/scuolasidra09/Ch6...Stability 4of MPC - 3 MPC problem: at any time k find the sequenceminimizingg(

Stability ofModel Predictive ControlRiccardo ScattoliniRiccardo ScattoliniDipartimento di Elettronica e Informazione

Page 2: Stability of Model Predictive Control - Uniudusers.dimi.uniud.it/~franco.blanchini/scuolasidra09/Ch6...Stability 4of MPC - 3 MPC problem: at any time k find the sequenceminimizingg(

2Stability of MPC - 1

Consider the system

where f is continuously differentiable with respect to itswhere f is continuously differentiable with respect to its arguments and f(0,0)=0. The state and control variables must satisfy the following constraints

where X and U contain the origin as an interior point.The problem is to design MPC algorithms guaranteeingThe problem is to design MPC algorithms guaranteeing

that the origin of the closed-loop system is an asymptotically stable equilibrium point.

Riccardo Scattolini Dip. di Elettronica e Informazione

Page 3: Stability of Model Predictive Control - Uniudusers.dimi.uniud.it/~franco.blanchini/scuolasidra09/Ch6...Stability 4of MPC - 3 MPC problem: at any time k find the sequenceminimizingg(

3Stability of MPC - 2

The auxiliary control law

Assume to know an auxiliary control law

and a positively invariant set containing the origin such that for the closed loop systemsuch that, for the closed-loop system

and for anyand for anyone has

Riccardo Scattolini Dip. di Elettronica e Informazione

Page 4: Stability of Model Predictive Control - Uniudusers.dimi.uniud.it/~franco.blanchini/scuolasidra09/Ch6...Stability 4of MPC - 3 MPC problem: at any time k find the sequenceminimizingg(

4Stability of MPC - 3

MPC problem: at any time k find the sequence

minimizing the cost function (Q>0, R>0)g ( , )

subject toj

The RH solution implicitly defines the MPC time-invariant control law

Riccardo Scattolini Dip. di Elettronica e Informazione

Page 5: Stability of Model Predictive Control - Uniudusers.dimi.uniud.it/~franco.blanchini/scuolasidra09/Ch6...Stability 4of MPC - 3 MPC problem: at any time k find the sequenceminimizingg(

5Stability of MPC - 4

TheoremLet be the set of states where a solution of theLet be the set of states where a solution of the optimization problem exists.If for any the conditionIf, for any the condition

is fulfilled andis fulfilled and

where is a class K function then the origin of thewhere is a class K function, then the origin of the closed-loop system with the MPC-RH control law is an asymptotically stable equilibrium point with region of attractiony p y q p g

. Moreover, if and then the origin is exponentially stable in .

Riccardo Scattolini Dip. di Elettronica e Informazione

then the origin is exponentially stable in .

Page 6: Stability of Model Predictive Control - Uniudusers.dimi.uniud.it/~franco.blanchini/scuolasidra09/Ch6...Stability 4of MPC - 3 MPC problem: at any time k find the sequenceminimizingg(

6Stability of MPC - 5

ProofLet andLet and

be the optimal solution at k with prediction horizon N. Then, at time k+1

i f ibl l ti th tis a feasible solution, so that

Moreover,

so that the condition is verified in

Riccardo Scattolini Dip. di Elettronica e Informazione

so that the condition is verified in

Page 7: Stability of Model Predictive Control - Uniudusers.dimi.uniud.it/~franco.blanchini/scuolasidra09/Ch6...Stability 4of MPC - 3 MPC problem: at any time k find the sequenceminimizingg(

7Stability of MPC - 6

At time k, the sequence

is feasible for the MPC problem with horizon N+1 and

so that we have the monotonicity property (with respect to N)

withThenand the condition is satisfied.

Riccardo Scattolini Dip. di Elettronica e Informazione

Page 8: Stability of Model Predictive Control - Uniudusers.dimi.uniud.it/~franco.blanchini/scuolasidra09/Ch6...Stability 4of MPC - 3 MPC problem: at any time k find the sequenceminimizingg(

8Stability of MPC - 7

Finally

and also the condition is satisfiedis satisfied.In conclusion, V(x,N) is a Lyapunov function.M if th i i iMoreover, if the origin is exponentially stable

Riccardo Scattolini Dip. di Elettronica e Informazione

Page 9: Stability of Model Predictive Control - Uniudusers.dimi.uniud.it/~franco.blanchini/scuolasidra09/Ch6...Stability 4of MPC - 3 MPC problem: at any time k find the sequenceminimizingg(

9Stability of MPC - 8

Remark 1

The main point is to prove that the cost function is decreasing. For this, it is not necessary to find the optimum, but just a sequencesequence

such thatsuch that

Remark 2It is possible to conclude thatIt is possible to conclude that

In fact with longer horizons one has more degrees of freedom

Riccardo Scattolini Dip. di Elettronica e Informazione

In fact, with longer horizons one has more degrees of freedom.

Page 10: Stability of Model Predictive Control - Uniudusers.dimi.uniud.it/~franco.blanchini/scuolasidra09/Ch6...Stability 4of MPC - 3 MPC problem: at any time k find the sequenceminimizingg(

10Stability of MPC - 9

Remark 3

In fact the auxiliary control law can be used by theIn fact, the auxiliary control law can be used by the optimization algorithm

Remark 4

There exists a value such that where is theThere exists a value such that where is the maximum (unknown) positively invariant set associated to the auxiliary control law.au a y co o a

But, how to select the terminal cost and the terminal set?

Riccardo Scattolini Dip. di Elettronica e Informazione

But, how to select the terminal cost and the terminal set?

Page 11: Stability of Model Predictive Control - Uniudusers.dimi.uniud.it/~franco.blanchini/scuolasidra09/Ch6...Stability 4of MPC - 3 MPC problem: at any time k find the sequenceminimizingg(

11Zero terminalconstraint - 1

This is the first algorithm proposed, defined by

In fact, since f(0,0)=0, if at time k the optimal sequence is

leading to , at time k+1 the sequence

is such that

and the condition

Riccardo Scattolini Dip. di Elettronica e Informazione

is satisfied (all the terms are null).

Page 12: Stability of Model Predictive Control - Uniudusers.dimi.uniud.it/~franco.blanchini/scuolasidra09/Ch6...Stability 4of MPC - 3 MPC problem: at any time k find the sequenceminimizingg(

12Zero terminalconstraint - 2

Remark 1The terminal constraint x(k+N)=0 is difficult to verify for nonlinear systems For linear systems without constraints it

Remark 1

nonlinear systems. For linear systems without constraints it is possible to compute the explicit solution (CRHPC algorithm).g )

Remark 2

When the input constraints are present, coincides with the constrained controllability set , which can be computed for linear systems.

Riccardo Scattolini Dip. di Elettronica e Informazione

Page 13: Stability of Model Predictive Control - Uniudusers.dimi.uniud.it/~franco.blanchini/scuolasidra09/Ch6...Stability 4of MPC - 3 MPC problem: at any time k find the sequenceminimizingg(

13Quasi Infinite HorizonMPC – linear systems - 1

Consider the linear system

and the LQ control law (computed with the same Q, Rt i f th MPC t f ti )matrices of the MPC cost function)

Define the matrix P solution of

and the terminal set

h i ffi i l ll l

Riccardo Scattolini Dip. di Elettronica e Informazione

where α is a sufficiently small value.

Page 14: Stability of Model Predictive Control - Uniudusers.dimi.uniud.it/~franco.blanchini/scuolasidra09/Ch6...Stability 4of MPC - 3 MPC problem: at any time k find the sequenceminimizingg(

14Quasi Infinite HorizonMPC – linear systems - 2

Consider also the terminal weight

These choices fulfill the stability conditionThese choices fulfill the stability condition

In fact

Riccardo Scattolini Dip. di Elettronica e Informazione

Page 15: Stability of Model Predictive Control - Uniudusers.dimi.uniud.it/~franco.blanchini/scuolasidra09/Ch6...Stability 4of MPC - 3 MPC problem: at any time k find the sequenceminimizingg(

15Quasi Infinite HorizonMPC – linear systems - 3

Moreover, Xf is positively invariant for the auxiliary control law, since its boundary coincides with a level line of thelaw, since its boundary coincides with a level line of the Lyapunov function associated to the closed-loop system.

Finally, with continuity arguments it can be concluded that in the neighborhood of the origin (i,.e. for a sufficiently small α)one has

Note that the terminal cost can be interpreted as the “cost to go” of a classical LQ-IH approach.

Riccardo Scattolini Dip. di Elettronica e Informazione

Page 16: Stability of Model Predictive Control - Uniudusers.dimi.uniud.it/~franco.blanchini/scuolasidra09/Ch6...Stability 4of MPC - 3 MPC problem: at any time k find the sequenceminimizingg(

16Quasi Infinite HorizonMPC – nonlinear systems - 1

First assume that the system is linearizable at the origin

where

For the linearized system compute with the same Q, Rmatrices the LQ control lawmatrices the LQ control law

Riccardo Scattolini Dip. di Elettronica e Informazione

which will be used as the auxiliary control law.

Page 17: Stability of Model Predictive Control - Uniudusers.dimi.uniud.it/~franco.blanchini/scuolasidra09/Ch6...Stability 4of MPC - 3 MPC problem: at any time k find the sequenceminimizingg(

17Quasi Infinite HorizonMPC – nonlinear systems - 2

For the corresponding nonlinear controlled system one has

andand

Now solve the Lyapunov equation

and consider again the terminal cost

Riccardo Scattolini Dip. di Elettronica e Informazione

Page 18: Stability of Model Predictive Control - Uniudusers.dimi.uniud.it/~franco.blanchini/scuolasidra09/Ch6...Stability 4of MPC - 3 MPC problem: at any time k find the sequenceminimizingg(

18Quasi Infinite HorizonMPC – nonlinear systems - 3

In the neighborhood of the origin,

Riccardo Scattolini Dip. di Elettronica e Informazione

Page 19: Stability of Model Predictive Control - Uniudusers.dimi.uniud.it/~franco.blanchini/scuolasidra09/Ch6...Stability 4of MPC - 3 MPC problem: at any time k find the sequenceminimizingg(

19Quasi Infinite HorizonMPC – nonlinear systems - 4

Letting

one has

and

Since then in a sufficientlysmall neighborhood of the origin, so that the decreasing g g , gcondition is satisified.

Finally note that is positively invariantFinally note that is positively invariant for the auxiliary LQ control law, as it coincides with a level line of the Lyapunov function associated to the linearized system.

Riccardo Scattolini Dip. di Elettronica e Informazione

Moreover, in a neighborhood of the origin .

Page 20: Stability of Model Predictive Control - Uniudusers.dimi.uniud.it/~franco.blanchini/scuolasidra09/Ch6...Stability 4of MPC - 3 MPC problem: at any time k find the sequenceminimizingg(

20Prediction andcontrol horizons - 1

For nonlinear systems it can be difficult to compute the largest terminal set where the stability and feasibility conditions areterminal set where the stability and feasibility conditions are verified for the auxiliary control law.

If a small Xf is used (smaller that the largest and unknown one associated to the terminal set), it could be necessary to use a ), yvery large prediction horizon N. This in turn means that the number of optimization variables can become very high, with significant computational burden.

To avoid this problem, it is useful to use different prediction (Np) and control (Nc) horizons.

Riccardo Scattolini Dip. di Elettronica e Informazione

Page 21: Stability of Model Predictive Control - Uniudusers.dimi.uniud.it/~franco.blanchini/scuolasidra09/Ch6...Stability 4of MPC - 3 MPC problem: at any time k find the sequenceminimizingg(

21Prediction andcontrol horizons - 2

The problem can be reformulated as follows.Solve with respect to the sequenceSolve with respect to the sequence The following optimization problem

x(k+Nc)Xfmax (unknown)

x(k)

c

( )

0

Riccardo Scattolini Dip. di Elettronica e Informazione

x(k) x(k+Np) Xf

Page 22: Stability of Model Predictive Control - Uniudusers.dimi.uniud.it/~franco.blanchini/scuolasidra09/Ch6...Stability 4of MPC - 3 MPC problem: at any time k find the sequenceminimizingg(

22Essential references

H. Chen, F. Allgöwer: “A Quasi-Infinite Horizon Nonlinear Model Predictive Control Scheme with Guaranteed Stability” Automatica Vol 34 n 10 ppControl Scheme with Guaranteed Stability , Automatica, Vol. 34, n. 10, pp. 1205-1217, 1998.

D.W.Clarke, R.Scattolini: "Constrained Receding-Horizon Predictive Control", Proc. IEE Part D, Vol.138, n.4, 347-354, 1991.

Magni L., G. De Nicolao, L. Magnani, and R. Scattolini : "A Stabilizing Model-Based Predictive Controller for Nonlinear Systems", Automatica, Vol. 37,Based Predictive Controller for Nonlinear Systems , Automatica, Vol. 37, pp. 11351-1362, 2001.

D.Q. Mayne, H. Michalska: “Receding horizon control of nonlinear systems”, IEEE AC V l 35 7 814 824 1990IEEE-AC, Vol. 35, n. 7,pp. 814 - 824 , 1990.

D.Q. Mayne, J.B. Rawlings, C.V. Rao, P.O. Scokaert: “Constrained model predictive control: stability and optimality”, Automatica, Vol. 36, pp. 789-p y p y pp814, 2000.

P.O.M. Scokaert, D.Q. Mayne, J.B. Rawlings: “Suboptimal model predictive t l (f ibilit i li t bilit )” IEEE AC V l 44 3 648 654

Riccardo Scattolini Dip. di Elettronica e Informazione

control (feasibility implies stability)”, IEEE-AC, Vol. 44, n. 3,pp. 648 - 654, 1999.