Linear Optimal control - uniroma1.itiacoviel/Materiale/OptimalControl-Lecture3.pdf · Performance...

27
Optimal Control Lecture Prof. Daniela Iacoviello Department of Computer, Control, and Management Engineering Antonio Ruberti Sapienza University of Rome

Transcript of Linear Optimal control - uniroma1.itiacoviel/Materiale/OptimalControl-Lecture3.pdf · Performance...

Page 1: Linear Optimal control - uniroma1.itiacoviel/Materiale/OptimalControl-Lecture3.pdf · Performance compare between LQR and PID control of DC Motor Optimal ... introduction to mathematical

Optimal Control

Lecture

Prof. Daniela Iacoviello

Department of Computer, Control, and Management Engineering Antonio Ruberti

Sapienza University of Rome

Page 2: Linear Optimal control - uniroma1.itiacoviel/Materiale/OptimalControl-Lecture3.pdf · Performance compare between LQR and PID control of DC Motor Optimal ... introduction to mathematical

26/10/2015 Controllo nei sistemi biologici

Lecture 1

Pagina 2

Prof. Daniela Iacoviello

Department of computer, control and management

Engineering Antonio Ruberti

Office: A219 Via Ariosto 25

http://www.dis.uniroma1.it/~iacoviel

Prof.Daniela Iacoviello- Optimal Control

Page 3: Linear Optimal control - uniroma1.itiacoviel/Materiale/OptimalControl-Lecture3.pdf · Performance compare between LQR and PID control of DC Motor Optimal ... introduction to mathematical

Grading

Project + oral exam

The exam must be concluded before the second

part of Identification that will be held by Prof. Battilotti

Page 4: Linear Optimal control - uniroma1.itiacoviel/Materiale/OptimalControl-Lecture3.pdf · Performance compare between LQR and PID control of DC Motor Optimal ... introduction to mathematical

Grading

Project+ oral exam

Example of project:

- Read a paper on an optimal control problem

- Study: background, motivations, model, optimal control, solution,

results

- Simulations

You must give me, before the date of the exam:

- A .doc document

- A power point presentation

- Matlab simulation files

The exam must be concluded before the second

part of Identification that will be held by Prof. Battilotti

Page 5: Linear Optimal control - uniroma1.itiacoviel/Materiale/OptimalControl-Lecture3.pdf · Performance compare between LQR and PID control of DC Motor Optimal ... introduction to mathematical

Some projects studied in 2014-15

Application of Optimal Control to malaria: strategies and simulations

Performance compare between LQR and PID control of DC Motor

Optimal Low-Thrust LEO (low-Earth orbit) to GEO (geosynchronous-Earth orbit)

Circular Orbit Transfer

Controllo ottimo di una turbina eolica a velocità variabile attraverso il metodo

dell'inseguimento ottimo a regime permanente

OptimalControl in Dielectrophoresis

On the Design of P.I.D. Controllers Using Optimal Linear Regulator Theory

Rocket Railroad Car

………

Page 6: Linear Optimal control - uniroma1.itiacoviel/Materiale/OptimalControl-Lecture3.pdf · Performance compare between LQR and PID control of DC Motor Optimal ... introduction to mathematical

THESE SLIDES ARE NOT SUFFICIENT

FOR THE EXAM: YOU MUST STUDY ON THE BOOKS

Prof.Daniela Iacoviello- Optimal Control

Part of the slides has been taken from the References indicated below

Page 7: Linear Optimal control - uniroma1.itiacoviel/Materiale/OptimalControl-Lecture3.pdf · Performance compare between LQR and PID control of DC Motor Optimal ... introduction to mathematical

References B.D.O.Anderson, J.B.Moore, Optimal control, Prentice Hall, 1989 C.Bruni, G. Di Pillo, Metodi Variazionali per il controllo ottimo, Masson , 1993 L. Evans, An introduction to mathematical optimal control theory, 1983 H.Kwakernaak , R.Sivan, Linear Optimal Control Systems, Wiley Interscience, 1972 D. E. Kirk, "Optimal Control Theory: An Introduction, New York, NY: Dover, 2004 D. Liberzon, "Calculus of Variations and Optimal Control Theory: A Concise Introduction", Princeton University Press, 2011 How, Jonathan, Principles of optimal control, Spring 2008. (MIT OpenCourseWare: Massachusetts Institute of Technology). License: Creative Commons BY-NC-SA.

Prof.Daniela Iacoviello- Optimal Control

Page 8: Linear Optimal control - uniroma1.itiacoviel/Materiale/OptimalControl-Lecture3.pdf · Performance compare between LQR and PID control of DC Motor Optimal ... introduction to mathematical

Calculus of variation and optimal control

Problem 1

Let us consider the dynamical system described by:

f function of C2 class

),,( tuxfx

Prof.Daniela Iacoviello- Optimal Control

x(t) state vector in Rn

u(t) control vector in Rp

ii xtx )( known

Page 9: Linear Optimal control - uniroma1.itiacoviel/Materiale/OptimalControl-Lecture3.pdf · Performance compare between LQR and PID control of DC Motor Optimal ... introduction to mathematical

1 nf

Prof.Daniela Iacoviello- Optimal Control

0),( ff ttx

Vectorial function of C1 class

of dimension

0),,( tuxq

Vectorial function of C2 class

of dimension

Define the cost index

With L function of C2 class

f

i

t

t

f dttuxLtuxJ ,,),,(

Assume the norm:

ft

t

ttttf ttudutxtxtux

i

)(sup)(sup)(sup)(sup,,

Page 10: Linear Optimal control - uniroma1.itiacoviel/Materiale/OptimalControl-Lecture3.pdf · Performance compare between LQR and PID control of DC Motor Optimal ... introduction to mathematical

AIM: Find

the instant

the control

the state

that satisfy the previous equations and

minimize the cost index

oft

Prof.Daniela Iacoviello- Optimal Control

)(0 RCuo

)(1 RCxo

Page 11: Linear Optimal control - uniroma1.itiacoviel/Materiale/OptimalControl-Lecture3.pdf · Performance compare between LQR and PID control of DC Motor Optimal ... introduction to mathematical

DEFINE the scalar function

the Hamiltonian function

Prof.Daniela Iacoviello- Optimal Control

),,()(),,(),,,,( 00 tuxfttuxLtuxH T

Page 12: Linear Optimal control - uniroma1.itiacoviel/Materiale/OptimalControl-Lecture3.pdf · Performance compare between LQR and PID control of DC Motor Optimal ... introduction to mathematical

Theorem 1

Let be an admissible solution such

that

Prof.Daniela Iacoviello- Optimal Control

)*,*,( *ftux

**

*

,),(

)),((

fiaactive

fff

ttttu

qrk

ttxrk

Page 13: Linear Optimal control - uniroma1.itiacoviel/Materiale/OptimalControl-Lecture3.pdf · Performance compare between LQR and PID control of DC Motor Optimal ... introduction to mathematical

IF is a local minimum

there exist

not simultaneously null in such that:

Prof.Daniela Iacoviello- Optimal Control

)*,*,( *ftux

],[],,[, *0**1**0 fifi ttCttCR

],[ *fi tt

***

***

*

0

TT

TT

u

q

u

H

x

q

x

H

Page 14: Linear Optimal control - uniroma1.itiacoviel/Materiale/OptimalControl-Lecture3.pdf · Performance compare between LQR and PID control of DC Motor Optimal ... introduction to mathematical

Prof.Daniela Iacoviello- Optimal Control

T

tft

T

tf

f

j

jj

f

f

f

f

tH

Rtx

t

t

jtuxqt

*

*

*

*

*

*

*

*

*

,))((

)(*

0)(

,...,2,1,0)*,*,()(

Page 15: Linear Optimal control - uniroma1.itiacoviel/Materiale/OptimalControl-Lecture3.pdf · Performance compare between LQR and PID control of DC Motor Optimal ... introduction to mathematical

Prof.Daniela Iacoviello- Optimal Control

The discontinuity of may occurr only in the points where has a discontinuity and

** and

t *u

** tt

HH

Page 16: Linear Optimal control - uniroma1.itiacoviel/Materiale/OptimalControl-Lecture3.pdf · Performance compare between LQR and PID control of DC Motor Optimal ... introduction to mathematical

Prof.Daniela Iacoviello- Optimal Control

Problem 2: Consider Problem 1 assuming L, f, q not depending on t Theorem 2 Let be an admissible solution

)*,*,( *ftux

**

**

**

*

,,

problemsstationaryforMoreover

uofpointcontinuityanyfor

fi

T

tttcH

t

q

t

H

dt

dH

Page 17: Linear Optimal control - uniroma1.itiacoviel/Materiale/OptimalControl-Lecture3.pdf · Performance compare between LQR and PID control of DC Motor Optimal ... introduction to mathematical

Problem 3

Let us consider the dynamical system described by:

f function of C2 class

),,( tuxfx

Prof.Daniela Iacoviello- Optimal Control

x(t) state vector in Rn

u(t) control vector in Rp

ii xtx )( known

Calculus of variation and optimal control

Page 18: Linear Optimal control - uniroma1.itiacoviel/Materiale/OptimalControl-Lecture3.pdf · Performance compare between LQR and PID control of DC Motor Optimal ... introduction to mathematical

1 nf

Prof.Daniela Iacoviello- Optimal Control

0),( ff ttx

Vectorial function of C1 class

of dimension

f

i

t

t

Kdtttutxh ),(),(

Vectorial function of C2 class

of dimension

Define the cost index

With L function of C2 class

f

i

t

t

f dttuxLtuxJ ,,),,(

Assume the norm:

ft

t

ttttf ttudutxtxtux

i

)(sup)(sup)(sup)(sup,,

Page 19: Linear Optimal control - uniroma1.itiacoviel/Materiale/OptimalControl-Lecture3.pdf · Performance compare between LQR and PID control of DC Motor Optimal ... introduction to mathematical

AIM: Find

the instant

the control

the state

that satisfy the previous equations and

minimize the cost index

oft

Prof.Daniela Iacoviello- Optimal Control

)(0 RCuo

)(1 RCxo

Page 20: Linear Optimal control - uniroma1.itiacoviel/Materiale/OptimalControl-Lecture3.pdf · Performance compare between LQR and PID control of DC Motor Optimal ... introduction to mathematical

DEFINE the scalar function

the Hamiltonian function

Prof.Daniela Iacoviello- Optimal Control

ttutxh

tuxfttuxLtuxH

T

T

),(),(

),,()(),,(),,,,( 00

Page 21: Linear Optimal control - uniroma1.itiacoviel/Materiale/OptimalControl-Lecture3.pdf · Performance compare between LQR and PID control of DC Motor Optimal ... introduction to mathematical

Theorem 3

Let be an admissible solution such

that

Prof.Daniela Iacoviello- Optimal Control

)*,*,( *ftux

fff ttx

rk

*

)),((

Page 22: Linear Optimal control - uniroma1.itiacoviel/Materiale/OptimalControl-Lecture3.pdf · Performance compare between LQR and PID control of DC Motor Optimal ... introduction to mathematical

IF is a local minimum

there exist

not simultaneously null in such that:

Prof.Daniela Iacoviello- Optimal Control

)*,*,( *ftux

T

T

u

H

x

H

*

**

0

RttCR fi **1**0 ],,[,

],[ *fi tt

T

tf

t

T

tf

f

f

f

f

f

tH

Rtx

t

*

*

*

*

*

*

*

,))((

)(*

Page 23: Linear Optimal control - uniroma1.itiacoviel/Materiale/OptimalControl-Lecture3.pdf · Performance compare between LQR and PID control of DC Motor Optimal ... introduction to mathematical

Prof.Daniela Iacoviello- Optimal Control

The discontinuity of may occurr only in the points where has a discontinuity and

*

kt *u

**

kk ttHH

Page 24: Linear Optimal control - uniroma1.itiacoviel/Materiale/OptimalControl-Lecture3.pdf · Performance compare between LQR and PID control of DC Motor Optimal ... introduction to mathematical

Prof.Daniela Iacoviello- Optimal Control

Problem 4: Consider the linea r system Assume: fixed

utBxtAx )()(

Functions of C2 class

fi tti

i xtx )(

nRor pointfixedabeing)( fff DDtx

0),,( tuxqVectorial function of C2 class

of dimension CONVEX

Page 25: Linear Optimal control - uniroma1.itiacoviel/Materiale/OptimalControl-Lecture3.pdf · Performance compare between LQR and PID control of DC Motor Optimal ... introduction to mathematical

Prof.Daniela Iacoviello- Optimal Control

Define the cost index

))((),,(),( f

t

t

txGdttuxLuxJ

f

i

Functions of C2 class

CONVEX

Functions of C3 class- CONVEX

Page 26: Linear Optimal control - uniroma1.itiacoviel/Materiale/OptimalControl-Lecture3.pdf · Performance compare between LQR and PID control of DC Motor Optimal ... introduction to mathematical

Prof.Daniela Iacoviello- Optimal Control

Theorem 4 Let be an admissible solution such that is a normal optimal solution

),( oo ux

fia

oactive ttttu

qrk ,),(

),( oo ux

0)(

,...,2,1

,0),,()(

0

t

j

tuxqt

u

q

u

H

x

q

x

H

o

ooj

oj

ooToT

ooToT

o

Page 27: Linear Optimal control - uniroma1.itiacoviel/Materiale/OptimalControl-Lecture3.pdf · Performance compare between LQR and PID control of DC Motor Optimal ... introduction to mathematical

Prof.Daniela Iacoviello- Optimal Control

AND IF

oT

ff

o

tdx

dGt

)()(

nf RD