Feedback stabilization of the wake behind a steady cylinder · pairs ofequalima ginary and opposite...

15
Introduction The optimal control problem Min-energy feedback control Results Feedback stabilization of the wake behind a steady cylinder J. Pralits 1 , T. Bewley 2 and P. Luchini 1 1 DIMEC, Universit` a di Salerno, Fisciano (SA), Italy 2 Flow Control Lab, Dept. of MAE, UC San Diego, USA 7th ERCOFTAC SIG33 - FLUBIO WORKSHOP ON OPEN ISSUES IN TRANSITION AND FLOW CONTROL S. Margherita Ligure 16-18 October 2008 Introduction The optimal control problem Min-energy feedback control Results Motivation Optimal control of wake instabilities via application of modern control algorithms (Riccati equation) is intractable because of the very large number of degrees of freedom deriving from the discretization of the Navier-Stokes equations. The research approach until today has been to use eg. reduced-order models (ROM) Here we show an approach based on direct and adjoint eigenvectors which make, at least in some cases, mathematically rigorous optimal control a reality.

Transcript of Feedback stabilization of the wake behind a steady cylinder · pairs ofequalima ginary and opposite...

Page 1: Feedback stabilization of the wake behind a steady cylinder · pairs ofequalima ginary and opposite realpart.) T his linear O D E is a tw o-point boundary value problem and ma y be

Introduction The optimal control problem Min-energy feedback control Results

Feedback stabilization of the wake behind a

steady cylinder

J. Pralits1, T. Bewley2 and P. Luchini1

1DIMEC, Universita di Salerno, Fisciano (SA), Italy

2Flow Control Lab, Dept. of MAE, UC San Diego, USA

7th ERCOFTAC SIG33 - FLUBIO WORKSHOP ONOPEN ISSUES IN TRANSITION AND FLOW

CONTROLS. Margherita Ligure 16-18 October 2008

Introduction The optimal control problem Min-energy feedback control Results

Motivation

Optimal control of wake instabilities via application of moderncontrol algorithms (Riccati equation) is intractable because ofthe very large number of degrees of freedom deriving from thediscretization of the Navier-Stokes equations.

The research approach until today has been to use eg.reduced-order models (ROM)

Here we show an approach based on direct and adjointeigenvectors which make, at least in some cases,mathematically rigorous optimal control a reality.

Page 2: Feedback stabilization of the wake behind a steady cylinder · pairs ofequalima ginary and opposite realpart.) T his linear O D E is a tw o-point boundary value problem and ma y be

Introduction The optimal control problem Min-energy feedback control Results

Framework

The Salerno group has experience in the computation and useof direct and adjoint modes of large-scale recirculating flows,linearized about unstable equilibria.

The UCSD group has developed an e!cient technique tocompute minimal-energy stabilizing linear feedback controlrules for linear systems. This technique is based solely on theunstable eigenvalues and corresponding left eigenvectors ofthe linearized open-loop system.

Introduction The optimal control problem Min-energy feedback control Results

Overview

If a minimal-energy stabilizing feedback rule u = Kx is applied tothe system x = Ax + Bu, the eigenvalues of the closed-loop systemA + BK are given by the union of the stable eigenvalues of A andthe reflection of the unstable eigenvalues of A into the left-halfplane.

!0.5 !0.4 !0.3 !0.2 !0.1 0 0.1 0.2 0.3!0.9

!0.8

!0.7

!0.6

!0.5

!0.4

!0.3

!0.2

!0.1

!(!k )

"(!k )

Page 3: Feedback stabilization of the wake behind a steady cylinder · pairs ofequalima ginary and opposite realpart.) T his linear O D E is a tw o-point boundary value problem and ma y be

Introduction The optimal control problem Min-energy feedback control Results

Since we know where the closed-loop eigenvalues of thesystem are, the feedback gain matrix K in this problem maybe computed by the process of pole assignment

Applying this process to the equation governing the dynamicsof the system in modal form, and then transformingappropriately, leads to an expression for K requiring only theknowledge of the unstable modes, as shown in the following

Introduction The optimal control problem Min-energy feedback control Results

The linear optimal control problem

The classical full-state-information control problem is formulatedas: for the state x and the control u related via the state equation

x = Ax + Bu on 0 < t < T with x = x0 at t = 0

find the control u that minimizes the cost function

J =1

2

∫ T

0[x∗Qx + u∗Ru] dt.

The adjoint variable r is introduced as a Lagrange multiplier. Thevariations of the augmented cost function

J =

∫ T

0

1

2[x∗Qx + u∗Ru] + r∗[x − Ax − Bu] dt.

gives r = −AHr − Qx, u = −R−1BHr with r(t = T ) = 0

Page 4: Feedback stabilization of the wake behind a steady cylinder · pairs ofequalima ginary and opposite realpart.) T his linear O D E is a tw o-point boundary value problem and ma y be

Introduction The optimal control problem Min-energy feedback control Results

A boundary-value problem

The state and adjoint equations may be written in the combinedmatrix form

dz

dt= Zz where Z = Z2n×2n =

[

A −BR−1BH

−Q −AH

]

(1)

z =

[

x

r

]

, and

{

x = x0 at t = 0,r = 0 at t = T .

(Z has a Hamiltonian symmetry, such that eigenvalues appear inpairs of equal imaginary and opposite real part.) This linear ODEis a two-point boundary value problem and may be solvedassuming there exist a relationship between the state vector x(t)and adjoint vector r(t) vi a matrix X(T ) such that r = Xx, andinserting this solution ansatz into (1) to eliminate r.

Introduction The optimal control problem Min-energy feedback control Results

The Riccati equation

It follows that matrix X obeys the di"erential Riccati equation

−dX

dt= AHX + XA − XBR−1BHX + Q where X(t = T ) = 0.

(2)Once X is known, the optimal value of u may then be written inthe form of a feedback control rule such that

u = Kx where K = −R−1BHX.

Finally, if the system is time invariant and we take the limit thatT → ∞, the matrix X in (2) may be marched to steady state.This steady state solution for X satisfies the continuous-timealgebraic Riccati equation

0 = AHX + XA − XBR−1BHX + Q,

where additionally X is constrained such that A + BK is stable.

Page 5: Feedback stabilization of the wake behind a steady cylinder · pairs ofequalima ginary and opposite realpart.) T his linear O D E is a tw o-point boundary value problem and ma y be

Introduction The optimal control problem Min-energy feedback control Results

The classical way of solution

A linear time-invariant system can be solved using its eigenvectors.Assume that an eigenvector decomposition of the 2n × 2n matrixZ is available such that

Z = V!cV−1 where V =

[

V11 V12

V21 V22

]

and z =

[

x

r

]

and the eigenvalues of Z appearing in the diagonal matrix !c areenumerated in order of increasing real part. Since

z = Ve!c tV−1z0

the solutions z that obey the boundary conditions at t = ∞ arespanned by the first n columns of V. The direct (x) and adjoint(r) parts of the these columns are related as r = Xx, where

X = V21V−111

Introduction The optimal control problem Min-energy feedback control Results

The minimal-energy stabilizing feedback control

Taking the limit as Q → 0 (maintain constraint that x∗Qx shouldbe integrable), we obtain the so called minimal-energy stabilizingfeedback control. In this limit Z becomes block triangular, and thedirect and adjoint equations become

x = Ax + Bu, u = −R−1BHr, r = −AHr (3)

Page 6: Feedback stabilization of the wake behind a steady cylinder · pairs ofequalima ginary and opposite realpart.) T his linear O D E is a tw o-point boundary value problem and ma y be

Introduction The optimal control problem Min-energy feedback control Results

The minimal-energy stabilizing feedback control

Taking the limit as Q → 0 (maintain constraint that x∗Qx shouldbe integrable), we obtain the so called minimal-energy stabilizingfeedback control. In this limit Z becomes block triangular, and thedirect and adjoint equations become

x = Ax + Bu, u = −R−1BHr, r = −AHr (3)

The eigenvalues of this system is given by the union of theeigenvalues of A and the eigenvalues of −AH .

Introduction The optimal control problem Min-energy feedback control Results

The minimal-energy stabilizing feedback control

Taking the limit as Q → 0 (maintain constraint that x∗Qx shouldbe integrable), we obtain the so called minimal-energy stabilizingfeedback control. In this limit Z becomes block triangular, and thedirect and adjoint equations become

x = Ax + Bu, u = −R−1BHr, r = −AHr (3)

The eigenvalues of this system is given by the union of theeigenvalues of A and the eigenvalues of −AH .Denoting:xi and !i the i-th right eigenvector and eigenvalue of A,yi and −!i∗ the i-th right eigenvector and eigenvalue of −AH

(yi∗ is left e.v. of A), we see that the stable eigenvectors of (3) areof two possible types:

Page 7: Feedback stabilization of the wake behind a steady cylinder · pairs ofequalima ginary and opposite realpart.) T his linear O D E is a tw o-point boundary value problem and ma y be

Introduction The optimal control problem Min-energy feedback control Results

The minimal-energy stabilizing feedback control

Taking the limit as Q → 0 (maintain constraint that x∗Qx shouldbe integrable), we obtain the so called minimal-energy stabilizingfeedback control. In this limit Z becomes block triangular, and thedirect and adjoint equations become

x = Ax + Bu, u = −R−1BHr, r = −AHr (3)

The eigenvalues of this system is given by the union of theeigenvalues of A and the eigenvalues of −AH .Denoting:xi and !i the i-th right eigenvector and eigenvalue of A,yi and −!i∗ the i-th right eigenvector and eigenvalue of −AH

(yi∗ is left e.v. of A), we see that the stable eigenvectors of (3) areof two possible types:

r = 0, x = xi if %(!i ) < 0 (stable)

Introduction The optimal control problem Min-energy feedback control Results

The minimal-energy stabilizing feedback control

Taking the limit as Q → 0 (maintain constraint that x∗Qx shouldbe integrable), we obtain the so called minimal-energy stabilizingfeedback control. In this limit Z becomes block triangular, and thedirect and adjoint equations become

x = Ax + Bu, u = −R−1BHr, r = −AHr (3)

The eigenvalues of this system is given by the union of theeigenvalues of A and the eigenvalues of −AH .Denoting:xi and !i the i-th right eigenvector and eigenvalue of A,yi and −!i∗ the i-th right eigenvector and eigenvalue of −AH

(yi∗ is left e.v. of A), we see that the stable eigenvectors of (3) areof two possible types:

r = 0, x = xi if %(!i ) < 0 (stable)r = yi , x = (!i∗ + A)−1BR−1BHyi if %(!i ) > 0 (unstable)

Page 8: Feedback stabilization of the wake behind a steady cylinder · pairs ofequalima ginary and opposite realpart.) T his linear O D E is a tw o-point boundary value problem and ma y be

Introduction The optimal control problem Min-energy feedback control Results

We now project an arbitrary initial condition x0 onto these modes,

x0 =∑

stable

djxj +

unstable

ej(!j∗ + A)−1BR−1BHyj (4)

and note that in order to reconstruct r we only need the ej ’s,because the stable modes have r = 0.

Introduction The optimal control problem Min-energy feedback control Results

We now project an arbitrary initial condition x0 onto these modes,

x0 =∑

stable

djxj +

unstable

ej(!j∗ + A)−1BR−1BHyj (4)

and note that in order to reconstruct r we only need the ej ’s,because the stable modes have r = 0.The coe!cients dj can beeliminated from (4) by projecting the left eigenvectors:

yi∗x0 = yi∗∑

unstable

ej(!j∗ + A)−1BR−1BHyj =

unstable

fijej

where, since yi∗ is also a left eigenvector of (!j∗ + A)−1,

fij =yi∗BR−1BHyj

!i + !j∗

Page 9: Feedback stabilization of the wake behind a steady cylinder · pairs ofequalima ginary and opposite realpart.) T his linear O D E is a tw o-point boundary value problem and ma y be

Introduction The optimal control problem Min-energy feedback control Results

We now project an arbitrary initial condition x0 onto these modes,

x0 =∑

stable

djxj +

unstable

ej(!j∗ + A)−1BR−1BHyj (4)

and note that in order to reconstruct r we only need the ej ’s,because the stable modes have r = 0.The coe!cients dj can beeliminated from (4) by projecting the left eigenvectors:

yi∗x0 = yi∗∑

unstable

ej(!j∗ + A)−1BR−1BHyj =

unstable

fijej

where, since yi∗ is also a left eigenvector of (!j∗ + A)−1,

fij =yi∗BR−1BHyj

!i + !j∗

Only the unstable eigenvalues and left eigenvectors are needed.

Introduction The optimal control problem Min-energy feedback control Results

The main theorem

Summarizing, the solution of the minimal-energy stabilizing controlfeedback problem can be written in terms of the unstable lefteigenvectors only.

Theorem 1. Consider a stabilizable system x = Ax + Bu with nopure imaginary open-loop eigenvalues. Determine the unstableeigenvalues and corresponding left eigenvectors of A such thatTH

u A = !uTHu (equivalently, determine the unstable eigenvalues

and corresponding right eigenvectors of AH such thatAHTu = Tu!

Hu ). Define Bu = TH

u B and C = BuBHu , and compute

a matrix F with elements fij = cij/(!i + !∗

j ). The minimal-energystabilizing feedback controller is then given by u = Kx, whereK = −BH

u F−1THu .

Page 10: Feedback stabilization of the wake behind a steady cylinder · pairs ofequalima ginary and opposite realpart.) T his linear O D E is a tw o-point boundary value problem and ma y be

Introduction The optimal control problem Min-energy feedback control Results

Application

Computation of minimal-energy stabilizing linear feedback controlto suppress vortex shedding from a circular cylinder (Re = UD/")

Full state information

Actuator: rotational oscillation

One pair of unstable complex conjugate modes

K︸︷︷︸

1×n

= − BHu

︸︷︷︸

1×2

F−1

︸︷︷︸

2×2

THu

︸︷︷︸

2×n

, real valued

BaseFlow, Re=60

!5 0 5 10 15!5

0

5

0.2

0.4

0.6

0.8

1

mean velocity field modulus

Mode : Real part of Vorticity, Re=60

!5 0 5 10 15!5

0

5

!2

0

2

real part of vorticity (unstable)

Introduction The optimal control problem Min-energy feedback control Results

Background: control using rotational oscillation

Aim: reduce CDExp. Tokumaru & Dimotakis (1991), -20%, Re = 15000

Feedback control:Exp. Fujisawa & Nakabayashi (2002) -16% (-70% CL), Re = 20000Exp. Fujisawa et al.(2001) “reduction”, Re = 6700

Optimal control (using adjoints):Num. He et al.(2000) -30 to -60% for Re = 200 − 1000Num. Protas & Styczek (2002) -7% at Re = 75, -15% at Re = 150Num. Bergmann et al.(2005) -25% at Re = 200 (POD)

Aim: reduce vortex sheddingFeedback control:

Num. Protas (2004) reduction, “point vortex model”, Re = 75Optimal control (using adjoints):

Num. Homescu et al.(2002) reduction, Re = 60 − 1000

Page 11: Feedback stabilization of the wake behind a steady cylinder · pairs ofequalima ginary and opposite realpart.) T his linear O D E is a tw o-point boundary value problem and ma y be

Introduction The optimal control problem Min-energy feedback control Results

Numerical procedure

All equations are discretized using second-orderfinite-di"erences over a staggered, stretched, Cartesian mesh.

An immersed-boundary technique is used to enforce theboundary conditions on the cylinder.

The system of algebraic equations deriving from thedisretization of the nonlinear mean-flow equations, along withtheir boundary conditions, is solved by a Newton-Raphsonprocedure.

The eigenvalue problem is solved by inverse iteration, bothright and left eigenvectors are solved simultaneously, as in thework by Giannetti & Luchini1

The linear and nonlinear evolution equations are solved usingAdams-Bashforth/Crank-Nicholson

1Structural sensitivity of the first instability of the cylinder wake, J. FluidMech. 581, 167 (2007)

Introduction The optimal control problem Min-energy feedback control Results

Results: Ku

Re = 55

Re = 100

Re = 75

Re = 150

Page 12: Feedback stabilization of the wake behind a steady cylinder · pairs ofequalima ginary and opposite realpart.) T his linear O D E is a tw o-point boundary value problem and ma y be

Introduction The optimal control problem Min-energy feedback control Results

Results: Kv

Re = 55

Re = 100

Re = 75

Re = 150

Introduction The optimal control problem Min-energy feedback control Results

Results: |K|

Re = 55

Re = 100

Re = 75

Re = 150

Page 13: Feedback stabilization of the wake behind a steady cylinder · pairs ofequalima ginary and opposite realpart.) T his linear O D E is a tw o-point boundary value problem and ma y be

Introduction The optimal control problem Min-energy feedback control Results

Results: linearized N-S equations

Applying the control to the linearized system allows us to check if“pole assignment” actually works.

With the control OFF: u ∼ exp(i!i t) exp(!r t)

With the control ON: u ∼ exp(i!i t) exp(−!r t)

CL: lift coe!cient; ut tangential velocity of the cylinder.

Test case: Re = 55, control is turned on at t = 18

-3

-2

-1

0

1

2

3

0 20 40 60 80 100 120 140

t

CL

OFFON

-0.2

-0.15

-0.1

-0.05

0

0.05

0.1

0.15

0.2

0 20 40 60 80 100 120 140

t

ut

OFFON

Introduction The optimal control problem Min-energy feedback control Results

Results: linearized N-S equations

The temporal evolution of the frequency and growth rate iscompared with the eigenvalue !

The Strouhal number: St = fD/U compared to St = !r/2#

The growth rate: $ = ddt log(u(t)) compared to !i

Test case: Re = 55, control is turned on at t = 18

0.12

0.122

0.124

0.126

0.128

0.13

0.132

0.134

0 20 40 60 80 100 120 140

t

St

LIN!u

r /2"

-0.02

-0.015

-0.01

-0.005

0

0.005

0.01

0.015

0.02

0 20 40 60 80 100 120 140

t

!i

LIN!u

i−!u

i

Page 14: Feedback stabilization of the wake behind a steady cylinder · pairs ofequalima ginary and opposite realpart.) T his linear O D E is a tw o-point boundary value problem and ma y be

Introduction The optimal control problem Min-energy feedback control Results

Results: N-S equations

Vorticity: No Control

NoControl

Vorticity: With Control

WithControl

Screen Screen

Introduction The optimal control problem Min-energy feedback control Results

Results: N-S equations

The temporal evolution of the lift (CL) and drag (CD) coe!cientswith and without control

CL goes to zero as the control is applied

CD goes towards value for steady state solution (-2.5%)

Control, so far, verified to work up to Re = 75

Test case: Re = 55, control is turned on at t = 0

-0.08

-0.06

-0.04

-0.02

0

0.02

0.04

0.06

0.08

0 50 100 150 200

t

CL

OFFON

1.4

1.41

1.42

1.43

1.44

1.45

0 50 100 150 200

t

CD

OFFON

STEADY

Page 15: Feedback stabilization of the wake behind a steady cylinder · pairs ofequalima ginary and opposite realpart.) T his linear O D E is a tw o-point boundary value problem and ma y be

Introduction The optimal control problem Min-energy feedback control Results

Conclusions

The solution of the minimal-energy stabilizing controlfeedback problem can be written in terms of the unstable lefteigenvectors only.

A practical algorithm to do so has been devised and tested onthe cylinder wake.

An optimal controller using rotational oscillations as actuatorhas been tested. The “pole assignment” work, and the controlworks on the full non-linear system (at least up to Re = 75)

Ongoing developments

Continue to analyse the Re dependence for this type offeedback control

Test the control on systems with more unstable modes.

Introduction The optimal control problem Min-energy feedback control Results

N-S versus LST

Comparing results obtained with N-S and Linear Stability Theory.

period

6

6.5

7

7.5

8

8.5

9

55 60 65 70 75 80 85 90 95 100

NS

EV

t

T

Strouhal number

0.115

0.12

0.125

0.13

0.135

0.14

0.145

0.15

0.155

0.16

0.165

0.17

55 60 65 70 75 80 85 90 95 100

NS

EV

t

St