TOWARDS a UNIFIED FRAMEWORK for NONLINEAR CONTROL with LIMITED INFORMATION Daniel Liberzon...

25
TOWARDS a UNIFIED FRAMEWORK for NONLINEAR CONTROL with LIMITED INFORMATION Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer Eng., Univ. of Illinois at Urbana-Champaign 1 of 15 shop on Control and Optimization, UIUC, Dec 5, 2007

Transcript of TOWARDS a UNIFIED FRAMEWORK for NONLINEAR CONTROL with LIMITED INFORMATION Daniel Liberzon...

Page 1: TOWARDS a UNIFIED FRAMEWORK for NONLINEAR CONTROL with LIMITED INFORMATION Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer.

TOWARDS a UNIFIED FRAMEWORK for

NONLINEAR CONTROL with

LIMITED INFORMATION

Daniel Liberzon

Coordinated Science Laboratory andDept. of Electrical & Computer Eng.,Univ. of Illinois at Urbana-Champaign

1 of 15Workshop on Control and Optimization, UIUC, Dec 5, 2007

Page 2: TOWARDS a UNIFIED FRAMEWORK for NONLINEAR CONTROL with LIMITED INFORMATION Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer.

Plant

Controller

INFORMATION FLOW in CONTROL SYSTEMS

2 of 15

Page 3: TOWARDS a UNIFIED FRAMEWORK for NONLINEAR CONTROL with LIMITED INFORMATION Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer.

INFORMATION FLOW in CONTROL SYSTEMS

• Limited communication capacity

• many control loops share network cable or wireless medium

• microsystems with many sensors/actuators on one chip

• Need to minimize information transmission (security)

• Event-driven actuators2 of 15

Page 4: TOWARDS a UNIFIED FRAMEWORK for NONLINEAR CONTROL with LIMITED INFORMATION Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer.

[Brockett, Delchamps, Elia, Mitter, Nair, Savkin, Tatikonda, Wong,…]

• Deterministic & stochastic models

• Tools from information theory

• Mostly for linear plant dynamics

BACKGROUND

Earlier work:

• Unified framework for

• quantization

• time delays

• disturbances

Our goals:

• Handle nonlinear dynamics

3 of 15

Page 5: TOWARDS a UNIFIED FRAMEWORK for NONLINEAR CONTROL with LIMITED INFORMATION Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer.

Caveat:

This doesn’t work in general, need robustness from controller

OUR APPROACH

(Goal: treat nonlinear systems; handle quantization, delays, etc.)

• Model these effects via deterministic error signals,

• Design a control law ignoring these errors,

• “Certainty equivalence”: apply control,

combined with estimation to reduce to zero

Technical tools:

• Input-to-state stability (ISS)

• Lyapunov functions

• Small-gain theorems

• Hybrid systems

4 of 15

Page 6: TOWARDS a UNIFIED FRAMEWORK for NONLINEAR CONTROL with LIMITED INFORMATION Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer.

QUANTIZATION

Encoder DecoderQUANTIZER

finite subset

of

is the range, is the quantization error bound

For , the quantizer saturates

Assume such that

is partitioned into quantization regions

5 of 15

Page 7: TOWARDS a UNIFIED FRAMEWORK for NONLINEAR CONTROL with LIMITED INFORMATION Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer.

QUANTIZATION and ISS

6 of 15

Page 8: TOWARDS a UNIFIED FRAMEWORK for NONLINEAR CONTROL with LIMITED INFORMATION Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer.

QUANTIZATION and ISS

quantization error

Assume

6 of 15

Page 9: TOWARDS a UNIFIED FRAMEWORK for NONLINEAR CONTROL with LIMITED INFORMATION Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer.

Solutions that start in

enter and remain there

This is input-to-state stability (ISS) w.r.t. measurement errors

In time domain: [Sontag ’89]

QUANTIZATION and ISS

6 of 15

quantization error

Assume

cf. linear:

Page 10: TOWARDS a UNIFIED FRAMEWORK for NONLINEAR CONTROL with LIMITED INFORMATION Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer.

LINEAR SYSTEMS

Quantized control law:

9 feedback gain & Lyapunov function

Closed-loop:

(automatically ISS w.r.t. )

7 of 15

Page 11: TOWARDS a UNIFIED FRAMEWORK for NONLINEAR CONTROL with LIMITED INFORMATION Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer.

DYNAMIC QUANTIZATION

8 of 15

Page 12: TOWARDS a UNIFIED FRAMEWORK for NONLINEAR CONTROL with LIMITED INFORMATION Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer.

DYNAMIC QUANTIZATION

– zooming variable

Hybrid quantized control: is discrete state

8 of 15

Page 13: TOWARDS a UNIFIED FRAMEWORK for NONLINEAR CONTROL with LIMITED INFORMATION Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer.

DYNAMIC QUANTIZATION

– zooming variable

Hybrid quantized control: is discrete state

8 of 15

Page 14: TOWARDS a UNIFIED FRAMEWORK for NONLINEAR CONTROL with LIMITED INFORMATION Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer.

Zoom out to overcome saturation

DYNAMIC QUANTIZATION

– zooming variable

Hybrid quantized control: is discrete state

8 of 15

Page 15: TOWARDS a UNIFIED FRAMEWORK for NONLINEAR CONTROL with LIMITED INFORMATION Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer.

After ultimate bound is achieved,recompute partition for smaller region

DYNAMIC QUANTIZATION

– zooming variable

Hybrid quantized control: is discrete state

Can recover global asymptotic stability

ISS from to ISS from to small-gain conditionSwitching strategy based on dwell time or quantized state

8 of 15

Page 16: TOWARDS a UNIFIED FRAMEWORK for NONLINEAR CONTROL with LIMITED INFORMATION Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer.

9 of 15

EXTERNAL DISTURBANCES [Nešić-L]

State quantization and completely unknown disturbance

Page 17: TOWARDS a UNIFIED FRAMEWORK for NONLINEAR CONTROL with LIMITED INFORMATION Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer.

EXTERNAL DISTURBANCES [Nešić-L]

State quantization and completely unknown disturbance

9 of 15

Page 18: TOWARDS a UNIFIED FRAMEWORK for NONLINEAR CONTROL with LIMITED INFORMATION Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer.

Issue: disturbance forces the state outside quantizer range

Must switch repeatedly between zooming-in and zooming-out

EXTERNAL DISTURBANCES [Nešić-L]

State quantization and completely unknown disturbance

Developed two different strategies:

• continuous-time vs. sampled-data implementation

• Lyapunov-based vs. trajectory-based analysis

Result: for linear plant, can achieve ISS w.r.t. disturbance

(ISS gains are nonlinear although plant is linear [cf. Martins])9 of 15

Page 19: TOWARDS a UNIFIED FRAMEWORK for NONLINEAR CONTROL with LIMITED INFORMATION Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer.

10 of 15

QUANTIZATION and DELAY

QUANTIZER DELAY

Architecture-independent approach

Based on the work of Teel

Page 20: TOWARDS a UNIFIED FRAMEWORK for NONLINEAR CONTROL with LIMITED INFORMATION Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer.

QUANTIZATION and DELAY

Assuming ISS w.r.t. actuator errors:

In time domain:

where

11 of 15

Page 21: TOWARDS a UNIFIED FRAMEWORK for NONLINEAR CONTROL with LIMITED INFORMATION Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer.

SMALL – GAIN ARGUMENT

hence

ISS property becomes

if

then we recover ISS w.r.t. [Teel ’98]

Small gain:

12 of 15

Page 22: TOWARDS a UNIFIED FRAMEWORK for NONLINEAR CONTROL with LIMITED INFORMATION Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer.

FINAL RESULT

Need:

small gain true

13 of 15

Page 23: TOWARDS a UNIFIED FRAMEWORK for NONLINEAR CONTROL with LIMITED INFORMATION Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer.

FINAL RESULT

Need:

small gain true

13 of 15

Page 24: TOWARDS a UNIFIED FRAMEWORK for NONLINEAR CONTROL with LIMITED INFORMATION Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer.

FINAL RESULT

solutions starting in

enter and remain there

13 of 15

Can use “zooming” to recover global asymptotic stability

Need:

small gain true

Page 25: TOWARDS a UNIFIED FRAMEWORK for NONLINEAR CONTROL with LIMITED INFORMATION Daniel Liberzon Coordinated Science Laboratory and Dept. of Electrical & Computer.

RESEARCH DIRECTIONS

• Modeling uncertainty (robust, adaptive control)

• Disturbances and coarse quantizers [Sharon-L]

• Moving away from estimation-based approach

• Quantized output feedback

• Performance-based design

• Vision-based control and other applications

• how many variables to transmit?

• nonlinear ISS observer design

15 of 15

http://decision.csl.uiuc.edu/~liberzon