Systematic model reduction techniques for chemically...

74
Systematic model reduction techniques for chemically reactive systems Eliodoro Chiavazzo , Pietro Asinari Multi-scale Modeling Lab, Department of Energetics, Politecnico di Torino PHD COURSE: COMPLEX SYSTEMS IN ENGINEERING SCIENCES, Organizer: Prof. Nicola Bellomo, Deparment of Mathematics, Politecnico di Torino 21°-22° November 2011.

Transcript of Systematic model reduction techniques for chemically...

Page 1: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

Systematic model reduction techniques for chemically reactive

systems Eliodoro Chiavazzo, Pietro Asinari

Multi-scale Modeling Lab, Department of Energetics, Politecnico di Torino

PHD COURSE: COMPLEX SYSTEMS IN ENGINEERING SCIENCES, Organizer: Prof. Nicola Bellomo, Deparment of Mathematics, Politecnico di Torino 21°-22° November 2011.

Page 2: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

Brief outline • Detailed chemical kinetics and governing equations of reactive

flows;

• Combustion in homogeneous reactors;

• Model reduction and low dimensional manifolds;

• Invariant manifolds and construction techniques;

• A few words on model reconstruction for biological systems

• More references

Page 3: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

Motivations • Energy conversion systems are today dominated and will for several

decades depend very significantly on combustion processes (still around 80%).

• Particularly in transportation systems (internal combustion engines and gas turbines), efficient and “near-zero” pollutant combustion processes can only be designed if complex reaction kinetics and their interaction with thermofluidics can be investigated and understood in depth.

Page 4: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

The simplest fuel: H2

OHOH 2222

1

9 species, 21 reactions

+ Large disparity of time scales

Page 5: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

Elementary reactions

OHHHO 2

• Detailed mechanisms aim at describing a chemical reaction at a more

fundamental level as it results from a large number of reversible collision

processes (elementary reaction steps) involving a usually remarkably large

number of chemical components (species):

O

2H

O

OH

5

Page 6: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

Detailed chemistry modeling • The detailed description of combustion chemistry of practical fuels

(typically blends of higher hydrocarbons) can include hundreds of species participating in thousands of reactions.

)22(2 nnHC

Page 7: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

Reactive flows: Governing equations

0

i

i

uxt

Conservation of mass,

NkYVVuxt

Ykkik

c

ii

i

k ,...,1,,

t

pTVvhY

t

h

k

kkk

Conservation of species

Conservation of energy

i

j

j

i

ji

ji

j

i

x

u

x

u

xx

puu

xt

u

Conservation of momentum

RTp Eq. of state

N. Fields at each grid node: Nf=3+D+N

Bell et al., PNAS 2005

N. of equations to solve at each time step:

f

D

x NN

Ex. dof107.1100256 93

Page 8: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

A few examples: Chaotic laminar flames

Yu et al., MCS, Cagliari (Italy) 2011

Evolution of corrugated flame front:

Altantzis et al., Proc. Comb. Inst., 2011

Cellular structure of flames:

Page 9: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

A few examples: Oscillating laminar flames

Pizza et al., Comb. Flame., 2008

Page 10: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

Kerkemeier, PhD thesis ETH Zurich, 2011

A few examples: Turbulent flames Auto-ignition in turbulent non-premixed flows (hydrogen injected in co-flowing air, run on circa 130.000 CPUs):

Page 11: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

Time scales in combustion

11

Page 12: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

12

Starting point: Homogeneous reactors

NkWdt

dYkk

k ,...,1,1

N

k

kkk

p

WTHcdt

dT

1

1

Autonomous Dynamical system are to be solved. Two main drawbacks: 1) The number of degrees of

freedom is typically huge!

2) The dynamics is characterized by a wide range of time scales. This significantly hinders the numerical solution of them (due to stiffness)

• Those problems have been pointed out from the very beginning, and several methods aiming at simplifying the solution of the above governing equations have been investigated;

• Among others, the very popular techniques are surely: 1) the Quasi-Steady-State-Assumption – QSSA – (for fast species) and 2) the Partial Equilibrium Approximation (for fast reactions);

• Although those methods present a simple implementation, they are often out of reach for non-experts and not automated!!! (Chemist’s intuition needed).

Page 13: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

13

Thermodynamic Lyapunov function

H,P,ϕ: fixed

2H 2O

OH2

H

Physical system: Homogeneous reactive mixture

Autonomous Dynamical system: Kinetic equations for a batch reactor

NkWdt

dYkk

k ,...,1,1

N

k

kkk

p

WTHcdt

dT

1

1

The Lyapunov function candidate L with respect to the above kinetic system of equations is suggested by the second law of thermodynamics. L can be constructed on the basis of the specific mixture-averaged entropy (mass based):

0~

0~

lnln1~

1 L

L

P

PRXRTSX

WSL

N

k ref

kkk

eq

Page 14: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

14

Elemental constraints • In a given batch reactor, the equilibrium point is unique. Notice that, the

kinetic system of equations typically has several zeros, however only one is

physically acceptable (positive concentrations):

• Due to conservation of the number of moles of “d” different atoms involved

in the reaction, elemental linear constraints have to be fulfilled:

• Hence, another Lyapunov function candidate G can be written as follows:

0Y,,,YYY eq

1 fYYfdt

dN

dCYW

dN

k

k

k

k,...,1,

1

0Y~

Y~ eq

,

eq

11

LddLYW

dClLL PHk

N

k k

kd

Page 15: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

15

Phase-Space

• In homogeneous reactive mixtures, the state evolves in N-dimensional

phase space (N is the number of chemical species), however it is only a

sub-set of

• The reason for that are the elemental constraints (equality constraints) and

the positivity of the concentrations (inequality constraints) due to the fact

that negative concentrations are physically not acceptable:

N

0

0

,...,1,0

1

1

N

N

k

k

k

k

Y

Y

dCYW

d

OHY2

OY

2HY

Phase-Space: Convex N-dimensional Polytope (hyper-polyhedron)

Steady-State

Page 16: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

16

Simplification of a description 1/2

OHY2

OY

2HY

Steady-State

Initial conditions

NkWdt

dYkk

k ,...,1,1

N

k

kkk

p

WTHcdt

dT

1

1

Detailed description of the chemical phenomenon:

Simplified description of the same phenomenon (valid after a “long time”):

0Y ,

eq PHdL

2H 2O

OH2

HH,P,ϕ: fixed

Page 17: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

17

Simplification of a description 2/2

NkWdt

dYkk

k ,...,1,1

N

k

kkk

p

WTHcdt

dT

1

1

Original problem: ODE’s system

Under which condition can we trust the above simplification (thermodynamic description)? t

• Thermodynamic data is reliable after a very long time!!!

• Finding the equilibrium state can be regarded as a simple model

reduction technique!!!

• However, the validity condition may be a rather restricting one!!!

0Y ,

eq PHdL

Reduced problem: Non-linear algebraic system

Page 18: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

Dr Eliodoro Chiavazzo 18

Can we generalize that idea? • A useful generalization of the latter model reduction technique is

accomplished assuming the existence of hierarchical structures in the

phase-space due to disparate time scales in the dynamics, as exemplified

in the following cartoon: Arbitrary

initial conditions

Two-dimensional surface (2D manifold)

One-dimensional curve (1D manifold)

Steady State (0D manifold)

Solution trajectory (say 3D)

t

0tLOW DIMENSIONAL MANIFOLDS:

Page 19: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

19

Low dimensional manifolds • Constructing low dimensional manifolds (of various dimensions) allows to

generalize the idea of model reduction, whereas the higher the manifold

dimension the more time-scales are included in the reduced model.

• The entire solution trajectory is the detailed model (dashed line): full model

= maximal computational effort = best accuracy

0D manifold, valid for: t

00 tt

1tt

2tt

...210 ttt

1D manifold, valid for: tt2

2D manifold, valid for: But necessary for:

tt121 ttt

Full dimension (3D), valid for: But necessary for:

0tt

10 ttt

Page 20: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

20

Reduced degrees of freedom • In general, a state can evolve in the full phase-space (N-dimensions = N

degrees of freedom (DoF) to describe a given phenomenon),

• However, the occurrence of low dimensional manifolds (after a given time)

forces the states to evolve in low dimensional subspaces, which can be

therefore described by a fewer number “M” of degrees of freedom:

Hopefully M<<N.

• Fewer degrees of freedom to take into account means both a less

computational effort and a better understanding of a complex phenomenon,

without renouncing (after a given time) to a good accuracy.

Elapsed time 0 1t2t

Full model with N=3 DoF

Dynamics with M=2 DoF, 2D manidold

Dynamics with M=1 DoF, 1D manidold

M=0 DoF, Steady state

• Model reduction techniques typically operate a cut with respect to the

time scales to be represented.

Page 21: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

21

General strategy • The problem of simplification of large ODE’s system (system of kinetic

equation) turns out to be the computation of low dimensional manifolds in

the phase-space:

N DoF N-1 DoF 1 DoF

“M=0” easy: Equilibrium point (Thermodynamic description)

Construction of a low dimensional manifold with a given dimension “M”.

Very fast time scales

Fast time scales

Intermediate Time scales

Page 22: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

22

Fast/Slow motions have different directions in the phase-space:

1x

2x

Initial condition

Steady state

Separation of motions

Page 23: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

23

How do we compute low dimensional manifolds for model reduction in

combustion?

Beyond Equilibrium (0D): 1-2-3…ND?

N DoF N-1 DoF 1 DoF

Fast time scales

Intermediate Time scales

0 Elapsed time

Page 24: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

Quasi-Equilibrium manifold (QEM)

Dr Eliodoro Chiavazzo 24

1Y

2Y

Based on the implication due to: Motion separation + Lyapunov function

0t

1t

2t

3t

0t

1t

2t

3t

...

...

3210

3210

tLtLtLtL

tLtLtLtL

The conseguence is: The minimum of L constrained to the fast direction gives a point “around” the low dimensional manifold

0 1 2 3 3 2 1 0

Fast direction

L

Page 25: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

Dr Eliodoro Chiavazzo 25

Iso-lines of the Lyapunov function L (convex function)

1Y

2Y

The geometry of a QEM When searching for a QEM, we guess the fast directions and assume that have fixed inclination in the full phase-space:

The locus of the constrained minima is called QEM

Fast directions are assumed to be known and fixed in the entire phase-space

2N

Page 26: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

Dr Eliodoro Chiavazzo 26

Constrained equilibrium point of L or QEM point

Does it remind you anything?

1Y

2Y

2211 YY

CE

STATESTEADY

• The blue dashed line represents an

ideal fast direction;

• The blue line can be interpreted as

the locus where the following linear

combination has the constant value ξ:

• The quantity ξ is a “slow variable”

because it does not change during

fast movements;

• In general, more constraints can be

imposed.

• We need to guess one inclination of

the fast direction (1D manifold) and

fix the slow variable ξ :

2211

1

YYYN

k

kk

2N

21,

Page 27: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

27

How do we find a QE-point?

MjY

dCYW

dts

L

N

k

j

k

j

k

N

k

k

k

k

PH

,...,1,

,...,1,..

minimum~

1

1

,

Mathematically speaking, a QE-point is the solution of the problem:

N

k ref

kkk

eq

P

PRXRTSX

WSL

1

lnln1~

This ensures that the number of atoms are conserved!!!

This imposes that the slow variables ξj are conserved during the fast motions

The locus of all the QE-points is called QE-manifold (considering ξj as variable parameters). The number “M” of additional constraints dictates the dimension of the QE-manifold

How do we solve the above problem?

k

N

k

j

k

jM

j

jk

N

k k

kd

YlYW

dClLL

1111

~

Global minimization of the following Lagrange function:

Page 28: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

28

RCCE parameterization • A M-dimensional QE-manifold can be computed as soon as the following M

parameterization vectors are specified:

• In combustion problems, it is rather popular the RCCE (Rate Controlled

Constrained Equilibrium) parameterization (by Keck & Gillespie, 1971),

where the above vectors are linked to known slow variables.

• For example, the total number of moles is a slow variable due to the fact

that recombination/dissociation reactions (that make the total number of

moles to change) are quite slow:

M

N

M

N

,,

,,

1

11

1

N

N

N

k k

k

WWW

Y 1,,

1,,

1

11

1

1

1

Page 29: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

29

Spectral Quasi Equilibrium • RCCE parameterization requires that slow quantities are know in advance

(there are some recipes).

• A more systematic parameterization is given by the Spectral Quasi

Equilibrium SQE (by Chiavazzo, Gorban, Karlin, 2007):

0Y,,,YYY eq

1 fYYfdt

dN

N

NN

N

Yf

Yf

Yf

Yf

J

1

1

1

1

System of kinetic equations:

Jacobian matrix J of the above system:

• According to the SQE, the parameterization vectors are given by the left

eigenvectors of the Jacobian matrix evaluated at the equilibrium point:

eqYJ

Page 30: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

30

Slow Invariant Manifolds – SIM and construction techniques (for homogeneous reactors)

Page 31: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

31

• Manifolds suitable for model reduction collect all the trajectories after a short

relaxation (fast motion);

• After reaching such manifolds, fast dynamics is exhausted and only the slow

dynamics is left;

• Hence, those manifolds can be termed as low-dimensional manifolds of the

slow motions;

• Trajectories, once attracted to the manifold, do not leave any more the manifold

• The latter properties is typically referred to as “Invariance Condition”:

Invariance condition

Fast relaxation toward the manifold

Slow dynamics toward the steady state (always on the manifold)

Slow Invariant Manifolds (Best for Model Reduction)

Page 32: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

32

Invariant manifolds • A given manifold is termed invariant with respect to a dynamical system if,

starting from any of its points (as initial condition at time t=0), the solution

trajectory proceeds along the manifold without leaving it any longer at a future

time t>0:

0Y,,,YYY eq

1 fYYfdt

dN

Initial Condition

Steady state

2D invariant manifold with respect to the dynamical system

How do we check if a given manifold is invariant?

Page 33: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

33

Modern model reduction methods • Various modern model reduction methods are all about techniques aiming at

accurately compute slow invariant manifolds - SIM;

• Constructing SIM is everything but a simple task;

• Usually, only approximations are computed;

• Quasi-Equilibrium Manifolds are rough approximations of the SIM, since they

are typically not invariant:

Yf

Non invariant manifold:

Tangent space

T~

Tf~

Y

Yf

Invariant manifold:

T~

Tf~

Y

Page 34: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

34

Using the invariance condition

MODEL REDUCTION OF N-dimensional systems

SEARCHING FOR SLOW-INVARIANT MANIFOLDS

HOW CAN WE FIND SIMs? • SIM are some very special INVARIANT MANIFOLDS;

• Hence, an option is to write the invariance condition in a form of an equation e

try to solve it: INVARIANCE EQUATION;

• However, this is not a trivial task because INVARIANCE IS ONLY

NECESSARY CONDITION FOR SIM!!!

• Notice, for example, that all trajectories are 1D invariant manifolds

• SIM are only a small subset of invariant manifolds.

• Model reduction is understood as the construction of SIM in the phase-space:

Invariant manifolds SIM

Page 35: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

Davis-Skodje toy-model

2

1

2

112

2

11

1

1

y

yyy

dt

dy

ydt

dy

• Simple system with two degrees of freedom (y1,y2). A reduced description with

one degree of freedom is required:

• The Davis-Skodje example is characterized by a Slow Invariant Manifold (SIM)

whose analycal form is explicitly known, thus can be used for testing SIM

construction methods.

1

35

Page 36: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

Singularly perturbed systems

• The Davis-Skodje example is a classical example of singularly perturbed systems

(derivatives multiplied with small number) and can be rewritten as follows:

11

2

1

1

1

12

2

11

11 y

y

y

yy

dt

dy

ydt

dy

• At a glance, we expect that if ε is small, then the variable y2 will be

characterized by a fast dynamics compared to y1. In other words, the

dynamics of y2 is expected to be slaved by the dynamics of y1 on a larger time

scale.

36

Page 37: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

Slaving and invariance condition

• The idea of slaving can be elucidated by saying that fast variables have not

independent dynamics in time. Mathematically speaking, this can be expressed

as follows:

tyyty 122

• Hence, time derivatives of fast variables can be computed applying the chain

rule (and recording the first equation of the D-S system):

1

21

1

1

22

dy

dyy

dt

dy

dy

dy

dt

dy

• Upon substitution in the second equation of the D-S system:

21

1

1

12

1

21

11 y

y

y

yy

dy

dyy

INVARIANCE EQUATION

37

Page 38: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

Invariance condition 1/2

21

1

1

12

1

21

11 y

y

y

yy

dy

dyy

• The invariance equation (IE) states that: For any dependence of the slow

variable y1, function y2(y1) has to be such that the above equation is satisfied;

• Importantly, in the invariance equation there are no more time-derivatives;

• A certain function y2(y1) has to be found to describe the SIM;

• The latter function has to satisfy the IE at least up to some orders of accuracy;

• The IE itself does not provide the unknown function y2(y1), due to the fact that

there are simply too many solutions. Additional hypothesis are to be done

before trying to solve it: IE only necessary condition!!!

38

Page 39: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

Invariance condition 2/2

f

1y

2y

12: yy does not satisfy the invariance condition

21, yyy

yfdt

dy

12: yydoes satisfy the invariance condition

f

1y

2y

39

Page 40: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

Chapman-Enskog solution to the IC

21

1

1

12

1

21

11 y

y

y

yy

dy

dyy

,...,2,1,0...,... )(

2

)2(

2

2)1(

2

)0(

22 nyyyyy nn

• Chapman-Enskog expansion is a perturbation method that attempts a solution

of the invariance condition, by exploiting the smallness of ε and assuming the

following shape of the unknown solution function y2(y1):

• Where:

tyyy nn

1

)(

2

)(

2

21

1

1

1)2(

2

2)1(

2

)0(

2

)2(

2

2)1(

2

)0(

2

1

111

......y

y

y

yyyyyyy

dy

dy

• Upon substitution into the invariance condition:

• IC:

40

Page 41: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

Dynamics at different scales • Grouping together terms of the same order in ε:

1

1)0(

2

0

10:

y

yy

1

1)0(

21 y

yy

2

1

1)1(

2

1

)0(

21

1

1:

y

yy

dy

dyy 0)1(

2 y

)(

2

1

)1(

21: n

nn y

dy

dyy

ny n 0)(

2

• The full summation can be computed and it gives the exact SIM equation (very special case, typically we stop after a few terms):

1

1

0

)(

221 y

yyy

n

nn

Exact expression for the SIM 41

Page 42: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

Trajectories solutions in the phase-space

• Solution trajectories (blue circles) in the phase-space (y1,y2) of the D-S

example with ε=1/50 – by Euler scheme with constant dt=5e-3:

• Asymptotic solution y2(y1) (black curve): 1

12

1 y

yy

2

1

2

112

2

11

1

1

y

yyy

dt

dy

ydt

dy

50

42

Page 43: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

CE method for combustion

• In combustion, CE method is typically adopted for analysis purposes of fairly

simple systems, mainly due to the fact that small parameters are not explicitly

expressed in the RHS of dynamical systems;

• Usually, dynamical systems are regarded as a black box, hence there is a need

of automated procedure for constructing numerical approximations of the SIMs.

2H 2O

OH2

HH,P,ϕ: fixed

NkWdt

dYkk

k ,...,1,1

N

k

kkk

p

WTHcdt

dT

1

1

Chemical system Black box (from commercial codes)

f Automated

reduction

Desired technological chain for realistic systems:

Page 44: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

Method of Invariant Manifold

44

A.N. Gorban I.V. Karlin

• This approach is about an alternative method for

solving the invariance equation. Introduced (for

chemical kinetics) in 2004 by Gorban and Karlin

How do we write the invariance equation in a general form?

T~ fP

~

f • Define a Projector operator (matrix)

onto the tangent space, such that:

fPfPPPP

TfP

~~~~~

~~

2

• General form of the invariance equation:

0~

fPfTangent space

Leicester University (UK)

ETH-Zurich

Page 45: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

45

General form of the IE • In general, invariance can be imposed by introducing a projector operator onto

the tangent space and writing down the following condition:

T~

f

iY

fP~

fPf ~

0~

cfcPcf

Example: It does not satisfy the invariance equation (local condition):

jY

c

NYYc ,,1

0~

fPf

The idea here is to solve the (non-linear) Invariance equation in order to find SIM

How do we solve non-linear equations?

Page 46: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

Local correction

Initial guess – Typically non-invariant manifold (E.G. QE-Manifolds)

Slow invariant manifold – to be found

Intermediate iteration

Steady state

c

0c1c

46

Iterative solution of the IE • In the same spirit of the Newton-Raphson method for solving non-linear

equations, The Method of Invariant Manifold (MIM) operates a linearization of

the Invariance Equation (non linear because of both the Projector and the

vector field) around an initial guess and try to solve it.

0~~ 00000 ccJcfcPccJcffPf

Incomplete linearization of the IE:

Plus a solvability condition:

0~ 0 ccP

Plus the conservation of atoms

dCYW

dN

k

k

k

k,...,1,0

1

Page 47: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

47

The MIM algorithm 1/2

0

0~

0~

cD

cP

ccJcfcPccJcf nnnnn

N

dNd

N

N

nn

W

d

W

d

W

d

W

d

Dccc

1

1

1

1

11

1 ,

• Linear system to solve with respect to cn+1

Iterations terminate when the

invariance defect is small:

cfcfcPcffc ~

Page 48: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

48

The MIM algorithm 2/2

0

0~

0~

(*)

cD

cP

ccJcfcPccJcf nnnnn

• Algebraic system of equations to solve at each node of the manifold:

• It proves convenient to introduce the following vectors:

ib

Basis of the subspace: DP ker~

ker

• The last two equations of (*) are automatically fulfilled if we impose:

i

h

i ibc

1

• The sistem (*) can be recast as follows by scalar product with bk, to be solved

with respect to the coefficients δi:

hwith Being the dimension of DP ker~

ker

hkbJPbbJP kki

h

i i ,...,1,~

1~

11

Page 49: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

49

Construction of the projector: An example (1D)

u

u

uu

ˆ

Unity vector:

T~

f

fP~

uuffP ˆˆ~

Euclidean projector:

yyxy

yxxx

uuuu

uuuuP

ˆˆˆˆ

ˆˆˆˆ~ yx uuu ˆ,ˆˆ Tensorial notation (N=2):

Tu~

Page 50: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

50

How do we construct an Euclidean 2D projector?

T~

1u

2u

f

0

~

~

21

2

1

uu

Tu

Tu

2D tangent space (hyper-plane)

Gram-Schmidt ortho-normalization:

11

21

112121

122

11

0

uu

uu

uuuuuu

uuu

uu

2

22

1

11

ˆ,ˆu

uu

u

uu

2211ˆˆˆˆ

~uufuuffP

Page 51: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

Relaxation of the Film Equation (FE)

51

A.N. Gorban I.V. Karlin U. Maas

• The Film equation is dynamical equation

written for manifolds, aiming at refining an

initial non-invariant manifold. Used by Maas

& Collaborators for Combustion problems,

and further developed by Gorban and Karlin.

12: YY

fPfdt

d ~

1Y

2Y

Initial guess – Typically non-invariant manifold (E.G. QE-Manifolds)

Hint: Write by yourself an explicit first-order scheme for solving the FE (e.g. for the Davis-Skodje model)!

SIM

Leicester University (UK)

ETH-Zurich University of Karlsruhe (Germany)

Page 52: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

Example: H2 + Air

D1 D2

Chiavazzo, PHD thesis, ETH-Zurich 2009

Reduced system to solve (not closed):

MY

ik YfMPt

NqM Matrix, q<<N

SIM do provide closures for reduced systems.

NiYft

Yi

k ,...,1,

Detailed system:

Page 53: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

Spectral decomposition of J 1/2

53

U. Maas S.B. Pope

• The Intrinsic Low dimensional Manifold (ILDM) method is a very popular method in combustion (introduced in 1992 by Maas and Pope) for computing accurate approximations of SIM, though typically NOT INVARIANT!!!

Basic idea: The slow invariant manifolds (SIM) represent the locus of points “c” in the phase-space where we observe very strong contractions along some directions (fast directions) compared to other transversal directions (slow directions along the SIM):

c

c

fcc

fc

Perturbation along the fast direction:

ffff

ff

cccJcfccf

ccJcfccf

The fast direction is almost an eigen-direction of the Jacobian matrix “J” evaluated at “c”.

University of Karlsruhe (Germany)

Cornell University (NY - US)

Page 54: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

54

c

scc

sc

c

Perturbation along the slow direction:

ssss

ss

cccJcfccf

ccJcfccf

0 sf

The slow direction (SIM) is “almost” an eigen-direction of the Jacobian matrix “J” evaluated at “c”. Due to the disparate time scales, there exists a separation between “fast” and “slow eigenvalues”:

• The above idea can be generalized by noticing that it can be established a hierarchy of eigen-vectors on the basis of the corresponding eigen-values of J:

NMNMN vvvv

,,,,, 11

011 NMNMN

Fast subspace Slow subspace

Spectral decomposition of J 2/2

Page 55: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

55

ILDM

c

• The ILDM approach divides the eigenvectors of the Jacobian matrix “J” in two

sub-groups: The first one identifies the slow sub-space, whereas the other

identifies the fast sub-space.

• By decomposing the vector field “f” into components of the fast- and slow-

subspace, the equation of the ILD-Manifold is found imposing that the fast

component is null:

f

slowf

fastf

slowfast fff

1v

2v

21 vvfff slowfastslowfast

0fast

ILDM condition:

Page 56: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

56

Non-Cartesian coordinate systems 1v

2v

1v

2v

f

How do we find the components in a Non-Cartesian coordinate system?

2

2

1

1 vvf

ijji vv

Let’s introduce the dual spaces as follows:

2211 vfvvfvf

Kronecker delta

Page 57: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

57

The ILDM equation

c

f

slowf

fastf

slowfast fff

1v

2v

21 vvf slowfast

00 1 fvfast

ILDM equation:

2211 vfvvfvf

ijji vv

Slow-Fast decomposition of the vector field “f”:

In general, let’s compute the matrix “Q” and its dual:

NMNMN vvvvQ

,,,,, 11

Fast Slow

slow

fast

N

MNQ

Q

v

v

v

Q

1

1

IQQ 1

0 fQ fast

ILDM equation:

Hint: Find the analytical ILDM of the Davis-Skodje model!

Page 58: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

CSP

58

H. Lam

Computational Singular Perturbation (CSP) method

D. Goussis Princeton University (NJ - USA)

?

• Similarly to ILDM, the CSP method looks for a decomposition into fast and slow

modes of the right-hand side of the kinetic equation system “f”:

0Y,,,YYY eq

1 fYYfdt

dN

MNf vvA

1

N x (N-M) Matrix of the fast vectors

NMNs vvA

1 N x M Matrix of the slow vectors

TMN

f vvB

1

(N-M) x N Dual of Af: IAB f

f

TNMN

s vvB

1

M x N Dual of Af: IAB s

s

fBAfBAf s

s

f

f

The four matrices are updated according to the CSP iterative algorithm, and the SIM equation is:

0fB f

Page 59: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

Lebiedz’s Method

59

D. Lebiedz University of Freiburg (Germany)

• This method is called Minimal Entropy Production

Trajectories (MEPT);

• It looks for approximations of SIM, and it typically

does not deliver the exact SIM;

• It has been introduced in 2004-2006;

• It is based on a variational problem: Minimization

of the Entropy production under constraints

0Y,,,YYY eq

1 fYYfdt

dN

MjY

dCYW

d

fdt

d

dt

N

k

j

k

j

k

N

k

k

k

k

t

t

f

,...,1,

,...,1,0

YY

Ymin

1

1

0

An approximate SIM is given by all solution trajectories that minimize an objective function (time integral of a function ϕ).

Two options have been adopted:

dt

Sd.1

fJdt

d

d

fd

dt

fdY

Y

Y.2

Entropy production

Trajectory Curvature

Atom conservation

Parameterization

Page 60: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

Kevrekidis’s method

60

I. Kevrekidis Princeton University (NJ - USA)

Reverse integration method:

Initial condition

SIM

• According to this approach, we let a system relax from an arbitrary initial condition;

• After some time, the trajectory is expected to land on the SIM (non simple to check it);

• From this point on (yellow), we can integrate the system backward and extend the manifold;

• Simple and fascinating idea, though with a quite tricky implementation when the dimension of the manifold is high;

• Still under investigations.

Forward integration

Backward integration Steady state

Page 61: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

ICE-PIC Method

61

S. B. Pope Cornell University (NY - USA)

Z. Ren

?

• This method is called: Invariant Constrained

Equilibrium edge PreImage Curve method (ICE-

PIC);

• This method is based on the notion of Quasi-

Equilibrium Manifold (Constrained Equilibrium

Manifold) with the RCCE parameterization and an

algorithm to improve it;

• It has been introduced in 2006 by Prof. Pope and

collaborators

QE-Manifold

Steady-State

Convex Polytope (Phase-Space) boundary

Back to the edge of the domain

Forward integration

CE-point

ICE-PIC point

• First, the Quasi-Equilibrium problem is solved and the CE-point found;

• Second, an appropriate boundary point “cbound” is found by the Preimage Curve Method;

• Finally, forward integration allows to find a much more accurate state than the CE point. boundc

Page 62: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

Relaxation Redistribution Method Yet another (and numerically stable) way of solving the Film equation of dynamics, and the problem of minimal reduced description (choice of the manifold dimension q):

Chiavazzo & Karlin, PRE 2011

Global construction in the Phase-Space: Local construction in the Phase-Space:

http://arxiv.org/PS_cache/arxiv/pdf/1011/1011.1618v2.pdf

http://arxiv.org/PS_cache/arxiv/pdf/1102/1102.0730v2.pdf

More info at:

fPfdt

d ~

Page 63: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

Minimal description: Example

63

Chiavazzo & Karlin, PRE 2011

Homogeneous reactor: Detailed vs reduced with variable dimension:

Page 64: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

Closure of reduced equations (flows)

FSIM for homogeneous reactor

Transport term

Chemistry term

iiY

Primitive variable

Collection of SIM for homogeneous reactor

Full dynamics (transport + chemistry)

Reduced dynamics (projection onto tangent)

Full dynamics

Page 65: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

Reduced description of reactive flows

NqiYm k

k

i

ki ,...,1, Reduced observables

NkYYYFt

Yikiik

k ,...,1,, 2

Species equations

Energy eq. + Momentum Eq. + Eq. of state

qkFt

kkk ,...,1,

Reduced species

equations

Energy eq. + Momentum Eq. + Eq. of state

REDUCTI ON

Typical strategy:

NOT CLOSED!

Closure provided by the collection of SIMs (typically stored in the form of a LUT)

Page 66: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

Example: Detailed vs Reduced

Fiorina et al, Comb. Theo. Model. 2003

(A) Detailed solution;

(B) Reduced solution.

Methane: 29 species, 300 reactions

Page 67: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

Example: Detailed vs Reduced

Gicquel et al, Comb. Theo. Model. 1999

13 species 2 species 13 species 2 species

Page 68: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

Biological systems • Biological systems are often characterized by several interacting agents (biological

network) and processes with disparate time scales;

• Sometimes, model reduction techniques may be reversed in order to construct models for describing time evolution of e.g. biological systems (Model reconstruction);

• The simplest instance of bio-network (Micaelis-Menten catalytic reaction):

Network:

Mechanism:

Kinetic model:

Page 69: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

An example

Schematics: Sugar from CO2 Modeling: Agents interacting in a network

Page 70: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

An approach to dissipative bio-systems

Basic assumption for dissipative bio-systems:

We assume that dynamics is described by a hyerarchy of relaxation processes towards low dimensional manifolds, and each process can be approximated by BGK (Bhatnagar–Gross–Krook) – like expressions:

Fasano, Chiavazzo, Asinari, Unpublished 2011

Gibbs free energy (ideal systems):

Dynamical system: Approximation of SIMs (QEM approximation):

Page 71: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

Parameter tuning

Chose parameters: Mi , That ensure minimal deviation from experimental data

min

Page 72: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

Mitogen-activated protein kinase (MAPK)

Optimized system:

Fasano, Master thesis, Politecnico Torino 2011

http://www.ebi.ac.uk/biomodels-main/

Page 73: Systematic model reduction techniques for chemically ...calvino.polito.it/fismat/poli/pdf/PhD_Courses/ModelReduction_Chiavazzo.pdfSystematic model reduction techniques for chemically

MAPK: Network inference

ii y

dt

dx