Stability Analysis and Application of Kalman Filtering ...

6
Stability Analysis and Application of Kalman Filtering with Irregularly Sampled Measurements Huazhen Fang and Raymond A. de Callafon Abstract— This paper analyzes the peak covariance stability properties of Kalman filtering for linear discrete-time systems with irregular time intervals for sampling of output measure- ments. Existing research on Kalman filtering with irregular sampling mostly builds on probabilistic description of sampling intermittence. In this work, we focus on the general case of irregular sampling without probabilistic assumptions. The obtained stability conditions show that the peak covariance stability is influenced by the eigenvalue distribution of the state matrix in the complex plane. The effectiveness of the analysis is illustrated via a simulation based study on ocean flow field estimation using submersible drogues that can measure position intermittently and acceleration incessantly. I. I NTRODUCTION The classical discrete-time KF is premised on the implicit assumption of regular sampling of the output measurements. However, it is sometimes unrealistic to obtain measurements regularly in a few situations. Especially in applications of process control, networked control systems, navigation and guidance, and ocean surveillance, irregular time sampling intervals are used to monitor a system. Thus the KF analysis under irregular time sampling has been given much emphasis recently. When irregular sampling occurs, boundedness of the es- timation error covariance in the KF has been studied exten- sively in the setting that the availability of measurements follows a stochastic process. It is common to employ an auxiliary binary random variable γ k : γ k =1 or 0 denotes the measurement is available or not at time instant k, respectively. The sequence {γ k } are usually considered to belong to either of the following two categories: Bernoulli process: γ k ’s are i.i.d. random variables, with the probability distribution of p(γ k = 1) = λ and p(γ k = 0) = 1 - λ. A lead has been taken in [1] with the conclusion that there exists a critical probability λ c . If λ>λ c , then the expectation of the resulting estimation error covariance P k is guaranteed bounded (given the usual stabilizability and detectability hypotheses), and divergent otherwise. Determination of the value of λ c is investigated in [2] and [3]. A novel probability-based metric is proposed in [4] to evaluate the KF performance. Specifically, the upper and lower bounds of Pr (P k M ) for a given M , are derived to assess the KF. H. Fang is with the Department of Mechanical & Aerospace Engineering, University of California, San Diego, CA 92093, USA R.A. de Callafon is with the Department of Mechanical & Aerospace Engineering, University of California, San Diego, CA 92093, USA [email protected] Two-state Markovian process: Another interesting exploration is to consider the Gilbert-Elliott channel model, in which {γ k } is modeled as a two-state Markov chain. Sufficient conditions are derived in [5] for the boundedness of the expectation of the peak estimation error covariance. Some less conservative results are obtained in [6], [7]. It is shown in [8] that the estimation error covariance of the KF with Markovian intermittent measurements has a power-law decay, with the critical probability derived. The following observations have motivated our research to develop results for KF with irregular time sampling schemes: Observation 1: Probability distributions for intermittent sampling are not easy to determine in practice. It is a big challenge to know the type of the probability distribution and the accurate probability values. Observation 2: Stochastic modeling may fail if the measurements are sampled irregularly but not randomly in many real-life applications. In this paper, we will study the KF under general irregular sampling without stochastic modeling. Irregular sampling has been examined in the literature on system identification and nonlinear predictive control, see [9]–[11]. For a continuous- time system, state observability from irregularly sampled measurements is discussed in [12] and [13]. However, it is noted that analysis of the discrete-time KF with general irregular sampling schemes has seldom been discussed. We will hence contribute to this topic in this paper through studying the boundedess conditions for the KF’s estimation error covariance. II. PROBLEM FORMULATION Consider a linear discrete-time system Σ d with the fol- lowing state equation: Σ d : x k+1 = Ax k + Bu k + w k (1) where A R n×n , B R n×p , x R n is the state vector, u R p is the input vector, and w R n is the process noise vector, which is white Gaussian with zero mean and covariance matrix Q 0. Here, the subscript k of a vector a k denotes the k-th sampling time instant, i.e., a k := a(kT s ), where T s is the standard sampling period. Sampling of the output measurement of Σ d is not regular in temporal scale. The sampling durations are not fixed but the integer multiples of T s . It is convenient to use the binary variable γ k to denote the availability of the measurement at time instant k. If the measurement is sampled, γ k =1; and γ k =0 2012 American Control Conference Fairmont Queen Elizabeth, Montréal, Canada June 27-June 29, 2012 978-1-4577-1094-0/12/$26.00 ©2012 AACC 4795

Transcript of Stability Analysis and Application of Kalman Filtering ...

Page 1: Stability Analysis and Application of Kalman Filtering ...

Stability Analysis and Application of Kalman Filtering with IrregularlySampled Measurements

Huazhen Fang and Raymond A. de Callafon

Abstract— This paper analyzes the peak covariance stabilityproperties of Kalman filtering for linear discrete-time systemswith irregular time intervals for sampling of output measure-ments. Existing research on Kalman filtering with irregularsampling mostly builds on probabilistic description of samplingintermittence. In this work, we focus on the general caseof irregular sampling without probabilistic assumptions. Theobtained stability conditions show that the peak covariancestability is influenced by the eigenvalue distribution of the statematrix in the complex plane. The effectiveness of the analysisis illustrated via a simulation based study on ocean flow fieldestimation using submersible drogues that can measure positionintermittently and acceleration incessantly.

I. INTRODUCTION

The classical discrete-time KF is premised on the implicitassumption of regular sampling of the output measurements.However, it is sometimes unrealistic to obtain measurementsregularly in a few situations. Especially in applications ofprocess control, networked control systems, navigation andguidance, and ocean surveillance, irregular time samplingintervals are used to monitor a system. Thus the KF analysisunder irregular time sampling has been given much emphasisrecently.

When irregular sampling occurs, boundedness of the es-timation error covariance in the KF has been studied exten-sively in the setting that the availability of measurementsfollows a stochastic process. It is common to employ anauxiliary binary random variable γk: γk = 1 or 0 denotesthe measurement is available or not at time instant k,respectively. The sequence γk are usually considered tobelong to either of the following two categories:• Bernoulli process: γk’s are i.i.d. random variables,

with the probability distribution of p(γk = 1) = λand p(γk = 0) = 1 − λ. A lead has been takenin [1] with the conclusion that there exists a criticalprobability λc. If λ > λc, then the expectation of theresulting estimation error covariance Pk is guaranteedbounded (given the usual stabilizability and detectabilityhypotheses), and divergent otherwise. Determination ofthe value of λc is investigated in [2] and [3]. A novelprobability-based metric is proposed in [4] to evaluatethe KF performance. Specifically, the upper and lowerbounds of Pr (Pk ≤M) for a given M , are derived toassess the KF.

H. Fang is with the Department of Mechanical & Aerospace Engineering,University of California, San Diego, CA 92093, USA

R.A. de Callafon is with the Department of Mechanical & AerospaceEngineering, University of California, San Diego, CA 92093, [email protected]

• Two-state Markovian process: Another interestingexploration is to consider the Gilbert-Elliott channelmodel, in which γk is modeled as a two-state Markovchain. Sufficient conditions are derived in [5] for theboundedness of the expectation of the peak estimationerror covariance. Some less conservative results areobtained in [6], [7]. It is shown in [8] that the estimationerror covariance of the KF with Markovian intermittentmeasurements has a power-law decay, with the criticalprobability derived.

The following observations have motivated our research todevelop results for KF with irregular time sampling schemes:• Observation 1: Probability distributions for intermittent

sampling are not easy to determine in practice. It isa big challenge to know the type of the probabilitydistribution and the accurate probability values.

• Observation 2: Stochastic modeling may fail if themeasurements are sampled irregularly but not randomlyin many real-life applications.

In this paper, we will study the KF under general irregularsampling without stochastic modeling. Irregular sampling hasbeen examined in the literature on system identification andnonlinear predictive control, see [9]–[11]. For a continuous-time system, state observability from irregularly sampledmeasurements is discussed in [12] and [13]. However, itis noted that analysis of the discrete-time KF with generalirregular sampling schemes has seldom been discussed. Wewill hence contribute to this topic in this paper throughstudying the boundedess conditions for the KF’s estimationerror covariance.

II. PROBLEM FORMULATION

Consider a linear discrete-time system Σd with the fol-lowing state equation:

Σd : xk+1 = Axk +Buk + wk (1)

where A ∈ Rn×n, B ∈ Rn×p, x ∈ Rn is the state vector,u ∈ Rp is the input vector, and w ∈ Rn is the processnoise vector, which is white Gaussian with zero mean andcovariance matrix Q ≥ 0. Here, the subscript k of a vectorak denotes the k-th sampling time instant, i.e., ak := a(kTs),where Ts is the standard sampling period. Sampling of theoutput measurement of Σd is not regular in temporal scale.The sampling durations are not fixed but the integer multiplesof Ts. It is convenient to use the binary variable γk todenote the availability of the measurement at time instantk. If the measurement is sampled, γk = 1; and γk = 0

2012 American Control ConferenceFairmont Queen Elizabeth, Montréal, CanadaJune 27-June 29, 2012

978-1-4577-1094-0/12/$26.00 ©2012 AACC 4795

Page 2: Stability Analysis and Application of Kalman Filtering ...

otherwise. With the initial condition γ0 = 1, let us introducethe following time sequence of measurement sampling:

t0 = 1, t` = infk : k > t`−1, γk = 1 for ` = 1, 2, · · ·

The new time index t` denotes the time instant when the `-thmeasurement is sampled. We define the set

T = t`+1 − t` : ` = 0, 1, · · ·

which is the collection of all irregular sampling intervals.The output equation of Σd is given by

yt` = Cxt` + vt` (2)

where C ∈ Rm×n, y ∈ Rm is the output vector, and v ∈ Rmis the measurement noise vector, which is independent ofw, also white and Gaussian with zero mean and covariancematrix R > 0.

For Σd, we adopt the following standard assumptionsthroughout the paper:

(A1) (A,C) is detectable;(A2) (A,Q

12 ) is stabilizable;

(A3) supT <∞.The assumptions (A1)-(A2) are well known to guaranteethat, under regular single-rate sampling, the estimation er-ror covariance of the Kalman filter converges to a uniquefixed point from any initial condition [14]. We have (A3)established, since effective state estimation requires that thesampling intervals be finite. If the matrix A is stable, itis a trivial task to design a stable state estimator evenunder irregular sampling. Thus only the unstable case isparticularly worth studying. In sequel, only an unstable Awill be considered.

We use the lifting technique [15] to deal with irregularsampling. The lifted system Σl can be built from Σd:

Σl :

xt`+1

= Φ(t`+1, t`)xt` + Γ(t`+1, t`)ut`+1,t`(3a)

+Ω(t`+1, t`)wt`+1,t`(3b)

yt` = Cxt` + vt` (3c)

where

Φ(t`+1, t`) = At`+1−t`

Γ(t`+1, t`) =[At`+1−t`−1B · · · AB B

]Ω(t`+1, t`) =

[At`+1−t`−1 · · · A I

]ut`+1,t` =

[uTt`· · · uT

t`+1−2 uTt`+1−1

]Twt`+1,t` =

[wTt`· · · wT

t`+1−2 wTt`+1−1

]TWe denote the covariance matrix of wt`+1,t` be

∆(t`+1, t`) = diag(Q, · · · , Q︸ ︷︷ ︸t`+1−t`

)

It is noted that the system Σl is linear time-varying.The KF can be applied to optimal state estimation for Σl.With the initializing condition x+

t−1= E(xt−1), P+

t−1=

E[(xt−1

− x+t−1

)(xt−1− x+

t−1)T]. the KF is given in a two-

step procedure for ` ≥ 1:

• Step 1: Prediction

x−t` = Φ(t`, t`−1)x+t`−1

+ Γ(t`, t`−1)ut`−1(4)

P−t` = Φ(t`, t`−1)P+t`−1

ΦT(t`, t`−1)

+Ω(t`, t`−1)∆(t`, t`−1)ΩT(t`, t`−1) (5)

• Step 2: Update

Kt` = P−t`CT(CP−t`C

T +R)−1 (6)

x+t`

= x−t` +Kt`(yt` − Cx−t`

) (7)

P+t`

= (I −Kt`C)P−t` (8)

where the superscripts “-” and “+” denote a priori and aposteriori, respectively, and x and P are the state estimateand estimation error covariance matrix, respectively. At inter-sample time instants, due to the lack of output measurements,the propagation of state estimate is dependent only on thestate equation (1). Hence,

x−k = Ax+k−1 +Buk−1 (9)

P−k = AP+k−1A

T +Q (10)

x+k = x−k (11)

P+k = P−k (12)

for t` < k < t`+1.The lifted KF in (6)-(12) can be decomposed into single

steps, resorting to using γk’s. Its equivalent expression isgiven by the following equations:

x−k = Ax+k−1 +Buk−1 (13)

P−k = AP+k−1A

T +Q (14)

Kk = P−k CT(CP−k C

T +R)−1

(15)

x+k = x−k + γkKk

(yk − Cx−k

)(16)

P+k = (I − γkKkC)P−k (17)

If γk’s are Bernoulli or two-state Markov random variables,there are a variety of works in the literature devoted tostudying the behavior of the binary switching Kalman filterin (13)-(17), e.g., [1], [4], [5], to mention them. In this paper,we will explore a general situation, breaking away from theassumption that γk’s are random variables.

III. PEAK COVARIANCE STABILITY ANALYSIS

With the inspiration from the literature, e.g., [5], we shallfocus on analysis of peak covariance stability defined in thissection.

Definition 1: The peak covariance sequence Pt` is saidto be stable if Pt` < ∞ ∀` ≥ 1 for Pt0 < ∞. The filteringsystem satisfies peak covariance stability if Pt` is stable.

A. Pathological & Degenerate Sampling Intervals

It is easily verifiable that the KF performance may sufferseriously from the irregular sampling scheme. This indicatesthat the intervals between two consecutive samples caninfluence the KF behavior significantly.

4796

Page 3: Stability Analysis and Application of Kalman Filtering ...

Before proceeding further, let us investigate the eigen-values of A. Suppose that A has l distinct eigenvalues, µifor i = 1, 2 · · · , l, each with multiplicities hi. Obviously,Σli=1hi = n. These eigenvalues lie on different eigencirclescentered around the original point, depending on their ownmagnitudes. If |µi| = |µj |, ∀i, j ∈ 1, 2, · · · , l, they are onthe same eigencircle, the radius of which is given by |µi| orequally |µj |. This leads to the definition about pathologicalsampling intervals:

Definition 2: The sampling interval t`+1 − t` for ` =0, 1, 2, · · · is pathological if t`+1 − t` ∈ P, where

P =κ ∈ N\0, 1 :

(µiµj

)κ= 1, |µi| = |µj | > 1,

∀i, j ∈ 1, 2, · · · , l

(18)

Otherwise, it is non-pathological.Definition 2 can be briefly explained in the following way.

Let µi and µj be two distinct unstable eigenvalues of A with|µi| = |µj |. Note that the eigenvalues of At`+1−t` are equalto the t`+1 − t` power of the eigenvalues of A. Thus thesampling operation is equivalent to mapping the eigenvaluesof A to new points on the complex plane. Lying on the sameeigencircle, µi and µj will be mapped to one coincidencepoint and can not be distinguished any more, if the samplinginterval t`+1 − t` is pathological. The next lemma furthershows the property of the set P.

Lemma 1: Assume that µ is any unstable eigenvalue ofA (|µ| ≥ 1). For all κ ∈ N\0, 1, if µej2πi/κ for anyi = 1, 2, · · · , κ− 1 is an eigenvalue of A, then κ ∈ P.

Proof: It is straightforward to see that(µ

µej2πi/κ

)κ= 1

implying κ ∈ P. In addition, for all κ ∈ P, there existsi = 1, 2, · · · , κ−1 such that µej2πi/κ is an eigenvalue of A.

If any sampling interval is pathological, we continue tocheck if it is ‘degenerate’. It is known that there always existsa similarity transformation M such that AJ := M−1AM ,where AJ is the Jordan canonical form of A. Accordingly,denote CJ := CM . For all κ ∈ P, define Gκ,α as the setof eigenvalues with the same modulus α and suffering fromthe pathological sampling interval κ:

Gκ,α =µi, µj :

(µiµj

)κ= 1, |µi| = |µj | = α, κ ∈ P,

∀i, j ∈ 1, 2, · · · , h

(19)

Let AJ,Gκ,α be the block in AJ , with the diagonal entriesbeing the elements of Gκ,α, and CJ,Gκ,α be the associatedblock in CJ .

Definition 3: The sampling interval t`+1 − t` for ` =0, 1, 2, · · · is degenerate if t`+1 − t` ∈ D, where

D :=κ ∈ P : CJ,Gκ,α is rank deficient

(20)

Otherwise, it is non-degenerate.It is obvious that D ⊆ P. Indeed, a non-degenerate

sampling interval is non-pathological, but not vice versa.

B. Peak Covariance Stability

We have the following main theorem.Theorem 1: If T ∩ D = ∅, the Kalman filter with

irregularly sampled measurements satisfies peak covariancestability.

To prove Theorem 1, the following lemmas will be needed.Lemma 2: If T∩P, the pair (Aκ, C) is detectable for any

k ∈ T.Proof: The reader may refer to [15] [16] [17] for some

existing discussion on the lemma. Here we give a proof forcompleteness.

Let µ be any unstable eigenvalue of A. Define the complexfunction

f(s) :=sκ − µκ

s− µNote that f(s) is analytic everywhere. Its zeros are given byµej2πi/κ for i = 1, 2, · · · , κ − 1. By the spectral mappingtheorem, the eigenvalues of f(A) are the values of f(s) atthe eigenvalues of A. According to the definition of P in(18), none of the points µej2πi/κ, where i = 1, 2, · · · , κ− 1,is an eigenvalues of A. Hence, 0 is also not an eigenvalueof f(A), implying that f(A) is invertible.

It follows from the invertibility of f(A) that[Aκ − µκI

C

]=

[f(A) 0

0 I

] [A− µIC

](21)

where µκ is the eigenvalue of Aκ. By (A1), we haverank [AT − µI CT ] = n. Hence, we obtain from (21) thatrank [ (Aκ)

T − µκI CT ] = n This shows that (Aκ, C) isdetectable.

The lemma below can be developed on the basis ofLemma 2.

Lemma 3: If T ∩ D = ∅, the pair (Aκ, C) is detectablefor any k ∈ T.

Proof: For simplicity and without loss of generality, as-sume that all l eigenvalues of A are unstable, and that Gκ =µl−1, µl, that is, µl−1 and µl are the only eigenvaluesaffected by the pathological κ. Then we drop the subscript‘α’ here for convenience. It is obvious from Lemma 2 thatrank [ (Aκ)

T − µκi I CT ] = n for i = 1, 2, · · · , l−2. AfterJordan canonical transformation, AJ and CJ are given by

AJ = diag ([AJ,1 · · · AJ,l−1 AJ,l ])

CJ = [CJ,1 · · · CJ,l−1 CJ,l ]

where AJ,i is the Jordan block associated with µiand CJ,iis the corresponding block in C. Define

AJ,Gκ := diag ([AJ,1 · · · AJ,l−2 ])

CJ,Gκ := [CJ,1 · · · CJ,l−2 ]

AJ,Gκ := diag ([AJ,l−1 AJ,l ])

CJ,Gκ := [CJ,l−1 CJ,l ] .

For i = l− 1, l,[ (AκJ,Gκ

)T

− µκi I CTJ,Gκ

]is of full rank

by Lemma 2, and so is[ (AκJ,Gκ

)T − µκi I CTJ,Gκ

]due to

the full rank of CJ,Gκ . We additionally have AκJ,Gκ−µ

κi I is of

full rank as its diagonal elements are nonzero. Consequently,

4797

Page 4: Stability Analysis and Application of Kalman Filtering ...

for i = l − 1, l, rank [AκJ − µκi I CTJ ] = n. Thus we have

rank [ (Aκ)T − µκI CT ] = n, where µ is any eigenvalue

of A.The proof of Theorem 1 is as follows.

Proof of Theorem 1: If T ∩ P = ∅, it follows fromLemmas 2 and 3 that, (Aκ, C) is detectable for κ ∈ T. Inother words, (Φ(t`+1, t`), C) is detectable for ` = 0, 1, · · ·.Thus there always exists Ksub

t`such that Φ(t`+1, t`)−Ksub

t`C

is stable. We can then construct a suboptimal estimatorxsubt`+1

= Φ(t`+1, t`)xsubt`

+Ksubt`

(yt`−Cxsubt`

). The estimationerror is given by

xsubt`+1

:= xt`+1− xsub

t`+1

=[Φ(t`+1, t`)−Ksub

t`C]xsubt`

+ wt` −Ksubt`

vt`

It is observed that the above error performance systemis stable. Then the associated estimation error covarianceP subt`

is upper bounded. Furthermore, given the same initialcondition, Pt` ≤ P sub

t`, due to the KF’s optimality. Thus if

Pt0 <∞, then Pt` <∞. The proof is complete.Theorem 1 shows that, the peak covariance stability of

the filtering system with irregular sampling is guaranteedif the sampling intervals are non-degenerate (or futhermore,non-pathological). From Theorem 1, some corollaries can bederived to further reveal the stability properties.

Corollary 1: If the matrix A has no two or more dis-tinct unstable eigenvalues with the same modulus, the peakcovariance sequence is stable.

Proof: For the given condition, P = ∅ and thus T∩P =∅ is satisfied, ensuring the peak covariance stability.

Corollary 2: For any eigenvalues of A that have the samemodulus, if the corresponding block of the matrix C inJordan canonical form is of full column rank, then the peakcovariance sequence is stable.

Proof: Note that D = ∅ is satisfied in this case, so thepeak covariance stability is ensured.

A question of interest here is: Can we determine theaccurate upper and lower bounds of the peak covariance?Currently, there is no definite answer for the general case.However, if narrowing the scope to scalar systems, we canobtain some desirable conclusions.

For an scalar system (n = 1), the peak covariance stabilityis always guaranteed, given the assumptions (A1)-(A3).Define τ := inf T and η := supT, where 1 ≤ τ ≤ η < ∞.Suppose there are two associated linear multi-rate systems,which are generated by sampling the output of the systemΣd every τTs and ηTs, respectively. Implementation of theKF to both systems yields two prediction error covariancematrices, denoted by Pτ,` and Pη,`, respectively.

To proceed further, let us define the following mappings

f(X) := AXAT +Q (22)g(X) := X −XCT(CXCT +R)−1CX (23)

where X ≥ 0. It is noted that

Pt`+1= f f · · · f︸ ︷︷ ︸

t`+1−t`

g(Pt`) =: f t`+1−t` g(Pt`)

(a) (b)

Fig. 1. (a) Diagrammatic sketch of ocean flow field estimation (arrows: flowdirection, filled circles: drogues, dashed lines: depth profiles of drogues);(b) the prototype of the drogue to be used.

where ‘’ denotes function composition. Similarly, Pτ,`+1 =fτ g(Pτ,`), and Pη,`+1 = fη g(Pη,`).

Theorem 2: Assume n = 1. If the initial condition satis-fies 0 ≤ Pτ,0 ≤ Pt0 ≤ Pη,0, then

Pτ,` ≤ Pt` ≤ Pη,` (24)

Furthermore, let Pτ and Pη , respectively, be the uniquepositive solutions to the auxiliary equations X = fτ g(X)and X = fη g(X). Then

Pτ ≤ lim`→∞

Pt` ≤ Pη <∞ (25)

Proof: It is proven by [1] and [4] that f(X) and g(X)are monotonically increasing with X . In addition, for a ≤ b,we have fa(X) ≤ f b(X), since n = 1 and A is unstable.Given 0 ≤ Pτ,0 ≤ Pt0 ≤ Pη,0, it follows that

0 ≤ fτ g(Pτ,0) ≤ f t1−t0 g(Pt0) ≤ fη g(Pη,0)

or equivalently

0 ≤ Pτ,1 ≤ Pt1 ≤ Pη,1

Repeating the above procedure inductively until `, we obtain(24). For the associated multi-rate systems, there exist uniquePτ and Pη such that Pτ = fτ g(Pτ ) and Pη = fη g(Pη),respectively, in light of the theories of solutions to Riccatiequations. Hence, (25) is obtained from (24).

IV. APPLICATION EXAMPLE

In this section, we show the application of the KF withirregularly sampled measurements to ocean flow estimation.The scenario is shown in Fig. 1(a). A three-dimensionalocean flow velocity field is considered. It is assumed tobe only dependent on depth but independent of time. Afew drogues are released at different locations, and thentravels along the flow through the field. Capable of arbitraryvertical migration behaviors, each drogue has a motion ofsubmersion and surfacing, featuring different depth profiles.During the process, the acceleration information of eachdrogue is recorded, but the position information is availableonly when the drogue is at water surface. Incessant accel-eration and intermittent position measurements will be usedfor reconstruction of the velocity profile of the drogue toestimate the flow field.

4798

Page 5: Stability Analysis and Application of Kalman Filtering ...

Depth

Density

0 1 2 3 4 5

x 104

0

20

40

60

80

1023.2

1023.4

1023.6

1023.8

1024

1024.2

Width

Depth

Along-front velocity (m/s)

0 1 2 3 4 5

x 104

0

20

40

60

80−0.7

−0.6

−0.5

−0.4

−0.3

−0.2

−0.1

Fig. 2. The density and flow field profiles at a cross section.

0 50 100 150 200 250 3000

10

20

30

40

50

60

70

80

Time

Depth

Fig. 3. The depth profile of the drogue released at 2.5× 104m.

The prototype of the drogue is shown in Fig. 1(b). Wehave the drogue dynamics described by the differentialequation [18]

md(t) = c ·(vd(z, t)− d(t)

)·∣∣∣vd(z, t)− d(t)

∣∣∣ (26)

where m is the constant rigid mass plus added mass, d is thedisplacement of the drogue, and c is the drag parameter thatquantifies the drag or resistance applied on the drogue in theflow field. It is understood that the drogue has the irregularsampling feature. When both underwater and at surface, thedrogue samples its acceleration d and depth z regularly.However, the displacement d is irregularly measurable – itcan be obtained only when the drogue is at the surface.Here, the objective is to estimate vd(z, t), using (26) andthe measurements.

Define the states x1 := d and x2 := d; also definethe acceleration term as the input to system because theacceleration is available every time instant, that is,

u :=c

m·(vd(z, t)− d(t)

)·∣∣∣vd(z, t)− d(t)

∣∣∣ (27)

It then follows that

x =

[0 10 0

]x+

[01

]u

0 50 100 150 200 250 3000

10

20

30

40

50

60

Time

Position(x

1)

(a)

0 50 100 150 200 250 300−0.2

0

0.2

0.4

0.6

0.8

1

1.2

TimeVelocity

(x2)

(b)

0 50 100 150 200 250 300−0.2

0

0.2

0.4

0.6

0.8

1

1.2

1.4

1.6

1.8

Time

Flow

velocity

(vd(z,k

))

(c)

Fig. 4. (a) x1 vs. x1 (solid line: true values, dashed line: estimatedvalues, circle: the time instant when the sampling occurs); (b) x2 vs. x2;(c) estimation of the along-front velocity.

Its discrete-time representation, by assuming zero-order holdfor the input variable u and using step invariant transfor-mation to approximate the differentiation over half openintervals [kT, (k + 1)T ), can be written as

xk+1 = Axk +Buk + wk

whereA =

[1 T0 1

], B =

[12T

2

T

]Here, the term wk is added to reflect the impact of the processnoise. Now the output y is the displacement that is irregularly

4799

Page 6: Stability Analysis and Application of Kalman Filtering ...

Depth

True along-front velocity (m/s)

0 1 2 3 4 5

x 104

0

20

40

60

80

−0.6

−0.4

−0.2

0

Width

Depth

Estimated along-front velocity (m/s)

0 1 2 3 4 5

x 104

0

20

40

60

80

−0.6

−0.4

−0.2

0

Fig. 5. Comparison between the true and reconstructed flow field.

measured at time instant t`:

yt` = Cxt` + vt`

whereC = [ 1 0 ]

It is verifiable that P = ∅ for the discrete-time state-space model. Thus for any sequence of sampling intervalsT, the KF satisfies peak covariance stability when applied toestimate the state variables x1 and x2 from the irregularlysampled measurements y. Then the flow velocity vd(z, k)can be computed using the inverse of (27).

A cross section of the along-front velocity field underconsideration is shown in Fig 2. The fronts are regions ofstrong horizontal density gradient in the ocean. Inherentlyunstable, they are usually sites of strong currents and eddyformation. Due to the density gradient and Coriolis force,the along-front velocity is yielded as illustrated. The field isassumed as wide as 5× 104m and as deep as 80m.

Suppose no priori knowledge about the flow field isavailable. Thus for simplicity, the drogues are released every500m, though uneven distribution introduces no more diffi-culties to this application. Each drogue can have a differentdepth profile, with irregular diving and surfacing patterns.The KF is implemented to every single drogue to estimatethe along-front velocities. Let us take a close look at thedrogue released at the position of 2.5 × 104m. Its depthprofile is shown in Fig. 3. As is seen, the time intervals ofunderwater traveling are unequal, resulting in the irregularsampling of the position measurement. Fig. 4 illustrates theestimation results, including the displacement and velocity ofthe drogue and the along-front flow velocity. We observe thatthe estimated values approach the true ones. In particular, theflow estimation in Fig. 4(c) exhibits satisfactory performance,with even small variations captured.

Finally, the flow field can be reconstructed by combiningthe flow estimation results of all drogues. The reconstructedflow field is compared with the true one in Fig. 5. Despitethe existence of minor differences, the reconstruction agreeswell with the original flow field, verifying the effectivenessof the application of the KF with irregular sampling.

V. CONCLUSION

In this paper, we study the KF with irregularly sampledmeasurements. When irregular sampling occurs, the KFis still the optimal state estimator for linear discrete-timesystems. Sufficient conditions that guarantee the defined peakcovariance stability are derived. It is found that the stabilityis closely related with the distribution of eigenvalues of Ain the complex plane. As a demonstration example, the KFis applied to address ocean flow field estimation, which is acompelling problem in oceanography and involves irregularsampling, with adequate accuracy achieved.

REFERENCES

[1] B. Sinopoli, L. Schenato, M. Franceschetti, K. Poolla, M. Jordan,and S. Sastry, “Kalman filtering with intermittent observations,” IEEETransactions on Automatic Control, vol. 49, no. 9, pp. 1453–1464,2004.

[2] Y. Mo and B. Sinopoli, “A characterization of the critical valuefor Kalman filtering with intermittent observations,” in 47th IEEEConference on Decision and Control, 2008. CDC 2008., 2008, pp.2692–2697.

[3] K. Plarre and F. Bullo, “On kalman filtering for detectable systemswith intermittent observations,” IEEE Transactions on Automatic Con-trol, vol. 54, no. 2, pp. 386–390, 2009.

[4] L. Shi, M. Epstein, and R. Murray, “Kalman filtering over a packet-dropping network: A probabilistic perspective,” IEEE Transactions onAutomatic Control, vol. 55, no. 3, pp. 594–604, 2010.

[5] M. Huang and S. Dey, “Stability of Kalman filtering with Markovianpacket losses,” Automatica, vol. 43, no. 4, pp. 598–607, 2007.

[6] L. Xie and L. Xie, “Stability of a random Riccati equation withMarkovian binary switching,” IEEE Transactions on Automatic Con-trol, vol. 53, no. 7, pp. 1759–1764, 2008.

[7] N. Xiao, L. Xie, and M. Fu, “Kalman filtering over unreliablecommunication networks with bounded Markovian packet dropouts,”International Journal of Robust and Nonlinear Control, vol. 19, no. 16,pp. 1770–1786, 2009.

[8] Y. Mo and B. Sinopoli, “Kalman filtering with intermittent obser-vations: Tail distribution and critical value,” IEEE Transactions onAutomatic Control, p. in press, 2011.

[9] F. Ding and J. Ding, “Least-squares parameter estimation for systemswith irregularly missing data,” International Journal of AdaptiveControl and Signal Processing, vol. 24, no. 7, pp. 540–553, 2010.

[10] H. Raghavan, A. K. Tangirala, R. B. Gopaluni, and S. L. Shah,“Identification of chemical processes with irregular output sampling,”Control Engineering Practice, vol. 14, no. 5, pp. 467–480, 2006.

[11] M. Srinivasarao, S. C. Patwardhan, and R. D. Gudi, “Nonlinearpredictive control of irregularly sampled multirate systems usingblackbox observers,” Journal of Process Control, vol. 17, no. 1, pp.17–35, 2007.

[12] C. Li, L. Y. Wang, G. Yin, L. Guo, and C.-Z. Xu, “Irregular sampling,active observability, and convergence rates of state observers forsystems with binary-valued observations,” in Proceedings of the 48thIEEE Conference on Decision and Control, 2009 held jointly with the28th Chinese Control Conference, 2009, pp. 8506–8511.

[13] A. Fuster, “A joint criterion for reachability and observability ofnonuniformly sampled discrete systems,” IEEE Transactions on Auto-matic Control, vol. 36, no. 11, pp. 1281–1284, 1991.

[14] B. D. O. Anderson and J. B. Moore, Optimal Filtering. Prentice-Hall,Englewood Cliffs, 1979.

[15] T. Chen and B. A. Francis, Optimal Sampled-Data Control Systems.Secaucus, NJ, USA: Springer-Verlag New York, Inc., 1995.

[16] B. Francis and T. Georgiou, “Stability theory for linear time-invariantplants with periodic digital controllers,” IEEE Transactions on Auto-matic Control, vol. 33, no. 9, pp. 820–832, 1988.

[17] J. Wang, T. Chen, and B. Huang, “Multirate sampled-data systems:computing fast-rate models,” Journal of Process Control, vol. 14, no. 1,pp. 79–88, 2004.

[18] D. A. Booth, “On the use of drogues for measuring subsurface oceancurrents,” Ocean Dynamics, vol. 34, pp. 284–294, 1981.

4800