IN RANDOM Kemp APMtkemp/182/182-Lec25-After.pdf · 2020-03-07 · Feature matrix X E Mmm C = d-XXT...

9
MATH 182 : HIDDEN DATA IN RANDOM MATRICES Todd Kemp , APM 5202 www.math.ucsd.edu/ntkemp/l82 TODAY . Spiked Covariance Models NEXT : ' outliers Labs 4- 6 Due Friday , March 13 Homework 3 Due TONIGHT Final Lab Project Due Monday , March 16 Final Exam Friday , March 20 lithe - 2:30 , this room )

Transcript of IN RANDOM Kemp APMtkemp/182/182-Lec25-After.pdf · 2020-03-07 · Feature matrix X E Mmm C = d-XXT...

Page 1: IN RANDOM Kemp APMtkemp/182/182-Lec25-After.pdf · 2020-03-07 · Feature matrix X E Mmm C = d-XXT mxm f-my featuret samples. g w--fxTX ANtf u Pure noise: Eigenvalues of W f l" tho)

MATH 182 : HIDDEN DATAIN RANDOM MATRICES

Todd Kemp ,APM 5202

www.math.ucsd.edu/ntkemp/l82

TODAY . Spiked Covariance ModelsNEXT :

'

outliers

Labs 4- 6 Due Friday,March 13

Homework 3 Due TONIGHT

Final Lab Project Due Monday , March 16

Final Exam Friday , March 20 lithe - 2:30,this room)

Page 2: IN RANDOM Kemp APMtkemp/182/182-Lec25-After.pdf · 2020-03-07 · Feature matrix X E Mmm C = d-XXT mxm f-my featuret samples. g w--fxTX ANtf u Pure noise: Eigenvalues of W f l" tho)

Feature matrix X E Mmm C = d- XXT mxm

f- my feature,

t samples .

gw -

- fxTX AN

tf u

Pure noise : Eigenvalues of W, f l"

tho) ④€=µµu, %gmah" of C µG#ga ,

ftp.VK.hfft#IDg..pd"

Page 3: IN RANDOM Kemp APMtkemp/182/182-Lec25-After.pdf · 2020-03-07 · Feature matrix X E Mmm C = d-XXT mxm f-my featuret samples. g w--fxTX ANtf u Pure noise: Eigenvalues of W f l" tho)

eisetgnal Ej Iid. Me

.

Im)og. = g- t ?, Centered

k ; = g. t ?g - t,!f # t- bynoe by LLN( = Is this ttiijd.

↳often,we're thinking of ¥ , as Samp↳ ⇒ g.

= g,i. I. -- I . : % - I -- e .

Just have nose !

Page 4: IN RANDOM Kemp APMtkemp/182/182-Lec25-After.pdf · 2020-03-07 · Feature matrix X E Mmm C = d-XXT mxm f-my featuret samples. g w--fxTX ANtf u Pure noise: Eigenvalues of W f l" tho)

Noisetlhoisysigheoj= Gj t Bj Gj,By idp.

P T environmental noisesignal+structural noise

.

Nce.fm)

NHC)&

Gv = Gvkgjltced = CTI.

"

per!Yb§¥mItc

x.j n Nce , Itg ) expect rankle)is small

.

ko - rank perturbation

Page 5: IN RANDOM Kemp APMtkemp/182/182-Lec25-After.pdf · 2020-03-07 · Feature matrix X E Mmm C = d-XXT mxm f-my featuret samples. g w--fxTX ANtf u Pure noise: Eigenvalues of W f l" tho)

Spiked Guarani model Iof rank r)M

X -- ha.

.

. -il Me, Itc )

"""g"" """ " "

C is peseta semidefinite i. symmetric,

C - QDat QE 0cm)

D= In:*:/ → visas. an:pIt C '

- It QDQT = QQTTQDQT = QC It D)QT

Page 6: IN RANDOM Kemp APMtkemp/182/182-Lec25-After.pdf · 2020-03-07 · Feature matrix X E Mmm C = d-XXT mxm f-my featuret samples. g w--fxTX ANtf u Pure noise: Eigenvalues of W f l" tho)

Proposition If Ir Nce,ID ,

QE Olm) ,

a'I n Nk, Ind .

fgi.at : if x. iiiiiidtb Gainsaying !!:&,Pf

.Ceuta

tact : GHAZI = FAT i. If A-QI-

Gula = at QQIf Guffy. I T -

- I.

H

Page 7: IN RANDOM Kemp APMtkemp/182/182-Lec25-After.pdf · 2020-03-07 · Feature matrix X E Mmm C = d-XXT mxm f-my featuret samples. g w--fxTX ANtf u Pure noise: Eigenvalues of W f l" tho)

Theory : The distribution of eigenvalues of

*↳ x.s.sx.nl X'X X;- Nce

,Itc)

and X"X' = ELIADE Xjr Ale , ItD)

are the same.

Pf.

Construct Xj is Xj -- AZ's where Atc.

Itc = QLITDIQTA - QCVITDTQT i . AAT '-A2=QItDQT

= Itc .-

X -- f%z, .AZ#--,AZnI= AZ ItDfZATA '- Itci

. xtx -- ZTATAZ III. tag Ijaz = zJcItDaTE

Page 8: IN RANDOM Kemp APMtkemp/182/182-Lec25-After.pdf · 2020-03-07 · Feature matrix X E Mmm C = d-XXT mxm f-my featuret samples. g w--fxTX ANtf u Pure noise: Eigenvalues of W f l" tho)

i.

The most general spiked avwrnu medelis ( as far as eigenvalues of XTX are concerned)

X '- Hi,

-, Hl Xj -Ale, ItD)

Tdiagonal .6

we = txtx n 's El#DIZ

Now restart our Wishart matrix analysis?Thy : The hotel -gram of eigenvalues of Wo

( m, a →es, F-→g , r freed )is asymptotically the same as We

.

Page 9: IN RANDOM Kemp APMtkemp/182/182-Lec25-After.pdf · 2020-03-07 · Feature matrix X E Mmm C = d-XXT mxm f-my featuret samples. g w--fxTX ANtf u Pure noise: Eigenvalues of W f l" tho)

tr,( WI ) - I Lwclii

WE's CITTDZLxiii''¥. ha.!sii÷÷i÷.⇐⇒. ...

trulwo-trlwd-t.si?raholaisteer IT 'T Trtems

→ o.