On the usage of Principal Components Analysis (PCA) for ... · Principal Components Analysis (PCA)...

22
On the usage of Principal Components Analysis (PCA) for the Prediction of Solar Energetic Particle (SEP) events A. Papaioannou 1 , A. Anastasiadis 1 , A. Kouloumvakos 2 , M. Paassilta 3 , R. Vainio 3 , E. Valtonen 3 , A. Belov 4 , E. Eroshenko 4 , M. Abunina 4 , A. Abunin 4 1 IAASARS, National Observatory of Athens, Penteli, Greece 2 IRAP, Université de Toulouse, CNRS, CNES, UPS, Toulouse, France 3 Departement of Physics, University of Turku, Finland 4 IZMIRAN, Troitsk, Moscow, Russia

Transcript of On the usage of Principal Components Analysis (PCA) for ... · Principal Components Analysis (PCA)...

Page 1: On the usage of Principal Components Analysis (PCA) for ... · Principal Components Analysis (PCA) 15th European Space Weather Week (ESWW15) Session 6 Unveiling Current Challenges

On the usage of Principal Components Analysis (PCA) for the Prediction of Solar Energetic Particle (SEP) events

A. Papaioannou1, A. Anastasiadis1, A. Kouloumvakos2, M. Paassilta3, R. Vainio3, E. Valtonen3, A. Belov4, E. Eroshenko4, M. Abunina4, A. Abunin4

1IAASARS, National Observatory of Athens, Penteli, Greece 2IRAP, Université de Toulouse, CNRS, CNES, UPS, Toulouse, France

3Departement of Physics, University of Turku, Finland 4IZMIRAN, Troitsk, Moscow, Russia

Page 2: On the usage of Principal Components Analysis (PCA) for ... · Principal Components Analysis (PCA) 15th European Space Weather Week (ESWW15) Session 6 Unveiling Current Challenges

15th European Space Weather Week (ESWW15)

Session 6 Unveiling Current Challenges in Space Weather Forecasting Leuven

07.11.2018

Re

ame

s, S

pac

e S

cie

nce

Rev

iew

s, 1

99

9 > Since the 90s:

Distinction of 2 classes of events:

-Impulsive (small, frequent, presumably flare related)

- Gradual (large, rare, presumably fast CME related)

Impulsive Gradual

Impulsive Gradual

Credit: SOHO / NASA / ESA

Solar Energetic Particle (SEP) events

The origin of SEP events

Page 3: On the usage of Principal Components Analysis (PCA) for ... · Principal Components Analysis (PCA) 15th European Space Weather Week (ESWW15) Session 6 Unveiling Current Challenges

Motivation

15th European Space Weather Week (ESWW15)

Session 6 Unveiling Current Challenges in Space Weather Forecasting Leuven

07.11.2018

Solar Energetic Particle (SEP) events

> We know that several inter-related quantities (solar) that describe (map) SEP events Can we make use of a higher-order combination of these quantities in order to classify and predict SEP events ?

Solar Energetic Particle (SEP) events

Motivation

Page 4: On the usage of Principal Components Analysis (PCA) for ... · Principal Components Analysis (PCA) 15th European Space Weather Week (ESWW15) Session 6 Unveiling Current Challenges

Ad

by

& W

illia

ms,

Will

ey In

terd

isci

plin

ary

Rev

iew

s,

Co

mp

uta

tio

nal

Sta

tist

ics

, 20

11

> Principal Component Analysis (PCA) is a multivariate technique that analyzes a data table in which observations are described by several inter-correlated quantities.

Principal Components Analysis (PCA)

15th European Space Weather Week (ESWW15)

Session 6 Unveiling Current Challenges in Space Weather Forecasting Leuven

07.11.2018

Flare lo

ngitu

de

> PCA rotates the original data space such that the axes of the new coordinate system point into the directions of highest variance of the data

Page 5: On the usage of Principal Components Analysis (PCA) for ... · Principal Components Analysis (PCA) 15th European Space Weather Week (ESWW15) Session 6 Unveiling Current Challenges

> 126 SEP events + 3599 non SEP events

> 6 variables > several different mappings

Application of the PCA

15th European Space Weather Week (ESWW15)

Session 6 Unveiling Current Challenges in Space Weather Forecasting Leuven

07.11.2018

1. 2. 3. 4. 5. 6.

DATA MATRIX

Page 6: On the usage of Principal Components Analysis (PCA) for ... · Principal Components Analysis (PCA) 15th European Space Weather Week (ESWW15) Session 6 Unveiling Current Challenges

> The variance plot shows how much variance in the dataset is explained by which PC (as bar) and how much variance is explained by the first n PCs (as line)

Application of the PCA

15th European Space Weather Week (ESWW15)

Session 6 Unveiling Current Challenges in Space Weather Forecasting Leuven

07.11.2018

Page 7: On the usage of Principal Components Analysis (PCA) for ... · Principal Components Analysis (PCA) 15th European Space Weather Week (ESWW15) Session 6 Unveiling Current Challenges

> PCA is a transformation of the old coordinate system (data grid) into the new coordinate system (PC), it can be estimated how much each of the old coordinates (columns of the data matrix. i.e. variables) contribute to each of the new ones (PCs) Loadings

Application of the PCA

> The values that the row vectors (observations/data) have in the component space

(PCs space) Scores

15th European Space Weather Week (ESWW15)

Session 6 Unveiling Current Challenges in Space Weather Forecasting Leuven

07.11.2018

Load

ings

Page 8: On the usage of Principal Components Analysis (PCA) for ... · Principal Components Analysis (PCA) 15th European Space Weather Week (ESWW15) Session 6 Unveiling Current Challenges

> Radiation storms [S2 – S4] are closely related to SFs:

> of M and X magnitude

> mostly impulsive + short duration

> central, east & west

15th European Space Weather Week (ESWW15)

Session 6 Unveiling Current Challenges in Space Weather Forecasting Leuven

07.11.2018

Application of the PCA

Score Plots l Classification of SEPs l Flares

Page 9: On the usage of Principal Components Analysis (PCA) for ... · Principal Components Analysis (PCA) 15th European Space Weather Week (ESWW15) Session 6 Unveiling Current Challenges

> Radiation storms [S2 – S4] are closely related to:

> Fast and Halo CMEs

15th European Space Weather Week (ESWW15)

Session 6 Unveiling Current Challenges in Space Weather Forecasting Leuven

07.11.2018

Application of the PCA

Score Plots l Classification of SEPs l CMEs

Page 10: On the usage of Principal Components Analysis (PCA) for ... · Principal Components Analysis (PCA) 15th European Space Weather Week (ESWW15) Session 6 Unveiling Current Challenges

15th European Space Weather Week (ESWW15)

Session 6 Unveiling Current Challenges in Space Weather Forecasting Leuven

07.11.2018

Application of the PCA

A possible index (I) for SEP nowcasting

Page 11: On the usage of Principal Components Analysis (PCA) for ... · Principal Components Analysis (PCA) 15th European Space Weather Week (ESWW15) Session 6 Unveiling Current Challenges

15th European Space Weather Week (ESWW15)

Session 6 Unveiling Current Challenges in Space Weather Forecasting Leuven

07.11.2018

Application of the PCA

A possible index (I) for SEP nowcasting

> Apply Logistic Regression

# 1-parametric regression

Page 12: On the usage of Principal Components Analysis (PCA) for ... · Principal Components Analysis (PCA) 15th European Space Weather Week (ESWW15) Session 6 Unveiling Current Challenges

15th European Space Weather Week (ESWW15)

Session 6 Unveiling Current Challenges in Space Weather Forecasting Leuven

07.11.2018

Application of the PCA

A possible index (I) for SEP nowcasting

> Apply Logistic Regression

# 1-parameric regression

# multivariate regression

Page 13: On the usage of Principal Components Analysis (PCA) for ... · Principal Components Analysis (PCA) 15th European Space Weather Week (ESWW15) Session 6 Unveiling Current Challenges

> Apply a probability threshold of 50% > Construct a contingency table > Calculate Categorical metrics (POD, FAR)

15th European Space Weather Week (ESWW15)

Session 6 Unveiling Current Challenges in Space Weather Forecasting Leuven

07.11.2018

Application of the PCA

A possible index (I) for SEP nowcasting

# multivariate regression

Page 14: On the usage of Principal Components Analysis (PCA) for ... · Principal Components Analysis (PCA) 15th European Space Weather Week (ESWW15) Session 6 Unveiling Current Challenges

15th European Space Weather Week (ESWW15)

Session 6 Unveiling Current Challenges in Space Weather Forecasting Leuven

07.11.2018

Application of the PCA

A possible index (I) for SEP nowcasting

> pth = 50 %

Page 15: On the usage of Principal Components Analysis (PCA) for ... · Principal Components Analysis (PCA) 15th European Space Weather Week (ESWW15) Session 6 Unveiling Current Challenges

15th European Space Weather Week (ESWW15)

Session 6 Unveiling Current Challenges in Space Weather Forecasting Leuven

07.11.2018

Application of the PCA

A possible index (I) for SEP nowcasting

> pth = 50 %

+ interaction terms

Page 16: On the usage of Principal Components Analysis (PCA) for ... · Principal Components Analysis (PCA) 15th European Space Weather Week (ESWW15) Session 6 Unveiling Current Challenges

> Apply different probability thresholds of 25%, 50%, 75% > Construct a contingency table (pth = 50%) > Calculate Categorical metrics (POD, FAR)

15th European Space Weather Week (ESWW15)

Session 6 Unveiling Current Challenges in Space Weather Forecasting Leuven

07.11.2018

Application of the PCA

A possible index (I) for SEP nowcasting

# multivariate regression [+ interaction terms]

Page 17: On the usage of Principal Components Analysis (PCA) for ... · Principal Components Analysis (PCA) 15th European Space Weather Week (ESWW15) Session 6 Unveiling Current Challenges

15th European Space Weather Week (ESWW15)

Session 6 Unveiling Current Challenges in Space Weather Forecasting Leuven

07.11.2018

Application of the PCA

A possible index (I) for SEP nowcasting

> pth = 50 %

Page 18: On the usage of Principal Components Analysis (PCA) for ... · Principal Components Analysis (PCA) 15th European Space Weather Week (ESWW15) Session 6 Unveiling Current Challenges

15th European Space Weather Week (ESWW15)

Session 6 Unveiling Current Challenges in Space Weather Forecasting Leuven

07.11.2018

Application of the PCA

A possible index (I) for SEP nowcasting

> pth = 50 %

Page 19: On the usage of Principal Components Analysis (PCA) for ... · Principal Components Analysis (PCA) 15th European Space Weather Week (ESWW15) Session 6 Unveiling Current Challenges

15th European Space Weather Week (ESWW15)

Session 6 Unveiling Current Challenges in Space Weather Forecasting Leuven

07.11.2018

Application of the PCA

A possible index (I) for SEP nowcasting

Page 20: On the usage of Principal Components Analysis (PCA) for ... · Principal Components Analysis (PCA) 15th European Space Weather Week (ESWW15) Session 6 Unveiling Current Challenges

15th European Space Weather Week (ESWW15)

Session 6 Unveiling Current Challenges in Space Weather Forecasting Leuven

07.11.2018

Application of the PCA

A possible index (I) for SEP nowcasting

Page 21: On the usage of Principal Components Analysis (PCA) for ... · Principal Components Analysis (PCA) 15th European Space Weather Week (ESWW15) Session 6 Unveiling Current Challenges

15th European Space Weather Week (ESWW15)

Session 6 Unveiling Current Challenges in Space Weather Forecasting Leuven

07.11.2018

Conclusions

> PCA can be used for the:

• Classification the SEP events with respect to the characteristics of their parent solar drivers

• Prediction of the occurrence (or not) of an SEP event; utilizing logistic regression and the I index

Papaioannou et al, Solar Physics, 2018

Page 22: On the usage of Principal Components Analysis (PCA) for ... · Principal Components Analysis (PCA) 15th European Space Weather Week (ESWW15) Session 6 Unveiling Current Challenges

> AP would like to acknowledge support from a post-doctoral IKY scholarship funded by the action “Supporting post-doctoral researchers” from the resources of the b.p. “Human Resources Development Education and Lifelong Learning” with Priority Axes 6, 8, 9 and co-funded by the European Social Fund and the Greek government. AA would further like to acknowledge the “SPECS: Solar Particle Events and foreCasting Studies” research grant of the National Observatory of Athens. MP and RV acknowledge the funding from the Academy of Finland (decision 267186). Research conducted by MP and RV was further supported by ESA contract 4000120480/17/NL/LF/hh

15th European Space Weather Week (ESWW15)

Session 6 Unveiling Current Challenges in Space Weather Forecasting Leuven

07.11.2018

Papaioannou et al, Solar Physics, 2018

Thank you

http://members.noa.gr/atpapaio/iky.html

Acknowledgement