Building an automated 100 million+ variable star catalogue ... · 1 Building an automated 100...

21
1 Building an automated 100 million+ variable star catalogue for Gaia Berry Holl 1 presented by: Laurent Eyer 1 Nami Mowlavi 1 , Dafydd W. Evans 2 , Gisella Clementini 3 , Jan Cuypers 4 , Alessandro Lanzafame 5 , Joris D. Ridder 6 , Luis Sarro 7 , Diego Ordoñez-Blanco 1 , Krzysztof Nienartowicz 1 , Jonathan Charnas 1 , Leanne Guy 1 , Grégory Jévardat de Fombelle 1 , Isabelle Lecoeur-Taïbi 1 , Lorenzo Rimoldini 1 , Maria Süveges 1 , François Bouchy 8,1 , Sara Regibo 6 , Mauro López 9 , Jonas Debosscher 6 , Fabio Barblan 1 1 Department of Astronomy, University of Geneva,Versoix, Switzerland 2 Institute of Astronomy, University of Cambridge, Cambridge, United Kingdom 3 INAF Osservatorio Astronomico di Bologna, Bologna, Italy 4 Royal Observatory of Belgium, Brussels, Belgium 5 Dipartimento di Fisica e Astronomia, Universita di Catania, Catania, Italy 6 Instituut voor Sterrenkunde, KU Leuven, Leuven, Belgium 7 Departamento de Inteligencia Artificial, UNED, Madrid, Spain 8 Institut d'Astrophysique de Paris, CNRS, Paris, France IAU XXIX General Assembly, Hawaii, Division G: Large-Scale Surveys and Variability (DG.6.02)

Transcript of Building an automated 100 million+ variable star catalogue ... · 1 Building an automated 100...

Page 1: Building an automated 100 million+ variable star catalogue ... · 1 Building an automated 100 million+ variable star catalogue for Gaia Berry Holl1 presented by: Laurent Eyer1 Nami

1

Building an automated 100 million+ variable star catalogue for Gaia

Berry Holl1presented by: Laurent Eyer1 Nami Mowlavi1, Dafydd W. Evans2, Gisella Clementini3, Jan Cuypers4, Alessandro Lanzafame5, Joris D. Ridder6, Luis Sarro7, Diego Ordoñez-Blanco1, Krzysztof Nienartowicz1, Jonathan Charnas1, Leanne Guy1, Grégory Jévardat de Fombelle1, Isabelle Lecoeur-Taïbi1, Lorenzo Rimoldini1, Maria Süveges1, François Bouchy8,1, Sara Regibo6, Mauro López9, Jonas Debosscher6, Fabio Barblan1

1Department of Astronomy, University of Geneva, Versoix, Switzerland2Institute of Astronomy, University of Cambridge, Cambridge, United Kingdom3INAF Osservatorio Astronomico di Bologna, Bologna, Italy4Royal Observatory of Belgium, Brussels, Belgium5Dipartimento di Fisica e Astronomia, Universita di Catania, Catania, Italy6Instituut voor Sterrenkunde, KU Leuven, Leuven, Belgium7Departamento de Inteligencia Artificial, UNED, Madrid, Spain8Institut d'Astrophysique de Paris, CNRS, Paris, France

IAU XXIX General Assembly, Hawaii, Division G: Large-Scale Surveys and Variability (DG.6.02)

Page 2: Building an automated 100 million+ variable star catalogue ... · 1 Building an automated 100 million+ variable star catalogue for Gaia Berry Holl1 presented by: Laurent Eyer1 Nami

Credit : L. Eyer & N. Mowlavi (03/2009)

ZZ Ceti

Solar-like

PG 1159

V1093 Her

CWCEP

RR

SXPHE

Hot OB Supergiants

ACYG

BCEPSPB

SPBe

GDOR

DST

PMSδ Scuti

roAp

M

SRL

RV

SARV

PV Tel

PulsationSecular

V777 Her

V361 Hya

Photom. Period

LBV

Stars

AGN

Stars

AsteroidsExtrinsic Intrinsic

Asteroid occultation

Eclipsing binary

Planetary transits

RCB

GCAS

BY Dra

RS CVn

Rotation

Eclipse

Microlensing CataclysmicEruptiveRotation Eclipse

DY Per

WR

FU

UV Ceti

ACV

ELL

FKCOM

SXA

Eclipse

NSN

ZANDUG

Variability Tree

Gaia challenge>1,000,000,000 objects, ~10% variable~72 epochs in 5 years

How to automatically detect, classify and characterise?

Page 3: Building an automated 100 million+ variable star catalogue ... · 1 Building an automated 100 million+ variable star catalogue for Gaia Berry Holl1 presented by: Laurent Eyer1 Nami

Credit : L. Eyer & N. Mowlavi (03/2009)

ZZ Ceti

Solar-like

PG 1159

V1093 Her

CWCEP

RR

SXPHE

Hot OB Supergiants

ACYG

BCEPSPB

SPBe

GDOR

DST

PMSδ Scuti

roAp

M

SRL

RV

SARV

PV Tel

PulsationSecular

V777 Her

V361 Hya

Photom. Period

LBV

Stars

AGN

Stars

AsteroidsExtrinsic Intrinsic

Asteroid occultation

Eclipsing binary

Planetary transits

RCB

GCAS

BY Dra

RS CVn

Rotation

Eclipse

Microlensing CataclysmicEruptiveRotation Eclipse

DY Per

WR

FU

UV Ceti

ACV

ELL

FKCOM

SXA

Eclipse

NSN

ZANDUG

Variability Tree

Gaia challenge>1,000,000,000 objects, ~10% variable~72 epochs in 5 years

How to automatically detect, classify and characterise?

Gaia integrated approach:• Multiple instruments

• Instrument calibration

• Variability detection

• Characterisation

• Classification

• Type-specific modelling

• Iterative training set improvement

Page 4: Building an automated 100 million+ variable star catalogue ... · 1 Building an automated 100 million+ variable star catalogue for Gaia Berry Holl1 presented by: Laurent Eyer1 Nami

Berry Holl (Department of Astronomy, University of Geneva)

Detect, classify, and characterise variable stars

Gaia focal plane (106 CCDs)

detection and FOV

discrimination

astrometric measurements

photometry (dispersed

images)

radial velocity (dispersed images)

BAM = basic angle monitor, WFS = wavefront sensor

WFS

1

WFS

2 B

AM

2 B

AM

1

SM

1

SM

2

AF1

AF2

AF3

AF4

AF5

AF6

AF7

AF8

AF9

BP RP

RV

S1

RV

S2

RV

S3

0.42

m

0.93 m

AC

AL

Gaia focal plane (106 CCDs)

detection and FOV

discrimination

astrometric measurements

photometry (dispersed

images)

radial velocity (dispersed images)

BAM = basic angle monitor, WFS = wavefront sensor

WFS

1

WFS

2 B

AM

2 B

AM

1

SM

1

SM

2

AF1

AF2

AF3

AF4

AF5

AF6

AF7

AF8

AF9

BP RP

RV

S1

RV

S2

RV

S3

0.42

m

0.93 m

AC

AL

star%<20%mag%detected!

Place%window.

Gaia focal plane (106 CCDs)

detection and FOV

discrimination

astrometric measurements

photometry (dispersed

images)

radial velocity (dispersed images)

BAM = basic angle monitor, WFS = wavefront sensor

WFS

1

WFS

2 B

AM

2 B

AM

1

SM

1

SM

2

AF1

AF2

AF3

AF4

AF5

AF6

AF7

AF8

AF9

BP RP

RV

S1

RV

S2

RV

S3

0.42

m

0.93 m

AC

AL

6

Multiple(instruments

Source signals

Gaia FoV: 0.7 deg x 0.7 degpixel: 0.059”(AL) x 0.177”(AC)

Page 5: Building an automated 100 million+ variable star catalogue ... · 1 Building an automated 100 million+ variable star catalogue for Gaia Berry Holl1 presented by: Laurent Eyer1 Nami

Berry Holl (Department of Astronomy, University of Geneva)

Detect, classify, and characterise variable stars

observed windows (not to scale):

Gaia focal plane (106 CCDs)

detection and FOV

discrimination

astrometric measurements

photometry (dispersed

images)

radial velocity (dispersed images)

BAM = basic angle monitor, WFS = wavefront sensor

WFS

1

WFS

2 B

AM

2 B

AM

1

SM

1

SM

2

AF1

AF2

AF3

AF4

AF5

AF6

AF7

AF8

AF9

BP RP

RV

S1

RV

S2

RV

S3

0.42

m

0.93 m

AC

AL

Gaia focal plane (106 CCDs)

detection and FOV

discrimination

astrometric measurements

photometry (dispersed

images)

radial velocity (dispersed images)

BAM = basic angle monitor, WFS = wavefront sensor

WFS

1

WFS

2 B

AM

2 B

AM

1

SM

1

SM

2

AF1

AF2

AF3

AF4

AF5

AF6

AF7

AF8

AF9

BP RP

RV

S1

RV

S2

RV

S3

0.42

m

0.93 m

AC

AL

Gaia focal plane (106 CCDs)

detection and FOV

discrimination

astrometric measurements

photometry (dispersed

images)

radial velocity (dispersed images)

BAM = basic angle monitor, WFS = wavefront sensor

WFS

1

WFS

2 B

AM

2 B

AM

1

SM

1

SM

2

AF1

AF2

AF3

AF4

AF5

AF6

AF7

AF8

AF9

BP RP

RV

S1

RV

S2

RV

S3

0.42

m

0.93 m

AC

AL

~80 sec~4.4 sec

6

Multiple(instruments

Source signals

Gaia FoV: 0.7 deg x 0.7 degpixel: 0.059”(AL) x 0.177”(AC)

Page 6: Building an automated 100 million+ variable star catalogue ... · 1 Building an automated 100 million+ variable star catalogue for Gaia Berry Holl1 presented by: Laurent Eyer1 Nami

Berry Holl (Department of Astronomy, University of Geneva)

Detect, classify, and characterise variable stars

Measured signals+noise

7

Multiple(instruments

Photometry

Astrometr

ySpectroscopy

Source signals

i.e. both photometric and astrometric signal

Page 7: Building an automated 100 million+ variable star catalogue ... · 1 Building an automated 100 million+ variable star catalogue for Gaia Berry Holl1 presented by: Laurent Eyer1 Nami

Berry Holl (Department of Astronomy, University of Geneva)

Detect, classify, and characterise variable stars

Measured signals+noise

8

Multiple(instruments

Photometry

Astrometr

ySpectroscopy

detected detected

detected

Source signals

Figure adapted from Eyer & Holl, et al. (2013)

signal detection

Page 8: Building an automated 100 million+ variable star catalogue ... · 1 Building an automated 100 million+ variable star catalogue for Gaia Berry Holl1 presented by: Laurent Eyer1 Nami

Berry Holl (Department of Astronomy, University of Geneva)

Gaia integrated approach:• Multiple instruments

• Instrument calibration

•Variability detection•Characterisation•Classification•Type-specific modelling• Iterative training set improvement

9

Gaia challengeHow to automatically detect, classify and characterise 100 million+ variable stars?

Page 9: Building an automated 100 million+ variable star catalogue ... · 1 Building an automated 100 million+ variable star catalogue for Gaia Berry Holl1 presented by: Laurent Eyer1 Nami

Berry Holl (Department of Astronomy, University of Geneva)

Special variability detection

Classify and characterise variable stars

Measured signals+noise

10

Variability(detection

Variability detection

Constancy rejection based on p-values of e.g.: Chi2, Abbe, Kurtosis, Skewness, ...

Signal matching filters• short timescale [10s, 2h]

e.g. eclipsing binaries, pulsating stars

• solar-like activity (spots and flares)

• small periodic amplitude

• planet transits

Select for variable processing (~10%)

>1,000,000,000 time series(spectro)photometric bands, radial velocity, ...

General variability detection

Page 10: Building an automated 100 million+ variable star catalogue ... · 1 Building an automated 100 million+ variable star catalogue for Gaia Berry Holl1 presented by: Laurent Eyer1 Nami

Berry Holl (Department of Astronomy, University of Geneva)

(spectro)photometric bands, radial velocity, ...

Special variability detection

Classify variable stars

Measured signals+noise

11

Signal(characterisation

Variability detection

>1,000,000,000 time series

General variability detection

Characterisation

• Many parameters available: i.e. astrometric, astrophysical,radial velocity (for bright stars), etc.

• Various attributes, e.g.:absolute magnitude (using parallax),BP-RP (colour), peak-to-peak amplitude,period,skewness,A2/A1 (ratio of Fourier harm. ampl.), etc.

Attribute computationPeriodicity / stochastic / ....

• Periodic model:multi-periodic harmonic Fourierwith polynomial (e.g. trend)

Page 11: Building an automated 100 million+ variable star catalogue ... · 1 Building an automated 100 million+ variable star catalogue for Gaia Berry Holl1 presented by: Laurent Eyer1 Nami

Berry Holl (Department of Astronomy, University of Geneva)

(spectro)photometric bands, radial velocity, ...Measured signals+noise

12

Classification

Variability detection

>1,000,000,000 time series

Attribute computationPeriodicity / stochastic / ....Characterisation

Classification

Identify/confirm new classesHierarchical Modal Association Clustering (HMAC)

• Single and multi-stage:Gaussian Mixture, Random Forest, Bayesian network, ...

• Extractors: transients, microlensing

• Meta-classifier: combination of classifiers for best performance.

UnsupervisedSupervised

Special variability detectionGeneral variability detection

Page 12: Building an automated 100 million+ variable star catalogue ... · 1 Building an automated 100 million+ variable star catalogue for Gaia Berry Holl1 presented by: Laurent Eyer1 Nami

Berry Holl (Department of Astronomy, University of Geneva)

(spectro)photometric bands, radial velocity, ...Measured signals+noise

13

Type:specific(modelling

Variability detection

>1,000,000,000 time series

Attribute computationPeriodicity / stochastic / ....Characterisation

Classification UnsupervisedSupervised

Detailed modelling Specific Object Modelling

• BE stars• Pre main sequence• Rapid phase • Microlensing• AGN

• RR-Lyrae• Cepheids• Eclipsing binaries• Long period Var.• Cataclysmic

• Planetary transit• Solar like oscillators• Flare stars

General variability detection Special variability detection

Page 13: Building an automated 100 million+ variable star catalogue ... · 1 Building an automated 100 million+ variable star catalogue for Gaia Berry Holl1 presented by: Laurent Eyer1 Nami

Berry Holl (Department of Astronomy, University of Geneva)

Gaia integrated approach:• Multiple instruments

• Instrument calibration

• Variability detection

• Characterisation

• Classification

• Type-specific modelling

• Iterative training set improvement

14

Gaia challengeHow to automatically detect, classify and characterise 100 million+ variable stars?

Page 14: Building an automated 100 million+ variable star catalogue ... · 1 Building an automated 100 million+ variable star catalogue for Gaia Berry Holl1 presented by: Laurent Eyer1 Nami

Berry Holl (Department of Astronomy, University of Geneva)

start set

15

Iterative(training(set(improvement

Supervisedtrain

classify

Literature

Specific Object Modelling

training set

= requires visual inspection/confirmation

First iteration:

Page 15: Building an automated 100 million+ variable star catalogue ... · 1 Building an automated 100 million+ variable star catalogue for Gaia Berry Holl1 presented by: Laurent Eyer1 Nami

Berry Holl (Department of Astronomy, University of Geneva)

semi-supervised

16

Iterative(training(set(improvement

Supervised

update set

train

Further iterations:

classify

Literature

Specific Object Modelling

newclass

add/remove/

relabel

Unsupervised

compare clusters with literature: identify

new classes

training set

= requires visual inspection/confirmation

Page 16: Building an automated 100 million+ variable star catalogue ... · 1 Building an automated 100 million+ variable star catalogue for Gaia Berry Holl1 presented by: Laurent Eyer1 Nami

Berry Holl (Department of Astronomy, University of Geneva)

28 day Ecliptic Pole Scanning data (summer 2014)

17

First Gaia data!

Berry Holl

Field-of-view transits during EPSL (equatorial)

DEC

RA 180 090 270

45

-45

ecliptic plane

South ecliptic pole

North ecliptic pole

180

Page 17: Building an automated 100 million+ variable star catalogue ... · 1 Building an automated 100 million+ variable star catalogue for Gaia Berry Holl1 presented by: Laurent Eyer1 Nami

Berry Holl (Department of Astronomy, University of Geneva)

28 day Ecliptic Pole Scanning data (summer 2014)

18

First Gaia data!

Berry Holl

DEC

RA 180 090 270

45

-45

Number density of stars up to magnitude 20

180

South ecliptic pole

North ecliptic pole

Page 18: Building an automated 100 million+ variable star catalogue ... · 1 Building an automated 100 million+ variable star catalogue for Gaia Berry Holl1 presented by: Laurent Eyer1 Nami

Berry Holl (Department of Astronomy, University of Geneva)

28 day Ecliptic Pole Scanning data (summer 2014)

19

First Gaia data!

Berry Holl

)

DEC

180RA 180 090 270

45

-45

Number density of EPSL measurements up to magnitude 20

South ecliptic pole

North ecliptic pole

Page 19: Building an automated 100 million+ variable star catalogue ... · 1 Building an automated 100 million+ variable star catalogue for Gaia Berry Holl1 presented by: Laurent Eyer1 Nami

Berry Holl (Department of Astronomy, University of Geneva) 20

EPSL(data(examplesShort period/faint magnitude Cepheidsin the Large Magellanic Cloud

Gaia Image of the week:http://www.cosmos.esa.int/web/gaia/iow_20150528

Credits: ESA/Gaia/DPAC/CU5/DPCI/CU7/INAF-OABo/INAF-OACn Gisella Clementini, Vincenzo Ripepi, Silvio Leccia, Laurent Eyer, Lorenzo Rimoldini, Isabelle Lecoeur-Taibi, Nami Mowlavi, Dafydd Evans, Geneva CU7/DPCG and the whole CU7 team. The photometric data reduction was done with the PhotPipe pipeline at DPCI; processing data were received from the IDT pipeline at DPCE.

Gaia: G-band

Page 20: Building an automated 100 million+ variable star catalogue ... · 1 Building an automated 100 million+ variable star catalogue for Gaia Berry Holl1 presented by: Laurent Eyer1 Nami

Berry Holl (Department of Astronomy, University of Geneva)

RR-Lyrae starsin the Large Magellanic Cloud

Gaia Image of the week:http://www.cosmos.esa.int/web/gaia/iow_20150305

Credits: ESA/Gaia/DPAC/CU5/CU7/INAF-OABo, Gisella Clementini, Dafydd Evans, Laurent Eyer, Krzysztof Nienartowicz, Lorenzo Rimoldini and the Geneva CU7/DPCG and CU7/INAF-OACN teams.

21

EPSL(data(examples Gaia: G-band OGLE: IV I-band

Page 21: Building an automated 100 million+ variable star catalogue ... · 1 Building an automated 100 million+ variable star catalogue for Gaia Berry Holl1 presented by: Laurent Eyer1 Nami

Berry Holl (Department of Astronomy, University of Geneva) 22

Gaia(data(releasesnominal

mission%endextended

mission%end?

science%operations%started

2014 20222021202020192018201720162015

Release 1:‣ α and δ, mean G-magnitude‣ 100K proper motion stars

(Hipparcos+Gaia)‣ Adequately characterised and

calibration Ecliptic-pole data

Release 2:‣ 5-parameter astrometric

solutions for single star (parallax)‣ Integrated BP/RP + Astrophysical

parameters‣ Mean Vrad (for non variable)

Release 3:‣ Mean Vrad

‣ 5-par astrometry‣ Object classifications and

Astrophysical Parameters‣ Orbital solution of binaries‣ mean RVS spectra

Release 4:‣ Variable stars classification

(All variability products)‣ non-single star catalogue‣ solar system objects

Final release:‣ everything !

Release 1 and/or 2:‣ Possibly: RR-Lyrae, Cepheids, ...

Today!