Canadian Virtual Observatory David Schade Canadian Astronomy Data Centre Pat Dowler, Daniel Durand,...

14
Canadian Virtual Observatory David Schade Canadian Astronomy Data Centre Pat Dowler, Daniel Durand, Luc Simard, Norm Hill, Severin Gaudet

Transcript of Canadian Virtual Observatory David Schade Canadian Astronomy Data Centre Pat Dowler, Daniel Durand,...

Page 1: Canadian Virtual Observatory David Schade Canadian Astronomy Data Centre Pat Dowler, Daniel Durand, Luc Simard, Norm Hill, Severin Gaudet.

Canadian Virtual Observatory

David Schade

Canadian Astronomy Data Centre

Pat Dowler, Daniel Durand, Luc Simard, Norm Hill,Severin Gaudet

Page 2: Canadian Virtual Observatory David Schade Canadian Astronomy Data Centre Pat Dowler, Daniel Durand, Luc Simard, Norm Hill, Severin Gaudet.

Virtual Observatories: June 10-14, 2002

Canadian Virtual Observatory

The Canadian Virtual Observatory is a reality

– IT WORKS

– CVO is funded by National Research Council Canada and the Canadian Space Agency

• $4.3 million over 3-5 years

– Design: Working CVO architecture

– Content: WFPC2 associations pipeline, 12,000 images and 18.6 million sources

Page 3: Canadian Virtual Observatory David Schade Canadian Astronomy Data Centre Pat Dowler, Daniel Durand, Luc Simard, Norm Hill, Severin Gaudet.

Virtual Observatories: June 10-14, 2002

CVO system components

• User interface– Database exploration with constraints

• API based on JAVA/JINI – Others could use our API to access our system

effectively

• Content– WFPC2 images and catalogues

• CADC infrastructure– Database servers– Processing– Storage– Web servers

Page 4: Canadian Virtual Observatory David Schade Canadian Astronomy Data Centre Pat Dowler, Daniel Durand, Luc Simard, Norm Hill, Severin Gaudet.

Virtual Observatories: June 10-14, 2002

VoPix

VoProc

VoSrc

VO Architecture

Archive

Web interface to archive

Archives publish to the VO

Pat Dowler at ADASS

Page 5: Canadian Virtual Observatory David Schade Canadian Astronomy Data Centre Pat Dowler, Daniel Durand, Luc Simard, Norm Hill, Severin Gaudet.

Virtual Observatories: June 10-14, 2002

VoPix

VoProc

VoSrc

VO Architecture

An idealized representation of pixel datafree from archive-specific descriptors

Instances of processingClasses of processing

Source measurements free fromarchive-specific descriptors

Page 6: Canadian Virtual Observatory David Schade Canadian Astronomy Data Centre Pat Dowler, Daniel Durand, Luc Simard, Norm Hill, Severin Gaudet.

Virtual Observatories: June 10-14, 2002

Drill down

• Scientists must be able to drill down from a catalogue entry:

– Processing details– Pixels– Input parameters– Raw pixels

• Measurements reproducible

• Data integrity– Data Verification procedures– Online documentation– Refereed publications

V i r t u a l O b s e r v a t o r i e s : J u n e 1 0 - 1 4 , 2 0 0 2

V o P i x

V o P r o c

V o S r c

V O A r c h i t e c t u r e

A r c h i v e

VO Architecture

Page 7: Canadian Virtual Observatory David Schade Canadian Astronomy Data Centre Pat Dowler, Daniel Durand, Luc Simard, Norm Hill, Severin Gaudet.

Virtual Observatories: June 10-14, 2002

VoObj

Object catalogues combine multi-wavelength sources into an object identification

V i r t u a l O b s e r v a t o r i e s : J u n e 1 0 - 1 4 , 2 0 0 2

V o P i x

V o P r o c

V o S r c

V O A r c h i t e c t u r e

A n i d e a l i z e d r e p r e s e n t a t i o n o f p i x e l d a t af r e e f r o m a r c h i v e - s p e c i f i c d e s c r i p t o r s

I n s t a n c e s o f p r o c e s s i n gC l a s s e s o f p r o c e s s i n g

S o u r c e m e a s u r e m e n t s f r e e f r o ma r c h i v e - s p e c i f i c d e s c r i p t o r s

Production of object catalogues is a science process. The master object catalogue is a representation of the state of our astrophysical knowledge.

Science Project

VO Architecture

Object catalogues

Page 8: Canadian Virtual Observatory David Schade Canadian Astronomy Data Centre Pat Dowler, Daniel Durand, Luc Simard, Norm Hill, Severin Gaudet.

Virtual Observatories: June 10-14, 2002VO Architecture

Pixels sample• Energy• Space• Time

Processing table links back to archive

Page 9: Canadian Virtual Observatory David Schade Canadian Astronomy Data Centre Pat Dowler, Daniel Durand, Luc Simard, Norm Hill, Severin Gaudet.

Virtual Observatories: June 10-14, 2002VO Architecture

Source Table

Page 10: Canadian Virtual Observatory David Schade Canadian Astronomy Data Centre Pat Dowler, Daniel Durand, Luc Simard, Norm Hill, Severin Gaudet.

Virtual Observatories: June 10-14, 2002

WFPC2 associations, stacks, source catalogues

• What we have now– 12,300 stacks in 6 filters– 18.6 million sources

• What we will have this year– 25,000 stacks– 30 million sources– Object catalogues

Content

Page 11: Canadian Virtual Observatory David Schade Canadian Astronomy Data Centre Pat Dowler, Daniel Durand, Luc Simard, Norm Hill, Severin Gaudet.

Virtual Observatories: June 10-14, 2002WFPC2 catalogues

Sextractor (Bertin) for object detection/photometry

Page 12: Canadian Virtual Observatory David Schade Canadian Astronomy Data Centre Pat Dowler, Daniel Durand, Luc Simard, Norm Hill, Severin Gaudet.

Virtual Observatories: June 10-14, 2002

How do we do it

• WFPC2 associations (ST-ECF/CADC collaboration)

• New storage/processing environment– 20 AMD 1.5 GHz for processing– 18 Terabytes for storage

• We can do 25,000 stacks and extract 30 million sources in a few weeks

Processing and storage hardware

Page 13: Canadian Virtual Observatory David Schade Canadian Astronomy Data Centre Pat Dowler, Daniel Durand, Luc Simard, Norm Hill, Severin Gaudet.

Virtual Observatories: June 10-14, 2002

Future CVO : this year

• CVO Prototype released to the public July 15

• Release CVO Phase II near the end of 2002– Add 2MASS catalogues

• Explore inter-operability prototype (2MASS)

• Explore ACS collaboration with STScI, ST-ECF, CADC

• Increase WFPC2 content– 25,00 stacked images– 30 million sources with high-quality imaging

• Object Catalogues

Page 14: Canadian Virtual Observatory David Schade Canadian Astronomy Data Centre Pat Dowler, Daniel Durand, Luc Simard, Norm Hill, Severin Gaudet.

Virtual Observatories: June 10-14, 2002

Future CVO

• Develop the functionality of the CVO

• Link with other interesting pixel/catalogue datasets

• Generate more high-quality VO content

• CFHT Legacy Surveys– Partnership with CFHT,TERAPIX, CDS– Science: Supernovae, Weak Lensing, Kuiper Belt– 500 nights/5years: Wide and deep components– 50 million objects with high-quality imaging– Processed image products and catalogues– 100 Terabyte project

CFHT Legacy Surveys