An Overview of the TERAPIX pipeline

15
April 2001 April 2001 OPTICON workshop in Nice OPTICON workshop in Nice 1 An Overview of the An Overview of the TERAPIX pipeline TERAPIX pipeline Emmanuel BERTIN (TERAPIX) Emmanuel BERTIN (TERAPIX)

description

An Overview of the TERAPIX pipeline. Emmanuel BERTIN (TERAPIX). The people. On site: Yannick Mellier (PI): getting money and scientific analysis Gilles Missonnier : Hardware, system manager and webmaster - PowerPoint PPT Presentation

Transcript of An Overview of the TERAPIX pipeline

Page 1: An Overview of the TERAPIX pipeline

April 2001April 2001 April 2001April 2001 OPTICON workshop in NiceOPTICON workshop in Nice OPTICON workshop in NiceOPTICON workshop in Nice 11

An Overview of the An Overview of the TERAPIX pipelineTERAPIX pipeline

An Overview of the An Overview of the TERAPIX pipelineTERAPIX pipeline

Emmanuel BERTIN (TERAPIX)Emmanuel BERTIN (TERAPIX) Emmanuel BERTIN (TERAPIX)Emmanuel BERTIN (TERAPIX)

Page 2: An Overview of the TERAPIX pipeline

April 2001April 2001 April 2001April 2001 OPTICON workshop in NiceOPTICON workshop in Nice OPTICON workshop in NiceOPTICON workshop in Nice 22

The peopleThe peopleThe peopleThe people• On site:On site:

Yannick MellierYannick Mellier (PI): getting money and scientific analysis (PI): getting money and scientific analysis Gilles MissonnierGilles Missonnier: Hardware, system manager and webmaster: Hardware, system manager and webmaster Mario RadovichMario Radovich (OC): Software development and scientific (OC): Software development and scientific

analysis (image processing, astrometric and photometric analysis (image processing, astrometric and photometric calibrations)calibrations)

Emmanuel BertinEmmanuel Bertin: Software development and scientific analysis : Software development and scientific analysis (image resampling and source extraction)(image resampling and source extraction)

Pierre DidelonPierre Didelon: Software development (Pipeline database): Software development (Pipeline database) Bertrand MorinBertrand Morin: Software development (Pipeline database): Software development (Pipeline database)

• Abroad:Abroad: Francois BonnarelFrancois Bonnarel (CDS): Catalog Archive (CDS): Catalog Archive Jean-Charles CuillandreJean-Charles Cuillandre (CFHT): on-site prereduction (CFHT): on-site prereduction Daniel DurandDaniel Durand & & David SchadeDavid Schade (Co-I): Image archive (Co-I): Image archive

• On site:On site: Yannick MellierYannick Mellier (PI): getting money and scientific analysis (PI): getting money and scientific analysis Gilles MissonnierGilles Missonnier: Hardware, system manager and webmaster: Hardware, system manager and webmaster Mario RadovichMario Radovich (OC): Software development and scientific (OC): Software development and scientific

analysis (image processing, astrometric and photometric analysis (image processing, astrometric and photometric calibrations)calibrations)

Emmanuel BertinEmmanuel Bertin: Software development and scientific analysis : Software development and scientific analysis (image resampling and source extraction)(image resampling and source extraction)

Pierre DidelonPierre Didelon: Software development (Pipeline database): Software development (Pipeline database) Bertrand MorinBertrand Morin: Software development (Pipeline database): Software development (Pipeline database)

• Abroad:Abroad: Francois BonnarelFrancois Bonnarel (CDS): Catalog Archive (CDS): Catalog Archive Jean-Charles CuillandreJean-Charles Cuillandre (CFHT): on-site prereduction (CFHT): on-site prereduction Daniel DurandDaniel Durand & & David SchadeDavid Schade (Co-I): Image archive (Co-I): Image archive

Page 3: An Overview of the TERAPIX pipeline

April 2001April 2001 April 2001April 2001 OPTICON workshop in NiceOPTICON workshop in Nice OPTICON workshop in NiceOPTICON workshop in Nice 33

The current hardwareThe current hardwareThe current hardwareThe current hardware

Page 4: An Overview of the TERAPIX pipeline

April 2001April 2001 April 2001April 2001 OPTICON workshop in NiceOPTICON workshop in Nice OPTICON workshop in NiceOPTICON workshop in Nice 44

The current hardwareThe current hardwareThe current hardwareThe current hardware

• 4+2 COMPAQ Alpha workstations (2 4+2 COMPAQ Alpha workstations (2 XP1000 for processing, with 1-2GB of XP1000 for processing, with 1-2GB of RAM)RAM)

• 100Mb/s fast-ethernet link100Mb/s fast-ethernet link• 4+ TB of disk-space (RAID5 arrays)4+ TB of disk-space (RAID5 arrays)• DLT7000 and DDS3 tape readersDLT7000 and DDS3 tape readers• 5 Linux PCs and 4 X-terminals5 Linux PCs and 4 X-terminals

• 4+2 COMPAQ Alpha workstations (2 4+2 COMPAQ Alpha workstations (2 XP1000 for processing, with 1-2GB of XP1000 for processing, with 1-2GB of RAM)RAM)

• 100Mb/s fast-ethernet link100Mb/s fast-ethernet link• 4+ TB of disk-space (RAID5 arrays)4+ TB of disk-space (RAID5 arrays)• DLT7000 and DDS3 tape readersDLT7000 and DDS3 tape readers• 5 Linux PCs and 4 X-terminals5 Linux PCs and 4 X-terminals

Page 5: An Overview of the TERAPIX pipeline

April 2001April 2001 April 2001April 2001 OPTICON workshop in NiceOPTICON workshop in Nice OPTICON workshop in NiceOPTICON workshop in Nice 55

Layout of the pipelineLayout of the pipelineLayout of the pipelineLayout of the pipeline

Page 6: An Overview of the TERAPIX pipeline

April 2001April 2001 April 2001April 2001 OPTICON workshop in NiceOPTICON workshop in Nice OPTICON workshop in NiceOPTICON workshop in Nice 66

Software modulesSoftware modulesSoftware modulesSoftware modules

Page 7: An Overview of the TERAPIX pipeline

April 2001April 2001 April 2001April 2001 OPTICON workshop in NiceOPTICON workshop in Nice OPTICON workshop in NiceOPTICON workshop in Nice 77

Image prereduction: PrerepixImage prereduction: PrerepixImage prereduction: PrerepixImage prereduction: Prerepix

Page 8: An Overview of the TERAPIX pipeline

April 2001April 2001 April 2001April 2001 OPTICON workshop in NiceOPTICON workshop in Nice OPTICON workshop in NiceOPTICON workshop in Nice 88

Warping and co-additionWarping and co-additionWarping and co-additionWarping and co-addition

Page 9: An Overview of the TERAPIX pipeline

April 2001April 2001 April 2001April 2001 OPTICON workshop in NiceOPTICON workshop in Nice OPTICON workshop in NiceOPTICON workshop in Nice 99

Visualization software: Visualization software: PanorapixPanorapix

Visualization software: Visualization software: PanorapixPanorapix

Page 10: An Overview of the TERAPIX pipeline

April 2001April 2001 April 2001April 2001 OPTICON workshop in NiceOPTICON workshop in Nice OPTICON workshop in NiceOPTICON workshop in Nice 1010

Simulation software: Simulation software: SkyMakerSkyMaker

Simulation software: Simulation software: SkyMakerSkyMaker

Page 11: An Overview of the TERAPIX pipeline

April 2001April 2001 April 2001April 2001 OPTICON workshop in NiceOPTICON workshop in Nice OPTICON workshop in NiceOPTICON workshop in Nice 1111

Simulation software:StuffSimulation software:StuffSimulation software:StuffSimulation software:Stuff

Photometric redshift Photometric redshift derived with HyperZderived with HyperZ

Page 12: An Overview of the TERAPIX pipeline

April 2001April 2001 April 2001April 2001 OPTICON workshop in NiceOPTICON workshop in Nice OPTICON workshop in NiceOPTICON workshop in Nice 1212

Software development: status in Software development: status in December 2000December 2000

Software development: status in Software development: status in December 2000December 2000

Page 13: An Overview of the TERAPIX pipeline

April 2001April 2001 April 2001April 2001 OPTICON workshop in NiceOPTICON workshop in Nice OPTICON workshop in NiceOPTICON workshop in Nice 1313

Public software releasePublic software releasePublic software releasePublic software release

Page 14: An Overview of the TERAPIX pipeline

April 2001April 2001 April 2001April 2001 OPTICON workshop in NiceOPTICON workshop in Nice OPTICON workshop in NiceOPTICON workshop in Nice 1414

Pipeline databasePipeline databasePipeline databasePipeline database

• Based on Objectivity (Object-oriented)Based on Objectivity (Object-oriented)

• Still in developmentStill in development

• (more details this afternoon)(more details this afternoon)

• Based on Objectivity (Object-oriented)Based on Objectivity (Object-oriented)

• Still in developmentStill in development

• (more details this afternoon)(more details this afternoon)

Page 15: An Overview of the TERAPIX pipeline

April 2001April 2001 April 2001April 2001 OPTICON workshop in NiceOPTICON workshop in Nice OPTICON workshop in NiceOPTICON workshop in Nice 1515

In the worksIn the worksIn the worksIn the works

• Disk-space /Input-outputDisk-space /Input-output

• Automatic masking of image defectsAutomatic masking of image defects

• Defringing (depending on the instrument)Defringing (depending on the instrument)

• PSF homogenizationPSF homogenization

• Pipeline databasePipeline database

• Disk-space /Input-outputDisk-space /Input-output

• Automatic masking of image defectsAutomatic masking of image defects

• Defringing (depending on the instrument)Defringing (depending on the instrument)

• PSF homogenizationPSF homogenization

• Pipeline databasePipeline database