An Overview of the TERAPIX pipeline
description
Transcript of An Overview of the TERAPIX pipeline
April 2001April 2001 April 2001April 2001 OPTICON workshop in NiceOPTICON workshop in Nice OPTICON workshop in NiceOPTICON workshop in Nice 11
An Overview of the An Overview of the TERAPIX pipelineTERAPIX pipeline
An Overview of the An Overview of the TERAPIX pipelineTERAPIX pipeline
Emmanuel BERTIN (TERAPIX)Emmanuel BERTIN (TERAPIX) Emmanuel BERTIN (TERAPIX)Emmanuel BERTIN (TERAPIX)
April 2001April 2001 April 2001April 2001 OPTICON workshop in NiceOPTICON workshop in Nice OPTICON workshop in NiceOPTICON workshop in Nice 22
The peopleThe peopleThe peopleThe people• On site:On site:
Yannick MellierYannick Mellier (PI): getting money and scientific analysis (PI): getting money and scientific analysis Gilles MissonnierGilles Missonnier: Hardware, system manager and webmaster: Hardware, system manager and webmaster Mario RadovichMario Radovich (OC): Software development and scientific (OC): Software development and scientific
analysis (image processing, astrometric and photometric analysis (image processing, astrometric and photometric calibrations)calibrations)
Emmanuel BertinEmmanuel Bertin: Software development and scientific analysis : Software development and scientific analysis (image resampling and source extraction)(image resampling and source extraction)
Pierre DidelonPierre Didelon: Software development (Pipeline database): Software development (Pipeline database) Bertrand MorinBertrand Morin: Software development (Pipeline database): Software development (Pipeline database)
• Abroad:Abroad: Francois BonnarelFrancois Bonnarel (CDS): Catalog Archive (CDS): Catalog Archive Jean-Charles CuillandreJean-Charles Cuillandre (CFHT): on-site prereduction (CFHT): on-site prereduction Daniel DurandDaniel Durand & & David SchadeDavid Schade (Co-I): Image archive (Co-I): Image archive
• On site:On site: Yannick MellierYannick Mellier (PI): getting money and scientific analysis (PI): getting money and scientific analysis Gilles MissonnierGilles Missonnier: Hardware, system manager and webmaster: Hardware, system manager and webmaster Mario RadovichMario Radovich (OC): Software development and scientific (OC): Software development and scientific
analysis (image processing, astrometric and photometric analysis (image processing, astrometric and photometric calibrations)calibrations)
Emmanuel BertinEmmanuel Bertin: Software development and scientific analysis : Software development and scientific analysis (image resampling and source extraction)(image resampling and source extraction)
Pierre DidelonPierre Didelon: Software development (Pipeline database): Software development (Pipeline database) Bertrand MorinBertrand Morin: Software development (Pipeline database): Software development (Pipeline database)
• Abroad:Abroad: Francois BonnarelFrancois Bonnarel (CDS): Catalog Archive (CDS): Catalog Archive Jean-Charles CuillandreJean-Charles Cuillandre (CFHT): on-site prereduction (CFHT): on-site prereduction Daniel DurandDaniel Durand & & David SchadeDavid Schade (Co-I): Image archive (Co-I): Image archive
April 2001April 2001 April 2001April 2001 OPTICON workshop in NiceOPTICON workshop in Nice OPTICON workshop in NiceOPTICON workshop in Nice 33
The current hardwareThe current hardwareThe current hardwareThe current hardware
April 2001April 2001 April 2001April 2001 OPTICON workshop in NiceOPTICON workshop in Nice OPTICON workshop in NiceOPTICON workshop in Nice 44
The current hardwareThe current hardwareThe current hardwareThe current hardware
• 4+2 COMPAQ Alpha workstations (2 4+2 COMPAQ Alpha workstations (2 XP1000 for processing, with 1-2GB of XP1000 for processing, with 1-2GB of RAM)RAM)
• 100Mb/s fast-ethernet link100Mb/s fast-ethernet link• 4+ TB of disk-space (RAID5 arrays)4+ TB of disk-space (RAID5 arrays)• DLT7000 and DDS3 tape readersDLT7000 and DDS3 tape readers• 5 Linux PCs and 4 X-terminals5 Linux PCs and 4 X-terminals
• 4+2 COMPAQ Alpha workstations (2 4+2 COMPAQ Alpha workstations (2 XP1000 for processing, with 1-2GB of XP1000 for processing, with 1-2GB of RAM)RAM)
• 100Mb/s fast-ethernet link100Mb/s fast-ethernet link• 4+ TB of disk-space (RAID5 arrays)4+ TB of disk-space (RAID5 arrays)• DLT7000 and DDS3 tape readersDLT7000 and DDS3 tape readers• 5 Linux PCs and 4 X-terminals5 Linux PCs and 4 X-terminals
April 2001April 2001 April 2001April 2001 OPTICON workshop in NiceOPTICON workshop in Nice OPTICON workshop in NiceOPTICON workshop in Nice 55
Layout of the pipelineLayout of the pipelineLayout of the pipelineLayout of the pipeline
April 2001April 2001 April 2001April 2001 OPTICON workshop in NiceOPTICON workshop in Nice OPTICON workshop in NiceOPTICON workshop in Nice 66
Software modulesSoftware modulesSoftware modulesSoftware modules
April 2001April 2001 April 2001April 2001 OPTICON workshop in NiceOPTICON workshop in Nice OPTICON workshop in NiceOPTICON workshop in Nice 77
Image prereduction: PrerepixImage prereduction: PrerepixImage prereduction: PrerepixImage prereduction: Prerepix
April 2001April 2001 April 2001April 2001 OPTICON workshop in NiceOPTICON workshop in Nice OPTICON workshop in NiceOPTICON workshop in Nice 88
Warping and co-additionWarping and co-additionWarping and co-additionWarping and co-addition
April 2001April 2001 April 2001April 2001 OPTICON workshop in NiceOPTICON workshop in Nice OPTICON workshop in NiceOPTICON workshop in Nice 99
Visualization software: Visualization software: PanorapixPanorapix
Visualization software: Visualization software: PanorapixPanorapix
April 2001April 2001 April 2001April 2001 OPTICON workshop in NiceOPTICON workshop in Nice OPTICON workshop in NiceOPTICON workshop in Nice 1010
Simulation software: Simulation software: SkyMakerSkyMaker
Simulation software: Simulation software: SkyMakerSkyMaker
April 2001April 2001 April 2001April 2001 OPTICON workshop in NiceOPTICON workshop in Nice OPTICON workshop in NiceOPTICON workshop in Nice 1111
Simulation software:StuffSimulation software:StuffSimulation software:StuffSimulation software:Stuff
Photometric redshift Photometric redshift derived with HyperZderived with HyperZ
April 2001April 2001 April 2001April 2001 OPTICON workshop in NiceOPTICON workshop in Nice OPTICON workshop in NiceOPTICON workshop in Nice 1212
Software development: status in Software development: status in December 2000December 2000
Software development: status in Software development: status in December 2000December 2000
April 2001April 2001 April 2001April 2001 OPTICON workshop in NiceOPTICON workshop in Nice OPTICON workshop in NiceOPTICON workshop in Nice 1313
Public software releasePublic software releasePublic software releasePublic software release
April 2001April 2001 April 2001April 2001 OPTICON workshop in NiceOPTICON workshop in Nice OPTICON workshop in NiceOPTICON workshop in Nice 1414
Pipeline databasePipeline databasePipeline databasePipeline database
• Based on Objectivity (Object-oriented)Based on Objectivity (Object-oriented)
• Still in developmentStill in development
• (more details this afternoon)(more details this afternoon)
• Based on Objectivity (Object-oriented)Based on Objectivity (Object-oriented)
• Still in developmentStill in development
• (more details this afternoon)(more details this afternoon)
April 2001April 2001 April 2001April 2001 OPTICON workshop in NiceOPTICON workshop in Nice OPTICON workshop in NiceOPTICON workshop in Nice 1515
In the worksIn the worksIn the worksIn the works
• Disk-space /Input-outputDisk-space /Input-output
• Automatic masking of image defectsAutomatic masking of image defects
• Defringing (depending on the instrument)Defringing (depending on the instrument)
• PSF homogenizationPSF homogenization
• Pipeline databasePipeline database
• Disk-space /Input-outputDisk-space /Input-output
• Automatic masking of image defectsAutomatic masking of image defects
• Defringing (depending on the instrument)Defringing (depending on the instrument)
• PSF homogenizationPSF homogenization
• Pipeline databasePipeline database