phase 3 workflow & tools
1 ESO Public Surveys Phase III Workshop 30.11.2010
1
S. ZampieriV. ForchiP. NunesD. SfornaM. Klein GebbinckF. Sogni
2
workflow
1. Create Phase 3 Program
2. Manage Program
Permissions
ESO/EDP PI PI/COI
3. Create Collection
and Release
4. Prepare Data
5. Validate Data
6. Upload Data
7. Close Release
8. Validate Release
(automatic)
9. Validate Release
(scientific)
10. Archive Release
11. Publish Release
Legend:
3
start
4
login
5
manage programs
6
manage program permissions
7
create new collection
8
manage collections
9
create new release
science data: *.fits, *.fits.fz, PRODCATG
ancillary data: *, associated to science data
scientific meta-data: FITS keywords
associations: ASSONi, ASSOCi
provenance: PROVi
description: release-description.tar
See Phase 3 User DocumentationSee Jörg’s presentation
10
prepare data release
java –jar validator.jar –r <dir> \ -m create|update
OutputSummary: console (OK | ERROR)Table of contents: validator.tocValidation errors: validator.errorApplication log messages: validator.log
11
validate data release
lftp –u user,pass phase3ftp.eso.org
cd program/collection/release
mput *
Requires secure FTP client (FileZilla, lftp, etc.)
Standard FTP doesn’t work
12
upload data
13
close release
Only PI can close a release
Triggers automatic validation process
FTP area becomes unavailable for the user
14
release states
1. Open 2. Closed
3a. Valid 3b. Error
4. ToBeArchived
5. Archived
PI/COI
ESO/SYSTEM
ESO/EDP
15
view release contents (only for archived releases)
download release description file
16
updating or superseding a release
To update a release:
1. Download releasedescription fileCONTENT.ESO
2. CreateCHANGES.USERDELETE fileREPLACE file
3. Validate-m update
4. Upload data +CHANGES.USER
Top Related