SCD User Briefing The Community Data Portal and the Earth System Grid Don Middleton with presentation material developed by Luca Cinquini, Mary Haley, Fred Clare - and many project collaborators NCAR Scientific Computing Division Section Head, Visualization & Enabling Technologies January 11, 2005 Don Middleton with presentation material developed by Luca Cinquini, Mary Haley, Fred Clare - and many project collaborators NCAR Scientific Computing Division Section Head, Visualization & Enabling Technologies January 11, th AMS Annual Meeting January 9-14, 2005 Data Organized by Org Chart (?) The NCAR Community Data Portal (CDP) CDP Goals Build the cyberinfrastructure for the integration and support of a broad range of geo-informatic projects within NCAR, thus reducing startup cost and development time Develop unified gateway to the large, diverse UCAR/NCAR/UOP data holdings, providing a wide range of data services on these holdings: publishing, browsing, search and discovery, download, remote access, analysis, visualization Build the cyberinfrastructure for the integration and support of a broad range of geo-informatic projects within NCAR, thus reducing startup cost and development time Develop unified gateway to the large, diverse UCAR/NCAR/UOP data holdings, providing a wide range of data services on these holdings: publishing, browsing, search and discovery, download, remote access, analysis, visualization The Community Data Portal - A Brief Tour Browse Click Mozart Metadata Mozart Data Search for NCEP ETA Type Search for NCEP ETA results Search for tree ring Type Search for tree ring results Advanced Search 1 Advanced Search 2 Forest Fire Visualization Click CDP Home with WACCM Click WACCM Data WACCM Source Code CDP Collaborations and Acknowledgements SCD/DSG: thanks for supporting the hardware! SCD/DSS: metadata and data services SCD/MSS: online access to MSS ESG (including CGD, HAO): shared development, hosting environment, technologies Unidata: joint development of NcML, collaborated on THREDDS search and discovery metadata DLESE, BADC, GCMD: export or exchange (via OAI) of metadata documents for cross-institutional searches COLA: provide remote data services through GRADS Many data providers across UCAR/NCAR/UOP and others: ACD, ATD, CGD (CAS, PCM, CCSM), JOSS, SCD (DSS, VETS), Unidata, WACCM and CU/ENLIL GridBGC: shared development GIS: NetCDF to GIS conversion services BADC: cross-center data discovery ESP: sharing information and technologies NOMADS: undergoing exploratory collaboration SCD/DSG: thanks for supporting the hardware! SCD/DSS: metadata and data services SCD/MSS: online access to MSS ESG (including CGD, HAO): shared development, hosting environment, technologies Unidata: joint development of NcML, collaborated on THREDDS search and discovery metadata DLESE, BADC, GCMD: export or exchange (via OAI) of metadata documents for cross-institutional searches COLA: provide remote data services through GRADS Many data providers across UCAR/NCAR/UOP and others: ACD, ATD, CGD (CAS, PCM, CCSM), JOSS, SCD (DSS, VETS), Unidata, WACCM and CU/ENLIL GridBGC: shared development GIS: NetCDF to GIS conversion services BADC: cross-center data discovery ESP: sharing information and technologies NOMADS: undergoing exploratory collaboration Climate Data Click The Earth System Grid The ESG Collaboration ORNL: Climate storage & computational resources ORNL: Climate storage & computational resources LANL: Next generation coupled models & computing LANL: Next generation coupled models & computing USC/ISI: Computational grids, & grid-based applications USC/ISI: Computational grids, & grid-based applications NCAR: Climate change predication and scenarios NCAR: Climate change predication and scenarios LBNL: Climate storage facility LBNL: Climate storage facility LLNL: Model diagnostics & inter-comparison LLNL: Model diagnostics & inter-comparison ANL: Computational grids, & grid-based applications ANL: Computational grids, & grid-based applications ESG Home PCM Metadata PCM Files and MSS ESG CCSM CCSM Datasets Subsetting List Subsetting Interface IPCC Data Click Data Available via ESG Portal (November 2004) Community Climate System Model 28.4 Terabytes, including 21 simulations, 141 datasets, and 289,374 files Parallel Climate Model Terabytes, including 98 simulations, 434 datasets, and 44,000 files Total 48.8 Terabytes, 119 simulations, 575 datasets, in over 333,872 files 167 registrations, 132 approved, 154.2GB downloaded to date Plus new IPCC Data 150 user registrations, 1.1TB of data downloaded, in 16,000 files Community Climate System Model 28.4 Terabytes, including 21 simulations, 141 datasets, and 289,374 files Parallel Climate Model Terabytes, including 98 simulations, 434 datasets, and 44,000 files Total 48.8 Terabytes, 119 simulations, 575 datasets, in over 333,872 files 167 registrations, 132 approved, 154.2GB downloaded to date Plus new IPCC Data 150 user registrations, 1.1TB of data downloaded, in 16,000 files ing Our Data Data->Knowledge Mass Storage System (2.0PB) Petascale Knowledge Environment Establish new paradigms for managing and accessing scientific data based on semantic organization. END