Atmospheric Science Data Center HPC User Forum

Atmospheric Science Data Center HPC User Forum

Michael Little

September 10, 2009

Broomfield, CO

9/9/09 NASA ASDC HPCU Forum Page: 2

Agenda – September 09, 2009

•Recent NASA Science Mission Directorate Activities•SMD Modeling Needs Study 2008/2009 – Tsengdar Lee

http://www.hec.nasa.gov/news/reports.html•Decadal Survey Data Systems (DSDS) –Martha Maiden

•June, 2009 http://dsds.nasa.gov

•Atmospheric Science at NASA Langley Research Center•Science Focus•Atmospheric Science Data Center

•NextGen Net-centric Operations

Atmospheric Science @LaRC

• Remote Sensing Instruments &in situ measurements– Earth Radiation Budget (ERBE, CERES)

▫ 40 years of internally consistent measurements (<1% err)▫ TRMM, AQUA, TERRA, NPP*, NPOESS*

– Atmospheric Chemistry (SAGE)– Clouds and aerosols (CALIPSO)

• Analysis of measurements– Radiation and Clouds in Climate– Clouds properties

• Data Fusion is key to all higher order data products

9/9/09 Page: 3NASA ASDC HPCU Forum

Earth Radiation Budget

CERES Measures the Earth’s Radiant Energy Balance

02S00220-T0051b-15402S00220-T0051b-154

Figure 1-1. Earth Radiation Balance


CALIPSO LIDAR Data


Climate Science Needs for Computation

• High accuracy (reduce error to <1% in measurement)– Calibrate, calibrate, calibrate– Current weather measurements are ~15%

• Re-processing long time series– Internal consistency– 100x (100 days of observations re-processed in 1 day of compute

time)– Cannot guarantee re-processing will give same data

• Easy to Use Development Environment– Physical Scientists frequently have weak computer science skills (no

formal training)– Resistance to change– Scientists are more valuable than compute cycles– MATLAB and IDL/ENVI


Atmospheric Science Data Center

• ESDIS Digital Active Archive Center– Data Sets

▫ ERBE, CERES, CALIPSO, SAGE, TES, MISR

– 6 Functions: Ingest, Archive, Produce, Distribute, Report, Support– Produce/re-process instrument data products

▫ CERES, CALIPSO, MISR, SAGE

– Distribute Released Data Products

• Science Computing Facility– Local research and missions(300 users)– Develop/test code to produce data products– Instrument calibration (including pre-launch ground cal)– Data Product calibration– Analysis of data – Commercial Applications: MatLab and IDL/ENVI


Recent Changes at ASDC

• Replace legacy systems with computational environment with high I/O to disk systems

– Big endian and little endian due to code migration issues– Increase processor availability with minimum system-wide outages– Fiberchannel interconnect– Improve reliability, maintainability– Reduce SysAdmin workload– Put all interesting data online (2PB)– IBM x3950, x3650, P6 processors– IBM DS4800, DS5300 Disk Arrays with lots of redundancy– Brocade M48k Director– Sun Grid Engine

• Improve stewardship and data protection– All sites have local environmental risks

▫ Key products stored offsite on tape

– Tape archive and backup– SunSTK 8500 with Quantum StoreNext

• Code conversion took > 5 years– Scientifically identical data products


64 x86 SMP256 GB

ASDC/SCF Fiberchannel Connectivity

Fiberchannel Switch

64 x86 SMP256 GB

56 P6256GB

56 P6256GB

56 P6256GB

56 P6256GB

220TBDS4800

220TBDS4800

220TBDS4800

220TBDS4800

220TBDS4800

64 x86 SMP128 GB

16 x86 HS1264 GB

CommonSANhead

(NFS)(AFP)

(Samba)

ASDC JBOSSServer & TS-1& Ingest

ASDC SDP Production

64 x86 SMP256 GB

56 P6256GB

SCF Cluster(Access through

Sun Grid Engine)

220TBDS4800

220TBDS4800

SCF Disk Array

Inst

rum

ent

Inst

rum

ent

ER

BE

-lik

e

SRB

/Pow

erSR

B/P

ower

SAR

B

14 4P6@8GB

SCF Interactive Processors

ASDC Disk Archive(R/W Production)

(R/O SCF)

Con

sodi

ne

TIS

A

SOFA

Clo

uds

Clo

uds

TIS

A

220TBDS4800

WW

WW

WW

64 x86 SMP128 GB

Cloud ModelingCluster (Xu)

64 x86 SMP128 GB

ECS DUEProcessing

DbServer

DbServer

Tesla

Tesla

3755

3755

GPU Experiment (YongHu)

SimServer

FCMonitor

LB1 LB1


Projected Work at ASDC

• Improve performance of processing and storage– Tune SGE– Fiberchannel switch configurations– Improve quality of SysAdmin Support

• Train Users to leverage investment• Model computational environment

– SIMSCRIPT III

• Improve Distribution Function– Google Earth– Permit direct access of data by non-local research community– Service Oriented Architecture (SOA)


NextGen National Airspace System

• Trajectory Based Operations requires Common Operating Picture among everyone using NAS

• Avionics Roadmap created in November, 2008• Scope is curb-to-curb instead of gate-to-gate• NextGen Joint Planning and Development Office

– Created by Public Law 108-176, VISION 100 Act– Coordination function, not PMO– 3x air traffic, safer, cheaper with less environmental impact by 2025– http://www.jpdo.gov– Industry participates via NextGen Institute to avoid Conflict of Interest

• Governance by Collaboration among Partner Agencies and Companies– FAA, Defense, Homeland Security, Commerce, NASA, EPA– Airlines, Airports


http://www.jpdo.gov/

NextGen Net-centric Operations

• Leverage DoD experience with Net-centric Operations• JPDO Net-centric Operations Division leads collaboration

– USAF CIO, Electronic Systems Center, AF Weather Agency– FAA SWIM PM, FAA Telecommunications Infrastructure– NOAA Office of the Federal Coordinator for Meterological Services and

Supporting Research– NWS Aviation Weather Office– NASA LaRC, GSFC and eventually ARC and DFRC– DHS Chief Technology Officer and CIO– NASA, DARPA and NSF supporting R&D

• Industry partnership via Net-centric Working Group– Membership cleared through NextGen Institute– https://jpdo-ncowg.larc.nasa.gov/wiki/index.php/Main_Page

• Lead business process re-engineering, info exchange design – Info owners to implement information exchanges– Ensure access to information for all parties in NAS

• Semantic Service Oriented Architecture (SOA)– Machine-to-machine readability is essential9/9/09 Page: 12NASA ASDC HPCU Forum

https://jpdo-ncowg.larc.nasa.gov/wiki/index.php/Main_Page

NextGen Semantic SOA

• 4D Weather Cube is first implementation– 2013 Initial Operational Capability for Info Exchange Services

– Development at MIT Lincoln Labs and NCAR

– FAA NNEW and Weather in the Cockpit programs

– NWS Aviation Weather Office

• Other Business Areas with Information for Exchange– Safety

– Aircraft

– Airports

– Flight/Flow

– Unmanned Aerial Vehicles

• Key Issues– Cultural Change

– NCO Governance

– Cybersecurity

– Infrastructure: computation and data communications9/9/09 NASA ASDC HPCU Forum Page: 13

- Integrated Surveillance

- Environmental Impact

- Airports

- Special Use Airspace

Atmospheric Science Data Center HPC User Forum

Technology

Transcript of Atmospheric Science Data Center HPC User Forum