Ed Kearns National Climatic Data Center Asheville, NC.

8
Ed Kearns National Climatic Data Center Asheville, NC

description

Archive Responsibilities Accept information from Data Producers Exercise sufficient control to ensure long-term preservation and access (stewardship) Ensures the information to be preserved is independently understandable and accessible now and in the future Follow policies and procedures that ensure the information is preserved against all reasonable contingencies

Transcript of Ed Kearns National Climatic Data Center Asheville, NC.

Page 1: Ed Kearns National Climatic Data Center Asheville, NC.

Ed KearnsNational Climatic Data Center

Asheville, NC

Page 2: Ed Kearns National Climatic Data Center Asheville, NC.

Archive and AccessArchives preserve data, make them

accessible in meaningful ways , and ensure their information remains available for future generations.

What changes in technology and observing systems are anticipated?

What kinds of data and information should be archived in the future?

What can the Data Centers do to prepare?

Page 3: Ed Kearns National Climatic Data Center Asheville, NC.

Archive ResponsibilitiesAccept information from Data ProducersExercise sufficient control to ensure long-

term preservation and access (stewardship)Ensures the information to be preserved is

independently understandable and accessible now and in the future

Follow policies and procedures that ensure the information is preserved against all reasonable contingencies

Page 4: Ed Kearns National Climatic Data Center Asheville, NC.

IT IssuesPhysical Storage: Paper, Tapes, Spinning Disk

Future: solid state?All ultimately fragile

Security though redundancyMultiple copies, distributed systems

Access : high speed internet, physical media deliveryDistributed systems, multiple access pointsData formats: facilitate access, self describing,

metadata stdsAccess tools that serve data to a variety of audiences

The data can be expected to be well-cared for….but what about the information?

Page 5: Ed Kearns National Climatic Data Center Asheville, NC.

What to archive?NOAA Observing Systems Council

http://www.nosc.noaa.gov/docs/products/NOAA_Procedure_document_final_12-16-1.pdf

Volume of Observations : NCDC stores 3.5 PB todayNPOESS, next-gen NEXRAD : several PB per year

increaseModel outputs : archive them if not easily

reproducibleBut for how long? Shelf life of synthetic data?

Derived products : process raw records to higher levelsExample

Climate Data Records (CDR) Climate Information Records (CIR)

Page 6: Ed Kearns National Climatic Data Center Asheville, NC.

CDR and CIRClimate Data Records (CDRs) are the essential long

term records for climate studies and assessmentsCDRs require updates as our knowledge of the

observing systems and science improvesArchived data must be revisited, reprocessed

Climate Information Records (CIRs) are derived from and directly dependent upon CDRs

Higher level CIRs will be found more useful by a larger number of user communitiesWater managers, energy industry, ecosystem

managersCIRs place more emphasis on access and delivery

Page 7: Ed Kearns National Climatic Data Center Asheville, NC.

Current challengesFully track associations between the archived

information and its users and applicationsProvides an aggregate value of the info for our societyEstablish a 2-way relationship between info and usersProvides a context for the information for future users

Deliver more information to broader communitiesLess reliance on hierarchal systems and more on

networked systems – ideally a blend of the twoFaster transitions from research to operations

Page 8: Ed Kearns National Climatic Data Center Asheville, NC.

Thoughts and questionsThroughout history, significant information

breakthroughs have brought about social and/or technological revolutionsScientific literacy?

The survival of archives across generations has been a political issue, not a technical or physical issue.

Archives must serve society to stay relevant – so what does society want from our archives?