Bradley Evans SPEDDEXES 2014

21
What is SPEDDEXES? Brad Evans

description

Overview: What is SPEDDEXES?

Transcript of Bradley Evans SPEDDEXES 2014

Page 1: Bradley Evans SPEDDEXES 2014

What is SPEDDEXES?Brad Evans

Page 2: Bradley Evans SPEDDEXES 2014

Housekeeping

Who is a registered NCI user?

http://nci.org.au/access/user-registration/register-new-user/

http://nci.org.au/access/user-registration/connect-to-existing-project/

Page 3: Bradley Evans SPEDDEXES 2014

SPatially Explicit Data Discovery, EXtraction and Evaluation Service

SPATIALLY and temporally EXPLICIT research data infrastructure to interrogate data streams on the National Computing Infrastructure

DATA DISCOVERY for TERN or any datasets which can be read by the platform

EXTRACTION AND EVALUATION drives advances in ecosystem science, impact assessment and land management

Page 4: Bradley Evans SPEDDEXES 2014

Technology?

• It’s a TOOL, a software API • Runs in the cloud

• Open source, community owned

• Connects to OpenDAP, AGDC, AODAAC, ERDDAP ? Whatever we connect it too!• Provides a common API for multiple data streams

• Serves “Extractions” or “Summaries” of data• Spatially and temporally explicit queries

• Data discoverers via map servers• HPC users (i.e. modellers & scientists)

Conceptually…

Page 5: Bradley Evans SPEDDEXES 2014

Example

You are an ecosystem scientist, unashamedly multi-disciplinary, and you have a research question.

What is the impact of a tropical cyclone on a regions carbon cycle?

You need to spatially and temporally analyze several datasets (in this real-life example the entire AusCover MODIS archive!)

Page 6: Bradley Evans SPEDDEXES 2014
Page 7: Bradley Evans SPEDDEXES 2014

Motivation…

Page 8: Bradley Evans SPEDDEXES 2014

Tree damage maps – estimate coarse woody debris

Page 9: Bradley Evans SPEDDEXES 2014

Tree damage maps – estimate coarse woody debris

Monitoring transects

Page 10: Bradley Evans SPEDDEXES 2014

Monica : Impact on productivity?GPP MOD17A2 - Seasonal Trend filter

Stats: R-Project STL package

Page 11: Bradley Evans SPEDDEXES 2014

Monica

SteveHelen

Page 12: Bradley Evans SPEDDEXES 2014
Page 13: Bradley Evans SPEDDEXES 2014

That’s nothing new!

• But without the SPEDDEXES API, you would:• Run on your desktop (most likely)

• Possibly not share the code

• Highly likely you WOULD NOT write your code to connect to n servers or API’s• You would have to write a script/ tool for each server!

• Possibly not share the code

• Possibly explore less data – OR WORSE!• NOT use spatially explicit queries or analysis

• OR Download EVERYTHING first, then analyze 5% of it !• Clog up the HPC with 95% unused data for YEARS

• until you publish your results and share the code

• Who cares?

Somewhat correct…

Page 14: Bradley Evans SPEDDEXES 2014

SCIENTISTSSPEDDEXES = LESS GHG’s

= BETTER, GREENER SCIENCE

Page 15: Bradley Evans SPEDDEXES 2014

Scientists will evolve!

Page 16: Bradley Evans SPEDDEXES 2014

Scientists will evolve!

Page 17: Bradley Evans SPEDDEXES 2014

Scientists will evolve!

Page 18: Bradley Evans SPEDDEXES 2014

Scientists will evolve!

Page 19: Bradley Evans SPEDDEXES 2014

Scientists will evolve!

Page 20: Bradley Evans SPEDDEXES 2014

Scientists will evolve!

Page 21: Bradley Evans SPEDDEXES 2014

Agenda

• Today• Listen to the experts

• Form our community vision on how to make it

• Tuesday, Wednesday, Thursday• Discuss, hack, review, test & commit• Enjoy each others company

• Friday• Publish• Agree on our next steps

• As a community

• Go home

Contemplate, discuss, hack, publish, go home