Chris A. Mattmann Senior Computer Scientist Jet Propulsion Laboratory D. Waliser (JPL) C. Goodale...
-
Upload
hillary-james -
Category
Documents
-
view
213 -
download
1
Transcript of Chris A. Mattmann Senior Computer Scientist Jet Propulsion Laboratory D. Waliser (JPL) C. Goodale...
![Page 1: Chris A. Mattmann Senior Computer Scientist Jet Propulsion Laboratory D. Waliser (JPL) C. Goodale (JPL) J. Kim (UCLA/JIFRESSE Many others ADSIMNOR-CORDEX.](https://reader037.fdocuments.in/reader037/viewer/2022110321/56649f3f5503460f94c5ff84/html5/thumbnails/1.jpg)
Chris A. MattmannSenior Computer ScientistJet Propulsion Laboratory
D. Waliser (JPL)C. Goodale (JPL)
J. Kim (UCLA/JIFRESSE
Many others
ADSIMNOR-CORDEX workshop on Arctic climate modeling results and needs, March 20-21, 2012
![Page 2: Chris A. Mattmann Senior Computer Scientist Jet Propulsion Laboratory D. Waliser (JPL) C. Goodale (JPL) J. Kim (UCLA/JIFRESSE Many others ADSIMNOR-CORDEX.](https://reader037.fdocuments.in/reader037/viewer/2022110321/56649f3f5503460f94c5ff84/html5/thumbnails/2.jpg)
Using Satellite & Other Observations For Regional Model Evaluation
![Page 3: Chris A. Mattmann Senior Computer Scientist Jet Propulsion Laboratory D. Waliser (JPL) C. Goodale (JPL) J. Kim (UCLA/JIFRESSE Many others ADSIMNOR-CORDEX.](https://reader037.fdocuments.in/reader037/viewer/2022110321/56649f3f5503460f94c5ff84/html5/thumbnails/3.jpg)
![Page 4: Chris A. Mattmann Senior Computer Scientist Jet Propulsion Laboratory D. Waliser (JPL) C. Goodale (JPL) J. Kim (UCLA/JIFRESSE Many others ADSIMNOR-CORDEX.](https://reader037.fdocuments.in/reader037/viewer/2022110321/56649f3f5503460f94c5ff84/html5/thumbnails/4.jpg)
![Page 5: Chris A. Mattmann Senior Computer Scientist Jet Propulsion Laboratory D. Waliser (JPL) C. Goodale (JPL) J. Kim (UCLA/JIFRESSE Many others ADSIMNOR-CORDEX.](https://reader037.fdocuments.in/reader037/viewer/2022110321/56649f3f5503460f94c5ff84/html5/thumbnails/5.jpg)
![Page 6: Chris A. Mattmann Senior Computer Scientist Jet Propulsion Laboratory D. Waliser (JPL) C. Goodale (JPL) J. Kim (UCLA/JIFRESSE Many others ADSIMNOR-CORDEX.](https://reader037.fdocuments.in/reader037/viewer/2022110321/56649f3f5503460f94c5ff84/html5/thumbnails/6.jpg)
![Page 7: Chris A. Mattmann Senior Computer Scientist Jet Propulsion Laboratory D. Waliser (JPL) C. Goodale (JPL) J. Kim (UCLA/JIFRESSE Many others ADSIMNOR-CORDEX.](https://reader037.fdocuments.in/reader037/viewer/2022110321/56649f3f5503460f94c5ff84/html5/thumbnails/7.jpg)
We started with MySQL…and then broke it at 6B data points…and then federated it, and broke it
again
Then we experimented with Hadoop/HIVE
Query times scaledwith the amount of nodes weadded
Currently evaluating
![Page 8: Chris A. Mattmann Senior Computer Scientist Jet Propulsion Laboratory D. Waliser (JPL) C. Goodale (JPL) J. Kim (UCLA/JIFRESSE Many others ADSIMNOR-CORDEX.](https://reader037.fdocuments.in/reader037/viewer/2022110321/56649f3f5503460f94c5ff84/html5/thumbnails/8.jpg)
The RCMED API:- Search the entire database
- Space/Time box- Simple RESTful URL- Simple ASCII result format
![Page 9: Chris A. Mattmann Senior Computer Scientist Jet Propulsion Laboratory D. Waliser (JPL) C. Goodale (JPL) J. Kim (UCLA/JIFRESSE Many others ADSIMNOR-CORDEX.](https://reader037.fdocuments.in/reader037/viewer/2022110321/56649f3f5503460f94c5ff84/html5/thumbnails/9.jpg)
• Use web service from RCMED
• Regrid onto obs or model grid
• Seasonal, monthly or annual temporal compositing
• Perform metric (bias, RMSE, etc.)
• Output plot using NCAR NCL
• Bottle Python web services• PHP Wizard Front End
![Page 10: Chris A. Mattmann Senior Computer Scientist Jet Propulsion Laboratory D. Waliser (JPL) C. Goodale (JPL) J. Kim (UCLA/JIFRESSE Many others ADSIMNOR-CORDEX.](https://reader037.fdocuments.in/reader037/viewer/2022110321/56649f3f5503460f94c5ff84/html5/thumbnails/10.jpg)
![Page 11: Chris A. Mattmann Senior Computer Scientist Jet Propulsion Laboratory D. Waliser (JPL) C. Goodale (JPL) J. Kim (UCLA/JIFRESSE Many others ADSIMNOR-CORDEX.](https://reader037.fdocuments.in/reader037/viewer/2022110321/56649f3f5503460f94c5ff84/html5/thumbnails/11.jpg)
• Config ACentralized RCMEDVM-based RCMET
• Config BCentralized RCMET and RCMED
![Page 12: Chris A. Mattmann Senior Computer Scientist Jet Propulsion Laboratory D. Waliser (JPL) C. Goodale (JPL) J. Kim (UCLA/JIFRESSE Many others ADSIMNOR-CORDEX.](https://reader037.fdocuments.in/reader037/viewer/2022110321/56649f3f5503460f94c5ff84/html5/thumbnails/12.jpg)
ftp://ftp.cccma.ec.gc.ca/pub/yjiao/CanRCM4/
Worked with Melanie Cookie/Paul Kushner
Compared Near-Surface Air Temperature with ERA 2 Metre Temp
Selected time range: 2008/01/01 00:00 2008/02/01 00:00•Use Model grid•Calculate time mean for full period.•Bias: mean bias across full time range
![Page 13: Chris A. Mattmann Senior Computer Scientist Jet Propulsion Laboratory D. Waliser (JPL) C. Goodale (JPL) J. Kim (UCLA/JIFRESSE Many others ADSIMNOR-CORDEX.](https://reader037.fdocuments.in/reader037/viewer/2022110321/56649f3f5503460f94c5ff84/html5/thumbnails/13.jpg)
![Page 14: Chris A. Mattmann Senior Computer Scientist Jet Propulsion Laboratory D. Waliser (JPL) C. Goodale (JPL) J. Kim (UCLA/JIFRESSE Many others ADSIMNOR-CORDEX.](https://reader037.fdocuments.in/reader037/viewer/2022110321/56649f3f5503460f94c5ff84/html5/thumbnails/14.jpg)
![Page 15: Chris A. Mattmann Senior Computer Scientist Jet Propulsion Laboratory D. Waliser (JPL) C. Goodale (JPL) J. Kim (UCLA/JIFRESSE Many others ADSIMNOR-CORDEX.](https://reader037.fdocuments.in/reader037/viewer/2022110321/56649f3f5503460f94c5ff84/html5/thumbnails/15.jpg)
![Page 16: Chris A. Mattmann Senior Computer Scientist Jet Propulsion Laboratory D. Waliser (JPL) C. Goodale (JPL) J. Kim (UCLA/JIFRESSE Many others ADSIMNOR-CORDEX.](https://reader037.fdocuments.in/reader037/viewer/2022110321/56649f3f5503460f94c5ff84/html5/thumbnails/16.jpg)
![Page 17: Chris A. Mattmann Senior Computer Scientist Jet Propulsion Laboratory D. Waliser (JPL) C. Goodale (JPL) J. Kim (UCLA/JIFRESSE Many others ADSIMNOR-CORDEX.](https://reader037.fdocuments.in/reader037/viewer/2022110321/56649f3f5503460f94c5ff84/html5/thumbnails/17.jpg)
![Page 18: Chris A. Mattmann Senior Computer Scientist Jet Propulsion Laboratory D. Waliser (JPL) C. Goodale (JPL) J. Kim (UCLA/JIFRESSE Many others ADSIMNOR-CORDEX.](https://reader037.fdocuments.in/reader037/viewer/2022110321/56649f3f5503460f94c5ff84/html5/thumbnails/18.jpg)
![Page 19: Chris A. Mattmann Senior Computer Scientist Jet Propulsion Laboratory D. Waliser (JPL) C. Goodale (JPL) J. Kim (UCLA/JIFRESSE Many others ADSIMNOR-CORDEX.](https://reader037.fdocuments.in/reader037/viewer/2022110321/56649f3f5503460f94c5ff84/html5/thumbnails/19.jpg)
![Page 20: Chris A. Mattmann Senior Computer Scientist Jet Propulsion Laboratory D. Waliser (JPL) C. Goodale (JPL) J. Kim (UCLA/JIFRESSE Many others ADSIMNOR-CORDEX.](https://reader037.fdocuments.in/reader037/viewer/2022110321/56649f3f5503460f94c5ff84/html5/thumbnails/20.jpg)
![Page 21: Chris A. Mattmann Senior Computer Scientist Jet Propulsion Laboratory D. Waliser (JPL) C. Goodale (JPL) J. Kim (UCLA/JIFRESSE Many others ADSIMNOR-CORDEX.](https://reader037.fdocuments.in/reader037/viewer/2022110321/56649f3f5503460f94c5ff84/html5/thumbnails/21.jpg)
![Page 22: Chris A. Mattmann Senior Computer Scientist Jet Propulsion Laboratory D. Waliser (JPL) C. Goodale (JPL) J. Kim (UCLA/JIFRESSE Many others ADSIMNOR-CORDEX.](https://reader037.fdocuments.in/reader037/viewer/2022110321/56649f3f5503460f94c5ff84/html5/thumbnails/22.jpg)
![Page 23: Chris A. Mattmann Senior Computer Scientist Jet Propulsion Laboratory D. Waliser (JPL) C. Goodale (JPL) J. Kim (UCLA/JIFRESSE Many others ADSIMNOR-CORDEX.](https://reader037.fdocuments.in/reader037/viewer/2022110321/56649f3f5503460f94c5ff84/html5/thumbnails/23.jpg)
![Page 24: Chris A. Mattmann Senior Computer Scientist Jet Propulsion Laboratory D. Waliser (JPL) C. Goodale (JPL) J. Kim (UCLA/JIFRESSE Many others ADSIMNOR-CORDEX.](https://reader037.fdocuments.in/reader037/viewer/2022110321/56649f3f5503460f94c5ff84/html5/thumbnails/24.jpg)
![Page 25: Chris A. Mattmann Senior Computer Scientist Jet Propulsion Laboratory D. Waliser (JPL) C. Goodale (JPL) J. Kim (UCLA/JIFRESSE Many others ADSIMNOR-CORDEX.](https://reader037.fdocuments.in/reader037/viewer/2022110321/56649f3f5503460f94c5ff84/html5/thumbnails/25.jpg)
![Page 26: Chris A. Mattmann Senior Computer Scientist Jet Propulsion Laboratory D. Waliser (JPL) C. Goodale (JPL) J. Kim (UCLA/JIFRESSE Many others ADSIMNOR-CORDEX.](https://reader037.fdocuments.in/reader037/viewer/2022110321/56649f3f5503460f94c5ff84/html5/thumbnails/26.jpg)
![Page 27: Chris A. Mattmann Senior Computer Scientist Jet Propulsion Laboratory D. Waliser (JPL) C. Goodale (JPL) J. Kim (UCLA/JIFRESSE Many others ADSIMNOR-CORDEX.](https://reader037.fdocuments.in/reader037/viewer/2022110321/56649f3f5503460f94c5ff84/html5/thumbnails/27.jpg)
![Page 28: Chris A. Mattmann Senior Computer Scientist Jet Propulsion Laboratory D. Waliser (JPL) C. Goodale (JPL) J. Kim (UCLA/JIFRESSE Many others ADSIMNOR-CORDEX.](https://reader037.fdocuments.in/reader037/viewer/2022110321/56649f3f5503460f94c5ff84/html5/thumbnails/28.jpg)
![Page 29: Chris A. Mattmann Senior Computer Scientist Jet Propulsion Laboratory D. Waliser (JPL) C. Goodale (JPL) J. Kim (UCLA/JIFRESSE Many others ADSIMNOR-CORDEX.](https://reader037.fdocuments.in/reader037/viewer/2022110321/56649f3f5503460f94c5ff84/html5/thumbnails/29.jpg)
![Page 30: Chris A. Mattmann Senior Computer Scientist Jet Propulsion Laboratory D. Waliser (JPL) C. Goodale (JPL) J. Kim (UCLA/JIFRESSE Many others ADSIMNOR-CORDEX.](https://reader037.fdocuments.in/reader037/viewer/2022110321/56649f3f5503460f94c5ff84/html5/thumbnails/30.jpg)
![Page 31: Chris A. Mattmann Senior Computer Scientist Jet Propulsion Laboratory D. Waliser (JPL) C. Goodale (JPL) J. Kim (UCLA/JIFRESSE Many others ADSIMNOR-CORDEX.](https://reader037.fdocuments.in/reader037/viewer/2022110321/56649f3f5503460f94c5ff84/html5/thumbnails/31.jpg)
![Page 32: Chris A. Mattmann Senior Computer Scientist Jet Propulsion Laboratory D. Waliser (JPL) C. Goodale (JPL) J. Kim (UCLA/JIFRESSE Many others ADSIMNOR-CORDEX.](https://reader037.fdocuments.in/reader037/viewer/2022110321/56649f3f5503460f94c5ff84/html5/thumbnails/32.jpg)
[K]
![Page 33: Chris A. Mattmann Senior Computer Scientist Jet Propulsion Laboratory D. Waliser (JPL) C. Goodale (JPL) J. Kim (UCLA/JIFRESSE Many others ADSIMNOR-CORDEX.](https://reader037.fdocuments.in/reader037/viewer/2022110321/56649f3f5503460f94c5ff84/html5/thumbnails/33.jpg)
[K]
![Page 34: Chris A. Mattmann Senior Computer Scientist Jet Propulsion Laboratory D. Waliser (JPL) C. Goodale (JPL) J. Kim (UCLA/JIFRESSE Many others ADSIMNOR-CORDEX.](https://reader037.fdocuments.in/reader037/viewer/2022110321/56649f3f5503460f94c5ff84/html5/thumbnails/34.jpg)
[K]
![Page 35: Chris A. Mattmann Senior Computer Scientist Jet Propulsion Laboratory D. Waliser (JPL) C. Goodale (JPL) J. Kim (UCLA/JIFRESSE Many others ADSIMNOR-CORDEX.](https://reader037.fdocuments.in/reader037/viewer/2022110321/56649f3f5503460f94c5ff84/html5/thumbnails/35.jpg)
Thank you!
Contact information:Chris A. Mattmann – [email protected]
Duane Waliser – [email protected]
Jinwon Kim – [email protected]