Weather & Climate Data Analysis with Google Earth Engine

24
Weather & Climate Data Analysis with Google Eah Engine Tyler Erickson, PhD Developer Advocate, Google Eah Engine 10 February 2021 Slides:

Transcript of Weather & Climate Data Analysis with Google Earth Engine

Page 1: Weather & Climate Data Analysis with Google Earth Engine

Weather & Climate Data Analysis with Google Earth Engine

Tyler Erickson, PhD

Developer Advocate, Google Earth Engine

10 February 2021 Slides:

Page 2: Weather & Climate Data Analysis with Google Earth Engine

DemoTime to run with scissors....

Questions??? and more ???

What is Earth Engine?A very brief overview.

Earth Engine Data CatalogWhat datasets are available?

APIs & Client LibrariesHow to request outputs...

01

02

03

04

05

Agenda

Page 3: Weather & Climate Data Analysis with Google Earth Engine

Earth Enginein Three Sentences

Earth Engine is Google's platform for doing scientific analysis of large-scale Earth data, including satellite imagery, census data, etc. It's composed of two big

components: a collection of scientific data, and the computational power to effectively work with data at

that scale.

The Earth Engine API is the interface through which scientists and researchers express the operations they'd

like Earth Engine to perform.

Page 4: Weather & Climate Data Analysis with Google Earth Engine

Earth Enginein Three Sentences

Earth Engine is Google's platform for doing scientific analysis of large-scale Earth data, including satellite imagery, census data, etc. It's composed of two big

components: a collection of scientific data, and the computational power to effectively work with data at

that scale.

The Earth Engine API is the interface through which scientists and researchers express the operations they'd

like Earth Engine to perform.

Page 5: Weather & Climate Data Analysis with Google Earth Engine

Expressions and Lazy Evaluation

● Earth Engine expressions define new objects in terms of existing objects, as a directed acyclic graph.

● Users can define custom functions in terms of other functions.

● The core Image and Collection types are lazy and inherently parallel.

● Computations are specified by an expression + a selector (i.e. which part of the result is needed — for a raster, which pixels at what resolution)

Page 6: Weather & Climate Data Analysis with Google Earth Engine

Expressions and Lazy Evaluation - Example

Page 7: Weather & Climate Data Analysis with Google Earth Engine

Public Data Catalog

7

600+ public datasets

BoundaryData

Weather &Climate

Terrain &Land Cover

1+ PB of new data every month100+ datasets added yearly

30+ petabytes of data

OpticalImagery

... and upload your own vectors and rasters

Page 8: Weather & Climate Data Analysis with Google Earth Engine

Selected Weather & Climate Datasets

● Reanalysis○ ECMWF ERA5 daily / monthly○ ECMWF ERA5-Land hourly / monthly○ NOAA CFSR○ NCEP/NCAR Reanalysis Data

● Weather Forecast○ NOAA GFS○ NOAA RTMA○ ECMWF CAMS Global Near-Real-Time (optical depth & particulate matter)

● Climate Projections○ CMIP5 NEX-GDDP

Page 9: Weather & Climate Data Analysis with Google Earth Engine

Available Functions

Over 1000 functions/methods that work on Earth Engine objects:

● Images, Image Collections● Features, Feature Collections● Reducers● Joins● Filters● Kernels● Numbers, Lists, Arrays● Machine Learning Classifiers● etc...

Page 10: Weather & Climate Data Analysis with Google Earth Engine

ExampleWeb Application: Climate Engine

Page 11: Weather & Climate Data Analysis with Google Earth Engine

JavascriptClient Library

PythonClient Library

Earth EngineCode Editor

RESTAPI

Web Application

Earth EngineBackend Servers

Page 12: Weather & Climate Data Analysis with Google Earth Engine

JavascriptClient Library

PythonClient Library

Earth EngineCode Editor

RESTAPI

Web Application

Earth EngineBackend Servers

Page 13: Weather & Climate Data Analysis with Google Earth Engine

Example: ERA5-Land

● Search for “ERA5-Land hourly”on Google Dataset Search

Page 14: Weather & Climate Data Analysis with Google Earth Engine

Example: ERA5-Land

● Search for “ERA5-Land hourly”on Google Dataset Search

● Select a dataset on Earth Engine

Page 15: Weather & Climate Data Analysis with Google Earth Engine

Example: ERA5-Land

● Search for “ERA5-Land hourly”on Google Dataset Search

● Select a dataset on Earth Engine

● Open the dataset description page

Page 16: Weather & Climate Data Analysis with Google Earth Engine

Example: ERA5-Land

● Search for “ERA5-Land hourly”on Google Dataset Search

● Select a dataset on Earth Engine

● Open the dataset description page

● Scroll down to find the sample script

Page 17: Weather & Climate Data Analysis with Google Earth Engine

Example: ERA5-Land

● Search for “ERA5-Land hourly”on Google Dataset Search

● Select a dataset on Earth Engine

● Open the dataset description page

● Scroll down to find the sample script

● Open the sample script in the Code Editor GUI

Page 18: Weather & Climate Data Analysis with Google Earth Engine

Example: ERA5-Land

● Search for “ERA5-Land hourly”on Google Dataset Search

● Select a dataset on Earth Engine

● Open the dataset description page

● Scroll down to find the sample script

● Open the sample script in the Code Editor GUI

● Modify and click “Get Link”to share with others

https://code.earthengine.google.com/14fa4eec4ff2ca39621cc54aa1f9b2ed

Page 19: Weather & Climate Data Analysis with Google Earth Engine
Page 20: Weather & Climate Data Analysis with Google Earth Engine

JavascriptClient Library

PythonClient Library

Earth EngineCode Editor

RESTAPI

Jupyter-based Development Environment

Web Application

Earth EngineBackend Servers

Page 21: Weather & Climate Data Analysis with Google Earth Engine

DemoExploring ERA5-Land.ipynb https://colab.research.google.com/drive/1suLcNvGzg4derqbf7zN1l9i0Upytbnko

ECMWF 2021

Page 22: Weather & Climate Data Analysis with Google Earth Engine

JupyterLab!

● Docker configuration examplegithub.com/gee-community/ee-jupyter-contrib

● geemap packagehttps://github.com/giswqs/geemap

Page 23: Weather & Climate Data Analysis with Google Earth Engine

How to get access1. Goto: https://earthengine.google.com/

2. Click on “Sign Up”

3. Fill out and submit the simple form.Hint: Use your organizational email

4. Wait for approval email.

Google Earth Engine Terms of Service● Development, research, or educational purposes

are allowed

● Services can be evaluated in a production environment

● Services may not be used for sustained commercial purposes unless otherwise approved by Google

Page 24: Weather & Climate Data Analysis with Google Earth Engine

Thank you!Tyler Erickson, PhDDeveloper Advocate Google Earth Enginegithub.com/tylere@tylerickson

More information at:

● Slides for this talkg.co/earth/ecmwf2021

● Earth Engine Documentationhttps://developers.google.com/earth-engine

● Geo for Good Summit Videoshttps://earthoutreachonair.withgoogle.com/events/geoforgood20

● More code exampleshttps://github.com/google/earthengine-apihttps://github.com/google/earthengine-communityhttps://github.com/gee-community/ee-jupyter-contribhttps://github.com/giswqs/geemap