Google Earth Engine - LISTIC · Author Google Mars and Google Moon Co-founder Google Earth Engine....

59
Google Earth Engine Noel Gorelick

Transcript of Google Earth Engine - LISTIC · Author Google Mars and Google Moon Co-founder Google Earth Engine....

Page 1: Google Earth Engine - LISTIC · Author Google Mars and Google Moon Co-founder Google Earth Engine. Google's Mission Organize the world's information and make it universally accessible

Google Earth Engine

Noel Gorelick

Page 2: Google Earth Engine - LISTIC · Author Google Mars and Google Moon Co-founder Google Earth Engine. Google's Mission Organize the world's information and make it universally accessible

Who Am I?

"The software guy" on 6 NASA Mars missions

Engineer at Google for 9 years

Author Google Mars and Google Moon

Co-founder Google Earth Engine

Page 3: Google Earth Engine - LISTIC · Author Google Mars and Google Moon Co-founder Google Earth Engine. Google's Mission Organize the world's information and make it universally accessible
Page 4: Google Earth Engine - LISTIC · Author Google Mars and Google Moon Co-founder Google Earth Engine. Google's Mission Organize the world's information and make it universally accessible

Google's Mission

Organize the world's information and

make it universally accessible and useful.

Page 5: Google Earth Engine - LISTIC · Author Google Mars and Google Moon Co-founder Google Earth Engine. Google's Mission Organize the world's information and make it universally accessible

My Mission

Organize the world's information and

make it universally accessible and useful.

scientific

v

Page 6: Google Earth Engine - LISTIC · Author Google Mars and Google Moon Co-founder Google Earth Engine. Google's Mission Organize the world's information and make it universally accessible

The Saga of Landsat

Series of 8 satellites

Continuous record since 1972

Multiband optical and thermal

Data became "free" in 2008

Page 7: Google Earth Engine - LISTIC · Author Google Mars and Google Moon Co-founder Google Earth Engine. Google's Mission Organize the world's information and make it universally accessible

The Saga of Landsat

Only 3.5M scenes out of ~7.1M in the catalog (4.1 PB)The rest are held at international receiving stations

Page 8: Google Earth Engine - LISTIC · Author Google Mars and Google Moon Co-founder Google Earth Engine. Google's Mission Organize the world's information and make it universally accessible

The Saga of Landsat

Only 3.5M scenes out of ~7.1M in the catalog (4.1 PB)The rest are held at international receiving stationsTapes blocked at the border by the Army

Page 9: Google Earth Engine - LISTIC · Author Google Mars and Google Moon Co-founder Google Earth Engine. Google's Mission Organize the world's information and make it universally accessible

The Saga of Landsat

Only 3.5M scenes out of ~7.1M in the catalog (4.1 PB)The rest are held at international receiving stationsTapes blocked at the border by the Army35 year old tapes …

Page 10: Google Earth Engine - LISTIC · Author Google Mars and Google Moon Co-founder Google Earth Engine. Google's Mission Organize the world's information and make it universally accessible

The Saga of Landsat

Only 3.5M scenes out of ~7.1M in the catalog (4.1 PB)The rest are held at international receiving stationsTapes blocked at the border by the Army35 year old tapes … have to be baked in an oven before reading

Page 11: Google Earth Engine - LISTIC · Author Google Mars and Google Moon Co-founder Google Earth Engine. Google's Mission Organize the world's information and make it universally accessible

The Saga of Landsat

3 years to download the entire archiveProcessed from tape, on demand

USGS Download Stats: http://landsat.usgs.gov/Landsat_Project_Statistics.php

Page 12: Google Earth Engine - LISTIC · Author Google Mars and Google Moon Co-founder Google Earth Engine. Google's Mission Organize the world's information and make it universally accessible
Page 13: Google Earth Engine - LISTIC · Author Google Mars and Google Moon Co-founder Google Earth Engine. Google's Mission Organize the world's information and make it universally accessible
Page 14: Google Earth Engine - LISTIC · Author Google Mars and Google Moon Co-founder Google Earth Engine. Google's Mission Organize the world's information and make it universally accessible
Page 15: Google Earth Engine - LISTIC · Author Google Mars and Google Moon Co-founder Google Earth Engine. Google's Mission Organize the world's information and make it universally accessible
Page 16: Google Earth Engine - LISTIC · Author Google Mars and Google Moon Co-founder Google Earth Engine. Google's Mission Organize the world's information and make it universally accessible
Page 17: Google Earth Engine - LISTIC · Author Google Mars and Google Moon Co-founder Google Earth Engine. Google's Mission Organize the world's information and make it universally accessible
Page 18: Google Earth Engine - LISTIC · Author Google Mars and Google Moon Co-founder Google Earth Engine. Google's Mission Organize the world's information and make it universally accessible

What did we do with all that data?

29 yearsof satellite data

2,068,467landsat scenes

909terabytes

2,000,000hours of computation

66,000CPUs

on

https://googleblog.blogspot.ch/2013/05/a-picture-of-earth-through-time.html

Page 19: Google Earth Engine - LISTIC · Author Google Mars and Google Moon Co-founder Google Earth Engine. Google's Mission Organize the world's information and make it universally accessible

We made a video!

Page 20: Google Earth Engine - LISTIC · Author Google Mars and Google Moon Co-founder Google Earth Engine. Google's Mission Organize the world's information and make it universally accessible

We made a video!

24 Terapixels

Page 21: Google Earth Engine - LISTIC · Author Google Mars and Google Moon Co-founder Google Earth Engine. Google's Mission Organize the world's information and make it universally accessible

We made a video!

24 Terapixels

Page 22: Google Earth Engine - LISTIC · Author Google Mars and Google Moon Co-founder Google Earth Engine. Google's Mission Organize the world's information and make it universally accessible

We made a video!

24 Terapixels

Page 23: Google Earth Engine - LISTIC · Author Google Mars and Google Moon Co-founder Google Earth Engine. Google's Mission Organize the world's information and make it universally accessible

We made a video!

24 Terapixels

Page 24: Google Earth Engine - LISTIC · Author Google Mars and Google Moon Co-founder Google Earth Engine. Google's Mission Organize the world's information and make it universally accessible

We made a video!

24 Terapixels

Page 25: Google Earth Engine - LISTIC · Author Google Mars and Google Moon Co-founder Google Earth Engine. Google's Mission Organize the world's information and make it universally accessible

TimeLapse

Launched with Time MagazineThousands of embedsMillions of views

Page 26: Google Earth Engine - LISTIC · Author Google Mars and Google Moon Co-founder Google Earth Engine. Google's Mission Organize the world's information and make it universally accessible

So what?

Page 27: Google Earth Engine - LISTIC · Author Google Mars and Google Moon Co-founder Google Earth Engine. Google's Mission Organize the world's information and make it universally accessible

So what?

These guys...

live here...

Page 28: Google Earth Engine - LISTIC · Author Google Mars and Google Moon Co-founder Google Earth Engine. Google's Mission Organize the world's information and make it universally accessible

So what?

724,000 km2 forest loss in Brazil since 1970 (17%)It's visible from space, "just" need a deforestation detector

Page 29: Google Earth Engine - LISTIC · Author Google Mars and Google Moon Co-founder Google Earth Engine. Google's Mission Organize the world's information and make it universally accessible

Earth Engine

Page 30: Google Earth Engine - LISTIC · Author Google Mars and Google Moon Co-founder Google Earth Engine. Google's Mission Organize the world's information and make it universally accessible

Earth Engine

Page 31: Google Earth Engine - LISTIC · Author Google Mars and Google Moon Co-founder Google Earth Engine. Google's Mission Organize the world's information and make it universally accessible

Earth Engine

Page 32: Google Earth Engine - LISTIC · Author Google Mars and Google Moon Co-founder Google Earth Engine. Google's Mission Organize the world's information and make it universally accessible
Page 33: Google Earth Engine - LISTIC · Author Google Mars and Google Moon Co-founder Google Earth Engine. Google's Mission Organize the world's information and make it universally accessible

WhyStarted by for public benefit

Operationalize science, at scale

GoalsRemove access and capacity barriers

Foster open science

Promote transparency, reproducibility & collaboration

Maximum throughput, minimum latency

Page 34: Google Earth Engine - LISTIC · Author Google Mars and Google Moon Co-founder Google Earth Engine. Google's Mission Organize the world's information and make it universally accessible

WhyStarted by for public benefit

Operationalize science, at scale

GoalsRemove access and capacity barriers

Foster open science

Promote transparency, reproducibility & collaboration

Maximum throughput, minimum latency

Build the world's most advanced geospatial analysis platform

Page 35: Google Earth Engine - LISTIC · Author Google Mars and Google Moon Co-founder Google Earth Engine. Google's Mission Organize the world's information and make it universally accessible

Goals

Build the world's most advanced geospatial analysis platform

Page 36: Google Earth Engine - LISTIC · Author Google Mars and Google Moon Co-founder Google Earth Engine. Google's Mission Organize the world's information and make it universally accessible

Goals

… so we don't all die.

Build the world's most advanced geospatial analysis platform

Page 37: Google Earth Engine - LISTIC · Author Google Mars and Google Moon Co-founder Google Earth Engine. Google's Mission Organize the world's information and make it universally accessible

Goals

to help solve the world's biggest challenges… so we don't all die.

Build the world's most advanced geospatial analysis platform

Page 38: Google Earth Engine - LISTIC · Author Google Mars and Google Moon Co-founder Google Earth Engine. Google's Mission Organize the world's information and make it universally accessible

Goals

DeforestationDroughtDiseaseFamineFloodingFireEarthquakes

… so we don't all die.

Build the world's most advanced geospatial analysis platform

to help solve the world's biggest challenges

Page 39: Google Earth Engine - LISTIC · Author Google Mars and Google Moon Co-founder Google Earth Engine. Google's Mission Organize the world's information and make it universally accessible

Global Forest Extent and Change

Source: Hansen, Potapov, Moore, Hancher et al. , Science, 15 November 2013

Page 40: Google Earth Engine - LISTIC · Author Google Mars and Google Moon Co-founder Google Earth Engine. Google's Mission Organize the world's information and make it universally accessible

Drought Monitoring

Source: Hansen, Potapov, Moore, Hancher et al. , Science, 15 November 2013Desert Research Institute - Justin Huntington and Charles Morton

Page 41: Google Earth Engine - LISTIC · Author Google Mars and Google Moon Co-founder Google Earth Engine. Google's Mission Organize the world's information and make it universally accessible

Global Surface Water

Source: Pekel, Belward, Cotton & Gorelick, 2015

Page 42: Google Earth Engine - LISTIC · Author Google Mars and Google Moon Co-founder Google Earth Engine. Google's Mission Organize the world's information and make it universally accessible

Global Crop Map

Source: Prasad Thenkabai, Jun Xiong, USGS

Page 43: Google Earth Engine - LISTIC · Author Google Mars and Google Moon Co-founder Google Earth Engine. Google's Mission Organize the world's information and make it universally accessible

Disease Early Warning: Malaria Risk

Swaziland National Malaria Control Program / UCSF Global Health Group

Page 44: Google Earth Engine - LISTIC · Author Google Mars and Google Moon Co-founder Google Earth Engine. Google's Mission Organize the world's information and make it universally accessible

Earthquake Ground Velocity Prediction

Source: David Lallemant, Stanford

Page 45: Google Earth Engine - LISTIC · Author Google Mars and Google Moon Co-founder Google Earth Engine. Google's Mission Organize the world's information and make it universally accessible

Global Development

DMSP-OLS Nighttime persistent lights

Page 46: Google Earth Engine - LISTIC · Author Google Mars and Google Moon Co-founder Google Earth Engine. Google's Mission Organize the world's information and make it universally accessible

What Is Earth Engine

A "big data" platform for remote sensing

A fast computation & visualization system,

for global-scale geospatial analysis,

with a large scientific data catalog.

Page 47: Google Earth Engine - LISTIC · Author Google Mars and Google Moon Co-founder Google Earth Engine. Google's Mission Organize the world's information and make it universally accessible
Page 48: Google Earth Engine - LISTIC · Author Google Mars and Google Moon Co-founder Google Earth Engine. Google's Mission Organize the world's information and make it universally accessible

Scientific Data Catalog

Imagery

Landsat 4, 5, 7, 85,500,000 scenes

30+ MODIS Level 2Daily, NBAR, LST, ...

Sentinel-1 GRD

Sentinel-2

Hyperion / ALINAIP, ASTER, ...

Page 49: Google Earth Engine - LISTIC · Author Google Mars and Google Moon Co-founder Google Earth Engine. Google's Mission Organize the world's information and make it universally accessible

Scientific Data Catalog

ImageryGeophysical

TerrainSRTM, ETOPO, GMTEDHIRES Global DEM project

Landcover Cropland Surface Temperature Other

Global forest change, canopy heightBiomass estimates, Burned areas, Vegetation continuous fields

Page 50: Google Earth Engine - LISTIC · Author Google Mars and Google Moon Co-founder Google Earth Engine. Google's Mission Organize the world's information and make it universally accessible

Scientific Data Catalog

ImageryGeophysicalClimate & Weather

MOD08 TOMS & OMI Ozone NCEP/NARR Precipitation

TRMM, Daymet, RTMA, CHRIPSCFSV2, GFS, PERSIANN

Forecast and ReanalysisNEX DCP-30, MACA, NLDAS, GLDAS,

GRIDMET

Page 51: Google Earth Engine - LISTIC · Author Google Mars and Google Moon Co-founder Google Earth Engine. Google's Mission Organize the world's information and make it universally accessible

Scientific Data Catalog

ImageryGeophysicalClimate & Weather

More than 250 public datasetsContinuously Updated +4000 images/day5.5 PB

Page 52: Google Earth Engine - LISTIC · Author Google Mars and Google Moon Co-founder Google Earth Engine. Google's Mission Organize the world's information and make it universally accessible

Pick your: projection, resolution, bands, bounding-box, visualization

What Can It Do?

Get an Image

Page 53: Google Earth Engine - LISTIC · Author Google Mars and Google Moon Co-founder Google Earth Engine. Google's Mission Organize the world's information and make it universally accessible

What Can It Do?

Library functions or your own script

Get an Image

Apply an algorithm to an image

Page 54: Google Earth Engine - LISTIC · Author Google Mars and Google Moon Co-founder Google Earth Engine. Google's Mission Organize the world's information and make it universally accessible

What Can It Do?

Time, Space, Metadata

Get an Image

Apply an algorithm to an image

Filter a collection

Page 55: Google Earth Engine - LISTIC · Author Google Mars and Google Moon Co-founder Google Earth Engine. Google's Mission Organize the world's information and make it universally accessible

N → N

Get an Image

Apply an algorithm to an image

Filter a collection

Map an algorithm over a collection

What Can It Do?

Page 56: Google Earth Engine - LISTIC · Author Google Mars and Google Moon Co-founder Google Earth Engine. Google's Mission Organize the world's information and make it universally accessible

N → 1 or N → M

What Can It Do?

Get an Image

Apply an algorithm to an image

Filter a collection

Map an algorithm over a collection

Reduce a collection

Page 57: Google Earth Engine - LISTIC · Author Google Mars and Google Moon Co-founder Google Earth Engine. Google's Mission Organize the world's information and make it universally accessible

What Can It Do?

Get an Image

Apply an algorithm to an image

Filter a collection

Map an algorithm over a collection

Reduce a collection

Compute an aggregate

Page 58: Google Earth Engine - LISTIC · Author Google Mars and Google Moon Co-founder Google Earth Engine. Google's Mission Organize the world's information and make it universally accessible

What Can It Do?

Good At

Band mathSpectral unmixingML ClassificationSegmentation,Template matchingTexture analysis

Parallelizable Operations

Bad At

Finite Element AnalysisHydrologic FlowIteration and Recursion

Page 59: Google Earth Engine - LISTIC · Author Google Mars and Google Moon Co-founder Google Earth Engine. Google's Mission Organize the world's information and make it universally accessible

earthengine.google.com/signup

Thank you

[email protected]