neat-EO.pink : Computer Vision framework for GeoSpatial Imagery · 2020-02-12 · neat-EO.pink...
Transcript of neat-EO.pink : Computer Vision framework for GeoSpatial Imagery · 2020-02-12 · neat-EO.pink...
![Page 1: neat-EO.pink : Computer Vision framework for GeoSpatial Imagery · 2020-02-12 · neat-EO.pink powered by @data_pink Take Away - Industrial OpenSource AI4EO Imagery framework available](https://reader034.fdocuments.in/reader034/viewer/2022042300/5eca94525366ed5cdc2fde21/html5/thumbnails/1.jpg)
neat-EO.pink : Computer Vision framework for GeoSpatial Imagery
@o_courtin
@FOSDEM 2020
![Page 2: neat-EO.pink : Computer Vision framework for GeoSpatial Imagery · 2020-02-12 · neat-EO.pink powered by @data_pink Take Away - Industrial OpenSource AI4EO Imagery framework available](https://reader034.fdocuments.in/reader034/viewer/2022042300/5eca94525366ed5cdc2fde21/html5/thumbnails/2.jpg)
Error Detection
Error Correction
Cybernetic Loop, Norber Wiener, ~1940s
![Page 3: neat-EO.pink : Computer Vision framework for GeoSpatial Imagery · 2020-02-12 · neat-EO.pink powered by @data_pink Take Away - Industrial OpenSource AI4EO Imagery framework available](https://reader034.fdocuments.in/reader034/viewer/2022042300/5eca94525366ed5cdc2fde21/html5/thumbnails/3.jpg)
Earth Observation
Widely Used: Govs Agencies, NGOs, Scientists, Companies, Farmers...
Huge Data: ~100To / Day
Wasted Data: ~80% of acquired pixels remains unused
![Page 4: neat-EO.pink : Computer Vision framework for GeoSpatial Imagery · 2020-02-12 · neat-EO.pink powered by @data_pink Take Away - Industrial OpenSource AI4EO Imagery framework available](https://reader034.fdocuments.in/reader034/viewer/2022042300/5eca94525366ed5cdc2fde21/html5/thumbnails/4.jpg)
From Pixels to Insights
![Page 5: neat-EO.pink : Computer Vision framework for GeoSpatial Imagery · 2020-02-12 · neat-EO.pink powered by @data_pink Take Away - Industrial OpenSource AI4EO Imagery framework available](https://reader034.fdocuments.in/reader034/viewer/2022042300/5eca94525366ed5cdc2fde21/html5/thumbnails/5.jpg)
NeuralsNetwork
Output
Input
Loss Function
Supervised Learning
![Page 6: neat-EO.pink : Computer Vision framework for GeoSpatial Imagery · 2020-02-12 · neat-EO.pink powered by @data_pink Take Away - Industrial OpenSource AI4EO Imagery framework available](https://reader034.fdocuments.in/reader034/viewer/2022042300/5eca94525366ed5cdc2fde21/html5/thumbnails/6.jpg)
NeuralsNetwork
Output
Input
Loss Function
TrainedModel Output
Supervised Learning
![Page 7: neat-EO.pink : Computer Vision framework for GeoSpatial Imagery · 2020-02-12 · neat-EO.pink powered by @data_pink Take Away - Industrial OpenSource AI4EO Imagery framework available](https://reader034.fdocuments.in/reader034/viewer/2022042300/5eca94525366ed5cdc2fde21/html5/thumbnails/7.jpg)
Polynom
Weighted Graph
Lossy Data Compression
Grey Box
A Trained model ?
![Page 8: neat-EO.pink : Computer Vision framework for GeoSpatial Imagery · 2020-02-12 · neat-EO.pink powered by @data_pink Take Away - Industrial OpenSource AI4EO Imagery framework available](https://reader034.fdocuments.in/reader034/viewer/2022042300/5eca94525366ed5cdc2fde21/html5/thumbnails/8.jpg)
neat-EO.pink
Computer Vision framework for GeoSpatial Imagery
@neat_eo
![Page 9: neat-EO.pink : Computer Vision framework for GeoSpatial Imagery · 2020-02-12 · neat-EO.pink powered by @data_pink Take Away - Industrial OpenSource AI4EO Imagery framework available](https://reader034.fdocuments.in/reader034/viewer/2022042300/5eca94525366ed5cdc2fde21/html5/thumbnails/9.jpg)
NeuralsNetwork
Output
Input
Loss Function
TrainedModel Output
Quality Analysis
AlternateDataSet
Compare
![Page 10: neat-EO.pink : Computer Vision framework for GeoSpatial Imagery · 2020-02-12 · neat-EO.pink powered by @data_pink Take Away - Industrial OpenSource AI4EO Imagery framework available](https://reader034.fdocuments.in/reader034/viewer/2022042300/5eca94525366ed5cdc2fde21/html5/thumbnails/10.jpg)
Neat WebUI to ease compare
Pink : Predicted by trained model
Green : Alternate dataset
Grey : Both agree
Spotify significative differences
![Page 11: neat-EO.pink : Computer Vision framework for GeoSpatial Imagery · 2020-02-12 · neat-EO.pink powered by @data_pink Take Away - Industrial OpenSource AI4EO Imagery framework available](https://reader034.fdocuments.in/reader034/viewer/2022042300/5eca94525366ed5cdc2fde21/html5/thumbnails/11.jpg)
NeuralsNetwork
Output
Input
Loss Function
TrainedModel Output
Change Detection
AlternateOutput
Compare
AlternateInput
![Page 12: neat-EO.pink : Computer Vision framework for GeoSpatial Imagery · 2020-02-12 · neat-EO.pink powered by @data_pink Take Away - Industrial OpenSource AI4EO Imagery framework available](https://reader034.fdocuments.in/reader034/viewer/2022042300/5eca94525366ed5cdc2fde21/html5/thumbnails/12.jpg)
NeuralsNetwork
Output
Input
Loss Function
TrainedModel
WiderOutput
Feature Extraction
WiderInput
Vectorize
![Page 13: neat-EO.pink : Computer Vision framework for GeoSpatial Imagery · 2020-02-12 · neat-EO.pink powered by @data_pink Take Away - Industrial OpenSource AI4EO Imagery framework available](https://reader034.fdocuments.in/reader034/viewer/2022042300/5eca94525366ed5cdc2fde21/html5/thumbnails/13.jpg)
Command Line Interface
![Page 14: neat-EO.pink : Computer Vision framework for GeoSpatial Imagery · 2020-02-12 · neat-EO.pink powered by @data_pink Take Away - Industrial OpenSource AI4EO Imagery framework available](https://reader034.fdocuments.in/reader034/viewer/2022042300/5eca94525366ed5cdc2fde21/html5/thumbnails/14.jpg)
neat-EO
GeoJSON
PostGIS
Rasters
WMS
Tiles
MasksPrediction
MasksCompare
VectorPrediction
Spotifydifferences
areas
OSM PBF
![Page 15: neat-EO.pink : Computer Vision framework for GeoSpatial Imagery · 2020-02-12 · neat-EO.pink powered by @data_pink Take Away - Industrial OpenSource AI4EO Imagery framework available](https://reader034.fdocuments.in/reader034/viewer/2022042300/5eca94525366ed5cdc2fde21/html5/thumbnails/15.jpg)
Stacks
Proj 4
GEOS GDAL
Rasterio
CUDAcuDNN
PyTorch
NumPy
OpenCV
neat-EO
PillowShapely PostGIS
Mercantile
SuperMercado
Albumentations
LeafLet+ VectorGrid
![Page 16: neat-EO.pink : Computer Vision framework for GeoSpatial Imagery · 2020-02-12 · neat-EO.pink powered by @data_pink Take Away - Industrial OpenSource AI4EO Imagery framework available](https://reader034.fdocuments.in/reader034/viewer/2022042300/5eca94525366ed5cdc2fde21/html5/thumbnails/16.jpg)
Easy to deploy
pip3 install neat-EO
![Page 17: neat-EO.pink : Computer Vision framework for GeoSpatial Imagery · 2020-02-12 · neat-EO.pink powered by @data_pink Take Away - Industrial OpenSource AI4EO Imagery framework available](https://reader034.fdocuments.in/reader034/viewer/2022042300/5eca94525366ed5cdc2fde21/html5/thumbnails/17.jpg)
- Install neat-EO- Download data- Data Preparation- Training - Inference- Compare to OSM- Spotify differences areas- Vectorize features
https://github.com/datapink/neat-eo.pink/blob/master/docs/101.md
101 Tutorial
![Page 18: neat-EO.pink : Computer Vision framework for GeoSpatial Imagery · 2020-02-12 · neat-EO.pink powered by @data_pink Take Away - Industrial OpenSource AI4EO Imagery framework available](https://reader034.fdocuments.in/reader034/viewer/2022042300/5eca94525366ed5cdc2fde21/html5/thumbnails/18.jpg)
So all you need is :
- Imagery → any file format readable by GDAL
- GPU → NVIDIA > 8Go VRAM
- Labels → usualy the key point
![Page 19: neat-EO.pink : Computer Vision framework for GeoSpatial Imagery · 2020-02-12 · neat-EO.pink powered by @data_pink Take Away - Industrial OpenSource AI4EO Imagery framework available](https://reader034.fdocuments.in/reader034/viewer/2022042300/5eca94525366ed5cdc2fde21/html5/thumbnails/19.jpg)
GIGO
Imagery City OpenData OSM
![Page 20: neat-EO.pink : Computer Vision framework for GeoSpatial Imagery · 2020-02-12 · neat-EO.pink powered by @data_pink Take Away - Industrial OpenSource AI4EO Imagery framework available](https://reader034.fdocuments.in/reader034/viewer/2022042300/5eca94525366ed5cdc2fde21/html5/thumbnails/20.jpg)
NeuralsNetwork
Output
Input
Loss Function
TrainedModel Output
Quality Analysis on DataSet Training
LabelsCompare
![Page 21: neat-EO.pink : Computer Vision framework for GeoSpatial Imagery · 2020-02-12 · neat-EO.pink powered by @data_pink Take Away - Industrial OpenSource AI4EO Imagery framework available](https://reader034.fdocuments.in/reader034/viewer/2022042300/5eca94525366ed5cdc2fde21/html5/thumbnails/21.jpg)
WebUI BuildIn Binary Selector
![Page 22: neat-EO.pink : Computer Vision framework for GeoSpatial Imagery · 2020-02-12 · neat-EO.pink powered by @data_pink Take Away - Industrial OpenSource AI4EO Imagery framework available](https://reader034.fdocuments.in/reader034/viewer/2022042300/5eca94525366ed5cdc2fde21/html5/thumbnails/22.jpg)
What’s new ?
![Page 23: neat-EO.pink : Computer Vision framework for GeoSpatial Imagery · 2020-02-12 · neat-EO.pink powered by @data_pink Take Away - Industrial OpenSource AI4EO Imagery framework available](https://reader034.fdocuments.in/reader034/viewer/2022042300/5eca94525366ed5cdc2fde21/html5/thumbnails/23.jpg)
Metatiles option on predict
With (but x3 time slower) Without
![Page 24: neat-EO.pink : Computer Vision framework for GeoSpatial Imagery · 2020-02-12 · neat-EO.pink powered by @data_pink Take Away - Industrial OpenSource AI4EO Imagery framework available](https://reader034.fdocuments.in/reader034/viewer/2022042300/5eca94525366ed5cdc2fde21/html5/thumbnails/24.jpg)
Multi GPUs efficient scaling
neo train
neo predict
Allow to scale to x8 GPUs
![Page 25: neat-EO.pink : Computer Vision framework for GeoSpatial Imagery · 2020-02-12 · neat-EO.pink powered by @data_pink Take Away - Industrial OpenSource AI4EO Imagery framework available](https://reader034.fdocuments.in/reader034/viewer/2022042300/5eca94525366ed5cdc2fde21/html5/thumbnails/25.jpg)
Multi Classes
Including auto weighted umbalaced classes option
![Page 26: neat-EO.pink : Computer Vision framework for GeoSpatial Imagery · 2020-02-12 · neat-EO.pink powered by @data_pink Take Away - Industrial OpenSource AI4EO Imagery framework available](https://reader034.fdocuments.in/reader034/viewer/2022042300/5eca94525366ed5cdc2fde21/html5/thumbnails/26.jpg)
Limits
- Predict Imagery DataSet must be quite related to the training one
- Still need about thousands labels per class (as a rule of thumb)
- Don’t deal (for now) with topology, so behave badly on connected stuff (as roads)
![Page 27: neat-EO.pink : Computer Vision framework for GeoSpatial Imagery · 2020-02-12 · neat-EO.pink powered by @data_pink Take Away - Industrial OpenSource AI4EO Imagery framework available](https://reader034.fdocuments.in/reader034/viewer/2022042300/5eca94525366ed5cdc2fde21/html5/thumbnails/27.jpg)
Request For Funding
- Increase again accuracy - Low Resolution - Topology
- Reduce significantly amount of needed labels (weakly supervised)
- Improve again performances
![Page 28: neat-EO.pink : Computer Vision framework for GeoSpatial Imagery · 2020-02-12 · neat-EO.pink powered by @data_pink Take Away - Industrial OpenSource AI4EO Imagery framework available](https://reader034.fdocuments.in/reader034/viewer/2022042300/5eca94525366ed5cdc2fde21/html5/thumbnails/28.jpg)
Open Source AI4EO
![Page 29: neat-EO.pink : Computer Vision framework for GeoSpatial Imagery · 2020-02-12 · neat-EO.pink powered by @data_pink Take Away - Industrial OpenSource AI4EO Imagery framework available](https://reader034.fdocuments.in/reader034/viewer/2022042300/5eca94525366ed5cdc2fde21/html5/thumbnails/29.jpg)
Why using neat-EO.pink ?
- GIS Standards compliancy
- Easy Data Preparation
- Build-In WebUI
- Modular and extensible
- Handle MultiBands Imagery and DataFusion
- High Performances
- Accurate (state of art Computer Vision)
![Page 30: neat-EO.pink : Computer Vision framework for GeoSpatial Imagery · 2020-02-12 · neat-EO.pink powered by @data_pink Take Away - Industrial OpenSource AI4EO Imagery framework available](https://reader034.fdocuments.in/reader034/viewer/2022042300/5eca94525366ed5cdc2fde21/html5/thumbnails/30.jpg)
Human Learning
http://www.math.ens.fr/~feydy/Teaching/culture_mathematique.pdf [FR]
http://cs231n.stanford.edu/
https://neurovenge.antonomase.fr/NeuronsSpikeBack.pdf
http://www.numerical-tours.com/python/
![Page 31: neat-EO.pink : Computer Vision framework for GeoSpatial Imagery · 2020-02-12 · neat-EO.pink powered by @data_pink Take Away - Industrial OpenSource AI4EO Imagery framework available](https://reader034.fdocuments.in/reader034/viewer/2022042300/5eca94525366ed5cdc2fde21/html5/thumbnails/31.jpg)
Extract insights from GeoSpatial data with Deep Learning
@data_pink
www.datapink.com
![Page 32: neat-EO.pink : Computer Vision framework for GeoSpatial Imagery · 2020-02-12 · neat-EO.pink powered by @data_pink Take Away - Industrial OpenSource AI4EO Imagery framework available](https://reader034.fdocuments.in/reader034/viewer/2022042300/5eca94525366ed5cdc2fde21/html5/thumbnails/32.jpg)
neat-EO.pink powered by @data_pink
Take Away
- Industrial OpenSource AI4EO Imagery framework available
- Performances already OK to use it on regions or countries
- No need anymore to be a Computer Vision expert to use it
- Plain OpenData can be use to train accurate model
- Funding and Pull Requests can make the difference