BID CE Workshop 1 Session 09 - Biodiversity Data Management Tools
-
Upload
alberto-gonzalez-talavan -
Category
Education
-
view
228 -
download
0
Transcript of BID CE Workshop 1 Session 09 - Biodiversity Data Management Tools
![Page 1: BID CE Workshop 1 Session 09 - Biodiversity Data Management Tools](https://reader031.fdocuments.in/reader031/viewer/2022030309/58f2ac931a28ab34618b456b/html5/thumbnails/1.jpg)
Auguest 24th, 2016THE BID PROGRAMME IS FUNDED BY THE EUROPEAN UNION
Other data management toolsNicolas Noé
![Page 2: BID CE Workshop 1 Session 09 - Biodiversity Data Management Tools](https://reader031.fdocuments.in/reader031/viewer/2022030309/58f2ac931a28ab34618b456b/html5/thumbnails/2.jpg)
Auguest 24th, 2016THE BID PROGRAMME IS FUNDED BY THE EUROPEAN UNION
Autres outils de gestion de données Nicolas Noé
![Page 3: BID CE Workshop 1 Session 09 - Biodiversity Data Management Tools](https://reader031.fdocuments.in/reader031/viewer/2022030309/58f2ac931a28ab34618b456b/html5/thumbnails/3.jpg)
Rationale
●You NEED someone in the team who’s comfortable with data manipulation:
• Real-world data = messy• Transformations are always needed• Automate!
●Cleaning but also other transformations
Rat
iona
le
![Page 4: BID CE Workshop 1 Session 09 - Biodiversity Data Management Tools](https://reader031.fdocuments.in/reader031/viewer/2022030309/58f2ac931a28ab34618b456b/html5/thumbnails/4.jpg)
Justification
●Importance d’avoir au moins une personne à l’aise avec la manipulation de données:
• Données réelles = désordonnées• Des transformations sont toujours nécessaires• Automatisation!
●Nettoyage des données, mais pas seulement
Just
ifica
tion
![Page 5: BID CE Workshop 1 Session 09 - Biodiversity Data Management Tools](https://reader031.fdocuments.in/reader031/viewer/2022030309/58f2ac931a28ab34618b456b/html5/thumbnails/5.jpg)
Pre-workshop activity: results
• https://docs.google.com/spreadsheets/d/1QtV4z45pgvbAyM_ibKTW5bK1BOipqpfRpCd_o29TSi4/edit#gid=0P
re-w
orks
hop
![Page 6: BID CE Workshop 1 Session 09 - Biodiversity Data Management Tools](https://reader031.fdocuments.in/reader031/viewer/2022030309/58f2ac931a28ab34618b456b/html5/thumbnails/6.jpg)
Sondage pré-atelier: résultats
• https://docs.google.com/spreadsheets/d/1QtV4z45pgvbAyM_ibKTW5bK1BOipqpfRpCd_o29TSi4/edit#gid=0
Pré
-ate
lier
![Page 7: BID CE Workshop 1 Session 09 - Biodiversity Data Management Tools](https://reader031.fdocuments.in/reader031/viewer/2022030309/58f2ac931a28ab34618b456b/html5/thumbnails/7.jpg)
Strengths and weaknesses
• Price, availability, license, …• Ease of use• Documentation and support• Flexibility• Performance• Technical requirements• Automation• ...
Tool
cho
ice
![Page 8: BID CE Workshop 1 Session 09 - Biodiversity Data Management Tools](https://reader031.fdocuments.in/reader031/viewer/2022030309/58f2ac931a28ab34618b456b/html5/thumbnails/8.jpg)
Forces et faiblesses
• Prix, disponibilité, license, ...• Facilité d’utilisation• Documentation et support• Flexibilité• Performances• Besoins techniques• Automatisation• ...
Sél
ectio
n d’
outil
![Page 9: BID CE Workshop 1 Session 09 - Biodiversity Data Management Tools](https://reader031.fdocuments.in/reader031/viewer/2022030309/58f2ac931a28ab34618b456b/html5/thumbnails/9.jpg)
Build your own palette of tools!
This is not a recipe
![Page 10: BID CE Workshop 1 Session 09 - Biodiversity Data Management Tools](https://reader031.fdocuments.in/reader031/viewer/2022030309/58f2ac931a28ab34618b456b/html5/thumbnails/10.jpg)
Créez votre propre palette d’outils !
Pas de “recette toute faite”
![Page 11: BID CE Workshop 1 Session 09 - Biodiversity Data Management Tools](https://reader031.fdocuments.in/reader031/viewer/2022030309/58f2ac931a28ab34618b456b/html5/thumbnails/11.jpg)
Exchange format: CSV, TSV, *SV
• What is it?• Separators• Encoding• Demo!
Form
at
![Page 12: BID CE Workshop 1 Session 09 - Biodiversity Data Management Tools](https://reader031.fdocuments.in/reader031/viewer/2022030309/58f2ac931a28ab34618b456b/html5/thumbnails/12.jpg)
Format d’échange: CSV, TSV, *SV
• De quoi s’agit-il• Separateurs• Encodage• Demonstration
Form
at
![Page 13: BID CE Workshop 1 Session 09 - Biodiversity Data Management Tools](https://reader031.fdocuments.in/reader031/viewer/2022030309/58f2ac931a28ab34618b456b/html5/thumbnails/13.jpg)
CSV tips
●When creating the file:• Document options used• Encoding: use UTF-8
●When opening external file: try different options and check the results.
CS
V fo
rmat
![Page 14: BID CE Workshop 1 Session 09 - Biodiversity Data Management Tools](https://reader031.fdocuments.in/reader031/viewer/2022030309/58f2ac931a28ab34618b456b/html5/thumbnails/14.jpg)
Trucs et astuces CSV
●A la création du fichier:• Documentation sur • Encodage: UTF-8
●A l’utilisation: essayez différentes options et valider.
Form
at C
SV
![Page 15: BID CE Workshop 1 Session 09 - Biodiversity Data Management Tools](https://reader031.fdocuments.in/reader031/viewer/2022030309/58f2ac931a28ab34618b456b/html5/thumbnails/15.jpg)
- MDB ACCDB Viewer
- CSV files- ...
Tool
sStep 0: Out of MS-Access
![Page 16: BID CE Workshop 1 Session 09 - Biodiversity Data Management Tools](https://reader031.fdocuments.in/reader031/viewer/2022030309/58f2ac931a28ab34618b456b/html5/thumbnails/16.jpg)
- MDB ACCDB Viewer
- Fichiers CSV- ...
Out
ils Etape 0: Exporter depuis MS-Access
![Page 17: BID CE Workshop 1 Session 09 - Biodiversity Data Management Tools](https://reader031.fdocuments.in/reader031/viewer/2022030309/58f2ac931a28ab34618b456b/html5/thumbnails/17.jpg)
Step 1: SQLite- A complete lightweight relational
database- Free and Open Source
Tool
s
![Page 18: BID CE Workshop 1 Session 09 - Biodiversity Data Management Tools](https://reader031.fdocuments.in/reader031/viewer/2022030309/58f2ac931a28ab34618b456b/html5/thumbnails/18.jpg)
Etape 1: SQLite- Un moteur de base de données
relationnelle complet- Gratuir et Open Source
Out
ils
![Page 19: BID CE Workshop 1 Session 09 - Biodiversity Data Management Tools](https://reader031.fdocuments.in/reader031/viewer/2022030309/58f2ac931a28ab34618b456b/html5/thumbnails/19.jpg)
Step 2: LibreOfficeTo
ols
Learn how to use advanced spreadsheet features!
![Page 20: BID CE Workshop 1 Session 09 - Biodiversity Data Management Tools](https://reader031.fdocuments.in/reader031/viewer/2022030309/58f2ac931a28ab34618b456b/html5/thumbnails/20.jpg)
Etape 2: LibreOfficeO
utils
Utilisez les fonctions avancées du tableur !
![Page 21: BID CE Workshop 1 Session 09 - Biodiversity Data Management Tools](https://reader031.fdocuments.in/reader031/viewer/2022030309/58f2ac931a28ab34618b456b/html5/thumbnails/21.jpg)
Step 3: QGIS- General use Desktop GIS solution- For transformation, analysis,
visualisation, cleaning, ...
Tool
s
![Page 22: BID CE Workshop 1 Session 09 - Biodiversity Data Management Tools](https://reader031.fdocuments.in/reader031/viewer/2022030309/58f2ac931a28ab34618b456b/html5/thumbnails/22.jpg)
Etape 3: QGIS- Solution SIG Desktop complète et
généraliste- Pour transformations, analyse,
visualisation, nettoyage, ...
Out
ils
![Page 23: BID CE Workshop 1 Session 09 - Biodiversity Data Management Tools](https://reader031.fdocuments.in/reader031/viewer/2022030309/58f2ac931a28ab34618b456b/html5/thumbnails/23.jpg)
Step 4: ScriptingTo
ols
![Page 24: BID CE Workshop 1 Session 09 - Biodiversity Data Management Tools](https://reader031.fdocuments.in/reader031/viewer/2022030309/58f2ac931a28ab34618b456b/html5/thumbnails/24.jpg)
Etape 4: ScriptsO
utils
![Page 25: BID CE Workshop 1 Session 09 - Biodiversity Data Management Tools](https://reader031.fdocuments.in/reader031/viewer/2022030309/58f2ac931a28ab34618b456b/html5/thumbnails/25.jpg)
Specialised tools- Nomenclature:
• ECAT Name Parser: http://tools.gbif.org/nameparser/parser.do• TNRS: http://tnrs.iplantcollaborative.org/index.html
- Geography:• Info XY: http://splink.cria.org.br/infoxy?criaLANG=en• Canadensys coordinates conversion:
http://data.canadensys.net/tools/coordinates• GPS Visualizer: http://www.gpsvisualizer.com/
Tool
s
![Page 26: BID CE Workshop 1 Session 09 - Biodiversity Data Management Tools](https://reader031.fdocuments.in/reader031/viewer/2022030309/58f2ac931a28ab34618b456b/html5/thumbnails/26.jpg)
Outils spécialisés- Nomenclature:
• ECAT Name Parser: http://tools.gbif.org/nameparser/parser.do• TNRS: http://tnrs.iplantcollaborative.org/index.html• http://splink.cria.org.br/infoxy?criaLANG=en
- Geographie:• Info XY: http://splink.cria.org.br/infoxy?criaLANG=en• Canadensys coordinates conversion:
http://data.canadensys.net/tools/coordinates• GPS Visualizer: http://www.gpsvisualizer.com/
Out
ils
![Page 27: BID CE Workshop 1 Session 09 - Biodiversity Data Management Tools](https://reader031.fdocuments.in/reader031/viewer/2022030309/58f2ac931a28ab34618b456b/html5/thumbnails/27.jpg)
Data sources- www.naturalearthdata.com- http://www.diva-gis.org/Data- Biodiversity data already at GBIF- OpenStreetMap- Catalog of Life annual checklistD
ata
sour
ces
![Page 28: BID CE Workshop 1 Session 09 - Biodiversity Data Management Tools](https://reader031.fdocuments.in/reader031/viewer/2022030309/58f2ac931a28ab34618b456b/html5/thumbnails/28.jpg)
Sources de données- www.naturalearthdata.com- http://www.diva-gis.org/Data- Biodiversity data already at GBIF- OpenStreetMap- Catalog of Life annual checklist
Sou
rces
de
donn
ées
![Page 29: BID CE Workshop 1 Session 09 - Biodiversity Data Management Tools](https://reader031.fdocuments.in/reader031/viewer/2022030309/58f2ac931a28ab34618b456b/html5/thumbnails/29.jpg)
Demo!
![Page 30: BID CE Workshop 1 Session 09 - Biodiversity Data Management Tools](https://reader031.fdocuments.in/reader031/viewer/2022030309/58f2ac931a28ab34618b456b/html5/thumbnails/30.jpg)
Exercise!
![Page 31: BID CE Workshop 1 Session 09 - Biodiversity Data Management Tools](https://reader031.fdocuments.in/reader031/viewer/2022030309/58f2ac931a28ab34618b456b/html5/thumbnails/31.jpg)
Auguest 24th, 2016THE BID PROGRAMME IS FUNDED BY THE EUROPEAN UNION
Other data management toolsNicolas Noé
![Page 32: BID CE Workshop 1 Session 09 - Biodiversity Data Management Tools](https://reader031.fdocuments.in/reader031/viewer/2022030309/58f2ac931a28ab34618b456b/html5/thumbnails/32.jpg)
Auguest 24th, 2016THE BID PROGRAMME IS FUNDED BY THE EUROPEAN UNION
Autres outils de gestion de données Nicolas Noé