Bringing Validation to Users - State of the Map · Bringing Validation to Users Integrating Quality...

33
Bringing Validation to Users Integrating Quality Assurance Checks into Map Editors Clarisse Abalos @map2save Matthew Gibb @giblet22

Transcript of Bringing Validation to Users - State of the Map · Bringing Validation to Users Integrating Quality...

Page 1: Bringing Validation to Users - State of the Map · Bringing Validation to Users Integrating Quality Assurance Checks into Map Editors Clarisse Abalos @map2save Matthew Gibb @giblet22

Bringing Validation to Users

Integrating Quality Assurance Checks

into Map Editors

Clarisse Abalos@map2save

Matthew Gibb@giblet22

Page 2: Bringing Validation to Users - State of the Map · Bringing Validation to Users Integrating Quality Assurance Checks into Map Editors Clarisse Abalos @map2save Matthew Gibb @giblet22

The Problem• Abundance of data issues waiting to be

cleaned up

• There are more mappers than validators

• Mappers need more guidance while mapping

Page 3: Bringing Validation to Users - State of the Map · Bringing Validation to Users Integrating Quality Assurance Checks into Map Editors Clarisse Abalos @map2save Matthew Gibb @giblet22

This Photo by Unknown author is licensed under CC BY-NC-ND.

To-Fix

Improve OSM

OSM Lint

Atlas

OSM Inspector

Keep Right

Osmose

Page 4: Bringing Validation to Users - State of the Map · Bringing Validation to Users Integrating Quality Assurance Checks into Map Editors Clarisse Abalos @map2save Matthew Gibb @giblet22

Quality Assurance ApproachStop bad or incomplete data from being created

Page 5: Bringing Validation to Users - State of the Map · Bringing Validation to Users Integrating Quality Assurance Checks into Map Editors Clarisse Abalos @map2save Matthew Gibb @giblet22

Solutions

Validation rules in JOSM and iD

Custom Presets and Validation Rules

Validation-centric Overpass Queries

Page 6: Bringing Validation to Users - State of the Map · Bringing Validation to Users Integrating Quality Assurance Checks into Map Editors Clarisse Abalos @map2save Matthew Gibb @giblet22

Validation in JOSM

Validation on dataset while editing features Warnings before upload

Page 7: Bringing Validation to Users - State of the Map · Bringing Validation to Users Integrating Quality Assurance Checks into Map Editors Clarisse Abalos @map2save Matthew Gibb @giblet22

JOSM Data Validator Types

Tag Checker Rules (MapCSS)• Great for basic topology

and tag checks

Tests (Java)

• Able to handle more complex geometry checks

Page 8: Bringing Validation to Users - State of the Map · Bringing Validation to Users Integrating Quality Assurance Checks into Map Editors Clarisse Abalos @map2save Matthew Gibb @giblet22

What is MapCSS?

• CSS-like language for map stylesheets

• Used in JOSM for map styling and data validation

Each color represents a building with a different name

Page 9: Bringing Validation to Users - State of the Map · Bringing Validation to Users Integrating Quality Assurance Checks into Map Editors Clarisse Abalos @map2save Matthew Gibb @giblet22

Basic MapCSS Validation Checks

Features that meet the rule criteria appear in the JOSM Validation Results window

Page 10: Bringing Validation to Users - State of the Map · Bringing Validation to Users Integrating Quality Assurance Checks into Map Editors Clarisse Abalos @map2save Matthew Gibb @giblet22

Create your own MapCSS checks locally 1. Write the rule -

save as .mapcss or .validator.mapcss file

2. Add as an Active Rule in JOSM

3. Click “Validation”

Page 11: Bringing Validation to Users - State of the Map · Bringing Validation to Users Integrating Quality Assurance Checks into Map Editors Clarisse Abalos @map2save Matthew Gibb @giblet22

Converting other QA tools to MapCSS

Page 12: Bringing Validation to Users - State of the Map · Bringing Validation to Users Integrating Quality Assurance Checks into Map Editors Clarisse Abalos @map2save Matthew Gibb @giblet22

Available JOSM

Tag CheckerRules

❏ Osmose (QA Tool Inspired Validations)

❏ KeepRight❏ OSM Lint

Page 13: Bringing Validation to Users - State of the Map · Bringing Validation to Users Integrating Quality Assurance Checks into Map Editors Clarisse Abalos @map2save Matthew Gibb @giblet22

JOSM Wiki Ruleshttps://josm.openstreetmap.de/wiki/Rules

Page 14: Bringing Validation to Users - State of the Map · Bringing Validation to Users Integrating Quality Assurance Checks into Map Editors Clarisse Abalos @map2save Matthew Gibb @giblet22
Page 15: Bringing Validation to Users - State of the Map · Bringing Validation to Users Integrating Quality Assurance Checks into Map Editors Clarisse Abalos @map2save Matthew Gibb @giblet22

JOSM Validator – Water StructuresInspired by Osmose analyser: #1221 “Far from water”

(Developed by: Milla Zagorski)

Page 16: Bringing Validation to Users - State of the Map · Bringing Validation to Users Integrating Quality Assurance Checks into Map Editors Clarisse Abalos @map2save Matthew Gibb @giblet22

JOSM Validator - WaterwaysInspired by Osmose analyser: #1220 “Waterway”

(Developed by: Milla Zagorski)

Page 17: Bringing Validation to Users - State of the Map · Bringing Validation to Users Integrating Quality Assurance Checks into Map Editors Clarisse Abalos @map2save Matthew Gibb @giblet22

JOSM Validator – Public TransportInspired by Osmose analyser: #1260 “Public Transport”

(Developed by: Milla Zagorski)

Page 18: Bringing Validation to Users - State of the Map · Bringing Validation to Users Integrating Quality Assurance Checks into Map Editors Clarisse Abalos @map2save Matthew Gibb @giblet22

What's new in JOSM?

58 new validators!

• Osmose – 41

• KeepRight – 7

• OSM Lint – 9

• Atlas – 1

(Developed by: David Manzer & Milla Zagorski)

Page 19: Bringing Validation to Users - State of the Map · Bringing Validation to Users Integrating Quality Assurance Checks into Map Editors Clarisse Abalos @map2save Matthew Gibb @giblet22

Mainly addressing...

highway issues tagging issues tree-trimming issues

Page 20: Bringing Validation to Users - State of the Map · Bringing Validation to Users Integrating Quality Assurance Checks into Map Editors Clarisse Abalos @map2save Matthew Gibb @giblet22

A really sweet bar chart

Page 21: Bringing Validation to Users - State of the Map · Bringing Validation to Users Integrating Quality Assurance Checks into Map Editors Clarisse Abalos @map2save Matthew Gibb @giblet22

Tasking Manager Campaign

MapRules(configId)

Presets

JOSM

ID

Validation Rules

JOSM

ID

Custom Presets and Validation Rules

Requirements for mapping features become• Simplified• Standardized• Streamlined

Simple UI to create guidelines that can be tied to campaigns and generate presets and validation rules that can tailor the editors to your campaign/organization focus specific needs

iframe

xml

json

MapCSS

json

Page 22: Bringing Validation to Users - State of the Map · Bringing Validation to Users Integrating Quality Assurance Checks into Map Editors Clarisse Abalos @map2save Matthew Gibb @giblet22

Creating Attribution Guidelines

Assisted with taginfo popular combinations

Page 23: Bringing Validation to Users - State of the Map · Bringing Validation to Users Integrating Quality Assurance Checks into Map Editors Clarisse Abalos @map2save Matthew Gibb @giblet22

Campaign Focused Presets

Page 24: Bringing Validation to Users - State of the Map · Bringing Validation to Users Integrating Quality Assurance Checks into Map Editors Clarisse Abalos @map2save Matthew Gibb @giblet22

Realtime Validation

• Only show fields and values relevant to campaign

• Throw validation errors or suggestions for further information while editing

Page 25: Bringing Validation to Users - State of the Map · Bringing Validation to Users Integrating Quality Assurance Checks into Map Editors Clarisse Abalos @map2save Matthew Gibb @giblet22

In Progress

USER PRESETS SHARING AND REUSING PRESETS

INTEGRATING INTO TASKING MANAGER 4

https://github.com/radiant-maxar/maprules

Page 26: Bringing Validation to Users - State of the Map · Bringing Validation to Users Integrating Quality Assurance Checks into Map Editors Clarisse Abalos @map2save Matthew Gibb @giblet22

Validation Based Overpass Queries

Why?

• Stale errors in QA databases

• Pulling in validation targeted data over larger areas

• Bulk operations

Page 27: Bringing Validation to Users - State of the Map · Bringing Validation to Users Integrating Quality Assurance Checks into Map Editors Clarisse Abalos @map2save Matthew Gibb @giblet22

MapRoulette Challenges

GeoJSON ● Local File● Remote Url

Overpass Query

Page 28: Bringing Validation to Users - State of the Map · Bringing Validation to Users Integrating Quality Assurance Checks into Map Editors Clarisse Abalos @map2save Matthew Gibb @giblet22
Page 29: Bringing Validation to Users - State of the Map · Bringing Validation to Users Integrating Quality Assurance Checks into Map Editors Clarisse Abalos @map2save Matthew Gibb @giblet22
Page 30: Bringing Validation to Users - State of the Map · Bringing Validation to Users Integrating Quality Assurance Checks into Map Editors Clarisse Abalos @map2save Matthew Gibb @giblet22

Automatically Fix Validation

Errors

Page 31: Bringing Validation to Users - State of the Map · Bringing Validation to Users Integrating Quality Assurance Checks into Map Editors Clarisse Abalos @map2save Matthew Gibb @giblet22

Why does this matter?

• Custom validations give users and groups the directed focus they need.

• If you're only interested in mapping railways, why not share your `railway=switch` validation MapCSS checker?

• Thematic validations can assist with directed editing and cleanup

Page 32: Bringing Validation to Users - State of the Map · Bringing Validation to Users Integrating Quality Assurance Checks into Map Editors Clarisse Abalos @map2save Matthew Gibb @giblet22

Create and Share Validation Rules

ADD TO MAPCSS VALIDATION RULES

ADD TO JOSM VALIDATORS

CREATE MAPRULES

Page 33: Bringing Validation to Users - State of the Map · Bringing Validation to Users Integrating Quality Assurance Checks into Map Editors Clarisse Abalos @map2save Matthew Gibb @giblet22

[email protected]

@map2save

Questions

[email protected]

@giblet22