Using Crowdsourced Data and Free Tools in Government · Mayor’s culture encourages breakthrough...
Transcript of Using Crowdsourced Data and Free Tools in Government · Mayor’s culture encourages breakthrough...
![Page 1: Using Crowdsourced Data and Free Tools in Government · Mayor’s culture encourages breakthrough and innovation work. Civic Innovation department is run like a start-up: Connect](https://reader034.fdocuments.in/reader034/viewer/2022042305/5ed0b49d0725b354e0667d88/html5/thumbnails/1.jpg)
Using Crowdsourced Data and Open Source Tools in Government
Michael Schnuerle, Chief Data Officer
Office of Civic Innovation and Technology
Louisville, Kentucky, USA
NOCoE - Adventures in Crowdsourcing
January 28, 2020
![Page 2: Using Crowdsourced Data and Free Tools in Government · Mayor’s culture encourages breakthrough and innovation work. Civic Innovation department is run like a start-up: Connect](https://reader034.fdocuments.in/reader034/viewer/2022042305/5ed0b49d0725b354e0667d88/html5/thumbnails/2.jpg)
Office of Civic Innovation and TechnologyMayor Greg Fischer Created Innovation office in 2010
Grace SimrallChief of Civic Innovation and Technology
Ed BlayneyCivic Technology Manager
Michael SchnuerleData Officer
TBDSenior Data Analyst
Ricky SantiagoInnovation Project Manager
Chris SeidtIT Director
Sioban KingInnovation and Improvement Coordinator
Info
rmat
ion
Tech
nolo
gy
web: OPI.LSVLL.io/innovation
![Page 3: Using Crowdsourced Data and Free Tools in Government · Mayor’s culture encourages breakthrough and innovation work. Civic Innovation department is run like a start-up: Connect](https://reader034.fdocuments.in/reader034/viewer/2022042305/5ed0b49d0725b354e0667d88/html5/thumbnails/3.jpg)
• Data management & analysis projects• Manages city open data program • Data Governance internal team:
• 60+ cross-department data employees• Create and update data policies• Training, tools, collaboration, workshops on data lifecycle• Manage open data for their departments• Data Inventory, standards• Annual and integrated data privacy, ethics, bias, security training
• Collaborations on university, private company, non-profit, and government projects. Public hackathons.
Chief Data Officer Responsibilities
![Page 4: Using Crowdsourced Data and Free Tools in Government · Mayor’s culture encourages breakthrough and innovation work. Civic Innovation department is run like a start-up: Connect](https://reader034.fdocuments.in/reader034/viewer/2022042305/5ed0b49d0725b354e0667d88/html5/thumbnails/4.jpg)
City-wide Traffic Sensors: Crowdsourced
![Page 5: Using Crowdsourced Data and Free Tools in Government · Mayor’s culture encourages breakthrough and innovation work. Civic Innovation department is run like a start-up: Connect](https://reader034.fdocuments.in/reader034/viewer/2022042305/5ed0b49d0725b354e0667d88/html5/thumbnails/5.jpg)
Waze App - iOS and Android50,000 active daily users in Louisville
![Page 6: Using Crowdsourced Data and Free Tools in Government · Mayor’s culture encourages breakthrough and innovation work. Civic Innovation department is run like a start-up: Connect](https://reader034.fdocuments.in/reader034/viewer/2022042305/5ed0b49d0725b354e0667d88/html5/thumbnails/6.jpg)
Data Officer| Bellarmine PresentationOffice of PerformanceImprovement and InnovationOPI2
Waze.com/ccp
![Page 7: Using Crowdsourced Data and Free Tools in Government · Mayor’s culture encourages breakthrough and innovation work. Civic Innovation department is run like a start-up: Connect](https://reader034.fdocuments.in/reader034/viewer/2022042305/5ed0b49d0725b354e0667d88/html5/thumbnails/7.jpg)
Waze sends us traffic jams, alerts, and user reports. You can see all of that combined on Waze's Live Map: www.waze.com/en-GB/livemap
![Page 8: Using Crowdsourced Data and Free Tools in Government · Mayor’s culture encourages breakthrough and innovation work. Civic Innovation department is run like a start-up: Connect](https://reader034.fdocuments.in/reader034/viewer/2022042305/5ed0b49d0725b354e0667d88/html5/thumbnails/8.jpg)
• Near real-time data feed for:• Jams/Congestion (passively collected for users)• Alerts (actively submitted by users)
• Potholes
• Roadkill
• Cars stopped on road
• Irregularities - speeds on slower roads
What does it give us?
• Missing Signs
• Weather
• Accidents
![Page 9: Using Crowdsourced Data and Free Tools in Government · Mayor’s culture encourages breakthrough and innovation work. Civic Innovation department is run like a start-up: Connect](https://reader034.fdocuments.in/reader034/viewer/2022042305/5ed0b49d0725b354e0667d88/html5/thumbnails/9.jpg)
Post Event Analysis
Thunder Over Louisville
Fireworks show to kick off two weeks of Kentucky Derby festivities
Animated Map of people leaving downtown after event
![Page 10: Using Crowdsourced Data and Free Tools in Government · Mayor’s culture encourages breakthrough and innovation work. Civic Innovation department is run like a start-up: Connect](https://reader034.fdocuments.in/reader034/viewer/2022042305/5ed0b49d0725b354e0667d88/html5/thumbnails/10.jpg)
Change in Jams after re-timing
![Page 11: Using Crowdsourced Data and Free Tools in Government · Mayor’s culture encourages breakthrough and innovation work. Civic Innovation department is run like a start-up: Connect](https://reader034.fdocuments.in/reader034/viewer/2022042305/5ed0b49d0725b354e0667d88/html5/thumbnails/11.jpg)
Pothole Reports - 311 vs Waze
Waze use is higher on faster roads vs 311 use on slower roads.
Static Map
Animated Map
![Page 12: Using Crowdsourced Data and Free Tools in Government · Mayor’s culture encourages breakthrough and innovation work. Civic Innovation department is run like a start-up: Connect](https://reader034.fdocuments.in/reader034/viewer/2022042305/5ed0b49d0725b354e0667d88/html5/thumbnails/12.jpg)
911 ReportsGenesis PULSEMASSDOT
Real-time notifications of crashes and road closures
Ability to find crash scenes easier and faster
Best navigation to incidents using Waze SDK
Reducing response times
![Page 13: Using Crowdsourced Data and Free Tools in Government · Mayor’s culture encourages breakthrough and innovation work. Civic Innovation department is run like a start-up: Connect](https://reader034.fdocuments.in/reader034/viewer/2022042305/5ed0b49d0725b354e0667d88/html5/thumbnails/13.jpg)
● Over a time period to do a traffic study on a corridor, instead of
a paid study.
● Monitor changes to a corridor based on tweaks
● Hot spot analysis for how to focus their resources
● Detect faulty non-connected equipment (eg. induction loops)● Post event analysis to check effectiveness of road closures and
routing to optimize future events.
Traffic Use Cases
![Page 14: Using Crowdsourced Data and Free Tools in Government · Mayor’s culture encourages breakthrough and innovation work. Civic Innovation department is run like a start-up: Connect](https://reader034.fdocuments.in/reader034/viewer/2022042305/5ed0b49d0725b354e0667d88/html5/thumbnails/14.jpg)
● Real-time alerts and routing for emergency vehicles
● Real-time collision user reports● Vision Zero analysis● Citizen facing notifications in custom areas
Other Use Cases
![Page 15: Using Crowdsourced Data and Free Tools in Government · Mayor’s culture encourages breakthrough and innovation work. Civic Innovation department is run like a start-up: Connect](https://reader034.fdocuments.in/reader034/viewer/2022042305/5ed0b49d0725b354e0667d88/html5/thumbnails/15.jpg)
WAZE WARP Open Source
![Page 16: Using Crowdsourced Data and Free Tools in Government · Mayor’s culture encourages breakthrough and innovation work. Civic Innovation department is run like a start-up: Connect](https://reader034.fdocuments.in/reader034/viewer/2022042305/5ed0b49d0725b354e0667d88/html5/thumbnails/16.jpg)
Waze Data Ingestion Platform Costs
Using the CCP data is complicated.
Jurisdictions have spent hundreds of thousands of dollars on the infrastructure, databases, and reporting tools based off just the Waze data.
![Page 17: Using Crowdsourced Data and Free Tools in Government · Mayor’s culture encourages breakthrough and innovation work. Civic Innovation department is run like a start-up: Connect](https://reader034.fdocuments.in/reader034/viewer/2022042305/5ed0b49d0725b354e0667d88/html5/thumbnails/17.jpg)
Waze WARPWaze Analytics Relational-database Platform takes the Waze CCP data feed and processes it into a cloud database system for historic and real-time querying, analysis, API hooks, mapping.
Over 80 Govs on board and 15+ are using it for less than $200/m in cloud costs.
Paid by sponsors
![Page 18: Using Crowdsourced Data and Free Tools in Government · Mayor’s culture encourages breakthrough and innovation work. Civic Innovation department is run like a start-up: Connect](https://reader034.fdocuments.in/reader034/viewer/2022042305/5ed0b49d0725b354e0667d88/html5/thumbnails/18.jpg)
Free On Demand Traffic Studies
Blog Post and Downloads: medium.com/louisville-metro-opi2/
![Page 19: Using Crowdsourced Data and Free Tools in Government · Mayor’s culture encourages breakthrough and innovation work. Civic Innovation department is run like a start-up: Connect](https://reader034.fdocuments.in/reader034/viewer/2022042305/5ed0b49d0725b354e0667d88/html5/thumbnails/19.jpg)
Using WARP and Power BI, we can replicate $50,000 traffic studies, for free on and on-demand.
Power BI Tool Online: bit.ly/WazePowerBI
Free On Demand Traffic Studies
![Page 20: Using Crowdsourced Data and Free Tools in Government · Mayor’s culture encourages breakthrough and innovation work. Civic Innovation department is run like a start-up: Connect](https://reader034.fdocuments.in/reader034/viewer/2022042305/5ed0b49d0725b354e0667d88/html5/thumbnails/20.jpg)
Predicting Congestion
pennmusa.github.io/MUSA_801.io/
![Page 21: Using Crowdsourced Data and Free Tools in Government · Mayor’s culture encourages breakthrough and innovation work. Civic Innovation department is run like a start-up: Connect](https://reader034.fdocuments.in/reader034/viewer/2022042305/5ed0b49d0725b354e0667d88/html5/thumbnails/21.jpg)
Since the Power BI tool connects to an uses the Waze WARP schema, you can use this free tool too for your area when you deploy WARP.
Instructions on the project page:
github.com/LouisvilleMetro/WazeCCPProcessor
Deployed in Anchorage in 30 mins on a plane!
Built on Waze WARP Platform
![Page 22: Using Crowdsourced Data and Free Tools in Government · Mayor’s culture encourages breakthrough and innovation work. Civic Innovation department is run like a start-up: Connect](https://reader034.fdocuments.in/reader034/viewer/2022042305/5ed0b49d0725b354e0667d88/html5/thumbnails/22.jpg)
Open SourceCrowdsourcing
![Page 23: Using Crowdsourced Data and Free Tools in Government · Mayor’s culture encourages breakthrough and innovation work. Civic Innovation department is run like a start-up: Connect](https://reader034.fdocuments.in/reader034/viewer/2022042305/5ed0b49d0725b354e0667d88/html5/thumbnails/23.jpg)
Open Government Coalition (OGC)
OGC is a network of government agencies working on open source cloud projects together.
www.GovInTheOpen.com
![Page 24: Using Crowdsourced Data and Free Tools in Government · Mayor’s culture encourages breakthrough and innovation work. Civic Innovation department is run like a start-up: Connect](https://reader034.fdocuments.in/reader034/viewer/2022042305/5ed0b49d0725b354e0667d88/html5/thumbnails/24.jpg)
Open Source ToolsWe work collaboratively with residents, researchers, other cities and companies on Github. See the tools and projects we publish there, jump in and help out if you can.
● Louisville Metro - github.com/LouisvilleMetro● Office of Civic Innovation - github.com/LouisvilleMetro-innovation● DKAN Open Data Platform - github.com/GetDKAN/dkan● Open Government Coalition - github.com/GovInTheOpen (Waze)● Open Mobility Foundation - OpenMobilityFoundation.org (MDS)
![Page 25: Using Crowdsourced Data and Free Tools in Government · Mayor’s culture encourages breakthrough and innovation work. Civic Innovation department is run like a start-up: Connect](https://reader034.fdocuments.in/reader034/viewer/2022042305/5ed0b49d0725b354e0667d88/html5/thumbnails/25.jpg)
Data Governance | Grow Data Capacity
Open Data Website - Metro
data.LouisvilleKY.gov
Open Source (free) DKAN
software. Run by the city
with departments in
charge of their data.
![Page 26: Using Crowdsourced Data and Free Tools in Government · Mayor’s culture encourages breakthrough and innovation work. Civic Innovation department is run like a start-up: Connect](https://reader034.fdocuments.in/reader034/viewer/2022042305/5ed0b49d0725b354e0667d88/html5/thumbnails/26.jpg)
OpenStreetMap
Crowdsourced Mapping Data
415,000 buildings. 398,000 addresses.
![Page 27: Using Crowdsourced Data and Free Tools in Government · Mayor’s culture encourages breakthrough and innovation work. Civic Innovation department is run like a start-up: Connect](https://reader034.fdocuments.in/reader034/viewer/2022042305/5ed0b49d0725b354e0667d88/html5/thumbnails/27.jpg)
How Do We Do This?
![Page 28: Using Crowdsourced Data and Free Tools in Government · Mayor’s culture encourages breakthrough and innovation work. Civic Innovation department is run like a start-up: Connect](https://reader034.fdocuments.in/reader034/viewer/2022042305/5ed0b49d0725b354e0667d88/html5/thumbnails/28.jpg)
Data Driven Culture in Louisville
Use data to drive decisions and see opportunities for improvement.
Mayor Greg Fischer at Code for America Summit
![Page 29: Using Crowdsourced Data and Free Tools in Government · Mayor’s culture encourages breakthrough and innovation work. Civic Innovation department is run like a start-up: Connect](https://reader034.fdocuments.in/reader034/viewer/2022042305/5ed0b49d0725b354e0667d88/html5/thumbnails/29.jpg)
Importance of Innovation
Most gov employees focused on the daily work. Mayor’s culture encourages breakthrough and innovation work.
Civic Innovation department is run like a start-up:Connect the dots, partner, prove value, find future funding.
Focus Areas: 1. Smart City/Smart Home2. Tech Enabled Public Health3. Social Innovation4. Maker/Hacker Community
Values: Data-driven compassion/ digital inclusion
![Page 30: Using Crowdsourced Data and Free Tools in Government · Mayor’s culture encourages breakthrough and innovation work. Civic Innovation department is run like a start-up: Connect](https://reader034.fdocuments.in/reader034/viewer/2022042305/5ed0b49d0725b354e0667d88/html5/thumbnails/30.jpg)
Innovation Grant Funds - Grand Total: $13,589,568
Cash Awards: $11,704,568 - includes Bloomberg Philanthropies, US Dept of Labor, Kauffman Foundation, Robert Wood Johnson Foundation, PNC Foundation, US Housing and Urban Development, Kentucky Transportation Cabinet from US DOT, Amazon Web Services, and JP Morgan Chase.
In-Kind Awards: $1,885,000
Equals 27 years of our entire operating expenses.
Office of Civic Innovation - Projects, Programs, Funding
![Page 31: Using Crowdsourced Data and Free Tools in Government · Mayor’s culture encourages breakthrough and innovation work. Civic Innovation department is run like a start-up: Connect](https://reader034.fdocuments.in/reader034/viewer/2022042305/5ed0b49d0725b354e0667d88/html5/thumbnails/31.jpg)
Data Governance Team
50+ people who manage data from every department.
![Page 32: Using Crowdsourced Data and Free Tools in Government · Mayor’s culture encourages breakthrough and innovation work. Civic Innovation department is run like a start-up: Connect](https://reader034.fdocuments.in/reader034/viewer/2022042305/5ed0b49d0725b354e0667d88/html5/thumbnails/32.jpg)
What is the Data Governance Team?
Expand department’s existing data capacity.
Together build skills and efficiency, learn
new tools, share data, network, and
get rewarded.
![Page 33: Using Crowdsourced Data and Free Tools in Government · Mayor’s culture encourages breakthrough and innovation work. Civic Innovation department is run like a start-up: Connect](https://reader034.fdocuments.in/reader034/viewer/2022042305/5ed0b49d0725b354e0667d88/html5/thumbnails/33.jpg)
● Training & Events● Working Groups● Data Inventory● Business Intelligence● Open Data● Data Quality● Data Standards● Badges● Write Policy
What does Data Governance do?
Data Gov Website
![Page 34: Using Crowdsourced Data and Free Tools in Government · Mayor’s culture encourages breakthrough and innovation work. Civic Innovation department is run like a start-up: Connect](https://reader034.fdocuments.in/reader034/viewer/2022042305/5ed0b49d0725b354e0667d88/html5/thumbnails/34.jpg)
Working Groups
1. Data Inventory2. Data Standards:
a. Sex/Genderb. Street Addressesc. Date/Time
3. Data Warehouse + ETL4. Open Data Policy 5. Data Automation6. Data Quality
![Page 35: Using Crowdsourced Data and Free Tools in Government · Mayor’s culture encourages breakthrough and innovation work. Civic Innovation department is run like a start-up: Connect](https://reader034.fdocuments.in/reader034/viewer/2022042305/5ed0b49d0725b354e0667d88/html5/thumbnails/35.jpg)
Contact Info:Michael SchnuerleData [email protected]@LouDataOfficer
Website: opi.lsvll.io/innovation
Open Data: Data.LouisvilleKY.gov