National Retrofit Programme Keith Willcock Scottish Government.
Open Data & Government Data Programme
-
Upload
uk-government-digital-service -
Category
Data & Analytics
-
view
1.034 -
download
1
Transcript of Open Data & Government Data Programme
![Page 1: Open Data & Government Data Programme](https://reader035.fdocuments.in/reader035/viewer/2022081414/589eb4261a28ab4a5c8b4961/html5/thumbnails/1.jpg)
Open Data & Government Data Programme Update event for external data users8 December 2015
Paul MaltbyDirector of DataGovernment Digital Service@maltbyps
![Page 2: Open Data & Government Data Programme](https://reader035.fdocuments.in/reader035/viewer/2022081414/589eb4261a28ab4a5c8b4961/html5/thumbnails/2.jpg)
In the last Parliament our data approach was dominated by open data
GDS
![Page 4: Open Data & Government Data Programme](https://reader035.fdocuments.in/reader035/viewer/2022081414/589eb4261a28ab4a5c8b4961/html5/thumbnails/4.jpg)
The data user community worked wonders
GDS
![Page 5: Open Data & Government Data Programme](https://reader035.fdocuments.in/reader035/viewer/2022081414/589eb4261a28ab4a5c8b4961/html5/thumbnails/5.jpg)
But like ODI & others we know we now need to stretch our approach wider and deeper
GDS
![Page 6: Open Data & Government Data Programme](https://reader035.fdocuments.in/reader035/viewer/2022081414/589eb4261a28ab4a5c8b4961/html5/thumbnails/6.jpg)
That means, where appropriate, shared data, not just open data
GDS
![Page 7: Open Data & Government Data Programme](https://reader035.fdocuments.in/reader035/viewer/2022081414/589eb4261a28ab4a5c8b4961/html5/thumbnails/7.jpg)
That means quality, not just quantity
GDS
![Page 8: Open Data & Government Data Programme](https://reader035.fdocuments.in/reader035/viewer/2022081414/589eb4261a28ab4a5c8b4961/html5/thumbnails/8.jpg)
We will continue the deep involvement with external data users to keep pressure on the quality and quantity of open data
GDS
![Page 9: Open Data & Government Data Programme](https://reader035.fdocuments.in/reader035/viewer/2022081414/589eb4261a28ab4a5c8b4961/html5/thumbnails/9.jpg)
But the big shift is to drive data quality by dog-fooding within government
GDS
![Page 10: Open Data & Government Data Programme](https://reader035.fdocuments.in/reader035/viewer/2022081414/589eb4261a28ab4a5c8b4961/html5/thumbnails/10.jpg)
A new Government Data Programme aiming to transform how data is used across public services
GDS
![Page 11: Open Data & Government Data Programme](https://reader035.fdocuments.in/reader035/viewer/2022081414/589eb4261a28ab4a5c8b4961/html5/thumbnails/11.jpg)
GDS
Too much government data isDuplicatedIn many different formatsHard to reachHard to maintainHard to put to good use
![Page 12: Open Data & Government Data Programme](https://reader035.fdocuments.in/reader035/viewer/2022081414/589eb4261a28ab4a5c8b4961/html5/thumbnails/12.jpg)
GDS
Our aim = better digital services
![Page 13: Open Data & Government Data Programme](https://reader035.fdocuments.in/reader035/viewer/2022081414/589eb4261a28ab4a5c8b4961/html5/thumbnails/13.jpg)
GDS
Our aim = good policy and operational decisions
![Page 14: Open Data & Government Data Programme](https://reader035.fdocuments.in/reader035/viewer/2022081414/589eb4261a28ab4a5c8b4961/html5/thumbnails/14.jpg)
GDS
Our aim = economic benefits
![Page 15: Open Data & Government Data Programme](https://reader035.fdocuments.in/reader035/viewer/2022081414/589eb4261a28ab4a5c8b4961/html5/thumbnails/15.jpg)
GDS
Our aim = public trust & security
![Page 16: Open Data & Government Data Programme](https://reader035.fdocuments.in/reader035/viewer/2022081414/589eb4261a28ab4a5c8b4961/html5/thumbnails/16.jpg)
GDS
The Government Data Programme has 3 workstreams
![Page 17: Open Data & Government Data Programme](https://reader035.fdocuments.in/reader035/viewer/2022081414/589eb4261a28ab4a5c8b4961/html5/thumbnails/17.jpg)
1.Better use of data
GDS
![Page 18: Open Data & Government Data Programme](https://reader035.fdocuments.in/reader035/viewer/2022081414/589eb4261a28ab4a5c8b4961/html5/thumbnails/18.jpg)
Driving internal use of new data with:
Data science and open data projects on top policy challengesData capability and literacy (with ONS)
GDS
![Page 19: Open Data & Government Data Programme](https://reader035.fdocuments.in/reader035/viewer/2022081414/589eb4261a28ab4a5c8b4961/html5/thumbnails/19.jpg)
Maintaining UK’s international leadership on open data and transparency
GDS
![Page 20: Open Data & Government Data Programme](https://reader035.fdocuments.in/reader035/viewer/2022081414/589eb4261a28ab4a5c8b4961/html5/thumbnails/20.jpg)
Improving decision making and boosting demand for data quality for benefit of all
GDS
![Page 21: Open Data & Government Data Programme](https://reader035.fdocuments.in/reader035/viewer/2022081414/589eb4261a28ab4a5c8b4961/html5/thumbnails/21.jpg)
@cgchristrottConsul General, Cape Town, SA
Data science opportunities: Unstructured data and visualisations
GDS
![Page 22: Open Data & Government Data Programme](https://reader035.fdocuments.in/reader035/viewer/2022081414/589eb4261a28ab4a5c8b4961/html5/thumbnails/22.jpg)
Data Science & the Civil Service 22
Data science opportunities: Clustering and prediction
GDS
![Page 23: Open Data & Government Data Programme](https://reader035.fdocuments.in/reader035/viewer/2022081414/589eb4261a28ab4a5c8b4961/html5/thumbnails/23.jpg)
![Page 24: Open Data & Government Data Programme](https://reader035.fdocuments.in/reader035/viewer/2022081414/589eb4261a28ab4a5c8b4961/html5/thumbnails/24.jpg)
There is some unfinished business on open data
GDS
![Page 25: Open Data & Government Data Programme](https://reader035.fdocuments.in/reader035/viewer/2022081414/589eb4261a28ab4a5c8b4961/html5/thumbnails/25.jpg)
We especially want help from external users with ODI to keep driving the open data agenda
GDS
![Page 26: Open Data & Government Data Programme](https://reader035.fdocuments.in/reader035/viewer/2022081414/589eb4261a28ab4a5c8b4961/html5/thumbnails/26.jpg)
![Page 27: Open Data & Government Data Programme](https://reader035.fdocuments.in/reader035/viewer/2022081414/589eb4261a28ab4a5c8b4961/html5/thumbnails/27.jpg)
ONS creating mainstream data science capability among analysts in government
GDS
![Page 28: Open Data & Government Data Programme](https://reader035.fdocuments.in/reader035/viewer/2022081414/589eb4261a28ab4a5c8b4961/html5/thumbnails/28.jpg)
GDS will be supporting this, including through data literacy for non-data specialists
GDS
![Page 29: Open Data & Government Data Programme](https://reader035.fdocuments.in/reader035/viewer/2022081414/589eb4261a28ab4a5c8b4961/html5/thumbnails/29.jpg)
2. Modernising data infrastructure
GDS
![Page 30: Open Data & Government Data Programme](https://reader035.fdocuments.in/reader035/viewer/2022081414/589eb4261a28ab4a5c8b4961/html5/thumbnails/30.jpg)
Creating a security-conscious data layer in government consisting of
Data access toolsAPIsRegisters
GDS
![Page 31: Open Data & Government Data Programme](https://reader035.fdocuments.in/reader035/viewer/2022081414/589eb4261a28ab4a5c8b4961/html5/thumbnails/31.jpg)
Resulting in a National Information Infrastructure of open and shared data to fuel business and government innovation
GDS
![Page 32: Open Data & Government Data Programme](https://reader035.fdocuments.in/reader035/viewer/2022081414/589eb4261a28ab4a5c8b4961/html5/thumbnails/32.jpg)
Registers: lists of facts where the government is the canonical source of truth
API standards: so without friction appropriate data can be queried across government
Discovery tools: so civil servants can find out if data exists & if they can access it
![Page 33: Open Data & Government Data Programme](https://reader035.fdocuments.in/reader035/viewer/2022081414/589eb4261a28ab4a5c8b4961/html5/thumbnails/33.jpg)
GDS
companies, charities, trade unions, courts, schools, universities, hospitals, zoos, circuses, inspections, licences, certificates, births, marriages, deaths, electoral roll, insolvencies, bankruptcies, passports, animal passports, drivers, vehicles, land parcels, land ownership, land use, legal boundaries, awards, tax rates, benefits, livestock movements, flood risk, river levels, companies, fish caught, patents, trademarks, designs, non-native invasive plants, bank holidays, food standards, clock changes …
![Page 34: Open Data & Government Data Programme](https://reader035.fdocuments.in/reader035/viewer/2022081414/589eb4261a28ab4a5c8b4961/html5/thumbnails/34.jpg)
“SCOLAND UK” “SCOTALND UK” “SCOTKLAND UK”“SCOTLAD UK”“SCOTLAND”“SCOTLAND UK”“SCOTLAND UK”“SCOTLAND UNITED KINGDO”“SCOTLAND UNITED KINGDOM”“SCOTLAND UNITED KINGODM”“SCOTLAND, UK”
GDS
![Page 35: Open Data & Government Data Programme](https://reader035.fdocuments.in/reader035/viewer/2022081414/589eb4261a28ab4a5c8b4961/html5/thumbnails/35.jpg)
Registers are more than just a list
GDS
![Page 36: Open Data & Government Data Programme](https://reader035.fdocuments.in/reader035/viewer/2022081414/589eb4261a28ab4a5c8b4961/html5/thumbnails/36.jpg)
GDS
Persistent & canonicalMinimum viable datasetA service, not a listIntegrity of historyOpen / shared / private
![Page 37: Open Data & Government Data Programme](https://reader035.fdocuments.in/reader035/viewer/2022081414/589eb4261a28ab4a5c8b4961/html5/thumbnails/37.jpg)
GDS
![Page 38: Open Data & Government Data Programme](https://reader035.fdocuments.in/reader035/viewer/2022081414/589eb4261a28ab4a5c8b4961/html5/thumbnails/38.jpg)
GDS
Registers:Are owned by a departmentProvided as a service for others inside and outside governmentAccording to common design patterns & software
![Page 39: Open Data & Government Data Programme](https://reader035.fdocuments.in/reader035/viewer/2022081414/589eb4261a28ab4a5c8b4961/html5/thumbnails/39.jpg)
GDS
Starting with commonly referenced registers such as
CountriesCompanies (limited companies, charities, sole traders)Local authoritiesPremisesAddresses
![Page 40: Open Data & Government Data Programme](https://reader035.fdocuments.in/reader035/viewer/2022081414/589eb4261a28ab4a5c8b4961/html5/thumbnails/40.jpg)
GDS
No technology big bang required
![Page 41: Open Data & Government Data Programme](https://reader035.fdocuments.in/reader035/viewer/2022081414/589eb4261a28ab4a5c8b4961/html5/thumbnails/41.jpg)
Creating an API infrastructure across government and, where appropriate, to users outside
GDS
![Page 42: Open Data & Government Data Programme](https://reader035.fdocuments.in/reader035/viewer/2022081414/589eb4261a28ab4a5c8b4961/html5/thumbnails/42.jpg)
Reducing the need for bulk data sharing in government
GDS
![Page 43: Open Data & Government Data Programme](https://reader035.fdocuments.in/reader035/viewer/2022081414/589eb4261a28ab4a5c8b4961/html5/thumbnails/43.jpg)
So no more downloading and emailing data around Whitehall
GDS
![Page 44: Open Data & Government Data Programme](https://reader035.fdocuments.in/reader035/viewer/2022081414/589eb4261a28ab4a5c8b4961/html5/thumbnails/44.jpg)
And no more disks in the post
GDS
![Page 45: Open Data & Government Data Programme](https://reader035.fdocuments.in/reader035/viewer/2022081414/589eb4261a28ab4a5c8b4961/html5/thumbnails/45.jpg)
(but we know how important bulk availability of data is for some external users via data.gov.uk)
GDS
![Page 46: Open Data & Government Data Programme](https://reader035.fdocuments.in/reader035/viewer/2022081414/589eb4261a28ab4a5c8b4961/html5/thumbnails/46.jpg)
We’re also starting to think about better data discovery tools - both inside and outside government
GDS
![Page 47: Open Data & Government Data Programme](https://reader035.fdocuments.in/reader035/viewer/2022081414/589eb4261a28ab4a5c8b4961/html5/thumbnails/47.jpg)
GDS
![Page 48: Open Data & Government Data Programme](https://reader035.fdocuments.in/reader035/viewer/2022081414/589eb4261a28ab4a5c8b4961/html5/thumbnails/48.jpg)
There are currently no tools for civil servants to know whether non-open data exists across government
GDS
![Page 49: Open Data & Government Data Programme](https://reader035.fdocuments.in/reader035/viewer/2022081414/589eb4261a28ab4a5c8b4961/html5/thumbnails/49.jpg)
Never mind knowing whether they can or should access it
GDS
![Page 50: Open Data & Government Data Programme](https://reader035.fdocuments.in/reader035/viewer/2022081414/589eb4261a28ab4a5c8b4961/html5/thumbnails/50.jpg)
Or having tools available to help them query the data or provide basic manipulation, eg plot on a map
GDS
![Page 51: Open Data & Government Data Programme](https://reader035.fdocuments.in/reader035/viewer/2022081414/589eb4261a28ab4a5c8b4961/html5/thumbnails/51.jpg)
A discovery process on tooling will start in the new year - we will be doing user research with users inside and outside government
GDS
![Page 52: Open Data & Government Data Programme](https://reader035.fdocuments.in/reader035/viewer/2022081414/589eb4261a28ab4a5c8b4961/html5/thumbnails/52.jpg)
3. Data policy and governance
GDS
![Page 53: Open Data & Government Data Programme](https://reader035.fdocuments.in/reader035/viewer/2022081414/589eb4261a28ab4a5c8b4961/html5/thumbnails/53.jpg)
Supporting the programme through cross-dept governance:
Agree the technical approach and common policies Data access legislation?International engagement and policies
GDS
![Page 54: Open Data & Government Data Programme](https://reader035.fdocuments.in/reader035/viewer/2022081414/589eb4261a28ab4a5c8b4961/html5/thumbnails/54.jpg)
Creating shared vision & ambition and collective rules of the road
GDS
![Page 55: Open Data & Government Data Programme](https://reader035.fdocuments.in/reader035/viewer/2022081414/589eb4261a28ab4a5c8b4961/html5/thumbnails/55.jpg)
GDS
A new Ministerial Group on Digital Transformation - including data
![Page 56: Open Data & Government Data Programme](https://reader035.fdocuments.in/reader035/viewer/2022081414/589eb4261a28ab4a5c8b4961/html5/thumbnails/56.jpg)
An external Steering Group chaired by National Statistician John Pullinger
GDS
![Page 57: Open Data & Government Data Programme](https://reader035.fdocuments.in/reader035/viewer/2022081414/589eb4261a28ab4a5c8b4961/html5/thumbnails/57.jpg)
Open Data Institute keeping our feet to the fire and connected with external data users
GDS
See more on the ODI process
![Page 58: Open Data & Government Data Programme](https://reader035.fdocuments.in/reader035/viewer/2022081414/589eb4261a28ab4a5c8b4961/html5/thumbnails/58.jpg)
GDS
At the heart of the programme senior Data Leaders drawn from across government
![Page 59: Open Data & Government Data Programme](https://reader035.fdocuments.in/reader035/viewer/2022081414/589eb4261a28ab4a5c8b4961/html5/thumbnails/59.jpg)
Agreeing:Common policies (eg external sharing) Data standardsResponsibility for registersOpportunities for collaboration
And leading the new data vision across Whitehall
GDS
![Page 60: Open Data & Government Data Programme](https://reader035.fdocuments.in/reader035/viewer/2022081414/589eb4261a28ab4a5c8b4961/html5/thumbnails/60.jpg)
Possible new data access legislation?
GDS
Research and statistics●HMRC●ADRNs●ONS admin data
Tailored public services●Personal data for
defined & limited individual benefit
Fraud●Personal data for
tackling fraud (with sunset clause)
See more on the earlier open policy process with civil society at datasharing.org.uk
![Page 61: Open Data & Government Data Programme](https://reader035.fdocuments.in/reader035/viewer/2022081414/589eb4261a28ab4a5c8b4961/html5/thumbnails/61.jpg)
12345
Start with clear user need and public benefit
Use data and tools which have the minimum intrusion necessary
Create robust data science models
Be alert to public perceptions
Be as open as possible
Data science ethical framework
6 Keep data secure
GDS
![Page 62: Open Data & Government Data Programme](https://reader035.fdocuments.in/reader035/viewer/2022081414/589eb4261a28ab4a5c8b4961/html5/thumbnails/62.jpg)
And tackling the big questions
Citizen consent and control of data When and how data should/shouldn’t be shared outside government
GDS
![Page 63: Open Data & Government Data Programme](https://reader035.fdocuments.in/reader035/viewer/2022081414/589eb4261a28ab4a5c8b4961/html5/thumbnails/63.jpg)
Better use of dataOpen dataData ScienceData literacy and capability
GDS
Modernising data infrastructureData discovery toolsAPIsRegisters
Data policy and governanceCommon policies and leadershipPossible legislationInternational leadership
![Page 64: Open Data & Government Data Programme](https://reader035.fdocuments.in/reader035/viewer/2022081414/589eb4261a28ab4a5c8b4961/html5/thumbnails/64.jpg)
Paul MaltbyDirector of DataGovernment Digital Service@maltbyps