Open Data for Economic and Social Development: Why Government Should Care

58
Open Data for Economic and Social Development: Why Government Should Care Andrew Stott UK Transparency Board Senior Consultant, World Bank Istanbul 17 Sep 2014 @dirdigeng [email protected]

description

Presentation at UNDP/World Bank workshop in Istanbul 17 September 2014

Transcript of Open Data for Economic and Social Development: Why Government Should Care

Page 1: Open Data for Economic and Social Development: Why Government Should Care

Open Data for Economic and

Social Development:

Why Government Should Care

Andrew Stott

UK Transparency Board

Senior Consultant,

World Bank

Istanbul

17 Sep 2014

@dirdigeng

[email protected]

Page 2: Open Data for Economic and Social Development: Why Government Should Care

Policy Objectives of Open Data

2

New Economic and Social Value

Improved public services

More Transparent Government

More Efficient Government

Page 3: Open Data for Economic and Social Development: Why Government Should Care

Clarity about objectives

3

More Efficient Government

More Transparent Government

Improved public services

New Economic and Social Value

Page 4: Open Data for Economic and Social Development: Why Government Should Care

Policy Objectives of Open Data

4

New Economic and Social Value

Improved public services

More Transparent Government

More Efficient Government

Page 5: Open Data for Economic and Social Development: Why Government Should Care

McKinsey Global Institute

5

Page 6: Open Data for Economic and Social Development: Why Government Should Care

European Union

6

Page 7: Open Data for Economic and Social Development: Why Government Should Care

Evidence base for EU Open Data Directive

Open Gov Data in EU would

‒ increase business activity by up to €40 Bn/yr

‒ have total benefits up to €140 Bn/yr

Open Data was reused 10x-100x more than

charged-for data

Lowering charges may attract new types of re-

users, in particular SMEs.

Costs appear to increase very little: in fact, they

may eventually decrease

7

All economic analysis and case studies

point the same way

Page 8: Open Data for Economic and Social Development: Why Government Should Care

Case Study: Statistics Germany

8

Users: +1800% Downloads: +800%

Page 9: Open Data for Economic and Social Development: Why Government Should Care

Omidyar/Lateral Economics

9

Page 10: Open Data for Economic and Social Development: Why Government Should Care

What are the Open Data

Businesses

10

Page 11: Open Data for Economic and Social Development: Why Government Should Care

Aggregators

11

Page 12: Open Data for Economic and Social Development: Why Government Should Care

Developers

12

Page 13: Open Data for Economic and Social Development: Why Government Should Care

Enrichers

13

Page 14: Open Data for Economic and Social Development: Why Government Should Care

$930m business from Open Data

14

Weather for 1m

points

60 years of crop

yield data

14 TB of soil

data

Company

formed in 2006

Sold to

Monsanto

October 2013 for

$930m cash

Page 15: Open Data for Economic and Social Development: Why Government Should Care

Enablers

15

Page 16: Open Data for Economic and Social Development: Why Government Should Care

Why is this not conclusive?

16

Page 17: Open Data for Economic and Social Development: Why Government Should Care

Economic Benefits? Not our agency’s job!

17

Page 18: Open Data for Economic and Social Development: Why Government Should Care

Set new objectives for data owning agencies

18

Page 19: Open Data for Economic and Social Development: Why Government Should Care

Set new objectives for data owning agencies

19

Page 20: Open Data for Economic and Social Development: Why Government Should Care

Economic Benefits? We want some of it!

Charging economically

sub-optimal

Licensing inhibits

innovation

Hidden Costs –

marketing, payment

collection, enforcement

Barriers to entry suit

existing customers

No real pressure for

efficiency 20

Page 21: Open Data for Economic and Social Development: Why Government Should Care

Open Data would cannibalise our income

21

Page 22: Open Data for Economic and Social Development: Why Government Should Care

However Open Data can stimulate demand too

22

Page 23: Open Data for Economic and Social Development: Why Government Should Care

Data Imperialism?

23

Page 24: Open Data for Economic and Social Development: Why Government Should Care

Data Imperialism?

~80% of the benefit goes to a country’s data

end-users – citizens, businesses, visitors,

investors

~½ of the business value chain is intrinsically

local (10% of total benefit)

Therefore only 10% of total benefit is

internationally contestable

Worst case: country get 90% of the potential

benefit from their data

Best case: early-movers get to steal

neighbours’ lunch as well 24

Page 25: Open Data for Economic and Social Development: Why Government Should Care

Policy Objectives of Open Data

25

New Economic and Social Value

Improved public services

More Transparent Government

More Efficient Government

Page 26: Open Data for Economic and Social Development: Why Government Should Care

Performance of individual hospitals

26

12+ Weeks

MRSA-free

Good C-Diff

record Low

Mortality

2 recent

MRSA

Blood

clots

Patient

ratings

Page 27: Open Data for Economic and Social Development: Why Government Should Care

1000 less heart surgery deaths each year

27

Page 28: Open Data for Economic and Social Development: Why Government Should Care

Uganda: Open Data and Community Health

Monitoring

28

33% reduction in

under-5 mortality

20% extra utilisation

of out-patient

services

Significant

improvements in:

Immunization

Waiting times

Absenteeism

Page 29: Open Data for Economic and Social Development: Why Government Should Care

Police

29

Page 30: Open Data for Economic and Social Development: Why Government Should Care

Open Data used to drive Citizen Engagement

30

Local team

Telephone, website, Facebook and YouTube

….

Local police

Twitter feed

How YOU

can get

involved

It’s very local

Accessible data on crime

Attract Inform Engage Action

Page 31: Open Data for Economic and Social Development: Why Government Should Care

Why are Ministers taking blame for local

variation?

31

Page 32: Open Data for Economic and Social Development: Why Government Should Care

Push-back from professions

32 http://bma.org.uk/news-views-analysis/news/2013/june/consultants-face-online-rating

Page 33: Open Data for Economic and Social Development: Why Government Should Care

“We welcome this in principle but ….” (1)

‘Some consultants may take on higher risk

cases that would lead to raised mortality

rates’

‘Some patients could have multiple health

problems’

‘Most consultants work in teams.’

‘Patients’ experiences are obviously highly

subjective’

‘A range of factors can affect the feedback

they provide’

33

Page 34: Open Data for Economic and Social Development: Why Government Should Care

“We welcome this in principle but ….” (2)

‘Different ways of working make it harder to

gather meaningful data for patients’

‘It is critical that any information provided is

accurate and in context.’

Whereas there are ways of comparing

performance in some specialties, such as

cardiothoracic surgery, in other areas it is

much harder.

‘It will be misleading and cause unnecessary

anxiety to patients.’

34

Page 35: Open Data for Economic and Social Development: Why Government Should Care

Policy Objectives of Open Data

35

New Economic and Social Value

Improved public services

More Transparent Government

More Efficient Government

Page 36: Open Data for Economic and Social Development: Why Government Should Care

36

Page 37: Open Data for Economic and Social Development: Why Government Should Care

Politicians start to get nervous ….

37

htt

p://w

ww

.to

pte

nz.n

et/

top-1

0-c

rooke

d-a

me

rica

n-p

olit

icia

ns.p

hp

Page 38: Open Data for Economic and Social Development: Why Government Should Care

It’s hard to uncover major issues

38

Input

• 285,000 records

• 1.17m rows of

data

• PDF documents

Findings

• $34bn spent in 8

years

• Aid increased

1,965%

• 20 companies

benefited most

Page 39: Open Data for Economic and Social Development: Why Government Should Care

Transparency is about what officials do too

39

Page 40: Open Data for Economic and Social Development: Why Government Should Care

Civil Service pay and expenses

40

Page 41: Open Data for Economic and Social Development: Why Government Should Care

Holding officials to account

41

Page 42: Open Data for Economic and Social Development: Why Government Should Care

Pressure to justify and restrain costs

42

Page 43: Open Data for Economic and Social Development: Why Government Should Care

Make officials’ responsibilities clearer

43

Where the person

is in the structure

Pay Responsibilities

Contact details

Page 44: Open Data for Economic and Social Development: Why Government Should Care

International Corporate Transparency

44

Page 45: Open Data for Economic and Social Development: Why Government Should Care

Policy Objectives of Open Data

45

New Economic and Social Value

Improved public services

More Transparent Government

More Efficient Government

Page 46: Open Data for Economic and Social Development: Why Government Should Care

Government can be an Open Data user too

46

Greater Manchester estimated £6.5m

savings from finding and using its own

data more easily

Page 47: Open Data for Economic and Social Development: Why Government Should Care

EU Inspire Directive on Geospatial Data

47

One Government reported fiscal ROI 8:1

in first 4 years, plus wider benefits

Page 48: Open Data for Economic and Social Development: Why Government Should Care

British Columbia Open Data

48

Government

itself is #1

user of its

data

33% of

downloads

come from

within BC

Government

Page 49: Open Data for Economic and Social Development: Why Government Should Care

Data Quality

49

Release of data will

reveal issues of data

quality

Surprisingly little

criticism

Celebrate greater

checking of data!

Use as stimulus to

Measure

Prioritise

Improve

Page 50: Open Data for Economic and Social Development: Why Government Should Care

Citizens helping improve government data

50

Page 51: Open Data for Economic and Social Development: Why Government Should Care

Other Considerations

51

Page 52: Open Data for Economic and Social Development: Why Government Should Care

It’s not just about new data

Opening new data is hard.

So includes data previously “published” but

in non-reusable format

with restricted licence

only aimed at specialist groups

only for payment

only in response to requests

difficult to find

52

data.gov.uk contains a lot of data which

nobody knew was already published

Page 53: Open Data for Economic and Social Development: Why Government Should Care

Handling the concerns of data owners

“People hug their database, they don't want to

let it go. You have no idea the number of

excuses people come up with to hang onto

their data and not give it to you, even though

you've paid for it as a taxpayer.”

– Tim Berners-Lee

http://www.ted.com/talks/tim_berners_lee_on_the_next_web.html 53

Page 54: Open Data for Economic and Social Development: Why Government Should Care

Still everyone thought that they were an

exception

It’s held separately by n different organisations, and we can’t join it up

It will make people angry and scared without helping them

It is technically impossible

We do not own the data

The data is just too large to be published and used

Our website cannot hold files this large

We know the data is wrong

We know the data is wrong, and people will tell us where it is wrong

We know the data is wrong, and we will waste valuable resources

inputting the corrections people send us

People will draw superficial conclusions from the data without

understanding the wider picture

People will construct league tables from it

It will generate more Freedom of Information requests

It will cost too much to put it into a standard format

It will distort the market

Our IT suppliers will charge us a fortune to do an ad hoc extract

54

Page 55: Open Data for Economic and Social Development: Why Government Should Care

Handling reasons for exceptions

Most reasons are valid in some contexts

The reasons quoted are not necessarily the

real ones, just plausible-sounding ones

No-one likes to be told that they are wrong

Disproving one reason may just provoke a

different reason

No-one likes to be told that they are wrong

again and again

55

Page 56: Open Data for Economic and Social Development: Why Government Should Care

Better to work with the data owner

What are the risks?

How could they be mitigated?

How could remaining risks be managed?

Would it be less risky if

‒ Some records were removed?

‒ Some fields were removed?

Let’s focus on what can be opened

56

Page 57: Open Data for Economic and Social Development: Why Government Should Care

Thank You

57

Page 58: Open Data for Economic and Social Development: Why Government Should Care

58