Model of open data in the Generalitat of Catalonia

57
This work is subject to a Creative Commons Attribution License 3.0. Reproduction, distribution, public communication and transformation is permitted in order to generate a derived work, without any restriction provided that the authors are quoted and it does not contradict the specific license held by a photo, which shall prevail. The full license can be found on http://creativecommons.org/licenses/by/3.0/es/legalcode.ca Model of open data in the Generalitat of Catalonia slideshare.net/gencat General Directorate for Citizen Services and Publicity Barcelona, November 2012

Transcript of Model of open data in the Generalitat of Catalonia

Page 1: Model of open data in the Generalitat of Catalonia

This work is subject to a Creative Commons Attribution License 3.0. Reproduction, distribution, public communication and transformation is permitted in order to generate a derived work, without any restriction provided that the authors are quoted and it does not contradict the specific license held by a photo, which

shall prevail. The full license can be found on http://creativecommons.org/licenses/by/3.0/es/legalcode.ca

Model of open data in the Generalitat of Catalonia

slideshare.net/gencat

General Directorate for Citizen Services and Publicity

Barcelona, November 2012

Page 2: Model of open data in the Generalitat of Catalonia

2Dades obertes. Direcció General d’Atenció Ciutadana i Difusió. Juliol de 2012 CC – BY 3.0

Why open public data?

Page 3: Model of open data in the Generalitat of Catalonia

3Dades obertes. Direcció General d’Atenció Ciutadana i Difusió. Juliol de 2012 CC – BY 3.0

Open government oGov What is it?

Memorandum Open Government USA

- Transparency

- Participation

- Collaboration

25.07.2001 European Governance – White paper EU

- Openness

- Participation

- Clarity and accountability

- Efficiency

- Coherence

Other concepts

- Communicate

- Listen

- Answer

- Innovate

* Bason: Domingo Laborda. A Club de la Innovación. Madrid, Proyecto Aporta. June 2011

Related concepts

- Open data (RPSI)

- Interoperability

Page 4: Model of open data in the Generalitat of Catalonia

4Dades obertes. Direcció General d’Atenció Ciutadana i Difusió. Juliol de 2012 CC – BY 3.0

Data of the Administration

In Europe, according to the EU:

1. 40,000 M€ / year approx.

2. Up to 140,000 M€ of direct impact.

* Graham Vickery report 'REVIEW OF RECENT STUDIES

ON PSI RE-USE AND RELATED MARKET DEVELOPMENTS', commissioned by the European Commission 2011http://ec.europa.eu/information_society/policy/psi/docs/pdfs/report/psi_final_version_formatted.docx

In Spain, activity in the infomediary sector*:

1. A business volume of 330-550 M€ is forecast.

2. There is a group of 150 companies that generate applications, products and services with value destined to third parties, using public sector information. 30% have clients in the EU and 25% outside.

3. Creates employment for approximately 3,600-4,400 workers

* According to the study ‘Caracterización del sector infomediario en España’. Dabos.gob.es. June

2012.

Page 5: Model of open data in the Generalitat of Catalonia

5Dades obertes. Direcció General d’Atenció Ciutadana i Difusió. Juliol de 2012 CC – BY 3.0

Scope of activity re-use companies

- Business / Economic 37.6%

- Geographic / Cartographic 30.5%

- Law / Legal 17 %

- Transport 5.2 %

- Socio-demographic / Statistic 1.9 %

- Meteorological 1.1 %

- Others : IT... 6.7 %

Page 6: Model of open data in the Generalitat of Catalonia

6Dades obertes. Direcció General d’Atenció Ciutadana i Difusió. Juliol de 2012 CC – BY 3.0

Geographical

Demographics / Statistics

Business / Economy

Meteorological / Environment

Transport

Natural resources

Agriculture, livestock and fishing

Tourism and leisure

Law / Legal

Science and research

Cultural

Politics

Education

Com

mer

cial

use

Graham Vickery report: 'REVIEW OF RECENT STUDIES ON PSI RE-USE AND RELATED MARKET DEVELOPMENTS', commissioned by the European Commission 2011http://ec.europa.eu/information_society/policy/psi/docs/pdfs/report/psi_final_version_formatted.docx

Commercial use of the dataInformation type

Page 7: Model of open data in the Generalitat of Catalonia

7Dades obertes. Direcció General d’Atenció Ciutadana i Difusió. Juliol de 2012 CC – BY 3.0

Commercial use of the dataInformation type

Page 8: Model of open data in the Generalitat of Catalonia

8Dades obertes. Direcció General d’Atenció Ciutadana i Difusió. Juliol de 2012 CC – BY 3.0

Geography

Cartography

Land

Commercial use of the dataBasic datasets

Meteorology

Meteorological data

Business

Production, employment and unemployment indicators

Census of economic activities

Bids

Grants and subsidies

Job offers

Facilities

Work calendar

Demographics

Transport

Status of public transport

Status of traffic

Tourism / leisure

Facilities

Cultural agenda

Tourist accommodation

Tourist routes

Page 9: Model of open data in the Generalitat of Catalonia

9Dades obertes. Direcció General d’Atenció Ciutadana i Difusió. Juliol de 2012 CC – BY 3.0

Geography

Cartography

Land

Commercial use of the data

Meteorology

Meteorological data

Business

Production, employment and unemployment indicators

Census of economic activities

Bids

Grants and subsidies

Job offers

Facilities

Work calendar

Demographics

Transport

Status of public transport

Status of traffic

Tourism / leisure

Facilities

Cultural agenda

Tourist accommodation

Tourist routes

Basic datasets

Page 10: Model of open data in the Generalitat of Catalonia

10Dades obertes. Direcció General d’Atenció Ciutadana i Difusió. Juliol de 2012 CC – BY 3.0

Legal model in open data – RPSI of the

Generalitat of Catalonia

Page 11: Model of open data in the Generalitat of Catalonia

11Dades obertes. Direcció General d’Atenció Ciutadana i Difusió. Juliol de 2012 CC – BY 3.0

Law 37/2007, of 16th November, on re-use of public sector information (RPSI), transposed by the Directive 2003/98/CE of the European Parliament and Council on RPSI

Proposal of directive of the European Parliament and Council in which the Directive 2003/98/CE relating to RPSI is modified

Royal decree 1495/2011, of 24th October, which states Law 37/2007, of 16th November on RPSI, for the state public sector

Government agreement of 31st July 2012 on the promotion of open data by the Generalitat of Catalonia with regards economic activity

Government agreement of 9th November 2010 on the launch of the public data project by the Generalitat

The government agreements of 31.07.2012 and 9.11.2010 apply the precepts of the European directive 2003/98/CE in the scope of the Generalitat of Catalonia but not to local Catalan administrations. Possibilities of applying the new Directive directly.

Aim and scope of application

Page 12: Model of open data in the Generalitat of Catalonia

12Dades obertes. Direcció General d’Atenció Ciutadana i Difusió. Juliol de 2012 CC – BY 3.0

Re-usable content made available by electronic means: from a single point (portal), that must also be linked from the electronic headquarters, with a catalogue containing the re-usable public information and headed and maintained by the General Directorate for Citizen Services and Publicity (DGACD. Presidential Department), according to the Government Agreement of 31.07.2012 on the promotion of open data by the Generalitat of Catalonia with regards to economic activity.

Legal system of RPSI

Page 13: Model of open data in the Generalitat of Catalonia

13Dades obertes. Direcció General d’Atenció Ciutadana i Difusió. Juliol de 2012 CC – BY 3.0

According to the Government Agreement of 31.07.2012 on the promotion of open data with regards to economic activity, it lies with the DGACD, as governing body of the process to:

1. Write up an inventory of the public data of the Generalitat and its public sector that is available to be opened up.

2. Write up a calendar of data of the departments to be opened up, giving priority to those that provide more opportunities for entrepreneurs.

3. Collaborate with other administrations to encourage RPSI projects.

4. Write up a guide to open data and RPSI in the Generalitat.

5. Promote mechanisms to detect demand for RPSI data.

6. Manage and maintain the Open data portal of the Generalitat.

7. Organize working sessions to develop new functionalities and applications, collaborating with other bodies, professional associations, chambers of commerce and entities related to RPSI.

RPSI responsibilities Generalitat 1/2

Page 14: Model of open data in the Generalitat of Catalonia

14Dades obertes. Direcció General d’Atenció Ciutadana i Difusió. Juliol de 2012 CC – BY 3.0

The Generalitat of Catalonia Ministries must:

1. Communicate to the DGACD the data available to be opened up and also the activities carried out in the scope of RPSI.

2. Write up RPSI departmental plans that give details on the documents and public data available to be offered on the Open data portal of the Generalitat.

3. Foresee, at the start of the procedure, that the formats and the availability of the data facilitate the later extraction, processing, opening

and interoperability.

RPSI responsibilities Generalitat 2/2

Page 15: Model of open data in the Generalitat of Catalonia

15Dades obertes. Direcció General d’Atenció Ciutadana i Difusió. Juliol de 2012 CC – BY 3.0

1. RPSI subject to general conditions: legal notice with terms and conditions established in article 8 of Law 37/2007 (mention of source, non-alteration or distortion of information and specification of date of last update). Including general data as well as documents with intellectual copyright (IC) or industrial copyright.

RPSI with prior application because the documents require this (reasoned cases, documents on paper format and not in digital format...).

2. RPSI subject to specific conditions additional to the general conditions, because the general conditions are not sufficient. E.g. The material that is

published in Creative Commons licenses (CC) or the maps from the Institut

Cartogràfic de Catalunya (ICC).

In the case of the use of CC licenses, the RPSI of works and documents must be made with non-exclusive disclosure of the corresponding IC. When the IC or industrial copyright on documents or works are from third parties, RPSI can only be authorized if the disclosure precept from the holders of the copyright is available.

Modes of RPSI

Page 16: Model of open data in the Generalitat of Catalonia

16Dades obertes. Direcció General d’Atenció Ciutadana i Difusió. Juliol de 2012 CC – BY 3.0

The Administration permits the re-use of its contents and data without any type of restriction beyond the basic conditions established in article 8 of Law 37/2007 (mention of source, non-alteration or distortion of information and specification of date of last update), and provided that this does not contradict the license or notice that a work may hold and which shall prevail.

Authorization implies non-exclusive disclosure of the intellectual copyright when it applies, in all formats – graphic, sound and image – and in any of the following modes for all publics and without time restrictions.

Legal notice on RPSI at gencat

Page 17: Model of open data in the Generalitat of Catalonia

17Dades obertes. Direcció General d’Atenció Ciutadana i Difusió. Juliol de 2012 CC – BY 3.0

With RPSI, it is important to take great care with personal data protection; and establish limits.

Likewise, when technical and economic means permit, personal data can be disassociated from a document to make it available for RPSI.

Documents with personal data

Page 18: Model of open data in the Generalitat of Catalonia

18Dades obertes. Direcció General d’Atenció Ciutadana i Difusió. Juliol de 2012 CC – BY 3.0

Conceptual model in open data– RPSI of the Generalitat of Catalonia

Page 19: Model of open data in the Generalitat of Catalonia

19Dades obertes. Direcció General d’Atenció Ciutadana i Difusió. Juliol de 2012 CC – BY 3.0

http://dadesobertes.gencat.cat

Open data website Generalitat

Page 20: Model of open data in the Generalitat of Catalonia

20Dades obertes. Direcció General d’Atenció Ciutadana i Difusió. Juliol de 2012 CC – BY 3.0

As we have seen, the Generalitat of Catalonia follows its own model for open data:

1. Data that is useful for companies and citizens: which generates value for companies, which encourages citizen participation and participation from other public players and finally, data which complements that of other administrations (real or effective interoperability).

2. By opening up all types of data, companies develop their own business applications (computer applications; publications; models of data based on publicity, subscription, certification, transformation...) and also multimedia resources, even though these may be subject to intellectual copyright (e.g. The 200 photos opened up for Sant Jordi in 2011 or the over 400 in 2012).

Open data model Generalitat

Page 21: Model of open data in the Generalitat of Catalonia

21Dades obertes. Direcció General d’Atenció Ciutadana i Difusió. Juliol de 2012 CC – BY 3.0

Enterprise and Employment: work calendar, employment offers...

Territory and Sustainability: MUC (urban planning), cartography ICC..

Agriculture: SIGPAC (use of agricultural land)...

Governance: elections, Catalan public functions...

Culture: agenda, heritage...

Interior: traffic...

Health: Diagnosis, CIM...

Etc.

Collaborating with the Ministries of the Generalitat

Page 22: Model of open data in the Generalitat of Catalonia

22Dades obertes. Direcció General d’Atenció Ciutadana i Difusió. Juliol de 2012 CC – BY 3.0

On networks Catalunya Data

Page 23: Model of open data in the Generalitat of Catalonia

23Dades obertes. Direcció General d’Atenció Ciutadana i Difusió. Juliol de 2012 CC – BY 3.0

Participating With other entities to award economic grants

Page 24: Model of open data in the Generalitat of Catalonia

24Dades obertes. Direcció General d’Atenció Ciutadana i Difusió. Juliol de 2012 CC – BY 3.0

Examples in opendata – RPSI of the

Generalitat of Catalonia

Page 25: Model of open data in the Generalitat of Catalonia

25Dades obertes. Direcció General d’Atenció Ciutadana i Difusió. Juliol de 2012 CC – BY 3.0

1. Communicating rationally and creating a presence in society with a difference

Page 26: Model of open data in the Generalitat of Catalonia

26Dades obertes. Direcció General d’Atenció Ciutadana i Difusió. Juliol de 2012 CC – BY 3.0

The media and data

Page 27: Model of open data in the Generalitat of Catalonia

27Dades obertes. Direcció General d’Atenció Ciutadana i Difusió. Juliol de 2012 CC – BY 3.0

2. Making administrations interoperable

Page 28: Model of open data in the Generalitat of Catalonia

28Dades obertes. Direcció General d’Atenció Ciutadana i Difusió. Juliol de 2012 CC – BY 3.0

Interoperability Open Agenda

Company Pimpampum

Description Agenda of activities in Catalan-speaking regions

Dataset Cultural agenda of Catalonia. Winner of the puntCAT 2011 grants

ober

ta.c

at

Page 29: Model of open data in the Generalitat of Catalonia

29Dades obertes. Direcció General d’Atenció Ciutadana i Difusió. Juliol de 2012 CC – BY 3.0

3. Providing services from social networks

Page 30: Model of open data in the Generalitat of Catalonia

30Dades obertes. Direcció General d’Atenció Ciutadana i Difusió. Juliol de 2012 CC – BY 3.0

Providing services from social networks Twitter Feina Activa

Description23 Twitter profiles on job offers by categories

DatasetJob offers from Servei d’Ocupació de Catalunya

Increase of 800% in access to the website Feina Activa from Twitter

Page 31: Model of open data in the Generalitat of Catalonia

31Dades obertes. Direcció General d’Atenció Ciutadana i Difusió. Juliol de 2012 CC – BY 3.0

Description14 Twitter profiles with the status of the service on the railway Rodalies de Catalunya

DatasetStatus of service of Rodalies de Catalunya

Providing services from social networks Twitter Rodalies

Page 32: Model of open data in the Generalitat of Catalonia

32Dades obertes. Direcció General d’Atenció Ciutadana i Difusió. Juliol de 2012 CC – BY 3.0

Company Pimpampum

Description Information on the status of the service of Rodalies provided by Twitter users

DatasetStatus of service of Rodalies de Catalunya

Providing services from social networks Rodalia.info

Page 33: Model of open data in the Generalitat of Catalonia

33Dades obertes. Direcció General d’Atenció Ciutadana i Difusió. Juliol de 2012 CC – BY 3.0

4. Developing mobile applications

Page 34: Model of open data in the Generalitat of Catalonia

34Dades obertes. Direcció General d’Atenció Ciutadana i Difusió. Juliol de 2012 CC – BY 3.0

Mobile services CAT Facilities

Company gynoidApps

DescriptionView of the facilities of Catalonia in augmented reality. For various mobile phone platforms.

DatasetCatalonia Facilities.

Page 35: Model of open data in the Generalitat of Catalonia

35Dades obertes. Direcció General d’Atenció Ciutadana i Difusió. Juliol de 2012 CC – BY 3.0

Mobile services The Weather

CompanyLujop

Description3-day weather forecast, rain radar and information on temperatures, wind and rainfall. For Android.

DatasetForecast from Servei Meteorològic de Catalunya

Page 36: Model of open data in the Generalitat of Catalonia

36Dades obertes. Direcció General d’Atenció Ciutadana i Difusió. Juliol de 2012 CC – BY 3.0

CompanyRepilpa

DescriptionTraffic alerts in Catalonia in real time, based on information from Servei Català del Trànsit. For Android.

Dataset

Information from Servei Català de Trànsit

Mobile services Traffic

Page 37: Model of open data in the Generalitat of Catalonia

37Dades obertes. Direcció General d’Atenció Ciutadana i Difusió. Juliol de 2012 CC – BY 3.0

CompanyAmidasoft

DescriptionHotels, rural holiday establishments and camp sites in Catalonia, with information on their services, prices, opening seasons, location… For Android.

DatasetTourist accommodation in Catalonia

Mobile services Tourist accommodation

Page 38: Model of open data in the Generalitat of Catalonia

38Dades obertes. Direcció General d’Atenció Ciutadana i Difusió. Juliol de 2012 CC – BY 3.0

5. Raising awareness and facilitating the creation of all types of services and

products, not only technological applications

Page 39: Model of open data in the Generalitat of Catalonia

39Dades obertes. Direcció General d’Atenció Ciutadana i Difusió. Juliol de 2012 CC – BY 3.0

Copyright Open data

gencat.cat/santjordi

Page 40: Model of open data in the Generalitat of Catalonia

40Dades obertes. Direcció General d’Atenció Ciutadana i Difusió. Juliol de 2012 CC – BY 3.0

Publications All CC licenses

Publishing regulations of the Generalitat (2009): All paper or digital publications of the Generalitat with open dissemination licenses (Creative Commons BY-NC-ND or any other).

http

://b

it.ly

/fIE

Xla

Page 41: Model of open data in the Generalitat of Catalonia

41Dades obertes. Direcció General d’Atenció Ciutadana i Difusió. Juliol de 2012 CC – BY 3.0

Guide to Basque Government networks Re-use

>Cinquena edició:

Febrer 2012

>Quinta edición:febrero 2012

Page 42: Model of open data in the Generalitat of Catalonia

42Dades obertes. Direcció General d’Atenció Ciutadana i Difusió. Juliol de 2012 CC – BY 3.0

6. Generating economic activity and encouraging transparency

Page 43: Model of open data in the Generalitat of Catalonia

43Dades obertes. Direcció General d’Atenció Ciutadana i Difusió. Juliol de 2012 CC – BY 3.0

Map services eixos.cat

Companyplanol.info

DescriptionMaps of activity, services and facilities for locating businesses and others

DatasetFacilities of Catalonia

Winner of puntCAT 2011 Grants

Page 44: Model of open data in the Generalitat of Catalonia

44Dades obertes. Direcció General d’Atenció Ciutadana i Difusió. Juliol de 2012 CC – BY 3.0

open

spen

ding

.org

Financial transactions governments

Page 45: Model of open data in the Generalitat of Catalonia

45Dades obertes. Direcció General d’Atenció Ciutadana i Difusió. Juliol de 2012 CC – BY 3.0

[...]

open

spen

ding

.org

Page 46: Model of open data in the Generalitat of Catalonia

46Dades obertes. Direcció General d’Atenció Ciutadana i Difusió. Juliol de 2012 CC – BY 3.0

IBM Many Bills: view of the website of the USA Congress (and Senate) legislative bills according to data from the Congress Library and from Govtrack.us (to follow the representatives and the legislation and see how this affects citizens).

manybills.researchlabs.ibm.com

Why open data in Catalonia? General Directorate for Citizen Services and Publicity. 2012 CC – BY 3.0

View USA Congress laws

Page 47: Model of open data in the Generalitat of Catalonia

47Dades obertes. Direcció General d’Atenció Ciutadana i Difusió. Juliol de 2012 CC – BY 3.0

MEPRanking is a website that gives weekly updates on the parliamentary activity of the Members of the European Parliament. Created by Miquel Català, who applied to do the same for MPs in the Catalonia Parliament.

mep

rank

ing.

eu

Why open data in Catalonia. General Directorate for Citizen Services and Publicity. 2012 CC – BY 3.0

Control activity europarlamentarians

Page 48: Model of open data in the Generalitat of Catalonia

48Dades obertes. Direcció General d’Atenció Ciutadana i Difusió. Juliol de 2012 CC – BY 3.0

Technological model of open data – RPSI of the Generalitat of Catalonia

Page 49: Model of open data in the Generalitat of Catalonia

49Dades obertes. Direcció General d’Atenció Ciutadana i Difusió. Juliol de 2012 CC – BY 3.0

Technological platform

Bodi

es

Bodi

es

Databases Portals

Standardization and transformation

Web services Files

open data gencat

open services gencat

Citizens

Companies and administrations

Web

Mobile phones

Social networks

Management tool

dadesobertes.gencat.cat

Page 50: Model of open data in the Generalitat of Catalonia

50Dades obertes. Direcció General d’Atenció Ciutadana i Difusió. Juliol de 2012 CC – BY 3.0

Management toolManagement tool

Page 51: Model of open data in the Generalitat of Catalonia

51Dades obertes. Direcció General d’Atenció Ciutadana i Difusió. Juliol de 2012 CC – BY 3.0

dadesobertes.gencat.cat

Page 52: Model of open data in the Generalitat of Catalonia

52Dades obertes. Direcció General d’Atenció Ciutadana i Difusió. Juliol de 2012 CC – BY 3.0

Proprietary formatsFree formats

These are files published on Internet in diverse formats, containing unprocessed information on the data to be disseminated.

Example: Files on the facilities in Catalonia in RDF format.

Complex data RDF </> XML { } JSON

News data RSS

Simple data x,y CSV XLS

Geographical data KML SHP

Files

open data gencat

Page 53: Model of open data in the Generalitat of Catalonia

53Dades obertes. Direcció General d’Atenció Ciutadana i Difusió. Juliol de 2012 CC – BY 3.0

These are services that provide programmatic access to the open data using APIs. This way, any programme component (websites, mobile phone applications, widgets, etc.) can make dynamic queries on the data.

Example: A web service that gives facilities located within a 5 km radius from a geographical point.

Web services

open services gencat

Page 54: Model of open data in the Generalitat of Catalonia

54Dades obertes. Direcció General d’Atenció Ciutadana i Difusió. Juliol de 2012 CC – BY 3.0

Platform evolution

Companies and administrationsOpen data gencat

Corporate data

Open services gencatApplications

Data explorer

CitizensData search

Open data gencat

Open services gencat

Data explorer

Data search

Page 55: Model of open data in the Generalitat of Catalonia

55Dades obertes. Direcció General d’Atenció Ciutadana i Difusió. Juliol de 2012 CC – BY 3.0

Data search toolA single tool allows citizens to search different kinds of information

Page 56: Model of open data in the Generalitat of Catalonia

56Dades obertes. Direcció General d’Atenció Ciutadana i Difusió. Juliol de 2012 CC – BY 3.0

Data explorer toolA single tool allows companies to explore different kinds of information

Page 57: Model of open data in the Generalitat of Catalonia

This work is subject to a Creative Commons Attribution License 3.0. Reproduction, distribution, public communication and transformation is permitted in order to generate a derived work, without any restriction provided that the authors are quoted and it does not contradict the specific license held by a photo, which

shall prevail. The full license can be found on http://creativecommons.org/licenses/by/3.0/es/legalcode.ca.

Open data model of the Generalitat of Catalonia

Thanks!

slideshare.net/gencat

General Directorate for Citizen Services and Publicity

Barcelona, November 2012