ODDC at ICTD2013 - Research methods discussion - Expert Survey and Composite Index

Post on 10-May-2015

270 views 2 download

Tags:

description

At ICTD2013 the Exploring the Emerging Impacts of Open Data in Developing Countries (ODDC) network discussed different methods for open data research. This presentation provides an overview of the Open Data Barometer methodology.

Transcript of ODDC at ICTD2013 - Research methods discussion - Expert Survey and Composite Index

Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org

The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

The Open Data Barometer

• Building on the 2012 Web Index

• Based on primary expert survey data & secondary indicator data

• A pilot methodology to provide a macro-level picture of open data policy and practice

Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org

The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

The process...

Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org

The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

The process...

Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org

The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

The process...

Literature review

Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org

The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

The process...

Literature review

Idea storm

Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org

The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

The process...

Literature review

Review of qualitative cases

Idea storm

Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org

The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

The process...

Literature review

Review of qualitative cases

Idea storm

Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org

The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

The process...

Context & impact themes

Literature review

Review of qualitative cases

Idea storm

Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org

The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

The process...

Context & impact themes

Supply side questions

Literature review

Review of qualitative cases

Idea storm

Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org

The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

The process...

Context & impact themes

Supply side questions

Literature review

Review of qualitative cases

Idea storm

Secondary datashortlist

Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org

The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

The process...

Context & impact themes

Supply side questions

Literature review

Review of qualitative cases

Idea storm

Expert survey

Secondary datashortlist

Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org

The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

The process...

Expert survey

Recruit researchers

Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org

The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

The process...

Expert survey

Recruit researchers

Research handbook

Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org

The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

The process...

Expert survey

Recruit researchers

Research handbook

Onlinetraining

Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org

The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

The process...

Expert survey

Recruit researchers

Research handbook

Onlinetraining

Initialresearch

Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org

The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

The process...

Expert survey

Recruit researchers

Research handbook

Onlinetraining

Initialresearch

Spotcheck

Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org

The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

The process...

Expert survey

Recruit researchers

Research handbook

Onlinetraining

Initialresearch

Spotcheck

Clarifications

Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org

The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

The process...

Expert survey

Recruit researchers

Research handbook

Onlinetraining

Initialresearch

Spotcheck

ClarificationsDouble-blindpeer-review

Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org

The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

The process...

Expert survey

Recruit researchers

Research handbook

Onlinetraining

Initialresearch

Spotcheck

ClarificationsDouble-blindpeer-review

Furtherclarification

Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org

The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

The process...

Expert survey

Recruit researchers

Research handbook

Onlinetraining

Initialresearch

Spotcheck

ClarificationsDouble-blindpeer-review

Furtherclarification

Technicalreview

Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org

The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

The process...

Expert survey

Recruit researchers

Research handbook

Onlinetraining

Initialresearch

Spotcheck

ClarificationsDouble-blindpeer-review

Furtherclarification

Cross-checking& calibration

Technicalreview

Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org

The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

The process...

Expert survey

Recruit researchers

Research handbook

Onlinetraining

Initialresearch

Spotcheck

ClarificationsDouble-blindpeer-review

Furtherclarification

Cross-checking& calibration

Export dataTechnicalreview

Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org

The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

Question structure...

Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org

The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

Question structure...

Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org

The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

Dataset assessment...

Ten point checklista - Does the data exist?

b - Is it available online from government in any form?

c - Is the dataset provided in machine-readable formats?

d - Is the machine-readable data available in bulk?

e - Is the dataset available free of charge?

f - Is the data openly licensed?

g - Is the dataset up to date?

h - Is the publication of the dataset sustainable?

i - Was it easy to find information about this dataset?

j - Are (linked) data URIs provided for key elements of the data?

Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org

The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

Dataset assessment...

Ten point checklista - Does the data exist?

b - Is it available online from government in any form?

c - Is the dataset provided in machine-readable formats?

d - Is the machine-readable data available in bulk?

e - Is the dataset available free of charge?

f - Is the data openly licensed?

g - Is the dataset up to date?

h - Is the publication of the dataset sustainable?

i - Was it easy to find information about this dataset?

j - Are (linked) data URIs provided for key elements of the data?Detailed justification data

Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org

The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

Dataset assessment...

Ten point checklista - Does the data exist?

b - Is it available online from government in any form?

c - Is the dataset provided in machine-readable formats?

d - Is the machine-readable data available in bulk?

e - Is the dataset available free of charge?

f - Is the data openly licensed?

g - Is the dataset up to date?

h - Is the publication of the dataset sustainable?

i - Was it easy to find information about this dataset?

j - Are (linked) data URIs provided for key elements of the data?Detailed justification data

Category definitions and guidance

Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org

The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

Datasets assessed...

D1: Map data (full map coverage of the country)D2: Land ownership data(D3: Government service directory)D4: Detailed census dataD5: Detailed government budgetD6: Detailed data on government spendD7: Company registerD8: LegislationD9: Public transport timetablesD10: International trade dataD11: Health sector performanceD12: Primary or secondary education performance dataD13: Crime statisticsD14: National environment statisticsD15: National election results

Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org

The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

Tools...

Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org

The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

Tools...

Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org

The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

Analysis...

Z-score normalization

Creation of sub-components (unweighted mean)

Creation of sub-indices(unweighted mean)

Creating of overall ranking

Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org

The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

The result...

Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org

The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

The result...

Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org

The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

The result...

Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org

The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

The result...

Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org

The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

The result...

Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org

The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

Results...

Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org

The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

Results...

Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org

The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

Next steps...

• Improving questions, definitions and datasets selected;

• Iterative development of the data collection methodology;

• Checking relevance of created data for policy influence, and supporting in-depth local research;

www.opendatabarometer.org | @timdavies

Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org

The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).

Questions?

www.opendatabarometer.org

Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org

The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).