Government Social Research Unit
description
Transcript of Government Social Research Unit
![Page 1: Government Social Research Unit](https://reader036.fdocuments.in/reader036/viewer/2022062520/5681596b550346895dc6ab0d/html5/thumbnails/1.jpg)
www.gsr.gov.uk
Government Social Research Unit
Impact and Insight Seminar
Overseas Development Institute
17 October 2005
Evidence-Based Policy at the Cabinet Office
Philip Davies PhDGovernment Social Research Unit
Cabinet OfficeLondon SW1A 2WH
www.gsr.gov.uk
![Page 2: Government Social Research Unit](https://reader036.fdocuments.in/reader036/viewer/2022062520/5681596b550346895dc6ab0d/html5/thumbnails/2.jpg)
www.gsr.gov.uk
Government Social Research Unit
Impact and Insight Seminar
Overseas Development Institute
17 October 2005
Making Public Policy More Evidence-Based
Philip Davies PhDGovernment Social Research Unit
Cabinet OfficeLondon SW1A 2WH
www.gsr.gov.uk
![Page 3: Government Social Research Unit](https://reader036.fdocuments.in/reader036/viewer/2022062520/5681596b550346895dc6ab0d/html5/thumbnails/3.jpg)
www.gsr.gov.uk
Outline
• Why evidence-based policy?
• Factors other the evidence
• Different types of evidence
• Some Problems
• Some solutions
![Page 4: Government Social Research Unit](https://reader036.fdocuments.in/reader036/viewer/2022062520/5681596b550346895dc6ab0d/html5/thumbnails/4.jpg)
www.gsr.gov.uk
Why Make Public Policy More Evidenced-Based?
• Effectiveness - ensure we do more good than harm
• Efficiency - use scarce public resources to maximum effect
• Service Orientation - meet citizen’s needs/expectations
• Accountability - transparency of what is done and why
• Democracy - enhance the democratic process
• Trust - help ensure/restore trust in government and public services
![Page 5: Government Social Research Unit](https://reader036.fdocuments.in/reader036/viewer/2022062520/5681596b550346895dc6ab0d/html5/thumbnails/5.jpg)
www.gsr.gov.uk
What is Evidence-Based Policy?
“Evidence-based policy helps people make well-
informed decisions about policies, programmes and
projects by putting the best available evidence from
research at the heart of policy development and
implementation”
(Davies, P.T., 1999a)
![Page 6: Government Social Research Unit](https://reader036.fdocuments.in/reader036/viewer/2022062520/5681596b550346895dc6ab0d/html5/thumbnails/6.jpg)
www.gsr.gov.uk
Factors Influencing Policy Making
Evidence
Experience & Expertise
Judgement
Resources
Values and Policy
Context
Habits & Tradition
Lobbyists & Pressure Groups
Pragmatics & Contingencies
![Page 7: Government Social Research Unit](https://reader036.fdocuments.in/reader036/viewer/2022062520/5681596b550346895dc6ab0d/html5/thumbnails/7.jpg)
www.gsr.gov.uk
Different Types of Evidence for Policy
Impact Evidence
Implementation Evidence
Descriptive Analytical Evidence
Economic and
Econometric Evidence
Ethical Evidence
ExperimentalQuasi-Experimental
Counterfactual
SurveysAdmin DataComparativeQualitative
Cost-BenefitCost-Effectiveness
Cost-UtilityEconometrics
ExperimentalQuasi-Experimental
QualitativeTheories of Change
Social EthicsPublic Consultation
Statistical Modelling
Multivariate Analysis
Attitudinal Evidence
SurveysQualitative
![Page 8: Government Social Research Unit](https://reader036.fdocuments.in/reader036/viewer/2022062520/5681596b550346895dc6ab0d/html5/thumbnails/8.jpg)
www.gsr.gov.uk
Evidence-Based Policy
Opinion-Based Policy
Evidence-Based Policy
Increasing Pressure (Time)
Adapted from: Muir Gray 1997
![Page 9: Government Social Research Unit](https://reader036.fdocuments.in/reader036/viewer/2022062520/5681596b550346895dc6ab0d/html5/thumbnails/9.jpg)
www.gsr.gov.uk
Problem 1 - Social Scientific Knowledge
• Not all research is of sufficient quality
• Uncertainty of scientific knowledge• Different status of different fields of knowledge
• Unclear objectives• Poor research design• Methodological weaknesses• Inadequate data reporting• Selective use of data• Unsupported conclusions
![Page 10: Government Social Research Unit](https://reader036.fdocuments.in/reader036/viewer/2022062520/5681596b550346895dc6ab0d/html5/thumbnails/10.jpg)
www.gsr.gov.uk
Evidence-Based Policy
Adapted from: Muir Gray 1997
Opinion-Based Policy
Increasing Pressure (Time)
Evidence-Based Policy
![Page 11: Government Social Research Unit](https://reader036.fdocuments.in/reader036/viewer/2022062520/5681596b550346895dc6ab0d/html5/thumbnails/11.jpg)
www.gsr.gov.uk
Policy Makers’
Evidence
• Colloquial (Contextual)
• Anything that seems reasonable
• Policy relevant
• Timely
• Clear Message
Researchers’ Evidence
• ‘Scientific’ (Context free)
• Proven empirically
• Theoretically driven
• As long as it takes
• Caveats and qualifications
Problem 2 - Different Notions of Evidence
![Page 12: Government Social Research Unit](https://reader036.fdocuments.in/reader036/viewer/2022062520/5681596b550346895dc6ab0d/html5/thumbnails/12.jpg)
www.gsr.gov.uk
Problem 2 – UK Policy Makers’ Types of Evidence
• Quantitative and statistical evidence
• Economic evidence
• Qualitative evidence
• Surveys and attitudinal evidence
• Consultation evidence
• Behavioural evidence
• Anecdotal evidence
• Hard and soft evidence
• International evidence• Experimental and Quasi-Experimental Evidence• Systematic review/meta-analytical evidence
XX
![Page 13: Government Social Research Unit](https://reader036.fdocuments.in/reader036/viewer/2022062520/5681596b550346895dc6ab0d/html5/thumbnails/13.jpg)
www.gsr.gov.uk
Problem 3 - Getting Research Into the Evidence Chain
Academics
Constituents, Consumers and Users
Media
Professional Associations
Lobbyists and Pressure Groups
Think Tanks/Opinion Formers
'Experts'
Special Advisers
Policy or Practice
![Page 14: Government Social Research Unit](https://reader036.fdocuments.in/reader036/viewer/2022062520/5681596b550346895dc6ab0d/html5/thumbnails/14.jpg)
www.gsr.gov.uk
Problem 4 – Uncertain Policy Logic/Theory of Change
Visit to aPrison byJuveniles
First HandExperience of
Prison Life
Exposure toPrison Life and
Prisoners asNegative Role
Models
Frightens orScares
Juveniles Awayfrom Crime
ReducesCrime andOffending
Theories of Change - A Policy Logic Model‘Scared Straight’ Programmes
Visit to aPrison byJuveniles
First HandExperience of
Prison Life
Exposure toPrison Life and
Prisoners asPositive Role
Models
Stimulates orAttracts
JuvenilesTowards Crime
IncreasesCrime andOffending
Programme Theory
Programme Evidence
![Page 15: Government Social Research Unit](https://reader036.fdocuments.in/reader036/viewer/2022062520/5681596b550346895dc6ab0d/html5/thumbnails/15.jpg)
www.gsr.gov.uk
Problem 5 – Inaccessibility of Evidence
For Policymakers Research Evidence Is Too:
• Long
• Verbose
• Detailed
• Dense
• Impenetrable
• Jargonesque
• Methodological
• Untimely
• Non-relevant/irrelevant
![Page 16: Government Social Research Unit](https://reader036.fdocuments.in/reader036/viewer/2022062520/5681596b550346895dc6ab0d/html5/thumbnails/16.jpg)
www.gsr.gov.uk
Some Solutions
• Integrate and plan research into policy strategically (CRAG)• Establish incentives to use evidence (PSG initiative)• Establish ownership of the evidence• Clarify the policy/practice issues with users ex ante• Establish users’ theory of change/logic model• Establish answerable questions• Establish the policy/practice timetable• Knowledge translation (establish key messages clearly)• Use appropriate formats for presentation (e.g. 1:3:25)• Persistence and Opportunism (Matthew Taylor, 2005)
![Page 17: Government Social Research Unit](https://reader036.fdocuments.in/reader036/viewer/2022062520/5681596b550346895dc6ab0d/html5/thumbnails/17.jpg)
www.gsr.gov.uk
[email protected] Social Research UnitCabinet OfficeAdmiralty ArchThe MallLondon SW1A 2WHEnglandTel: +44 (0)20 7276 1862Fax: +44 (0)20 7276 1450
http://www.policyhub.gov.uk