The Public Impact Fundamentals · PDF fileELEMENT Stakeholder engagement Possible sources...

20
The Public Impact Fundamentals Self-assessment tool

Transcript of The Public Impact Fundamentals · PDF fileELEMENT Stakeholder engagement Possible sources...

Page 1: The Public Impact Fundamentals · PDF fileELEMENT Stakeholder engagement Possible sources Conduct an assessment 1. ... The Public Impact Fundamentals Self-assessment tool 18 2

The Public Impact FundamentalsSelf-assessment tool

Page 2: The Public Impact Fundamentals · PDF fileELEMENT Stakeholder engagement Possible sources Conduct an assessment 1. ... The Public Impact Fundamentals Self-assessment tool 18 2

The Public Impact Fundamentals Self-assessment tool 2

ContentsIntroduction & methodology................................03

Self-assessment tool............................................05

Conduct an assessment.............................06

Identify areas for action..............................16

Design an action plan.................................18

Page 3: The Public Impact Fundamentals · PDF fileELEMENT Stakeholder engagement Possible sources Conduct an assessment 1. ... The Public Impact Fundamentals Self-assessment tool 18 2

The Public Impact Fundamentals Self-assessment tool 3

Introduction & methodology

Page 4: The Public Impact Fundamentals · PDF fileELEMENT Stakeholder engagement Possible sources Conduct an assessment 1. ... The Public Impact Fundamentals Self-assessment tool 18 2

The Public Impact Fundamentals Self-assessment tool 4

The Public Impact Fundamentals

What are the Public Impact Fundamentals:

The Public Impact Fundamentals are a framework for thinking about the elements that most influence the impact of government initiatives.

There are three Fundamentals:

• Legitimacy: Underlying support for an objective and the attempts to achieve it

• Policy: Quality of policies intended to achieve impact

• Action: Translation of policies into real-world effect which collectively contribute to its performance:

The framework

LEGITIMACY Public confidenceStakeholder engagementPolitical commitment

POLICY Clear objectivesEvidence Feasibility

ACTION Management MeasurementAlignment

Page 5: The Public Impact Fundamentals · PDF fileELEMENT Stakeholder engagement Possible sources Conduct an assessment 1. ... The Public Impact Fundamentals Self-assessment tool 18 2

The Public Impact Fundamentals Self-assessment tool 5

Background

Self-assessment is based on three core parts of the Centre for Public Impact (CPI) proprietary research:

• Fundamentals of Public Impact - a framework for thinking about the elements that most influence the impact of government initiatives

• Fundamentals rubric - the standard way used by CPI researchers to assess policy case studies on the nine elements of the Fundamentals

• Observatory of case studies - a collection of 250+ case studies assessed using the Fundamentals rubric

From these, we are able to assess how impactful an initiative will be, based on how well it ranks against the Fundamentals.

Objectives

The objective of this qualitative assessment is to evaluate whether the key elements that typically lead to impactful policies are in place in the chosen initiative and guide the reader to improve its weaknesses and maintain its strengths.

How does it work

Pick one initiative that is currently being consideed for implementation or is one that is under implementation / has been implemented.

Over the next few pages, we will guide you through the assessment in three steps, as illustrated below. They will help you to identify key strengths and weaknesses, as well as target interventions to improve performance along a subset of the elements, maximising the chances of the initiative achieving public impact.

Design an action plan 4

Identify areas for action

Conduct an assessment 1

2

3

Self-assessment tool

Page 6: The Public Impact Fundamentals · PDF fileELEMENT Stakeholder engagement Possible sources Conduct an assessment 1. ... The Public Impact Fundamentals Self-assessment tool 18 2

The Public Impact Fundamentals Self-assessment tool 6

Legitimacy - Support for an objective and attempts to achieve it

Your assessment

Public confidenceELEMENT

Reasoning (optional)

WEAK FAIR GOOD STRONGSignificant public distrust in the institutions involved

Public neither strongly trust nor distrust institutions involved

Public broadly trust the institutions involved

Strong public trust in the institutions involved

Using the support information, please draw a circle around the option that best describes how the initiative performs on this specific element

Support information

Definition

The extent to which the general public trusts the institutions involved to act competently and in support of the wider public interest in the execution of this objective

Supporting questions

Is there public confidence in:• Overall outcome pursued?• Institutions responsible for delivering outcome?• Specific initiatives carried out to acheived outcome?

• Elections • Opinion polls • Surveys

? Possible sources

Conduct an assessment 1

Page 7: The Public Impact Fundamentals · PDF fileELEMENT Stakeholder engagement Possible sources Conduct an assessment 1. ... The Public Impact Fundamentals Self-assessment tool 18 2

The Public Impact Fundamentals Self-assessment tool 7

Legitimacy - Support for an objective and attempts to achieve it

Your assessment

Reasoning (optional)

WEAK FAIR GOOD STRONGMajority of stakeholders are opposed

Tentative support from some stakeholders

Solid support from majority of stakeholders

Strong support from key stakeholders

Using the support information, please draw a circle around the option that best describes how the initiative performs on this specific element

Support information

Definition

The degree to which relevant stakeholder groups are supportive of the objective and the approach

Supporting questions

• Is there evidence of internal and external stakeholder support?• Are interests of the internal and external stakeholders aligned to support the policy?• Is there evidence of stakeholder engagement in the policy-design process?

• Elections • Opinion polls • Surveys

?

Stakeholder engagementELEMENT

Possible sources

Conduct an assessment 1

Page 8: The Public Impact Fundamentals · PDF fileELEMENT Stakeholder engagement Possible sources Conduct an assessment 1. ... The Public Impact Fundamentals Self-assessment tool 18 2

The Public Impact Fundamentals Self-assessment tool 8

Legitimacy - Underlying support for objective and attempts to achieve it

Your assessment

Reasoning (optional)

WEAK FAIR GOOD STRONGImportant political actors are actively opposed

Tentative support from some political actors

Solid support from majority of political actors

Strong support across the political spectrum

Using the information below, please draw a circle around the option that best describes how the initiative performs on this specific element

Support information

Definition

Willingness of politicians and other leaders to spend political capital in support of this objective

Supporting questions

• Is this a political priority for the political leadership?• Where is active opposition coming from?

• Speeches from politicians• Party manifestos• Opinion from political actors in newspapers

?

Political commitmentELEMENT

Possible sources

Conduct an assessment 1

Page 9: The Public Impact Fundamentals · PDF fileELEMENT Stakeholder engagement Possible sources Conduct an assessment 1. ... The Public Impact Fundamentals Self-assessment tool 18 2

The Public Impact Fundamentals Self-assessment tool 9

Policy - Quality of policies intended to achieve impact

Your assessment

Reasoning (optional)

WEAK FAIR GOOD STRONGNo objectives stated Objectives stated at outset

but weakened over time Objectives stated at outset and clarified over time

Objectives defined at the outset and maintained throughout

Using the information below,, please draw a circle around the option that best describes how the initiative performs on this specific element

Support information

Definition

The extent to which the public impact objectives have been stated at the outset and maintained throughout the period being considered

Supporting questions

• Does the policy state specific and measurable outcome objectives?• Do the outcome objectives address the relevant issues?• Were the objectives maintained over time?

• Organisation publications• Initiative blueprint• Initiative implementation plan• Articles/case studies/reports on initiative

?

Clear objectivesELEMENT

Possible sources

Conduct an assessment 1

Page 10: The Public Impact Fundamentals · PDF fileELEMENT Stakeholder engagement Possible sources Conduct an assessment 1. ... The Public Impact Fundamentals Self-assessment tool 18 2

The Public Impact Fundamentals Self-assessment tool 10

Policy - Quality of policies intended to achieve impact

Your assessment

Reasoning (optional)

WEAK FAIR GOOD STRONGNo evidence or clear evidence to the contrary

Mixed evidence for approach

Broadly positive evidence in favour of approach

Strong evidence in favour of approach (e.g., multiple studies, pilots)

Using the information below, please draw a circle around the option that best describes how the initiative performs on this specific element

Support information

Definition

The extent to which the best available evidence was brought to bear in determining the policy direction

Supporting questions

• Do policy-makers draw on evidence of existing similar policies?• Does evidence support impact of former similar initiatives?• Is this evidence based on reliable sources?• Are pilots being rolled out?• Are pilot results used to adapt the policy?

• Organisation publications• Initiative blueprint • Feasibility studies• Initiative implementation plan• Articles/case studies/reports on initiative

?

EvidenceELEMENT

Possible sources

Conduct an assessment 1

Page 11: The Public Impact Fundamentals · PDF fileELEMENT Stakeholder engagement Possible sources Conduct an assessment 1. ... The Public Impact Fundamentals Self-assessment tool 18 2

The Public Impact Fundamentals Self-assessment tool 11

Policy - Quality of policies intended to achieve impact

Your assessment

Reasoning (optional)

WEAK FAIR GOOD STRONGSignificant doubts over feasibility of initiative/major challenges likely

Some doubts over feasibility of initiative/some challenges likely

Initiative considered to be feasible with a few manageable challenges

Initiative considered to be highly feasible with no real challenges

Using the information below, please draw a circle around the option that best describes how the initiative performs on this specific element

Support information

Definition

The extent to which the proposed approach is feasible in terms of resources (e.g. financial, people) and time (e.g. unrealistic deadlines)

Supporting questions

• Were legal concerns evaluated exhaustively?• Were fiscal constraints evaluated exhaustively?• Were human resources constraints evaluated exhaustively?• Was any large feasibility challenge identified?

• Organisation publications• Initiative blueprint • Initiative implementation plan• Articles/case studies/reports on initiative

?

FeasibilityELEMENT

Possible sources

Conduct an assessment 1

Page 12: The Public Impact Fundamentals · PDF fileELEMENT Stakeholder engagement Possible sources Conduct an assessment 1. ... The Public Impact Fundamentals Self-assessment tool 18 2

The Public Impact Fundamentals Self-assessment tool 12

Action - Translation of policies into real-world effect

Your assessment

Reasoning (optional)

WEAK FAIR GOOD STRONGNo obvious mechanisms in place to ensure progress is made

Some mechanisms in place to ensure progress is made but with significant weaknesses

Good mechanisms in place to ensure progress is made with only minor weaknessess

Strong mechanisms in place to ensure progress is made

Using the information below, please draw a circle around the option that best describes how the initiative performs on this specific element

Support information

Definition

The extent to which mechanisms are in place to ensure progress is made

Supporting questions

• Are there skilled programme managers who understand the context and are continuously aligned on goals and approach?• Is there use of data to drive intelligent decision-making?• Is there pragmatic resolution of issues?

• Organisation publications• Initiative implementation plan and methodology• Articles/case studies/reports on initiative

?

ManagementELEMENT

Possible sources

Conduct an assessment 1

Page 13: The Public Impact Fundamentals · PDF fileELEMENT Stakeholder engagement Possible sources Conduct an assessment 1. ... The Public Impact Fundamentals Self-assessment tool 18 2

The Public Impact Fundamentals Self-assessment tool 13

Action - Translation of policies into real-world effect

Your assessment

MeasurementELEMENT

Reasoning (optional)

Using the information below, please draw a circle around the option that best describes how the initiative performs on this specific element

Support information

Definition

The extent to which attempts have been made to ensure public impact can be measured and used to inform the approach over time

Supporting questions

• Are effective measurement functions incorporated in the execution of the policy?• Is the impact of the policy monitored consistently?• Do the indicators capture the outcome objectives of the policy?• Are the results of the outcome measurements used to adapt the policy where necessary?

• Organisation publications• Initiative implementation plan and methodology• Articles/case studies/reports on initiative

? Possible sources

WEAK FAIR GOOD STRONGNo metrics identified Metrics identified at outset

but not tracked over time and/or incomplete

Comprehensive metrics identified at outset and tracked over time but not used to significantly influence approach

Comprehensive metrics identified at outset and tracked over time with results used to assess progress and refine approach

Conduct an assessment 1

Page 14: The Public Impact Fundamentals · PDF fileELEMENT Stakeholder engagement Possible sources Conduct an assessment 1. ... The Public Impact Fundamentals Self-assessment tool 18 2

The Public Impact Fundamentals Self-assessment tool 14

Action - Translation of policies into real-world effect

Your assessment

Reasoning (optional)

Using the information below, please draw a circle around the option that best describes how the initiative performs on this specific element

Support information

Definition

The extent to which those actors required to make change happen (e.g. frontline workers, service users, general public) share an alignment of interests in relation to the achievement of this objective

Supporting questions

• Are there different interests among implementing actors?• Are the relevant actors cooperating effectively?• Are all actors equipped to execute their part of initiative?• Are the main actors motived to execute the initiative?

• Organisation publications• Initiative implementation plan and methodology• Articles/case studies/reports on initiative

?

AlignmentELEMENT

Possible sources

WEAK FAIR GOOD STRONGNo alignment of interests between the actors required to make change happen

Partial alignment of interests between the actors required to make change happen

Good alignment of interests between the actors required to make change happen

Strong alignment of interests between the actors required to make change happen

Conduct an assessment 1

Page 15: The Public Impact Fundamentals · PDF fileELEMENT Stakeholder engagement Possible sources Conduct an assessment 1. ... The Public Impact Fundamentals Self-assessment tool 18 2

The Public Impact Fundamentals Self-assessment tool 15

Please fill in with the results of your assessment

Summary of results

Initiative name:

Legi

timac

yPo

licy

Actio

n

Public confidence

Clear objectives

Management

Stakeholder engagement

Evidence

Measurement

Political commitment

Feasibility

Alignment

Assessment Average score for Fundamental

Grade

Grade key: Strong = 3 Good = 2 Fair = 1 Weak = 0

(see key below)(Weak-Strong)

Conduct an assessment 1

Page 16: The Public Impact Fundamentals · PDF fileELEMENT Stakeholder engagement Possible sources Conduct an assessment 1. ... The Public Impact Fundamentals Self-assessment tool 18 2

The Public Impact Fundamentals Self-assessment tool 16

I.

I.

II.

II.

III.

III.

Identifying areas for actionTo identify areas for action, follow the instructions below. Please refer to your scores from the Summary of results page (page 15)

Identifying the strengths of the initiative List the three highest scoring elements below

Identifying the weaknesses of the initiativeList the three lowest scoring elements below

Identify areas for action 2

Page 17: The Public Impact Fundamentals · PDF fileELEMENT Stakeholder engagement Possible sources Conduct an assessment 1. ... The Public Impact Fundamentals Self-assessment tool 18 2

The Public Impact Fundamentals Self-assessment tool 17

Specific challenges and strengths in selected areasOut of the six elements selected on the previous page, select three that you/your department can influence the most and write them down in the boxes on the left hand side. Explain the reasons for choosing those elements

What are the key strengths of the initiative and what could be done to re-inforce these?

Selected elements Reasons for selection

1

2

3

Identify areas for action 2

Page 18: The Public Impact Fundamentals · PDF fileELEMENT Stakeholder engagement Possible sources Conduct an assessment 1. ... The Public Impact Fundamentals Self-assessment tool 18 2

The Public Impact Fundamentals Self-assessment tool 18

Design an action planThinking about the three elements you have selected that you / your department can influence the most, write down actions that can be taken to improve weaknesses or maintain strengths

What are the key strengths of the initiative and what could be done to re-inforce these?

Selected elements Actions that can be taken

1

2

3

Design an action plan 3

Page 19: The Public Impact Fundamentals · PDF fileELEMENT Stakeholder engagement Possible sources Conduct an assessment 1. ... The Public Impact Fundamentals Self-assessment tool 18 2

The Public Impact Fundamentals Self-assessment tool 19

Page 20: The Public Impact Fundamentals · PDF fileELEMENT Stakeholder engagement Possible sources Conduct an assessment 1. ... The Public Impact Fundamentals Self-assessment tool 18 2

The Public Impact Fundamentals Self-assessment tool 20

I. Using the resources below, you can learn more about the theory behind the Fundamentals, as well as see policy initiatives from around the world graded using the Fundamentals rubric to assess public impact

• Read the Public Impact Fundamentals report to gain a deeper understanding of a framework underpinned by cutting-edge thinking from academia and tested by government officials. Available in English, Spanish and Portuguese

• Go to the Public Impact Observatory and filter case studies by policy areas, region and rating along the nine elements

• Explore our range of articles and insights from conversations, with policymakers across the globe

II. Connect with us for more tailored engagements. We offer: • Public Impact Fundamentals seminars and workshops • Short assessments and policy evaluation

To find out more, please email us on: [email protected]

Thank you!