29/8/20

1

Integrated Performance and Accountability Approach

1

Integrating Performance & Accountability

• Measurement approaches that integrate performance and accountability

• Not just standalone measurement but integrated into day-to-day strategy and operations

• Examples:– Results Based Accountability– Tool for Systemic Change– Social Accounting & Audit

Muir& Bennett, 2014, p. 32

2

29/8/20

2

Results Based Accountability

• Developed by Mark Friedman

• Continual tracking of performance

• Uses a three-part categorisation scheme for performance measures– How much did we do (e.g. numbers served)? – How well did we do it (e.g. % satisfied with key aspects of the service)? – Is anyone better off (e.g. % of participants served showing improvements of

various kinds in their lives)?

• Uses a seven-step process to answer three questions

Adult Learning Australia, 2016

3

Results Based Accountability

• Seven Steps

Adult Learning Australia, 2016

4

29/8/20

3

Results Based Accountability

Adult Learning Australia, 2016

5

Contribution Towards Population Accountability?

Butland, et al., 2007

©CommunityCapacityBuilders2020

6

29/8/20

4

Tool for Systemic Change

• Developed by Wicked Lab

• Maps, tracks and measures systems change over time

• The measurement of systems change is undertaken through vector measurement

• Vector measurement: measuring for a solution ecosystem “the direction and speed of travel from the present”

Snowden, 2017

• Outcome targets for complicated problems, vector targets for the complex problems

Snowden, 2016

7

Transition Card

8

29/8/20

5

Underpinning Model

9

10

29/8/20

6

11

12

29/8/20

7

13

14

29/8/20

8

Transition Card Activity Report provides a vector analysis: it measures ‘the direction and speed of travel from the present’ (Snowden, 2016) for all of the initiatives in a solution ecosystem.

15

Holistic Nested Measurement Approach

• Easier for government to adopt complexity approach if part of an overarching narrative, that bridges the traditional and complexity approaches to results measurement.

• Three levels of reporting included in the overarching narrative approach: – measure the results of each intervention

in solution ecosystem using theory driven evaluation

– measure systems change results – discuss changes to the broader

macroenvironment that impact on wicked problem using a PESTLE type analysis

Intervention level

System level

Macro-environment level

Zivkovic, 2020

16

29/8/20

9

Social Accounting & Audit

• Social Accounting– The process whereby the organisation collects, analysis and interprets

descriptive, quantitative and qualitative information gathered in order to produce an account of its social, environmental and economic performance and impact.

• Social Audit– The process of reviewing and verifying the Social Accounts at the end

of each social accounting period. The term ‘social audit’ is also sometimes used generically for the concept and for the whole process.

Kay, 2011

17

Kay, 2011

18

29/8/20

10

Social Accounting & Audit Steps• Step 1: What difference do we want to make

– This step is about focus. What do you do? Why do you do it? Who do you work with and for? What difference will you make?

• Step 2: How do we know we are making a difference– This step is about recording and keeping relevant information. What do you need to know to show

you are making the difference? How do you make sure you are tracking it?

• Step 3: What is the difference we are making– This step is about presenting the information. What can you say about your performance? What

impact are you making? How do you report the information?

•• Step 4: Can we prove that we made a difference

– This step is about verification. How credible are your claims? Who has checked out your draft social accounts and what did they find?

Kay, 2011

19

Kay, 2011

20

29/8/20

11

References

• Adult Learning Australia (ALA). (2016). The ACE sector and results based accountability: an exploratory study.

• Godrich, S. L., Payet, J., Brealey, D., Edmunds, M., Stoneham, M., & Devine, A. (2019). South West Food Community: A place-based pilot study to understand the food security system. Nutrients, 11(4), 738.

• Kay, A. (2011). Prove! Improve! Account!: The New Guide to Social Accounting and Audit. Social Audit Network.

• Muir, K. & Bennett, S. (2014). The Compass: Your Guide to Social Impact Measurement. Sydney, Australia: The Centre for Social Impact.

• Snowden, D. (2017), Systems thinking & complexity, viewed 5 June 2019, blog post, https://cognitive-edge.com/blog/systems-thinking-complexity/

• Snowden, D. (2016), The banality of measurement, viewed 5 June 2019, blog post, https://cognitive-edge.com/blog/the-banality-of-measurement/

• Zivkovic, S. (2020), Increasing the willingness and ability of governments to use appropriate measurement approaches when addressing wicked problems, paper presented at the 12th International Social Innovation Research Conference, Sheffield, 1-3 September 2020.

21