Applying SROI in the evaluation of Libraries for Life
-
Upload
alysontyler -
Category
Education
-
view
886 -
download
3
description
Transcript of Applying SROI in the evaluation of Libraries for Life
Corporate slide masterWith guidelines for corporate presentations
Applying SROI in the evaluation of Libraries for Life
CyMAL: Amgueddfeydd Archifau a Llyfrgelloedd CymruCyMAL: Museums Archives and Libraries Wales
Dr Alyson TylerLibraries Development AdviserCyMAL, Welsh Government
@libalyson
Alison KennedyASK Consulting
Outline of talk
• Wales context • Libraries for Life strategy
and evaluation• Social Return on Investment• Issues to consider• Questions
Grandad Bibli – part of marketing campaign
Wales context3 million people, 20% speak Welsh
1 National Library of Wales22 local authority library services c. 12 HE libraries (mergers ongoing)c. 23 FE libraries (mergers ongoing)50+ health libraries5 Prison librariesSchool librariesWorkplace libraries
Image from CC Flickr - giveawayboy
What is CyMAL?
• Policy division of Welsh Government (Cymru Museums Archives and Libraries)
• Cross-domain approach
• Policy development, grant programmes, advice and support
• Library strategies:– 2005-07 @ your library– 2008-11 Libraries for Life
Government building in Aberystwyth
Libraries for life 2008-11
• Funding £10.5 m– 2008-09 £1m + £1.5m capital– 2009-10 £1m + £3m capital– 2010-11 £1m + £3m capital
• Work strands– Community Learning Libraries Programme– Online content and resources – Regional Library Partnerships framework– National marketing strategy – Developing workforce skills – Welsh Public Libraries Standards Framework Three
Evaluation framework• Independent research company Scotinform, with
Associates• 16 month evaluation process – interim reports• Qualitative research:
– Literature review – country comparator– Interviews with CyMAL staff– Interviews with strand leaders and key stakeholders– Survey of heads of library services– Staff: survey (online), focus groups (online and face to
face)– Users: survey (online and paper), focus groups (online
and face to face) – Non-users: interviews (face to face) and focus groups
(online and face to face)• SROI analysis on two programme strands
What is SROI?
• Framework for measuring and accounting for value
• Developed by Cabinet Office of the Third Sector
• It measures relevant change
• Value rather than money
• 2 work strands assessed
• Workforce Development
• CLLIP – 2 case study libraries• Pontarddulais (near Swansea, south Wales)• Wrexham (north Wales)
SROI - Process
1.Establishing scope and identifying key stakeholders
2.Mapping outcomes
3.Evidencing outcomes and giving them a value
4.Establishing impact
5.Calculating the SROI
6.Reporting, using and embedding
SROI – 6 Stage Process
SROI – Information Gathering
• Focus groups held with library staff and users
• SROI relevant questions included in evaluation surveys
• CyMAL reports and management information analyzed
Outcomes Identified
Outcomes
• Workforce Development: £3.12* of SROI• Pontarddulais: £3.42* of SROI• Wrexham: £2.16* of SROI
“SROI is not just a number but a story about change which includes narrative, qualitative,
quantitative and financial aspects”
* = unverified
Findings from the SROI Process
• Staff and users benefited; increased usage and users and improved staff working environments
• Staff benefitted from increased levels of skills and confidence and higher earning potential
• Provided valuable insight into wider impacts and benefits of the investment in the library sector in Wales
SROI and Measuring Impact of Libraries for Life
• Challenging process• Many stakeholders and indicators identified• Not always possible to find a financial proxy to
show the benefit (materiality)• Consulting with large number of stakeholders
biggest challenge• Not an appropriate measurement tool for a
programme of this size• Tool would be more appropriate for smaller,
discreet projects
Other findings and conclusions
• “… excellent value for money…”
• Wide reach impact of an holistic approach to investment in libraries
• Value of partnerships across the library sector
• Intrinsic ‘value’ of libraries, even from non-users
Future issues
• Data gathering framework vital
• SROI suitability for large programmes?
• Other economic impact tools e.g. joint ROI project 2011-12
• Other options for measuring performance in libraries (cf our Public Library Standards)
Contact details
• Alyson Tyler [email protected]@libalysonhttp://libalyson.wordpress.com www.wales.gov.uk/cymal - Evaluation report available here
• Alison Kennedy [email protected] www.askconsulting.org.uk
• Scotinform www.scotinform.co.uk