Class 8 - accountability and measuring success

34
Accountability and Measuring Success IS 430 (UCLA) Sarah Clark Monday, November 25, 2013

description

What does it mean to have a successful library collection? How can that success be measured in terms of community benefit? How do you communicate those benefits to your users and stakeholders?

Transcript of Class 8 - accountability and measuring success

Page 1: Class 8  - accountability and measuring success

Accountability and Measuring SuccessIS 430 (UCLA)Sarah ClarkMonday, November 25, 2013

Page 2: Class 8  - accountability and measuring success

Overview of Today

1. Measuring Success and Communicating Benefits (60 min)

2. Group-led discussion of readings (30 min)3. Field Trip and Guest Speaker:

Julia Glassman, UCLA College Library (70-90 min)

Page 3: Class 8  - accountability and measuring success

Next Week

● Bring the following:○ Your library’s mission + Your community profile

and needs assessment○ Your collection policy○ Your website/flyer/artifact to connect your users to

your resources

Page 4: Class 8  - accountability and measuring success

Final Project

● Due: Friday, December 13th (sorry!)

● Submit via email: [email protected]

● You can pick it up from the GSEIS office after break.

Credit: Clear Guitar

Page 5: Class 8  - accountability and measuring success

Measuring Success...… and demonstrating your success to your stakeholders and community.

Flickr CC @martapiqs

Page 6: Class 8  - accountability and measuring success

Evaluation and Measuring Success

● How do you determine what “success” means in terms of a library collection?

● What are ways to measure success of our collections?

● What are the benefits and drawbacks to those methods?

Flickr CC @SalFalko

Page 7: Class 8  - accountability and measuring success

The Logic Model

Page 9: Class 8  - accountability and measuring success

Outcomes

Outcome = the impact your collections and services have on your user community.

Ask yourself: What is the big purpose? What impact do I want my collections to have on my user community? How will I measure that impact?

Page 10: Class 8  - accountability and measuring success

Outputs

Outputs = Activities and what is produced through activities.

Libraries tend to be good at measuring outputs: #of participants, #circulations, etc.

Page 12: Class 8  - accountability and measuring success

University of Wisconsin - Extension, Cooperative Extension, Program Development and EvaluationUniversity of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation

Everyday example

HEADACHE

Feel betterGet pills Take pills

Situation INPUTS OUTPUTS OUTCOMES

Source: University of Wisconsin

Page 13: Class 8  - accountability and measuring success

University of Wisconsin - Extension, Cooperative Extension, Program Development and EvaluationUniversity of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation

Family Members

Budget

Car

Camping Equipment

Drive to state park

Set up camp

Cook, play, talk, laugh, hike

Family members learn about each

other; family bonds; family has

a good time

Everyday logic model – Family Vacation

INPUTS OUTPUTS OUTCOMES

Source: University of Wisconsin

Page 14: Class 8  - accountability and measuring success

University of Wisconsin - Extension, Cooperative Extension, Program Development and EvaluationUniversity of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation

A bit more detail

INPUTS OUTPUTS OUTCOMES

Program investments

Activities Participation Short Medium

What we

invest

What we do

Who we

reach

What results

SO WHAT??

What is the VALUE?

Long-

term

Source: University of Wisconsin

Page 15: Class 8  - accountability and measuring success

University of Wisconsin - Extension, Cooperative Extension, Program Development and EvaluationUniversity of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation

Fully detailed logic model

Source: University of Wisconsin

Page 16: Class 8  - accountability and measuring success

University of Wisconsin - Extension, Cooperative Extension, Program Development and EvaluationUniversity of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation

Source: University of Wisconsin

Page 17: Class 8  - accountability and measuring success

University of Wisconsin - Extension, Cooperative Extension, Program Development and EvaluationUniversity of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation

OUTPUTS What we do Who we reach

ACTIVITIES

•Train, teach•Deliver services•Develop products and resources•Network with others•Build partnerships•Assess•Facilitate•Work with the media•…

PARTICIPATION

•Participants•Clients•Customers•Agencies•Decision makers•Policy makers

Satisfaction

Source: University of Wisconsin

Page 18: Class 8  - accountability and measuring success

University of Wisconsin - Extension, Cooperative Extension, Program Development and EvaluationUniversity of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation

OUTCOMESWhat results for individuals, families, communities..…

SHORTLearning

Changes in

● Awareness● Knowledge● Attitudes● Skills● Opinion● Aspirations● Motivation● Behavioral

intent

MEDIUMAction

Changes in

● Behavior ● Decision-making● Policies● Social action

LONG-TERMConditions

Changes in

● Conditions● Social (well-

being)● Health● Economic● Civic● Environmental

C H A I N OF O U T C O M E S

Source: University of Wisconsin

Page 19: Class 8  - accountability and measuring success

Work Backwards from Your Goal

Page 20: Class 8  - accountability and measuring success

Example Outcome at Windward

● Collection: Grab and Read● Target Group: High School

students too busy for pleasure reading

● Outcome: Students who otherwise would not read for fun will take breaks from the rigor of school to reignite their imaginations and rediscover the love of learning independently and with friends.

Page 21: Class 8  - accountability and measuring success

What Are Your Outcomes?

● Identify a target community.● Create a specific outcome connected to

your collection.

Page 22: Class 8  - accountability and measuring success

What Are Your Outcomes?

OUTCOMESWhat results for individuals, families, communities..…

SHORTLearning

Changes in

● Awareness● Knowledge● Attitudes● Skills● Opinion● Aspirations● Motivation● Behavioral

intent

MEDIUMAction

Changes in

● Behavior ● Decision-making● Policies● Social action

LONG-TERMConditions

Changes in

● Conditions● Social (well-

being)● Health● Economic● Civic● Environmental

Page 23: Class 8  - accountability and measuring success

Demonstrating Successcommunicating your successes with your community and with stakeholders

Page 24: Class 8  - accountability and measuring success

Flickr CC @Enokson

Page 25: Class 8  - accountability and measuring success

Turning Data into Stories

● Show the problem (and how you plan to make a difference).

● Show your impact.

● Make your data beautiful.

● Return to the story.

Source: Daniel Melbye

Page 27: Class 8  - accountability and measuring success

Elevator Speech

Flickr CC @daryl_mitchell

Page 28: Class 8  - accountability and measuring success

So, what is it that you are doing here?

Flickr CC @daryl_mitchell

Page 29: Class 8  - accountability and measuring success

Flickr CC @daryl_mitchell

Elevator Speech should ...

● … be simple and memorable.● … be ready at any time for a chance

encounter.● … show what your collection contributes to

the community and why it matters.● … create curiosity.

Page 30: Class 8  - accountability and measuring success

Step 1: Imagine Success

Imagine success.

What does it look like? Invent the results you want.

What impact does your collection have on your community?

Flickr CC @Fairfax Library Foundation

Page 31: Class 8  - accountability and measuring success

Step 2: Who is Your Audience?

How will you modify your message for different stakeholders?

Librarian Peers

Organizational Head Patrons

Page 32: Class 8  - accountability and measuring success

Speed Elevator Speeches -- Round 1

1. Find a partner.2. One person gives his/her elevator speech as

if the partner is a key stakeholder. (30 sec)3. Partners switch roles. (30 sec)4. Rotate to a new partner.5. Repeat.

Page 33: Class 8  - accountability and measuring success

Speed Elevator Speeches -- Round 2

1. Find a partner.2. One person gives his/her elevator speech as

if the partner is a library patron curious about the collection and its purpose. (30 sec)

3. Partners switch roles. (30 sec)4. Rotate to a new partner.5. Repeat.

Page 34: Class 8  - accountability and measuring success

Parting Words

● Begin with your purpose. Know what outcomes you want.

● Consider how you will measure your success from the beginning.

Flickr CC Local Studies NSW

● Embrace the power of storytelling.