Accountability and Measuring SuccessIS 430 (UCLA)Sarah ClarkMonday, November 25, 2013

Overview of Today

1. Measuring Success and Communicating Benefits (60 min)

2. Group-led discussion of readings (30 min)3. Field Trip and Guest Speaker:

Julia Glassman, UCLA College Library (70-90 min)

Next Week

● Bring the following:○ Your library’s mission + Your community profile

and needs assessment○ Your collection policy○ Your website/flyer/artifact to connect your users to

your resources

Final Project

● Due: Friday, December 13th (sorry!)

● Submit via email: sarahclark@ucla.edu

● You can pick it up from the GSEIS office after break.

Credit: Clear Guitar

Measuring Success...… and demonstrating your success to your stakeholders and community.

Flickr CC @martapiqs

Evaluation and Measuring Success

● How do you determine what “success” means in terms of a library collection?

● What are ways to measure success of our collections?

● What are the benefits and drawbacks to those methods?

Flickr CC @SalFalko

The Logic Model

Source: KnowHowNonProfit.org

Outcomes

Outcome = the impact your collections and services have on your user community.

Ask yourself: What is the big purpose? What impact do I want my collections to have on my user community? How will I measure that impact?

Outputs

Outputs = Activities and what is produced through activities.

Libraries tend to be good at measuring outputs: #of participants, #circulations, etc.

Source: QuantumLeap.com

University of Wisconsin - Extension, Cooperative Extension, Program Development and EvaluationUniversity of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation

Everyday example

HEADACHE

Feel betterGet pills Take pills

Situation INPUTS OUTPUTS OUTCOMES

Source: University of Wisconsin

University of Wisconsin - Extension, Cooperative Extension, Program Development and EvaluationUniversity of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation

Family Members

Budget

Car

Camping Equipment

Drive to state park

Set up camp

Cook, play, talk, laugh, hike

Family members learn about each

other; family bonds; family has

a good time

Everyday logic model – Family Vacation

INPUTS OUTPUTS OUTCOMES

Source: University of Wisconsin

University of Wisconsin - Extension, Cooperative Extension, Program Development and EvaluationUniversity of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation

A bit more detail

INPUTS OUTPUTS OUTCOMES

Program investments

Activities Participation Short Medium

What we

invest

What we do

Who we

reach

What results

SO WHAT??

What is the VALUE?

Long-

term

Source: University of Wisconsin

University of Wisconsin - Extension, Cooperative Extension, Program Development and EvaluationUniversity of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation

Fully detailed logic model

Source: University of Wisconsin

University of Wisconsin - Extension, Cooperative Extension, Program Development and EvaluationUniversity of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation

Source: University of Wisconsin

University of Wisconsin - Extension, Cooperative Extension, Program Development and EvaluationUniversity of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation

OUTPUTS What we do Who we reach

ACTIVITIES

•Train, teach•Deliver services•Develop products and resources•Network with others•Build partnerships•Assess•Facilitate•Work with the media•…

PARTICIPATION

•Participants•Clients•Customers•Agencies•Decision makers•Policy makers

Satisfaction

Source: University of Wisconsin

University of Wisconsin - Extension, Cooperative Extension, Program Development and EvaluationUniversity of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation

OUTCOMESWhat results for individuals, families, communities..…

SHORTLearning

Changes in

● Awareness● Knowledge● Attitudes● Skills● Opinion● Aspirations● Motivation● Behavioral

intent

MEDIUMAction

Changes in

● Behavior ● Decision-making● Policies● Social action

LONG-TERMConditions

Changes in

● Conditions● Social (well-

being)● Health● Economic● Civic● Environmental

C H A I N OF O U T C O M E S

Source: University of Wisconsin

Work Backwards from Your Goal

Example Outcome at Windward

● Collection: Grab and Read● Target Group: High School

students too busy for pleasure reading

● Outcome: Students who otherwise would not read for fun will take breaks from the rigor of school to reignite their imaginations and rediscover the love of learning independently and with friends.

What Are Your Outcomes?

● Identify a target community.● Create a specific outcome connected to

your collection.

What Are Your Outcomes?

OUTCOMESWhat results for individuals, families, communities..…

SHORTLearning

Changes in

● Awareness● Knowledge● Attitudes● Skills● Opinion● Aspirations● Motivation● Behavioral

intent

MEDIUMAction

Changes in

● Behavior ● Decision-making● Policies● Social action

LONG-TERMConditions

Changes in

● Conditions● Social (well-

being)● Health● Economic● Civic● Environmental

Demonstrating Successcommunicating your successes with your community and with stakeholders

Flickr CC @Enokson

Turning Data into Stories

● Show the problem (and how you plan to make a difference).

● Show your impact.

● Make your data beautiful.

● Return to the story.

Source: Daniel Melbye

Storytelling in Presentations

Nancy Duarte

Elevator Speech

Flickr CC @daryl_mitchell

So, what is it that you are doing here?

Flickr CC @daryl_mitchell

Flickr CC @daryl_mitchell

Elevator Speech should ...

● … be simple and memorable.● … be ready at any time for a chance

encounter.● … show what your collection contributes to

the community and why it matters.● … create curiosity.

Step 1: Imagine Success

Imagine success.

What does it look like? Invent the results you want.

What impact does your collection have on your community?

Flickr CC @Fairfax Library Foundation

Step 2: Who is Your Audience?

How will you modify your message for different stakeholders?

Librarian Peers

Organizational Head Patrons

Speed Elevator Speeches -- Round 1

1. Find a partner.2. One person gives his/her elevator speech as

if the partner is a key stakeholder. (30 sec)3. Partners switch roles. (30 sec)4. Rotate to a new partner.5. Repeat.

Speed Elevator Speeches -- Round 2

1. Find a partner.2. One person gives his/her elevator speech as

if the partner is a library patron curious about the collection and its purpose. (30 sec)

3. Partners switch roles. (30 sec)4. Rotate to a new partner.5. Repeat.

Parting Words

● Begin with your purpose. Know what outcomes you want.

● Consider how you will measure your success from the beginning.

Flickr CC Local Studies NSW

● Embrace the power of storytelling.