Project Outcome User Panel:

Survey Lessons Learned

June 9, 2016

About Project Outcome

Why Measure Outcomes?

• Respond to questions from stakeholders

• Report program successes to funders

• Show that programs are making a difference

• Patrons gained confidence

• Patrons learned something new

• Patrons changed behavior

What does Project Outcome Measure?

As a result of library programs & services, did

library patrons:

• Learn something new?

• Gain confidence?

• Change their behavior?

• Gain awareness of the library?

Surveys for 7 Service Areas

Today’s Speakers

Crystal Schimpf Facilitator

Samantha Lopez Public Library Association

Emily Plagman Public Library Association

Justin Wasterlain Santa Clara City Library (CA)

Maria Redburn Bedford Public Library (TX)

Dan Caufield Buffalo & Erie County

Public Library (NY)

Agenda

• Panelist Introductions

• Lessons Learned

Planning

Survey Distribution

Data Collection & Entry

• Challenges Faced

• Questions & Discussion

• Announcements

Panelist Introductions

• Santa Clara, California

• Population of 120,000

• 3 branch library system

• 370 adult programs last year

• Using Project Outcome since

September 2015

Technology Education Reevaluation

• About 4-8 computer related programs a month.

• Tech classes were poorly attended but no real feedback

available

• Needed consistent evaluation model to determine

effectiveness of programs

• Use Project Outcome for new or under performing programs

Results:

• Response rate for these surveys has been very high and positive.

• Gives concrete data to show administration and other stakeholders about program

effectiveness

• Comments were often most valuable part from a development standpoint.

Buffalo & Erie County Public Library System

• Erie County, N.Y

• Population: 919,000

• 37 library locations

• New to Project Outcome

(2 months in)

Workforce Development & Computer Training

Workforce & Business Development

• Offsite programs for entrepreneurs and job seekers

• Between 17-35 participants in classroom settings at

local schools, colleges, and partnering organizations

• Paper surveys offered at the end of program with the

option to use cell phone with a survey link.

• Project Outcome was emphasized as the evaluation

method for an approved 2016-2019 adult literacy

grant.

“Workforce Development at New York Libraries

through Public Library Systems”

Survey Results

Questions asked, scores and comparisons

Bedford Public Library

• Bedford, TX

• Population: 48,592

• 1 library location

To Survey or Not to Survey

• Outcome rich

• Pilot program

• Identify new programs

• Improve existing programs

• Evaluate resource intense programs

Survey Results

Results: 24 ESL Surveys

Lessons Learned

What did your library learn during the

planning process?

Planning for Project Outcome

Audience: Please share in chat

Planning for Project Outcome

What did your library learn during the

planning process?

Audience: Please share in chat

Dan Caufield Buffalo & Erie County

Public Library (NY)

Planning for Project Outcome

What did your library learn during the

planning process?

Audience: Please share in chat

Maria Redburn Bedford Public Library (TX)

Justin Wasterlain Santa Clara City Library (CA)

Planning for Project Outcome

What did your library learn during the

planning process?

Audience: Please share in chat

Survey Distribution

What did your library learn about

distributing surveys to patrons?

Audience: Please share in chat

Survey Distribution

What did your library learn about

distributing surveys to patrons?

Audience: Please share in chat

Maria Redburn Bedford Public Library (TX)

Dan Caufield Buffalo & Erie County

Public Library (NY)

Survey Distribution

What did your library learn about

distributing surveys to patrons?

Audience: Please share in chat

Entering Survey data

What did your library learn about

collecting & entering survey data?

Audience: Please share in chat

Entering Survey data

What did your library learn about

collecting & entering survey data?

Audience: Please share in chat

Justin Wasterlain Santa Clara City Library (CA)

Entering Survey data

What did your library learn about

collecting & entering survey data?

Audience: Please share in chat

Dan Caufield Buffalo & Erie County

Public Library (NY)

Maria Redburn Bedford Public Library (TX)

Entering Survey data

What did your library learn about

collecting & entering survey data?

Audience: Please share in chat

Type your questions in the chat.

Audience Questions & Comments

Justin Wasterlain Santa Clara City Library (CA)

Maria Redburn Bedford Public Library (TX)

Dan Caufield Buffalo & Erie County

Public Library (NY)

Challenges

Challenges

What is one challenge your library

has faced in implementing Project

Outcome?

How have you addressed it?

Audience: Please share in chat

Challenges

What is one challenge your library has faced

while implementing Project Outcome?

How have you addressed it?

Audience: Please share in chat

Maria Redburn Bedford Public Library (TX)

Challenges

What is one challenge your library has faced

while implementing Project Outcome?

How have you addressed it?

Audience: Please share in chat

Justin Wasterlain Santa Clara City Library (CA)

Type your questions in the chat.

Audience Questions & Comments

Justin Wasterlain Santa Clara City Library (CA)

Maria Redburn Bedford Public Library (TX)

Dan Caufield Buffalo & Erie County

Public Library (NY)

Plans for the Future

Justin Wasterlain Santa Clara City Library (CA)

Maria Redburn Bedford Public Library (TX)

What are your plans for the future with

Project Outcome?

Audience: Please share in chat

Dan Caufield Buffalo & Erie County

Public Library (NY)

Announcements

ALA Annual Conference: June 24-28, 2016

Friday, June 24, 9:00AM-4:00PM

Preconference

Project Outcome Enrollment Workshop : Simple Tools to

Measure Our True Impact

DEADLINE TO REGISTER IS JUNE 10

Saturday, June 25, 3:00-4:00PM

The Power of Performance: Project Outcome

Next Webinar – Save the Date

July 14, 2016, Thursday @ 1:00PM Central

Project Outcome Regional Training: Virtual Information Session

If you haven’t already…

• Sign up on the Project Outcome website

• View training resources

• Schedule a survey in the Survey Portal

• View Data Dashboards

• Join the Facebook group

• Follow Project Outcome on Twitter

Thank you!