Measuring Outcomes & Libraries Illuminated · 3/14/2018 · About using virtual reality...
Transcript of Measuring Outcomes & Libraries Illuminated · 3/14/2018 · About using virtual reality...
![Page 1: Measuring Outcomes & Libraries Illuminated · 3/14/2018 · About using virtual reality technology. 92% Increased their confidence Using ESL programming to learn English. 87% Intend](https://reader035.fdocuments.in/reader035/viewer/2022071002/5fbe7f4b60bdb0039c11bcf3/html5/thumbnails/1.jpg)
March 14, 2018
Measuring Outcomes & Libraries Illuminated
![Page 2: Measuring Outcomes & Libraries Illuminated · 3/14/2018 · About using virtual reality technology. 92% Increased their confidence Using ESL programming to learn English. 87% Intend](https://reader035.fdocuments.in/reader035/viewer/2022071002/5fbe7f4b60bdb0039c11bcf3/html5/thumbnails/2.jpg)
Agenda
Emily PlagmanProject ManagerPublic Library Association
Welcome & Intro
Why measure outcomes
Project Outcome toolkit
From-the-Field: Sacramento
Measuring Libraries Illuminated
Tips for Getting Started
Q&A
![Page 3: Measuring Outcomes & Libraries Illuminated · 3/14/2018 · About using virtual reality technology. 92% Increased their confidence Using ESL programming to learn English. 87% Intend](https://reader035.fdocuments.in/reader035/viewer/2022071002/5fbe7f4b60bdb0039c11bcf3/html5/thumbnails/3.jpg)
What kind of programming are you planning for Libraries Illuminated?
Please share in chat
![Page 4: Measuring Outcomes & Libraries Illuminated · 3/14/2018 · About using virtual reality technology. 92% Increased their confidence Using ESL programming to learn English. 87% Intend](https://reader035.fdocuments.in/reader035/viewer/2022071002/5fbe7f4b60bdb0039c11bcf3/html5/thumbnails/4.jpg)
Why Measure Outcomes
![Page 5: Measuring Outcomes & Libraries Illuminated · 3/14/2018 · About using virtual reality technology. 92% Increased their confidence Using ESL programming to learn English. 87% Intend](https://reader035.fdocuments.in/reader035/viewer/2022071002/5fbe7f4b60bdb0039c11bcf3/html5/thumbnails/5.jpg)
Demonstrating Library Value
Needs Assessment Patron Satisfaction
Outputs Outcomes
![Page 6: Measuring Outcomes & Libraries Illuminated · 3/14/2018 · About using virtual reality technology. 92% Increased their confidence Using ESL programming to learn English. 87% Intend](https://reader035.fdocuments.in/reader035/viewer/2022071002/5fbe7f4b60bdb0039c11bcf3/html5/thumbnails/6.jpg)
Measuring the Good We Do
Patron-reported changes/effects/impacts programs are having in/on…KnowledgeSkillsAttitudesOpinionsBehaviorsActions Status
![Page 7: Measuring Outcomes & Libraries Illuminated · 3/14/2018 · About using virtual reality technology. 92% Increased their confidence Using ESL programming to learn English. 87% Intend](https://reader035.fdocuments.in/reader035/viewer/2022071002/5fbe7f4b60bdb0039c11bcf3/html5/thumbnails/7.jpg)
What kind of outcome data would help demonstrate the value of Libraries
Illuminated?
Learning gained about virtual reality
Technology facilitates increased confidence about use of a new language
Increased use of coding skills used for professional or school purposes
Awareness of additional technology available at the library
![Page 8: Measuring Outcomes & Libraries Illuminated · 3/14/2018 · About using virtual reality technology. 92% Increased their confidence Using ESL programming to learn English. 87% Intend](https://reader035.fdocuments.in/reader035/viewer/2022071002/5fbe7f4b60bdb0039c11bcf3/html5/thumbnails/8.jpg)
But, How?
PLA’s got your back!
![Page 9: Measuring Outcomes & Libraries Illuminated · 3/14/2018 · About using virtual reality technology. 92% Increased their confidence Using ESL programming to learn English. 87% Intend](https://reader035.fdocuments.in/reader035/viewer/2022071002/5fbe7f4b60bdb0039c11bcf3/html5/thumbnails/9.jpg)
Project Outcome Goal
Outcome measurement becomes “business as usual” for public libraries
Supply standardized outcome measures that any library can use and learn from
Provide easy-to-use tools for measuring
Offer resources to support implementation
Supply “from-the-field” cases to demonstrate usage and lessons learned
![Page 10: Measuring Outcomes & Libraries Illuminated · 3/14/2018 · About using virtual reality technology. 92% Increased their confidence Using ESL programming to learn English. 87% Intend](https://reader035.fdocuments.in/reader035/viewer/2022071002/5fbe7f4b60bdb0039c11bcf3/html5/thumbnails/10.jpg)
Project Outcome Toolkit
![Page 11: Measuring Outcomes & Libraries Illuminated · 3/14/2018 · About using virtual reality technology. 92% Increased their confidence Using ESL programming to learn English. 87% Intend](https://reader035.fdocuments.in/reader035/viewer/2022071002/5fbe7f4b60bdb0039c11bcf3/html5/thumbnails/11.jpg)
Project Outcome Toolkit
Access to:
Standardized surveys
Survey management tool
Custom data reports
Interactive data dashboards
Resources & training
From-the-field
It’s FREE!
www.ProjectOutcome.org
![Page 12: Measuring Outcomes & Libraries Illuminated · 3/14/2018 · About using virtual reality technology. 92% Increased their confidence Using ESL programming to learn English. 87% Intend](https://reader035.fdocuments.in/reader035/viewer/2022071002/5fbe7f4b60bdb0039c11bcf3/html5/thumbnails/12.jpg)
Toolkit: Standardized Outcome Measures
What did patrons like most?What can the library do to improve?
Knowledge
Confidence
Behavior Change
Awareness
![Page 13: Measuring Outcomes & Libraries Illuminated · 3/14/2018 · About using virtual reality technology. 92% Increased their confidence Using ESL programming to learn English. 87% Intend](https://reader035.fdocuments.in/reader035/viewer/2022071002/5fbe7f4b60bdb0039c11bcf3/html5/thumbnails/13.jpg)
Toolkit: Survey Management
![Page 14: Measuring Outcomes & Libraries Illuminated · 3/14/2018 · About using virtual reality technology. 92% Increased their confidence Using ESL programming to learn English. 87% Intend](https://reader035.fdocuments.in/reader035/viewer/2022071002/5fbe7f4b60bdb0039c11bcf3/html5/thumbnails/14.jpg)
Toolkit: Custom Data Reports
![Page 15: Measuring Outcomes & Libraries Illuminated · 3/14/2018 · About using virtual reality technology. 92% Increased their confidence Using ESL programming to learn English. 87% Intend](https://reader035.fdocuments.in/reader035/viewer/2022071002/5fbe7f4b60bdb0039c11bcf3/html5/thumbnails/15.jpg)
Toolkit: Data DashboardsOverview
Matrix
Detail
![Page 16: Measuring Outcomes & Libraries Illuminated · 3/14/2018 · About using virtual reality technology. 92% Increased their confidence Using ESL programming to learn English. 87% Intend](https://reader035.fdocuments.in/reader035/viewer/2022071002/5fbe7f4b60bdb0039c11bcf3/html5/thumbnails/16.jpg)
Toolkit: Resources
Getting Started Surveys Data Collection Data Analysis Taking Action Outcome
Measurement Guidelines
www.ProjectOutcome.org
![Page 17: Measuring Outcomes & Libraries Illuminated · 3/14/2018 · About using virtual reality technology. 92% Increased their confidence Using ESL programming to learn English. 87% Intend](https://reader035.fdocuments.in/reader035/viewer/2022071002/5fbe7f4b60bdb0039c11bcf3/html5/thumbnails/17.jpg)
Toolkit: From-the-Field
![Page 18: Measuring Outcomes & Libraries Illuminated · 3/14/2018 · About using virtual reality technology. 92% Increased their confidence Using ESL programming to learn English. 87% Intend](https://reader035.fdocuments.in/reader035/viewer/2022071002/5fbe7f4b60bdb0039c11bcf3/html5/thumbnails/18.jpg)
Toolkit: Becoming Business-as-UsualToolkit supports progression from registration to sustained outcome data collection & use
![Page 19: Measuring Outcomes & Libraries Illuminated · 3/14/2018 · About using virtual reality technology. 92% Increased their confidence Using ESL programming to learn English. 87% Intend](https://reader035.fdocuments.in/reader035/viewer/2022071002/5fbe7f4b60bdb0039c11bcf3/html5/thumbnails/19.jpg)
From the Field: Sacramento Public
Library
![Page 20: Measuring Outcomes & Libraries Illuminated · 3/14/2018 · About using virtual reality technology. 92% Increased their confidence Using ESL programming to learn English. 87% Intend](https://reader035.fdocuments.in/reader035/viewer/2022071002/5fbe7f4b60bdb0039c11bcf3/html5/thumbnails/20.jpg)
CHRISTOPHER TREWPUBL IC SERVICES SUPPORT SUPERVISOR
![Page 21: Measuring Outcomes & Libraries Illuminated · 3/14/2018 · About using virtual reality technology. 92% Increased their confidence Using ESL programming to learn English. 87% Intend](https://reader035.fdocuments.in/reader035/viewer/2022071002/5fbe7f4b60bdb0039c11bcf3/html5/thumbnails/21.jpg)
@
![Page 22: Measuring Outcomes & Libraries Illuminated · 3/14/2018 · About using virtual reality technology. 92% Increased their confidence Using ESL programming to learn English. 87% Intend](https://reader035.fdocuments.in/reader035/viewer/2022071002/5fbe7f4b60bdb0039c11bcf3/html5/thumbnails/22.jpg)
Library Strategic Planning Approach Understanding Outcomes
Questions to Answer:
Strategic Plan Monthly service Patron Surveys Patron Surveys
measures
![Page 23: Measuring Outcomes & Libraries Illuminated · 3/14/2018 · About using virtual reality technology. 92% Increased their confidence Using ESL programming to learn English. 87% Intend](https://reader035.fdocuments.in/reader035/viewer/2022071002/5fbe7f4b60bdb0039c11bcf3/html5/thumbnails/23.jpg)
• Job Coach In Service
• Survey Period: - September 1st - December 9th, 2016
• 14 Branches Offer Job Coach
• 16 Job Coaches
![Page 24: Measuring Outcomes & Libraries Illuminated · 3/14/2018 · About using virtual reality technology. 92% Increased their confidence Using ESL programming to learn English. 87% Intend](https://reader035.fdocuments.in/reader035/viewer/2022071002/5fbe7f4b60bdb0039c11bcf3/html5/thumbnails/24.jpg)
Job Skills Survey
Immediate Survey
![Page 25: Measuring Outcomes & Libraries Illuminated · 3/14/2018 · About using virtual reality technology. 92% Increased their confidence Using ESL programming to learn English. 87% Intend](https://reader035.fdocuments.in/reader035/viewer/2022071002/5fbe7f4b60bdb0039c11bcf3/html5/thumbnails/25.jpg)
• Paper survey offered at completion of each job coach session
• Completely voluntary
• Completed survey placed in envelop addressed to Volunteer Services
• Envelop turned into service desk – not back to job coach
![Page 26: Measuring Outcomes & Libraries Illuminated · 3/14/2018 · About using virtual reality technology. 92% Increased their confidence Using ESL programming to learn English. 87% Intend](https://reader035.fdocuments.in/reader035/viewer/2022071002/5fbe7f4b60bdb0039c11bcf3/html5/thumbnails/26.jpg)
• 209 sessions conducted during the survey period
• 83 surveys returned – 38%
![Page 27: Measuring Outcomes & Libraries Illuminated · 3/14/2018 · About using virtual reality technology. 92% Increased their confidence Using ESL programming to learn English. 87% Intend](https://reader035.fdocuments.in/reader035/viewer/2022071002/5fbe7f4b60bdb0039c11bcf3/html5/thumbnails/27.jpg)
Survey Results: Quantitative
• 96% felt more knowledgeable about the job seeking process.
• 93% felt more confident about the job seeking process.
• 99% indicated they will use what they learned.
• 90% were more aware of library resources and services.
![Page 28: Measuring Outcomes & Libraries Illuminated · 3/14/2018 · About using virtual reality technology. 92% Increased their confidence Using ESL programming to learn English. 87% Intend](https://reader035.fdocuments.in/reader035/viewer/2022071002/5fbe7f4b60bdb0039c11bcf3/html5/thumbnails/28.jpg)
Survey Results: QualitativeWhat did you like most about the program?
• It gave me more tips to help me build a resume.
• I learned a lot about how to be presentable at a job interview.
• The job coach was very knowledgeable, helpful and friendly.
• The program provides people seeking guidance for their future, a safe place where they can get help and advice without judgment.
• I have more confidence now.
![Page 29: Measuring Outcomes & Libraries Illuminated · 3/14/2018 · About using virtual reality technology. 92% Increased their confidence Using ESL programming to learn English. 87% Intend](https://reader035.fdocuments.in/reader035/viewer/2022071002/5fbe7f4b60bdb0039c11bcf3/html5/thumbnails/29.jpg)
Survey Results: Qualitative What can the library do to better assist you?
• Offer more dates and times
• Post open library positions
• Host a job fair
• More literature on local jobs
• Provide additional technology training
• More opportunities to practice interviewing
![Page 30: Measuring Outcomes & Libraries Illuminated · 3/14/2018 · About using virtual reality technology. 92% Increased their confidence Using ESL programming to learn English. 87% Intend](https://reader035.fdocuments.in/reader035/viewer/2022071002/5fbe7f4b60bdb0039c11bcf3/html5/thumbnails/30.jpg)
Measuring Libraries Illuminated
![Page 31: Measuring Outcomes & Libraries Illuminated · 3/14/2018 · About using virtual reality technology. 92% Increased their confidence Using ESL programming to learn English. 87% Intend](https://reader035.fdocuments.in/reader035/viewer/2022071002/5fbe7f4b60bdb0039c11bcf3/html5/thumbnails/31.jpg)
Measuring Libraries Illuminated
What to measure? Libraries Illuminated programming
What not to measure? Collections, use of technology
Make it your own! Survey customization
![Page 32: Measuring Outcomes & Libraries Illuminated · 3/14/2018 · About using virtual reality technology. 92% Increased their confidence Using ESL programming to learn English. 87% Intend](https://reader035.fdocuments.in/reader035/viewer/2022071002/5fbe7f4b60bdb0039c11bcf3/html5/thumbnails/32.jpg)
Standardized Surveys Options
![Page 33: Measuring Outcomes & Libraries Illuminated · 3/14/2018 · About using virtual reality technology. 92% Increased their confidence Using ESL programming to learn English. 87% Intend](https://reader035.fdocuments.in/reader035/viewer/2022071002/5fbe7f4b60bdb0039c11bcf3/html5/thumbnails/33.jpg)
Education/Lifelong Learning Survey
1. You learned something new that is helpful
2. You feel more confident about what you just learned
3. You intend to apply what you just learned
4. You are more aware of resources and services provided by the library
What did you like the most about the programs?What could the library do to better assist you in learning more?
![Page 34: Measuring Outcomes & Libraries Illuminated · 3/14/2018 · About using virtual reality technology. 92% Increased their confidence Using ESL programming to learn English. 87% Intend](https://reader035.fdocuments.in/reader035/viewer/2022071002/5fbe7f4b60bdb0039c11bcf3/html5/thumbnails/34.jpg)
Education/Lifelong Learning Survey
Program examples include: Coding Virtual Reality STEM-activities Computer/technology classes English literacy programming Job-training or skills Tutoring/mentoring
![Page 35: Measuring Outcomes & Libraries Illuminated · 3/14/2018 · About using virtual reality technology. 92% Increased their confidence Using ESL programming to learn English. 87% Intend](https://reader035.fdocuments.in/reader035/viewer/2022071002/5fbe7f4b60bdb0039c11bcf3/html5/thumbnails/35.jpg)
Measuring Libraries Illuminated
www.ProjectOutcome.org
![Page 36: Measuring Outcomes & Libraries Illuminated · 3/14/2018 · About using virtual reality technology. 92% Increased their confidence Using ESL programming to learn English. 87% Intend](https://reader035.fdocuments.in/reader035/viewer/2022071002/5fbe7f4b60bdb0039c11bcf3/html5/thumbnails/36.jpg)
Measuring Libraries Illuminated
![Page 37: Measuring Outcomes & Libraries Illuminated · 3/14/2018 · About using virtual reality technology. 92% Increased their confidence Using ESL programming to learn English. 87% Intend](https://reader035.fdocuments.in/reader035/viewer/2022071002/5fbe7f4b60bdb0039c11bcf3/html5/thumbnails/37.jpg)
Measuring Libraries Illuminated
Begin program name with “LI:” Example – “LI: Coding for Kids”
![Page 38: Measuring Outcomes & Libraries Illuminated · 3/14/2018 · About using virtual reality technology. 92% Increased their confidence Using ESL programming to learn English. 87% Intend](https://reader035.fdocuments.in/reader035/viewer/2022071002/5fbe7f4b60bdb0039c11bcf3/html5/thumbnails/38.jpg)
Measuring Libraries Illuminated
Add your own custom intro & footer messages
![Page 39: Measuring Outcomes & Libraries Illuminated · 3/14/2018 · About using virtual reality technology. 92% Increased their confidence Using ESL programming to learn English. 87% Intend](https://reader035.fdocuments.in/reader035/viewer/2022071002/5fbe7f4b60bdb0039c11bcf3/html5/thumbnails/39.jpg)
Measuring Libraries Illuminated
![Page 40: Measuring Outcomes & Libraries Illuminated · 3/14/2018 · About using virtual reality technology. 92% Increased their confidence Using ESL programming to learn English. 87% Intend](https://reader035.fdocuments.in/reader035/viewer/2022071002/5fbe7f4b60bdb0039c11bcf3/html5/thumbnails/40.jpg)
Adding Survey Questions – CA DRAFT The library has the technology I need to do things.
The library has technology that I can’t access elsewhere.
I use technology in the library to... Checklist: Research, find information, do homework, communicate with others, create things, play, learn, other? Please check all that apply.
Other technology I would like to see in the library is... (Open)
The library is relevant to me.
I intend to return to the library.
California libraries have the technology to deliver information and services in the ways their communities expect and need.
![Page 41: Measuring Outcomes & Libraries Illuminated · 3/14/2018 · About using virtual reality technology. 92% Increased their confidence Using ESL programming to learn English. 87% Intend](https://reader035.fdocuments.in/reader035/viewer/2022071002/5fbe7f4b60bdb0039c11bcf3/html5/thumbnails/41.jpg)
Measuring Libraries Illuminated
![Page 42: Measuring Outcomes & Libraries Illuminated · 3/14/2018 · About using virtual reality technology. 92% Increased their confidence Using ESL programming to learn English. 87% Intend](https://reader035.fdocuments.in/reader035/viewer/2022071002/5fbe7f4b60bdb0039c11bcf3/html5/thumbnails/42.jpg)
Measuring Libraries Illuminated
![Page 43: Measuring Outcomes & Libraries Illuminated · 3/14/2018 · About using virtual reality technology. 92% Increased their confidence Using ESL programming to learn English. 87% Intend](https://reader035.fdocuments.in/reader035/viewer/2022071002/5fbe7f4b60bdb0039c11bcf3/html5/thumbnails/43.jpg)
Measuring Libraries Illuminated
![Page 44: Measuring Outcomes & Libraries Illuminated · 3/14/2018 · About using virtual reality technology. 92% Increased their confidence Using ESL programming to learn English. 87% Intend](https://reader035.fdocuments.in/reader035/viewer/2022071002/5fbe7f4b60bdb0039c11bcf3/html5/thumbnails/44.jpg)
Measuring Libraries Illuminated
Aggregate Libraries Illuminated results in report builder
![Page 45: Measuring Outcomes & Libraries Illuminated · 3/14/2018 · About using virtual reality technology. 92% Increased their confidence Using ESL programming to learn English. 87% Intend](https://reader035.fdocuments.in/reader035/viewer/2022071002/5fbe7f4b60bdb0039c11bcf3/html5/thumbnails/45.jpg)
Using Data to Take Action
95% Learned something new About using virtual reality technology
92% Increased their confidence Using ESL programming to learn English
87% Intend to use what they learned Application of coding for a job task
75% Are more aware of library resources Patrons are more aware of other technology-related
programs
![Page 46: Measuring Outcomes & Libraries Illuminated · 3/14/2018 · About using virtual reality technology. 92% Increased their confidence Using ESL programming to learn English. 87% Intend](https://reader035.fdocuments.in/reader035/viewer/2022071002/5fbe7f4b60bdb0039c11bcf3/html5/thumbnails/46.jpg)
Using Data to Take Action
State-level staff: Aggregate data across all libraries To communicate the value of Libraries
Illuminated Use data to advocate for new support Future program planning purposes
![Page 47: Measuring Outcomes & Libraries Illuminated · 3/14/2018 · About using virtual reality technology. 92% Increased their confidence Using ESL programming to learn English. 87% Intend](https://reader035.fdocuments.in/reader035/viewer/2022071002/5fbe7f4b60bdb0039c11bcf3/html5/thumbnails/47.jpg)
Tips for Getting Started
![Page 48: Measuring Outcomes & Libraries Illuminated · 3/14/2018 · About using virtual reality technology. 92% Increased their confidence Using ESL programming to learn English. 87% Intend](https://reader035.fdocuments.in/reader035/viewer/2022071002/5fbe7f4b60bdb0039c11bcf3/html5/thumbnails/48.jpg)
Tips for Libraries
![Page 49: Measuring Outcomes & Libraries Illuminated · 3/14/2018 · About using virtual reality technology. 92% Increased their confidence Using ESL programming to learn English. 87% Intend](https://reader035.fdocuments.in/reader035/viewer/2022071002/5fbe7f4b60bdb0039c11bcf3/html5/thumbnails/49.jpg)
Identify Needs
What do you hope to do with what you learn?Programming changesCommunication/AdvocacyFundingStrategic planningPartnerships
![Page 50: Measuring Outcomes & Libraries Illuminated · 3/14/2018 · About using virtual reality technology. 92% Increased their confidence Using ESL programming to learn English. 87% Intend](https://reader035.fdocuments.in/reader035/viewer/2022071002/5fbe7f4b60bdb0039c11bcf3/html5/thumbnails/50.jpg)
Measure Outcomes
Prepare ahead of time: Use paper survey Print survey ahead of time Anonymous drop box Explain the WHY Allow time for responses
![Page 51: Measuring Outcomes & Libraries Illuminated · 3/14/2018 · About using virtual reality technology. 92% Increased their confidence Using ESL programming to learn English. 87% Intend](https://reader035.fdocuments.in/reader035/viewer/2022071002/5fbe7f4b60bdb0039c11bcf3/html5/thumbnails/51.jpg)
Review Results
o Read through paper responseso Recruit a volunteer to help with data entryo A little bit of data can say a lot
![Page 52: Measuring Outcomes & Libraries Illuminated · 3/14/2018 · About using virtual reality technology. 92% Increased their confidence Using ESL programming to learn English. 87% Intend](https://reader035.fdocuments.in/reader035/viewer/2022071002/5fbe7f4b60bdb0039c11bcf3/html5/thumbnails/52.jpg)
Take Action
Target one key activityProgramming changesCommunication/AdvocacyFundingStrategic planningPartnerships
Take Action!
![Page 53: Measuring Outcomes & Libraries Illuminated · 3/14/2018 · About using virtual reality technology. 92% Increased their confidence Using ESL programming to learn English. 87% Intend](https://reader035.fdocuments.in/reader035/viewer/2022071002/5fbe7f4b60bdb0039c11bcf3/html5/thumbnails/53.jpg)
Ready, Set, Measure!
Register for FREE at www.projectoutcome.org
Tutorial videos to help you get started
Case studies to learn more about how libraries are using their data to take action
Follow us on social media
#ProjectOutcome www.projectoutcome.org
![Page 54: Measuring Outcomes & Libraries Illuminated · 3/14/2018 · About using virtual reality technology. 92% Increased their confidence Using ESL programming to learn English. 87% Intend](https://reader035.fdocuments.in/reader035/viewer/2022071002/5fbe7f4b60bdb0039c11bcf3/html5/thumbnails/54.jpg)
Questions?