Data, evidence and outcomes
-
Upload
jmatthews -
Category
Health & Medicine
-
view
258 -
download
1
description
Transcript of Data, evidence and outcomes
![Page 1: Data, evidence and outcomes](https://reader035.fdocuments.in/reader035/viewer/2022081602/5565bfc5d8b42a5b488b49ad/html5/thumbnails/1.jpg)
Data, Evidence and Outcomes
Joe Matthews
American Library Association
Sponsored by Counting Opinions
June 28, 2014
![Page 2: Data, evidence and outcomes](https://reader035.fdocuments.in/reader035/viewer/2022081602/5565bfc5d8b42a5b488b49ad/html5/thumbnails/2.jpg)
Need for Data
Making management decisions
Increase program & service effectiveness
Justifying budgets
Evaluating performance
Doing advocacy
![Page 3: Data, evidence and outcomes](https://reader035.fdocuments.in/reader035/viewer/2022081602/5565bfc5d8b42a5b488b49ad/html5/thumbnails/3.jpg)
Types of Data
Quantitative
Counting Surveys
evaluation of services Customer satisfaction
Qualitative
![Page 4: Data, evidence and outcomes](https://reader035.fdocuments.in/reader035/viewer/2022081602/5565bfc5d8b42a5b488b49ad/html5/thumbnails/4.jpg)
Purpose
The purpose of any data gathering activity
& analysis is to INFORM
![Page 5: Data, evidence and outcomes](https://reader035.fdocuments.in/reader035/viewer/2022081602/5565bfc5d8b42a5b488b49ad/html5/thumbnails/5.jpg)
Strategies
User versus library’s perspective
Examining trends
Comparing libraries
Social context
Outcomes
![Page 6: Data, evidence and outcomes](https://reader035.fdocuments.in/reader035/viewer/2022081602/5565bfc5d8b42a5b488b49ad/html5/thumbnails/6.jpg)
User’s Perspective
How well?
How courteous?
How responsive?
How satisfied?
![Page 7: Data, evidence and outcomes](https://reader035.fdocuments.in/reader035/viewer/2022081602/5565bfc5d8b42a5b488b49ad/html5/thumbnails/7.jpg)
How courteous?
Welcoming
Attentive
![Page 8: Data, evidence and outcomes](https://reader035.fdocuments.in/reader035/viewer/2022081602/5565bfc5d8b42a5b488b49ad/html5/thumbnails/8.jpg)
How responsive?
Anticipatory
Helpful
Empathetic
![Page 9: Data, evidence and outcomes](https://reader035.fdocuments.in/reader035/viewer/2022081602/5565bfc5d8b42a5b488b49ad/html5/thumbnails/9.jpg)
How satisfied?
Expectations met Materials obtained Personal interaction Ease of use Equipment used Environment Comfort Willingness to return
![Page 10: Data, evidence and outcomes](https://reader035.fdocuments.in/reader035/viewer/2022081602/5565bfc5d8b42a5b488b49ad/html5/thumbnails/10.jpg)
Library’s Perspective
How much?
How many?
How prompt?
How economical?
![Page 11: Data, evidence and outcomes](https://reader035.fdocuments.in/reader035/viewer/2022081602/5565bfc5d8b42a5b488b49ad/html5/thumbnails/11.jpg)
How much?
Magnitude
Percent of change from last year
Percent of overall change
Cost
![Page 12: Data, evidence and outcomes](https://reader035.fdocuments.in/reader035/viewer/2022081602/5565bfc5d8b42a5b488b49ad/html5/thumbnails/12.jpg)
How many?
Magnitude
Change
![Page 13: Data, evidence and outcomes](https://reader035.fdocuments.in/reader035/viewer/2022081602/5565bfc5d8b42a5b488b49ad/html5/thumbnails/13.jpg)
How prompt?
Cycle times
Turnaround time
Wait times
Anticipatory
![Page 14: Data, evidence and outcomes](https://reader035.fdocuments.in/reader035/viewer/2022081602/5565bfc5d8b42a5b488b49ad/html5/thumbnails/14.jpg)
How economical?
Resources used
Units processed
Productivity
![Page 15: Data, evidence and outcomes](https://reader035.fdocuments.in/reader035/viewer/2022081602/5565bfc5d8b42a5b488b49ad/html5/thumbnails/15.jpg)
Library & Customers Perspective
How valuable?
How reliable?
How accurate?
How well?
![Page 16: Data, evidence and outcomes](https://reader035.fdocuments.in/reader035/viewer/2022081602/5565bfc5d8b42a5b488b49ad/html5/thumbnails/16.jpg)
How valuable?
Effort expended
Costs
Benefits obtained
![Page 17: Data, evidence and outcomes](https://reader035.fdocuments.in/reader035/viewer/2022081602/5565bfc5d8b42a5b488b49ad/html5/thumbnails/17.jpg)
How reliable?
Dependability/Consistency
Access
Accuracy
![Page 18: Data, evidence and outcomes](https://reader035.fdocuments.in/reader035/viewer/2022081602/5565bfc5d8b42a5b488b49ad/html5/thumbnails/18.jpg)
How accurate?
Completeness
Comprehensiveness
Currency
![Page 19: Data, evidence and outcomes](https://reader035.fdocuments.in/reader035/viewer/2022081602/5565bfc5d8b42a5b488b49ad/html5/thumbnails/19.jpg)
How well?
Accuracy
Promptness
Courtesy
Expertise
![Page 20: Data, evidence and outcomes](https://reader035.fdocuments.in/reader035/viewer/2022081602/5565bfc5d8b42a5b488b49ad/html5/thumbnails/20.jpg)
Outcomes
Change in a person’s life
Affective – attitudes, confidence, satisfaction
Behavioral
Knowledge-based
Competency-based – apply new skills
![Page 21: Data, evidence and outcomes](https://reader035.fdocuments.in/reader035/viewer/2022081602/5565bfc5d8b42a5b488b49ad/html5/thumbnails/21.jpg)
Tracking Trends
Year-to-year trends
Comparing trends
Indexing dollars for inflation
Indexing budgets for cost of living
Projecting future needs
![Page 22: Data, evidence and outcomes](https://reader035.fdocuments.in/reader035/viewer/2022081602/5565bfc5d8b42a5b488b49ad/html5/thumbnails/22.jpg)
Comparing Libraries
Identifying peers
Individual vs. grouped data
Rankings
![Page 23: Data, evidence and outcomes](https://reader035.fdocuments.in/reader035/viewer/2022081602/5565bfc5d8b42a5b488b49ad/html5/thumbnails/23.jpg)
Comparing Libraries Examples
Comparing Peers – criteria ?
Rankings
Percentages/grouped data
Summary stats
Benchmarking/standards
![Page 24: Data, evidence and outcomes](https://reader035.fdocuments.in/reader035/viewer/2022081602/5565bfc5d8b42a5b488b49ad/html5/thumbnails/24.jpg)
Libraries in Social Context
Social, political, & economic environment
Focusing on decision-makers’ concerns
Finding the right data
Creating the “hook”
![Page 25: Data, evidence and outcomes](https://reader035.fdocuments.in/reader035/viewer/2022081602/5565bfc5d8b42a5b488b49ad/html5/thumbnails/25.jpg)
Social Context Examples
PLs rank 2nd behind fire protection among local government services
Visits to PLs outnumber professional football attendance of X annually by a factor of Y
PLs loan 4.5 million items per day – FedEx delivers about 1.75 million packages each day
![Page 26: Data, evidence and outcomes](https://reader035.fdocuments.in/reader035/viewer/2022081602/5565bfc5d8b42a5b488b49ad/html5/thumbnails/26.jpg)
Evidence How can evidence contribute to the quality
of the decision making process?
What are the risks, costs, and benefits of an evidence-based approach?
Ensure that objective evidence is reflected in the decision making process.
![Page 27: Data, evidence and outcomes](https://reader035.fdocuments.in/reader035/viewer/2022081602/5565bfc5d8b42a5b488b49ad/html5/thumbnails/27.jpg)
Evidence
Depends on the need
BIG DATA
Combine data
![Page 28: Data, evidence and outcomes](https://reader035.fdocuments.in/reader035/viewer/2022081602/5565bfc5d8b42a5b488b49ad/html5/thumbnails/28.jpg)
Source of Data
IMLS data
ARL data
PLAmetrics
ACRLMetrics
Edge Initiative
Impact Survey – UW
Evidence-based Library & Information Practice
![Page 29: Data, evidence and outcomes](https://reader035.fdocuments.in/reader035/viewer/2022081602/5565bfc5d8b42a5b488b49ad/html5/thumbnails/29.jpg)
Collection Insights
collectionHQ – selection, management, promotion
Reports from your ILS
![Page 30: Data, evidence and outcomes](https://reader035.fdocuments.in/reader035/viewer/2022081602/5565bfc5d8b42a5b488b49ad/html5/thumbnails/30.jpg)
Patron Perspective
Segmentation analytics
Demographics
Lifestyles
Geography
Benefit segmentation
![Page 31: Data, evidence and outcomes](https://reader035.fdocuments.in/reader035/viewer/2022081602/5565bfc5d8b42a5b488b49ad/html5/thumbnails/31.jpg)
Program Priorities
Track program measures
Provide programs tied to strategic goals –
aligned with community needs
Early childhood education School age education support Economic development Community engagement . . .
![Page 32: Data, evidence and outcomes](https://reader035.fdocuments.in/reader035/viewer/2022081602/5565bfc5d8b42a5b488b49ad/html5/thumbnails/32.jpg)
Advocacy Hooks
Use data for presentations
Use data to target likely voters
Use data to demonstrate value in the life of your customers
![Page 33: Data, evidence and outcomes](https://reader035.fdocuments.in/reader035/viewer/2022081602/5565bfc5d8b42a5b488b49ad/html5/thumbnails/33.jpg)
Outcomes
Libraries cannot demonstrate value
until they define outcomes
of institutional relevance
and then measure the degree
to which they attain them
![Page 34: Data, evidence and outcomes](https://reader035.fdocuments.in/reader035/viewer/2022081602/5565bfc5d8b42a5b488b49ad/html5/thumbnails/34.jpg)
Outcomes
Focus on the end results
Logic Model
Orr’s Input-Process-Output-Outcomes Model
![Page 35: Data, evidence and outcomes](https://reader035.fdocuments.in/reader035/viewer/2022081602/5565bfc5d8b42a5b488b49ad/html5/thumbnails/35.jpg)
Logic Model
use the if then exercise
![Page 36: Data, evidence and outcomes](https://reader035.fdocuments.in/reader035/viewer/2022081602/5565bfc5d8b42a5b488b49ad/html5/thumbnails/36.jpg)
If the library provides assistance to students with their
homework then the students will do better
with their schoolwork.
If they do better with their schoolwork
then they will get better grades and attend more regularly.
If they get better grades and attend more regularly
then they are more likely to graduate.
If they graduate then they are more
likely to become employed and have a
higher standard of living.
![Page 37: Data, evidence and outcomes](https://reader035.fdocuments.in/reader035/viewer/2022081602/5565bfc5d8b42a5b488b49ad/html5/thumbnails/37.jpg)
Orr’s Model
Input Process Output Outcome Impact
![Page 38: Data, evidence and outcomes](https://reader035.fdocuments.in/reader035/viewer/2022081602/5565bfc5d8b42a5b488b49ad/html5/thumbnails/38.jpg)
Gates Common Impact Measurement System
Digital inclusion
Culture & Leisure
Education
Communication
Health
Economic Development
![Page 39: Data, evidence and outcomes](https://reader035.fdocuments.in/reader035/viewer/2022081602/5565bfc5d8b42a5b488b49ad/html5/thumbnails/39.jpg)
Academic Library Outcomes
Student Learning
Teaching Effectiveness
Research
![Page 40: Data, evidence and outcomes](https://reader035.fdocuments.in/reader035/viewer/2022081602/5565bfc5d8b42a5b488b49ad/html5/thumbnails/40.jpg)
Public Library Outcomes PLA Performance Measurement Task Force
Focus is on programs and their outcomes
Summer Reading Programs
Early Childhood Education Programs
Civic Engagement
Digital Access & Learning
Economic Development
![Page 41: Data, evidence and outcomes](https://reader035.fdocuments.in/reader035/viewer/2022081602/5565bfc5d8b42a5b488b49ad/html5/thumbnails/41.jpg)
Communication
Know your customer needs
What’s going to resonate
Data + stories = success
Focus on value – not how busy you are
![Page 42: Data, evidence and outcomes](https://reader035.fdocuments.in/reader035/viewer/2022081602/5565bfc5d8b42a5b488b49ad/html5/thumbnails/42.jpg)
Data, Evidence and Outcomes
Joe AT JoeMatthews.Org