Library Metrics and Measurement

download Library Metrics and Measurement

of 52

Transcript of Library Metrics and Measurement

  • 8/13/2019 Library Metrics and Measurement

    1/52

    LIBRARY METRICS AND

    MEASUREMENT:COUNTING WHAT COUNTS &

    MAKING IT MATTER

    Emily Clasper

    Wild Wisconsin Winter Web Conference 2014

  • 8/13/2019 Library Metrics and Measurement

    2/52

    Todays Big Question

  • 8/13/2019 Library Metrics and Measurement

    3/52

    http://farm6.staticflickr.com/5478/11442225495_0ff925eda3_o.jpg

  • 8/13/2019 Library Metrics and Measurement

    4/52

    Library Statistics

    Circulation Transactions

    Door Count

    Reference Questions

    Web site visits

    Program Attendance

    Collection Inventory

    Staff Actions

    http://farm7.staticflickr.com/6074/6033655868_6b53ef4ebb_b.jpg

  • 8/13/2019 Library Metrics and Measurement

    5/52

    The Panicked Call

    Weve been doing

    so well! How can ourstats all be down?

    http://farm9.staticflickr.com/8006/7706143020_e533940f18_b.jpg

  • 8/13/2019 Library Metrics and Measurement

    6/52

    Depending on Our Numbers

    Securing Funds

    Justifying expenses

    Complying with mandates

    Gaining support fromstakeholders

    Demonstrating the value ofservices, ROI

    Data-driven decision making Allocation of our internal

    resources

    Service development decisions

    http://farm3.staticflickr.com/2602/3678747186_b63d82fe2c_o.jpg

  • 8/13/2019 Library Metrics and Measurement

    7/52

    Moving Beyond Circ Stats

    https://reader010.{domain}/reader010/html5/0621/5b2b441239fda/5b2b44161c114.jpg

  • 8/13/2019 Library Metrics and Measurement

    8/52

    Asking The Right Questions

    htt : farm3.staticflickr.com 2318 2201907500 6f0741be40 o.

  • 8/13/2019 Library Metrics and Measurement

    9/52

    The Wrong Question

    http://static.flickr.com/7062/6845000770_ebd5fb87d5.jpg

    We bought a 3-D printer

    and it seems to get a lot of

    use, but circulation down!

  • 8/13/2019 Library Metrics and Measurement

    10/52

    The Wrong Question

    http://farm5.staticflickr.com/4141/4817786416_282faf5324_o.jpg

    That long jumper seems like

    a really strong athlete, but

    she doesnt run very fast!

  • 8/13/2019 Library Metrics and Measurement

    11/52

    Asking New Questions

    Is this a question that we can

    Will the answer lead to new

    Does this knowledge help us assess our

    Can this assessment be used to suggest

    Will the actions help lead us closer to our

  • 8/13/2019 Library Metrics and Measurement

    12/52

    Go Back to Your Goals

    http://farm3.staticflickr.com/2773/4318924726_85eae8b991_o.jpg

  • 8/13/2019 Library Metrics and Measurement

    13/52

    Outputs vs. Outcomes

    http://farm5.staticflickr.com/4040/5143354092_e15831241a_b.jpg http://static.flickr.com/2565/3810230521_35410d4b38.jpg

  • 8/13/2019 Library Metrics and Measurement

    14/52

    Outcomes Measurement

    Inputs Activities Output InterimOutcomes

    Outcomes Goals

    Process Results of Process

    Library Perspective: What

    Library Does/Provides

    User Perspective: Results of

    the Users Experience

    Adapted from: Rubin, Rhea Joyce. 2006.Demonstrating Results: Using Outcome Measurement in Your Library

    . PLA ResultsSeries. Chicago: American Library Association.

  • 8/13/2019 Library Metrics and Measurement

    15/52

    What Defines Success?

    What is it that were

    actually trying to DO?

    How will we know if

    weve accomplished

    that goal?

  • 8/13/2019 Library Metrics and Measurement

    16/52

    Data Collection

    http://static.flickr.com/2423/3971932491_27e5acf65b.jpg

  • 8/13/2019 Library Metrics and Measurement

    17/52

    What Data Do We Need?

    http://farm9.staticflickr.com/8514/8450658347_06c56211f9_b.jpg

  • 8/13/2019 Library Metrics and Measurement

    18/52

    Key Performance Indicators

    Measureable

    Indicates progress towards goals

    Actionable Measured frequently and consistently

    May be objective or subjective

  • 8/13/2019 Library Metrics and Measurement

    19/52

    Library KPIs Can Take Many Forms

    http://www.bu.edu/library/files/2013/03/Faculty-Satisfaction-Services.bmp

    0

    50,000

    100,000

    150,000

    200,000

    250,000

    12

    am-

    1am

    3-

    4

    am

    4-

    5

    am

    5-

    6

    am

    6-

    7

    am

    7-

    8

    am

    8-

    9

    am

    9-

    10

    am

    10-

    11

    am

    11a

    m-

    12pm

    12-

    1

    pm

    1-

    2

    pm

    2-

    3

    pm

    3-

    4

    pm

    4-

    5

    pm

    5-

    6

    pm

    6-

    7

    pm

    7-

    8

    pm

    8-

    9

    pm

    9-

    10

    pm

    10-

    11

    pm

    11p

    m-

    12am

  • 8/13/2019 Library Metrics and Measurement

    20/52

    KPIs as Strategic Goals

    By 2015, 80% of users surveyed will indicate that theywaited no longer than three minutes for staff assistanceat a public service desk.

    By 2015, at least 85% of all purchased items will beinvoiced, cataloged, processed, ad sent for shelvingwithin two weeks of receipt.

    By 2016, the number of children aged 6-11 withlibrary cards will increase from X to Y.

    Each year, a minimum of 80% of adults and teens whoattend a training session on how to use technology tocreate content will indicate that the training session wasvery good or excellent.

  • 8/13/2019 Library Metrics and Measurement

    21/52

    Qualitative Measures

    https://reader010.{domain}/reader010/html5/0621/5b2b441239fda/5b2b441de9037.jpg

  • 8/13/2019 Library Metrics and Measurement

    22/52

    Standards

    http://farm7.staticflickr.com/6049/6372676915_b651c4614d_o.jpg

  • 8/13/2019 Library Metrics and Measurement

    23/52

    Open Data

    http://static.flickr.com/5002/5265955179_4a33d2f2cb.jpg

  • 8/13/2019 Library Metrics and Measurement

    24/52

    Available Tools

    https://reader010.{domain}/reader010/html5/0621/5b2b441239fda/5b2b441fafc01.jpg https://reader010.{domain}/reader010/html5/0621/5b2b44

  • 8/13/2019 Library Metrics and Measurement

    25/52

    Available Tools

    htt : online.ws .com news articles SB10001424052702303332904579230401030827722

  • 8/13/2019 Library Metrics and Measurement

    26/52

    Questions for Data Collection

    Are we counting effectively?

    What structures do libraries have in place for

    gathering performance data?

    What kind of models can we emulate for improvingour data collection strategies?

    How do we get closer to gathering qualitative

    measures as well?

    http://farm3.staticflickr.com/2197/2200500024_33038620af_o.jpg

  • 8/13/2019 Library Metrics and Measurement

    27/52

    Use of Tools

    http://farm4.staticflickr.com/3119/3132662146_b305c1c058_b.jpg

  • 8/13/2019 Library Metrics and Measurement

    28/52

    Accessing and Storing Data

    http://farm4.staticflickr.com/3245/2294144289_3102e0de26_o.jpg

  • 8/13/2019 Library Metrics and Measurement

    29/52

    Analysis and Interpretation

    http://farm3.staticflickr.com/2173/2121472112_8ac5d673ff_b.jpg

  • 8/13/2019 Library Metrics and Measurement

    30/52

    Now That We Have The Data

    http://static.flickr.com/6017/5961260280_f38d3cbee9.jpg

  • 8/13/2019 Library Metrics and Measurement

    31/52

    Drawing Conclusions

    http://farm9.staticflickr.com/8389/8597760704_70f681d096_k.jpg

  • 8/13/2019 Library Metrics and Measurement

    32/52

    What Does This Really Mean?

    http://farm3.staticflickr.com/2891/9354301543_30e405da0a_b.jpg

  • 8/13/2019 Library Metrics and Measurement

    33/52

    Using Data for Good, Not Evil

    http://farm4.staticflickr.com/3674/10868394285_6a10dc9e99_b.jpg

  • 8/13/2019 Library Metrics and Measurement

    34/52

    Making it Matter

    http://static.flickr.com/5213/5397741531_84b940fea1.jpg

  • 8/13/2019 Library Metrics and Measurement

    35/52

    Using and Presenting Data

    http://farm9.staticflickr.com/8330/8436405977_d0613c3cac_b.jpg

  • 8/13/2019 Library Metrics and Measurement

    36/52

    http://farm6.staticflickr.com/5144/5659510216_657431c231_b.jpg

    Making Data Easy to Understand

  • 8/13/2019 Library Metrics and Measurement

    37/52

    http://farm3.staticflickr.com/2842/10950781743_5ffecf486c_o.png

    Making Data Relatable

  • 8/13/2019 Library Metrics and Measurement

    38/52

    Making Decisions

    http://www.nytimes.com/newsgraphics/2014/01/05/poverty-map/

    http://www.nytimes.com/newsgraphics/2014/01/05/poverty-map/http://www.nytimes.com/newsgraphics/2014/01/05/poverty-map/http://www.nytimes.com/newsgraphics/2014/01/05/poverty-map/http://www.nytimes.com/newsgraphics/2014/01/05/poverty-map/
  • 8/13/2019 Library Metrics and Measurement

    39/52

    http://farm8.staticflickr.com/7018/6785112263_1bdc801df8_o.png

    Making Connections

  • 8/13/2019 Library Metrics and Measurement

    40/52

    http://farm9.staticflickr.com/8192/8112404383_669f0c715a_h.jpg

    Making a Point

  • 8/13/2019 Library Metrics and Measurement

    41/52

    http://farm2.staticflickr.com/1128/585861831_c3647f199d_b.jpg

    Making an Impression

  • 8/13/2019 Library Metrics and Measurement

    42/52

    Telling a Story

    http://media-cache-

    ak0.pinimg.com/736x/43/80/84/438084e70887229c890b9deae32a0db1.jpghttp://media-cache-

    ec0.pinimg.com/736x/9f/c2/aa/9fc2aa3f178ff11634dfe236bd68b96c.jpg

  • 8/13/2019 Library Metrics and Measurement

    43/52

    Promoting a Brand

    http://obieosobalu.files.wordpress.com/2011/01/history-of-microsoft-final.jpg http://www.coca-colacompany.com/our-company/infographic-coca-cola-at-a-glance

  • 8/13/2019 Library Metrics and Measurement

    44/52

    http://www.heroicpixels.com/wp-

    content/uploads/2013/02/school_library_impact_blog13.jpg

    http://www.thisblogrules.com/wp-content/uploads/2011/07/lib-550x317.jpg

    https://fbcdn-sphotos-e-a.akamaihd.net/hphotos-ak-ash3/1229853_10151835031660743_782695969_n.jpg

  • 8/13/2019 Library Metrics and Measurement

    45/52

    Turning Outcomes Into Impact

    htt : media-cache-ec0. inim .com 736x 6d 23 29 6d232935bd4317fdf3547144ebad6dba.

  • 8/13/2019 Library Metrics and Measurement

    46/52

    Moving Forward

    http://farm5.staticflickr.com/4062/4529934744_98a8f4bcc7_o.png

  • 8/13/2019 Library Metrics and Measurement

    47/52

    Questions for Libraries

    What areas of measurement might we get into in

    response to changing organizational goals?

    How can we present the data we gather and the

    conclusions we draw from it to more effectivelydemonstrate success, promote the library and its goals,

    boost productivity, make more informed decisions, tell

    the librarys story to stakeholders?

    What skills do we, as Information Pros, Managers, andAdvocates need to develop in order to effectively make

    analytics the powerful tool we need it to be?

  • 8/13/2019 Library Metrics and Measurement

    48/52

    http://farm8.staticflickr.com/7171/6632168217_bdc32df214_b.jpg

    Do We Have the Skills?

  • 8/13/2019 Library Metrics and Measurement

    49/52

    http://farm1.staticflickr.com/113/286709039_105881e4b9_o.jpg

    Do We Have The Tools?

  • 8/13/2019 Library Metrics and Measurement

    50/52

    Can We Make it Matter?

    htt : media-cache-ec0. inim .com 736x 6d 23 29 6d232935bd4317fdf3547144ebad6dba.

  • 8/13/2019 Library Metrics and Measurement

    51/52

    Recommended Reading

    Brophy, Peter. 2006. Measuring Library Performance: Principles and Techniques. London: Facet.

    Hernon, Peter, Robert E. Dugan, and Joseph R. Matthews. 2014. Getting Started with Evaluation. Chicago:

    American Library Association.

    Ishak, Das. 2014. Discovering the Right Key Performance Indicators in Libraries: A Review of Literatures.

    Accessed January 14.

    http://www.academia.edu/1805631/Discovering_the_right_key_performance_indicators_in_libraries_a_review

    _of_literatures. Larkin, Richard. 2013. Using Outcomes to Measure Nonprofit Success. NPQ - Nonprofit Quarterly. July 2.

    http://www.nonprofitquarterly.org/management/22549-using-outcomes-to-measure-nonprofit-success.html.

    Matthews, Joseph R. 2007. The Evaluation and Measurement of Library Services. Westport, Conn: Libraries

    Unlimited.

    Rubin, Rhea Joyce. 2006. Demonstrating Results: Using Outcome Measurement in Your Library . PLA Results Series.

    Chicago: American Library Association.

    Webbmedia Group. 20:12:02 UTC. Key Performance Indicators For Libraries. Education.

    http://www.slideshare.net/webbmedia/key-performance-indicators-for-libraries.

    Wolf, Lesile. 2010. What Gets Measured Gets Done: Key Performance Indicators. California Digital Library.

    http://www.cdlib.org/cdlinfo/2010/09/15/what-gets-measured-gets-done-key-performance-indicators/.

    Zappone, Marisa. 2013. Why It Makes Sense for Nonprofits To Focus on Contribution, Not Causation.

    Greenlights for Nonprofit Success. http://www.greenlights.org/blog/2013/09/16/why-it-makes-sense-for-

    nonprofits-to-focus-on-contribution-not-causation/#more-7572.

    http://www.academia.edu/1805631/Discovering_the_right_key_performance_indicators_in_libraries_a_review_of_literatures.http://www.academia.edu/1805631/Discovering_the_right_key_performance_indicators_in_libraries_a_review_of_literatures.http://www.nonprofitquarterly.org/management/22549-using-outcomes-to-measure-nonprofit-success.html.http://www.slideshare.net/webbmedia/key-performance-indicators-for-libraries.http://www.cdlib.org/cdlinfo/2010/09/15/what-gets-measured-gets-done-key-performance-indicators/http://greenlights%20for%20nonprofit%20success.%20http/www.greenlights.org/blog/2013/09/16/why-it-makes-sense-for-nonprofits-to-focus-on-contribution-not-causation/#more-7572http://greenlights%20for%20nonprofit%20success.%20http/www.greenlights.org/blog/2013/09/16/why-it-makes-sense-for-nonprofits-to-focus-on-contribution-not-causation/#more-7572http://greenlights%20for%20nonprofit%20success.%20http/www.greenlights.org/blog/2013/09/16/why-it-makes-sense-for-nonprofits-to-focus-on-contribution-not-causation/#more-7572http://greenlights%20for%20nonprofit%20success.%20http/www.greenlights.org/blog/2013/09/16/why-it-makes-sense-for-nonprofits-to-focus-on-contribution-not-causation/#more-7572http://greenlights%20for%20nonprofit%20success.%20http/www.greenlights.org/blog/2013/09/16/why-it-makes-sense-for-nonprofits-to-focus-on-contribution-not-causation/#more-7572http://greenlights%20for%20nonprofit%20success.%20http/www.greenlights.org/blog/2013/09/16/why-it-makes-sense-for-nonprofits-to-focus-on-contribution-not-causation/#more-7572http://greenlights%20for%20nonprofit%20success.%20http/www.greenlights.org/blog/2013/09/16/why-it-makes-sense-for-nonprofits-to-focus-on-contribution-not-causation/#more-7572http://greenlights%20for%20nonprofit%20success.%20http/www.greenlights.org/blog/2013/09/16/why-it-makes-sense-for-nonprofits-to-focus-on-contribution-not-causation/#more-7572http://greenlights%20for%20nonprofit%20success.%20http/www.greenlights.org/blog/2013/09/16/why-it-makes-sense-for-nonprofits-to-focus-on-contribution-not-causation/#more-7572http://greenlights%20for%20nonprofit%20success.%20http/www.greenlights.org/blog/2013/09/16/why-it-makes-sense-for-nonprofits-to-focus-on-contribution-not-causation/#more-7572http://greenlights%20for%20nonprofit%20success.%20http/www.greenlights.org/blog/2013/09/16/why-it-makes-sense-for-nonprofits-to-focus-on-contribution-not-causation/#more-7572http://greenlights%20for%20nonprofit%20success.%20http/www.greenlights.org/blog/2013/09/16/why-it-makes-sense-for-nonprofits-to-focus-on-contribution-not-causation/#more-7572http://greenlights%20for%20nonprofit%20success.%20http/www.greenlights.org/blog/2013/09/16/why-it-makes-sense-for-nonprofits-to-focus-on-contribution-not-causation/#more-7572http://greenlights%20for%20nonprofit%20success.%20http/www.greenlights.org/blog/2013/09/16/why-it-makes-sense-for-nonprofits-to-focus-on-contribution-not-causation/#more-7572http://greenlights%20for%20nonprofit%20success.%20http/www.greenlights.org/blog/2013/09/16/why-it-makes-sense-for-nonprofits-to-focus-on-contribution-not-causation/#more-7572http://greenlights%20for%20nonprofit%20success.%20http/www.greenlights.org/blog/2013/09/16/why-it-makes-sense-for-nonprofits-to-focus-on-contribution-not-causation/#more-7572http://greenlights%20for%20nonprofit%20success.%20http/www.greenlights.org/blog/2013/09/16/why-it-makes-sense-for-nonprofits-to-focus-on-contribution-not-causation/#more-7572http://greenlights%20for%20nonprofit%20success.%20http/www.greenlights.org/blog/2013/09/16/why-it-makes-sense-for-nonprofits-to-focus-on-contribution-not-causation/#more-7572http://greenlights%20for%20nonprofit%20success.%20http/www.greenlights.org/blog/2013/09/16/why-it-makes-sense-for-nonprofits-to-focus-on-contribution-not-causation/#more-7572http://greenlights%20for%20nonprofit%20success.%20http/www.greenlights.org/blog/2013/09/16/why-it-makes-sense-for-nonprofits-to-focus-on-contribution-not-causation/#more-7572http://greenlights%20for%20nonprofit%20success.%20http/www.greenlights.org/blog/2013/09/16/why-it-makes-sense-for-nonprofits-to-focus-on-contribution-not-causation/#more-7572http://greenlights%20for%20nonprofit%20success.%20http/www.greenlights.org/blog/2013/09/16/why-it-makes-sense-for-nonprofits-to-focus-on-contribution-not-causation/#more-7572http://greenlights%20for%20nonprofit%20success.%20http/www.greenlights.org/blog/2013/09/16/why-it-makes-sense-for-nonprofits-to-focus-on-contribution-not-causation/#more-7572http://greenlights%20for%20nonprofit%20success.%20http/www.greenlights.org/blog/2013/09/16/why-it-makes-sense-for-nonprofits-to-focus-on-contribution-not-causation/#more-7572http://greenlights%20for%20nonprofit%20success.%20http/www.greenlights.org/blog/2013/09/16/why-it-makes-sense-for-nonprofits-to-focus-on-contribution-not-causation/#more-7572http://greenlights%20for%20nonprofit%20success.%20http/www.greenlights.org/blog/2013/09/16/why-it-makes-sense-for-nonprofits-to-focus-on-contribution-not-causation/#more-7572http://greenlights%20for%20nonprofit%20success.%20http/www.greenlights.org/blog/2013/09/16/why-it-makes-sense-for-nonprofits-to-focus-on-contribution-not-causation/#more-7572http://www.cdlib.org/cdlinfo/2010/09/15/what-gets-measured-gets-done-key-performance-indicators/http://www.cdlib.org/cdlinfo/2010/09/15/what-gets-measured-gets-done-key-performance-indicators/http://www.cdlib.org/cdlinfo/2010/09/15/what-gets-measured-gets-done-key-performance-indicators/http://www.cdlib.org/cdlinfo/2010/09/15/what-gets-measured-gets-done-key-performance-indicators/http://www.cdlib.org/cdlinfo/2010/09/15/what-gets-measured-gets-done-key-performance-indicators/http://www.cdlib.org/cdlinfo/2010/09/15/what-gets-measured-gets-done-key-performance-indicators/http://www.cdlib.org/cdlinfo/2010/09/15/what-gets-measured-gets-done-key-performance-indicators/http://www.cdlib.org/cdlinfo/2010/09/15/what-gets-measured-gets-done-key-performance-indicators/http://www.cdlib.org/cdlinfo/2010/09/15/what-gets-measured-gets-done-key-performance-indicators/http://www.cdlib.org/cdlinfo/2010/09/15/what-gets-measured-gets-done-key-performance-indicators/http://www.cdlib.org/cdlinfo/2010/09/15/what-gets-measured-gets-done-key-performance-indicators/http://www.cdlib.org/cdlinfo/2010/09/15/what-gets-measured-gets-done-key-performance-indicators/http://www.cdlib.org/cdlinfo/2010/09/15/what-gets-measured-gets-done-key-performance-indicators/http://www.cdlib.org/cdlinfo/2010/09/15/what-gets-measured-gets-done-key-performance-indicators/http://www.cdlib.org/cdlinfo/2010/09/15/what-gets-measured-gets-done-key-performance-indicators/http://www.slideshare.net/webbmedia/key-performance-indicators-for-libraries.http://www.slideshare.net/webbmedia/key-performance-indicators-for-libraries.http://www.slideshare.net/webbmedia/key-performance-indicators-for-libraries.http://www.slideshare.net/webbmedia/key-performance-indicators-for-libraries.http://www.slideshare.net/webbmedia/key-performance-indicators-for-libraries.http://www.slideshare.net/webbmedia/key-performance-indicators-for-libraries.http://www.slideshare.net/webbmedia/key-performance-indicators-for-libraries.http://www.slideshare.net/webbmedia/key-performance-indicators-for-libraries.http://www.slideshare.net/webbmedia/key-performance-indicators-for-libraries.http://www.nonprofitquarterly.org/management/22549-using-outcomes-to-measure-nonprofit-success.html.http://www.nonprofitquarterly.org/management/22549-using-outcomes-to-measure-nonprofit-success.html.http://www.nonprofitquarterly.org/management/22549-using-outcomes-to-measure-nonprofit-success.html.http://www.nonprofitquarterly.org/management/22549-using-outcomes-to-measure-nonprofit-success.html.http://www.nonprofitquarterly.org/management/22549-using-outcomes-to-measure-nonprofit-success.html.http://www.nonprofitquarterly.org/management/22549-using-outcomes-to-measure-nonprofit-success.html.http://www.nonprofitquarterly.org/management/22549-using-outcomes-to-measure-nonprofit-success.html.http://www.nonprofitquarterly.org/management/22549-using-outcomes-to-measure-nonprofit-success.html.http://www.nonprofitquarterly.org/management/22549-using-outcomes-to-measure-nonprofit-success.html.http://www.nonprofitquarterly.org/management/22549-using-outcomes-to-measure-nonprofit-success.html.http://www.nonprofitquarterly.org/management/22549-using-outcomes-to-measure-nonprofit-success.html.http://www.nonprofitquarterly.org/management/22549-using-outcomes-to-measure-nonprofit-success.html.http://www.nonprofitquarterly.org/management/22549-using-outcomes-to-measure-nonprofit-success.html.http://www.academia.edu/1805631/Discovering_the_right_key_performance_indicators_in_libraries_a_review_of_literatures.http://www.academia.edu/1805631/Discovering_the_right_key_performance_indicators_in_libraries_a_review_of_literatures.
  • 8/13/2019 Library Metrics and Measurement

    52/52

    EMILY CLASPERHTTP://BIT.LY/CLASPERWWWC14

    http://eclasper.com

    http://bit.ly/clasperwwwc14http://bit.ly/clasperwwwc14http://bit.ly/clasperwwwc14