Rachel G. Rubin BEXLEY PUBLIC LIBRARY Enlighten Engage Inspire

download Rachel  G. Rubin BEXLEY PUBLIC LIBRARY Enlighten  Engage  Inspire

If you can't read please download the document

  • date post

  • Category


  • view

  • download


Embed Size (px)


Rachel G. Rubin BEXLEY PUBLIC LIBRARY Enlighten Engage Inspire. Engagement through evaluation: understanding and using data to connect to your community Everyday Advocacy 4/25/2013. Evaluation vs. assessment. Evaluation: Focused on making a judgment about quality - PowerPoint PPT Presentation

Transcript of Rachel G. Rubin BEXLEY PUBLIC LIBRARY Enlighten Engage Inspire

Bexley public Library

Rachel G. RubinBEXLEY PUBLIC LIBRARYEnlighten Engage InspireEngagement through evaluation: understanding and using data to connect to your community

Everyday Advocacy4/25/2013

1Evaluation: Focused on making a judgment about qualityTo document achievement against set standards

Assessment:Measures performance in order to produce feedback for improvementNon-judgmental

Evaluation vs. assessmentEvaluation: (grant? Pre/post test for SRC?)1. Final to gauge quality2. Whats been done/learned3. Externally imposed standards4. Judgmental overall score or gradeAssessment:1. Ongoing to improve2. Processhows it going? Take the temperature3. Reflective internally defined criteria/goals4. ID areas for improvement5. Adjust measures as problems are clarified

2Between 2011 and 2012, the number of kids with Bexley Public Library cards increased 14%.Some smiles?3

Lots of smiles.A word about data. Remember that ultimately in libraries, the data is about human beings, because our missions are about human beings. Even though the mission and goals of an academic library or a school library are not necessarily the same as a public librarys, the principals of data collection and advocacy are the same. So two most important drivers: Mission and People

4The number of kids with Bexley Public Library cards increased 14% from 2011-2012

Sometimes you need both.If youre going to advocate, you have to know what will have the most impact. For many stakeholders, it may be a combination of reason and emotion. Emotion trumps reason more often than you might think. If you want people to feel engaged, you need to grab their emotions. For public libraries, that may mean children. For academic libraries, it may be connected to student achievement. At the end of the day, you need data to back up your assertions, but using emotions helps!


Why collect data?Why do we collect data? To tell our stories betterTo help us improve our own performance by creating internal measures of success (assessment) (Why did the number of kids with cards go up?)To compare where we are against benchmarks set by other institutions (evaluation)Because we have to (SLO, IMLS)

WHO IS THE DATA FOR? Know your audience. With whom are you trying to connect? To whom are you advocating? (Are you advocating on behalf of your patrons/constituents or on behalf of your library?)

6Pew Internet and American Life Project: Librarieshttp://www.pewinternet.org/topics/Libraries.aspx?typeFilter=5


ALAImpact Research: http://www.ala.org/research/librariesmatter/State of Americas Libraries: http://www.ala.org/news/pr?id=12834Pew, oclc, imls, oh my!There is a lot of information out there already about what library patron behaviors, wants, and needs. Schools NCES. These are mostly for public libraries, and Im sure youre all familiar with the sources (youre all librarians) to find out information about general trends in your library type. 791% of Americans ages 16 and older say public libraries are important to their communities

Just 22% say they know all or most of the services their libraries offer now

Library Services in the Digital Age http://libraries.pewinternet.org/2013/01/22/library-services/National trends, local impactNational trends keep you thinking. Do national trends matter when youre trying to connect to your local community? Sure. Should libraries focus on this based on this information. Probably. But be smart about it. Many factors come to play in how national data translates locally, but it can help to frame the ways you seek to engage your own communities or structure your own data collection efforts. Maybe this is something you want to probe in your own community.DemographicsEconomicsEducationTechnology adoption and access

8Loco for local

Lets say you want to collect data in your community. For the purposes of this presentation were focusing on collecting data for advocacy and for driving services and communications that connect to your community.

9What do you want to know?Does the data youre collecting answer the questions you need to answer? What will you do with the information?Do you need help?Ready, fire, aimWe do this a lot in libraries-- We LOVE surveys and think they will solve all of our problems. Form AND substance are important. Before you dash off a survey, make sure that you have figured out what it is that you want to know. Is a survey the best way to answer the question? Is a survey really the best way to get at the issue? If so, do the questions youre asking answer the right question? You might actually need focus groups or maybe a interviews with community leaders or important stakeholders?

Universities often have research departments that can help with data collection. Many times libraries can do basic data collection on their own, but partnerships with other non-profits, local universities, etc, depending on what youre looking for, can also be helpful. Again, depending on what youre going for, you can also buy some pre-packaged data collection instruments. Library Journal Patron Profiles. 10Counting opinions

Some survey instruments are already made for you this is a satisfaction survey that runs on our website all the time. Most public and school libraries dont have the expertise on hand to do survey design and data collection and analysis. If you want to do a large scale project, you can work with a company like Counting Opinions, or other firms that do in-depth community engagement surveys. How big do you need this to be? Are you just looking for how people feel about your programs? Or are you looking for larger scale community needs assessments? 11Counting Opinions

Local Data CollectionDashboard tells us where we are and will compare us to othersOn a scale of 1-10, Bexley Public Library patrons report an average:Satisfaction with staff of 9.05Average importance of 9.18Average likely to reuse score of 9.45An average recommend to others score of 9.21

12Business decision

Much more information than from the census (although the census is also a good start, .) From a few years ago BD uses ESRI data. Exports graphically, does market segmentation what are people interested in? etc. Can be very useful, but not library centric. 13Evaluation formsDid this program/service/training/class meet your expectations?Ongoing FeedbackTell us how were doing!Surveys and Focus GroupsInformal/Anecdotal


This is the most underemphasized skill in data gathering. Listen to what people are telling you with their actions, their words, and their data. 15Advocate

http://ebookfriendly.com/2013/04/05/libraries-matter-5-fantastic-library-infographics/Data collection is advocacy. Advocacy happens when you communicate effectively. -Infographics-Letters to the editor-Facts-PicturesWho is your audience? 16advocate

http://www.ala.org/offices/sites/ala.org.offices/files/content/QuotableFacts.2012_0.pdf17Library Advocates Handbookhttp://www.ala.org/offices/ola/libraryadvocateshandbookAdvocacy Universityhttp://www.ala.org/advocacy/advleg/advocacyuniversity

Advocacy toolsLAH: is a .pdfAU: is a list of resources to help you be a better advocate18

connectUse what you learn and hear to improve your services. Sometimes the best advocacy technique is just to do great work. Demonstrate that youre listening. Be responsive to the changing needs and demographics of the people you serve.

But dont underestimate the value of being prepared and of know why something came to be. Your decisions should be backed up with evidence, whenever possible, even if its not from a survey or it cant be quantified. 19

Ask the right questions.Dont collect data for data collections sake. If youre going to gather your own data, first you need to ask the right questions:

Can be very basic:How many more children attend our programming than last year?

Can be more complex:How have the demographics of my community/classroom/student body changed in the last five years? What do they want or need from library services?What information does my legislator need so that she does not cut our funding?What programs does my community value the most?