There's gold in them thar hills: linking library usage to student attainment
-
Upload
samantha-mason -
Category
Documents
-
view
21 -
download
2
description
Transcript of There's gold in them thar hills: linking library usage to student attainment
![Page 1: There's gold in them thar hills: linking library usage to student attainment](https://reader035.fdocuments.in/reader035/viewer/2022062422/56813751550346895d9ee419/html5/thumbnails/1.jpg)
There's gold in them thar hills: linking library usage to student attainment
Graham Stone
Information Resources Manager
SCONUL Conference
8-10 June 2011, Cardiff
http://eprints.hud.ac.uk/10654/#lidp#jiscad
![Page 2: There's gold in them thar hills: linking library usage to student attainment](https://reader035.fdocuments.in/reader035/viewer/2022062422/56813751550346895d9ee419/html5/thumbnails/2.jpg)
Background
• Huddersfield’s non/low usage project– Data from 700+ courses from 2005 onwards
– White, S and Stone, G (2010) Maximising use of library resources at the University of Huddersfield. Serials, 23 (2). pp. 83-90. http://eprints.hud.ac.uk/7811/
![Page 3: There's gold in them thar hills: linking library usage to student attainment](https://reader035.fdocuments.in/reader035/viewer/2022062422/56813751550346895d9ee419/html5/thumbnails/3.jpg)
3
Non/Low Use Projectdigging deeper into data
![Page 4: There's gold in them thar hills: linking library usage to student attainment](https://reader035.fdocuments.in/reader035/viewer/2022062422/56813751550346895d9ee419/html5/thumbnails/4.jpg)
4
Measuring Library Impact2008/9 honours graduates
![Page 5: There's gold in them thar hills: linking library usage to student attainment](https://reader035.fdocuments.in/reader035/viewer/2022062422/56813751550346895d9ee419/html5/thumbnails/5.jpg)
5
Measuring Library Impact2008/9 honours graduates
![Page 6: There's gold in them thar hills: linking library usage to student attainment](https://reader035.fdocuments.in/reader035/viewer/2022062422/56813751550346895d9ee419/html5/thumbnails/6.jpg)
6
Measuring Library Impact2008/9 honours graduates
![Page 7: There's gold in them thar hills: linking library usage to student attainment](https://reader035.fdocuments.in/reader035/viewer/2022062422/56813751550346895d9ee419/html5/thumbnails/7.jpg)
Results
• Analysis of the results consistently revealed a correlation between e-resource use, book borrowing and student attainment
• This appears to be the case across all disciplines
![Page 8: There's gold in them thar hills: linking library usage to student attainment](https://reader035.fdocuments.in/reader035/viewer/2022062422/56813751550346895d9ee419/html5/thumbnails/8.jpg)
…but
• Not a cause and effect relationship
• Never proved statistically significant
• Potential for collaboration on future projects
http://www.flickr.com/photos/rabinal/152126577/http://www.flickr.com/photos/caroslines/492277046/
![Page 9: There's gold in them thar hills: linking library usage to student attainment](https://reader035.fdocuments.in/reader035/viewer/2022062422/56813751550346895d9ee419/html5/thumbnails/9.jpg)
JISC Activity Data Call
• Obtained funding from the JISC Activity Data Call
• 6 month project (Feb-Jul 2011)
![Page 10: There's gold in them thar hills: linking library usage to student attainment](https://reader035.fdocuments.in/reader035/viewer/2022062422/56813751550346895d9ee419/html5/thumbnails/10.jpg)
Library Impact Data Project
![Page 11: There's gold in them thar hills: linking library usage to student attainment](https://reader035.fdocuments.in/reader035/viewer/2022062422/56813751550346895d9ee419/html5/thumbnails/11.jpg)
To prove the hypothesis that…
“There is a statistically significant correlation across a number of universities between library activity data
and student attainment”
![Page 12: There's gold in them thar hills: linking library usage to student attainment](https://reader035.fdocuments.in/reader035/viewer/2022062422/56813751550346895d9ee419/html5/thumbnails/12.jpg)
Project reports
• Themed posts– The Project Plan– Hypothesis– Users– Benefits– Technical and Standards– Licensing & reuse of
software and data– Wins and fails (lessons
along the way)– Final post
![Page 13: There's gold in them thar hills: linking library usage to student attainment](https://reader035.fdocuments.in/reader035/viewer/2022062422/56813751550346895d9ee419/html5/thumbnails/13.jpg)
Data requirements
• For each student who graduated in a given year, the following data was required:– Final grade achieved– Number of books borrowed– Number of times e-resources were accessed – Number of times each student entered the library, e.g. via a
turnstile system that requires identity card access– School/Faculty
![Page 14: There's gold in them thar hills: linking library usage to student attainment](https://reader035.fdocuments.in/reader035/viewer/2022062422/56813751550346895d9ee419/html5/thumbnails/14.jpg)
Legal issues
• Consultation with JISC Legal, University legal officer and data protection officer
• Ensured that any identifying information is excluded before it is handled for analysis
• Excluded any small courses to prevent identification of individuals e.g. where a course has less than 35 students and/or fewer than 5 of a specific degree level
![Page 15: There's gold in them thar hills: linking library usage to student attainment](https://reader035.fdocuments.in/reader035/viewer/2022062422/56813751550346895d9ee419/html5/thumbnails/15.jpg)
Using OpenURL Activity Data
“When you search for and/or access bibliographic resources such as journal articles…[the university] …captures and anonymises activity data which are then included in an aggregation of data about use of bibliographic resources… The aggregation is used as the basis of services for users in UK HE and is made available to the public so that others may use it as the basis of services. The aggregation contains no information that could identify you as an individual.”
![Page 16: There's gold in them thar hills: linking library usage to student attainment](https://reader035.fdocuments.in/reader035/viewer/2022062422/56813751550346895d9ee419/html5/thumbnails/16.jpg)
Data issues
• Anticipated that there may be problems in getting enough data to make the project viable– Potential partners were asked to confirm that they could provide
at least 2 of the 3 measures of usage as well as student grades– Huddersfield has provided definitions on the data required and
the form the data can be accepted in
• Some partners have already run into some issues with data collection, but it is felt that there is still enough information to prove the hypothesis one way or another
![Page 17: There's gold in them thar hills: linking library usage to student attainment](https://reader035.fdocuments.in/reader035/viewer/2022062422/56813751550346895d9ee419/html5/thumbnails/17.jpg)
Initial findings
• Is there gold in them thar hills?
• Probably!
http://www.flickr.com/photos/jthorstad/2203256491/
![Page 18: There's gold in them thar hills: linking library usage to student attainment](https://reader035.fdocuments.in/reader035/viewer/2022062422/56813751550346895d9ee419/html5/thumbnails/18.jpg)
Can we prove the hypothesis?
• Not quite!
• Due to the data not being continuous, a correlation cannot be calculated
http://www.flickr.com/photos/caroslines/492277046/
![Page 19: There's gold in them thar hills: linking library usage to student attainment](https://reader035.fdocuments.in/reader035/viewer/2022062422/56813751550346895d9ee419/html5/thumbnails/19.jpg)
Some Deep Thought
• Maybe we knew the answer…
• …but we didn’t ask the right question
![Page 20: There's gold in them thar hills: linking library usage to student attainment](https://reader035.fdocuments.in/reader035/viewer/2022062422/56813751550346895d9ee419/html5/thumbnails/20.jpg)
Further statistical tests (1)
• Running a Kruskal-Wallis test– to indicate whether there is
a difference between values e.g. between levels of e-resource usage across degree results
– THEN we analyse the data visually to check which variables to compare
![Page 21: There's gold in them thar hills: linking library usage to student attainment](https://reader035.fdocuments.in/reader035/viewer/2022062422/56813751550346895d9ee419/html5/thumbnails/21.jpg)
Further statistical tests (2)
• Running a the Mann-Whitney U test to see whether there is a significant difference between variables tested
• Initial findings imply that there is a relationship between usage and attainment
• And that these findings concur with previous tests using ANOVA and the Student T test
![Page 22: There's gold in them thar hills: linking library usage to student attainment](https://reader035.fdocuments.in/reader035/viewer/2022062422/56813751550346895d9ee419/html5/thumbnails/22.jpg)
What we think we can prove
• That the relationship and variance means that you can believe what you see
• And you can believe it across a range of data, e.g. subjects
• So library usage does impact on students attainment
70
60
45
30
83
65
41
27
0
20
40
60
80
100
1 2:1 2:2 3
MetaLib logins books borrowed
![Page 23: There's gold in them thar hills: linking library usage to student attainment](https://reader035.fdocuments.in/reader035/viewer/2022062422/56813751550346895d9ee419/html5/thumbnails/23.jpg)
Remember the disclaimer!
Not a cause and effect relationship
![Page 24: There's gold in them thar hills: linking library usage to student attainment](https://reader035.fdocuments.in/reader035/viewer/2022062422/56813751550346895d9ee419/html5/thumbnails/24.jpg)
Library Impact Data Projectbook loans inc. renewals (2009/10)
![Page 25: There's gold in them thar hills: linking library usage to student attainment](https://reader035.fdocuments.in/reader035/viewer/2022062422/56813751550346895d9ee419/html5/thumbnails/25.jpg)
25
Library Impact Data Projectbook loans & Athens (2009/10)
![Page 26: There's gold in them thar hills: linking library usage to student attainment](https://reader035.fdocuments.in/reader035/viewer/2022062422/56813751550346895d9ee419/html5/thumbnails/26.jpg)
26
Library Impact Data Projectlibrary PC logins & visits (2009/10)
![Page 27: There's gold in them thar hills: linking library usage to student attainment](https://reader035.fdocuments.in/reader035/viewer/2022062422/56813751550346895d9ee419/html5/thumbnails/27.jpg)
All we set out to do was prove the hypothesis
• At this early stage, for books and e-resource usage, there appears to be a statistical significance across all partner libraries
• If we know that there is a link between usage and attainment
– We can link this back to non/low usage
![Page 28: There's gold in them thar hills: linking library usage to student attainment](https://reader035.fdocuments.in/reader035/viewer/2022062422/56813751550346895d9ee419/html5/thumbnails/28.jpg)
28
Measuring Library Impact2008/9 – library visits
15.5% of students who gaineda 1st never visited the library
34% of students who gaineda 3rd never visited the library
![Page 29: There's gold in them thar hills: linking library usage to student attainment](https://reader035.fdocuments.in/reader035/viewer/2022062422/56813751550346895d9ee419/html5/thumbnails/29.jpg)
29
Measuring Library Impact2008/9 – MetaLib usage
10.5% of students who gained a1st logged in more than 180 times
![Page 30: There's gold in them thar hills: linking library usage to student attainment](https://reader035.fdocuments.in/reader035/viewer/2022062422/56813751550346895d9ee419/html5/thumbnails/30.jpg)
30
Measuring Library Impact2008/9 – book loans
15% of students who gaineda 1st never borrowed a book
34% of students who gaineda 3rd never borrowed a book
![Page 31: There's gold in them thar hills: linking library usage to student attainment](https://reader035.fdocuments.in/reader035/viewer/2022062422/56813751550346895d9ee419/html5/thumbnails/31.jpg)
Prospecting!
• By engaging non/low users we may be able to play a role in increasing attainment
• Find out why they don’t use resources
• Motivate/encourage?• Target our users by
concentrating staff resources at the right point
http://www.flickr.com/photos/tooliver/497511638/
![Page 32: There's gold in them thar hills: linking library usage to student attainment](https://reader035.fdocuments.in/reader035/viewer/2022062422/56813751550346895d9ee419/html5/thumbnails/32.jpg)
Book issues by final degree result
![Page 33: There's gold in them thar hills: linking library usage to student attainment](https://reader035.fdocuments.in/reader035/viewer/2022062422/56813751550346895d9ee419/html5/thumbnails/33.jpg)
Next steps for the project
• Finish statistical testing• Pull out any themes from the focus groups• Release the data on an Open Data Commons Licence• Release a toolkit to help others benchmark their data
![Page 34: There's gold in them thar hills: linking library usage to student attainment](https://reader035.fdocuments.in/reader035/viewer/2022062422/56813751550346895d9ee419/html5/thumbnails/34.jpg)
Future work
• To develop generic and subject specific information skills sessions
• To target promotion of resources at point of need
• To increase library use over time in areas of non/low use
http://www.flickr.com/photos/daniel_brunner/3092262373/
![Page 35: There's gold in them thar hills: linking library usage to student attainment](https://reader035.fdocuments.in/reader035/viewer/2022062422/56813751550346895d9ee419/html5/thumbnails/35.jpg)
Further questions?
• Will cuts to the information budget mean that attainment will fall?
• Can we add more value by better use of resources?– By analysing the data in conjunction with UCAS tariff points
![Page 36: There's gold in them thar hills: linking library usage to student attainment](https://reader035.fdocuments.in/reader035/viewer/2022062422/56813751550346895d9ee419/html5/thumbnails/36.jpg)
Better use leads to better attainment
![Page 37: There's gold in them thar hills: linking library usage to student attainment](https://reader035.fdocuments.in/reader035/viewer/2022062422/56813751550346895d9ee419/html5/thumbnails/37.jpg)
Acknowledgements
• Dave Pattern and Bryony Ramsden
• Phil Adams, Leo Appleton, Iain Baird, Polly Dawes, Regina Ferguson, Pia Krogh, Marie Letzgus, Dominic Marsh, Habby Matharoo, Kate Newell, Sarah Robbins, Paul Stainthorp
![Page 38: There's gold in them thar hills: linking library usage to student attainment](https://reader035.fdocuments.in/reader035/viewer/2022062422/56813751550346895d9ee419/html5/thumbnails/38.jpg)
Thank you
• Graham Stone• [email protected]• http://twitter.com/Graham_Stone
• http://library.hud.ac.uk/blogs/projects/lidp/
• http://eprints.hud.ac.uk/10654/