16.00 ks mon pyle
-
Upload
uksg-connecting-the-knowledge-community -
Category
Technology
-
view
990 -
download
1
Transcript of 16.00 ks mon pyle
![Page 1: 16.00 ks mon pyle](https://reader035.fdocuments.in/reader035/viewer/2022062319/55508aacb4c905a85c8b4cf7/html5/thumbnails/1.jpg)
12 April 2023 1
Enhancing life-long learning, teaching and research through information resources and services
![Page 2: 16.00 ks mon pyle](https://reader035.fdocuments.in/reader035/viewer/2022062319/55508aacb4c905a85c8b4cf7/html5/thumbnails/2.jpg)
12 April 2023 2
Fast, autonomous and verifiable:piloting a new method for gathering library usage statistics independently from the resource provider
Richard Cross, Nottingham Trent University
Joshua M Pyle, Dublin Six
UKSG Conference April 2014, Harrogate
![Page 3: 16.00 ks mon pyle](https://reader035.fdocuments.in/reader035/viewer/2022062319/55508aacb4c905a85c8b4cf7/html5/thumbnails/3.jpg)
12 April 2023 3
Abstract
Metrics about the use of library resources is a growing preoccupation for all library services concerned to demonstrate value-for-money on their resource budgets and prove that their customers are using the materials they acquire. In 2013 Nottingham Trent University became the first UK university to begin piloting the new AUDITOR application from US start-up Dublin Six. The AUDITOR combines sophisticated web traffic logging (at the network level) with a range of analytical and reporting tools to provide COUNTER-compliant usage data for library resources, which is collated and analysed independently of any publisher service. In contrast to the time-delayed (and ultimately unverifiable) data offered by publisher websites, the AUDITOR generates usage analytics based on the verifiable network traffic of the institution, producing reports which reflect near real-time usage. As well as having immediate value in itself, this autonomous usage statistics service will, as the product develops, support a range of proactive services designed to improve the library customer experience (through more timely responses to interruptions in online publisher services) and enhance collection management processes (by offering responsive analytics on events such as 'turnaways'). This session will introduce the key features of the AUDITOR application; explain how and why NTU chose to be such an early adopter of the AUDITOR; and describe how the library service at NTU will be leveraging the data and reporting tools that the AUDITOR provides to improve service management and delivery.
![Page 4: 16.00 ks mon pyle](https://reader035.fdocuments.in/reader035/viewer/2022062319/55508aacb4c905a85c8b4cf7/html5/thumbnails/4.jpg)
12 April 2023 4
Agenda
• The importance of usage data
• The challenge of partial usage data
• Resource usage management at Nottingham Trent University
• Attractions of the AUDITOR pilot
• Committing to the AUDITOR pilot
• The need for institutional buy-in
• Participating in the AUDITOR pilot
• AUDITOR demonstration
• Next stages and future developments
![Page 5: 16.00 ks mon pyle](https://reader035.fdocuments.in/reader035/viewer/2022062319/55508aacb4c905a85c8b4cf7/html5/thumbnails/5.jpg)
12 April 2023 5
The importance of usage data
• Enabling evidence based acquisition and subscription planning
• Supporting ‘cost per use’ and other value-for-money calculations
• Demonstrating of customer engagement (or disengagement)
• Informing collection management and profile review
• Tracking ‘anticipated’ against ‘actual’ resource use
• Underpinning cross-institution benchmarking
• Delivery quantitative data that can demonstrate– Library service’s resource match to learning, teaching and resource needs– The continuing case for the resource budget
![Page 6: 16.00 ks mon pyle](https://reader035.fdocuments.in/reader035/viewer/2022062319/55508aacb4c905a85c8b4cf7/html5/thumbnails/6.jpg)
12 April 2023 6
The challenge of partial usage data
• Some electronic publishers provide no usage data
• Some providers provide bespoke, idiosyncratic usage data
• COUNTER is a strong and widely adopted standard for journals, books and databases – but is silent on some critically important variables
• Next to no usage standards exist for non-standard, non-text based materials
• Libraries have access to range of other access and ‘log in’ metrics for resource platforms (GA, discovery portal, link resolver, Shibboleth, eZproxy or Athens log counts)
• No single all-encompassing framework for calculating electronic resource use across the online collection
![Page 7: 16.00 ks mon pyle](https://reader035.fdocuments.in/reader035/viewer/2022062319/55508aacb4c905a85c8b4cf7/html5/thumbnails/7.jpg)
12 April 2023 7
The issue with provider usage data
• Confidence and dependability
• Despite COUNTER, counting mechanisms are not transparent
• No ability to independently audit or verify
• Delay – after-the-fact data, released to the publisher’s schedule
• Instances where publishers have withdrawn and republished data
• SUSHI protocol has reduced manual overhead, but process can still be staff-resource intensive
• Provide ‘compliance’ with SUSHI, COUNTER and other standards can be ‘aspirational’
![Page 8: 16.00 ks mon pyle](https://reader035.fdocuments.in/reader035/viewer/2022062319/55508aacb4c905a85c8b4cf7/html5/thumbnails/8.jpg)
12 April 2023 8
Resource usage data management at NTU
• UStat (Ex Libris): SUSHI and manual COUNTER JR1, DB1 (from 2009)
• JUSP (JISC): SUSHI JR1 (from 2013)
• Manual: spreadsheets for BR1
• Manual: spreadsheets for non-COUNTER (recording variety of metrics)
• None: rump of subscription resource providers offering no data
• None: free-to-access, open-access resources outside of subscription
• Application usage data: Primo, SFX,
• System logs: Shibboleth, eZproxy
![Page 9: 16.00 ks mon pyle](https://reader035.fdocuments.in/reader035/viewer/2022062319/55508aacb4c905a85c8b4cf7/html5/thumbnails/9.jpg)
12 April 2023 9
Attractions of the AUDITOR pilot
Short-term
• Independent, verifiable usage data
• Real-time access to usage data
Medium to longer-term
• Collect data for non-COUNTER compliant resources
• Capture service interruptions, access fails and resource turnaways
• Enable user-responsive services in the event of failures and lock-outs
• Benefit from pro-active alerting of platform issues
![Page 10: 16.00 ks mon pyle](https://reader035.fdocuments.in/reader035/viewer/2022062319/55508aacb4c905a85c8b4cf7/html5/thumbnails/10.jpg)
12 April 2023 10
Committing to the AUDITOR pilot programme
• Met with Dublin Six at UKSG conference in 2012
• Discussed possibility of involvement in trialing the AUDITOR software during active first-phase development
• Libraries and Learning Resources at Nottingham Trent University has extensive track record of ‘early adoption’ of emergent library technologies and services
• Quickly won the backing of SMT of the library service to commit
![Page 11: 16.00 ks mon pyle](https://reader035.fdocuments.in/reader035/viewer/2022062319/55508aacb4c905a85c8b4cf7/html5/thumbnails/11.jpg)
12 April 2023 11
The need for institutional buy-in
• Library services and Information Systems (IS) teams at NTU have strong collaborative ethic
• Remained key for IS to be supportive of the pilot – because of the local network and data copying components
• Required extensive legal and contractual discussion to secure the sign-up– Location of the data– Access to the data– Exclusions from the data tracking– Governance– Change management
![Page 12: 16.00 ks mon pyle](https://reader035.fdocuments.in/reader035/viewer/2022062319/55508aacb4c905a85c8b4cf7/html5/thumbnails/12.jpg)
12 April 2023 12
Participating in the AUDITOR pilot
• Put simply – the AUDITOR is compromised of three components– Specialised logging software: deployed to the institutional network which
copies the imprint of ‘packets’ of network traffic being sent/returned to/from the web
– Analytical software: interprets and unpacks the raw web logs, mapping them to set of access behaviours on known resource providers web sites
– Reporting and services software: delivers analytics, reports and responsive services for librarians and end-users based on the analysed data
• For the pilot, LLR facilitated, with the support of IS, the deployment of Dublin Six’s servers and software to the NTU network
• IS provided expertise to configure environment, configure secure, managed access, ensure no compromise to the integrity, security or performance of the network
• Discussion began in April 2012, pilot began in early 2013
![Page 13: 16.00 ks mon pyle](https://reader035.fdocuments.in/reader035/viewer/2022062319/55508aacb4c905a85c8b4cf7/html5/thumbnails/13.jpg)
12 April 2023 13
Introduction to the AUDITOR
• Passive, Integrated Access Checking• Comprehensive Link Fault Detection
Holdings Verification
• Comprehensive, Real-time Consolidation • Contribution-level Granularity• Local, Indefinite Archival
Usage Logging
• Comparative, Integrated Availability• Comparative Performance
Performance Monitoring
![Page 14: 16.00 ks mon pyle](https://reader035.fdocuments.in/reader035/viewer/2022062319/55508aacb4c905a85c8b4cf7/html5/thumbnails/14.jpg)
12 April 2023 14
![Page 15: 16.00 ks mon pyle](https://reader035.fdocuments.in/reader035/viewer/2022062319/55508aacb4c905a85c8b4cf7/html5/thumbnails/15.jpg)
12 April 2023 15
![Page 16: 16.00 ks mon pyle](https://reader035.fdocuments.in/reader035/viewer/2022062319/55508aacb4c905a85c8b4cf7/html5/thumbnails/16.jpg)
12 April 2023 16
![Page 17: 16.00 ks mon pyle](https://reader035.fdocuments.in/reader035/viewer/2022062319/55508aacb4c905a85c8b4cf7/html5/thumbnails/17.jpg)
12 April 2023 17
![Page 18: 16.00 ks mon pyle](https://reader035.fdocuments.in/reader035/viewer/2022062319/55508aacb4c905a85c8b4cf7/html5/thumbnails/18.jpg)
12 April 2023 18
![Page 19: 16.00 ks mon pyle](https://reader035.fdocuments.in/reader035/viewer/2022062319/55508aacb4c905a85c8b4cf7/html5/thumbnails/19.jpg)
12 April 2023 19
![Page 20: 16.00 ks mon pyle](https://reader035.fdocuments.in/reader035/viewer/2022062319/55508aacb4c905a85c8b4cf7/html5/thumbnails/20.jpg)
12 April 2023 20
![Page 21: 16.00 ks mon pyle](https://reader035.fdocuments.in/reader035/viewer/2022062319/55508aacb4c905a85c8b4cf7/html5/thumbnails/21.jpg)
12 April 2023 21
![Page 22: 16.00 ks mon pyle](https://reader035.fdocuments.in/reader035/viewer/2022062319/55508aacb4c905a85c8b4cf7/html5/thumbnails/22.jpg)
12 April 2023 22
![Page 23: 16.00 ks mon pyle](https://reader035.fdocuments.in/reader035/viewer/2022062319/55508aacb4c905a85c8b4cf7/html5/thumbnails/23.jpg)
12 April 2023 23
![Page 24: 16.00 ks mon pyle](https://reader035.fdocuments.in/reader035/viewer/2022062319/55508aacb4c905a85c8b4cf7/html5/thumbnails/24.jpg)
12 April 2023 24
![Page 25: 16.00 ks mon pyle](https://reader035.fdocuments.in/reader035/viewer/2022062319/55508aacb4c905a85c8b4cf7/html5/thumbnails/25.jpg)
12 April 2023 25
![Page 26: 16.00 ks mon pyle](https://reader035.fdocuments.in/reader035/viewer/2022062319/55508aacb4c905a85c8b4cf7/html5/thumbnails/26.jpg)
12 April 2023 26
![Page 27: 16.00 ks mon pyle](https://reader035.fdocuments.in/reader035/viewer/2022062319/55508aacb4c905a85c8b4cf7/html5/thumbnails/27.jpg)
12 April 2023 27
![Page 28: 16.00 ks mon pyle](https://reader035.fdocuments.in/reader035/viewer/2022062319/55508aacb4c905a85c8b4cf7/html5/thumbnails/28.jpg)
12 April 2023 28
![Page 29: 16.00 ks mon pyle](https://reader035.fdocuments.in/reader035/viewer/2022062319/55508aacb4c905a85c8b4cf7/html5/thumbnails/29.jpg)
12 April 2023 29
![Page 30: 16.00 ks mon pyle](https://reader035.fdocuments.in/reader035/viewer/2022062319/55508aacb4c905a85c8b4cf7/html5/thumbnails/30.jpg)
12 April 2023 30
![Page 31: 16.00 ks mon pyle](https://reader035.fdocuments.in/reader035/viewer/2022062319/55508aacb4c905a85c8b4cf7/html5/thumbnails/31.jpg)
12 April 2023 31
![Page 32: 16.00 ks mon pyle](https://reader035.fdocuments.in/reader035/viewer/2022062319/55508aacb4c905a85c8b4cf7/html5/thumbnails/32.jpg)
12 April 2023 32
![Page 33: 16.00 ks mon pyle](https://reader035.fdocuments.in/reader035/viewer/2022062319/55508aacb4c905a85c8b4cf7/html5/thumbnails/33.jpg)
12 April 2023 33
Catalog Integration – Holdings Verification
![Page 34: 16.00 ks mon pyle](https://reader035.fdocuments.in/reader035/viewer/2022062319/55508aacb4c905a85c8b4cf7/html5/thumbnails/34.jpg)
12 April 2023 34
Catalog Integration – Holdings Verification
![Page 35: 16.00 ks mon pyle](https://reader035.fdocuments.in/reader035/viewer/2022062319/55508aacb4c905a85c8b4cf7/html5/thumbnails/35.jpg)
12 April 2023 35
Catalog Integration – Holdings Verification
![Page 36: 16.00 ks mon pyle](https://reader035.fdocuments.in/reader035/viewer/2022062319/55508aacb4c905a85c8b4cf7/html5/thumbnails/36.jpg)
12 April 2023 36
Catalog Integration – Holdings Verification
![Page 37: 16.00 ks mon pyle](https://reader035.fdocuments.in/reader035/viewer/2022062319/55508aacb4c905a85c8b4cf7/html5/thumbnails/37.jpg)
12 April 2023 37
Catalog Integration – Performance Monitoring
![Page 38: 16.00 ks mon pyle](https://reader035.fdocuments.in/reader035/viewer/2022062319/55508aacb4c905a85c8b4cf7/html5/thumbnails/38.jpg)
12 April 2023 38
Catalog Integration – Performance Monitoring
![Page 39: 16.00 ks mon pyle](https://reader035.fdocuments.in/reader035/viewer/2022062319/55508aacb4c905a85c8b4cf7/html5/thumbnails/39.jpg)
12 April 2023 39
Catalog Integration – Performance Monitoring
![Page 40: 16.00 ks mon pyle](https://reader035.fdocuments.in/reader035/viewer/2022062319/55508aacb4c905a85c8b4cf7/html5/thumbnails/40.jpg)
12 April 2023 40
Catalog Integration – Performance Monitoring
![Page 41: 16.00 ks mon pyle](https://reader035.fdocuments.in/reader035/viewer/2022062319/55508aacb4c905a85c8b4cf7/html5/thumbnails/41.jpg)
12 April 2023 41
Next stages in the AUDITOR pilot process
• Library to validate, QA and compare AUDITOR usage data with resource provider usage reports
• Begin process of evaluating AUDITOR library reports and services
• Focus discussions with selected providers on opportunities and challenges (for them) of the AUDITOR approach
• Whilst remaining an active development partner, agree with Dublin Six the tipping points that will enable us to move from pilot to full-scale production
• Consider how best to merge, integrate, blend or supplement AUDITOR data with data gathered in UStat, JUSP, RAPTOR, and application usage data
![Page 42: 16.00 ks mon pyle](https://reader035.fdocuments.in/reader035/viewer/2022062319/55508aacb4c905a85c8b4cf7/html5/thumbnails/42.jpg)
12 April 2023 42
The AUDITOR: future developments
• Working to test and assist development of service layers of the AUDITOR
• With Dublin Six, exploring the potential for recording usage for non-standard library resources
• Investigate potential for combining tracking of Shibboleth, eZproxy and off-campus use
![Page 43: 16.00 ks mon pyle](https://reader035.fdocuments.in/reader035/viewer/2022062319/55508aacb4c905a85c8b4cf7/html5/thumbnails/43.jpg)
12 April 2023 43
Questions and comments?
Fast, autonomous and verifiable
Richard Cross, Resource Discovery and Innovation Manager
Libraries and Learning Resources, Nottingham Trent University
+44(0)115 848 4878 | [email protected]
Joshua M Pyle, Dublin Six