preSCORE Presentation by Adam Etkin for Highwire Fall 2013 Meeting
-
Upload
adam-etkin -
Category
Technology
-
view
384 -
download
0
description
Transcript of preSCORE Presentation by Adam Etkin for Highwire Fall 2013 Meeting
![Page 1: preSCORE Presentation by Adam Etkin for Highwire Fall 2013 Meeting](https://reader035.fdocuments.in/reader035/viewer/2022062406/5592bc711a28abf9408b457f/html5/thumbnails/1.jpg)
preSCOREpeer review evaluation SCORE –
A new set of metrics for today’s information ecosystem
![Page 2: preSCORE Presentation by Adam Etkin for Highwire Fall 2013 Meeting](https://reader035.fdocuments.in/reader035/viewer/2022062406/5592bc711a28abf9408b457f/html5/thumbnails/2.jpg)
Traditional peer review seems to be under constant criticism
![Page 3: preSCORE Presentation by Adam Etkin for Highwire Fall 2013 Meeting](https://reader035.fdocuments.in/reader035/viewer/2022062406/5592bc711a28abf9408b457f/html5/thumbnails/3.jpg)
Cases of faulty research being published seem to support the critics
![Page 4: preSCORE Presentation by Adam Etkin for Highwire Fall 2013 Meeting](https://reader035.fdocuments.in/reader035/viewer/2022062406/5592bc711a28abf9408b457f/html5/thumbnails/4.jpg)
The recent Bohannon “sting” highlights the problem
![Page 5: preSCORE Presentation by Adam Etkin for Highwire Fall 2013 Meeting](https://reader035.fdocuments.in/reader035/viewer/2022062406/5592bc711a28abf9408b457f/html5/thumbnails/5.jpg)
But this problem isn’t new & isn’t just an OA problem
It’s about Peer Review.
![Page 6: preSCORE Presentation by Adam Etkin for Highwire Fall 2013 Meeting](https://reader035.fdocuments.in/reader035/viewer/2022062406/5592bc711a28abf9408b457f/html5/thumbnails/6.jpg)
What is preSCORE?
These are extreme examples which make news, however surveys indicate that most researchers value peer review. Different approaches are not easy to identify. preSCORE is a new tool that generates a metric indicating the level of peer review conducted.
Both article and journal level metrics are included in preSCORE.
![Page 7: preSCORE Presentation by Adam Etkin for Highwire Fall 2013 Meeting](https://reader035.fdocuments.in/reader035/viewer/2022062406/5592bc711a28abf9408b457f/html5/thumbnails/7.jpg)
Creating a Different Metric
Calculated metric includes other “best practices” Not a lagging indicator, a leading indicator Newer initiatives such as altmetrics offer more immediate,
useful info, but this is also post-publication. We focus on pre-publication peer-review, which sets it apart from other metrics
Supports filtering and differentiation, both critical to readers and researchers
![Page 8: preSCORE Presentation by Adam Etkin for Highwire Fall 2013 Meeting](https://reader035.fdocuments.in/reader035/viewer/2022062406/5592bc711a28abf9408b457f/html5/thumbnails/8.jpg)
Who Benefits?
Readers Authors Publishers/Journals Librarians
![Page 9: preSCORE Presentation by Adam Etkin for Highwire Fall 2013 Meeting](https://reader035.fdocuments.in/reader035/viewer/2022062406/5592bc711a28abf9408b457f/html5/thumbnails/9.jpg)
How Does It Work?
Export tagged metadata from peer review system
Pull reviewer h-index from Thomson-Reuters Metadata and h-index analyzed by preSCORE,
and the score is calculated preSCORE passed as needed via API and
made available on journal page displays, within article metrics, and so on
![Page 10: preSCORE Presentation by Adam Etkin for Highwire Fall 2013 Meeting](https://reader035.fdocuments.in/reader035/viewer/2022062406/5592bc711a28abf9408b457f/html5/thumbnails/10.jpg)
preSCORE and preVAL
preSCORE is the “heart” of the system Not focused on good/bad numbers preVAL answers the first, most basic
question…“Was this peer reviewed?” This allows users to drill in for more details if
they want Allows journals to share additional info
![Page 11: preSCORE Presentation by Adam Etkin for Highwire Fall 2013 Meeting](https://reader035.fdocuments.in/reader035/viewer/2022062406/5592bc711a28abf9408b457f/html5/thumbnails/11.jpg)
Examples
![Page 12: preSCORE Presentation by Adam Etkin for Highwire Fall 2013 Meeting](https://reader035.fdocuments.in/reader035/viewer/2022062406/5592bc711a28abf9408b457f/html5/thumbnails/12.jpg)
Drill Down for Details
![Page 13: preSCORE Presentation by Adam Etkin for Highwire Fall 2013 Meeting](https://reader035.fdocuments.in/reader035/viewer/2022062406/5592bc711a28abf9408b457f/html5/thumbnails/13.jpg)
Project Status
Currently completing development with ScholarOne and Aries
Beta testing underway Expect to launch in 2014 Anyone who would like more info OR
publishers/journals who wish to participate in beta testing, please contact me directly