Metrics: The New Black?
-
Upload
kristen-fisher-ratan -
Category
Technology
-
view
2.896 -
download
1
description
Transcript of Metrics: The New Black?
![Page 1: Metrics: The New Black?](https://reader034.fdocuments.in/reader034/viewer/2022052600/558630acd8b42a32618b4e83/html5/thumbnails/1.jpg)
Metrics:
The New Black?
Kristen Fisher Ratan
NFAIS 2012
![Page 2: Metrics: The New Black?](https://reader034.fdocuments.in/reader034/viewer/2022052600/558630acd8b42a32618b4e83/html5/thumbnails/2.jpg)
The web is getting personal
![Page 3: Metrics: The New Black?](https://reader034.fdocuments.in/reader034/viewer/2022052600/558630acd8b42a32618b4e83/html5/thumbnails/3.jpg)
![Page 4: Metrics: The New Black?](https://reader034.fdocuments.in/reader034/viewer/2022052600/558630acd8b42a32618b4e83/html5/thumbnails/4.jpg)
![Page 5: Metrics: The New Black?](https://reader034.fdocuments.in/reader034/viewer/2022052600/558630acd8b42a32618b4e83/html5/thumbnails/5.jpg)
![Page 6: Metrics: The New Black?](https://reader034.fdocuments.in/reader034/viewer/2022052600/558630acd8b42a32618b4e83/html5/thumbnails/6.jpg)
Can Web Metrics Indicate Research Impact?
![Page 7: Metrics: The New Black?](https://reader034.fdocuments.in/reader034/viewer/2022052600/558630acd8b42a32618b4e83/html5/thumbnails/7.jpg)
Metrics:
The New Black?
Kristen Fisher Ratan
NFAIS 2012
![Page 8: Metrics: The New Black?](https://reader034.fdocuments.in/reader034/viewer/2022052600/558630acd8b42a32618b4e83/html5/thumbnails/8.jpg)
Research Dissemination IS
Research Impact
![Page 9: Metrics: The New Black?](https://reader034.fdocuments.in/reader034/viewer/2022052600/558630acd8b42a32618b4e83/html5/thumbnails/9.jpg)
•Citations •Web usage •Star Ratings •Social bookmarking •Community rating •Media/blog coverage •Commenting activity •and more…
Dissemination creates indicators of impact
Dissemination Publication
Article Level Metrics (ALMs)
![Page 10: Metrics: The New Black?](https://reader034.fdocuments.in/reader034/viewer/2022052600/558630acd8b42a32618b4e83/html5/thumbnails/10.jpg)
![Page 11: Metrics: The New Black?](https://reader034.fdocuments.in/reader034/viewer/2022052600/558630acd8b42a32618b4e83/html5/thumbnails/11.jpg)
![Page 12: Metrics: The New Black?](https://reader034.fdocuments.in/reader034/viewer/2022052600/558630acd8b42a32618b4e83/html5/thumbnails/12.jpg)
![Page 13: Metrics: The New Black?](https://reader034.fdocuments.in/reader034/viewer/2022052600/558630acd8b42a32618b4e83/html5/thumbnails/13.jpg)
ALMs: Two Traditional Use Cases
Author
Measure the impact and reach of their work
Benchmark article performance against others
Evaluate publication decisions to maximize the impact of their work
Understand readership
Communicate impact of research to employers, funders, potential collaborators
Researcher/Writer/Journalist
Gauge value of any article with post-publication peer review
Conduct custom searches that account for research impact
Collect relevant articles and organize based upon array of criteria
Gain insight into article’s impact within context of related research
Analyze trends/behaviors across a database of academic literature
Self-Metrics Research & Discovery
The Third? Meta-analysis using large
datasets of ALMs
![Page 14: Metrics: The New Black?](https://reader034.fdocuments.in/reader034/viewer/2022052600/558630acd8b42a32618b4e83/html5/thumbnails/14.jpg)
Beyond the Article
![Page 15: Metrics: The New Black?](https://reader034.fdocuments.in/reader034/viewer/2022052600/558630acd8b42a32618b4e83/html5/thumbnails/15.jpg)
1595 Tweets
Usage isn’t always indicative
![Page 16: Metrics: The New Black?](https://reader034.fdocuments.in/reader034/viewer/2022052600/558630acd8b42a32618b4e83/html5/thumbnails/16.jpg)
![Page 17: Metrics: The New Black?](https://reader034.fdocuments.in/reader034/viewer/2022052600/558630acd8b42a32618b4e83/html5/thumbnails/17.jpg)
Inside the Article
![Page 18: Metrics: The New Black?](https://reader034.fdocuments.in/reader034/viewer/2022052600/558630acd8b42a32618b4e83/html5/thumbnails/18.jpg)
Powerpoint download feature inadvertently tracked sub-article usage
![Page 19: Metrics: The New Black?](https://reader034.fdocuments.in/reader034/viewer/2022052600/558630acd8b42a32618b4e83/html5/thumbnails/19.jpg)
New feature may be able to track cut/paste activities
![Page 20: Metrics: The New Black?](https://reader034.fdocuments.in/reader034/viewer/2022052600/558630acd8b42a32618b4e83/html5/thumbnails/20.jpg)
90%
![Page 21: Metrics: The New Black?](https://reader034.fdocuments.in/reader034/viewer/2022052600/558630acd8b42a32618b4e83/html5/thumbnails/21.jpg)
To Measure is to Know
![Page 22: Metrics: The New Black?](https://reader034.fdocuments.in/reader034/viewer/2022052600/558630acd8b42a32618b4e83/html5/thumbnails/22.jpg)
Let’s get tracking
• Cut/paste
• Figures opened, downloaded
• Links clicked
• Time spent on article page
• Supplemental info viewed
• Authors’ info viewed
• Pathways that info travels
• ALMs viewed and used
To understand true use of context
![Page 23: Metrics: The New Black?](https://reader034.fdocuments.in/reader034/viewer/2022052600/558630acd8b42a32618b4e83/html5/thumbnails/23.jpg)
What Might Data Drive?
• Tenure and promotion
• Grants
• Reputation
• Discovery
• Prioritization
Attention: the new currency
$
![Page 24: Metrics: The New Black?](https://reader034.fdocuments.in/reader034/viewer/2022052600/558630acd8b42a32618b4e83/html5/thumbnails/24.jpg)
Caveats and concerns
• Missed citation data
• Data sources aren’t reliable
• Digital addresses change
• Usage doesn’t mean useful
• Deliberate gaming
• Context
![Page 25: Metrics: The New Black?](https://reader034.fdocuments.in/reader034/viewer/2022052600/558630acd8b42a32618b4e83/html5/thumbnails/25.jpg)
Next: Context-Mining
![Page 26: Metrics: The New Black?](https://reader034.fdocuments.in/reader034/viewer/2022052600/558630acd8b42a32618b4e83/html5/thumbnails/26.jpg)