Metrics for Assessing Research Impact Article Level Metrics October 2013
description
Transcript of Metrics for Assessing Research Impact Article Level Metrics October 2013
![Page 1: Metrics for Assessing Research Impact Article Level Metrics October 2013](https://reader036.fdocuments.in/reader036/viewer/2022062310/568163a2550346895dd4a5e4/html5/thumbnails/1.jpg)
Metrics for Assessing Research ImpactArticle Level MetricsOctober 2013
William Gunn, PhDHead of Academic Outreach
@mrgunn
https://orcid.org/0000-0002-3555-2054
![Page 2: Metrics for Assessing Research Impact Article Level Metrics October 2013](https://reader036.fdocuments.in/reader036/viewer/2022062310/568163a2550346895dd4a5e4/html5/thumbnails/2.jpg)
Based in London, Mendeley is researchers, graduates and software developers from...
![Page 3: Metrics for Assessing Research Impact Article Level Metrics October 2013](https://reader036.fdocuments.in/reader036/viewer/2022062310/568163a2550346895dd4a5e4/html5/thumbnails/3.jpg)
Key questions• What’s the problem?• What’s the opportunity?• How do we serve researchers?
• How do we get the context right?
![Page 4: Metrics for Assessing Research Impact Article Level Metrics October 2013](https://reader036.fdocuments.in/reader036/viewer/2022062310/568163a2550346895dd4a5e4/html5/thumbnails/4.jpg)
What is the problem?
• Is a researcher doing impactful research?
• Does an institution have an effective research program?
• Is the research being effectively disseminated?
• Is the work advancing the field?
![Page 5: Metrics for Assessing Research Impact Article Level Metrics October 2013](https://reader036.fdocuments.in/reader036/viewer/2022062310/568163a2550346895dd4a5e4/html5/thumbnails/5.jpg)
How do you measure advancement?
What are the units?
![Page 6: Metrics for Assessing Research Impact Article Level Metrics October 2013](https://reader036.fdocuments.in/reader036/viewer/2022062310/568163a2550346895dd4a5e4/html5/thumbnails/6.jpg)
The HIPPO
https://secure.flickr.com/photos/doug88888/5937412419/
![Page 7: Metrics for Assessing Research Impact Article Level Metrics October 2013](https://reader036.fdocuments.in/reader036/viewer/2022062310/568163a2550346895dd4a5e4/html5/thumbnails/7.jpg)
People like numbers
https://secure.flickr.com/photos/tifotter/2312080178/
![Page 8: Metrics for Assessing Research Impact Article Level Metrics October 2013](https://reader036.fdocuments.in/reader036/viewer/2022062310/568163a2550346895dd4a5e4/html5/thumbnails/8.jpg)
“Not everything that can be counted counts and not
everything that counts can be counted.” – William Bruce
Cameron (1967)
![Page 9: Metrics for Assessing Research Impact Article Level Metrics October 2013](https://reader036.fdocuments.in/reader036/viewer/2022062310/568163a2550346895dd4a5e4/html5/thumbnails/9.jpg)
Let research be research
https://secure.flickr.com/photos/bert_m
_b/2418461161
![Page 10: Metrics for Assessing Research Impact Article Level Metrics October 2013](https://reader036.fdocuments.in/reader036/viewer/2022062310/568163a2550346895dd4a5e4/html5/thumbnails/10.jpg)
http://xkcd.com/54/
![Page 11: Metrics for Assessing Research Impact Article Level Metrics October 2013](https://reader036.fdocuments.in/reader036/viewer/2022062310/568163a2550346895dd4a5e4/html5/thumbnails/11.jpg)
The Opportunity
• Helping researchers make better decisions
• Some answers– Find out what researchers really need
& try to meet that need• Some unanswered questions
– What do the different metrics tell you?– Whose needs are best served by which
info?
• Some unasked questions
![Page 12: Metrics for Assessing Research Impact Article Level Metrics October 2013](https://reader036.fdocuments.in/reader036/viewer/2022062310/568163a2550346895dd4a5e4/html5/thumbnails/12.jpg)
What we do know
• Amgen: 47 of 53 “landmark” oncology publications could not be reproduced.
• Bayer: 43 of 67 oncology & cardiovascular projects were based on contradictory results
• Dr. John Ioannidis: Of 432 publications purporting sex differences in hypertension, multiple sclerosis, or lung cancer, only one data set was reproducible.
![Page 13: Metrics for Assessing Research Impact Article Level Metrics October 2013](https://reader036.fdocuments.in/reader036/viewer/2022062310/568163a2550346895dd4a5e4/html5/thumbnails/13.jpg)
“authors who make data from their articles available are cited twice as frequently as articles with no data… but otherwise equal qualifications”
Gleditsch, N.P. & Strand, H. Posting your data: will you be scooped or will you be famous? International Studies Perspectives 4, 89-97 (2003). http://dx.doi.org/10.1111/1528-3577.04105
![Page 14: Metrics for Assessing Research Impact Article Level Metrics October 2013](https://reader036.fdocuments.in/reader036/viewer/2022062310/568163a2550346895dd4a5e4/html5/thumbnails/14.jpg)
Post-scarcity in data
“Preservation should be baked into the tools that we use… I would like for you to think of yourselves as people engaged in a task that is important to everyone and not just people in a scholarly niche.”
![Page 15: Metrics for Assessing Research Impact Article Level Metrics October 2013](https://reader036.fdocuments.in/reader036/viewer/2022062310/568163a2550346895dd4a5e4/html5/thumbnails/15.jpg)
...and aggregates researchdata in the cloud
Mendeley extracts research data…
Mendeley makes science more collaborative and transparent:
InstallMendeley Desktop
![Page 16: Metrics for Assessing Research Impact Article Level Metrics October 2013](https://reader036.fdocuments.in/reader036/viewer/2022062310/568163a2550346895dd4a5e4/html5/thumbnails/16.jpg)
![Page 17: Metrics for Assessing Research Impact Article Level Metrics October 2013](https://reader036.fdocuments.in/reader036/viewer/2022062310/568163a2550346895dd4a5e4/html5/thumbnails/17.jpg)
![Page 18: Metrics for Assessing Research Impact Article Level Metrics October 2013](https://reader036.fdocuments.in/reader036/viewer/2022062310/568163a2550346895dd4a5e4/html5/thumbnails/18.jpg)
![Page 19: Metrics for Assessing Research Impact Article Level Metrics October 2013](https://reader036.fdocuments.in/reader036/viewer/2022062310/568163a2550346895dd4a5e4/html5/thumbnails/19.jpg)
Future Directions
• Let’s get better at understanding how to meet researcher needs.
• Let’s get the context right for metrics.
• Practical tips– Collect lots of data– Build expertise in analysis– Make that data available openly – it’s
more valuable in aggregate than siloed apart.
![Page 20: Metrics for Assessing Research Impact Article Level Metrics October 2013](https://reader036.fdocuments.in/reader036/viewer/2022062310/568163a2550346895dd4a5e4/html5/thumbnails/20.jpg)
http://www.flickr.com/photos/delfo/153254882/
![Page 21: Metrics for Assessing Research Impact Article Level Metrics October 2013](https://reader036.fdocuments.in/reader036/viewer/2022062310/568163a2550346895dd4a5e4/html5/thumbnails/21.jpg)
www.mendeley.com