Durham Leading Research Programme: Academic Impact
-
Upload
jamie-bisset -
Category
Education
-
view
148 -
download
1
Transcript of Durham Leading Research Programme: Academic Impact
![Page 1: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/1.jpg)
Contact Details
Academic Liaison Librarian (Researcher Support) [email protected] Phone: +44 (191) 334 2961
Leading Research Module 15:
Academic Impact: Research Indicators
![Page 2: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/2.jpg)
Learning Outcomes for the session
• Increased awareness of the various journal and author
metrics available.
• Understanding of how some key indicators (JIF, H-index)
are calculated
• Understanding of the key issues around the use of these
metrics and what research behaviours might be
incentivised.
• Awareness of the potential opportunities for exploring
wider academic and non-academic impact of publications
from altmetric tools available.
![Page 3: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/3.jpg)
Session outline
• Introduction: What can you measure?
• Citations
• Author metrics
• Journal metrics
• Metrics and the REF
• Altmetrics (in brief)
![Page 4: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/4.jpg)
Quick Survey (1)
• How many of you have been advised to publish
in certain journals (eg “high impact journals”)?
• How many of you are aware of if and how any
citation metrics were used in the last REF?
![Page 5: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/5.jpg)
Quick Survey (2)
• What does it mean if an article has a citation
count of 97?
• What does it mean if an author has an h-index
of 14?
• What does it mean if a journal has a Journal
Impact Factor of 1.317?
• What does it mean if an article has an altmetric
score (on altmetric.com) of 2734?
![Page 6: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/6.jpg)
![Page 7: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/7.jpg)
What can you measure?
• Article/Book impact
• One measure of the impact of
individual journal articles,
conference proceedings or books,
is the number of times they are
cited by other works.
![Page 8: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/8.jpg)
What can you measure?
• Publication (Journal) impact
• The perceived impact of a specific
academic journal might be
assessed by the number of times
their articles are cited (on average)
and where they are cited.
![Page 9: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/9.jpg)
What can you measure?
• Researcher impact
• The number of outputs and citation
a researcher generates can be an
indicator for the impact of an
individual researcher.
![Page 10: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/10.jpg)
What can you measure?
• Institutional impact
• The prestige of a department or
area of research within an
institution compared to those at
other institutions can be measured
by the sum of individual
researchers ‘impact’.
![Page 11: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/11.jpg)
Impact ?
![Page 12: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/12.jpg)
Are bibliometrics
effective & reliable
measures of
academic impact?
![Page 13: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/13.jpg)
Part 1 Citations
and
Citation
Indices
![Page 14: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/14.jpg)
Citations
• Links between papers that have
something in common
![Page 15: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/15.jpg)
Citations
• Links between papers that have
something in common
• Building upon, or challenging, research
![Page 16: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/16.jpg)
Citations
• Links between papers that have
something in common
• Building upon, or challenging, research
• Help make a judgement about impact
an article has made
![Page 17: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/17.jpg)
Citations
• Links between papers that have
something in common
• Building upon, or challenging, research
• Help make a judgement about impact
an article has made
• Sum of citations can be an indication of
the ‘impact’ of an author’s work / a
journal as a collection of articles
![Page 18: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/18.jpg)
... The problem...
• How do you identify who has cited a
publication you have written or read?
![Page 19: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/19.jpg)
Citation indices
• 1955: Eugene Garfield proposed
creating a citation index for science to...
![Page 20: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/20.jpg)
Citation indices
• 1955: Eugene Garfield proposed
creating a citation index for science to...
“eliminate the uncritical citation of fraudulent,
incomplete or obsolete data by making it
possible for the conscientious scholar to be
aware of criticisms of earlier papers” Garfield, E (1955) ‘Citation Indexes for Science’
Science, New Series, Vol. 122, No. 3159, pp. 108-111
![Page 21: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/21.jpg)
Citation indices
• 1955: Eugene Garfield - presents the idea of
measuring the ‘impact’ of journal articles
using citations
![Page 22: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/22.jpg)
Citation indices
• 1955: Eugene Garfield - presents the idea of
measuring the ‘impact’ of journal articles
using citations
• 1960s: Science Citation Index developed to
highlight “formal, explicit linkages between
papers that have particular points in common”
![Page 23: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/23.jpg)
Citation indices
• 1955: Eugene Garfield - presents the idea of
measuring the ‘impact’ of journal articles
using citations
• 1960s: Science Citation Index developed to
highlight “formal, explicit linkages between
papers that have particular points in common”
• 1975: Journal Citation Reports use Web of
Science data to rank journals within
disciplines
![Page 24: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/24.jpg)
Citation indices
(2008) Taylor and Francis LibSite Newsletter,
issue 9. p. 5
Science subjects
Social-science subjects
![Page 25: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/25.jpg)
Citation indices
“reference lists are held under copyright by
academic publishers which makes tracking
citations impossible”
The death of the reference and the re-use factor (2013) http://figshare.com/blog/The_Death_Of_The_Reference_and_the_reuse_factor/103
![Page 26: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/26.jpg)
Citation indices
• Web of Science (Thomson Reuters)
• Sci-verse Scopus (Elsevier)
• Google Scholar
![Page 27: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/27.jpg)
Things you can do
• Count citations to an article
• Link to other related articles
• Citation mapping
• Set up citation alerts
• Search for cited references
• See citation reports for authors and journals
![Page 28: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/28.jpg)
Demo Web of Science /
Google Scholar
![Page 29: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/29.jpg)
![Page 30: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/30.jpg)
![Page 31: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/31.jpg)
Over to you • Check Google Scholar and Web of Science for an
article you have already written/read or are aware
of, or try:
Zong, Y. and Tooley, M. J. (2003) 'A historical record of coastal
floods in Britain : frequencies and associated storm tracks.',
Natural hazards, 29 (1). pp. 13-36.
• Explore and compare the number of citations (if
any) listed
Citation searching
Via Flickr Creative Commons, by © Stuti Sakhalkar. Original available at http://www.flickr.com/photos/theblackcanvas/2945878325/
![Page 32: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/32.jpg)
![Page 33: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/33.jpg)
Citation Metrics
h-index (Hirsch, 2005)
• an author’s number of articles (h) that have
received at least h citations
• a researcher with an h-index of 10 has published
10 articles that have each been cited 10+ times
g-index (Egghe, 2006)
• the highest number (g) of papers that together
received g2 or more citations
• a researcher with a g-index of 10 has published 10
papers that, in total, have been cited at least 100
times
![Page 34: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/34.jpg)
h-index
Author: Smith, J
Has written and published 9 articles (a-i),
which have been cited as follows:
a:3, b:6, c:6, d:2, e:13, f:3, g:0, h:1, i:3
“no. of articles (n) that have received at least n citations”
![Page 35: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/35.jpg)
h-index
Author: Smith, J
Has written and published 9 articles (a-i),
which have been cited as follows:
a:3, b:6, c:6, d:2, e:13, f:3, g:0, h:1, i:3
H-index: 3 (at least 3 References with 3 or
more citations)
“no. of articles (n) that have received at least n citations”
![Page 36: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/36.jpg)
h-index
Author: Smith, J
Has written and published 9 articles (a-i),
which have been cited as follows:
a:3, b:6, c:6, d:2, e:13, f:3, g:0, h:1, i:3
H-index: not 4 (only 3 References with 4 or
more citations)
“no. of articles (n) that have received at least n citations”
![Page 37: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/37.jpg)
h-index: what’s in a number?
• Nobel Prize Winner 2013, Peter W
Higgs
• H-index (Google Scholar) = 12
• H-index (Web of Science) = 11
![Page 38: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/38.jpg)
![Page 39: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/39.jpg)
![Page 40: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/40.jpg)
g-index
Author: Smith, J
Has written and published 9 articles (a-i),
which have been cited as follows:
a:3, b:6, c:6, d:2, e:13, f:3, g:0, h:1, i:3
“the highest number (g) of papers that together have received
g2 or more citations”
![Page 41: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/41.jpg)
g-index
Author: Smith, J
Has written and published 9 articles (a-i),
which have been cited as follows:
a:3, b:6, c:6, d:2, e:13, f:3, g:0, h:1, i:3
G-index: 5 (5x5 = 25... Total of top 5 cited
articles citations = 31)
“the highest number (g) of papers that together have received
g2 or more citations”
![Page 42: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/42.jpg)
g-index
Author: Smith, J
Has written and published 9 articles (a-i),
which have been cited as follows:
a:3, b:6, c:6, d:2, e:13, f:3, g:0, h:1, i:3
G-index: not 6 (6x6 = 36... Total of top 6 cited
articles citations = 34)
“the highest number (g) of papers that together have received
g2 or more citations”
![Page 43: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/43.jpg)
Demo
Web of Science
![Page 44: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/44.jpg)
Over to you • If you have published 1 or more papers, and if all
are indexed on Web of Science or Google Scholar,
see if you can calculate and compare your h-index
(or try to calculate your g-index)
• ... or try the same for a colleague, supervisor or
head of department.
Author metrics
Via Flickr Creative Commons, by © Stuti Sakhalkar. Original available at http://www.flickr.com/photos/theblackcanvas/2945878325/
![Page 45: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/45.jpg)
Google Scholar – My Citations
• Track citations to your publications
• Check who is citing your publications. Graph your
citations over time. Calculate citation metrics.
• View publications by colleagues or co-authors
• Keep up with their work, view their citation
metrics.
• Appear in Google Scholar Search Results
• Create a public profile that can appear in Google
Scholar when someone searches for your name.
![Page 46: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/46.jpg)
Author metrics – Issues?
• Author identification
e.g. Professor Gordon Love
A name is not unique
o Prof. Gordon Love, University of California (Earth Science)
o Dr Gordon L Love, Sacramento (Medicine and Health)
o Prof. Gordon Love, Durham University (Physics)
![Page 47: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/47.jpg)
Author metrics – Issues?
• Author identification
e.g. Professor Gordon Love
... So you need a unique identifier (or 3)
o ORCID profile (0000-0001-5137-9434)
o Researcher ID profile (A-3071-2011)
o Google Scholar profile (3xJXtlwAAAAJ)
![Page 48: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/48.jpg)
Part 3 Journal
Metrics
![Page 49: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/49.jpg)
Journal Citation Reports (JCRs)
• JCRs – annual publication of journals and
their impact factors.
• Over 10,800 titles, across 232 disciplines
have JIFs in 2015 editions
• A journal that is cited once, on average, for
each article published has an JIF of 1.
![Page 50: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/50.jpg)
Journal Citation Reports (JCRs)
• 2015 edition (published June 2015):
• is JCR year 2014 (providing 2014 Journal
Impact Factor (JIF) metrics)
• counting citation data from 2014
• for articles published in 2012/13
![Page 51: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/51.jpg)
Journal Impact Factor (JIF)
Citations in 2014 to all
articles published by Journal
X in 2012 & 2013
Journal
X’s
2014
impact
factor
=
![Page 52: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/52.jpg)
Journal Impact Factor (JIF)
Citations in 2014 to all
articles published by Journal
X in 2012 & 2013
Number of articles that
were published in Journal X
in 2012 & 2013
Journal
X’s
2014
impact
factor
=
![Page 53: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/53.jpg)
Journal Impact Factor (JIF)
Citations in 2014 (in journals
indexed in Web of Science) to
all articles published by
Journal X in 2012 & 2013
Number of articles (of a type
deemed to be citeable) that
were published in Journal X
in 2012 & 2013
Journal
X’s
2014
impact
factor
=
![Page 54: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/54.jpg)
Journal Ranking
![Page 55: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/55.jpg)
Journal Ranking
![Page 56: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/56.jpg)
Demo
JCRs
Journal Impact Factors
![Page 57: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/57.jpg)
Other journal impact metrics
• Eigenfactor
• Calculates weightings based on ‘where’
the citation came from
• Also takes into account the ‘size’ of a
journal, to measure the ‘total importance of
a journal’
• http://www.eigenfactor.org/ (1997-2013)
![Page 58: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/58.jpg)
Other journal impact metrics
• SCImago
• Based on data from Scopus (rather than
Web of Science)
• http://www.scimagojr.com/journalrank.php
![Page 59: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/59.jpg)
Over to you • Explore the JCRs to identify relevant subject
categories for your field of research.
• Identify journals and compare JIFs and Eigenfactor
Scores
Journal metrics
Via Flickr Creative Commons, by © Stuti Sakhalkar. Original available at http://www.flickr.com/photos/theblackcanvas/2945878325/
![Page 60: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/60.jpg)
Issues with journal metrics
• No comprehensive data source
• Citation cultures vary across disciplines
• Publication cultures vary across disciplines
• Research careers have different stages
• Citations ≠ confirmation of excellence
• Scholarly communication is evolving…
• Blogs, twitter, data and open access
repositories
![Page 61: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/61.jpg)
![Page 62: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/62.jpg)
Metrics for Research Assessment
• REF2014
• 11 of 36 panels assessing submissions looked at
citation data
• Benchmarked against data for comparable articles
• Did not take into account Journal Impact Factors in
assessment (?)
• REF(2020?)
• Consulting on use of metrics
• “The Metric Tide” (9th July 2015)
![Page 63: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/63.jpg)
Metrics for Research Assessment
“Placing too much emphasis on narrow,
poorly-designed indicators – such as journal
impact factors (JIFs) – can have negative
consequences”
“… correlation analysis of the REF2014
results ... Has shown that individual metrics
give significantly different outcomes from the
REF peer review process.”
![Page 64: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/64.jpg)
Metrics for Research Assessment
“At an institutional level, HEI leaders should develop
a clear statement of principles … including the role
of quantitative indicators.”
“Individual researchers should be mindful of the
limitations of particular indicators in the the way they
present their own CVs and evaluate the work of
colleagues.”
“Publishers should reduce the emphasis on journal
impact factors as a promotional tool … [and] should
also make available a range of article-level metrics”
![Page 65: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/65.jpg)
Journal Impact Factors and Citations
• “… the JIF is the main determinant of article citation
impact”
Didegah, F. and Thelwall, M. (2013) “Which factors help authors produce the highest impact research?
Collaboration, journal and document properties” Journal of Informetrics 7: 861-873. Available at
http://dx.doi.org/10.1016/j.joi.2013.08.006
• “… the impact factor of the journal in which articles
appeared was the primary predictor of the
citations that they accrued”
Haslam, N. and Koval, P. (2010) “Predicting long-term citation impact in articles in social and personality
psychology” Psychological Reports 106(3) Jun 2010. Available at http://dx.doi.org/10.2466/pr0.106.3.891-900
![Page 66: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/66.jpg)
Journal Impact Factors and Citations
• “…a small but significant correlation between journal
rank and future citations can be observed … stems
from visibility effects due to the influence of the IF on
reading habits (Lozano et al., 2012), rather than from
factors intrinsic to the published articles … [but] the
correlation is so weak that it cannot alone account
for the strong correlation between retractions and
journal rank”
Björn Brembs, Katherine Button and Marcus Munafò (2013) “Deep impact: unintended consequences of journal
rank” Frontiers in Human Neuroscience 7: 291. Available at http://dx.doi.org/10.3389/fnhum.2013.00291
Citing
Lozano, G. A., Larivière, V., and Gingras, Y. (2012). “The weakening relationship between the impact factor and
papers' citations in the digital age” J. Am. Soc. Inf. Sci. Technol. 63, 2140–2145. Available at
http://dx.doi.org/10.1002/asi.22731
![Page 67: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/67.jpg)
Journal Impact Factors and Citations
Fang, F. C., & Casadevall, A. (2011). Retracted Science and the Retraction Index
. Infection and Immunity, 79(10), 3855–3859. http://doi.org/10.1128/IAI.05661-11
![Page 68: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/68.jpg)
Impact ?
![Page 69: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/69.jpg)
Place of Publication: Open Access
• Boost the potential visibility and access of research,
to a wider audience
• Removes research from behind paywall barriers for
existing audience
• Enables authors to retain their rights and more easily
share via social media, email etc.
![Page 70: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/70.jpg)
Place of Publication: Open Access
• 4633 articles across ecology, applied
mathematics, sociology and economics.
• 2280 were open access, and had an
average citation count of 9.04
• 2353 were subscriptions journals, and had
an average citation count of 5.76.
Norris, M. (2008) “The citation advantage of open access articles” Thesis. Available at
https://dspace.lboro.ac.uk/2134/4089
![Page 71: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/71.jpg)
Place of Publication: Open Access
• 4633 articles across ecology, applied
mathematics, sociology and economics.
• 2280 were open access, and had an
average citation count of 9.04
• 2353 were subscriptions journals, and had
an average citation count of 5.76.
Norris, M. (2008) “The citation advantage of open access articles” Thesis. Available at
https://dspace.lboro.ac.uk/2134/4089
![Page 72: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/72.jpg)
Place of Publication: Open Access
SPARC Europe: Open Access Citation Advantage Service
http://sparceurope.org/oaca/
Total number of studies so far 70
Studies that found a citation advantage 46
Studies that found no citation advantage 17
Studies that were inconclusive, found non-
significant data or measured other
things than citation advantage for articles
7
![Page 73: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/73.jpg)
Place of Publication: Open Access
SPARC Europe: Open Access Citation Advantage Service
http://sparceurope.org/oaca/
Total number of studies so far 70
Studies that found a citation advantage 46
Studies that found no citation advantage 17
Studies that were inconclusive, found non-
significant data or measured other
things than citation advantage for articles
7
Correlation ≠ Causation
evidence of a positive correlation between citation count
and open access (gold or green)…
but…
• [Cause] Because research is more discoverable and
accessible
• [Cause] Because authors choose to make their best
(most citable) research open access
![Page 74: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/74.jpg)
Part 5 Altmetrics
(in brief)
![Page 75: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/75.jpg)
Altmetrics
“Unlike the JIF, altmetrics reflect the impact
of the article itself, not its venue. Unlike
citation metrics, altmetrics will track impact
outside the academy, impact of influential
but uncited work, and impact from sources
that aren’t peer-reviewed.“
http://altmetrics.org/manifesto/
![Page 76: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/76.jpg)
![Page 77: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/77.jpg)
![Page 78: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/78.jpg)
![Page 79: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/79.jpg)
![Page 80: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/80.jpg)
![Page 81: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/81.jpg)
![Page 82: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/82.jpg)
![Page 83: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/83.jpg)
Altmetric.com
![Page 85: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/85.jpg)
![Page 86: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/86.jpg)
Learning Outcomes for the session
• Increased awareness of the various journal and author
metrics available.
• Understanding of how some key indicators (JIF, H-index)
are calculated
• Understanding of the key issues around the use of these
metrics and what research behaviours might be
incentivised.
• Awareness of the potential opportunities for exploring
wider academic and non-academic impact of publications
from altmetric tools available.
![Page 87: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/87.jpg)
Image Credits
[Slide 6] Via Flickr Creative Commons, by demonsub. Original available at http://www.flickr.com/photos/66397367@N05/6993902269
[Slide 13] Via Flickr Creative Commons, by Kirsty Andrews. Original available at http://www.flickr.com/photos/47745961@N08/5169765739
[Slide 31,44,59] Via Flickr Creative Commons, by © Stuti Sakhalkar. Original at http://www.flickr.com/photos/theblackcanvas/2945878325/
[Slide 49] Via Flickr Creative Commons, by Alan Cleaver. Original available at http://www.flickr.com/photos/11121568@N06/4122176776/
[Slide 22] ‘Vitae®, © 2010 Careers Research and Advisory Centre (CRAC) Limited‘ Available at www.vitae.ac.uk/rdf
![Page 88: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/88.jpg)
Measuring
Researcher
Development Vitae Researcher Development Framework [see image credits]
![Page 89: Durham Leading Research Programme: Academic Impact](https://reader034.fdocuments.in/reader034/viewer/2022042907/587ede531a28abdb198b7f2d/html5/thumbnails/89.jpg)
Durham University Library: Supporting your research
Contact Details
Academic Liaison Librarian (Researcher Support) [email protected] Phone: +44 (191) 334 2961