Elsevier's innovations in peer review Athenes · 2016. 1. 8. · Elsevier Reviewer Recognition...
Transcript of Elsevier's innovations in peer review Athenes · 2016. 1. 8. · Elsevier Reviewer Recognition...
Elsevier’s
Innovations in Peer
ReviewReview
Dr. Bahar Mehmani
Three Main DirectionThree Main Direction
Recognition: Reviewer Recognition Platform(All Elsevier Journals)
Transparency: Publishing peer review reports (selective Subjects)
Collaboration: Cross Review(Cell Press)
Recognition
08/01/2016 3
Recognition
Elsevier Reviewer Recognition Platform
Objective:
Collect and publicly display
reviewer activities, introduce
statuses, and provide perks
related to important
contribution of reviewerscontribution of reviewers
Current status:
• +1000 journals across all disciplines, +470,000 Reviewer Profile page
Advisors:
Prof. Dr. Lutz Prechelt
Dr. Simon Gosling
My Elsevier Reviews Profile
You are a Recognized Reviewer!
>> Access My Elsevier Reviews Profile
We recognize the important contribution all reviewers make to Elsevier's journals. Based on your contribution, we have awarded you Recognized Reviewer Status.
My Latest Review
General and Comparative Endocrinology
September 2014
My Elsevier Reviews Profile
You are a Recognized Reviewer!
>> Access My Elsevier Reviews Profile
We recognize the important contribution all reviewers make to Elsevier's journals. Based on your contribution, we have awarded you Recognized Reviewer Status.
My Latest Review
General and Comparative Endocrinology
September 2014
Emails are
sent to
reviewers
08/01/2016 5
You are awarded this status as you have completed at least one manuscript review in the last two years for General and Comparative Endocrinology.
My Elsevier Reviews Profile BETA is a personalized page where you can:
• Track your reviewer status
• Claim reviewer discounts
• Collect your certificate
• Share your reviewer record.
Data Protection Notice
You are awarded this status as you have completed at least one manuscript review in the last two years for General and Comparative Endocrinology.
My Elsevier Reviews Profile BETA is a personalized page where you can:
• Track your reviewer status
• Claim reviewer discounts
• Collect your certificate
• Share your reviewer record.
Data Protection Notice
reviewers
after review
with link to
personal
profile page
Volunteering for Review
08/01/2016 6
Volunteer for Review via Review Profiles
08/01/2016 7
08/01/2016 8
Volunteering for Review via Journal Homepage
08/01/2016 9
Nominated by Editor
08/01/2016 10
08/01/2016 11
08/01/2016 12
Create your Public ProfileAnd
Claim your Reviews for
08/01/2016 13
AndClaim your Reviews for
Non-Elsevier Titles
08/01/2016 14
Example: Link
Transparency
08/01/2016 15
Transparency
Review Reports as Articles on Science Direct
Objectives:
• Allow reviewers to receive
credit for their important
contribution
• Contribute to greater
transparency transparency
Current status:
• 5 journals since Nov. 2014
• Interlinked reviews with
separate DOIs on SD
• ORCiD listed
Reviewer Feedback: Accepted Review Invite
08/01/2016 17
Review Invite
• 95% said publishing review reports didn’t influence their recommendation.• 76% said the fact their reports will be publicly available didn’t change their
wording. 45% gave us consent to reveal their names.
Accepted Review Invite
08/01/2016 18
• 45% gave us consent to reveal their names.• 36% of those who preferred to stay anonymous said they will reveal their
names next time they review of the journal.• 98% said they will accept further review invites for the journal.
Reviewer Feedback: Declined Review Invite
08/01/2016 19
Declined Review Invite
Article Usage in Science Direct
08/01/2016 21
Direct
400
600
800
1.000
1.200Pe
er Re
view
Repo
rt Us
age
Feb-15
Apr-15
Jun-15
08/01/2016 22
0
200
400
Agricultural and Forest
Meteorology
Annals of Medicine and
Surgery
Engineering Fracture
Mechanics
International Journal of Surgery
Journal of Hydrology: Regional Studies
Peer
Revie
w Re
port
Usag
e
Jun-15
0.60
0.80
1.00Ra
tio Pe
er Re
view
Repo
rt Us
age/A
rticle
Usag
eEngineering Fracture Mechanics
08/01/2016 23
0.00
0.20
0.40
feb-15 mar-15 apr-15 mag-15 giu-15 lug-15 ago-15
Ratio
Peer
Revie
w Us
age/A
rticle
• Depends on the community’s attitude.• Spin off: Number of Peer Review reports received on Science
Direct as of 2016.
Peer Review Reports as Articles
08/01/2016 24
Direct as of 2016.• Most reviewers list their published peer review reports on their ORCiD
records under “peer review” section.• More journals will be taken on board as of 2016.
Collaboration
08/01/2016 25
Collaboration
• Most reviewers want to see other referee reports and be informed about the final decision.
• In case of conflicting recommendations, editors need more clarification.
Cross Review
08/01/2016 26
clarification.o Editor Invites all reviewers to a private forum where
� Reviewers can read and comment on each others reports� Answer editor’s question� Get informed about editors decision
• 94% of reviewers liked the discussion and would be willing to participate in the future
• 94% of reviewers liked the discussion and would be willing to participate in the future
Initial Results for Cell Press
08/01/2016 27
• All authors felt that cross-review made it clearer how to revise their paper
• All editors found the forum useful particularly when reviewers disagreed
• All authors felt that cross-review made it clearer how to revise their paper
• All editors found the forum useful particularly when reviewers disagreed
Thank You!Thank You!