Supporting Evaluation with Unique and Persistent Identifiers

31
orcid.org Contact Info: p. +1-301-922-9062 a. 10411 Motor City Drive, Suite 750, Bethesda, MD 20817 USA Supporting Evaluation with Unique and Persistent Identifiers for Researchers 16 February 2014 AAAS Annual Meeting, Chicago Rebecca Bryant, PhD Director of Community, ORCID [email protected] @ORCID_ORG http://orcid.org/0000-0002-2753-3881

description

Presentation at AAAS, Feb 16, 2014. https://aaas.confex.com/aaas/2014/webprogram/Session7211.html

Transcript of Supporting Evaluation with Unique and Persistent Identifiers

Page 1: Supporting Evaluation with Unique and Persistent Identifiers

orcid.org Contact Info: p. +1-301-922-9062 a. 10411 Motor City Drive, Suite 750, Bethesda, MD 20817 USA

Supporting Evaluation with Unique and Persistent Identifiers for Researchers   16 February 2014 AAAS Annual Meeting, Chicago Rebecca Bryant, PhD

Director of Community, ORCID [email protected]

@ORCID_ORG http://orcid.org/0000-0002-2753-3881

Page 2: Supporting Evaluation with Unique and Persistent Identifiers

The research community has lacked the ability to link researchers and scholars with their professional activities.

What is the problem?

•  Discoverability within and across databases •  Acknowledgement and citation of contributions •  Author, grantee, and faculty record management •  Research reporting and impact assessment

15 February 2014 orcid.org 2

Page 3: Supporting Evaluation with Unique and Persistent Identifiers

Why so difficult? Relying on author names is inadequate for identification

15 February 2014 orcid.org 3

Page 4: Supporting Evaluation with Unique and Persistent Identifiers

Common Names

“Estimates by China's Ministry of Public Security suggest that more than 1.1 billion people — around 85% of China's population — share just 129 surnames. Problems with abbreviations, ordering of given names and surnames and inconsistent journal practices heighten the confusion.” http://www.nature.com/news/2008/080213/full/451766a.html

15 February 2014 orcid.org 4

Page 5: Supporting Evaluation with Unique and Persistent Identifiers

Multiple Names

•  J. Å. S. Sørensen

•  J. Aa. S. Sørensen

•  J. Å. S. Sorensen

•  J. Aa. S. Sorensen

•  J. Å. S. Soerensen

•  J. Aa. S. Soerensen

•  Jens Å. S. Sørensen

•  Jens Aa. S. Sørensen

•  Jens Å. S. Sorensen

•  Jens Aa. S. Sorensen

•  Jens Å. S. Soerensen

•  Jens Aa. S. Soerensen

•  J. Åge S. Sørensen

•  J. Aage S. Sørensen

•  J. Åge S. Sorensen

•  J. Aage S. Sorensen

•  J. Åge S. Soerensen

•  J. Aage S. Soerensen

•  Jens Åge S. Sørensen

•  Jens Aage S. Sørensen

•  Jens Åge S. Sorensen

•  Jens Aage S. Sorensen

•  Jens Åge S. Soerensen

•  Jens Aage S. Soerensen

An illustrative example: Jens Åge Smærup Sørensen

•  J. Åge Smærup Sørensen

•  J. Aage Smaerup Sørensen

•  J. Åge Smarup Sorensen

•  J. Aage Smarup Sorensen

•  J. Åge Smaerup Soerensen

•  J. Aage Smaerup Soerensen

•  Jens Åge Smærup Sørensen

•  Jens Aage Smaerup Sørensen

•  Jens Åge Smarup Sorensen

•  Jens Aage Smarup Sorensen

•  Jens Åge Smærup Soerensen

•  Jens Aage Smaerup Soerensen

And on and on it goes …

Page 6: Supporting Evaluation with Unique and Persistent Identifiers

Name Changes

15 February 2014 orcid.org 6

Page 7: Supporting Evaluation with Unique and Persistent Identifiers

Why so difficult? Contributions are also complex—more than journal articles

15 February 2014 orcid.org 7

Page 8: Supporting Evaluation with Unique and Persistent Identifiers

idea People

Team Collaborations

Trainees

Affiliations Employer

Professional Associations

Funding Grants

Contracts Seed Funding

Coop Agreements

Publications Journal Articles Books Patents Legal Briefs Algorithms Software Code

Datasets Physical Objects Electronic Files Protein Structures Genetic Sequences

Impacts Policy Legal Health Environment Education Product Development Spin Off Workforce

Service Activities Peer Review

Working Groups Leadership Positions

Training and Mentoring

Many different research outputs

15 February 2014 orcid.org 8

Page 9: Supporting Evaluation with Unique and Persistent Identifiers

Multiple Disciplines

15 February 2014 9

Narcolepsy Hibernation Stanford Univ. 1988-1991

Circadian Rhythms

Glutamate Receptors Stanford Univ. 1997-2006

Postdoc Policy AAAS

2001-2003

Calcium Sparks Neuron-Glial Signals Potassium Channels

NIH 1997-2002 Science Workforce

Women in Science Interdisciplinary Research

NAS 2003-2007

Research Policy Evaluation Metrics

Infrastructure Discovery Logic

2007-2012

? ? ? ? One person or many

Page 10: Supporting Evaluation with Unique and Persistent Identifiers

Understanding Impact

v How can we reliably connect researchers to their contributions?

v Can we expand our view of what is considered a contribution?

v How do we track research activities across careers? Databases? Organizations?

v How can we measure the impact of our training program? Funding program? Department? Project?

15 February 2014 orcid.org 10

v Funders v Universities &

research organizations

v Publishers v Professional

societies v Researchers

We all have questions:

Page 11: Supporting Evaluation with Unique and Persistent Identifiers

Identifiers for Researchers Effective evaluation requires:

v Unique and persistent person-identifier that can be used throughout one’s research career, across professional activities, affiliations, nations and languages

v IDs that are integrated in standard workflows, embedded in works metadata, independent of platform, and can be linked with other IDs

v Data exchange standards, accessible data, and links to source docs

15 February 2014 orcid.org 11

Page 12: Supporting Evaluation with Unique and Persistent Identifiers

v ORCID provides a non-proprietary registry of persistent unique identifiers for researchers

v ORCID iDs are embedded in research systems and ORCID provides an API that enables the interoperable exchange of information between systems

v ORCID code is open source and we support community efforts to develop tools and services

v ORCID links research information across systems through persistent identifiers

ORCID

15 February 2014 orcid.org 12

v ORCID record data marked public by researchers is published annually

Page 13: Supporting Evaluation with Unique and Persistent Identifiers

15 February 2014 orcid.org 13

Interoperability

ORCID works collaboratively with the research community to ensure use and adoption of research

information exchange standards

Page 14: Supporting Evaluation with Unique and Persistent Identifiers

14

Other identifiers

Funders

Universities

Professional associations

Repositories

Publishers

ORCID is a hub

Page 15: Supporting Evaluation with Unique and Persistent Identifiers

120 members and growing

15

Publishing* AIP$Publishing,$AIRITI,$Aries,$Atlas,$Cactus,$Copernicus,$EBSCO,$Elsevier,$EDP$Sciences,$eJournal$Press,$eLife,$Epistemio,$Flooved,$Hindawi,$InfraFM$Academic$Publishing,$Jnl$Bone$and$Joint$Surgery,$Karger,$Landes$Bioscience,$National$Academy$of$Sciences,$Nature,$Oxford$University$Press,$Peerage$of$Science,$PLOS,$Rockefeller$University$Press,$RNAi,$ScienceOpen,$Springer,$Taylor$&$Francis,$Wiley,$Wolters$Kluwer$

Associations* American$Astronomical$Soc,$American$Chemical$Soc,$ACSESS,$AAAS,$American$Geophysical$Union,$American$Mathematical$Soc,$American$Psychological$Assn,$American$Physical$Soc,$American$Soc$Microbiology,$American$Soc$Civil$Engineers,$Assn$Computing$Machinery,$Electrochemical$Society,$IEEE,$IOP,$Modern$Language$Assn,$OSA,$Royal$Soc$Chemistry,$Soc$Neuroscience$

Funders* Autism$Speaks,$US$Department$of$Energy,$US$Food$and$Drug$Administration,$Fundação$para$a$Ciência$e$a$Tecnologia,$Japan$Science$and$Technology$Agency,$Qatar$National$Research$Foundation,$US$National$Institutes$of$Health,$UK$National$Institute$of$Health$Research,$Wellcome$Trust$

Universities*and*Research*Organizations*

Boston$Univ,$CalTech,$Cambridge$Univ,$Chalmers$Univ$Technology,$Charles$Darwin$Univ,$Chinese$Academy$of$Sciences$Library,$CERN,$Cornell$Univ,$EMBL$(EBI),$FHCRC,$Glasgow$Univ,$Harvard$Univ,$IFPRI,$KACST,$KISTI,$Consorcio$Madroño,$Forschungszentrum$Jülich,$KTH$Royal$Inst$Tech,$$MIT,$MSKCC,$National$Institute$of$Informatics,$National$Taiwan$Univ$College$of$Medicine,$National$Taiwan$Normal$Univ,$NYU$Langone$Medical$Center,$Oxford$University,$Penn$State,$Purdue$Univ,$Riga$Technical$Univ,$SUNYFStonybrook,$Texas$A&M$Univ,$Univ$Bern,$Univ.$Cadiz,$Univ$Carlos$III$de$Madrid,$Univ$Oviedo,$Univ$Zaragoza,$Univ$College$London,$Univ$Colorado,$Univ$Hong$Kong,$Univ$Kansas,$Univ$Manchester,$Univ$Michigan,$Univ$Missouri,$Univ$Politécnica$Madrid,$Univ.$Waikato,$Univ$Washington$

Repositories*and*Profile*Systems*

Altmetric,$Association$of$Users$of$Ukranian$Research$and$Academic$Network,$Australian$National$Data$Service,$AVEDAS,$British$Library,$Copyright$Clearance$Center,$CrossRef,$DataCite,$Dryad,$F1000$Research,$Faculty$of$1000,$figshare,$Impact$Story,$Knode,$M2Community,$OCLC,$PubMed$Europe$(EBI),$Symplectic,$Thomson$Reuters,$Überresearch$$

!

Publishers

Associations

Funders

Universities and Research Orgs

Repositories and Profile Systems

Americas 50%

AsiaPac 13%

EMEA 37%

Page 16: Supporting Evaluation with Unique and Persistent Identifiers

Registrations growing steadily

15 February 2014 orcid.org 16

 -­‐        

 50,000    

 100,000    

 150,000    

 200,000    

 250,000    

 300,000    

 350,000    

 400,000    

 450,000    

 500,000    

Oct   Nov   Dec   Jan   Feb   Mar   Apr   May   Jun   Jul   Aug   Sep   Oct   Nov   Dec  

Member  Creator  

Website  

Trusted  party  

ORCID has issued over 525,000 identifiers since our launch in October 2012

Page 17: Supporting Evaluation with Unique and Persistent Identifiers

Broad international usage

•  36 countries >10,000 unique visitors

•  84 countries >1,000 unique visitors

•  Registry supports multiple character sets

•  Content in Spanish, French, English, and Chinese (adding Portuguese, Korean, Japanese, and Russian in 2014)

15 February 2014 17 orcid.org

Country   Visits   %  USA   370082   15.5%  China   230908   9.7%  

Portugal   155445   6.5%  UK   127906   5.4%  India   126960   5.3%  Spain   104542   4.4%  Italy   88814   3.7%  Brazil   84693   3.6%  

Germany   83155   3.5%  Japan   75587   3.2%  

Australia   63133   2.6%  France   61973   2.6%  Canada   50670   2.1%  Iran   44592   1.9%  Russia   44061   1.8%  

South  Korea   42598   1.8%  Turkey   36496   1.5%  Sweden   33458   1.4%  

Netherlands   31583   1.3%  Malaysia   31516   1.3%  Taiwan   30983   1.3%  Egypt   27373   1.1%  Poland   22350   0.9%  

Switzerland   22043   0.9%  Mexico   21973   0.9%  Vietnam   16820   0.7%  Belgium   16011   0.7%  

Saudi  Arabia   15875   0.7%  Greece   15302   0.6%  Denmark   13152   0.6%  

Page 18: Supporting Evaluation with Unique and Persistent Identifiers

18

“Where possible, it is also recommended that contributors be uniquely identifiable, and data uniquely attributable, through identifiers which are persistent, non-proprietary, open and interoperable (e.g. through leveraging existing sustainable initiatives such as ORCID for contributor identifiers and DataCite for data identifiers).” --European Commission Grantee Guidelines http://ec.europa.eu/research/participants/data/ref/h2020/grants_manual/hi/oa_pilot/h2020-hi-oa-pilot-guide_en.pdf

http://biomedicalresearchworkforce.nih.gov/tracking-system.htm#d

Funding policy

“Greater precision and transparency of the research outputs linked to a particular funder or grant is vital to help us better understand the impact of our funding.” Liz Allen, Head of Evaluation, Wellcome Trust http://orcid.org/0000-0002-9298-3168

Page 19: Supporting Evaluation with Unique and Persistent Identifiers

http://www.jisc.ac.uk/whatwedo/programmes/di_researchmanagement/researchinformation/orcid.aspx

http://openaccess.blogg.kb.se/2013/01/30/slutrapport-fran-projekt-forfattarindentifikatorer/

National adoption

15 February 2014 orcid.org 19

bit.l

y/1a

bIO

yG

Page 20: Supporting Evaluation with Unique and Persistent Identifiers

Who is Integrating and How?

20

•  Research Funders •  Professional Associations •  Publishers •  Universities and Research Orgs •  Repositories, CRIS, Metrics Sites

For a list of organizations and integrations see http://orcid.org/organizations/integrators

Page 21: Supporting Evaluation with Unique and Persistent Identifiers

Grant applications: NIH SciENcv

15 February 2014 orcid.org 21

Link ScienCV record to ORCID using OAuth

Import iD from ORCID record

Page 22: Supporting Evaluation with Unique and Persistent Identifiers

Grant applications v The US Department of Energy has integrated ORCID iDs into

their E-Link and Announcement Notices.

v The Australian NHMRC has integrated ORCID identifiers into their RGMS grant application system.

v The Wellcome Trust has integrated ORCID iDs into its eGrants application system.

http://www.nhmrc.gov.au/media/newsletters/research-tracker/2013/nhmrc-research-tracker-28-june-2013

https://www.osti.gov/elink/aboutorcid.jsp

15 February 2014 orcid.org 22

Page 23: Supporting Evaluation with Unique and Persistent Identifiers

“AGU is implementing ORCIDs in our member records, editorial databases, and papers. Having the ability to uniquely identify scientists helps the society, editors, authors, and members in many ways, from improving efficiency to providing services and support.”   Brooks Hanson, Director of Publications, American Geophysical Union  http://orcid.org/0000-0001-6230-7145

15 February 2014 orcid.org 23

Professional associations

Page 24: Supporting Evaluation with Unique and Persistent Identifiers

Publishing

15 February 2014 orcid.org 24

Page 25: Supporting Evaluation with Unique and Persistent Identifiers

How are Universities

Engaging?

25

For more on university integrators see http://orcid.org/organizations/researchorganizations

•  Encouraging ORCID adoption by faculty, researchers, and grad students

•  Record creation •  Embedding in repositories, theses and

dissertations •  Tying to university identifiers/directory

information •  Incorporating in researcher information/

CRIS systems

Page 26: Supporting Evaluation with Unique and Persistent Identifiers

“We want to use ORCIDs to simplify the life of Oxford’s researchers for working with institutional systems and publishers’ systems by re-using already available information for publication data management and reporting. The motto is: Input once – re-use often.”   Wolfram Horstmann, Associate Director, Bodleian Libraries, University of Oxford http://orcid.org/0000-0001-8673-6104

15 February 2014 orcid.org 26

Page 27: Supporting Evaluation with Unique and Persistent Identifiers

Career Life Cycle

15 February 2014 orcid.org 27

http://guides.library.tamu.edu/content.php?pid=553864&sid=4564757

Page 28: Supporting Evaluation with Unique and Persistent Identifiers

Third party tools: Metrics

http://impactstory.org

Use your ORCID iD to obtain usage metrics for your

public works

15 February 2014 orcid.org 28

Page 29: Supporting Evaluation with Unique and Persistent Identifiers

What’s next?

•  Grants & account delegation (Q1) •  Triple the registry to 1.5 million users in 2014 •  Build membership & support adoption: support

national memberships, reduce barriers to using authentication, document use cases

•  Support adoption: Increase international reach: more languages, ambassadors, & community partners

29

Page 30: Supporting Evaluation with Unique and Persistent Identifiers

Need more information?

•  Find out more at http://orcid.org •  More on membership at http://orcid.org/about/membership •  Learn about tools to embed ORCID iDs at http://

support.orcid.org/knowledgebase/ •  Subscribe to our blog at http://orcid.org/about/news and follow

@ORCID_Org on Twitter •  Attend an Outreach Meeting, http://orcid.org/about/events

•  May 21-22, Chicago •  November 5, Tokyo

30 15 February 2014 orcid.org

Thank you!

Page 31: Supporting Evaluation with Unique and Persistent Identifiers

orcid.org Contact Info: p. +1-301-922-9062 a. 10411 Motor City Drive, Suite 750, Bethesda, MD 20817 USA

Supporting Evaluation with Unique and Persistent Identifiers for Researchers   16 February 2014 AAAS Annual Meeting, Chicago Rebecca Bryant, PhD

Director of Community, ORCID [email protected]

@ORCID_ORG http://orcid.org/0000-0002-2753-3881