Momentum of Open Research Data: now in 5-d!

94
Heather Piwowar @researchremix Postdoc with NESCent and Dryad, at Duke and UBC SFU Research Data Repository Project Launch October 2012 Momentum of open research data: now in 5-D! some photos NC, SA

description

Presentation by Heather Piwowar at Simon Fraser University in October 2012 at the SFU Research Data Repository Project Launch. Highlights current state of research data sharing. http://www.lib.sfu.ca/node/11510

Transcript of Momentum of Open Research Data: now in 5-d!

Page 1: Momentum of Open Research Data: now in 5-d!

Heather  Piwowar  @researchremix  Postdoc  with  NESCent  and  Dryad,  at  Duke  and  UBC

SFU  Research  Data  Repository  Project  Launch

 October  2012  

Momentum ofopen research data:

now in 5-D!

some photos NC, SA

Page 2: Momentum of Open Research Data: now in 5-d!

http://www.metmuseum.org/toah/ho/09/euwf/ho_24.45.1.htm

Page 3: Momentum of Open Research Data: now in 5-d!

http://www.flickr.com/photos/jsmjr/62443357/

Page 4: Momentum of Open Research Data: now in 5-d!

http://www.flickr.com/photos/camilleharrington/3587294608/

Page 5: Momentum of Open Research Data: now in 5-d!

http://www.flickr.com/photos/rkuhnau/3318245976/

Page 6: Momentum of Open Research Data: now in 5-d!

http://www.flickr.com/photos/conformpdx/1796399674/

Page 7: Momentum of Open Research Data: now in 5-d!

http://www.flickr.com/photos/rkuhnau/3317418699/

Page 8: Momentum of Open Research Data: now in 5-d!

http://www.flickr.com/photos/zemlinki/261617721/

Page 9: Momentum of Open Research Data: now in 5-d!

http://www.flickr.com/photos/tracenmatt/3020786491/

Page 10: Momentum of Open Research Data: now in 5-d!

http://www.flickr.com/photos/the-o/2078239333/

Page 11: Momentum of Open Research Data: now in 5-d!
Page 13: Momentum of Open Research Data: now in 5-d!

http://www.flickr.com/photos/75166820@N00/5318468/

Page 14: Momentum of Open Research Data: now in 5-d!

MOMENTUM

Page 15: Momentum of Open Research Data: now in 5-d!

5 dimensions

Page 16: Momentum of Open Research Data: now in 5-d!

- repositories- research- policies- tools- environment

Page 17: Momentum of Open Research Data: now in 5-d!

- repositories- research- policies- tools- environment

Page 18: Momentum of Open Research Data: now in 5-d!
Page 19: Momentum of Open Research Data: now in 5-d!
Page 20: Momentum of Open Research Data: now in 5-d!
Page 21: Momentum of Open Research Data: now in 5-d!

Discipline repositoryDatatype repositoryJournal repositoryInstitutional repository...

Page 22: Momentum of Open Research Data: now in 5-d!

Institutional repository:https://circle.ubc.ca/

Discipline repository:http://datadryad.org/

Datatype repository:http://www.ncbi.nlm.nih.gov/genbank/(example: http://www.ncbi.nlm.nih.gov/nuccore/192496?report=genbank )

Journal supplementary information:http://www.nature.com/nature/journal/v429/n6990/suppinfo/nature02564.html

Lab website:http://www.bx.psu.edu/~ross/dataset/DatasetHome.html

"Data paper"http://www.biomedcentral.com/bmcresnotes/

Catch-all data repository:http://figshare.com/

Page 23: Momentum of Open Research Data: now in 5-d!

X X

X

X

X

XX

X

X

X

X

X

X

X

X X

X

XX

XX

X

Page 24: Momentum of Open Research Data: now in 5-d!

What’s best?It depends.We don’t know.

Page 25: Momentum of Open Research Data: now in 5-d!

It depends.

Page 27: Momentum of Open Research Data: now in 5-d!

- repositories- research- policies- tools- environment

Page 28: Momentum of Open Research Data: now in 5-d!

Citation boost

Page 29: Momentum of Open Research Data: now in 5-d!

Gleditsch et al. 2003. Posting Your Data: Will You Be Scooped or Will You Be Famous?, International Studies Perspectives 4(1): 89–97.

Piwowar et al. 2007. Sharing Detailed research data is associated with increased citation Rate. PLoS ONE.

Ioannidis et al. Repeatability of published microarray gene expression analyses. Nature Genetics 41, 149 - 155

Pienta et al. 2010. NSR Social Science Secondary Use. Michigan IR.

Henneken et al. 2011. Linking to Data – Effect on Citation Rates in Astronomy. ESO.

Sears 2011. Data Sharing Effect on Article Citation rate in Paleoceanography. AGU.

Page 30: Momentum of Open Research Data: now in 5-d!

~70% in multivariate analysis

Page 31: Momentum of Open Research Data: now in 5-d!
Page 32: Momentum of Open Research Data: now in 5-d!

Amount shared and withheld

Page 33: Momentum of Open Research Data: now in 5-d!

0.05

0.10

0.15

0.20

0.25

0.30

0.35

Year article published

Pro

po

rtio

n o

f a

rtic

les w

ith

da

tase

ts f

ou

nd

in

GE

O o

r A

rra

yE

xp

ress

2000 2001 2002 2003 2004 2005 2006 2007 2008 2009

Proportion of articles with shared datasets, by year

Across  time

Page 34: Momentum of Open Research Data: now in 5-d!

19%

Piwowar and Chapman. Journal of Informetrics 2010

Page 35: Momentum of Open Research Data: now in 5-d!

Odds Ratio

0.25 0.50 1.00 2.00 4.00

OA journal & previous GEO-AE sharing

0.95Amount of NIH funding

Journal impact factor and policy

Higher Ed in USA

Cancer & humans

Multivariate nonlinear regression with interactions

Page 36: Momentum of Open Research Data: now in 5-d!

Amount of reuse

Page 37: Momentum of Open Research Data: now in 5-d!
Page 38: Momentum of Open Research Data: now in 5-d!
Page 39: Momentum of Open Research Data: now in 5-d!

Type of reuse

Page 40: Momentum of Open Research Data: now in 5-d!
Page 41: Momentum of Open Research Data: now in 5-d!

Cost/benefit

Page 42: Momentum of Open Research Data: now in 5-d!
Page 43: Momentum of Open Research Data: now in 5-d!

Traditional research funding:$400k = 16 papers

At Dryad cost levels,at similar levels of reuse to GEO, $400k would facilitate 1000 reuse papers

A stellar Scientific ROI is in easy reach.

2) more impact per funding dollar

Page 44: Momentum of Open Research Data: now in 5-d!

Piwowar, Vision, Whitlock (2011) Data archiving is a good investment. Nature 473, 285

http://researchremix.wordpress.com/2011/05/19/nature-letter/

Page 45: Momentum of Open Research Data: now in 5-d!

- repositories- research- policies- tools- environment

Page 46: Momentum of Open Research Data: now in 5-d!

Journal requirements

Page 47: Momentum of Open Research Data: now in 5-d!

“An inherent principle of publication is that others should be able to replicate and build upon the authors' published claims. Therefore, a condition of publication in a Nature journal is that authors are required to make materials, data and associated protocols available in a publicly accessible database …”

http://www.nature.com/authors/editorial_policies/availability.html

http://www.nature.com/nature/journal/v453/n7197/index.html

journal  data  sharing  policy

Page 48: Momentum of Open Research Data: now in 5-d!

JDAP<< Journal>> requires, as a condition for publication, that data supporting the results in the paper should be archived in an appropriate public archive, such as << list of approved archives here >>. Data are important products of the scientific enterprise, and they should be preserved and usable for decades in the future. Authors may elect to have the data publicly available at time of publication, or, if the technology of the archive allows, may opt to embargo access to the data for a period up to a year after publication. Exceptions may be granted at the discretion of the editor, especially for sensitive information such as human subject data or the location of endangered species.

Page 49: Momentum of Open Research Data: now in 5-d!

High-impact journals

tend to have

a strong data-sharing

policy

Page 50: Momentum of Open Research Data: now in 5-d!

Articles published in journals with a strong data-sharing policy are more likely to have publicly

available datasets

Page 51: Momentum of Open Research Data: now in 5-d!

NSF data management requirement

Page 52: Momentum of Open Research Data: now in 5-d!
Page 53: Momentum of Open Research Data: now in 5-d!

NSF biosketch

Page 54: Momentum of Open Research Data: now in 5-d!
Page 55: Momentum of Open Research Data: now in 5-d!

!"#

$!"#

%!"#

&!"#

'!"#

(!"#

)*+,-./0#1234.+55#

6# 6# 758*+4/# 6# 6# )*+,-./0#4.+55#

9:/54351#,*;5+3#<4-#=82/1#,-#>0#?,+@#>,+5#5432/0#

!"#

$!"#

%!"#

&!"#

'!"#

(!"#

)*+,-./0#1234.+55#

6# 6# 758*+4/# 6# 6# )*+,-./0#4.+55#

9:/54351#;#<2//#.5*#=,+5#>2*4?,-3##

Do not publicize

Page 56: Momentum of Open Research Data: now in 5-d!

!"#

$!"#

%!"#

&!"#

'!"#

(!"#

)*+,-./0#1234.+55#

6# 6# 758*+4/# 6# 6# )*+,-./0#4.+55#

9#:/54351#2*#;2//#<5#=4/851##<0#>0#?8-15+#

!"#

$!"#

%!"#

&!"#

'!"#

(!"#

)*+,-./0#1234.+55#

6# 6# 758*+4/# 6# 6# )*+,-./0#4.+55#

9#:/54351#2*#;2//#<5#=4/851##<0#>0#:+,>,?,-#,+#*5-8+5#@,>>2A55#

!"#

$!"#

%!"#

&!"#

'!"#

(!"#

)*+,-./0#1234.+55#

6# 6# 758*+4/# 6# 6# )*+,-./0#4.+55#

9:/54351#,*;5+3#<4-#=82/1#,-#>0#?,+@#>,+5#5432/0#

!"#

$!"#

%!"#

&!"#

'!"#

(!"#

)*+,-./0#1234.+55#

6# 6# 758*+4/# 6# 6# )*+,-./0#4.+55#

9:/54351#;#<2//#.5*#=,+5#>2*4?,-3##

Do not publicize

Page 58: Momentum of Open Research Data: now in 5-d!

NSF Biosketchstarting January:

Publications to Products

Page 59: Momentum of Open Research Data: now in 5-d!

- repositories- research- policies- tools- environment

Page 60: Momentum of Open Research Data: now in 5-d!

DataUp

Page 61: Momentum of Open Research Data: now in 5-d!

DMP Tool

Page 62: Momentum of Open Research Data: now in 5-d!

RunMyCode

Page 63: Momentum of Open Research Data: now in 5-d!
Page 64: Momentum of Open Research Data: now in 5-d!
Page 66: Momentum of Open Research Data: now in 5-d!

In 2009, 116 articles cited ORNL DAAC data.

Finding these articles took 70-80 hours

across at least 12 resourcesall chosen from a deep understanding of this specific research domain

then the full text of all the hits were manually reviewed

Valerie Enriquez interview with James Kidderhttp://openwetware.org/wiki/DataONE:Notebook/Reuse_of_repository_data

Page 67: Momentum of Open Research Data: now in 5-d!
Page 69: Momentum of Open Research Data: now in 5-d!
Page 70: Momentum of Open Research Data: now in 5-d!

altmetrics.org/tools

ImpactStoryaltmetric.comPLoS article-level metricsReader MeterScience Card

Page 71: Momentum of Open Research Data: now in 5-d!
Page 72: Momentum of Open Research Data: now in 5-d!
Page 73: Momentum of Open Research Data: now in 5-d!
Page 74: Momentum of Open Research Data: now in 5-d!

CC-BY-NC by maniacyak on flickrhttp://www.flickr.com/photos/maniacyak/3432589472

impact flavour

Page 75: Momentum of Open Research Data: now in 5-d!
Page 76: Momentum of Open Research Data: now in 5-d!
Page 77: Momentum of Open Research Data: now in 5-d!
Page 78: Momentum of Open Research Data: now in 5-d!
Page 79: Momentum of Open Research Data: now in 5-d!
Page 84: Momentum of Open Research Data: now in 5-d!
Page 85: Momentum of Open Research Data: now in 5-d!

ImpactStory.org

Page 86: Momentum of Open Research Data: now in 5-d!

- repositories- research- policies- tools- environment

Page 87: Momentum of Open Research Data: now in 5-d!

Open Access

Page 88: Momentum of Open Research Data: now in 5-d!

Reproducibility

Page 89: Momentum of Open Research Data: now in 5-d!

Big Data

Page 90: Momentum of Open Research Data: now in 5-d!

- repositories- research- policies- tools- environment

Page 91: Momentum of Open Research Data: now in 5-d!

GET EXCITEDand

MAKE THINGS

Page 92: Momentum of Open Research Data: now in 5-d!

Open up your data while you are doing it :)

http://www.flickr.com/photos/myklroventine/892446624/

Page 93: Momentum of Open Research Data: now in 5-d!

thank you!Todd Vision: PI of Dryad

Jason Priem: cofounder of ImpactStory

Also: Mike Whitlock, Jonathan Carlson, Estephanie Sta MariaThe open science online community and those who release their articles, datasets and photos openly.

blog: ResearchRemix.wordpress.com@researchremix

Page 94: Momentum of Open Research Data: now in 5-d!