Data Citation from the perspective of tracking data reuse

80
Data Citation Challenges and Opportunities from the perspective of Tracking Data Reuse Heather Piwowar DataONE postdoc with NESCent and Dryad @researchremix DataCite Summer Meeting August 2011

description

Presentation by Heather Piwowar at DataCite 2011 Summer Meeting, Aug 24 2011.

Transcript of Data Citation from the perspective of tracking data reuse

Page 1: Data Citation from the perspective of tracking data reuse

Data Citation Challenges and Opportunities

from the perspective ofTracking Data Reuse

Heather  PiwowarDataONE  postdoc  with  NESCent  and  Dryad

@researchremix  

DataCite  Summer  MeetingAugust  2011

Page 2: Data Citation from the perspective of tracking data reuse

http://www.metmuseum.org/toah/ho/09/euwf/ho_24.45.1.htm

Page 3: Data Citation from the perspective of tracking data reuse

http://www.flickr.com/photos/jsmjr/62443357/

Page 4: Data Citation from the perspective of tracking data reuse

http://www.flickr.com/photos/camilleharrington/3587294608/

Page 5: Data Citation from the perspective of tracking data reuse

http://www.flickr.com/photos/rkuhnau/3318245976/

Page 6: Data Citation from the perspective of tracking data reuse

http://www.flickr.com/photos/conformpdx/1796399674/

Page 7: Data Citation from the perspective of tracking data reuse

http://www.flickr.com/photos/rkuhnau/3317418699/

Page 8: Data Citation from the perspective of tracking data reuse

http://www.flickr.com/photos/zemlinki/261617721/

Page 9: Data Citation from the perspective of tracking data reuse

http://www.flickr.com/photos/tracenmatt/3020786491/

Page 10: Data Citation from the perspective of tracking data reuse

http://www.flickr.com/photos/the-o/2078239333/

Page 15: Data Citation from the perspective of tracking data reuse
Page 17: Data Citation from the perspective of tracking data reuse
Page 18: Data Citation from the perspective of tracking data reuse
Page 19: Data Citation from the perspective of tracking data reuse
Page 20: Data Citation from the perspective of tracking data reuse

We have observed reuse of at 35% of GEO datasets submitted in 2005.

Page 21: Data Citation from the perspective of tracking data reuse

Piwowar, Vision, Whitlock (2011) Data archiving is a good investment. Nature 473, 285

http://researchremix.wordpress.com/2011/05/19/nature-letter/

Page 22: Data Citation from the perspective of tracking data reuse

Tracking 1k

Page 23: Data Citation from the perspective of tracking data reuse

10 * 100 = 1000

Page 24: Data Citation from the perspective of tracking data reuse

!"#

$!"#

%!"#

&!"#

'!"#

(!"#

)!"#

*!"#

+!"#

,!"#

$!!"#

-./# 0123141# 56447184#

!"#$"%

&'()'*

++',*

&*'#"

-."'*/

#01-2

(%.'

948:;1<4=

># 1?6@AB:C2#@2#64D4642E4#

1?6@AB:C2#@2#DCC<2C<4#

1?6@AB:C2#@2#<1AF4#

1?6@AB:C2#@2#<4G<#

Page 25: Data Citation from the perspective of tracking data reuse

!"!!!!

!#$!!

!%$$!!

!%#$!!

!&$$!!

!&#$!!

&$$'! &$$#! &$$(! &$$)! &$$*! &$$+! &$%$! &$%%!

!"#

$%&'(

)'*+,+'&%"-%-'.,

-./01,2

3!

456!

70890,0!

:;,,<0-,!

=>?@89!0?,;,09,!A4563!

=>?@89!0?,;09,!A70890,03!

=>?@89!0?,;09,!A:;,,<0-,3!

Page 26: Data Citation from the perspective of tracking data reuse

https://notebooks.dataone.org/tracking1000datasets/

Piwowar, Carlson, Vision (2011) Beginning to track 1000 datasets from public repositories into the published literature. ASIS&T poster.

Page 27: Data Citation from the perspective of tracking data reuse

My research blog:

ResearchRemix.wordpress.com

http://www.flickr.com/photos/myklroventine/892446624/

Page 28: Data Citation from the perspective of tracking data reuse

Data citation in the wild IDCC 2010 poster.

Page 29: Data Citation from the perspective of tracking data reuse

A best-practice solution!

Page 30: Data Citation from the perspective of tracking data reuse
Page 31: Data Citation from the perspective of tracking data reuse
Page 33: Data Citation from the perspective of tracking data reuse

#1

Lack of tool support for our best practice

Page 34: Data Citation from the perspective of tracking data reuse
Page 35: Data Citation from the perspective of tracking data reuse
Page 36: Data Citation from the perspective of tracking data reuse
Page 37: Data Citation from the perspective of tracking data reuse
Page 38: Data Citation from the perspective of tracking data reuse
Page 41: Data Citation from the perspective of tracking data reuse

We need more diversityWe need more players

We need start-ups

Page 42: Data Citation from the perspective of tracking data reuse

Abstracts are open. Ref lists should be too.

Page 43: Data Citation from the perspective of tracking data reuse

#2

Our best practice doesn’t scale to mega-reuse

Page 44: Data Citation from the perspective of tracking data reuse
Page 45: Data Citation from the perspective of tracking data reuse

!"#$!"#%!"#&!"#'!"#(!"#)!"#*!"#+!"#,!"#

$!!"#

!# (# $!# $(# %!# %(# &!#

!"#$%&'()'*+,+-%,-'&%)%&%./%*'$0'+&1/2%-',3+,'&%"-%*'456'*+,+7'/"#"2+18%'

Page 46: Data Citation from the perspective of tracking data reuse

!"#$!"#%!"#&!"#'!"#(!"#)!"#*!"#+!"#,!"#

$!!"#

!# (# $!# $(# %!# %(# &!#

!"#$%&'()'*+,+-%,-'&%)%&%./%*'$0'+&1/2%-',3+,'&%"-%*'456'*+,+7'/"#"2+18%'

Page 47: Data Citation from the perspective of tracking data reuse

!"#$!"#%!"#&!"#'!"#(!"#)!"#*!"#+!"#,!"#

$!!"#

!# (# $!# $(# %!# %(# &!#

!"#$%&'()'*+,+-%,-'&%)%&%./%*'$0'+&1/2%-',3+,'&%"-%*'456'*+,+7'/"#"2+18%'

Page 49: Data Citation from the perspective of tracking data reuse
Page 50: Data Citation from the perspective of tracking data reuse

But wait!

Page 51: Data Citation from the perspective of tracking data reuse
Page 52: Data Citation from the perspective of tracking data reuse
Page 53: Data Citation from the perspective of tracking data reuse
Page 54: Data Citation from the perspective of tracking data reuse
Page 55: Data Citation from the perspective of tracking data reuse
Page 56: Data Citation from the perspective of tracking data reuse

#2

Our best practice doesn’tcan

scale to mega-reuse(if we work at it)

Page 57: Data Citation from the perspective of tracking data reuse

Another place where having a few big players is a bottleneck

Open reference lists.

Page 58: Data Citation from the perspective of tracking data reuse

#3a

Adoption of best practices erode incentives in the

short term

Page 59: Data Citation from the perspective of tracking data reuse

~70% in multivariate analysis

Page 60: Data Citation from the perspective of tracking data reuse

#3b

Data citations only matter if they are valued

Page 61: Data Citation from the perspective of tracking data reuse

Please donʼt tweet or publicize this next bit...

Early results from an ongoing survey.

n=538

Page 62: Data Citation from the perspective of tracking data reuse

!"#

$!"#

%!"#

&!"#

'!"#

(!"#

)*+,-./0#1234.+55#

6# 6# 758*+4/# 6# 6# )*+,-./0#4.+55#

9:/54351#,*;5+3#<4-#=82/1#,-#>0#?,+@#>,+5#5432/0#

!"#

$!"#

%!"#

&!"#

'!"#

(!"#

)*+,-./0#1234.+55#

6# 6# 758*+4/# 6# 6# )*+,-./0#4.+55#

9:/54351#;#<2//#.5*#=,+5#>2*4?,-3##

Do not publicize

Page 63: Data Citation from the perspective of tracking data reuse

!"#

$!"#

%!"#

&!"#

'!"#

(!"#

)*+,-./0#1234.+55#

6# 6# 758*+4/# 6# 6# )*+,-./0#4.+55#

9#:/54351#2*#;2//#<5#=4/851##<0#>0#?8-15+#

!"#

$!"#

%!"#

&!"#

'!"#

(!"#

)*+,-./0#1234.+55#

6# 6# 758*+4/# 6# 6# )*+,-./0#4.+55#

9#:/54351#2*#;2//#<5#=4/851##<0#>0#:+,>,?,-#,+#*5-8+5#@,>>2A55#

!"#

$!"#

%!"#

&!"#

'!"#

(!"#

)*+,-./0#1234.+55#

6# 6# 758*+4/# 6# 6# )*+,-./0#4.+55#

9:/54351#,*;5+3#<4-#=82/1#,-#>0#?,+@#>,+5#5432/0#

!"#

$!"#

%!"#

&!"#

'!"#

(!"#

)*+,-./0#1234.+55#

6# 6# 758*+4/# 6# 6# )*+,-./0#4.+55#

9:/54351#;#<2//#.5*#=,+5#>2*4?,-3##

Do not publicize

Page 64: Data Citation from the perspective of tracking data reuse

Top-down

Page 66: Data Citation from the perspective of tracking data reuse

Bottom-up

Page 67: Data Citation from the perspective of tracking data reuse
Page 68: Data Citation from the perspective of tracking data reuse
Page 69: Data Citation from the perspective of tracking data reuse
Page 70: Data Citation from the perspective of tracking data reuse
Page 71: Data Citation from the perspective of tracking data reuse

Text

DataCite!

Page 75: Data Citation from the perspective of tracking data reuse

thank youTodd Vision,

Jonathan Carlson, Estephanie Sta Maria, Nicholas Weber, Sarah Judson, Valerie EnriquezJason Priem and Beyond ImpactDryad and DataONE teams

The open science online community and those who release their articles, datasets and photos openly

blog: ResearchRemix.wordpress.com

Page 76: Data Citation from the perspective of tracking data reuse

No consistent practice

Page 77: Data Citation from the perspective of tracking data reuse

Sarah Judson, Data citation in the wild IDCC 2010 poster.

We reviewed 500 articles in six major evolution and ecology journals for evidence of data citation:

Page 78: Data Citation from the perspective of tracking data reuse

Sarah Judson, Data citation in the wild IDCC 2010 poster.

We reviewed 500 articles in six major evolution and ecology journals for evidence of data citation:

Page 79: Data Citation from the perspective of tracking data reuse
Page 80: Data Citation from the perspective of tracking data reuse

In 2009, 116 articles cited ORNL DAAC data.

Finding these articles took 70-80 hours

across at least 12 resourcesall chosen from a deep understanding of this specific research domain

then the full text of all the hits were manually reviewed

Valerie Enriquez interview with James Kidderhttp://openwetware.org/wiki/DataONE:Notebook/Reuse_of_repository_data