Crossref Event Data A New, Open Underlying Data Set for...
Transcript of Crossref Event Data A New, Open Underlying Data Set for...
![Page 1: Crossref Event Data A New, Open Underlying Data Set for ...altmetrics.org/wp-content/uploads/2017/10/altmetrics17-joe-wass.pdf · Crossref Event Data A New, Open Underlying Data Set](https://reader030.fdocuments.in/reader030/viewer/2022040612/5edbb3a7ad6a402d66660d2d/html5/thumbnails/1.jpg)
![Page 2: Crossref Event Data A New, Open Underlying Data Set for ...altmetrics.org/wp-content/uploads/2017/10/altmetrics17-joe-wass.pdf · Crossref Event Data A New, Open Underlying Data Set](https://reader030.fdocuments.in/reader030/viewer/2022040612/5edbb3a7ad6a402d66660d2d/html5/thumbnails/2.jpg)
Crossref Event Data A New, Open Underlying Data Set for Altmetricsaltmetrics17 workshop
Joe WassPrincipal R&D EngineerCrossref@joewass
![Page 3: Crossref Event Data A New, Open Underlying Data Set for ...altmetrics.org/wp-content/uploads/2017/10/altmetrics17-joe-wass.pdf · Crossref Event Data A New, Open Underlying Data Set](https://reader030.fdocuments.in/reader030/viewer/2022040612/5edbb3a7ad6a402d66660d2d/html5/thumbnails/3.jpg)
Hello again!
![Page 4: Crossref Event Data A New, Open Underlying Data Set for ...altmetrics.org/wp-content/uploads/2017/10/altmetrics17-joe-wass.pdf · Crossref Event Data A New, Open Underlying Data Set](https://reader030.fdocuments.in/reader030/viewer/2022040612/5edbb3a7ad6a402d66660d2d/html5/thumbnails/4.jpg)
What is an “underlying dataset”?
![Page 5: Crossref Event Data A New, Open Underlying Data Set for ...altmetrics.org/wp-content/uploads/2017/10/altmetrics17-joe-wass.pdf · Crossref Event Data A New, Open Underlying Data Set](https://reader030.fdocuments.in/reader030/viewer/2022040612/5edbb3a7ad6a402d66660d2d/html5/thumbnails/5.jpg)
Problems to tackle when building a metric or doing research.
![Page 6: Crossref Event Data A New, Open Underlying Data Set for ...altmetrics.org/wp-content/uploads/2017/10/altmetrics17-joe-wass.pdf · Crossref Event Data A New, Open Underlying Data Set](https://reader030.fdocuments.in/reader030/viewer/2022040612/5edbb3a7ad6a402d66660d2d/html5/thumbnails/6.jpg)
Identifying a data set.
![Page 7: Crossref Event Data A New, Open Underlying Data Set for ...altmetrics.org/wp-content/uploads/2017/10/altmetrics17-joe-wass.pdf · Crossref Event Data A New, Open Underlying Data Set](https://reader030.fdocuments.in/reader030/viewer/2022040612/5edbb3a7ad6a402d66660d2d/html5/thumbnails/7.jpg)
Identifying a data set.
Links from where?
![Page 8: Crossref Event Data A New, Open Underlying Data Set for ...altmetrics.org/wp-content/uploads/2017/10/altmetrics17-joe-wass.pdf · Crossref Event Data A New, Open Underlying Data Set](https://reader030.fdocuments.in/reader030/viewer/2022040612/5edbb3a7ad6a402d66660d2d/html5/thumbnails/8.jpg)
Identifying a data set.
Links to where?
![Page 9: Crossref Event Data A New, Open Underlying Data Set for ...altmetrics.org/wp-content/uploads/2017/10/altmetrics17-joe-wass.pdf · Crossref Event Data A New, Open Underlying Data Set](https://reader030.fdocuments.in/reader030/viewer/2022040612/5edbb3a7ad6a402d66660d2d/html5/thumbnails/9.jpg)
Identifying a data set.
What kind of links?
![Page 10: Crossref Event Data A New, Open Underlying Data Set for ...altmetrics.org/wp-content/uploads/2017/10/altmetrics17-joe-wass.pdf · Crossref Event Data A New, Open Underlying Data Set](https://reader030.fdocuments.in/reader030/viewer/2022040612/5edbb3a7ad6a402d66660d2d/html5/thumbnails/10.jpg)
Non-traditional publications, non-traditional rules.
![Page 11: Crossref Event Data A New, Open Underlying Data Set for ...altmetrics.org/wp-content/uploads/2017/10/altmetrics17-joe-wass.pdf · Crossref Event Data A New, Open Underlying Data Set](https://reader030.fdocuments.in/reader030/viewer/2022040612/5edbb3a7ad6a402d66660d2d/html5/thumbnails/11.jpg)
Collecting data from the corpus.
![Page 12: Crossref Event Data A New, Open Underlying Data Set for ...altmetrics.org/wp-content/uploads/2017/10/altmetrics17-joe-wass.pdf · Crossref Event Data A New, Open Underlying Data Set](https://reader030.fdocuments.in/reader030/viewer/2022040612/5edbb3a7ad6a402d66660d2d/html5/thumbnails/12.jpg)
Identifying & canonicalising links.
Link rot in your dataset.
![Page 13: Crossref Event Data A New, Open Underlying Data Set for ...altmetrics.org/wp-content/uploads/2017/10/altmetrics17-joe-wass.pdf · Crossref Event Data A New, Open Underlying Data Set](https://reader030.fdocuments.in/reader030/viewer/2022040612/5edbb3a7ad6a402d66660d2d/html5/thumbnails/13.jpg)
Recording data for reproducibility.
“The data we got are not transparent””
![Page 14: Crossref Event Data A New, Open Underlying Data Set for ...altmetrics.org/wp-content/uploads/2017/10/altmetrics17-joe-wass.pdf · Crossref Event Data A New, Open Underlying Data Set](https://reader030.fdocuments.in/reader030/viewer/2022040612/5edbb3a7ad6a402d66660d2d/html5/thumbnails/14.jpg)
Who’s human? Who’s a machine?
![Page 15: Crossref Event Data A New, Open Underlying Data Set for ...altmetrics.org/wp-content/uploads/2017/10/altmetrics17-joe-wass.pdf · Crossref Event Data A New, Open Underlying Data Set](https://reader030.fdocuments.in/reader030/viewer/2022040612/5edbb3a7ad6a402d66660d2d/html5/thumbnails/15.jpg)
Two categories.
![Page 16: Crossref Event Data A New, Open Underlying Data Set for ...altmetrics.org/wp-content/uploads/2017/10/altmetrics17-joe-wass.pdf · Crossref Event Data A New, Open Underlying Data Set](https://reader030.fdocuments.in/reader030/viewer/2022040612/5edbb3a7ad6a402d66660d2d/html5/thumbnails/16.jpg)
Category A
Everyone has to solve these.
![Page 17: Crossref Event Data A New, Open Underlying Data Set for ...altmetrics.org/wp-content/uploads/2017/10/altmetrics17-joe-wass.pdf · Crossref Event Data A New, Open Underlying Data Set](https://reader030.fdocuments.in/reader030/viewer/2022040612/5edbb3a7ad6a402d66660d2d/html5/thumbnails/17.jpg)
Category B
Everyone has to different issues.
![Page 18: Crossref Event Data A New, Open Underlying Data Set for ...altmetrics.org/wp-content/uploads/2017/10/altmetrics17-joe-wass.pdf · Crossref Event Data A New, Open Underlying Data Set](https://reader030.fdocuments.in/reader030/viewer/2022040612/5edbb3a7ad6a402d66660d2d/html5/thumbnails/18.jpg)
Category BParticular corpus of articles. Links from a particular website. Blogs from known authors. Links via DOIs or not. Building different things?
![Page 19: Crossref Event Data A New, Open Underlying Data Set for ...altmetrics.org/wp-content/uploads/2017/10/altmetrics17-joe-wass.pdf · Crossref Event Data A New, Open Underlying Data Set](https://reader030.fdocuments.in/reader030/viewer/2022040612/5edbb3a7ad6a402d66660d2d/html5/thumbnails/19.jpg)
Category A: We can help you solve.
Category B: We can do.
![Page 20: Crossref Event Data A New, Open Underlying Data Set for ...altmetrics.org/wp-content/uploads/2017/10/altmetrics17-joe-wass.pdf · Crossref Event Data A New, Open Underlying Data Set](https://reader030.fdocuments.in/reader030/viewer/2022040612/5edbb3a7ad6a402d66660d2d/html5/thumbnails/20.jpg)
Crossref
![Page 21: Crossref Event Data A New, Open Underlying Data Set for ...altmetrics.org/wp-content/uploads/2017/10/altmetrics17-joe-wass.pdf · Crossref Event Data A New, Open Underlying Data Set](https://reader030.fdocuments.in/reader030/viewer/2022040612/5edbb3a7ad6a402d66660d2d/html5/thumbnails/21.jpg)
~100 million items. Metadata. Infrastructure to make it work.
![Page 22: Crossref Event Data A New, Open Underlying Data Set for ...altmetrics.org/wp-content/uploads/2017/10/altmetrics17-joe-wass.pdf · Crossref Event Data A New, Open Underlying Data Set](https://reader030.fdocuments.in/reader030/viewer/2022040612/5edbb3a7ad6a402d66660d2d/html5/thumbnails/22.jpg)
Metadata typically provided by publishers.
![Page 23: Crossref Event Data A New, Open Underlying Data Set for ...altmetrics.org/wp-content/uploads/2017/10/altmetrics17-joe-wass.pdf · Crossref Event Data A New, Open Underlying Data Set](https://reader030.fdocuments.in/reader030/viewer/2022040612/5edbb3a7ad6a402d66660d2d/html5/thumbnails/23.jpg)
Crossref Registered Content
The Rest of the world
relations,funding information,author links
citations
![Page 24: Crossref Event Data A New, Open Underlying Data Set for ...altmetrics.org/wp-content/uploads/2017/10/altmetrics17-joe-wass.pdf · Crossref Event Data A New, Open Underlying Data Set](https://reader030.fdocuments.in/reader030/viewer/2022040612/5edbb3a7ad6a402d66660d2d/html5/thumbnails/24.jpg)
Crossref Registered Content
The Rest of the world
citationsrelations,funding information,author links
Event Data
![Page 25: Crossref Event Data A New, Open Underlying Data Set for ...altmetrics.org/wp-content/uploads/2017/10/altmetrics17-joe-wass.pdf · Crossref Event Data A New, Open Underlying Data Set](https://reader030.fdocuments.in/reader030/viewer/2022040612/5edbb3a7ad6a402d66660d2d/html5/thumbnails/25.jpg)
No longer supplied by publishers.
![Page 26: Crossref Event Data A New, Open Underlying Data Set for ...altmetrics.org/wp-content/uploads/2017/10/altmetrics17-joe-wass.pdf · Crossref Event Data A New, Open Underlying Data Set](https://reader030.fdocuments.in/reader030/viewer/2022040612/5edbb3a7ad6a402d66660d2d/html5/thumbnails/26.jpg)
An underlying data set.
(Category A)
![Page 27: Crossref Event Data A New, Open Underlying Data Set for ...altmetrics.org/wp-content/uploads/2017/10/altmetrics17-joe-wass.pdf · Crossref Event Data A New, Open Underlying Data Set](https://reader030.fdocuments.in/reader030/viewer/2022040612/5edbb3a7ad6a402d66660d2d/html5/thumbnails/27.jpg)
Problems
![Page 28: Crossref Event Data A New, Open Underlying Data Set for ...altmetrics.org/wp-content/uploads/2017/10/altmetrics17-joe-wass.pdf · Crossref Event Data A New, Open Underlying Data Set](https://reader030.fdocuments.in/reader030/viewer/2022040612/5edbb3a7ad6a402d66660d2d/html5/thumbnails/28.jpg)
Which data set to use?
A
![Page 29: Crossref Event Data A New, Open Underlying Data Set for ...altmetrics.org/wp-content/uploads/2017/10/altmetrics17-joe-wass.pdf · Crossref Event Data A New, Open Underlying Data Set](https://reader030.fdocuments.in/reader030/viewer/2022040612/5edbb3a7ad6a402d66660d2d/html5/thumbnails/29.jpg)
Which link source corpus?
A
![Page 30: Crossref Event Data A New, Open Underlying Data Set for ...altmetrics.org/wp-content/uploads/2017/10/altmetrics17-joe-wass.pdf · Crossref Event Data A New, Open Underlying Data Set](https://reader030.fdocuments.in/reader030/viewer/2022040612/5edbb3a7ad6a402d66660d2d/html5/thumbnails/30.jpg)
•Reddit ~ 100,000 •Twitter ~ 3,000,000 •Wikipedia ~ 30,000,000 •hypothes.is ~ 20,000 •wordpress.com ~ 30,000 •Blogs ~ 200,000 •Stack Exchange ~ 6,000
A
![Page 31: Crossref Event Data A New, Open Underlying Data Set for ...altmetrics.org/wp-content/uploads/2017/10/altmetrics17-joe-wass.pdf · Crossref Event Data A New, Open Underlying Data Set](https://reader030.fdocuments.in/reader030/viewer/2022040612/5edbb3a7ad6a402d66660d2d/html5/thumbnails/31.jpg)
What kind of links?
A
![Page 32: Crossref Event Data A New, Open Underlying Data Set for ...altmetrics.org/wp-content/uploads/2017/10/altmetrics17-joe-wass.pdf · Crossref Event Data A New, Open Underlying Data Set](https://reader030.fdocuments.in/reader030/viewer/2022040612/5edbb3a7ad6a402d66660d2d/html5/thumbnails/32.jpg)
Canonicalisation and link rot.
A
![Page 33: Crossref Event Data A New, Open Underlying Data Set for ...altmetrics.org/wp-content/uploads/2017/10/altmetrics17-joe-wass.pdf · Crossref Event Data A New, Open Underlying Data Set](https://reader030.fdocuments.in/reader030/viewer/2022040612/5edbb3a7ad6a402d66660d2d/html5/thumbnails/33.jpg)
Reproducibility of data collection.
A
![Page 34: Crossref Event Data A New, Open Underlying Data Set for ...altmetrics.org/wp-content/uploads/2017/10/altmetrics17-joe-wass.pdf · Crossref Event Data A New, Open Underlying Data Set](https://reader030.fdocuments.in/reader030/viewer/2022040612/5edbb3a7ad6a402d66660d2d/html5/thumbnails/34.jpg)
Reproducibility of state.
A
![Page 35: Crossref Event Data A New, Open Underlying Data Set for ...altmetrics.org/wp-content/uploads/2017/10/altmetrics17-joe-wass.pdf · Crossref Event Data A New, Open Underlying Data Set](https://reader030.fdocuments.in/reader030/viewer/2022040612/5edbb3a7ad6a402d66660d2d/html5/thumbnails/35.jpg)
Reproducibility of data processing.
A
![Page 36: Crossref Event Data A New, Open Underlying Data Set for ...altmetrics.org/wp-content/uploads/2017/10/altmetrics17-joe-wass.pdf · Crossref Event Data A New, Open Underlying Data Set](https://reader030.fdocuments.in/reader030/viewer/2022040612/5edbb3a7ad6a402d66660d2d/html5/thumbnails/36.jpg)
Representing an evolving set of links.
A
![Page 37: Crossref Event Data A New, Open Underlying Data Set for ...altmetrics.org/wp-content/uploads/2017/10/altmetrics17-joe-wass.pdf · Crossref Event Data A New, Open Underlying Data Set](https://reader030.fdocuments.in/reader030/viewer/2022040612/5edbb3a7ad6a402d66660d2d/html5/thumbnails/37.jpg)
Telling humans from machines.
B
![Page 38: Crossref Event Data A New, Open Underlying Data Set for ...altmetrics.org/wp-content/uploads/2017/10/altmetrics17-joe-wass.pdf · Crossref Event Data A New, Open Underlying Data Set](https://reader030.fdocuments.in/reader030/viewer/2022040612/5edbb3a7ad6a402d66660d2d/html5/thumbnails/38.jpg)
Artifacts Agents Evidence Percolator
External APIs & Websites
External APIs & Websites
Evidence Logs
Event
Agents consume Artifacts
Agents produce Evidence Records
Percolator consumes Evidence Records
Percolator produces
Events
Percolator consults external services
Agents monitor external services
![Page 39: Crossref Event Data A New, Open Underlying Data Set for ...altmetrics.org/wp-content/uploads/2017/10/altmetrics17-joe-wass.pdf · Crossref Event Data A New, Open Underlying Data Set](https://reader030.fdocuments.in/reader030/viewer/2022040612/5edbb3a7ad6a402d66660d2d/html5/thumbnails/39.jpg)
![Page 40: Crossref Event Data A New, Open Underlying Data Set for ...altmetrics.org/wp-content/uploads/2017/10/altmetrics17-joe-wass.pdf · Crossref Event Data A New, Open Underlying Data Set](https://reader030.fdocuments.in/reader030/viewer/2022040612/5edbb3a7ad6a402d66660d2d/html5/thumbnails/40.jpg)
All data is free. CC0, CC-BY-4.0, etc
![Page 41: Crossref Event Data A New, Open Underlying Data Set for ...altmetrics.org/wp-content/uploads/2017/10/altmetrics17-joe-wass.pdf · Crossref Event Data A New, Open Underlying Data Set](https://reader030.fdocuments.in/reader030/viewer/2022040612/5edbb3a7ad6a402d66660d2d/html5/thumbnails/41.jpg)
Open for Beta
![Page 42: Crossref Event Data A New, Open Underlying Data Set for ...altmetrics.org/wp-content/uploads/2017/10/altmetrics17-joe-wass.pdf · Crossref Event Data A New, Open Underlying Data Set](https://reader030.fdocuments.in/reader030/viewer/2022040612/5edbb3a7ad6a402d66660d2d/html5/thumbnails/42.jpg)
https://www.eventdata.crossref.org/guide/
https://www.crossref.org/blog
4:AM Talk & Hackathon!
[email protected]@joewass