Charlie Rapple Co-founder and Director Harnessing Researchers’ Expertise and Networks to increase...

39
Charlie Rapple Co-founder and Director g Researchers’ and Networks se sage, and Introducing Kudos CONFIDENTIAL: NOT FOR EXTERNAL CIRCULATION

Transcript of Charlie Rapple Co-founder and Director Harnessing Researchers’ Expertise and Networks to increase...

Page 1: Charlie Rapple Co-founder and Director Harnessing Researchers’ Expertise and Networks to increase Article Usage, Citations and Impact Introducing Kudos.

Charlie RappleCo-founder

and DirectorHarnessing Researchers’Expertise and Networks to increase Article Usage, Citations and Impact

Introducing Kudos

CONFIDENTIAL: NOT FOR EXTERNAL CIRCULATION

Page 2: Charlie Rapple Co-founder and Director Harnessing Researchers’ Expertise and Networks to increase Article Usage, Citations and Impact Introducing Kudos.

1996 2006

The problem that we are solving,

or, “challenges in the information sector”

Page 3: Charlie Rapple Co-founder and Director Harnessing Researchers’ Expertise and Networks to increase Article Usage, Citations and Impact Introducing Kudos.

CONFIDENTIAL: NOT FOR EXTERNAL CIRCULATION 3

♯1: information overload

Growth curve for number of articles published per annumChart based on 3.26% pa growth in article numbers,the lower limit proposed by Mabe and Amin in „Growth dynamics of scholarly and scientific journals”. Scientometrics, 51:1 (2001) 147–162

In the world today, there are

50 million published research articlesand that number is doubling every twenty years

but readers’ time is not doubling!

Page 4: Charlie Rapple Co-founder and Director Harnessing Researchers’ Expertise and Networks to increase Article Usage, Citations and Impact Introducing Kudos.

CONFIDENTIAL: NOT FOR EXTERNAL CIRCULATION

♯2: dense communication

4

• Research requires expertise to understand

• Formal communications often dense

• Opportunity for new discoverability layer

– e.g. impact statements

– e.g. lay summaries

– e.g. video ‘abstracts’

– e.g. visual abstracts

– e.g. data

Such useful materials lost in silos

Page 5: Charlie Rapple Co-founder and Director Harnessing Researchers’ Expertise and Networks to increase Article Usage, Citations and Impact Introducing Kudos.

CONFIDENTIAL: NOT FOR EXTERNAL CIRCULATION

♯3: under-utilized networks

• Personal networks are key to how people share, find and select relevant articles

• Traditionally: conferences, word of mouth, email

• Future: social networks (exist, but underutilized)

5

Page 6: Charlie Rapple Co-founder and Director Harnessing Researchers’ Expertise and Networks to increase Article Usage, Citations and Impact Introducing Kudos.

CONFIDENTIAL: NOT FOR EXTERNAL CIRCULATION

Self-fulfilling popularity

6

Usa

ge o

r ci

tati

ons

Article Usage / Citation Distribution

Usage / citations

Most read/cited article

Least read/cited article

Page 7: Charlie Rapple Co-founder and Director Harnessing Researchers’ Expertise and Networks to increase Article Usage, Citations and Impact Introducing Kudos.

1996 2006

Meanwhile …

Page 8: Charlie Rapple Co-founder and Director Harnessing Researchers’ Expertise and Networks to increase Article Usage, Citations and Impact Introducing Kudos.

CONFIDENTIAL: NOT FOR EXTERNAL CIRCULATION

Rise of article-level metrics

8

Page 9: Charlie Rapple Co-founder and Director Harnessing Researchers’ Expertise and Networks to increase Article Usage, Citations and Impact Introducing Kudos.

CONFIDENTIAL: NOT FOR EXTERNAL CIRCULATION

Emergence of altmetrics

9

Page 10: Charlie Rapple Co-founder and Director Harnessing Researchers’ Expertise and Networks to increase Article Usage, Citations and Impact Introducing Kudos.

CONFIDENTIAL: NOT FOR EXTERNAL CIRCULATION

Changes in research evaluation

Different and diverse ways to assess impactLess focus on publication metricsMore focus on individual performance

Page 11: Charlie Rapple Co-founder and Director Harnessing Researchers’ Expertise and Networks to increase Article Usage, Citations and Impact Introducing Kudos.

11

Article-level

metrics• Altmetrics

• Usage marketing Author

services• Open access

• Academic spring

• Community• Advocacy

Discovery• SEO

• Social media• International

reach• Metadata

• Marketing to individualsClosing

the loop• Data-driven

services• Integration not

duplication

Intelligent reading

• Filtering• Multimedia

• Public accessibility

Research evaluatio

n• Funding

• REF, STAR• ORCID

• H-index etcPerfectStorm?

Page 12: Charlie Rapple Co-founder and Director Harnessing Researchers’ Expertise and Networks to increase Article Usage, Citations and Impact Introducing Kudos.

CONFIDENTIAL: NOT FOR EXTERNAL CIRCULATION

Our challenge

12

How to match the

right people to the right articles?

Problem 1: too much

information, not enough

time

Problem 2: valuable

assets lost in silos

Problem 3: valuable networks

underutilized

Authors

Publishers Funders

Institutions

Page 13: Charlie Rapple Co-founder and Director Harnessing Researchers’ Expertise and Networks to increase Article Usage, Citations and Impact Introducing Kudos.

1996 2006

Our solution

Page 14: Charlie Rapple Co-founder and Director Harnessing Researchers’ Expertise and Networks to increase Article Usage, Citations and Impact Introducing Kudos.

CONFIDENTIAL: NOT FOR EXTERNAL CIRCULATION

• Harness researchers’ expertise to aid understanding of their work and give it context

• Leverage researchers’ networks to increase exposure for their work

• Supercharge existing efforts by institutions, funders, publishers by involving researchers more effectively

• Automated • Scalable • Cross-publisher • Rewarding

The missing link

14

Page 15: Charlie Rapple Co-founder and Director Harnessing Researchers’ Expertise and Networks to increase Article Usage, Citations and Impact Introducing Kudos.

CONFIDENTIAL: NOT FOR EXTERNAL CIRCULATION

That’s what lies behind …

Helping maximize the impact of published research by: • Empowering authors to explain and share their work

• Using article-level metrics to motivate and reward them

• Driving traffic back to publisher sites

• Strengthening relationships between authors and publishers

15

Page 16: Charlie Rapple Co-founder and Director Harnessing Researchers’ Expertise and Networks to increase Article Usage, Citations and Impact Introducing Kudos.

CONFIDENTIAL: NOT FOR EXTERNAL CIRCULATION

Three core steps for researchers

Increase discoverability,

monitor effect of tools

Write plain English descriptions to explain work:

• Short title• Lay summary• Impact statement

Add links to resources that put work in context:

• Videos• Images• Blog entries …

Share trackable links within existing networks:

• Email • Facebook• Twitter

step 1 step 2 step 3

Make articles more discoverable (data distributed by Kudos) and easier to appraise / interpret (data displayed

alongside article)

Page 17: Charlie Rapple Co-founder and Director Harnessing Researchers’ Expertise and Networks to increase Article Usage, Citations and Impact Introducing Kudos.

1996 2006

Progress to date

Page 18: Charlie Rapple Co-founder and Director Harnessing Researchers’ Expertise and Networks to increase Article Usage, Citations and Impact Introducing Kudos.

CONFIDENTIAL: NOT FOR EXTERNAL CIRCULATION

Literature review

• Role of social media in research comms (speed, context, discovery)

• Correlation between social media discussion and citations (generally: further research required but positive indications)

• Role of short / lay metadata (increases media coverage > audience > citations )

• Role of multimedia (broaden audiences)• Aiming to publish results – would

welcome suggestions of suitable journals!

18

Page 19: Charlie Rapple Co-founder and Director Harnessing Researchers’ Expertise and Networks to increase Article Usage, Citations and Impact Introducing Kudos.

CONFIDENTIAL: NOT FOR EXTERNAL CIRCULATION

Survey: interest in Kudos

• Surveyed almost 4,000 researchers

• 84% of authors think more can be done to raise the visibility, impact and usage of their work

– 50% get no support from their institution

– 80% feel it is their personal responsibility

• Over 75% think they will personally use Kudos

Authors are likely to embrace Kudos 19

Page 20: Charlie Rapple Co-founder and Director Harnessing Researchers’ Expertise and Networks to increase Article Usage, Citations and Impact Introducing Kudos.

CONFIDENTIAL: NOT FOR EXTERNAL CIRCULATION

Pilot site

20

Test Grou

p

Control Group

50 / 50 random split

for each title / yearNew

articles, Oct 2013 >

(70,000 and

counting!

100,000 articles, Jan 2011- Aug 2013

Page 21: Charlie Rapple Co-founder and Director Harnessing Researchers’ Expertise and Networks to increase Article Usage, Citations and Impact Introducing Kudos.

CONFIDENTIAL: NOT FOR EXTERNAL CIRCULATION 21

Claim your article

Page 22: Charlie Rapple Co-founder and Director Harnessing Researchers’ Expertise and Networks to increase Article Usage, Citations and Impact Introducing Kudos.

CONFIDENTIAL: NOT FOR EXTERNAL CIRCULATION

View current metrics

22

Currently: publisher site usage, Altmetric

score

Page 23: Charlie Rapple Co-founder and Director Harnessing Researchers’ Expertise and Networks to increase Article Usage, Citations and Impact Introducing Kudos.

CONFIDENTIAL: NOT FOR EXTERNAL CIRCULATION

View current metrics

23

It’s not uncommon for initial article

metrics to look like this …

Page 24: Charlie Rapple Co-founder and Director Harnessing Researchers’ Expertise and Networks to increase Article Usage, Citations and Impact Introducing Kudos.

CONFIDENTIAL: NOT FOR EXTERNAL CIRCULATION 24

Explain your article

Page 25: Charlie Rapple Co-founder and Director Harnessing Researchers’ Expertise and Networks to increase Article Usage, Citations and Impact Introducing Kudos.

CONFIDENTIAL: NOT FOR EXTERNAL CIRCULATION 25

Adding multimedia

Page 26: Charlie Rapple Co-founder and Director Harnessing Researchers’ Expertise and Networks to increase Article Usage, Citations and Impact Introducing Kudos.

CONFIDENTIAL: NOT FOR EXTERNAL CIRCULATION 26

Add context

Page 27: Charlie Rapple Co-founder and Director Harnessing Researchers’ Expertise and Networks to increase Article Usage, Citations and Impact Introducing Kudos.

CONFIDENTIAL: NOT FOR EXTERNAL CIRCULATION

Share your article

27

Choose a template and generate

proposed text with trackable links

Page 28: Charlie Rapple Co-founder and Director Harnessing Researchers’ Expertise and Networks to increase Article Usage, Citations and Impact Introducing Kudos.

CONFIDENTIAL: NOT FOR EXTERNAL CIRCULATION

Watch the traffic roll in!

28

(Within 24 hours of the tweet)

Page 29: Charlie Rapple Co-founder and Director Harnessing Researchers’ Expertise and Networks to increase Article Usage, Citations and Impact Introducing Kudos.

CONFIDENTIAL: NOT FOR EXTERNAL CIRCULATION

Re-view metrics

29

See referrals from tracked links, and re-view usage against

activities undertaken

Page 30: Charlie Rapple Co-founder and Director Harnessing Researchers’ Expertise and Networks to increase Article Usage, Citations and Impact Introducing Kudos.

Results so far

30

Page 31: Charlie Rapple Co-founder and Director Harnessing Researchers’ Expertise and Networks to increase Article Usage, Citations and Impact Introducing Kudos.

CONFIDENTIAL: NOT FOR EXTERNAL CIRCULATION

Pilot results

31

In the first 24 hours after 1 email …

1,000 registrations

Page 32: Charlie Rapple Co-founder and Director Harnessing Researchers’ Expertise and Networks to increase Article Usage, Citations and Impact Introducing Kudos.

CONFIDENTIAL: NOT FOR EXTERNAL CIRCULATION

Pilot results

32

After 12 weeks …

5,500 registrations

Page 33: Charlie Rapple Co-founder and Director Harnessing Researchers’ Expertise and Networks to increase Article Usage, Citations and Impact Introducing Kudos.

CONFIDENTIAL: NOT FOR EXTERNAL CIRCULATION

Pilot results

19% higherarticle usage per day

for articles shared using the Kudos tools compared to the control group

Page 34: Charlie Rapple Co-founder and Director Harnessing Researchers’ Expertise and Networks to increase Article Usage, Citations and Impact Introducing Kudos.

Plansfor 2014

Page 35: Charlie Rapple Co-founder and Director Harnessing Researchers’ Expertise and Networks to increase Article Usage, Citations and Impact Introducing Kudos.

CONFIDENTIAL: NOT FOR EXTERNAL CIRCULATION

2014 objectives for Kudos

1. Broader dataset: much wider group of publishers, articles and researchers: 20-30 publishers, 500,000+ articles, subscription and OA.

2. Broader functionality: sharing data with repositories and third parties; integrating with author / publisher workflows and tools; enabling participating publishers to integrate data in their own platforms.

3. Broader target audience: engaging institutional and funding partners; understanding potential of local language tools.

4. Longer test period: measuring the effectiveness of Kudos activities over a longer time period (to begin entering citation window).

5. More rigorous results analysis: including effectiveness of different combinations / sequences of activities

6. Business model development: developing a sustainable business model for Kudos.

35

Page 36: Charlie Rapple Co-founder and Director Harnessing Researchers’ Expertise and Networks to increase Article Usage, Citations and Impact Introducing Kudos.

CONFIDENTIAL: NOT FOR EXTERNAL CIRCULATION

Publishing partners 2014

36

And some still secret!

Page 37: Charlie Rapple Co-founder and Director Harnessing Researchers’ Expertise and Networks to increase Article Usage, Citations and Impact Introducing Kudos.

37CONFIDENTIAL: NOT FOR EXTERNAL CIRCULATION

But no limits for researchers!

• New site launching April 2013

• Anyone can register, add their articles, view altmetrics, and use the tools to explain and share!– Usage data is

only available for participating publishers

Page 38: Charlie Rapple Co-founder and Director Harnessing Researchers’ Expertise and Networks to increase Article Usage, Citations and Impact Introducing Kudos.

38CONFIDENTIAL: NOT FOR EXTERNAL CIRCULATION

Still exploring …

• How important is article performance to researchers? How is this changing?

• How (and with whom) do researchers currently share information about publications?

• What are researchers’ experiences to date with social media / academic networking tools?

• How attractive is the idea of being able to enrich articles with contextual data?

• How would Kudos best fit within research workflows?

• What else could it do for you?

Page 39: Charlie Rapple Co-founder and Director Harnessing Researchers’ Expertise and Networks to increase Article Usage, Citations and Impact Introducing Kudos.

Thank youCharlie Rapple

[email protected]/blog

www.facebook.com/GrowKudos@GrowKudosPlease follow us so

we can let you know when you can sign up for Kudos

1.0!