Open science workshop recap - BMIR research colloquium

Post on 21-Oct-2014

1.680 views 1 download

Tags:

description

Recap of the PSB 2009 Open Science workshop, given at the Biomedical Informatics Research group weekly colloquium, 1/15/2009

Transcript of Open science workshop recap - BMIR research colloquium

The Open Science Workshop at PSB 2009

A recap by Shirley WuBMIR RIP 1/15/09

2 hours of talks + 1 hour discussion

Phil BourneDrew Endy

Larry HunterRuss Altman

Steven Brenner

Style, text, photos borrowed from Cameron Neylon

If you couldn’t make it...

If you couldn’t make it...

http://tinyurl.com/psb09-openscience

Microblogging

Slides

Webcasts

What is it?

Why should I care?

“Open Science?”

http://flickr.com/photos/good-karma/710068054/

“Open Science?”

http://flickr.com/photos/good-karma/710068054/

The movement that advocates making changes to the research process that make more of the outputs of research accessible in an effective and timely way

more stuff, more available, more quickly

If a million post-docs repeat a million experiments...

http://flickr.com/photos/heymans/480396810/

... and 25% of those don’t work...

http://flickr.com/photos/cliche/120070310/

... how much taxpayers’ money is that?

http://flickr.com/photos/luismimunoznajar/2093185804/

Make research more...

efficienteffectiveaccessible

http://flickr.com/photos/luismimunoznajar/2093185804/

“We argue in good faith from shared evidence to shared conclusions.”

- Lee Smolin

“I never had an idea that couldn’t be improved by sharing it with as many people as possible…”

- Bill Hooker

Idea

Develop

Fund

Plan

Record

Process

Publish

Read

Idea

Develop

Fund

Plan

Record

Process

Publish

Read

IdeaDevelop

Fund

Process

Record

PlanFund

Develop

Idea

Develop

Fund

Plan

Record

Process

Publish

Read

Idea

Read

Publi

shPr

oces

s

Reco

rd

Plan

Fund

Develo

p

IdeaDevelop

Fund

Process

Record

PlanFund

Develop

Idea

Develop

Fund

Plan

Record

Process

Publish

Read

Idea

Read

Publi

shPr

oces

s

Reco

rd

Plan

Fund

Develo

p

IdeaDevelop

Fund

Process

Record

PlanFund

Develop

Idea

Develop

Fund

Plan

Record

Process

Publish

Read

Web 2.0

http://flickr.com/photos/virtualsugar/316200555/

ProtocolsExperimental record DataLiterature

Workshop agenda

• Identify challenges and next steps for Open Science

• Discuss:• Current approaches and practice• Development of tools• Socio-cultural issues

Keynote: Phil BourneOpen Science:

One Person’s View and What We Are Doing About It

The research contract is changing

The relationship between scientist and publisher will be different

Keynote: Phil BourneOpen Science:

One Person’s View and What We Are Doing About It

What’s missing?

• Seamless integration between data and publications• Seamless integration of the authoring and publishing

process• Association of publications with multimedia• Professional networking akin to social networking

Keynote: Phil BourneOpen Science:

One Person’s View and What We Are Doing About It

Keynote: Phil BourneOpen Science:

One Person’s View and What We Are Doing About It

Tool developmentDavid de Roure

The myExperiment approach towards open science

Tool developmentNigam Shah

How bio-ontologies enable open science

Open science requires structured content

Generation of structured content requires automated and collaborative curation

NCBO provides services that address these needs:Ontology servicesAnnotator servicesData services

Social issuesCF Quo

Community annotation in translational bioinformatics:

lessons from Wikipedia

Picture by Hay Kranen

Social issuesCF Quo

Community annotation in translational bioinformatics:

lessons from Wikipedia

Few users, many edits

Many users, few edits

Picture by Hay Kranen

Social issuesCF Quo

Community annotation in translational bioinformatics:

lessons from Wikipedia

If 0.01% of users contribute...

Picture by Hay Kranen

Social issuesCF Quo

Community annotation in translational bioinformatics:

lessons from Wikipedia

Picture by Hay Kranen

Social issuesCF Quo

Community annotation in translational bioinformatics:

lessons from Wikipedia

... you need millions of users

Picture by Hay Kranen

Social issuesHeather Piwowar

Measuring the adoption of open science sharing data

How much is shared, not shared? Who is sharing and who isn’t? Why do people share or not share?

Social issuesHeather Piwowar

Measuring the adoption of open science sharing data

40% said data sharing was discouraged during their training

80% said sharing was too much effort

Obstacles are publishing, control, and cost

Social issuesHeather Piwowar

Measuring the adoption of open science sharing data

Benefits are personal as well as societal

People will share if they think it really helps others

It would be easier if there was more help, better tools and guidelines

Main themes

“If you build it, they won’t come.”- Sean Mooney

The design of tools cannot be divorced from the cultural and social issues that surround them

Community building is just as important as tool building

Need active conversation between users and builders

Main themes

“You cannot manage what you cannot measure.”- Lord Kelvin

Does any of this actually provide benefits, and if so, to whom?

What is the return on investment?

Without this it is difficult to convince anyone of anything

http://www.flickr.com/photos/gaetanlee/2792436526/

Tools?

Specific tools are required (persistent identity, good repository systems)

Build the service and the community

http://flickr.com/photos/amrufm/2351316712/

Policy?

Standards and methods of citation are at the core of good science

Focus on specific actions with measurable outcomes

Identify successes (and celebrate), identify failures (and learn)

http://flickr.com/photos/luismimunoznajar/2093185804/

Funding?

Infrastructure

Research on research

Improving the research process is an area for (experimental) research

that requires the same rigour, standards, and funding as anything else that we do

http://tinyurl.com/psb09-openscience