Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The...

65
Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit

Transcript of Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The...

Page 1: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit.

BuildingOpen Science Communities

Luis IbáñezKitware, Inc.Insight Software Consortium

The Insight Toolkit

Page 2: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit.

What is ITK ?

Software Library

Written in C++

Using Generic Programming

Extreme Programming

Open Source with Free license

Page 3: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit.

What is Free Software ?

“Free software” is a matter

of liberty, not price.

To understand the concept,

you should think of “FREE” as

in “FREE SPEECH”,

not as in “FREE BEER”.

http://www.gnu.org/philosophy/free-sw.html

Page 4: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit.

Open Source Software versus Free Software

“Open source is a development methodology”

“Free software is a social movement”

“For the Open Source movement, non-free software is

a suboptimal solution.”

“For the Free Software movement, non-free software

is a social problem and free software is the solution.”

http://www.gnu.org/philosophy/free-software-for-freedom.html

Page 5: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit.

Interdit d’Interdire

ITK is Free

as in

“Free Speech”

and…

as in

“Free Beer”

Page 6: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit.

Well…

free for the users…

Page 7: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit.

ITK Sponsors

The NationalScienceFoundation

The NationalInstitute for Dental and Craniofacial Research

The National Institute of Neurological Disorders and Stroke

Page 8: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit.

ITK Developers

Insight Software Consortium

Page 9: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit.

How did ITK start ?

VisibleHumanProject

Acquisition

MR, CT & Cryogenic Distribution

Page 10: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit.

but,

Data was not Enough…

Page 11: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit.

Software was needed

for analyzing the data

Page 12: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit.

Use my library…

I haveone, but…

I haveone, but…

I haveone, but…

I haveone, but…

I haveone, but…

Page 13: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit.

Developing Software

for Research

is an intrinsically

Ungrateful

business

Page 14: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit.

Software

PapersAlgorithms

Research

Mean Goal

DataDriving

Problem

?

Page 15: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit.

You don’t get research credits for:

Implementing algorithms published by others

Writing Software Documentation Fixing Bugs Improving Performance Preparing Tutorials Porting to new platforms Supporting Users Making software releases

Page 16: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit.

If you are a student

If you are a professor

Software will not giveyou a degree…

Software will not give you a promotion…

Page 17: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit.

Software development is seen as

not worthy

of a researcher time

Page 18: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit.

Raise your hand those who can do

Medical Image Processing

without Software

Page 19: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit.

You do get research credits for:

Publishing papers Publishing books Getting Patents Getting Funding (Grants, Contracts) Licensing your Patents

Page 20: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit.

Why is that ?

Page 21: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit.

Time to face the

Truth

Page 22: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit.
Page 23: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit.

Publications

do not

cure Cancer !

Page 24: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit.

Doctors do not prescribe

“reading papers”

as a treatment.

Page 25: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit.

Medical treatment is done with

Medical Devices

Drugs

Surgical Procedures

Page 26: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit.

Publications that don’t lead

to one of those treatments

are sterile publications

Page 27: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit.

Really good

research results

are not published…

They get Patented !

Page 28: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit.

With the hope of being used for

Medical Devices

Drugs

Surgical Procedures

Page 29: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit.

Why do we care so much

about publishing ?

Page 30: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit.

Publications are a measure

of scientific productivity

They disseminate knowledge

They allow others to reproduce our results

They are validated by the peer-review process

Page 31: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit.

Papers disseminate

knowledge

Page 32: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit.

Information in the 21st Century

Is disseminated on the Internet

Page 33: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit.

How long it takes to post a

PDF file on the Web ?

At most 1 day

Typically 1 hour

Page 34: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit.

How long it takes to publish

a paper on a Journal ?

At least 1 year

Typically 2 years

Page 35: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit.

How much do you

have to pay for publishing

a paper in a Journal ?

About $500 / paper

Page 36: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit.

How much do you

have to pay

for reading the same paper ?

About $30 / paper

or subscribe for $300 / year

Page 37: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit.

How much it costs to

post a PDF on the Web ?

Certainly less than

$500 + N x $30

Page 38: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit.

Papers allow others to

reproduce the results

Page 39: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit.

Reproducing the Results…

Do you get source code with the paper ?

How long it will take you to rewrite this code ?

Do you get the author’s data ?

How can you get their data ?

Do you get all the parameters they used ?

How can you reproduce results if you don’t

have code, data and parameters ?

Page 40: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit.

And anyways, why do you

want to invest time in reproducing

somebody else’s results…

If you don’t get any credit for doing it ?

Page 41: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit.

Have you ever seen a paper

in a Medical Image Journal

whose only content is the

reproduction of results from

another paper ?

Page 42: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit.

Have you ever seen a paper

in a Medical Image Journal

whose only content is the

failure to reproduce the results

of another paper ?

Page 43: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit.

If reproducibility is the goal

of publishing…

You should post your source codeYou should post your dataYou should post your parameters

In the same way that you posted your PDF file: on the Web.

Page 44: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit.

Research is validated

by the

Peer-Review process

Page 45: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit.

How can a reviewer

validate a paper ?

If we just concludedthat papers are not

reproducible…

Page 46: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit.

What does a reviewer

actually do ?

Emit an opinion based on his/her expertise

Page 47: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit.

How much time does a reviewer

dedicate to a paper ?

1 hour ?

2 hours ?

6 hours ?

Page 48: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit.

Why not more time ?

Reviewers are volunteers

They don’t get paid for reviewing papers

They don’t get credits for reviewing papers

They have their own papers to write

They have exams to grade

Their own grant applications to submit

They also have families, pets and… a life !

Page 49: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit.

How long does a paper waits on

the reviewer’s desk before he/she

finds time for reviewing it ?

Six weeks ?

6 months ?

Page 50: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit.

How many reviewers typically

judge your paper ?

Minimum Two

Typically Three

Exceptionally Four

Why not more ?

Why only one time ?

Page 51: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit.

Why do we really

want to publish ?

Page 52: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit.

Because we need

to have publications

in our CV

Page 53: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit.

“Publish or Perish”

Who invented this ?

and Why ?

Page 54: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit.

“Publish or Perish”

Was invented by those who needed to evaluate

researcher’s productivity.

Page 55: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit.

“Publish or Perish”

Empowers those who read

your CV to grade you by

simply counting lines in the

“Publications” section.

Page 56: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit.

“Publish or Perish”

The group of best educated

people in the world has been

alienated with a simple trick

Page 57: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit.

Who are you

working for ?

Page 58: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit.

Who really pays

your salary ?

Page 59: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit.

Public

Researchers

Hospitals& Doctors

Who pays for Research ?

PharmaceuticalCompanies

Medical DeviceManufacturers

Page 60: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit.

What do your owe to those

who pay your salary ?

Page 61: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit.

or

Competition with other

researchers ?

Collaboration with other

researchers ?

Page 62: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit.

How to collaborate ?

Creating public repositories for source code Creating public image databases Posting parameters on the web Creating forums for hosting positive

discussions online Validating other’s methods and suggesting

improvements.

Page 63: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit.

The Insight Journal Solution

Open Source

Open Science

Agile Programming

Agile PublishingInsightJournal

Page 64: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit.

The Dark Ages are Over…

Page 65: Building Open Science Communities Luis Ibáñez Kitware, Inc. Insight Software Consortium The Insight Toolkit.

Embrace Open Science !