Going Against Goliath 23 rd May 2010
description
Transcript of Going Against Goliath 23 rd May 2010
![Page 1: Going Against Goliath 23 rd May 2010](https://reader036.fdocuments.in/reader036/viewer/2022062305/5681615a550346895dd0e513/html5/thumbnails/1.jpg)
Going Against Goliath23rd May 2010
Katrina Kurtz, MLISCarrie Iwema, PhD, MLSAnsuman Chattopadhyay, PhDHealth Sciences Library SystemUniversity of Pittsburgh
http://www.hsls.pitt.edu/guides/genetics
![Page 2: Going Against Goliath 23 rd May 2010](https://reader036.fdocuments.in/reader036/viewer/2022062305/5681615a550346895dd0e513/html5/thumbnails/2.jpg)
Photo credit: http://www.uncabaret.com/node?page=5
![Page 3: Going Against Goliath 23 rd May 2010](https://reader036.fdocuments.in/reader036/viewer/2022062305/5681615a550346895dd0e513/html5/thumbnails/3.jpg)
Bioinformatics Tools
Answer biological questions
Made by informatics researchers
Freely available to the public
Published in scholarly journals
http://www.hsls.pitt.edu/guides/genetics
![Page 4: Going Against Goliath 23 rd May 2010](https://reader036.fdocuments.in/reader036/viewer/2022062305/5681615a550346895dd0e513/html5/thumbnails/4.jpg)
Bioinformatics Tools Examples:
Protein structure prediction
Sequence alignment
Databases of genes associated with disease
Protein interactions
http://www.hsls.pitt.edu/guides/genetics
![Page 5: Going Against Goliath 23 rd May 2010](https://reader036.fdocuments.in/reader036/viewer/2022062305/5681615a550346895dd0e513/html5/thumbnails/5.jpg)
Who Uses Bioinformatics Tools?
Biologists: Faculty researchers Graduate students Undergraduate students
Doctors who do biomedical research
Biomedical informatics researchers
http://www.hsls.pitt.edu/guides/genetics
![Page 6: Going Against Goliath 23 rd May 2010](https://reader036.fdocuments.in/reader036/viewer/2022062305/5681615a550346895dd0e513/html5/thumbnails/6.jpg)
Online Bioinformatics Resources Collection Manually curated
Searchable collection of bioinformatics tools
Freely available to the public
2696 resources
http://www.hsls.pitt.edu/guides/genetics/obrc/
http://www.hsls.pitt.edu/guides/genetics
![Page 7: Going Against Goliath 23 rd May 2010](https://reader036.fdocuments.in/reader036/viewer/2022062305/5681615a550346895dd0e513/html5/thumbnails/7.jpg)
http://www.hsls.pitt.edu/guides/genetics
![Page 8: Going Against Goliath 23 rd May 2010](https://reader036.fdocuments.in/reader036/viewer/2022062305/5681615a550346895dd0e513/html5/thumbnails/8.jpg)
http://www.hsls.pitt.edu/guides/genetics
![Page 9: Going Against Goliath 23 rd May 2010](https://reader036.fdocuments.in/reader036/viewer/2022062305/5681615a550346895dd0e513/html5/thumbnails/9.jpg)
http://www.hsls.pitt.edu/guides/genetics
![Page 10: Going Against Goliath 23 rd May 2010](https://reader036.fdocuments.in/reader036/viewer/2022062305/5681615a550346895dd0e513/html5/thumbnails/10.jpg)
Common Criticisms…
Why bother?
Everyone uses Google.
Google is taking over.
http://www.hsls.pitt.edu/guides/genetics
![Page 11: Going Against Goliath 23 rd May 2010](https://reader036.fdocuments.in/reader036/viewer/2022062305/5681615a550346895dd0e513/html5/thumbnails/11.jpg)
Is Google Actually Better?
http://www.hsls.pitt.edu/guides/genetics
Large amount of data
Popularity ranking
Biologists are not librarians
![Page 12: Going Against Goliath 23 rd May 2010](https://reader036.fdocuments.in/reader036/viewer/2022062305/5681615a550346895dd0e513/html5/thumbnails/12.jpg)
Research Project Hypothesis
http://www.hsls.pitt.edu/guides/genetics
OBRC is better than Google at Locating bioinformatics tools
Quickly Easily Successfully
Leaving users happier with: Results Overall experience
![Page 13: Going Against Goliath 23 rd May 2010](https://reader036.fdocuments.in/reader036/viewer/2022062305/5681615a550346895dd0e513/html5/thumbnails/13.jpg)
Research Project
http://www.hsls.pitt.edu/guides/genetics
10 biology graduate students
Three tasks on both OBRC and Google
Recorded search as they narrated
Search experience survey
![Page 14: Going Against Goliath 23 rd May 2010](https://reader036.fdocuments.in/reader036/viewer/2022062305/5681615a550346895dd0e513/html5/thumbnails/14.jpg)
Research Project Measured:
Time spent on each search Number of search queries Number of sites visited Success rate Users’ ratings
http://www.hsls.pitt.edu/guides/genetics
![Page 15: Going Against Goliath 23 rd May 2010](https://reader036.fdocuments.in/reader036/viewer/2022062305/5681615a550346895dd0e513/html5/thumbnails/15.jpg)
Task 1: Protein Interaction
http://www.hsls.pitt.edu/guides/genetics
You are a pharmacologist interested in drugs that target proteins. Where would you find reliable information about how drugs interact with proteins, specifically information about the strength of the binding between the protein and ligand?
![Page 16: Going Against Goliath 23 rd May 2010](https://reader036.fdocuments.in/reader036/viewer/2022062305/5681615a550346895dd0e513/html5/thumbnails/16.jpg)
Task 2: Structure Prediction
http://www.hsls.pitt.edu/guides/genetics
Find a tool that performs protein structure prediction. Determine from the search engine how often it has been cited.
![Page 17: Going Against Goliath 23 rd May 2010](https://reader036.fdocuments.in/reader036/viewer/2022062305/5681615a550346895dd0e513/html5/thumbnails/17.jpg)
Task 3: Ovarian Cancer
http://www.hsls.pitt.edu/guides/genetics
Where would you look for information about all the published gene mutations implicated in ovarian cancer, in one place?
![Page 18: Going Against Goliath 23 rd May 2010](https://reader036.fdocuments.in/reader036/viewer/2022062305/5681615a550346895dd0e513/html5/thumbnails/18.jpg)
Is it faster?
http://www.hsls.pitt.edu/guides/genetics
Task 1 Task 2 Task 3 Average0
50
100
150
200
250
300
350
Average Task Completion Time
GoogleOBRC
Tim
e (s
)
ProteinInteraction
StructurePrediction
Ovarian Cancer
![Page 19: Going Against Goliath 23 rd May 2010](https://reader036.fdocuments.in/reader036/viewer/2022062305/5681615a550346895dd0e513/html5/thumbnails/19.jpg)
Is it easier to find results?
http://www.hsls.pitt.edu/guides/genetics
Task 1 Task 2 Task 3 Average0
1
2
3
4
Average Number of Search Queries
GoogleOBRC
Num
ber o
f Que
ries
ProteinInteraction
StructurePrediction
Ovarian Cancer
![Page 20: Going Against Goliath 23 rd May 2010](https://reader036.fdocuments.in/reader036/viewer/2022062305/5681615a550346895dd0e513/html5/thumbnails/20.jpg)
Is it easier to find results?
http://www.hsls.pitt.edu/guides/genetics
Task 1 Task 2 Task 3 Average0
1
2
3
4
Number of Sites Visited Before Success
GoogleOBRC
Num
ber o
f Site
s Vi
site
d
ProteinInteraction
StructurePrediction
Ovarian Cancer
![Page 21: Going Against Goliath 23 rd May 2010](https://reader036.fdocuments.in/reader036/viewer/2022062305/5681615a550346895dd0e513/html5/thumbnails/21.jpg)
Is it successful?
http://www.hsls.pitt.edu/guides/genetics
Task 1 Task 2 Task 3 Average0%
20%
40%
60%
80%
100%Rate of Success
GoogleOBRC
Perc
enta
ge o
f Suc
cess
ful S
earc
hes
ProteinInteraction
StructurePrediction
Ovarian Cancer
![Page 22: Going Against Goliath 23 rd May 2010](https://reader036.fdocuments.in/reader036/viewer/2022062305/5681615a550346895dd0e513/html5/thumbnails/22.jpg)
Do users like it?
http://www.hsls.pitt.edu/guides/genetics
Appropriateness of Results
Ease of Use Overall Experience1
2
3
4
5
6
7
Survey Results
GoogleOBRC
Ratin
g
![Page 23: Going Against Goliath 23 rd May 2010](https://reader036.fdocuments.in/reader036/viewer/2022062305/5681615a550346895dd0e513/html5/thumbnails/23.jpg)
What do they say about Google?
http://www.hsls.pitt.edu/guides/genetics
“I was just frustrated [by Google].”
“Google was difficult to navigate with all the information on cancer.”
“[Google is] time consuming unless we know what we are searching for.”
“I realized that Google is not an
effective search tool.”
![Page 24: Going Against Goliath 23 rd May 2010](https://reader036.fdocuments.in/reader036/viewer/2022062305/5681615a550346895dd0e513/html5/thumbnails/24.jpg)
What do they say about OBRC?
http://www.hsls.pitt.edu/guides/genetics
“Wow, this is really direct!”
“Gives good results, but I don’t like the interface.”
“OBRC is an excellent resource, especially if
you don’t know exactly what you’re
searching for.”
“[OBRC] was much easier to locate
relevant information.”
![Page 25: Going Against Goliath 23 rd May 2010](https://reader036.fdocuments.in/reader036/viewer/2022062305/5681615a550346895dd0e513/html5/thumbnails/25.jpg)
What did we learn about OBRC? Time lag
Scopus and Google Scholar
Spell check
Long search queries
Unaware it exists
http://www.hsls.pitt.edu/guides/genetics
![Page 26: Going Against Goliath 23 rd May 2010](https://reader036.fdocuments.in/reader036/viewer/2022062305/5681615a550346895dd0e513/html5/thumbnails/26.jpg)
Limitations
Small sample size
Potential bias from tasks
Previous experience with Google
http://www.hsls.pitt.edu/guides/genetics
![Page 27: Going Against Goliath 23 rd May 2010](https://reader036.fdocuments.in/reader036/viewer/2022062305/5681615a550346895dd0e513/html5/thumbnails/27.jpg)
Future Work
Larger sample size
Other user groups
User-chosen task
http://www.hsls.pitt.edu/guides/genetics
![Page 28: Going Against Goliath 23 rd May 2010](https://reader036.fdocuments.in/reader036/viewer/2022062305/5681615a550346895dd0e513/html5/thumbnails/28.jpg)
Conclusions…
http://www.hsls.pitt.edu/guides/genetics
Searches using OBRC are: Faster Easier More successful
Users are more satisfied.
Users plan to use OBRC in the future.
![Page 29: Going Against Goliath 23 rd May 2010](https://reader036.fdocuments.in/reader036/viewer/2022062305/5681615a550346895dd0e513/html5/thumbnails/29.jpg)
Conclusions…
http://www.hsls.pitt.edu/guides/genetics
…libraries can and should
compete!
![Page 30: Going Against Goliath 23 rd May 2010](https://reader036.fdocuments.in/reader036/viewer/2022062305/5681615a550346895dd0e513/html5/thumbnails/30.jpg)
http://www.hsls.pitt.edu/guides/genetics
This study is IRB approved. Funding provided by: NLM Grant 3 T15
LM007059-23S1 Thanks to my collaborators, Dr. Carrie Iwema
and Dr. Ansuman Chattopadhyay Special thanks to Nancy Tannery and Dr.
Rebecca Crowley
![Page 31: Going Against Goliath 23 rd May 2010](https://reader036.fdocuments.in/reader036/viewer/2022062305/5681615a550346895dd0e513/html5/thumbnails/31.jpg)
Thank you!Any questions?
Katrina Kurtz Carrie Iwema Ansuman [email protected] [email protected] [email protected] 412-624-3508 412-648-6887 412-648-1297
http://www.hsls.pitt.edu/guides/genetics