Post on 22-Feb-2016
description
Google vs. Copernic
An Academic Exercise
Introduction A comparison of Google’s Knowledge Graph and
Copernic 3 Queries Batch Evaluation Qualitative Evaluation
Google http://www.youtube.com/watch?v=mmQl6VGvX-c
Copernic meta search engine Copernic Agent gives you the ability to search
deeper into the Web and to get relevant, high quality results grouped into categories. http://www.copernic.com/en/products/agent/index.html
Research Process1. system selection2. hypothesis creation3. information needs scenario development4. query selection5. survey creation6. subject recruiting7. survey dissemination8. results aggregation9. batch evaluation10. qualitative evaluation11. analysis12. results
Needs and Queries John wants to make sure that he uses that classic
"to be or not to be" quote from Shakespeare correctly in a speech to a book club, he wants to make sure he understands the meaning.
(keyword search terms: to be or not)
Needs and Queries A Student is going to visit Stanford University to
interview and wants to know how to get to the University from the airport as cheaply as possible.
(keyword search terms: how to get from San Francisco airport to Stanford)
Needs and Queries Grandma was told that Junior’s favorite music is
electronica and wants to know what this music is so that she can buy him a cd.
(keyword search terms: electronica music cd)
Needs and Queries A student wants to do a report on Huey P. Long’s
contribution to education. (keyword search terms: user chosen)
o Huey Long education contributiono Huey p long's contribution to education o huey long's contribution to educationo Huey P Long's contribution to educationo Huey P. Long Educationo Huey P. Long's contribution to Louisiana educationo Huey P. Long’s contribution to education
Research Tools Jotform’s online
form builder 8 forms (2 per
query)
Submission results downloadable via excel, csv, or pdf
Research Tools
Research Tools (Recruiting)
Email Facebook
0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.00.000.100.200.300.400.500.600.700.800.901.00
Copernic To Be or Not to Be
Precision-Recall
Copernic Precision RecallInterpolation
Recall
Prec
isio
n
Summary:Google has a higher Interpolated average precision
0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.00.00
0.10
0.20
0.30
0.40
0.50
0.60
GoogleTo Be or Not To Be
Precision-Recall
Google Pre-cision Recall
Interpolation
Recall
Precision
0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 10
0.10.20.30.40.50.60.70.80.9
1
Copernic Precison RecallStanford Query
Copernic P/RInterpolation
Recall
Prec
isio
n
0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 10
0.10.20.30.40.50.60.70.80.9
1
Google Precision Recall Stanford QueryGoogle P/RInterpolation
Recall
Prec
isio
n
Summary:Google has a higher Interpolated average precision
0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.00.00
0.10
0.20
0.30
0.40
0.50
Google Precision Recall
Electronica
Google P-RInterpolation
RecallPr
ecis
ion
0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.00.00
0.05
0.10
0.15
0.20
0.25
0.30
CopernicPrecision Recall
Electronica
"Copernic Precision-Re-call"Interpolation
Recall
Prec
isio
n
Summary:Google has a higher Interpolated average precision
Qualitative: Google Returns More Relevant Results
1st Re
sult
2nd Resu
lt
3rd Resu
lt
4th Resu
lt
5th Resu
lt
6th Resu
lt
7th Resu
lt
8th Resu
lt
9th Resu
lt
10th R
esult
15 5
3 3 46 6 6
2
62 1 4 4 3
1 1 15
Google Relevance ResultsIrrelevant Relevant
1st Result
2nd Result
3rd Result
4th Result
5th Result
6th Result
7th Result
8th Result
9th Result
10th Result
4 5 6 5
24 4
1
5 4
3 2 0 1
42 2
5
1 2
Copernic Relevance ResultsIrrelevant Relevant
10 9 8 7 6 5 4 3 2 1 00
1
2
3
Ease of Use
Google Ease of SearchCopernic Ease of Search
On a Scale of 1 - 10, how easy is each system to use?
Use
r Re
spon
se
Results Summary Results indicate that Google is superior This can be attributed to several factors:
Knowledge Graph produces more relevant documents
Google has more users thus a broader base of aggregated search results from a common query; Copernic does not have this feature.