Searching with tools other than Google
114
1 Searching with Tools other than Google CILIP South East HIOW, University of Winchester Wednesday 25 th May 2016 Karen Blakeman, RBA Information Services [email protected] www.rba.co.uk twitter.com/ karenblakeman Slides available for a short time at http://www.rba.co.uk/as/ This work is licensed under a Creative Commons Attribution-ShareAlike License “If I were you, I wouldn’t start from here”
-
Upload
karen-blakeman -
Category
Internet
-
view
977 -
download
4
Transcript of Searching with tools other than Google
1
Searching with Tools other than Google CILIP South East HIOW, University of Winchester
Wednesday 25th May 2016
Karen Blakeman, RBA Information [email protected] www.rba.co.uk twitter.com/karenblakeman
Slides available for a short time at http://www.rba.co.uk/as/
This work is licensed under a Creative Commons Attribution-ShareAlike License
“If I were you, I wouldn’t start from here”
Download slides from www.rba.co.uk/as/
Ask questions as we go along – the slides are just a framework and we can explore topics in more depth
This session will NOT be a totally Google-free zone!
Share with colleagues but bear in mind things change rapidly and commands disappear
01/05/2023 www.rba.co.uk 2
Big discussion points at the moment
Google becomes Alphabet, machine learning & artificial intelligence, Quick Answers & Facts, Yahoo up for sale
Right to be forgotten extended
Anonymous browsing, Tor, Opera VPN
Sci-Hub, academic publishing, OA, predatory journals
Data mining, content mining, Open Data, Big Data
Governance and transparency, Panama Papers, Beneficial Register, Open Gazettes
Critical thinking, evaluating information, tools for analysing and assessing What, Why, When, How, Where and Who (Kipling’s Six Honest Serving Men), CRAAP test
01/05/2023 www.rba.co.uk 3
“Right to be forgotten”
01/05/2023 www.rba.co.uk 4
Google Europe Blog: Adapting our approach to the European right to be forgotten http://googlepolicyeurope.blogspot.co.uk/2016/03/adapting-our-approach-to-european-right.html
Google Agrees To Complicated Worldwide "Right To Be Forgotten" Censorship Plan http://searchengineland.com/google-to-censor-worldwide-sorta-243938
Information remains on the web but is not listed in search results – go direct to source
Applies to all search engines with a European presence
Europeans cannot bypass it by using Google.com – location of searcher determines what can be seen.
Hiding location, identity
Use a search tool that does not have a European presence (difficult)
Startpage.com anonymises your IP address but you have no control over the server used – could be elsewhere in Europe.
VPN – Virtual Private Network, anonymous proxy servers
Free VPN integrated in Opera for better online privacy [coming soon] http://www.opera.com/blogs/desktop/2016/04/free-vpn-integrated-opera-for-windows-mac/
01/05/2023 www.rba.co.uk 5
Why Google?
Why not Google?
What are the alternatives?
What do you already use?
01/05/2023 www.rba.co.uk 6
It’s difficult to kick the Google habit
Good coverage
Much of the time it gives reasonable results with minimal effort
Personalisation is sometimes a good thing
Synchronisation across multiple platforms and services means can access calendars, bookmarks, maps and directions any time, anywhere
Can’t escape “Powered by Google” - Google search engine used by many websites for navigating their pages
Google powered ads everywhere
01/05/2023 www.rba.co.uk 7
It’s not just about conventional web pages
01/05/2023 www.rba.co.uk 8
Data Never Sleeps 3.0 https://www.domo.com/blog/2015/08/data-never-sleeps-3-0/
Private browsing
Personalisation of results is not just a Google thing
Private browsing, Incognito
– Chrome - New Incognito window Ctrl+Shift+N
– FireFox Ctrl+Shift+P
– Internet Explorer Ctrl+Shift+P
– Opera Ctrl+Shift+N
Will not remove country personalisation, does not hide IP address
Not search engine specific, built into the browser
Quality of results - test search on height of Ben Nevis
01/05/2023 www.rba.co.uk 10
No source given
No source given
01/05/2023 www.rba.co.uk 11
Key search options to look for in search tools
Forcing an exact match
filetype: command or similar to search for document formatse.g. car ownership UK filetype:xlsx
site: command to limit your search to a specific site e.g. renewable energy site:www.gov.uk
intitle: command to search for terms in the title of a document
Date option
01/05/2023 www.rba.co.uk 12
filetype:
PDF for research documents, government reports, industry papers
ppt or pptx for presentations, tracking down an expert on a topic
xls or xlsx for spreadsheets containing data
Google – have to search for both Office 2007 and pre 2007 extensions
UK waste vegetable oil energy generation filetype:ppt OR filetype:pptx
Most web search alternatives will automatically search for both
site:
For searching large websites, or groups of sites by type for example government, NHS, academic
renewable energy generation site:ons.gov.ukrenewable energy generation site:www.gov.ukrenewable energy generation site:ac.uk
01/05/2023 www.rba.co.uk 13
General web search alternatives
01/05/2023 www.rba.co.uk 14
Bing/Yahoo
Since 2010 Yahoo has been using Bing’s database, commands and ranking algorithms. Yahoo now for sale
No advanced search screen on Bing so use commands
List at Advanced Operator Reference http://msdn.microsoft.com/en-us/library/ff795620.aspx
filetype: site: inbody: intitle:
AND, NOT, OR parentheses for complex Boolean searches
NEAR:n where n is a number, specifies that the terms must be within that number of words of each other and in any order
- banana NEAR:3 toffee01/05/2023 www.rba.co.uk 15
Bing
01/05/2023 www.rba.co.uk 16
Compare with Google
01/05/2023 www.rba.co.uk 17
Ben Nevis – Bing UK
01/05/2023 www.rba.co.uk 18
Ben Nevis – Bing US
01/05/2023 www.rba.co.uk 19
Bing limit by date – US version
01/05/2023 www.rba.co.uk 20
Bing limit by date – UK version
01/05/2023 www.rba.co.uk 21
Changing country version of Bing
01/05/2023 www.rba.co.uk 22
Bing http://www.bing.com/
Results seem to be more consumer/retail focused– more ‘shopping’ than research– results improve as soon as you start using the advanced
search commandsSometimes more up to date than Google
– updates sites more frequently– adds new sites more quickly– useful if you are looking for information on a new company or
organisationBUT some search features and options available only to US users
– changing location /version of Bing does not always work– using anonymous proxy or a VPN does not always work
01/05/2023 www.rba.co.uk 23
Bing vs Google
01/05/2023 www.rba.co.uk 24
Bing automatically searches for .xls as well as .xlsx
Have to search for .xls separately
When does Bing do better than Google?
Holiday destinations
Tourist attractions
Shopping
People profiles
On a par with Google when you start using advanced commands
01/05/2023 www.rba.co.uk 25
Bing
Bing images – good alternative to Google
Bing videos – good alternative to Google Videos (includes YouTube in results)
Bing maps – much improved over the last 2-3 years and generally a good alternative to Google. Some aspects e.g. mapping of lakes, rivers somewhat vague. Availability of different views including Streetside are dependant on location.
Ordnance Survey option for the UK is back
Bing news – much improved over the last year and now has good UK national and local coverage
Bing Translator http://www.bing.com/translator
Close links and integration with Facebook, also LinkedIn
01/05/2023 www.rba.co.uk 26
DuckDuckGo – http://duckduckgo.com/
Does not track, does not personalise
Results come from over 400 resources https://duck.co/help/results/sources
Advanced search commands include:
inbody: intitle: filetype: site:region:cc (e.g. de) to boost a country
DuckDuckGo Syntax http://help.duckduckgo.com/customer/portal/articles/300304
01/05/2023 www.rba.co.uk 27
DuckDuckGo
01/05/2023 www.rba.co.uk 28
Automatically searches for .xls as well as .xlsx
DuckDuckGo Ben Nevis UK
01/05/2023 www.rba.co.uk 29
Millionshort http://millionshort.com
Million Short: unearthing information hidden in the dungeons of Google’s results
– http://www.rba.co.uk/wordpress/2012/10/04/million-short-unearthing-stuff-hidden-in-the-dungeons-of-googles-results/
Uses Bing API plus other sources
Great for finding specialist articles that Google buries beyond reach
Removes top 10k sites from results - can change to top million, 100k, 1k, 100
Can use site: and filetype: commands
Country versions give different results (under Manage Settings and Country)01/05/2023 www.rba.co.uk 30
Million Short
01/05/2023 www.rba.co.uk 31
Yandex.com
01/05/2023 www.rba.co.uk 32
Advanced search
Yandex
01/05/2023 www.rba.co.uk 33
Searching for xls also picks up .xlsx files
Ask
http://www.ask.com/ http://uk.ask.com/
01/05/2023 www.rba.co.uk 34
eTools.ch
01/05/2023 www.rba.co.uk 35
eTools Results Tool
01/05/2023 www.rba.co.uk 36
Carrotsearch circles
01/05/2023 www.rba.co.uk 38
Carrotsearch FoamTree
01/05/2023 www.rba.co.uk 39
Wolframalpha.com
01/05/2023 www.rba.co.uk 40
People find information using general search engines, social media (Facebook, Twitter) and their
favourite websites.
Information needs to pass the CRAAP test
01/05/2023 www.rba.co.uk 41
01/05/2023 www.rba.co.uk 42
Resource sheets for schools | Information Literacy http://www.informationliteracy.org.uk/teentech/resource-sheets/
Evaluating the information you find – CRAAP test
http://www.informationliteracy.org.uk/wp-content/uploads/2015/10/evaluating_info_new1_20-1-16.pdf
Currency When was it published, updated?
Relevance Does it fit in with the needs of your project
Authority Who has published the information – individual/organisation? Do you trust them? What else have they written? Further information about them? Who is behind the website?
Accuracy Is the information correct/interpreted correctly? Check with another independent source (may not be easy or possible)
Purpose Why does the page/site exist? Activist site? Selling a product or service? Revenue from advertising?
Debunking Euromyths
01/05/2023 www.rba.co.uk 44
Euromyths and Letters to the Editor A-Z index http://blogs.ec.europa.eu/ECintheUK/euromyths-a-z-index/
European Commission in the UK – Euromyths and Letters to the Editor http://blogs.ec.europa.eu/ECintheUK/
http://www.independent.co.uk/news/science/t-cell-therapy-extraordinary-results-lead-to-paradigm-shift-in-cancer-treatment-a6875961.html
Behind the headlines - Health News - Index - NHS Choices http://www.nhs.uk/news/Pages/NewsIndex.aspx
Fake pages/sites, hoaxes, scams
Latest Email and Social Media Hoaxes - Current Internet Scams - Hoax-Slayer http://www.hoax-slayer.com/ https://www.facebook.com/pages/Hoax-Slayer/69502133435
The Museum of Hoaxes http://hoaxes.org/
Snopes - Rumour has it http://www.snopes.com/ Snopes Field Guide to Fake News Sites and Hoax Purveyors http://www.snopes.com/2016/01/14/fake-news-sites/
Phil Bradley's weblog: Fake Facebook page - amazing example http://philbradley.typepad.com/phil_bradleys_weblog/2013/09/fake-facebook-page-amazing-example.html
Images - genuine or fake?
Tineye.com – search by image
SearchReSearch: Answer: Fake or real? How do you know? http://searchresearch1.blogspot.co.uk/2015/11/answer-fake-or-real-how-do-you-know.html
“Gun control works great for the people who are law-abiding citizens and it does nothing for the criminals, and all it does is put the people at risk.” Thomas Jefferson?
01/05/2023 www.rba.co.uk 52
True or false?
http://searchresearch1.blogspot.co.uk/2015/11/answer-fake-or-real-how-do-you-know.html
“Gun control works great for the people who are law-abiding citizens and it does nothing for the criminals, and all it does is put the people at risk.” Thomas Jefferson?
Ngram Viewer used to check whether a quote was genuine or fake by analysing the frequency of occurrence over time of a key phrase – “gun control”
01/05/2023 www.rba.co.uk 53
True or false?
“Germany Now Produces Half of its Energy Using Solar”
Image: Thomas Quine https://www.flickr.com/photos/quinet/6197284308/
Germany Now Produces Half Of Its Energy Using Solar | IFLScience http://www.iflscience.com/technology/germany-now-produces-half-its-energy-using-solar
True – sort off – but the title is misleading and inaccurate . Read the whole article to get the full story.
False impressions from skim reading feeds and titles
01/05/2023 www.rba.co.uk 55
Dave Grohl ordered to stay the fuck indoors http://newsthump.com/2016/04/22/dave-grohl-ordered-to-stay-the-fuck-indoors/
The spoof news site
Plenty of them - get to know the main ones. Spoofs are not always obvious.
Research literature
But the peer reviewed research literature is OK, isn’t it?
01/05/2023 www.rba.co.uk 56
Beall’s List http://scholarlyoa.com/ Predatory journals included in Google Scholar and subscription databases
Hijacked Journals Are Still a Problem | Scholarly Open Access https://scholarlyoa.com/2016/05/19/hijacked-journals-are-still-a-problem/
01/05/2023 www.rba.co.uk 58
01/05/2023 www.rba.co.uk 59
I Fooled Millions Into Thinking Chocolate Helps Weight Loss. Here's How. http://io9.gizmodo.com/i-fooled-millions-into-thinking-chocolate-helps-weight-1707251800
Microsoft Academic http://academic.research.microsoft.com/
01/05/2023 www.rba.co.uk 60
Institutional repositories and open access
BASE - Bielefeld Academic Search Engine http://www.base-search.net/
CORE (COnnecting Repositories) http://core.ac.uk/
DART-Europe E-theses Portal http://www.dart-europe.eu/basic-search.php
DOAJ: Directory of Open Access Journals http://doaj.org/
Open DOAR http://opendoar.org/
RIAN - Pathways to Irish Research http://rian.ie
OpenAIRE http://www.openaire.eu/
01/05/2023 www.rba.co.uk 61
Specialist search tools for research information
ArXiv http://arxiv.org/
bioRxiv.org - the preprint server for Biology http://biorxiv.org/
BioMed Central http://www.biomedcentral.com/
Chemistry Central http://www.chemistrycentral.com/
ChemSpider http://www.chemspider.com/
01/05/2023 www.rba.co.uk 62
Specialist search tools for research information
British Library EThOS - Search and order theses online http://ethos.bl.uk/
Europe PubMed Central http://europepmc.org/
Open Biology http://rsob.royalsocietypublishing.org/
PhilPapers: Online Research in Philosophy http://philpapers.org/
PubMed Central http://www.ncbi.nlm.nih.gov/pmc/ SSRN Social Science Research Network http://www.ssrn.com/en/ [Acquired by Elsevier]
01/05/2023 www.rba.co.uk 63
ChemSpider | Search and share chemistry http://www.chemspider.com/
01/05/2023 www.rba.co.uk 64
Compound Interest http://www.compoundchem.com
01/05/2023 www.rba.co.uk 65
http://www.compoundchem.com/2015/07/28/wet-dog/
ResearchGate - http://www.researchgate.net/
01/05/2023 www.rba.co.uk 66
Slideshare.net
Official Information
01/05/2023 www.rba.co.uk 68
Central government
Welcome to GOV.UK http://www.gov.uk/
Welsh Government http://gov.wales/
Welsh Assembly http://www.assembly.wales/
The Scottish Government http://www.gov.scot/
The Northern Ireland Assembly http://www.niassembly.gov.uk/
http://www.nationalarchives.gov.uk/webarchive/
www.rba.co.uk 7001/05/2023
http://www.webarchive.org.uk/ukwa/
01/05/2023 www.rba.co.uk 71
GitHub - jsvine/waybackpack: Download the entire Wayback Machine archive for a given URL. https://github.com/jsvine/waybackpack
01/05/2023 www.rba.co.uk 73
Digital Education Resource Archive (DERA) http://dera.ioe.ac.uk/
01/05/2023 www.rba.co.uk 74
http://www.legislation.gov.uk/
Launched in 2010Not all legislation has been updatedPending updates are flagged
01/05/2023 www.rba.co.uk 75
Monitoring progress of legislationhttp://services.parliament.uk/bills/2014-15/infrastructure.html
01/05/2023 www.rba.co.uk 77
TheyWorkForYou: Hansard and Official Reports for the UK Parliament, Scottish Parliament, and Northern Ireland Assembly - done right http://www.theyworkforyou.com/
01/05/2023 www.rba.co.uk 78
WhatDoTheyKnow - Make and browse Freedom of Information (FOI) requests https://www.whatdotheyknow.com/
01/05/2023 www.rba.co.uk 79
AsktheEU.org - Make and browse Freedom of Information (FOI) requests http://www.asktheeu.org/
01/05/2023 www.rba.co.uk 80
Company data
01/05/2023 www.rba.co.uk 81
Panama Papers https://offshoreleaks.icij.org/
01/05/2023 www.rba.co.uk 87
Panama Papers https://offshoreleaks.icij.org/
01/05/2023 www.rba.co.uk 88
Do it yourself with open data
01/05/2023 www.rba.co.uk 89
Panama Papers, Quick Start in SQLite3 | OUseful.Info, the blog... https://blog.ouseful.info/2016/04/10/panama-papers-quick-start-in-sqlite3/
01/05/2023 www.rba.co.uk 90
Bands Incorporated | OUseful.Info, the blog... https://blog.ouseful.info/2016/04/30/bands-incorporated/
01/05/2023 www.rba.co.uk 91
Analysing and presenting data
Basic statistical analysis – sorting/ranking, averagesBasic charts
– Excel, LibreOffice, Google Docs
Visualisations, maps – Google Fusion Tables/Google Charts
May find that charts and visualisations show anomalies in the data – need to go back a stage and re-check the data
Combining datasets, linked data and in depth analysis can be time consuming and require programming skills
01/05/2023 www.rba.co.uk 92
Chart and image gallery: 30+ free tools for data visualization and analysis | Computerworld http://www.computerworld.com/article/2506820/business-intelligence/business-intelligence-chart-and-image-gallery-30-free-tools-for-data-visualization-and-analysis.html
01/05/2023 www.rba.co.uk 93
Statistics and Industry Information
01/05/2023 www.rba.co.uk 94
Google Public Data Explorer http://www.google.com/publicdata/
01/05/2023 www.rba.co.uk 95
http://www.google.com/publicdata/Google Public Data Explorer - minimum wage Europe
www.rba.co.uk 9601/05/2023
British Library Business & IP Centre in London Industry guides http://www.bl.uk/bipc/dbandpubs/Industry%20guides/industry.html
01/05/2023 www.rba.co.uk 97
Various sectors covered
Resources include publications and databases at the BL but also freely accessible websites.
Good starting points if you are new to a sector/industry
Official statistics
OFFSTATS http://www.offstats.auckland.ac.nz/
Google Public data Explorer http://www.google.com/publicdata
UK National Statistics https://www.gov.uk/government/statistics/ Office for National Statistics http://www.ons.gov.uk/
Official Statistics in Scotland http://www.gov.scot/Topics/Statistics
Welsh Government Statistics & Research http://gov.wales/statistics-and-research/?lang=en
Welsh Assembly Government StatsWales http://statswales.wales.gov.uk/
data.gov.uk http://data.gov.uk/
Eurostat http://ec.europa.eu/eurostat/
European Union Open Data Portal http://open-data.europa.eu/en/data/
International organisations such as the World Bank, ILO01/05/2023 www.rba.co.uk 98
01/05/2023 www.rba.co.uk 100
Quandl Financial and Economic Data http://www.quandl.com/
01/05/2023 www.rba.co.uk 101
Quandl Financial and Economic Data http://www.quandl.com/
Statista http://www.statista.com/
“The Statistics Portal for Market Data, Market Research and Market Studies” – 60,000 topics from over 18,000 sources– http://www.statista.com/topics/– some information free, registration (free) required – Chart of the day https://www.statista.com/chartoftheday/
01/05/2023 www.rba.co.uk 102
Zanran
http://www.zanran.com/ Zanran – great for data in tables, charts and graphs http://www.rba.co.uk/wordpress/2013/01/25/zanran-great-for-data-in-tables-charts-and-graphs/
01/05/2023 www.rba.co.uk 103
Spurious correlations!
Per capita consumption of cheese (US) correlates with Number of people who died by becoming tangled in their bedsheets http://www.tylervigen.com/view_correlation?id=7
www.rba.co.uk 10401/05/2023
Images
01/05/2023 www.rba.co.uk 105
Bing images - License
01/05/2023 www.rba.co.uk 106
Creative Commons and public domain imagesAlways check the copyright on individual photos
Flickr Creative Commons http://www.flickr.com/creativecommons
Flickr The Commons http://www.flickr.com/commons/
Multicolr Search Lab http://labs.tineye.com/multicolr
Chromatik – Exalead Labs http://chromatik.labs.exalead.com/
Wikimedia Commons http://commons.wikimedia.org/
Geograph http://www.geograph.org.uk/ “UK and Ireland photos of landmarks and buildings for every Ordnance Survey grid”
Wellcome Images http://wellcomeimages.org/
Most of the images on US government web sites
Nasa http://www.nasa.gov/ 01/05/2023 www.rba.co.uk 107
http://www.flickr.com/creativecommons
01/05/2023 www.rba.co.uk 108
http://www.flickr.com/commons/institutions/
01/05/2023 www.rba.co.uk 109
TinEye Multicolr http://labs.tineye.com/multicolr
01/05/2023 www.rba.co.uk 110
The best free cultural & educational media on the web - Open Culture http://www.openculture.com/
01/05/2023 www.rba.co.uk 112
3,900 Pages of Paul Klee's Personal Notebooks Are Now Online, Presenting His Bauhaus Teachings (1921-1931) | Open Culture http://www.openculture.com/2016/03/3900-pages-of-paul-klees-personal-notebooks-are-now-online.html
Keeping up to date
SearchReSearch : http://searchresearch1.blogspot.co.uk/
Search Engine Land http://searchengineland.com/
Search Engine Watch http://searchenginewatch.com/
Search Engine Roundtable http://www.seroundtable.com/
Karen Blakeman’s Blog http://www.rba.co.uk/wordpress/
Phil Bradley's weblog http://philbradley.typepad.com/
01/05/2023 www.rba.co.uk 113
Slides available at http://www.rba.co.uk/as/
Also on Slideshare http://www.slideshare.net/KarenBlakeman/ and
authorSTREAM http://www.authorstream.com/User-Presentations/karenblakeman/
01/05/2023 www.rba.co.uk 114
