Specialized search engines

28
Specialized search Specialized search engines engines Alex Kotov Alex Kotov (04/05/2007) (04/05/2007)

description

Specialized search engines. Alex Kotov (04/05/2007). Outline. Vertical search engines; Opinion search engines; Personalized search engines; Social search engines. Vertical search engines. - PowerPoint PPT Presentation

Transcript of Specialized search engines

Page 1: Specialized search engines

Specialized search Specialized search enginesengines

Alex KotovAlex Kotov

(04/05/2007)(04/05/2007)

Page 2: Specialized search engines

OutlineOutline

► Vertical search engines;Vertical search engines;► Opinion search engines;Opinion search engines;► Personalized search engines;Personalized search engines;► Social search engines. Social search engines.

Page 3: Specialized search engines

Vertical search enginesVertical search engines

► Known as “specialized” search, which Known as “specialized” search, which addresses the particular information addresses the particular information needs of niche audiences and needs of niche audiences and professions (doctors, job seekers, professions (doctors, job seekers, house buyers, recruiters, etc.);house buyers, recruiters, etc.);

► Deliver to users the information that Deliver to users the information that the broad-based search engines can’t the broad-based search engines can’t without the use of complex keyword without the use of complex keyword combinations;combinations;

Page 4: Specialized search engines

Vertical search design Vertical search design modelsmodels

► Vertical search engine as a separate Vertical search engine as a separate portal: gizmocafe.com (consumer portal: gizmocafe.com (consumer electronics), loupeit.net (jewelers);electronics), loupeit.net (jewelers);

► Vertical search engine as a Vertical search engine as a complimentary web site application complimentary web site application (embedding a search engine box on an (embedding a search engine box on an existing site): amazon.com;existing site): amazon.com;

► Parametric search (allows for face-to-Parametric search (allows for face-to-face product and manufacturer face product and manufacturer comparison): autotrader.com, trulia.com comparison): autotrader.com, trulia.com (real estate); (real estate);

Page 5: Specialized search engines

Vertical Search EnginesVertical Search Engines► Job search engines (monster.com, hotjobs.com, Job search engines (monster.com, hotjobs.com,

simplyhired.com);simplyhired.com);► Medical search engines (gopubmed.co, webmd.com);Medical search engines (gopubmed.co, webmd.com);► Property search engines (rightmove.com, zillow.com);Property search engines (rightmove.com, zillow.com);► Accountancy search engines (ifacnet.com);Accountancy search engines (ifacnet.com);► Legal search engines (westlaw.com, quicklaw.com, Legal search engines (westlaw.com, quicklaw.com,

lexis.com);lexis.com);► Code search engines (krugle.com, koders.com, Google Code search engines (krugle.com, koders.com, Google

Code Search); Code Search); ► Comparison shopping search engines (froogle.com, Comparison shopping search engines (froogle.com,

msn shopping, shopzilla, nextag.com, msn shopping, shopzilla, nextag.com, pricerunner.com).pricerunner.com).

Page 6: Specialized search engines

KrugleKrugle

► Allows programmers to search Open Allows programmers to search Open Source repositories in order to locate Source repositories in order to locate source code and quickly share code source code and quickly share code with others;with others;

► Searches Apache, JavaDocs, Searches Apache, JavaDocs, SourceForge and Wikipedia amongst SourceForge and Wikipedia amongst other sources;other sources;

► Plugins for Firefox and Explorer are Plugins for Firefox and Explorer are available.available.

Page 7: Specialized search engines

KrugleKrugle

Page 8: Specialized search engines

KrugleKrugle

Page 9: Specialized search engines

KodersKoders

► Web-based code search engine + Web-based code search engine + plug-ins for the Eclipse and Microsoft plug-ins for the Eclipse and Microsoft Visual Studio IDEs;Visual Studio IDEs;

► Can be deployed as a stand-alone Can be deployed as a stand-alone application on a developer’s desktop application on a developer’s desktop or as a networked solution across or as a networked solution across multiple development teams.multiple development teams.

Page 10: Specialized search engines

KodersKoders

Page 11: Specialized search engines

KodersKoders

Page 12: Specialized search engines

OutlineOutline

► Vertical search engines;Vertical search engines;► Opinion search engines;Opinion search engines;► Personalized search engines;Personalized search engines;► Social search engines. Social search engines.

Page 13: Specialized search engines

Opinion search enginesOpinion search engines

► Unsupervised information extraction Unsupervised information extraction systems, which mine product review systems, which mine product review data for important product features;data for important product features;

► Identify opinions regarding product Identify opinions regarding product features and establish their polarity features and establish their polarity (positive or negative);(positive or negative);

► Rank opinions based on their Rank opinions based on their strength;strength;

► Example: Opine (joint project of Example: Opine (joint project of Google and U of Washington).Google and U of Washington).

Page 14: Specialized search engines

OpineOpine

Page 15: Specialized search engines

OpineOpine

Page 16: Specialized search engines

OutlineOutline

► Vertical search engines;Vertical search engines;► Opinion search engines;Opinion search engines;► Personalized search engines;Personalized search engines;► Social search engines. Social search engines.

Page 17: Specialized search engines

Personalized search enginesPersonalized search engines

► Use information about the user to provide Use information about the user to provide better search results;better search results;

► Require a user to set up a profile;Require a user to set up a profile;► Filter search results to the user’s area of Filter search results to the user’s area of

interest (subject-based personalization);interest (subject-based personalization);► Analyze and score pages by their attributes, Analyze and score pages by their attributes,

looking for particular categories (attribute-looking for particular categories (attribute-based personalization);based personalization);

► A9 (keeps track of searches and allows to A9 (keeps track of searches and allows to repeat same searches at a later time).repeat same searches at a later time).

Page 18: Specialized search engines

Subject-based Subject-based personalizationpersonalization

► Example: Google Personalized Search Example: Google Personalized Search 1.0;1.0;

► Users creates a profile by selecting Users creates a profile by selecting particular categories he is interested in particular categories he is interested in (movies, radio, music);(movies, radio, music);

► By using a slider, a user can By using a slider, a user can “personalize” search results to skew “personalize” search results to skew them toward particular interest areas;them toward particular interest areas;

► Pages are classified by topics on the Pages are classified by topics on the server side.server side.

Page 19: Specialized search engines

Yahoo MyWeb Yahoo MyWeb

Page 20: Specialized search engines

Google personalized search Google personalized search 2.02.0

Page 21: Specialized search engines

OutlineOutline

► Vertical search engines;Vertical search engines;► Opinion search engines;Opinion search engines;► Personalized search engines;Personalized search engines;► Social search engines.Social search engines.

Page 22: Specialized search engines

Personalized Search vs. Social Personalized Search vs. Social Search Search

►Personalized search: by knowing some Personalized search: by knowing some things about you, a search engine things about you, a search engine might refine your results to make might refine your results to make them more relevant;them more relevant;

►Social Search: provide personalized Social Search: provide personalized results based not only on who you are, results based not only on who you are, but also on who you know;but also on who you know;

►Social Search Engines are also called Social Search Engines are also called swikis = search engine + wiki.swikis = search engine + wiki.

Page 23: Specialized search engines

Social SearchSocial Search

► Is considered the 3Is considered the 3rdrd big evolution of big evolution of the search business after algorithmic the search business after algorithmic search and paid search models;search and paid search models;

►Web 2.0 trends converge toward social Web 2.0 trends converge toward social search (social networking, consumer search (social networking, consumer generated media, open platforms);generated media, open platforms);

► It is about helping people find stuff.It is about helping people find stuff.

Page 24: Specialized search engines

Social searchSocial search

► Typical scenario: if you search for “jaguar” Typical scenario: if you search for “jaguar” and any of your friends have done the same and any of your friends have done the same search before, their selections are pushed search before, their selections are pushed up in the results page;up in the results page;

► Users can see queries posed by their Users can see queries posed by their colleagues and help them find necessary colleagues and help them find necessary information;information;

► Users can see what is “hot topic” for a Users can see what is “hot topic” for a particular category of users;particular category of users;

► Users may opt not to share some queries.Users may opt not to share some queries.

Page 25: Specialized search engines

Social searchSocial search► Advantages:Advantages:

leverage a network of trusted individuals in judging the leverage a network of trusted individuals in judging the relevance of search results;relevance of search results;

reduced impact of link spam by relying less on the link reduced impact of link spam by relying less on the link structure of Web pages;structure of Web pages;

as opposed to PageRank, Web pages are considered to be as opposed to PageRank, Web pages are considered to be relevant from the reader’s perspective, rather than the relevant from the reader’s perspective, rather than the author’s, who desires their content to be viewed; author’s, who desires their content to be viewed;

► Downsides: Downsides: as social network grows, commonalities that are useful get as social network grows, commonalities that are useful get

diluted. Solution: divide friends into groups;diluted. Solution: divide friends into groups; risk of search spam (user pushing up certain pages in risk of search spam (user pushing up certain pages in

search results). Requires the ability to detect the validity of search results). Requires the ability to detect the validity of a users’ contribution;a users’ contribution;

► Potential uses: research group/lab, library.Potential uses: research group/lab, library.

Page 26: Specialized search engines

Social search enginesSocial search engines

► Eurekster;Eurekster;► Yahoo! MyWeb;Yahoo! MyWeb;► Google Coop;Google Coop;► Younanimous;Younanimous;► Decipho;Decipho;► Rollyo;Rollyo;► Wink (people search).Wink (people search).

Page 27: Specialized search engines

EureksterEurekster

► Launched to the public in 2004;Launched to the public in 2004;► Pioneered vertical, social search;Pioneered vertical, social search;► Is built on top of AllTheWeb search engine;Is built on top of AllTheWeb search engine;► Hosts 50,000 swickis;Hosts 50,000 swickis;► Receives 20 million searches per month or Receives 20 million searches per month or

around 500,000 searches per day;around 500,000 searches per day;► In January 2007 announced one of the 100 In January 2007 announced one of the 100

best companies in terms of innovation and best companies in terms of innovation and market potential.market potential.

Page 28: Specialized search engines

EureksterEurekster