How Search Engines Work

ORGANIC SEARCH

CRAWL

INDEX

RANK

CRAWLING

KnownWeb

pages

KnownWeb

pages

Index ServersIndex

Servers

CrawlerMachinesCrawler

Machines

GooglebotGooglebot

Doc ServersDoc Servers

DEVELOPING THE LIST OF KNOWN WEB PAGES

KnownWeb

pages

KnownWeb

pages

Prior CrawlsPrior

Crawls

/addurl/addurl

PEREMECH

CRAWLING FOR PEREMECH

CRAWLERS IDENTIFY THEMSELVES

ROBOTS.TXT – EXCLUDES SITES FROM CRAWLING

whitehouse.gov/robots.txtwhitehouse.gov/robots.txt

CRAWLERS SHOULD NOT HOG RESOURCES

CRAWLING PROBLEM: THE WEB IS VAST

CRAWLING PROBLEM: THE HIDDEN WEB

INDEXING

RANKING

Closely guarded, proprietary algorithm

RANKING

Organic Search Results

Keyword Phrase

RANKING – THINGS THAT MATTER

Can you find the word Lobster?

WHY IS RED LOBSTER RANKED HIGHER?

Can you find the word Lobster?

HOW CAN I IMPROVE MY RANK?

BASIC SEO CONCEPTS –TEXT

KEYWORD PROXIMITY

We sell live Maine lobster

Home of Maine’s best lobster

All of our lobsters come from Maine


KEYWORD DENSITY

What percentage of the words on this page are lobster.


KEYWORD FREQUENCY

The keyword lobster is visible 32 times and occurs 182 times on the page


KEYWORD PROMINENCE

LobsterLobster

Lobster

Lobster

Lobster

Lobster

BASIC SEO CONCEPTS – LINKING

LINK EXCHANGE AND PAID PLACEMENT


An article written at thefreelibrary.com


PAID PLACEMENT


LINK EXCHANGE - RELEVANT


LINK EXCHANGE – NON RELEVANT


LINK SPAM


COMMENT/ FORUM SPAM

LINK EXCHANGE IS CONTROVERSIAL

USER RELEVANCE

LOCATION

USER ID

130.111.115.24

USER EXPERTISE VARIES

PHOTO ATTRIBUTIONS

Slide 10: 'OINK! OINK!’ www.flickr.com/photos/49968232@N00/51679641

Slide 11: ‘The Vast Web’ wikicommons.com

Slide 13: 'Royal Guards’ www.flickr.com/photos/23697065@N05/2356109302

Slide 17: 'Yoda (IMG_3308)‘ www.flickr.com/photos/73531322@N00/194828922

Slide 30: ‘Vera Cruz’ BAM/Photofest

How Search Engines Work

Technology

Transcript of How Search Engines Work