Server side SEO - The art of making love to spiders
-
Upload
boaz-sasson -
Category
Internet
-
view
175 -
download
1
Transcript of Server side SEO - The art of making love to spiders
![Page 1: Server side SEO - The art of making love to spiders](https://reader035.fdocuments.in/reader035/viewer/2022070601/588440b51a28aba8438b5099/html5/thumbnails/1.jpg)
Boaz Sasson | Head of Performancesas son@ s im i l a rwe b .com
Server-side SEO: The Art of Making Love to Spiders
![Page 2: Server side SEO - The art of making love to spiders](https://reader035.fdocuments.in/reader035/viewer/2022070601/588440b51a28aba8438b5099/html5/thumbnails/2.jpg)
Every Website
Traffic Trends Desktop & Mobile Referring Traffic
Keywords Advertising Analysis
Popular Pages
Every App
Current User Installs Active Users
Engagement per app Retention Analysis
App store optimization
Every Country
We Reveal the Secrets of Online Success
![Page 3: Server side SEO - The art of making love to spiders](https://reader035.fdocuments.in/reader035/viewer/2022070601/588440b51a28aba8438b5099/html5/thumbnails/3.jpg)
Do You Know?
![Page 4: Server side SEO - The art of making love to spiders](https://reader035.fdocuments.in/reader035/viewer/2022070601/588440b51a28aba8438b5099/html5/thumbnails/4.jpg)
Not Even a Spider: Googlebot is a headless browser, not a simple link crawlerCan render pages visually
Traverses the DOM
Executes AJAX, JS & forms
*Spotted in the wild as early as 2010(h t tp : / / sea rcheng ine land .com/goog les -p roposa l- fo r - c ra w l ing -a jax -may -be - l i ve -34411)
![Page 5: Server side SEO - The art of making love to spiders](https://reader035.fdocuments.in/reader035/viewer/2022070601/588440b51a28aba8438b5099/html5/thumbnails/5.jpg)
Meet the Cookie MonsterGooglebot DOES seem able to accept cookies
No longer a reliable way to Segregate/sniff bot traffic
![Page 6: Server side SEO - The art of making love to spiders](https://reader035.fdocuments.in/reader035/viewer/2022070601/588440b51a28aba8438b5099/html5/thumbnails/6.jpg)
Mr. Greedybot RequiresAccess to All Your Files,and QuicklyDo NOT block JS, CSS, scripts orimages from Googlebot if they are needed to render a page
Avoid setting crawl rate limits, if atall possible
Search bot traffic can eat your bandwidth, let them
![Page 7: Server side SEO - The art of making love to spiders](https://reader035.fdocuments.in/reader035/viewer/2022070601/588440b51a28aba8438b5099/html5/thumbnails/7.jpg)
Impact on PR/Linkjuice??Not clear how it flows on links in JS,forms, code, etc…
Consider all the links/filepaths in code, as well as text links, as part of the page’s link graph
Internal links can either promote Indexation, or pass juice, or do both
![Page 8: Server side SEO - The art of making love to spiders](https://reader035.fdocuments.in/reader035/viewer/2022070601/588440b51a28aba8438b5099/html5/thumbnails/8.jpg)
What is a crawl budget and how does is affect me?
![Page 9: Server side SEO - The art of making love to spiders](https://reader035.fdocuments.in/reader035/viewer/2022070601/588440b51a28aba8438b5099/html5/thumbnails/9.jpg)
More Pages Crawled = More Pages Indexed = More Traffic (*If site is healthy)
![Page 10: Server side SEO - The art of making love to spiders](https://reader035.fdocuments.in/reader035/viewer/2022070601/588440b51a28aba8438b5099/html5/thumbnails/10.jpg)
Depth Prob Based On:Amount of incoming links/buzz
Content creation rate/amounts
Trust – more of it results in wider and deeper crawling
Think in terms of both crawling a site (laterally) and crawling a page (depth)
Bad/low quality content getting crawled is a waste of your crawl budget
![Page 11: Server side SEO - The art of making love to spiders](https://reader035.fdocuments.in/reader035/viewer/2022070601/588440b51a28aba8438b5099/html5/thumbnails/11.jpg)
Indicator of Site’s HealthCrawl stats can be used as a quick indicator of a site’s general SEO health
How many pages indexed?
Trends?
What errors/parameters are indexed?
![Page 12: Server side SEO - The art of making love to spiders](https://reader035.fdocuments.in/reader035/viewer/2022070601/588440b51a28aba8438b5099/html5/thumbnails/12.jpg)
Life is HardNot easy to get many pages indexed quickly on a new site
![Page 13: Server side SEO - The art of making love to spiders](https://reader035.fdocuments.in/reader035/viewer/2022070601/588440b51a28aba8438b5099/html5/thumbnails/13.jpg)
What Should I Block?
![Page 14: Server side SEO - The art of making love to spiders](https://reader035.fdocuments.in/reader035/viewer/2022070601/588440b51a28aba8438b5099/html5/thumbnails/14.jpg)
Golden rule: “One filepath per specific content piece”
![Page 15: Server side SEO - The art of making love to spiders](https://reader035.fdocuments.in/reader035/viewer/2022070601/588440b51a28aba8438b5099/html5/thumbnails/15.jpg)
Low quality/trust pages
![Page 16: Server side SEO - The art of making love to spiders](https://reader035.fdocuments.in/reader035/viewer/2022070601/588440b51a28aba8438b5099/html5/thumbnails/16.jpg)
Duplicate (many forms), sorting, multi- category, non-existent,
framed content
![Page 17: Server side SEO - The art of making love to spiders](https://reader035.fdocuments.in/reader035/viewer/2022070601/588440b51a28aba8438b5099/html5/thumbnails/17.jpg)
How to Block Content & Some Misconceptions
![Page 18: Server side SEO - The art of making love to spiders](https://reader035.fdocuments.in/reader035/viewer/2022070601/588440b51a28aba8438b5099/html5/thumbnails/18.jpg)
Better to delete crap than to block it
![Page 19: Server side SEO - The art of making love to spiders](https://reader035.fdocuments.in/reader035/viewer/2022070601/588440b51a28aba8438b5099/html5/thumbnails/19.jpg)
Assume that anything in the DOM is technically accessible to modern search bots, even though it may not pass juice
![Page 20: Server side SEO - The art of making love to spiders](https://reader035.fdocuments.in/reader035/viewer/2022070601/588440b51a28aba8438b5099/html5/thumbnails/20.jpg)
Robots.txt only works on internally
![Page 21: Server side SEO - The art of making love to spiders](https://reader035.fdocuments.in/reader035/viewer/2022070601/588440b51a28aba8438b5099/html5/thumbnails/21.jpg)
Don't block with both robots.txt and meta robots together
![Page 22: Server side SEO - The art of making love to spiders](https://reader035.fdocuments.in/reader035/viewer/2022070601/588440b51a28aba8438b5099/html5/thumbnails/22.jpg)
Best to block with meta robots & delete via GWT (*renew every 6 months)
![Page 23: Server side SEO - The art of making love to spiders](https://reader035.fdocuments.in/reader035/viewer/2022070601/588440b51a28aba8438b5099/html5/thumbnails/23.jpg)
X-robots tag, is in document HEAD, useful for PDFs, XML, etc…
![Page 24: Server side SEO - The art of making love to spiders](https://reader035.fdocuments.in/reader035/viewer/2022070601/588440b51a28aba8438b5099/html5/thumbnails/24.jpg)
Play around with blocking elements via frames, tabs, forms, animations,
lazyloading
![Page 25: Server side SEO - The art of making love to spiders](https://reader035.fdocuments.in/reader035/viewer/2022070601/588440b51a28aba8438b5099/html5/thumbnails/25.jpg)
Redirect Logic
![Page 26: Server side SEO - The art of making love to spiders](https://reader035.fdocuments.in/reader035/viewer/2022070601/588440b51a28aba8438b5099/html5/thumbnails/26.jpg)
Links lose juice with each hop
![Page 27: Server side SEO - The art of making love to spiders](https://reader035.fdocuments.in/reader035/viewer/2022070601/588440b51a28aba8438b5099/html5/thumbnails/27.jpg)
Catch as many instances as possible in single rules
![Page 28: Server side SEO - The art of making love to spiders](https://reader035.fdocuments.in/reader035/viewer/2022070601/588440b51a28aba8438b5099/html5/thumbnails/28.jpg)
Default redirect should be 301
![Page 29: Server side SEO - The art of making love to spiders](https://reader035.fdocuments.in/reader035/viewer/2022070601/588440b51a28aba8438b5099/html5/thumbnails/29.jpg)
If no other options, use meta refresh set to zero seconds for 301s, & 5
seconds for 302s
![Page 30: Server side SEO - The art of making love to spiders](https://reader035.fdocuments.in/reader035/viewer/2022070601/588440b51a28aba8438b5099/html5/thumbnails/30.jpg)
Google Really Dislikes Broken Links
Check using a scheduled 404 report or spider
Scan on a regular basis
![Page 31: Server side SEO - The art of making love to spiders](https://reader035.fdocuments.in/reader035/viewer/2022070601/588440b51a28aba8438b5099/html5/thumbnails/31.jpg)
Sessions, parameters and cookies
![Page 32: Server side SEO - The art of making love to spiders](https://reader035.fdocuments.in/reader035/viewer/2022070601/588440b51a28aba8438b5099/html5/thumbnails/32.jpg)
Do NOT:
Print session IDs/parameters on filepaths in code
Pass session IDs via filepaths
![Page 33: Server side SEO - The art of making love to spiders](https://reader035.fdocuments.in/reader035/viewer/2022070601/588440b51a28aba8438b5099/html5/thumbnails/33.jpg)
Be mindful of parameters used, each is considered to be a unique page
![Page 34: Server side SEO - The art of making love to spiders](https://reader035.fdocuments.in/reader035/viewer/2022070601/588440b51a28aba8438b5099/html5/thumbnails/34.jpg)
Use cookies to pass session info
![Page 35: Server side SEO - The art of making love to spiders](https://reader035.fdocuments.in/reader035/viewer/2022070601/588440b51a28aba8438b5099/html5/thumbnails/35.jpg)
If no other alternative, block parameters via GWT
![Page 36: Server side SEO - The art of making love to spiders](https://reader035.fdocuments.in/reader035/viewer/2022070601/588440b51a28aba8438b5099/html5/thumbnails/36.jpg)
Supercookies (flash, browser cache, fingerprinting, E Tags, etc)
![Page 37: Server side SEO - The art of making love to spiders](https://reader035.fdocuments.in/reader035/viewer/2022070601/588440b51a28aba8438b5099/html5/thumbnails/37.jpg)
URL Structures
![Page 38: Server side SEO - The art of making love to spiders](https://reader035.fdocuments.in/reader035/viewer/2022070601/588440b51a28aba8438b5099/html5/thumbnails/38.jpg)
Filepaths can be flat, deep, or with several parameters if needed, all
seem to work fine
![Page 39: Server side SEO - The art of making love to spiders](https://reader035.fdocuments.in/reader035/viewer/2022070601/588440b51a28aba8438b5099/html5/thumbnails/39.jpg)
Have a clear hierarchy in terms of directory structure, use internal links
to emphasize relationships
![Page 40: Server side SEO - The art of making love to spiders](https://reader035.fdocuments.in/reader035/viewer/2022070601/588440b51a28aba8438b5099/html5/thumbnails/40.jpg)
Be consistent - all lower case, hyphens not underscores, avoid empty
spaces
![Page 41: Server side SEO - The art of making love to spiders](https://reader035.fdocuments.in/reader035/viewer/2022070601/588440b51a28aba8438b5099/html5/thumbnails/41.jpg)
Think of clickability of the filepath when seen by a human
![Page 42: Server side SEO - The art of making love to spiders](https://reader035.fdocuments.in/reader035/viewer/2022070601/588440b51a28aba8438b5099/html5/thumbnails/42.jpg)
Avoid foreign language encoding on URLs
![Page 43: Server side SEO - The art of making love to spiders](https://reader035.fdocuments.in/reader035/viewer/2022070601/588440b51a28aba8438b5099/html5/thumbnails/43.jpg)
Two Great & Free Tools for Crawling
![Page 44: Server side SEO - The art of making love to spiders](https://reader035.fdocuments.in/reader035/viewer/2022070601/588440b51a28aba8438b5099/html5/thumbnails/44.jpg)
IIS SEO Toolkithttp://www.iis.net/downloads/microsoft/search-engine-
optimization-toolkit
![Page 45: Server side SEO - The art of making love to spiders](https://reader035.fdocuments.in/reader035/viewer/2022070601/588440b51a28aba8438b5099/html5/thumbnails/45.jpg)
Xenuhttp://home.snafu.de/tilman/xenulink.html
![Page 46: Server side SEO - The art of making love to spiders](https://reader035.fdocuments.in/reader035/viewer/2022070601/588440b51a28aba8438b5099/html5/thumbnails/46.jpg)
Quick Tests:
Technical, Penalty, or Market?
![Page 47: Server side SEO - The art of making love to spiders](https://reader035.fdocuments.in/reader035/viewer/2022070601/588440b51a28aba8438b5099/html5/thumbnails/47.jpg)
47/20
Thank YouBoaz Sasson
sas son@ s im i l a rwe b .com