Ensuring Your Site is Technically Sound for Spiders and Visitors Alike By Anthony Piwarun
-
Upload
search-marketing-expo-smx -
Category
Internet
-
view
258 -
download
0
description
Transcript of Ensuring Your Site is Technically Sound for Spiders and Visitors Alike By Anthony Piwarun
![Page 1: Ensuring Your Site is Technically Sound for Spiders and Visitors Alike By Anthony Piwarun](https://reader033.fdocuments.in/reader033/viewer/2022051609/546fae70b4af9faa0b8b4594/html5/thumbnails/1.jpg)
@apiwarun
C O N Q U E R I N G T O D A Y ’ S S E O
Ensuring your site is technically sound for spiders and visitors alike.
ANTHONY PIWARUN @apiwarun
Manager, Search Engine Marketing Zeon Solutions
C H A L L E N G E S
Slides: mesr.me/SMXEast14
![Page 2: Ensuring Your Site is Technically Sound for Spiders and Visitors Alike By Anthony Piwarun](https://reader033.fdocuments.in/reader033/viewer/2022051609/546fae70b4af9faa0b8b4594/html5/thumbnails/2.jpg)
@apiwarun
AGENDA
ü I n t r o d u c t i o n
ü W a i t . . W h y d o e s t h i s m a t t e r ?
ü O h , t h e r e a r e b e s t p r a c t i c e s ?
ü F i n a l T h o u g h t s
ü Q & A
![Page 3: Ensuring Your Site is Technically Sound for Spiders and Visitors Alike By Anthony Piwarun](https://reader033.fdocuments.in/reader033/viewer/2022051609/546fae70b4af9faa0b8b4594/html5/thumbnails/3.jpg)
@apiwarun
HELLO!
ü Practice Lead, Search & Content @
Zeon Solutions
ü 7+ years digital marketing experience
ü Contributing Editor / Author for Search
Engine Journal and MarketingProfs
ü SMX East, SMX West, Outdoor Retailer &
LavaCon Speaker
![Page 4: Ensuring Your Site is Technically Sound for Spiders and Visitors Alike By Anthony Piwarun](https://reader033.fdocuments.in/reader033/viewer/2022051609/546fae70b4af9faa0b8b4594/html5/thumbnails/4.jpg)
@apiwarun
QUICK SURVEY!
A Little Participation Never Hurt ;)
![Page 5: Ensuring Your Site is Technically Sound for Spiders and Visitors Alike By Anthony Piwarun](https://reader033.fdocuments.in/reader033/viewer/2022051609/546fae70b4af9faa0b8b4594/html5/thumbnails/5.jpg)
@apiwarun
THE SURVEY SAYS…
ü Who here is responsible for “digital marketing”?
![Page 6: Ensuring Your Site is Technically Sound for Spiders and Visitors Alike By Anthony Piwarun](https://reader033.fdocuments.in/reader033/viewer/2022051609/546fae70b4af9faa0b8b4594/html5/thumbnails/6.jpg)
@apiwarun
THE SURVEY SAYS…
ü Who here is responsible for “digital marketing”?
ü How many of you do “search marketing”?
![Page 7: Ensuring Your Site is Technically Sound for Spiders and Visitors Alike By Anthony Piwarun](https://reader033.fdocuments.in/reader033/viewer/2022051609/546fae70b4af9faa0b8b4594/html5/thumbnails/7.jpg)
@apiwarun
THE SURVEY SAYS…
ü Who here is responsible for “digital marketing”?
ü How many of you do “search marketing”?
ü Who can guess the difference?
![Page 8: Ensuring Your Site is Technically Sound for Spiders and Visitors Alike By Anthony Piwarun](https://reader033.fdocuments.in/reader033/viewer/2022051609/546fae70b4af9faa0b8b4594/html5/thumbnails/8.jpg)
@apiwarun
We’re Technical GEEKS, duh!
![Page 9: Ensuring Your Site is Technically Sound for Spiders and Visitors Alike By Anthony Piwarun](https://reader033.fdocuments.in/reader033/viewer/2022051609/546fae70b4af9faa0b8b4594/html5/thumbnails/9.jpg)
@apiwarun
INTRODUCTION
So… Why Are We Here?
![Page 10: Ensuring Your Site is Technically Sound for Spiders and Visitors Alike By Anthony Piwarun](https://reader033.fdocuments.in/reader033/viewer/2022051609/546fae70b4af9faa0b8b4594/html5/thumbnails/10.jpg)
@apiwarun
SO… WHY ARE WE HERE?
ü Whether we’re optimizing a lead generation or ecommerce
site, let’s face it… technical factors matter…
ü Regardless of the server, out-of-the-box platforms just don’t cut
it when it comes to “plug and play”
ü If we want to weather the storm, we need to first recognize
that…
![Page 11: Ensuring Your Site is Technically Sound for Spiders and Visitors Alike By Anthony Piwarun](https://reader033.fdocuments.in/reader033/viewer/2022051609/546fae70b4af9faa0b8b4594/html5/thumbnails/11.jpg)
@apiwarun MILLENNIALS!
![Page 12: Ensuring Your Site is Technically Sound for Spiders and Visitors Alike By Anthony Piwarun](https://reader033.fdocuments.in/reader033/viewer/2022051609/546fae70b4af9faa0b8b4594/html5/thumbnails/12.jpg)
@apiwarun
HOLD UP…
WINTER IS COMING?!?!
![Page 13: Ensuring Your Site is Technically Sound for Spiders and Visitors Alike By Anthony Piwarun](https://reader033.fdocuments.in/reader033/viewer/2022051609/546fae70b4af9faa0b8b4594/html5/thumbnails/13.jpg)
@apiwarun
HOW CAN WE WEATHER THE STORM?
ü Utilize technical best practices to ensure search engines can
effectively crawl, index and of course rank the pages relevant to
a user’s query
ü Taking a proactive approach to guiding search engines in the
right direction
ü Board up the windows, lock the doors and buckle up for the ride!
![Page 14: Ensuring Your Site is Technically Sound for Spiders and Visitors Alike By Anthony Piwarun](https://reader033.fdocuments.in/reader033/viewer/2022051609/546fae70b4af9faa0b8b4594/html5/thumbnails/14.jpg)
@apiwarun
HOW WE’LL DO IT
ü URL Structure
ü Gateways & Mall Directories
ü Mobile & International
ü Redirects
ü Structured Data Markup (i.e. schema.org & microformats)
ü Rel=Canonical & Next/Prev (The never-ending battle)
![Page 15: Ensuring Your Site is Technically Sound for Spiders and Visitors Alike By Anthony Piwarun](https://reader033.fdocuments.in/reader033/viewer/2022051609/546fae70b4af9faa0b8b4594/html5/thumbnails/15.jpg)
@apiwarun
GATEWAYS & MALL DIRECTORIES
I.E. Robots.txt and Sitemap.xml
![Page 16: Ensuring Your Site is Technically Sound for Spiders and Visitors Alike By Anthony Piwarun](https://reader033.fdocuments.in/reader033/viewer/2022051609/546fae70b4af9faa0b8b4594/html5/thumbnails/16.jpg)
@apiwarun
ROBOTS.TXT
ü Critical to managing access to content as well as indexation
ü No one-size fits all robots.txt file
ü Highlights ü On-Site Search
ü Sitemap.xml File
ü Assets of Value Directory!
![Page 17: Ensuring Your Site is Technically Sound for Spiders and Visitors Alike By Anthony Piwarun](https://reader033.fdocuments.in/reader033/viewer/2022051609/546fae70b4af9faa0b8b4594/html5/thumbnails/17.jpg)
@apiwarun
SITEMAP.XML
ü Segmented sitemaps allow for increased visibility into what bots are indexing
ü Add index & subfiles to webmaster tools to measure crawl-to-indexation ratio
ü Identify areas needed for improvement
![Page 18: Ensuring Your Site is Technically Sound for Spiders and Visitors Alike By Anthony Piwarun](https://reader033.fdocuments.in/reader033/viewer/2022051609/546fae70b4af9faa0b8b4594/html5/thumbnails/18.jpg)
@apiwarun
MOBILE OPTIMIZATIONS
Walking Through The Options
![Page 19: Ensuring Your Site is Technically Sound for Spiders and Visitors Alike By Anthony Piwarun](https://reader033.fdocuments.in/reader033/viewer/2022051609/546fae70b4af9faa0b8b4594/html5/thumbnails/19.jpg)
@apiwarun
MOBILE EXPERIENCE OPTIONS
ü For mobile browsing, three primary options:
ü Responsive – desktop view & functionality shrunk to device size. Full, desktop experience is kept intact.
ü Adaptive – experience is tailored to mobile or tablet. Focus on efficiency & navigation. Like a “new” site.
ü Hybrid Responsive – incorporates elements of both Responsive and Adaptive design
![Page 20: Ensuring Your Site is Technically Sound for Spiders and Visitors Alike By Anthony Piwarun](https://reader033.fdocuments.in/reader033/viewer/2022051609/546fae70b4af9faa0b8b4594/html5/thumbnails/20.jpg)
@apiwarun
MOBILE OPTIONS – THE RUNDOWN
ü Caution – controversy ahead!
ü Google says you should use responsive design
ü My take? Adaptive OR Hybrid Responsive almost always
preferred…
ü It’s about the experience… remember?
![Page 21: Ensuring Your Site is Technically Sound for Spiders and Visitors Alike By Anthony Piwarun](https://reader033.fdocuments.in/reader033/viewer/2022051609/546fae70b4af9faa0b8b4594/html5/thumbnails/21.jpg)
@apiwarun
Why make it harder to convert?
Source: Monetate eCommerce Quarterly 2014
![Page 22: Ensuring Your Site is Technically Sound for Spiders and Visitors Alike By Anthony Piwarun](https://reader033.fdocuments.in/reader033/viewer/2022051609/546fae70b4af9faa0b8b4594/html5/thumbnails/22.jpg)
@apiwarun
RESPONSIVE & HYBRID CAVEATS
ü Since content & experience is altered dynamically, need to tell the G what’s going on
ü VARY: User-Agent HTTP header status does the trick
Image Credit: Google
![Page 23: Ensuring Your Site is Technically Sound for Spiders and Visitors Alike By Anthony Piwarun](https://reader033.fdocuments.in/reader033/viewer/2022051609/546fae70b4af9faa0b8b4594/html5/thumbnails/23.jpg)
@apiwarun
ADAPTIVE CAVEATS
ü Separate desktop & mobile experiences cause duplicate
content
ü Eliminate the potential by utilizing the one-two punch of
rel=canonical and rel=alternate
ü Implementation can be easy or complex.. It’s entirely
dependent on the platform
![Page 24: Ensuring Your Site is Technically Sound for Spiders and Visitors Alike By Anthony Piwarun](https://reader033.fdocuments.in/reader033/viewer/2022051609/546fae70b4af9faa0b8b4594/html5/thumbnails/24.jpg)
@apiwarun
ADAPTIVE CAVEATS (CONT.)
On the desktop page:
<link rel=“canonical” href=“http://www.DOMAIN.com/DESKTOP-VERSION-OF-PAGE.html” >
<link rel=“alternate” href=“http://m.DOMAIN.com/MOBILE-VERSION-OF-PAGE.html” >
On the mobile page:
<link rel=“canonical” href=“http://www.DOMAIN.com/DESKTOP-VERSION-OF-PAGE.html” >
![Page 25: Ensuring Your Site is Technically Sound for Spiders and Visitors Alike By Anthony Piwarun](https://reader033.fdocuments.in/reader033/viewer/2022051609/546fae70b4af9faa0b8b4594/html5/thumbnails/25.jpg)
@apiwarun
REDIRECTS
A Tale of Two Hosts…
![Page 26: Ensuring Your Site is Technically Sound for Spiders and Visitors Alike By Anthony Piwarun](https://reader033.fdocuments.in/reader033/viewer/2022051609/546fae70b4af9faa0b8b4594/html5/thumbnails/26.jpg)
@apiwarun
LINUX - APACHE
ü 301 redirects and RewriteRules handled in one of two (sometimes
three) files:
ü HTACCESS – file used for one-off redirects if a URL changes, product is
discontinued, etc.
ü HTTPD.conf – file used to batch process rewrite rules and redirects.
ü Use HTTPD.conf for massive quantities of redirects / rules to
prevent hit on server performance
![Page 27: Ensuring Your Site is Technically Sound for Spiders and Visitors Alike By Anthony Piwarun](https://reader033.fdocuments.in/reader033/viewer/2022051609/546fae70b4af9faa0b8b4594/html5/thumbnails/27.jpg)
@apiwarun
MICROSOFT - IIS
ü Two methods to 301 URLs:
ü Redirects – one-to-one mapping in web.config or IIS manager
implementing client-side 301s
ü Rewrites – server side configuration utilizing regular expressions and
patterns
ü Rewrite rules are ideal as they are server-level and can cast a wider
net using regular expressions… plus, there’s a lot less manual work ;)
![Page 28: Ensuring Your Site is Technically Sound for Spiders and Visitors Alike By Anthony Piwarun](https://reader033.fdocuments.in/reader033/viewer/2022051609/546fae70b4af9faa0b8b4594/html5/thumbnails/28.jpg)
@apiwarun
REDIRECT CAVEATS
ü Everyone knows the difference between 301’s, 302’s, 307’s etc…
BUT… redirect chains?
ü Redirect chains occur due to rewrite rules implemented server
side that execute in order
ü So… a non-www to www, force lower case, force trailing slash
and remove file extension could potentially amount to FOUR
redirects!
![Page 29: Ensuring Your Site is Technically Sound for Spiders and Visitors Alike By Anthony Piwarun](https://reader033.fdocuments.in/reader033/viewer/2022051609/546fae70b4af9faa0b8b4594/html5/thumbnails/29.jpg)
@apiwarun
REDIRECT SOLUTIONS
ü First we need to identify chains… use one-off tools like
WhereGoes.com or a crawler like Screaming Frog to follow
redirects
ü After they’re identified, regex wizardry must ensue to stop
execution of rewrite rules in IIS and Apache if matches are found
ü After the call is stopped, combine rules into one to remove chains
![Page 30: Ensuring Your Site is Technically Sound for Spiders and Visitors Alike By Anthony Piwarun](https://reader033.fdocuments.in/reader033/viewer/2022051609/546fae70b4af9faa0b8b4594/html5/thumbnails/30.jpg)
@apiwarun
CANONICAL VS. NEXT/PREV
Let’s Do This…
![Page 31: Ensuring Your Site is Technically Sound for Spiders and Visitors Alike By Anthony Piwarun](https://reader033.fdocuments.in/reader033/viewer/2022051609/546fae70b4af9faa0b8b4594/html5/thumbnails/31.jpg)
@apiwarun
REL=CANONICAL VS. NEXT/PREV… FIGHT!
ü Rel = canonical should be the standard for
eCommerce websites
ü This is in stark contrast with Google’s suggestions
ü Let’s think logically, however…
![Page 32: Ensuring Your Site is Technically Sound for Spiders and Visitors Alike By Anthony Piwarun](https://reader033.fdocuments.in/reader033/viewer/2022051609/546fae70b4af9faa0b8b4594/html5/thumbnails/32.jpg)
@apiwarun
REL=CANONICAL VS. NEXT/PREV… FIGHT!
ü Rel=Canonical is simply a recommendation
ü Yet, it’s critical for eCommerce sites with faceted
navigation / filterable attributes
ü Too many sites take “recommendations” on setting
canonical to ViewAll state
ü What suffers? Page load speed = user experience.
![Page 33: Ensuring Your Site is Technically Sound for Spiders and Visitors Alike By Anthony Piwarun](https://reader033.fdocuments.in/reader033/viewer/2022051609/546fae70b4af9faa0b8b4594/html5/thumbnails/33.jpg)
@apiwarun
SPEAKING OF CANONICAL…
Cross-Domain Canonicalization FTW!
![Page 34: Ensuring Your Site is Technically Sound for Spiders and Visitors Alike By Anthony Piwarun](https://reader033.fdocuments.in/reader033/viewer/2022051609/546fae70b4af9faa0b8b4594/html5/thumbnails/34.jpg)
@apiwarun
CROSS-DOMAIN CANONICALIZATION
ü Cross domain canonicalization is like the standard
rel=canonical tag, but points to a page on another domain
ü Markup is structured as so:
ü Main Site: <link rel="canonical" href="http://www.DOMAIN1.com/page-1" />
ü Duplicate Site: <link rel="canonical" href="http://www.DOMAIN1.com/page-1" />
![Page 35: Ensuring Your Site is Technically Sound for Spiders and Visitors Alike By Anthony Piwarun](https://reader033.fdocuments.in/reader033/viewer/2022051609/546fae70b4af9faa0b8b4594/html5/thumbnails/35.jpg)
@apiwarun
ECOMMERCE USE CASES
ü Brands / Distributors that have either a B2B & B2C site with the
same catalog or a separate content site with duplicate
articles on the store’s blog… that’s duplicate content, right?
ü Identify which category/subcategory/product is most relevant
to audience of each site and implement accordingly
![Page 36: Ensuring Your Site is Technically Sound for Spiders and Visitors Alike By Anthony Piwarun](https://reader033.fdocuments.in/reader033/viewer/2022051609/546fae70b4af9faa0b8b4594/html5/thumbnails/36.jpg)
@apiwarun
CONTENT USE CASES
ü Hosted Content
ü Let’s say you’re hosting content on a site like WP.com or Tumblr and you decide to self-
host
ü If you don’t have access to the server, you can’t 301
ü Cross-domain canonicalization will help send those soft 301 signals to Google
ü Original Content
ü Say, for example, you write a post and publish it on your corporate blog or a news site.
If you own a personal blog, you want to publish your work without rewriting, right?
ü Cross-domain canonical can help YOU get the message out without duplicating
content and impacting potential traffic for the original site
![Page 37: Ensuring Your Site is Technically Sound for Spiders and Visitors Alike By Anthony Piwarun](https://reader033.fdocuments.in/reader033/viewer/2022051609/546fae70b4af9faa0b8b4594/html5/thumbnails/37.jpg)
@apiwarun
HREFLANG
Saving The Best For Last!
![Page 38: Ensuring Your Site is Technically Sound for Spiders and Visitors Alike By Anthony Piwarun](https://reader033.fdocuments.in/reader033/viewer/2022051609/546fae70b4af9faa0b8b4594/html5/thumbnails/38.jpg)
@apiwarun
HREFLANG IN A NUTSHELL
ü International / global websites often struggle with with
duplicate content post-translation. Even if it’s in another
language, it could still potentially be viewed as duplicate
ü At a high-level, it tells search engines “Hey, the canonical tag says
THIS PAGE is relevant, however, there are other versions that are
language-specific so please don’t discard those.”
![Page 39: Ensuring Your Site is Technically Sound for Spiders and Visitors Alike By Anthony Piwarun](https://reader033.fdocuments.in/reader033/viewer/2022051609/546fae70b4af9faa0b8b4594/html5/thumbnails/39.jpg)
@apiwarun
Note: rel=alternate and ISO language call need to be ON EVERY SINGLE PAGE of EVERY SINGLE POSSIBLE language option. Canonical tag should
accurately self-refer.
IMPLEMENTATION
![Page 40: Ensuring Your Site is Technically Sound for Spiders and Visitors Alike By Anthony Piwarun](https://reader033.fdocuments.in/reader033/viewer/2022051609/546fae70b4af9faa0b8b4594/html5/thumbnails/40.jpg)
@apiwarun
MISC. TIPS & NOTES
ü HREFLang will NOT geotarget. That’s what GWT is for. This will
only handle duplicate content issues with localization
ü If you have a language selector page, you can assign
hreflang=“x-default”, meaning there’s no specific language
and to consider it the default
ü Track international indexation / implementation success in
GWT -> Search Traffic -> International Targeting report
![Page 41: Ensuring Your Site is Technically Sound for Spiders and Visitors Alike By Anthony Piwarun](https://reader033.fdocuments.in/reader033/viewer/2022051609/546fae70b4af9faa0b8b4594/html5/thumbnails/41.jpg)
@apiwarun
PUBLIC SERVICE ANNOUNCEMENT
Concluding Thoughts…
![Page 42: Ensuring Your Site is Technically Sound for Spiders and Visitors Alike By Anthony Piwarun](https://reader033.fdocuments.in/reader033/viewer/2022051609/546fae70b4af9faa0b8b4594/html5/thumbnails/42.jpg)
@apiwarun
C O N Q U E R I N G T O D A Y ’ S S E O
Ensuring your site is technically sound for spiders and visitors alike.
ANTHONY PIWARUN @apiwarun
Manager, Search Engine Marketing Zeon Solutions
C H A L L E N G E S
Slides: mesr.me/SMXEast14