Getting Better Data from Internal Search - Pubcon 2014

36
GETTING BETTER INFORMATION FROM INTERNAL SEARCH HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN Presenter: JP Sherman Title: Search & Findability Manager Follow me: @jpsherman

description

Internal search is one of the best ways to get information on user intent. However, it's under-utilized and often ignored. Here's the basics you need to maximize your internal search efforts.

Transcript of Getting Better Data from Internal Search - Pubcon 2014

Page 1: Getting Better Data from Internal Search - Pubcon 2014

GETTING BETTER INFORMATION

FROM INTERNAL SEARCH

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

Presenter: JP Sherman

Title: Search & Findability Manager

Follow me: @jpsherman

Page 2: Getting Better Data from Internal Search - Pubcon 2014

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

Search is a Journey that Starts Internally

When Successful, It Ends With the

Searcher Having More Than They

Started With

Page 3: Getting Better Data from Internal Search - Pubcon 2014

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

1: http://bit.ly/1swVhSM

Statistics on Internal SearchUp to 30 % of visitors use internal search ¹

For information & knowledge based sites,

that percent can be significantly higher.

Page 4: Getting Better Data from Internal Search - Pubcon 2014

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

Customers who make an internal search are 5x to 6x more

likely to convert

When compared to customers who make no search.

Statistics on Internal Search

Page 5: Getting Better Data from Internal Search - Pubcon 2014

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

Statistics on Internal Search

Only 15% of Companies Have Dedicated

Resources to Improve Internal Search

Page 6: Getting Better Data from Internal Search - Pubcon 2014

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

Search Behavior is the Foundation

Page 7: Getting Better Data from Internal Search - Pubcon 2014

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

Search Behavior Is Always On

Active Search Passive Search

Page 8: Getting Better Data from Internal Search - Pubcon 2014

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

Understanding Search Behavior

Search Initiates With Desire

Page 9: Getting Better Data from Internal Search - Pubcon 2014

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

Understanding Search Behavior

From Desire, Search expresses itself as a query

Page 10: Getting Better Data from Internal Search - Pubcon 2014

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

Understanding Search Behavior

Desire Creates Expectation

Expectation Creates Criteria for Acceptance

Page 11: Getting Better Data from Internal Search - Pubcon 2014

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

Understanding Search Behavior

People simultaneously process acceptance and rejection criteria.

For every single result on the SERP

Page 12: Getting Better Data from Internal Search - Pubcon 2014

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

Understanding Search Behavior

Each Result is Measured Against These Search Criteria

Page 13: Getting Better Data from Internal Search - Pubcon 2014

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

Understanding Search Behavior

The Searcher Accepts or Rejects Results

Based on Internal Criteria, Influenced by Results of that Search

Page 14: Getting Better Data from Internal Search - Pubcon 2014

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

Measuring Search Behavior

Measurement Leads to Understanding

Understanding Leads to Control

Control Leads to Improvement

- H. James Harrington (paraphrased)

Page 15: Getting Better Data from Internal Search - Pubcon 2014

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

Measuring Search Behavior

Search behavior serves as context for search as measurable actions

Page 16: Getting Better Data from Internal Search - Pubcon 2014

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

Measuring Search Behavior

Measuring Search Behavior Falls Under 3 Categories

Query

Acceptance

Rejection

Page 17: Getting Better Data from Internal Search - Pubcon 2014

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

Understanding Search BehaviorAcceptance

Identify the Conditions that Trigger Acceptance, Usually Measured

by a Click

Page 18: Getting Better Data from Internal Search - Pubcon 2014

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

Understanding Search BehaviorRejection

Identify the Conditions that Result in a Non-Click.

Page 19: Getting Better Data from Internal Search - Pubcon 2014

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

Understanding Search BehaviorTermination

The Searcher Accepts or Rejects the Results.

This Behavior is Based on the Internal Criteria, Influenced by the

Results of that Search

Page 20: Getting Better Data from Internal Search - Pubcon 2014

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

Measuring Search BehaviorQuestions to Avoid Data Overload

What are the top things people are looking for?

Priorities:

Balance out popularity with depth of content with conversions obtained

Page 21: Getting Better Data from Internal Search - Pubcon 2014

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

Measuring Search BehaviorQuestions to Avoid Data Overload

Which keywords and content drive the most engagement?

Priorities:

Define engagement to support key objectives

Page 22: Getting Better Data from Internal Search - Pubcon 2014

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

Measuring Search BehaviorQuestions to Avoid Data Overload

What are your top converting keywords and content?

Priorities:

Use this set as your control group for experimentation

Page 23: Getting Better Data from Internal Search - Pubcon 2014

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

An Analytics Recipe to Measure Search Effectiveness

Keyword

Any keyword refinements

Rank of content that was clicked

Destination page of search result

Activity post-search, ie: conversion or consumption

Time query occurred

Time spent on destination content page

Measuring Search Behavior

Most Enterprise CMS & Analytics Packages Give You This Data, it Just Needs

to be Configured.

Page 24: Getting Better Data from Internal Search - Pubcon 2014

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

When Measured, Search Failure is

Awesome

Page 25: Getting Better Data from Internal Search - Pubcon 2014

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

Measuring Search Failure

Which queries result in no clicks?

Priorities:

This is the beginning of improving UI/ UX and Metadata

Page 26: Getting Better Data from Internal Search - Pubcon 2014

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

Measuring Search Failure

Which queries result in no results?

Priorities:

These are queries that return no or few results. This is the

beginning of a content gap analysis

Page 27: Getting Better Data from Internal Search - Pubcon 2014

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

Measuring Search FailureProTip

Measuring Just the Click is 10% of the Story

Page 28: Getting Better Data from Internal Search - Pubcon 2014

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

Measuring Search Failure

There are 9 Other Results

There are 9 Other Results Other than the One Clicked

Page 29: Getting Better Data from Internal Search - Pubcon 2014

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

Measuring Search Failure

Consider the “Non-Clicked” Results as Impressions

Find the content that generates impressions but few clicks

Page 30: Getting Better Data from Internal Search - Pubcon 2014

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

Improving Search

Improving Resolution & Detail

Page 31: Getting Better Data from Internal Search - Pubcon 2014

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

Making Search Better

Master the Basics of Measuring Search

1. Practical Exercises

o Use Popular Search Terms for Featuring

o Hyper Localize Your Internal Search

o Discover Content Gaps from Failed Search

Improving Resolution: 8 Bit

Page 32: Getting Better Data from Internal Search - Pubcon 2014

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

Making Search Better

Intermediate Mastery

- Measure the Time from Query to Conversion

- Create Conversion Events for Content

- Test UI Changes in SERP (pictures, schema, fonts, colors)

Improving Resolution: 32 Bit

Page 33: Getting Better Data from Internal Search - Pubcon 2014

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

Making Search Better

Mastery as Integration

- Create Search-Oriented Microdata into Content

- Use Personalization and Other Data to Bias Results

- Integrate Search Data in CMS

Improving Resolution: 128 Bit

Page 34: Getting Better Data from Internal Search - Pubcon 2014

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

The Barriers to Entry Are MinimalUsing Data to Improve Internal Search Starts With Data You’re Most

Likely Collecting.

Visualizing Iterations as Resolution Helps

- Start With the Data You Already Collect

- Refine That Data With Greater Accuracy

- Turn Data Into Intelligence That Can Be Connected, Integrated &

Shared

Page 35: Getting Better Data from Internal Search - Pubcon 2014

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

The Power Was With You

This Whole Time

Page 36: Getting Better Data from Internal Search - Pubcon 2014

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

Thank You

Questions? Comments? Threats?

Reach out to me on Twitter, I’d be thrilled to chat more

@jpsherman