Getting Better Data from Internal Search - Pubcon 2014

Post on 03-Jul-2015

74 views 1 download

description

Internal search is one of the best ways to get information on user intent. However, it's under-utilized and often ignored. Here's the basics you need to maximize your internal search efforts.

Transcript of Getting Better Data from Internal Search - Pubcon 2014

GETTING BETTER INFORMATION

FROM INTERNAL SEARCH

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

Presenter: JP Sherman

Title: Search & Findability Manager

Follow me: @jpsherman

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

Search is a Journey that Starts Internally

When Successful, It Ends With the

Searcher Having More Than They

Started With

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

1: http://bit.ly/1swVhSM

Statistics on Internal SearchUp to 30 % of visitors use internal search ¹

For information & knowledge based sites,

that percent can be significantly higher.

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

Customers who make an internal search are 5x to 6x more

likely to convert

When compared to customers who make no search.

Statistics on Internal Search

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

Statistics on Internal Search

Only 15% of Companies Have Dedicated

Resources to Improve Internal Search

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

Search Behavior is the Foundation

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

Search Behavior Is Always On

Active Search Passive Search

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

Understanding Search Behavior

Search Initiates With Desire

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

Understanding Search Behavior

From Desire, Search expresses itself as a query

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

Understanding Search Behavior

Desire Creates Expectation

Expectation Creates Criteria for Acceptance

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

Understanding Search Behavior

People simultaneously process acceptance and rejection criteria.

For every single result on the SERP

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

Understanding Search Behavior

Each Result is Measured Against These Search Criteria

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

Understanding Search Behavior

The Searcher Accepts or Rejects Results

Based on Internal Criteria, Influenced by Results of that Search

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

Measuring Search Behavior

Measurement Leads to Understanding

Understanding Leads to Control

Control Leads to Improvement

- H. James Harrington (paraphrased)

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

Measuring Search Behavior

Search behavior serves as context for search as measurable actions

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

Measuring Search Behavior

Measuring Search Behavior Falls Under 3 Categories

Query

Acceptance

Rejection

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

Understanding Search BehaviorAcceptance

Identify the Conditions that Trigger Acceptance, Usually Measured

by a Click

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

Understanding Search BehaviorRejection

Identify the Conditions that Result in a Non-Click.

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

Understanding Search BehaviorTermination

The Searcher Accepts or Rejects the Results.

This Behavior is Based on the Internal Criteria, Influenced by the

Results of that Search

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

Measuring Search BehaviorQuestions to Avoid Data Overload

What are the top things people are looking for?

Priorities:

Balance out popularity with depth of content with conversions obtained

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

Measuring Search BehaviorQuestions to Avoid Data Overload

Which keywords and content drive the most engagement?

Priorities:

Define engagement to support key objectives

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

Measuring Search BehaviorQuestions to Avoid Data Overload

What are your top converting keywords and content?

Priorities:

Use this set as your control group for experimentation

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

An Analytics Recipe to Measure Search Effectiveness

Keyword

Any keyword refinements

Rank of content that was clicked

Destination page of search result

Activity post-search, ie: conversion or consumption

Time query occurred

Time spent on destination content page

Measuring Search Behavior

Most Enterprise CMS & Analytics Packages Give You This Data, it Just Needs

to be Configured.

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

When Measured, Search Failure is

Awesome

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

Measuring Search Failure

Which queries result in no clicks?

Priorities:

This is the beginning of improving UI/ UX and Metadata

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

Measuring Search Failure

Which queries result in no results?

Priorities:

These are queries that return no or few results. This is the

beginning of a content gap analysis

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

Measuring Search FailureProTip

Measuring Just the Click is 10% of the Story

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

Measuring Search Failure

There are 9 Other Results

There are 9 Other Results Other than the One Clicked

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

Measuring Search Failure

Consider the “Non-Clicked” Results as Impressions

Find the content that generates impressions but few clicks

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

Improving Search

Improving Resolution & Detail

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

Making Search Better

Master the Basics of Measuring Search

1. Practical Exercises

o Use Popular Search Terms for Featuring

o Hyper Localize Your Internal Search

o Discover Content Gaps from Failed Search

Improving Resolution: 8 Bit

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

Making Search Better

Intermediate Mastery

- Measure the Time from Query to Conversion

- Create Conversion Events for Content

- Test UI Changes in SERP (pictures, schema, fonts, colors)

Improving Resolution: 32 Bit

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

Making Search Better

Mastery as Integration

- Create Search-Oriented Microdata into Content

- Use Personalization and Other Data to Bias Results

- Integrate Search Data in CMS

Improving Resolution: 128 Bit

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

The Barriers to Entry Are MinimalUsing Data to Improve Internal Search Starts With Data You’re Most

Likely Collecting.

Visualizing Iterations as Resolution Helps

- Start With the Data You Already Collect

- Refine That Data With Greater Accuracy

- Turn Data Into Intelligence That Can Be Connected, Integrated &

Shared

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

The Power Was With You

This Whole Time

HOW TO GET MORE INFORMATION FROM INTERNAL SEARCH FOLLOW ME @JPSHERMAN

Thank You

Questions? Comments? Threats?

Reach out to me on Twitter, I’d be thrilled to chat more

@jpsherman