Enterprise Search Using SharePoint 2010 and FAST

37
Enterprise Search Using SharePoint 2010 and FAST Bert Johnson SharePoint Architect and 2010 MCM, West Monroe Partners

description

Slides from my "Enterprise Search Using SharePoint 2010 and FAST" session at SharePoint Summit 2011 in Toronto.

Transcript of Enterprise Search Using SharePoint 2010 and FAST

Page 1: Enterprise Search Using SharePoint 2010 and FAST

Enterprise Search Using SharePoint 2010 and FAST

Bert JohnsonSharePoint Architect and 2010 MCM, West Monroe Partners

Page 2: Enterprise Search Using SharePoint 2010 and FAST

2

Bert Johnson

SharePoint Architect with West Monroe Partners

Microsoft Certified Master – SharePoint Server 2010

Twitter: @SPBert Event Hashtag: #sps2011

Email: [email protected]

Page 3: Enterprise Search Using SharePoint 2010 and FAST

3

Agenda

The Need for Enterprise Search

Microsoft’s Enterprise Search Capabilities

Search in SharePoint 2010What’s New, What’s ImprovedDemo

FAST Search 2010Advanced ScenariosDemo

Q&A

Page 4: Enterprise Search Using SharePoint 2010 and FAST

4

The Need for

Enterprise Search

Page 5: Enterprise Search Using SharePoint 2010 and FAST

5

Enterprise Challenges…

More data in more placesFind data spread across multiple systemsScale to support large index and query volumes

Different types of dataIncorporate different types of resultsFind employee expertise

A need to act quicklyEnable fast decisions through filteringAdapt based on user behavior

Ensure results are secure and manageableAutomatic security trimmingCentralized analytics

Search Solutions

Page 6: Enterprise Search Using SharePoint 2010 and FAST

6

Microsoft’s Search Capabilities

Page 7: Enterprise Search Using SharePoint 2010 and FAST

7

Microsoft’s Search Capabilities

Search is one of Microsoft’s top priorities, permeating every product line

SharePoint, FAST, and Bing are the cornerstones of a ten year R&D roadmap focused on search innovation

2010’s R&D budget for search is over $2.67 billion

Microsoft has recently made several large search acquisitions, including:

Page 8: Enterprise Search Using SharePoint 2010 and FAST

8

Microsoft’s Search Capabilities

FAST Search solves the toughest challenges…

The #1 electronics retailer

The source for all government publications

The #1 computer retailer

The #1 fashion retailer

The #1 career site

Page 9: Enterprise Search Using SharePoint 2010 and FAST

9

Microsoft’s Search Capabilities

Thanks to its new capabilities,Microsoft is now recognizedas the leader in Gartner’sInformation AccessTechnology quadrant.

Forrester’s 2010 Reporton Search says:“SharePoint gives users theability to find the content,information, and people theyneed by combining anintegrated, easy-to-manageplatform with best-of-breedenterprise search technology.”

Page 10: Enterprise Search Using SharePoint 2010 and FAST

10

What’s New for

Search in SharePoint 2010

Page 11: Enterprise Search Using SharePoint 2010 and FAST

11

What’s New for Search in SharePoint 2010

• Taxonomy• Metadata can now be managed

centrally in a reusable term store• Enables hierarchy of structured terms• Ensures more consistent data labels• Can be reused across sites and farms

• Folksonomy• Tagging allows users to find content

using consistent, familiar terms• Ratings make finding quality easier

Page 12: Enterprise Search Using SharePoint 2010 and FAST

12

What’s New for Search in SharePoint 2010

• Filter-Based Navigation

• Navigators• Allow easy filtering within results• Automatically generated based

on context

• Document Library Filters• Filter results directly from within

document libraries• Drill into content based on tags

or taxonomy

Page 13: Enterprise Search Using SharePoint 2010 and FAST

13

What’s New for Search in SharePoint 2010

• Social Search Enhancements• People Search

• Incorporates people’s interests, expertise, and recent activity• Outlook Social Connector automatically discovers relationships

• “Self Search”• Returns information about the current user

• User Behavior• Click popularity influences the ranking of search results• Suggestions driven by past searches and taxonomy• Ranking driven by:

• Content ratings• Social tagging• Query suggestions• Popularity of click-through

Page 14: Enterprise Search Using SharePoint 2010 and FAST

14

What’s New for Search in SharePoint 2010

Supports phonetic name lookup and

Wildcards

Organization browsing

Recentcontent

Filter by focus, expertise, etc

Page 15: Enterprise Search Using SharePoint 2010 and FAST

15

What’s New for Search in SharePoint 2010

• Linguistic Capabilities• Wildcard searches using a partial prefix• e.g. “Micro*” returns “Microchip”, “Microscope”, and “Microsoft”

• Correct common misspellings and recommend alternatives• Phonetic search algorithm and nickname matching• Search using booleans (AND, OR, NOT)• Support for operators on property restrictions

• e.g. “modified>10/16/2010”• Even more language packs supported

Page 16: Enterprise Search Using SharePoint 2010 and FAST

16

What’s Improved for

Search in SharePoint 2010

Page 17: Enterprise Search Using SharePoint 2010 and FAST

17

What’s Improved for Search in SP 2010

• Architectural Improvements• Crawling now distributed across

multiple load balanced servers• Index can be partitioned and

distributed across servers• New service application model can

isolate search from other services• Scale and performance improvements• Manageability through PowerShell

Page 18: Enterprise Search Using SharePoint 2010 and FAST

18

What’s Improved for Search in SP 2010

• Functional Improvements• Federation

• Additional OpenSearch providers now available• Can now be searched directly from Windows 7 or Internet Explorer

• Indexing• Now uses Business Connectivity Services• Connectors can be defined visually through SharePoint Designer• Connectors can be written in .NET

• Usage Analytics• Built-in reports show term popularity and peak times used• Custom reports can be written using the Report Definition Language

Page 19: Enterprise Search Using SharePoint 2010 and FAST

19

Bringing It All Together:

SharePoint 2010 Search Demo

Page 20: Enterprise Search Using SharePoint 2010 and FAST

20

SharePoint 2010 Search Demo

Page 21: Enterprise Search Using SharePoint 2010 and FAST

21

Advanced Scenarios with

FAST Search

Page 22: Enterprise Search Using SharePoint 2010 and FAST

22

Advanced Scenarios with FAST Search

• Contextual Audience Targeting• Search results and best bets can be targeted to specific audiences• Results can be targeted based on what group or office a user

belongs to• Results can also be targeted based on a user’s expertise or other

profile data

Page 23: Enterprise Search Using SharePoint 2010 and FAST

23

Advanced Scenarios with FAST Search

Alan Brewer, Sales

What should I know about selling ERP consulting?

Renee Lo, Engineer

What should I know about implementing ERP?

Page 24: Enterprise Search Using SharePoint 2010 and FAST

24

Advanced Scenarios with FAST Search

• Visual Cues• Visual Best Bets

• Support plug-in graphicresults, videos, orinteractive tools

• Document Previews• Allow you to easily

distinguish betweenfiles based on thumbnails

• Office Web Applications• Full document view is

only one click away

Page 25: Enterprise Search Using SharePoint 2010 and FAST

25

Advanced Scenarios with FAST Search

• Deep Refinement• Refinement panels in FAST give exact # of results• Navigators are based on all data, not just a subset• Built-in support for sorting by any property• Eliminate duplicates automatically

Page 26: Enterprise Search Using SharePoint 2010 and FAST

26

Advanced Scenarios with FAST Search

• Flexible Content Pipeline• FAST introduces a “Content Pipeline”

• Sequential stages perform specific tasks on content• Breaks down content into discrete parts• Understands file encoding, data formats, and written languages

• Custom stages can be built to enrich content• The Content Pipeline tries to infer known properties (names,

addresses, dates)• e.g. Author property of “John Doe” is automatically picked up from “By

John Doe”

Form

at

Con

vers

ion

Lan

gu

ag

eD

ete

cti

on

En

tity

Extr

acti

on

Lem

mati

zati

o n

Map

per

Page 27: Enterprise Search Using SharePoint 2010 and FAST

27

Advanced Scenarios with FAST Search

• Durability and Immense Scale• Deployments can scale as large as needed in query and index

dimensions• All node types can be configured with failovers• Natively understands over 400 document types and 85 languages• Performance targets

• 30 million documents / node• 50 queries / sec / node• 35 documents indexed / sec / node

Page 28: Enterprise Search Using SharePoint 2010 and FAST

28

Advanced Scenarios with FAST Search

Content Volume

Query Volume

Scale-out Multiple “Dimensions”

Content VolumeQuery VolumeIndexing Freshness

Redundancy Options

SearchIndexing

Performance Targets*

15M Docs/column30 QPS/row

Search and Indexing

Crawling and Content Processing

Query and Result Processing

Page 29: Enterprise Search Using SharePoint 2010 and FAST

29

FAST Search Demo

Page 31: Enterprise Search Using SharePoint 2010 and FAST

31

Questions?

Page 32: Enterprise Search Using SharePoint 2010 and FAST

32

Bert Johnson

SharePoint Architect with West Monroe Partners

Microsoft Certified Master – SharePoint Server 2010

Twitter: @SPBert Event Hashtag: #sps2011

Email: [email protected]

Page 33: Enterprise Search Using SharePoint 2010 and FAST

33

Where else can you find WMP at the summit?

Records Management Capabilities in SharePoint 2010

Coskun Cavusoglu

3:00 – 4:15

How We Did It/Case Study: A SharePoint 2007 extranet solution provides valuable new capabilities and helps transform members' online experience.

Kyle Snyder

Wed: 11:30 – 12:45

Page 34: Enterprise Search Using SharePoint 2010 and FAST

34

Appendices

Page 35: Enterprise Search Using SharePoint 2010 and FAST

35

Microsoft Search Solutions Compared

Feature SharePoint Foundation 2010

Search Server 2010 Express

Search Server 2010

SharePoint Server 2010

FAST Search Server 2010 for SharePoint

Basic search ü ü ü ü ü

Visual Best Bets   Limited Limited Limited ü

Scopes   ü ü ü ü

Search enhancements based on user context

        ü

Custom properties   ü ü ü ü

Property extraction   Limited Limited Limited ü

Query federation   ü ü ü ü

Query suggestions   ü ü ü ü

Similar results         ü

Sort results on managed properties or rank profiles

        ü

Page 36: Enterprise Search Using SharePoint 2010 and FAST

36

Microsoft Search Solutions Compared

Feature SharePoint Foundation 2010

Search Server 2010 Express

Search Server 2010

SharePoint Server 2010

FAST Search Server 2010 for SharePoint

Relevancy tuning by document or site promotions

  Limited Limited Limited ü

Shallow results refinement   ü ü ü ü

Deep results refinement         ü

Document preview and thumbnails

        ü

Windows 7 federation   ü ü ü ü

People search       ü ü

Social search       ü ü

Taxonomy integration       ü ü

Multi-tenant hosting       ü  

Rich Web indexing support         ü

Page 37: Enterprise Search Using SharePoint 2010 and FAST

37

Enterprise Search Using SharePoint 2010 and FAST