Start Your Search Engines: Optimizing Solr to Improve Results

25
SOLR Facts 65% of IT organizations were able to reduce the costs of developing and deploying their search application by 50% or more as a result of using SOLR Source: Survey of 26 Solr/Lucene users conducted by TechValidate 05/12/2022 © 2011 Crown Partners. All Rights Reserved. 1

description

Advanced troubleshooting and optimization techniques to improve solr search results.

Transcript of Start Your Search Engines: Optimizing Solr to Improve Results

Page 1: Start Your Search Engines: Optimizing Solr to Improve Results

SOLR Facts

65% of IT organizations were able to reduce the costs of developing and deploying their search application by 50% or more as a result of using SOLR

Source: Survey of 26 Solr/Lucene users conducted by TechValidate

04/10/2023 © 2011 Crown Partners. All Rights Reserved. 1

Page 2: Start Your Search Engines: Optimizing Solr to Improve Results

SOLR Facts

43% of IT organizations index or update 1,000,001 to 5,000,000 or more documents each week with SOLR.

Source: Survey of 26 Solr/Lucene users conducted by TechValidate

04/10/2023 © 2011 Crown Partners. All Rights Reserved. 2

43%

Page 3: Start Your Search Engines: Optimizing Solr to Improve Results

SOLR Facts

“We were able to decrease risk by allowing our catalog of 6 million- plus items and 50 million user profiles to be searched well beyond the possibilities with MySQL.”

Source: Executive, Small Business Computer Software Company

04/10/2023 © 2011 Crown Partners. All Rights Reserved. 3

Page 4: Start Your Search Engines: Optimizing Solr to Improve Results

SOLR Facts

“With SOLR’s Dis-Max query parser, we were able to drastically increase the relevance of returned search results.”

Source: IT Architect, Small Business Media & Entertainment Company

04/10/2023 © 2011 Crown Partners. All Rights Reserved. 4

Page 5: Start Your Search Engines: Optimizing Solr to Improve Results

04/10/2023 © 2011 Crown Partners. All Rights Reserved. 5

Click to edit Master title style

04/10/2023

© 2011 Crown Partners. All Rights Reserved. 5

SOLR

Presented by: Rob Miller, Jason Grim & Ryan Street08/15/2012

Optimizing SOLR to Improve Search

Page 6: Start Your Search Engines: Optimizing Solr to Improve Results

About Crown

Certified Magento Development Team

SOLR experts in Advanced Search

Integration between SOLR and Magento, ERP

04/10/2023 © 2011 Crown Partners. All Rights Reserved. 6

Page 7: Start Your Search Engines: Optimizing Solr to Improve Results

Agenda

Overview of SOLR

Basic Solr Troubleshooting

– Common SOLR Troubleshooting and Solutions

Advanced optimization of search results

– Making changes in Solr configuration to better your results.

Improving search speed

– Optimizing to improve search speed.

04/10/2023 © 2011 Crown Partners. All Rights Reserved. 7

Page 8: Start Your Search Engines: Optimizing Solr to Improve Results

04/10/2023 © 2011 Crown Partners. All Rights Reserved. 8

Page 9: Start Your Search Engines: Optimizing Solr to Improve Results

Crown’s First SOLR Webinar

Crown’s SOLR 1.0 Webinar

– Support for Spelling/Synonyms/Stop Words

– Improved Layered Navigation

– September 21, 2011

– http://bit.ly/solrmagentowebinar

04/10/2023 © 2011 Crown Partners. All Rights Reserved. 9

Page 10: Start Your Search Engines: Optimizing Solr to Improve Results

04/10/2023 © 2011 Crown Partners. All Rights Reserved. 10

Basic Troubleshooting

Page 11: Start Your Search Engines: Optimizing Solr to Improve Results

Useful SOLR Tools

Web Interface

Luke

Command Line

04/10/2023 © 2011 Crown Partners. All Rights Reserved. 11

Page 12: Start Your Search Engines: Optimizing Solr to Improve Results

Magento Cannot Connect to SOLR

Do you have the right URL and Port?

Does Your server communicate SOLR and Magento?

04/10/2023 © 2011 Crown Partners. All Rights Reserved. 12

Page 13: Start Your Search Engines: Optimizing Solr to Improve Results

Magento and Solr Show Bad or No Results

Bad Data

Change from Final to Partial Commit

Look into the command line for critical errors during index

04/10/2023 © 2011 Crown Partners. All Rights Reserved. 13

Page 14: Start Your Search Engines: Optimizing Solr to Improve Results

Where to find more answers…

Magento Forums

– http://www.magentocommerce.com/boards/

Magento Answers

– http://www.magentocommerce.com/answers/welcome

Dr. Gento

– http://www.drgento.com

And of course… Crown!

– http://www.crownpartners.com/

04/10/2023 © 2011 Crown Partners. All Rights Reserved. 14

Page 15: Start Your Search Engines: Optimizing Solr to Improve Results

04/10/2023 © 2011 Crown Partners. All Rights Reserved. 15

Advanced Optimization of Search Results

Page 16: Start Your Search Engines: Optimizing Solr to Improve Results

Configuration: Minimum Must Match

Must Match Formats

– 2

– 75%

– 2<-25%

– 2<-1 5<80%

Setting is language specific

Will NOT require Reindex (Query time parameter)

04/10/2023 © 2011 Crown Partners. All Rights Reserved. 16

Page 17: Start Your Search Engines: Optimizing Solr to Improve Results

Query Boosting Results

Boost individual product attributes

Query time configuration

Language specific

04/10/2023 © 2011 Crown Partners. All Rights Reserved. 17

Page 18: Start Your Search Engines: Optimizing Solr to Improve Results

Where to Find More Answers

Apache’s Wiki

– http://wiki.apache.org/solr/

Dr. Gento

– http://www.drgento.com

And of course… Crown!

– http://www.crownpartners.com/

04/10/2023 © 2011 Crown Partners. All Rights Reserved. 18

Page 19: Start Your Search Engines: Optimizing Solr to Improve Results

04/10/2023 © 2011 Crown Partners. All Rights Reserved. 19

Improving Search Speed

Page 20: Start Your Search Engines: Optimizing Solr to Improve Results

SOLR and Magento Relationship

04/10/2023 © 2011 Crown Partners. All Rights Reserved. 20

User submits a search query

Magento connects to SOLR and sends over query

SOLR processes query and returns Magento Product IDs

Magento loads the product IDs and displays them to the user

Page 21: Start Your Search Engines: Optimizing Solr to Improve Results

Is SOLR the Problem?

Check qtime of a query

– /select params={…} hits=79 status=0 QTime=48

Solr Performance Enhancements

– http://wiki.apache.org/solr/SolrPerformanceFactors

04/10/2023 © 2011 Crown Partners. All Rights Reserved. 21

Page 22: Start Your Search Engines: Optimizing Solr to Improve Results

MySQL Optimization

Update your version of MySQL to the latest version

Make sure your MySQL settings are tuned per Magento’s recommendations

– http://www.magentocommerce.com/whitepaper/

Using the Memory (HEAP) Storage Engine for Temp Tables

– http://dev.mysql.com/doc//refman/5.0/en/memory-storage-engine.html

Leverage MySQL query caching

04/10/2023 © 2011 Crown Partners. All Rights Reserved. 22

Page 23: Start Your Search Engines: Optimizing Solr to Improve Results

Where to Find More Answers

Magento Forums

– http://www.magentocommerce.com/boards/

Magento U Performance and Optimization for System Administrators

– http://www.magentocommerce.com/services/training

Dr. Gento

– http://www.drgento.com

And of course… Crown!

– http://www.crownpartners.com/

04/10/2023 © 2011 Crown Partners. All Rights Reserved. 23

Page 24: Start Your Search Engines: Optimizing Solr to Improve Results

Questions?

04/10/2023 © 2011 Crown Partners. All Rights Reserved. 24

Page 25: Start Your Search Engines: Optimizing Solr to Improve Results

Thank You!

Rob [email protected]

Jason [email protected]

Ryan [email protected]

04/10/2023 © 2011 Crown Partners. All Rights Reserved. 25