Elasticsearch in Zalando
-
Upload
alae-samer -
Category
Documents
-
view
218 -
download
3
Transcript of Elasticsearch in Zalando
![Page 1: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/1.jpg)
Elasticsearch MeetupAlaa [email protected]
![Page 2: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/2.jpg)
A
C P
![Page 3: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/3.jpg)
REST
Distributed
Scalable
Queryable
![Page 4: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/4.jpg)
Search Engine
![Page 5: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/5.jpg)
![Page 6: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/6.jpg)
Red basketball tshirt...
![Page 7: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/7.jpg)
SearchEngine
Red basketball tshirt...
![Page 8: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/8.jpg)
SearchEngine
Red basketball tshirt...
![Page 9: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/9.jpg)
SearchEngine
Red basketball tshirt...
![Page 10: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/10.jpg)
SearchEngine
Red basketball tshirt...
![Page 11: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/11.jpg)
SearchEngine
Red basketball tshirt...
![Page 12: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/12.jpg)
SearchEngine
Red basketball tshirt...
![Page 13: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/13.jpg)
SearchEngine
![Page 14: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/14.jpg)
SearchEngine
![Page 15: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/15.jpg)
SearchEngine
![Page 16: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/16.jpg)
SearchEngine
![Page 17: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/17.jpg)
SearchEngine
![Page 18: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/18.jpg)
SearchEngine
![Page 19: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/19.jpg)
![Page 20: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/20.jpg)
![Page 21: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/21.jpg)
SearchEngine
Red basketball tshirt...
![Page 22: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/22.jpg)
SearchEngine
Red basketball tshirt...
![Page 23: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/23.jpg)
![Page 24: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/24.jpg)
Feature Extraction
![Page 25: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/25.jpg)
Extracting features
It’s all about…….. TOKENS
This parka is crafted from sturdy cotton in classic army green and comes with a removable wool gilet that we've printed in leopard and can be worn inside or as an outer. The parka features all the essentials: a quilted hood, a drawstring waist, a fishtail, and utilitarian pockets. Detailed with silky padded sleeves for extra warmth and superb comfort.
?
![Page 26: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/26.jpg)
Char Filters Tokenizer Token
Filters
Analyzer
![Page 27: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/27.jpg)
Char Filters Tokenizer Token
Filters
Analyzer
& => and, ph => f
Mapping char filter
![Page 28: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/28.jpg)
Char Filters Tokenizer Token
Filters
Analyzer
<b> Elasticsearch </b> -> Elasticsearch
HTML strip filter
![Page 29: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/29.jpg)
Char Filters Tokenizer Token
Filters
Analyzer
Elasticsearch is an awesome technology
White space tokenizer
![Page 30: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/30.jpg)
Char Filters Tokenizer Token
Filters
Analyzer
“Foo”, “bar”, “baz”
Pattern Tokenizer
[^\\w]+foo,bar baz
![Page 31: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/31.jpg)
Char Filters Tokenizer Token
Filters
Analyzer
Stemmer Token Filter
Playing, Played, Player => play
![Page 32: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/32.jpg)
Char Filters Tokenizer Token
Filters
Analyzer
Shingle Token Filter
"please divide", "divide this", "this sentence", "sentence into", "into shingles"
Please divide this sentence into shingles
![Page 33: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/33.jpg)
Char Filters Tokenizer Token
Filters
Analyzer
Stop Token Filter
a, about, above, after, again, against, all, am, an, and, any, are, aren't, as, at, be
![Page 34: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/34.jpg)
Char Filters Tokenizer Token
Filters
Analyzer
Synonyms Token Filter
- america, usa- british, english- blue, duke blue, jade blue - cuisine, food
![Page 35: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/35.jpg)
Char Filters Tokenizer Token
Filters
Analyzer
![Page 36: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/36.jpg)
<p> in the U.S.A. anyone can become president. that’s the problem </p>
Char Filters Tokenizer
Analyzer
HTML strip filter White space Stop
Stemmer
Synonyms
Token Filters
![Page 37: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/37.jpg)
![Page 38: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/38.jpg)
Char Filters Tokenizer Token
Filters
Analyzer
{ “america” “anyone” “become” “president” “problem” }
<p> in the U.S.A. anyone can become president. that’s the problem </p>
![Page 39: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/39.jpg)
Extracting features
It’s all about…….. TOKENS
fishtail, utilitarian pocketsparka, military, army green, army, green, wool, hoodie, silky sleeves, 100% cotton, winter, leopard, jacket, coat, winter, coat, tiger, warm, casual, hiking, …
This parka is crafted from sturdy cotton in classic army green and comes with a removable wool gilet that we've printed in leopard and can be worn inside or as an outer. The parka features all the essentials: a quilted hood, a drawstring waist, a fishtail, and utilitarian pockets. Detailed with silky padded sleeves for extra warmth and superb comfort.
![Page 40: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/40.jpg)
Design for user expectations
Acronyms: “I.B.M” , “Wi-Fi”, “U.S.A” , “IT” , “AFAIK” , “LOL”
Telephone Numbers: (+49) 152-02434977, (0049)15202434977, 015202434977
Names: “John Smith”, “John A. Smith”, “John Adam Smith”, “John S.”
1(800)867-5209
![Page 41: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/41.jpg)
Tailored analysis per field
![Page 42: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/42.jpg)
The Art of Ranking
![Page 43: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/43.jpg)
Ranking
● Filtering
● Boosting
● Scoring
![Page 44: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/44.jpg)
Ranking
User Query
white sneakers
Color Category
![Page 45: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/45.jpg)
Ranking
User Query
Color Category Recency Availability Location Business Value
![Page 46: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/46.jpg)
Ranking
User Query
Color Category Recency Availability Location Business Value
![Page 47: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/47.jpg)
Ranking
User Query
Color Category Recency Availability Location Business Value
![Page 48: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/48.jpg)
Ranking
Boosting Boosting Score Func. Filtering Score Func.Filtering
User Query
Boosting Boosting Score Func. Filtering Score Func.Filtering
Color Category Recency Availability Location Business Value
![Page 49: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/49.jpg)
Ranking
Color Category Recency Availability Location Business Value
Boosting Boosting Score Func. Filtering Score Func.Filtering
User Query
![Page 50: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/50.jpg)
Boosting
Base score
Base Score
Total score = Base score + Additive Score Total score = Base score X Multiplicative Score
Adding Scores Multiplying Scores
![Page 51: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/51.jpg)
Scoring in Elasticsearch
Function Score Query
● weight● field_value_factor● random_score● Decay functions● script_score
![Page 52: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/52.jpg)
SearchEngine
Data ingestion & enrichment
Data retrieval & ranking
![Page 53: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/53.jpg)
![Page 54: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/54.jpg)
Elasticsearch in Zalando
![Page 55: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/55.jpg)
Shop The Look
![Page 56: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/56.jpg)
Shop The Look
![Page 57: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/57.jpg)
Product Service
● Fetch articles by sku
● Fetch articles by urlkey
● Fetch articles by family_sku
![Page 58: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/58.jpg)
Key-Value Store ?
![Page 59: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/59.jpg)
Catalog use-case
example:100 Articles X
![Page 60: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/60.jpg)
Catalog use-case
example:100 Articles X 5 Colors
![Page 61: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/61.jpg)
Catalog use-case
example:100 Articles X 5 Colors X 1000 RPS
![Page 62: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/62.jpg)
Catalog use-case
example:100 Articles X 5 Colors X 1000 RPS = 500,000 RPS
![Page 63: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/63.jpg)
Catalog use-case
Key-Value Store
example:100 Articles X 5 Colors X 1000 RPS = 500,000 RPS
![Page 64: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/64.jpg)
Product Service
![Page 65: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/65.jpg)
Auto Scaling
shards_per_node: 3
![Page 66: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/66.jpg)
Auto Scaling
shards_per_node: 1
![Page 67: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/67.jpg)
The New PDP
Reviews Shop The LookProducts
![Page 68: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/68.jpg)
Elasticsearch Express
● Easy deployment across multiple AZs
● Start serving data in less than 10 minutes
● Full data availability guarantee on each AZ
● Role separation of nodes
● Stable master election
● No manual configuration on AWS
● Automatic data backups in S3 bucket
● ES Monitoring dashboard template
![Page 69: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/69.jpg)
![Page 70: Elasticsearch in Zalando](https://reader034.fdocuments.in/reader034/viewer/2022042506/5877cb821a28ab39588b6b27/html5/thumbnails/70.jpg)
www.search-relevancy-workshop.com
A hands-on workshop for building killer search applications with Elasticsearch.
?