Power of Elastic Search - nLocate

13
nLocate.c om power of Elastic Search Aayush Shrestha nLocate.com | Locate things nearby @AayushShrestha [email protected]

Transcript of Power of Elastic Search - nLocate

Page 1: Power of Elastic Search - nLocate

nLocate.com

power ofElastic SearchAayush ShresthanLocate.com | Locate things nearby

@[email protected]

Page 2: Power of Elastic Search - nLocate

nLocate.com

n is for new● Rethinking the Local Search● Vendors . Products . Services .

Consumers● Aggregation of data . Structured

Content.● Open Platform (eventually)● Not a Google Maps/ Google Local

alternative

Page 3: Power of Elastic Search - nLocate

nLocate.com

Our stackWeb Client(AngularJS)

Mobile Client

(HTML5)

Third Party Developers

API Server(nginx > gunicorn > Django)

Spots(ElasticSearch)

Analytics(ElasticSearch)

Business Portal(Django, PgSQL)

Admin Portal(Django, Scrapy)

● Proxy Server (nginx)● App. Server (gunicorn)● App. Framework (Django)● Parsing (PyParsing)● Client Framework

(AngularJS)● Front-end Framework (Ionic)● Messaging (ZeroMQ)● Web Crawler (Scrapy)● RDBMS (PgSQL)● Document Database

(ElasticSearch)● Visualization (HighCharts)

Page 4: Power of Elastic Search - nLocate

nLocate.com

what is Elastic Search?An enterprise level search server

Page 5: Power of Elastic Search - nLocate

nLocate.com

what is Elastic Search?uses Lucene under the hood

Page 6: Power of Elastic Search - nLocate

nLocate.com

The Good things● Distributed FULLTEXT Search Engine● SCHEMALESS● RESTful API == ‘awesomeness’● Uses JSON not XML● Cross-platform (built on Java)● near RealTime Search

Page 7: Power of Elastic Search - nLocate

nLocate.com

The Good things(one page was not enough)

● Query DSL● Distributed. Meant to be highly

available● Load Balancing● Free and Open Source

Page 8: Power of Elastic Search - nLocate

nLocate.com

Elasticsearch in nLocate.com● Stores our spots and addon data

○ Scalable Data storage and retrieval○ ranking algorithm○ Customizable and vertical specific

structured data

Page 9: Power of Elastic Search - nLocate

nLocate.com

Elasticsearch in nLocate.com● Logs EVERYTHING

○ Usage Monitoring○ KPI Monitoring○ Ad-hoc Data Integration

Page 10: Power of Elastic Search - nLocate

nLocate.com

Elasticsearch in nLocate.com● Listing a.k.a. Ranking

○ Name (shingle, exact term, gram)○ Addon (exact term, gram)○ Headline○ Address and Description○ Distance (Linear Decay)

Page 11: Power of Elastic Search - nLocate

nLocate.com

.. and beyond nLocate.com● Measure our KPIs

○ No of unique users and Total Searches

● Measuring our performance● Source of Traffic● User behavior

Page 12: Power of Elastic Search - nLocate

nLocate.com

ElasticSearch superpowers● ES Aggregation Queries● Output to Information (highcharts for

visualization)● Gave some steroids to ES Query DSL

Page 13: Power of Elastic Search - nLocate

nLocate.com

That’s all folks!Aayush Shrestha

@AayushShresthafb.me/[email protected]