Search: the right tool, but what is the job. At nosqlmatters amsterdam 2013

Post on 10-May-2015

503 views 1 download

Tags:

description

This presentation is a non-technical overview of what kind of tool a search solution is. Elasticsearch is used to explain the concepts as well as provide a number of jobs that can be performed with a search solution. This presentation is given at the nosqlmatters road show conference in Amsterdam in oktober 2013

Transcript of Search: the right tool, but what is the job. At nosqlmatters amsterdam 2013

Search: the right tool ... ... but what is the job?

Jettro Coenradie jco@trifork.nl @gridshore

The right tool ...

... but what is the job?

Search

The right tool

and the job is

Two people to help me

Meet the

customer !

Marc

Meet our software developer

!

John

What is a Search Solution?

Search finding stuff=

Search Solution

Services for finding stuff

=

SELECT * FROM jobs WHERE title like ‘%elasticsearch%’ OR description like ‘%elasticsearch%’ OR ...

Not optimized for free text search

Inverted indexFor this job you need thorough knowledge

of elasticsearch.

We are looking for Elasticsearch

trainees

job 1

knowledge 1

elasticsearch 1,2

trainees 2

Terms

Analysis

• Tokenizing

• Filters

• Analyzers

Searching/Querying

• Stemming

• Synonyms

• Sounds like

Open source Search solutions

elasticsearch

Design overviewApplication

Driver

uses

calls

JavaGroovyPhpPerl

Python

+

Design overview

Application

REST/HTTP

calls

What can you tell about Security?

There is no security

• Do not expose your search solution to the public

• Use a proxy (guides are available)

Becoming successful

A lot of vacancies

A lot of job seekers

Being successful

Scalability Availability

Storing more content

Storing more content

Prevent data loss

Keep copies

The right tool ...

Github

Facets

Highlighting

Recommendation

Geospatial search

Log analysis

Data analysis

http://www.kibana.org

Log analysis

http://www.elasticsearch.org/blog/using-elasticsearch-and-logstash-to-serve-billions-of-searchable-events-for-customers/

using elasticsearch and logstash to serve billions of searchable events

Ralph Meijer

Percolator

Percolator

https://github.com/abronner/elasticsearch-monitoring

Percolator

NoSQL

Beeld en Geluid

Store the meta-data of all image, audio and video material

Jettro Coenradie jco@trifork.nl

The right tool The job

Questions?