C* Summit EU 2013: Stratio Search: In-Memory Search with Cassandra Persistence

13
#CassandraEU Stratio Search In-memory search with Cassandra persistence “Pluralitas non est ponenda sine necessitate”

description

Speaker: Álvaro Agea Herradón — Big Data Architect at Stratio

Transcript of C* Summit EU 2013: Stratio Search: In-Memory Search with Cassandra Persistence

Page 1: C* Summit EU 2013: Stratio Search: In-Memory Search with Cassandra Persistence

#CassandraEU

Stratio SearchIn-memory search with Cassandra persistence“Pluralitas non est ponenda sine necessitate”

Page 2: C* Summit EU 2013: Stratio Search: In-Memory Search with Cassandra Persistence

#CassandraEU

Why?We have a problem…200M documents in a databaseAnd …We need full text search

Page 3: C* Summit EU 2013: Stratio Search: In-Memory Search with Cassandra Persistence

#CassandraEU

Why?The first approach…Batch processingBut…A long long time after

Page 4: C* Summit EU 2013: Stratio Search: In-Memory Search with Cassandra Persistence

#CassandraEU

Requirements?A database… CassandraA indexer… LuceneAnd… Work Together

Page 5: C* Summit EU 2013: Stratio Search: In-Memory Search with Cassandra Persistence

#CassandraEU

TryTrySomebody found the same problem“You’ll never go alone”

Page 6: C* Summit EU 2013: Stratio Search: In-Memory Search with Cassandra Persistence

#CassandraEU

In the marketSolr – ElasticSearchLucandra – Solandra“Insanity is repeating the same mistakes and expecting different results”

Page 7: C* Summit EU 2013: Stratio Search: In-Memory Search with Cassandra Persistence

#CassandraEU

ChallengeAccepted

Page 8: C* Summit EU 2013: Stratio Search: In-Memory Search with Cassandra Persistence

#CassandraEU

Page 9: C* Summit EU 2013: Stratio Search: In-Memory Search with Cassandra Persistence

#CassandraEU

1 10 100 10000

10000

20000

30000

40000

50000

60000

123 591 1721

8510

666 10666243

53047

Response time

StratioLucene

Petitions

Tim

e

Internal Benchmark – 1M documents – No stored index

Page 10: C* Summit EU 2013: Stratio Search: In-Memory Search with Cassandra Persistence

#CassandraEU

ConclusionFasterDistributedFault tolerant

Page 11: C* Summit EU 2013: Stratio Search: In-Memory Search with Cassandra Persistence

#CassandraEU

Who are we?

Page 12: C* Summit EU 2013: Stratio Search: In-Memory Search with Cassandra Persistence

#CassandraEU

Page 13: C* Summit EU 2013: Stratio Search: In-Memory Search with Cassandra Persistence

#CassandraEU

Thanks“If I take one more step. I’ll be the farthest away from home I’ve ever been.” - Sam Antonio Alcocer - [email protected] Agea – [email protected]