5 Redis Use Cases - Redis Labs | The Best Redis Experience · 2020-01-02 · Cache Web Server...

15
5 Redis Use Cases That Power the Datorama Query API

Transcript of 5 Redis Use Cases - Redis Labs | The Best Redis Experience · 2020-01-02 · Cache Web Server...

Page 1: 5 Redis Use Cases - Redis Labs | The Best Redis Experience · 2020-01-02 · Cache Web Server Decentralization Auto-Scaling. 3. Locking Queue Cache Lock Web Server Query Worker Resilience

5 Redis Use CasesThat Power the Datorama Query API

Page 2: 5 Redis Use Cases - Redis Labs | The Best Redis Experience · 2020-01-02 · Cache Web Server Decentralization Auto-Scaling. 3. Locking Queue Cache Lock Web Server Query Worker Resilience

Gur Dotan

Platform Team Leader

- Datorama R&D -

About Me

@gurdotan

Page 3: 5 Redis Use Cases - Redis Labs | The Best Redis Experience · 2020-01-02 · Cache Web Server Decentralization Auto-Scaling. 3. Locking Queue Cache Lock Web Server Query Worker Resilience

Datorama is

Intelligence for Marketing

Everyperformance,outcome&investmentacrossthecustomerjourney– allinoneplace.

Page 4: 5 Redis Use Cases - Redis Labs | The Best Redis Experience · 2020-01-02 · Cache Web Server Decentralization Auto-Scaling. 3. Locking Queue Cache Lock Web Server Query Worker Resilience

Daily Stats

5 Billion 3.5Million 40,000Rows

ProcessedRedis

Calls/SecondQueriesExecuted

Page 5: 5 Redis Use Cases - Redis Labs | The Best Redis Experience · 2020-01-02 · Cache Web Server Decentralization Auto-Scaling. 3. Locking Queue Cache Lock Web Server Query Worker Resilience

The Datorama Query API

- Core Service -

IO Intensive

CPU Intensive

RAM Intensive

Distributed Nature => Driven By Redis

Page 6: 5 Redis Use Cases - Redis Labs | The Best Redis Experience · 2020-01-02 · Cache Web Server Decentralization Auto-Scaling. 3. Locking Queue Cache Lock Web Server Query Worker Resilience

A Distributed Swiss Army Knife

Caching

Queueing

Locking

Throttling

PubSub’ing

Page 7: 5 Redis Use Cases - Redis Labs | The Best Redis Experience · 2020-01-02 · Cache Web Server Decentralization Auto-Scaling. 3. Locking Queue Cache Lock Web Server Query Worker Resilience

Query API Backend

WebServer

QueryWorker

Page 8: 5 Redis Use Cases - Redis Labs | The Best Redis Experience · 2020-01-02 · Cache Web Server Decentralization Auto-Scaling. 3. Locking Queue Cache Lock Web Server Query Worker Resilience

WebServer

1. Caching

CacheWebServer

QueryWorker

Speed Less Compute

Page 9: 5 Redis Use Cases - Redis Labs | The Best Redis Experience · 2020-01-02 · Cache Web Server Decentralization Auto-Scaling. 3. Locking Queue Cache Lock Web Server Query Worker Resilience

QueryWorker

2. Queueing

Queue

CacheWebServer

QueryWorker

Decentralization Auto-Scaling

Page 10: 5 Redis Use Cases - Redis Labs | The Best Redis Experience · 2020-01-02 · Cache Web Server Decentralization Auto-Scaling. 3. Locking Queue Cache Lock Web Server Query Worker Resilience

3. Locking

Queue

LockCacheWebServer

QueryWorker

Resilience no “Noisy Neighbor”

Page 11: 5 Redis Use Cases - Redis Labs | The Best Redis Experience · 2020-01-02 · Cache Web Server Decentralization Auto-Scaling. 3. Locking Queue Cache Lock Web Server Query Worker Resilience

4. Throttling

LockCacheWebServer

Queue

QueryWorker

Congestion Mgmt.

Queue

Page 12: 5 Redis Use Cases - Redis Labs | The Best Redis Experience · 2020-01-02 · Cache Web Server Decentralization Auto-Scaling. 3. Locking Queue Cache Lock Web Server Query Worker Resilience

5. PubSub’ing

PubSub

Queue

LockCacheWebServer

QueryWorker

Immediate Feedback

Page 13: 5 Redis Use Cases - Redis Labs | The Best Redis Experience · 2020-01-02 · Cache Web Server Decentralization Auto-Scaling. 3. Locking Queue Cache Lock Web Server Query Worker Resilience

One Flow – Five Use Cases

Caching

Queueing

Locking

Throttling

PubSub’ing

Page 14: 5 Redis Use Cases - Redis Labs | The Best Redis Experience · 2020-01-02 · Cache Web Server Decentralization Auto-Scaling. 3. Locking Queue Cache Lock Web Server Query Worker Resilience

WE’RE HIRING

engineering.datorama.com

Page 15: 5 Redis Use Cases - Redis Labs | The Best Redis Experience · 2020-01-02 · Cache Web Server Decentralization Auto-Scaling. 3. Locking Queue Cache Lock Web Server Query Worker Resilience

Thank You!