Redis in a Multi Tenant Environment–High Availability, Monitoring & Much More!
-
Upload
redis-labs -
Category
Technology
-
view
490 -
download
0
Transcript of Redis in a Multi Tenant Environment–High Availability, Monitoring & Much More!
2
IcchaSethi.__dict__
{ “Name”: “Iccha Sethi”, “Occupation”: “Software Developer”, “Team”: “Redis”, “Company”: “Object Rocket, Rackspace”, “Fun Fact”: “loading….” }
Outline
10
VIP
LB1 (Master) HAProxy
Redis Master
Redis Slave
Access HA Redis: DNS: read/write port 6379 password
Outline
11
VIP
LB1 (Master) HAProxy
LB2 (Backup) HAProxy
keepalived
Redis Master
Redis Slave
Access HA Redis: DNS: read/write port 6379 password
13
Highly Available REDIS
STASH NOVA
Proxy API
Sentinels
Host 0
Host 1
Host 2
Host 3
Redis Master
Redis Slave
KeepAliveD HA Proxy
KeepAliveD HA Proxy
Proxy Agent
Proxy Agent
Agent
Agent
Customer :6379
HA Create
17
Fail Over – Redis Nodes
STASH NOVA
Proxy API
Sentinels
Host 0
Host 1
Host 2
Host 3
Redis Master
Redis Slave
KeepAliveD HA Proxy
KeepAliveD HA Proxy
Proxy Agent
Proxy Agent
Agent
Agent
Customer :6379
18
Fail Over – Redis Nodes
STASH NOVA
Proxy API
Sentinels
Host 0
Host 1
Host 2
Host 3
Redis Master
Redis Slave
KeepAliveD HA Proxy
KeepAliveD HA Proxy
Proxy Agent
Proxy Agent
Agent
Agent
Customer :6379
19
Fail Over – Redis Nodes
STASH NOVA
Proxy API
Sentinels
Host 0
Host 1
Host 2
Host 3
Redis Master
Redis Master
KeepAliveD HA Proxy
KeepAliveD HA Proxy
Proxy Agent
Proxy Agent
Agent
Agent
Customer :6379
20
Fail Over – Redis Nodes
STASH NOVA
Proxy API
Sentinels
Host 0
Host 1
Host 2
Host 3
Redis Master
Redis Master
KeepAliveD HA Proxy
KeepAliveD HA Proxy
Proxy Agent
Proxy Agent
Agent
Agent
Customer :6379
21
Fail Over – Redis Nodes
STASH NOVA
Proxy API
Sentinels
Host 0
Host 1
Host 2
Host 3
Redis Master
Redis Master
KeepAliveD HA Proxy
KeepAliveD HA Proxy
Proxy Agent
Proxy Agent
Agent
Agent
Customer :6379
22
Fail Over – Redis Nodes
STASH NOVA
Proxy API
Sentinels
Host 0
Host 1
Host 2
Host 3
Redis Master
Redis Master
KeepAliveD HA Proxy
KeepAliveD HA Proxy
Proxy Agent
Proxy Agent
Agent
Agent
Customer :6379
23
Fail Over – Redis Nodes
STASH NOVA
Proxy API
Sentinels
Host 0
Host 1
Host 2
Host 3
Redis Master
Redis Master
KeepAliveD HA Proxy
KeepAliveD HA Proxy
Proxy Agent
Proxy Agent
Agent
Agent
Customer :6379
25
Redis Resize – Vertical Scaling
STASH
Sentinels
Redis Master
Redis Slave
HA Proxy
HA Proxy
Customer :6379
26
Redis Resize – Vertical Scaling
STASH
Sentinels
Redis Master
Redis Slave
HA Proxy
HA Proxy
Customer :6379
New Redis Master
New Redis Slave
27
Redis Resize – Vertical Scaling
STASH
Sentinels
Redis Master
Redis Slave
HA Proxy
HA Proxy
Customer :6379
New Redis Master
New Redis Slave
28
Redis Resize – Vertical Scaling
STASH
Sentinels
HA Proxy
HA Proxy
Customer :6379
New Redis Master
New Redis Slave
38
Redis Resize – Vertical Scaling
STASH
Sentinels
Redis Master
Redis Slave
HA Proxy
HA Proxy
Customer :6379
New Redis Master
New Redis Slave
42
VIP
LB1 (Master) HAProxy
ACLS
LB2 (Backup) HAProxy
ACLs
keepalived
Redis Master
Redis Slave
Access HA Redis: VIP: read/write port 6379
ACLs
44
VIP
LB1 (Master) HAProxy
ACLs SSL certs
LB2 (Backup) HAProxy
ACLs SSL certs
keepalived
Redis Master
Redis Slave
Access HA Redis: VIP: read/write port 6379 SSL port 6380
SSL
46
VIP
LB1 (Master) HAProxy
LB2 (Backup) HAProxy
keepalived
Redis Master
Redis Slave
Access HA Redis: VIP: read/write port 6379
Containers
48
VIP
LB1 (Master) HAProxy
LB2 (Backup) HAProxy
keepalived
Redis Master
Redis Slave
Access HA Redis: VIP: read/write port 6379
Tale of the Customer with 120K connections
Monitoring, Monitoring, Monitoring
• What do you monitor? • How often is it monitored? • Who does the monitoring? • What action is taken?
51
Monitoring, Monitoring, Monitoring
• What do you monitor? – Front door check – Connection limit – Memory usage – Failover – Failed failover – Redis process down – No valid slaves
• How often is it monitored? • Who does the monitoring? • What action is taken?
52
Monitoring, Monitoring, Monitoring
• What do you monitor? • How often is it monitored?
– Front door check – Memory usage – Failover – Failed failover – Redis process down – No valid slaves
• Who does the monitoring? • What action is taken?
53
Monitoring, Monitoring, Monitoring
• What do you monitor? • How often is it monitored? • Who does the monitoring? • What action is taken?
54
Monitoring, Monitoring, Monitoring
• What do you monitoring? • How often is it monitored? • Who does the monitoring? • What action is taken?
57
Monitoring, Monitoring, Monitoring
• What do you monitoring? • How often is it monitored? • Who does the monitoring? • What action is taken?
– Front door check – Memory usage – Failover – Failed failover – Redis process down – No valid slaves
59