From Ubu to kafka
28
From Ubu to Kafka ingesting logs at Criteo
-
Upload
yann-schwartz -
Category
Data & Analytics
-
view
1.491 -
download
1
Transcript of From Ubu to kafka
From Ubu to Kafka ingesting logs at Criteo
Dramatis PersonaeYann Schwartz
@abolibibelot
SRE / DPS / Lake
/ Rivers
Evolutionary design
2009
2011
2014
2015
Are we there yet?
Wheel of misfortune
May you live in interesting times
● Rsyslog evil twin
● Who shaves the barber?
● Line based formatting for fun and profit
● The World according to ARP
● No one will ever need more than 4096 file descriptors
● Who needs Redis when you have Zookeeper?
● Big Data fits on an Integer
● Fault tolerance is overrated
Mind the gap
Oh noes● Use replication
● ...and understand ISRs
● ...and forbid unclean leader elections
● Your client hates you (BYOB)
● Storm hates you even more
●
Art credit: Mathieu Chataigner - François Visconte - Yann Schwartz
Join the fun. We’re hiring.
