strata_2015_kpcb_unboxing_jawbone_eugene_mandel
Transcript of strata_2015_kpcb_unboxing_jawbone_eugene_mandel
DATA @JAWBONEUNBOXING DATA STARTUPS
EUGENE MANDEL (@EUGMANDEL) JAWBONE
STRATA + HADOOP WORLD, 2015, SAN JOSE
THE PATH TO BETTER STARTS HEREUP® is a revolutionary system that guides you every step of the way to a better, healthier you.
Tracking hardware, sensors and algorithms
Engaging application and service
Science and data insight
API partners and signals
CO2
UP IS A SYSTEM
PAST
MULTIPLE DATABASES (MYSQL, MONGO, CASSANDRA)
DISTRIBUTED EVENT LOGGING -> SCRIBE -> S3
ANALYSIS BY EMR JOBS ON EVENT FILES OR QUERY PRODUCTION DATABASES
DATA PIPELINES
MYSQL -> ETL (EMR) -> REDSHIFT
DISTRIBUTED EVENT LOGGING -> KINESIS -> S3
DISTRIBUTED EVENT LOGGING -> KINESIS -> STREAMING ETL -> REDSHIFT
S3 EVENT LOGS -> BATCH ETL (EMR, SPARK) -> REDSHIFT
REDSHIFT -> ANALYSIS (SQL, PYTHON, SPARK) -> REDSHIFT
REDSHIFT -> DATA PRODUCT LOGIC -> DYNAMO DB