Eat Sleep Tweet Repeat
12
Barsha Shrestha Insight Data Engineering
-
Upload
barshashrest -
Category
Data & Analytics
-
view
32 -
download
1
Transcript of Eat Sleep Tweet Repeat
Barsha ShresthaInsight Data Engineering
Motivation:
APIs:
>300GB
DATA INGESTION FILE SYSTEM/
FRONT-END
BATCH PROCESSING
DATABASE
DATA INGESTION FILE SYSTEM/
BATCH PROCESSING
DATABASE
FRONT-END
PRODUCER
PRODUCER
CONSUMER
DATA INGESTION FILE SYSTEM/
BATCH PROCESSING
DATABASE
FRONT-END
TMDB
DATA INGESTION FILE SYSTEM/
FRONT-END
BATCH PROCESSING
DATABASE
Challenges1. Learning new technologies!2. Next steps
About me:
Barsha Shrestha
Chemistry and Computer Science Movies, Soccer, Science Jokes, Bad puns