Data driven culture & infrastructure from the ground up
-
Upload
squadex -
Category
Technology
-
view
27 -
download
3
Transcript of Data driven culture & infrastructure from the ground up
![Page 1: Data driven culture & infrastructure from the ground up](https://reader035.fdocuments.in/reader035/viewer/2022062821/58a3937b1a28abb1348b4991/html5/thumbnails/1.jpg)
Data-driven culture & infrastructure from the ground up
January 2017
![Page 2: Data driven culture & infrastructure from the ground up](https://reader035.fdocuments.in/reader035/viewer/2022062821/58a3937b1a28abb1348b4991/html5/thumbnails/2.jpg)
Data-driven culture and infrastructure from the ground up
Agenda
● R&D and IT consultancy firm● Clients - Silicon Valley Startups from Round A to Round D● Hardcore Big Data Analytics team in Kazan
![Page 3: Data driven culture & infrastructure from the ground up](https://reader035.fdocuments.in/reader035/viewer/2022062821/58a3937b1a28abb1348b4991/html5/thumbnails/3.jpg)
Data-driven culture and infrastructure from the ground up
January 2017
People driven
![Page 4: Data driven culture & infrastructure from the ground up](https://reader035.fdocuments.in/reader035/viewer/2022062821/58a3937b1a28abb1348b4991/html5/thumbnails/4.jpg)
Data-driven culture and infrastructure from the ground up
Excel driven
January 2017
![Page 5: Data driven culture & infrastructure from the ground up](https://reader035.fdocuments.in/reader035/viewer/2022062821/58a3937b1a28abb1348b4991/html5/thumbnails/5.jpg)
Data-driven culture and infrastructure from the ground up
BI driven
January 2017
![Page 6: Data driven culture & infrastructure from the ground up](https://reader035.fdocuments.in/reader035/viewer/2022062821/58a3937b1a28abb1348b4991/html5/thumbnails/6.jpg)
Data-driven culture and infrastructure from the ground up
Data Driven Team
January 2017
Product Manager
Owners
Engineer UI Data Scientist
Sales/Marketing DevOps Customer
![Page 7: Data driven culture & infrastructure from the ground up](https://reader035.fdocuments.in/reader035/viewer/2022062821/58a3937b1a28abb1348b4991/html5/thumbnails/7.jpg)
Data-driven culture and infrastructure from the ground up
Data Driven Team
January 2017
Product
Metrics
Ad-hoc reports
Reports
![Page 8: Data driven culture & infrastructure from the ground up](https://reader035.fdocuments.in/reader035/viewer/2022062821/58a3937b1a28abb1348b4991/html5/thumbnails/8.jpg)
Data-driven culture and infrastructure from the ground up
Data Driven Team
January 2017
Product
Metrics
Ad-hoc reports
Reports
Engineer
Alerts, Errors
Metrics
![Page 9: Data driven culture & infrastructure from the ground up](https://reader035.fdocuments.in/reader035/viewer/2022062821/58a3937b1a28abb1348b4991/html5/thumbnails/9.jpg)
Data-driven culture and infrastructure from the ground up
Data Driven Team
January 2017
Product
Metrics
Ad-hoc reports
Reports
Engineer
Alerts, Errors
Metrics
UX
Usage Patterns
A/B tests
![Page 10: Data driven culture & infrastructure from the ground up](https://reader035.fdocuments.in/reader035/viewer/2022062821/58a3937b1a28abb1348b4991/html5/thumbnails/10.jpg)
Data-driven culture and infrastructure from the ground up
Data Driven Team
January 2017
Product
Metrics
Ad-hoc reports
Reports
Engineer
Alerts, Errors
Metrics
Data Scientist
Scripts
Models
UX
Usage Patterns
A/B tests
![Page 11: Data driven culture & infrastructure from the ground up](https://reader035.fdocuments.in/reader035/viewer/2022062821/58a3937b1a28abb1348b4991/html5/thumbnails/11.jpg)
Data-driven culture and infrastructure from the ground up
Data Driven Team
January 2017
Product
Metrics
Ad-hoc reports
Reports
Owners
Revenue trends
Prescriptions
Insights
Engineer
Alerts, Errors
Metrics
Data Scientist
Scripts
Models
UX
Usage Patterns
A/B tests
![Page 12: Data driven culture & infrastructure from the ground up](https://reader035.fdocuments.in/reader035/viewer/2022062821/58a3937b1a28abb1348b4991/html5/thumbnails/12.jpg)
Data-driven culture and infrastructure from the ground up
Data Driven Team
January 2017
Product
Metrics
Ad-hoc reports
Reports
Owners
Revenue trends
Prescriptions
Insights
Engineer
Alerts, Errors
Metrics
Data Scientist
Scripts
Models
Marketing
BI tools
A/B test
UX
Usage Patterns
A/B tests
![Page 13: Data driven culture & infrastructure from the ground up](https://reader035.fdocuments.in/reader035/viewer/2022062821/58a3937b1a28abb1348b4991/html5/thumbnails/13.jpg)
Data-driven culture and infrastructure from the ground up
Data Driven Team
January 2017
Product
Metrics
Ad-hoc reports
Reports
Owners
Revenue trends
Prescriptions
Insights
Engineer
Alerts, Errors
Metrics
DevOps
Alerts, Errors
Metrics
Monitoring
Data Scientist
Scripts
Models
Marketing
BI tools
A/B test
UX
Usage Patterns
A/B tests
![Page 14: Data driven culture & infrastructure from the ground up](https://reader035.fdocuments.in/reader035/viewer/2022062821/58a3937b1a28abb1348b4991/html5/thumbnails/14.jpg)
Data-driven culture and infrastructure from the ground up
Data Driven Team
January 2017
Product
Metrics
Ad-hoc reports
Reports
Customer
Dashboards
Personalization
Insights
Reports
Owners
Revenue trends
Prescriptions
Insights
Engineer
Alerts, Errors
Metrics
DevOps
Alerts, Errors
Metrics
Monitoring
Data Scientist
Scripts
Models
Marketing
BI tools
A/B test
UX
Usage Patterns
A/B tests
![Page 15: Data driven culture & infrastructure from the ground up](https://reader035.fdocuments.in/reader035/viewer/2022062821/58a3937b1a28abb1348b4991/html5/thumbnails/15.jpg)
Data-driven culture and infrastructure from the ground up
Data Driven Team
January 2017
Product
Metrics
Ad-hoc reports
Reports
Customer
Dashboards
Personalization
Insights
Reports
Owners
Revenue trends
Prescriptions
Insights
Engineer
Alerts, Errors
Metrics
DevOps
Alerts, Errors
Metrics
Monitoring
Data Scientist
Scripts
Models
Marketing
BI tools
A/B test
UX
Usage Patterns
A/B tests
![Page 16: Data driven culture & infrastructure from the ground up](https://reader035.fdocuments.in/reader035/viewer/2022062821/58a3937b1a28abb1348b4991/html5/thumbnails/16.jpg)
Data-driven culture and infrastructure from the ground up
● Product Managers - SQL
● Engineers - Production, Product, Metrics, SOFT SKILLS
● UX - Marketing, Analytics
● Sales Engineer
● Business - BI, Reports, Metrics
January 2017
New Cross Skills - Evangelism
![Page 17: Data driven culture & infrastructure from the ground up](https://reader035.fdocuments.in/reader035/viewer/2022062821/58a3937b1a28abb1348b4991/html5/thumbnails/17.jpg)
Data-driven culture and infrastructure from the ground up
Infrastructure
![Page 18: Data driven culture & infrastructure from the ground up](https://reader035.fdocuments.in/reader035/viewer/2022062821/58a3937b1a28abb1348b4991/html5/thumbnails/18.jpg)
Data-driven culture and infrastructure from the ground up
● You could not just BUY it
● It’s not a Data Warehouse
● It’s not easy at all
January 2017
Myths
![Page 19: Data driven culture & infrastructure from the ground up](https://reader035.fdocuments.in/reader035/viewer/2022062821/58a3937b1a28abb1348b4991/html5/thumbnails/19.jpg)
Data-driven culture and infrastructure from the ground up
High Level
January 2017
App Servers
Production database
Logs
Storage
BI
Prescriptions
Application Data Infrastructure Visualisation
![Page 20: Data driven culture & infrastructure from the ground up](https://reader035.fdocuments.in/reader035/viewer/2022062821/58a3937b1a28abb1348b4991/html5/thumbnails/20.jpg)
Data-driven culture and infrastructure from the ground up
Micro
January 2017
App Servers
Production database Logs agg/
Papertrail
Keen.ioClicdata
DatadogPrometheus
Application Data Infrastructure Visualisation
GA
![Page 21: Data driven culture & infrastructure from the ground up](https://reader035.fdocuments.in/reader035/viewer/2022062821/58a3937b1a28abb1348b4991/html5/thumbnails/21.jpg)
Data-driven culture and infrastructure from the ground up
Small
January 2017
App Servers
Production database
Log agg/ Papertrail
S3
ClicdataInteranaLooker
DatadogPrometheus
Application Data Infrastructure Visualisation
Slave replica
![Page 22: Data driven culture & infrastructure from the ground up](https://reader035.fdocuments.in/reader035/viewer/2022062821/58a3937b1a28abb1348b4991/html5/thumbnails/22.jpg)
Data-driven culture and infrastructure from the ground up
Medium
January 2017
App Servers
Prod
Log stream S3ClicdataInteranaLooker
DatadogPrometheus
Application Data Infrastructure Visualisation
Slave replica
ETL RedShift
Ad-hoc SQL
![Page 23: Data driven culture & infrastructure from the ground up](https://reader035.fdocuments.in/reader035/viewer/2022062821/58a3937b1a28abb1348b4991/html5/thumbnails/23.jpg)
Data-driven culture and infrastructure from the ground up
Medium
January 2017
App Servers
Prod
AWS Kinesis S3ClicdataInteranaLooker
Datadog
Application Data Infrastructure Visualisation
Slave replica
AWS Lambda RedShift
Ad-hoc SQL
![Page 24: Data driven culture & infrastructure from the ground up](https://reader035.fdocuments.in/reader035/viewer/2022062821/58a3937b1a28abb1348b4991/html5/thumbnails/24.jpg)
Data-driven culture and infrastructure from the ground up
Medium
January 2017
App Servers
Prod
Kafka S3ClicdataInteranaLooker
DatadogPrometheus
Application Data Infrastructure Visualisation
Slave replica
Spark Streaming RedShift
Ad-hoc SQL
![Page 25: Data driven culture & infrastructure from the ground up](https://reader035.fdocuments.in/reader035/viewer/2022062821/58a3937b1a28abb1348b4991/html5/thumbnails/25.jpg)
Data-driven culture and infrastructure from the ground up
Big
January 2017
App Servers
Prod
TableauClicdataInteranaLooker
Application Data Infrastructure Visualisation
Slave replica
ETL/Spark/Streaming
RedShift
Ad-hoc SQL
Hadoop/Parquet Impala
Spark SQLData Science
![Page 26: Data driven culture & infrastructure from the ground up](https://reader035.fdocuments.in/reader035/viewer/2022062821/58a3937b1a28abb1348b4991/html5/thumbnails/26.jpg)
www.squadex.com
125 University Avenue,
Suite 290, Palo Alto,
California, 94301
Questions, details?We would be happy to answer!