2016 09 measurecamp - event data modeling
-
Upload
yalisassoon -
Category
Data & Analytics
-
view
223 -
download
1
Transcript of 2016 09 measurecamp - event data modeling
![Page 1: 2016 09 measurecamp - event data modeling](https://reader031.fdocuments.in/reader031/viewer/2022030316/58738c0b1a28ab272d8b6d5f/html5/thumbnails/1.jpg)
EVENT DATA MODELINGMEASURECAMP LONDON ‘16
![Page 2: 2016 09 measurecamp - event data modeling](https://reader031.fdocuments.in/reader031/viewer/2022030316/58738c0b1a28ab272d8b6d5f/html5/thumbnails/2.jpg)
MEASURECAMP LONDON ‘16
WHO’S CAPTURING ATOMIC DATA?
Who’s using GA Premium, Adobe, Snowplow, Segment, … to capture atomic or event-level data?
How is the data made available, consumed, turned into insights?
![Page 3: 2016 09 measurecamp - event data modeling](https://reader031.fdocuments.in/reader031/viewer/2022030316/58738c0b1a28ab272d8b6d5f/html5/thumbnails/3.jpg)
MEASURECAMP LONDON ‘16
WE ALL LIKE ATOMIC DATA…
With current technologies, we can record all user interactions, across all channels, store it in our own data warehouse, and join it with all other datasets we have.
… BUT IT REMAINS HARD TO CONSUME
![Page 4: 2016 09 measurecamp - event data modeling](https://reader031.fdocuments.in/reader031/viewer/2022030316/58738c0b1a28ab272d8b6d5f/html5/thumbnails/4.jpg)
MEASURECAMP LONDON ‘16
EXAMPLE 1
Event stream:
‣ Pre-roll loaded, clicked, skipped, …
‣ Main video loaded, paused, …
‣ Interactions within the video
‣ Subscribe, like, share, comment, …
‣ Much, much more
![Page 5: 2016 09 measurecamp - event data modeling](https://reader031.fdocuments.in/reader031/viewer/2022030316/58738c0b1a28ab272d8b6d5f/html5/thumbnails/5.jpg)
MEASURECAMP LONDON ‘16
EXAMPLE 2
Event stream:
‣ Tutorial start, tutorial finish
‣ Start game, change difficulty
‣ Level up
‣ Purchase
‣ Invite friends
‣ Much, much more
![Page 6: 2016 09 measurecamp - event data modeling](https://reader031.fdocuments.in/reader031/viewer/2022030316/58738c0b1a28ab272d8b6d5f/html5/thumbnails/6.jpg)
MEASURECAMP LONDON ‘16
WHY IS IT HARD TO CONSUME?
Events need to be looked at in context, and in the right order, to become valuable.
End users cannot be expected to do the complex transformations that are required to draw insights from the atomic data.
![Page 7: 2016 09 measurecamp - event data modeling](https://reader031.fdocuments.in/reader031/viewer/2022030316/58738c0b1a28ab272d8b6d5f/html5/thumbnails/7.jpg)
“EVENT DATA MODELING IS THE PROCESS OF USING BUSINESS LOGIC TO AGGREGATE AND TRANSFORM EVENT-LEVEL DATA TO PRODUCE MODELED DATA THAT IS SIMPLER TO CONSUME”
DEFINITION
![Page 8: 2016 09 measurecamp - event data modeling](https://reader031.fdocuments.in/reader031/viewer/2022030316/58738c0b1a28ab272d8b6d5f/html5/thumbnails/8.jpg)
MEASURECAMP LONDON ‘16
EVENT DATA MODELING
BEFORE DATA MODELING
DATA IS IMMUTABLE AND UN-OPINIONATED
AFTER DATA MODELING
DATA IS MUTABLE AND OPINIONATED
![Page 9: 2016 09 measurecamp - event data modeling](https://reader031.fdocuments.in/reader031/viewer/2022030316/58738c0b1a28ab272d8b6d5f/html5/thumbnails/9.jpg)
MEASURECAMP LONDON ‘16
EVENT DATA MODELING
▸ ID stitching
▸ Macro events
▸ Units of work
▸ Sessions
▸ Users
![Page 10: 2016 09 measurecamp - event data modeling](https://reader031.fdocuments.in/reader031/viewer/2022030316/58738c0b1a28ab272d8b6d5f/html5/thumbnails/10.jpg)
THOUGHTS OR QUESTIONS?WE’RE HIRING JUNIOR DATA
ANALYSTS
![Page 11: 2016 09 measurecamp - event data modeling](https://reader031.fdocuments.in/reader031/viewer/2022030316/58738c0b1a28ab272d8b6d5f/html5/thumbnails/11.jpg)
MEASURECAMP LONDON ‘16
EVENT DATA PIPELINE
PROCESSINGCOLLECTION
REAL-TIME APPS
REAL-TIME DASHBOARDS
DATA EXPLORATION
PREDICTIVE MODELING
DATA WAREHOUSE
WEB
APPS
SERVERS
3RD PARTY
IOT
![Page 12: 2016 09 measurecamp - event data modeling](https://reader031.fdocuments.in/reader031/viewer/2022030316/58738c0b1a28ab272d8b6d5f/html5/thumbnails/12.jpg)
MEASURECAMP LONDON ‘16
EVENT DATA PIPELINE
PROCESSINGCOLLECTION
REAL-TIME APPS
REAL-TIME DASHBOARDS
DATA EXPLORATION
PREDICTIVE MODELING
DATA WAREHOUSE
WEB
APPS
SERVERS
3RD PARTY
IOTMANY SOURCES
![Page 13: 2016 09 measurecamp - event data modeling](https://reader031.fdocuments.in/reader031/viewer/2022030316/58738c0b1a28ab272d8b6d5f/html5/thumbnails/13.jpg)
MEASURECAMP LONDON ‘16
EVENT DATA PIPELINE
PROCESSINGCOLLECTION
REAL-TIME APPS
REAL-TIME DASHBOARDS
DATA EXPLORATION
PREDICTIVE MODELING
DATA WAREHOUSE
WEB
APPS
SERVERS
3RD PARTY
IOTONE PIPELINE
UNIFIED LOG, NO SILOS
![Page 14: 2016 09 measurecamp - event data modeling](https://reader031.fdocuments.in/reader031/viewer/2022030316/58738c0b1a28ab272d8b6d5f/html5/thumbnails/14.jpg)
MEASURECAMP LONDON ‘16
EVENT DATA PIPELINE
PROCESSINGCOLLECTION
REAL-TIME APPS
REAL-TIME DASHBOARDS
DATA EXPLORATION
PREDICTIVE MODELING
DATA WAREHOUSE
WEB
APPS
SERVERS
3RD PARTY
IOT
VALIDATION ENRICHMENT DATA MODELING
ONE PIPELINE UNIFIED LOG, NO SILOS
![Page 15: 2016 09 measurecamp - event data modeling](https://reader031.fdocuments.in/reader031/viewer/2022030316/58738c0b1a28ab272d8b6d5f/html5/thumbnails/15.jpg)
MEASURECAMP LONDON ‘16
EVENT DATA PIPELINE
PROCESSINGCOLLECTION
REAL-TIME APPS
REAL-TIME DASHBOARDS
DATA EXPLORATION
PREDICTIVE MODELING
DATA WAREHOUSE
WEB
APPS
SERVERS
3RD PARTY
IOT
MANY CONSUMERS