Autonomous Analytics
-
Upload
anodot -
Category
Data & Analytics
-
view
193 -
download
0
Transcript of Autonomous Analytics
2
“There were 5 exabytes of information created by the entire world between the dawn of civilization and 2003.Now That same number is created very two days.”
Trend #1: Information Overload
3
Historical Real Time Prediction
Trend #2:The need for speed
4
Autonomous Analytics
Autonomous analytics enables you to perform any type of analytics (past, real-time and predictive) on practically everything with minimal configuration
5
Let’s go through an exampleapplication
6
SO YOU’VE CREATED THIS MOBILE APP…
7
TIME TO MAKE SOME MONEY
8
SOMETHING BROKE…TOO MANY PEOPLE STARTED UNINSTALLING
https://techcrunch.com/2013/03/12/users-have-low-tolerance-for-buggy-apps-only-16-will-try-a-failing-app-more-than-twice/
ONLY 16% OF
USERS WILL TRY A
CRASHING APP
MORE THAN TWICE
9
WHAT HAPPENED?
10
You can't control what you can't measure.Tom DeMarco in Controlling Software Projects
11
WHAT TO MEASURE? MEASURE WHATEVER BROKE
12
KPIS CAN BE GROUPED
per app, ad campaign, partners/affilates, store items, cross promotion…
Per Geo, user segment, game,…
Per Device Type, OS version, network,…
BUSINESS:REVENUE
BUSINESS GENERATION:DAU, MAU, RETENTION RATES
APPLICATION :CRASHES, PERFORMANCE, ERRORS, USABILITY
13
EACH KPI HAS DOZENS OF OTHERS IT RELATES TO
14
SO MANY THINGS CAN CAUSE BREAKDOWNS/ SLOWDOWNS… OR OPPORTUNITIES
Partner integration Data
format
OS updateNew devices
Competitor bid strategy Media
coverage Social media
exposure
New version deployment
New game release New campaign type
AB Tests
PARTNER CHANGES
DEVICE CHANGES OTHER EXTERNAL CHANGES
COMPANY CHANGES
15
YOU NEED ANOMALY DETECTION
1616
AUTOMATED ANOMALY DETECTION
17
NORMAL BEHAVIOR LEARNING FOR ANY TIME SERIES
◎ Stationary / non stationary◎ Regularly Irregular
sampling◎ Discrete/Real valued◎ …
17
◎ Single/Mixture models◎ Symmetric/non-symmetric◎ Continuous/discrete◎ …
◎ Seasonal/non seasonal◎ Single/multiple seasonal
patterns◎ Additive/Convolutional
multi-seasonal patterns
◎ Optimal adaptation during normal times
◎ Optimal adaptation during anomalies
◎ Optimal adaptation following anomalies
ADAPTATION
18
ABNORMAL BEHAVIORAL LEARNING: RANKING, SCORING
ABNORMAL BEHAVIOR MODELP(ANOMALY SIGNIFICANCE | ANOMALY PATTERN)
19
ABNORMAL BEHAVIORAL LEARNING: CLASSIFYING ANOMALIES
TRANSIENT ANOMALY
ANOMALY CLASSIFICATION MODELP(ANOMALY TYPE| ANOMALY PATTERN )
LEVEL CHANGETREND CHANGESEASONAL PATTERN CHANGE
20
BEHAVIORAL TOPOLOGY LEARNING
21
THE VALUE OF THE STEPS: WEEKLY STATS
22
WORKING WITH AN ANOMALY DETECTION SYSTEM
Alert Open Investigation Remediation Alert Close: Back to Normal
23
ANOMALY DETECTION SYSTEM ARCHITECTURE