Autonomous Analytics

24
1 Autonomous Analytics Ira Cohen, Chief Data Scientist [email protected]

Transcript of Autonomous Analytics

Page 1: Autonomous Analytics

1

Autonomous Analytics

Ira Cohen, Chief Data [email protected]

Page 2: Autonomous Analytics

2

“There were 5 exabytes of information created by the entire world between the dawn of civilization and 2003.Now That same number is created very two days.”

Trend #1: Information Overload

Page 3: Autonomous Analytics

3

Historical Real Time Prediction

Trend #2:The need for speed

Page 4: Autonomous Analytics

4

Autonomous Analytics

Autonomous analytics enables you to perform any type of analytics (past, real-time and predictive) on practically everything with minimal configuration

Page 5: Autonomous Analytics

5

Let’s go through an exampleapplication

Page 6: Autonomous Analytics

6

SO YOU’VE CREATED THIS MOBILE APP…

Page 7: Autonomous Analytics

7

TIME TO MAKE SOME MONEY

Page 8: Autonomous Analytics

8

SOMETHING BROKE…TOO MANY PEOPLE STARTED UNINSTALLING

https://techcrunch.com/2013/03/12/users-have-low-tolerance-for-buggy-apps-only-16-will-try-a-failing-app-more-than-twice/

ONLY 16% OF

USERS WILL TRY A

CRASHING APP

MORE THAN TWICE

Page 9: Autonomous Analytics

9

WHAT HAPPENED?

Page 10: Autonomous Analytics

10

You can't control what you can't measure.Tom DeMarco in Controlling Software Projects

Page 11: Autonomous Analytics

11

WHAT TO MEASURE? MEASURE WHATEVER BROKE

Page 12: Autonomous Analytics

12

KPIS CAN BE GROUPED

per app, ad campaign, partners/affilates, store items, cross promotion…

Per Geo, user segment, game,…

Per Device Type, OS version, network,…

BUSINESS:REVENUE

BUSINESS GENERATION:DAU, MAU, RETENTION RATES

APPLICATION :CRASHES, PERFORMANCE, ERRORS, USABILITY

Page 13: Autonomous Analytics

13

EACH KPI HAS DOZENS OF OTHERS IT RELATES TO

Page 14: Autonomous Analytics

14

SO MANY THINGS CAN CAUSE BREAKDOWNS/ SLOWDOWNS… OR OPPORTUNITIES

Partner integration Data

format

OS updateNew devices

Competitor bid strategy Media

coverage Social media

exposure

New version deployment

New game release New campaign type

AB Tests

PARTNER CHANGES

DEVICE CHANGES OTHER EXTERNAL CHANGES

COMPANY CHANGES

Page 15: Autonomous Analytics

15

YOU NEED ANOMALY DETECTION

Page 16: Autonomous Analytics

1616

AUTOMATED ANOMALY DETECTION

Page 17: Autonomous Analytics

17

NORMAL BEHAVIOR LEARNING FOR ANY TIME SERIES

◎ Stationary / non stationary◎ Regularly Irregular

sampling◎ Discrete/Real valued◎ …

17

◎ Single/Mixture models◎ Symmetric/non-symmetric◎ Continuous/discrete◎ …

◎ Seasonal/non seasonal◎ Single/multiple seasonal

patterns◎ Additive/Convolutional

multi-seasonal patterns

◎ Optimal adaptation during normal times

◎ Optimal adaptation during anomalies

◎ Optimal adaptation following anomalies

ADAPTATION

Page 18: Autonomous Analytics

18

ABNORMAL BEHAVIORAL LEARNING: RANKING, SCORING

ABNORMAL BEHAVIOR MODELP(ANOMALY SIGNIFICANCE | ANOMALY PATTERN)

Page 19: Autonomous Analytics

19

ABNORMAL BEHAVIORAL LEARNING: CLASSIFYING ANOMALIES

TRANSIENT ANOMALY

ANOMALY CLASSIFICATION MODELP(ANOMALY TYPE| ANOMALY PATTERN )

LEVEL CHANGETREND CHANGESEASONAL PATTERN CHANGE

Page 20: Autonomous Analytics

20

BEHAVIORAL TOPOLOGY LEARNING

Page 21: Autonomous Analytics

21

THE VALUE OF THE STEPS: WEEKLY STATS

Page 22: Autonomous Analytics

22

WORKING WITH AN ANOMALY DETECTION SYSTEM

Alert Open Investigation Remediation Alert Close: Back to Normal

Page 23: Autonomous Analytics

23

ANOMALY DETECTION SYSTEM ARCHITECTURE

Page 24: Autonomous Analytics

24

THANK YOUwww.anodot.com

Ira Cohen, Chief Data [email protected]