Building Successful Apps Using Application Telemetry and Data Driven Decisions - Rakefet Jackoby...

15
Building successful apps using application telemetry and data driven decisions It’s time to turn the lights on! Rakefet Jackoby Galazan Senior Product Manager

Transcript of Building Successful Apps Using Application Telemetry and Data Driven Decisions - Rakefet Jackoby...

Page 1: Building Successful Apps Using Application Telemetry and Data Driven Decisions - Rakefet Jackoby Galazan, Microsoft - DevOpsDays Tel Aviv 2016

Building successful apps using application telemetry and data driven decisions

It’s time to turn the lights on!

Rakefet Jackoby GalazanSenior Product Manager

Page 2: Building Successful Apps Using Application Telemetry and Data Driven Decisions - Rakefet Jackoby Galazan, Microsoft - DevOpsDays Tel Aviv 2016

It’s tough out there…Business is faster

Competition is fiercer

Time-to-market is key

Page 3: Building Successful Apps Using Application Telemetry and Data Driven Decisions - Rakefet Jackoby Galazan, Microsoft - DevOpsDays Tel Aviv 2016

Diagnostics for modern applicationsDifferent clientsand browsers

Multiple data centers

Multiple tiers and components

Feature churn Continuous Delivery

Quickly find and fix

Page 4: Building Successful Apps Using Application Telemetry and Data Driven Decisions - Rakefet Jackoby Galazan, Microsoft - DevOpsDays Tel Aviv 2016

Answer questions like …

Is my application crashing?What exactly happened?

Is my application fast enough?Is my server able to handle the

load?How responsive are my

dependencies?Is my application UP or DOWN?

What is the root cause?How many people are impacted?

Page 5: Building Successful Apps Using Application Telemetry and Data Driven Decisions - Rakefet Jackoby Galazan, Microsoft - DevOpsDays Tel Aviv 2016

What is APM?Telemetry is collected at each tier: server backend, middleware, web service & browser1

Telemetry arrives to the APM product where it is processed & stored

Identify, understand and resolve issues with powerful out-of-the-box and custom telemetry3

2

Page 6: Building Successful Apps Using Application Telemetry and Data Driven Decisions - Rakefet Jackoby Galazan, Microsoft - DevOpsDays Tel Aviv 2016

Sources of telemetry

infrastructure

platform

app

1 Outside-in monitoringURL pings and web tests from different global points of presence

Observed user behaviorHow is the application being used?2

Observed application behaviorService dependencies, queries, response time, exceptions, logs, etc.

3Developer traces and events

Whatever the developer would like tosend to the APM product

4Infrastructure performance

System performance counters5

Page 7: Building Successful Apps Using Application Telemetry and Data Driven Decisions - Rakefet Jackoby Galazan, Microsoft - DevOpsDays Tel Aviv 2016

Plan1 Monitor +

Learn

Release

Develop + Test2

Development

Production

DevOps Lifecycle4

3

Page 8: Building Successful Apps Using Application Telemetry and Data Driven Decisions - Rakefet Jackoby Galazan, Microsoft - DevOpsDays Tel Aviv 2016

It starts with an idea – and a plan how to turn this idea into reality…

Manage work

Develop + Test

1

PlanProject starts

PlanTrack progress

Prioritization and validation of investments not based on real data

Page 9: Building Successful Apps Using Application Telemetry and Data Driven Decisions - Rakefet Jackoby Galazan, Microsoft - DevOpsDays Tel Aviv 2016

Write Code

Unit Testing

2

Build

Version Control

Build Verification

Release

Once the iteration starts, developers turn great ideas into features…

Develop + Test

Lack of collaboration between development and operations

Page 10: Building Successful Apps Using Application Telemetry and Data Driven Decisions - Rakefet Jackoby Galazan, Microsoft - DevOpsDays Tel Aviv 2016

Load TestingIntegration

testingenvironment

Automated functional testing

environment

3

Pre-production

environment

Stagingenvironme

nt

Monitor + Learn

When all tests pass, the build is deployed to testing environments for each stage in the release process

Release

Inability to quickly detect, diagnoseand triage application issues

Page 11: Building Successful Apps Using Application Telemetry and Data Driven Decisions - Rakefet Jackoby Galazan, Microsoft - DevOpsDays Tel Aviv 2016

Learn and understand how users use your app, how it reacts and quickly fix issues and bugs

Monitor + Learn

4

Monitor

Feedback

Plan the next iteration

Lack of actionable and contextualinformation to resolve incidents

Page 12: Building Successful Apps Using Application Telemetry and Data Driven Decisions - Rakefet Jackoby Galazan, Microsoft - DevOpsDays Tel Aviv 2016

APM: Detect, Triage & DiagnoseDetect

Charts, dashboards, webtests & alerts based on metrics/Traces/events/ APM data

Triage Application map and real user impact

Diagnose Exceptions, performance issues, dependency and failures

Page 13: Building Successful Apps Using Application Telemetry and Data Driven Decisions - Rakefet Jackoby Galazan, Microsoft - DevOpsDays Tel Aviv 2016

Proactive DetectionsDetect

Machine learning algorithms for automatic detection Find disruptive trends and anomalous segments Correlated data for triage and fast diagnostics Configuration/customization may or may not be required

Page 14: Building Successful Apps Using Application Telemetry and Data Driven Decisions - Rakefet Jackoby Galazan, Microsoft - DevOpsDays Tel Aviv 2016

Demo

Page 15: Building Successful Apps Using Application Telemetry and Data Driven Decisions - Rakefet Jackoby Galazan, Microsoft - DevOpsDays Tel Aviv 2016

Questions?