Ed BlankenshipProduct Manager, Visual Studio Online

Make Data-Driven, High-Impact Improvements to Your Application

Ed BlankenshipEdBlank@microsoft.com

@EdBlankenship

http://www.edsquared.com

http://bit.ly/TFS2013Book

http://bit.ly/TFS2013Book

“Every company is a software company”

Applications are the lifeblood of nearly every organization – they attract and engage customers, drive revenue, differentiate products and services, and automate critical business processes. The agile transformation and the movement to the cloud create new and exacerbate existing impediments.

Evolving ALM and DevOps dynamics

Diverse teams Team autonomyAgility in development and production

Data in Many Silos

Availability

Performance & Issues

Usage

Release/Environment Management

Builds Version Control

Bug Tracking Testing Backlog Management

Production

Development Collaboration

BACKLOG

REQUIREMENTS

Impediments

Quickly detect and resolve application issues.

Prioritize and validate investments based on qualitative and quantitative data.

Monitor + Learn

Diagnostics for production is an afterthought

Plan

Develop + TestRelease

How to start getting insights into your applications?

Basic Availability

Embrace the advantages of the cloud for your enterprise at your paceEmbrace the advantages of the cloud at your own pace

Basic Performance

Application Usage

Custom Telemetry

Non-invasive

Code change

Visibility to application’s healthCustomer experience and value erosion

360 degree view to application’s availability and performanceAutomatic alerts, relevant metrics to identify issues promptly

Problem

Solution

Value

Mean Time to Detect (MTTD)

Reduce MTTDMinimize outages and customer impact

Know before your customers know• Get 360 degree view to

application’s health with relevant metrics to help you detect issues in production.

Set up a view of your

application health with metrics that

you care

Identify issues and patterns

with your application in

production

Check the pulse of your application

Know before your customers know• Get 360 degree view to

application’s health with relevant metrics to help you spot issues in production.

• Get alerted automatically whenever your application is not responding properly according to your threshold before your customer notice it.

Automatic alerts with relevant

Contextual information

Minimize customer impactHigh MTTR and value erosion

Uncover root of live issues quicklyTesting in production, Integrated incident management, Production debugging, Go to code / Go to memory

Problem

Solution

Value

Mean Time to Repair (MTTR)

Reduce MTTRReduce customer impact and increasing team efficiency

Quickly uncover the root of live issues• Detect if the problem is

your code or your dependencies

Understand what failed and why by drilling

down into failed tests

Quickly uncover the root of live issues• Detect if the problem is

your code or your dependencies

• Detect when and which release impacted your application.

Get the necessary information for

your development

team to review the exact code

deployed

Quickly uncover the root of live issues• Detect if the problem is

your code or your dependencies

• Detect when and which release impacted your application.

• Get advanced diagnostics directly in your Visual Studio to speed up resolution and increase efficiency between Developers and Operations.

Get the code/memory dump you need

directly in your Dev Environment

Lack of information to prioritize future investmentsPoor decision making, stale ideas

Prioritize and validate investment decisions using real-world dataUsage data

Problem

Solution

Value

Continuous learning

Continuous learning Increase delivery value

Continuously improve

• Identify systemic issues and trends affecting application and infrastructure health

• Prioritize new features, bug fixes and strategic direction based on qualitative and quantitative data

Valuable data at your finger tips

Validate your investments

The solution – Application Insights

Available

Is my application available and performing for users?

One Dashboard

ImprovingPerforming

What’s wrong?Show me suspicious code and test cases

Where do we invest next?Show me top features and customer

Usage patterns

Health Dashboards Notifications & Deep Insights

Usage Dashboards

Source Repos

Test Case Management

Feedback Management

Build and Continuous Integration

Agile Planning

Team Rooms

Team Foundation Server

Visual Studio Online

Questions?

Tuesday (today) 4:30-5:30

The session will include:• Practical guidance on application analytics implementations• Demonstrations of another application analytics option

• Functionality already included with Visual Studio 2012 and 2013• On-premises solution (analytics storage and Team Foundation Server

integration)• Support for non-MSFT runtimes

Application Analytics: What every application stakeholder should know

Ed BlankenshipEdBlank@microsoft.com

@EdBlankenship

http://www.edsquared.com

http://bit.ly/TFS2013Book

© 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Telemetry is collected at each component: usage, performance, exception, crash, event, synthetic transactions, logs, developer supplied event data

Telemetry arrives to Application Insights service where it is processed

A 360 degree view of the application: keep it available, performing and improving

Application Insights service

Application Insights