DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

78
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. AWS re:INVENT A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda DEV209

Transcript of DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

Page 1: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

AWS re:INVENTA Fie ld Guide to Moni tor ing in the Cloud:

From Li f t and Shi f t to AWS Lambda

D E V 2 0 9

Page 2: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Hello

Page 3: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

“We count everything in baseball.”

-Billy Chapel

Played by Kevin Costner in

For Love of the Game

Page 4: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Hello

Page 5: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Timex Sinclair 1000

Senior Cloud Architect

in/kupsand

Page 6: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Compaq DeskPro

Manager, Site Reliability Engineering

in/rob-gindes

Page 7: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

…is the empirical analysis

of baseball, especially baseball

statistics that measure in-game

activity.

-term coined by Bill James

SABERMETRICS…

Page 8: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

WorldHello

Page 9: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

10 PRINT “Hello World”

MY FIRST PROGRAM…

Page 10: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

TWO MINUTES LATER…

Page 11: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

5 REM My first program

10 PRINT “Hello World”

VERSION 1.1 (WELL DOCUMENTED)

Page 12: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

<HTML>

<HEAD>

<TITLE>

My first web page

</TITLE>

</HEAD>

<BODY>

<H1>Hello World</H1>

</BODY>

</HTML>

MY FIRST WEB PAGE…

Page 13: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

SuccessProve

Page 14: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

• Monitoring has changed

• Migration 101

• New Relic Platform

• Gannett – USA Today

WHAT WE’LL COVER…

Page 15: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

THINGS HAVE CHANGED…

1 Deploy

per quarter

Page 16: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

THINGS HAVE CHANGED…

2 Deploys

per month

Page 17: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

THINGS HAVE CHANGED…

2 Deploys

per week

Page 18: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

THINGS HAVE CHANGED…

Many Deploys

per day

Page 19: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

DATA VOLUME HAS INCREASED EXPONENTIALLY …

Web Application

Before

1 application

3 large servers

1 database

1 data center

1 deploy/quarter

Page 20: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

DATA VOLUME HAS INCREASED EXPONENTIALLY …

Web Application

Now

30 containers

4 services

10 small instances

1 load balancer

2 databases

2 cloud regions

Many deploys/day

Page 21: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

CUSTOMER EXPERIENCE

Page 22: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

APPLICATIONS

Page 23: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

INFRASTRUCTURE

Page 24: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Migration 101

MIGRATION 101

Start with the little things

Page 25: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

QUESTIONS TO ASK…

• How are we performing now?

• Are we stable?

• Are we ready to migrate?

Page 26: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

NEW RELIC SYNTHETICS

An automated source of

performance data

Page 27: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

BASELINE CURRENT STATE

Page 28: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

COMPARE WITH MIGRATED STATE

Page 29: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

CLOUD BENEFIT: AWS INTEGRATIONS

Page 30: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

NEW RELIC @ GANNETT

Page 31: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

START BASIC, BUT QUICKLY!

This scripting action is the basis for

nearly all scripted browsers.

Page 32: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

MORE ADVANCED

Page 33: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

EASY TO SETUP

From

Where?

How Often?

Name &

Apdex

Page 34: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

NEW RELIC BROWSER

Get actionable performance

visibility in the wild

Page 35: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

REAL USERS

Page Load Time

Page 36: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

DRILL DOWN

Session

TracesJS Errors

Page 37: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

NEW RELIC @ GANNETT

Page 38: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

NEW RELIC MOBILE

Understand how your apps

perform on the small screen

Page 39: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

MOBILE OVERVIEW

Launches

Crashes Errors

Response

Time

Interactions

Page 40: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

MOBILE SUPPORTED PLATFORMS

• Ant

• Eclipse

• Gradle and Android Studio

• Maven

• Legacy Android 2.2

• Objective-C

• Swift

• CocoaPods

Android iOS

Page 41: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

CUSTOMER EXPERIENCE

Page 42: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

APPLICATIONS

Page 43: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

NEW RELIC APM

Build, deploy, and maintain great

software with better monitoring for

the best customer experience

(Application Performance Monitoring)

Page 44: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

APM – SERVICE MAP

Page 45: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

APM – HEALTH MAP

Page 46: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

APM – SEVEN LANGUAGES

Go: Import agent into application

Java: Unzip agent files & add line to JVM arguments

.Net: Use MSI installer on server

Page 47: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

APM – SEVEN LANGUAGES

Node: Use NPM to install dependency & add as a required file in application

PHP: Include as PHP extension

Python: Use PIP to install New Relic as dependency

Ruby: Include New Relic as Gem file

Page 48: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

NEW RELIC @ GANNETT

Page 49: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

RECAP

Page 50: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

INFRASTRUCTURE

Page 51: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

NEW RELIC INFRASTRUCTURE

Complete dynamic infrastructure

and server monitoring

Page 52: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

INFRASTRUCTURE OVERVIEW

Load

CPU

Events

Memory

APM

Page 53: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

NEW RELIC @ GANNETT

Page 54: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

NEW RELIC @ GANNETT

Page 55: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

MANUAL DEPLOYMENT

Linux: BASH script

Windows: Uses MSI install package or PowerShell script

Page 56: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

DEPLOY QUICKLY

Linux: User Data

http://bit.ly/nr-0toDataIn60

Page 57: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

AUTOMATED INSTALLATION

AWS

Systems

Manager

• Ansible

• Chef

• Puppet

• AWS Elastic Beanstalk

• AWS Systems Manager

Page 58: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

NEW RELIC @ GANNETT

Page 59: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

NEW RELIC @ GANNETT

Page 60: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

NEW RELIC @ GANNETT

Page 61: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

NEW RELIC @ GANNETT

Page 62: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

SuccessProve

Page 63: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

WHAT WE’VE COVERED

Page 64: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Migration 101

NEW RELIC PLATFORM

Page 65: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

NEW RELIC INSIGHTS

Organize. Visualize. Evaluate.

All your data in one place

Page 66: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

DASHBOARD 1 OF 3

Page 67: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

DASHBOARD 2 OF 3

Page 68: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

DASHBOARD 3 OF 3

Page 69: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

NRQL EXAMPLE 1 OF 2

SELECT count(*) FROM Transaction since 1 day ago FACET httpResponseCode

Page 70: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

NRQL EXAMPLE 2 OF 2

SELECT (((uniquecount(PotentialCartGrandTotal))-

(uniquecount(PurchasedCartGrandTotal))/(uniquecount(PotentialCartGrandTotal))))

AS '(%) Carts Left Without Purchase' FROM PageView SINCE today

Page 71: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

MOBILE INTERFACE

• Access anywhere

• Key Transactions

• Event notifications

Page 72: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

1.5BMETRICS AND EVENTS

PER MINUTE

Page 73: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

BASELINE ALERTING

• Best algorithm chosen automatically

• Metric data and NRQL queries

• Surface abnormalities

Page 74: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

APM ERROR PROFILES

Page 75: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

RADAR

Page 76: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Migration 101

NEW RELIC PLATFORM

Page 77: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Senior Cloud Architect

in/kupsand

Manager, Site Reliability Engineering

in/rob-gindes

Page 78: DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS Lambda

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

THANK YOU!

Vis i t New Rel ic

at booth # 2412