Application Monitoring in a Post-Server World: Why Data Context is Critical
-
Upload
new-relic -
Category
Data & Analytics
-
view
208 -
download
1
Transcript of Application Monitoring in a Post-Server World: Why Data Context is Critical
![Page 1: Application Monitoring in a Post-Server World: Why Data Context is Critical](https://reader036.fdocuments.in/reader036/viewer/2022062522/58a84f3c1a28ab210b8b58cd/html5/thumbnails/1.jpg)
![Page 2: Application Monitoring in a Post-Server World: Why Data Context is Critical](https://reader036.fdocuments.in/reader036/viewer/2022062522/58a84f3c1a28ab210b8b58cd/html5/thumbnails/2.jpg)
Confidential ©2008-15 New Relic, Inc. All rights reserved. 2
![Page 3: Application Monitoring in a Post-Server World: Why Data Context is Critical](https://reader036.fdocuments.in/reader036/viewer/2022062522/58a84f3c1a28ab210b8b58cd/html5/thumbnails/3.jpg)
The Decline of the Server
Containerization Docker Amazon ECS
Zero config infrastructure-less compute AWS Lambda
©2008-15 New Relic, Inc. All rights reserved.
![Page 4: Application Monitoring in a Post-Server World: Why Data Context is Critical](https://reader036.fdocuments.in/reader036/viewer/2022062522/58a84f3c1a28ab210b8b58cd/html5/thumbnails/4.jpg)
Lessons learned from Docker
©2008-15 New Relic, Inc. All rights reserved.
![Page 5: Application Monitoring in a Post-Server World: Why Data Context is Critical](https://reader036.fdocuments.in/reader036/viewer/2022062522/58a84f3c1a28ab210b8b58cd/html5/thumbnails/5.jpg)
Docker is the app’s lightweight VM
Long livedShort lived
VM
AmazonEC2
©2008-15 New Relic, Inc. All rights reserved.
![Page 6: Application Monitoring in a Post-Server World: Why Data Context is Critical](https://reader036.fdocuments.in/reader036/viewer/2022062522/58a84f3c1a28ab210b8b58cd/html5/thumbnails/6.jpg)
Confidential ©2008-15 New Relic, Inc. All rights reserved. 6
Well, that was surprising
49ACCOUNTS USING DOCKER
IN LAST 24 HOURS
9,974CONTAINERS REPORTING IN
IN LAST 24 HOURS
©2008-15 New Relic, Inc. All rights reserved.
![Page 7: Application Monitoring in a Post-Server World: Why Data Context is Critical](https://reader036.fdocuments.in/reader036/viewer/2022062522/58a84f3c1a28ab210b8b58cd/html5/thumbnails/7.jpg)
Confidential ©2008-15 New Relic, Inc. All rights reserved. 7
Apparent usage
Long livedShort lived
AmazonEC2
VM
©2008-15 New Relic, Inc. All rights reserved.
![Page 8: Application Monitoring in a Post-Server World: Why Data Context is Critical](https://reader036.fdocuments.in/reader036/viewer/2022062522/58a84f3c1a28ab210b8b58cd/html5/thumbnails/8.jpg)
Confidential ©2008-15 New Relic, Inc. All rights reserved. 8
Along came New Relic Synthetics…
Test external availability and performance User authored selenium scripts run in our data
center Each run in its own container for security
isolation Most run for under a minute
©2008-15 New Relic, Inc. All rights reserved.
![Page 9: Application Monitoring in a Post-Server World: Why Data Context is Critical](https://reader036.fdocuments.in/reader036/viewer/2022062522/58a84f3c1a28ab210b8b58cd/html5/thumbnails/9.jpg)
Confidential ©2008-15 New Relic, Inc. All rights reserved. 9
Disposable compute container
Long livedShort lived
VM
AmazonEC2
AWSLambd
a
©2008-15 New Relic, Inc. All rights reserved.
![Page 10: Application Monitoring in a Post-Server World: Why Data Context is Critical](https://reader036.fdocuments.in/reader036/viewer/2022062522/58a84f3c1a28ab210b8b58cd/html5/thumbnails/10.jpg)
Confidential ©2008-15 New Relic, Inc. All rights reserved.
What the heck’s going on?
Long livedShort lived? ? ?
VM
AmazonEC2
AWSLambd
a
©2008-15 New Relic, Inc. All rights reserved.
![Page 11: Application Monitoring in a Post-Server World: Why Data Context is Critical](https://reader036.fdocuments.in/reader036/viewer/2022062522/58a84f3c1a28ab210b8b58cd/html5/thumbnails/11.jpg)
Confidential ©2008-15 New Relic, Inc. All rights reserved.
We’re Data Nerds!
©2008-15 New Relic, Inc. All rights reserved.
![Page 12: Application Monitoring in a Post-Server World: Why Data Context is Critical](https://reader036.fdocuments.in/reader036/viewer/2022062522/58a84f3c1a28ab210b8b58cd/html5/thumbnails/12.jpg)
Docker container age, count vs. hours
100
10K
1M
3.7 M
83 days 333 days
©2008-15 New Relic, Inc. All rights reserved.
![Page 13: Application Monitoring in a Post-Server World: Why Data Context is Critical](https://reader036.fdocuments.in/reader036/viewer/2022062522/58a84f3c1a28ab210b8b58cd/html5/thumbnails/13.jpg)
Docker container age, count vs. hours
100
10K
1M
3.7 M
VM’ish
©2008-15 New Relic, Inc. All rights reserved.
![Page 14: Application Monitoring in a Post-Server World: Why Data Context is Critical](https://reader036.fdocuments.in/reader036/viewer/2022062522/58a84f3c1a28ab210b8b58cd/html5/thumbnails/14.jpg)
Confidential ©2008-15 New Relic, Inc. All rights reserved.
Docker container age, count vs. hours
100
10K
1M
3.7 M
EC2’ish
©2008-15 New Relic, Inc. All rights reserved.
![Page 15: Application Monitoring in a Post-Server World: Why Data Context is Critical](https://reader036.fdocuments.in/reader036/viewer/2022062522/58a84f3c1a28ab210b8b58cd/html5/thumbnails/15.jpg)
Confidential ©2008-15 New Relic, Inc. All rights reserved.
Docker container age, count vs. hours
100
10K
1M
3.7 M
Lambda’ish
©2008-15 New Relic, Inc. All rights reserved.
![Page 16: Application Monitoring in a Post-Server World: Why Data Context is Critical](https://reader036.fdocuments.in/reader036/viewer/2022062522/58a84f3c1a28ab210b8b58cd/html5/thumbnails/16.jpg)
Confidential ©2008-15 New Relic, Inc. All rights reserved.
Container age, by hour under 24 hours
3,741,00046% under one hour
©2008-15 New Relic, Inc. All rights reserved.
![Page 17: Application Monitoring in a Post-Server World: Why Data Context is Critical](https://reader036.fdocuments.in/reader036/viewer/2022062522/58a84f3c1a28ab210b8b58cd/html5/thumbnails/17.jpg)
Confidential ©2008-15 New Relic, Inc. All rights reserved.
Container age, by minute under an hour
950,00011% under one minute
©2008-15 New Relic, Inc. All rights reserved.
![Page 18: Application Monitoring in a Post-Server World: Why Data Context is Critical](https://reader036.fdocuments.in/reader036/viewer/2022062522/58a84f3c1a28ab210b8b58cd/html5/thumbnails/18.jpg)
Confidential ©2008-15 New Relic, Inc. All rights reserved.
Container age, by minute under an hour
27% under 5 minutes (versus a VM?)
©2008-15 New Relic, Inc. All rights reserved.
![Page 19: Application Monitoring in a Post-Server World: Why Data Context is Critical](https://reader036.fdocuments.in/reader036/viewer/2022062522/58a84f3c1a28ab210b8b58cd/html5/thumbnails/19.jpg)
Confidential ©2008-15 New Relic, Inc. All rights reserved.
A surprising result
Long livedShort lived
VMVM
AmazonEC2
AWSLambd
a
©2008-15 New Relic, Inc. All rights reserved.
![Page 20: Application Monitoring in a Post-Server World: Why Data Context is Critical](https://reader036.fdocuments.in/reader036/viewer/2022062522/58a84f3c1a28ab210b8b58cd/html5/thumbnails/20.jpg)
Confidential ©2008-15 New Relic, Inc. All rights reserved.
June versus now: 5x data, same shape
©2008-15 New Relic, Inc. All rights reserved.
![Page 21: Application Monitoring in a Post-Server World: Why Data Context is Critical](https://reader036.fdocuments.in/reader036/viewer/2022062522/58a84f3c1a28ab210b8b58cd/html5/thumbnails/21.jpg)
The evolution of computation as a serviceShort startup time (orders mag.) allows very short lived computing
Containers only exist, and only for as long, as they provide value.
Full stop.
Containers are created Do their work Go away
©2008-15 New Relic, Inc. All rights reserved.
![Page 22: Application Monitoring in a Post-Server World: Why Data Context is Critical](https://reader036.fdocuments.in/reader036/viewer/2022062522/58a84f3c1a28ab210b8b58cd/html5/thumbnails/22.jpg)
Elements of monitoring computation as a service
A mere list of instances doesn’t scale, nor help
De-provisioned containers still contribute to knowledge
Raw metrics just table stakes
Context matters to identify computational intent
©2008-15 New Relic, Inc. All rights reserved.
![Page 23: Application Monitoring in a Post-Server World: Why Data Context is Critical](https://reader036.fdocuments.in/reader036/viewer/2022062522/58a84f3c1a28ab210b8b58cd/html5/thumbnails/23.jpg)
Monitoring servers
©2008-15 New Relic, Inc. All rights reserved.
![Page 24: Application Monitoring in a Post-Server World: Why Data Context is Critical](https://reader036.fdocuments.in/reader036/viewer/2022062522/58a84f3c1a28ab210b8b58cd/html5/thumbnails/24.jpg)
Monitoring computation
©2008-15 New Relic, Inc. All rights reserved.
![Page 25: Application Monitoring in a Post-Server World: Why Data Context is Critical](https://reader036.fdocuments.in/reader036/viewer/2022062522/58a84f3c1a28ab210b8b58cd/html5/thumbnails/25.jpg)
Confidential ©2008-15 New Relic, Inc. All rights reserved.
Low friction install
New Relic AWS EC2 Beta addresses
Managing the dynamic nature of AWS
Managing the scale of AWS
©2008-15 New Relic, Inc. All rights reserved.
![Page 26: Application Monitoring in a Post-Server World: Why Data Context is Critical](https://reader036.fdocuments.in/reader036/viewer/2022062522/58a84f3c1a28ab210b8b58cd/html5/thumbnails/26.jpg)
Increased visibility
Application Monitoring
Server Monitoring
EC2 AWS Metadata
©2008-15 New Relic, Inc. All rights reserved.
![Page 27: Application Monitoring in a Post-Server World: Why Data Context is Critical](https://reader036.fdocuments.in/reader036/viewer/2022062522/58a84f3c1a28ab210b8b58cd/html5/thumbnails/27.jpg)
SaaS to SaaS monitoring, under one minute
©2008-15 New Relic, Inc. All rights reserved.
![Page 28: Application Monitoring in a Post-Server World: Why Data Context is Critical](https://reader036.fdocuments.in/reader036/viewer/2022062522/58a84f3c1a28ab210b8b58cd/html5/thumbnails/28.jpg)
Dynamic management
Provides AWS status
Maintains accurate EC2 list
Detects blind spots
Shows instance state
©2008-15 New Relic, Inc. All rights reserved.
![Page 29: Application Monitoring in a Post-Server World: Why Data Context is Critical](https://reader036.fdocuments.in/reader036/viewer/2022062522/58a84f3c1a28ab210b8b58cd/html5/thumbnails/29.jpg)
Context via tags and metadata as labels
AWS metadata
AWS custom
tags
©2008-15 New Relic, Inc. All rights reserved.
![Page 30: Application Monitoring in a Post-Server World: Why Data Context is Critical](https://reader036.fdocuments.in/reader036/viewer/2022062522/58a84f3c1a28ab210b8b58cd/html5/thumbnails/30.jpg)
EC2 instance name
AWS metadata
Custom label
Customer example
©2008-15 New Relic, Inc. All rights reserved.
![Page 31: Application Monitoring in a Post-Server World: Why Data Context is Critical](https://reader036.fdocuments.in/reader036/viewer/2022062522/58a84f3c1a28ab210b8b58cd/html5/thumbnails/31.jpg)
New Relic by instance typeSelected
labelInstance
countHealth status
©2008-15 New Relic, Inc. All rights reserved.
![Page 32: Application Monitoring in a Post-Server World: Why Data Context is Critical](https://reader036.fdocuments.in/reader036/viewer/2022062522/58a84f3c1a28ab210b8b58cd/html5/thumbnails/32.jpg)
New Relic by availability zone
©2008-15 New Relic, Inc. All rights reserved.
![Page 33: Application Monitoring in a Post-Server World: Why Data Context is Critical](https://reader036.fdocuments.in/reader036/viewer/2022062522/58a84f3c1a28ab210b8b58cd/html5/thumbnails/33.jpg)
New Relic by instance type in us-east-1
©2008-15 New Relic, Inc. All rights reserved.
![Page 34: Application Monitoring in a Post-Server World: Why Data Context is Critical](https://reader036.fdocuments.in/reader036/viewer/2022062522/58a84f3c1a28ab210b8b58cd/html5/thumbnails/34.jpg)
Confidential ©2008-15 New Relic, Inc. All rights reserved.
Future requirements for monitoring toolsThe obvious ones
Should handle scale
Should handle dynamic lifecycle
of resources
The less obvious ones
It’s a big data problem
Ops needs ways of quickly pivoting and
drilling in
Deeper understanding requires analytics (raw metrics not
enough) ©2008-15 New Relic, Inc. All rights reserved.
![Page 35: Application Monitoring in a Post-Server World: Why Data Context is Critical](https://reader036.fdocuments.in/reader036/viewer/2022062522/58a84f3c1a28ab210b8b58cd/html5/thumbnails/35.jpg)
We all love… … and yet
Common AWS scenarios
No large infrastructure build out
Quickly provision
Scale out to meet demand
Am I under-provisioned?
Am I over-provisioned?
How well am I responding to demand?
©2008-15 New Relic, Inc. All rights reserved.
![Page 36: Application Monitoring in a Post-Server World: Why Data Context is Critical](https://reader036.fdocuments.in/reader036/viewer/2022062522/58a84f3c1a28ab210b8b58cd/html5/thumbnails/36.jpg)
Prototype examples of Analytics
Application and Server metrics
Enriched with context from AWS
As New Relic Insights events
©2008-15 New Relic, Inc. All rights reserved.
![Page 37: Application Monitoring in a Post-Server World: Why Data Context is Critical](https://reader036.fdocuments.in/reader036/viewer/2022062522/58a84f3c1a28ab210b8b58cd/html5/thumbnails/37.jpg)
Detecting under-provisioned
Hmm, that’s bad
The smoking gun Aha!
©2008-15 New Relic, Inc. All rights reserved.
![Page 38: Application Monitoring in a Post-Server World: Why Data Context is Critical](https://reader036.fdocuments.in/reader036/viewer/2022062522/58a84f3c1a28ab210b8b58cd/html5/thumbnails/38.jpg)
Detecting over-provisionedHmm, that’s too
good
Aha!That’s a waste
©2008-15 New Relic, Inc. All rights reserved.
![Page 39: Application Monitoring in a Post-Server World: Why Data Context is Critical](https://reader036.fdocuments.in/reader036/viewer/2022062522/58a84f3c1a28ab210b8b58cd/html5/thumbnails/39.jpg)
Evaluating availability elasticity
Through scale outBut never
de-provisioned
Response time settles back
Increased load
©2008-15 New Relic, Inc. All rights reserved.
![Page 40: Application Monitoring in a Post-Server World: Why Data Context is Critical](https://reader036.fdocuments.in/reader036/viewer/2022062522/58a84f3c1a28ab210b8b58cd/html5/thumbnails/40.jpg)
Confidential ©2008-15 New Relic, Inc. All rights reserved.
The Ultimate AWS control panel
RESOURCES CUSTOMER EXPERIENCE COST
©2008-15 New Relic, Inc. All rights reserved.
![Page 41: Application Monitoring in a Post-Server World: Why Data Context is Critical](https://reader036.fdocuments.in/reader036/viewer/2022062522/58a84f3c1a28ab210b8b58cd/html5/thumbnails/41.jpg)
newrelic.com/aws
Sign up for Beta notificationAWS Monitoring resources
Demo videosCome by the booth!
![Page 42: Application Monitoring in a Post-Server World: Why Data Context is Critical](https://reader036.fdocuments.in/reader036/viewer/2022062522/58a84f3c1a28ab210b8b58cd/html5/thumbnails/42.jpg)