Cloud Expo (Keynote) - Static vs Dynamic
-
Upload
lee-atchison -
Category
Technology
-
view
65 -
download
3
Transcript of Cloud Expo (Keynote) - Static vs Dynamic
Life’s Too Short…... for Cloud without Analytics Monitoring the Dynamic Nature of Cloud Computing
Lee Atchison, Principal Cloud Architect and Advocate at New Relic, Inc.
Confidential ©2008-16NewRelic, Inc. Allrights reserved.
@leeatchison leeatchison
2
SafeHarbor
Confidential ©2008-16NewRelic, Inc. Allrights reserved.
This document and the information herein (including any information that may be incorporated by reference) is provided for informationalpurposes only and should not be construed as an offer, commitment, promiseor obligation on behalf of New Relic, Inc. (“New Relic”) to sellsecurities or deliver any product, material, code, functionality, or other feature. Any information provided hereby is proprietary to New Relicand may not be replicated or disclosed without New Relic’s expresswritten permission.
Such information may contain forward-looking statementswithin themeaning of federal securities laws. Any statement that is not a historicalfact or refers to expectations, projections, futureplans, objectives, estimates, goals, or other characterizations of future events is a forward-looking statement. These forward-looking statements can often be identified as such because the context of the statement will includewordssuch as “believes,” “anticipates,”, “expects” or words of similar import.
Actual results may differ materially from those expressed in these forward-looking statements, which speak only as of the date hereof, andare subject to change at any time without notice. Existing and prospective investors, customers and other third parties transacting businesswith New Relic are cautioned not to place undue reliance on this forward-looking information. The achievement or success of the matterscovered by such forward-looking statements are based on New Relic’s current assumptions, expectations, and beliefs and are subject tosubstantial risks, uncertainties, assumptions, and changes in circumstances that may cause the actual results, performance, or achievementsto differ materially from those expressed or implied in any forward-looking statement. Further information on factors that could affect suchforward-looking statements is included in the filingswemake with theSEC from time to time. Copies of thesedocumentsmay be obtained byvisiting New Relic’s Investor Relationswebsite at http://ir.newrelic.comor theSEC’swebsite at www.sec.gov.
New Relic assumes no obligation and does not intend to update these forward-looking statements, except as required by law. New Relicmakes no warranties, expressed or implied, in this documentor otherwise, with respect to the information provided.
3
WhoamI?
Confidential ©2008-16NewRelic, Inc. Allrights reserved.
Specializein:
Cloudcomputing
Services&Microservices
Scalability,Availability
28yearsinindustry7inAmazonRetail&AWS(BuiltSW/VGAppStore,AWSElasticBeanstalk)
4inNewRelic(ArchitectureLead,Cloud,ServiceMigration)
@leeatchison leeatchison
4
Wewantbetterappsfaster
Confidential ©2008-16NewRelic, Inc. Allrights reserved.
DynamicEnvironment
BetterDataCenter
Howdoweusethecloudtoaccomplishthis?
CloudasaBetterDataCenter
6
Cloudasa“Better DataCenter”
Confidential ©2008-16NewRelic, Inc. Allrights reserved.
Resourcesareallocatedtouses,justlikeinadatacenter
7
Cloudasa“Better DataCenter”
Confidential ©2008-16NewRelic, Inc. Allrights reserved.
Resourcesareallocatedtouses,justlikeinadatacenter
Provisioning processisfaster
8
Cloudasa“Better DataCenter”
Confidential ©2008-16NewRelic, Inc. Allrights reserved.
Resourcesareallocatedtouses,justlikeinadatacenter
Lifetimeofcomponents isrelativelylong
Provisioning processisfaster
9
Cloudasa“Better DataCenter”
Confidential ©2008-16NewRelic, Inc. Allrights reserved.
Resourcesareallocatedtouses,justlikeinadatacenter
Lifetimeofcomponents isrelativelylong
Provisioning processisfaster
Capacityplanning isstillimportantand
stillapplies
10
Whyusea“Better DataCenter”?
Confidential ©2008-16NewRelic, Inc. Allrights reserved.
11
Whyusea“Better DataCenter”?
Confidential ©2008-16NewRelic, Inc. Allrights reserved.
AddnewCapacity(faster)
12
Whyusea“Better DataCenter”?
Confidential ©2008-16NewRelic, Inc. Allrights reserved.
ImproveApplicationAvailability(redundancy)
AddnewCapacity(faster)
13
Whyusea“Better DataCenter”?
Confidential ©2008-16NewRelic, Inc. Allrights reserved.
ComplianceImproveApplicationAvailability(redundancy)
AddnewCapacity(faster)
14
Whoisimpacted?
Confidential ©2008-16NewRelic, Inc. Allrights reserved.
BetterDataCenter
Operations Development
15
Whoisimpacted?
Confidential ©2008-16NewRelic, Inc. Allrights reserved.
BetterDataCenter
CanIscalemyserverfleet?Canappsrunanywhere?Howdotheyperforminthecloud?
Operations Development
16
Whoisimpacted?
Confidential ©2008-16NewRelic, Inc. Allrights reserved.
BetterDataCenter
CanIscalemyserverfleet?Canappsrunanywhere?Howdotheyperforminthecloud?
Operations
Datacenterisadatacenter…
Development
17
Whoisimpacted?
Confidential ©2008-16NewRelic, Inc. Allrights reserved.
BetterDataCenter FasterApplicationLaunch/Deploy=
BetterDataCenter
CanIscalemyserverfleet?Canappsrunanywhere?Howdotheyperforminthecloud?
Operations
Datacenterisadatacenter…
Development
18
HowdoImonitorit?
Confidential ©2008-16NewRelic, Inc. Allrights reserved.
Similartomonitoringanyotherdatacenter…
19
Monitoringanapplication
Confidential ©2008-16NewRelic, Inc. Allrights reserved.
Typical Server / EC2 Instance
• Application & Application Microservices
• Server OS• Hardware (virtual)
EC2Instance
Application&ApplicationMicroservices
ServerOS
Server(Virtual)Hardware
20
AWSMonitoring
Confidential ©2008-16NewRelic, Inc. Allrights reserved.
CloudWatch
• Monitors:– EC2 instance– Virtualization– Hardware– [CPU / Disk / Networking]
• Doesn’t know about:– Server OS– Memory / Filesystem– Processes– Application
• Latency• Error rates• Internal insights
EC2Instance
Application&ApplicationMicroservices
ServerOS
Server(Virtual)Hardware
CloudWatch
AWSCONSOLE
21
NewRelicMonitoring
Confidential ©2008-16NewRelic, Inc. Allrights reserved.
New Relic
• Monitors (Server):– How O.S. is performing– Processes– Hardware
• Monitors (Application):– App health– App performance– Microservices
• Doesn’t know– Virtualization
EC2Instance
Application&ApplicationMicroservices
NewRelicApplicationMonitoring
ServerOS
Server(Virtual)Hardware
NewRelicServer
Monitoring
CloudWatch
DASHBOARDS
AWSCONSOLE
22
AWSçèNewRelicworktogether
Confidential ©2008-16NewRelic, Inc. Allrights reserved.
AWS / CloudWatch
• Visibility into virtualization• CPU / Disk / Networking
New Relic
• CPU / Disk / Networking• Memory / Filesystem• Processes• Infrastructure components• Application / Microservices:– Latency– Error rates– App insights
EC2Instance
Application&ApplicationMicroservices
NewRelicApplicationMonitoring
ServerOS
Server(Virtual)Hardware
NewRelicServer
Monitoring
CloudWatch
DASHBOARDS
CloudWatchmonitors
NewRelicmonitors
AWSCONSOLE
CloudasaDynamicTool
24
Cloudasa“DynamicToolforDynamicApps”
Confidential ©2008-16NewRelic, Inc. Allrights reserved.
Useonlytheresourcesyouneed
25
Cloudasa“DynamicToolforDynamicApps”
Confidential ©2008-16NewRelic, Inc. Allrights reserved.
Useonlytheresourcesyouneed
Allocate/de-allocateresourceson
thefly
26
Cloudasa“DynamicToolforDynamicApps”
Confidential ©2008-16NewRelic, Inc. Allrights reserved.
Useonlytheresourcesyouneed
Resourceallocationisanintegralpartofyourapplicationarchitecture
Allocate/de-allocateresourceson
thefly
27
DynamicCloud
Confidential ©2008-16NewRelic, Inc. Allrights reserved.
Resourcesare:
Application isawareofandiscontrolling traditionalOPs
resources
De-allocatedConsumedAllocated
AutoScale
28
DynamicCloud
Confidential ©2008-16NewRelic, Inc. Allrights reserved.
Dockercontainers:
• Quicker/cheaperstartup/shutdownthanEC2instances
• EasytoconsumeDockercontainersmuchlikeyoudo“processes”
• Perform jobs:– Inascript– Offofsomequeueofjobrequests
29
DynamicCloud
Confidential ©2008-16NewRelic, Inc. Allrights reserved.
100
10K
1M
3.7M
83days 333days
DockerContainerAge(Countvs.Hours)
30
DynamicCloud
Confidential ©2008-16NewRelic, Inc. Allrights reserved.
950,00011%underoneminute
DockerContainerAge(byMinuteUnderandHour)
EC2AutoScaling
31
DynamicCloudTechnologies
Confidential ©2008-16NewRelic, Inc. Allrights reserved.
Mobile/IoTDynamicrouting
Loadbalancing
Datatransport
Queuesandnotifications
Docker
DynamicCloudisaboutscaling
32
HowdoImonitortheDynamicCloud?
Confidential ©2008-16NewRelic, Inc. Allrights reserved.
DynamicCloudhasuniquemonitoringrequirements…
33
Responsibility (DynamicCloud)
Confidential ©2008-16NewRelic, Inc. Allrights reserved.
ServerOS
Server(Virtual)Hardware
Application&ApplicationMicroservices
Application&ApplicationMicroservices
Application&ApplicationMicroservices
Provisioning
Responsible for the parts you care about
• Application & Application Microservices
Let cloud manage rest
• Infrastructure• Allocation/Provisioning• Scaling
34
AWSInfrastructureçèNewRelicworktogether
Confidential ©2008-16NewRelic, Inc. Allrights reserved.
ServerOS
Server(Virtual)Hardware
CloudWatch
DASHBOARDS
Application&ApplicationMicroservices
Application&ApplicationMicroservices
Application&ApplicationMicroservices
ProvisioningAWS
CONSOLE
35
AWSInfrastructureçèNewRelicworktogether
Confidential ©2008-16NewRelic, Inc. Allrights reserved.
ServerOS
Server(Virtual)Hardware
CloudWatch
DASHBOARDS
Application&ApplicationMicroservices
Application&ApplicationMicroservices
Application&ApplicationMicroservices
ProvisioningAWS
CONSOLE
36
AWSInfrastructureçèNewRelicworktogether
Confidential ©2008-16NewRelic, Inc. Allrights reserved.
ServerOS
Server(Virtual)Hardware
CloudWatch
DASHBOARDS
Application&ApplicationMicroservices
Application&ApplicationMicroservices
Application&ApplicationMicroservices
Provisioning
CloudWatch&AWSmonitoring
NewRelicmonitors
AWSCONSOLE
37
Howdoyoumonitorthis?
Confidential ©2008-16NewRelic, Inc. Allrights reserved.
ServerOS
Server(Virtual)Hardware
Application&ApplicationMicroservices
Application&ApplicationMicroservices
Application&ApplicationMicroservices
Provisioning
?Howdoyoumonitorthis?
38
Wherediditgo?Itwasjusthere!!!
Confidential ©2008-16NewRelic, Inc. Allrights reserved.
? Thethingyoumonitored10minutesago…...doesn’texistanymore!
39
DynamicCloud
Confidential ©2008-16NewRelic, Inc. Allrights reserved.
950,00011%underoneminute
DockerContainerAge(byMinuteUnderandHour)
40
Monitoring theDynamicCloud
Confidential ©2008-16NewRelic, Inc. Allrights reserved.
VerydifferentthanmonitoringtraditionalDataCentercomponents
Monitor theCloudComponents
themselves
Monitor thelifecycleofthe
CloudComponents
41
WhoisimpactedbyDynamicCloud?
Confidential ©2008-16NewRelic, Inc. Allrights reserved.
BetterDataCenter
CanIscalemyserverfleet?Canappsrunanywhere?Howdotheyperforminthecloud?
Operations
Datacenterisadatacenter…
Development
DynamicCloud
42
WhoisimpactedbyDynamicCloud?
Confidential ©2008-16NewRelic, Inc. Allrights reserved.
BetterDataCenter
CanIscalemyserverfleet?Canappsrunanywhere?Howdotheyperforminthecloud?
Operations
Datacenterisadatacenter…
Development
DynamicCloud
What isacontainer?WhydoIcare??Itwas justhere,wherediditgo???
43
WhoisimpactedbyDynamicCloud?
Confidential ©2008-16NewRelic, Inc. Allrights reserved.
BetterDataCenter
CanIscalemyserverfleet?Canappsrunanywhere?Howdotheyperforminthecloud?
Operations
Datacenterisadatacenter…
Development
DynamicCloud
What isacontainer?WhydoIcare??Itwas justhere,wherediditgo???
CloudarchitectureisintegraltotheapplicationarchitectureDevelopersdeeplyinvolvedincloudactivities
44
Changeisspeedingup
Confidential ©2008-16NewRelic, Inc. Allrights reserved.
TraditionalDataCenter
CloudDataCenter
DynamicCloud
DynamicCloudenablesbetterapplicationsfaster.
Good Better Best
Thewayyou’vedonethingsinthepastwon’tworkinthefuture.
45
DynamicCloud
Confidential ©2008-16NewRelic, Inc. Allrights reserved.
EC2
Serverrunningapplication/processes
Dockercontainer
Processrunningacommand
Thisishard
Thingshappenfasterbecauseof…
46
DynamicCloud
Confidential ©2008-16NewRelic, Inc. Allrights reserved.
EC2
Serverrunningapplication/processes
Dockercontainer
Processrunningacommand
Lambda
Function performingataskoroperation
TheFuturewithLambda
48
Microcomputing &AWSLambda
Confidential ©2008-16NewRelic, Inc. Allrights reserved.
• Newestentrancetothe“dynamiccloud”
• Provideseventdrivencomputecapabilities
49
Microcomputing &AWSLambda
Confidential ©2008-16NewRelic, Inc. Allrights reserved.
• Noinfrastructure toprovision
• Massivelysharedinfrastructure
50
WhyuseLambda?
Confidential ©2008-16NewRelic, Inc. Allrights reserved.
Lambdascripts
Runinresponsetoastatechangeoractioninthecloud
Stateless,“filters”Performquickactions
Virtuallynostartup/shutdown
cost
51
AWSLambda
Confidential ©2008-16NewRelic, Inc. Allrights reserved.
S3Bucket
DynamoDB
APIGateway
SQS
RESOURCESSOME
• TakesaneventfromanAWSresource(ATrigger)
52
AWSLambda
Confidential ©2008-16NewRelic, Inc. Allrights reserved.
S3Bucket
DynamoDB
APIGateway
SQS
RESOURCESSOME
LambdaScript
• TakesaneventfromanAWSresource(ATrigger)
• Createsaninstancetoexecute
LambdaInstance
53
AWSLambda
Confidential ©2008-16NewRelic, Inc. Allrights reserved.
S3Bucket
DynamoDB
APIGateway
SQS
RESOURCESSOME
S3Bucket
APIGateway SQS
RESOURCESSOMELambdaScript
• TakesaneventfromanAWSresource(ATrigger)
• Createsaninstancetoexecute
• CanimpactoriginalordifferentAWSResource
LambdaInstance
54
AWSLambda
Confidential ©2008-16NewRelic, Inc. Allrights reserved.
S3Bucket
DynamoDB
APIGateway
SQS
RESOURCESSOME
S3Bucket
APIGateway SQS
RESOURCESSOMELambdaScript
LambdaInstance
LambdaInstance
LambdaInstance
LambdaInstance
LambdaInstance
LambdaInstance
LambdaInstance
LambdaInstance
LambdaInstance
• TakesaneventfromanAWSresource(ATrigger)
• Createsaninstancetoexecute
• CanimpactoriginalordifferentAWSResource
• Anynumberofinstancescanrunatatime
55
MonitoringLambdaScripts
Confidential ©2008-16NewRelic, Inc. Allrights reserved.
Lesslikeservermonitoring /Morelikewebapplicationmonitoring
WeCareAbout
WeDon’tCareAbout
• Runtime(average,extremes–TP90/TP99)
• Statisticalmetrics
• Errorratesandotherdeviations fromnorm
• “Drilldown”intoindividual “runs”
• Detailsaboutall”runs”
• Server/infrastructuremetrics
56
MonitoringLambda
Confidential ©2008-16NewRelic, Inc. Allrights reserved.
Morelikeapplicationperformancemonitoringthaninfrastructuremonitoring
57
MonitoringLambda
Confidential ©2008-16NewRelic, Inc. Allrights reserved.
Morelikeapplicationperformancemonitoringthaninfrastructuremonitoring
58
Changeisspeedingup
Confidential ©2008-16NewRelic, Inc. Allrights reserved.
TraditionalDataCenter
CloudDataCenter
DynamicCloud
DynamicCloudenablesbetterapplicationsfaster.Therateofchangeisincreasing…
Good Better Best
Thewayyou’vedonethingsinthepastwon’tworkinthefuture.
59
Monitoring justtheserver
Confidential ©2008-16NewRelic, Inc. Allrights reserved.
EC2Instance
Application&ApplicationMicroservices
ServerOS
Server(Virtual)Hardware
CloudWatch
Worked when rate of change was low…
AWSCONSOLE
Monitoringjusttheserver
ServerOS
Server(Virtual)Hardware
Application&ApplicationMicroservices
Application&ApplicationMicroservices
Application&ApplicationMicroservices
Provisioning
Insufficient in the cloud:
• Rate of change is faster• Problems come up quicker• “Server” isn’t a server anymore• “Provisioning” isn’t provisioning anymore
Youneedtoptobottommonitoring…
Youneedfullstackaccountability...
61
NewRelicenablesaccountability betweenyourcode&AWS
Confidential ©2008-16NewRelic, Inc. Allrights reserved.
Customers
Mobile/Apps/Browser
On-Premises
OnPremisesRelationalData
EC2
AWSContainerService
AWSRDSSyntheticCustomers
S3
NoSQL
AWSStorageServices
YourResponsibilities
§ Applicationcode&3rd partyservices
§ Apparchitecture
§ Customerexperience
§ On-Premisescomponents
NoSQLAWSResponsibility:
§ ServiceAvailability &Performance
§ Provisioning&operationofDC
§ Isolation&securityofresources
§ Servicemaintenance&innovation
ArchitectingforScaleBy:LeeAtchisonPublishedby:O’ReillyMedia,Available:June2016www.architectingforscale.com
WanttoLearnMore?
“FlyTwoMistakesHigh”AGuidetoNotCrashing
5:40pmtoday–HotTrack1|Cloud(Room1A04)
KeepingHighAvailability
©2008-15NewRelic,Inc.Allrightsreserved.
Thank you.
LeeAtchisonPrincipal Cloud Architect andAdvocate atNewRelic, Inc.
Architecting forScalePublishedby:O’Reilly Media,Available: June2016www.architectingforscale.com
@leeatchison leeatchison