devOps - Katedra počítačov a informatiky the visual evidence and full ... § Delphix (Database...
Transcript of devOps - Katedra počítačov a informatiky the visual evidence and full ... § Delphix (Database...
§Introduction§ContinuousBusinessPlanning§CollaborativeDevelopment§ContinuousTesting§ContinuousReleaseandDeployment§ContinuousMonitoring§ContinuousCustomerFeedbackandOptimization§DevOpsinBlueMix
IssueswithtraditionalsoftwaredeliverymethodsBusinessesarechallengedtomeettimepressureswithqualitysoftware.
TypicalSoftwareDeliveryPainPoints:
*Forrester/IBMStudy:ANewViewofIBM’sOpportunityforIntegratedOptimizedSystemsAddress,2011**Forrester“FiveWaysToStreamlineReleaseManagement”,2011
experiencedelaysareduetoconfigurationanddeployment.
41%ofallnewITprojectsare
deliveredlate.
34%applicationsarerolledbackduetoqualityissuesescapinginto
production.
51%
GAPGAPGAPGAP
Business Owners CustomersIT OperationsDevelopment
& TestLine of
Business
Ittakes4– 6weeks tocompleteasmallrelease.
Forcesofchange
Mobileandsocialarechangingcustomerexpectations.
FocusofITischangingfrom“systemsofrecord”to“systemofengagement”.
CloudandtechnologyisblurringthetraditionalrolesbetweentheDevandOpsteams.
Acceleratessoftwaredelivery–
forfastertimetovalue
Balancesspeed,cost,quality,andrisk–
forincreasedcapacitytoinnovate
Reducestimeforcustomerfeedback–
forimprovedcustomerexperience
ContinuousCustomer
FeedbackandOptimization
CollaborativeDevelopmentandContinuousIntegration
ContinuousReleaseandDeployment
ContinuousMonitoring
ContinuousBusinessPlanning
ContinuousTesting
Operate Develop/Test
Deploy
Steer
DevOpsContinuousFeedback
People Process
Technology
Continuouslyplan,measure,andintegratebusinessstrategyandcustomerfeedbackintothedevelopmentlifecycle
Enablecollaborationbetweenbusiness,development,andQAtodeliverinnovativeandqualitysoftwarecontinuously
Reducethecostoftestingwhilehelpingdevelopmentteamsbalancequalityandspeed
Deliversoftwaretocustomersandinternalusersfasterandmorefrequentlywithbetterquality,lowercosts,andreducedrisk
Understandandaccommodatetheuserperspectivetoachieveservicelevelswithbettervisibilityandcontinuousfeedbackacrosstheentiresoftwarelifecycle
ContinuousBusinessPlanning
CollaborativeDevelopment
ContinuousTesting
ContinuousReleaseandDeployment
ContinuousMonitoring
ContinuousCustomerFeedbackandOptimization
Providethevisualevidenceandfullcontextforanalyzingcustomerbehaviorandpinpointingpainpoints
Steer Develop/Test Deploy Operate
§ Agileplanningandtracking§ Applicationauto-scaling§ AppScanmobileanalyzer§ Continuousdeliverypipeline§ Githosting
§ Mobileapplicationsecurity§ Mobiledata§ Mobilequalityassurance§ Monitorandanalytics§ Push
§ RapidApps(beta)§ Server-sidecode§ WebIDE
BluemixDevOpsServices
Continuousbusinessplanning
Tooling Process
Outcome
§ Helpscontinuouslyplanbusinessneeds§ Integratescustomerfeedbackwith business
strategy§ Alignscustomerfeedbackintothedevelopment
lifecycle§ Focuseson“doingtherightthings”§ Focusesonbusinessneedsthataddthemost
value
DevOpseco-system
Focusedonbusinessplanning
Continuoussteering
Continuousbusinessplanning
CollaborativeDevelopmentandContinuousIntegration
ContinuousMonitoring
ContinuousBusinessPlanning
ContinuousTesting
Operate Develop/Test
Deploy
Steer
DevOpsContinuousFeedback
ContinuousReleaseandDeployment
Operate Develop/Test
Deploy
Steer
DevOpsContinuousFeedback
ContinuousUserFeedbackandOptimization
Helpsorganizationsfocusonactivitieswheretheywillgainmostvalue:
§ Attacksthehighvalueandhighriskitemsfirst
§ Predictsandquantifiestheoutcomesandresources
§ Measureshonestlywithdistributionsofoutcomes
§ Learningwhatcustomersreallywantandsteerwithagility
Continuousbusinessplanning
ContinuousReleaseandDeployment
ContinuousMonitoring
ContinuousUserFeedbackandOptimization
CollaborativeDevelopmentandContinuousIntegration
ContinuousBusinessPlanning
§ RationalTeamConcert§ RationalDOORSNext
Generation§ CLMaaS§ JIRA§ Kanboard.net
Operate Develop/Test
Deploy
Steer
DevOpsContinuousinnovation,
feedback,andimprovements
LegendIBMSoftwareProduct/OfferingOpenSource/ThirdParty
ContinuousTesting
Collaborativedevelopment
§ Bringstogethercustomerandteamstakeholderstowardsapartneredgoal
§ Workswithinatime-boxedscope§ Focusesondeliveringatangibleand
functionalbusinessoutcome
Focusedonacceleratedoutcomes
Tooling Process
Outcome
DevOpseco-system
Continuousintegration
§ Thisreferstothebestpracticeofintegratingcodeoftheentireteamregularlytoverifythatitworkswelltogether.
§ Eachdeveloperintegratesdaily,whichleadstomultipleintegrationsperday.
§ Integrationsareverifiedbyautomatedbuildsthatrunregressionteststodetectintegrationerrorsasquicklyaspossible.
§ Smallincrementalfrequentbuildshelpwithearlyerrordetectionandlessrework.
§ Continuousintegrationisthebestpracticeforsuccessfulglobalcollaborativedevelopment.
Focusedonerrorfreeoutcomes
Tooling Process
Outcome
DevOpseco-system
Continuousintegration
§ Thisreferstothebestpracticeofintegratingcodeoftheentireteamregularlytoverifythatitworkswelltogether.
§ Eachdeveloperintegratesdaily,whichleadstomultipleintegrationsperday.
§ Integrationsareverifiedbyautomatedbuildsthatrunregressionteststodetectintegrationerrorsasquicklyaspossible.
§ Smallincrementalfrequentbuildshelpwithearlyerrordetectionandlessrework.
§ Continuousintegrationisthebestpracticeforsuccessfulglobalcollaborativedevelopment.
Focusedonerrorfreeoutcomes
Tooling Process
Outcome
DevOpseco-system
Collaborativedevelopmentandcontinuousintegration
ContinuousReleaseandDeployment
ContinuousMonitoring
ContinuousUserFeedbackandOptimization
CollaborativeDevelopmentandContinuousIntegration
ContinuousBusinessPlanning
Operate Develop/Test
Deploy
Steer
DevOpsContinuousinnovation,
feedback,andimprovements
ContinuousTesting
§ RationalCollaborationLifecycleManagement
§ RationalLifecycleIntegrationAdapter
§ RationalDeveloperforSystemZ§ IBMWorklightStudio§ IBMUrbanCodeBuild§ Git§ Jenkins§ Gerrit§ Bugzilla
LegendIBMSoftwareProduct/OfferingOpenSource/ThirdParty
CollaborativeDevelopment:Usecase
ConnectedCarSolutionwanttoexposebillingsystemfunctionstocustomers.
Theissue:Dataisspreadacrossmultiplelegacyapps.Moreover,peaksellingseasoncomingup.
14
InitialUseCasesandWireFramesandDeign
ClientIBM
ProposesCollaborativeDevelopmentsolution:UseAPIstocapturelegacybillingsystemappdata,createwebUIandmobileUItomakedataaccessible,andthen,hostitonsecureIBMCloud.
Collaborativeconfiguration
Agreedtiming
AgreedOutcomes
andRates
Base
Specialty
Collaborativedevelopmentteam
AgreedOutcomes
APIlinksandMobileAppPrototypes
APIlinksandMobileAppsolution
ExtratimepurchasedforWeb/Mobiletesting
AgreedOutcomes
AgreedOutcomes
Accepted Paid Accepted PaidAccepted Paid
Deliverqualitycustomerexperienceswithspeed!
2
3
4
5
6
Theneedforcontinuoustesting
TestingLabor TestLabComplexity
HeterogeneousEnvironments
PublicCloudPrivateCloud
DataWarehouse Mainframe EnterpriseServiceBus
DirectoryIdentity
FileSystems
CollaborationWeb/Internet
RoutingService
Third-partyServices Portals
ContentProviders EJB
SharedServicesArchives
BusinessPartners
MessagingServices
TraditionalTesting
Othercosts
Testingcosts
Manualhandoffs
GAP
SoftwareDevelopment
Manualhandoffs
GAP
OperationsTestLine ofBusiness
Pooralignment
GAP
ofcustomersexperienceproduction
delays.
>45 %todelivervalidatedtest
environments.
~2-8weeks
oflargeorganizationsspendapproximately25%–30%ofprojectbudgetontesting.
>60 % Manualhandoffs
GAP
SoftwareDevelopment
Manualhandoffs
GAP
OperationsTestLine ofBusiness
Pooralignment
GAP
DevelopmentVelocity
Continuoustesting
!
IMPACT
CAUSE
SOLUTION
§ Testdelaysanddisruptions§ Higherriskofcomponentfailure§ Manual,inefficient,andinaccurate§ MoreunplannedITwork
§ Manualprovisionoftestenvironments§ Manualgapsbetweenautomatedprocesses§ Manualinstallation/configuration§ Manualtestsetup(backendproviders,datasetup,and
resourcedependency)
?AutomatedIntegrationTesting
ServiceVirtualization
DeploymentAutomation ContinuousTesting
Continuoustesting
ContinuousReleaseandDeployment
ContinuousMonitoring
ContinuousUserFeedbackandOptimization
CollaborativeDevelopmentandContinuousIntegration
ContinuousBusinessPlanning
Operate Develop/Test
Deploy
Steer
DevOpsContinuousinnovation,
feedback,andimprovements
ContinuousTesting
§ HATc§ IntegrationwithRTC§ Greenhat§ Delphix(Database
Virtualization)§ Selenium§ JUnit§ Cucumber
LegendIBMSoftwareProduct/OfferingOpenSource/ThirdParty
ContinuousReleaseandDeployment:Continuousdelivery
§ Thisreferstothebestpracticeofdeployingcoderapidlyandsafelyintoproduction-likeenvironments.
§ Deploymentskickoffautomatedteststoensurecomponentsperformbusinessfunctionsasexpected.
§ Everychangeisautomaticallydeployedtostaging.
§ Deploymentsareon-demandandselfservice.§ Applicationscanbedeployedintoproduction
withapushofabutton,whenbusinessisready.
Focusedonrapidandautomateddelivery
Tooling Process
Outcome
DevOpseco-system
Continuousreleaseanddeployment
IMPACT
CAUSE
SOLUTION
§ Delayedenvironmentsdelivery…§ Delayedturnaroundfromdevtotest…andback…
§ Manual,inefficient,inaccurate,andlong
§ Highlevelofre-workanderrors§ Costsincreased§ MoreunplannedITwork
§ Manualenvironmentsplanning/delivery§ Manualprovisionofdevenvironments§ Manualinstallation/configurationofbadly-documentedOS/MW/APPS§ Manualintegration(backendproviders,datasetupandresourcedependency)
?
Middleware
Security Compliance Backup and Recovery
Infrastructure
Private
Application / Database
Hybrid
IBM UrbanCodeDeploy
I
ProductionContinuous Integration
Storage
Continuous Delivery
Continuous Deploy
Continuousreleaseanddeployment
ContinuousReleaseandDeployment
ContinuousMonitoring
ContinuousUserFeedbackandOptimization
CollaborativeDevelopmentandContinuousIntegration
ContinuousBusinessPlanning
Operate Develop/Test
Deploy
Steer
DevOpsContinuousinnovation,
feedback,andimprovements
ContinuousTesting
§ IBMUrbanCodeDeploywithPatterns
§ IBMUrbanCodeRelease
§ Chef§ Puppet§ Juju§ Docker§ Ansible
LegendIBMSoftwareProduct/OfferingOpenSource/ThirdParty
Continuouscustomerfeedbackandoptimization
§ EfficientDevOpsallowsfasterfeedback.§ Continuouscustomerfeedbackandoptimization
providesvisualevidenceandfullcontexttoanalyzecustomerbehavior,pinpointcustomerstruggles,andunderstandcustomerexperiences usingwebormobileapplications.
§ Experimentation,learningthroughfirst-handclientexperiences,andcontinuousfeedbackarecriticaltobeingsuccessfulinthisnewworld.
§ Deliveringaminimalviableproduct,learning,andpivotinginaresponsivewaywillchallengethestatusquo.
§ Instrumentedfeedbackalongwithsponsorusersconnectedintocrossfunctionalfeatureteamscanbeanincrediblecombination.
§ Evolveinadisruptiveyethealthywaythatenablestheteamtoinnovatewhileremainingconnectedwiththesystemofrecordteamwherethedataandtransactionslive.
Focusedonlearningandfinetuning
Tooling Process
Outcome
DevOpseco-system
Continuouscustomerfeedbackandoptimization
Focusonuserengagementandfeedback
Needforrapidresponse
Organizationsarechallengedtoapplynewapproachestoassessingthequalityoftheirmobileapps.
Wemustbemuchmoreefficientandeffectiveinourtestingandassessmentofmobileappquality.
Continuouscustomerfeedbackandoptimization
ContinuousReleaseandDeployment
ContinuousMonitoring
ContinuousUserFeedbackandOptimization
CollaborativeDevelopmentandContinuousIntegration
ContinuousBusinessPlanning
Operate Develop/Test
Deploy
Steer
DevOpsContinuousinnovation,
feedback,andimprovements
ContinuousTesting§ TealeafCustomerBehavior
AnalysisSuite§ IBMDigitalAnalytics§ MobileFirstQuality
Assurance§ OpenWebAnalytics(OWA)§ Webalizer§ W3Perl
LegendIBMSoftwareProduct/OfferingOpenSource/ThirdParty
Continuousmonitoring§ Continuousmonitoringoffersenterprise-
class,easy-to-usereportingthathelpsdevelopersandtestersunderstandtheperformanceandavailabilityoftheirapplication,evenbeforeitisdeployedtoproduction.
§ Inproduction,theoperationsteammanagesandensuresthattheapplicationisperformingasdesiredandtheenvironmentisstableviacontinuousmonitoring.
§ Thresholdscanbesetforwhatisconsidered“optimal.”
§ Anyuntowardincidenttriggersanautomaticalertand/orremediation
§ Monitoringlogsareusedforoperationalanalytics.
Focusedonoperationalefficiency
Tooling Process
Outcome
DevOpseco-system
Continuousmonitoring
ContinuousReleaseandDeployment
ContinuousMonitoring
ContinuousUserFeedbackandOptimization
CollaborativeDevelopmentandContinuousIntegration
ContinuousBusinessPlanning
Operate Develop/Test
Deploy
Steer
DevOpsContinuousinnovation,
feedback,andimprovements
ContinuousTesting
§ SmartCloudApplicationPerformanceManagement(APM)
§ IBMServiceEngage§ Nagios§ Nmon§ Cacti§ Logtash§ Fluentd
LegendIBMSoftwareProduct/OfferingOpenSource/ThirdParty
Withapplicationperformancemanagement….
8:02am AffectedapplicationserverDBisfull.
8:02am Applicationserverisbroughtdown,DBextended,andproblemresolved.
8:00amAllcriticalapplicationsaremonitoredwithintheDevOpsdashboard.
8:03amL2/L3teamsimplementautoextendparametersinapplicationprocedurestopreventproblemfromreoccurring.
8:01amApplicationincriticalstatus.Widgetallowsdrill-downtoidentifytheroot-cause.
§ Drilldownindicatesthatthe“OnlineCatalog”applicationishavingprobleminthe“Transactions”areaand“Components”area.
§ Drill-downto“Transactions”areaindicatesthatthereisaproblemwith“EndUserTransactions.”Specifically,theproblemiswith“create_account,”“search_books,”and“check_out”operations.“Create_account”operationseemstobefailingalways(100%),“search_books”33%ofthetime.
§ Furtherdrilldownindicatesthatthe“create_account”operationisrealizedbyanapplicationhostedonserverwithIPAddress10.32.173.102andisrunningonportnumber80.Additionaltoolingisavailabletofurtherdrill-downandpin-pointtheproblem(includingloganalytics).
Bluemix andDevOps 1
2
3
4