Enterprise monitoring Shifting Left by Continuous ...€¦ · Who we are: Founded 7,900 Employees...
35
#Perform2018 Enterprise monitoring Shifting Left by Continuous Performance Testing Sumit Nagal Principal Engineer in Quality Intuit
Transcript of Enterprise monitoring Shifting Left by Continuous ...€¦ · Who we are: Founded 7,900 Employees...
#Perform2018
Enterprise monitoring
Shifting Left by Continuous Performance Testing
Sumit Nagal
Principal Engineer in Quality
Intuit
Sumit NagalJan, 2018
Shifting Left by continuous Performance Testing
About
Work:
Play:
Consumers Small Businesses Self-Employed
Who we serve:
Our mission:Powering Prosperity Around the World
Who we are:
Founded
7,900
Employees
42M
Customers
1993
IPO
$4.7B
Revenue
24
Locations
1983
Intuit global locations: NA SA EU AS AU
24 locations in 11 countries
BrazilSão Paulo
EuropeLondon, UKParis, France
Munster, Germany
AustraliaMelbourneSydney
IndiaBangalore Singapore
IsraelTel Aviv
United StatesCal i fornia:
Mounta in ViewSan DiegoSan FranciscoWoodland Hills
Cambridge, MAFredericksburg, VAPlano/Dallas, TXQuincy, WAReno, NVTucson, AZWashington, D.C.
CanadaEdmontonMississauga/Toronto
Updated February 2017
New ZealandAuckland
Intuit Confidential and Proprietary8 Intuit Confidential and Proprietary8
Agenda
• What
– Strategy
• How
– Setup / Configuration
– Execution
– Analysis
• Why
– Benefits
Performance - What
Intuit Confidential and Proprietary10 Intuit Confidential and Proprietary10
SBG Performance Testing
10
On Development
On Commit/PR
On Deployment
Intuit Confidential and Proprietary11 Intuit Confidential and Proprietary11
SBG Performance Testing
11
Shifting Left
Debug ability
Traceability
Intuit Confidential and Proprietary12 Intuit Confidential and Proprietary12
SBG Performance Testing
Test Tracking
Application Log
Analysis & Report
Intuit Confidential and Proprietary13 Intuit Confidential and Proprietary13
SBG Performance Testing – On Development
Developers DO
Local Tests
Local Validations
Local Reproduction
Intuit Confidential and Proprietary14 Intuit Confidential and Proprietary14
SBG Performance Testing – on PR
Quality Team
Performance Quality Gate
This is Work in Progress!
Intuit Confidential and Proprietary15 Intuit Confidential and Proprietary15
SBG Performance Testing – Deployment
Quality Team
Validate Deployment
Research Regressions
Still Manual -> To Be Automated!
Performance - Dynatrace
•What
–Memory Profiling tool
–Detail in depth analysis for JVM, thread and CPU Sampling
•How–Integrated with CICD process and enable via config
–Available to find RCA for performance problem
–Enable at Perf CI to track single call via Test Edition
•Why
–Solved complicated problem of Java Application
–PurePath technology to get full insight of api, code,DB, etc .
–Effective with performance testing
Performance - How
Intuit Confidential and Proprietary18 Intuit Confidential and Proprietary18
Performance CI – GitHub
Intuit Confidential and Proprietary19 Intuit Confidential and Proprietary19
Performance CI – Code Change
Intuit Confidential and Proprietary20 Intuit Confidential and Proprietary20
Performance CI – Jenkins Template
Intuit Confidential and Proprietary21 Intuit Confidential and Proprietary21
Performance CI
Intuit Confidential and Proprietary22 Intuit Confidential and Proprietary22
Performance CI - Configuration
Intuit Confidential and Proprietary23 Intuit Confidential and Proprietary23
Performance CI – Perf Portal
Intuit Confidential and Proprietary24 Intuit Confidential and Proprietary24
Performance CI – Analysis from Baselines -1
Intuit Confidential and Proprietary25 Intuit Confidential and Proprietary25
Performance CI – Analysis from Baselines - 2
Intuit Confidential and Proprietary26 Intuit Confidential and Proprietary26
Performance CI - Analysis
Intuit Confidential and Proprietary27 Intuit Confidential and Proprietary27
Performance CI - Analysis
Intuit Confidential and Proprietary28 Intuit Confidential and Proprietary28
Performance CI - Analysis
Intuit Confidential and Proprietary29 Intuit Confidential and Proprietary29
Performance CI - Analysis
Intuit Confidential and Proprietary30 Intuit Confidential and Proprietary30
Performance CI - Analysis
Intuit Confidential and Proprietary31 Intuit Confidential and Proprietary31
Performance CI - Analysis
Performance - Why
Intuit Confidential and Proprietary33 Intuit Confidential and Proprietary33
Benefits
• Self Service
• Tracing single Txn
• Handle common end point – /graphql OR /entities
• Preserve Session State for debugging
• Quick Feedback to team
• Integrated with various tools to get code level insight
• Identifying commit caused degradation ( WIP )
• Development and PR process ( WIP )
Intuit Confidential and Proprietary34 Intuit Confidential and Proprietary34
Appendix
• https://github.com/Dynatrace/Dynatrace-AppMon-Jenkins-Plugin - Jenkins Plug-in
• https://www.youtube.com/watch?v=O0SQL8DJxaI&list=PLqt2rd0eew1bmDn54E2_M2uvb
hm_WxY_6&index=64&t=2072s Performance clinic
• https://community.dynatrace.com/community/display/DOCDT65/Web+API+Tests
Thank you
