#Perform2018

Enterprise monitoring

Shifting Left by Continuous Performance Testing

Sumit Nagal

Principal Engineer in Quality

Intuit

Sumit NagalJan, 2018

Shifting Left by continuous Performance Testing

About

Work:

Play:

Consumers Small Businesses Self-Employed

Who we serve:

Our mission:Powering Prosperity Around the World

Who we are:

Founded

7,900

Employees

42M

Customers

1993

IPO

$4.7B

Revenue

24

Locations

1983

Intuit global locations: NA SA EU AS AU

24 locations in 11 countries

BrazilSão Paulo

EuropeLondon, UKParis, France

Munster, Germany

AustraliaMelbourneSydney

IndiaBangalore Singapore

IsraelTel Aviv

United StatesCal i fornia:

Mounta in ViewSan DiegoSan FranciscoWoodland Hills

Cambridge, MAFredericksburg, VAPlano/Dallas, TXQuincy, WAReno, NVTucson, AZWashington, D.C.

CanadaEdmontonMississauga/Toronto

Updated February 2017

New ZealandAuckland

Intuit Confidential and Proprietary8 Intuit Confidential and Proprietary8

Agenda

• What

– Strategy

• How

– Setup / Configuration

– Execution

– Analysis

• Why

– Benefits

Performance - What

Intuit Confidential and Proprietary10 Intuit Confidential and Proprietary10

SBG Performance Testing

10

On Development

On Commit/PR

On Deployment

Intuit Confidential and Proprietary11 Intuit Confidential and Proprietary11

SBG Performance Testing

11

Shifting Left

Debug ability

Traceability

Intuit Confidential and Proprietary12 Intuit Confidential and Proprietary12

SBG Performance Testing

Test Tracking

Application Log

Analysis & Report

Intuit Confidential and Proprietary13 Intuit Confidential and Proprietary13

SBG Performance Testing – On Development

Developers DO

Local Tests

Local Validations

Local Reproduction

Intuit Confidential and Proprietary14 Intuit Confidential and Proprietary14

SBG Performance Testing – on PR

Quality Team

Performance Quality Gate

This is Work in Progress!

Intuit Confidential and Proprietary15 Intuit Confidential and Proprietary15

SBG Performance Testing – Deployment

Quality Team

Validate Deployment

Research Regressions

Still Manual -> To Be Automated!

Performance - Dynatrace

•What

–Memory Profiling tool

–Detail in depth analysis for JVM, thread and CPU Sampling

•How–Integrated with CICD process and enable via config

–Available to find RCA for performance problem

–Enable at Perf CI to track single call via Test Edition

•Why

–Solved complicated problem of Java Application

–PurePath technology to get full insight of api, code,DB, etc .

–Effective with performance testing

Performance - How

Intuit Confidential and Proprietary18 Intuit Confidential and Proprietary18

Performance CI – GitHub

Intuit Confidential and Proprietary19 Intuit Confidential and Proprietary19

Performance CI – Code Change

Intuit Confidential and Proprietary20 Intuit Confidential and Proprietary20

Performance CI – Jenkins Template

Intuit Confidential and Proprietary21 Intuit Confidential and Proprietary21

Performance CI

Intuit Confidential and Proprietary22 Intuit Confidential and Proprietary22

Performance CI - Configuration

Intuit Confidential and Proprietary23 Intuit Confidential and Proprietary23

Performance CI – Perf Portal

Intuit Confidential and Proprietary24 Intuit Confidential and Proprietary24

Performance CI – Analysis from Baselines -1

Intuit Confidential and Proprietary25 Intuit Confidential and Proprietary25

Performance CI – Analysis from Baselines - 2

Intuit Confidential and Proprietary26 Intuit Confidential and Proprietary26

Performance CI - Analysis

Intuit Confidential and Proprietary27 Intuit Confidential and Proprietary27

Performance CI - Analysis

Intuit Confidential and Proprietary28 Intuit Confidential and Proprietary28

Performance CI - Analysis

Intuit Confidential and Proprietary29 Intuit Confidential and Proprietary29

Performance CI - Analysis

Intuit Confidential and Proprietary30 Intuit Confidential and Proprietary30

Performance CI - Analysis

Intuit Confidential and Proprietary31 Intuit Confidential and Proprietary31

Performance CI - Analysis

Performance - Why

Intuit Confidential and Proprietary33 Intuit Confidential and Proprietary33

Benefits

• Self Service

• Tracing single Txn

• Handle common end point – /graphql OR /entities

• Preserve Session State for debugging

• Quick Feedback to team

• Integrated with various tools to get code level insight

• Identifying commit caused degradation ( WIP )

• Development and PR process ( WIP )

Intuit Confidential and Proprietary34 Intuit Confidential and Proprietary34

Appendix

• https://github.com/Dynatrace/Dynatrace-AppMon-Jenkins-Plugin - Jenkins Plug-in

• https://www.youtube.com/watch?v=O0SQL8DJxaI&list=PLqt2rd0eew1bmDn54E2_M2uvb

hm_WxY_6&index=64&t=2072s Performance clinic

• https://community.dynatrace.com/community/display/DOCDT65/Web+API+Tests

Thank you