Performance Engineering in Agile February 9, 2016...2016/02/09  · Performance Engineering & Agile...

34
Performance Engineering in Agile February 9, 2016

Transcript of Performance Engineering in Agile February 9, 2016...2016/02/09  · Performance Engineering & Agile...

Page 1: Performance Engineering in Agile February 9, 2016...2016/02/09  · Performance Engineering & Agile P E R F O R M A N C E Polling Question #2 How are Performance Engineering practices

Performance Engineering in Agile February 9, 2016

Page 2: Performance Engineering in Agile February 9, 2016...2016/02/09  · Performance Engineering & Agile P E R F O R M A N C E Polling Question #2 How are Performance Engineering practices

Brought to you by

Vivit Performance Engineering SIG

Leaders: Todd DeCapua, Petar Puskarich,

Paul Shovlin and Chris Trimper

http://bit.ly/VIVITPE

Page 3: Performance Engineering in Agile February 9, 2016...2016/02/09  · Performance Engineering & Agile P E R F O R M A N C E Polling Question #2 How are Performance Engineering practices

Hosted By:

Chris Trimper

Application Services Manager,

QA Engineering

Independent Health

Page 4: Performance Engineering in Agile February 9, 2016...2016/02/09  · Performance Engineering & Agile P E R F O R M A N C E Polling Question #2 How are Performance Engineering practices

Panelists

Jonathon Wright

Director Digital Engineering

HitachiBrian Copeland

Sr. Dir, QE & A

Cognizant

Todd DeCapua

Chief Technology

Evangelist

HPE Chris Trimper

Application Services Manager,

QA Engineering

Independent Health

Page 5: Performance Engineering in Agile February 9, 2016...2016/02/09  · Performance Engineering & Agile P E R F O R M A N C E Polling Question #2 How are Performance Engineering practices

• This “LIVE” session is being recorded

Recordings are available to all Vivit members

• Session Q&A:

Please type questions in the Questions Pane

Housekeeping

Page 6: Performance Engineering in Agile February 9, 2016...2016/02/09  · Performance Engineering & Agile P E R F O R M A N C E Polling Question #2 How are Performance Engineering practices

Webinar Control Panel

Toggle View Window between

Full screen/window mode.

Questions

Page 7: Performance Engineering in Agile February 9, 2016...2016/02/09  · Performance Engineering & Agile P E R F O R M A N C E Polling Question #2 How are Performance Engineering practices

Today’s Agenda

• What is Agile / Performance Engineering (PE)

• How PE is impacted by waterfall

• How Agile can be impacted by PE

• Real-life stories

Page 8: Performance Engineering in Agile February 9, 2016...2016/02/09  · Performance Engineering & Agile P E R F O R M A N C E Polling Question #2 How are Performance Engineering practices

What is Agile

Extreme

Lean

Scrum

Feature-Driven

Iterative Development

Page 9: Performance Engineering in Agile February 9, 2016...2016/02/09  · Performance Engineering & Agile P E R F O R M A N C E Polling Question #2 How are Performance Engineering practices

Polling Question #1

How progressive are you in using Agile as your SDLC? [select one]1. Advanced2. Average3. Just Starting4. None

Page 10: Performance Engineering in Agile February 9, 2016...2016/02/09  · Performance Engineering & Agile P E R F O R M A N C E Polling Question #2 How are Performance Engineering practices

Performance Engineering

Enhancing the common goal of a proper and quality-ensured user experience under all circumstances made available through performance engineering

Page 11: Performance Engineering in Agile February 9, 2016...2016/02/09  · Performance Engineering & Agile P E R F O R M A N C E Polling Question #2 How are Performance Engineering practices
Page 12: Performance Engineering in Agile February 9, 2016...2016/02/09  · Performance Engineering & Agile P E R F O R M A N C E Polling Question #2 How are Performance Engineering practices

• Test every iteration

• Understand impact of changes

• Build testing scripts as you deliver

• Ensuring quality and responsiveness

• Req

• Dev

• TestIteration 1

• Req

• Dev

• TestIteration 2

• Req

• Dev

• TestIteration 3

Release

Performance Engineering & Agile

P

E

R

F

O

R

M

A

N

C

E

Page 13: Performance Engineering in Agile February 9, 2016...2016/02/09  · Performance Engineering & Agile P E R F O R M A N C E Polling Question #2 How are Performance Engineering practices

Polling Question #2

How are Performance Engineering practices incorporated intoyour SDLC? [select one]1. Advanced2. Average3. Just Starting4. None

Page 14: Performance Engineering in Agile February 9, 2016...2016/02/09  · Performance Engineering & Agile P E R F O R M A N C E Polling Question #2 How are Performance Engineering practices

Maintaining Performance in Agile

Changes

New Features

Technology Changes

Page 15: Performance Engineering in Agile February 9, 2016...2016/02/09  · Performance Engineering & Agile P E R F O R M A N C E Polling Question #2 How are Performance Engineering practices

Test Always @Independent Health

Daily performance test on all ESB consuming applications

• Observe trends

• Frequent ‘iterative’ deploys

• Eliminates ‘did we remember to test?’

9pm 9pm 9pm 9pm 9pm

9pm 9pm 9pm 9pm 9pm

M T W Th F

Page 16: Performance Engineering in Agile February 9, 2016...2016/02/09  · Performance Engineering & Agile P E R F O R M A N C E Polling Question #2 How are Performance Engineering practices

Journey to Agile

Page 17: Performance Engineering in Agile February 9, 2016...2016/02/09  · Performance Engineering & Agile P E R F O R M A N C E Polling Question #2 How are Performance Engineering practices

Polling Question #3

Do you feel the HPE Software capabilities enable you to deliverPerformance Engineering within Agile? [select one]1. Yes2. No3. Not sure4. Want to learn more

Page 18: Performance Engineering in Agile February 9, 2016...2016/02/09  · Performance Engineering & Agile P E R F O R M A N C E Polling Question #2 How are Performance Engineering practices

So, what about PE, Agile & HPE

• LoadRunner / Performance Center 12+• Test from the cloud

• Test Mobile

• Integrate with CI / Build Server

• Integrate with HPE Agile Manager

• ….more?

Page 19: Performance Engineering in Agile February 9, 2016...2016/02/09  · Performance Engineering & Agile P E R F O R M A N C E Polling Question #2 How are Performance Engineering practices

Continuous Assessment

Continuous Assessment

Continuous Operations

Continuous Delivery &

Deployment

Continuous Integration & Testing

Continuous delivery & deployment

• HPE CODAR HPE Helion

• HPE SA Synergy / Composable Infra

• HPE OO HPE App Defender

Continuous integration & testing

• HPE Verigreen

• HPE AGM

• HPE ALM & ALI

• HPE LeanFT

• HPE Fortify

• HPE DevInspect

• HPE LR, PC, SRL

• HPE Mobile Center

• HPE Service Virtualization

• HPE Network Virtualization

Continuous assessment

HPE PPM HPE APM

HPE AGM HPE BSM

HPE AppDefender HPE App Pulse

Continuous operations

• HPE OO

• HPE SAW

• HPE Propel

• HPE App Defender

Page 20: Performance Engineering in Agile February 9, 2016...2016/02/09  · Performance Engineering & Agile P E R F O R M A N C E Polling Question #2 How are Performance Engineering practices

CI / Build Server

Page 21: Performance Engineering in Agile February 9, 2016...2016/02/09  · Performance Engineering & Agile P E R F O R M A N C E Polling Question #2 How are Performance Engineering practices

Delivery

Page 22: Performance Engineering in Agile February 9, 2016...2016/02/09  · Performance Engineering & Agile P E R F O R M A N C E Polling Question #2 How are Performance Engineering practices

Monitoring

Page 23: Performance Engineering in Agile February 9, 2016...2016/02/09  · Performance Engineering & Agile P E R F O R M A N C E Polling Question #2 How are Performance Engineering practices

Polling Question #3

Do you have enough examples / stories of how others are doing Performance Engineering within Agile? [select one]1. Yes2. No3. Want more examples / stories

Page 24: Performance Engineering in Agile February 9, 2016...2016/02/09  · Performance Engineering & Agile P E R F O R M A N C E Polling Question #2 How are Performance Engineering practices

24

Virtual Power Plant – Digital Broker

Page 25: Performance Engineering in Agile February 9, 2016...2016/02/09  · Performance Engineering & Agile P E R F O R M A N C E Polling Question #2 How are Performance Engineering practices

25

“Performance engineering represents a cultural shift in the way organizationsview their essential processes. It embraces practices and capabilities that buildin quality and performance throughout an organization.”

SENSOR MICRO-SERVICES

MQ API

NOSQLJSONRESTNetwork Virtualization

Service VirtualizationStub

component(s)

Shim method(s)

Stub database(s)

Stub service(s)

Virtual Power Plant – Micro-containers

Page 26: Performance Engineering in Agile February 9, 2016...2016/02/09  · Performance Engineering & Agile P E R F O R M A N C E Polling Question #2 How are Performance Engineering practices

26

Design QA/TESTDEV PRODUCTIONPRE-PROD

Release Plan

CI/Build Functional testing UAT Integration

testing Performance

testingDeploy to pre-prod

Code commit SCM

Design Spec

Requirements

Business Users

TESTData

TESTStub

TESTData

User BA

Product Manager

CustomerUsers

CustomerExperience

CustomerExperience

CustomerExperience

CustomerExperience

Design

Business Value

Business Value

Business Value

Improvement

Innovation

Intelligence

Assessment

Insight

Learning

Maintenance

Operations

Delivery

Testing

Support

Cu

sto

mer

Scenarios Context

Learn Learn

Monitor Monitor TESTStub

REALUser

s

TESTData

REALData

TESTStub

USERCase

Bu

sin

ess

Page 27: Performance Engineering in Agile February 9, 2016...2016/02/09  · Performance Engineering & Agile P E R F O R M A N C E Polling Question #2 How are Performance Engineering practices

Performance Application Lifecycle

Page 28: Performance Engineering in Agile February 9, 2016...2016/02/09  · Performance Engineering & Agile P E R F O R M A N C E Polling Question #2 How are Performance Engineering practices

Looking for Agile NFRs

Don’t look for the Product Owners to start writing performance stories Acceptance Criteria Definition of done

“Responding to Change over Following a Plan”

Page 29: Performance Engineering in Agile February 9, 2016...2016/02/09  · Performance Engineering & Agile P E R F O R M A N C E Polling Question #2 How are Performance Engineering practices

Progressive Performance

Agile is all about Progressive Elaboration of the solution. Focus on the performance acceptance criteria for each story

May require non-traditional performance techniques

Progressively expand coverage through iterations As the application features expand, look to verify performance across

ever increasing integrations Avoid the compulsion to wait until all functionality is available to test

End-to-End performance should validate the Definition of Done

Just because there is a performance acceptance criteria on all stories, doesn’t mean the app will perform

Page 30: Performance Engineering in Agile February 9, 2016...2016/02/09  · Performance Engineering & Agile P E R F O R M A N C E Polling Question #2 How are Performance Engineering practices

Scaled Agile Framework (SAFe)

Identify where the Performance team members belong Agile Team Systems Team Shared Service

Page 31: Performance Engineering in Agile February 9, 2016...2016/02/09  · Performance Engineering & Agile P E R F O R M A N C E Polling Question #2 How are Performance Engineering practices

Polling Question #4

What is the #1 reason preventing you from adoptingPerformance Engineering practices? [select one]1. Time2. Money3. Effort4. Value5. We are adopting Performance Engineering practices

Page 32: Performance Engineering in Agile February 9, 2016...2016/02/09  · Performance Engineering & Agile P E R F O R M A N C E Polling Question #2 How are Performance Engineering practices

One tip

What is one thing you could do today to adopt Performance

Engineering practicesinto your Agile process?

Page 33: Performance Engineering in Agile February 9, 2016...2016/02/09  · Performance Engineering & Agile P E R F O R M A N C E Polling Question #2 How are Performance Engineering practices

More Information

HPE Software Performance Engineeringhttp://www.HPE.com/Software/PE

TechBeacon Performancehttp://techbeacon.com/performance

Blogs: LoadRunner and Performance Centerhttp://bit.ly/HPE-LRPCBlog

Vivit Worldwide: PE SIGhttp://bit.ly/VIVITPE

Page 34: Performance Engineering in Agile February 9, 2016...2016/02/09  · Performance Engineering & Agile P E R F O R M A N C E Polling Question #2 How are Performance Engineering practices

Questions & Thank you

http://bit.ly/VIVITPE

Vivit WorldwidePerformance Engineering

Special Interest Group