Combining Front-End and Backend Testing with Sauce Labs & BlazeMeter

33
August, 2016 COMBINING FRONTEND AND BACKEND TESTING PART 1: FUNCTIONAL (FRONTEND) TESTING

Transcript of Combining Front-End and Backend Testing with Sauce Labs & BlazeMeter

August, 2016

C O M B I N I N G F R O N T E N D A N D B A C K E N D T E S T I N GP A R T 1 : F U N C T I O N A L ( F R O N T E N D ) T E S T I N G

THREE THINGS YOU NEED TO KNOW

August, 2016 © Sauce Labs, Inc.

1. Think of your users!

2. Quality Automation

3. Test Function and Performance

2

A B O U T F U N C T I O N A L T E S T I N G

mWHY FUNCTIONAL TESTING

August, 2016 © Sauce Labs, Inc. 3

www.tomshardware.com/picturestory/607-ios-maps-fail.html

So stuff works.

HOW DO WE FUNCTIONALLY TEST?

August, 2016 © Sauce Labs, Inc. 4

E X E R C I S E T H E A P P

AUTOMATION FOR FUNCTIONAL TESTING

August, 2016 © Sauce Labs, Inc. 5

C L O N I N G Y O U R S E L F – Y O U R O W N R O B O T A R M Y

Feature 1

Feature 2

Feature 3

THE SOFTWARE DEVELOPMENT JOURNEY

August, 2016 © Sauce Labs, Inc. 6

Continuous Delivery

Fully automated Development process

Automated testing in high frequency

Dev, Ops & QA functions merge to

one team

Continuous Integration

Full adoption of Agile

Automated testing dominates;

manual only for debugging

Dev, Ops & QA collaborate closely

Fast Waterfall

Initial adoption of Agile

Automated testing begins

Dev, Ops & QA start to communicate

Waterfall

Traditional sequential design model

Manual testing dominates

Dev, Ops & QA completely separate

Process

People

Tools

HowSauce works

August, 2016 © Sauce Labs, Inc. 7

The World’s Largest Automated Testing Cloudfor Web & Mobile Apps

Just point your tests to Sauce.

Selenium or Appium test scripts.

Test data

Instant access to secure, pristine VMs + mobile devices

VM

Improve quality with massive coverage.

Increase velocity by testing in parallel (avg 10x faster)

HOW SAUCE WORKS

Rapidly review, share and debug.

results

commands

Sauce ConnectProxy

D E M O

8/25/16 1

www.blazemeter.com

ThePerformanceEngineeringPlatformforDevops

SidNarangAugust2016

2011FOUNDED

$7.7MFUNDING

120,000USERS

1,000,000TESTS

SF,TLVOFFICES

8/25/16 3

www.blazemeter.com

WhyPerformanceTesting?

ThreeThings- PerformanceTesting

8/25/16 4©2016 BlazeMeter.Confidential.

UnderstandBottlenecks/SaturationPointsQualityAutomationTestFunctionalandPerformance

SIGNIFICANTLY IMPROVE PRODUCTIVITY

• Run x10 more tests• In a fraction of the time• By x10 more people

TESTING

SenttoTesting TestSucceeded TestFailed

TOOL-SET

Developer

DevOps

QA

OPs

PEOPLE

http://www.example.com

SIMULATED CLIENTS

PerformanceTesting

KeyPerformanceIndicators

Cross-platform, open-source load and performance testing tool

Works at the protocol level to simulate client requests at scale

BlazeMeter is 100% JMetercompatible. Think “JMeter in the Cloud”

JMeter Architecture

RecordingaTestPlan

Web Recorder Mobile Recorder

WhatMakesBlazeMeterSoUnique?

PureSaaS,NoSetup

100%Open-SourceCompatibility

PublicCloudand/orBehindTheFirewall

NativeMobileTestingBuilt-In

DedicatedServersOn-Demand

BlazeMeterCustomersTestingisatTheHeartofContinuousDelivery

HarnessThePowerofJMeter CoupledwithEnterpriseFeatures,Integrations,Reporting,Support&Security

BlazeMeter– EnterpriseGrade

Simulatetestsfromthecloudand behindyourfirewall.

Useopensourcescriptsand canrecordyourownscriptautomatically.

Runlargeloadtestingand automatedcontinuoustesting.

Beusedextremelyfastand yetmeettheentireenterpriseneeds

WhatisBlazeMeter?OnePerformanceTestingPlatform.AllEssentials.

Theonlyavailablesolutionthatcan:

Testresponsetimeanduserexperiencefromdifferentgeographiclocations(e.g.Japan,Brazil,US)

EnjoyuniquereportsperGEOaswellasanaggregatedreport

MultiGEOTesting

Web/Mobile Application

APIEnterprise Private Cloud Web Interface

Architecture

8/25/16 15©2016 BlazeMeter.Confidential.Donotshare.

Process

CreateScenario

DefineParameters RunTest Analyze

Results

TOOL-SET TESTING

SenttoTesting TestSucceeded TestFailed

Developer

DevOps

QA

OPs

PEOPLE

Test Orchestration for Modern Software Delivery

8/25/16 17

www.blazemeter.com

Demo

ThreeThings- PerformanceTesting

8/25/16 18©2016 BlazeMeter.Confidential.

UnderstandBottlenecks/SaturationPointsQualityAutomationTestFunctionalandPerformance

AutomateFromAnyCI/CD

C

WhatareyourOptions?

Takes days, even weeks.

Risk postponing or missing release.

Continuous Testingby BlazeMeter

Requires No Time, Ensures Quality.

RUN ALL TESTS

CUT CORNERS

CONTINUOUS TESTING

Risk placing faulty product into production.

2 31

ContinuousTestingRun unlimited tests as part of Continuous Integration and Continuous Deployment – Automatically 1

Create Tests

2Configure Pass/Fail

3Sit Back, Relax

Define test and thresholds for JMeter and eight other

open source tools.Store in GIT repository Update continuously.

Set tests to run automatically.

If test causes build to fail you’ll know instantly and can

immediately take action.

Test Performance of new code

Test Performance of every deployment

Test Performance of every build

Test Performance in production

SHIFTLEFT SHIFTRIGHT

SHIFTLEFTANDRIGHT

NextStepsCreateyourAccountatblazemeter.com

BlazeMeter's PerformanceTestingBlogblazemeter.com/blog

BlazeMeter’s KnowledgeBaseguide.blazemeter.com

Twitter- @blazemeter

8/25/16 23©2016 BlazeMeter.Confidential.

8/25/16 24

www.blazemeter.com

Q&A

8/25/16 25

www.blazemeter.com

Thankyou!