Modernize Your Test Automation For Modern Application Delivery · Modernize Your Test Automation...

Post on 19-Aug-2018

220 views 0 download

Transcript of Modernize Your Test Automation For Modern Application Delivery · Modernize Your Test Automation...

Modernize Your Test Automation For Modern Application Delivery PARASOFT  webinar:  Why  Testers  Can't  Test:  Solving  the  Test  Environment  Dilemma.

May 21, 2015 Diego Lo Giudice,  Vice  President,  Principal  Analyst  @dlogiudice  

For:  PARASOFT  

Businesses must continuously exploit digital technologies to both create new sources of value for customers and increase operational agility in service

of customers.

Rolls Royce and GE Aviation lease hours of propulsion.

 “It’s  Great  So-ware  Applica4ons  That  Drive  Digital  Businesses  Success….                                                                                ….And  Every  Enterprise  Needs  To  Excel  At  Delivering  Them  !”  

           

Test  Obsessed!  

© 2015 Forrester Research, Inc. Reproduction Prohibited 5

Tes<ng  has  never  been  a  good  companion  of  Speed…

© 2015 Forrester Research, Inc. Reproduction Prohibited 6

Modern  Applica;ons  Are  All  About  Delivery  Speed,  But  At  Different  Levels…  

Social media and search

Systems of engagement (SOE) Systems of record

(SOR)

Traditional

3rd party Cloud-based services

•  Mobile,  web,  and  smart  devices  •  Frequent  changes  •  Delight  clients  •  Mobile  and  Web  apps  

•  Stable  requirements  •  Highly  transac;onal  •  Less  change  •  ERPs  (SAP,  ORACLE,  JDEDWARS,  etc)  

Private Cloud

 Months  Weeks  

Weeks,  Days,  Minutes,  Seconds  

Months,  Weeks  Days  

© 2015 Forrester Research, Inc. Reproduction Prohibited 7

Tes4ng  must  improve  Quality@speed  

Old-School thinking compromises between speed and quality

Introducing  quality@speed:  fast  frequent  pit  stops  and  con<nuous  tes<ng…

© 2015 Forrester Research, Inc. Reproduction Prohibited 9

 Modern  Automa<on  Is  2  of  the  5  Must  Do’s  For  tes<ng  quality@speed  !

From manual GUI testing

Automated Functional Testing (API/Non GUI Testing)

Target state

Automated GUI tests

Increase  Test  Automa<on  and  Focus  it  on  API  /  Non  GUI  tes<ng  automa<on

Manual testing

% Automation vs % Manual

Current state

10 – 20 %

60 – 80 %

Automated Testing

To manual exploratory testing 5 – 20 %

5 – 10 %

60 – 80 %

Automated API/ non GUI tests

% Automation vs % Manual

Source:  Wolgang  Platz  –  Tricen4s  -­‐    modified  by  Forrester    

© 2015 Forrester Research, Inc. Reproduction Prohibited 11

Test  beyond  GUI  to  verify  and  validate  business  and  technical  services

API  Layer  UI    Layer  

Backend  /  resource    Layer    (Apps,  services,  etc)  

© 2015 Forrester Research, Inc. Reproduction Prohibited 12

Continuous delivery Pipeline

Development Build Test environment Stage environment

Production environment

Integra<ng  Tes<ng  Tightly  And  Efficiently  In  Your  Con<nuous  SoTware  Delivery  Process

›  Source:  Forrester  adapta4on  of  SVT  for  dummies  

Deploy  

Automated  Gate  checks  

Automated    Process  Tes4ng  

Automated    Func4onal  Tes4ng  

Automated  Unit  Tes4ng  

Release  automa4on  

Release  candidates  

Retro-­‐vert  

Continuous Integration / Continuous Delivery

Retro-­‐vert  

Automated  Performance  Tes4ng  

© 2015 Forrester Research, Inc. Reproduction Prohibited 13

Use  Service  Virtualiza;on  To  Deal  With  Teams  Different  Speed  Levels…  

Social media and search Traditional Private Cloud

 Months  Weeks  

Weeks,  Days,  Minutes,  Seconds  

Months,  Weeks  Days  

Tes4ng  Of  Simulated  and  Virtualized  Services  (Func4onal,  Performance  Load,  Integra4on,  Data)    

Design  Assets  (WSDL,  XML,  ….)  

Custom  Developed  

(Java,  JavaScript,  C#,    etc  

Run;me  Non  Accessible  Services  

(Messaging,  Swi-,  Tibco,  etc)    

Paid  Third  Party  Services  (Cloud,  

Mainframe,  etc)    

APIs  (  Mainframe,  Middleware,  Applica4on  Services)    

© 2015 Forrester Research, Inc. Reproduction Prohibited 14

Conclusions

1. Digital  is  disrup4ng  and  transforming  *ANY*  business,  and  “so-ware  tes4ng”  with  it  !    

2. To  increase  levels  of  automa4on  you  need  to  focus  on  beyond  the  GUI  or  do  more  API  Tes4ng  

3. Introduce  Service  Virtualiza4on  to  test  your  so-ware  in  a  wind  tunnel  

forrester.com

Thank  you  

Diego Lo Giudice +39-340-7710775 dlogiudice@forrester.com

Alaska  Airlines  Plug

Flight Operations Manager Challenges + Solutions Ryan  Papineau  –  Automated  Test  Engineer  2015-­‐05-­‐21  

Flight  Opera4ons  Manager  

Cargo   Load  Plan   Baggage  

Passenger   Aircra-  

Fuel   Flight  Events   Crew  

System    under  test  

Complex  cross  system  dependencies  make  tes4ng  very  difficult  

•  Environment •  Shared •  Continual changes

•  Data •  Integrated, but not coordinated. •  Does not exist •  Inconsistent

•  Services •  Not available •  Inconsistent

•  Events •  Do not exist •  Lack of resources to make them happen

Challenges  –  “Why  testers  can’t  test.”

Flight  Opera4ons  Manager  

Cargo   Load  Plan   Baggage  

Passenger   Aircra-  

Fuel   Flight  Events   Crew  

Isolate  System  Under  Test  

Virtualize  Data  Feeds  –  stabilizing  tes4ng  

AirportWebService

CargoWebService

BaggageWebService

PassengerWebService

Planeside  Device

Service Virtualization

Events - Message Exchange Patterns Synchronous  (Request/Response)   Asynchronous  (Event  Driven)  

GetCargo  

GetBaggage  

GetPassenger  

Depart  

Take  Off  

Land  

Arrive  

Book  Ticket  

Check  In  

GetFuel  

Board  Flight  

Final Solution Cargo   Load  Plan   Baggage  

Passenger   Aircra-  

Fuel   Flight  Events   Crew  

Cargo  WebserviceBacked  by  Test  Data  Management  (TDM)

Baggage  WebserviceBacked  by  (TDM)

Passenger  Webservice  Virtualized

AircraftCommunication  

Virtualized

Crew  WebserviceBacked  by  (TDM)

Flight  Movement  Triggered  byAutomatedTest  Client

Aircraft  Maintenance  Webservice

Backed  by  (TDM)

Load  PlanBacked  by  (TDM)

Event Modeling

X  =

Data Modeling

Final Solution Cargo   Load  Plan   Baggage  

Passenger   Aircra-  

Fuel   Flight  Events   Crew  

Cargo  WebserviceBacked  by  Test  Data  Management  (TDM)

Baggage  WebserviceBacked  by  (TDM)

AircraftCommunication  

Virtualized

Crew  WebserviceBacked  by  (TDM)

Aircraft  Maintenance  Webservice

Backed  by  (TDM)

Load  PlanBacked  by  (TDM)

Challenges + Solutions

Problem Solution Tool Environmental Impacts Isolated Environment + System VMWare Data Alignment Test Data Management (TDM) Custom SQL Inconsistent Web Services Service Virtualization (SV) Parasoft Virtualize Lack of Events Automated Test Clients Parasoft SOAtest

Q + A