Agile vs Fragile - ANZTB Inception Elaboration Construction Transition Development Operations DevOps

download Agile vs Fragile - ANZTB Inception Elaboration Construction Transition Development Operations DevOps

If you can't read please download the document

  • date post

    02-Aug-2020
  • Category

    Documents

  • view

    2
  • download

    0

Embed Size (px)

Transcript of Agile vs Fragile - ANZTB Inception Elaboration Construction Transition Development Operations DevOps

  • Susmit Bhattacharya, Solution Architect, Asia Pacific

    Agile vs Fragile - The need for Automation in Agile

    © 2017 Tricentis GmbH. All Rights Reserved.

  • © 2017 Tricentis GmbH. All Rights Reserved. 2

    Critical Physical Limit

    Ever-Growing Challenge

    Technical Complexity

    & Rate of Change

    Years Months

    Months Weeks

    Weeks Days

    Days Hours

    Hours Minutes

    Delivery

    Cycle Time

    Perceived Disruption Beyond

    Continuous

    Testing

    Today

  • © 2017 Tricentis GmbH. All Rights Reserved. 3

    Requirements Design Implementation Testing Acceptance Deployment

    Inception Elaboration Construction Transition

    Development Operations

    DevOps

    Agile Event Horizon

    Digital Singularity

    Incremental Rational Unified Process

    4

    Agile Scrum, Kanban

    2

    Continuous DevOps

    1

    6+ Big Bang

    Waterfall

    Development Response = wall of confusion

    Flexible Framework

    Rigid Rules

    Following a Plan

    Contract Negotiation

    Copious Documentation

    Processes & Tools

    Individuals & Interactions

    Working Software

    Customer Collaboration

    Responding to Change

  • © 2017 Tricentis GmbH. All Rights Reserved. 4

    Dev Ops

    Continuous

    Release & Deployment Collaborative

    Development

    Continuous

    Testing

    Continuous

    Monitoring

    Continuous

    Integration

    Continuous

    Feedback

    DevOps Movement

    DevOps is no longer a

    unicorn’s discipline.

    TestDev Ops Shift Left Shift Right

    of enterprises have

    adopted or plan to adopt

    81%

    DevOps.

  • © 2017 Tricentis GmbH. All Rights Reserved. 5

    Current State Target State

    remaining manual tests (exploratory and manual spec-based)

    automated UI tests

    automated API tests

    +

    service virtualization (key enabler for high automation)

    GUI

    API

    20-40%

    60-80% Specification

    driven

    5-20%

    80-95%

    Testing Future

    Budgets won’t increase

  • © 2017 Tricentis GmbH. All Rights Reserved. 6

    remaining manual tests (exploratory and manual spec-based)

    automated UI tests

    automated API tests

    +

    service virtualization (key enabler for high automation)

    GUI

    API

    Model-Based Test Automation (MBTA) for

    UI and API Automating the automation framework.Automate

    Session-Based Exploratory Testing Make your testing intellectually rich.

    Explore

    Orchestrated Service Virtualization Make testing independent.

    Stateful Test Data Management Manage

    Computer-Aided Test Portfolio Design Redundancy-free test case portfolio with

    maximum risk coverage and fewer tests.Optimize

    Integrate

    CT Integration (CI, CD)

    Distributed Execution Target State

    Testing Future

    Current State

    Budgets won’t increase

  • © 2017 Tricentis GmbH. All Rights Reserved. 7

    remaining manual tests (exploratory and manual spec-based)

    automated UI tests

    automated API tests

    +

    service virtualization (key enabler for high automation)

    GUI

    API

    Computer-Aided Test Portfolio Design Redundancy-free test case portfolio with

    maximum risk coverage and fewer tests.Optimize

    Target State

    Testing Future

    Current State

    Budgets won’t increase

  • © 2017 Tricentis GmbH. All Rights Reserved. 8

    Low

    Risk

    High

    Risk

    Medium

    Risk 80%20%

    Business Risk Coverage

    Test Cases

    The time needed for

    testing is infinitely larger

    than the time available.

    Critical Limit

    Risk-Based Testing

    Have the right test cases.

    Do the right things.

  • © 2017 Tricentis GmbH. All Rights Reserved. 9

    ri sk

    c o

    v e ra

    g e

    60%

    80%

    100%

    40%

    20%

    0%

    𝑴

    𝑵 =

    0

    d e fe

    ct r

    a te

    max

    100%

    test cases

    20%0% 40% 60% 80%

    critical defects

    M N

    𝟏 weight𝟏 𝟏 𝟏 𝟏 𝟏 𝟏… … [%]

    Computer-Aided Test Portfolio Optimisation

  • © 2017 Tricentis GmbH. All Rights Reserved. 10

    60%

    80%

    100%

    40%

    20%

    0%

    ri sk

    c o

    v e ra

    g e

    100%20%0% 40% 60% 80%

    test cases

    critical defects

    0

    d e fe

    ct r

    a te

    max

    M N

    𝒘𝟏 𝒘𝟐 𝒘𝟑 𝒘𝟒 𝒘𝒊 𝒘𝑵… … … … 𝒘𝒊 ≥ 𝒘𝒊+𝟏weight

    Computer-Aided Test Portfolio Optimisation

  • © 2017 Tricentis GmbH. All Rights Reserved. 11

    60%

    80%

    100%

    40%

    20%

    0%

    Intuitive Test Design

    Methodical Test Design

    100%20%0% 40% 60% 80% Test Cases

    Risk

    Coverage

    Risk-Based Testing

    Achieve maximum risk coverage with

    a minimal number of powerful test cases.

  • © 2017 Tricentis GmbH. All Rights Reserved. 12

    remaining manual tests (exploratory and manual spec-based)

    automated UI tests

    automated API tests

    +

    service virtualization (key enabler for high automation)

    GUI

    API

    Model-Based Test Automation (MBTA) for

    UI and API Automating the automation framework.Automate

    Optimize

    Target State

    Testing Future

    Current State

    Budgets won’t increase

  • © 2017 Tricentis GmbH. All Rights Reserved. 13

    2nd Generation

    Test Automation

    Framework

    1st Generation

    Record

    Replay

    10% Automation

    Evolution of Automated Testing

  • © 2017 Tricentis GmbH. All Rights Reserved. 14

    Example:

    “…select invoice with the car registration number VIC-3456”

    Great for developers who can code

    ...but is even harder to understand for the business team

    Conclusion: Only for developer & Expensive to maintain

    Keyword Driven Data Driven

    Custom Hybrid

    Functionally Decomposed Commercial

    Script Based Test Automation Frameworks

  • © 2017 Tricentis GmbH. All Rights Reserved. 15

    Script-Based

    2nd Generation

    Test Automation

    Framework

    1st Generation

    Record

    Replay

    30% Automation

    10% Automation

    + -Programming Required

    - +Business Readable

    Model-Based Test Automation

    Next Generation

    No Scripting

    90% Automation

    +

    Future of Automated Testing

  • © 2017 Tricentis GmbH. All Rights Reserved. 16

    Technical Information

    Application Pages

    sampleapp.tricentis.com

    Technical Name Value Range

    -

    -

    1;2;3;4;5;6;7;8;9

    Petrol;Diesel;Gas;Other

    -

    -

    {CLICK};{RIGHTCLICK}

    Private;Commercial

    2016;2015;2014;2013

    -

    Vehicle Data

    Make

    Engine Performance [kW]

    Number of Seats

    Fuel

    List Price [$]

    Annual Mileage

    Next

    Usage

    Year of Construction

    License Plate Number

    Insurant Data

    Product Data

    Next {CLICK}

    Start Date 01/03/2016;01/04/2016

    Insurance Sum [$] 3Mio;7Mio;10Mio;15Mio

    Payment Option Yearly;Quarterly;Monthly

    Next >>

    Make Audi

    Engine Performance [kW] 200

    Number of Seats 5

    Fuel Petrol

    Year of Construction 2016

    List Price [$] 35.000

    License Plate Number B-CD 123

    Annual Mileage [mi] 10.000

    Usage Private

    Scan Application…. Silver; Gold; Platinum; Ultimate

    Quote Details

    Price per Year($);Online Claim; ..

  • © 2017 Tricentis GmbH. All Rights Reserved. 17

    Logical Name

    Enter Insurant Data

    Create Vehicle Insurance

    Enter Vehicle Data

    Make

    Engine Performance [kW]

    Number of Seats

    Fuel

    List Price [$]

    Annual Mileage

    Next

    Usage

    Year of Construction

    License Plate Number

    Value

    Audi

    200

    5

    Petrol

    35.000

    10.000

    {CLICK}

    Private

    {Year}

    B-CD 123

    Action

    Input

    Input

    Input

    Input

    Input

    Input

    Input

    Input

    Input

    Input

    Enter Product Data

    Next

    Start Date

    Insurance Sum [$]

    Payment Option

    {CLICK}

    01/03/2016

    7Mio

    Yearly

    Input

    Input

    Input

    Input

    Verify Quote Details

    Price List

    Price per Year($)

    Silver 1.535,22 Verify

    Select

    Select

    Business Information

    Technical Name Value Range

    Technical Information

    -

    -

    1;2;3;4;5;6;7;8;9

    Petrol;Diesel;Gas;Other

    -

    -

    {CLICK};{RIGHTCLICK}

    Private;Commercial