Ranger4 DevOps at High Speed Event - Stu Feasey

22
© 2013 IBM Corporation IBM Software - Rational Test Workbench Focus on : Testing and Virtualisation in complex world. Stuart Feasey, IBM Rational Quality Management Specialist IBM Software, Rational 15 November 2013

description

On 14th November 2013 Ranger4 held an event, DevOps at High Speed, at Claridge's in London with our partners IBM and AppDynamics. This is Stu Feasey's from IBM's presentation from the session on service virtualisation and test automation

Transcript of Ranger4 DevOps at High Speed Event - Stu Feasey

Page 1: Ranger4 DevOps at High Speed Event - Stu Feasey

© 2013 IBM Corporation

IBM Software - Rational Test WorkbenchFocus on : Testing and Virtualisation in complex world.

Stuart Feasey, IBM Rational Quality Management SpecialistIBM Software, Rational15 November 2013

Page 2: Ranger4 DevOps at High Speed Event - Stu Feasey

© 2013 IBM Corporation

Accelerating Product and Service Innovation | Rational

Software drives today’s innovation for a smarter planetTransforming the way we live, work, and play

Page 3: Ranger4 DevOps at High Speed Event - Stu Feasey

© 2013 IBM Corporation

Accelerating Product and Service Innovation | Rational

Yet software quality is a major problem across all industries

Software is blamed for more majorbusiness problems than any other man-made product.

Poor software quality has become one ofthe most expensive topics in humanhistory– $150+ billion per year in U.S.

– $500+ billion per year worldwide.

Projects cancelled due to poor quality are15% more costly than successful projectsof the same size and type.

Source: Capers Jones, 2011Based on 675 companies, 35 government/military groups, 13,500 projects, 50-75 new projects/month, 24 countries, 15 lawsuits

Page 4: Ranger4 DevOps at High Speed Event - Stu Feasey

© 2013 IBM Corporation

Accelerating Product and Service Innovation | Rational

BalancingQuality and Speed

IncreasingCost of Quality

IncreasingDevelopment Complexity

What is driving the need for a change?

a The Times of India, salary increase for India Inc in 2012, Feb 21, 2012.b IBM customer reference.c NIST, Planning Report 2002-2003. The Economic Impacts of Inadequate Infrastructure for Software Testing, May2002.

Heterogeneous Environments

Public Cloud Private Cloud

Data Warehouse Mainframe EnterpriseService Bus

DirectoryIdentity

Filesystems

CollaborationWeb/

InternetRoutingService

Third-partyServices Portals

ContentProviders EJB

SharedServicesArchives

BusinessPartners

MessagingServices

TraditionalTesting

Other costs

Testing costs

30-50%The average amount of timetesting teams spend on setting uptest environments, insteadof testing  c

12%The projected increase in wages forIndia IT workforce in 2012 a

$5-30 millionThe typical investment to builda single test lab for a Fortune 500company. Most have dozens  b…

Page 5: Ranger4 DevOps at High Speed Event - Stu Feasey

© 2013 IBM Corporation

Accelerating Product and Service Innovation | Rational

§

Page 6: Ranger4 DevOps at High Speed Event - Stu Feasey

© 2013 IBM Corporation

Accelerating Product and Service Innovation | Rational

Page 7: Ranger4 DevOps at High Speed Event - Stu Feasey

© 2013 IBM Corporation

Accelerating Product and Service Innovation | Rational

Page 8: Ranger4 DevOps at High Speed Event - Stu Feasey

© 2013 IBM Corporation

Accelerating Product and Service Innovation | Rational

Complexity…. Made Simple!• Multiple layers of

technology

• Multiple vendorplatforms

• Complextransactions

• Complexdependencies

• Multiplestakeholders

Page 9: Ranger4 DevOps at High Speed Event - Stu Feasey

© 2013 IBM Corporation

Accelerating Product and Service Innovation | Rational

The future of testing: New IBM Rational solutions

IBM Rational Test Workbench–Enable functional, performance and integrationtesting throughout your project lifecycle.

–With a scriptless, wizard-driven test authoringenvironment and support for more than 70technologies and protocols,

IBM Rational Performance Test Server–Save time and effort by reusing your functionalintegration tests for performance testing

–Combine your tests to model real-world scenariosand assess the impact of load on your integratedinfrastructure.

IBM Rational Test Virtualization Server–Model real system behavior to eliminate testdependencies and simulate production,

–Accelerate testing and reduce the setup andinfrastructure costs of traditional testing environments.

TestWorkbench

Functional TestingIntegration Testing

Performance TestingRegression Testing

TestServers

Load AgentsVirtualization Agents

QA

Test LabInfrastructure

DEV

Page 10: Ranger4 DevOps at High Speed Event - Stu Feasey

© 2013 IBM Corporation

Accelerating Product and Service Innovation | Rational

Supported Environments and TechnologiesMessaging Protocols SOA and ESB Message FormatsActiveMQEmail (SMTP, IMAP)FilesFTP/SHTTP/SIBM WebSphere MQJMSSAP IDoc, BAPI, RFCSoftware AG’s IB & ISSonic MQTCP/IPTIBCO Rendezvous, SmartSockets & EMSCICSIMS Connect

CentraSiteOracle FusionSCA DomainSoftware AG IS, Broker, BPMSWebsphere Application ServerWebsphere Message BrokerWebsphere MQWebsphere Registry &RepositorySonic ESBSystem z (CICS and IMS)TIBCO ActiveMatrixUDDIWeb ServicesWSDL

.Net ObjectsBytesCOBOL CopybookebXMLASC X12EDI/EDIFACTDFDLFixed WidthJava ObjectsJSONMIMESOAPSoftware AG Broker DocsSWIFTCHIPSFedWireFIXTIBCO ActiveEnterpriseXML (DTD, XSD, WSDL)Custom

Other TechnologiesBPMDatabasesLog Files

Page 11: Ranger4 DevOps at High Speed Event - Stu Feasey

© 2013 IBM Corporation

Accelerating Product and Service Innovation | Rational

How it all fits together…

Page 12: Ranger4 DevOps at High Speed Event - Stu Feasey

© 2013 IBM Corporation

Accelerating Product and Service Innovation | Rational

Sys Tests

Unit Tests

UAT

OAT

Performance

The Old World

Big Bang

• Multiple defects introduced at once• More unknowables – greater risk• Expensive!

Requirements

Page 13: Ranger4 DevOps at High Speed Event - Stu Feasey

© 2013 IBM Corporation

Accelerating Product and Service Innovation | Rational

Requirements

Unit Tests

Performance

UAT

OAT

The New World

Big Bang

Integration Tests Sys TestsSys Tests

• Accelerated testing• Reduced costs• Lowered risk

Page 14: Ranger4 DevOps at High Speed Event - Stu Feasey

© 2013 IBM Corporation

Accelerating Product and Service Innovation | Rational

Find defects earlier

Reducing the cost of fixing Defects earlier in the Application Development lifecycle

Requirements

Big Bang

E2E testing UATIntegration testing

£290

£1032

£97

Earlier testing and Risk mitigation

£16 Unit test£97 Integration test

£290 E2E Test£1032 in UATSource: SEI

Page 15: Ranger4 DevOps at High Speed Event - Stu Feasey

© 2013 IBM Corporation

Application Virtualization

Rational Test Virtualization Server

Page 16: Ranger4 DevOps at High Speed Event - Stu Feasey

© 2013 IBM Corporation

Accelerating Product and Service Innovation | Rational

Blockers for End to End testing

“The environmentwill be another 3

weeks”

“Too costly to setup a testmessage feed for test”

“We’re stillwaiting for them

to deploy”

“The dev team hasn’tstarted work on it yet”

Page 17: Ranger4 DevOps at High Speed Event - Stu Feasey

© 2013 IBM Corporation

Accelerating Product and Service Innovation | Rational

Service Virtualisation

Page 18: Ranger4 DevOps at High Speed Event - Stu Feasey

© 2013 IBM Corporation

Accelerating Product and Service Innovation | Rational

Incremental Integration TestingIncremental Integration Testing

Actual Service/AppVirtual Service/App

Test Virtualization is an enabler forcontinuous Integration Testing

Services, applications, systems areintroduced into the continuous integrationcycle in a prioritized, controlled fashion.

From Test Virtualization to Continuous Integration Testing

Page 19: Ranger4 DevOps at High Speed Event - Stu Feasey

© 2013 IBM Corporation

Accelerating Product and Service Innovation | Rational

Presentation Tier

SOA/BPM B2B

Database ESB Mainframe

Page 20: Ranger4 DevOps at High Speed Event - Stu Feasey

© 2013 IBM Corporation

Accelerating Product and Service Innovation | Rational

Presentation Tier

SOA/BPM B2B

Database ESB Mainframe

Virtual Integration EnvironmentVirtual Integration Environment

• Virtualise entire set of applications• ‘Users’ unaware of virtualisation

Page 21: Ranger4 DevOps at High Speed Event - Stu Feasey

© 2013 IBM Corporation

Accelerating Product and Service Innovation | Rational

IBM Rational Test Virtualization Solution has proven measureableresults and business value

Major telecom carrierMultiple test releases required additionaltest resources, increasing testing costs

Solution: Virtualized services and createdreusable test cases across multiple

environments Results: Reduced testing time by 50%,

saving $800K over 3 years

A leading global financial servicesfirm with assets of over $2 trillionMany disparate legacy format to be

migrated to next gen payments system Solution: Virtualized third-party systems

otherwise unavailable for testing Results: Reduced manual testing from 10 days

to 10 minutes, saving over $7 million to date

Major U.S. insurerRecognized manual efforts insufficient

for complex SOA and web services Solution: Agile middleware solution created

to match the legacy systems’ functionality Results: Reduced testing by 95% to 2 hours;

reduced ‘rate filing’ validation by 94%to 320 hours

Global manufacturer acquirescompetitor

Migrate off rented infrastructure ontocompany’s standardized middleware platform

Solution: Virtualized critical, unavailable systemsduring migration

Results: Fully integrated in 6 months – 2 monthsahead of schedule; saved significant rental costs

and dependencies on third-party systems

Page 22: Ranger4 DevOps at High Speed Event - Stu Feasey

© 2013 IBM Corporation

Accelerating Product and Service Innovation | Rational

www.ibm.com/software/rational