Thinking Beyond HPQC ALM
-
Upload
qasymphony -
Category
Business
-
view
817 -
download
0
Transcript of Thinking Beyond HPQC ALM
September 25, 2015
Introduction to QASymphony for
[INSERT COMPANY NAME]
Modern Software Testing
26th July 2016
Kevin Dunne – QASymphony
Thinking Beyond HP Quality Center
Join the conversation on Twitter use #moderntesting
HOW TO WATCH THIS WEBINAR
• Audio for this webinar is delivered through your computer. Make sure your speakers are turned up or use a set of headphones.
• If your audio quality is choppy, it could be your internet connection.
• You can customize your webinar viewing experience by increasing, decreasing or minimizing the size of the widgets on your screen.
• If you have questions, enter them in the widget on the bottom left.
Join the conversation on Twitter use #moderntesting
Robust test management platform purpose-built to integrate with JIRA and to help agile teams centralize, organize and gain visibility into software
testing
ABOUT QASYMPHONY
Title: Tips, Tricks & Lessons Learned for Hiring Professional Testers
Date: August 18th
Guest Speakers: Huib Schoots
UPCOMING WEBINARS
Title: Evolve or Die: Healthcare IT Testing
Date: August 30th
Guest Speakers: Kevin Dunne & Mike Cooper
Huib Schoots
Kevin Dunne Mike Cooper
Join the conversation on Twitter use #moderntesting
• Kevin Dunne is the VP of Strategy and Business Development at QASymphony, ensuring their continued commitment to innovation and delivering tools to create better software. With a deep interest in the emerging trends in software development and testing, Kevin is dedicated to collaborating with thought leaders in this space. Kevin comes to QASymphony from Deloitte, where he managed testing on large government and Fortune 500 engagements.
OUR PRESENTER
Kevin Dunne
Join the conversation on Twitter use #moderntesting
• This webinar will be recorded and available on-demand a few hours after the webinar is over. You will get an email when it is available.
• Use the Q&A widgets to the left to ask questions during the webinar.
• At the end of the webinar, you will be asked to take a short survey.
HOUSEKEEPING
Join the conversation on Twitter use #moderntesting
• What has changed related to software development and testing since HP Quality Center was released?
• How have recent changes caused HP Quality Center to become a less effective solution for software testing and development?
• What is HP’s strategy for modernizing the Quality Center solution to meet today’s testing demands?
• How can QASymphony help you to better manage my testing and development in today’s environment?
AGENDA
Join the conversation on Twitter use #moderntesting
HP acquires the then market leader in testing tools, Mercury, and its 3000 employees in 2006 for $4.5 billion.
HP software unit doubled with Mercury’s ~$800 million rev.:
Source: http://www.hp.com/hpinfo/investor/financials/annual/2005/05ar-graphics.pdf
WHERE DOES THE STORY BEGIN?
Before acquiring Mercury, HP had $90 billion of revenue, with 1% coming from “software and other”, meaning $1 billion or less in revenues
Join the conversation on Twitter use #moderntesting
Mercury was the market leading developer of testing tools, having produced current HP products such as:
WHO IS MERCURY?
Join the conversation on Twitter use #moderntesting
The acquired Mercury products still continue to be the cash cow for HP’s testing practice, while self-built tools have struggled:
HP STACK
Category Sub Cat. Tool Notes
Test Auto
Functional UFT Mercury Acquisition
Perf/Load Load Runner/Performance Center Mercury Acquisition
Integration Service Tester Mercury Acquisition
Test MgmtAgile Octane (future) Built
Waterfall HP Quality Center Mercury Acquisition
Infra & Setup
Test Cloud StormRunner (Load only) Built
Mobile Device Farm Mobile Center Built
Test Data Mgmt Test Data Management Mercury Acquisition
Environment Mgmt Surgient VQMS Mercury Acquisition
Other Logging/Debug Sprinter Built
Join the conversation on Twitter use #moderntesting
What has Changed Since HP Acquired Mercury?
Join the conversation on Twitter use #moderntesting
HP HAS MADE MANY MORE ACQUISITIONS
HP’s modest growth since 2006 has been achieved through making more acquisitions of high performing companies, not through making meaningful improvements to the software they acquire:
Year Company Revenue
2007 Opsware $100m
2008 Exstream $30m
2011 Autonomy $900m
+Est. 2006 Software Revenue $1.8b
2006 Rev. + Acquired Rev. $2.83b
2015 Annual Report
HP has experienced only 2.5% annual organic growth in software revenue
Join the conversation on Twitter use #moderntesting
FOR STARTERS:
To put things in perspective, the iPhone was released a year after the Mercury acquisition, in 2007:
Join the conversation on Twitter use #moderntesting
1. Agile adoption
2. Adoption of open source
tools/best-of-breed
3. SaaS growth4. Multi-channel development
5. DevOps and Automation
OTHER TRENDS SINCE 2006
Join the conversation on Twitter use #moderntesting
Since 2006, the growth of Agile has been tremendous:
THE GROWTH OF AGILE
2006
39%of organizations practicing Agile
development
2016
95%of organizations practicing Agile
development
Join the conversation on Twitter use #moderntesting
With agile has come a switch to more best of breed tooling:
Source: https://www.planittesting.com/nz/insights/2013/industry-stats-test-tool-utilisation-2012/
SWITCHING TO OPEN SOURCE
Join the conversation on Twitter use #moderntesting
The growth of Atlassian has been incredible to experience:
Source: http://static.amigobulls.com/articles/wp-content/uploads/2015/12/TEAM_Chart-3_121515.png
ATLASSIAN: A TECH UNICORN
Join the conversation on Twitter use #moderntesting
The demand for Selenium automation engineers points to equally impressive growth:
Source: http://1.bp.blogspot.com/-u5tJObxwS2g/Vl9jHto3Z7I/AAAAAAAAAH0/a3LNQxgOJf8/s1600/jobgraph.png
SELENIUM: THE MARKET STANDARD
Join the conversation on Twitter use #moderntesting
The demand for JMeter is growing quickly and has surpassed load runner in job postings:
Source: http://www.indeed.com/trendgraph/jobgraph.png?q=load+runner%2C+jmeter
JMETER: AN EMERGING COMPETITOR
Join the conversation on Twitter use #moderntesting
The growth in new technologies is driven almost entirely by subscription based solutions, rather than traditional licenses:
Source: http://blogs-images.forbes.com/louiscolumbus/files/2015/01/Global-Forecast-Public-Cloud-Forrester.jpg
SAAS RULES THE WORLD
Join the conversation on Twitter use #moderntesting
Chrome, Firefox, and Safari have taken over the world and driven the adoption of Internet Explorer to all-time lows:
Source: http://www.slate.com/content/dam/slate/blogs/moneybox/2012/06/12/the_rise_of_chrome_and_the_fall_of_internet_explorer/1339516947484.jpg.CROP.rectangle3-large.jpg
THE DEATH OF INTERNET EXPLORER
Join the conversation on Twitter use #moderntesting
Seemingly, almost every organization is thinking about DevOps, if they aren’t doing it already:
Source: https://media.licdn.com/mpr/mpr/shrinknp_400_400/AAEAAQAAAAAAAAkLAAAAJGQ4OTgxZDViLTZhZWQtNGU4Mi1iN2NiLWI5ZjBhMDIwMTQzMg.png
THE RISE OF JENKINS
Join the conversation on Twitter use #moderntesting
qTest is Today’s Testing Solution
Join the conversation on Twitter use #moderntesting
1. Agile adoption
2. Adoption of open source
tools/best-of-breed
3. SaaS growth4. Multi-channel development
5. DevOps and Automation
REMINDING US OF TRENDS SINCE 2006
Join the conversation on Twitter use #moderntesting
HP QC has several limitations from its waterfall architecture that prevent it from working well in Agile, including:
WHY HP QC FAILS IN AGILE
Heavy Workflows/UI
A clunky UI and restrictive workflows prevent quick
iterations
Rigid Structure
The rigid, prescriptive workflow doesn’t adapt to
various agile flavors
Expensive Licensing
Expensive licensing prevents collaboration and
team quality
Join the conversation on Twitter use #moderntesting
By building a platform later (in 2011) we were able to build to the then-current Agile process:
QTEST: AGILE TEST CASE MANAGEMENT
Intuitive UI/Workflows
The modern web UI allows you to work quickly and
efficiently
Adaptable Structure
The adaptable structure is embraced by all
methodologies, from waterfall to BDD
Lower Cost of Ownership
Lower licensing cost, with included support and maintenance than HP
Join the conversation on Twitter use #moderntesting
HP QC has lackluster integration to JIRA that causes both process and technology problems when leveraged:
HP’S POOR JIRA INTEGRATION
Join the conversation on Twitter use #moderntesting
We have put intense focus into our unique real-time JIRA integration, which 80%+ of our customers use:
QTEST’S REAL-TIME JIRA INTEGRATION
Join the conversation on Twitter use #moderntesting
SaaS (if implemented properly) has many benefits to organizations, HP’s model captures none of them:
HP ISN’T SAAS, IT’S ON-PREM IN THE CLOUD
qTest HP QCAbility to add extra servers/resources on demand ×No minimum purchase/service fees ×Instant upgrades and hotfixes ×Ability to convert trial data into paying sites ×Access to full features of On-Premise product ×
Join the conversation on Twitter use #moderntesting
We have implemented true multi-tenant architecture, a best-in-class way of optimizing resources across customers: HP QASymphony
Source: http://erpcloudnews.com/wp-content/uploads/2010/06/multi_tenant_versions_2.png
COMPARING THE ARCHITECTURES
Join the conversation on Twitter use #moderntesting
For years, HP QC had no support for Chrome, FireFox, and Safari. Their recent Web client still falls short in many areas:
HPQC DOESN’T SUPPORT MODERN BROWSERS
Requirements Test Cases Test Execution DefectsChrome × × Firefox × × Safari × × IE 10,11
Requires 300MB client
Requires
300MB client
Join the conversation on Twitter use #moderntesting
Unlike HP ALM, qTest offers full functionality in a modern, cross browser web app, with no thick client to install:
QTEST IS A BREATH OF FRESH AIR
Requirements Test Cases Test Execution DefectsChrome Firefox Safari IE 10,11
Join the conversation on Twitter use #moderntesting
When using JIRA for defect and requirements management, their synchronizer provides a clunky 5 step process:
Viewing impact of Defects on User Story Releases
HP IS NOT BUILT FOR DEVOPS
Defect Viewed in
JIRA
Navigate to Defect in
ALM
Link to Test Run in ALM
Link to Requirement
in ALM
Navigate to Requirement
in JIRA
Join the conversation on Twitter use #moderntesting
When using qTest with JIRA, all related executions as well as linked issues and test cases are visible directly in JIRA:
QTEST + JIRA – DEVOPS NIRVANA
Join the conversation on Twitter use #moderntesting
HP’s Future Plans
Join the conversation on Twitter use #moderntesting
At HP Discover this June, HP announced the release of a new ALM offering Octane, which will solve some key problems:
As is common for HP, the specific features/dates are uncertain:
HP’S VISION FOR THE FUTURE
HP OctaneCross Browser Support Gherkin Support Organize tests & requirements by feature Robust REST API’s DevOps workflows
Join the conversation on Twitter use #moderntesting
Though ALM Octane may solve many problems, it will leave many old ones unsolved and create several new ones:
ONE STEP FORWARD, TWO STEPS BACK
No Migration Path
ALM.net users have been told they need to start
completely fresh in Octane
Scheduled Sync with JIRA
HP still sees Octane as the system of record for user
stories and defects
No Bi-Modal Reporting
ALM.net and Octane use separate reporting
architectures with no shared visibility
Join the conversation on Twitter use #moderntesting
Given the uncertainty around HP Octane/ALM, rumors of HP selling off assets are gaining traction once again:
Source: http://www.bloomberg.com/news/articles/2016-07-08/hewlett-packard-enterprise-said-to-mull-selling-software-assets
RUMORS ARE SWIRLING
Join the conversation on Twitter use #moderntesting
The QAS Experience: Why the most HP Users
Choose Us
Join the conversation on Twitter use #moderntesting
qTest offers a viable path forward for large organizations that are ready for a change, but not convinced of HP ALM Octane:
QTEST IS BUILT FOR THE ENTERPRISE
Proven Migration Path• Migrate all relevant assets
yourself or through partners• No additional license or cost
Best In Class Support• Dedicated support rep for
implementation, installs, upgrades, training, etc.
• Support included with no additional cost
Continued Innovation• Monthly releases with input
collected directly from customer base
• Five new products released in 5 years of development
Join the conversation on Twitter use #moderntesting
We’ve migrated dozens of enterprise customers using our best-in-class migration tool. Others lack a cohesive migration tool:
BEST-IN-CLASS MIGRATION
qTest HP Octane ZephyrUsers/Assignees × ×Custom Fields/Values × ×Requirements × ×Links (Req<>TC, DF<> TR, etc.) × ×Test Cases Test Results × ×Defects
(using TaskTop) ×
Join the conversation on Twitter use #moderntesting
You’ll enjoy the level of attention and enablement you receive as part of your qTest subscription:
UPGRADE YOUR CUSTOMER SUPPORT
qTest HP ZephyrAssigned Account Rep × ×Customer Product Council ×Best Practices Webinars × ×Live Installation Support × ×24x5 support coverage × ×1 hour response time × ×Annual User Conference × ×
Join the conversation on Twitter use #moderntesting
Unlike HP, we practice Agile development using our own tools + many others, meaning more functionality, delivered faster:
YOU’RE AGILE, WE’RE AGILE
2016 2017Q1 Q2 Q3 Q4 Q12017
Late Q2
Late Q3
Early Q1
Feb 22 - Mar 28 Armstrong
Mar 28 - May 9
BaffinMay 9 - Jun
6 ColumbusJun 6 - Jul
11 DrakeJul 11 - Aug
15 EricsonAug 15 - Sep
19 FraserSep 19 - Oct
24 GamaOct 24 - Nov
28 HudsonNov 28 -
Jan 9Ingstad
Cloud releases every five weeks with features prioritized by customer requests
On Premise Releases
CloudReleases
Join the conversation on Twitter use #moderntesting
5 Key Takeaways
Join the conversation on Twitter use #moderntesting
IF YOU ONLY REMEMBER ONE SLIDE…
1. HP is not a software company• They still do less than 3% of their revenue on software
2. HP tools have not evolved• Many things have changed drastically since 2006, HP’s stance on testing has not
3. Using HP can hold you back• There are major drawbacks to using outdated testing tools, including operational inefficiencies
and competitive losses
4. HP is trying to evolve, but the vision is unclear• Octane might be a step in the right direction, but many questions are unanswered and the track
record for HP built software is poor
5. QASymphony is the dominant HP replacement option• We’ve build a business on replacing HP and considered the key challenges of moving from HP
from top to bottom – we are the complete solution with the pedigree
Join the conversation on Twitter use #moderntesting
Q&A
Questions?
Join the conversation on Twitter use #moderntesting
Thank you