Testing Trendsfiles.meetup.com/2625872/voke_SQuAD_Testing Trends and the Pivot… · Testing...
Transcript of Testing Trendsfiles.meetup.com/2625872/voke_SQuAD_Testing Trends and the Pivot… · Testing...
© 2013 voke media, llc All Rights Reserved. Reproduction and distribution are prohibited.
◉ Testing Trends: The Pivotal Role of the Test Professional
Theresa Lanowitz, voke Founder
Denver, CO | 16 September, 2013
© 2013 voke media, llc All Rights Reserved. Reproduction and distribution are prohibited.
◉ Agenda
• About voke
• Global Trends – The Need for Quality
• Organizational Secrets to Success – Quality Assurance a Critical
Business Partner
• Quality Assurance Roadmap
• Net/Net
© 2013 voke media, llc All Rights Reserved. Reproduction and distribution are prohibited.
๏ About voke
© 2013 voke media, llc All Rights Reserved. Reproduction and distribution are prohibited.
◉ About voke
• Independent industry analyst firm
• Founded in 2006 by Theresa Lanowitz
• Firm focuses on the application lifecycle and its transformation
including virtualization, cloud computing, embedded systems,
mobile and device software
• Provides strategic, independent, and impartial advice and market
observations through qualitative and quantitative research
© 2013 voke media, llc All Rights Reserved. Reproduction and distribution are prohibited.
๏ Global Trends –
The Need for Quality
© 2013 voke media, llc All Rights Reserved. Reproduction and distribution are prohibited.
◉ Current Reality
© 2013 voke media, llc All Rights Reserved. Reproduction and distribution are prohibited.
◉ NASDAQ – August 22, 2013
A “computer malfunction”
froze thousands of
securities listed on the
Nasdaq Stock Market for
three hours. Many of the
country’s most-traded
shares ground to a
standstill as brokers were
unable to execute orders.
© 2013 voke media, llc All Rights Reserved. Reproduction and distribution are prohibited.
◉ Chicago Board Options Exchange – April 25, 2013
Chicago Board Options
Exchange delayed the start of
trading by three hours because
of “an unresolved software
bug”.
Executives of CBOE were
quoted as saying “it was a
tough morning”.
© 2013 voke media, llc All Rights Reserved. Reproduction and distribution are prohibited.
◉ Novopay New Zealand – August 2012 to Present
Novopay, a web-based payment
system for New Zealand teachers
and staff created by Talent2, was
delayed by more than two years.
Once in production users of the
system were either overpaid,
underpaid, or not paid at all.
Defects such as hyphenated
names caused disappearance.
Estimated $5 million remediation
plan and $3.5 million in extra
staffing.
© 2013 voke media, llc All Rights Reserved. Reproduction and distribution are prohibited.
◉ Sabre Holdings – September 11, 2012
American Airlines,
Southwest Airlines,
JetBlue Airways, and
Alaska Airlines lost
access to their
reservation systems
hosted by Sabre Holdings, a global distribution system.
© 2013 voke media, llc All Rights Reserved. Reproduction and distribution are prohibited.
◉ More Software Failures Daily
© 2013 voke media, llc All Rights Reserved. Reproduction and distribution are prohibited.
◉ Why Are Software Failures Making Headlines?
• Economy
- Lack of investment during Global Financial Crisis (GFC)
• Faster, faster, faster
- Faster is not equal to better
• Old technology
- Most organizations are not up to date on current software platforms
- Most organizations are not leveraging the power of modern solutions
© 2013 voke media, llc All Rights Reserved. Reproduction and distribution are prohibited.
◉ Audience Question 1
Does your team deliver software with greater quality today vs.
five years ago?
1. Yes, and we know this because we measure
2. Yes, we think we do but do not measure
3. Our quality is about the same as five years ago
4. No, we deliver less quality
5. Not sure
© 2013 voke media, llc All Rights Reserved. Reproduction and distribution are prohibited.
๏Organizational Secrets to
Success
Quality Assurance –
A Critical Business Partner
© 2013 voke media, llc All Rights Reserved. Reproduction and distribution are prohibited.
◉ A Renaissance for Quality Assurance Professionals
“Since our last published report on the testing market in 2010
there has been a renaissance in the testing market by both the
software vendors and the testing professionals themselves.
Testing professionals are far more visible, vocal, and confident
than at any other time in the history of the market. This new
found confidence is based on the value delivered through their
dedication to software excellence.”
voke 2012 Market Mover ArrayTM Report: Testing Platforms
© 2013 voke media, llc All Rights Reserved. Reproduction and distribution are prohibited.
◉ Parity – A Basic Requirement
© 2013 voke media, llc All Rights Reserved. Reproduction and distribution are prohibited.
◉ Parity – A Basic Requirement
© 2013 voke media, llc All Rights Reserved. Reproduction and distribution are prohibited.
◉ Classic Challenge
Cost
Quality Schedule
© 2013 voke media, llc All Rights Reserved. Reproduction and distribution are prohibited.
๏Quality Assurance Roadmap
© 2013 voke media, llc All Rights Reserved. Reproduction and distribution are prohibited.
◉ QA Roadmap – Critical for Business Success
Chaos
Establish
QA Role
Dev and
QA Parity
IT & Biz
Alignment
Change
Agent
© 2013 voke media, llc All Rights Reserved. Reproduction and distribution are prohibited.
◉ QA Roadmap – Recognize the Value in QA
Would you believe
you can gain
“CONTROL” from
“KAOS”? Source: http://en.wikipedia.org/wiki/Get_Smart
© 2013 voke media, llc All Rights Reserved. Reproduction and distribution are prohibited.
◉ QA Roadmap – Establish the Role
Actions Expectations Technology Tips
Seek executive
champion
Evaluate QA model •Internal QA
•Outsourced QA
•Hybrid
Establish a QA team
QA team demonstrates
its value •Metrics
•Results
•Visibility
•Accountability
Be proactive with
manual testing tools •HP Sprinter
•Microsoft Visual Studio
2012 Test Professional
© 2013 voke media, llc All Rights Reserved. Reproduction and distribution are prohibited.
◉ QA Roadmap – Mutual Respect Between Development and QA
Actions Expectations Technology Tips
Build on previous step
Seek an executive champion
to elevate QA role as a peer
level to development
Promote the QA organization
to a peer level to development
Empower QA to communicate
any potential business risks
that may arise upon release
Development and QA
collaborate to deliver higher
quality
QA is a proactive lifecycle
participant
QA professionals have
equivalent career paths to
development
Eliminate bottlenecks – use
lifecycle virtualization •CA LISA
•HP
•IBM
•Parasoft
Eliminate elusive defects •CA LISA
•Microsoft •Parasoft
Collaborate with development
embrace
development testing •Coverity
•Parasoft
Deliver higher quality with
continuous integration •Electric Cloud
•Microsoft
© 2013 voke media, llc All Rights Reserved. Reproduction and distribution are prohibited.
◉ QA Roadmap - QA Value Recognized
Actions Expectations Technology Tips
QA takes a leadership role
•Promotes its value
•Puts customers at the forefront
•Advocates the Business
Analyst and strategic
requirements
•Expands reach into
application/software usability
QA is a valued leader in the
organization
QA leverages Centers of
Excellence (CoE)
QA is known as the
customer advocate
Make requirements a central theme
•Evaluate requirements definition
solutions
Protect your data
•Harness the power of service
virtualization to manage test data
across multiple teams
Understand impacts of performance
•Ensure application performance
throughout the lifecycle
•Mobile applications highlight the
importance of performance
© 2013 voke media, llc All Rights Reserved. Reproduction and distribution are prohibited.
◉ QA Roadmap – QA Leads Change for Business Value
Actions Expectations Technology Tips
Continue with previous
actions
Publicly promote the results
of the QA organization
Continue to emphasize
requirements •Strategic asset to the
business
Lead •Inside QA
•Inside the application lifecycle
•With the line of business and
customers
Focus efforts strategically •Tackle quality issues beyond the
current release
•Identify root cause and solutions
Identify enterprise-wide software
quality issues
Leverage application security
tools to expand expertise and
show more lifecycle value
Mobile applications highlight
the importance of application
security •Coverity
•HP
•IBM
•Parasoft
Extend traceability into the
development environment
Use tools to deliver policy and
governance throughout the
lifecycle
© 2013 voke media, llc All Rights Reserved. Reproduction and distribution are prohibited.
◉ Audience Question 2
Where is your organization on the QA Roadmap?
1. Chaos
2. Establishing the QA role
3. Development and QA parity
4. IT and business alignment
5. Change agent
© 2013 voke media, llc All Rights Reserved. Reproduction and distribution are prohibited.
๏Embracing
Technology
© 2013 voke media, llc All Rights Reserved. Reproduction and distribution are prohibited.
◉ Embrace New Technology – Innovate
Technology Market Vendor/Product Benefit to Quality
Manual Testing • HP Sprinter
• Microsoft Visual Studio 2012
• Dynamic creation of test cases
• Increase testing across platforms
Lifecycle Virtualization • CA Lisa
• HP Service Virtualization
• IBM Rational Test Virtualization Server
• Parasoft Virtualize
• Microsoft Visual Studio 2012
• Reduce wait times
• Increase availability of services
• Reduce defects entering production
• Reduce overall software cycle time
• Reduce test cycle time
• Increase code coverage
Development Testing • Coverity Development Testing Platform
• Microsoft Visual Studio 2012
• Parasoft Development Testing
• Prevent defects from leaving development
• Increase predictability
• Increase visibility across the lifecycle
• Increase collaboration
Continuous Integration • Electric Cloud Electric Commander
• Microsoft Visual Studio 2012
• Prevent broken builds from entering QA
• Automate build/test/deploy process
Requirements • HP Requirements Management
• IBM Rational Requisite Pro
• Microsoft Visual Studio 2012
• Provide a single view across lifecycle
• Trace requirements across lifecycle
• Prevent requirements defects from
entering production
Performance • HP Performance Center
• IBM Rational Performance Tester
• Microsoft Visual Studio 2012
• Neotys NeoLoad
• Prevent and manage non-functional
defects
• Retain customer engagement
Application Security • Coverity Security Advisor
• HP Security Solution
• IBM Security AppScan
• Parasoft Application Security Solution
• Reduce security vulnerabilities from
entering production
• Manage security risks of applications
© 2013 voke media, llc All Rights Reserved. Reproduction and distribution are prohibited.
๏2012 voke Market Mover ArrayTM Chart
Testing Platforms
Source: voke Market Mover ArrayTM Report: Testing Platforms – June 2012
© 2013 voke media, llc All Rights Reserved. Reproduction and distribution are prohibited.
◉ Net/Net
• Software and the brand are linked
• QA delivers value to the business
• QA is a critical business partner
• Know where you are on the QA Roadmap
- Transform your organization and embrace QA as a customer advocate
- Strive to become a change agent in the organization
• Innovate in your organization
© 2013 voke media, llc All Rights Reserved. Reproduction and distribution are prohibited.
◉ Learn More at www.vokeinc.com
• Become a Research client at www.vokeinc.com
- voke Market Snapshot: Agile Realities
- voke Strategic Brief: Cost of Rework
- voke Market Snapshot: Service Virtualization
- voke Category Snapshot: Lifecycle Virtualization
- voke Market Snapshot: Virtual Lab Management
- voke Market Mover Array: Testing Platforms 2012
- voke Market Mover Array: Application Lifecycle Management
• Follow voke on Twitter: @vokeinc
• Take our surveys
© 2013 voke media, llc All Rights Reserved. Reproduction and distribution are prohibited.
Thank You!!!
© 2013 voke media, llc All Rights Reserved. Reproduction and distribution are prohibited.
◉ voke Contact
voke, inc.
2248 Meridian Boulevard
Suite H
Minden, NV 89423
P: +1.866.895.9045
W: www.vokeinc.com
T: @vokeinc