Proprietary Material Provided for Training Purposes Only © 2012 Excella Consulting, Inc.
Richard Cheng - @RichardKCheng
◊ Agile trainer & coach
◊ Member of PMI, Scrum Alliance, Agile Alliance, Agile Leadership Network
◊ CST, PMP, CSM, CSPO, CSP, PMI-ACP
◊ Founder & executive committee member of Agile Defense Adoption Proponents Team (ADAPT), the Agile DoD Task Force
◊ Deep expertise in Federal and commercial Agile transformations
Quality and the Business Analyst
Validates work Validates correctness Validates usability
◊ Building Quality into the process – Real time identification of quality issues
• Automation – Using the right tools and techniques
21st Century Quality Practices
Benefits*
Assuming 100 defects in 10,000 lines of code
1. Traditional testing finds a defect in about 10 hours
2. Manual code inspections find a defect in 1 hour
3. Automated testing finds a defect every 6 minutes
þ 36% reduction in defect ratewhen integration/regression testing at each code check-in
þ 90% reduction in bugs reaching QAMajor municipal gas utility
þ
þ
þ
þ
þ
95% cut in cost of bugsLarge retail web site
90% cut in defect remediation costGlobal supplier of healthcare equipment
Faster time-to-marketMore features and higher quality
Agility in the marketplaceAdded new functionality 2 weeks before ship
Confidence in the process“Oozing Confidence”
*Sources: • Grant, T. (2005). Continuous integration using cruise control. Northern Virginia Java Users Group (Novajug), Reston, Virginia, USA. • Fredrick, J. (2008). Accelerate software delivery with continuous integration and testing. Japanese Symposium on Software Testing, Tokyo,
Japan. • Rico, D. F. (2012). The Cost of Quality (CoQ) for Agile vs. Traditional Project Management. Fairfax, VA: Gantthead.Com.
Technology Stacks
◊ .Net ◊ Java ◊ Python ◊ Ruby ◊ JavaScript ◊ Others….
Don’t Do It All At Once
Do This First 1. Version
Control 2. Build
Automation 3. Automated
Unit Testing 4. Continuous
Integration
Next Do This 5. Static Code
Analysis 6. Dependency
Management
Then Do This 7. Automated
Integration Testing
8. Automated Acceptance Testing
9. Deployment Automation
First Do This
1. Version Control – What: Repository to persist and track version of code and
artifacts – Effort: Low – Sample Tools:
• Traditional – TFS (MS), Subversion • Distributed Version Control (branching and merging) - Git,
Mercurial
First Do This
2. Build Automation – What: One click or one command launch of build process – Effort: Low – Sample Tools:
• Microsoft – MSBuild, Powershell • Java/Others – Ant, Gradle, Maven
First Do This
3. Automated Unit Testing – What: An automated stand alone test that test a single
unit of the code. – Effort: Medium – Sample Tools:
• Unit test tools: JUnit (Java), NUnit (MS), MS Test (MS) • Advanced tools: Moq, Fluent Assertions
First Do This
4. Continuous Integration – What: Provides frequent verification and notification of
changes to the code and application – Effort: Medium – Sample Tools: Jenkins, Hudson, TFS (MS), TeamCity
Continuous Integration
Build #1 compile
unit test
integra0on test
package
deploy/run
acceptance test
analyze code
Build Report
Version Control
change #1
change #2
Build Server
Build #2 compile
unit test
integra0on test
package
deploy/run
acceptance test
analyze code
Build Report Email
Failed Build
Continuous Integration
◊ CI involves: – Frequent code check-ins – Regularly scheduled, automated builds – Automated tests – Immediate feedback to developers detailing any build
errors or failed tests
◊ Benefit: – Developers know immediately upon check-in if their code
works and if any other application features were broken as a result
CI Effect on Schedule
Code Phase QA Phase Code Phase QA Phase
Code Phase Code Phase
Code + Test Phase Code + Test Phase
Schedule
Release 1 Release 2
Original Plan
Reality
With CI
Benefits of Continuous Integration
◊ Avoids last-minute chaos at release dates ◊ Early warnings of broken code ◊ Early warning of conflicting changes ◊ Immediate testing of all changes ◊ High availability of a "current" build for testing,
demo, or release purposes
Don’t Do It All At Once
Do This First 1. Version Control 2. Build
Automation 3. Automated
Unit Testing 4. Continuous
Integration
Next Do This 5. Static Code
Analysis 6. Dependency
Management
Then Do This 7. Automated
Integration Testing
8. Automated Acceptance Testing
9. Deployment Automation
Next Do This
5) Static Code Analysis – What: Checks for coding standards and code quality – Effort: Low – Sample Tools: Visual Studio Code Analysis, FindBugs
(Java), PMD, Cobertura, Sonar, CheckStyle
Code Quality
Next Do This
6) Dependency Management – What: Manages 3rd party components and ensure we have
the latest / correct version these components – Effort: Low – Sample Tools: Gradle, NuGet
Don’t Do It All At Once
Do This First 1. Version Control 2. Build
Automation 3. Automated
Unit Testing 4. Continuous
Integration
Next Do This 5. Static Code
Analysis 6. Dependency
Management
Then Do This 7. Automated
Integration Testing
8. Automated Acceptance Testing
9. Deployment Automation
Then Do This
7. Automated Integration Testing – What: Testing interaction between multiple components to
ensure our component dependencies don’t break – Effort: Medium to High – Sample Tools: DBUnit (Java), NDBUnit (MS)
Then Do This
8. Automated Acceptance Testing – What: Automated testing to ensure the systems meets
business needs – Effort: High – Sample Tools: SpecFlow, Cucumber, FitNess – For Browser Testing: Selenium, WatiN
Automated Tests
◊ Automated tests involves: – Unit tests: Testing of smallest possible piece of code that can
operate in isolation – Integration tests: Testing interaction between multiple
components – Acceptance tests: Testing complete segments of a system to
ensure it meets the business needs
◊ Benefits – Enables rapid discovery of root cause – Reduces defect rate – Saves time in system test – Ensures testing starts early in cycle – Provides for a free regression testing suite
Testing Quadrant
Functional Tests Acceptance Tests
Unit Tests Component Tests System Tests
Showcases Exploratory Tests Usability Tests
Performance Tests Security Tests
The
Team
The Product
Functionality
The System from Brian Marick
Then Do This
8. Automated Deployment – What: Push button deployment capabilities – Effort: High – Sample Tools: FluentMigrator, Puppet, Octopus
Automated Deployments
Sandbox
Production Version Control
CI Server
DB
Web Server Web Server
DB
Test DB
Web Server Web Server
DB
DB
Web Server
Automated Nightly Deployments
Push Bu6on Deployments
Managed Deployments
Benefits of Automated Deployments
◊ Reduces complexity by using standardized script ◊ Reduces risk by re-running same script ◊ Reduces cost by speeding up deployment ◊ Frees up resources to focus on new features
Team Member’s Bill of Rights
1. Every {team member} shall have two monitors 2. Every {team member} shall have a fast PC 3. Every {team member} shall have their choice of
mouse and keyboard 4. Every {team member} shall have a comfortable chair 5. Every {team member} shall have a fast internet
connection 6. Every {team member} shall have {effective} working
conditions
Modified from Jeff Atwood’s http://www.codinghorror.com/blog/2006/08/the-programmers-bill-of-rights.html
Useful References
◊ Stephen Ritchie, Pro .NET Best Practices, Apress, 2011.
◊ Paul Duvall, Steve Matyas, and Andrew Glover, Continuous Integration: Improving Software Quality and Reducing Risk, Addison-Wesley, 2007.
◊ Jez Humble, Continuous Delivery: Reliable Software Releases through Build, Test, and Deployment Automation, Addison-Wesley, 2010
Excella Consul<ng Experience and Exper<se in Agile Solu<ons
– Coaching – Training – Assessments
– Agile Adop0on – Agile Development Teams – Agile PMO
Training Courses – Cer0fied ScrumMaster (CSM) – Cer0fied Scrum Product Owner (CSPO): The Agile Business Analyst – Advanced Cer0fied Scrum Product Owner (CSPO) – Cer0fied Scrum Developer (CSD) – Agile Tes0ng – Agile Business Intelligence and Data Warehousing
See h3p://www.excella.com/services/agile-‐training-‐services.aspx for more informa@on
Contact Information
Richard K Cheng [email protected] 703-967-8620 http://www.excella.com Twitter: @RichardKCheng
Top Related