T17 DevOps & The Cloud 2019-‐05-‐02 13:30
A Practical Guide to Testing in DevOps
Presented by:
Katrina Clokie Bank of New Zealand
‘
Brought to you by:
888-‐-‐-‐268-‐-‐-‐8770 ·∙·∙ 904-‐-‐-‐278-‐-‐-‐0524 -‐ [email protected] -‐ http://www.stareast.techwell.com/
Katrina Clokie Katrina Clokie leads a team of around a hundred testers as a test practice manager in Wellington, New Zealand. Katrina is an active contributor to the international testing community as the author of A Practical Guide to Testing in DevOps, an international keynote speaker, a cofounder of the WeTest New Zealand testing community, the founder of Testing Trapeze magazine, and a frequent blogger and tweeter. Her complete professional profile is available on LinkedIn.
16/03/2019
1
DEV OPSDEVOPS
DAN ASHBY
16/03/2019
2
DAN ASHBY
ONCE UPON A TIME
#1. GRID GROUP
JENKINS SLAVE
NODE SERVER - MOCK TEST DATA
WEB SERVER - APPLICATION UNDER TEST
SELENIUM WEBDRIVER TESTS
JENKINS SLAVE
NODE SERVER
WEB SERVER
WEBDRIVER TESTS
SELENIUM GRID
16/03/2019
3
REFACTOR SELENIUM WEBDRIVER TESTS
CHANGE JENKINS BUILD CONFIGURATION
PROVISION NEW VIRTUAL INFRASTRUCTURE via PUPPET
TEST SELENIUM GRID
IN THE BOOK
BLAZING A TRAIL
PLATFORM EVOLUTION
ENVIRONMENT MANAGEMENT
INFRASTRUCTURE TESTING
#2. CALL ME MAYBE
WORKFLOW
16/03/2019
4
WORKFLOW WORKFLOW
WORKFLOW A/B TESTING
16/03/2019
5
IN THE BOOK
A/B TESTING
BETA TESTING
MONITORING AS TESTING
EXPOSURE CONTROL
#3. THE PIPELINE THAT WASN’T
16/03/2019
6
HYPOTHESISWE BELIEVE THAT VISUALISING THE RELEASE BUS IN A WAY THAT SHOWS
STATUS OF THE CURRENT RELEASE
IS ESSENTIAL FOR OUR RELEASE MANAGEMENT AND DELIVERY TEAMS
ACTIVELY INVOLVED IN RELEASING TO PRODUCTION
THIS WILL ACHIEVE SHARED UNDERSTANDING OF RELEASE STATUS, CLARITY IN WHERE TIME IS SPENT IN THE RELEASE BUS, AND GIVE US THE ABILITY TO
IDENTIFY COMMON BLOCKERS
WE WILL HAVE DEMONSTRATED THIS WHEN WE HAVE USED A PIPELINE TOOL MORE THAN ONCE TO DRIVE AND MANAGE RELEASES
IN SCOPE
SHOW STEPS OF RELEASE
AUTOMATED & MANUAL STEPS
TIMING OF EACH STEP
TRENDS IN RELEASE BLOCKERS
AUDITABILITY
OPTION TO FALLBACK
OUT OF SCOPE
CUSTOM NOTES
FULL REPLACEMENT OF GOVERNANCE
FIXING ENVIRONMENTS DURING DEPLOY
PROJECT-SPECIFIC ENVIRONMENTS
ROLLBACK PIPELINE
IN THE BOOK
PIPELINES
FEATURE TOGGLES
BUG BASH
CROWDSOURCED TESTING
#4. BUTTERFLY BUGS
16/03/2019
7
16/03/2019
8
IN THE BOOK
RISK WORKSHOP
FINDING BALANCE IN EXPLORATION
TESTING VS TESTER
VISUAL TEST STRATEGY
AND THEY ALL LIVED
HAPPILY EVER AFTER
KATRINA CLOKIE
@katrina_tester
leanpub.com/testingindevops
katrina-clokie
Top Related