PowerPoint Presentation
DevOps challenges facing QA
Webinar Presenters:Garry HeonBrian Le Suer
Gary and Brian give intros on themselves.3
AgendaWhat is DevOps?ChallengesMetricsToolsResources & SkillsetsIntroduction
Read the Agenda
4
AgendaWhat is DevOps?ChallengesMetricsToolsResources & SkillsetsIntroduction
Read the Agenda
5
Worlds 2nd Largest Independent Testing Company
QualiTest recognized for the past 3years as the only visionary pure play QA and Testing Services Company in the Magic Quadrant
About QualiTest Group
6
About ZeenyxCreators of AscentialTest, the award-winning testing solution for Windows, Web, dotNet, Java, PowerBuilder, Terminal and PDF
Committed to reducing the cost of software testing by making testers more productive
7
AgendaWhat is DevOps?ChallengesMetricsToolsResources & SkillsetsIntroduction
Read the Agenda
8
What is DevOps?Born from Agile software development and the need to keep up with the new software velocityIts combined with the understanding of value of collaboration between organizations throughout all stages of developmentThe increased importance of operations in the SAAS world has driven the need for innovation on the systems sideAs its name suggests, DevOps is a combination of software development,QA and operations disciplinesDevOps recognizes the interdependence of the groups
What DevOps is not?DevOps is not Development taking over OperationsDevOps is not just cultureDevOps is not just toolsDevOps is not just Development and Operations
AgendaWhat is DevOps?ChallengesMetricsToolsResources & SkillsetsIntroduction
Read the Agenda
11
ChallengesAlignment of development,QA and operations perspectivesLearning new skillsFrequent code changes must be tested quickly Automation suites must be resilient to application changesHaving the ability to automate in sprintNon-automatable tests must be integrated into the test cycle (exploratory, Ux, usability testing)Maintaining a developer toQA ratio that delivers consistently
Addressing the QA ChallengesUser stories are available and clearly defined before the sprint open/close meetingMock-ups/HTML of the UI design are made available to Dev andQA team at the same timeTesters must design their automation test case using mockups (pseudo code and/or the layout of the keyword)When Development completes UI integration, DOM elements are available forQA to complete the test case
Addressing the QA ChallengesTesters work closely with DevelopmentWhen the Xpath or the identifier of a page object is available,QA can make changes immediatelyPage object identifiers/Xpaths must be implemented so that all page objects are defined uniquelyAn appropriate automation test suite should be identified and plugged into the continuous integration pipeline
AgendaWhat is DevOps?ChallengesMetricsToolsResources & SkillsetsIntroduction
Read the Agenda
15
ResourcesNeed to maintain a good developer toQA ratioQualiTesters are finding the most successTest resources that are well rounded who can analyze requirements, automate test cases and execute them manually when neededSDETs find the transition easiestQA engineers are well-versed with technology, tools and processCI/CD, AgileBamboo, Jenkins, Git/TFS, Automation frameworks, AWSKeep up-to-date on trending technologies related to DevOps
ResourcesQA engineers need to be empoweredQA engineers need to communicate clearly during scrum meetingsQA engineers need to hold other team members (Dev, Ops) accountable to commitmentsQA engineers need to facilitate collaboration within the teamsQA engineers must address issues immediately
AgendaWhat is DevOps?ChallengesMetricsToolsResources & SkillsetsIntroduction
Read the Agenda
18
Requirements for an automated testing solution in an Agile/DevOps environmentFrequent code/component changes means that:
Tests must be executed frequently so that defects can be traced directly to most recent changes Tests must be resilient to application changesTests must be built using tools and approaches that makes it possible to update tests quickly and easily
AscentialTest Integration with Version ControlAscentialTest provides integration with version control to facilitate collaboration:Teams of people modify integrated test componentsTest projects must compile and be ready to execute at all times
AscentialTest version control integration:Check-out/check-inUpdate projectMerge changesVersion history
AscentialTest Integration with Build SystemsAscentialTest provides integration with build systems so that tests can be executed automatically on demand:
AscentialTests command line provides a mechanism to checkout the latest version of tests to target test machinesAscentialTests execution engine is accessible from the command line to allow tests to be run directly by the build systemAscentialTest report generator is accessible from the command line so that reports can be generated at the conclusion of a test runZeenyx Portal makes test results and reports available to the entire organization from any web browser
Rapid Test Development and MaintenanceAscentialTest AppObjects insulate tests from changes in the applications GUIAppObject definitions provide a single point of changeIf an application object is modified, only the AppObject definition needs to be updated. No changes to tests are required.
AscentialTests Step-based TestsTests are built with reusable components called steps that speed up the test creation process and reduce the maintenance effort when the target application changes.If application logic changes, only impacted steps need to be modified. Tests that implement those steps do not require any maintenance.
AgendaWhat is DevOps?ChallengesMetricsToolsResources & SkillsetsIntroduction
Read the Agenda
27
DevOps MetricsMetricDescriptionChange VolumeHow many user stories/fixes are being deployed.Change Lead TimeWhen commitment is made to business -> production.QA Lead TimeThe time from when the code is committed to when its deployedChange Failure RateHow many defects does a change introduce into the systemProduction DefectsNumber of defects found in productionHotfix/Rollback Production DefectsNumber of defects found in production that require a hotfixMTTR (Rollbacks)When a failure occurs how much time does it take to roll backMTTRWhen a failure occurs how much time does it take to recover (Hotfix)Number of Hotfixes/RollbacksNumber of hotfixes deployed over timeDeployment FrequencyHow often is new code being deployedTime to deployTime to deploy new codePercentage of Failed DeploymentsPercentage of deployments had issuesAvailabilityOverall uptime of the system
[email protected]@zeenyx.com
Thank You!
www.QualiTestGroup.com
Top Related