Bringing Softteks Software Testing Organization from Good to World- Class Software Testing OrganizationProposal

AgendaMission StatementVision StatementGoalsAssessing Software Testing Capabilities Your current processesProcess to achieve a world-class software testing organizationDeployment ProcessAssessing Software Testing Competencies - The quality of your testersQ&A

Mission Statement

Mission StatementTo bring Softteks Software Testing Organization from Good to World-Class Software Testing Organization implementing the Quality Assurance Institutes (QAI) World-Class Software Testing Model.

Vision Statement

Vision StatementTo be an outsourcing Software Testing Organization leader in providing Quality Control services for our customers.

Goals

GoalsTo implement the Quality Assurance Institutes World-Class Software Testing Organization Model in the organization, to improve Software Testing Capabilities.To implement the Quality Assurance Institutes developed Common Body Of Knowledge (CBOK) for a Certified Software Tester (CSTE) in the organization, to improve testers competencies.To have Software Testers certified as CSTE within 1 year.

Assessing Software Testing Capabilities- Your Current Processes

Assessing Software Testing CapabilitiesMost testing organizations, as well as testers, believe they are doing a good job. However, there is no basis for making that determination.In order to make that determination, an assessment must be made against a model of a world-class testing organization.During the past 20 years the Quality Assurance Institute has studied many organizations and has developed a model of a world-class testing organization.

Assessing Software Testing CapabilitiesThe Nine components needed to achieve World-Class Software Testing are:Management SupportProcessesTrainingPlanningQuality ControlToolsEfficiencyTest Execution, analysis and ReportingUser Satisfaction

Assessing Software Testing Capabilities QAIs Model

Assessing Software Testing CapabilitiesCause-Effect-Diagram

Assessing Software Testing CapabilitiesUser Satisfaction: To involve the user at key points in the software testing process:Test StrategyTest ObjectivesTest PlanAcceptance TestingReporting the status and results of testing

Assessing Software Testing CapabilitiesQuality ControlIt raises the question, Who tests the testers?The answer is quality control within the test process evaluates whether the process has been performed correctly.Assessment to evaluate software testing organizations competencies.The following test processes incorporate quality control as part of the process:

Assessing Software Testing CapabilitiesEleven-step software testing processAssess Project Management Development Estimate and statusDevelop Test PlanRequirements Phase testingDesign Phase TestingProgram Phase TestingExecute Test and Record Results

Assessing Software Testing CapabilitiesAcceptance TestReport Test ResultsTesting Software InstallationTest Software ChangesEvaluate Test Effectiveness

Assessing Software Testing CapabilitiesTesting Specialized Systems and ApplicationsTesting the Adequacy of System DocumentationTesting Web-based SystemsTesting Off-the-Shelf SoftwareTesting SecurityCreating Test Documentation

Assessing Software Testing CapabilitiesExecution and ReportingProvides the opportunity to evaluate executable programs as a systemBuild Test DataExecute TestRecord Test ResultsTest Report

Assessing Software Testing CapabilitiesPlanningIf you fail to plan, plan to failTo plan a test together with the components of a test planDevelop Test Plan

Assessing Software Testing CapabilitiesEfficiencyInvolves planning and performing software testing in a manner that provides the greatest coverage and the maximum assessment of business risks for the resources allocatedEstablishing a Software Testing MethodologyDetermining Software Testing TechniquesSelecting and Installing Software Testing ToolsEvaluate Test Effectiveness

Assessing Software Testing CapabilitiesTools TechniquesTools are necessary to provide effective and efficient software testingProcesses for selecting and installing testing tools

Assessing Software Testing CapabilitiesProcessesWithout processing, testing is an art that is subject to significant variation in executionProcesses bring stability and consistency to software testingBuilding a Software Testing strategyEleven Step Software Testing Process

Assessing Software Testing CapabilitiesTrainingEffective software testing begins and ends with educationDefine the test strategy that must include training 11 step testing process in which software testers must be trained

Assessing Software Testing CapabilitiesManagement Support (Test Environment)Effective testing requires strong management supportSupport is needed so that the test strategy meets the needs of the business, and appropriate time and resources are available to accomplish that strategyEstablish the need for managements support by providing a baseline of the current software testing capabilities and competencies

Process to achieve a world-class software testing organization

Process to achieve a World-Class Software Testing Organization A Four step process to achieve a World-Class Software Testing Organization:Use QAIs model for setting a strategic quality goalDevelop a baseline by assessing your current processesBased on the results of the assessment, a long-range strategy will be developed to maximize the efficiency of the organizationDefine a quick-payback approach to implement the strategy

Process to achieve a World-Class Software Testing OrganizationUse QAIs model for setting a strategic quality goal

Process to achieve a World-Class Software Testing OrganizationDevelop a baseline by assessing your current processesBuild Assessment TeamComplete Assessment QuestionnairesBuild Kiviatt ChartAssess Results

Assessing Current Process- Workbench

Process to achieve a World-Class Software Testing OrganizationTask 1: Build Assessment TeamThe assessment team needs to combine people who in totality possess the knowledge on how software testing is performed in your organizationTask 2: Complete Assessment QuestionnairesIt is composed of eight categories (Drivers of World- Class Testing)Task 3: Build Kiviatt ChartThis chart is implemented to transcribe the results of completing Questionnaire

Process to achieve a World-Class Software Testing OrganizationTask 4: Assess ResultsAsses status of each category versus what the category should be in a world-class testing organizationInterpret your software testing assessment Kiviatt Chart

Task 1: Build Assessment Team

Task 2: Assessment Questionnaires

Task 3: Kiviat Chart

Task 3: Kiviat ChartFor each category the number of Yes responses should be totaledA dot should be placed on the kiviat chart on the line representing the number of Yes responsesFor example:If there were three Yes responses for test planning a dot would be placed on the test planning line at the intersection of the line representing three Yes responses.

Task 3: Kiviat ChartA dot should be put on the line representing all eight categories for the number of Yes responses. The dots are then connected by a line resulting in what is called a footprint of the status of your software testing organization versus a world-class testing organization.

Task 4: Assess ResultsSofttek can use the results of this assessment in any of these three ways:Determine Softteks current software testing status versus a world-class testing organization. The responses in the area to address will indicate Softteks strengths and weaknesses compared to a world-class testing organizationDevelop a software testing goal to become a world-class testing organizationDevelop an improvement plan

Deployment Process

Deployment ProcessAssessment questionnaires are sent to Test leadsTest Leads answer questionnairesTotal number of Yes are dumped into Capabilities Assess Results MatrixKiviat Chart is builtBased on Results develop testing goalsDevelop improvement plan

Deployment Process

Deployment Process

Deployment ProcessInterpreting Kiviat Results:The areas that need improvement are:Test TrainingTest EfficiencyTest Quality Control

Assessing The Quality Of Your Testers

Assessing the quality of your testersAssessing the Quality of Your TestersThis practice will enable you to assess your individual testing competencies against the five skill categories in QAIs Common Body of Knowledge (CBOK)General SkillsTest Skills/ApproachesTest PlanningExecuting the Test PlanTest Analysis and Reporting

Assessing the quality of your testersTest Competency Cause-Effect-Diagram

Test Competency Workbench

Assessing the quality of your testersTask 1: Understand CSTE CBOKBefore you can effectively evaluate your software test competencies, you need to understand the Common Body Of Knowledge (CBOK) for software testingTask 2: Complete Assessment QuestionnairesIt is composed of 5 categories (Drivers of Testing Competency)Task 3: Build Kiviat ChartThis chart is implemented to transcribe the results of completing Questionnaire

World-Class Software Testing Organization ModelTask 4: Assess ChartAssess status of each category versus what the category should be as indicated in the CSTE CBOKInterpret your software testing competencies against your current job responsibilities

Task 1: Understand CSTE CBOK

Task 2: Complete Assessment

Task 3: Kiviat Chart

Task 3: Kiviat ChartFor each of the five questionnaires, total the number of Yes responses.Convert the number of Yes responses to a percentage by multiplying the number of Yes responses by 10 (e.g., 3 Yes responses x 10= 30%)Transcribe the percentage for each of the five questionnaires.For the lines corresponding to the questionnaire name, put a dot on the kiviat chart for the percentage of Yes responses for that assessment competency category.

Task 4: Assess ChartAny rating less than 100 percent indicates a potential area of improvement in that skill categoryInterpret your software testing competencies against your current job responsibilities

Q&AAny Questions.