CSTE – Skill Category 3 - 1 © Copyright 2014 / All rights reserved
Skill Category 3
Managing the Test Project
The following topics will be discussed in this Skill Category:
• Test Administration
• Test Supervision
• Test Leadership
• Managing Change
CSTE – Skill Category 3 - 2 © Copyright 2014 / All rights reserved
Test Administration
• Test Planning*
• Test Estimation
– Budgeting
– Scheduling
• Staffing
• Customization of the test process
* Test Planning will be covered in detail in Skill Category 5
CSTE – Skill Category 3 - 3 © Copyright 2014 / All rights reserved
Challenge of Estimation...
It's tough to make predictions, especially about the future.
Yogi Berra
CSTE – Skill Category 3 - 4 © Copyright 2014 / All rights reserved
What is the challenge of producing a reasonable budget and schedule?
The size of the work effort must be correctly estimated.
Estimating a Budget and Schedule
CSTE – Skill Category 3 - 5 © Copyright 2014 / All rights reserved
What Factors Influence Estimation?
• Development life cycle model used
• Requirements
• Past data
• Organization culture
• Selection of suitable estimation technique
• Test management experience
• Resources available
• Tools at our disposal
CSTE – Skill Category 3 - 6 © Copyright 2014 / All rights reserved
What Techniques are Usedto Estimate Budget?
• Expert judgment
• Top-down (cost, constraints, Function Points, COCOMO)
• Bottom-up (needs Work Breakdown Structure)
CSTE – Skill Category 3 - 7 © Copyright 2014 / All rights reserved
Top Down Estimation Techniques
• Analogous - The process of analogous estimating takes the actual time and/or cost of a historical project as a basis for the current project. The time cost of the historical project is applied to the current project with respect to the scope of the current project, its size, and other known variables.
• Parametric - Parametric Modeling uses a mathematical model based on known parameters to predict the cost/schedule of a test project. The parameters in the model can vary based on the type of project. For example, a parameter can be “years of experience of the test analyst”, or “years of experience with a programming language of the programmer”.
CSTE – Skill Category 3 - 8 © Copyright 2014 / All rights reserved
Expert Judgment Estimation
Expert judgment is the ability, based on experience, to compare historical figures with current project variables to make time and effort predictions.
CSTE – Skill Category 3 - 9 © Copyright 2014 / All rights reserved
Top Down Estimation Techniques
• Source Lines of Code (SLOC) - Counting the source lines of code written for the application. However, SLOC is a resultant measure. It is a measure that is ultimately obtained after the application has been written or, at the very least, estimated with significant knowledge of the application’s structure.
CSTE – Skill Category 3 - 10 © Copyright 2014 / All rights reserved
Top Down Estimation Techniques
Function Points• External inputs are largely data entry screens
• External interface files are file-based inputs or outputs
• External outputs are reports
• External queries are message or external function-based communication into or out of the application
• Logical internal tables are the number of tables in the database
CSTE – Skill Category 3 - 11 © Copyright 2014 / All rights reserved
Top Down Estimation Techniques
• Use Case Points - Count Use Case Attributes
• Cost Models (e.g., COCOMO II Constructive Cost Model) - Combine estimated SLOC, five Scale Drivers, and fifteen Cost Factors to determine cost.
CSTE – Skill Category 3 - 12 © Copyright 2014 / All rights reserved
Bottom Up Estimation Techniques
• Work Breakdown Structure (WBS) - Defines the total project based on the product composed of hardware and software elements and service elements. The WBS does not break down to the smallest level.
CSTE – Skill Category 3 - 13 © Copyright 2014 / All rights reserved
Agile Estimation Techniques• Story Points - Measure relative story sizes
• Planning Poker - Individuals estimate the cost by ‘playing’ cards of their estimate that are then revealed and the estimate discussed
• Triangulation - Comparison between estimates with no set baseline
• Wideband Delphi - Everyone creates three estimates for the effort and then they are compared
CSTE – Skill Category 3 - 14 © Copyright 2014 / All rights reserved
Test Specific Estimation Techniques
• Analogous Percentage Method – An estimate based on previous efforts and a predicted Size Factor
• Test Point Analysis - similar to Function Points
• Development Ratio Method - Based on a ratio with the number of developers
• Test Condition Analysis - Use the number of test conditions and historical information
CSTE – Skill Category 3 - 15 © Copyright 2014 / All rights reserved
ExerciseThree methods of estimating budgets are :
a. Top Down, Bottom Up, Peer Reviewb. Past History, Expert Judgment, WBSc. Top Down, Bottom Up, Expert Judgmentd. Expert Judgment, Random Guessing, Stochastic Processes
CSTE – Skill Category 3 - 18 © Copyright 2014 / All rights reserved
Budgeting
A budget is a plan for specifying how resources, especially time or money, will be allocated or spent during a particular period.
CSTE – Skill Category 3 - 19 © Copyright 2014 / All rights reserved
Budgeting
• A budget is not an estimate
• A plan based on the earlier size and effort estimates
• Should not be changed unless approved by the project stakeholders
CSTE – Skill Category 3 - 20 © Copyright 2014 / All rights reserved
Scheduling
A schedule is a calendar-based breakdown of tasks and deliverables.
The schedule answers the following questions:
• What tasks will be done?
• Who will do them?
• When will they do them?
CSTE – Skill Category 3 - 21 © Copyright 2014 / All rights reserved
ResourcingSoftware Testing Projects
• Developers test
• Independent testers
• Non-IT testers
• Combination of above
It is not necessary for every member of the test team to possess all the skills, but in total the team should have all the needed skills.
If the test team does not possess the necessary skills, it is the responsibility of the test manager to teach those individuals the needed skills.
CSTE – Skill Category 3 - 22 © Copyright 2014 / All rights reserved
Software Testing Staffing Matrix
Skills Needed
Staff Planning Test Data Generation
Tool X Tool Y
A
B
C
D
CSTE – Skill Category 3 - 23 © Copyright 2014 / All rights reserved
What Causes the Need for the Test Process to be Customized?
• Release cycle schedules
• Software development methodology
• User schedules
• Project status reporting
• Interfacing with other projects
• Interfacing with enterprise-wide databases
• Different naming conventions/data definitions
CSTE – Skill Category 3 - 24 © Copyright 2014 / All rights reserved
Customization Includes
• Adding new test tasks
• Deleting test tasks
• Adding or removing test tools
• Supplementing skill sets of testers
CSTE – Skill Category 3 - 25 © Copyright 2014 / All rights reserved
Software Development Constraints
Budget Schedule
QualityStaffing
Changes to one of the constraints will cause one or more of the other constraints to also change
CSTE – Skill Category 3 - 26 © Copyright 2014 / All rights reserved
Essay (5 minutes):
Assume you are a test manager for an online order entry system that is a web-based system in which customers enter their orders over the internet. Your challenge is how to staff the project. It is a large project and you will be assigned 4 testers. For this project, indicate the testing skills that you believe are needed on this project and explain why those skills are necessary.
CSTE – Skill Category 3 - 28 © Copyright 2014 / All rights reserved
Essay (5 minutes):
Assume you are a test manager for an online order entry system that is a web-based system in which customers enter their orders over the internet. Your challenge is how to staff the project. It is a large project and you will be assigned 4 testers. For this project, indicate the testing skills that you believe are needed on this project and explain why those skills are necessary.
EXAM HINT
When answering essay questions, don’t be long winded!
CSTE – Skill Category 3 - 30 © Copyright 2014 / All rights reserved
Test SupervisionSupervision is a combination of the supervisor possessing the skill sets needed to supervise, and the tasks that contribute to successful supervision.
• Communication
• Negotiation
• Project relationships
• Motivation, mentoring, recognition
CSTE – Skill Category 3 - 31 © Copyright 2014 / All rights reserved
Communication Skills
• Written & oral communications
• Listening skills
• Interviewing skills
• Analyzing skills
CSTE – Skill Category 3 - 32 © Copyright 2014 / All rights reserved
3 Step Listening ProcessOral communication (which includes listening) is rated as the number one skill for the tester.
The listening process involves three separate steps:
• Hearing the speaker
• Attending to the speaker
• Understanding the speaker
CSTE – Skill Category 3 - 33 © Copyright 2014 / All rights reserved
3 Step Listening ProcessStep 1. Hearing the speaker.
Hearing the speaker requires an understanding of the five channels of communication incorporated into speech:
• Information Channel - The speaker’s subject.
• Verbal Channel - The words used by the speaker.
• Vocal Channel - The tone of voice associated with the various words.
• Body Channel - The body movements and gestures associated with the information being conveyed.
• Graphic Channel - The pictures, charts, etc. that the speaker uses to emphasize or illustrate the material being discussed.
CSTE – Skill Category 3 - 34 © Copyright 2014 / All rights reserved
3 Step Listening Process
Step 2. Attending to the Speaker (sometimes referred to as being an active listener).
Some suggestions to help in attending to the speaker are:
• Concentrate on the speaker.
• Maintain eye contact (80%).
• Provide feedback.
• Restate what you heard.
CSTE – Skill Category 3 - 35 © Copyright 2014 / All rights reserved
3 Step Listening ProcessStep 3. Understanding the Speaker
There are five types of listening. The type chosen will have an impact on the ability to understand what the speaker is saying.
• Type 1: Discriminative Listening
• Type 2: Comprehensive Listening
• Type 3: Therapeutic Listening
• Type 4: Critical Listening
• Type 5: Appreciative or Enjoyment Listening
CSTE – Skill Category 3 - 36 © Copyright 2014 / All rights reserved
Interviewing Skills
A software tester will use interviewing skills for fact-finding and to convey information
• A finding – identifies a difference between what is and what should be.
When documenting a finding, it should include:
• Fact
• Cause
• Significance
CSTE – Skill Category 3 - 37 © Copyright 2014 / All rights reserved
Analyzing Skills and the Analysis Process
CSTE – Skill Category 3 - 38 © Copyright 2014 / All rights reserved
Negotiations
Conflict can be defined as a breakdown in the decision-making process.
Some sources of conflict requiring negotiations are:
• Project Priorities
• Administrative Procedures
• Technical Opinions and Performance Trade-Offs
• Human Resource
• Cost
• Schedule
• Personality
CSTE – Skill Category 3 - 39 © Copyright 2014 / All rights reserved
Negotiation Resolution Methods
• Forcing
• Withdrawal
• Smoothing
• Compromise
• Problem solving
CSTE – Skill Category 3 - 40 © Copyright 2014 / All rights reserved
Resolving ComplaintsResearch shows that complaints must be resolved within four minutes.*
4-Step Complaint-Resolution Process
Step 1: Get on your customer’s wavelength
(Establish physical parity. Show empathy.)
Step 2: Get the facts
Step 3: Establish and initiate an action program
Step 4: Follow up with your customer
* Contact: The First Four Minutes, Dr. Leonard Zunin
CSTE – Skill Category 3 - 41 © Copyright 2014 / All rights reserved
Judgment
Judgment is a decision made by an individual.
Judgment is normally a decision based on three criteria which are:
• Facts
• Standards
• Experience
CSTE – Skill Category 3 - 42 © Copyright 2014 / All rights reserved
Constructive Criticism
Constructive criticism should incorporate the following tactics:
• Do it privately
• Have the facts
• Be prepared to help the worker improve his performance
• Be specific on expectations
• Follow a specific process in giving criticism
CSTE – Skill Category 3 - 44 © Copyright 2014 / All rights reserved
Project Relationships
Listening
+ Interviewing
+ Resolving
+ Criticism
Relations
CSTE – Skill Category 3 - 45 © Copyright 2014 / All rights reserved
Motivation
The Four Most Common Motivators
• Personal challenge
• Respect
• Rewards
• Recognition
Motivation has been defined as getting individuals to:
• Do work tasks they do not want to do
• Perform those work tasks in a more efficient or effective manner.
CSTE – Skill Category 3 - 46 © Copyright 2014 / All rights reserved
MentoringMentoring is helping or supporting an individual in a non-supervisory capacity. Mentoring can occur in any of the following three areas:
• Career counseling
• Work tasks
• Professional advancement
Recognition• A key concept in supervision is that recognition is
important.
• People like to be recognized for the contribution they make to a project.
CSTE – Skill Category 3 - 47 © Copyright 2014 / All rights reserved
ExerciseNegotiation Resolution Methods include all of
the following except :a. Forcingb. Smoothingc. Problem Solvingd. Competitione. Compromise
CSTE – Skill Category 3 - 49 © Copyright 2014 / All rights reserved
Essay (8 minutes):
Assume you are a test manager and you have noticed during meetings with clients that one of your mid-level test analysts often interrupts the client when the client is explaining an issue they are having. While the client is gracious and doesn’t say anything you see that the client is angered by this behavior. After today’s meeting you call the test analyst into your office to discuss this problem. Describe what you are going to say to the analyst regarding listening skills and follow a good “constructive criticism” process.
CSTE – Skill Category 3 - 52 © Copyright 2014 / All rights reserved
Supervisor Leader
All test managers are part manager and part leader.
In discussing leadership, we will address these areas:
• Chairing Meetings
• Team Building
• Quality Management Organizational Structure
• Code of ethics
Test Leadership
CSTE – Skill Category 3 - 53 © Copyright 2014 / All rights reserved
Team Building
Team building needs to focus on the following items that an individual can achieve from working on a specific project:
• Challenge
• Growth
• Credit
“New loyalty is not to the boss or to the company, but to projects that actualize the mission and offer challenge, growth, and credit for results.”
R.M. Kanter
CSTE – Skill Category 3 - 54 © Copyright 2014 / All rights reserved
Team DevelopmentThere are seven guidelines that are helpful in developing
compatibility and motivation of a software project team:
1. Communicate
2. Define roles and responsibilities
3. Empower team members
4. Hold team members accountable
5. Ensure skills are present
6. Provide training
7. Reward successes
CSTE – Skill Category 3 - 55 © Copyright 2014 / All rights reserved
Team Ethics
The following attributes of the team are associated with ethical team behavior:
• Customer relations that are truthful and fair to all parties
• Protecting company property
• Compliance with company policies
• Integrity of information
• Attendance
• Redefine standards of quality
CSTE – Skill Category 3 - 56 © Copyright 2014 / All rights reserved
Quality Management Organization Structure
The quality revolution significantly impacted the traditional hierarchical structure.
• The structure was flattened
• Employees were empowered to make more decisions
• New approaches to management were introduced.
CSTE – Skill Category 3 - 57 © Copyright 2014 / All rights reserved
Traditional vs Quality Management Philosophy
Traditional Management Philosophy Quality Management Philosophy
Controls each result Use the process
Who made the error? What allowed the error?
Correct the error Reduce variation and prevent the error
Employees are the problem Refine the process
Management accountable to their manager Management accountable to the customer
Competition between organizations Teamwork
Motivation from fear of failure Motivation from within (self)
Management of outputs (results)—focusing on detection of defects
Management of process inputs—methods or sources of variation that focus on preventing defects
Fire fighting Continuous process improvement
Accomplishment from meeting quotas, the monthly or quarterly bottom line
Accomplishment from long-term impact of improving processes
CSTE – Skill Category 3 - 58 © Copyright 2014 / All rights reserved
Why a Code of Ethics is Important
• Differentiates a profession from a job
• Teaches how to conduct oneself as a professional
• When followed, it gains the respect of colleagues
CSTE – Skill Category 3 - 59 © Copyright 2014 / All rights reserved
DiscussionWhat are three differences between a Leader
and a Supervisor (manager).
CSTE – Skill Category 3 - 61 © Copyright 2014 / All rights reserved
Managing Change
• Managing change is a process.
• The process of managing change is a primary responsibility of all IT staff.
CSTE – Skill Category 3 - 62 © Copyright 2014 / All rights reserved
Test Manager Must Manage Change
• Software Configuration Management: Controlling change over project artifacts (e.g. test cases)
• Software Change Management: Changes to software
• Software Version Control: Changed versions of software
CSTE – Skill Category 3 - 63 © Copyright 2014 / All rights reserved
Software Configuration Management
The entire Test Environment and all its project artifacts must be managed including:
• Source code
• Requirements
• Analysis models
• Design models
• Test cases and procedures
• Automated test scripts
• User documentation, including manuals and online Help
• Hardware and software configuration settings
CSTE – Skill Category 3 - 64 © Copyright 2014 / All rights reserved
Software Change ManagementThe testers need to know two aspects of change:
• The characteristics of the change so that modification to the test plan and test data can be made to assure the right functionality and structure are tested.
• The version in which that change will be implemented.
CSTE – Skill Category 3 - 65 © Copyright 2014 / All rights reserved
Software Version Control• Once dynamic testing begins, the project team must ensure
that the appropriate versions of the software components are being tested.
• The Configuration Manager must develop both migration and back-out procedures to support this process. These processes can be either manual or automated.
• Often, the CM tool selected will support the creation of automated build procedures that reduce the level of risk associated with migration.
CSTE – Skill Category 3 - 66 © Copyright 2014 / All rights reserved
ExerciseWhen people are presented with new ideas, their most common reaction is:
a) Accept the ideab) Object to the new ideac) Ask for more information about the idead) Ask to be trained in the concepts related to the new idea
Which of the following is NOT the type of project artifact that must be managed and controlled in configuration management environment?
a) Source codeb) Requirementsc) Name of the project teamd) Test case and procedures
CSTE – Skill Category 3 - 69 © Copyright 2014 / All rights reserved
ExerciseWhen people are presented with new ideas, their most common reaction is:
a) Accept the ideab) Object to the new ideac) Ask for more information about the idead) Ask to be trained in the concepts related to the new idea
Which of the following is NOT the type of project artifact that must be managed and controlled in configuration management environment?
a) Source codeb) Requirementsc) Name of the project teamd) Test case and procedures
EXAM HINTOnce you have gone through the test
twice, see if any of the questions asked can help you answer those really difficult questions.
This is a little used trick. Sometimes questions asked are answered in later questions asking for different things
Top Related