1

CIS-74 Computer Software Quality Assurance

Midterm Review

Systematic Software Testing

Chapters 1-6

2

Testing conducted without written or formal plans or test cases.

3

Testing conducted without written or formal plans or test cases.

What is ad hoc testing?

4

A group problem-solving technique that involves the spontaneous contribution of ideas from all members of the group.

5

A group problem-solving technique that involves the spontaneous contribution of ideas from all members of the group.

What is brainstorming?

6

A type of testing where the internal workings of the system are unknown or ignored.

7

A type of testing where the internal workings of the system are unknown or ignored.

What is black-box testing?

8

An activity undertaken to reduce risk.

9

An activity undertaken to reduce risk.

What is mitigation?

10

The entire product to be tested, including software and associated documentation; acronym is SUT.

11

The entire product to be tested, including software and associated documentation; acronym is SUT.

What is Software Under Test?

12

A testing technique where the test design and execution are conducted concurrently.

13

A testing technique where the test design and execution are conducted concurrently.

What is exploratory testing?

14

An organization which publishes engineering standards for things such as Test Design Specifications and other test documentation.

15

An organization which publishes engineering standards for things such as Test Design Specifications and other test documentation.

What is the IEEE (Institute of Electrical and Electronic Engineers)?

16

Shipping a product to the entire customer base in increments.

17

Shipping a product to the entire customer base in increments.

What is phased implementation?

18

A test for valid input.

19

A test for valid input.

What is a positive test?

20

Installing and using a new system at the same time the old system is installed and running.

21

Installing and using a new system at the same time the old system is installed and running.

What is parallel implementation?

22

80% of the contribution comes from 20% of the contributors.

23

80% of the contribution comes from 20% of the contributors.

What is the Pareto Principle?

24

An original and usually working model of a new product or new version of an existing product, which serves as a basis or standard for later models.

25

An original and usually working model of a new product or new version of an existing product, which serves as a basis or standard for later models.

What is a prototype?

26

The process of checking whether all requirements are covered by one or more test cases.

27

The process of checking whether all requirements are covered by one or more test cases.

What is requirements traceability?

28

A test run to demonstrate that the basic functionality of a system exists and that a certain level of stability has been achieved. Frequently used as part of the entrance criteria to a level of test.

29

A test run to demonstrate that the basic functionality of a system exists and that a certain level of stability has been achieved. Frequently used as part of the entrance criteria to a level of test.

What is a smoke test?

30

The copyrighted testing methodology described throughout our textbook; its acronym is STEP.

31

The copyrighted testing methodology described throughout our textbook; its acronym is STEP.

What is Systematic Test and Evaluation Process?

32

Any document or product created as part of the testing effort.

33

Any document or product created as part of the testing effort.

What is testware?

34

The level of test undertaken to validate a single module of code, usually by the programmer who wrote the code.

35

The level of test undertaken to validate a single module of code, usually by the programmer who wrote the code.

What is unit testing?

36

Another trio of names for white-box testing.

37

Another trio of names for white-box testing.

What is glass-box, clear-box, or translucent-box testing?

38

A model of software development based upon distinct, sequential phases.

39

A model of software development based upon distinct, sequential phases.

What is the Waterfall Model?

40

A specially equipped laboratory designed to allow potential users of a system to “try out” a prototype of a system prior to its completion.

41

A specially equipped laboratory designed to allow potential users of a system to “try out” a prototype of a system prior to its completion.

What is a usability lab?

42

Code that simulates the function of nonexistent components; consists of stubs and drivers.

43

Code that simulates the function of nonexistent components; consists of stubs and drivers.

What is scaffolding code?

44

A level of test undertaken to validate the interface between internal components of a system. Normally done by a group of developers.

45

A level of test undertaken to validate the interface between internal components of a system. Normally done by a group of developers.

What is integration test?

46

An existing defect that has not yet caused a failure because the exact set of conditions has not been met.

47

An existing defect that has not yet caused a failure because the exact set of conditions has not been met.

What is a latent defect?

48

Applications that reside on the same platform as the software being tested.

49

Applications that reside on the same platform as the software being tested.

What is cohabiting software?

50

A group of tests which have these characteristics:

They all test the same thing.

If one catches a bug, the others will too.

If one doesn’t catch a bug, the others won’t either.

51

A group of tests which have these characteristics:

They all test the same thing.

If one catches a bug, the others will too.

If one doesn’t catch a bug, the others won’t either.

What is an equivalence class?

52

Another name for behavioral testing.

53

Another name for behavioral testing.

What is black-box testing?

54

The situation in which a test passes in spite of being incorrectly processed.

55

The situation in which a test passes in spite of being incorrectly processed.

What is coincidental correctness?

56

Represented by a circle in a state-transition diagram.

57

Represented by a circle in a state-transition diagram.

What is the state?

58

A two-dimensional array in which any two columns contain all combinations of the numbers within the matrix.

59

A two-dimensional array in which any two columns contain all combinations of the numbers within the matrix.

What is an orthogonal array?

60

Testing in which the data is in the format of real data, but is actually generated by a tool; sometimes called monkey testing.

61

Testing in which the data is in the format of real data, but is actually generated by a tool; sometimes called monkey testing.

What is random testing?

62

A test in which one enters invalid input in the expectation of receiving an error message.

63

A test in which one enters invalid input in the expectation of receiving an error message.

What is a negative test?

64

A test environment (probably acceptance) that is set up exactly like a real office.

65

A test environment (probably acceptance) that is set up exactly like a real office.

What is a model office?

66

They’re examples of testing tool traps.

67

They’re examples of testing tool traps.

What are the following examples of: no clear strategy, great expectations, lack of buy-in, poor training, automating the wrong thing, choosing the wrong tool, choosing the wrong vendor, doing too much too soon, underestimating time/resources, inadequate or unique test environment, poor timing, cost of tools causing inadequate licenses, lack of ease of use, and unstable software?

68

A technique developed to estimate the number of bugs resident in a piece of software, it involves deliberately planting bugs in a piece of software, then running the test set in order to determine how many of the planted bugs were found and how many were not.

69

A technique developed to estimate the number of bugs resident in a piece of software, it involves deliberately planting bugs in a piece of software, then running the test set in order to determine how many of the planted bugs were found and how many were not.

What is defect seeding?

70

Unscheduled events or late activities that may jeopardize the testing schedule.

71

Unscheduled events or late activities that may jeopardize the testing schedule.

What are planning risks?

72

The first test document to consider when doing test planning.

73

The first test document to consider when doing test planning.

What is the Master Test Plan (MTP)?

74

TBD.

75

TBD.

What is the acronym for “To Be Determined?”

76

The order in which the four level test plans are written.

77

The order in which the four level test plans are written.

Which order is represented here--Acceptance Test Plan, System Test Plan, Integration Test Plan, and Unit Test Plan?

78

The level of test in which the test environment most closely resembles production.

79

The level of test in which the test environment most closely resembles production.

What is acceptance testing?

80

A process involving measuring the percentage of program statements, branches, and/or paths that are executed by a test set.

81

A process involving measuring the percentage of program statements, branches, and/or paths that are executed by a test set.

What is code coverage?

82

Another form of software evaluation besides testing.

83

Another form of software evaluation besides testing.

What are reviews?

84

The two most common types of reviews.

85

The two most common types of reviews.

What are walkthroughs and inspections?

86

Retesting previously tested features to ensure that a change or bug fix has not introduced new problems.

87

Retesting previously tested features to ensure that a change or bug fix has not introduced new problems.

What is regression testing?

88

Charts used to show dependencies between testing activities.

89

Charts used to show dependencies between testing activities.

What are Gantt charts?

90

Test data that is quickly outdated due to a quickly changing business environment.

91

Test data that is quickly outdated due to a quickly changing business environment.

What is fragile test data?

92

Acceptance testing that occurs at the development site as opposed to a customer site.

93

Acceptance testing that occurs at the development site as opposed to a customer site.

What is alpha testing?

94

Acceptance testing that occurs at a customer site.

95

Acceptance testing that occurs at a customer site.

What is beta testing?

96

Implementation involving shipping the entire product to a few customers at a time.

97

Implementation involving shipping the entire product to a few customers at a time.

What is gradual implementation?

98

A group charged with determining how incidents, defects, and enhancements should be handled--what should be changed and in what order.

99

A group charged with determining how incidents, defects, and enhancements should be handled--what should be changed and in what order.

What is the CCB (Change Control Board)?

100

The level of testing done to ensure that the various components of a system interact and pass data correctly amongst one another and function cohesively.

101

The level of testing done to ensure that the various components of a system interact and pass data correctly amongst one another and function cohesively.

What is integration testing?

102

The very first tests that should be automated.

103

The very first tests that should be automated.

What are smoke tests?

104

The ratio of defects to size.

105

The ratio of defects to size.

What is defect density?

106

KLOC.

107

KLOC.

What is the acronym for “thousand lines of code?”

108

A form of testing in which two-person teams are identified and assigned to create test cases for the other person’s code.

109

A form of testing in which two-person teams are identified and assigned to create test cases for the other person’s code.

What is buddy testing?

110

The name of the code coverage tool demonstrated in class.

111

The name of the code coverage tool demonstrated in class.

What is gcov?

112

The values that must be tested when doing boundary value analysis.

113

The values that must be tested when doing boundary value analysis.

What are the boundaries, the value immediately below the lowest boundary, and the value immediately above the highest boundary?

114

The time when changes to the system (requirements, design, code, and documentation) are halted or closely managed.

115

The time when changes to the system (requirements, design, code, and documentation) are halted or closely managed.

What is a code freeze?

116

The two states that a Bugzilla bug might be moved to by a QA engineer as a result of confirmation testing (bug-fix testing).

117

The two states that a Bugzilla bug might be moved to by a QA engineer as a result of confirmation testing (bug-fix testing).

What are REOPENED and VERIFIED?

118

The fields within Bugzilla bugs that cannot be changed once they have been saved.

119

The fields within Bugzilla bugs that cannot be changed once they have been saved.

What are the Description and Comment fields?

120

Another name for structural testing.

121

Another name for structural testing.

What is another name for white-box testing?

122

A production system executed at a single or limited number of sites.

123

A production system executed at a single or limited number of sites.

What is a pilot?

124

End of Midterm Review