INFERENTIAL TATISTICS INTRODUCTION TO HYPOTHESIS ESTING€¦ · inferential statistics –...
Transcript of INFERENTIAL TATISTICS INTRODUCTION TO HYPOTHESIS ESTING€¦ · inferential statistics –...
![Page 1: INFERENTIAL TATISTICS INTRODUCTION TO HYPOTHESIS ESTING€¦ · inferential statistics – introduction to hypothesis testing p rof. j osefina v. a lmeda c ollege s ecretary. s. chool](https://reader033.fdocuments.in/reader033/viewer/2022053016/5f16d6841b04135d7544baff/html5/thumbnails/1.jpg)
INFERENTIAL STATISTICS –INTRODUCTION TO
HYPOTHESIS TESTING
PROF. JOSEFINA V. ALMEDACOLLEGE SECRETARYSCHOOL OF STATISTICSUNIVERSITY OF THE PHILIPPINES DILIMAN2012
1
![Page 2: INFERENTIAL TATISTICS INTRODUCTION TO HYPOTHESIS ESTING€¦ · inferential statistics – introduction to hypothesis testing p rof. j osefina v. a lmeda c ollege s ecretary. s. chool](https://reader033.fdocuments.in/reader033/viewer/2022053016/5f16d6841b04135d7544baff/html5/thumbnails/2.jpg)
OUTLINE
Basic Concepts in Hypothesis TestingNull and Alternative HypothesesTwo Types of ErrorsTypes of HypothesesSteps in Conducting a test of Hypothesis
2
![Page 3: INFERENTIAL TATISTICS INTRODUCTION TO HYPOTHESIS ESTING€¦ · inferential statistics – introduction to hypothesis testing p rof. j osefina v. a lmeda c ollege s ecretary. s. chool](https://reader033.fdocuments.in/reader033/viewer/2022053016/5f16d6841b04135d7544baff/html5/thumbnails/3.jpg)
LEARNING OBJECTIVES
After the lesson on Introduction to Hypothesis Testing, the participants should be able to
State the null and alternative hypotheses;Differentiate the two types of errors;Learn the types of hypotheses; andList the steps in performing a test of hypothesis.
3
![Page 4: INFERENTIAL TATISTICS INTRODUCTION TO HYPOTHESIS ESTING€¦ · inferential statistics – introduction to hypothesis testing p rof. j osefina v. a lmeda c ollege s ecretary. s. chool](https://reader033.fdocuments.in/reader033/viewer/2022053016/5f16d6841b04135d7544baff/html5/thumbnails/4.jpg)
WHAT IS HYPOTHESIS TESTING?
Hypothesis testing evaluates a conjecture about some characteristic of the parent population based upon the information contained in the random sample.
Usually the conjecture concerns one of the unknown parameters of the population.
4
![Page 5: INFERENTIAL TATISTICS INTRODUCTION TO HYPOTHESIS ESTING€¦ · inferential statistics – introduction to hypothesis testing p rof. j osefina v. a lmeda c ollege s ecretary. s. chool](https://reader033.fdocuments.in/reader033/viewer/2022053016/5f16d6841b04135d7544baff/html5/thumbnails/5.jpg)
WHAT IS A HYPOTHESIS?
A hypothesis is a claim or statement about the populationparameter
Examples of parametersare population meanand population proportionThe parameter mustbe identified before analysis
This drug is guaranteed to change cholesterol levels (on the average) by more than 30%!
© 1984-1994 T/Maker Co.5
![Page 6: INFERENTIAL TATISTICS INTRODUCTION TO HYPOTHESIS ESTING€¦ · inferential statistics – introduction to hypothesis testing p rof. j osefina v. a lmeda c ollege s ecretary. s. chool](https://reader033.fdocuments.in/reader033/viewer/2022053016/5f16d6841b04135d7544baff/html5/thumbnails/6.jpg)
EXAMPLE OF HYPOTHESIS
The mean body temperature for patients admitted to elective surgery is not equal to 37.0oC.
Note: The parameter of interest here iswhich is the mean body
temperature for patients admitted toelective surgery.
μ
6
![Page 7: INFERENTIAL TATISTICS INTRODUCTION TO HYPOTHESIS ESTING€¦ · inferential statistics – introduction to hypothesis testing p rof. j osefina v. a lmeda c ollege s ecretary. s. chool](https://reader033.fdocuments.in/reader033/viewer/2022053016/5f16d6841b04135d7544baff/html5/thumbnails/7.jpg)
EXAMPLE OF A HYPOTHESIS
The proportion of registered voters in Quezon City favoring Candidate A exceeds 0.60.
Note: The parameter of interest hereis p which is the proportion of registeredvoters in Quezon City favoring Candidate A.
7
![Page 8: INFERENTIAL TATISTICS INTRODUCTION TO HYPOTHESIS ESTING€¦ · inferential statistics – introduction to hypothesis testing p rof. j osefina v. a lmeda c ollege s ecretary. s. chool](https://reader033.fdocuments.in/reader033/viewer/2022053016/5f16d6841b04135d7544baff/html5/thumbnails/8.jpg)
Components of a Formal Hypothesis Test
8
![Page 9: INFERENTIAL TATISTICS INTRODUCTION TO HYPOTHESIS ESTING€¦ · inferential statistics – introduction to hypothesis testing p rof. j osefina v. a lmeda c ollege s ecretary. s. chool](https://reader033.fdocuments.in/reader033/viewer/2022053016/5f16d6841b04135d7544baff/html5/thumbnails/9.jpg)
NULL HYPOTHESIS
denoted by Hothe statement being testedit represents what the experimenter doubts to be truemust contain the condition of equality and must be written with the symbol =
9
![Page 10: INFERENTIAL TATISTICS INTRODUCTION TO HYPOTHESIS ESTING€¦ · inferential statistics – introduction to hypothesis testing p rof. j osefina v. a lmeda c ollege s ecretary. s. chool](https://reader033.fdocuments.in/reader033/viewer/2022053016/5f16d6841b04135d7544baff/html5/thumbnails/10.jpg)
FOR THE MEAN, THE NULL HYPOTHESISWILL BE
Ho: = some value
Note: the hypothesized value of can be obtained from previous studies or from knowledge of the population
μ
μ
10
![Page 11: INFERENTIAL TATISTICS INTRODUCTION TO HYPOTHESIS ESTING€¦ · inferential statistics – introduction to hypothesis testing p rof. j osefina v. a lmeda c ollege s ecretary. s. chool](https://reader033.fdocuments.in/reader033/viewer/2022053016/5f16d6841b04135d7544baff/html5/thumbnails/11.jpg)
EXAMPLE OF NULL HYPOTHESIS
The null hypothesis corresponding to the common belief that the mean body temperature is 37oC is expressed as
Ho:
We test the null hypothesis directly in the sense that we assume it is true and reach a conclusion to either reject Ho or fail to reject Ho.
Co37=μ
11
![Page 12: INFERENTIAL TATISTICS INTRODUCTION TO HYPOTHESIS ESTING€¦ · inferential statistics – introduction to hypothesis testing p rof. j osefina v. a lmeda c ollege s ecretary. s. chool](https://reader033.fdocuments.in/reader033/viewer/2022053016/5f16d6841b04135d7544baff/html5/thumbnails/12.jpg)
ALTERNATIVE HYPOTHESIS
denoted by HaIs the statement that must be true if the null hypothesis is falsethe operational statement of the theory that the experimenter believes to be true and wishes to proveIs sometimes referred to as the research hypothesis
12
![Page 13: INFERENTIAL TATISTICS INTRODUCTION TO HYPOTHESIS ESTING€¦ · inferential statistics – introduction to hypothesis testing p rof. j osefina v. a lmeda c ollege s ecretary. s. chool](https://reader033.fdocuments.in/reader033/viewer/2022053016/5f16d6841b04135d7544baff/html5/thumbnails/13.jpg)
FOR THE MEAN, THE ALTERNATIVE HYPOTHESISWILL BE STATED IN ONLY ONE OF THREE POSSIBLEFORMS:
Ha: some valueHa: > some valueHa: < some value
Note: Ha is the opposite of Ho. For example, if Ho is given as = 37.0, then it follows that the alternative hypothesis is given by Ha: 37.0.
≠μμμ
μμ ≠
13
![Page 14: INFERENTIAL TATISTICS INTRODUCTION TO HYPOTHESIS ESTING€¦ · inferential statistics – introduction to hypothesis testing p rof. j osefina v. a lmeda c ollege s ecretary. s. chool](https://reader033.fdocuments.in/reader033/viewer/2022053016/5f16d6841b04135d7544baff/html5/thumbnails/14.jpg)
EXAMPLE IN STATING YOURHYPOTHESIS
14
![Page 15: INFERENTIAL TATISTICS INTRODUCTION TO HYPOTHESIS ESTING€¦ · inferential statistics – introduction to hypothesis testing p rof. j osefina v. a lmeda c ollege s ecretary. s. chool](https://reader033.fdocuments.in/reader033/viewer/2022053016/5f16d6841b04135d7544baff/html5/thumbnails/15.jpg)
SOME NOTES:In this context of trying to support the goal of the research, the alternative hypothesis is sometimes referred to as the research hypothesis.
Also in this context, the null hypothesis is assumed true for the purpose of conducting the hypothesis test, but it is hoped that the conclusion will be rejection of the null hypothesis so that the research hypothesis is supported.
15
![Page 16: INFERENTIAL TATISTICS INTRODUCTION TO HYPOTHESIS ESTING€¦ · inferential statistics – introduction to hypothesis testing p rof. j osefina v. a lmeda c ollege s ecretary. s. chool](https://reader033.fdocuments.in/reader033/viewer/2022053016/5f16d6841b04135d7544baff/html5/thumbnails/16.jpg)
WHAT IS A TEST OF SIGNIFICANCE?
• A test of significance is a problem ofdeciding between the null and the alternativehypotheses on the basis of the informationcontained in a random sample.
• The goal will be to reject Ho in favor of Ha,because the alternative is the hypothesis thatthe researcher believes to be true. If we aresuccessful in rejecting Ho, we then declarethe results to be “significant”.
16
![Page 17: INFERENTIAL TATISTICS INTRODUCTION TO HYPOTHESIS ESTING€¦ · inferential statistics – introduction to hypothesis testing p rof. j osefina v. a lmeda c ollege s ecretary. s. chool](https://reader033.fdocuments.in/reader033/viewer/2022053016/5f16d6841b04135d7544baff/html5/thumbnails/17.jpg)
TWO TYPES OF ERRORS
Type I Error
Type II Error
17
![Page 18: INFERENTIAL TATISTICS INTRODUCTION TO HYPOTHESIS ESTING€¦ · inferential statistics – introduction to hypothesis testing p rof. j osefina v. a lmeda c ollege s ecretary. s. chool](https://reader033.fdocuments.in/reader033/viewer/2022053016/5f16d6841b04135d7544baff/html5/thumbnails/18.jpg)
TYPE I ERROR
18
![Page 19: INFERENTIAL TATISTICS INTRODUCTION TO HYPOTHESIS ESTING€¦ · inferential statistics – introduction to hypothesis testing p rof. j osefina v. a lmeda c ollege s ecretary. s. chool](https://reader033.fdocuments.in/reader033/viewer/2022053016/5f16d6841b04135d7544baff/html5/thumbnails/19.jpg)
EXAMPLES OF TYPE I ERROR
1. The mistake of rejecting the null hypothesis that the mean body temperature is 37.0 when that mean is really 37.0.
2. BFaD allows the release of an ineffective medicine
19
![Page 20: INFERENTIAL TATISTICS INTRODUCTION TO HYPOTHESIS ESTING€¦ · inferential statistics – introduction to hypothesis testing p rof. j osefina v. a lmeda c ollege s ecretary. s. chool](https://reader033.fdocuments.in/reader033/viewer/2022053016/5f16d6841b04135d7544baff/html5/thumbnails/20.jpg)
TYPE II ERROR
The mistake of failing to reject the null hypothesis when it is false.
The symbol (beta) is used to represent the probability of a type II error.
β
20
![Page 21: INFERENTIAL TATISTICS INTRODUCTION TO HYPOTHESIS ESTING€¦ · inferential statistics – introduction to hypothesis testing p rof. j osefina v. a lmeda c ollege s ecretary. s. chool](https://reader033.fdocuments.in/reader033/viewer/2022053016/5f16d6841b04135d7544baff/html5/thumbnails/21.jpg)
EXAMPLES OF TYPE II ERRORS
1. The mistake of failing to reject the null hypothesis ( = 37.0) when it is actually false (that is, the mean is not 37.0).
2. BFaD does not allow the release of an effective drug.
μ
21
![Page 22: INFERENTIAL TATISTICS INTRODUCTION TO HYPOTHESIS ESTING€¦ · inferential statistics – introduction to hypothesis testing p rof. j osefina v. a lmeda c ollege s ecretary. s. chool](https://reader033.fdocuments.in/reader033/viewer/2022053016/5f16d6841b04135d7544baff/html5/thumbnails/22.jpg)
Summary of Possible Decisions in Hypothesis Testing
True Situation
The null hypothesis is
true.
The null hypothesis is
false.
Decision We decide to reject the null hypothesis.
TYPE I error(rejecting a true null
hypothesis)
CORRECTdecision
We fail to reject the null hypothesis.
CORRECTdecision
TYPE II error(failing to reject
a false nullhypothesis)
![Page 23: INFERENTIAL TATISTICS INTRODUCTION TO HYPOTHESIS ESTING€¦ · inferential statistics – introduction to hypothesis testing p rof. j osefina v. a lmeda c ollege s ecretary. s. chool](https://reader033.fdocuments.in/reader033/viewer/2022053016/5f16d6841b04135d7544baff/html5/thumbnails/23.jpg)
ANALOGY TO DECISIONS INHYPOTHESIS TESTING
The Truth
Verdict Innocent Guilty
Innocent Correct Error
Guilty Error Correct
Trial
23
![Page 24: INFERENTIAL TATISTICS INTRODUCTION TO HYPOTHESIS ESTING€¦ · inferential statistics – introduction to hypothesis testing p rof. j osefina v. a lmeda c ollege s ecretary. s. chool](https://reader033.fdocuments.in/reader033/viewer/2022053016/5f16d6841b04135d7544baff/html5/thumbnails/24.jpg)
CONTROLLING TYPE I AND TYPE II ERRORS
The experimenter is free to determine α. Ifthe test leads to the rejection of Ho, theresearcher can then conclude that there issufficient evidence supporting Ha at α levelof significance.
Usually, β is unknown because it’s hard tocalculate it. The common solution to thisdifficulty is to “withhold judgment” if thetest leads to the failure to reject Ho.
α and β are inversely related. For a fixedsample size n, as α decreases β increases.
24
![Page 25: INFERENTIAL TATISTICS INTRODUCTION TO HYPOTHESIS ESTING€¦ · inferential statistics – introduction to hypothesis testing p rof. j osefina v. a lmeda c ollege s ecretary. s. chool](https://reader033.fdocuments.in/reader033/viewer/2022053016/5f16d6841b04135d7544baff/html5/thumbnails/25.jpg)
CONTROLLING TYPE I AND TYPE II ERRORS
In almost all statistical tests, both α and β canbe reduced by increasing the sample size.
Because of the inverse relationship of α and β,setting a very small α should also be avoided ifthe researcher cannot afford a very large risk ofcommitting a Type II error.
25
![Page 26: INFERENTIAL TATISTICS INTRODUCTION TO HYPOTHESIS ESTING€¦ · inferential statistics – introduction to hypothesis testing p rof. j osefina v. a lmeda c ollege s ecretary. s. chool](https://reader033.fdocuments.in/reader033/viewer/2022053016/5f16d6841b04135d7544baff/html5/thumbnails/26.jpg)
Common Choices of α Consequences ofType I error
0.01 or smaller0.050.10
very seriousmoderately serious
not too serious
The choice of α usually depends on the consequences associated with making aType I error.
Controlling Type I and Type II Errors
![Page 27: INFERENTIAL TATISTICS INTRODUCTION TO HYPOTHESIS ESTING€¦ · inferential statistics – introduction to hypothesis testing p rof. j osefina v. a lmeda c ollege s ecretary. s. chool](https://reader033.fdocuments.in/reader033/viewer/2022053016/5f16d6841b04135d7544baff/html5/thumbnails/27.jpg)
CONTROLLING TYPE I AND TYPE II ERRORS
27
![Page 28: INFERENTIAL TATISTICS INTRODUCTION TO HYPOTHESIS ESTING€¦ · inferential statistics – introduction to hypothesis testing p rof. j osefina v. a lmeda c ollege s ecretary. s. chool](https://reader033.fdocuments.in/reader033/viewer/2022053016/5f16d6841b04135d7544baff/html5/thumbnails/28.jpg)
EXAMPLE TO ILLUSTRATE TYPE I ANDTYPE II ERRORS
Consider M&Ms (produced by Mars, Inc.) and Bufferin brand aspirin tablets (produced by Bristol-Myers Products).
The M&M package contains 1498 candies. The mean weight of the individual candies should be at least 0.9085 g., because the M&M package is labeled as containing 1361 g.
28
![Page 29: INFERENTIAL TATISTICS INTRODUCTION TO HYPOTHESIS ESTING€¦ · inferential statistics – introduction to hypothesis testing p rof. j osefina v. a lmeda c ollege s ecretary. s. chool](https://reader033.fdocuments.in/reader033/viewer/2022053016/5f16d6841b04135d7544baff/html5/thumbnails/29.jpg)
The Bufferin package is labeled as holding 30 tablets, each of which contains 325 mg of aspirin.
Because M&Ms are candies used for enjoyment whereas Bufferin tablets are drugs used for treatment of health problems, we are dealing with two very different levels of seriousness.
Example to illustrate Type I and Type II Errors
29
![Page 30: INFERENTIAL TATISTICS INTRODUCTION TO HYPOTHESIS ESTING€¦ · inferential statistics – introduction to hypothesis testing p rof. j osefina v. a lmeda c ollege s ecretary. s. chool](https://reader033.fdocuments.in/reader033/viewer/2022053016/5f16d6841b04135d7544baff/html5/thumbnails/30.jpg)
If the M&Ms don’t have a population mean weight of 0.9085 g, the consequences are not very serious, but if the Bufferin tablets don’t have a mean of 325 mg of aspirin, the consequences could be very serious.
Example to illustrate Type I and Type II Errors
30
![Page 31: INFERENTIAL TATISTICS INTRODUCTION TO HYPOTHESIS ESTING€¦ · inferential statistics – introduction to hypothesis testing p rof. j osefina v. a lmeda c ollege s ecretary. s. chool](https://reader033.fdocuments.in/reader033/viewer/2022053016/5f16d6841b04135d7544baff/html5/thumbnails/31.jpg)
If the M&Ms have a mean that is too large, Mars will lose some money but consumers will not complain.
In contrast, if the Bufferin tablets have too much aspirin, Bristol-Myers could be faced with consumer lawsuits.
Example to illustrate Type I and Type II Errors
31
![Page 32: INFERENTIAL TATISTICS INTRODUCTION TO HYPOTHESIS ESTING€¦ · inferential statistics – introduction to hypothesis testing p rof. j osefina v. a lmeda c ollege s ecretary. s. chool](https://reader033.fdocuments.in/reader033/viewer/2022053016/5f16d6841b04135d7544baff/html5/thumbnails/32.jpg)
Example to illustrate Type I and Type II Errors
![Page 33: INFERENTIAL TATISTICS INTRODUCTION TO HYPOTHESIS ESTING€¦ · inferential statistics – introduction to hypothesis testing p rof. j osefina v. a lmeda c ollege s ecretary. s. chool](https://reader033.fdocuments.in/reader033/viewer/2022053016/5f16d6841b04135d7544baff/html5/thumbnails/33.jpg)
TYPES OF TESTS
33
![Page 34: INFERENTIAL TATISTICS INTRODUCTION TO HYPOTHESIS ESTING€¦ · inferential statistics – introduction to hypothesis testing p rof. j osefina v. a lmeda c ollege s ecretary. s. chool](https://reader033.fdocuments.in/reader033/viewer/2022053016/5f16d6841b04135d7544baff/html5/thumbnails/34.jpg)
The p-value - the smallest level of significance at which Ho will be rejected based on the information contained in the sample
Form of Decision Rule(based on the p-value)
Reject Ho if the p-value is less than orequal to the level of significance (α).
34
![Page 35: INFERENTIAL TATISTICS INTRODUCTION TO HYPOTHESIS ESTING€¦ · inferential statistics – introduction to hypothesis testing p rof. j osefina v. a lmeda c ollege s ecretary. s. chool](https://reader033.fdocuments.in/reader033/viewer/2022053016/5f16d6841b04135d7544baff/html5/thumbnails/35.jpg)
EXAMPLE OF MAKING DECISIONSUSING THE P-VALUE
If the level of significance α=0.05,
p-value Decision
0.01 Reject Ho.0.05 Reject Ho.0.10 Do not reject Ho
35
![Page 36: INFERENTIAL TATISTICS INTRODUCTION TO HYPOTHESIS ESTING€¦ · inferential statistics – introduction to hypothesis testing p rof. j osefina v. a lmeda c ollege s ecretary. s. chool](https://reader033.fdocuments.in/reader033/viewer/2022053016/5f16d6841b04135d7544baff/html5/thumbnails/36.jpg)
CONCLUSIONS IN HYPOTHESIS TESTING
1. Fail to reject the null hypothesis Ho.2. Reject the null hypothesis Ho.
Notes:Some texts say “accept the null hypothesis” instead of “fail to reject the null hypothesis.”
Whether we use the term accept or fail to reject, we should recognize that we are not proving the null hypothesis; we are merely saying that the sample evidence is not strong enough to warrant rejection of the null hypothesis.
36
![Page 37: INFERENTIAL TATISTICS INTRODUCTION TO HYPOTHESIS ESTING€¦ · inferential statistics – introduction to hypothesis testing p rof. j osefina v. a lmeda c ollege s ecretary. s. chool](https://reader033.fdocuments.in/reader033/viewer/2022053016/5f16d6841b04135d7544baff/html5/thumbnails/37.jpg)
![Page 38: INFERENTIAL TATISTICS INTRODUCTION TO HYPOTHESIS ESTING€¦ · inferential statistics – introduction to hypothesis testing p rof. j osefina v. a lmeda c ollege s ecretary. s. chool](https://reader033.fdocuments.in/reader033/viewer/2022053016/5f16d6841b04135d7544baff/html5/thumbnails/38.jpg)
CON’T OF STEPS IN HYPOTHESIS TESTING
Obtain the p-value.
Make the conclusion.
If the p-value is less than or equal to α, reject the Ho at αlevel of significance and support the alternative hypothesis.
If the p-value is greater than α, do not reject the Ho. There is no sufficient sample evidence to reject the null hypothesis.
6.
5.
38