Essential Statistics Chapter 131 Introduction to Inference.

42
Essential Statis tics Chapter 13 1 Chapter 13 Introduction to Inference

Transcript of Essential Statistics Chapter 131 Introduction to Inference.

Page 1: Essential Statistics Chapter 131 Introduction to Inference.

Essential Statistics Chapter 13 1

Chapter 13

Introduction to Inference

Page 2: Essential Statistics Chapter 131 Introduction to Inference.

Essential Statistics Chapter 13 2

Provides methods for drawing conclusions about a population from sample data– Confidence Intervals

What is the population mean?

– Tests of Significance Is the population mean larger than 66.5?

Statistical Inference

Page 3: Essential Statistics Chapter 131 Introduction to Inference.

Essential Statistics Chapter 13 3

1. SRS from the population of interest

2. Variable has a Normal distribution N(, ) in the population

3. Although the value of is unknown, the value of the population standard deviation is known

Inference about a MeanSimple Conditions

Page 4: Essential Statistics Chapter 131 Introduction to Inference.

Essential Statistics Chapter 13 4

A level C confidence interval has two parts1. An interval calculated from the data,

usually of the form:estimate ± margin of error

2. The confidence level C, which is the probability that the interval will capture the true parameter value in repeated samples; that is, C is the success rate for the method.

Confidence Interval

Page 5: Essential Statistics Chapter 131 Introduction to Inference.

Essential Statistics Chapter 13 5

Case Study

NAEP Quantitative Scores(National Assessment of Educational Progress)

Rivera-Batiz, F. L., “Quantitative literacy and the likelihood of employment among young adults,” Journal of Human

Resources, 27 (1992), pp. 313-328.

What is the average score for all young adult males?

Page 6: Essential Statistics Chapter 131 Introduction to Inference.

Essential Statistics Chapter 13 6

Case Study

NAEP Quantitative Scores

The NAEP survey includes a short test of quantitative skills, covering mainly basic arithmetic and the ability to apply it to realistic problems. Scores on the test range from 0 to 500, with higher scores indicating greater numerical abilities. It is known that NAEP scores have standard deviation = 60.

Page 7: Essential Statistics Chapter 131 Introduction to Inference.

Essential Statistics Chapter 13 7

Case Study

NAEP Quantitative Scores

In a recent year, 840 men 21 to 25 years of age were in the NAEP sample. Their mean quantitative score was 272.

On the basis of this sample, estimate the mean score in the population of all 9.5 million young men of these ages.

Page 8: Essential Statistics Chapter 131 Introduction to Inference.

Essential Statistics Chapter 13 8

Case StudyNAEP Quantitative Scores

1. To estimate the unknown population mean , use the sample mean = 272.

2. The law of large numbers suggests that will be close to , but there will be some error in the estimate.

3. The sampling distribution of has the Normal distribution with mean and standard deviation

x

x

x

n

60

8402.1

Page 9: Essential Statistics Chapter 131 Introduction to Inference.

Essential Statistics Chapter 13 9

Case Study

NAEP Quantitative Scores

Page 10: Essential Statistics Chapter 131 Introduction to Inference.

Essential Statistics Chapter 13 10

Case Study

NAEP Quantitative Scores4. The 68-95-99.7 rule

indicates that and are within two standard deviations (4.2) of each other in about 95% of all samples.

x

267.8=4.2272=4.2 x276.2=4.2+272=4.2+x

Page 11: Essential Statistics Chapter 131 Introduction to Inference.

Essential Statistics Chapter 13 11

Case Study

NAEP Quantitative Scores

So, if we estimate that lies within 4.2 of , we’ll be right about 95% of the time.

x

Page 12: Essential Statistics Chapter 131 Introduction to Inference.

Essential Statistics Chapter 13 12

Take an SRS of size n from a Normal population with unknown mean and known standard deviation . A level C confidence interval for is:

z* is called the critical value, and z* and –z* mark off the Central area C under a standard normal curve (next slide); values of z* for many choices of C can be found at the bottom of Table C in the back of the textbook, and the most common values are on the next slide.

Confidence IntervalMean of a Normal Population

n

σzx

Page 13: Essential Statistics Chapter 131 Introduction to Inference.

Essential Statistics Chapter 13 13

Confidence IntervalMean of a Normal Population

Page 14: Essential Statistics Chapter 131 Introduction to Inference.

Essential Statistics Chapter 13 14

Case StudyNAEP Quantitative Scores

Using the 68-95-99.7 rule gave an approximate 95% confidence interval. A more precise 95% confidence interval can be found using the appropriate value of z* (1.960) with the previous formula.

267.884=4.116272=1)(1.960)(2. x276.116=4.116272=1)(1.960)(2. x

We are 95% confident that the average NAEP quantitative score for all adult males is between 267.884 and 276.116.

Page 15: Essential Statistics Chapter 131 Introduction to Inference.

Essential Statistics Chapter 13 15

Careful Interpretation of a Confidence Interval

“We are 95% confident that the mean NAEP score for the population of all adult males is between 267.884 and 276.116.”(We feel that plausible values for the population of males’ mean NAEP score are between 267.884 and 276.116.)

** This does not mean that 95% of all males will have NAEP scores between 267.884 and 276.116. **

Statistically: 95% of all samples of size 840 from the population of males should yield a sample mean within two standard errors of the population mean; i.e., in repeated samples, 95% of the C.I.s should contain the true population mean.

Page 16: Essential Statistics Chapter 131 Introduction to Inference.

Essential Statistics Chapter 13 16

What would happen if we repeated the sample or experiment many times?

How likely would it be to see the results we saw if the claim of the test were true?

Do the data give evidence against the claim?

Reasoning of Tests of Significance

Page 17: Essential Statistics Chapter 131 Introduction to Inference.

Essential Statistics Chapter 13 17

The statement being tested in a statistical test is called the null hypothesis.

The test is designed to assess the strength of evidence against the null hypothesis.

Usually the null hypothesis is a statement of “no effect” or “no difference”, or it is a statement of equality.

When performing a hypothesis test, we assume that the null hypothesis is true until we have sufficient evidence against it.

Stating HypothesesNull Hypothesis, H0

Page 18: Essential Statistics Chapter 131 Introduction to Inference.

Essential Statistics Chapter 13 18

The statement we are trying to find evidence for is called the alternative hypothesis.

Usually the alternative hypothesis is a statement of “there is an effect” or “there is a difference”, or it is a statement of inequality.

The alternative hypothesis should express the hopes or suspicions we bring to the data. It is cheating to first look at the data and then frame Ha to fit what the data show.

Stating HypothesesAlternative Hypothesis, Ha

Page 19: Essential Statistics Chapter 131 Introduction to Inference.

Essential Statistics Chapter 13 19

Case Study ISweetening Colas

Diet colas use artificial sweeteners to avoid sugar. These sweeteners gradually lose their sweetness over time. Trained testers sip the cola and assign a “sweetness score” of 1 to 10. The cola is then retested after some time and the two scores are compared to determine the difference in sweetness after storage. Bigger differences indicate bigger loss of sweetness.

Page 20: Essential Statistics Chapter 131 Introduction to Inference.

Essential Statistics Chapter 13 20

Case Study ISweetening Colas

Suppose we know that for any cola, the sweetness loss scores vary from taster to taster according to a Normal distribution with standard deviation = 1.

The mean for all tasters measures loss of sweetness.

The sweetness losses for a new cola, as measured by 10 trained testers, yields an average sweetness loss of = 1.02. Do the data provide sufficient evidence that the new cola lost sweetness in storage?

x

Page 21: Essential Statistics Chapter 131 Introduction to Inference.

Essential Statistics Chapter 13 21

Case Study ISweetening Colas

If the claim that = 0 is true (no loss of sweetness, on average), the sampling distribution of from 10 tasters is Normal with = 0 and standard deviation

The data yielded = 1.02, which is more than three standard deviations from = 0. This is strong evidence that the new cola lost sweetness in storage.

If the data yielded = 0.3, which is less than one standard deviations from = 0, there would be no evidence that the new cola lost sweetness in storage.

x

0.31610

1

n

σ

x

x

Page 22: Essential Statistics Chapter 131 Introduction to Inference.

Essential Statistics Chapter 13 22

Case Study ISweetening Colas

Page 23: Essential Statistics Chapter 131 Introduction to Inference.

Essential Statistics Chapter 13 23

The Hypotheses for Means

Null: H0: = 0

One sided alternatives

Ha:

Ha:

Two sided alternative

Ha: 0

Page 24: Essential Statistics Chapter 131 Introduction to Inference.

Essential Statistics Chapter 13 24

Sweetening Colas

Case Study I

The null hypothesis is no average sweetness loss occurs, while the alternative hypothesis (that which we want to show is likely to be true) is that an average sweetness loss does occur.

H0: = 0 Ha: > 0

This is considered a one-sided test because we are interested only in determining if the cola lost sweetness (gaining sweetness is of no consequence in this study).

Page 25: Essential Statistics Chapter 131 Introduction to Inference.

Essential Statistics Chapter 13 25

Studying Job Satisfaction

Case Study II

Does the job satisfaction of assembly workers differ when their work is machine-paced rather than self-paced? A matched pairs study was performed on a sample of workers, and each worker’s satisfaction was assessed after working in each setting. The response variable is the difference in satisfaction scores, self-paced minus machine-paced.

Page 26: Essential Statistics Chapter 131 Introduction to Inference.

Essential Statistics Chapter 13 26

Studying Job Satisfaction

Case Study II

The null hypothesis is no average difference in scores in the population of assembly workers, while the alternative hypothesis (that which we want to show is likely to be true) is there is an average difference in scores in the population of assembly workers.

H0: = 0 Ha: ≠ 0

This is considered a two-sided test because we are interested determining if a difference exists (the direction of the difference is not of interest in this study).

Page 27: Essential Statistics Chapter 131 Introduction to Inference.

Essential Statistics Chapter 13 27

Take an SRS of size n from a Normal population with unknown mean and known standard deviation . The test statistic for hypotheses about the mean (H0: = 0) of a Normal distribution is the standardized version of :

Test StatisticTesting the Mean of a Normal Population

μxz 0

x

Page 28: Essential Statistics Chapter 131 Introduction to Inference.

Essential Statistics Chapter 13 28

Sweetening Colas

Case Study I

If the null hypothesis of no average sweetness loss is true, the test statistic would be:

Because the sample result is more than 3 standard deviations above the hypothesized mean 0, it gives strong evidence that the mean sweetness loss is not 0, but positive.

3.23

101

01.020

μxz

Page 29: Essential Statistics Chapter 131 Introduction to Inference.

Essential Statistics Chapter 13 29

Assuming that the null hypothesis is true, the probability that the test statistic would take a value as extreme or more extreme than the value actually observed is called the P-value of the test.

The smaller the P-value, the stronger the evidence the data provide against the null hypothesis. That is, a small P-value indicates a small likelihood of observing the sampled results if the null hypothesis were true.

P-value

Page 30: Essential Statistics Chapter 131 Introduction to Inference.

Essential Statistics Chapter 13 30

P-value for Testing Means Ha: > 0

P-value is the probability of getting a value as large or larger than the observed test statistic (z) value.

Ha: < 0 P-value is the probability of getting a value as small or

smaller than the observed test statistic (z) value.

Ha: 0 P-value is two times the probability of getting a value as

large or larger than the absolute value of the observed test statistic (z) value.

Page 31: Essential Statistics Chapter 131 Introduction to Inference.

Essential Statistics Chapter 13 31

Sweetening Colas

Case Study I

For test statistic z = 3.23 and alternative hypothesisHa: > 0, the P-value would be:

P-value = P(Z > 3.23) = 1 – 0.9994 = 0.0006

If H0 is true, there is only a 0.0006 (0.06%) chance that we would see results at least as extreme as those in the sample; thus, since we saw results that are unlikely if H0 is true, we therefore have evidence against H0 and in favor of Ha.

Page 32: Essential Statistics Chapter 131 Introduction to Inference.

Essential Statistics Chapter 13 32

Sweetening Colas

Case Study I

Page 33: Essential Statistics Chapter 131 Introduction to Inference.

Essential Statistics Chapter 13 33

Studying Job Satisfaction

Case Study II

Suppose job satisfaction scores follow a Normal distribution with standard deviation = 60. Data from 18 workers gave a sample mean score of 17. If the null hypothesis of no average difference in job satisfaction is true, the test statistic would be:

1.20

1860

0170

μxz

Page 34: Essential Statistics Chapter 131 Introduction to Inference.

Essential Statistics Chapter 13 34

Studying Job Satisfaction

Case Study IIFor test statistic z = 1.20 and alternative hypothesisHa: ≠ 0, the P-value would be:

P-value = P(Z < -1.20 or Z > 1.20)

= 2 P(Z < -1.20) = 2 P(Z > 1.20)

= (2)(0.1151) = 0.2302

If H0 is true, there is a 0.2302 (23.02%) chance that we would see results at least as extreme as those in the sample; thus, since we saw results that are likely if H0 is true, we therefore do not have good evidence against H0 and in favor of Ha.

Page 35: Essential Statistics Chapter 131 Introduction to Inference.

Essential Statistics Chapter 13 35

Studying Job Satisfaction

Case Study II

Page 36: Essential Statistics Chapter 131 Introduction to Inference.

Essential Statistics Chapter 13 36

If the P-value is as small as or smaller than the significance level (i.e., P-value ≤ ), then we say that the data give results that are statistically significant at level .

If we choose = 0.05, we are requiring that the data give evidence against H0 so strong that it would occur no more than 5% of the time when H0 is true.

If we choose = 0.01, we are insisting on stronger evidence against H0, evidence so strong that it would occur only 1% of the time when H0 is true.

Statistical Significance

Page 37: Essential Statistics Chapter 131 Introduction to Inference.

Essential Statistics Chapter 13 37

The four steps in carrying out a significance test:1. State the null and alternative hypotheses.2. Calculate the test statistic.3. Find the P-value.4. State your conclusion in the context of the

specific setting of the test.

The procedure for Steps 2 and 3 is on the next page.

Tests for a Population Mean

Page 38: Essential Statistics Chapter 131 Introduction to Inference.

Essential Statistics Chapter 13 38

Page 39: Essential Statistics Chapter 131 Introduction to Inference.

Essential Statistics Chapter 13 39

Sweetening Colas

Case Study I

1. Hypotheses: H0: = 0Ha: > 0

2. Test Statistic:

3. P-value: P-value = P(Z > 3.23) = 1 – 0.9994 = 0.0006

4. Conclusion:

Since the P-value is smaller than = 0.01, there is very strong evidence that the new cola loses sweetness on average during storage at room temperature.

3.23

101

01.020

μxz

Page 40: Essential Statistics Chapter 131 Introduction to Inference.

Essential Statistics Chapter 13 40

Studying Job Satisfaction

Case Study II

1. Hypotheses: H0: = 0Ha: ≠ 0

2. Test Statistic:

3. P-value: P-value = 2P(Z > 1.20) = (2)(1 – 0.8849) = 0.2302

4. Conclusion:

Since the P-value is larger than = 0.10, there is not sufficient evidence that mean job satisfaction of assembly workers differs when their work is machine-paced rather than self-paced.

1.20

1860

0170

μxz

Page 41: Essential Statistics Chapter 131 Introduction to Inference.

Essential Statistics Chapter 13 41

Confidence Intervals & Two-Sided Tests

A level two-sided significance test

rejects the null hypothesis H0: = 0

exactly when the value 0 falls outside a

level (1 – ) confidence interval for .

Page 42: Essential Statistics Chapter 131 Introduction to Inference.

Essential Statistics Chapter 13 42

Case Study II

A 90% confidence interval for is:

Since 0 = 0 is in this confidence interval, it is plausible that the true value of is 0; thus, there is not sufficient evidence(at = 0.10) that the mean job satisfaction of assembly workers differs when their work is machine-paced rather than self-paced.

40.26 to 6.26

23.261718

601.64517

n

σzx

Studying Job Satisfaction