Tests of significance

Post on 20-Jan-2017

609 views 0 download

Transcript of Tests of significance

Hypothesis TestsHypothesis Tests

One Sample Means

Example 2: A government agency has received numerous complaints that a particular restaurant has been selling underweight hamburgers. The restaurant advertises that it’s patties are “a quarter pound” (4 ounces).

How can I tell if they really are underweight?

Take a sample & find x.

But how do I know if this x is one that I expectexpect to happen or

is it one that is unlikelyunlikely to happen?

A hypothesis test will help me decide!

What are hypothesis What are hypothesis tests?tests?

Calculations that tell us if a value, x, occurs by random chance or not – if it is statistically significantIs it . . .

–a random occurrence due to natural variation?

–a biased occurrence due to some other reason?

Statistically significant means that it is NOTNOT a random

chance occurrence!

Is it one of the sample means

that are likely to occur?

Is it one that isn’t likely to

occur?

Nature of hypothesis tests Nature of hypothesis tests --•First begin by supposing the

“effect” is NOT present•Next, see if data provides

evidence against the supposition

Example: murder trial

How does a murder trial work?

First - assume that the person is innocentThen – mustmust have

sufficient evidence to prove guilty

Hmmmmm …Hypothesis tests use the same process!

Steps:Steps:

1) Assumptions2) Hypothesis statements &

define parameters3) Calculations4) Conclusion, in context

Notice the steps are the same except we add

hypothesis statements – which you will learn

today

Assumptions for z-test (t-Assumptions for z-test (t-test):test):• Have an SRS of context• Distribution is (approximately)

normal– Given– Large sample size– Graph data

• is known (unknown)

YEA YEA –These are the same

assumptions as confidence intervals!!

Example 1: Bottles of a popular cola are supposed to contain 300 mL of cola. There is some variation from bottle to bottle. An inspector, who suspects that the bottler is under-filling, measures the contents of six randomly selected bottles. Are the assumptions met?

299.4 297.7 298.9 300.2 297 301

•Have an SRS of bottles•Sampling distribution is approximately normal because the boxplot is symmetrical• is unknown

Writing Hypothesis Writing Hypothesis statements:statements:

• Null hypothesis – is the statement being tested; this is a statement of “no effect” or “no difference”

• Alternative hypothesis – is the statement that we suspect is true

H0:

Ha:

The form:The form:Null hypothesis H0: parameter = hypothesized value

Alternative hypothesis Ha: parameter > hypothesized value Ha: parameter < hypothesized value Ha: parameter = hypothesized value

Example 2: A government agency has received numerous complaints that a particular restaurant has been selling underweight hamburgers. The restaurant advertises that it’s patties are “a quarter pound” (4 ounces).State the hypotheses :

Where is the true mean weight of hamburger patties

H0: = 4

Ha: < 4

Example 3: A car dealer advertises that is new subcompact models get 47 mpg. You suspect the mileage might be overrated. State the hypotheses :

Where is the true mean mpg

H0: = 47

Ha: < 47

Example 4: Many older homes have electrical systems that use fuses rather than circuit breakers. A manufacturer of 40-A fuses wants to make sure that the mean amperage at which its fuses burn out is in fact 40. If the mean amperage is lower than 40, customers will complain because the fuses require replacement too often. If the amperage is higher than 40, the manufacturer might be liable for damage to an electrical system due to fuse malfunction. State the hypotheses :Where is the

true mean amperage of the fuses

H0: = 40

Ha: = 40

Facts to remember about Facts to remember about hypotheses:hypotheses:• ALWAYS refer to populations

(parameters)• The null hypothesis for the

“difference” between populations is usually equal to zero

• The null hypothesis for the correlation (rho) of two events is usually equal to zero.

H0: x-y= 0

H0: = 0

Activity: For each pair of hypotheses, indicate which are not legitimate & explain why

0:H;0:H e)6.:H;4.:H d)1.:H;1.:H c)123:H;123:H b)

15:H;15:H a)

a0

a0

a0

a0

a0

xx

Must use parameter (population) x is a statistics

(sample)

is the population proportion!Must use same

number as H0! is parameter for population correlation coefficient – but H0

MUST be “=“ !

Must be NOT equal!

P-values -P-values -

•Assuming H0 is true, the probability that the test statistic would have a value as extreme or more than what is actually observedIn other words . . . is it

far out in the tails of the distribution?

Level of significance -Level of significance - • Is the amount of evidence

necessary before we begin to doubt that the null hypothesis is true

• Is the probability that we will reject the null hypothesis, assuming that it is true

• Denoted by – Can be any value– Usual values: 0.1, 0.05, 0.01– Most common is 0.05

Statistically significant –• The p-value is as smallas small or

smaller smaller than the level of significance ()

• If p > , “fail to rejectfail to reject” the null hypothesis at the level.

• If p < , “rejectreject” the null hypothesis at the level.

Facts about p-values:• ALWAYS make decision about the

null hypothesis!• Large p-values show support for

the null hypothesis, but never that it is true!

• Small p-values show support that the null is not true.

• Double the p-value for two-tail (=) tests

• Never acceptNever accept the null hypothesis!

Never “accept” the null hypothesis!Never “accept” the null

hypothesis!

Never “accept” the null hypothesis!

At an level of .05, would you reject or fail to reject H0

for the given p-values?a) .03b) .15c) .45d) .023

Reject

Reject

Fail to rejectFail to reject

Draw & shade a curve & calculate the p-value:1) right-tail test t = 1.6; n = 20

2) left-tail test z = -2.4; n = 15

3) two-tail test t = 2.3; n = 25

P-value = .0630

P-value = .0082

P-value = (.0152)2 = .0304

Writing Conclusions:1) A statement of the decision

being made (reject or fail to reject H0) & why (linkage)

2) A statement of the results in context. (state in terms of Ha)

AND

“Since the p-value < (>) , I reject (fail to reject) the H0. There is (is not) sufficient evidence to suggest that Ha.” Be sure to write Ha

in context (words)!

Example 5: Drinking water is considered unsafe if the mean concentration of lead is greater than 15 ppb (parts per billion). Suppose a community randomly selects of 25 water samples and computes a t-test statistic of 2.1. Assume that lead concentrations are normally distributed. Write the hypotheses, calculate the p-value & write the appropriate conclusion for = 0.05.

H0: = 15Ha: > 15Where is the true mean concentration of lead in drinking waterP-value = tcdf(2.1,10^99,24) =.0232

t=2.1

Since the p-value < , I reject H0. There is sufficient evidence to suggest that the mean concentration of lead in drinking water is greater than 15 ppb.

Example 6: A certain type of frozen dinners states that the dinner contains 240 calories. A random sample of 12 of these frozen dinners was selected from production to see if the caloric content was greater than stated on the box. The t-test statistic was calculated to be 1.9. Assume calories vary normally. Write the hypotheses, calculate the p-value & write the appropriate conclusion for = 0.05.

H0: = 240Ha: > 240Where is the true mean caloric content of the frozen dinners

P-value = tcdf(1.9,10^99,11) =.0420

t=1.9Since the p-value < , I reject H0. There is sufficient evidence to suggest that the true mean caloric content of these frozen dinners is greater than 240 calories.

Formulas:known:

statistic of deviation standardparameter - statisticstatistic test

z =

x

n

Formulas: unknown:

statistic of deviation standardparameter - statisticstatistic test

t =

x

ns

Example 7: The Fritzi Cheese Company buys milk from several suppliers as the essential raw material for its cheese. Fritzi suspects that some producers are adding water to their milk to increase their profits. Excess water can be detected by determining the freezing point of milk. The freezing temperature of natural milk varies normally, with a mean of -0.545 degrees and a standard deviation of 0.008. Added water raises the freezing temperature toward 0 degrees, the freezing point of water (in Celsius). The laboratory manager measures the freezing temperature of five randomly selected lots of milk from one producer with a mean of -0.538 degrees. Is there sufficient evidence to suggest that this producer is adding water to his milk?

Assumptions:•I have an SRS of milk from one producer•The freezing temperature of milk is a normal distribution. (given)• is known

SRS?Normal?How do

you know?

Do you know

?H0: = -0.545Ha: > -0.545 where is the true mean freezing temperature of milk

What are your hypothesis

statements? Is there a key

word? 9566.1

5008.

545.538.

z Plug values

into formula.

p-value = normalcdf(1.9566,1E99)=.0252 Use normalcdf

to calculate p-value.

= .05

Conclusion: Compare your p-value to a & make

decisionSince p-value < , I reject the null hypothesis.

Write conclusion in context in terms of

Ha.

There is sufficient evidence to suggest that the true mean freezing temperature is greater than -0.545. This suggests that the producer is adding water to the milk.

Example 8: The Degree of Reading Power (DRP) is a test of the reading ability of children. Here are DRP scores for a random sample of 44 third-grade students in a suburban district:

(data on note page)At the = .1, is there sufficient evidence to suggest that this district’s third graders reading ability is different than the national mean of 34?

• I have an SRS of third-graders•Since the sample size is large, the sampling distribution is approximately normally distributedOR•Since the histogram is unimodal with no outliers, the sampling distribution is approximately normally distributed• is unknown

SRS?Normal?How do

you know?Do you know

?What are your

hypothesis statements? Is

there a key word?

6467.

44189.11

34091.35

t Plug values

into formula.

p-value = tcdf(.6467,1E99,43)=.2606(2)=.5212 Use tcdf to

calculate p-value.

= .1

H0: = 34 where is the true mean readingHa: = 34 ability of the district’s third-graders

Conclusion: Compare your p-value to & make

decisionSince p-value > , I fail to reject the null hypothesis.

Write conclusion in context in terms of Ha.

There is not sufficient evidence to suggest that the true mean reading ability of the district’s third-graders is different than the national mean of 34.

Example 9: The Wall Street Journal (January 27, 1994) reported that based on sales in a chain of Midwestern grocery stores, President’s Choice Chocolate Chip Cookies were selling at a mean rate of $1323 per week. Suppose a random sample of 30 weeks in 1995 in the same stores showed that the cookies were selling at the average rate of $1208 with standard deviation of $275. Does this indicate that the sales of the cookies is different from the earlier figure?

Assume: •Have an SRS of weeks•Distribution of sales is approximately normal due to large sample size• s unknownH0: = 1323 where is the true mean cookie salesHa: ≠ 1323 per week

Since p-value < of 0.05, I reject the null hypothesis. There is sufficient to suggest that the sales of cookies are different from the earlier figure.

0295.29.230

27513231208

valuept

Example 9: President’s Choice Chocolate Chip Cookies were selling at a mean rate of $1323 per week. Suppose a random sample of 30 weeks in 1995 in the same stores showed that the cookies were selling at the average rate of $1208 with standard deviation of $275. Compute a 95% confidence interval for the mean weekly sales rate.CI = ($1105.30, $1310.70)Based on this interval, is the mean weekly sales rate statistically different from the reported $1323?

What do you notice about the decision from the confidence interval & the

hypothesis test?What decision would you make on Example 10 if = .01?

What confidence level would be correct to use?

Does that confidence interval provide the same decision?

If Ha: < 1323, what decision would the hypothesis test give at = .02?

Now, what confidence level is appropriate for this alternative hypothesis?

You should use a 99% confidence level for a two-sided hypothesis test at = .01.

You would fail to reject H0 since the p-value > .

CI = ($1068.6 , $1346.40) - Since $1323 is in this interval we would fail to reject H0.

Remember your, p-value = .01475At = .02, we would reject H0.

The 98% CI = ($1084.40, $1331.60) - Since $1323 is in the interval, we would

fail to reject H0.

Why are we getting different answers?

In a one-sided test, all of goes into that tail (lower tail).

= .02

In a CI, the tails have equal area – so there should also be 2% in the upper tailThat leaves 96%96% in the middle & that should be your confidence confidence levellevel

.02.96

A 96% CI = ($1100, $1316).Since $1323 is not in the interval, we

would reject H0.

Tail probabilities between the significant level ()

and the confidence level MUST match!)

Matched Pairs Test

A special type of t-inference

Matched Pairs – two forms

• Pair individuals by certain characteristics

• Randomly select treatment for individual A

• Individual B is assigned to other treatment

• Assignment of B is dependent on assignment of A

• Individual persons or items receive both treatments

• Order of treatments are randomly assigned or before & after measurements are taken

• The two measures are dependent on the individual

Is this an example of matched pairs?

1)A college wants to see if there’s a difference in time it took last year’s class to find a job after graduation and the time it took the class from five years ago to find work after graduation. Researchers take a random sample from both classes and measure the number of days between graduation and first day of employmentNo, there is no pairing of individuals, you have two independent samples

Is this an example of matched pairs?

2) In a taste test, a researcher asks people in a random sample to taste a certain brand of spring water and rate it. Another random sample of people is asked to taste a different brand of water and rate it. The researcher wants to compare these samplesNo, there is no pairing of individuals, you have two independent samples – If you would have the same people taste both brands in random order, then it would bean example of matched pairs.

Is this an example of matched pairs?

3) A pharmaceutical company wants to test its new weight-loss drug. Before giving the drug to a random sample, company researchers take a weight measurement on each person. After a month of using the drug, each person’s weight is measured again.Yes, you have two measurements that are dependent on each individual.

A whale-watching company noticed that many customers wanted to know whether it was better to book an excursion in the morning or the afternoon. To test this question, the company collected the following data on 15 randomly selected days over the past month. (Note: days were not consecutive.)

Day 1 2 3 4 5 6 7 8 9 10 11

12

13

14

15

Morning 8 9 7 9 1

013 10 8 2 5 7 7 6 8 7

After-noon 8 10 9 8 9 1

1 8 10 4 7 8 9 6 6 9First, you must find the differences for

each day.

Since you have two values for each day, they are

dependent on the day – making this data matched

pairs

You may subtract either way – just be careful

when writing Ha

Day 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15

Morning 8 9 7 9 10 13 10 8 2 5 7 7 6 8 7After-noon 8 10 9 8 9 11 8 10 4 7 8 9 6 6 9

Differences 0 -1 -2 1 1 2 2 -2 -2 -2 -1 -2 0 2 -2

Assumptions:• Have an SRS of days for whale-watching• unknown•Since the normal probability plot is approximately linear, the distribution of difference is approximately normal.

I subtracted:Morning – afternoon

You could subtract the other way!

You need to state assumptions using the differences!

Notice the granularity in this plot, it is still displays a nice linear relationship!

Differences 0 -1 -2 1 1 2 2 -2 -2 -2 -1 -2 0 2 -2

Is there sufficient evidence that more whales are sighted in the afternoon?

Be careful writing your Ha!

Think about how you subtracted: M-A

If afternoon is more should the differences be

+ or -?Don’t look at numbers!!!!

H0: D = 0Ha: D < 0Where D is the true mean difference in whale sightings from morning minus afternoon

Notice we used D for differences

& it equals 0 since the null should be that there is NO

difference.

If you subtract afternoon – morning; then Ha: D>0

finishing the hypothesis test:

Since p-value > , I fail to reject H0. There is insufficient evidence to suggest that more whales are sighted in the afternoon than in the morning.

05.141803.

945.15

639.104.

dfp

nsxt Notice that if

you subtracted A-M, then your test statistic

t = + .945, but p-value would be the same

In your calculator, perform a t-test

using the differences (L3)

Differences 0 -1 -2 1 1 2 2 -2 -2 -2 -1 -2 0 2 -2