Point and Interval Estimates - Αρχικήmba.teipir.gr/files/4rth_lecture.pdf · We can estimate...

37
Point and Interval Estimates A point estimate is a single number, a confidence interval provides additional information about the variability of the estimate Basic Business Statistics, 11e © 2009 Prentice-Hall, Inc.. Chap 8-1 Point Estimate Lower Confidence Limit Upper Confidence Limit Width of confidence interval

Transcript of Point and Interval Estimates - Αρχικήmba.teipir.gr/files/4rth_lecture.pdf · We can estimate...

Page 1: Point and Interval Estimates - Αρχικήmba.teipir.gr/files/4rth_lecture.pdf · We can estimate a Population Parameter … Point Estimates with a Sample Statistic (a Point Estimate)

Point and Interval Estimates

A point estimate is a single number,

a confidence interval provides additionalinformation about the variability of the estimate

Basic Business Statistics, 11e © 2009 Prentice-Hall, Inc.. Chap 8-1

information about the variability of the estimate

Point Estimate

Lower

Confidence

Limit

Upper

Confidence

Limit

Width ofconfidence interval

Page 2: Point and Interval Estimates - Αρχικήmba.teipir.gr/files/4rth_lecture.pdf · We can estimate a Population Parameter … Point Estimates with a Sample Statistic (a Point Estimate)

We can estimate aPopulation Parameter …

Point Estimates

with a SampleStatistic

(a Point Estimate)

Basic Business Statistics, 11e © 2009 Prentice-Hall, Inc.. Chap 8-2

(a Point Estimate)

Mean

Proportion pπ

Page 3: Point and Interval Estimates - Αρχικήmba.teipir.gr/files/4rth_lecture.pdf · We can estimate a Population Parameter … Point Estimates with a Sample Statistic (a Point Estimate)

Confidence Intervals

How much uncertainty is associated with apoint estimate of a population parameter?

An interval estimate provides more

Basic Business Statistics, 11e © 2009 Prentice-Hall, Inc.. Chap 8-3

An interval estimate provides moreinformation about a population characteristicthan does a point estimate

Such interval estimates are called confidenceintervals

Page 4: Point and Interval Estimates - Αρχικήmba.teipir.gr/files/4rth_lecture.pdf · We can estimate a Population Parameter … Point Estimates with a Sample Statistic (a Point Estimate)

Confidence Interval Estimate

An interval gives a range of values:

Takes into consideration variation in samplestatistics from sample to sample

Based on observations from 1 sample

Basic Business Statistics, 11e © 2009 Prentice-Hall, Inc.. Chap 8-4

Based on observations from 1 sample

Gives information about closeness tounknown population parameters

Stated in terms of level of confidence

e.g. 95% confident, 99% confident

Can never be 100% confident

Page 5: Point and Interval Estimates - Αρχικήmba.teipir.gr/files/4rth_lecture.pdf · We can estimate a Population Parameter … Point Estimates with a Sample Statistic (a Point Estimate)

Confidence Interval Example

Cereal fill example

Population has µ = 368 and σ = 15.

If you take a sample of size n = 25 you know

368 ± 1.96 * 15 / = (362.12, 373.88) contains 95% of25

Basic Business Statistics, 11e © 2009 Prentice-Hall, Inc.. Chap 8-5

368 ± 1.96 * 15 / = (362.12, 373.88) contains 95% ofthe sample means

When you don’t know µ, you use X to estimate µ If X = 362.3 the interval is 362.3 ± 1.96 * 15 / = (356.42, 368.18)

Since 356.42 ≤ µ ≤ 368.18 the interval based on this sample makes a correct statement about µ.

But what about the intervals from other possible samplesof size 25?

25

25

Page 6: Point and Interval Estimates - Αρχικήmba.teipir.gr/files/4rth_lecture.pdf · We can estimate a Population Parameter … Point Estimates with a Sample Statistic (a Point Estimate)

Confidence Interval Example(continued)

Sample # XLower

Limit

Upper

Limit

Contain

µ?

1 362.30 356.42 368.18 Yes

Basic Business Statistics, 11e © 2009 Prentice-Hall, Inc.. Chap 8-6

2 369.50 363.62 375.38 Yes

3 360.00 354.12 365.88 No

4 362.12 356.24 368.00 Yes

5 373.88 368.00 379.76 Yes

Page 7: Point and Interval Estimates - Αρχικήmba.teipir.gr/files/4rth_lecture.pdf · We can estimate a Population Parameter … Point Estimates with a Sample Statistic (a Point Estimate)

Confidence Interval Example

In practice you only take one sample of size n

In practice you do not know µ so you do notknow if the interval actually contains µ

However you do know that 95% of the intervals

(continued)

Basic Business Statistics, 11e © 2009 Prentice-Hall, Inc.. Chap 8-7

However you do know that 95% of the intervalsformed in this manner will contain µ

Thus, based on the one sample, you actuallyselected you can be 95% confident your intervalwill contain µ (this is a 95% confidence interval)

Note: 95% confidence is based on the fact that we used Z = 1.96.

Page 8: Point and Interval Estimates - Αρχικήmba.teipir.gr/files/4rth_lecture.pdf · We can estimate a Population Parameter … Point Estimates with a Sample Statistic (a Point Estimate)

Estimation Process

Population

Random Sample

Mean

I am 95%confident thatμ is between 40 & 60.

Basic Business Statistics, 11e © 2009 Prentice-Hall, Inc.. Chap 8-8

(mean, μ, is unknown)

Population Mean

X = 50

Sample

40 & 60.

Page 9: Point and Interval Estimates - Αρχικήmba.teipir.gr/files/4rth_lecture.pdf · We can estimate a Population Parameter … Point Estimates with a Sample Statistic (a Point Estimate)

General Formula

The general formula for all confidenceintervals is:

Point Estimate ± (Critical Value)(Standard Error)

Basic Business Statistics, 11e © 2009 Prentice-Hall, Inc.. Chap 8-9

Wh

Where:•Point Estimate is the sample statistic estimating the populationparameter of interest

•Critical Value is a table value based on the samplingdistribution of the point estimate and the desired confidencelevel

•Standard Error is the standard deviation of the point estimate

Page 10: Point and Interval Estimates - Αρχικήmba.teipir.gr/files/4rth_lecture.pdf · We can estimate a Population Parameter … Point Estimates with a Sample Statistic (a Point Estimate)

Confidence Level

Confidence Level

Confidence the interval will containthe unknown population parameter

Basic Business Statistics, 11e © 2009 Prentice-Hall, Inc.. Chap 8-10

A percentage (less than 100%)

Page 11: Point and Interval Estimates - Αρχικήmba.teipir.gr/files/4rth_lecture.pdf · We can estimate a Population Parameter … Point Estimates with a Sample Statistic (a Point Estimate)

Confidence Level, (1-)

Suppose confidence level = 95%

Also written (1 - ) = 0.95, (so = 0.05)

A relative frequency interpretation:

95% of all the confidence intervals that can be

(continued)

Basic Business Statistics, 11e © 2009 Prentice-Hall, Inc.. Chap 8-11

95% of all the confidence intervals that can beconstructed will contain the unknown trueparameter

A specific interval either will contain or willnot contain the true parameter

No probability involved in a specific interval

Page 12: Point and Interval Estimates - Αρχικήmba.teipir.gr/files/4rth_lecture.pdf · We can estimate a Population Parameter … Point Estimates with a Sample Statistic (a Point Estimate)

Confidence Intervals

Population

ConfidenceIntervals

Population

Basic Business Statistics, 11e © 2009 Prentice-Hall, Inc.. Chap 8-12

PopulationMean

σ Unknown

PopulationProportion

σ Known

Page 13: Point and Interval Estimates - Αρχικήmba.teipir.gr/files/4rth_lecture.pdf · We can estimate a Population Parameter … Point Estimates with a Sample Statistic (a Point Estimate)

Confidence Interval for μ(σ Known)

Assumptions Population standard deviation σ is known Population is normally distributed If population is not normal, use large sample

Confidence interval estimate:

Basic Business Statistics, 11e © 2009 Prentice-Hall, Inc.. Chap 8-13

where is the point estimate

Zα/2 is the normal distribution critical value for a probability of /2 in each tail

is the standard error

n

σ/2ZX α

X

nσ/

Page 14: Point and Interval Estimates - Αρχικήmba.teipir.gr/files/4rth_lecture.pdf · We can estimate a Population Parameter … Point Estimates with a Sample Statistic (a Point Estimate)

Finding the Critical Value, Zα/2

Consider a 95% confidence interval:

0.05so0.951 αα

1.96/2Z α

Basic Business Statistics, 11e © 2009 Prentice-Hall, Inc.. Chap 8-14

Zα/2 = -1.96 Zα/2 = 1.96

0.0252

α0.025

2

α

Point EstimateLowerConfidenceLimit

UpperConfidenceLimit

Z units:

X units: Point Estimate

0

Page 15: Point and Interval Estimates - Αρχικήmba.teipir.gr/files/4rth_lecture.pdf · We can estimate a Population Parameter … Point Estimates with a Sample Statistic (a Point Estimate)

Common Levels of Confidence

Commonly used confidence levels are 90%,95%, and 99%

ConfidenceLevel

ConfidenceCoefficient, Zα/2 value

1

Basic Business Statistics, 11e © 2009 Prentice-Hall, Inc.. Chap 8-15

Level

1.28

1.645

1.96

2.33

2.58

3.08

3.27

0.80

0.90

0.95

0.98

0.99

0.998

0.999

80%

90%

95%

98%

99%

99.8%

99.9%

1

Page 16: Point and Interval Estimates - Αρχικήmba.teipir.gr/files/4rth_lecture.pdf · We can estimate a Population Parameter … Point Estimates with a Sample Statistic (a Point Estimate)

Intervals and Level of Confidence

Intervals

Sampling Distribution of the Mean

x

/2 /21

Basic Business Statistics, 11e © 2009 Prentice-Hall, Inc.. Chap 8-16

μμx

Confidence Intervals

Intervalsextend from

to

(1-)x100%of intervalsconstructedcontain μ;

()x100% donot.

n

σ2/αZX

n

σ2/αZX

x

x1

x2

Page 17: Point and Interval Estimates - Αρχικήmba.teipir.gr/files/4rth_lecture.pdf · We can estimate a Population Parameter … Point Estimates with a Sample Statistic (a Point Estimate)

Example

A sample of 11 circuits from a large normalpopulation has a mean resistance of 2.20ohms. We know from past testing that thepopulation standard deviation is 0.35 ohms.

Basic Business Statistics, 11e © 2009 Prentice-Hall, Inc.. Chap 8-17

Determine a 95% confidence interval for thetrue mean resistance of the population.

Page 18: Point and Interval Estimates - Αρχικήmba.teipir.gr/files/4rth_lecture.pdf · We can estimate a Population Parameter … Point Estimates with a Sample Statistic (a Point Estimate)

Example

A sample of 11 circuits from a large normalpopulation has a mean resistance of 2.20ohms. We know from past testing that the

population standard deviation is 0.35 ohms.

(continued)

Basic Business Statistics, 11e © 2009 Prentice-Hall, Inc.. Chap 8-18

2.40681.9932

0.20682.20

)11(0.35/1.962.20

n

σ/2ZX

μ

α

population standard deviation is 0.35 ohms.

Solution:

Page 19: Point and Interval Estimates - Αρχικήmba.teipir.gr/files/4rth_lecture.pdf · We can estimate a Population Parameter … Point Estimates with a Sample Statistic (a Point Estimate)

Interpretation

We are 95% confident that the true mean

resistance is between 1.9932 and 2.4068

ohms

Although the true mean may or may not be

Basic Business Statistics, 11e © 2009 Prentice-Hall, Inc.. Chap 8-19

Although the true mean may or may not be

in this interval, 95% of intervals formed in

this manner will contain the true mean

Page 20: Point and Interval Estimates - Αρχικήmba.teipir.gr/files/4rth_lecture.pdf · We can estimate a Population Parameter … Point Estimates with a Sample Statistic (a Point Estimate)

Confidence Intervals

Population

ConfidenceIntervals

Population

Basic Business Statistics, 11e © 2009 Prentice-Hall, Inc.. Chap 8-20

PopulationMean

σ Unknown

PopulationProportion

σ Known

Page 21: Point and Interval Estimates - Αρχικήmba.teipir.gr/files/4rth_lecture.pdf · We can estimate a Population Parameter … Point Estimates with a Sample Statistic (a Point Estimate)

Do You Ever Truly Know σ?

Probably not!

In virtually all real world business situations, σ is not known.

Basic Business Statistics, 11e © 2009 Prentice-Hall, Inc.. Chap 8-21

known.

If there is a situation where σ is known then µ is also known (since to calculate σ you need to know µ.)

If you truly know µ there would be no need to gather asample to estimate it.

Page 22: Point and Interval Estimates - Αρχικήmba.teipir.gr/files/4rth_lecture.pdf · We can estimate a Population Parameter … Point Estimates with a Sample Statistic (a Point Estimate)

If the population standard deviation σ is unknown, we can substitute the samplestandard deviation, S

Confidence Interval for μ(σ Unknown)

Basic Business Statistics, 11e © 2009 Prentice-Hall, Inc.. Chap 8-22

This introduces extra uncertainty, sinceS is variable from sample to sample

So we use the t distribution instead of thenormal distribution

Page 23: Point and Interval Estimates - Αρχικήmba.teipir.gr/files/4rth_lecture.pdf · We can estimate a Population Parameter … Point Estimates with a Sample Statistic (a Point Estimate)

Assumptions

Population standard deviation is unknown

Population is normally distributed

If population is not normal, use large sample

Confidence Interval for μ(σ Unknown)

(continued)

Basic Business Statistics, 11e © 2009 Prentice-Hall, Inc.. Chap 8-23

If population is not normal, use large sample

Use Student’s t Distribution

Confidence Interval Estimate:

(where tα/2 is the critical value of the t distribution with n -1 degreesof freedom and an area of α/2 in each tail)

n

StX 2/α

Page 24: Point and Interval Estimates - Αρχικήmba.teipir.gr/files/4rth_lecture.pdf · We can estimate a Population Parameter … Point Estimates with a Sample Statistic (a Point Estimate)

Student’s t Distribution

The t is a family of distributions

The tα/2 value depends on degrees offreedom (d.f.)

Basic Business Statistics, 11e © 2009 Prentice-Hall, Inc.. Chap 8-24

Number of observations that are free to vary aftersample mean has been calculated

d.f. = n - 1

Page 25: Point and Interval Estimates - Αρχικήmba.teipir.gr/files/4rth_lecture.pdf · We can estimate a Population Parameter … Point Estimates with a Sample Statistic (a Point Estimate)

Degrees of Freedom (df)

Idea: Number of observations that are free to varyafter sample mean has been calculated

Example: Suppose the mean of 3 numbers is 8.0

Basic Business Statistics, 11e © 2009 Prentice-Hall, Inc.. Chap 8-25

If the mean of these threevalues is 8.0,then X3 must be 9(i.e., X3 is not free to vary)

Here, n = 3, so degrees of freedom = n – 1 = 3 – 1 = 2

(2 values can be any numbers, but the third is not free to varyfor a given mean)

Let X1 = 7

Let X2 = 8

What is X3?

Page 26: Point and Interval Estimates - Αρχικήmba.teipir.gr/files/4rth_lecture.pdf · We can estimate a Population Parameter … Point Estimates with a Sample Statistic (a Point Estimate)

Student’s t Distribution

StandardNormal

(t with df = ∞)

Note: t Z as n increases

Basic Business Statistics, 11e © 2009 Prentice-Hall, Inc.. Chap 8-26

t0

t (df = 5)

t (df = 13)t-distributions are bell-shaped and symmetric, buthave ‘fatter’ tails than thenormal

Page 27: Point and Interval Estimates - Αρχικήmba.teipir.gr/files/4rth_lecture.pdf · We can estimate a Population Parameter … Point Estimates with a Sample Statistic (a Point Estimate)

Student’s t Table

Upper Tail Area

df .25 .10 .05

1 1.000 3.078 6.314

Let: n = 3df = n - 1 = 2

= 0.10/2 = 0.05

Basic Business Statistics, 11e © 2009 Prentice-Hall, Inc.. Chap 8-27

1 1.000 3.078 6.314

2 0.817 1.886 2.920

3 0.765 1.638 2.353

t0 2.920

The body of the tablecontains t values, notprobabilities

/2 = 0.05

/2 = 0.05

Page 28: Point and Interval Estimates - Αρχικήmba.teipir.gr/files/4rth_lecture.pdf · We can estimate a Population Parameter … Point Estimates with a Sample Statistic (a Point Estimate)

Selected t distribution values

With comparison to the Z value

Confidence t t t ZLevel (10 d.f.) (20 d.f.) (30 d.f.) (∞ d.f.)

0.80 1.372 1.325 1.310 1.28

Basic Business Statistics, 11e © 2009 Prentice-Hall, Inc.. Chap 8-28

0.80 1.372 1.325 1.310 1.28

0.90 1.812 1.725 1.697 1.645

0.95 2.228 2.086 2.042 1.96

0.99 3.169 2.845 2.750 2.58

Note: t Z as n increases

Page 29: Point and Interval Estimates - Αρχικήmba.teipir.gr/files/4rth_lecture.pdf · We can estimate a Population Parameter … Point Estimates with a Sample Statistic (a Point Estimate)

Example of t distributionconfidence interval

A random sample of n = 25 has X = 50 andS = 8. Form a 95% confidence interval for μ

d.f. = n – 1 = 24, so 2.06390.025t/2 αt

Basic Business Statistics, 11e © 2009 Prentice-Hall, Inc.. Chap 8-29

The confidence interval is

25

8(2.0639)50

n

S/2 αtX

46.698 ≤ μ ≤ 53.302

Page 30: Point and Interval Estimates - Αρχικήmba.teipir.gr/files/4rth_lecture.pdf · We can estimate a Population Parameter … Point Estimates with a Sample Statistic (a Point Estimate)

Example of t distributionconfidence interval

Interpreting this interval requires theassumption that the population you aresampling from is approximately a normaldistribution (especially since n is only 25).

(continued)

Basic Business Statistics, 11e © 2009 Prentice-Hall, Inc.. Chap 8-30

distribution (especially since n is only 25).

This condition can be checked by creating a:

Normal probability plot or

Boxplot

Page 31: Point and Interval Estimates - Αρχικήmba.teipir.gr/files/4rth_lecture.pdf · We can estimate a Population Parameter … Point Estimates with a Sample Statistic (a Point Estimate)

Confidence Intervals

Population

ConfidenceIntervals

Population

Basic Business Statistics, 11e © 2009 Prentice-Hall, Inc.. Chap 8-31

PopulationMean

σ Unknown

PopulationProportion

σ Known

Page 32: Point and Interval Estimates - Αρχικήmba.teipir.gr/files/4rth_lecture.pdf · We can estimate a Population Parameter … Point Estimates with a Sample Statistic (a Point Estimate)

Confidence Intervals for thePopulation Proportion, π

An interval estimate for the population

proportion ( π ) can be calculated by

adding an allowance for uncertainty to

Basic Business Statistics, 11e © 2009 Prentice-Hall, Inc.. Chap 8-32

adding an allowance for uncertainty to

the sample proportion ( p )

Page 33: Point and Interval Estimates - Αρχικήmba.teipir.gr/files/4rth_lecture.pdf · We can estimate a Population Parameter … Point Estimates with a Sample Statistic (a Point Estimate)

Confidence Intervals for thePopulation Proportion, π

Recall that the distribution of the sampleproportion is approximately normal if thesample size is large, with standard deviation

(continued)

)(1

Basic Business Statistics, 11e © 2009 Prentice-Hall, Inc.. Chap 8-33

We will estimate this with sample data:

n

p)p(1

n

)(1σp

Page 34: Point and Interval Estimates - Αρχικήmba.teipir.gr/files/4rth_lecture.pdf · We can estimate a Population Parameter … Point Estimates with a Sample Statistic (a Point Estimate)

Confidence Interval Endpoints

Upper and lower confidence limits for thepopulation proportion are calculated with theformula

p)p(1

Basic Business Statistics, 11e © 2009 Prentice-Hall, Inc.. Chap 8-34

where Zα/2 is the standard normal value for the level of confidence desired

p is the sample proportion

n is the sample size

Note: must have np > 5 and n(1-p) > 5

n

p)p(1/2Zp

α

Page 35: Point and Interval Estimates - Αρχικήmba.teipir.gr/files/4rth_lecture.pdf · We can estimate a Population Parameter … Point Estimates with a Sample Statistic (a Point Estimate)

Example

A random sample of 100 people

shows that 25 are left-handed.

Form a 95% confidence interval for

Basic Business Statistics, 11e © 2009 Prentice-Hall, Inc.. Chap 8-35

Form a 95% confidence interval for

the true proportion of left-handers

Page 36: Point and Interval Estimates - Αρχικήmba.teipir.gr/files/4rth_lecture.pdf · We can estimate a Population Parameter … Point Estimates with a Sample Statistic (a Point Estimate)

Example

A random sample of 100 people showsthat 25 are left-handed. Form a 95%confidence interval for the true proportionof left-handers.

(continued)

Basic Business Statistics, 11e © 2009 Prentice-Hall, Inc.. Chap 8-36

/1000.25(0.75)1.9625/100

p)/np(1/2Zp

α

0.33490.1651

(0.0433)1.960.25

π

Page 37: Point and Interval Estimates - Αρχικήmba.teipir.gr/files/4rth_lecture.pdf · We can estimate a Population Parameter … Point Estimates with a Sample Statistic (a Point Estimate)

Interpretation

We are 95% confident that the truepercentage of left-handers in the populationis between

16.51% and 33.49%.

Basic Business Statistics, 11e © 2009 Prentice-Hall, Inc.. Chap 8-37

16.51% and 33.49%.

Although the interval from 0.1651 to 0.3349may or may not contain the true proportion,95% of intervals formed from samples ofsize 100 in this manner will contain the trueproportion.