Chapter 4

23
Copyright © 2010 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin Chapter 4 Probability

description

Chapter 4. Probability. Chapter Outline. 4.1 The Concept of Probability 4.2 Sample Spaces and Events 4.3 Some Elementary Probability Rules 4.4 Conditional Probability and Independence 4.5 Bayes’ Theorem (Optional). 4.1 The Concept of Probability. - PowerPoint PPT Presentation

Transcript of Chapter 4

Copyright © 2010 by The McGraw-Hill Companies, Inc. All rights reserved.

McGraw-Hill/Irwin

Chapter 4

Probability

4-2

Chapter Outline

4.1 The Concept of Probability4.2 Sample Spaces and Events4.3 Some Elementary Probability

Rules4.4 Conditional Probability and

Independence4.5 Bayes’ Theorem (Optional)

4-3

4.1 The Concept of Probability

An experiment is any process of observation with an uncertain outcome

The possible outcomes for an experiment are called the experimental outcomes

Probability is a measure of the chance that an experimental outcome will occur when an experiment is carried out

4-4

Probability

If E is an experimental outcome, then P(E) denotes the probability that E will occur and:Conditions

1. 0 P(E) 1 such that: If E can never occur, then P(E) = 0 If E is certain to occur, then P(E) = 1

2. The probabilities of all the experimental outcomes must sum to 1

4-5

Assigning Probabilities to Experimental Outcomes

Classical MethodFor equally likely outcomes

Long-run relative frequency In the long run

SubjectiveAssessment based on experience,

expertise or intuition

4-6

4.2 Sample Spaces and Events

Sample Space: The set of all possible experimental outcomes

Sample Space Outcomes: The experimental outcomes in the sample space

Event: A set of sample space outcomes

4-7

Events

If A is an event, then 0 ≤ P(A) ≤ 1

1. If an event never occurs, then the probability of this event equals 0

2. If an event is certain to occur, then the provability of this event equals 1

4-8

Example 4.3

Figure 4.2

4-9

4.3 Some Elementary Probability Rules

1. Complement2. Union3. Intersection4. Addition5. Conditional probability

4-10

Complement

Figure 4.4

APAP 1

4-11

Union and Intersection

1. The intersection of A and B are elementary events that belong to both A and B

Written as A ∩ B

2. The union of A and B are elementary events that belong to either A or B or both

Written as A B

4-12

Union and Intersection Diagram

Figure 4.5

4-13

Mutually Exclusive

Figure 4.6

4-14

The Addition Rule

If A and B are mutually exclusive, then the probability that A or B will occur is

P(AB) = P(A) + P(B)

If A and B are not mutually exclusive:

P(AB) = P(A) + P(B) – P(A∩B)

where P(A∩B) is the joint probability of A and B both occurring together

4-15

4.4 Conditional Probability and Independence

The probability of an event A, given that the event B has occurred, is called the conditional probability of A given BDenoted as P(A|B)

Further, P(A|B) = P(A∩B) / P(B)P(B) ≠ 0

4-16

Interpretation

Restrict sample space to just event B

The conditional probability P(A|B) is the chance of event A occurring in this new sample space

In other words, if B occurred, then what is the chance of A occurring

4-17

General Multiplication Rule

BAPBP

ABPAPBAP

|

|

4-18

Independence of Events

Two events A and B are said to be independent if and only if:

P(A|B) = P(A)

This is equivalently to

P(B|A) = P(B)

4-19

The Multiplication Rule

The joint probability that A and B (the intersection of A and B) will occur is

P(A∩B) = P(A) P(B|A) = P(B) P(A|B)

If A and B are independent, then the probability that A and B will occur is:

P(A∩B) = P(A) P(B) = P(B) P(A)

4-20

4.5 Bayes’ Theorem (Optional)

S1, S2, …, Sk represents k mutually exclusive possible states of nature, one of which must be true

P(S1), P(S2), …, P(Sk) represents the prior probabilities of the k possible states of nature

If E is a particular outcome of an experiment designed to determine which is the true state of nature, then the posterior (or revised) probability of a state Si, given the experimental outcome E, is calculated using the formula on the next slide

4-21

Bayes’ Theorem Continued

))P(E|S+P(S...)+)P(E|S)+P(S)P(E|SP(S

))P(E|SP(S

P(E)

))P(E|SP(S

P(E)

E)P(S|E)P(S

kk

ii

ii

ii

2211

4-22

Example 4.18

Oil drilling on a particular siteP(S1 = none) = .7P(S2 = some) = .2P(S3 = much) = .1

Can perform a seismic experimentP(high|none) = .04P(high|some) = .02P(high|much) = .96

4-23

Example 4.18 Continued

275.

128.

96.1.||

03125.128.

02.2.||

21875.128.

04.7.||

128.96.1.02.2.04.7.

|||

highP

muchhighPmuchP

highP

highmuchPhighmuchP

highP

somehighPsomeP

highP

highsomePhighsomeP

highP

nonehighPnoneP

highP

highnonePhighnoneP

muchhighPmuchPsomehighPsomePnonehighPnoneP

highmuchPhighsomePhighnonePhighP