Download - Chapter 4

Copyright © 2010 by The McGraw-Hill Companies, Inc. All rights reserved.

McGraw-Hill/Irwin

Chapter 4

Probability

4-2

Chapter Outline

4.1 The Concept of Probability4.2 Sample Spaces and Events4.3 Some Elementary Probability

Rules4.4 Conditional Probability and

Independence4.5 Bayes’ Theorem (Optional)

4-3

4.1 The Concept of Probability

An experiment is any process of observation with an uncertain outcome

The possible outcomes for an experiment are called the experimental outcomes

Probability is a measure of the chance that an experimental outcome will occur when an experiment is carried out

4-4

Probability

If E is an experimental outcome, then P(E) denotes the probability that E will occur and:Conditions

1. 0 P(E) 1 such that: If E can never occur, then P(E) = 0 If E is certain to occur, then P(E) = 1

2. The probabilities of all the experimental outcomes must sum to 1

4-5

Assigning Probabilities to Experimental Outcomes

Classical MethodFor equally likely outcomes

Long-run relative frequency In the long run

SubjectiveAssessment based on experience,

expertise or intuition

4-6

4.2 Sample Spaces and Events

Sample Space: The set of all possible experimental outcomes

Sample Space Outcomes: The experimental outcomes in the sample space

Event: A set of sample space outcomes

4-7

Events

If A is an event, then 0 ≤ P(A) ≤ 1

1. If an event never occurs, then the probability of this event equals 0

2. If an event is certain to occur, then the provability of this event equals 1

4-8

Example 4.3

Figure 4.2

4-9

4.3 Some Elementary Probability Rules

1. Complement2. Union3. Intersection4. Addition5. Conditional probability

4-10

Complement

Figure 4.4

APAP 1

4-11

Union and Intersection

1. The intersection of A and B are elementary events that belong to both A and B

Written as A ∩ B

2. The union of A and B are elementary events that belong to either A or B or both

Written as A B

4-12

Union and Intersection Diagram

Figure 4.5

4-13

Mutually Exclusive

Figure 4.6

4-14

The Addition Rule

If A and B are mutually exclusive, then the probability that A or B will occur is

P(AB) = P(A) + P(B)

If A and B are not mutually exclusive:

P(AB) = P(A) + P(B) – P(A∩B)

where P(A∩B) is the joint probability of A and B both occurring together

4-15

4.4 Conditional Probability and Independence

The probability of an event A, given that the event B has occurred, is called the conditional probability of A given BDenoted as P(A|B)

Further, P(A|B) = P(A∩B) / P(B)P(B) ≠ 0

4-16

Interpretation

Restrict sample space to just event B

The conditional probability P(A|B) is the chance of event A occurring in this new sample space

In other words, if B occurred, then what is the chance of A occurring

4-17

General Multiplication Rule

BAPBP

ABPAPBAP

|

|

4-18

Independence of Events

Two events A and B are said to be independent if and only if:

P(A|B) = P(A)

This is equivalently to

P(B|A) = P(B)

4-19

The Multiplication Rule

The joint probability that A and B (the intersection of A and B) will occur is

P(A∩B) = P(A) P(B|A) = P(B) P(A|B)

If A and B are independent, then the probability that A and B will occur is:

P(A∩B) = P(A) P(B) = P(B) P(A)

4-20

4.5 Bayes’ Theorem (Optional)

S1, S2, …, Sk represents k mutually exclusive possible states of nature, one of which must be true

P(S1), P(S2), …, P(Sk) represents the prior probabilities of the k possible states of nature

If E is a particular outcome of an experiment designed to determine which is the true state of nature, then the posterior (or revised) probability of a state Si, given the experimental outcome E, is calculated using the formula on the next slide

4-22

Example 4.18

Oil drilling on a particular siteP(S1 = none) = .7P(S2 = some) = .2P(S3 = much) = .1

Can perform a seismic experimentP(high|none) = .04P(high|some) = .02P(high|much) = .96

4-23

Example 4.18 Continued

275.

128.

96.1.||

03125.128.

02.2.||

21875.128.

04.7.||

128.96.1.02.2.04.7.

|||

highP

muchhighPmuchP

highP

highmuchPhighmuchP

highP

somehighPsomeP

highP

highsomePhighsomeP

highP

nonehighPnoneP

highP

highnonePhighnoneP

muchhighPmuchPsomehighPsomePnonehighPnoneP

highmuchPhighsomePhighnonePhighP