Decision theory

16
Decision Theory Definition of Decision Analysis: Decision analysis is defined as the use of a rational process/technique for selecting the best of several alternatives. The “goodness” of a selected alternative depends on the quality of the data used in describing decision situation. Example: Mr X is a bright student, has received full academic scholarships from three institutions: U of A, U of B and U of C. To select a university Mr. X lists two three main criteria: location, academic reputation and political violence. Being the excellent student he is, he judges academic reputation to be five times as important as location and less political violence, which gives a weight of approximation 80% to reputation, 15% to location and 5% to political violence. He then use a systematic analysis to rank the three universities from the standard point of location, reputation and political violence. The analysis produces the following estimates Location: U of A (13%) U of B (28%) U of C (59%) Reputation U of A (54%) U of B (27%) U of C (19%) Political Violence U of A (25%) U of B 45% U of C (30%) The structure of the decision problem is summarized below in Figure. 1 Select a University Sazzad Hossain 128

Transcript of Decision theory

Page 1: Decision theory

Decision Theory

Definition of Decision Analysis: Decision analysis is defined as the use of a rational process/technique for selecting the best of several alternatives. The “goodness” of a selected alternative depends on the quality of the data used in describing decision situation. Example: Mr X is a bright student, has received full academic scholarships from three institutions: U of A, U of B and U of C. To select a university Mr. X lists two three main criteria: location, academic reputation and political violence. Being the excellent student he is, he judges academic reputation to be five times as important as location and less political violence, which gives a weight of approximation 80% to reputation, 15% to location and 5% to political violence. He then use a systematic analysis to rank the three universities from the standard point of location, reputation and political violence. The analysis produces the following estimates

Location: U of A (13%) U of B (28%) U of C (59%)Reputation U of A (54%) U of B (27%) U of C (19%)Political Violence U of A (25%) U of B 45% U of C (30%)

The structure of the decision problem is summarized below in Figure.

1

Select a University

Location (0.15) Reputation(0.80) Political

Violence 0.05

U of A 0.13

U of B0.28

U of C0.59

U of A0.54

U of B0.27

U of C0.19

U of A0.25

U Of B0.45

U of C0.30

Sazzad Hossain128

Page 2: Decision theory

To select the university here we use the technique of decision analysis.

Classification of Decision SituationDecision making process can be classified into the following three broad categories(1) Decision making under certainty in which the data are known deterministically(2) Decision making under risk in which the data can be described by probability distributions.3. Decision making under uncertainty in which the data cannot be assigned relative weights that represent their degree of relevance in the decision process.

Decision Making Under Certainty:Linear programming and transportation models provide an example of decision making under certainty. Here only one state of nature exists, there is complete certainty about the future. The decision maker simply finds the best payoff in that one column and chooses the associated alternative. Few complex managerial decision making problems, however ever enjoy the luxury of having complete information about the future and hence decision making under uncertainty is of little consequential interest. This section presents a different approaches for the situation in which ideas, feelings and emotions are quantified to provide a numeric scale for prioritizing decision alternatives. The approach is known as the

Decision Making Under RiskHere, more than one states of nature exist and decision maker has sufficient information to assign probabilities to each of these states. For this reason decision making under risk is usually based on the expected value criteria in which decision alternatives are compared based on the maximization of expected profits or the minimization of expected cost. This approach has limitations in the sense that it may not be applicable to certain situations

Expected Value Criteria: It is also known as the expected monetary value (EMV) criteria, it consists of the following steps.(i) Construct a payoff table listing the alternative decisions and the various states of nature. Enter the conditional profit for each decision-event combination along with the associated probabilities. In

general, a decision problem may include n states of nature and m alternatives. If is the

probability of occurrence for state of nature j and let is the payoff of alternative i

2

Page 3: Decision theory

given state of nature j (i= 1, 2,……,m; j = 1, 2,……,n)

State jProbability( )

Alternatives1, 2, ……………. i………. ….. m

12...j..n

.

.

.

.

.

………………. ……………. ………………… ……………

. ………………………………………..

. ………………………………………..

. ……………………………………….. ………………….. ………………

. …………………………………………….

. ………………………………………..

…………………… ………………

(ii) Calculate the EMV for each decision alternative by multiplying the conditional profits by the assigned probabilities and adding the resulting conditional values. The expected monetary value or expected payoff for alternative I is computed as

(iii) The best alternative is the one associated with or

depending, respectively, on whether the payoff of the problem represents

profit (income) or loss (expense)Problem: A newspaper boy has the following probabilities of selling a sports magazineNo. of Copies Sold Probabilities10 0.0111 0.1512 0.2013 0.2514 0.30Cost of a copy is TK 30 and sale price is TK 50. He cannot return unsold copies. How many copies should ne order?Solution: The numbers of copies for purchases and for sales are 10, 11, 12, 13 and 14. These are his sales magnitudes. There is no reason for him to buy less than 10 or more than 14 copies. Stocking 10 copies each day will always result in profit TK200 irrespective of demand. For instance, even if the demand on some day is more than 10 copies, he can sell only 10 and hence

3

Page 4: Decision theory

his conditional profit is TK200. When he stocks 11 copies, his conditional profits is TK220 on days buyers request 11, 12, 13 or 14 copies. But on days when he has 11 copies on stock and buyers buy only 10 copies, his profit will be TK 170. The profit of TK 200 on the 10 copies sold must be reduced by TK 30, the cost of one copy left unsold. The same will be true when he stocks 12, 13, or 14 copies. The conditional profit is given below;

The payoff table is constructed below;

Table 1: Payoff Table: Conditional profit in TKPossible DemandNo. of Copies

Prob. Possible stock action10 Copies 11 Copies 12 Copies 13 Copies 14 Copies

1011121314

0.100.150.200.250.30

200200200200200

170220220220220

140190240240240

110160210260260

80130180230280

Now the expected value of each decision alternative is obtained by adding the multiplying its conditional profit and the associated probability. The is shown in Table below;

Table: Expected profitPossible DemandNo. of Copies

Prob. Expected profit from stocking in TK10 Copies 11 Copies 12 Copies 13 Copies 14 Copies

1011121314

0.100.150.200.250.30

2030405060

1733445566

1428.5486072

1124426578

819.53657.584

Total Expected Profit 200 215 222.5 220 205Thus the newsboy must order 12 copies to earn highest possible average daily profit. This stocking

will maximize the total profits over a period of time. Of course there is no guarantee that he will make a profit of TK222.5 tomorrow. However, if he stocks 12 copies each day under the condition given, he will have average profit of TK 222.5 per day. This is the best he can do because choice of any of the other four possible stock actions result in a lower daily profit.

Expected Opportunity Loss (EOL) Criterion This approach is an alternative to EMV. EOL or expected value of regrets is the amount by

which

4

Page 5: Decision theory

maximum possible profit will be reduced under various possible actions. The course of action that

minimize these losses is the optimal decision alternative. It consists of the following steps:Step 1: Construct the conditional profit table for each decision-event combination and write

the associated probabilities

Step 2: For each event, calculate the conditional opportunity loss (COL) by subtracting the payoff

from the maximum payoff for the event. Step 3: Calculate the expected opportunity loss (EOL) for each decision alternative by multiplying the COL’s by the associated probabilities and then adding the values.Step 4. Select the alternative that yields the lowest EOLProblem: A newspaper boy has the following probabilities of selling a sports magazineNo. of Copies Sold Probabilities10 0.0111 0.1512 0.2013 0.2514 0.30Cost of a copy is TK 30 and sale price is TK 50. He cannot return unsold copies. How many copies should ne order?Solution: The best alternative for demand 10 copies is to order 10 copies, resulting in optimal profit of TK 200. The conditional opportunity loss for each stock action is obtained just by subtraction the respective conditional profit from TK 200. Likewise, for demand of 11, 12, 13 and 14 copies we subtract the conditional payoff values for each of these rows from the maximum of that row. The resulting conditional opportunity loss table is shown below;Table 1: Conditional Loss Table in TKPossible DemandNo. of Copies

Prob. Possible stock action10 Copies 11 Copies 12 Copies 13 Copies 14 Copies

1011121314

0.100.150.200.250.30

020406080

300204060

603002040

906030020

1209060300

Now the EOL value of each decision alternative is obtained by adding the multiplying its conditional opportunity loss and the associated probability. The is shown in Table below;

Table: Expected profit

5

Page 6: Decision theory

Possible DemandNo. of Copies

Prob. Expected profit from stocking in TK10 Copies 11 Copies 12 Copies 13 Copies 14 Copies

1011121314

0.100.150.200.250.30

0381524

304108

64.50512

99606

1213.5127.50

Total Expected Profit 50 35 27.5 30 45

The optimal stock action is the one which will minimize expected opportunity losses. If the newsboy stock 12 copies each day, the expected loss will be minimum. Note : It may be pointed out that EMV and EOL decision criteria are completely consistent and yield the same optimal decision alternative. However, while the decisions alternative will be always based on finding the minimum EOL value under EOL criterion irrespective of whether the problem is of maximization expected profit or minimizing expected loss. Expected Value of Perfect Information (EVPI): Complete and accurate information about the future demand referred to as perfect information, would remove all uncertainty from the problem. With this perfect information, the decision maker would know in advance exactly about the future demand. EVPI represents the maximum amount he would pay to get this additional information on which may be based the decision alternative.Problem: A dairy firm wants to determine the quantity of butter it should produce to meet the demand. The past records have shown the following demand patterns;

Quantity Demanded (in kg) No. of Days Demand Occurred15202530354050

6142080403010

The stock levels are restricted to the range of 15 kg to 50 kg and the butter left unsold at the end of the day must be disposed of due to inadequate storing facilities. Butter costs TK 80 and sold TK 110 per kg. (i) Construct a conditional profit table(ii) Determine the action alternative associated with the maximization of expected profit(iii) Determine the EVPI

6

Page 7: Decision theory

Solution: The dairy firm would not produce butter less than 15 kg and more than 50 kg. Form the given data we can calculate the conditional profit for each stock action and event (demand combination. If CP is the conditional profit, S is the quantity in stock and D is the quantity demanded, then CP is given by;

The probability of demand of 15 kg is = 6/200 = 0.03. The probabilities associated with other demand levels are given below win payoff table below:

Possible Demand(Event in kg) (D)

Prob. Possible stock action (Alternative ) (in kg) (S)15 20 25 30 35 40 50

15202530354050

0.030.070.100.400.200.150.05

450450450450450450450

50600600600600600600

-350200750750750750750

-750-200350900900900900

-1150-600-50500105010501050

-1550-1000-45010065012001200

-2350-1800-1250-700-1504001500

The expected profit for each alternative is given belowTable: Expected profitPossible Demand(Event in kg) (D)

Prob. Possible stock action (Alternative ) (in kg) (S)15 20 25 30 35 40 50

15202530354050

0.030.070.100.400.200.150.05

13.5 31.5 45.0 180 90 67.5 22.5

1.5 42 60 240 120 90 30

-10.5 14 75300 150 112.5 37.5

-22.5 -14 35 360 180 135 45

-34.5 -42 -5200 210 157.5 52.5

-46.5 -70 -45 40 130 180 60

-70.5 -126 -125 -280 -30 60 75

EMV 450.0 583.5 678.5 718.5 538.5 248.5 -496.5Since the maximum EMV is TK 718.5 for stock of 30 kg of butter, thus the dairy firm may produce 30 kg of butter and can expect average daily profit of TK 718.5Now the expected profit with perfect information is given below in Table ()Table : Expected profit with perfect information

Market Demand(in kg)

Probabilities Conditional Profit under certainty

Expected profit with perfect

7

Page 8: Decision theory

information15202530354050

0.030.070.100.400.200.150.05

450600750900105012001500

13.5427536021018075

EPPI 955.5

The expected value of perfect information is given byEVPI = EPPI- max(EMV) = 955.5-718.5 = 237 TK

Use of Incremental (Marginal ) Analysis.Any additional unit purchased will be either sold or remain unsold. If p denotes the probability of selling one additional unit, then (1-p) must be the probability of not selling it. If the additional unit sold, the conditional profit will increase as a result of the profit earned from this additional unit. This is termed as the incremental profit or marginal profit. Let the define the marginal profit is MP. If the additional unit is not sold, the conditional profit is reduced and the amount of reduction is called the incremental loss or marginal loss. Let us define the marginal loss is ML. Thus the expected incremental profit will be pMP while the expected incremental loss will be (1-p) ML. Thus the units should be stocked up to the point such that

Thus additional unit should be stocked so long as the probability of selling at least one additional unit is greater than p.

Problem: A milkman buys milk at Tk 30 and sells for TK 40 per litre. Unsold milk has to be thrown away. The daily demand has the following probability distribution

Demand (Liter) Probability4648505254

0.010.030.060.100.20

8

Page 9: Decision theory

5658606264

0.250.150.100.050.05

If each day’s demand is independent of previous days’ demand, how many liters should he ordered every day.Solution: The marginal profit is given asMP = 10 TkAnd the marginal loss is given asML = TK 30The milkman should stock additional liters of milk so long as the probability of selling at least an additional liter of milk is greater than p where

The value of 0.75 for p implies that in order to justify the stocking of an additional unit, there

must be at least 0.75 cumulative probability of selling that unit. The cumulative probability of

sales are computed below;

Demand (Liter) Probability Cumulative probability that sales will be at this level or higher

46485052545658606264

0.010.030.060.100.200.250.150.100.050.05

1.000.990.960.900.800.600.350.200.100.05

9

Page 10: Decision theory

The optimum number of liters of milk to be stocked is 54 liters. If the number increased to 56 liters, the cumulative probability will become 0.60 which is less than the required probability 0.75.The expected incremental profit is given by;

The expected incremental loss is given by;

If the milkman stocks 56 liters of milk, the expected incremental loss will be more than expected

incremental gain. The approach give you the same decision as provided by the EMV and EOL

approaches. However, the computational effort required in this approach is much less.Problem: A vegetable seller buys a box of tomatoes for TK 300 and sells them for TK 450 a box. If the box is not sold on the first selling day, it is worth of TK 200 as salvage. The past records indicate that the demand is normally distributed with a mean of 30 boxes daily and standard deviation is 9. How many boxes should be stock?

Decision Trees Analysis: A decision tree is a graphical representation of the decision process indicating decision alternatives, states of nature, probabilities attached to the state of nature and conditional benefits and losses. It consists of a network of nodes and branches. Two types of nodes are used: (i) decision node represented by a square and state of nature (chance or event) node represented by a circle. Alternative courses of action (strategies) originate from the decision nodes as main branches (decision branches). At the end of each decision branch, there is a state of nature node from which emanate chance events in the form of sub-branches (chance branches). The respective payoff and the probabilities associated with alternative courses and the chance events are shown alongside these branches. At the terminal of the chance branches are shown the expected value of the outcome.The general approach used in decision tree analysis is to work backward through the tree from right to left, computing the expected value of each chance node. We then choose the particular branch leaving a decision node which leads to the chance node with the highest expected value. This approach is known as roll back or fold back process.

Example: A client asks an estate agent to sell three properties A, B, and C for him and agrees to pay him 5% commission on each sale. He specifies certain conditions. The estate agent must sell property A first, and this he must do within 60 days. If and when A is sold the agent receives his 5% commission on that sale. He can then either back out at this stage or nominate and try to sell

10

Page 11: Decision theory

one of the remaining two properties within 60 days. If he does not succeed in selling the nominated property in that period, he is not given the opportunity to sell the third property on the same conditions. The prices, selling costs( incurred by the estate agent whenever a sale is made) and the estate agent’s estimated probabilities of making a sale are given below;Property Price of Property Selling Cost Probability of SaleA 125000 5000 0.70B 175000 4000 0.60C 225000 6000 0.50(i) Draw up an appropriate decision tree for the state agent(ii) What is the estate agent’s best strategy under EMV approach?Solution: The state agent’s gets 5% commission if he sells the properties and satisfies the specified conditions. The amount he receives as commission on sale of properties A, B and C will be TK 6250, TK 8750, and TK 11250 respectively. Since the selling costs incurred by his are TK 5000, TK 4000 and TK 6000 respectively and his conditional profits are TK 1250, TK 4750 and TK 5250 respectively. The decision tree for the problem is shown below;

EMV of Node 3 = Max of TK [ 2625, 0] = TK2625EMV of Node 4 = Max of TK [ 2850, 0] = TK 2850

11

Sells C, 5250. 0.5 Takes c Stops, TK 0 Sells Does Not C, TK 0 4750, 0.60 Stop, TK0 4750, 0.6

Sells A, Takes B Does Not Sell B Sells B TK 0, 0.40 Takes B Does

Accepts TK1250, 0.70 Take C Sells, 5250, 0.50 Not Sell Does not Sell, TK 0 Does Not Sell C Stops, TK0 TK0 0.30 0.50, TK 0

1 A 2

B

C

3

4

D

E

Page 12: Decision theory

EMV of Node 2 = Max of [ 4425, 4050] = TK 4425

EMV of Node 1 = TK 3972.5Thus the optimal strategy for the estate agent is to sell A, if he sells A, then try to sell B and if he sells B and then try to sell C to get an optimum amount of TK 3972.5

12