1 RELATIONSHIP-OBJECTIVE ANALYSIS Getting Full Value From Earned Value With a Value-Added Way of...

34
1 RELATIONSHIP-OBJECTIVE ANALYSIS Getting Full Value From Earned Value With a Value-Added Way of Looking at Performance Measurement Presented at the 14th Annual International Integrated Program Management Conference Tysons Corner Sheraton Premiere Hotel November 19, 2002 Presented By Will Gran Windmill International, Inc. Nashua, New Hampshire 03060-5830 (603) 888-5502

Transcript of 1 RELATIONSHIP-OBJECTIVE ANALYSIS Getting Full Value From Earned Value With a Value-Added Way of...

Page 1: 1 RELATIONSHIP-OBJECTIVE ANALYSIS Getting Full Value From Earned Value With a Value-Added Way of Looking at Performance Measurement Presented at the 14th.

1

RELATIONSHIP-OBJECTIVE ANALYSIS

Getting Full Value From Earned Value With a Value-Added Way of Looking at

Performance Measurement

Presented at the 14th Annual International Integrated Program Management Conference

Tysons Corner Sheraton Premiere Hotel

November 19, 2002

Presented By Will Gran

Windmill International, Inc.

Nashua, New Hampshire 03060-5830

(603) 888-5502

Page 2: 1 RELATIONSHIP-OBJECTIVE ANALYSIS Getting Full Value From Earned Value With a Value-Added Way of Looking at Performance Measurement Presented at the 14th.

2

Value-Added From Earned Value • Review some basics• Traditional analyses

– Line graph presentation– EAC formula

• Relationship-Objective Analysis– Variances

– Efficiencies

– Resource use rates

– Estimates at completion

• Some closing thoughts . . .

Page 3: 1 RELATIONSHIP-OBJECTIVE ANALYSIS Getting Full Value From Earned Value With a Value-Added Way of Looking at Performance Measurement Presented at the 14th.

3

When I Say . . . I Mean . . . Planned Value BCWSCompleted Value BCWPResources Used ACWPRemaining Planned Value BCWRBaseline Total Value BACResource Value Variance CVTime Value Variance SVResource Use Efficiency Index CPITime Value Efficiency Index SPIContract At Cost TCContract At Price TPContract Liability CP

Page 4: 1 RELATIONSHIP-OBJECTIVE ANALYSIS Getting Full Value From Earned Value With a Value-Added Way of Looking at Performance Measurement Presented at the 14th.

4

EVMS 32 Criteria

• Industry Standard EIA 748, paragraph 2.4.f“Develop revised estimates of cost at completion based

on performance to date, commitment values for material, and estimates of future conditions. Compare this information with the performance measurement baseline to identify variances at completion important to company management and any applicable customer reporting requirements including statements of funding requirements.”

Page 5: 1 RELATIONSHIP-OBJECTIVE ANALYSIS Getting Full Value From Earned Value With a Value-Added Way of Looking at Performance Measurement Presented at the 14th.

5

Performance Analysis Process• Objective analysis from the data:

– Status performance to time now– Look for performance trends– Compare tends with a baseline plan– Project performance trends into the future– Relate projected trends to some meaningful objective

• Subjective analysis from information:– Investigate root causes of variances– Identify future influencing factors and risk– Adjust projected trends– Assess resource requirements– Compare with contract parameters

Page 6: 1 RELATIONSHIP-OBJECTIVE ANALYSIS Getting Full Value From Earned Value With a Value-Added Way of Looking at Performance Measurement Presented at the 14th.

6

Traditional Performance Analysis

The Line GraphX-Axis: Passage of time

Years, quarters, months, weeks, days, etc.

Y-Axis: Measure of ResourcesDollars, items, lengths, volumes, etc.

Page 7: 1 RELATIONSHIP-OBJECTIVE ANALYSIS Getting Full Value From Earned Value With a Value-Added Way of Looking at Performance Measurement Presented at the 14th.

7

The Line Graph

Page 8: 1 RELATIONSHIP-OBJECTIVE ANALYSIS Getting Full Value From Earned Value With a Value-Added Way of Looking at Performance Measurement Presented at the 14th.

8

Line Graph Charts

The presentation is limiting . . .

– Depicts absolute values versus a time scale

– That focus on performance history

– Difficult to identify trends

– Difficult to compare trends to a baseline plan

– Difficult to develop credible cost projections to completion

Page 9: 1 RELATIONSHIP-OBJECTIVE ANALYSIS Getting Full Value From Earned Value With a Value-Added Way of Looking at Performance Measurement Presented at the 14th.

9

Estimate At Completion FormulaEAC = Actuals + PF X Remaining Planned Value

– Assumes Performance Factor will be a constant

– And 1 unit of Planned Value will convert to 1+/- unit of Actual

The Estimate At Completion Formula

– Provides a point estimate

– Is a limited predictive metric

– That inherently underestimates overruns

– And inherently underestimates underruns

Page 10: 1 RELATIONSHIP-OBJECTIVE ANALYSIS Getting Full Value From Earned Value With a Value-Added Way of Looking at Performance Measurement Presented at the 14th.

10

The Traditional Analyses

Line Graph Charts

and the

Estimate At Completion Formula

Provide partial value from Earned Value

Page 11: 1 RELATIONSHIP-OBJECTIVE ANALYSIS Getting Full Value From Earned Value With a Value-Added Way of Looking at Performance Measurement Presented at the 14th.

11

Why The Difference In EACs?

Page 12: 1 RELATIONSHIP-OBJECTIVE ANALYSIS Getting Full Value From Earned Value With a Value-Added Way of Looking at Performance Measurement Presented at the 14th.

12

A Different Look At Performance

Relationship-Objective Analysis

X-Axis: Value of work completed

Y-Axis: Progress toward an (Objective)

Percent Complete = Work Completed Baseline Total Value X 100

Percent Of (Objective) = Resources Value Value Of (Objective) X 100

Page 13: 1 RELATIONSHIP-OBJECTIVE ANALYSIS Getting Full Value From Earned Value With a Value-Added Way of Looking at Performance Measurement Presented at the 14th.

13

Relationship-Objective GraphAn X - Y Scatter Diagram

Page 14: 1 RELATIONSHIP-OBJECTIVE ANALYSIS Getting Full Value From Earned Value With a Value-Added Way of Looking at Performance Measurement Presented at the 14th.

14

An (Objective) May Be• Baseline Total Value • Estimate At Completion• Contract At Cost• Contract At Price• Contract Liability

• Or any general (Objective) that is a specific resource value

Page 15: 1 RELATIONSHIP-OBJECTIVE ANALYSIS Getting Full Value From Earned Value With a Value-Added Way of Looking at Performance Measurement Presented at the 14th.

15

Variance As Percent Line Graph

Page 16: 1 RELATIONSHIP-OBJECTIVE ANALYSIS Getting Full Value From Earned Value With a Value-Added Way of Looking at Performance Measurement Presented at the 14th.

16

Variances As % Of Baseline Plan

• Deviation from baseline time plan

• Deviation from baseline resource plan

Reduces volatility of variance trends in early periods of the project.

Time Variance = Completed Value - Planned Value Baseline Total Value X 100

Resource Variance = Completed Value - Resources Used Baseline Total Value X 100

Page 17: 1 RELATIONSHIP-OBJECTIVE ANALYSIS Getting Full Value From Earned Value With a Value-Added Way of Looking at Performance Measurement Presented at the 14th.

17

Variances As % Of Baseline PlanAn X - Y Scatter Diagram

Page 18: 1 RELATIONSHIP-OBJECTIVE ANALYSIS Getting Full Value From Earned Value With a Value-Added Way of Looking at Performance Measurement Presented at the 14th.

18

Performance Efficiency Since Start

• Value of work completed with resources used

• History of past performance efficiency

• Efficient > 100%• Inefficient < 100%

Resource Use Efficiency Index Since Start = Completed ValueResources Used X 100

Time Value Efficiency Index Since Start = Completed ValuePlanned Value X 100

Page 19: 1 RELATIONSHIP-OBJECTIVE ANALYSIS Getting Full Value From Earned Value With a Value-Added Way of Looking at Performance Measurement Presented at the 14th.

19

Resource Use Efficiency Since StartAn X - Y Scatter Diagram

Page 20: 1 RELATIONSHIP-OBJECTIVE ANALYSIS Getting Full Value From Earned Value With a Value-Added Way of Looking at Performance Measurement Presented at the 14th.

20

Performance Efficiency To Finish

• Ability to accomplish work within (Objective)

• Future performance required

Efficiency Index To Meet (Objective) = Remaining Planned Value(Objective) Resources Remaining X 100

Efficiency Index To Meet (Objective) = Baseline Total Value - Completed Value(Objective) - Resources Used X 100

Page 21: 1 RELATIONSHIP-OBJECTIVE ANALYSIS Getting Full Value From Earned Value With a Value-Added Way of Looking at Performance Measurement Presented at the 14th.

21

Resource Use Efficiency To Finish

Page 22: 1 RELATIONSHIP-OBJECTIVE ANALYSIS Getting Full Value From Earned Value With a Value-Added Way of Looking at Performance Measurement Presented at the 14th.

22

Rate Of Using Resources

• History of a “resource burn rate”

Resource Use as % Of (Objective) = Resources Used (Objective) X 100

Planned Value as % Of (Objective) = Planned Value (Objective) X 100

Completed Value as % Of (Objective) = Completed Value (Objective) X 100

Page 23: 1 RELATIONSHIP-OBJECTIVE ANALYSIS Getting Full Value From Earned Value With a Value-Added Way of Looking at Performance Measurement Presented at the 14th.

23

Rate Of Using Resources

Page 24: 1 RELATIONSHIP-OBJECTIVE ANALYSIS Getting Full Value From Earned Value With a Value-Added Way of Looking at Performance Measurement Presented at the 14th.

24

EAC = Actuals + PF X Remaining Planned Value

– Assumes Performance Factor will be a constant

– And 1 unit of Planned Value will convert to 1+/- unit of Actual

The Estimate At Completion Formula

– Provides a point estimate

– Is a limited predictive metric

– That inherently underestimates overruns

– And inherently underestimates underruns

Estimate At Completion (EAC)

Page 25: 1 RELATIONSHIP-OBJECTIVE ANALYSIS Getting Full Value From Earned Value With a Value-Added Way of Looking at Performance Measurement Presented at the 14th.

25

Performance FactorsShould be related to performance

Running Average ~ Resource Use Efficiency Index (Period of Time)

Product ~ Resource Use Efficiency Index X Time Value Efficiency Index

Weighted ~ 0.8 Resource Use Efficiency Index + 0.2 Time Value Efficiency Index

Time Value Kicker ~ Resource Use Efficiency Index + 0.2 Time Value Efficiency Index

Cumulative ~ Resource Use Efficiency Index

Page 26: 1 RELATIONSHIP-OBJECTIVE ANALYSIS Getting Full Value From Earned Value With a Value-Added Way of Looking at Performance Measurement Presented at the 14th.

26

Estimate At Completion

Page 27: 1 RELATIONSHIP-OBJECTIVE ANALYSIS Getting Full Value From Earned Value With a Value-Added Way of Looking at Performance Measurement Presented at the 14th.

27

Trend Line Projection Analysis

• Identify performance trend

• Select set of data to project trend

• Determine “best fit” line– Y-Axis intercept– Slope of “best fit” line

• Extrapolate to 100% complete

Projects performance trend to end of effort

Page 28: 1 RELATIONSHIP-OBJECTIVE ANALYSIS Getting Full Value From Earned Value With a Value-Added Way of Looking at Performance Measurement Presented at the 14th.

28

Resource Use Trend Projection

Page 29: 1 RELATIONSHIP-OBJECTIVE ANALYSIS Getting Full Value From Earned Value With a Value-Added Way of Looking at Performance Measurement Presented at the 14th.

29

EAC Trend Projection

Page 30: 1 RELATIONSHIP-OBJECTIVE ANALYSIS Getting Full Value From Earned Value With a Value-Added Way of Looking at Performance Measurement Presented at the 14th.

30

Best Case - Worse Case - Most Likely

Page 31: 1 RELATIONSHIP-OBJECTIVE ANALYSIS Getting Full Value From Earned Value With a Value-Added Way of Looking at Performance Measurement Presented at the 14th.

31

Thoughts While Showering . . .

• Focus on the BIG picture first, then dig deeper

• Volatility indicates poor baseline plan, poor discipline, or both

• Watch for front loading due to optimistic planning

• Significant change in scope creates a new baseline

• Don’t be fooled by the early “resource variance hump”

• Time variances are associated with Work-In-Progress

• Time variances disappear when work is completed

• Resource variances accumulate when work is completed

• Time variances lead resource variances

• Look for long term trends and assess impacts

Page 32: 1 RELATIONSHIP-OBJECTIVE ANALYSIS Getting Full Value From Earned Value With a Value-Added Way of Looking at Performance Measurement Presented at the 14th.

32

Thoughts While Shaving . . .

• An Index produces a ratio• EAC formula produces a point estimate• EAC as percent of an (Objective) produces a rate of

change• Trends usually appear before 20% Complete

• Relationship-Objective Analysis extrapolates rate of change trend to completion . . .

. . . And gives you Full Value from Earned Value

Page 33: 1 RELATIONSHIP-OBJECTIVE ANALYSIS Getting Full Value From Earned Value With a Value-Added Way of Looking at Performance Measurement Presented at the 14th.

33

Thoughts While Sitting . . .

• The Performance Factor is not constant as the Estimate At Completion formula assumes

• The trend of the Performance factor is the key determining parameter for the most realistic Estimate At Completion

• Understand which Performance factor should be the best predictor and why

Page 34: 1 RELATIONSHIP-OBJECTIVE ANALYSIS Getting Full Value From Earned Value With a Value-Added Way of Looking at Performance Measurement Presented at the 14th.

34

Agathe Christie Says . . .

“Getting Full Value from Earned Value with Relationship-Objective Analysis is like a good

detective story.

The main characters are introduced, the plot is established, and the clues to Who Dunit

emerge in the first 20% of the story.”