Goodbye, “Last Measure In” Hello, “Option X”?

51
Goodbye, “Last Measure In” Hello, “Option X”? Staff Proposal for how to deal with the last measure in conundrum Regional Technical Forum October 15, 2013

description

Goodbye, “Last Measure In” Hello, “Option X”?. Staff Proposal for how to deal with the last measure in conundrum Regional Technical Forum October 15, 2013. Last Measure In - History. Problem: Simple versus Accurate Programs want simple deemed measures for weatherization and heat pumps. - PowerPoint PPT Presentation

Transcript of Goodbye, “Last Measure In” Hello, “Option X”?

Page 1: Goodbye, “Last Measure In” Hello, “Option X”?

Goodbye, “Last Measure In”Hello, “Option X”?

Staff Proposal for how to deal with the last measure in conundrum

Regional Technical ForumOctober 15, 2013

Page 2: Goodbye, “Last Measure In” Hello, “Option X”?

2

Last Measure In - History

• Problem: Simple versus Accurate– Programs want simple deemed measures for

weatherization and heat pumps.– With simple deemed measures, we don’t know

• The order in which measures get installed. • The starting point from which the measures get installed

• Solution: – Last Measure In

• While admittedly conservative, LMI allows for a reasonable savings estimate.

– Keep Weatherization separate from Heat Pumps• Weatherization measure savings dependent on existing heating system

Page 3: Goodbye, “Last Measure In” Hello, “Option X”?

3

Then came along the Guidelines…

Page 4: Goodbye, “Last Measure In” Hello, “Option X”?

4

Guidelines “The UES for each measure should be computed under the assumption that all other measures it significantly interacts with are already implemented. Interaction is significant if the RTF determines that it is likely to account for more than 10% of the measure savings. The other measures assumed to be present should be consistent with expected typical conditions at the end of the measure’s effective useful life. This “last-in” requirement may create a downward bias in the short-term savings estimate for a measure.”

Savings, Section 2.3.3.4. Interactions between Measures

Page 5: Goodbye, “Last Measure In” Hello, “Option X”?

5

Faithful implementation of the Guidelines appears to require that improvements in the HVAC system compete with shell improvements as a measure

• Simple logic:– Heat Pumps “significantly interact” with all the weatherization

measures.– So, they should be included in the analysis.

• In order to get the savings right, the RTF needs to agree on a forecast of the future mix of heat pumps.– But how far out in the future should we look?

• Guidelines say EUL, but that’s probably too far.– What about first year savings?

• Heat Pumps don’t play well with Last Measure In.

Page 6: Goodbye, “Last Measure In” Hello, “Option X”?

6

Heat Pump’s Effect on Wx Savings

1344 sq.ft. prototype; Heating Zone 1

Measure Duct TightnessHeating System

Attic Wall Floor Windows InfiltrationHeating Energy

(kWh/yr)

"Actual' savings

Existing Condition RBSA 9.0 HP 19 none 11 0.85 0.75 6594 n/aDuct Tightness PTCS 9.0 HP 38 11 25 0.22 0.35 2570 479Total 4025

Measure Duct TightnessHeating System

Attic Wall Floor Windows InfiltrationHeating Energy

(kWh/yr)

"Actual' savings

Existing Condition RBSA FAF 19 none 11 0.85 0.75 11158 n/aDuct Tightness PTCS FAF 38 11 25 0.22 0.35 4724 675Total 6434Fully Weatherized

Fully Weatherized

Page 7: Goodbye, “Last Measure In” Hello, “Option X”?

7

… and SEEM “Calibration”.

Page 8: Goodbye, “Last Measure In” Hello, “Option X”?

8

Calibration• Calibration required a change in thermostat setting

between poorly insulated and better insulated homes:

• This creates a discontinuity in the relationship between UA and space heating use/savings.– Now a measure could save significantly more if it were the

last measure in.• For an example, see savings for Walls in the “Measure Order” slide in the additional slides section.

Good Floor

Poor Floor

Good Floor

Poor Floor

Good Floor

Poor Floor

Good Floor

Poor Floor

70.3 68.2 66.5 64.5 66.9 64.8 63.1 60.7Daytime Thermostat Setting (°F)

Heating ZoneHeating System

Ceiling or Wall Insulation

Floor Insulation

Good Ceiling and Wall

Poor Ceiling or Wall

Good Ceiling and Wall

Poor Ceiling or Wall

Heating Zone 1Gas/HP Electric Resistance

Page 9: Goodbye, “Last Measure In” Hello, “Option X”?

9

ΔT-stat Setting’s effect depends on house UA

• So, insulation measures that begin with R-0 and cause an increase in T-stat setting save less if they’re done “first” (in a High UA house), versus “last” (in a Low UA house).

• This makes the last-in approach the opposite of conservative for these measures.

0

5000

10000

15000

20000

25000

55 60 65 70Heati

ng E

nerg

y U

se (k

wh/

yr)

Thermostat Setting (°F)

High UA Medium UA Low UA

0200400600800

100012001400

55 60 65 70

Slop

e:

ΔHe

ating

Ene

rgy

Use

ΔTh

erm

osta

t Setti

ng

Thermostat Setting (°F)

High UA Medium UA Low UA

Page 10: Goodbye, “Last Measure In” Hello, “Option X”?

10

ΔT-stat Setting Affects other Measures, too

• In houses with an R-0 component, savings from other components will be affected based on their order with respect to the R-0 component.

• Example House: Attic R-0, Wall R-11, Floor R-11; • Measure: Floor R-11 to R-25.– Scenario 1: Floors first

• Baseline and Efficient-case T-stat Setting: 66.5°F• Lower savings from floors

– Scenario 2: Floors last (Last Measure In)• Baseline and Efficient-case T-stat Setting: 73.5°F• Higher savings from floors

Page 11: Goodbye, “Last Measure In” Hello, “Option X”?

11

Measure Order

Now let’s change the measure order…

Measure Order-specific Calculator

MeasureHeating System

Attic Wall Floor Windows InfiltrationHeating Energy

(kWh/yr)Savings

(kwh/yr)Existing Condition Zonal 19 none 11 0.85 0.75 9263 n/aHeating System DHP 19 none 11 0.85 0.75 6534 2729Attic DHP 38 none 11 0.85 0.75 6173 361Windows DHP 38 none 11 0.22 0.75 4967 1206Wall DHP 38 11 11 0.22 0.75 3775 1192Floor DHP 38 11 25 0.22 0.75 3311 463Infiltration DHP 38 11 25 0.22 0.35 2471 840Total 6792

LMI Savings (kwh/yr)

n/a1744392126913394588406041

1344 sq.ft. prototype; Heating Zone 1

MeasureHeating System

Attic Wall Floor Windows InfiltrationHeating Energy

(kWh/yr)Savings

(kwh/yr)LMI Savings

(kwh/yr)Existing Condition Zonal 19 none 11 0.85 0.75 9263 n/a n/aWallAtticWindowsInfiltrationFloorHeating System

Zonal 19 11 11 0.85 0.75 8540 723 1339Zonal 38 11 11 0.85 0.75 8001 539 392Zonal 38 11 11 0.22 0.75 6182 1819 1269Zonal 38 11 11 0.22 0.35 4965 1217 840Zonal 38 11 25 0.22 0.35 4215 750 458DHP 38 11 25 0.22 0.35 2471 1744 1744

6792 6041Total

Page 12: Goodbye, “Last Measure In” Hello, “Option X”?

12

So Now What?

Page 13: Goodbye, “Last Measure In” Hello, “Option X”?

13

Primary Options for Calculating Savings

Last-measure in– Simple– Inaccurate

• T-stat settings• Heating system conversions• Requires a forecast• SEEM’s complex interactions

Savings Based on Existing Conditions at each House– Complex

• Requires an audit of the house (just like we used to do)– Most Accurate

• Both methods have many possible methods and sub-options; they can also be combined in different ways.

Page 14: Goodbye, “Last Measure In” Hello, “Option X”?

14

Some Options

Page 15: Goodbye, “Last Measure In” Hello, “Option X”?

15

Options Overview

ID Description

1A LMI Status Quo.

1B LMI assuming 85% of cost-effective measures.

1C LMI with measure-specific saturations.

1D LMI on an annual basis.

2A Use Existing Conditions for each house.

2B Use Existing Conditions for RBSA houses.

3 Use Existing Conditions for RBSA houses (2B), but prorate savings using ratio of LMI (1A) to "full package savings."

4 Use Option 3 for weatherization measures, and Option 2A for heat pump measures.

Option Guidelines w.r.t LMI

Program Delivery

Savings Reliability

Page 16: Goodbye, “Last Measure In” Hello, “Option X”?

16

Option 1A – LMI Status Quo

• Last measure in with all measures installed, except heating system known as a part of measure definition.– Separate attic insulation UES’s for a house with zonal heat and a

house with a heat pump.• Pro

– Simple– Familiar– Deals with heating system accurately for weatherization measures

• Con– Doesn’t deal well with uninsulated components’ interactions.– Doesn’t adhere to guidelines with respect to last measure in

• Assumes all measures are installed, not expected measures at EUL

Page 17: Goodbye, “Last Measure In” Hello, “Option X”?

17

Options OverviewID Description

1A LMI Status Quo. ?

1B LMI assuming 85% of cost-effective measures.

1C LMI with measure-specific saturations.

1D LMI on an annual basis.

2A Use Existing Conditions for each house.

2B Use Existing Conditions for RBSA houses.

3 Use Existing Conditions for RBSA houses (2B), but prorate savings using ratio of LMI (1A) to "full package savings."

4 Use Option 3 for weatherization measures, and Option 2A for heat pump measures.

Option Guidelines w.r.t LMI

Program Delivery

Savings Reliability

Page 18: Goodbye, “Last Measure In” Hello, “Option X”?

18

Option 1B – LMI assuming 85% of Cost Effective Measures

• Include all measures, including heating system, in last-measure in assumption at a rate of 85%.– One attic insulation UES, independent of existing heating system.

• Pro– Simple– Lines up with Council Planning Assumption– Attempts to line up with Guidelines with respect to last measure in

• Con– Assumed high penetration of heat pump conversions will cause a

large underestimate of actual saving if penetration is not achieved. – Doesn’t deal well with uninsulated components’ interactions.– Many Others

Page 19: Goodbye, “Last Measure In” Hello, “Option X”?

19

Options OverviewID Description

1A LMI Status Quo. ?

1B LMI assuming 85% of cost-effective measures.

1C LMI with measure-specific saturations.

1D LMI on an annual basis.

2A Use Existing Conditions for each house.

2B Use Existing Conditions for RBSA houses.

3 Use Existing Conditions for RBSA houses (2B), but prorate savings using ratio of LMI (1A) to "full package savings."

4 Use Option 3 for weatherization measures, and Option 2A for heat pump measures.

Option Guidelines w.r.t LMI

Program Delivery

Savings Reliability

Page 20: Goodbye, “Last Measure In” Hello, “Option X”?

20

Option 1C – LMI with Measure-specific Saturations

• Same as 1B, except estimate a saturation at end of measure’s EUL (different than 85%) for each measure component.

• Pro– Still simple– Lines up with Guidelines with respect to LMI.– Improves reliability (over 1B) of near-term savings by reducing error

caused by heat pump penetration assumption • Con

– Savings reliability is sensitive to the heat pump saturation estimate– Doesn’t deal well with uninsulated components’ interactions.– Still requires a forecast– What should the correct forecast period be?

• Guidelines currently say at end of measure life, but that could be revised.

Page 21: Goodbye, “Last Measure In” Hello, “Option X”?

21

Options OverviewID Description

1A LMI Status Quo. ?

1B LMI assuming 85% of cost-effective measures.

1C LMI with measure-specific saturations.

1D LMI on an annual basis.

2A Use Existing Conditions for each house.

2B Use Existing Conditions for RBSA houses.

3 Use Existing Conditions for RBSA houses (2B), but prorate savings using ratio of LMI (1A) to "full package savings."

4 Use Option 3 for weatherization measures, and Option 2A for heat pump measures.

Option Guidelines w.r.t LMI

Program Delivery

Savings Reliability

Page 22: Goodbye, “Last Measure In” Hello, “Option X”?

22

Option 1D – LMI on an Annual Basis • Like Option 1C, but each measure would have a saturation forecast curve.• This would allow unique savings to be calculated for each year of the

measure life.• Pro

– Still simple program delivery– Reasonable savings estimate accuracy each year (assuming forecast is correct)

• Further improves reliability (over 1c) of near-term savings by reducing error caused by heat pump penetration assumption

– Adheres to guidelines with respect to LMI• But, Which savings estimate would the RTF use?• 1st year, average over the EUL, end of EUL, something else?

– Deals with uninsulated components’ interactions.• Con

– Savings estimate accuracy depends on reliability of forecast– More involved analysis

Page 23: Goodbye, “Last Measure In” Hello, “Option X”?

23

Options OverviewID Description

1A LMI Status Quo. ?

1B LMI assuming 85% of cost-effective measures.

1C LMI with measure-specific saturations.

1D LMI on an annual basis.

2A Use Existing Conditions for each house.

2B Use Existing Conditions for RBSA houses.

3 Use Existing Conditions for RBSA houses (2B), but prorate savings using ratio of LMI (1A) to "full package savings."

4 Use Option 3 for weatherization measures, and Option 2A for heat pump measures.

Option Guidelines w.r.t LMI

Program Delivery

Savings Reliability

Page 24: Goodbye, “Last Measure In” Hello, “Option X”?

24

Option 2A – Existing Conditions for Each House

• Base savings on existing conditions at site.• Pro

– Savings are most accurate (average across all participants)• Eliminates any under counting and double-counting• Accurately deals with uninsulated measure interactions and heating systems.

– Lines up better with billing analyses, standard protocols, and custom measures• Con

– Very involved program delivery• Requires identification of detailed as-found conditions at house

– Requires many more UES values (or Standard Protocol) for each combination of existing conditions

– Data collection/reporting errors could be large– Doesn’t adhere to guidelines w.r.t. LMI

Page 25: Goodbye, “Last Measure In” Hello, “Option X”?

25

Options Overview

ID Description

1A LMI Status Quo. ?

1B LMI assuming 85% of cost-effective measures.

1C LMI with measure-specific saturations.

1D LMI on an annual basis.

2A Use Existing Conditions for each house.

2B Use Existing Conditions for RBSA houses.

3 Use Existing Conditions for RBSA houses (2B), but prorate savings using ratio of LMI (1A) to "full package savings."

4 Use Option 3 for weatherization measures, and Option 2A for heat pump measures.

Option Guidelines w.r.t LMI

Program Delivery

Savings Reliability

Page 26: Goodbye, “Last Measure In” Hello, “Option X”?

26

Option 2B – Existing Conditions for RBSA Houses

• Calculate savings for each relevant characteristic scenario in the RBSA dataset, take the weighted average.– Example Measure: Attic Insulation R-0 to R-38

• Filter RBSA dataset for houses with R-0 attic insulation• Determine percentage of houses with specific characteristic scenarios

– Example: » 5% have Zonal heat, Walls at R-0, Floors at R-0, etc.» 12% have Zonal heat, Walls at R-11, Floors at R-0, etc.» Etc.

• Pro– Does not impact program delivery– Savings fairly accurate because known distribution of starting points

• Con– Doesn’t deal with multiple measures installed simultaneously

• Heat pumps and weatherization– Component saturations need to be updated before they move too much

• Need new RBSA data. 5 year schedule adequate for Weatherization? heat pumps?– More involved analysis than status quo, many many measures and permutations.– Relies on Program house characteristics matching RBSA– Some data (infiltration, duct tightness) not available on each house– Doesn’t adhere to guidelines w.r.t. LMI

Page 27: Goodbye, “Last Measure In” Hello, “Option X”?

27

Options OverviewID Description

1A LMI Status Quo. ?

1B LMI assuming 85% of cost-effective measures.

1C LMI with measure-specific saturations.

1D LMI on an annual basis.

2A Use Existing Conditions for each house.

2B Use Existing Conditions for RBSA houses. ?

3 Use Existing Conditions for RBSA houses (2B), but prorate savings using ratio of LMI (1A) to "full package savings."

4 Use Option 3 for weatherization measures, and Option 2A for heat pump measures.

Option Guidelines w.r.t LMI

Program Delivery

Savings Reliability

Page 28: Goodbye, “Last Measure In” Hello, “Option X”?

28

Option 3 – Use Existing Conditions for RBSA houses (2B), but prorate measure savings using

ratio of LMI (1A) to “full package savings”

• Similar to Option 2B (Existing Conditions for RBSA Houses), except for within each characteristic scenario, calculate savings for the entire “full measure package” (all the way to Attic R-38, Wall R-11, Floor R-25, etc.), then prorate each measures’ LMI savings based on the ratio of the “LMI full measure package savings” to “actual full measure package savings”.

• Weatherization measures would be defined for each existing heating system type

Page 29: Goodbye, “Last Measure In” Hello, “Option X”?

29

Attic Wall Floor Window Infiltration Full Package2074 1444 571 804 507 5400

MeasureOption 3 Savings (Ratio X LMI for Attic R-0

Heating System

Attic Wall Floor Window InfiltrationEnergy Use

(Calibrated SEEM)

Characteristic Scenario Zonal R-0 R-0 R-0 u-0.5 0.55 ACHn 9616Full Measure Package Zonal R-38 R-11 R-25 u-0.22 0.35 ACHn 4215

"Actual" Full Measure Package Savings --> 5400

Attic Wall Floor Window Infiltration Full Package2529 1761 696 980 618 6584

Ratio: Actual/LMI --> 0.82

Last Measure In SavingsMeasure

Option 3: Explained With Numbers

Note: Only one Characteristic Scenario is shown here for simplicity. Instead, for each measure, the ratio “actual/LMI” would be determined for each applicable characteristic scenario and weighted according to its frequency of occurrence in the RBSA.

Note 2: Heat Pump conversion measures would be calculated in the same manner, but they would receive their own Actual/LMI ratio’s.

Page 30: Goodbye, “Last Measure In” Hello, “Option X”?

30

Option 3• Pro

– Deals with multiple measures installed at the same time, or over time.

– Early investigation by staff shows this should work well for weatherization measures with a known heating system

• Con– Difficult to explain– More complicated analysis

• New measures may require re-running analysis to develop new ratios– Accuracy can depend on how close houses get to the full

measure package.– Doesn’t adhere to guidelines w.r.t. LMI

Page 31: Goodbye, “Last Measure In” Hello, “Option X”?

31

Options Overview

ID Description

1A LMI Status Quo. ?

1B LMI assuming 85% of cost-effective measures.

1C LMI with measure-specific saturations.

1D LMI on an annual basis.

2A Use Existing Conditions for each house.

2B Use Existing Conditions for RBSA houses. ?

3 Use Existing Conditions for RBSA houses (2B), but prorate savings using ratio of LMI (1A) to "full package savings." ?

4 Use Option 3 for weatherization measures, and Option 2A for heat pump measures.

Option Guidelines w.r.t LMI

Program Delivery

Savings Reliability

Page 32: Goodbye, “Last Measure In” Hello, “Option X”?

32

Option 4 – Use Option 3 for weatherization measures, and Option 2A for heat pump measures

• For weatherization measures, with measure specification tied to existing heating system type:– Use Option 3 – Use Existing Conditions for RBSA houses (2B), but prorate savings using

ratio of LMI (1A) to “full package savings”• For heating system conversion measures:

– Use option 2A – Use existing conditions for each house.• Audit house at each site and use the audit data to calculate a house-specific savings value.

• Pro’s– Keeps weatherization program operation simple– Deals with multiple measures and interactions between measures– Keeps accurate heat pump savings

• Con’s– For weatherization, accuracy depends on definition of “full package”– For heat pumps, significant increase in program complexity

• Heat pump contractors are the likely ones to provide house insulation levels and other necessary characteristics (“necessary” would still need to be defined)

– Doesn’t adhere to guidelines w.r.t. LMI

Page 33: Goodbye, “Last Measure In” Hello, “Option X”?

33

Options Overview

ID Description

1A LMI Status Quo. ?

1B LMI assuming 85% of cost-effective measures.

1C LMI with measure-specific saturations.

1D LMI on an annual basis.

2A Use Existing Conditions for each house.

2B Use Existing Conditions for RBSA houses. ?

3 Use Existing Conditions for RBSA houses (2B), but prorate savings using ratio of LMI (1A) to "full package savings." ?

4 Use Option 3 for weatherization measures, and Option 2A for heat pump measures. ?

Option Guidelines w.r.t LMI

Program Delivery

Savings Reliability

Page 34: Goodbye, “Last Measure In” Hello, “Option X”?

34

Ok…

There’s no Perfect Solution

How do we assess reliability so we can pick the least imperfect Option?

(And once we do that, is it sufficiently reliable, or should we revert to program impact evaluation?)

Page 35: Goodbye, “Last Measure In” Hello, “Option X”?

35

Comparing Methods• Given:

– We know Options 3 and 4 won’t give us “Actual” savings every time.• Question:

– On average, how well will each option give us “actual” savings?• Problem:

– What is “average”? We don’t know:• which measures will be installed, and• which houses they’ll be installed in.

– Assumption• For the purposes of the Comparison exercise, let’s assume:• All possible measure combinations have an equal likelihood of being

installed.

Page 36: Goodbye, “Last Measure In” Hello, “Option X”?

36

Setting Up the Comparison• Each Characteristic Scenario,

has its own suite of possible measures, measure orders, and stopping points.

• For each possible measure installation order and stopping point, we can calculate the Ratio: Option’s Savings to “Actual” Savings.

• Then, we can generate a histogram of the results, for each option…

# HVAC Attic Wall Floor Window1 Zonal 19 11 11 0.5 9.9%2 Heat Pump 38 11 11 0.5 9.0%3 Zonal 38 11 11 0.5 8.5%4 Heat Pump 19 11 11 0.5 6.7%| | | | | | |

90 FAF none 11 Basement 0.5 0.1%91 FAF none none none 0.85 0.1%

RBSA Weight

Characteristic Scenario

Page 37: Goodbye, “Last Measure In” Hello, “Option X”?

37

Characteristic Scenario #1: Zonal, Attic R-19, Wall R-11, Floor R-11, Windows U-0.50

0%

5%

10%

15%

20%

25%

30%

35%

40%

< 0 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 1.1 1.2 1.3 1.4 1.5 1.6 1.7 1.8 1.9 > 2

Freq

uenc

y

Ratio: LMIstatus quo / "Actual" Savings

All possible stopping points, All possible measure installation orders, For this Scenario

Page 38: Goodbye, “Last Measure In” Hello, “Option X”?

38

Characteristic Scenario #1: Zonal, Attic R-19, Wall R-11, Floor R-11, Windows U-0.50

0%

5%

10%

15%

20%

25%

30%

35%

40%

< 0 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 1.1 1.2 1.3 1.4 1.5 1.6 1.7 1.8 1.9 > 2

Freq

uenc

y

Ratio: Option 3 / "Actual" Savings

All possible stopping points, All possible measure installation orders, For this Scenario

Page 39: Goodbye, “Last Measure In” Hello, “Option X”?

39

Characteristic Scenario #1: Zonal, Attic R-19, Wall R-11, Floor R-11, Windows U-0.50

0%

5%

10%

15%

20%

25%

30%

35%

40%

< 0 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 1.1 1.2 1.3 1.4 1.5 1.6 1.7 1.8 1.9 > 2

Freq

uenc

y

Ratio: Option 4 / "Actual" Savings

All possible stopping points, All possible measure installation orders, For this Scenario0.61

Page 40: Goodbye, “Last Measure In” Hello, “Option X”?

40

0%

5%

10%

15%

20%

25%

30%

35%

40%

< 0 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 1.1 1.2 1.3 1.4 1.5 1.6 1.7 1.8 1.9 > 2

Freq

uenc

y

Ratio: LMI / "Actual" Savings

All possible stopping points, All possible measure installation orders, For this Scenario

Average: 0.71

0%

5%

10%

15%

20%

25%

30%

35%

40%

< 0 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 1.1 1.2 1.3 1.4 1.5 1.6 1.7 1.8 1.9 > 2

Freq

uenc

y

Ratio: LMI / "Actual" Savings

All possible stopping points, All possible measure installation orders, For this Scenario

Average: 0.71

0%

5%

10%

15%

20%

25%

30%

35%

40%

< 0 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 1.1 1.2 1.3 1.4 1.5 1.6 1.7 1.8 1.9 > 2

Freq

uenc

y

Ratio: LMI / "Actual" Savings

All possible stopping points, All possible measure installation orders, For this Scenario

Average: 0.71

0%

5%

10%

15%

20%

25%

30%

35%

40%

< 0 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 1.1 1.2 1.3 1.4 1.5 1.6 1.7 1.8 1.9 > 2

Freq

uenc

y

Ratio: LMI / "Actual" Savings

All possible stopping points, All possible measure installation orders, For this Scenario

Average: 0.71

0%

5%

10%

15%

20%

25%

30%

35%

40%

< 0 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 1.1 1.2 1.3 1.4 1.5 1.6 1.7 1.8 1.9 > 2

Freq

uenc

y

Ratio: LMI / "Actual" Savings

All possible stopping points, All possible measure installation orders, For this Scenario

Average: 0.71

0%

5%

10%

15%

20%

25%

30%

35%

40%

< 0 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 1.1 1.2 1.3 1.4 1.5 1.6 1.7 1.8 1.9 > 2

Freq

uenc

y

Ratio: LMI / "Actual" Savings

All possible stopping points, All possible measure installation orders, For this Scenario

Average: 0.71

0%

5%

10%

15%

20%

25%

30%

35%

40%

< 0 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 1.1 1.2 1.3 1.4 1.5 1.6 1.7 1.8 1.9 > 2

Freq

uenc

y

Ratio: LMI / "Actual" Savings

All possible stopping points, All possible measure installation orders, For this Scenario

Average: 0.71

0%

5%

10%

15%

20%

25%

30%

35%

40%

< 0 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 1.1 1.2 1.3 1.4 1.5 1.6 1.7 1.8 1.9 > 2

Freq

uenc

y

Ratio: LMI / "Actual" Savings

All possible stopping points, All possible measure installation orders, For this Scenario

Average: 0.71

0%

5%

10%

15%

20%

25%

30%

35%

40%

< 0 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 1.1 1.2 1.3 1.4 1.5 1.6 1.7 1.8 1.9 > 2

Freq

uenc

y

Ratio: LMI / "Actual" Savings

All possible stopping points, All possible measure installation orders, For this Scenario

Average: 0.71

0%

5%

10%

15%

20%

25%

30%

35%

40%

< 0 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 1.1 1.2 1.3 1.4 1.5 1.6 1.7 1.8 1.9 > 2

Freq

uenc

y

Ratio: LMI / "Actual" Savings

All possible stopping points, All possible measure installation orders, For this Scenario

Average: 0.71

0%

5%

10%

15%

20%

25%

30%

35%

40%

< 0 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 1.1 1.2 1.3 1.4 1.5 1.6 1.7 1.8 1.9 > 2

Freq

uenc

y

Ratio: LMIstatus quo / "Actual" Savings

All possible stopping points, All possible measure installation orders, For this Scenario

We do this for each of the 91 Characteristic

Scenarios,

Apply the RBSA Weight for each

Scenario,

# HVAC Attic Wall Floor Window1 Zonal 19 11 11 0.5 9.9%2 Heat Pump 38 11 11 0.5 9.0%3 Zonal 38 11 11 0.5 8.5%4 Heat Pump 19 11 11 0.5 6.7%| | | | | | |

90 FAF none 11 Basement 0.5 0.1%91 FAF none none none 0.85 0.1%

RBSA Weight

Characteristic Scenario

And Generate the following Histograms…

0%

5%

10%

15%

20%

25%

30%

35%

40%

< 0 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 1.1 1.2 1.3 1.4 1.5 1.6 1.7 1.8 1.9 > 2

Freq

uenc

y

Ratio: Option 4 / "Actual" Savings

All possible stopping points, All possible measure installation orders, For this Scenario

Average: 0.99

0%

5%

10%

15%

20%

25%

30%

35%

40%

< 0 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 1.1 1.2 1.3 1.4 1.5 1.6 1.7 1.8 1.9 > 2

Freq

uenc

y

Ratio: Option 4 / "Actual" Savings

All possible stopping points, All possible measure installation orders, For this Scenario

Average: 0.99

0%

5%

10%

15%

20%

25%

30%

35%

40%

< 0 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 1.1 1.2 1.3 1.4 1.5 1.6 1.7 1.8 1.9 > 2

Freq

uenc

y

Ratio: Option 4 / "Actual" Savings

All possible stopping points, All possible measure installation orders, For this Scenario

Average: 0.99

0%

5%

10%

15%

20%

25%

30%

35%

40%

< 0 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 1.1 1.2 1.3 1.4 1.5 1.6 1.7 1.8 1.9 > 2

Freq

uenc

y

Ratio: Option 4 / "Actual" Savings

All possible stopping points, All possible measure installation orders, For this Scenario

Average: 0.99

0%

5%

10%

15%

20%

25%

30%

35%

40%

< 0 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 1.1 1.2 1.3 1.4 1.5 1.6 1.7 1.8 1.9 > 2

Freq

uenc

y

Ratio: Option 4 / "Actual" Savings

All possible stopping points, All possible measure installation orders, For this Scenario

Average: 0.99

0%

5%

10%

15%

20%

25%

30%

35%

40%

< 0 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 1.1 1.2 1.3 1.4 1.5 1.6 1.7 1.8 1.9 > 2

Freq

uenc

y

Ratio: Option 4 / "Actual" Savings

All possible stopping points, All possible measure installation orders, For this Scenario

Average: 0.99

0%

5%

10%

15%

20%

25%

30%

35%

40%

< 0 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 1.1 1.2 1.3 1.4 1.5 1.6 1.7 1.8 1.9 > 2

Freq

uenc

y

Ratio: Option 4 / "Actual" Savings

All possible stopping points, All possible measure installation orders, For this Scenario

Average: 0.99

0%

5%

10%

15%

20%

25%

30%

35%

40%

< 0 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 1.1 1.2 1.3 1.4 1.5 1.6 1.7 1.8 1.9 > 2

Freq

uenc

y

Ratio: Option 4 / "Actual" Savings

All possible stopping points, All possible measure installation orders, For this Scenario

Average: 0.99

0%

5%

10%

15%

20%

25%

30%

35%

40%

< 0 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 1.1 1.2 1.3 1.4 1.5 1.6 1.7 1.8 1.9 > 2

Freq

uenc

y

Ratio: Option 4 / "Actual" Savings

All possible stopping points, All possible measure installation orders, For this Scenario

Average: 0.99

0%

5%

10%

15%

20%

25%

30%

35%

40%

< 0 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 1.1 1.2 1.3 1.4 1.5 1.6 1.7 1.8 1.9 > 2

Freq

uenc

y

Ratio: Option 4 / "Actual" Savings

All possible stopping points, All possible measure installation orders, For this Scenario

Average: 0.99.

0%

5%

10%

15%

20%

25%

30%

35%

40%

< 0 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 1.1 1.2 1.3 1.4 1.5 1.6 1.7 1.8 1.9 > 2

Freq

uenc

y

Ratio: Option 3 / "Actual" Savings

All possible stopping points, All possible measure installation orders, For this Scenario

Average: 0.95

0%

5%

10%

15%

20%

25%

30%

35%

40%

< 0 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 1.1 1.2 1.3 1.4 1.5 1.6 1.7 1.8 1.9 > 2

Freq

uenc

y

Ratio: Option 3 / "Actual" Savings

All possible stopping points, All possible measure installation orders, For this Scenario

Average: 0.95

0%

5%

10%

15%

20%

25%

30%

35%

40%

< 0 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 1.1 1.2 1.3 1.4 1.5 1.6 1.7 1.8 1.9 > 2

Freq

uenc

y

Ratio: Option 3 / "Actual" Savings

All possible stopping points, All possible measure installation orders, For this Scenario

Average: 0.95

0%

5%

10%

15%

20%

25%

30%

35%

40%

< 0 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 1.1 1.2 1.3 1.4 1.5 1.6 1.7 1.8 1.9 > 2

Freq

uenc

y

Ratio: Option 3 / "Actual" Savings

All possible stopping points, All possible measure installation orders, For this Scenario

Average: 0.95

0%

5%

10%

15%

20%

25%

30%

35%

40%

< 0 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 1.1 1.2 1.3 1.4 1.5 1.6 1.7 1.8 1.9 > 2

Freq

uenc

y

Ratio: Option 3 / "Actual" Savings

All possible stopping points, All possible measure installation orders, For this Scenario

Average: 0.95

0%

5%

10%

15%

20%

25%

30%

35%

40%

< 0 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 1.1 1.2 1.3 1.4 1.5 1.6 1.7 1.8 1.9 > 2

Freq

uenc

y

Ratio: Option 3 / "Actual" Savings

All possible stopping points, All possible measure installation orders, For this Scenario

Average: 0.95

0%

5%

10%

15%

20%

25%

30%

35%

40%

< 0 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 1.1 1.2 1.3 1.4 1.5 1.6 1.7 1.8 1.9 > 2

Freq

uenc

y

Ratio: Option 3 / "Actual" Savings

All possible stopping points, All possible measure installation orders, For this Scenario

Average: 0.95

0%

5%

10%

15%

20%

25%

30%

35%

40%

< 0 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 1.1 1.2 1.3 1.4 1.5 1.6 1.7 1.8 1.9 > 2

Freq

uenc

y

Ratio: Option 3 / "Actual" Savings

All possible stopping points, All possible measure installation orders, For this Scenario

Average: 0.95

0%

5%

10%

15%

20%

25%

30%

35%

40%

< 0 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 1.1 1.2 1.3 1.4 1.5 1.6 1.7 1.8 1.9 > 2

Freq

uenc

y

Ratio: Option 3 / "Actual" Savings

All possible stopping points, All possible measure installation orders, For this Scenario

Average: 0.95

0%

5%

10%

15%

20%

25%

30%

35%

40%

< 0 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 1.1 1.2 1.3 1.4 1.5 1.6 1.7 1.8 1.9 > 2

Freq

uenc

y

Ratio: Option 3 / "Actual" Savings

All possible stopping points, All possible measure installation orders, For this Scenario

Average: 0.95.

Page 41: Goodbye, “Last Measure In” Hello, “Option X”?

41

0%

5%

10%

15%

20%

25%

30%

35%

40%

<0 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 1.1 1.2 1.3 1.4 1.5 1.6 1.7 1.8 1.9 >2

Freq

uenc

y

Ratio: LMIsq / "Actual" Savings

All Scenario's weighted to RBSA, All possible stopping points, All possible measure installation orders

Page 42: Goodbye, “Last Measure In” Hello, “Option X”?

42

0%

5%

10%

15%

20%

25%

30%

35%

40%

<0 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 1.1 1.2 1.3 1.4 1.5 1.6 1.7 1.8 1.9 >2

Freq

uenc

y

Ratio: Option 3 / "Actual" Savings

All Scenario's weighted to RBSA, All possible stopping points, All possible measure installation orders

Page 43: Goodbye, “Last Measure In” Hello, “Option X”?

43

0%

5%

10%

15%

20%

25%

30%

35%

40%

<0 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 1.1 1.2 1.3 1.4 1.5 1.6 1.7 1.8 1.9 >2

Freq

uenc

y

Ratio: Option 4 / "Actual" Savings

All Scenario's weighted to RBSA, All possible stopping points, All possible measure installation orders

Page 44: Goodbye, “Last Measure In” Hello, “Option X”?

44

0%

5%

10%

15%

20%

25%

30%

0 0.5 1 1.5 2

Freq

uenc

y

Ratio: Option Savings / "Actual" Savings

Options ComparedAll Scenario's weighted to RBSA, all possible stopping points and installation orders

Option 4Option 3LMIsq

Note: High and Low extremes have been cut off and are not included in the average (these are likely places where the “actual” savings are incorrect.

Weighted AveragesOption 4: 1.00Option 3: 0.98LMIsq: 0.96

Page 45: Goodbye, “Last Measure In” Hello, “Option X”?

45

Staff Recommendation• Option 3

– Reliable• While the comparison method is not perfect, it provides some confidence that Option 3 is likely

to provide reliable savings, on average.– Doable

• Program implementation will be mostly unchanged (“average heating system” case will be removed). (Early discussions imply Option 4 could be a deal-breaker for programs.)

• It requires more complicated analysis than LMIsq (Option 1A), but it’s probably worth the extra effort.

Option 1A – LMI Status QuoOption 1B – LMI assuming 85% of cost-effective measuresOption 1C – LMI with measure-specific saturationsOption 1D – LMI on an annual basisOption 2A – Use Existing Conditions for each houseOption 2B – Use Existing Conditions for RBSA housesOption 3 – Use Existing Conditions for RBSA houses (2B), but

prorate savings using ratio of LMI (1A) to “full package savings”

Option 4 – Use Option 3 for weatherization measures, and Option 2A for heat pump measures

Page 46: Goodbye, “Last Measure In” Hello, “Option X”?

46

Decision

“I __________ move the RTF use Option ___ in estimating savings for residential heating system and weatherization measures.”

Note: The guidelines are currently being reviewed. Today’s decision will be taken into consideration when proposing edits to the section of the guidelines that deals with last measure in.

Page 47: Goodbye, “Last Measure In” Hello, “Option X”?

47

Extra Slides

Page 48: Goodbye, “Last Measure In” Hello, “Option X”?

48

Measure Order

Now let’s change the measure order…

Measure Order-specific Calculator

MeasureHeating System

Attic Wall Floor Windows InfiltrationHeating Energy

(kWh/yr)Savings

(kwh/yr)Existing Condition Zonal 19 none 11 0.85 0.75 9263 n/aHeating System DHP 19 none 11 0.85 0.75 6534 2729Attic DHP 38 none 11 0.85 0.75 6173 361Windows DHP 38 none 11 0.22 0.75 4967 1206Wall DHP 38 11 11 0.22 0.75 3775 1192Floor DHP 38 11 25 0.22 0.75 3311 463Infiltration DHP 38 11 25 0.22 0.35 2471 840Total 6792

LMI Savings (kwh/yr)

n/a1744392126913394588406041

1344 sq.ft. prototype; Heating Zone 1

MeasureHeating System

Attic Wall Floor Windows InfiltrationHeating Energy

(kWh/yr)Savings

(kwh/yr)LMI Savings

(kwh/yr)Existing Condition Zonal 19 none 11 0.85 0.75 9263 n/a n/aWallAtticWindowsInfiltrationFloorHeating System

Zonal 19 11 11 0.85 0.75 8540 723 1339Zonal 38 11 11 0.85 0.75 8001 539 392Zonal 38 11 11 0.22 0.75 6182 1819 1269Zonal 38 11 11 0.22 0.35 4965 1217 840Zonal 38 11 25 0.22 0.35 4215 750 458DHP 38 11 25 0.22 0.35 2471 1744 1744

6792 6041Total

Page 49: Goodbye, “Last Measure In” Hello, “Option X”?

49

Sunday vs SEEM and LMI• Sunday said: A weatherization measure saves less when it’s installed in a

more efficient house.

– This made sense.• As the house gets more efficient, internal and solar gains meet a larger percentage

of its heating needs.

– This means LMI is always conservative

-

5,000

10,000

15,000

20,000

25,000

30,000

35,000

0 500 1000 1500

Annu

al H

eatin

g En

ergy

Use

House UA (Btu/°F/hr)

Sunday: 1350 sq ft Prototype in Portland

05

101520253035

0 500 1000 1500Annu

al E

nerg

y Sa

ving

s /

Chan

ge in

Hou

se U

A

House UA (Btu/°F/hr)

Slope

Page 50: Goodbye, “Last Measure In” Hello, “Option X”?

50

SEEM• Hourly simulation, models the effects of:

Solar gains, ground contact, crawlspace and attic buffer spaces, thermal mass, infiltration, radiant heat transfer, and duct leakage.

Input:.

Output: Heating Energy Use

Sunday SEEM

Page 51: Goodbye, “Last Measure In” Hello, “Option X”?

51

Let’s Compare• Sunday: (again)

• SEEM: “Last Measure In” is no longer predictably conservative.

-

5,000

10,000

15,000

20,000

25,000

30,000

35,000

0 500 1000 1500

Annu

al H

eatin

g En

ergy

Use

House UA (Btu/°F/hr)

Sunday: 1350 sq ft Prototype in Portland

05

101520253035

0 500 1000 1500Annu

al E

nerg

y Sa

ving

s /

Chan

ge in

Hou

se U

A

House UA (Btu/°F/hr)

Slope