Smart Evaluation: Incorporating Evaluation in Program Design, & Showing Contractors the Benefits...
-
Upload
nelson-dorsey -
Category
Documents
-
view
214 -
download
1
Transcript of Smart Evaluation: Incorporating Evaluation in Program Design, & Showing Contractors the Benefits...
![Page 1: Smart Evaluation: Incorporating Evaluation in Program Design, & Showing Contractors the Benefits Kathy Greely Program Manager, PA Home Energy Performance.](https://reader031.fdocuments.in/reader031/viewer/2022032707/56649e2d5503460f94b1c7cb/html5/thumbnails/1.jpg)
Smart Evaluation:Incorporating Evaluation in Program Design, &
Showing Contractors the Benefits
Kathy GreelyProgram Manager, PA Home EnergyPerformance Systems Development
![Page 2: Smart Evaluation: Incorporating Evaluation in Program Design, & Showing Contractors the Benefits Kathy Greely Program Manager, PA Home Energy Performance.](https://reader031.fdocuments.in/reader031/viewer/2022032707/56649e2d5503460f94b1c7cb/html5/thumbnails/2.jpg)
PA Home Energy• HPwES and ESQH• Infrastructure Development
– More auditors/raters– Dual RESNET/BPI certification
• Financing & Incentives– Keystone HELP loans– Performance-based (WPP)
• Consumer Marketing– Benefits of whole-house approach– Contractor differentiation– ENERGY STAR link
www.pahomeenergy.org
![Page 3: Smart Evaluation: Incorporating Evaluation in Program Design, & Showing Contractors the Benefits Kathy Greely Program Manager, PA Home Energy Performance.](https://reader031.fdocuments.in/reader031/viewer/2022032707/56649e2d5503460f94b1c7cb/html5/thumbnails/3.jpg)
Starting from Zero
August '07
October '07
February '08April '0
8May '08
August '08
October '08
December '08March '09
May '09
September '09
December '09March '10
0
20
40
60
80
100
120
140
160
RESNET/BPI Certified Individuals in PA(through PA Home Energy)
RESNET - Certified Raters
BPI - Certified Building Analysts
Service Providers
Nu
mb
er
of
Ind
ivid
uals
![Page 4: Smart Evaluation: Incorporating Evaluation in Program Design, & Showing Contractors the Benefits Kathy Greely Program Manager, PA Home Energy Performance.](https://reader031.fdocuments.in/reader031/viewer/2022032707/56649e2d5503460f94b1c7cb/html5/thumbnails/4.jpg)
Home Performance with ENERGY STAR
• Whole house energy improvement process– Diagnostic Audit– Report to the customer
• Modeled savings (optional)
– Installation– Test out
![Page 5: Smart Evaluation: Incorporating Evaluation in Program Design, & Showing Contractors the Benefits Kathy Greely Program Manager, PA Home Energy Performance.](https://reader031.fdocuments.in/reader031/viewer/2022032707/56649e2d5503460f94b1c7cb/html5/thumbnails/5.jpg)
Growth in Reported JobsHome Performance with ENERGY STAR• 623 audits, plus• 172 completed home performance jobs
HomeWorks (Lisbet Searle-White)
![Page 6: Smart Evaluation: Incorporating Evaluation in Program Design, & Showing Contractors the Benefits Kathy Greely Program Manager, PA Home Energy Performance.](https://reader031.fdocuments.in/reader031/viewer/2022032707/56649e2d5503460f94b1c7cb/html5/thumbnails/6.jpg)
Program Features• Young (< 3 years)• Relatively low budget• Not utility funded, but may be• Wide geographic range
![Page 7: Smart Evaluation: Incorporating Evaluation in Program Design, & Showing Contractors the Benefits Kathy Greely Program Manager, PA Home Energy Performance.](https://reader031.fdocuments.in/reader031/viewer/2022032707/56649e2d5503460f94b1c7cb/html5/thumbnails/7.jpg)
More Program Features
• Performance-based incentives (limited territory)– Based on modeled savings, trued up to bills– Little money to incent reporting otherwise
• Emphasis on billing data– Benchmarking– Disaggregation (true up/improvement opportunities)
• No evaluation funds, but some built in features
![Page 8: Smart Evaluation: Incorporating Evaluation in Program Design, & Showing Contractors the Benefits Kathy Greely Program Manager, PA Home Energy Performance.](https://reader031.fdocuments.in/reader031/viewer/2022032707/56649e2d5503460f94b1c7cb/html5/thumbnails/8.jpg)
Training• Focus on trainees who can succeed
![Page 9: Smart Evaluation: Incorporating Evaluation in Program Design, & Showing Contractors the Benefits Kathy Greely Program Manager, PA Home Energy Performance.](https://reader031.fdocuments.in/reader031/viewer/2022032707/56649e2d5503460f94b1c7cb/html5/thumbnails/9.jpg)
Evaluation: Customer Feedback
![Page 10: Smart Evaluation: Incorporating Evaluation in Program Design, & Showing Contractors the Benefits Kathy Greely Program Manager, PA Home Energy Performance.](https://reader031.fdocuments.in/reader031/viewer/2022032707/56649e2d5503460f94b1c7cb/html5/thumbnails/10.jpg)
Obtaining Utility Bills?
![Page 11: Smart Evaluation: Incorporating Evaluation in Program Design, & Showing Contractors the Benefits Kathy Greely Program Manager, PA Home Energy Performance.](https://reader031.fdocuments.in/reader031/viewer/2022032707/56649e2d5503460f94b1c7cb/html5/thumbnails/11.jpg)
Obtaining Utility Bills?
![Page 12: Smart Evaluation: Incorporating Evaluation in Program Design, & Showing Contractors the Benefits Kathy Greely Program Manager, PA Home Energy Performance.](https://reader031.fdocuments.in/reader031/viewer/2022032707/56649e2d5503460f94b1c7cb/html5/thumbnails/12.jpg)
File Review, by Contractor
• Savings:– Too low?– Unrealistically high?
• Whole-house scope?• Combustion testing?
![Page 13: Smart Evaluation: Incorporating Evaluation in Program Design, & Showing Contractors the Benefits Kathy Greely Program Manager, PA Home Energy Performance.](https://reader031.fdocuments.in/reader031/viewer/2022032707/56649e2d5503460f94b1c7cb/html5/thumbnails/13.jpg)
Field QA: Front-Line Evaluation
What are we looking for?Home performance jobs:• Heath & Safety issues• Combustion Safety compliance• Infiltration verification• Installation inspection• Missed opportunities
Common problem areas• CAZ depressurization• Ducts outside the envelope
![Page 14: Smart Evaluation: Incorporating Evaluation in Program Design, & Showing Contractors the Benefits Kathy Greely Program Manager, PA Home Energy Performance.](https://reader031.fdocuments.in/reader031/viewer/2022032707/56649e2d5503460f94b1c7cb/html5/thumbnails/14.jpg)
Getting Contractors to Report
• Balance reporting quality and quantity– Too much information means less reporting
• Competition valuable
AWARDS
![Page 15: Smart Evaluation: Incorporating Evaluation in Program Design, & Showing Contractors the Benefits Kathy Greely Program Manager, PA Home Energy Performance.](https://reader031.fdocuments.in/reader031/viewer/2022032707/56649e2d5503460f94b1c7cb/html5/thumbnails/15.jpg)
Deep SaversHome Performance with ENERGY STAR:• Rhett Major, Billeck Home, 71% savings
• GSHP• Air sealing• Insulation• Windows• Ventilation
![Page 16: Smart Evaluation: Incorporating Evaluation in Program Design, & Showing Contractors the Benefits Kathy Greely Program Manager, PA Home Energy Performance.](https://reader031.fdocuments.in/reader031/viewer/2022032707/56649e2d5503460f94b1c7cb/html5/thumbnails/16.jpg)
Getting Contractors to Report
• Reporting must be easy (especially with small/variable incentives)
• Reporting must be useful to contractor– Customer feedback, file management, tracking
• Paper/fax/email to on-line reporting– Less suffering, greater results– Benefit to participants
![Page 18: Smart Evaluation: Incorporating Evaluation in Program Design, & Showing Contractors the Benefits Kathy Greely Program Manager, PA Home Energy Performance.](https://reader031.fdocuments.in/reader031/viewer/2022032707/56649e2d5503460f94b1c7cb/html5/thumbnails/18.jpg)
Green Energy Compass is …
• An online benchmarking and tracking tool for single-family residential homes
• Sold as Software-As-A-Service, meaning there is nothing to download or install and the application is always up to date (free to PAHE)
• Designed to support the entire residential energy retrofit process
![Page 19: Smart Evaluation: Incorporating Evaluation in Program Design, & Showing Contractors the Benefits Kathy Greely Program Manager, PA Home Energy Performance.](https://reader031.fdocuments.in/reader031/viewer/2022032707/56649e2d5503460f94b1c7cb/html5/thumbnails/19.jpg)
Useful to Contractors for…
• Client education and benchmarking (pre-audit)
• Disaggregation for model true-up (audit)• Feedback to clients (post HP)• File management (audit/HP/test-out)• Program reporting (value, not burden)
![Page 20: Smart Evaluation: Incorporating Evaluation in Program Design, & Showing Contractors the Benefits Kathy Greely Program Manager, PA Home Energy Performance.](https://reader031.fdocuments.in/reader031/viewer/2022032707/56649e2d5503460f94b1c7cb/html5/thumbnails/20.jpg)
Green Energy Compass
Green Energy Compass provides a central hub for collecting and
disbursing information to all interested parties including contractors, programs, and
financial institutions
![Page 21: Smart Evaluation: Incorporating Evaluation in Program Design, & Showing Contractors the Benefits Kathy Greely Program Manager, PA Home Energy Performance.](https://reader031.fdocuments.in/reader031/viewer/2022032707/56649e2d5503460f94b1c7cb/html5/thumbnails/21.jpg)
Green Energy Compass answers your questions
How much $ could I save?
How does this home compare to
similar homes?How much did I actually save?
How is this home using
energy?
How can I keep track of all my documents?
Can this home qualify for an energy
efficient loan?
![Page 22: Smart Evaluation: Incorporating Evaluation in Program Design, & Showing Contractors the Benefits Kathy Greely Program Manager, PA Home Energy Performance.](https://reader031.fdocuments.in/reader031/viewer/2022032707/56649e2d5503460f94b1c7cb/html5/thumbnails/22.jpg)
Energy Usage ReportHow does
home compare to
national average?
What is biggest use of energy in home?
What is costing the
most for energy?
How much can the homeowner
spend on improvements?
What is biggest use of energy in the home?
Model true-up
info
![Page 23: Smart Evaluation: Incorporating Evaluation in Program Design, & Showing Contractors the Benefits Kathy Greely Program Manager, PA Home Energy Performance.](https://reader031.fdocuments.in/reader031/viewer/2022032707/56649e2d5503460f94b1c7cb/html5/thumbnails/23.jpg)
Peer Comparison ReportTotal Energy comparison yields first
level analysis.
But comparison of end use shows
that totals were masking a heating
improvement opportunity.
![Page 24: Smart Evaluation: Incorporating Evaluation in Program Design, & Showing Contractors the Benefits Kathy Greely Program Manager, PA Home Energy Performance.](https://reader031.fdocuments.in/reader031/viewer/2022032707/56649e2d5503460f94b1c7cb/html5/thumbnails/24.jpg)
Improvement SummaryBasic
information about the audit and test-out
Files from contractor to
support program QA
List of improvements and proposed
savings
Three stage process to
capture information
Free notes allow easy communication
between contractor and program
![Page 25: Smart Evaluation: Incorporating Evaluation in Program Design, & Showing Contractors the Benefits Kathy Greely Program Manager, PA Home Energy Performance.](https://reader031.fdocuments.in/reader031/viewer/2022032707/56649e2d5503460f94b1c7cb/html5/thumbnails/25.jpg)
Configure Energy Savings Report
The type of report controls what inputs are required
Easily set the baseline period based on actual meter data
![Page 26: Smart Evaluation: Incorporating Evaluation in Program Design, & Showing Contractors the Benefits Kathy Greely Program Manager, PA Home Energy Performance.](https://reader031.fdocuments.in/reader031/viewer/2022032707/56649e2d5503460f94b1c7cb/html5/thumbnails/26.jpg)
Energy Savings Report
![Page 27: Smart Evaluation: Incorporating Evaluation in Program Design, & Showing Contractors the Benefits Kathy Greely Program Manager, PA Home Energy Performance.](https://reader031.fdocuments.in/reader031/viewer/2022032707/56649e2d5503460f94b1c7cb/html5/thumbnails/27.jpg)
Dashboard – Peer comparison for Contractors