Evaluation of the 2002-2005 Center for Irrigation Technology’s Agricultural Pumping Efficiency Program

Presentation for the MAESTRO/CALMAC Evaluation ShowcaseEquipoise Consulting Inc.

Pacific Energy Center, San Francisco, CAJuly 26, 2006

2

Program Description

Two objectives of APEP were: Get highly efficient pumping systems in place. Manage those systems properly.

In all IOU service territories in 2002/03. Not in SDG&E in 2004/05

Agricultural Pumping Efficiency Program

Subsidies orIncentives Education Technical

Support

Pump Tests

Pump Retrofit /Repair

Mobile EnergyCenters

Facility Improvement

Pump Test Software /Internet

Printed Material

Agricultural Pumping Efficiency Program

Subsidies orIncentives Education Technical

Support

Pump Tests

Pump Retrofit /Repair

Mobile EnergyCenters

Facility Improvement

Pump Test Software /Internet

Printed Material

3

Evaluation Description Evaluation completed by Equipoise Consulting Inc.,

Ridge & Associates, Vanward Consulting, and California AgQuest Consulting Inc.

2002/2003 Energy Impact evaluation Program theory assessment Process evaluation Assessment of relationships between APEP and other

entities 2004/2005

Program Design assessment for flow meters as a potential energy saving measure in this sector

Energy Impact evaluation

4

Program Logic Models

MEC Travels toVarious Sites and

makesPresentation

Customer CallsCIT

CIT AnswersQuestions onProgram &

General TechnicalQuestions

CustomerReferred to Pump

Test Company

CustomerProvided RebateApplication Form

for Pump Repair &Help if Needed in

Filling it Out

Outreach to Customer viaArea Coordinators, Trade

Allies, AgriculturalOrganizations, CIT WebSite, Trade Publications,

or Local Newspaper

CustomerContacts Pump

Test Company andhas Pump Tested

Pump is repairedby pump company

of customerschoice.

Pump is re-testedafter repair

Customer ObtainsRebate for Repair

based onappropriate criteria

Pump TestCompany providedwith cost buy down

by Program

Customer obtains PumpTest Company name from

Website

ProgramDevelops

Mobile EnergyCenters (MEC)

ProgramDevelops Web

site and Printedmaterial

Enhancementof Hydraulics

Lab at CIT

Education andTraining

Finalization ofDemonstrationFacility at CSU-

Chico

Enhancementof Mobile

Irrigation Labs

APEP Implementation Theory as of June 2004

KEY

Services Available toAll Customers inPG&E, SCE, andSoCalGas service

territories

Services notavailable in SCEservice territory

Customer providedprinted material or

direction towebsite

Economic Analysisand Education on

Pump Test Results

Interactionsand Synergieswith multiplegovernment,

non-profit, andother agencies

Services that SCECustomers may

use that are not inSCE service

territory

1 2

3

45

6

7

8

9

10

11

12

13

14

15

16 17

18 19 20

21

22

23

24

Area CoordinatorsEnlist Trade Allies

25

Program Actions

2

Linkpreviouslyassessed

Highlighted numbers were assessed in the 2002/2003 evaluation.

5

Program Logic Models

CIT ContactsCustomer through

Various Means

Customer Responds to CITContact

IncreasesAwareness of

Efficient Practices

IncreasesKnowledge of

Efficient Practices

Decides toTest Pump and/or

Change Irrigation Practices

CustomerContinues on withCurrent Practices(efficient or not

efficient)

CustomerRequests Pump

Test

Customer BelievesResults of PumpTest and FindsResults Easy to

Understand

Customer Repairs PumpEither Because of PumpRepair Incentive or for

Other Reason(s)

Reduction in kWhseen by Pump

CustomerChanges Irrigation

Practices

No Change atPump

IncreasesAwareness of

Potential Problems

CIT ProvidesFinancialIncentives

APEP Program Theory as of June 2004

Marketing fromtrade allies

Repairing PumpCould Improve

Efficiency &Economics Are

Attractive

No

Yes

PumpTest CompanyConducts Pump Test

According toEstablished Procedures

No

Yes Yes

1

2

3

4

5

6 7

8

9

10

11

12

1314

15

16

17

No

18

Yes

19

2021

KEY

Linkpreviouslyassessed

2

Highlighted numbers were assessed in the 2002/2003 evaluation.

6

Evaluation Data Collection

Collection Type N2002/2003

N 2004/2005

Telephone Survey 396 250

Onsite Audit of MEC 12 0

In-depth Interviews 9 0

Database Verification 3 2

7

Evaluation Results – 2002/2003 Successful at reaching smaller, family-owned businesses. Analysis showed that information from the economic analysis of

the pump, the APEP seminars, or MEC demonstrations all had a positive impact on the likelihood that someone will make a change to their pumping system.

Process evaluation developed a picture of an exceptionally well-run program that appropriately staffed positions, established good communication, developed and clearly communicated the program goals to staff and contractors, tracked progress against those goals and communicated that progress to staff. Participants showed high levels of satisfaction with their program interactions and trade allies felt that the program was doing a good job overall.

8

Evaluation Results – 2004/2005 Premature to recommend that a full educational component focusing on

flow meters be added to the APEP (or any other agricultural program) or to provide incentives for the purchase of flow meter. However, some flow meter education should be provided.

Flow meter evaluation indicated the following areas to stress during education efforts: Installation of flow meters can reduce operating costs. This is particularly

important since cost is one of the major barriers to the installation of flow meters and reduced operating costs can help to reduce the payback on such a purchase.

There are a large number of behavioral and hardware changes that can be better informed using information provided by flow meters.

Because water use appears to be a more important factor than energy use in the decision to install flow meters, stressing in these educational materials the reduction of water use is recommended.

9

Evaluation Results – 2002/2005

N Pump Tests Net Annual MWh Impact

Net Annual Therm Impact

2002 /2003

6,193 (124% of goal)

9,762(95% of goal)

186,637(137% of goal)

2004 /2005

1,513 (76% of goal)

4,797(69% of goal)

85,959 (150% of goal)

10

Final Note The evaluation reports (4 files) can be found

on the CALMAC website (www.CALMAC.org) Perform a custom search using “Center for

Irrigation Technology” as the implementer You can reach the evaluator at

Mary@EquipoiseConsulting.com

11

Attachment 1 – picture of one of two mobile energy centers created by APEP

12

Attachment 2 – picture of a set up of a mobile energy center