Behavioral Energy Savings: Going Beyond Resource ...effort, California’s Flex Your Power (FYP)...

1
www.opiniondynamics.com Behavioral Energy Savings: Going Beyond Resource Acquisition Programs Evaluate the relative effects of social marketing while accounting for other variables that drive behaviors Examine how website browsers use online tools to gain information and to take action In the evolving social marketing world, online campaigns can reach targeted populations in a more cost-effective way. Web Statistics analysis allows us to quantify the success of online program efforts. We can track referrals, click-thrus and browsing behaviors of website visitors. We can then generate a comprehensive map of visitor online behaviors. FINDINGS 38% of website browsers are visiting the residential pages 98% of browsers are clicking-thru to other linked sites to take action Improve program implementation by identifying the strength, value, and role of individual actors and organizations Social Network Analysis is a techique used to assess the overall level of network connectedness, the importance of individual actors, and the presence of communication channels. The Opinion Dynamics team utilizes this method to gain insights into program structure, meetings, and organization to enhance and facilitate efficient and effective social marketing program implementation. FINDINGS Implementers are sufficiently networked to effectively execute program marketing and outreach objectives Leadership needs to be strengthened to ensure program objectives align with regulatory goals Central network players must be utilized to maintain the strength of the network Assess the efficacy of statewide events in gaining reach and providing depth of information Determine the actual reach of program messaging and examine the recall and behaviors of those exposed Verified Reach Technology is an innovative approach that allows us to know exactly how many times panelists were exposed to a social marketing radio or TV advertisement. We then follow up with these panelists via telephone and ask about their recall of the messages and whether they have taken any action. This method allows us to avoid relying on self-reported information for assessing awareness and recall of messages. Although limited by the number of panel respondents, it provides us with a window into the actual behavioral success of a social marketing effort. FINDINGS 83% of panelists (all based in or near Los Angeles) were exposed to at least one Flex Your Power radio or TV advertisement The program appears to be effectively reaching its stated age targets 74% of those exposed to at least one Flex Your Power advertisement recalled the ads Structural Equation Modeling (SEM) Web Statistics Analysis Social Network Analysis Dissemination Analysis and Ethnographic Observations Verified Reach Technology using Exciting New Methods About the Flex Your Power Evaluation The California Public Utilities Commission (CPUC) is funding a multi-million dollar evaluation of the Flex Your Power program, which utilizes mass media advertisements and other non-media efforts to help consumers understand the relationship between household energy use and global warming. Behaviors promoted by the program include the adoption of compact fluorescent lamps (CFLs), energy efficient appliances, heating, and cooling systems. Opinion Dynamics has been charged with assessing the energy- savings impact of the Flex Your Power program to determine its relevance in, and impact on, the California market. In other words, what influence does this social marketing effort have on Cali- fornians’ energy habits? 1 6 8 10 13 9 12 18 19 15 20 22 16 17 26 21 23 24 25 11 14 Past Participation in Utility Programs Non-Flex Your Power Messages Friends/Family Use of CFLs Flex Your Power Messages Participation in IOU Program(s) Called 800# or went to web site Socio-Economic Status CFL Purchase Belief that Energy Efficiency is a Movement Concern about Global Warming Intention to Act Orientation to Saving $ Price Signal Sense of Immediacy Personal Barriers 2 7 4 5 3 Concern about Energy Efficiency Product-Related Barriers Opinion Dynamics Corporation is a leader in providing market research and evaluation of non resource allocation programs. Whether formulating marketing messages upfront, or evaluating the effectiveness of a program after its launch, Opinion Dynamics brings a wealth of experience to any marketing effort. Opinion Dynamics has worked on a range of issues from health to recycling, with a specialty in providing upfront market research and comprehensive evaluations of energy efficiency and conservation efforts. Opinion Dynamics is currently conducting the largest evaluation ever conducted for an energy efficiency social marketing effort, California’s Flex Your Power (FYP) campaign. Other 1-5 Exhibits 1-15 Presentations 1-45 San Francisco Sacramento Los Angeles This method allows us to tease out effects of a particular effort when many other influences may also be at play. This is of greatest use when several similar but distinct efforts are being conducted at the same time. For instance, many organizations have recently developed global warming social marketing campaigns—SEM allows us to isolate the unique effects of one campaign. This statistical technique is used to test and estimate causal relationships using a combination of statistical data and qualitative causal assumptions. This analysis allows the Opinion Dynamics team to conduct a comprehensive and thorough analysis of factors that drive behaviors. FINDINGS 50% of the variance in consumer behavior intention was predicted by personal barriers, product barriers, and friends and families’ use of CFLs This method allows us to understand the depth and breadth of a non resource allocation program, and provides the program implementer with an unadulterated view of program reach. Used as a two-pronged method, we map and quantify the geographic dispersion of information and the number of potential individuals “touched” by this information. Ethnographic observations provide in-depth qualitative findings to better illustrate the efficacy of information transmission at each event. FINDINGS In 2006 and 2007 the program touched 984,060 rural residents Events draw on regional knowledge to communicate program information in a manner that is relevant to its audience Nov 2006 Dec 2006 Jan 2007 Feb 2007 Mar 2007 Apr 2007 May 2007 Jun 2007 Jul 2007 Aug 2007 Sep 2007 Oct 2007 Nov 2007 Dec 2007 100% 90% 80% 70% 60% 50% 40% 30% 20% 10% 0% CAMPAIGN TO DATE COVERAGE Ages 35-54 Ages 25-34 Female Male Overall Organization J Organization I Organization K Organization L Organization A Organization B Organization C Organization E Organization D Organization G Organization F Organization H Less than monthly Monthly Weekly Daily Approximately 10,000 sites referred visitors to Flex Your Power (top 200 sites brought in 86% of visitors) People were referred to the site 870,445 times Close to 3 million visits in 2006 & 2007 (1.1 million in 2006 & 1.8 million in 2007) • 64% of all referrals from search engines • Flex Your Power most used search term • TV/Radio station sites brought in 3 times more visitors than paid sites, mostly due to buys through m2omedia • Daily visits to the website increased by 33% during campaign seasons • Amongst the top 45 most viewed pages: Residential pages - 38% Homepage - 30% Commercial pages - 11% Energy news pages - 8% Rest of pages - 13% • Rebate, service and incentive pages were viewed 123,053 times with 91% of those targeting residential consumers Sites Sending People to Flex Your Power Flex Your Power Website Sites Where People go from Flex Your Power Viewers went to 614 sites from Flex Your Power Of the top 50 click-throughs to external sites: • 64% were to IOU and third party demand side management groups • 34% were to tax incentive sites People went to an external site 112,275 times

Transcript of Behavioral Energy Savings: Going Beyond Resource ...effort, California’s Flex Your Power (FYP)...

Page 1: Behavioral Energy Savings: Going Beyond Resource ...effort, California’s Flex Your Power (FYP) campaign. Other 1-5 Exhibits 1-15 Presentations 1-45 San Francisco Sacramento Los Angeles

www.opiniondynamics.com

Behavioral EnergySavings: Going

Beyond Resource Acquisition Programs

Evaluate the relative effects of social marketing while accounting for other variables that drive behaviors

Examine how website browsers use online tools to gain information and to take action

In the evolving social marketing world, online campaigns can reach targeted populations in a more cost-effective way. Web Statistics analysis allows us to quantify the success of online program efforts. We can track referrals, click-thrus and browsing behaviors of website visitors. We can then generate a comprehensive map of visitor online behaviors.

FINDINGS

38% of website browsers are visiting the residential pages

98% of browsers are clicking-thru to other linked sites to take action

Improve program implementation by identifying the strength, value, and role of individual actors and organizations

Social Network Analysis is a techique used to assess the overall level of network connectedness, the importance of individual actors, and the presence of communication channels. The Opinion Dynamics team utilizes this method to gain insights into program structure, meetings, and organization to enhance and facilitate efficient and effective social marketing program implementation.

FINDINGS

Implementers are sufficiently networked to effectively execute program marketing and outreach objectives

Leadership needs to be strengthened to ensure program objectives align with regulatory goals

Central network players must be utilized to maintain the strength of the network

Assess the efficacy of statewide events in gaining reach and

providing depth of information

Determine the actual reach of program messaging and examine the recall

and behaviors of those exposed

Verified Reach Technology is an innovative approach that allows us to know exactly how many times panelists were exposed to a social marketing radio or TV advertisement. We then follow up with these panelists via telephone and ask about their recall of the messages and whether they have taken any action. This method allows us to avoid relying on self-reported information for assessing awareness and recall of messages. Although limited by the number of panel respondents, it provides us with a window into the actual behavioral success of a social marketing effort.

FINDINGS

83% of panelists (all based in or near Los Angeles) were exposed to at least one Flex Your Power radio or TV advertisement

The program appears to be effectively reaching its stated age targets

74% of those exposed to at least one Flex Your Power advertisement recalled the ads

Structural Equation Modeling (SEM) Web Statistics Analysis

Social Network Analysis Dissemination Analysis and Ethnographic Observations Verified Reach Technology using Exciting New Methods

About the Flex Your Power EvaluationThe California Public Utilities Commission (CPUC) is funding a multi-million dollar evaluation of the Flex Your Power program, which utilizes mass media advertisements and other non-media efforts to help consumers understand the relationship between household energy use and global warming. Behaviors promoted by the program include the adoption of compact fluorescent lamps (CFLs), energy efficient appliances, heating, and cooling systems.

Opinion Dynamics has been charged with assessing the energy- savings impact of the Flex Your Power program to determine its relevance in, and impact on, the California market. In other words, what influence does this social marketing effort have on Cali-fornians’ energy habits?

����������������������������������������

1

6

8

1013

9

12

18

19

15

20

22

16

17

26

21

23

24

25

11

14

Past Participation inUtility Programs

Non-Flex YourPower Messages

Friends/FamilyUse of CFLs

Flex Your PowerMessages

Participationin IOU Program(s)

Called 800# orwent to web site

Socio-EconomicStatus

CFL Purchase

Belief thatEnergy Efficiencyis a Movement

Concern aboutGlobal Warming

Intentionto Act

Orientation toSaving $

Price Signal

Sense ofImmediacy

Personal Barriers

2

7

45

3

Concern aboutEnergy Efficiency

Product-RelatedBarriers

Opinion Dynamics Corporation is a leader in providing market research and evaluation of non resource allocation programs. Whether formulating marketing messages upfront, or evaluating the effectiveness of a program after its launch, Opinion Dynamics brings a wealth of experience to any marketing effort. Opinion Dynamics has worked on a range of issues from health to recycling, with a specialty in providing upfront market research and comprehensive evaluations of energy efficiency and conservation efforts. Opinion Dynamics is currently conducting the largest evaluation ever conducted for an energy efficiency social marketing effort, California’s Flex Your Power (FYP) campaign.

Other 1-5Exhibits 1-15Presentations 1-45

San Francisco

Sacramento

Los Angeles

This method allows us to tease out effects of a particular effort when many other influences may also be at play. This is of greatest use when several similar but distinct efforts are being conducted at the same time. For instance, many organizations have recently developed global warming social marketing campaigns—SEM allows us to isolate the unique effects of one campaign. This statistical technique is used to test and estimate causal relationships using a combination of statistical data and qualitative causal assumptions. This analysis allows the Opinion Dynamics team to conduct a comprehensive and thorough analysis of factors that drive behaviors.

FINDINGS

50% of the variance in consumer behavior intention was predicted by personal barriers, product barriers, and friends and families’ use of CFLs

This method allows us to understand the depth and breadth of a non resource allocation program, and provides the program implementer with an unadulterated view of program reach. Used as a two-pronged method, we map and quantify the geographic dispersion of information and the number of potential individuals “touched” by this information. Ethnographic observations provide in-depth qualitative findings to better illustrate the efficacy of information transmission at each event.

FINDINGS

In 2006 and 2007 the program touched 984,060 rural residents

Events draw on regional knowledge to communicate program information in a manner that is relevant to its audience

Nov2006

Dec2006

Jan2007

Feb2007

Mar2007

Apr2007

May2007

Jun2007

Jul2007

Aug2007

Sep2007

Oct2007

Nov2007

Dec2007

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

CAMPAIGN TO DATE

COVE

RAGE

Ages 35-54Ages 25-34FemaleMaleOverall

Organization JOrganization IOrganization K

Organization L

Organization AOrganization B

Organization C

Organization E

Organization D

Organization G

Organization F

Organization H

Less thanmonthly

MonthlyWeeklyDaily

Approximately 10,000 sitesreferred visitors to Flex Your Power

(top 200 sites brought in 86% of visitors)

People werereferred to the site

870,445 times

Close to 3 million visits in 2006 & 2007 (1.1 million in 2006 & 1.8 million in 2007)

• 64% of all referrals from search engines

• Flex Your Power most used search term

• TV/Radio station sites brought in 3 times more visitors than paid sites, mostly due to buys through m2omedia

• Daily visits to the website increased by 33% during campaign seasons

• Amongst the top 45 most viewed pages:

Residential pages - 38% Homepage - 30% Commercial pages - 11% Energy news pages - 8% Rest of pages - 13%

• Rebate, service and incentive pages were viewed 123,053 times with 91% of those targeting residential consumers

Sites Sending People to Flex Your Power Flex Your Power Website Sites Where People go from Flex Your Power

Viewers went to 614 sitesfrom Flex Your Power

Of the top 50 click-throughs toexternal sites:

• 64% were to IOU and third party demand side management groups

• 34% were to tax incentive sites

People wentto an external site

112,275 times