Conjoint Choice Introduction-overview
Transcript of Conjoint Choice Introduction-overview
-
7/28/2019 Conjoint Choice Introduction-overview
1/53
Choice-Based Conjoint Workshop
October, 2010
With information provided by
Sawtooth Software
-
7/28/2019 Conjoint Choice Introduction-overview
2/53
Outline
Introduction to Conjoint Analysis
Formulating Experiments
Conjoint Methods -types Use CBC software
Introduction to CBC analysis
-
7/28/2019 Conjoint Choice Introduction-overview
3/53
Introduction to Conjoint Analysis
Identify Your Goal
Design your experiment 5 stages
Interpreting part-worths and importance
A brief introduction to market simulations
-
7/28/2019 Conjoint Choice Introduction-overview
4/53
Different Perspectives, Different Goals
Public wants all of the most desirable features of
environmental assets at lowest possible cost
Providers want to maximize welfare by:1) minimizing costs of providing features
2) providing products/services that offer greater overall value than
other alternatives
-
7/28/2019 Conjoint Choice Introduction-overview
5/53
-
7/28/2019 Conjoint Choice Introduction-overview
6/53
Demand or Preference Side of Equation
Focus first on demand/preference side of the
equation
After figuring out what consumer wants, next assesswhether it can be built/provided in a cost- effective
manner
-
7/28/2019 Conjoint Choice Introduction-overview
7/53
Products/Services are Composed of
Features/Attributes
Olive Oil Source, Price, Aroma, Size
Forest Harvesting Program
Live trees after harvesting, Cost , Dead trees
after harvesting, % of forest set aside from
harvest
Plastic Bag Management Cost/tax, % wildlife impact, durability, waste
-
7/28/2019 Conjoint Choice Introduction-overview
8/53
Breaking the Problem Down
If we learn how consumer values the components ofa product, we are in a better position to design those
that improve profitability
If we learn how the public values the components of
environmental goods and services, we are in a better
position to design those goods and services to
maximize societal welfare
-
7/28/2019 Conjoint Choice Introduction-overview
9/53
How to Learn What Customers/Public Want?
One way: Ask Direct Questions about preference
What Brand do you prefer?
How much would you pay for it?
What color do you prefer What size of container would you like?
Answers often trivial and unenlightening (e.g.
respondents prefer low fees to high fees, mediumsize than large etc..)
-
7/28/2019 Conjoint Choice Introduction-overview
10/53
How to Learn What Is Important?
One way: Ask Direct Questions about Importances
How important is it that you get the > that you want?
-
7/28/2019 Conjoint Choice Introduction-overview
11/53
Stated Importances
Importance Ratings often have low discrimination:
-
7/28/2019 Conjoint Choice Introduction-overview
12/53
Stated Importances
Answers often have low discrimination, with most
answers falling in very important categories
If they were not important, we probably wouldnt have
included them in the research!
Answers sometimes useful for segmenting market,
but still not very actionable
We still dont exactly what product they want
-
7/28/2019 Conjoint Choice Introduction-overview
13/53
What is Conjoint Analysis?
Research technique developed in early 70s
Measures how buyers value components of aproduct/service bundle
Dictionary definition-- Conjoint: Joined together,combined.
Marketers catch-phrase-- Features CONsideredJOINTly
-
7/28/2019 Conjoint Choice Introduction-overview
14/53
How Does Conjoint Analysis Work?
We vary the product/service features (independent variables) to buildmany (usually 12 or more) product concepts
We ask respondents to rate/rank or choose among a subset ofthoseproduct concepts (dependent variable)
Based on the respondents evaluations of the product concepts, wefigure out how much unique value (utility) each of the features(attributes) added
(Regress dependent variable on independent variables; estimatedbetas equal to part worth utilities.)
-
7/28/2019 Conjoint Choice Introduction-overview
15/53
Important Early Articles
Luce, Duncan and John Tukey (1964), Simultaneous Conjoint Measurement: A
New Type of Fundamental Measurement,Journal of Mathematical Psychology, 1,
1-27
Green, Paul and Vithala Rao (1971), Conjoint Measurement for Quantifying
Judgmental Data,Journal of Marketing Research, 8 (Aug), 355-363
Johnson, Richard (1974), Trade-off Analysis of Consumer Values,Journal ofMarketing Research, 11 (May), 121-127
Green, Paul and V. Srinivasan (1978), Conjoint Analysis in Marketing: New
Development with Implications for Research and Practice,Journal of Marketing,
54 (Oct), 3-19
Louviere, Jordan and George Woodworth (1983), Design and Analysis ofSimulated Consumer Choice or Allocation Experiments,Journal of Marketing
Research, 20 (Nov), 350-367
-
7/28/2019 Conjoint Choice Introduction-overview
16/53
Traditional, Less-Effective Questions
How important is horsepower to you in a
vehicle?
How important is fuel efficiency to you in a
vehicle?
Which is more important to you, horsepower
or fuel efficiency?
-
7/28/2019 Conjoint Choice Introduction-overview
17/53
Whats So Good about Conjoint?
More realistic questions:Which product would you prefer . . .
- 210 horsepower or - 140 horsepower
- 17 MPG - 28 MPG
If choose left, you prefer Power. If you choose right, you
prefer Fuel Economy
Rather than ask directly whether you prefer Power over Fuel
Economy, we present realistic tradeoff scenarios and infer
preferences from your product choices
-
7/28/2019 Conjoint Choice Introduction-overview
18/53
Whats So Good about Conjoint? (cont.)
When respondents are forced to make difficult
tradeoffs, we learn what they truly value
These values (utility scores) are associated with
specific and actionable attribute levels relevant to
the problem at hand
-
7/28/2019 Conjoint Choice Introduction-overview
19/53
Building a Model
-
7/28/2019 Conjoint Choice Introduction-overview
20/53
Building a Model
Inputs:
Attributes
Levels
Respondents
Prior Knowledge External Data
Experimental
Design
Conjoint Method
Outputs:
Utility Scores for each
level
Importance Scores for
each attribute
Ability to perform
Simulations
-
7/28/2019 Conjoint Choice Introduction-overview
21/53
Defining Attributes
Attributes are independent aspects of a product or aservice (Brand, Price, Size, Color etc.)
How many attributes?
-Depends on research objectives One rule of thumb was that no more than 6 0r 7 attributes
is too much May cause respondents to simplify, looking only at 2-3 most
important
Attributes should be independent, mutually exclusive Brand, quality and product life expectancy may all measure
the same thing
Each attribute has varying degrees, or levels Cost: $1, $2, $3
-
7/28/2019 Conjoint Choice Introduction-overview
22/53
Rules for Formulating Attribute
Levels
Attributes are assumed to be mutually
exclusive
Attribute: Add-on features
Level 1= Sun roof
Level 2= GPS system
Level 3=DVD player
If you define levels in this way, you cannotdetermine the value of providing 2 or 3 of these
features at the same time (or none of them)
-
7/28/2019 Conjoint Choice Introduction-overview
23/53
Solutions
8 level Attribute:
Features
None
Sunroof GPS system
DVD Player
Sunroof, GPS
Sunroof, DVD
GPS, DVD
Sunroof, GPS, DVD
3 Binary Attributes:
Sunroof:
None
Sunroof
GPS System
None
GPS
DVD Player
None
DVD Player
-
7/28/2019 Conjoint Choice Introduction-overview
24/53
Rules for Formulating Attribute
Levels
Levels should have concrete/unambiguous
meaning
very expensive vs costs $575
weight: 5-7 kilos vs weight 6 kilos
-One description leaves meaning up toindividual interpretation, while the other does
not
-
7/28/2019 Conjoint Choice Introduction-overview
25/53
Rules for Formulating Attribute
Levels
Dont include too many levels for any one
attribute
The usual number is about 3-5 levels per attribute
Make sure levels from your attributes can
combine freely with one another without resulting
in utterly impossible combinations (very unlikely
combinations OK)
-
7/28/2019 Conjoint Choice Introduction-overview
26/53
Attribute Examples
Cost
$1
$2
$3
Brand
A
B
C
ColorRed
Black
Blue
or graphics as well can be levels.
-
7/28/2019 Conjoint Choice Introduction-overview
27/53
Suggestions for Determining Which
Attributes & Levels to Include
Talk to all stakeholders
Focus Groups
Search of competitors websites, sales materials
-
7/28/2019 Conjoint Choice Introduction-overview
28/53
Other Inputs into the Model
-
7/28/2019 Conjoint Choice Introduction-overview
29/53
Conjoint Utilities (Part Worths)
Numeric values that reflect how desirable differentfeatures are:
Feature Utility
Vanilla 2.5Chocolate 1.8
25 5.335 3.2
50 1.4
The higher the utility, the better
-
7/28/2019 Conjoint Choice Introduction-overview
30/53
Interpreting Conjoint Utilities
Interval scaled data (no ratio operations!)
You cannot compare one level from one attribute
with one level from another attribute, since conjoint
utilities are scaled to an arbitrary constant withineach attribute (often zero-centered)
You CAN compare differences between two levels of
one attribute versus two levels of another attribute
(an addition operation)
-
7/28/2019 Conjoint Choice Introduction-overview
31/53
Conjoint Importances
Ratio scaled data Measure of how much influence each attribute has on peoples
choices
Best minus worst level of each attribute, then percentaged:
Vanilla - Chocolate (2.5 - 1.8) = 0.7 15.2%25 - 50 (5.3 - 1.4) = 3.9 84.8%
----- --------Totals: 4.6 100.0%
Importances are directly affected by the range of levels youchoose for each attribute
-
7/28/2019 Conjoint Choice Introduction-overview
32/53
Market Simulations
Make alternative program/services scenarios and predict
which program/services respondents would choose
Accumulate (aggregate) respondent predictions to make
Shares of Preference (some refer to them as marketshares)
-
7/28/2019 Conjoint Choice Introduction-overview
33/53
Market Simulation Example
Predict market shares for 35 Vanilla cone vs. 25 Chocolate
cone for Respondent #1:
Vanilla (2.5) + 35 (3.2) = 5.7
Chocolate (1.8) + 25 (5.3) = 7.1
Respondent #1 chooses 25 Chocolate cone!
Repeat for rest of respondents. . .
-
7/28/2019 Conjoint Choice Introduction-overview
34/53
Market Simulation Results
Predict responses for 500 respondents, and we might seeshares of preference like:
65% of respondents prefer the 25 Chocolate cone
35%
65%
Vanilla @ 35
Chocolate @ 25
-
7/28/2019 Conjoint Choice Introduction-overview
35/53
So you want to do a conjoint..
-
7/28/2019 Conjoint Choice Introduction-overview
36/53
Step 1: Begin With the End in Mind
What is the objective of the research?
How much will public be willing to pay for biologicalcontrol feature?
Will farmers switch and adopt a different varieties?
The better you define the root problem, thebetter your research will be!
-
7/28/2019 Conjoint Choice Introduction-overview
37/53
Step 2: Plan Your Analysis
Identify how clients need to use data
Deliver analysis plan to clients as part of research
proposal Makes sure that objectives and deliverables are clear
-
7/28/2019 Conjoint Choice Introduction-overview
38/53
Step 3: Define Attributes and Levels
How many attributes? Depends on researchobjectives
More than 6 attributes may cause respondents to
simplify, looking only at 3-4 most important Attributes should be independent, mutually
exclusive
Brand, quality, product life expectancy may all
measure the same thing
-
7/28/2019 Conjoint Choice Introduction-overview
39/53
Rules for Formulating
Attribute Levels
Levels are assumed to be mutually exclusive
Attribute: Add-on features
level 1: Manuallevel 2: Biological Controllevel 3: Chemical
If you define levels in this way, you cannot determine thevalue of providing two or three of these features at thesame time (or none of them)
-
7/28/2019 Conjoint Choice Introduction-overview
40/53
Rules for Formulating
Attribute Levels
Dont include too many levels for any one attribute The usual number is about 3 to 5 levels per attribute
One temptation is to include many levels for price, so we canestimate peoples preferences for each
Better approach usually is to interpolate between fewermore precisely measured levels for not asked aboutprices
Cover the range of probable values
-
7/28/2019 Conjoint Choice Introduction-overview
41/53
Rules for Formulating
Attribute Levels
Make sure levels from your attributes can combine freely withone another without resulting in utterly impossiblecombinations (very unlikely combinations OK)
-
7/28/2019 Conjoint Choice Introduction-overview
42/53
Representing Levels
Text High Performance Sports Car
Pictures / Graphics
Sample boards Allows respondents to touch or feel samples for tactile attributes
(towel softness, greeting card paper quality, etc.)
Null Level Has Stereo vs. __________
Low
Medium
High
-
7/28/2019 Conjoint Choice Introduction-overview
43/53
Step 3: Choose a conjoint method
Step 4: Identify Research Constraints Sample issues
Sample Population >200
Length of survey (how long can I keep theirattention)
Fielding issues
Budget
Client sophistication
Example of a Pair of Soda Product Profile
-
7/28/2019 Conjoint Choice Introduction-overview
44/53
Attributes Program A: Program B:Cost $.50 $.25
Color Red Silver
Size .33 l .75 l
Sugar level Diet/light Regular
Example of a Pair of Soda Product Profile
Scenarios
-
7/28/2019 Conjoint Choice Introduction-overview
45/53
How to tell if you are in over your
head
You should be okay if
Small number of attributes
Attributes freely combine with one another Large sample, even after adjusting for subgroup
analysis
Your client can describe the analysis, attributes inone paragraph or less, and you can then explain it
to a six year old with little difficulty!
-
7/28/2019 Conjoint Choice Introduction-overview
46/53
Section 2
Intro to Choice-Based Conjoint (Discrete
Choice Modeling)
-
7/28/2019 Conjoint Choice Introduction-overview
47/53
Setting Up CBC Interview (Definitions)
Concept 1 Concept 2 Concept 3 Concept 4
How many concepts per task?
How many tasks per survey?
Task
-
7/28/2019 Conjoint Choice Introduction-overview
48/53
How Many Concepts per Task?
Generally, 2 to 5 concepts are used
Attribute text length, graphical representation affect the
decision
-
7/28/2019 Conjoint Choice Introduction-overview
49/53
How Many Tasks per Survey?
Respondents are expensive to recruit. It makes sense toask respondents multiple choice tasks.
Respondents take about 7 minutes on average to answer20 tasks (~20 seconds per task)
CBC is very flexible in terms of how many tasks to include.Minimum is just one task! (but youll need huge samplesize, and will face limitations in analysis)
Typical choice is 12 to 18 choice tasks
-
7/28/2019 Conjoint Choice Introduction-overview
50/53
Test CBC Design
What is a Design? The sum total of information about the
attribute levels being shown in the CBC tasks across all
respondents. (The independent variable matrix)
If you use ANY prohibitions, or use few questionnaire
versions, you MUST test your design
Failure to test the design can invalidate your study
CBC/Web automatically tests your design when it generates
the design file--pay attention to the test!
-
7/28/2019 Conjoint Choice Introduction-overview
51/53
The None Concept
Pros:
Respondents arent forced to choose a product concept
that they really dont like
Lets you capture information about whether respondents
(or segments) are more or less interested in buying the
product concept
Cons:
Choices of None provide much less information for
estimating utilities than other choices (reduces the
effectiveness of your sample size)
None utilities and Shares of Preference for None are
difficult to interpret
Design Stage of CCE
-
7/28/2019 Conjoint Choice Introduction-overview
52/53
Design Stage of CCE
-
7/28/2019 Conjoint Choice Introduction-overview
53/53
Exercise
Decide on topic
Discuss how you are going to decide the
attributes and the levels
Begin to think about attitudes
Assign team members tasks for the above
Be efficient