Market research and data analysis (12)

39
Marketing Research An Applied Approach 5 th edition Chapter 12 Measurement and scaling: fundamentals, comparative and non-comparative scaling When you can measure what you are speaking about and express it in numbers, you know something about it. – Lord Kelvin

Transcript of Market research and data analysis (12)

Page 1: Market research and data analysis (12)

Marketing ResearchAn Applied Approach 5th edition

Chapter 12Measurement and scaling: fundamentals, comparativeand non-comparativescaling

Whenyoucanmeasurewhatyouarespeakingaboutandexpressitinnumbers,youknowsomethingaboutit.

– LordKelvin

Page 2: Market research and data analysis (12)

Chapteroutline

1) Measurementandscaling2) Scalecharacteristicsandlevelsofmeasurement3) Primaryscalesofmeasurement4) Acomparisonofscalingtechniques5) Itemisedratingscales6) Scaleevaluation7) Choosingascalingtechnique8) Mathematicallyderivedscales.

Page 3: Market research and data analysis (12)

Measurementandscaling

• Measurementmeansassigningnumbers orothersymbols tocharacteristicsofobjectsaccordingtocertainpre-specifiedrules.Whatwemeasureisnottheobjectbutsomecharacteristicsofit.Animportantaspectofmeasurement isthespecification ofrules forassigningnumberstocharacteristics.

• Scalingmaybeconsideredanextensionofmeasurement.Scalinginvolvescreatingcontinuum uponwhichmeasuredobjectsarelocated.

• Considerascale forlocating consumersaccording tothecharacteristic attitude towardsvisiting acinema.Eachparticipant isassigned anumber thatis1toindicateanunfavorableattitude, thatis2toindicateaneutralattitudeandthatis3toindicate afavorableattitude.

• Scalingistheprocessofplacingtheparticipantsonacontinuumwithrespecttotheirattitudetowardsvisitingacinema.

Page 4: Market research and data analysis (12)

Scalecharacteristicsandlevels ofmeasurement

Allthescalesusedinmarketingresearchcanbeusedintermsoffourbasiccharacteristics.Thesecharacteristicsaredescription,order,distance andorigin.• Description. By description, we mean the unique labels or descriptors that are used to designate each valueof the scale. An example of descriptor is 1= strongly disagree; 2= disagree; 3= neither agree nor agree; 4=agree; 5 = strongly agree.

• Order. By order, we mean the relative sizes or positions of the descriptors. There are no absolute valuesassociated with order, only relative values. Order is denoted by descriptors such as “greater than”, “lessthan” and “equal to”. An example: a participant’s preference for art forms can be expressed by the followingorder: cinema, theatre and pop concert. The preference for the cinema is greater than the preference fortheatre.

• Distance. Absolute differences between the scale descriptors are known and may be expressed in units.Notice that a scale that has distance also has order.

• Origin. It means that the scale has a unique or fixed beginning or true zero point. An example: an exactmeasurement of income by a scale such as What is the annual income of your household before taxes? EuroXXX, ha a fixed origin or a true zero point.

Page 5: Market research and data analysis (12)

Primaryscales ofmeasurement

A NOMINAL SCALE• It is a scale in which the numbers serve only as labels or tags for identifying and classifying objects.

• A femaleparticipantmaybeassigneda number 1 and a maleparticipant 2.

• When a nominal scale is used for the purpose of identification, there is a strict one-to-one correspondencebetween the numbers and the objects. Each number is assigned to only one object and each object hasonly one number assigned to it.

Page 6: Market research and data analysis (12)

Primaryscales ofmeasurement

A NOMINAL SCALE

• Common examples: student registration numbers at a college or university, numbers assigned to football playersor jockeys in a horse race.

• In marketing research, nominal scales are used for identifying participants, brands, attributes, websites andother objects.

• The numbers in a nominal scale do not reflect the amount of the characteristics possessed by the objects. Forexample, a high number on a football player’s shirt does not imply that the foot-baller is a better player than onewith a low number.

• The only permissible operation on the numbers in a nominal scale is counting. Only a limited number of statisticsare possible; these include percentage andmode.

Page 7: Market research and data analysis (12)

Primaryscales ofmeasurement

AN ORDINAL SCALE

• It is a ranking scale in which numbers are assigned to objects to indicate the relative extent to whichthe objects possess some characteristics.

• An ordinal scale allow you to determine whether an object has more or less of a characteristic thansome other objects, but not how much more or less. An ordinal scale indicates relative position, notthe magnitude of the differences between objects.

• Common examples of ordinal scales include quality ranking, ranking of teams in a tournament andoccupational status.

Page 8: Market research and data analysis (12)

Primaryscales ofmeasurementAN ORDINAL SCALE

• In marketing research, ordinal scales are used to measure relative attitudes, opinions, perceptions andpreferences.

• In an ordinal scale as in a nominal scale, equivalent objects receive the same rank.

• Ordinal scales can be transformed in any way as long as the basic ordering of the object is maintained. Morespecifically any monotonic positive transformation of the scale is permissible, since the differences in numbersare void of any meaning other than order.

The second ordinal scale which assigns anumber 10 to Action, 25 to Comedy and 30 toDrama is an equivalent scale as it wasobtained by a monotonic positivetransformation of the first scale.

Page 9: Market research and data analysis (12)

Primaryscales ofmeasurement

AN ORDINAL SCALE

• In addition to the counting operation allowable for nominal scale data, ordinal scales permit the use ofstatistics based on centiles. It is meaningful to calculate percentile, quartile, median, rank ordercorrelation and other summary statistics from ordinal data.

Page 10: Market research and data analysis (12)

Primaryscales ofmeasurement

AN INTERVAL SCALE

• In an interval scale, numerically equal distances on the scale represent equal values in thecharacteristic being measured.

Page 11: Market research and data analysis (12)

Primaryscales ofmeasurement

AN INTERVAL SCALE

• An interval scale contains all the information of an ordinal scale, but it also allows you tocompare thedifferences between objects.

• In marketing the interval scale is used to investigate attitudes and opinions.• In an interval scale, the location of the zero is not fixed. Both the zero point and the units ofmeasurement are arbitrary.

• Any positive linear transformation of the form y= a+bx will preserve the properties of the scale.Here, x is the original scale value, y is the transformed scale value and b is a positive constant anda is any constant. Two interval scales that rate objects A,B,C, and D as 1,2,3, and 4 or as 22,24,26and 28 are equivalent. The latter scale can be derived from the from by using a= 20 and b=2 in thetransforming equation.

Page 12: Market research and data analysis (12)

Primaryscales ofmeasurement

AN INTERVAL SCALE

• Statistical techniques that may be used on interval scale data include all those that can be applied tonominal and ordinal data in addition to the arithmetic mean, standard deviation, product momentcorrelations.

Page 13: Market research and data analysis (12)

Primaryscales ofmeasurement

RATIO SCALE

• A ratio scale possesses all the properties of the nominal, ordinal and interval scale and inaddition an absolute zero point. Ratio scales possess the characteristic of origin.

Page 14: Market research and data analysis (12)

Primaryscales ofmeasurement

RATIO SCALE

• With ratio scales we can identify or classify objects, rank the objects and compare intervals ordifferences.

• Not only is the difference between 2 and 5 the same as the difference between 14 and 17, butalso 14 is seven times as large as 2 in an absolute sense.

• Common examples of ratio scales include height, weight, age andmoney.• In marketing researches, sales, costs, market share and number of customers are variablesmeasured on a ratio scale.

Page 15: Market research and data analysis (12)

Primaryscales ofmeasurementRATIO SCALE

• All statistical techniques can be applied to ratio data. These include specialized statistics such asgeometric mean, harmonicmean and coefficient of variation.

Page 16: Market research and data analysis (12)

S:Comm Leisure TimeSurvey

StudyonhowUKadultsspendtheir leisure time.Onekeyarea isdevoted tocinema andthepopularityoftypesoffilms.

Page 17: Market research and data analysis (12)

Acomparison ofscalingtechniques

• Thescalingtechniquesemployedinmarketingresearchcanbeclassifiedintocomparative andnon-comparativescales.

• Comparativescalesinvolvethedirectcomparison ofstimulusobjects[participants maybeaskedwhether theyprefertovisitacinemaoratheatre]

• Noncomparativescales:eachobjectisscaled independently ontheothersinthestimulusset[Participantsmaybeaskedtoevaluateonacinemavisitona1to6preference scale (1=notatallpreferred,6=greatlypreferred)]

Page 18: Market research and data analysis (12)

• In paired comparison scaling, a participant is presented with two objects and asked to select oneaccording to somecriterion. The data obtained are ordinal in nature.

• Participants may state that they prefer Belgian chocolate to Swiss,Adidas more than Nike.

Thefigureshowspairedcomparisondataobtainedtoassessaparticipant’sbottledbeerpreferences.Theparticipantmade10comparisonstoevaluatefivebrands.

Ingeneralwithnbrands,[n(n-1)/2]pairedcomparisonsincludeallpossiblepairingsofobjects.

Comparativescaling techniques - Paired comparison scaling

Page 19: Market research and data analysis (12)

• Transity ofpreferenceimpliesthatifbrandAispreferredtoB,andbrandBispreferredtoC,thenbrandAispreferredtoC.

• Toarriveatarankorder,theresearcherdeterminesthenumberoftimeseachbrandispreferredbysummingthecolumnsentries.Therefore,thisparticipant’sorderpreferenceisCarlsberg,Holsten,StellaArtois,BudvarandGrolsch.

Comparativescaling techniques - Paired comparison scaling

Page 20: Market research and data analysis (12)

• In this scaling we do not have the inclusion of a neutral/no difference/no opinionresponse.

• Paired comparing scaling is useful when the number of brands is limited since itrequiresdirect comparison and overt choice.

• Other disadvantages are the violations of the assumption of transitivitymay occur, andthe order in which the objects are presented may bias the results.

• Paired comparisons bear little resemblance to the marketplace situation, which involvesselection frommultiple alternatives.

• Participants may prefer one object over certain others, but they may not like it in anabsolute sense.

Comparativescaling techniques - Paired comparison scaling

Page 21: Market research and data analysis (12)

Comparativescalingtechniques - Rank order scaling

• In rank order scaling, participants are presented with several objects simultaneously and asked to orderor rank them according to somecriterion. The data are ordinal in nature.

• Rank order scaling is used to measureattributes of products and services aswell preferences for brands.

• Moreover, compared with pairedcomparisons, this type of scalingprocess more closely resembles theshopping environment.

• It also takes less time and eliminatesintransitive responses. If there are nstimulus object, only (n-1) scalingdecisions need be made in rank orderscaling. In paired comparison scaling[n(n-1)/2] decisions would be required.

• The major disadvantage is that thistechnique produces only ordinal data.

Page 22: Market research and data analysis (12)

• In constant sum scaling, participants allocate a constantsum of units such as points or euros, among a set ofstimulus object with respect to some criterion.

• Segment 1: importance to price

• Segment 2: high alcohol level

• Segment 3: hop flavours, fragrance

• Note that the constant sum also has an absolute zero;10 points are twice as many as 5 points, and thedifference between 5 and 2 points is the same as thedifference between 57 and 54 points. For this reason,constant sum scale data are sometimes treated asmetric.

• The main advantage is that it allows for finediscrimination among stimulus object withoutrequiring too much time.

• Two main disadvantages: a) participants may allocatemore or fewer units that those specified (they mayallocate 108 or 94 points); b) the use of a largenumber of units may cause confusion and fatigue.

Comparativescaling techniques - Constant sumscaling

Page 23: Market research and data analysis (12)

Q-sort andother procedures

• Q-sort scaling was developed to discriminate among a relatively large number of objectsquickly.

• This technique uses a rank order procedure in which objects are sorted into piles basedon similarity with respect to some criterion.

• For examples, participants are given 100 attitude statements on individual cards andasked to place them into 11 piles, ranging from “most highly agreed with” to “leasthighly agreed with”.

• The number of objects to be sorted should not be less than 60 nor more than 140; areasonable range is 60 to 90 objects.

Magnitude estimation• Numbers are assigned to objects such that ratios between the assigned numbers reflect ratios on the specificcriterion.

• For example, participants may be asked to indicate whether they agree or disagree with each of a series ofstatements measuring attitude towards different film genres.

• Then they assign a number between 0 and 100 to each statement to indicate the intensity of their agreementor disagreement.

Page 24: Market research and data analysis (12)

Non-comparativescaling techniques

• Non-comparativescalingtechniquesareusedwhateverratingstandardsseemappropriate.• Thesingleobjectisevaluatedwithoutmakingcomparisons.

Page 25: Market research and data analysis (12)

Continuousratingscale

• Inacontinuousratingscale,participantsratetheobjectsbyplacingamarkattheappropriatepositiononalinethatrunsfromoneextremeofthecriterionvariabletotheother.

• Thelinemaybevertical orhorizontal.

• Scalepointsmayhavetheformofnumbersofbriefdescriptions.

• Continuousratingscalesareeasytoconstructbutprovidenewlittleinformation.

• Withtheincreaseofonlineandmobiledevicesurveys,theiruseisbecomingmorefrequent.

Non-comparativescaling techniques

Page 26: Market research and data analysis (12)

Itemised ratingscales

• In an itemised rating scale, participants are provided with a scale that has anumber or brief description associated with each category. The categories areordered in terms of scale position, and the participants are required to select thespecified category that best describes the object being rated.

• The most common itemised rating scales are:• The Likert scale• The semantic differential scale• The Stapel scale

Non-comparativescaling techniques

Page 27: Market research and data analysis (12)

Likert scales • Likertscaleisawidelyusedratingscalethatrequirestheparticipantstoindicateadegreeofagreement ordisagreementwitheachofaseriesofstatementsaboutthestimulusobjects.

• Notethatforanegativestatement,anagreementreflectsanunfavourable response,whereasforapositivestatement,agreementrepresentsafavourableresponse.

• Inthefigurethepartecipant hasanattitudescoreof26.

Page 28: Market research and data analysis (12)

Likert scales • Likertscaleisawidelyusedratingscalethatrequirestheparticipantstoindicateadegreeofagreement ordisagreementwitheachofaseriesofstatementsaboutthestimulusobjects.

• TheLikertscalehasseveraladvantages.

• Itiseasytoconstructandadministerandparticipantsreadilyunderstandhowtousethescale,makingitsuitableforonlinesurveys,Kiosk,mobile,mail,telephoneorpersonalinterviews.

• ThemajordisadvantageoftheLikertscaleisthatittakeslongertocompletethanotheritemisedratingscalesbecauseparticipantshavetoreadandfullyreflectuponeachstatement.

Page 29: Market research and data analysis (12)

Semanticdifferential scale

• Thesemanticdifferentialscaleistypicallyaseven-pointratingscalewithendpointsassociatedwithbipolarlabelsthathavesemanticmeaning.

• Participantsrateobjectsonanumberofitemised,seven-pointratingscalesboundedateachendbyoneoftwobipolaradjectivessuchas“boring”and“exciting”.

• Meansandmedianvaluesoneachratingscalearecalculated.Thishelpsdeterminetheoveralldifferencesandsimilaritiesamongtheobjects.

• Itisusedincomparingbrand,productandcompanyimages.

• Ithasalsobeenusedtodevelopadvertisingandpromotionstrategiesandinnew-productdevelopmentstudies.

Page 30: Market research and data analysis (12)

Stapel Scale• TheStapel scaleisaunipolarratingscalewith10categoriesnumberedfrom-5to+5withoutaneutralpoint(zero).Thisscaleisusuallypresentedvertically.Participantsareaskedtoindicatebyselectinganappropriatenumericalresponsecategory,howaccuratelyorinaccuratelyeachtermdescribestheobject.

• TheStapel scaleproducesresultssimilartothesemanticdifferential.

• SomeresearchersbelievethattheStapel scaleisconfusinganddifficulttoapply.

• Ofthethreeitemisedratingscalesconsidered,theStapelscaleisusedleast.

Page 31: Market research and data analysis (12)

Itemised ratingscaledecisions

Theresearchermustmakesixmajordecisionswhenconstructinganyofthesescales:

• Thenumberofscalecategoriestouse

• Balancedversusunbalancedscale

• Oddorevennumberofcategories

• Forcedversusnon-forcedchoice

• Thenatureanddegreeoftheverbaldescription

• Thephysicalformofthescale

Page 32: Market research and data analysis (12)

Itemised ratingscaledecisionsNumberofscalecategories• Traditionalguidelinessuggestthattheappropriatenumberofcategoriesshouldbebetweenfiveand

nine.• Iftheparticipantsareinterestedinthescalingtaskandareknowledgeableabouttheobjects,many

categoriesmaybeemployed.• Iftheparticipantsarenotveryknowledgeableorengagedwiththetask,fewercategoriesshouldbeused.

BalancedversusunbalancedscaleInabalanced scale, thenumberoffavourableandunfavourablecategories isequal; inanunbalanced scale, thecategories areunequal.

Inorder toobtain themostobjectivedata, thescale shouldbebalanced.If the distribution of responses islikely to be skewed (either positivelyor negatively) an unbalanced scalewith more categories in the directionof skewness may be appropriate.

Page 33: Market research and data analysis (12)

Itemised ratingscaledecisions

Oddorevennumberofcategories• Withanoddnumberofcategories, themiddle scaleposition isgenerally designated asneutral.• Ifaneutralorindifferentresponse ispossible fromatleastsomeoftheparticipants, anoddnumberofcategories

shouldbeused.• If,ontheotherhand,theresearcher wantstoforcearesponseorbelieves thatnoneutralorindifferent response

exists,aratingscalewithanevennumberofcategories shouldbeused.

Forcedversusnon-forcedchoice• Onforcedratingscales theparticipants areforcestoexpressanopinionbecause a“noopinion”option

isnotprovided.Insuchacase,participants withoutanopinionmaymarkthemiddlescaleposition.• Ifanimportantportionoftheparticipants donothaveopinionsonthetopic,marking themiddle

positionwilldistortmeasuresofcentral tendencyandvariance.• Insituationswhere theparticipants areexpected tohavenoopinion,asopposed tosimplybeing

reluctant todisclose it,theaccuracyofdatamaybeimprovedbyanon-forcedscale thatincludesa“noopinion”category.

Page 34: Market research and data analysis (12)

Itemised ratingscaledecisions

Natureanddegreeofverbaldescription• Scalecategories mayhaveverbal,numerical orpictorial descriptions.• The researcher must decide whether to label every scale category, label only some scale categories or label

only extreme scale categories.• Providing a verbal description for each category may not improve the accuracy or reliability of the data.• Thestrengthoftheadjectives usedtoanchor thescalemayinfluence thedistributionoftheresponse.With

stronganchors(1=completely disagree; 7=completely agree)participants areless likelytousetheextremescalecategories.Week anchors(1=generally disagree; 7=generally agree)produceuniformorflatdistribution.

Page 35: Market research and data analysis (12)

Itemised ratingscaledecisionsPhysicalformofthescaleNumberofoptionsareavailable withrespect toscale formandconfiguration.Scalescanbepresentedvertically orhorizontally.

Page 36: Market research and data analysis (12)

Itemised ratingscaledecisionsPhysicalformofthescaleNumberofoptionsareavailable withrespect toscale formandconfiguration.Scalescanbepresented vertically orhorizontally.

Page 37: Market research and data analysis (12)
Page 38: Market research and data analysis (12)

Somecommonly used scales inmarketing

Page 39: Market research and data analysis (12)

Toevaluate themesasurment accuracy,we canusethetrue scoremodel:X0 =XT +XS +XR

Evaluationofthescale

• X0 = Theobserved scoreormeasurement• XT = thetrue scoreofthecharacteristic• XS =systematic error (mechanical factors)• XR=randomerror (situational factors)

Reliability canbedefinedastheextent towhichmeasuresare freefromrandomerror,XR.IfXR =0,themeasure isperfectly reliable.

Perfectvalidity requires thattherebenomeasurement error(XO =XT,XR =0,XS =0).