Setting up and gaining acceptance of formal sensory ... · Setting up and gaining acceptance of...

27
www.margareteveritt.com www.carolraithatha.co.uk Setting up and gaining acceptance of formal sensory procedures in quality control: Back to the Future June 6, 2011

Transcript of Setting up and gaining acceptance of formal sensory ... · Setting up and gaining acceptance of...

Page 1: Setting up and gaining acceptance of formal sensory ... · Setting up and gaining acceptance of formal sensory procedures in ... – Assessors • Screened and ... to ensure consistency

www.margareteveritt.com www.carolraithatha.co.uk

Setting up and gaining acceptanceof formal sensory procedures in

quality control:

Back to the Future

June 6, 2011

Page 2: Setting up and gaining acceptance of formal sensory ... · Setting up and gaining acceptance of formal sensory procedures in ... – Assessors • Screened and ... to ensure consistency

Credibility of Sensory Science

Satisfyingconsumerneed takesgreaterprecedence inNPD

Commercialdemand tooptimisesensoryattributesgrows

User friendlycomputerisedsensory evaluation& analysis programsreadily available

Product DevelopmentWidely well established

Growing needfor tightercontrol ofsensory quality

Sound set oftools andskills availablefor sensoryQC

Primeopportunity tomake progressin Productionbuilding linkswithDevelopment& MarketingProduction & QC/QA

Still a long way to go

Page 3: Setting up and gaining acceptance of formal sensory ... · Setting up and gaining acceptance of formal sensory procedures in ... – Assessors • Screened and ... to ensure consistency

Talk Agenda

• Aims of a QC program

• Defining and communicating sensory quality

• Key issues and possible solutions

• Making the most of the data

• Selling the benefits

• Future opportunities

3

Page 4: Setting up and gaining acceptance of formal sensory ... · Setting up and gaining acceptance of formal sensory procedures in ... – Assessors • Screened and ... to ensure consistency

Main Aims of QC Program

• Individual products as delivered to consumersare fit for purpose

– Legal requirements

– Fit & safe for use

– Nutritional compliance

– Weight compliance

– Sensory quality

4

Page 5: Setting up and gaining acceptance of formal sensory ... · Setting up and gaining acceptance of formal sensory procedures in ... – Assessors • Screened and ... to ensure consistency

Sensory Quality

• Defining quality through a sensory specification– the attributes are the key measurement criteria

• Use consumer liking information from ProductDevelopment and Marketing– Communication important

– If this link is missing process can become toosubjective

• Goal is to maintain Sensory Quality Margin– may be USP

5Image Source: Microsoft

Page 6: Setting up and gaining acceptance of formal sensory ... · Setting up and gaining acceptance of formal sensory procedures in ... – Assessors • Screened and ... to ensure consistency

Sensory Quality Margin

6

To have and maintain quality that gives asignificant lead for consumer liking

Page 7: Setting up and gaining acceptance of formal sensory ... · Setting up and gaining acceptance of formal sensory procedures in ... – Assessors • Screened and ... to ensure consistency

Consumer &SensoryResearchinformationideally fromPreferenceMapping

External Consumer Focused Approach

SensorySpecificationestablished

Key preferencedriversidentified –positive andnegative

Target productattributesdefined withtolerance limits

Defining Sensory Quality

7

Image Source: Microsoft

Page 8: Setting up and gaining acceptance of formal sensory ... · Setting up and gaining acceptance of formal sensory procedures in ... – Assessors • Screened and ... to ensure consistency

0

1

2

3

4

5

6

0 5 10

Lik

ing

Sweetness

0

2

4

6

8

10

0 5 10

Lik

ing

Bitter

Liking information together with sensoryprofile data inform the Sensory Specification

8

0

2

4

6

0 5 10

Lik

ing

Spicy

Sensory Specification

Sweet

1 2 3 4 5 6 7 8 9 10

Bitter

1 2 3 4 5 6 7 8 9 10

Spicy

1 2 3 4 5 6 7 8 9 10

DefiningSensory Quality

Page 9: Setting up and gaining acceptance of formal sensory ... · Setting up and gaining acceptance of formal sensory procedures in ... – Assessors • Screened and ... to ensure consistency

● Internal cross-functional business team define sensorytarget

● Based on a combination of market knowledge,product experience and production quality ranges.

9

Manufacturer Focused Approach

Marketing

Quality Systems

Product Development Sales

Production

ImageSource:Microsoft

Defining Sensory Quality

Page 10: Setting up and gaining acceptance of formal sensory ... · Setting up and gaining acceptance of formal sensory procedures in ... – Assessors • Screened and ... to ensure consistency

Sensory Specification:

Consumer• Key attributes driving

consumer liking

Business• Attributes that relate to important

processing stages or factors

• Attributes that relate to criticalingredients

• Likely occurring defects and off-flavours

• Potential Taints

10

Which criteria need to be measured:

Image Source: Microsoft

Page 11: Setting up and gaining acceptance of formal sensory ... · Setting up and gaining acceptance of formal sensory procedures in ... – Assessors • Screened and ... to ensure consistency

Application of Sensory Specification

• Design of sensory QC system depends on context• Options:

– On-line vs. off-line assessments, sampling, physicallocation of testing, etc.

– Sensory methodology• Adapted to context• Large range of methods to choose from

– From profiling to in/out

– Assessors• Screened and trained• Calibrated and validated against target quality range

– Feedback and Actions

Image Source:Microsoft

Page 12: Setting up and gaining acceptance of formal sensory ... · Setting up and gaining acceptance of formal sensory procedures in ... – Assessors • Screened and ... to ensure consistency

Potential Issues

• Lack of commitment from management

– Commitment is vital to convey and ensure support,interest and respect across a business

– “Without management support in a typical case theprogram will amount to nothing more than rubberstamping of supervisory opinion ….” (Lawless H T& Heymann H 1998)

12

Image Source: Microsoft

Page 13: Setting up and gaining acceptance of formal sensory ... · Setting up and gaining acceptance of formal sensory procedures in ... – Assessors • Screened and ... to ensure consistency

Management Commitment

• Likely Concerns– Value of Sensory Science

– Cost v benefits of setting up the system

– Focus on quality to the detriment of output

– Detract from other quality initiatives e.g. waterconservation; waste reduction

• Tackling Concerns– Tailored mini courses or workshops

– Pilot exercise to illustrate the benefits of establishing aformal sensory QC system

13

Image Source: Microsoft

Page 14: Setting up and gaining acceptance of formal sensory ... · Setting up and gaining acceptance of formal sensory procedures in ... – Assessors • Screened and ... to ensure consistency

Potential Issues

• Lack of an official sensory program co-ordinator– Needed to maintain consistency and accuracy of the

programs application

• Lack of well defined sensory specifications– Encourage use of product development information– Ensure the sensory element is not brought in as an after

thought

• Specification prone to subjective interpretation– Formal training required to achieve objective

assessment– Calibrate assessors to target quality

14

Image Source: Microsoft

Page 15: Setting up and gaining acceptance of formal sensory ... · Setting up and gaining acceptance of formal sensory procedures in ... – Assessors • Screened and ... to ensure consistency

Potential Issues

• Lack of formal training of ‘assessors’

– Formal training program required (initial and refresher)to ensure consistency and reliability of assessments

– Validate proficiency

• Poor use and integration of the sensoryinformation within the production process

– Procedures need to be designed to facilitate promptand concise feedback of results and actions both

– On-line and to the business

15

Image Source: Microsoft

Page 16: Setting up and gaining acceptance of formal sensory ... · Setting up and gaining acceptance of formal sensory procedures in ... – Assessors • Screened and ... to ensure consistency

Exploit the Data

Individual Assessments● Feedback needs to be precise and focused to aid corrective

action― Link back to the relevant process factors and or ingredients needing

modification

Over Time● Trend analysis gives a balanced perspective of the quality

deviations― Determine ad-hoc versus frequently occurring deviations― Identify effects due to other factors e.g. season, manufacturing site,

supplier …..― Establish ‘Sensory’ Critical Control Points (SCCP)

Data Collection & Communication● Paper is most popular on-line; computerised systems off-line

― Colour codes and graphical charts are popular communicationformats

16

Page 17: Setting up and gaining acceptance of formal sensory ... · Setting up and gaining acceptance of formal sensory procedures in ... – Assessors • Screened and ... to ensure consistency

Individual Assessments

Traffic Light ‘RAG’ colour system adopted by many companies to flag up the quality gradesand signal actions

1 2 3 4 5 6 7 8 9

Numerical Category

Scale Descriptor Action Standard

5Match with reference

sampleNo action required

2,6 Slight deviation from ref Monitor

3,7 Moderate deviation Take process action. Re-evaluate at increased frequency (1 hr).

2,8 Large deviation

1,9 Very large deviation

Take process action;

Re-evaluate at increased frequency (1 hr);

Hold all product produced since the last good check;

Held product must be evaluated by a larger trained sensory

panel that includes Quality Manager or representative.

Source: McCain (GB) Ltd

Page 18: Setting up and gaining acceptance of formal sensory ... · Setting up and gaining acceptance of formal sensory procedures in ... – Assessors • Screened and ... to ensure consistency

Quality Margin:not always maintainedagainst competitor 2

Trend Analysis:Liking

Page 19: Setting up and gaining acceptance of formal sensory ... · Setting up and gaining acceptance of formal sensory procedures in ... – Assessors • Screened and ... to ensure consistency

TargetIntensityRange

Trending specific attributes against the target specification range

Critical information:# deviations out oftarget

Trend Analysis:Key Attributes

Page 20: Setting up and gaining acceptance of formal sensory ... · Setting up and gaining acceptance of formal sensory procedures in ... – Assessors • Screened and ... to ensure consistency

-20

-10

0

10

20

30

-30 -20 -10 0 10 20 30

D2

23.7

%

c-C1

i-C1r-C1

e-C1

m-C1a-C1 g-C1

p-C1

b-C1

h-C1

q-C1

l-C1

d-C1

k-C1

s-C1

j-C1

f-C1

o-C1

IDEAL

c-Wr-W

e-Wm-W

a-W

g-W

p-Wb-W

h-W

q-W

d-W

k-W

s-Wj-W

f-W

o-W

c-C3

c-C2e-C2

m-C2

a-C2

p-C2

b-C2

h-C2

d-C2

f-C2

Amount of blemishes

Moistness

Depth of Ext Colour

Oiliness

Strength of Flavour

Smoothness

Thickness

Crispness

Trending Product Variation ofthe Key Sensory Attributes vConsumers’ Ideal

Site WComp 1

Comp 2

i-W

Production Time Points denotedby letters:a=Dec-07b=Feb-08c=Apr-08d=Jun-08e=Aug-08f=Oct-08g=Dec-08h=Feb-09i=Apr-09j=May-09k=Jun-09

l=Jul-09m=Aug-09n=Oct-09ao=Oct-09bp=Dec-09q=Feb-10r=Apr-10s=Jun-10

Trend Analysis

Page 21: Setting up and gaining acceptance of formal sensory ... · Setting up and gaining acceptance of formal sensory procedures in ... – Assessors • Screened and ... to ensure consistency

-20

-10

0

10

20

30

-30 -20 -10 0 10 20 30

c-C1

i-C1r-C1

e-C1

m-C1a-C1 g-C1

p-C1

b-C1

h-C1

q-C1

l-C1

d-C1

k-C1

s-C1

j-C1

f-C1

o-C1

c-Wr-W

e-Wm-W

a-W

g-W

p-Wb-W

h-W

q-W

d-W

k-W

s-Wj-W

f-W

o-W

c-C3

c-C2e-C2

m-C2

a-C2

p-C2

b-C2

h-C2

d-C2

f-C2

Amount of blemishes

Moistness

Depth of Ext Colour

Oiliness

Strength of Flavour

Smoothness

Thickness

Crispness

Trending Product Variation vConsumers’ Overall Liking

Site WComp 1

Comp 2

i-WMost LikedLeast Liked

Overall LikingIDEAL

Production Time Points denotedby letters:a=Dec-07b=Feb-08c=Apr-08d=Jun-08e=Aug-08f=Oct-08g=Dec-08h=Feb-09i=Apr-09j=May-09k=Jun-09

l=Jul-09m=Aug-09n=Oct-09ao=Oct-09bp=Dec-09q=Feb-10r=Apr-10s=Jun-10

Trend Analysis

Page 22: Setting up and gaining acceptance of formal sensory ... · Setting up and gaining acceptance of formal sensory procedures in ... – Assessors • Screened and ... to ensure consistency

Selling the Benefits

• Control of Sensory Quality– Reduced sensory quality variation– avoid development of serious quality issues by

detecting early development of off-flavours– Efficient trouble-shooting via precise descriptions of

quality deviations

• Brand Equity– Maintenance of quality margin over competitors– Retain consumer loyalty– Maintain brand image

22

Page 23: Setting up and gaining acceptance of formal sensory ... · Setting up and gaining acceptance of formal sensory procedures in ... – Assessors • Screened and ... to ensure consistency

Selling the Benefits

• Aid Production Practices and Efficiency

– Reduced held, reworked, rejected product

– Maintain customer contracts

– Improve product / system knowledge

– Wider ownership of quality across work force

– Build on current team working practices e.g. Kaizen

23

Page 24: Setting up and gaining acceptance of formal sensory ... · Setting up and gaining acceptance of formal sensory procedures in ... – Assessors • Screened and ... to ensure consistency

Future Opportunities• Sensory can become

focus and symbol oftotal quality culture(everyone can own)

• Sensory QC and QAcan become integraltool to improve productand process

• Two-waycommunications betweenProduction, ProductDevelopment andMarketing

24

Marketing

ProductionNPD

Productand ProcessKnowledge

Page 25: Setting up and gaining acceptance of formal sensory ... · Setting up and gaining acceptance of formal sensory procedures in ... – Assessors • Screened and ... to ensure consistency

Developing contexts –Measurement Automation

• Sensory validation of online quality assessments

– e.g. fruit packhouse non-destructive testing

• NIR (sugars, etc.), firmness (e.g. Sinclair IQ), colour, etc.

25

source: www.sacmi.com source: www.sinclair-intl.com

Page 26: Setting up and gaining acceptance of formal sensory ... · Setting up and gaining acceptance of formal sensory procedures in ... – Assessors • Screened and ... to ensure consistency

• Production automation

– How to work with factories with only one or twooperatives?

• Language

– multilingual QC staff and global products

• Sensory assessment and job description

– Should sensory abilities be part of a production orQC operative’s recruitment criteria?

ImageSource:Microsoft

Developing contexts – People

26

Page 27: Setting up and gaining acceptance of formal sensory ... · Setting up and gaining acceptance of formal sensory procedures in ... – Assessors • Screened and ... to ensure consistency

Conclusion

• The opportunity is ripe to establish sensory science’scredibility in the production environment

• Challenges are many• But if the framework is strong and clear, new

opportunities can be leveraged, and challengesaddressed

----------------• Qualities of the Sensory Professional: part scientist,

part business manager, part human resource expertAND also part visionary with a continual focus onthe horizon (Galvin & Waldrop. Food Technology Jan 1990) …….Now never more so!

27