Can you Trust your Process Capability Studies...Process Capability rule of thumb: – Cpk > 1.50...

16
Cowtown Quality Roundup - 2018 uality Q John Breckline – Key Quality Can you Trust your Process Capability Studies John Breckline April 20, 2018 Cowtown Quality Roundup - 2018 uality Q John Breckline – Key Quality 75 Minute Agenda Introduction to PCS Customer Perspective Capability Defined Short-Term v. Long-Term Measurement Issues Distribution Issues Conducting Studies Interpretation of Study Conclusions & Actions Wrap Up – Q&A 2 Process Capability Studies (PCS)

Transcript of Can you Trust your Process Capability Studies...Process Capability rule of thumb: – Cpk > 1.50...

Page 1: Can you Trust your Process Capability Studies...Process Capability rule of thumb: – Cpk > 1.50 Process is Six Sigma – Cpk > 1.00 All Product Meets Requirements – Cpk =

Cowtown Quality Roundup - 2018ualityQJohn Breckline – Key Quality

Can you Trust yourProcess Capability Studies

John Breckline April 20, 2018

Cowtown Quality Roundup - 2018ualityQJohn Breckline – Key Quality

75 Minute Agenda

• Introduction to PCS• Customer Perspective• Capability Defined

• Short-Term v. Long-Term• Measurement Issues• Distribution Issues

• Conducting Studies• Interpretation of Study• Conclusions & Actions

• Wrap Up – Q&A

2

Process Capability Studies (PCS)

Page 2: Can you Trust your Process Capability Studies...Process Capability rule of thumb: – Cpk > 1.50 Process is Six Sigma – Cpk > 1.00 All Product Meets Requirements – Cpk =

Cowtown Quality Roundup - 2018ualityQJohn Breckline – Key Quality

Statistical Thinking Map

DesignFMEA

ProcessFMEA

ProcessControl

DefineCritical

Characteristics

ApprovalPlanning

MeasurementSystemAnalysis

ProcessCapabilityStudies

ProcessImprovement

ControlPlan

ProcessCapable

Yes

No

StatisticalProcessControl

3

Cowtown Quality Roundup - 2018ualityQJohn Breckline – Key Quality

Data Use

Why Collect and Track Data

– Data Information Decision

– Understand – Evaluate – Control – Predict

Objective of Capability Studies

– Predict the performance of a process to specifications

– Provide short-term capability (Cpk)

– Predict long-term performance (Ppk)

– Baseline for improving the process

4

Page 3: Can you Trust your Process Capability Studies...Process Capability rule of thumb: – Cpk > 1.50 Process is Six Sigma – Cpk > 1.00 All Product Meets Requirements – Cpk =

Cowtown Quality Roundup - 2018ualityQJohn Breckline – Key Quality

Why care about Process Capability?

• Satisfy our customers

• Understand our processes

• Prioritize areas for quality improvement

• variation reduction activities

• Verify that process improvements are successful

• Track improvements over time

• Give us information to set realistic tolerances

• Help us identify how to cost products

• Select the best qualified supplier

• Improve our company Bottom Line

5

Cowtown Quality Roundup - 2018ualityQJohn Breckline – Key Quality

Process Capability Studies

Definition– Process Capability refers to the capability of a process

to consistently make a product (outputs) that meetscustomer specifications.

– Capability Indices are used to predict performance of aprocess by comparing the width of process variation tothe width of specification tolerances.

– Higher level indices include a ‘centering’ calculation

6

Page 4: Can you Trust your Process Capability Studies...Process Capability rule of thumb: – Cpk > 1.50 Process is Six Sigma – Cpk > 1.00 All Product Meets Requirements – Cpk =

Cowtown Quality Roundup - 2018ualityQJohn Breckline – Key Quality

Process Capability Roadmap

Improve

Improve

Select Characteristic

Study ScopeShort-term - Long-term

MeasurementCapability?

Is ProcessStable?

UnderstandConfidence Interval(based on sample size)

Improve /Transform

Segregate/Understand

ImproveProcess

Is DataNormal?

Maintain the Gain

MultipleSources?

Cpk / PpkAcceptable?

OK

No

No

Poor

Yes

OK

N/A

OK

Yes

No

7

Cowtown Quality Roundup - 2018ualityQJohn Breckline – Key Quality

Key Characteristics

What is Important• to End Customer• to Manufacturers• to Company Operations• to Supplier Operations

Identifying Characteristics• Design FMEA• Early Supplier Involvement• Process FMEA• White / Black Diamond Designation

8

Page 5: Can you Trust your Process Capability Studies...Process Capability rule of thumb: – Cpk > 1.50 Process is Six Sigma – Cpk > 1.00 All Product Meets Requirements – Cpk =

Cowtown Quality Roundup - 2018ualityQJohn Breckline – Key Quality

Key Process Characteristics

Measurement Machine Methods

. .

Mother Earth ManMaterials

9

Cowtown Quality Roundup - 2018ualityQJohn Breckline – Key Quality

Performance vs. Requirements

Requirements

– Customer Specifications

– Internal Operating Control Levels

– Compare Performance to Requirements

1615141312111098

USLLSL

O

10

Page 6: Can you Trust your Process Capability Studies...Process Capability rule of thumb: – Cpk > 1.50 Process is Six Sigma – Cpk > 1.00 All Product Meets Requirements – Cpk =

Cowtown Quality Roundup - 2018ualityQJohn Breckline – Key Quality

Normal Curve – Area Under the Curve

Normal Curve• Accounts for Common Cause variation – 99.97%

average+2 sigma

average-2 sigma

13.60 % 13.60 %

average-3 sigma

average+3 sigma

2.14 %2.14 %

0.13 % 0.13 %

Upper naturallimit (UNL)

Lower naturallimit (LNL)

average average+1 sigma

average-1 sigma

34.13 %34.13 %

11

Cowtown Quality Roundup - 2018ualityQJohn Breckline – Key Quality

Process Capability Ratios

Voice of The Customer

Voice of The Process

USLLSL

Voice of the CustomerVoice of the Process

Process RangeSpecification Range

LSL USL

Capability Ratio:comparison of the capability of a process to the specification limits

12

Page 7: Can you Trust your Process Capability Studies...Process Capability rule of thumb: – Cpk > 1.50 Process is Six Sigma – Cpk > 1.00 All Product Meets Requirements – Cpk =

Cowtown Quality Roundup - 2018ualityQJohn Breckline – Key Quality

Short-Term / Long-Term

Time

LSL

USLShort-term capability

13

Long-term capability

Cowtown Quality Roundup - 2018ualityQJohn Breckline – Key Quality

Process Capability

• Cpk – ratio to the smallestvalue (USL/LSL)

• Ppk – ratio to the smallestvalue (USL/LSL)

How it’s measured

• Cp – capability index

• Pp – performance index

14

Page 8: Can you Trust your Process Capability Studies...Process Capability rule of thumb: – Cpk > 1.50 Process is Six Sigma – Cpk > 1.00 All Product Meets Requirements – Cpk =

Cowtown Quality Roundup - 2018ualityQJohn Breckline – Key Quality

The Sources of Variation

Process/System

Customer Satisfaction

Environment

Measurement

Man

Material

Machine

Methods

15

Cowtown Quality Roundup - 2018ualityQJohn Breckline – Key Quality

Measurement Machine Methods

Output

Mother Earth ManMaterials

Process Capability

Long Term vs. Short Term Variation

5 Min Variation

10 Hr Variation

6 Mo Variation

Short Term

Long Term

Performance

16

Page 9: Can you Trust your Process Capability Studies...Process Capability rule of thumb: – Cpk > 1.50 Process is Six Sigma – Cpk > 1.00 All Product Meets Requirements – Cpk =

Cowtown Quality Roundup - 2018ualityQJohn Breckline – Key Quality

Measurement

Measurement Systems Analysis (MSA)• Gage Repeatability & Reproducibility (GR&R)

Variable GR&R• Understand capability of measurement

• Percent of Contribution – Variance• Percent of Study – Std Dev• Percent of Tolerance (P/T Ratio) ****• Effect of sample selection• <10% acceptable• 10-30% marginal• >30% high risk

17

Cowtown Quality Roundup - 2018ualityQJohn Breckline – Key Quality

Variable Gage R&R

average

Observed =Variability

Observedvalues

total2

ProductVariability

Product Variability

product2 systemtmeasuremen

2+ Measurement Variability

Measurement Variability- Additive -

18

Page 10: Can you Trust your Process Capability Studies...Process Capability rule of thumb: – Cpk > 1.50 Process is Six Sigma – Cpk > 1.00 All Product Meets Requirements – Cpk =

Cowtown Quality Roundup - 2018ualityQJohn Breckline – Key Quality

Distributions:– Not all distributions are Normal

– Exponential Distribution is common for one-sided specs

• Flatness – PPB – many other

– Predictive statistics require Normal Distributions

Basic Statistics… Distributions

Normal Distribution – not perfect Exponential Distribution

19

Cowtown Quality Roundup - 2018ualityQJohn Breckline – Key Quality

Central Limit Theorem

Concept– The sample mean become normally distributed as sample

size increases– The spread of the sample means are less than the spread

of the individuals of the sample

Value– Non-normal distributions can be assessed using normal

distribution statistics and tools (Cpk, SPC, etc.)– Most inferential statistical tools assume normality of data

• Confidence Intervals• SPC / Control Charts

20

Page 11: Can you Trust your Process Capability Studies...Process Capability rule of thumb: – Cpk > 1.50 Process is Six Sigma – Cpk > 1.00 All Product Meets Requirements – Cpk =

Cowtown Quality Roundup - 2018ualityQJohn Breckline – Key Quality

Antenna AssemblyLong Term Process Capability

-150%

-100%

-50%

0%

50%

100%

150%

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16

Tool Wear Direction

Locating Slot Width Upper Crush Rib Snap Height

Upper Spec

Lower Spec

Nom-

X

XX

SuggestedMonitoring

XX

X

X

X

X

XX

X

Lower Crush Rib

X

AssemblyFeatures

Understand Your Process

21

Cowtown Quality Roundup - 2018ualityQJohn Breckline – Key Quality

Process Capability Roadmap

Improve

Improve

Select Characteristic

Study ScopeShort-term - Long-term

MeasurementCapability?

Is ProcessStable?

UnderstandConfidence Interval(based on sample size)

Improve /Transform

Segregate/Understand

ImproveProcess

Is DataNormal?

Maintain the Gain

MultipleSources?

Cpk / PpkAcceptable?

OK

No

No

Poor

Yes

OK

N/A

OK

Yes

No

22

Page 12: Can you Trust your Process Capability Studies...Process Capability rule of thumb: – Cpk > 1.50 Process is Six Sigma – Cpk > 1.00 All Product Meets Requirements – Cpk =

Cowtown Quality Roundup - 2018ualityQJohn Breckline – Key Quality

Conducting Capability Studies

Preparation:– Select ‘critical to customer’ characteristics

– Assure validity of specifications

– Assure capability of measurement system (GR&R & P/T)

– Assure process stability at time of study – document ?

– Study Run / Data Collection (sampling plan)• Process Potential – 30+ Consecutive Pieces

– Cannot truly calculate Ppk or predict long term performance

• Short Term Study – n=5 for a day (20 groups of n)– Ppk statistics used to predict long term performance

• Long Term Study – extract data from ongoing SPC– Cpk and Ppk values will effectively be the same – actual long-term

23

Cowtown Quality Roundup - 2018ualityQJohn Breckline – Key Quality

Conducting Capability Studies

Analysis / Action:– Process data – include specification– Check stability – run chart analysis– Check normality – visual, probability plot, statistic

– THEN– Determine Cpk & Ppk as appropriate

• Must understand process conditions and limitations• Ppk is an estimate

– Determine actions to improve or maintain

24

Page 13: Can you Trust your Process Capability Studies...Process Capability rule of thumb: – Cpk > 1.50 Process is Six Sigma – Cpk > 1.00 All Product Meets Requirements – Cpk =

Cowtown Quality Roundup - 2018ualityQJohn Breckline – Key Quality

Stability25

Cowtown Quality Roundup - 2018ualityQJohn Breckline – Key Quality

Stability

– Without stability, cannot use data as a predictor of future

– Special Causes create instability – removal for study?

Normality:

– Calculations are based on Normal Distribution

– Further from ‘normal’ less accurate totally invalid

– Calculation Tests (p-value) & Probability Plotting

Stability & Normality

Stability Question Normality Question

26

Page 14: Can you Trust your Process Capability Studies...Process Capability rule of thumb: – Cpk > 1.50 Process is Six Sigma – Cpk > 1.00 All Product Meets Requirements – Cpk =

Cowtown Quality Roundup - 2018ualityQJohn Breckline – Key Quality

Is itNormal?

Is ItNormal?

How does theprocessvariation

compare tothe

spec limits?

Is it incontrol?(stable)

What dothe last 25

groupslook like?

Is it incontrol?(stable)

0 10 20 30 40 50

16

20

24

28Xbar and R Chart

Subgr

Me

an

s

X=22.03

3.0SL=26.83

-3.0SL=17.22

0

4

8

12

Ra

ng

es

R=4.699

3.0SL=12.10

-3.0SL=0.000

30 40 50

Last 25 Subgroups

14

19

24

29

Subgroup Number

Va

lue

s

18 25

Ppk: 0.35Pp: 0.41StDev: 2.84609Overall (LT)

Cpk: 0.36Cp: 0.42StDev: 2.77561Potential (ST)

Capability PlotProcess Tolerance

Specifications

I I I

I I I

I I I

ST

LT

15 20 25

Normal Prob Plot

14 22 30

Capability Histogram

Process Capability Sixpack for Thickness

Minitab Capability Sixpack27

Cowtown Quality Roundup - 2018ualityQJohn Breckline – Key Quality

Minitab Capability Summary

1615141312111098

USLLSL

Process Capability Analysis for CO2-Long

PPM Total

PPM > USL

PPM < LSL

PPM Total

PPM > USL

PPM < LSL

PPM Total

PPM > USL

PPM < LSL

Ppk

PPL

PPU

Pp

Cpm

Cpk

CPL

CPU

Cp

StDev (Overall)

StDev (Within)

Sample N

Mean

LSL

Target

USL

34.07

34.05

0.02

0.00

0.00

0.00

0.00

0.00

0.00

1.33

1.84

1.33

1.58

*

2.18

3.01

2.18

2.59

0.842976

0.514069

155

12.6426

8.0000

*

16.0000

Exp. "Overall" PerformanceExp. "Within" PerformanceObserved PerformanceOverall Capability

Potential (Within) Capability

Process Data

Within

Overall

28

Page 15: Can you Trust your Process Capability Studies...Process Capability rule of thumb: – Cpk > 1.50 Process is Six Sigma – Cpk > 1.00 All Product Meets Requirements – Cpk =

Cowtown Quality Roundup - 2018ualityQJohn Breckline – Key Quality

Process Capability

Process Capability rule of thumb:– Cpk > 1.50 Process is Six Sigma

– Cpk > 1.00 All Product Meets Requirements

– Cpk = 1.00 Most Product Meets Requirements

– Cpk < 1.00 Some Product Does Not Meet Requirements

– Ppk typically 0.33 less than Cpk

Note: Above calculates take in 1.5 s shift of mean over time

What are YOUR standards for Cpk ?What is difference between Cpk & Ppk in YOUR PROCESSES?

29

Cowtown Quality Roundup - 2018ualityQJohn Breckline – Key Quality

Process Capability

Objective of Process Capability Analysis– Determine how the natural process limits compare with the

specification range

– Depending on the comparison to standard:

Study Outcome

Do nothing -1- -2- Change the specs

Center the process -3- -4- Reduce process variability

-5-

Accept the losses

30

Page 16: Can you Trust your Process Capability Studies...Process Capability rule of thumb: – Cpk > 1.50 Process is Six Sigma – Cpk > 1.00 All Product Meets Requirements – Cpk =

Cowtown Quality Roundup - 2018ualityQJohn Breckline – Key Quality

Statistical Thinking Map

DesignFMEA

ProcessFMEA

ProcessControl

DefineCritical

Characteristics

ApprovalPlanning

MeasurementSystemAnalysis

ProcessCapabilityStudies

ProcessImprovement

ControlPlan

ProcessCapable

Yes

No

StatisticalProcessControl

31

Cowtown Quality Roundup - 2018ualityQJohn Breckline – Key Quality

John Breckline

Retired but…

Motorola: Auto Electronics, Commercial, Telecom (pagers)

Nokia: MBB / Continuous Improvement Manager

AT&T: MBB – Transactional / Lean Projects

ASQ Certifications: CQE (87), CBB (03), CSQP (17)

Certification Preparation Instructor since 1997

30+ years in Quality Disciplines

– Inspection, Sampling, Data Systems

– SPC, Measurement, Supplier Quality

– Quality Systems Management

– Six Sigma Master Black Belt

Fort Worth TX Mobile: 817-401-0412

email: [email protected]