Creating QbD / PAT Management Awareness - ISPE … · Creating QbD / PAT Management Awareness ISPE...
Transcript of Creating QbD / PAT Management Awareness - ISPE … · Creating QbD / PAT Management Awareness ISPE...
Creating QbD / PAT , Dated September 27, 2007, V1.0 page 2 of 67 ISPE-PAT-CoP-DACH-Awareness-Doc-Final-V1.0
Contents 1 Management Summary.................................................................................................. 4
1.1 Objective ................................................................................................................. 4 1.2 Current situation in pharmaceutical industry ..................................................... 4 1.3 How to build Quality into Processes and Products? ......................................... 4 1.4 Strategic benefit of QbD / PAT-Projects .............................................................. 4
2 Why PAT - Drivers and Benefits ................................................................................... 6 2.1 FDA Drivers............................................................................................................. 6 2.2 FDA Benefits........................................................................................................... 6 2.3 Industry Drivers...................................................................................................... 6 2.4 Industry benefits .................................................................................................... 6
3 Implications of PAT - Organization and Process........................................................ 6 3.1 Organization ........................................................................................................... 6
3.1.1 Personnel........................................................................................................ 6 3.1.2 Management ................................................................................................... 6 3.1.3 QA Approach.................................................................................................. 6
3.2 Process ................................................................................................................... 6 3.2.1 Process Understanding................................................................................. 6 3.2.2 QA/QC ............................................................................................................. 6 3.2.3 Technology..................................................................................................... 6 3.2.4 IT ...................................................................................................................... 6
4 Project Approach and Case Studies ............................................................................ 6 4.1 Introduction ............................................................................................................ 6 4.2 Questionnaires ....................................................................................................... 6 4.3 Case study results ................................................................................................. 6
4.3.1 Quality ............................................................................................................. 6 4.3.2 Process ........................................................................................................... 6 4.3.3 Risk.................................................................................................................. 6 4.3.4 Cost ................................................................................................................. 6 4.3.5 Personnel........................................................................................................ 6 4.3.6 Tools................................................................................................................ 6 4.3.7 Time................................................................................................................. 6 4.3.8 Validation ........................................................................................................ 6 4.3.9 Organization ................................................................................................... 6 4.3.10 Regulatory .................................................................................................... 6
4.4 Summary................................................................................................................. 6 5 Appendix: Structured Catalogue of Standardised Questions with
Benchmarking ......................................................................................................... 6 5.1 Quality (category 1)................................................................................................ 6 5.2 Process (category 2).............................................................................................. 6 5.3 Risk (category 3) .................................................................................................... 6 5.4 Costs (category 4).................................................................................................. 6 5.5 Personnel (category 5) .......................................................................................... 6
Creating QbD / PAT , Dated September 27, 2007, V1.0 page 3 of 67 ISPE-PAT-CoP-DACH-Awareness-Doc-Final-V1.0
5.6 Tools (category 6) .................................................................................................. 6 5.7 Time (category 7) ................................................................................................... 6 5.8 Validation (category 8)........................................................................................... 6 5.9 Organization (category 9)...................................................................................... 6 5.10 Regulatory (category 10) ..................................................................................... 6
6 Appendix: Project Approach and Case Studies -- completed questionaires .......... 6 6.1 Case Studies 1 to 2 ................................................................................................ 6 6.2 Case Studies 3 to 6 ................................................................................................ 6 6.3 Case Studies 7 to 8 ................................................................................................ 6
7 Volunteers....................................................................................................................... 6 8 Glossary .......................................................................................................................... 6
Creating QbD / PAT , Dated September 27, 2007, V1.0 page 4 of 67 ISPE-PAT-CoP-DACH-Awareness-Doc-Final-V1.0
1 Management Summary
1.1 Objective The objective of this document is to create awareness about the FDAs QbD/PAT initiative and its benefits. It describes
• Drivers and Benefits
• How to benchmark QbD/PAT projects
• Case studies
1.2 Current situation in pharmaceutical industry Nowadays innovations in the pharmaceutical industry are limited due to regulatory aspects which inhibit the introduction of new and state of the art technologies in validated processes.
The processes are fixed during clinical trials. Process parameters and quality attributes are part of the registration file (licence). Most variations require change controls. Changes require a lot of effort like pre-approval, additional clinical trials and registration activities.
Validated processes are inflexible to process optimisation measures or changes in feedstock by suppliers. For example, bio-feed-stocks are difficult to handle under GMP conditions due to regional and seasonal variations. During the product life cycle, process innovations with the target to improve product quality continuously is related to high cost when changing the registration file with the authorities.
To reduce this effort in the different areas of the pharmaceutical industry the FDA recommends to build quality into processes and products. This is a paradigm change with respect to the earlier way of final product quality testing.
1.3 How to build Quality into Processes and Products? To build quality into processes and products the authorities recommend to use principles and tools as QbD/PAT. This is an innovative way of thinking in developing and manufacturing pharmaceuticals. Pharmaceutical manufacturers should implement innovative and state of the art technologies to improve the production systems and for a sustainable cost reduction. QbD/PAT ensures constant and high product quality on the basis of flexible manufacturing processes. Thorough process understanding in combination with a well defined Design Space allows much more flexible process control strategies even if input parameters will vary. Regulatory authorities do not consider variability of the operating conditions within predefined limits (Design Space) as changes.
1.4 Strategic benefit of QbD / PAT-Projects Being aware of the regulatory flexibility industry can actively redefine their strategies applying QbD/PAT principles. Better process understanding leads to higher product quality and process robustness at lower costs and thus improves competitiveness.
Creating QbD / PAT , Dated September 27, 2007, V1.0 page 5 of 67 ISPE-PAT-CoP-DACH-Awareness-Doc-Final-V1.0
Authority view Commercial Management view More pharmaceuticals • Time-to-market
• More Innovation with higher quality • Reduced documentation
• Optimized communication between authorities and industry
• Guaranteed quality level ("unit-to-unit") at lower cost • Decreasing cost of production by improved productivity Further on: Competitive advantage
Image improvement Existing data and resources can typically be used
Authorities view corresponds to Commercial Management view and the common goals can be reached by QbD / PAT as an innovative way of thinking in manufacturing pharmaceuticals.
Creating QbD / PAT , Dated September 27, 2007, V1.0 page 6 of 67 ISPE-PAT-CoP-DACH-Awareness-Doc-Final-V1.0
2 Why PAT - Drivers and Benefits The goal of the PAT approach is to ensure patient health by the availability of safe, effective and affordable medicines.
This section summarizes and comments PAT drivers and benefits from the perspective of the FDA (and other regulatory authorities) and the pharmaceutical industry to help decision makers interpreting and implementing PAT strategy, processes and tools in their organizations.
2.1 FDA Drivers
• Assurance of affordable and safe & effective drugs for citizens • Ensuring high quality of drugs • Facilitating innovation for manufacturing processes
Only efficient research of new drugs, optimized processes and dedicated quality control procedures will provide in future affordable, safe & effective drugs for citizens. The implementation of PAT principles and tools enables efficient manufacturing while maintaining today’s quality standards.
Drug quality depends more on best development, production, storage and distribution strategies, than on expanded quality testing. With PAT there will be a shift from lab based end product quality testing to in-line, on-line or at-line testing.
Innovation transfer to routine production ensuring “state-of-the-art” manufacturing processes will be accelerated by regulatory authorities.
2.2 FDA Benefits
• Time-to-approval • Improved process understanding • Reduced inspection frequency
Time-to-market means in a first step „time-to-approval“. Regulatory authorities are commited to reduce time for administration by reduced volumes of CMCs / dossiers for new drugs as well as for submission changes of approved drugs. The key to reach this goal is appropriate management of increasing complexity.
Improved process understanding helps both industry and authority running, controlling and observing processes on a well assessed science and risk based level. Process understanding is
Drivers BenefitsQbD/PAT
Industry
Regulatory
Drivers BenefitsQbD/PAT
Industry
Regulatory
Creating QbD / PAT , Dated September 27, 2007, V1.0 page 7 of 67 ISPE-PAT-CoP-DACH-Awareness-Doc-Final-V1.0
the basis for process control and assured end product quality. Finally, time and frequency for extended audits or inspections can be reduced.
2.3 Industry Drivers
• Reduced costs of manufacturing • More flexible manufacturing processes • Real-time-release
PAT efforts could generate competitive advantages, i.e. better corporate image, increased quality and efficient management of risks. Cost of manufacturing or QA could be decreased by increasing productivity and better availability of production equipment. Moreover PAT offers the opportunity for interdisciplinary communication (e.g. R&D, manufacturing, QA, QC, IT departments).
Manufacturing processes could become more safe and flexible under PAT. A defined design space (Quality by design) for production processes offers flexibility for the used raw material, APIs and even process controls. Process understanding leads to an appropriate management of variability and improved operational efficiency (e.g.“Lean Manufacturing”, “Right first time” strategy). Real time release could help reducing time in warehouses of raw materials, final & intermediate products or bulk (work in progress). PAT projects can start in single unit operations or could cover the whole production site. Incremental deployment is enabled.
Improved communication between industry and the regulatory authorities is provided by FDA´s PAT teams („pre-approval“ activities). By implementing PAT tools and principles industry is prepared in case PAT becomes mandatory. International harmonisation by ICH guidelines Q 8 to 10 defines many PAT elements as today’s GMP standards.
2.4 Industry benefits
• Using of „state-of-the-art“ technologies in manufacturing • Guaranteed and improved quality level ("unit-to-unit") • Reduced documentation • Risk mitigation • Real time data acquisition and integration • Knowledge management
Implementation of „state-of-the-art“ and innovative production & control technology is encouraged by regulatory authorities. Know how transfer from other industries (as IT, food, automotive, electronic) is reasonable and useful. Reduced transfer time from development to production by using PAT tools seems to be possible.
Reduced personnel placement, less OOS batches, reduced lead time, cleaning, set-up or maintenance time lead to increased ROI. At the end a higher quality level of products will be obtained and yield can be increased.
Creating QbD / PAT , Dated September 27, 2007, V1.0 page 8 of 67 ISPE-PAT-CoP-DACH-Awareness-Doc-Final-V1.0
The use of PAT tools can reduce documentation efforts, e.g. by modified validation approaches. Risk based manufacturing could abandon frequent audits.
Early and frequent feedback from regulatory authority, e.g. by PAT teams and expanded communication within pre-approval activities is mandatory for successful PAT projects.
PAT has the potential for drug quality improvement. Increased production safety and process robustness is created by enhanced process understanding within all departments (QA, QC, R&D and Manufacturing). Risk mitigation by efficient risk management and the appropriate control of critical quality & process parameters is the outcome of adequate implementation of PAT tools.
Raised automation of processes helps to assess and control critical process parameters within the design space. Fewer lab based testing leads to fast and reliable information about product quality within manufacturing processes. Data should be all time available, auditable and autarkic. Enhanced process information will be created by structured data management. The process know how can be documented by process fingerprints, statistical methodology or a total process approach (e.g. downstream, upstream, tablet production). Knowledge management is the basis for better process understanding and process transfer from development and manufacturing.
QbDPAT
plan
check
act do
process
product
QbDPAT
plan
check
act do
process
product
Creating QbD / PAT , Dated September 27, 2007, V1.0 page 9 of 67 ISPE-PAT-CoP-DACH-Awareness-Doc-Final-V1.0
3 Implications of PAT - Organization and Process
QbD/PATimplications
ProcessOrganisation
Personnel
ManagementUnderstanding
TechnologyIT
Quality
QbD/PATimplications
ProcessOrganisation
Personnel
ManagementUnderstanding
TechnologyIT
Quality
3.1 Organization
3.1.1 Personnel • Demand on qualification and/or skills of employees may change
PAT may have an impact on qualification profiles in respect to scientific data analysis, statistics, process control, etc. Similar to implementing Six Sigma, implementing a PAT program may require dedicated training on methods and tools, including project management and statistics. (Probably at all levels of the company comparable with the Six Sigma training structure - master black belts, black belts, green belts, white belts?).
• Structural change within organization
There may be a need for implementation of a new department or restructuring of departments to deal with the new demands.
Interaction and collaboration between departments and functions may need to be increased (e.g. quality, regulatory, development, commercial production, etc.).
Contact to regulatory authorities may need to be intensified.
The implementation of PAT within the organizational structure requires accountability, roles and responsibilities to be defined (Clearly defined process owners, project managers, subject matter experts and process analysts).
Depending on the structure of the company, employees working for a PAT project could stay members of different departments or be integrated in a separate PAT-team or department.
Creating QbD / PAT , Dated September 27, 2007, V1.0 page 10 of 67 ISPE-PAT-CoP-DACH-Awareness-Doc-Final-V1.0
Depending on the PAT approach (holistic or more specialized) an interdisciplinary project team maybe useful (QA, R&D, engineering, QC, IT, manufacturing, etc.).
3.1.2 Management • Commitment of management:
Management has to be committed to PAT to deal with the early phase of PAT, which could mean more investment.
In later phases, when processes are more flexible due to PAT elements, companies will be able to maintain quality at lower cost, and will be prepared for future demands from agencies and be on top of the trend.
• Define PAT and development strategy:
Define general approach.
Define team.
Define which processes or products should be subjected to PAT first.
Define goals and objectives and the expected benefits.
Plan and commit resources (personnel, program money, equipment).
PAT means a paradigm shift from black/grey box to white box processes.
The development strategy may need to be revised – therefore, the specific requirements concerning PAT need to be analyzed.
• Risk concerning company:
If PAT is ignored, there may be a risk of getting behind the industry (competitive disadvantage), a risk of image or business loss due to lower operational efficiency in sustaining reproducible product quality.
• Management objectives: Regular review of benchmarks helps to stay on top of the project.
• Outsourcing:
Outsourcing partners need to be chosen and reviewed very carefully. Points to consider are: - Their ability to perform projects according to PAT. - Knowledge transfer (content, interfaces, patent, etc.). - Define accountabilities, roles and responsibilities. - Communicational structure. There may be an increased need for secrecacy agreements and/or more detailed contracts.
• Communication
Communication between all kinds of different partners (e.g. departments departments, vendor company company, company agencies, etc.) may need to be intensified.
Creating QbD / PAT , Dated September 27, 2007, V1.0 page 11 of 67 ISPE-PAT-CoP-DACH-Awareness-Doc-Final-V1.0
3.1.3 QA Approach • There may be an impact on existing QA structure. • Change in regulatory processes
Communication between regulatory authorities may have to start earlier and may be more regular (and possibly more informal) with PAT.
• Audits
Regulatory scrutiny will challenge the scientific understanding of quality relevant factors and how quality relevant risks are mitigated. Developing departments will get increasingly more attention from regulatory authorities. Continuous improvement and a clear structure for documenting changes and deviations need to be demonstrated. Comparison between real design space and documented design space will be in focus of an audit.
• Validation
Validation will be demonstrated by continuous measurement of critical-to-quality parameters in real/near time instead of the traditional three batch validation.
• Documentation
Better knowledge of impact of raw material may change specifications.
Specifications for submissions probably need to include design space and control space.
3.2 Process The QbD/PAT approach links the four areas of Process Understanding, QA/QC, Technology and IT together. This is the core of the QbD/PAT paradigm shift, linking these areas together.
The process is controlled and fully understood and the right data for real time release enables continuous process verification and improvement via knowledge management.
3.2.1 Process Understanding • Development of process models:
The analysis of the process should define which parts have some flexibility (Design space) and which are very rigorous.
In order to define system/process boundaries, (re-)structuring of complex processes may be helpful.
• Situation analysis is the evaluation of historical data (out of specification results, corrective actions.
• Impact analysis is the identification and evaluation of process steps, sources of variation and the variables that are critical to quality.
• Identification of critical process parameters are needed to be determined using appropriate techniques (e.g. FMEA, statistical analysis, risk analysis, root cause analysis, etc.).
• Monitoring/controlling of the process through definition and implementation of relevant measurements. This is necessary to obtain data which can be reviewed for better process/product understanding and control.
Creating QbD / PAT , Dated September 27, 2007, V1.0 page 12 of 67 ISPE-PAT-CoP-DACH-Awareness-Doc-Final-V1.0
• Verification of the control cycle is necessary to understand the impact of process parameters on process/product quality.
3.2.2 QA/QC • Specifications
Quality control testing will evolve from testing against a discrete specification (pass/fail) to real-time comparison of process/product signatures against a reference.
• QC testing
Parametric release and inline control could have an impact on QC headcount and work. There may be a necessity for additional verification of parameters and definition of prerequisites for parametric release. In order not to miss a slow deviation from expected requirements (e.g. raw material, wear of material, etc.) additional controls may be needed.
• Continuous improvement
Under PAT, manufacturing processes are monitored and controlled online, leading to continuous process improvements as opposed to static process validation. Continuous improvement and control of design space will be increasingly important.
• Validate equipment including the control cycle
In contrast to the common validation approach, where testing the functionality of the immediate equipment was sufficient, with PAT the complete control cycle of the equipment has to be included.
3.2.3 Technology • Continuous production
New equipment may be needed to enhance data acquisition and process understanding. Better knowledge of the process could lead to continuous production and faster release. Due to design space, production equipment could be used more flexible.
• Availability of suitable sensors/methods
After identification of critical process parameters availability of suitable sensors and methods has to be verified.
• Interface systems engineering product engineering
Since all parameters of a process have to be well understood system engineers and product engineers will probably have to work together more closely.
Creating QbD / PAT , Dated September 27, 2007, V1.0 page 13 of 67 ISPE-PAT-CoP-DACH-Awareness-Doc-Final-V1.0
3.2.4 IT • New software/ tools
New equipment, tools (e.g. SOA, XML) or applications may be needed to enhance data acquisition and analysis.
Infrastructure, databases and software should enable easy data mining. • New methods
New methods (e.g. MVDA, DoE, process modeling) including maintanance of knowledge base must be implemented to enhance data and process analysis.
• Software validation
There will be increasing scrutiny on software validation at regulatory audits.
The requirement for complete validation of software may start even earlier during research.
Creating QbD / PAT , Dated September 27, 2007, V1.0 page 14 of 67 ISPE-PAT-CoP-DACH-Awareness-Doc-Final-V1.0
4 Project Approach and Case Studies
4.1 Introduction Identification and evaluation of benchmarking parameters concerning PAT applications is important for various aspects:
• to raise acceptance in the management • to proof the maturity of projects • for monitoring project progress
Following categories have been defined for this assessment already, and may be extended on the user’s discretion:
• Quality (cat. 1) • Process (cat. 2) • Risk (cat. 3) • Cost (cat. 4) • Personnel (cat. 5) • Tools (cat. 6) • Time (cat. 7) • Validation (cat. 8) • Organization (cat. 9) • Regulatory (cat. 10)
In order to allow a proper benchmarking, quantification is necessary which is independent from absolute values and instead uses a rating which makes it possible to compare several projects. Thus the answers should be rated with measures from 1 to 5, whereby 1 corresponds to total dissatisfaction or not achieved and 5 indicate full satisfaction and success.
It is helpful to comment the decision of a specific rating for future review and audit in the respective comment field.
4.2 Questionnaires You will find the blank and completed questionaires in the appendix.
Creating QbD / PAT , Dated September 27, 2007, V1.0 page 15 of 67 ISPE-PAT-CoP-DACH-Awareness-Doc-Final-V1.0
4.3 Case study results Overall 11 case studies were collected based on the questionnaire in section 4.2. The case studies origin is taken from manufacturing and development sites of big pharmaceutical companies. The answers of case studies 5 - 11 were assessed according to the 10 categories in section 4.1.
Ben
efits
Degree of QbD/PAT
Case A
Case B
Case C
Ben
efits
Degree of QbD/PAT
Case A
Case B
Case C
4.3.1 Quality Positive effects depend on the degree of the PAT implementation as following
• OOS reduction
• Better quality definition and analysis methods
• Reduction of complaints and recalls
4.3.2 Process In all investigated case studies the general process understanding has strongly increased, e.g. by optimized adjustment of known process parameters. In some case studies also new CPPs were identified and used for advanced process control.
In most cases the process cycle time was reduced significantly and the productivity was increased.
Introduction and implementation of new technologies for process automation (including sensors, analytical devices and process control technologies) isn’t a mandatory prerequisite for QbD/PAT. QbD can also be achieved by existing process and control equipment.
The benefits of implementing QbD/PAT in the process has been estimated very positive.
Creating QbD / PAT , Dated September 27, 2007, V1.0 page 16 of 67 ISPE-PAT-CoP-DACH-Awareness-Doc-Final-V1.0
4.3.3 Risk Risk assessment is a positive state of the art methodology for risk detection and minimization, but independent from PAT. Risk assessment will become a key integral methods within PAT.
4.3.4 Cost Most of the case studies can not answer to the question of ROI, only one case claims a ROI of less than one year. For all other cases it is too early for any calculation.
As far as there are experiences, less rejected batches, less deviations increased yield higher OOE, less consumables, less waste and reworks are reported.
4.3.5 Personnel Up to now there is no reduction in personnel: Production is less lab intensive due to a higher degree of automation, but the personnel has shifted its tasks to implement and improve PAT. The mind change encourages communication between different depertments. A better process understanding is obtained. There are hints to a slight increase in personnel security.
4.3.6 Tools A clear result of the investigation is that more process data is recorded, analyzed and stored. The data is additionally used within the batch documentation. In most cases the data is used for advanced process control and the prediction of process deviations.
Applied analytical methods: e.g. NIR, MIR, Raman, laser diffraction, mass spectroscopy, accelerated dissolution testing.
Applied statistical methods: e.g. MVDA, DMAIC, DoE.
4.3.7 Time Summarizing, faster processes are reported:
• Higher utilization of resources.
• Reduced lead time by reduced intermediate off-line testing.
• Faster decisions for on-line quality assessment, faster and earlier decisions on waste material.
• Due to automated data acquisition, shorter transition time from raw data to meaningful process information.
• Material variability is detected earlier.
4.3.8 Validation
In total a lower effort for validation is expected but more effort has to be spend for facility, equipment and software validation during PAT implementation.
Creating QbD / PAT , Dated September 27, 2007, V1.0 page 17 of 67 ISPE-PAT-CoP-DACH-Awareness-Doc-Final-V1.0
4.3.9 Organization QbD/PAT projects have an impact on the organization of pharmaceutical companies and increase the interdisciplinary communications between departments.
4.3.10 Regulatory Regulatory issues have a strong impact on:
• Frequency of contacts and communication (scientific based) with regulatory bodies.
• Earlier and more often contact before and during implementation phase.
• The kind of documentation will be changed (more precise and deeper science based, earlier documentation during design expected).
• Positive impact on change control is expected.
4.4 Summary The aspects of quality, risk, validation and regulatory can be summarized as positive experience when PAT is professionally implemented. Companies with lower implementation expertise have slightly positive expectations, but needs more experiences.
Process understanding has strongly increased as well as the interdisciplinary communication between departments.
Generally speaking, a lot more data are stored due to implementation of PAT technologies; and we notice that a broad variety of sensors is used.
Currently most of the ongoing PAT projects are not mature enough for any sophisticated calculation of cost benefits. Experiences report about better indirect costs, like less rejected batches, higher yields etc.
Regarding to costs, benefits are claimed more in terms of higher yield, reduced cycle times and less rejections/ reworks than in less personnel; there is a shift in tasks for the same staff.
Creating QbD / PAT , Dated September 27, 2007, V1.0 page 18 of 67 ISPE-PAT-CoP-DACH-Awareness-Doc-Final-V1.0
"Ranking" of benefits
0,0
1,0
2,0
3,0
4,0
5,0
2.6 P-P
roces
s und
erstand
ing
4.2 co
sts sa
ving
9.2 C
ommun
icatio
n betw
een de
partm
ents
9.4 C
hange
in m
ind
2.1 Prod
uct c
ycle
time
2.8 Prod
uct y
ield
7.1on
time i
n full d
elive
ry
2.7 Proc
ess u
nderst
anding
helps i
n othe
r proc
esse
s
5.1 Pers
onnel
secu
rity in
creas
e
4.1 ov
erall e
quipm
ent effic
iency
9.1 Adv
antag
e to co
mpetiti
on
5.2 Auto
mation
7.2. T
ime to
mark
et
7.3. T
ime to
mark
et effic
iency
Creating QbD / PAT , Dated September 27, 2007, V1.0 page 19 of 67 ISPE-PAT-CoP-DACH-Awareness-Doc-Final-V1.0
5 Appendix: Structured Catalogue of Standardised Questions with Benchmarking
5.1 Quality (category 1)
Benchmark parameter Corresponding question
Description/Reference
Comment
1 Right the first time Has the fraction of products that has been produced right the first time changed?
Right first time percentage of the products at the point of manufacture that are delivered right first time with no defects
Answer: 1 2 3 4 5
Comment:
2 Quality processes Did the quality processes change in the organization with PAT implementation?
Quality process all processes that regulate all quality related activities in an organization
e.g. risk assessment
Answer: 1 2 3 4 5
Comment:
3 Quality tests In which kind has the process of quality control changed?
Quality control all processes and tests that evaluate the status quo versus specifications and requirements
Testing and definition of specifications, Real-time-release
Answer:
Creating QbD / PAT , Dated September 27, 2007, V1.0 page 20 of 67 ISPE-PAT-CoP-DACH-Awareness-Doc-Final-V1.0
Benchmark parameter Corresponding question
Description/Reference
Comment
4 Complaints/recalls Did you see a change in the amount of complaints and recalls of products with RTR/PR (Real Time Release / Parametric Release)?
Answer: 1 2 3 4 5
Comment:
5 Product specification Is there an impact to the product specification?
Answer: 1 2 3 4 5
Comment:
6 Product specification Is the product specification more science based?
Answer: 1 2 3 4 5
Comment:
7 Product specification R&D Is the
development of product specification changed with PAT?
Answer: 1 2 3 4 5
Comment:
Creating QbD / PAT , Dated September 27, 2007, V1.0 page 21 of 67 ISPE-PAT-CoP-DACH-Awareness-Doc-Final-V1.0
Benchmark parameter Corresponding question
Description/Reference
Comment
8 OOS Did you see a change in the number of OOS incidences?
Answer: 1 2 3 4 5
Comment:
Creating QbD / PAT , Dated September 27, 2007, V1.0 page 22 of 67 ISPE-PAT-CoP-DACH-Awareness-Doc-Final-V1.0
5.2 Process (category 2)
Benchmark parameter Corresponding question
Description/Reference
Comment
1 Cycle time Has the cycle time changed?
Cycle time this is the total time from commencing manufacture to delivering products to the customer which in many cases is the factory warehouse
Answer: 1 2 3 4 5
Comment:
2 Productivity increase Did a better understanding of the variability of a measurement result in an earlier transition to the next unit operation?
Answer: 1 2 3 4 5
Comment:
3 Process parameters Were new important process parameters or correlations between process parameters identified?
Answer: 1 2 3 4 5
Comment:
Creating QbD / PAT , Dated September 27, 2007, V1.0 page 23 of 67 ISPE-PAT-CoP-DACH-Awareness-Doc-Final-V1.0
Benchmark parameter Corresponding question
Description/Reference
Comment
4 Process parameters
Were any known process parameters adjusted?
Acceptance criteria
Answer: 1 2 3 4 5
Comment:
5 Implementation of new technologies
Were new technologies in the process implemented?
Answer: 1 2 3 4 5
Comment:
6 Process understanding Was process understanding increased?
i.e. usage of structured data management, statistical methods
Answer: 1 2 3 4 5
Comment:
7 Process understanding Did better understanding of a process help in other processes?
Answer: 1 2 3 4 5
Comment:
8 Yield Is the yield higher after PAT than before?
Answer: 1 2 3 4 5
Comment:
Creating QbD / PAT , Dated September 27, 2007, V1.0 page 24 of 67 ISPE-PAT-CoP-DACH-Awareness-Doc-Final-V1.0
Benchmark parameter Corresponding question
Description/Reference
Comment
9 Process control Did you find additional possibilities to control the process?
Answer: 1 2 3 4 5
Comment:
Creating QbD / PAT , Dated September 27, 2007, V1.0 page 25 of 67 ISPE-PAT-CoP-DACH-Awareness-Doc-Final-V1.0
5.3 Risk (category 3)
Benchmark parameter Corresponding question
Description/ Reference
Comment
1 Risk assessment Was the PAT project a result of a risk assessment?
Answer: 1 2 3 4 5
Comment:
2 Risk assessment Did the PAT project initiate risk assessments?
Answer: 1 2 3 4 5
Comment:
3 Risk reduction Did the PAT project reduce risks?
Answer: 1 2 3 4 5
Comment:
Creating QbD / PAT , Dated September 27, 2007, V1.0 page 26 of 67 ISPE-PAT-CoP-DACH-Awareness-Doc-Final-V1.0
5.4 Costs (category 4)
Benchmark parameter Corresponding question
Description/ Reference
Comment
1 Overall equipment effectiveness (OEE)
Has the OEE changed?
Overall equipment effectiveness This measures how effectively the manufacturing equipment is used. It is a product of the product rate multiplied by the quality rate multiplied by the plant availability. A figure of 100% implies that the plant is running flat out every hour of the day making perfect products
Example entry
Answer: 1 2 3 4 5
Comment:
2 Cost savings Where did you reduce costs?
Personnel, equipment, QC, raw material etc.
Answer:
3 Return on Investment What is the period until break even of the PAT project?
Investment phase
Answer:
Creating QbD / PAT , Dated September 27, 2007, V1.0 page 27 of 67 ISPE-PAT-CoP-DACH-Awareness-Doc-Final-V1.0
5.5 Personnel (category 5)
Benchmark parameter Corresponding question
Description/ Reference
Comment
1 Personnel security Did you improve the operator or/and product safety?
Answer: 1 2 3 4 5
Comment:
2 Automation versus human interaction
Was number of personnel reduced?
None
Answer: 1 2 3 4 5
Comment:
Creating QbD / PAT , Dated September 27, 2007, V1.0 page 28 of 67 ISPE-PAT-CoP-DACH-Awareness-Doc-Final-V1.0
5.6 Tools (category 6)
Benchmark parameter Corresponding question
Description/ Reference
Comment
1 Information / data management Can the additional/gained information be used in other areas as well?
The information of the process can be used on other levels or in other areas as well
Answer: 1 2 3 4 5
Comment:
2 Information / data management Do you store more or less of information?
Data management The data you store while processing the product
Answer: 1 2 3 4 5
Comment:
3 Information / data management Did you change the documentation storage structure?
Answer:
4 Process control Are additional analytical methods used to predict process deviations?
For example online exploitation of data with neural networks
Answer: 1 2 3 4 5
Comment: 5 Methods Which tools and
methods did you use in the PAT project?
i.e. as result of automation, usage of methods
Answer:
Creating QbD / PAT , Dated September 27, 2007, V1.0 page 29 of 67 ISPE-PAT-CoP-DACH-Awareness-Doc-Final-V1.0
5.7 Time (category 7)
Benchmark parameter Corresponding question
Description/ Reference
Comment
1 On time in full delivery Has the on time in full delivery changed?
On time in full delivery This is the percentage of orders that are satisfied on time in full, with zero defects. Note that if there is one defect in an order, the OTIF is zero percent
Example entry
Answer: 1 2 3 4 5
Comment: 2 Time to market Did a better
understanding of the process reduce the number of iterations in process development (e.g. scaling up)?
Answer: 1 2 3 4 5
Comment:
3 Time to market Is the efficiency in licensing processes (submission approval) higher after PAT?
Answer: 1 2 3 4 5
Comment:
Creating QbD / PAT , Dated September 27, 2007, V1.0 page 30 of 67 ISPE-PAT-CoP-DACH-Awareness-Doc-Final-V1.0
5.8 Validation (category 8)
Benchmark parameter Corresponding question
Description/ Reference
Comment
1 Process/parameter changes What relief in validation efforts did you notice?
Answer: 1 2 3 4 5
Comment:
2 Process/parameter changes Did you change the validation approach?
e.g. switch of responsibilities in the organization
Answer: 1 2 3 4 5
Comment:
3 (Re)validation effort Did you reduce the effort for (re)validation (how much in percentage)?
Effort in (Re)validation (Re)validation is a regular requirement. The effort is the complete work you must do (manpower, paperwork, data generation etc.) to reinstate the validated status
Answer: 1 2 3 4 5
Comment:
4 Validation of software Has PAT changed your effort in validating your computer systems?
Answer: 1 2 3 4 5
Comment:
Creating QbD / PAT , Dated September 27, 2007, V1.0 page 31 of 67 ISPE-PAT-CoP-DACH-Awareness-Doc-Final-V1.0
5.9 Organization (category 9)
Benchmark parameter Corresponding question
Description/ Reference
Comment
1 Advantage to the competition Has the organization gained an advantage to the competition? If yes, is this advantage measurable?
Answer: 1 2 3 4 5
Comment:
2 Communication between departments
Is there a feedback from the changes in the commercial production to the development methodology applied in R&D?
Answer: 1 2 3 4 5
Comment:
3 Change in IT Department Did the switch to PAT have an impact on your IT department?
Answer: 1 2 3 4 5
Comment:
Creating QbD / PAT , Dated September 27, 2007, V1.0 page 32 of 67 ISPE-PAT-CoP-DACH-Awareness-Doc-Final-V1.0
Benchmark parameter Corresponding question
Description/ Reference
Comment
4 Change in mind Has PAT an impact on the awareness of methodologies used in other industries?
Answer: 1 2 3 4 5
Comment:
Creating QbD / PAT , Dated September 27, 2007, V1.0 page 33 of 67 ISPE-PAT-CoP-DACH-Awareness-Doc-Final-V1.0
5.10 Regulatory (category 10)
Benchmark parameter Corresponding question
Description/ Reference
Comment
1 Regulatory requirements Has PAT an impact on the awareness of regulatory requirements?
Answer: 1 2 3 4 5
Comment:
2 Regulatory requirements Did PAT have an impact on change control processes with regulatory bodies?
Answer: 1 2 3 4 5
Comment:
3 Audits Are the discussions with regulatory bodies more scientific?
Answer: 1 2 3 4 5
Comment:
4 Audits Has the frequency of audits changed?
Answer: 1 2 3 4 5
Comment:
Creating QbD / PAT , Dated September 27, 2007, V1.0 page 34 of 67 ISPE-PAT-CoP-DACH-Awareness-Doc-Final-V1.0
Benchmark parameter Corresponding question
Description/ Reference
Comment
5 Documentation Has PAT an influence on the quality of documentation generated during development?
Answer: 1 2 3 4 5
Comment:
6 Documentation Has PAT changed your way of applying for registration?
Answer: 1 2 3 4 5
Comment:
7 Contact with regulatory bodies Did the time of first contact to regulatory bodies change?
Answer: 1 2 3 4 5
Comment:
8 Contact with regulatory bodies Did the regulatory body respond earlier than before?
Answer: 1 2 3 4 5
Comment:
Creating QbD / PAT , Dated September 27, 2007, V1.0 page 35 of 67 ISPE-PAT-CoP-DACH-Awareness-Doc-Final-V1.0
6 Appendix: Project Approach and Case Studies -- completed questionaires
6.1 Case Studies 1 to 2 Case study 1:
• PAT topic "Water Monitoring Freeze Drying" • Location / company Big Pharma, Switzerland • Interviewer Dr. Altermatt
Case study 2: • PAT topic “Blend Monitoring" • Location / company Big Pharma, Germany • Interviewer Dr. Christian Schmidt
Creating QbD / PAT , Dated September 27, 2007, V1.0 page 36 of 67 ISPE-PAT-CoP-DACH-Awareness-Doc-Final-V1.0
Cat No Category Benchmark Corresponding Description/ Answer Answer No Parameter Question References Case study 1 Case study 2
1 1 Quality Right the first time Has the percentage of the products that has been produced right the first time changed? If yes, how (in absolut and percentage numbers)?
RIGHT FIRST TIME percentage of the products at the point of manufacture that are delivered right first time with no defects
No, not yet No, not yet
1 2 Quality Quality processes Has the quality processes changed in the organization with PAT implementation?
QUALITY PROCESS all processes that regulate all quality related activities in an organization
Yes, PAT data has been added to the data that are reviewed prior to release
No, not yet
1 3 Quality Quality tests In which kind has the process of quality control changed?
QUALITY CONTROL all processes and tests that evaluate the status quo versus specifications and requirements
See above Not applicable
1 4 Quality complaints/ recalls
Has changed the amount of complaints and recalls of products with RTR/PR (Real Time Release/Parametric Release)?
No, not yet Not applicable
1 5 Quality Product specification
Is the product specification more science based? Is there an impact to the product specification?
No, future impact possible (narrower ranges)
No, not yet
Creating QbD / PAT , Dated September 27, 2007, V1.0 page 37 of 67 ISPE-PAT-CoP-DACH-Awareness-Doc-Final-V1.0
Cat No Category Benchmark Corresponding Description/ Answer Answer No Parameter Question References Case study 1 Case study 2
1 6 Quality Product specification R&D
Does the developing of the product specification change with PAT?
Not applicable Yes, if term specification is meant in a broader perspective of intermediate and end product specifications
2 1 Process Cycle Time Hour Has the cycle time changed? If yes, how (in absolut and percentage numbers)?
CYCLE TIME HOURS This is the total time from commencing manufacture to delivering products to the customer which in many cases is the factory warehouse.
Elonged time due to additional process step
Not applicable
2 2 Process Productivity Increase
Could a better understanding of the variability of a measurement lead to earlier transition to the next unit operation?
None Not applicable Theoretically yes, but times are in the order of minutes
2 3 Process Process Parameters
Has there be identified new important process parameters or correlations between process parameters?
None No No
2 4 Process Implementation of new technologies
Has there been implemented new technologies in the process?
Yes, the PAT tool
2 5 Process Process Parameters
Has there been any adjustments to known process parameters?
Yes
2 6 Process Process Understanding
Was it possible to increase process understanding?
Yes
Creating QbD / PAT , Dated September 27, 2007, V1.0 page 38 of 67 ISPE-PAT-CoP-DACH-Awareness-Doc-Final-V1.0
Cat No Category Benchmark Corresponding Description/ Answer Answer No Parameter Question References Case study 1 Case study 2
2 7 Process Process Understanding
Did better understanding of a process help in other processes?
No
2 8 Process Yield Is the yield higher after PAT than before?
In terms a single batch: No. In terms of overall production: in future potentially yes
3 1 Risk Risk assessment Was the PAT project a result of a risk assessment?
No
3 2 Risk Risk assessment Did the PAT project initiate risk assessments?
Yes, formal risk assessments were introduced
3 3 Risk Risk reduction Did the PAT project reduce risks?
Yes (high water level --> degradation)
4 1 Costs Overall Equipment Effectiveness (OEE)
Has the OEE changed? If yes, how (in absolut and percentage numbers)?
OVERALL EQUIPMENT EFFECTIVENESS This measures how effectively the manufacturing equipment is used. It is a product of the product rate multiplied by the quality rate multiplied by the plant availability. A figure of 100% implies that the plant is running flat out every hour of the day making perfect product
No
4 2 Costs cost savings Where did you reduce costs?
No, not yet
4 3 Costs ROI What is the ROI, in which period?
see above
Creating QbD / PAT , Dated September 27, 2007, V1.0 page 39 of 67 ISPE-PAT-CoP-DACH-Awareness-Doc-Final-V1.0
Cat No Category Benchmark Corresponding Description/ Answer Answer No Parameter Question References Case study 1 Case study 2
5 1 Personnel personnel security Could you improve the operator or/and product safety?
No change
5 2 Personnel Automation versus human interaction
Could number of personnel be reduced?
None No
6 1 Tools Information/ Data Management
Can the additional / gained information be used in other areas as well?
The information of the process can be used on other levels or in other areas as well.
Yes, for other freeze drying processes
6 2 Tools process control Where are analytical methods used to predict process deviations?
For example on-line exploitation of data with neural networks
No
6 3 Tools Information/ Data Management
Has changed the data management with the project? Do you store more or less of information? Did you change the documentation storage structure?
DATA MANAGEMENT The data you store while processing the product
Yes, more data is currently stored. Need for storing all data under discussion
6 5 Tools methods Which tools and methods did you use in the PAT project?
NIR, MVDA
7 1 Time On Time In Full delivery
Has the On Time in Full delivery changed? If yes, how (in absolut and percentage numbers)?
ON TIME IN FULL DELIVERY This is the percentage of orders that are satisfied On Time In Full, with zero defects. Note that if there is one defect in an order, the OTIF is zero percent
No
Creating QbD / PAT , Dated September 27, 2007, V1.0 page 40 of 67 ISPE-PAT-CoP-DACH-Awareness-Doc-Final-V1.0
Cat No Category Benchmark Corresponding Description/ Answer Answer No Parameter Question References Case study 1 Case study 2
7 2 Time Time to market Could a better understanding of the process reduce the number of iterations in process development (e.g. scaling up)?
None Yes
7 3 Time Time to market Is the efficiency in licencing processes (submission approval) higher after PAT?
Not applicable
8 1 Validation Process / Parameter Changes
Is a relief in validation efforts noticeable? If yes in which way?
None No
8 2 Validation Process / Parameter Changes
Did you change the validation approach (switch of responsibilities in the organization)? If yes, how did you change?
None No, not yet
8 3 Validation (Re)validation effort Did you reduce the effort for (re)validation (how much in percentage)?
EFFORT IN (RE)VALIDATION (Re)validation is a regular requirement. The effort is the complete work you must do (manpower, paperwork, data generation, etc.)
No
8 4 Validation Validation of Software
Has PAT changed your effort in validating your computer systems?
No
Creating QbD / PAT , Dated September 27, 2007, V1.0 page 41 of 67 ISPE-PAT-CoP-DACH-Awareness-Doc-Final-V1.0
Cat No Category Benchmark Corresponding Description/ Answer Answer No Parameter Question References Case study 1 Case study 2
9 1 Organization Advantage to the competition
Has the organization gained an advantage to the competition? If yes, is this advantage measurable?
None No
9 2 Organization Communication between departments
Is there a feedback from the changes in the commercial production to the development methodology applied in R&D ?
Yes, PAT philosophy introduced into R&D
9 3 Organization Change in IT department
Did changing to PAT have an impact on your IT department?
No
9 4 (not evaluated in case 1-4)
10 1 Regulatory regulatory requirements
Has PAT an impact on the awareness of regulatory requirements?
No
10 2 Regulatory regulatory requirements
Did PAT have an impact on change control processes with regulatory bodies?
No
10 3 Regulatory audits Is there a more scientific discussion with regulatory bodies possible?
Not applicable
10 4 Regulatory audits Has the frequency of audits changed?
No
10 5 Regulatory documentation Has PAT an influence on the quality of documentation during development?
Not applicable
Creating QbD / PAT , Dated September 27, 2007, V1.0 page 42 of 67 ISPE-PAT-CoP-DACH-Awareness-Doc-Final-V1.0
Cat No Category Benchmark Corresponding Description/ Answer Answer No Parameter Question References Case study 1 Case study 2
10 6 Regulatory documentation Has Pat changed your way of applying for registration?
No, not yet
1ß 7 (not evaluated in case 1-4)
10 8 (not evaluated in case 1-4)
Creating QbD / PAT , Dated September 27, 2007, V1.0 page 43 of 67 ISPE-PAT-CoP-DACH-Awareness-Doc-Final-V1.0
6.2 Case Studies 3 to 6 Case study 3:
• PAT topic “PAT in Capsule & Tablet Manufacturing” • Location / company Big Pharma, Europe • Interviewer Christian Woelbeling
Case study 4: • PAT topic PAT in Manufacturing • Location / company Big Pharma, Europe • Interviewer Disclosed
Case study 5: • PAT topic “PAT for secondary operations (formulation filling and freeze drying)” • Location / company Big Pharma, Belgium • Interviewer Disclosed
Case study 6: • PAT topic PAT for Research and Development • Location / company Big Pharma , Germany • Interviewer Disclosed
Creating QbD / PAT , Dated September 27, 2007, V1.0 page 44 of 67 ISPE-PAT-CoP-DACH-Awareness-Doc-Final-V1.0
Cat No Category Benchmark Corresponding Description/ Answer Answer Answer Answer No Parameter Question References Case Study 3 Case Study 4 Case Study 5 Case Study 6
0 1 Type of
Project What is the environment of the project?
Prod Final release drug product
R&D The project is in R&D at the moment, but will go right through to production.
R&D
0 2 Status of the project
What phase is the project in?
Ong Pending start-up inspection
Ong At the moment the first tests in industrial scale take place (looking for proof of concept). However there is already knowledge gained out of it.
other
Method successful established for scale up. No products for scale up at the moment. No benefit for usage of “old” products during routine production.
1 1 Right the first time
Has the fraction of the products that has been produced right the first time changed?
Right first time percentage of the products at the point of manufacture that are delivered right first time with no defects
4 Additional testing, during manufacturing, still end product testing, more knowledge. Improvement: No surprises during end product testing, only confirmation, Only 1 out of 500 out of spec batches.
- Not yet in commercial production mode, but this is expected, due to implementation of feedback control.
1 At the moment there is only monitoring of moisture inside the dryer. The expectation is that at the beginning there will be an increase of rejects, because the process is more closely watched. Then through CAPA, eventually the process will become more robust and “right the first time” will increase.
- No relevant products at the moment.
Creating QbD / PAT , Dated September 27, 2007, V1.0 page 45 of 67 ISPE-PAT-CoP-DACH-Awareness-Doc-Final-V1.0
Cat No Category Benchmark Corresponding Description/ Answer Answer Answer Answer No Parameter Question References Case Study 3 Case Study 4 Case Study 5 Case Study 6
1 2 Quality
processes Did the quality processes change in the organization with PAT implementation?
Quality process all processes that regulate all quality related activities in an organization
e.g. risk assessment 4 Still end product testing. But more process knowledge leads to less surprises during the final end product testing.
- PAT to replace laboratory release test
3 Not yet (still in proof of concept – therefore decision will be later), but it is expected, that PAT will add a tool for faster quality decision.
2
1 3 Quality tests In which kind has the process of quality control changed?
Quality control all processes and tests that evaluate the status quo versus specifications and requirements
Testing and definition of specifications, Real-time-release
Additional On-In-At-line testing implemented. The existing is still there – No regulatory change and still the same filing! No change management necessary!
Real-time release replacing lab assay
Objective and faster quality decision
No change.
1 4 Complaints/recalls
Did you see a change in the amount of complaints and recalls of products with RTR/PR (Real Time Release / Parametric Release)?
1 No RTR implemented
- Not yet 1 Not yet – the project has not yet come to this stage.
- No PTR/PR established.
1 5 Product specification
Is there an impact to the product specification?
1 No, still the same MBR.
- Release specs consistent, added Guard band for environmental variability
1 No – because PAT will impact the process specification, rather than the product specification.
1
Creating QbD / PAT , Dated September 27, 2007, V1.0 page 46 of 67 ISPE-PAT-CoP-DACH-Awareness-Doc-Final-V1.0
Cat No Category Benchmark Corresponding Description/ Answer Answer Answer Answer No Parameter Question References Case Study 3 Case Study 4 Case Study 5 Case Study 6
1 6 Product
specification Is the product specification more science based?
1 The new analytical tests are more science based, but full science based approach is only for new products under development.
- Yes, the use of the PAT release test was integral to discussions about appropriate specifications.
1 The process specification is more science based (specific to vaccines, because of very diluted active ingredients)
- No change in product specification.
1 7 Product specification R&D
Is the development of product specification changed with PAT?
5 Change in the future with the new filings under new PAT FDA approach!
- PAT for real-time monitoring of quality
1 See above - No product in development at the moment.
1 8 OOS Did you see a change in the number of OOS incidences?
5 Dramatic reduction. The project brought OOS nearly to 0! Process improvement!
- Not yet 1 No – not far enough at the moment.
1
2 1 Cycle time Has the cycle time changed?
Cycle time this is the total time from commencing manufacture to delivering products to the customer which in many cases is the factory warehouse
5 Yes, streamlined the process, much shorter cycle times, proved by evaluations!
- Not anticipated to change significantly, but there will be some decrease arising from the elimination of intermediate off-line testing (particularly during start-up).
3 No feedback at the moment, but the aim is yes – lower (faster quality decision)
1
2 2 Productivity increase
Did a better understanding of the variability of a measurement result in an earlier transition to the next unit operation?
5 Key point/benefit, WIP is no longer in unknown status.
- Expected to provide better control and provide process understanding, but not increased productivity
3 YES - Not applicable
Creating QbD / PAT , Dated September 27, 2007, V1.0 page 47 of 67 ISPE-PAT-CoP-DACH-Awareness-Doc-Final-V1.0
Cat No Category Benchmark Corresponding Description/ Answer Answer Answer Answer No Parameter Question References Case Study 3 Case Study 4 Case Study 5 Case Study 6
2 3 Process
parameters Were new important process parameters or correlations between process parameters identified?
2 Yes, but the same parameters were identified.
- New sources of variability have been identified, but not yet characterized
5 Yes 3
2 4 Process parameters
Were any known process parameters adjusted?
Acceptance criteria 5 Same parameters much more precise, much better process understanding
- PAT used for feedback control of filling equipment.
5 YES 1
2 5 Implementation of new technologies
Were new technologies in the process implemented?
1 Still the same process, new analytical technologies implemented successfully
- First commercial installation of the control technology anywhere in the world (NMR on solids)
2 Yes at clinical scale. The robustness of the process has to be verified before the information is given to the authorities.
1 Not yet.
2 6 Process understanding
Was process understanding increased?
i.e. usage of structured data management, statistical methods
5 Yes - Yes, including insight into previously undetected variability.
4 4
2 7 Process understanding
Did better understanding of a process help in other processes?
5 Cross product effects, shorter process optimization for other products and shorter time to market effect.
- Once new source of variability is characterized, it should have impact on other solid filling lines, and the technology may help in setting API specifications for subsequent products.
2 No because except of NIR, the technologies are too difficult to transfer.
2
Creating QbD / PAT , Dated September 27, 2007, V1.0 page 48 of 67 ISPE-PAT-CoP-DACH-Awareness-Doc-Final-V1.0
Cat No Category Benchmark Corresponding Description/ Answer Answer Answer Answer No Parameter Question References Case Study 3 Case Study 4 Case Study 5 Case Study 6
2 8 Yield Is the yield higher
after PAT than before?
- 3 for the process itself and 5 for no more lost batches!!
- No. 1 Would not sell Pat as a project that will increase yield. PAT is more a tool to increase compliance and quality, rather than yield.
1
2 9 Process control
Did you find additional possibilities to control the process?
1 No changes in the process control
- No 4 Yes 4 Part of the process could be controlled by NIR.
3 1 Risk assessment
Was the PAT project a result of a risk assessment?
5 Risk assessment made for market supply – Economic Risk assessment! But the Assessment was made already 15 years ago.
- No. A rigorous FMEA was developed as part of the PAT installation.
3 There was a good knowledge of the process – Risk Analysis was already done
3
3 2 Risk assessment
Did the PAT project initiate risk assessments?
1 No additional in this project. Other projects with Risk assessment already before the PAT initiative. Confirmation of the chosen approach.
- Yes. 1 No because it was already done for process validation
2
3 3 Risk reduction Did the PAT project reduce risks?
5 Yes, supply is with the new more robust and secured!!
- Anticipated this will be the case.
4 Yes 5
Creating QbD / PAT , Dated September 27, 2007, V1.0 page 49 of 67 ISPE-PAT-CoP-DACH-Awareness-Doc-Final-V1.0
Cat No Category Benchmark Corresponding Description/ Answer Answer Answer Answer No Parameter Question References Case Study 3 Case Study 4 Case Study 5 Case Study 6
4 1 Overall
equipment effectiveness (OEE)
Has the OEE changed?
Overall equipment effectiveness This measures how effectively the manufacturing equipment is used. It is a product of the product rate multiplied by the quality rate multiplied by the plant availability. A figure of 100% implies that the plant is running flat out every hour of the day making perfect products
Example entry 4 Streamlined the manufacturing
- Anticipated that this will be the case
1 Increase, return on investment is questionable. There is a question of what is more important: quality and compliance or costs.
1
4 2 Cost savings Where did you reduce costs?
Personnel, equipment, QC, raw material etc.
Minimized WIP/Work in Process Less rejected batches Early detection of variability of raw material. New detected / invented critical parameter resulted in a new parameter for the specification. - > Hugh saving by early detection Minimizing QC testing by moving it to the plant
Expected savings in recovery of partial lots and elimination (or at least decrease) in off-line testing.
Cost could be saved due to faster decision on good/bad product.
No reduction in costs till now.
Creating QbD / PAT , Dated September 27, 2007, V1.0 page 50 of 67 ISPE-PAT-CoP-DACH-Awareness-Doc-Final-V1.0
Cat No Category Benchmark Corresponding Description/ Answer Answer Answer Answer No Parameter Question References Case Study 3 Case Study 4 Case Study 5 Case Study 6
4 3 Return on
Investment What is the period until break even of the PAT project?
Investment phase Less than 1 year Has not been calculated. Can be performed once the system is operational.
No answer at the moment – but is that really the purpose of PAT?
5 1 Personnel security
Did you improve the operator or/and product safety?
5 Yes - 100% quality assessment is anticipated to improve product safety and efficacy
1 No - Not applicable.
5 2 Automation versus human interaction
Was number of personnel reduced?
None 1 Same staff - Anticipated outcome, based on PAT being less labor intensive at final deployment. Some personnel resource will be relocated, rather than eliminated, but as this is a new process, all headcount are projected, rather than actual.
2 What’s the cost of ownership? PAT usually means more technology – so there would be more likely a change of skills, rather than an objective decrease of people.
- Not applicable.
6 1 Information / data management
Can the additional/gained information be used in other areas as well?
The information of the process can be used on other levels or in other areas as well
5 The data is gathered in a special database incl. a feedback to R&D.
- Expected to be the case
1 No – but not far enough at the moment.
5
6 2 Information / data management
Do you store more or less of information?
Data management The data you store while processing the product
5 More valuable information
- Additional data collected, but fully automated, whereas traditional process was more labor intensive
4 far more - Not applicable.
Creating QbD / PAT , Dated September 27, 2007, V1.0 page 51 of 67 ISPE-PAT-CoP-DACH-Awareness-Doc-Final-V1.0
Cat No Category Benchmark Corresponding Description/ Answer Answer Answer Answer No Parameter Question References Case Study 3 Case Study 4 Case Study 5 Case Study 6
6 3 Information /
data management
Did you change the documentation storage structure?
PAT data in Batch Documentation added. PAT data is in a separate DB and printed out.
Incorporated directly into DCS
4 Yes – adapt some servers
Not applicable.
6 4 Process control
Are additional analytical methods used to predict process deviations?
For example online exploitation of data with neural networks
5 Yes new analytical methods were invented and used for the process control.
- Much higher data density, but no additional methods aside from PAT
4 Yes – more long term quality input - trend analysis
1
6 5 Methods Which tools and methods did you use in the PAT project?
i.e. as result of automation, usage of methods
Method: NIR – API content Method: Accelerated dissolution - film quality Method: Laser defraction - Particle size measurement
Not clear in the objective of this question.
Plasma system, NIR, two other technologies, but no further description because of Intellectual Property.
Mass spectrometry
7 1 On time in full delivery
Has the on time in full delivery changed?
On time in full delivery This is the percentage of orders that are satisfied on time in full, with zero defects. Note that if there is one defect in an order, the OTIF is zero percent
Example entry 4 - Likely to increase due to real-time quality assessment
3 No feedback at the moment – target is to increase
- Not applicable.
Creating QbD / PAT , Dated September 27, 2007, V1.0 page 52 of 67 ISPE-PAT-CoP-DACH-Awareness-Doc-Final-V1.0
Cat No Category Benchmark Corresponding Description/ Answer Answer Answer Answer No Parameter Question References Case Study 3 Case Study 4 Case Study 5 Case Study 6
7 2 Time to
market Did a better understanding of the process reduce the number of iterations in process development (e.g. scaling up)?
5 Yes, main project driver. Also cross product benefits realized.
- Will probably actually add resources initially to understand and characterize sensor response and process variability
1 PAT will not be a big driver to reduce time to market. It will make the process more robust, but this will not have a great impact on timing.
- Not applicable.
7 3 Time to market
Is the efficiency in licensing processes (submission approval) higher after PAT?
- Can not be answered yet, due to ongoing submissions under new FDA QbD PAT approach.
- Yet to be determined
4 Yes - Not applicable.
8 1 Process/parameter changes
What relief in validation efforts did you notice?
2 Still traditional validation. There is more confidence in the Validation approach, but no relief in the validation efforts.
- Not yet known 4 - Not applicable.
8 2 Process/parameter changes
Did you change the validation approach?
e.g. switch of responsibilities in the organization
1 No change. - Added PAT characterization to process validation
1 Not yet – but will be
- Not yet.
8 3 (Re)validation effort
Did you reduce the effort for (re)validation (how much in percentage)?
Effort in (Re)validation (Re)validation is a regular requirement. The effort is the complete work you must do (manpower, paperwork, data generation etc.) to reinstate the validated status
1 Still the same approach.
- Yet to be determined
- Not far enough – target, but no feedback.
1
Creating QbD / PAT , Dated September 27, 2007, V1.0 page 53 of 67 ISPE-PAT-CoP-DACH-Awareness-Doc-Final-V1.0
Cat No Category Benchmark Corresponding Description/ Answer Answer Answer Answer No Parameter Question References Case Study 3 Case Study 4 Case Study 5 Case Study 6
8 4 Validation of
software Has PAT changed your effort in validating your computer systems?
5 More analytical devices result in higher validation efforts.
- Imposed additional CSV testing for PAT system
1 No 1
9 1 Advantage to the competition
Has the organization gained an advantage to the competition? If yes, is this advantage measurable?
5 Main driver was the shorter Time To Market.
- Not a high priority for this installation.
4 1
9 2 Communication between departments
Is there a feedback from the changes in the commercial production to the development methodology applied in R&D?
4 Still room for improvement
- R&D “owned” process control strategy and partnered in PAT development.
4 5
9 3 Change in IT Department
Did the switch to PAT have an impact on your IT department?
5 Yes, additional SW to manage, higher data volume etc.
- Not particularly 1 1
9 4 Change in mind
Has PAT an impact on the awareness of methodologies used in other industries?
5 Yes, learning from others in the competence team.
- Installation has raised awareness and visibility of PAT, but not particularly from other industries.
3 It’s coming, but it takes time
4
Creating QbD / PAT , Dated September 27, 2007, V1.0 page 54 of 67 ISPE-PAT-CoP-DACH-Awareness-Doc-Final-V1.0
Cat No Category Benchmark Corresponding Description/ Answer Answer Answer Answer No Parameter Question References Case Study 3 Case Study 4 Case Study 5 Case Study 6
10 1 Regulatory
requirements Has PAT an impact on the awareness of regulatory requirements?
5 Following the new FDA Risk based and PAT oriented paradigm change.
- PAT installation is facilitating discussion with regulatory agencies regarding changing expectations for submissions, particularly with respect to risk management.
1 No, there is not much difference in filing a PAT application, because the description of the process is not so big. CMC section will be bigger
3
10 2 Regulatory requirements
Did PAT have an impact on change control processes with regulatory bodies?
5 Submission ongoing according to new PAT Guidance.
- Expected to be the case
- Not yet - Not applicable.
10 3 Audits Are the discussions with regulatory bodies more scientific?
5 Yes, lot of interactive discussions on a high scientific level.
- yes 3 It depends on authorities and inspector.
- Not applicable.
10 4 Audits Has the frequency of audits changed?
1 No change - Anticipated to decrease, but has not yet transpired.
1 No 1
10 5 Docu-mentation
Has PAT an influence on the quality of documentation generated during development?
5 More precise Documents in R&D, justification for docs and better process description, better validation of the CPP ranges, explanation of the process and the process understanding increased and is more extensive
- Documentation quality hasn’t changed, but additional development data was required.
3 Yes 3
Creating QbD / PAT , Dated September 27, 2007, V1.0 page 55 of 67 ISPE-PAT-CoP-DACH-Awareness-Doc-Final-V1.0
Cat No Category Benchmark Corresponding Description/ Answer Answer Answer Answer No Parameter Question References Case Study 3 Case Study 4 Case Study 5 Case Study 6
10 6 Docu-
mentation Has PAT changed your way of applying for registration?
5 Yes in New products!
- Lilly discussions with regulatory bodies were more forthcoming and technical than traditionally
3 Especially validation of methods will increase.
1
10 7 Contact with regulatory bodies
Did the time of first contact to regulatory bodies change?
5 Yes in very early stage, during filing/submission phase.
- PAT discussions were held separately (and earlier) from traditional regulatory conversations to ensure PAT did not become bottleneck to submission conversations.
1 No 1
10 8 Contact with regulatory bodies
Did the regulatory body respond earlier than before?
5 Yes very interested, educate the EU authorities with the chosen approach!
- Responded in mutually agreed timeframe.
- No feedback yet. 1
Creating QbD / PAT , Dated September 27, 2007, V1.0 page 56 of 67 ISPE-PAT-CoP-DACH-Awareness-Doc-Final-V1.0
6.3 Case Studies 7 to 8 Case study 7:
• PAT topic “PAT Case Study from prior company As of April, 2005, PAT Pilot” • Location / company Big Pharma, Global • Interviewer David Radspinner
Case study 8: • PAT topic PAT in R&D Environment • Location / company Big Pharma , Europe • Interviewer Disclosed
Cat No Category Benchmark Corresponding Description/ Answer Answer No Parameter Question References Case study 7 Case study 8
0 1 Type of Project
What is the environment of the project?
Prod Driven by Quality organization
Prod
0 2 Status of the project
What phase is the project in?
Ong As of April, 2005 Ong Study phase
1 1 Right the first time
Has the fraction of the products that has been produced right the first time changed?
Right first time percentage of the products at the point of manufacture that are delivered right first time with no defects
- Not disclosed Not yet implemented in routine production
1 2 Quality processes
Did the quality processes change in the organization with PAT implementation?
Quality process all processes that regulate all quality related activities in an organization
e.g. risk assessment 4 Systems remain the same, but adapted to reflect a risk-based approach
1
Creating QbD / PAT , Dated September 27, 2007, V1.0 page 57 of 67 ISPE-PAT-CoP-DACH-Awareness-Doc-Final-V1.0
Cat No Category Benchmark Corresponding Description/ Answer Answer No Parameter Question References Case study 7 Case study 8
1 3 Quality tests In which kind has the process of quality control changed?
Quality control all processes and tests that evaluate the status quo versus specifications and requirements
Testing and definition of specifications, Real-time-release
Several end-product, laboratory-based tests were in a position to be replaced with real-time process analytics and predictive models.
No change
1 4 Complaints/recalls
Did you see a change in the amount of complaints and recalls of products with RTR/PR (Real Time Release / Parametric Release)?
- Not disclosed Not yet implemented in routine production
1 5 Product specification
Is there an impact to the product specification?
3 Specification, as defined as an analytical property, test and acceptance criteria – yes. The tests were replaced with on-line/at-line analytics and predictive models. Possible changes to the acceptance criteria were not disclosed.
1
1 6 Product specification
Is the product specification more science based?
4 The mechanisms by which to measure and assess the quality attributes of interest were based upon sound science.
1
Creating QbD / PAT , Dated September 27, 2007, V1.0 page 58 of 67 ISPE-PAT-CoP-DACH-Awareness-Doc-Final-V1.0
Cat No Category Benchmark Corresponding Description/ Answer Answer No Parameter Question References Case study 7 Case study 8
1 7 Product specification R&D
Is the development of product specification changed with PAT?
- Not disclosed 1
1 8 OOS Did you see a change in the number of OOS incidences?
- Not disclosed Not yet implemented in routine production
2 1 Cycle time Has the cycle time changed?
Cycle time this is the total time from commencing manufacture to delivering products to the customer which in many cases is the factory warehouse
4 Not disclosed – only mention was that analytical testing cycle time was reduced.
5 Not yet – but is expected
2 2 Productivity increase
Did a better understanding of the variability of a measurement result in an earlier transition to the next unit operation?
1 Not disclosed 5 Not yet – but is expected
2 3 Process parameters
Were new important process parameters or correlations between process parameters identified?
4 It was disclosed that material attributes and select process parameters, in combination, affected the dissolution rate of the product. Other relationships were not disclosed.
Not yet
Creating QbD / PAT , Dated September 27, 2007, V1.0 page 59 of 67 ISPE-PAT-CoP-DACH-Awareness-Doc-Final-V1.0
Cat No Category Benchmark Corresponding Description/ Answer Answer No Parameter Question References Case study 7 Case study 8
2 4 Process parameters
Were any known process parameters adjusted?
Acceptance criteria - To be expected
2 5 Implementation of new technologies
Were new technologies in the process implemented?
5 New analytical technologies applied.
5
2 6 Process understanding
Was process understanding increased?
i.e. usage of structured data management, statistical methods
5 5
2 7 Process understanding
Did better understanding of a process help in other processes?
- Not disclosed 3
2 8 Yield Is the yield higher after PAT than before?
5 Disclosed that drying yield was higher (specific amount not disclosed).
5 To be expected
2 9 Process control
Did you find additional possibilities to control the process?
5 Yes, drying, blending.
5
3 1 Risk assessment
Was the PAT project a result of a risk assessment?
1 Project started prior to PAT guidance or the maturation of the risk-based approach.
1
3 2 Risk assessment
Did the PAT project initiate risk assessments?
5 Significant Risk assessments across many levels were executed and utilized.
5
Creating QbD / PAT , Dated September 27, 2007, V1.0 page 60 of 67 ISPE-PAT-CoP-DACH-Awareness-Doc-Final-V1.0
Cat No Category Benchmark Corresponding Description/ Answer Answer No Parameter Question References Case study 7 Case study 8
3 3 Risk reduction Did the PAT project reduce risks?
5 This question is too vague. Risks of what? What has been presented is that PAT reduced risks associated with poor sampling, delayed analytics, ineffectual qualification and validation.
Not yet implemented – to be expected
4 1 Overall equipment effectiveness (OEE)
Has the OEE changed?
Overall equipment effectiveness This measures how effectively the manufacturing equipment is used. It is a product of the product rate multiplied by the quality rate multiplied by the plant availability. A figure of 100% implies that the plant is running flat out every hour of the day making perfect products
Example entry - Not disclosed 5 To be expected upon implementation
4 2 Cost savings Where did you reduce costs?
Personnel, equipment, QC, raw material etc.
Laboratory personnel, consumables, waste
No cost reduction, but better OEE, higher yields, …
4 3 Return on Investment
What is the period until break even of the PAT project?
Investment phase Not disclosed Not yet calculated
Creating QbD / PAT , Dated September 27, 2007, V1.0 page 61 of 67 ISPE-PAT-CoP-DACH-Awareness-Doc-Final-V1.0
Cat No Category Benchmark Corresponding Description/ Answer Answer No Parameter Question References Case study 7 Case study 8
5 1 Personnel security
Did you improve the operator or/and product safety?
4 API reaction sampling risk reduced. This was the only area disclosed.
1
5 2 Automation versus human interaction
Was number of personnel reduced?
None 5 In the laboratory, yes.
1
6 1 Information / data management
Can the additional/gained information be used in other areas as well?
The information of the process can be used on other levels or in other areas as well
- Not disclosed 5
6 2 Information / data management
Do you store more or less of information?
Data management The data you store while processing the product
- More information. Stored for business reasons.
5
6 3 Information / data management
Did you change the documentation storage structure?
Not disclosed 1
6 4 Process control
Are additional analytical methods used to predict process deviations?
For example online exploitation of data with neural networks
5 Yes 1
6 5 Methods Which tools and methods did you use in the PAT project?
i.e. as result of automation, usage of methods
By methods do you mean measurement systems? NIR was primarily used for process analytics. Multivariate analysis tools (e.g. PLS for NIR model calibration, other techniques for dissolution predictive models).
DMAIC Tools (Control charts, process capability analysis, …), NIR Measurement system
Creating QbD / PAT , Dated September 27, 2007, V1.0 page 62 of 67 ISPE-PAT-CoP-DACH-Awareness-Doc-Final-V1.0
Cat No Category Benchmark Corresponding Description/ Answer Answer No Parameter Question References Case study 7 Case study 8
7 1 On time in full delivery
Has the on time in full delivery changed?
On time in full delivery This is the percentage of orders that are satisfied on time in full, with zero defects. Note that if there is one defect in an order, the OTIF is zero percent
Example entry - Not disclosed 5 To be expected
7 2 Time to market
Did a better understanding of the process reduce the number of iterations in process development (e.g. scaling up)?
- Not applicable Not applicable
7 3 Time to market
Is the efficiency in licensing processes (submission approval) higher after PAT?
- Not disclosed for follow-on products. Regulatory efficiency for change of this product improved.
Submission not yet done
8 1 Process/parameter changes
What relief in validation efforts did you notice?
5 Significant relief using a risk-based approach with process understanding, monitoring and control.
1 No relief
8 2 Process/parameter changes
Did you change the validation approach?
e.g. switch of responsibilities in the organization
4 Only to use a risk-based iterative and incremental approach.
1
Creating QbD / PAT , Dated September 27, 2007, V1.0 page 63 of 67 ISPE-PAT-CoP-DACH-Awareness-Doc-Final-V1.0
Cat No Category Benchmark Corresponding Description/ Answer Answer No Parameter Question References Case study 7 Case study 8
8 3 (Re)validation effort
Did you reduce the effort for (re)validation (how much in percentage)?
Effort in (Re)validation (Re)validation is a regular requirement. The effort is the complete work you must do (manpower, paperwork, data generation etc.) to reinstate the validated status
- Not disclosed 1
8 4 Validation of software
Has PAT changed your effort in validating your computer systems?
5 Yes, now risk-based, iterative and incremental for many systems.
1
9 1 Advantage to the competition
Has the organization gained an advantage to the competition? If yes, is this advantage measurable?
- Not disclosed Not yet
9 2 Communication between departments
Is there a feedback from the changes in the commercial production to the development methodology applied in R&D?
- Not disclosed 3
9 3 Change in IT Department
Did the switch to PAT have an impact on your IT department?
- Yes, awareness of criticality of historians not only for storage, but for model predictive control.
1
Creating QbD / PAT , Dated September 27, 2007, V1.0 page 64 of 67 ISPE-PAT-CoP-DACH-Awareness-Doc-Final-V1.0
Cat No Category Benchmark Corresponding Description/ Answer Answer No Parameter Question References Case study 7 Case study 8
9 4 Change in mind
Has PAT an impact on the awareness of methodologies used in other industries?
2 Slow progress. 4
10 1 Regulatory requirements
Has PAT an impact on the awareness of regulatory requirements?
- 3
10 2 Regulatory requirements
Did PAT have an impact on change control processes with regulatory bodies?
5 Presented that regulatory relief was granted for changes to existing product.
Submission not yet done
10 3 Audits Are the discussions with regulatory bodies more scientific?
5 Absolutely. Not applicable (not yet implemented)
10 4 Audits Has the frequency of audits changed?
- Not disclosed Not applicable (not yet implemented)
10 5 Documentation
Has PAT an influence on the quality of documentation generated during development?
- Not disclosed 1
10 6 Documentation
Has PAT changed your way of applying for registration?
5 Only disclosed for this project. Yes, now science and risk-based.
Submission not yet done
10 7 Contact with regulatory bodies
Did the time of first contact to regulatory bodies change?
4 Yes. Engaged earlier than typical PAS.
Submission not yet done
10 8 Contact with regulatory bodies
Did the regulatory body respond earlier than before?
5 Yes. Submission not yet done
Creating QbD / PAT , Dated September 27, 2007, V1.0 page 65 of 67 ISPE-PAT-CoP-DACH-Awareness-Doc-Final-V1.0
7 Volunteers For each chapter a group of volunteers worked on the contents.
Thanks to all the participants spending the effort to make this document happen and to provide the creative input.
Christian Wölbeling (chairman)
Dr. Schmidt-Bader (coordinator)
Lydia Dolezel (coordinator)
Thomas Peither (coordinator)
Dr. Christian Schmidt (coordinator)
Dr. Rolf Altermatt
Dr. Rolf Bauer
Dr. Reinhard Baumfalk
Josef Braunschädel-Hilger
Dr. Jens Cardinal
Jeannette Ewen
Norbert Franz
Dr. Wolfgang Fischer
Georg Frinke
Dr. Jürgen Haas
Dr. Jörg Häußler
Steffen Himstedt
Dr. Thilo Jahr
Dr. Frauke Jordt
Prof. Dr. Rudolf Kessler
Dr. Wolfgang List
Joachim Mannhardt
Dr. Jochen Mohns
Karin Mühlfriedel
Thomas Peither
Volker Roeder
Dr. Marc Schiller
Dr. Ingo Symietz
Dr. Hans Tups
Michael Voß
Wolfgang Winter
Creating QbD / PAT , Dated September 27, 2007, V1.0 page 66 of 67 ISPE-PAT-CoP-DACH-Awareness-Doc-Final-V1.0
8 Glossary API Active Pharmaceutical Ingredient
CMC Chemistry, Manufacturing and Control
CoP Community of Practice
CPP Critical Process Parameter
CQA Critical Quality Attributes
CSV Computer System Validation
DB Data Base
DCS Distributed Control System
DMAIC Define Measure Analyze Implement and Control
DoE Design of Experiment
DSC Differential Scanning Calorimetry
EU European Union
FDA Food and Drug Administration
FMEA Failure Mode and Effects Analysis
GMP Good Manufacturing Practice
HPLC High Performance Liquid Chromatography
ICH International Conference on Harmonisation of Technical Requirements for Registration of Pharmaceuticals for Human Use
IT Information Technology
MIR Mid Infrared (Spectroscopy)
MVDA Multi Variate Data Analysis
NIR Near Infrared (Spectroscopy)
NMR Nuclear Magnetic Resonance (Spectroscopy)
OEE Overall Equipment Effectiveness
OOS Out of Specification
OTIF On Time in Full Delivery
PAS Parental Alienation Syndrome
PAT Process Analytical Technology
PLS Partial Least Squares
PR Parametric Release
QA Quality Assurance
Creating QbD / PAT , Dated September 27, 2007, V1.0 page 67 of 67 ISPE-PAT-CoP-DACH-Awareness-Doc-Final-V1.0
QbD Quality by Design
QC Quality Control
R&D Research and Development
ROI Return on Investment
RTR Real Time Release
SOA Service Oriented Architecture
SW Software
WIP Work in Progress
XML Extensible Markup Language