TAUS MT SHOWCASE, The DQF Tools, Rahzeb Choudhury and Maxim Khalilov, TAUS, 12 June 2013
-
Upload
taus-enabling-better-translation -
Category
Technology
-
view
269 -
download
1
description
Transcript of TAUS MT SHOWCASE, The DQF Tools, Rahzeb Choudhury and Maxim Khalilov, TAUS, 12 June 2013
![Page 1: TAUS MT SHOWCASE, The DQF Tools, Rahzeb Choudhury and Maxim Khalilov, TAUS, 12 June 2013](https://reader033.fdocuments.in/reader033/viewer/2022052619/5563166cd8b42a81528b4dda/html5/thumbnails/1.jpg)
TAUS MACHINE TRANSLATION SHOWCASE
TAUS Dynamic Quality Framework Tools 11:30 – 11:50 Wednesday, 12 June 2013 Rahzeb Choudhury and Maxim Khalilov TAUS
![Page 2: TAUS MT SHOWCASE, The DQF Tools, Rahzeb Choudhury and Maxim Khalilov, TAUS, 12 June 2013](https://reader033.fdocuments.in/reader033/viewer/2022052619/5563166cd8b42a81528b4dda/html5/thumbnails/2.jpg)
2
Clients
MLV’s
In country offices/partners
Distributed translators/authors
4 to 30 vendors
10 to 40 languages
100’ to 1000’s translators/authors
Vendor Management Project Management
Quality Assurance TranslaOon Memory
Account Management
Resources Management
Quality Assurance
Project Management TranslaOon Memory
Resources Management
Quality Assurance
Project Management
TranslaOon Memory
Quality Assurance TranslaOon Memory
Cascaded Supply Chain
This slide may not be used or copied without permission from TAUS
![Page 3: TAUS MT SHOWCASE, The DQF Tools, Rahzeb Choudhury and Maxim Khalilov, TAUS, 12 June 2013](https://reader033.fdocuments.in/reader033/viewer/2022052619/5563166cd8b42a81528b4dda/html5/thumbnails/3.jpg)
Dynamic Quality Framework • Need to go up and down in quality and the translaPon
industry’s use of quality evaluaOon models and metrics needed to reflect this,
• Need industry benchmarking to strengthen and improve the credibility of quality assurance processes,
• Need to lower cost of quality assurance at buyers and providers.
" We aim to achieve this through an industry shared knowledge base, guidance on
QE model selecOon and shared tools for benchmarking.
This slide may not be used or copied without permission from TAUS
![Page 4: TAUS MT SHOWCASE, The DQF Tools, Rahzeb Choudhury and Maxim Khalilov, TAUS, 12 June 2013](https://reader033.fdocuments.in/reader033/viewer/2022052619/5563166cd8b42a81528b4dda/html5/thumbnails/4.jpg)
Project OrganizaPon
• Ongoing iniPaPve since January 2011
• Bimonthly project management calls, primarily with TAUS members
• TAUS DQF team – Nora Aranberri, Maxim Khalilov,
Sharon O’Brien, Jaap van der Meer, Rahzeb Choudhury
• Development outsourced
This slide may not be used or copied without permission from TAUS
![Page 5: TAUS MT SHOWCASE, The DQF Tools, Rahzeb Choudhury and Maxim Khalilov, TAUS, 12 June 2013](https://reader033.fdocuments.in/reader033/viewer/2022052619/5563166cd8b42a81528b4dda/html5/thumbnails/5.jpg)
DYNAMIC QUALITY FRAMEWORK THEORY
This slide may not be used or copied without permission from TAUS
![Page 6: TAUS MT SHOWCASE, The DQF Tools, Rahzeb Choudhury and Maxim Khalilov, TAUS, 12 June 2013](https://reader033.fdocuments.in/reader033/viewer/2022052619/5563166cd8b42a81528b4dda/html5/thumbnails/6.jpg)
This slide may not be used or copied without permission from TAUS
![Page 7: TAUS MT SHOWCASE, The DQF Tools, Rahzeb Choudhury and Maxim Khalilov, TAUS, 12 June 2013](https://reader033.fdocuments.in/reader033/viewer/2022052619/5563166cd8b42a81528b4dda/html5/thumbnails/7.jpg)
This slide may not be used or copied without permission from TAUS
DYNAMIC QUALITY FRAMEWORK IN PRACTICE
![Page 8: TAUS MT SHOWCASE, The DQF Tools, Rahzeb Choudhury and Maxim Khalilov, TAUS, 12 June 2013](https://reader033.fdocuments.in/reader033/viewer/2022052619/5563166cd8b42a81528b4dda/html5/thumbnails/8.jpg)
DQF Content Profiling – Since July 2012
This slide may not be used or copied without permission from TAUS
![Page 9: TAUS MT SHOWCASE, The DQF Tools, Rahzeb Choudhury and Maxim Khalilov, TAUS, 12 June 2013](https://reader033.fdocuments.in/reader033/viewer/2022052619/5563166cd8b42a81528b4dda/html5/thumbnails/9.jpg)
DQF Content Profiling
• DelineaPng quality requirements
• Shared approach to idenPfy best matching QE model(s) for content type and operaPng model
• Greater credibility to decisions
• Based on feedback during QE Summit Dublin (March 2013), working on version 2
• Available for scruPny QE Summit San Jose, October 9
This slide may not be used or copied without permission from TAUS
![Page 10: TAUS MT SHOWCASE, The DQF Tools, Rahzeb Choudhury and Maxim Khalilov, TAUS, 12 June 2013](https://reader033.fdocuments.in/reader033/viewer/2022052619/5563166cd8b42a81528b4dda/html5/thumbnails/10.jpg)
DQF Knowledgebase – Since July 2012
This slide may not be used or copied without permission from TAUS
![Page 11: TAUS MT SHOWCASE, The DQF Tools, Rahzeb Choudhury and Maxim Khalilov, TAUS, 12 June 2013](https://reader033.fdocuments.in/reader033/viewer/2022052619/5563166cd8b42a81528b4dda/html5/thumbnails/11.jpg)
DQF Knowledgebase
This slide may not be used or copied without permission from TAUS
![Page 12: TAUS MT SHOWCASE, The DQF Tools, Rahzeb Choudhury and Maxim Khalilov, TAUS, 12 June 2013](https://reader033.fdocuments.in/reader033/viewer/2022052619/5563166cd8b42a81528b4dda/html5/thumbnails/12.jpg)
DQF Knowledgebase
This slide may not be used or copied without permission from TAUS
![Page 13: TAUS MT SHOWCASE, The DQF Tools, Rahzeb Choudhury and Maxim Khalilov, TAUS, 12 June 2013](https://reader033.fdocuments.in/reader033/viewer/2022052619/5563166cd8b42a81528b4dda/html5/thumbnails/13.jpg)
DQF Knowledgebase
This slide may not be used or copied without permission from TAUS
![Page 14: TAUS MT SHOWCASE, The DQF Tools, Rahzeb Choudhury and Maxim Khalilov, TAUS, 12 June 2013](https://reader033.fdocuments.in/reader033/viewer/2022052619/5563166cd8b42a81528b4dda/html5/thumbnails/14.jpg)
DQF Knowledgebase
This slide may not be used or copied without permission from TAUS
![Page 15: TAUS MT SHOWCASE, The DQF Tools, Rahzeb Choudhury and Maxim Khalilov, TAUS, 12 June 2013](https://reader033.fdocuments.in/reader033/viewer/2022052619/5563166cd8b42a81528b4dda/html5/thumbnails/15.jpg)
Acer DQF KB
• Leverage industry best pracPces to create/refine quality programs
• Central resource that can be systemaPcally reviewed and improved to benefit all
• Work together to standardize approaches, definiPons and metrics
• Following QE Summit Dublin held consultaPons and published publicly available best pracPces guidelines
This slide may not be used or copied without permission from TAUS
![Page 16: TAUS MT SHOWCASE, The DQF Tools, Rahzeb Choudhury and Maxim Khalilov, TAUS, 12 June 2013](https://reader033.fdocuments.in/reader033/viewer/2022052619/5563166cd8b42a81528b4dda/html5/thumbnails/16.jpg)
DQF Best PracPce Guidelines – Since May 2013
This slide may not be used or copied without permission from TAUS
![Page 17: TAUS MT SHOWCASE, The DQF Tools, Rahzeb Choudhury and Maxim Khalilov, TAUS, 12 June 2013](https://reader033.fdocuments.in/reader033/viewer/2022052619/5563166cd8b42a81528b4dda/html5/thumbnails/17.jpg)
DQF Best PracPce Guidelines
This slide may not be used or copied without permission from TAUS
![Page 18: TAUS MT SHOWCASE, The DQF Tools, Rahzeb Choudhury and Maxim Khalilov, TAUS, 12 June 2013](https://reader033.fdocuments.in/reader033/viewer/2022052619/5563166cd8b42a81528b4dda/html5/thumbnails/18.jpg)
DQF Tools
This slide may not be used or copied without permission from TAUS
![Page 19: TAUS MT SHOWCASE, The DQF Tools, Rahzeb Choudhury and Maxim Khalilov, TAUS, 12 June 2013](https://reader033.fdocuments.in/reader033/viewer/2022052619/5563166cd8b42a81528b4dda/html5/thumbnails/19.jpg)
Metrics: Repor-ng
ü See how you compare against peers ü Drill down to see the impact of individuals ü Assess correlaPon between automated metrics and
human evaluaPon ü Shared learning to feed fundamental research Apply objec-ve criteria and raise the credibility of transla-on quality assurance func-on across the industry
This slide may not be used or copied without permission from TAUS
![Page 20: TAUS MT SHOWCASE, The DQF Tools, Rahzeb Choudhury and Maxim Khalilov, TAUS, 12 June 2013](https://reader033.fdocuments.in/reader033/viewer/2022052619/5563166cd8b42a81528b4dda/html5/thumbnails/20.jpg)
Quality evaluaPon
ProducPvity tesPng
System comparison
-‐ Adequacy -‐ Fluency -‐ Error typology
Post-‐edited MT / translaPon from scratch
-‐ Ranking -‐ Quick comparison
DQF tools
This slide may not be used or copied without permission from TAUS
![Page 21: TAUS MT SHOWCASE, The DQF Tools, Rahzeb Choudhury and Maxim Khalilov, TAUS, 12 June 2013](https://reader033.fdocuments.in/reader033/viewer/2022052619/5563166cd8b42a81528b4dda/html5/thumbnails/21.jpg)
Metrics: Tools
This slide may not be used or copied without permission from TAUS
![Page 22: TAUS MT SHOWCASE, The DQF Tools, Rahzeb Choudhury and Maxim Khalilov, TAUS, 12 June 2013](https://reader033.fdocuments.in/reader033/viewer/2022052619/5563166cd8b42a81528b4dda/html5/thumbnails/22.jpg)
MT EvaluaPon Tool: new project
This slide may not be used or copied without permission from TAUS
![Page 23: TAUS MT SHOWCASE, The DQF Tools, Rahzeb Choudhury and Maxim Khalilov, TAUS, 12 June 2013](https://reader033.fdocuments.in/reader033/viewer/2022052619/5563166cd8b42a81528b4dda/html5/thumbnails/23.jpg)
MT EvaluaPon Tool: new project
This slide may not be used or copied without permission from TAUS
![Page 24: TAUS MT SHOWCASE, The DQF Tools, Rahzeb Choudhury and Maxim Khalilov, TAUS, 12 June 2013](https://reader033.fdocuments.in/reader033/viewer/2022052619/5563166cd8b42a81528b4dda/html5/thumbnails/24.jpg)
MT EvaluaPon Tool: new project
This slide may not be used or copied without permission from TAUS
![Page 25: TAUS MT SHOWCASE, The DQF Tools, Rahzeb Choudhury and Maxim Khalilov, TAUS, 12 June 2013](https://reader033.fdocuments.in/reader033/viewer/2022052619/5563166cd8b42a81528b4dda/html5/thumbnails/25.jpg)
MT EvaluaPon Tool: new project
This slide may not be used or copied without permission from TAUS
![Page 26: TAUS MT SHOWCASE, The DQF Tools, Rahzeb Choudhury and Maxim Khalilov, TAUS, 12 June 2013](https://reader033.fdocuments.in/reader033/viewer/2022052619/5563166cd8b42a81528b4dda/html5/thumbnails/26.jpg)
MT EvaluaPon Tool: new project
This slide may not be used or copied without permission from TAUS
![Page 27: TAUS MT SHOWCASE, The DQF Tools, Rahzeb Choudhury and Maxim Khalilov, TAUS, 12 June 2013](https://reader033.fdocuments.in/reader033/viewer/2022052619/5563166cd8b42a81528b4dda/html5/thumbnails/27.jpg)
MT EvaluaPon Tool: quality evaluaPon project
This slide may not be used or copied without permission from TAUS
![Page 28: TAUS MT SHOWCASE, The DQF Tools, Rahzeb Choudhury and Maxim Khalilov, TAUS, 12 June 2013](https://reader033.fdocuments.in/reader033/viewer/2022052619/5563166cd8b42a81528b4dda/html5/thumbnails/28.jpg)
MT EvaluaPon Tool: quality evaluaPon project
This slide may not be used or copied without permission from TAUS
![Page 29: TAUS MT SHOWCASE, The DQF Tools, Rahzeb Choudhury and Maxim Khalilov, TAUS, 12 June 2013](https://reader033.fdocuments.in/reader033/viewer/2022052619/5563166cd8b42a81528b4dda/html5/thumbnails/29.jpg)
MT EvaluaPon Tool: quality evaluaPon project
This slide may not be used or copied without permission from TAUS
![Page 30: TAUS MT SHOWCASE, The DQF Tools, Rahzeb Choudhury and Maxim Khalilov, TAUS, 12 June 2013](https://reader033.fdocuments.in/reader033/viewer/2022052619/5563166cd8b42a81528b4dda/html5/thumbnails/30.jpg)
Metrics: Repor-ng
This slide may not be used or copied without permission from TAUS
![Page 31: TAUS MT SHOWCASE, The DQF Tools, Rahzeb Choudhury and Maxim Khalilov, TAUS, 12 June 2013](https://reader033.fdocuments.in/reader033/viewer/2022052619/5563166cd8b42a81528b4dda/html5/thumbnails/31.jpg)
Metrics: Repor-ng
This slide may not be used or copied without permission from TAUS
Post-‐editor 1
![Page 32: TAUS MT SHOWCASE, The DQF Tools, Rahzeb Choudhury and Maxim Khalilov, TAUS, 12 June 2013](https://reader033.fdocuments.in/reader033/viewer/2022052619/5563166cd8b42a81528b4dda/html5/thumbnails/32.jpg)
Metrics: Repor-ng
This slide may not be used or copied without permission from TAUS
![Page 33: TAUS MT SHOWCASE, The DQF Tools, Rahzeb Choudhury and Maxim Khalilov, TAUS, 12 June 2013](https://reader033.fdocuments.in/reader033/viewer/2022052619/5563166cd8b42a81528b4dda/html5/thumbnails/33.jpg)
Upcoming DQF
• ConsutlaPons (pricing MT post-‐ediPng)
• TranslaPon Tools Adopt DQF Models
• DQF Tool v2 -‐ Go live August
• LocalizaPon InsPtute Course translaPon quaity evaluaPon; will be based largely on the DQF, starts September 2013
• QE Summit, San Jose, 9 October 2013, hosted by Adobe
This slide may not be used or copied without permission from TAUS
![Page 34: TAUS MT SHOWCASE, The DQF Tools, Rahzeb Choudhury and Maxim Khalilov, TAUS, 12 June 2013](https://reader033.fdocuments.in/reader033/viewer/2022052619/5563166cd8b42a81528b4dda/html5/thumbnails/34.jpg)
QE Summit San Jose
This slide may not be used or copied without permission from TAUS