TAUS OPEN SOURCE MACHINE TRANSLATION SHOWCASE, Beijing, Yu Gong, Adobe, 23 April 2012
-
Upload
taus-enabling-better-translation -
Category
Technology
-
view
1.185 -
download
0
description
Transcript of TAUS OPEN SOURCE MACHINE TRANSLATION SHOWCASE, Beijing, Yu Gong, Adobe, 23 April 2012
![Page 1: TAUS OPEN SOURCE MACHINE TRANSLATION SHOWCASE, Beijing, Yu Gong, Adobe, 23 April 2012](https://reader033.fdocuments.in/reader033/viewer/2022052908/5595894b1a28ab1d2a8b4830/html5/thumbnails/1.jpg)
© 2012 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Moses Tool Set A set of tools based on Adobe technology to simplify your usage of Moses Yu Gong | Software Engineer
![Page 2: TAUS OPEN SOURCE MACHINE TRANSLATION SHOWCASE, Beijing, Yu Gong, Adobe, 23 April 2012](https://reader033.fdocuments.in/reader033/viewer/2022052908/5595894b1a28ab1d2a8b4830/html5/thumbnails/2.jpg)
© 2012 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Agenda
§ Addressing Moses Pain Points
§ Advantages of Moses Tool Set
§ Moses Tool Set Architecture
§ Moses Tool Set Features
§ Useful Resources
§ Q&A
![Page 3: TAUS OPEN SOURCE MACHINE TRANSLATION SHOWCASE, Beijing, Yu Gong, Adobe, 23 April 2012](https://reader033.fdocuments.in/reader033/viewer/2022052908/5595894b1a28ab1d2a8b4830/html5/thumbnails/3.jpg)
© 2012 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Addressing Moses Pain Points
1. Corpus Cleaning
2. Engine Training
3. Engine Testing
4. Integrating Moses With Linguistic Platform
![Page 4: TAUS OPEN SOURCE MACHINE TRANSLATION SHOWCASE, Beijing, Yu Gong, Adobe, 23 April 2012](https://reader033.fdocuments.in/reader033/viewer/2022052908/5595894b1a28ab1d2a8b4830/html5/thumbnails/4.jpg)
© 2012 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Advantages of Moses Tool Set
• User Friendly
• Platform Independent
• Open Source
![Page 5: TAUS OPEN SOURCE MACHINE TRANSLATION SHOWCASE, Beijing, Yu Gong, Adobe, 23 April 2012](https://reader033.fdocuments.in/reader033/viewer/2022052908/5595894b1a28ab1d2a8b4830/html5/thumbnails/5.jpg)
© 2012 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Moses Tool Set Architecture
![Page 6: TAUS OPEN SOURCE MACHINE TRANSLATION SHOWCASE, Beijing, Yu Gong, Adobe, 23 April 2012](https://reader033.fdocuments.in/reader033/viewer/2022052908/5595894b1a28ab1d2a8b4830/html5/thumbnails/6.jpg)
© 2012 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Moses Tool Set Features – Corpus Cleaning
Moses Func*onality • Tokenizing • Casing • Long Segments
Adobe Func*onality • Placeholder Handling • URL Handling • Number Cleaning • Duplicate Line
Cleaning • Weird Aligned Pairs • Cleaning by regular
expressions
![Page 7: TAUS OPEN SOURCE MACHINE TRANSLATION SHOWCASE, Beijing, Yu Gong, Adobe, 23 April 2012](https://reader033.fdocuments.in/reader033/viewer/2022052908/5595894b1a28ab1d2a8b4830/html5/thumbnails/7.jpg)
© 2012 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Moses Tool Set Features – Corpus Splitting & Uploading
Split Corpus by Purpose • Training • Tuning • TesCng
Upload Split Corpus to Moses Server
![Page 8: TAUS OPEN SOURCE MACHINE TRANSLATION SHOWCASE, Beijing, Yu Gong, Adobe, 23 April 2012](https://reader033.fdocuments.in/reader033/viewer/2022052908/5595894b1a28ab1d2a8b4830/html5/thumbnails/8.jpg)
© 2012 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Moses Tool Set Features –Training & Tuning
Command Line Pain
Human Unfriendly • Highly Detailed • Error Prone • Difficult To Reproduce
![Page 9: TAUS OPEN SOURCE MACHINE TRANSLATION SHOWCASE, Beijing, Yu Gong, Adobe, 23 April 2012](https://reader033.fdocuments.in/reader033/viewer/2022052908/5595894b1a28ab1d2a8b4830/html5/thumbnails/9.jpg)
© 2012 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Moses Tool Set Features –Training & Tuning
UI To Simplify Inputs • Training Run ID • Language Model
Parameters • Corpus ID • Source & Target • Default Alignment • Default Reordering • Remote Server
![Page 10: TAUS OPEN SOURCE MACHINE TRANSLATION SHOWCASE, Beijing, Yu Gong, Adobe, 23 April 2012](https://reader033.fdocuments.in/reader033/viewer/2022052908/5595894b1a28ab1d2a8b4830/html5/thumbnails/10.jpg)
© 2012 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Moses Tool Set Features –Testing
• How do you know when an engine is good enough? • How do you know when it is intrinsically flawed? • How do you automate comparing a new engine to old ones?
![Page 11: TAUS OPEN SOURCE MACHINE TRANSLATION SHOWCASE, Beijing, Yu Gong, Adobe, 23 April 2012](https://reader033.fdocuments.in/reader033/viewer/2022052908/5595894b1a28ab1d2a8b4830/html5/thumbnails/11.jpg)
© 2012 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Moses Tool Set Features –Testing
• Reliable Scoring • Bleu/Nist/Meteor
• Simplified UI • Dynamic ConnecCon to
exisCng engines • Repeatable
![Page 12: TAUS OPEN SOURCE MACHINE TRANSLATION SHOWCASE, Beijing, Yu Gong, Adobe, 23 April 2012](https://reader033.fdocuments.in/reader033/viewer/2022052908/5595894b1a28ab1d2a8b4830/html5/thumbnails/12.jpg)
© 2012 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Moses Tool Set Features –Testing
• Reliable Scoring • Bleu/Nist/Meteor
• Simplified UI • Dynamic ConnecCon to
exisCng engines • Repeatable
![Page 13: TAUS OPEN SOURCE MACHINE TRANSLATION SHOWCASE, Beijing, Yu Gong, Adobe, 23 April 2012](https://reader033.fdocuments.in/reader033/viewer/2022052908/5595894b1a28ab1d2a8b4830/html5/thumbnails/13.jpg)
© 2012 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Automation
Corpus Cleaning
Corpus Splitting & Uploading
Training & Tuning
Testing
![Page 14: TAUS OPEN SOURCE MACHINE TRANSLATION SHOWCASE, Beijing, Yu Gong, Adobe, 23 April 2012](https://reader033.fdocuments.in/reader033/viewer/2022052908/5595894b1a28ab1d2a8b4830/html5/thumbnails/14.jpg)
© 2012 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Localization Workflow Integration
Moses Tooling Chain
Linguistic Platform
![Page 15: TAUS OPEN SOURCE MACHINE TRANSLATION SHOWCASE, Beijing, Yu Gong, Adobe, 23 April 2012](https://reader033.fdocuments.in/reader033/viewer/2022052908/5595894b1a28ab1d2a8b4830/html5/thumbnails/15.jpg)
© 2012 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Resources
Source Code: http://code.google.com/p/m4loc
![Page 16: TAUS OPEN SOURCE MACHINE TRANSLATION SHOWCASE, Beijing, Yu Gong, Adobe, 23 April 2012](https://reader033.fdocuments.in/reader033/viewer/2022052908/5595894b1a28ab1d2a8b4830/html5/thumbnails/16.jpg)
© 2012 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Questions
![Page 17: TAUS OPEN SOURCE MACHINE TRANSLATION SHOWCASE, Beijing, Yu Gong, Adobe, 23 April 2012](https://reader033.fdocuments.in/reader033/viewer/2022052908/5595894b1a28ab1d2a8b4830/html5/thumbnails/17.jpg)
© 2012 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.