Domain-specific NLP pipelines - AI Convention Europe · Domain-specific pipelines Non-standard...
Transcript of Domain-specific NLP pipelines - AI Convention Europe · Domain-specific pipelines Non-standard...
![Page 2: Domain-specific NLP pipelines - AI Convention Europe · Domain-specific pipelines Non-standard language use: Radio communication (police, air traffic control) Dispatcher: Adam Twelve](https://reader034.fdocuments.in/reader034/viewer/2022042309/5ed6d2b8126754677f62fef5/html5/thumbnails/2.jpg)
NLP use cases
![Page 3: Domain-specific NLP pipelines - AI Convention Europe · Domain-specific pipelines Non-standard language use: Radio communication (police, air traffic control) Dispatcher: Adam Twelve](https://reader034.fdocuments.in/reader034/viewer/2022042309/5ed6d2b8126754677f62fef5/html5/thumbnails/3.jpg)
When do you need an NLP pipeline?
Resource intensive and/or repetitive tasks on textual data:
● Call center:○ 40% are requests for information
○ Employees answer the same questions over and over again
● Order management:○ orders come in in several formats: phone, email, …
○ every order has to be manually inserted in Order Management System
● Reviews:○ What are clients happy about?
○ What could be better?
![Page 4: Domain-specific NLP pipelines - AI Convention Europe · Domain-specific pipelines Non-standard language use: Radio communication (police, air traffic control) Dispatcher: Adam Twelve](https://reader034.fdocuments.in/reader034/viewer/2022042309/5ed6d2b8126754677f62fef5/html5/thumbnails/4.jpg)
Building blocks of an NLP pipeline
![Page 5: Domain-specific NLP pipelines - AI Convention Europe · Domain-specific pipelines Non-standard language use: Radio communication (police, air traffic control) Dispatcher: Adam Twelve](https://reader034.fdocuments.in/reader034/viewer/2022042309/5ed6d2b8126754677f62fef5/html5/thumbnails/5.jpg)
Building blocks
![Page 6: Domain-specific NLP pipelines - AI Convention Europe · Domain-specific pipelines Non-standard language use: Radio communication (police, air traffic control) Dispatcher: Adam Twelve](https://reader034.fdocuments.in/reader034/viewer/2022042309/5ed6d2b8126754677f62fef5/html5/thumbnails/6.jpg)
Building blocks
![Page 7: Domain-specific NLP pipelines - AI Convention Europe · Domain-specific pipelines Non-standard language use: Radio communication (police, air traffic control) Dispatcher: Adam Twelve](https://reader034.fdocuments.in/reader034/viewer/2022042309/5ed6d2b8126754677f62fef5/html5/thumbnails/7.jpg)
NLP Use cases
Technique Use cases
Classification or labelling Chatbots in customer support, FAQ, sales, ...
Sentiment analysis in customer support, reviews, ...
Automatic tagging, routing and answering support tickets
Tagging of customer complaints
Entity extraction Chatbots
Extract to-do lists, tasks, responsibilities, deadlines etc. from emails, meeting notes, …
Document matching Resume matching
Q&A matching
Summarization Information overload
Newsletters
Question answering based on help docs
Natural Language Generation Question Answering with Knowledge Database
Automatic translation
![Page 8: Domain-specific NLP pipelines - AI Convention Europe · Domain-specific pipelines Non-standard language use: Radio communication (police, air traffic control) Dispatcher: Adam Twelve](https://reader034.fdocuments.in/reader034/viewer/2022042309/5ed6d2b8126754677f62fef5/html5/thumbnails/8.jpg)
Building blocks
![Page 9: Domain-specific NLP pipelines - AI Convention Europe · Domain-specific pipelines Non-standard language use: Radio communication (police, air traffic control) Dispatcher: Adam Twelve](https://reader034.fdocuments.in/reader034/viewer/2022042309/5ed6d2b8126754677f62fef5/html5/thumbnails/9.jpg)
Word, sentence and document vectors
NLP models are trained on set of annotated expressions. They learn the relation
between a linguistic pattern and a label.
“Learn” = solve an equation that maps expressions to a label.
We need numbers!
![Page 10: Domain-specific NLP pipelines - AI Convention Europe · Domain-specific pipelines Non-standard language use: Radio communication (police, air traffic control) Dispatcher: Adam Twelve](https://reader034.fdocuments.in/reader034/viewer/2022042309/5ed6d2b8126754677f62fef5/html5/thumbnails/10.jpg)
Word vectors or embeddings
Numerical vectors that describe the meaning of the word. Trained on large text corpora (eg. Wikipedia) and huge amounts of processing power.
word Female name regalness …
King 0 0.1 1 …
Queen 1 0.1 1 …
Porsche 0.3 0.2 0.3 …
Fiat 500 0.6 0 0 …
Lieselotte 1 1 0.1 …
Elizabeth 1 1 0.4 …
… … … … …
300 ‘meaning’ dimensions
1.6
mill
ion w
ord
s
complaint:
[-0.041264 0.026875 0.021691 0.040996 0.066634 0.079733 0.022150 0.021975 -
0.029170 -0.084697 -0.082365 0.065289 0.085305 -0.082154 -0.064156 0.036492 -
0.036538 0.047131 0.051098 -0.036164 -0.023157 0.021665 0.082819 0.077477 ...]
![Page 11: Domain-specific NLP pipelines - AI Convention Europe · Domain-specific pipelines Non-standard language use: Radio communication (police, air traffic control) Dispatcher: Adam Twelve](https://reader034.fdocuments.in/reader034/viewer/2022042309/5ed6d2b8126754677f62fef5/html5/thumbnails/11.jpg)
Building blocks
![Page 12: Domain-specific NLP pipelines - AI Convention Europe · Domain-specific pipelines Non-standard language use: Radio communication (police, air traffic control) Dispatcher: Adam Twelve](https://reader034.fdocuments.in/reader034/viewer/2022042309/5ed6d2b8126754677f62fef5/html5/thumbnails/12.jpg)
Building blocks
![Page 13: Domain-specific NLP pipelines - AI Convention Europe · Domain-specific pipelines Non-standard language use: Radio communication (police, air traffic control) Dispatcher: Adam Twelve](https://reader034.fdocuments.in/reader034/viewer/2022042309/5ed6d2b8126754677f62fef5/html5/thumbnails/13.jpg)
Domain-specific pipelines
![Page 14: Domain-specific NLP pipelines - AI Convention Europe · Domain-specific pipelines Non-standard language use: Radio communication (police, air traffic control) Dispatcher: Adam Twelve](https://reader034.fdocuments.in/reader034/viewer/2022042309/5ed6d2b8126754677f62fef5/html5/thumbnails/14.jpg)
Domain-specific pipelines
Jargon-filled language:
● Financial documents like prospectuses, annual
reports, shareholder letters,...
● Legal documents like contracts, legislation, …
● Technical manuals
● R&D lab reports
![Page 15: Domain-specific NLP pipelines - AI Convention Europe · Domain-specific pipelines Non-standard language use: Radio communication (police, air traffic control) Dispatcher: Adam Twelve](https://reader034.fdocuments.in/reader034/viewer/2022042309/5ed6d2b8126754677f62fef5/html5/thumbnails/15.jpg)
Domain-specific pipelines
Jargon-filled language:
● Financial documents like prospectuses, annual
reports, shareholder letters,...
● Legal documents like contracts, legislation, …
● Technical manuals
● R&D lab reports
I have no interest in
your interest rate...
![Page 16: Domain-specific NLP pipelines - AI Convention Europe · Domain-specific pipelines Non-standard language use: Radio communication (police, air traffic control) Dispatcher: Adam Twelve](https://reader034.fdocuments.in/reader034/viewer/2022042309/5ed6d2b8126754677f62fef5/html5/thumbnails/16.jpg)
Domain-specific pipelines
Non-standard language use:
● Radio communication (police, air traffic control)
Dispatcher: Adam Twelve code five.
Adam Twelve: Twelve, code five, go ahead.
Dispatcher: I'm showing a warrant on your party, Doe, John Q., date of birth three five of sixty,
showing physical as white male, six foot, two-eighty, blond and blue, break--
● Text messages
![Page 17: Domain-specific NLP pipelines - AI Convention Europe · Domain-specific pipelines Non-standard language use: Radio communication (police, air traffic control) Dispatcher: Adam Twelve](https://reader034.fdocuments.in/reader034/viewer/2022042309/5ed6d2b8126754677f62fef5/html5/thumbnails/17.jpg)
Domain-specific pipelines
Additional preprocessing needed:
● Multi-language documents
● Resume - job matching
● AI project management tool based on email
● ...
![Page 18: Domain-specific NLP pipelines - AI Convention Europe · Domain-specific pipelines Non-standard language use: Radio communication (police, air traffic control) Dispatcher: Adam Twelve](https://reader034.fdocuments.in/reader034/viewer/2022042309/5ed6d2b8126754677f62fef5/html5/thumbnails/18.jpg)
Domain-specific pipelines
Singular use cases:
● Early-onset dementia detection
● Writing coach
● Pitching coach
● Spell corrector
![Page 19: Domain-specific NLP pipelines - AI Convention Europe · Domain-specific pipelines Non-standard language use: Radio communication (police, air traffic control) Dispatcher: Adam Twelve](https://reader034.fdocuments.in/reader034/viewer/2022042309/5ed6d2b8126754677f62fef5/html5/thumbnails/19.jpg)
Accuracy is paramount
![Page 20: Domain-specific NLP pipelines - AI Convention Europe · Domain-specific pipelines Non-standard language use: Radio communication (police, air traffic control) Dispatcher: Adam Twelve](https://reader034.fdocuments.in/reader034/viewer/2022042309/5ed6d2b8126754677f62fef5/html5/thumbnails/20.jpg)
Questions?
![Page 21: Domain-specific NLP pipelines - AI Convention Europe · Domain-specific pipelines Non-standard language use: Radio communication (police, air traffic control) Dispatcher: Adam Twelve](https://reader034.fdocuments.in/reader034/viewer/2022042309/5ed6d2b8126754677f62fef5/html5/thumbnails/21.jpg)
Thank you