Craftworkz at InterConnect 2017 - Creating a Highly Scalable Chatbot in a Microservices Architecture...
67
Session ID: 3322A Company: Craftworkz Sam Hendrickx & Michiel Vandendriessche IBM InterConnect 2017 Conference eating a Highly Scalable Chatbot in a Microservices Architecture Using IBM Bluemix
-
Upload
craftworkz -
Category
Data & Analytics
-
view
541 -
download
0
Transcript of Craftworkz at InterConnect 2017 - Creating a Highly Scalable Chatbot in a Microservices Architecture...
Session ID: 3322ACompany: Craftworkz
Sam Hendrickx & Michiel Vandendriessche
IBM InterConnect 2017 Conference
Creating a Highly Scalable Chatbot in a Microservices Architecture Using IBM Bluemix
Hi handsome! How are you doing today?
Feeling great! Just visiting San Francisco. How r u?
Not yet, we just came back from a conference.
I’m doing fine. Any plans for tonight?
Want to go for a drink?
Yeah why not!
Awesome Michiel! Can you please verify your identity here so I know you’re not a creep: http://bit.ly/abc123
OMG, IT’S A BOT!
THE ERA OF BOTS
BELGIUM
FRENCH GERMAN
39%
DUTCH
1%60%
BELGIUM
NOBODY CARESABOUT DUTCH
LET’S BUILD ITOURSELVES
NLP
REST
SESSION
RESPONSE
FIRST APPROACH
NLP
REST
SESSION
RESPONSE
FIRST APPROACH
NLP
REST
SESSION
RESPONSE
FIRST APPROACH
NLP
REST
SESSION
RESPONSE
FIRST APPROACH
NLP
REST
SESSION
RESPONSE
FIRST APPROACH
What can you tell me about IBM InterConnect 2017?
InterConnect is a conference where you can tap into the most advanced cloud technology in the market today!
Where is it being held?
The location of InterConnect is Mandalay Bay, Las Vegas, NV
DAMN, IT’S NOT SCALING!
10 USERS10 MESSAGES
2,0 SEC
1.000 USERS10 MESSAGES
TIMEOUTS
ADD MOREINSTANCES!
NLP
REST
SESSION
RESPONSENLP
REST
SESSION
RESPONSENLP
REST
SESSION
RESPONSE
PYTHON RUNTIMES
. . .
BOT SUFFERINGFROM AMNESIA
What can you tell me about IBM InterConnect 2017?
InterConnect is a conference where you can tap into the most advanced cloud technology in the market today!
Where is it being held?
I don’t know how to answer that question…
???
NLP
REST
SESSION
RESPONSENLP
REST
SESSION
RESPONSENLP
REST
SESSION
RESPONSE
PYTHON RUNTIMES
. . .
NLP
REST
SESSION
RESPONSE CONTEXT STORED IN MEMORY
NLP
REST
SESSION
RESPONSENLP
REST
SESSION
RESPONSENLP
REST
SESSION
RESPONSE
PYTHON RUNTIMES
. . .
STORE SESSION INFO IN DATABASE
NLP
REST
SESSION MANAGER
RESPONSENLP
REST
SESSION MANAGER
RESPONSENLP
REST
SESSION MANAGER
RESPONSE
PYTHON RUNTIMES
. . .
SESSION
COMPOSE FOR MONGODB
OUR BOT IS NOTON SOCIAL MEDIA!
NLP
REST
SESSION MANAGER
RESPONSE
WE DON’T WANT TO MANAGE CONNECTIONS HERE
ADD API MANAGERTO ARCHITECTURE
SESSION
COMPOSE FOR MONGODB
APIMANAGER
APIMANAGER
APIMANAGER . . .
NODEJS RUNTIMES
NLP
REST
SESSION MANAGER
RESPONSENLP
REST
SESSION MANAGER
RESPONSENLP
REST
SESSION MANAGER
RESPONSE
PYTHON RUNTIMES
. . .
SESSION
COMPOSE FOR MONGODB
APIMANAGER
APIMANAGER
APIMANAGER . . .
NODEJS RUNTIMES
NLP
REST
SESSION MANAGER
RESPONSENLP
REST
SESSION MANAGER
RESPONSENLP
REST
SESSION MANAGER
RESPONSE
PYTHON RUNTIMES
. . .
SOME MESSAGESARE GETTING LOST!
SESSION
COMPOSE FOR MONGODB
APIMANAGER
APIMANAGER
APIMANAGER . . .
NODEJS RUNTIMES
NLP
REST
SESSION MANAGER
RESPONSENLP
REST
SESSION MANAGER
RESPONSENLP
REST
SESSION MANAGER
RESPONSE
PYTHON RUNTIMES
. . .
MESSAGELOSS!
QUEUEING TOTHE RESCUE!
SESSION
COMPOSE FOR MONGODB
APIMANAGER
APIMANAGER
APIMANAGER
. . . NODEJS RUNTIMES
COMPOSE FOR REDIS
NLP
SESSION MANAGER
RESPONSE
PYTHON RUNTIMES
. . . NLP
SESSION MANAGER
RESPONSE NLP
SESSION MANAGER
RESPONSE
OUR AI NEEDSEXTERNAL DATA!
LET’S MANAGE THOSECONNECTIONS!
NLP
CONNECTION MANAGER
SESSION MANAGER
RESPONSE
SESSION
COMPOSE FOR MONGODB
APIMANAGER
APIMANAGER
APIMANAGER . . .
NODEJS RUNTIMES
COMPOSE FOR REDIS
PYTHON RUNTIMES
. . . NLP
SESSION MANAGER
RESPONSE
CONNECTION MANAGER
NLP
SESSION MANAGER
RESPONSE
CONNECTION MANAGER
NLP
SESSION MANAGER
RESPONSE
CONNECTION MANAGER
OOPS, THIS I/OIS QUITE SLOW!
BEFORE
NLP
SESSION MANAGER
RESPONSE
Q
A
~ 20 ms
WITH I/O
NLP
CONNECTION MANAGER
SESSION MANAGER
RESPONSE
Q
A
~ 200 ms
10.000 USERS10 MESSAGES
SLOOOOW
CPU USAGE
5%
THREADS THREADSTHREADS THREADS!
CPU USAGE
93%
SESSION
COMPOSE FOR MONGODB
APIMANAGER
APIMANAGER
APIMANAGER . . .
NODEJS RUNTIMES
COMPOSE FOR REDIS
PYTHON RUNTIMES
. . . NLP
SESSION MANAGER
RESPONSE
CONNECTION MANAGER
NLP
SESSION MANAGER
RESPONSE
CONNECTION MANAGER
NLP
SESSION MANAGER
RESPONSE
CONNECTION MANAGER
RESULTS
2,6 SEC
THESE INSTANCESSHOULD BE SCALING…
BLUEMIX AUTO-SCALING,
TAKE IT AWAY!
FINAL RESULTS
0,6 SEC
DEMO
NOBODY CARESABOUT DUTCH
WATSON CARES!
SESSION
COMPOSE FOR MONGODB
APIMANAGER
APIMANAGER
APIMANAGER . . .
NODEJS RUNTIMES
COMPOSE FOR REDIS
PYTHON RUNTIMES
. . . NLP
SESSION MANAGER
RESPONSE
CONNECTION MANAGER
NLP
SESSION MANAGER
RESPONSE
CONNECTION MANAGER
NLP
SESSION MANAGER
RESPONSE
CONNECTION MANAGER
SESSION
COMPOSE FOR MONGODB
APIMANAGER
APIMANAGER
APIMANAGER . . .
NODEJS RUNTIMES
COMPOSE FOR REDIS
PYTHON RUNTIMES
. . . SESSION MANAGER
RESPONSE
CONNECTION MANAGER
SESSION MANAGER
RESPONSE
CONNECTION MANAGER
SESSION MANAGER
RESPONSE
CONNECTION MANAGER
Get Connected
@craftworkz_co
Let’s stay in touch! We can meet you in one of our offices in Leuven or Kontich. Or we can come to you. Nothing beats a coffee and an interesting conversation ;-)
@craftworkz
@craftworkzco
@craftworkz_co
www.craftworkz.be
Veldkant 33A, 2550 Kontich
+32 498 44 50 61
Headquarter
Gaston Geenslaan 11 B4BE-3001 Leuven
LEUVEN (BE) OFFICE
Veldkant 33ABE-2550 Kontich
ANTWERP (BE) OFFICE
Pedro de Medinalaan 81,NL-1086 XP Amsterdam
AMSTERDAM (NL) OFFICE
![[LAB] Roberto Pozzi - Build a Microservices System with Bluemix](https://static.fdocuments.in/doc/165x107/587e11891a28abbc2e8b4785/lab-roberto-pozzi-build-a-microservices-system-with-bluemix.jpg)
