Title slide

Microservices in a Data

Science World@jhug | @NikosDimos

Microservices & Data Science | Jhug

Microservices & Data Science | Jhug

Monolith Microservice

Microservices & Data Science | Jhug

Definition of Microservices{Common Characteristics

1. Componentization via services2. Organized around business capabilities3. Products not Projects4. Smart endpoints and dumb pipes5. Decentralized Governance6. Decentralized Data Management7. Infrastructure Automation8. Design for failure9. Evolutionary Design

http://martinfowler.com/articles/microservices.html

Microservices & Data Science | Jhug

Common characteristics

1. Componentization via services2. Organized around business capabilities3. Products not Projects4. Smart endpoints and dumb pipes5. Decentralized Governance6. Decentralized Data Management7. Infrastructure Automation8. Design for failure9. Evolutionary Design

Microservices & Data Science | Jhug

Componentization via Services

Component

Independently upgradable

Independently replaceable

Library Service

Microservices & Data Science | Jhug

Common characteristics

1. Componentization via services2. Organized around business capabilities3. Products not Projects4. Smart endpoints and dumb pipes5. Decentralized Governance6. Decentralized Data Management7. Infrastructure Automation8. Design for failure9. Evolutionary Design

Microservices & Data Science | Jhug

Organized around business capabilities

UI

SERVER

DATA SCIENCE

Microservices & Data Science | Jhug

Organized around business capabilities

Candidate Deduplication

Candidate Recommender

Shopping Cart

Microservices & Data Science | Jhug

Common characteristics

1. Componentization via services2. Organized around business capabilities3. Products not Projects4. Smart endpoints and dumb pipes5. Decentralized Governance6. Decentralized Data Management7. Infrastructure Automation8. Design for failure9. Evolutionary Design

Microservices & Data Science | Jhug

Smart Endpoints Dumb Pipes

Microservices & Data Science | Jhug

Smart Endpoints Dumb Pipes

Microservices & Data Science | Jhug

Common characteristics

1. Componentization via services2. Organized around business capabilities3. Products not Projects4. Smart endpoints and dumb pipes5. Decentralized Governance6. Decentralized Data Management7. Infrastructure Automation8. Design for failure9. Evolutionary Design

Microservices & Data Science | Jhug

Decentralization of Data Management

Microservices & Data Science | Jhug

Decentralization of Data Management

Microservices & Data Science | Jhug

Benefits Costs

+

+

+

-

-

-

Strong Module Boundaries

Independent Deployment

TechnologyDiversity

Distribution

Eventual Consistency

Operational Complexity

Microservices & Data Science | Jhug

Productivity

Complexity

Monolith

Microservice

Microservices & Data Science | Jhug

Workable journey to Microservices

Microservices & Data Science | Jhug

Workable Gen 1.0

Microservices & Data Science | Jhug

Workable Gen 1.5

Microservices & Data Science | Jhug

Workable Gen 2.0

Microservices & Data Science | Jhug

Workable Gen 2.0

Until we reached this...

Microservices & Data Science | Jhug

Workable Lessons LearnedThings to improve

● Rapid provisioning - Heroku● Basic Monitoring - Newrelic● Rapid Application Deployment - Heroku● Traceable Business Transactions - Kafka

● Devops Culture● Continuous Delivery ● Product-centered Teams

Title slideThanks.@workable | @NikosDimos