Big Data and Machine Learning at Zalando€¦ · BIG DATA AT ZALANDO Business Intelligence Machine...
Transcript of Big Data and Machine Learning at Zalando€¦ · BIG DATA AT ZALANDO Business Intelligence Machine...
![Page 1: Big Data and Machine Learning at Zalando€¦ · BIG DATA AT ZALANDO Business Intelligence Machine Learning Data Governance Data at the core of everything we do. 10 A TYPICAL BIG](https://reader036.fdocuments.in/reader036/viewer/2022062416/5f029f6d7e708231d4052f57/html5/thumbnails/1.jpg)
Big Data and
Machine
Learning at
Zalando
K s h i t i j K u m a r
V i c e P r e s i d e n t ,
D a t a I n f r a s t r u c t u r e
1 0 - 0 3 - 2 0 1 9
![Page 2: Big Data and Machine Learning at Zalando€¦ · BIG DATA AT ZALANDO Business Intelligence Machine Learning Data Governance Data at the core of everything we do. 10 A TYPICAL BIG](https://reader036.fdocuments.in/reader036/viewer/2022062416/5f029f6d7e708231d4052f57/html5/thumbnails/2.jpg)
2
WE LOVE FASHION
![Page 3: Big Data and Machine Learning at Zalando€¦ · BIG DATA AT ZALANDO Business Intelligence Machine Learning Data Governance Data at the core of everything we do. 10 A TYPICAL BIG](https://reader036.fdocuments.in/reader036/viewer/2022062416/5f029f6d7e708231d4052f57/html5/thumbnails/3.jpg)
3
WHAT STARTED AS A
SIMPLE ONLINE
SHOP…
![Page 4: Big Data and Machine Learning at Zalando€¦ · BIG DATA AT ZALANDO Business Intelligence Machine Learning Data Governance Data at the core of everything we do. 10 A TYPICAL BIG](https://reader036.fdocuments.in/reader036/viewer/2022062416/5f029f6d7e708231d4052f57/html5/thumbnails/4.jpg)
4
…HAS BECOME THE
LEADING EUROPEAN
ONLINE PLATFORM
FOR FASHION
![Page 5: Big Data and Machine Learning at Zalando€¦ · BIG DATA AT ZALANDO Business Intelligence Machine Learning Data Governance Data at the core of everything we do. 10 A TYPICAL BIG](https://reader036.fdocuments.in/reader036/viewer/2022062416/5f029f6d7e708231d4052f57/html5/thumbnails/5.jpg)
5
W E O F F E R A S U C C E S S F U L AN D C U R AT E D AS S O R T M E N T
HIGHLY
EXPERIENCED category management
CURATED
SHOPPINGwith Zalon
> 500 designers & stylists
> 300,000 articles from
~ 2,000international brands
private labels11
LOCALIZATIONof the assortment
![Page 6: Big Data and Machine Learning at Zalando€¦ · BIG DATA AT ZALANDO Business Intelligence Machine Learning Data Governance Data at the core of everything we do. 10 A TYPICAL BIG](https://reader036.fdocuments.in/reader036/viewer/2022062416/5f029f6d7e708231d4052f57/html5/thumbnails/6.jpg)
6
PLATFORM STRATEGY
BRANDS CONSUMERS
ENABLER
![Page 7: Big Data and Machine Learning at Zalando€¦ · BIG DATA AT ZALANDO Business Intelligence Machine Learning Data Governance Data at the core of everything we do. 10 A TYPICAL BIG](https://reader036.fdocuments.in/reader036/viewer/2022062416/5f029f6d7e708231d4052f57/html5/thumbnails/7.jpg)
7
WE DRESS CODE
![Page 8: Big Data and Machine Learning at Zalando€¦ · BIG DATA AT ZALANDO Business Intelligence Machine Learning Data Governance Data at the core of everything we do. 10 A TYPICAL BIG](https://reader036.fdocuments.in/reader036/viewer/2022062416/5f029f6d7e708231d4052f57/html5/thumbnails/8.jpg)
8
WE ARE CONSTANTLY INNOVATING
CLOUD-BASED,
CUTTING-EDGE
& SCALABLEtechnology solutions
> 2,000employees at
international
tech locations8
HQsin Berlin
help our brand to
WIN ONLINE
![Page 9: Big Data and Machine Learning at Zalando€¦ · BIG DATA AT ZALANDO Business Intelligence Machine Learning Data Governance Data at the core of everything we do. 10 A TYPICAL BIG](https://reader036.fdocuments.in/reader036/viewer/2022062416/5f029f6d7e708231d4052f57/html5/thumbnails/9.jpg)
9
BIG DATA AT ZALANDO
Business
Intelligence
Machine
Learning
Data
Governance
Data at the
core of
everything
we do
![Page 10: Big Data and Machine Learning at Zalando€¦ · BIG DATA AT ZALANDO Business Intelligence Machine Learning Data Governance Data at the core of everything we do. 10 A TYPICAL BIG](https://reader036.fdocuments.in/reader036/viewer/2022062416/5f029f6d7e708231d4052f57/html5/thumbnails/10.jpg)
10
A TYPICAL BIG DATA INFRASTRUCTURE
ML Platform
•Explore
•Train
•Serve
•Observe
Data Platform
• Ingestion,
•Metadata,
•Store,
•Process
Business Intelligence
•Data Warehousing
•Visual KPIs
•Trusted datasets
Data Governance
•Data Catalog
•Privacy
•GDPR
![Page 11: Big Data and Machine Learning at Zalando€¦ · BIG DATA AT ZALANDO Business Intelligence Machine Learning Data Governance Data at the core of everything we do. 10 A TYPICAL BIG](https://reader036.fdocuments.in/reader036/viewer/2022062416/5f029f6d7e708231d4052f57/html5/thumbnails/11.jpg)
11
SOME ML USE CASES AT AN ONLINE RETAILER
![Page 12: Big Data and Machine Learning at Zalando€¦ · BIG DATA AT ZALANDO Business Intelligence Machine Learning Data Governance Data at the core of everything we do. 10 A TYPICAL BIG](https://reader036.fdocuments.in/reader036/viewer/2022062416/5f029f6d7e708231d4052f57/html5/thumbnails/12.jpg)
12
AN ML-DRIVEN CUSTOMER
EXPERIENCE
![Page 13: Big Data and Machine Learning at Zalando€¦ · BIG DATA AT ZALANDO Business Intelligence Machine Learning Data Governance Data at the core of everything we do. 10 A TYPICAL BIG](https://reader036.fdocuments.in/reader036/viewer/2022062416/5f029f6d7e708231d4052f57/html5/thumbnails/13.jpg)
13
ML-driven
real-time
reco
engine
People who browsed this style also browsed these other styles…
![Page 14: Big Data and Machine Learning at Zalando€¦ · BIG DATA AT ZALANDO Business Intelligence Machine Learning Data Governance Data at the core of everything we do. 10 A TYPICAL BIG](https://reader036.fdocuments.in/reader036/viewer/2022062416/5f029f6d7e708231d4052f57/html5/thumbnails/14.jpg)
14
COMPLETE THE LOOK
• Multi-dimensional ML driven
product placement
• Search
• Recommended products
• Complimentary items
• Size (fit)
• Delivery promise
![Page 15: Big Data and Machine Learning at Zalando€¦ · BIG DATA AT ZALANDO Business Intelligence Machine Learning Data Governance Data at the core of everything we do. 10 A TYPICAL BIG](https://reader036.fdocuments.in/reader036/viewer/2022062416/5f029f6d7e708231d4052f57/html5/thumbnails/15.jpg)
15
THE ML JOURNEY
Explore
Fetch
Prepare
Train Model
Evaluate Model
Deploy to production
Monitor/ Evaluate
Ready the dataServe the models
![Page 16: Big Data and Machine Learning at Zalando€¦ · BIG DATA AT ZALANDO Business Intelligence Machine Learning Data Governance Data at the core of everything we do. 10 A TYPICAL BIG](https://reader036.fdocuments.in/reader036/viewer/2022062416/5f029f6d7e708231d4052f57/html5/thumbnails/16.jpg)
16
ACHIEVING THE BALANCE TO RUN ML AT SCALE
Exploding new With the needs
![Page 17: Big Data and Machine Learning at Zalando€¦ · BIG DATA AT ZALANDO Business Intelligence Machine Learning Data Governance Data at the core of everything we do. 10 A TYPICAL BIG](https://reader036.fdocuments.in/reader036/viewer/2022062416/5f029f6d7e708231d4052f57/html5/thumbnails/17.jpg)
17
THE ML PIPELINE – FOR A SINGLE USE CASE
ML Use CaseNotebook/UI
creates workflows
Fetch Data
Extract Features
Prepare Data
Train Model Deploy Model
Serve
Monitor
Evaluate and Feedback
![Page 18: Big Data and Machine Learning at Zalando€¦ · BIG DATA AT ZALANDO Business Intelligence Machine Learning Data Governance Data at the core of everything we do. 10 A TYPICAL BIG](https://reader036.fdocuments.in/reader036/viewer/2022062416/5f029f6d7e708231d4052f57/html5/thumbnails/18.jpg)
18
WHAT HAPPENS – WITH A COUPLE OF USE CASES
![Page 19: Big Data and Machine Learning at Zalando€¦ · BIG DATA AT ZALANDO Business Intelligence Machine Learning Data Governance Data at the core of everything we do. 10 A TYPICAL BIG](https://reader036.fdocuments.in/reader036/viewer/2022062416/5f029f6d7e708231d4052f57/html5/thumbnails/19.jpg)
19
AND THE MESS THAT COMES WITH MANY USE
CASES
![Page 20: Big Data and Machine Learning at Zalando€¦ · BIG DATA AT ZALANDO Business Intelligence Machine Learning Data Governance Data at the core of everything we do. 10 A TYPICAL BIG](https://reader036.fdocuments.in/reader036/viewer/2022062416/5f029f6d7e708231d4052f57/html5/thumbnails/20.jpg)
20
TACKLING THE ML SCALING CHALLENGE
With cost efficiency
The ability to run hundreds of training jobs that are “serverless”. Trainings produce models and infrastructure is automatically shutdown.
3
With safety
The ability to understand metadata at every stage of the ML journey by just describing a training job at the
call of an API.
2
With speed
The ability to compose training jobs, tuning jobs and endpoints with ease, at the call of an API, and with algorithms available out of the box.
1
![Page 21: Big Data and Machine Learning at Zalando€¦ · BIG DATA AT ZALANDO Business Intelligence Machine Learning Data Governance Data at the core of everything we do. 10 A TYPICAL BIG](https://reader036.fdocuments.in/reader036/viewer/2022062416/5f029f6d7e708231d4052f57/html5/thumbnails/21.jpg)
21
END TO END ML PIPELINE(real-life use case)
![Page 22: Big Data and Machine Learning at Zalando€¦ · BIG DATA AT ZALANDO Business Intelligence Machine Learning Data Governance Data at the core of everything we do. 10 A TYPICAL BIG](https://reader036.fdocuments.in/reader036/viewer/2022062416/5f029f6d7e708231d4052f57/html5/thumbnails/22.jpg)
22
Productionizing ML: Speed, with simplicity
![Page 23: Big Data and Machine Learning at Zalando€¦ · BIG DATA AT ZALANDO Business Intelligence Machine Learning Data Governance Data at the core of everything we do. 10 A TYPICAL BIG](https://reader036.fdocuments.in/reader036/viewer/2022062416/5f029f6d7e708231d4052f57/html5/thumbnails/23.jpg)
23
SAFE AND MONITORABLE ML
How is the model endpoint performing?
![Page 24: Big Data and Machine Learning at Zalando€¦ · BIG DATA AT ZALANDO Business Intelligence Machine Learning Data Governance Data at the core of everything we do. 10 A TYPICAL BIG](https://reader036.fdocuments.in/reader036/viewer/2022062416/5f029f6d7e708231d4052f57/html5/thumbnails/24.jpg)
WHERE WOULD BE LIKE TO BE IN 2020?
A Scalable, Cost-efficient, Flexible Data Infrastructure
Shared Data, Models, Features
Safe, secure data usability, with privacy
Open source, Inner source, best-of-breed vendor tools
![Page 25: Big Data and Machine Learning at Zalando€¦ · BIG DATA AT ZALANDO Business Intelligence Machine Learning Data Governance Data at the core of everything we do. 10 A TYPICAL BIG](https://reader036.fdocuments.in/reader036/viewer/2022062416/5f029f6d7e708231d4052f57/html5/thumbnails/25.jpg)
We’re hiring!
![Page 26: Big Data and Machine Learning at Zalando€¦ · BIG DATA AT ZALANDO Business Intelligence Machine Learning Data Governance Data at the core of everything we do. 10 A TYPICAL BIG](https://reader036.fdocuments.in/reader036/viewer/2022062416/5f029f6d7e708231d4052f57/html5/thumbnails/26.jpg)
Big Data and
Machine
Learning at
Zalando
K s h i t i j K u m a r
V i c e P r e s i d e n t ,
D a t a I n f r a s t r u c t u r e
k s h i t i j . k u m a r @ z a l a n d o . d e
1 0 - 0 3 - 2 0 1 9
![Page 27: Big Data and Machine Learning at Zalando€¦ · BIG DATA AT ZALANDO Business Intelligence Machine Learning Data Governance Data at the core of everything we do. 10 A TYPICAL BIG](https://reader036.fdocuments.in/reader036/viewer/2022062416/5f029f6d7e708231d4052f57/html5/thumbnails/27.jpg)
27
ML pipelines should be safe and understandable
What training job resulted in the deployment?
Which model(s) was deployed?
What instances are the model(s) deployed?
How much traffic routed to which model?