Alibaba Technology · Cluster Scheduling System Enhances Resource Efficiency 17% 45% Sigma Online...
Transcript of Alibaba Technology · Cluster Scheduling System Enhances Resource Efficiency 17% 45% Sigma Online...
Alibaba TechnologyJeff Zhang, Chief Technology Officer, Alibaba Group
2
WORLD-CLASS TECHNOLOGIES RESHAPE WORLD-CLASS BUSINESSES
WORLD-CLASS PROBLEMS DRIVE WORLD-CLASS TECHNOLOGIES
Note: 1. As of August 31, 2018
3
Speed is Boosted from 100 Gbps to 400 Gbps The Only IPv6 Cloud Service Vendor in China
ServersFPGA-based Accelerators
Self-developed AliFlash V3
Immersion CoolingPower Usage Efficiency (PUE) Approaches 1.0
The World’s First Immersion Cooling Internet Server Cluster
Data Centers49
Infrastructure Supports Alibaba’s Global E-commerce Ecosystem
Networks200+ Regions around the WorldAvailable in
(1) (1)
4
Cluster Scheduling System Enhances Resource Efficiency
17% 45%
Sigma FuxiOnline Tasks Offline Tasks
Resource Management System
Data Center ClustersReduction in IT Cost per 10k Transactions
on the Single’s Day Shopping FestivalAverage CPU Utilization Rate of Clusters
(1) (1)
Note: 1. As of Aug 2018
5
Self-Developed, Full Stack Technologies and Solutions for Database and Storage Systems
Heterogeneous Hardware(GPU/FPGA, RDMA, NVM, OpenSSD)
PANGU DADIDistributed Storage Distributed Memory
TAIR
LindormNo-SQL
X-DB PolarDBOLTP
HybridDB DRDS HTAP Data Lake AnalyticsAnalyticDB
OLAPMulti-modelVectorDB
TSDB
Utility
DTS DMS
Self-DrivingCTC
Services
10+
Real-time Processing Capability of AnalyticDB325,000
Peak Throughput of X-DB
100+ PBData Sources Analyzed by Data Lake Analytics
6x MySQLRead and Write Throughputs of PolarDB
Sales Transactions per Second
Worker
Scale Out
Netw
ork
Shared NothingWorker
Scal
e U
PNetw
ork
Shared Storage
DiskDisk Disk Disk Disk
Worker Worker WorkerWorker Worker Worker
Notes: 1. As of Aug 2018 2. For Singles Day 2017
(1)
(1)
(1)
(2)
6
The World’s Largest E-commerce Knowledge Graph
10 million Vertices
1 trillion Edges 10 million Edges Traversal per Second
Other Items
Refrigerator Kitchen Appliances
Rice Cooker
Family of 5 Members
Large Capacity Rice
Cooker
Above 5 Liters
Countertop Appliances
Major Appliances
Large Capacity
Refrigerator
Above 400
Liters
MoreMore
Other Items
Family of 5 Members
(1)
(1)
(1)
Note: 1. As of Aug 2018
7
Indoor High-Definition Map Indoor 3D Reconstruction
Note: 1. As of August 31, 2018 8
Machine Translation Reading ComprehensionNatural Language Processing
AliTranx AliReaderAliNLP5 Champions In World-class Machine
Translation Competitions (WMT)Surpassed Humans on SQuAD
Reading ComprehensionChampion at Global Semantic
Understanding Competition “SemEval"
Traffic Drive and User Acquisition
Language Directions48
Multilingual Technologies Make Cross-border Trade Easier
1 millionServed Small and Medium Enterprises (SMEs)
Search on Website
Product Display
Consumer Inquiry
Payment & Logistics
Customer Service
(1)
Notes: 1. As of June 30, 2018 2. As of May 20, 2018 9
Tmall Genie: No.1 Smart Speaker Market Share in China
5 million Units Sold
Platforms
Devices
ContentA
pps
……
…… ……
……
100 50 million Appliance Categories Registered Devices
(1)
(2)
10
Distributed Voice Interaction Enhances Smart Home Experience
Voice Control 86mm x 86mm Distributed Deployment
Far-field Sound Pickup with Dual Microphones5 meters
Immersion Control Experience360
11
utlookdventure omentumiscovery
200 Research Collaboration Projects
10 50Countries Universities
XFinancial TechnologyRobotData ComputingMachine Intelligence
•Speech Intelligence •Vision Intelligence •Language Technology •Decision Intelligence •City Brain
•Computing Technology •Data Analytics & Intelligence •Database & Storage
•Intelligent Transportation •Smart Logistics
•Financial Intelligence •Blockchain •Biometrics
•Quantum Lab •AI Lab
Global Innovation Partnership4+X Labs
+
+ +
12
8 Cities 300Beijing Shenzhen
Tel Aviv-Yafo
Bellevue
Singapore
Sunnyvale
Hangzhou
Researchers
New York
13
Cloud-Edge Intelligent Chipset
AliNPU V1 AliNPU V2 AliNPU Lite
Video/Image Processing
General AI Requirements
Embedded Requirements Deep-learning
Inference CapabilityMass Production of Self-developed CPU IP Core
CK902 Support the 3rd Generation RISC-V Instruction System
Building Block of IoT Infrastructure Integrated with AliOS
10x New Release
City Brain Industry Brain Smart Security
Smart Home Autonomous Driving Robotics
Cloud-Edge AI Inference Chip
Training/Inference General Chip
IoT Specialized Chip Overall Performance
/Power Efficiency
40xDATA CENTER
Improvement
Improvement
14
Quantum Computing: Disruptive Computing Power for the Future
For Logistics, Finance, Materials, Chemistry, etc.Quantum-Enhanced Solutions
Quantum Computing System
Quantum Algorithms
Quantum Processor
Chinese Academy of Sciences -Alibaba Quantum Computing Laboratory
Zhejiang University -Alibaba Joint Center for Quantum Information TechnologiesTaiZhang
The First Successful Simulation of
Benchmarking 81-Qubits Random Quantum Circuit
Quantum-Classical Heterogeneous ComputingHigh-Precision Superconducting Processor
For Machine Learning, Optimization, and Physics Simulation
15
TECNOLOGY RESHAPES INDUSTRIES
THANK YOU