Xiaowei JiangDirectorAlibaba Infrastructure ServiceAlibaba Group
6/1/2017
Alibaba Today
Hangzhou
Beijing
Taipei
Hong Kong
Sydney
Mumbai
Milan
Paris
London
NYC
DCSan Mateo
Seattle
~ 50,000 employers, offices all over the world
The 11.11 Global Shopping Festival
2015 2016
GMV (USD in Billions) 14.3 17.8
Transactions (Peak Value) 140K/s 175K/s
Payments (Peak Value) 85.9K/s 120K/s
Unveiling the Miracle of 11.11
OnlineandMobileCommercePlatform
$BUYERSSELLERS
Marketing
Financing&PaymentSolution
ProfessionalServiceProviders
DigitalEntertainment
Logistics
MobileBrowser
Location-Based
AutoNavi
SocialMedia
Alibaba Global Infrastructure
14International DCs
530+CDN nodes
Alibaba Datacenters
Alibaba Server R&DODM
Components
Silicon
Memory
CPUHDD
SSD
Era of Post Moore’s LawHardware software co-designed datacenter
Compute
Deep customization
Heterogeneous computing for emerging workload
Storage
In-house SSDs
NVMoF, NVDIMM
Networking
Network acceleration
Server
In-house server designs
Immersion cooling
Compute Deep Customization
Customized x86 CPUs
Optimized for Alibaba’s workload
Alibench as perf metrics
Higher perf/watt than roadmap x86
Deployed at scaleALIBDWSKU HSWSKU IVBSKU
PERFORMANCE/WATT
Heterogeneous Computing
Deep Learning with GPU
Item classification
Shot and buy
Item prediction
Anti-ponography
Item quality control
Image search
Tag recognition
Voice recognition
Heterogeneous Computing
Pushing GPU power onto the cloud
Fully optimized for deep learning
Aliyun EC2 instances GA1 + GN4
C
AliFlash
Alibaba’s in-house SSD
Hardware software co-designed
Alibaba exclusive performance and functional features
A number of form factors
Reduced TCO
Deployed at scale
AliFlash
AliFlash PCIe v1.0
Host-based
PCIe interface
Low latency
High IOPS
11-25W
AliFlash
AliFlash NVMe v.10
Device-based
NVMe support
PCIe or U.2 interface
SPDK enabled
7-25W
AliFlash
AliFlash SATA v.10
SATA interface
Low cost
High density
For read-intensive workload
4-5W
AliFlash
AliFlash M.2 v.10
M.2 interface
SATA protocol
Low cost
For system drive
3W
Server Immersion Cooling
Air Cooling
Tf
Tcase
PROCESSOR
Immersion cooling
Boundary condition
Air cooling
35°C @ 1500m,1U server
Immersion cooling
fluid boils at 56°C
Server Immersion Cooling
Server Immersion CoolingThe layout of the chip is no longer limited
AirCooling
Airduct
Immersioncooling
AirCooling
Immersioncooling
Fans, heat sinks, air duct required
A lot of space waster
No heat sinks and fans
Compatibility cross generations
Q&A
Top Related