the End of Commodity Memory · The First 40 Years of DRAM 4 Bits Bits per Unit Units 1975 1995 2015...
Transcript of the End of Commodity Memory · The First 40 Years of DRAM 4 Bits Bits per Unit Units 1975 1995 2015...
![Page 1: the End of Commodity Memory · The First 40 Years of DRAM 4 Bits Bits per Unit Units 1975 1995 2015 + 53%/Yr 1975 1995 2015 1975 1995 2015](https://reader036.fdocuments.in/reader036/viewer/2022063003/5f716103f9cc242174586c9c/html5/thumbnails/1.jpg)
The 3rd Wave: Hyper Performance and the End of Commodity Memory
David Chapman VP Marketing
![Page 2: the End of Commodity Memory · The First 40 Years of DRAM 4 Bits Bits per Unit Units 1975 1995 2015 + 53%/Yr 1975 1995 2015 1975 1995 2015](https://reader036.fdocuments.in/reader036/viewer/2022063003/5f716103f9cc242174586c9c/html5/thumbnails/2.jpg)
An Introduction…
![Page 3: the End of Commodity Memory · The First 40 Years of DRAM 4 Bits Bits per Unit Units 1975 1995 2015 + 53%/Yr 1975 1995 2015 1975 1995 2015](https://reader036.fdocuments.in/reader036/viewer/2022063003/5f716103f9cc242174586c9c/html5/thumbnails/3.jpg)
Feeling Warm?
3
http://hairpinturnsahead.typepad.com/.a/6a0133ec7b075a970b01bb07aa594c970d-pi
![Page 4: the End of Commodity Memory · The First 40 Years of DRAM 4 Bits Bits per Unit Units 1975 1995 2015 + 53%/Yr 1975 1995 2015 1975 1995 2015](https://reader036.fdocuments.in/reader036/viewer/2022063003/5f716103f9cc242174586c9c/html5/thumbnails/4.jpg)
The First 40 Years of DRAM
4
Bits
Bits per Unit
Units
1975 1995 2015 + 53%/Yr
1975 1995 2015
1975 1995 2015
![Page 5: the End of Commodity Memory · The First 40 Years of DRAM 4 Bits Bits per Unit Units 1975 1995 2015 + 53%/Yr 1975 1995 2015 1975 1995 2015](https://reader036.fdocuments.in/reader036/viewer/2022063003/5f716103f9cc242174586c9c/html5/thumbnails/5.jpg)
The Bandwidth
Era
The Price per Bit
Era
The First Transformation
5
Units
1975 1995 2015
![Page 6: the End of Commodity Memory · The First 40 Years of DRAM 4 Bits Bits per Unit Units 1975 1995 2015 + 53%/Yr 1975 1995 2015 1975 1995 2015](https://reader036.fdocuments.in/reader036/viewer/2022063003/5f716103f9cc242174586c9c/html5/thumbnails/6.jpg)
DRAM Data Bandwidth
6
http://tech4gizmos.com/70/
![Page 7: the End of Commodity Memory · The First 40 Years of DRAM 4 Bits Bits per Unit Units 1975 1995 2015 + 53%/Yr 1975 1995 2015 1975 1995 2015](https://reader036.fdocuments.in/reader036/viewer/2022063003/5f716103f9cc242174586c9c/html5/thumbnails/7.jpg)
Cache Gone Wild
7
http://images.anandtech.com/reviews/cpu/intel/nehalem/part3/totalcache.png
![Page 8: the End of Commodity Memory · The First 40 Years of DRAM 4 Bits Bits per Unit Units 1975 1995 2015 + 53%/Yr 1975 1995 2015 1975 1995 2015](https://reader036.fdocuments.in/reader036/viewer/2022063003/5f716103f9cc242174586c9c/html5/thumbnails/8.jpg)
The Long Boil
8
1995 2015
DRAM
Fast SRAM M
arke
t Sha
re
Slow SRAM
![Page 9: the End of Commodity Memory · The First 40 Years of DRAM 4 Bits Bits per Unit Units 1975 1995 2015 + 53%/Yr 1975 1995 2015 1975 1995 2015](https://reader036.fdocuments.in/reader036/viewer/2022063003/5f716103f9cc242174586c9c/html5/thumbnails/9.jpg)
Volatile RAM Hierarchy
9
On-Die SRAM
Fast SRAM
Slow SRAM
DRAM
1000x 100x
10x
1x
![Page 10: the End of Commodity Memory · The First 40 Years of DRAM 4 Bits Bits per Unit Units 1975 1995 2015 + 53%/Yr 1975 1995 2015 1975 1995 2015](https://reader036.fdocuments.in/reader036/viewer/2022063003/5f716103f9cc242174586c9c/html5/thumbnails/10.jpg)
DRAM Vendor Base
10
> 30 DRAM Vendors
3 DRAM Vendors
1985 2015
![Page 11: the End of Commodity Memory · The First 40 Years of DRAM 4 Bits Bits per Unit Units 1975 1995 2015 + 53%/Yr 1975 1995 2015 1975 1995 2015](https://reader036.fdocuments.in/reader036/viewer/2022063003/5f716103f9cc242174586c9c/html5/thumbnails/11.jpg)
Bits Shrink – Die Grow
11
http://www.intechopen.com/books/advances-in-solid-state-circuit-technologies/dimension-increase-in-metal-oxide-semiconductor-memories-and-transistors
Die Size (mm2)
Bit Cell Size (µm2)
10K
1K
100
10
1
0.1
0.01 1K 256K 16K 64M 4M 1G 16G
![Page 12: the End of Commodity Memory · The First 40 Years of DRAM 4 Bits Bits per Unit Units 1975 1995 2015 + 53%/Yr 1975 1995 2015 1975 1995 2015](https://reader036.fdocuments.in/reader036/viewer/2022063003/5f716103f9cc242174586c9c/html5/thumbnails/12.jpg)
25% 40% 90%
Array Efficiency
12
1970 1990 2010
Arr
ay E
ffici
ency
![Page 13: the End of Commodity Memory · The First 40 Years of DRAM 4 Bits Bits per Unit Units 1975 1995 2015 + 53%/Yr 1975 1995 2015 1975 1995 2015](https://reader036.fdocuments.in/reader036/viewer/2022063003/5f716103f9cc242174586c9c/html5/thumbnails/13.jpg)
On-Die Routing Dominates
13
![Page 14: the End of Commodity Memory · The First 40 Years of DRAM 4 Bits Bits per Unit Units 1975 1995 2015 + 53%/Yr 1975 1995 2015 1975 1995 2015](https://reader036.fdocuments.in/reader036/viewer/2022063003/5f716103f9cc242174586c9c/html5/thumbnails/14.jpg)
The Gap
14
http://image.slidesharecdn.com/2010-10-02introtomicroprocessors1-120907074913-phpapp01/95/2010-1002-intro-to-microprocessors1-17-728.jpg?cb=1347004218
![Page 15: the End of Commodity Memory · The First 40 Years of DRAM 4 Bits Bits per Unit Units 1975 1995 2015 + 53%/Yr 1975 1995 2015 1975 1995 2015](https://reader036.fdocuments.in/reader036/viewer/2022063003/5f716103f9cc242174586c9c/html5/thumbnails/15.jpg)
Not Dead Yet
15
http://megaodd.com/wp-content/uploads/2015/01/70ae5__FoodsEatenAlive07-650x401.jpg
![Page 16: the End of Commodity Memory · The First 40 Years of DRAM 4 Bits Bits per Unit Units 1975 1995 2015 + 53%/Yr 1975 1995 2015 1975 1995 2015](https://reader036.fdocuments.in/reader036/viewer/2022063003/5f716103f9cc242174586c9c/html5/thumbnails/16.jpg)
The Bandwidth
Era
The Price per Bit Era
The Next 20 Years
16
1975 1995 2015 2035
Higher Density? More Bandwidth? Lower Latency? Higher Trans Rate? Lower Cost? Lower Power?
![Page 17: the End of Commodity Memory · The First 40 Years of DRAM 4 Bits Bits per Unit Units 1975 1995 2015 + 53%/Yr 1975 1995 2015 1975 1995 2015](https://reader036.fdocuments.in/reader036/viewer/2022063003/5f716103f9cc242174586c9c/html5/thumbnails/17.jpg)
Bandwidth is NOT the Problem
17
“The problem isn’t memory bandwidth — it’s memory latency and memory power consumption.”
Forget Moore’s law: Hot and slow DRAM is a major roadblock to exascale and beyond By Joel Hruska on July 14, 2014 @ http://www.extremetech.com
http://www.extremetech.com/computing/185797-forget-moores-law-hot-and-slow-dram-is-a-major-roadblock-to-exascale-and-beyond
![Page 18: the End of Commodity Memory · The First 40 Years of DRAM 4 Bits Bits per Unit Units 1975 1995 2015 + 53%/Yr 1975 1995 2015 1975 1995 2015](https://reader036.fdocuments.in/reader036/viewer/2022063003/5f716103f9cc242174586c9c/html5/thumbnails/18.jpg)
Higher Density? More Bandwidth? Lower Latency? Higher Trans Rate? Lower Cost? Lower Power?
The Bandwidth
Era
The Price per Bit Era
The Next 20 Years
18
1975 1995 2015 2035
Low Power
![Page 19: the End of Commodity Memory · The First 40 Years of DRAM 4 Bits Bits per Unit Units 1975 1995 2015 + 53%/Yr 1975 1995 2015 1975 1995 2015](https://reader036.fdocuments.in/reader036/viewer/2022063003/5f716103f9cc242174586c9c/html5/thumbnails/19.jpg)
Micron HMC
19
http://www.extremetech.com/computing/167368-hybrid-memory-cube-160gbsec-ram-starts-shipping-is-this-the-technology-that-finally-kills-ddr-ram
https://www.semiwiki.com/forum/content/1610-3d-memories.html
http://www.anandtech.com/show/4819/intel-and-micron-develop-hybrid-memory-cube-stacked-dram-is-coming
http://wiley-vch.e-bookshelf.de/products/reading-epub/product-id/2418826/title/handbook+of+3d+integration.html?lang=en
![Page 20: the End of Commodity Memory · The First 40 Years of DRAM 4 Bits Bits per Unit Units 1975 1995 2015 + 53%/Yr 1975 1995 2015 1975 1995 2015](https://reader036.fdocuments.in/reader036/viewer/2022063003/5f716103f9cc242174586c9c/html5/thumbnails/20.jpg)
Clocking Stalls
20
http://deliveryimages.acm.org/10.1145/2140000/2133822/figs/f7.jpg
![Page 21: the End of Commodity Memory · The First 40 Years of DRAM 4 Bits Bits per Unit Units 1975 1995 2015 + 53%/Yr 1975 1995 2015 1975 1995 2015](https://reader036.fdocuments.in/reader036/viewer/2022063003/5f716103f9cc242174586c9c/html5/thumbnails/21.jpg)
Hynix HBM
21
http://www.eetasia.com/ART_8800714409_499486_NT_874cb9d4.HTM
http://wccftech.com/nvidia-pascal-gpu-17-billion-transistors-32-gb-hbm2-vram-arrives-in-2016/
![Page 22: the End of Commodity Memory · The First 40 Years of DRAM 4 Bits Bits per Unit Units 1975 1995 2015 + 53%/Yr 1975 1995 2015 1975 1995 2015](https://reader036.fdocuments.in/reader036/viewer/2022063003/5f716103f9cc242174586c9c/html5/thumbnails/22.jpg)
Intel Knight’s Landing HPC Processor
22
http://www.eweek.com/servers/us-blocks-intel-from-supplying-chips-for-chinese-supercomputers.html
http://www.pcper.com/news/General-Tech/Learn-bit-more-about-Knights-Landing
http://electroiq.com/insights-from-leading-edge/2014/06/iftle-198-intel-to-commercialize-micron-hmc-3d-stacked-memory-in-hpc-processor-gs-nanotech-announces-3dic-plans-statschippac-suitors-named/
http://news.cecb2b.com/info/20150326/3082445.shtml
![Page 23: the End of Commodity Memory · The First 40 Years of DRAM 4 Bits Bits per Unit Units 1975 1995 2015 + 53%/Yr 1975 1995 2015 1975 1995 2015](https://reader036.fdocuments.in/reader036/viewer/2022063003/5f716103f9cc242174586c9c/html5/thumbnails/23.jpg)
High Performance “Near” Memory
23
http://cdn.wccftech.com/wp-content/uploads/2015/03/Intel-Knights-Landing-Processor_Adams-Rack.jpg
http://forums.anandtech.com/showthread.php?t=2388600
![Page 24: the End of Commodity Memory · The First 40 Years of DRAM 4 Bits Bits per Unit Units 1975 1995 2015 + 53%/Yr 1975 1995 2015 1975 1995 2015](https://reader036.fdocuments.in/reader036/viewer/2022063003/5f716103f9cc242174586c9c/html5/thumbnails/24.jpg)
Bandwidth?
24
http://images.anandtech.com/doci/8217/MCDRAM.jpg
![Page 25: the End of Commodity Memory · The First 40 Years of DRAM 4 Bits Bits per Unit Units 1975 1995 2015 + 53%/Yr 1975 1995 2015 1975 1995 2015](https://reader036.fdocuments.in/reader036/viewer/2022063003/5f716103f9cc242174586c9c/html5/thumbnails/25.jpg)
Multi Channel Memory • Reduces Trace Lengths • Reduces Power • Reduces Latency • Supports Multi Threading • Supports Multi-Core • Increases Bandwidth • Increases Transaction Rate
25
![Page 26: the End of Commodity Memory · The First 40 Years of DRAM 4 Bits Bits per Unit Units 1975 1995 2015 + 53%/Yr 1975 1995 2015 1975 1995 2015](https://reader036.fdocuments.in/reader036/viewer/2022063003/5f716103f9cc242174586c9c/html5/thumbnails/26.jpg)
Conventional 3D Packaging
26
• Die Stacking
• Preserves traditional RAM problems
• Adds stacking costs
![Page 27: the End of Commodity Memory · The First 40 Years of DRAM 4 Bits Bits per Unit Units 1975 1995 2015 + 53%/Yr 1975 1995 2015 1975 1995 2015](https://reader036.fdocuments.in/reader036/viewer/2022063003/5f716103f9cc242174586c9c/html5/thumbnails/27.jpg)
Di3D™: Dis-Integrated 3D™
27
![Page 28: the End of Commodity Memory · The First 40 Years of DRAM 4 Bits Bits per Unit Units 1975 1995 2015 + 53%/Yr 1975 1995 2015 1975 1995 2015](https://reader036.fdocuments.in/reader036/viewer/2022063003/5f716103f9cc242174586c9c/html5/thumbnails/28.jpg)
Tezzaron Stacks Wafers
28
![Page 29: the End of Commodity Memory · The First 40 Years of DRAM 4 Bits Bits per Unit Units 1975 1995 2015 + 53%/Yr 1975 1995 2015 1975 1995 2015](https://reader036.fdocuments.in/reader036/viewer/2022063003/5f716103f9cc242174586c9c/html5/thumbnails/29.jpg)
Side
Vie
w
< 0.
5 m
m
Dis-Integrated DiRAM4 Architecture
29
The Bit Layer(s) (Memory Cells &
Access Transistors)
The Control Layer (Sense Amps, etc.)
The I/O Layer
![Page 30: the End of Commodity Memory · The First 40 Years of DRAM 4 Bits Bits per Unit Units 1975 1995 2015 + 53%/Yr 1975 1995 2015 1975 1995 2015](https://reader036.fdocuments.in/reader036/viewer/2022063003/5f716103f9cc242174586c9c/html5/thumbnails/30.jpg)
Dis-Integrated DiRAM4 Architecture
30
Isometric View
Highest Transistors
Density Possible
≈ 150 femtometer Silicon Process
![Page 31: the End of Commodity Memory · The First 40 Years of DRAM 4 Bits Bits per Unit Units 1975 1995 2015 + 53%/Yr 1975 1995 2015 1975 1995 2015](https://reader036.fdocuments.in/reader036/viewer/2022063003/5f716103f9cc242174586c9c/html5/thumbnails/31.jpg)
1st bonding: F-to-F
1st bonding: F-to-F
1st bonding: F-to-F
1st bonding: F-to-F
2nd bonding : B-to-B
2nd bonding : B-to-B
3rd bonding : B-to-B
True Architectural 3D Micron HMC Die Stack
Hynix HBM Die Stack
Tezzaron TSV-free Wafer Bonding
![Page 32: the End of Commodity Memory · The First 40 Years of DRAM 4 Bits Bits per Unit Units 1975 1995 2015 + 53%/Yr 1975 1995 2015 1975 1995 2015](https://reader036.fdocuments.in/reader036/viewer/2022063003/5f716103f9cc242174586c9c/html5/thumbnails/32.jpg)
DiRAM4 Performance Advantage
32
2 x
Den
sityg
fPa
ge C
ycle
50%
Dat
a B
andw
idthg
4
x
fW
orst
Cas
e La
tenc
y 50
%
Tran
sact
ion
Rat
eg
70 x
Tezzaron Best-in-class competitive 3D offering
![Page 33: the End of Commodity Memory · The First 40 Years of DRAM 4 Bits Bits per Unit Units 1975 1995 2015 + 53%/Yr 1975 1995 2015 1975 1995 2015](https://reader036.fdocuments.in/reader036/viewer/2022063003/5f716103f9cc242174586c9c/html5/thumbnails/33.jpg)
3rd Wave RAM • High Signal Count • Intimate Interface • High Trans Rate • Low Latency • High Power Density • Much Smarter • Non-commodity
![Page 34: the End of Commodity Memory · The First 40 Years of DRAM 4 Bits Bits per Unit Units 1975 1995 2015 + 53%/Yr 1975 1995 2015 1975 1995 2015](https://reader036.fdocuments.in/reader036/viewer/2022063003/5f716103f9cc242174586c9c/html5/thumbnails/34.jpg)
Ending the Long Boil
34
1995 2015
DRAM
Fast SRAM
Mar
ket
Shar
e Slow
SRAM
100x RAM
3D NVM
10x RAM
1x RAM
![Page 35: the End of Commodity Memory · The First 40 Years of DRAM 4 Bits Bits per Unit Units 1975 1995 2015 + 53%/Yr 1975 1995 2015 1975 1995 2015](https://reader036.fdocuments.in/reader036/viewer/2022063003/5f716103f9cc242174586c9c/html5/thumbnails/35.jpg)
Crossing the Chasm…
35
FPGA
HPC
Networks
Expect FPGA Early Adopters ü Performance driven ü Quick to market ü Small volumes ü High value
![Page 36: the End of Commodity Memory · The First 40 Years of DRAM 4 Bits Bits per Unit Units 1975 1995 2015 + 53%/Yr 1975 1995 2015 1975 1995 2015](https://reader036.fdocuments.in/reader036/viewer/2022063003/5f716103f9cc242174586c9c/html5/thumbnails/36.jpg)
SyoPort™ Tagging Hub DTH1 4 Ports SIO DDR x64 Each 512 Add/Data
Wires
Maintenance Port
JTAG (ARM)
DiRAM4 64C64 64 Ports SIO DDR x32 Each 4096 Data Wires
JTAG DiRAM4
JTAG (ARM)
JTAG DTH1
TDI TMS TCK TRST# TDO
JTAG Internal
Maintenance Port
SPI SPI
16 SIO Ports
16 SIO Ports
16 SIO Ports
16 SIO Ports
x64 SIO Port
x64 SIO Port
x64 SIO Port
x64 SIO Port
TDO TMS TCK
TRST# TDI
JTAG External
I2C External
SDA SCL
I2C Internal
SDA SCL
Ayrees SyoPort-P BGA Module
MHUB-1
Cntl I/O-1
Bits 0 Bits 1 Bits 2 Bits 3 Bits 4 Bits 5 Bits 6 Bits 7 Bits 8 Bits 9
Bits 10 Bits 11 Bits 12 Bits 13 Bits 14 Bits 15
BGA Package Substrate http://www.etech-web.com/bga-reballing.htm
![Page 37: the End of Commodity Memory · The First 40 Years of DRAM 4 Bits Bits per Unit Units 1975 1995 2015 + 53%/Yr 1975 1995 2015 1975 1995 2015](https://reader036.fdocuments.in/reader036/viewer/2022063003/5f716103f9cc242174586c9c/html5/thumbnails/37.jpg)
Volatile RAM Hierarchy
37
On-Die SRAM
3D Multi-Channel
RAM
DRAM
1000x 100x
10x
1x
DRAM Replacement 0.1x
![Page 38: the End of Commodity Memory · The First 40 Years of DRAM 4 Bits Bits per Unit Units 1975 1995 2015 + 53%/Yr 1975 1995 2015 1975 1995 2015](https://reader036.fdocuments.in/reader036/viewer/2022063003/5f716103f9cc242174586c9c/html5/thumbnails/38.jpg)
Back to Normal
38
http://i.dailymail.co.uk/i/pix/2015/01/29/25298CC300000578-0-image-a-14_1422544485309.jpg