Data Apocalypse! - Storage Visions · 2018 KEYNOTES Andy Steinbach, Founder and CEO, Paradigm Shift...

25
Thriving in the Data Apocalypse! 1

Transcript of Data Apocalypse! - Storage Visions · 2018 KEYNOTES Andy Steinbach, Founder and CEO, Paradigm Shift...

Page 1: Data Apocalypse! - Storage Visions · 2018 KEYNOTES Andy Steinbach, Founder and CEO, Paradigm Shift AI Adam Roberts, Engineering Fellow, RISC-V Foundation and Western Digital Manish

Thriving in the

Data

Apocalypse!1

Page 2: Data Apocalypse! - Storage Visions · 2018 KEYNOTES Andy Steinbach, Founder and CEO, Paradigm Shift AI Adam Roberts, Engineering Fellow, RISC-V Foundation and Western Digital Manish

We Thank

Our

Sponsors

and

Exhibitors

2

Page 3: Data Apocalypse! - Storage Visions · 2018 KEYNOTES Andy Steinbach, Founder and CEO, Paradigm Shift AI Adam Roberts, Engineering Fellow, RISC-V Foundation and Western Digital Manish

3

We Thank Our Media and Organization Sponsors!

IEEE Magnetics SocietySanta Clara Valley Chapter

3

Page 4: Data Apocalypse! - Storage Visions · 2018 KEYNOTES Andy Steinbach, Founder and CEO, Paradigm Shift AI Adam Roberts, Engineering Fellow, RISC-V Foundation and Western Digital Manish

mobile

• Use your phone to get the latest agenda and exhibit information for Storage Visions® at StorageVisions.com/.

• We're also in Linked-in, Facebook and Twitter

• Just go to the home page at

• http://StorageVisions.com or

• Linkedin.com and Search Events for Storage Visions

• Twitter tag: #storagevisions

Storage Visions® 2018 is Mobile Friendlyand We're on Linked-in, Facebook & Twitter

4

Page 5: Data Apocalypse! - Storage Visions · 2018 KEYNOTES Andy Steinbach, Founder and CEO, Paradigm Shift AI Adam Roberts, Engineering Fellow, RISC-V Foundation and Western Digital Manish

2018 KEYNOTES

Andy Steinbach, Founder and CEO, Paradigm Shift AI

Adam Roberts, Engineering Fellow, RISC-V Foundation and Western Digital

Manish Muthal, VP Data Center, Xilinx

5

Page 6: Data Apocalypse! - Storage Visions · 2018 KEYNOTES Andy Steinbach, Founder and CEO, Paradigm Shift AI Adam Roberts, Engineering Fellow, RISC-V Foundation and Western Digital Manish

Morning Agenda Day 1 Monday Oct. 22

7:30 to 8:00 AM Continental Breakfast

8:00 to 8:15 AM Introduction: Tom Coughlin, Coughlin Associates

8:15 to 9:15 AM A1: Circling the Wagons— Memory/storage-centric computingSession Sponsor: TachyumModerator: Jim Handy, Objective AnalysisSpeakers: Roger Bertschmann, Eideticom Scott Shadley, NGD Systems

John Kim, Mellanox Rado Danilak, TachyumPanelist: Thad Omura, ScaleFlux

9:15 to 9:30 AM Morning Break

9:30 to 10:00 AM Keynote - Andy Steinbach, Founder and CEO, Paradigm Shift AI

10:00 AM to 11:30 AM B1: Good Monsters— Emerging memory technologies battle the data hordeModerator: Dave EgglestonSpeakers: Jim Pappas, Intel Kevin Conley, Everspin

Jeff Lewis, Spin Transfer Danny Sabour, Avalanche Technology

11:30 AM to 12:30 PM Lunch - Sponsored by Coughlin Associates and Research Development Consultants/HDDFA

12:30 to 1:00 PM Keynote - Adam Roberts, RISC-V Foundation and Western Digital

6

Page 7: Data Apocalypse! - Storage Visions · 2018 KEYNOTES Andy Steinbach, Founder and CEO, Paradigm Shift AI Adam Roberts, Engineering Fellow, RISC-V Foundation and Western Digital Manish

Afternoon Agenda Day 1 Monday Oct. 22

1:00 AM to 2:30 PM C1: Outrunning the Tsunami— NVMe and NVMe-over Fabric create opportunitiesSession Sponsor: SNIA Solid State Storage InitiativeModerator: Nick Adams, NVM Express and IntelSpeakers: Nishant Lodha, Marvell Kais Belgaied, Newisys

Saqib Jang, Chelsio Communications Rob Davis, MellanoxEden Kim, Calypso

Panelist: Yahya Mirza, Aclectic

2:30 to 3:00 PM Afternoon Break and Networking

3:00 to 4:00 PM D1:Epic Battles with Classic Heroes—Flash, HDDs and Tape slay data challengesModerator: Jean Bozman, HurwitzSpeakers: Jim Handy, Objective Analysis Andy Klein, Backblaze

Karim Kaddeche, L2 Drive Rich Gadomski, Fujilm

4:00 to 5:00 PM E1: On Location— Managing data during high resolution content captureModerator: Tim Feess, GnarboxSpeakers: Larry O’Connor, OWC Grant van Patten, Toshiba Memory America

Samuel Shimizu-Jones Scott Robert Lim, Scott Robert Photography

5:30 to 6:15 PM F1: Mobile Data Centers— Handling Big Data from Vehicle ApplicationsModerator: Alan Messer, Innovation ShiftPanelists: Alan Messer, Innovation Shift Marco Mezger, ATP Electronics

Kun Zhou, University of California, Berkeley Doug O’Flaherty, IBM

6:15 to 8:00 PM Reception - Sponsored by the Drive Trust Alliance

8:00 PM Conference Ends

7

Page 8: Data Apocalypse! - Storage Visions · 2018 KEYNOTES Andy Steinbach, Founder and CEO, Paradigm Shift AI Adam Roberts, Engineering Fellow, RISC-V Foundation and Western Digital Manish

Morning Agenda Day 2 Tuesday Oct. 23

7:30 to 8:00 AM Continental Breakfast

8:00 to 9:30 AM A2: Software Visions for High Performance Applications— Holding the beast at bayModerator: Brian Berg, Berg Software DesignSpeakers: Chet Mercado, STA Richelle Ahivers, Broadcom

Justin Wenck, PCI-SIG David Hay, LINBIT

9:30 to 10:00 AM Keynote - Manish Muthal, VP Data Center, Xilinx and Pankaj Metra, VP Product Planning, Samsung

10:00 to 10:30 AM Morning Break

10:30 AM to 12:00 PM B2: Big Data and Small Pipes: How will we get data where it needs to be?Session Sponsor: Eluv.ioModerator: Allan McLennan, Padem GroupSpeakers: Michelle Munson, Eluv.io Hans O’Sullivan, StorMagic

Motti Beck, Mellanox Scott Shadley, NGD SystemsShahar Noy, Marvell

12:00 AM to 1:30 PM Lunch and Exhibits - Sponsored by Coughlin Associates and Research Development Consultants/HDDFA

8

Page 9: Data Apocalypse! - Storage Visions · 2018 KEYNOTES Andy Steinbach, Founder and CEO, Paradigm Shift AI Adam Roberts, Engineering Fellow, RISC-V Foundation and Western Digital Manish

Afternoon Agenda Day 2 Tuesday Oct. 23

1:30 to 3:00 PM C2: Don’t Fear the Reaper—Storing data for the long termSponsored by: AparaviModerator: Geo Stedman, Marketing and Strategy ConsultantSpeakers: Rod Christensen, Aparavi Thib Guicherd-Callin, LOCKSS Program

Rich Gadomski, Active Archive Alliance Kumar Goswami, KompriseMark Pastor, Quantum

3:00 to 3:30 PM Afternoon Break - Sponsored by Keep It Safe

3:30 to 4:30 PM D2: Managing the Threat Above—Can clouds and AI deal with burgeoningdata growth?Session Sponsor: FileShadowModerator: Chris Preimesberger, eWeek.comSpeakers: Louis Imershein, Red Hat Jerome McFarland, Elastile

Jack Norris, MapR Tyrone Pike, FileShadow

4:30 to 5:30 PM E2: Apocalypse or Opportunity—Business leaders address the challenges and promise of ubiquitous dataModerator: Tom Coughlin, Coughlin AssociatesSpeakers: Jon Toor, Cloudian Robert Thibadeau, Drive Trust Alliance

RW Hawkins, Panasas Gaurav Yadav, HedvigPanelists: Farid Yavari, Jabil Brian Schwarz, Pure Storage

5:30 PM Conference Ends

9

Page 10: Data Apocalypse! - Storage Visions · 2018 KEYNOTES Andy Steinbach, Founder and CEO, Paradigm Shift AI Adam Roberts, Engineering Fellow, RISC-V Foundation and Western Digital Manish

Entertainment Storage AllianceTM

• On-going activities to provide resources and a forum for the integration of storage and entertainment

• www.entertainmentstorage.org• Quarterly Updates on Storage and Entertainment

(newsletter)• Discounts on partner reports related to storage,

entertainment and consumer electronics• Discounts on Storage Visions, Creative Storage

and other ESA programs.

10

Page 11: Data Apocalypse! - Storage Visions · 2018 KEYNOTES Andy Steinbach, Founder and CEO, Paradigm Shift AI Adam Roberts, Engineering Fellow, RISC-V Foundation and Western Digital Manish

hriving in the Data Tsunami

11

Page 12: Data Apocalypse! - Storage Visions · 2018 KEYNOTES Andy Steinbach, Founder and CEO, Paradigm Shift AI Adam Roberts, Engineering Fellow, RISC-V Foundation and Western Digital Manish

Setup and application of Canon’s free viewpoint video system

(Volumetric video)• 5-32 4K or

higher resolution cameras surrounding an event

• Images are stitched together and allow rendering a view from anyway in the captured volume

12© 2018 Coughlin Associates

Page 13: Data Apocalypse! - Storage Visions · 2018 KEYNOTES Andy Steinbach, Founder and CEO, Paradigm Shift AI Adam Roberts, Engineering Fellow, RISC-V Foundation and Western Digital Manish

360o Video and VR Will Drive Content Growth

13

• VR and AR could drive 16k video (8K per eye)

• For a display as close as a pair of glasses, you can see the difference

• 8K per eye would give more immersive experience

© 2018 Coughlin Associates

Page 14: Data Apocalypse! - Storage Visions · 2018 KEYNOTES Andy Steinbach, Founder and CEO, Paradigm Shift AI Adam Roberts, Engineering Fellow, RISC-V Foundation and Western Digital Manish

Exabyte Video Projects Coming? • Video at 16,000 X 8,000 pixel

resolution, 24 bits/pixel, 300 fps raw video content could require 115 GB/s data rates and 414 TB/hour. If 4 cameras were used to create data for a 360 degree presentation, the raw data would be 1.66 PB for an hour of content

• Within 10 years we could have pro-video projects generating close to an exabyte of data

14

Page 15: Data Apocalypse! - Storage Visions · 2018 KEYNOTES Andy Steinbach, Founder and CEO, Paradigm Shift AI Adam Roberts, Engineering Fellow, RISC-V Foundation and Western Digital Manish

Mobile Fog Nodes• Around the world, wireless carriers

are building all-new cellular networks for the Internet of Things.

• These new networks won’t work with cell phones, they’re made for IoTdevices that don’t yet exist.

• Comcast, SoftBank, Orange, SKT, KPN, Swisscom and many others are building all-new nationwide IoTnetworks. Verizon and Vodafone are upgrading their networks, setting aside spectrum just for IoT. Cisco, Samsung, Nokia and Ericsson are selling equipment to make it work.

• New networks are necessary because cell phone networks fall short for IoTin three ways: battery life, cost and wireless coverage.

15

TechCrunch, October 28, 2016

© 2018 Coughlin Associates

Page 16: Data Apocalypse! - Storage Visions · 2018 KEYNOTES Andy Steinbach, Founder and CEO, Paradigm Shift AI Adam Roberts, Engineering Fellow, RISC-V Foundation and Western Digital Manish

5G Implementation• In early 2018 Qualcomm

demonstration 5G technology in San Francisco, CA and Frankfurt, Germany. In Frankfurt browsing jumped from 56 Mbpsfor a median 4G user connection to >490 Mbps for a median 5G user connection. In San Francisco these speeds increased from 71 Mbps to 1.4 Gbps.

• Significant investments in cell tower infrastructure will be required and telecom companies must agree upon standards for 5G networks.

• Will some cell towers be “data centers?”

16© 2018 Coughlin Associates

Page 17: Data Apocalypse! - Storage Visions · 2018 KEYNOTES Andy Steinbach, Founder and CEO, Paradigm Shift AI Adam Roberts, Engineering Fellow, RISC-V Foundation and Western Digital Manish

Investments in infrastructure• Faster data delivery speeds need faster equipment

behind the radio delivery system• Lower latency requirements will drive requirements

for communication, processing and storage at the ”edge.” NVMe and NVMe-oF will drive this.

• Changes to new distribution models, such as Eluvio’s Content Fabric could change the nature of local connection nodes, including storage, processing and communication requirements

• In particular local content rendering, content caching and buffering will be key components in providing good content QoS

• This will lead to new investments in storage/memory architectures to support new ways to access, process and capture content and data

17© 2018 Coughlin Associates

Page 18: Data Apocalypse! - Storage Visions · 2018 KEYNOTES Andy Steinbach, Founder and CEO, Paradigm Shift AI Adam Roberts, Engineering Fellow, RISC-V Foundation and Western Digital Manish

Emerging Non-Volatile Memories• There is intense effort to commercialize several

non-volatile memories that could replace current volatile memories, such as DRAM and SRAM

• These technologies can be applied to stand along memory chips as well as in embedded memory

• This could reduce energy expenditure in battery and low power devices and also create more efficient data centers

• These NV memories will enable both IoT devices as well as data centers at the edge or in the cloud

• The memory technologies under consideration include magnetic random access memory (MRAM), resistive RAM (RRAM or ReRAM), phase change RAM (PRAM) and ferroelectric RAM (FRAM or FeRAM)

18© 2018 Coughlin Associates

Page 19: Data Apocalypse! - Storage Visions · 2018 KEYNOTES Andy Steinbach, Founder and CEO, Paradigm Shift AI Adam Roberts, Engineering Fellow, RISC-V Foundation and Western Digital Manish

MRAM and PRAM• MRAM

– Everspin shipped over 70 M MRAM Chips. Company has partnership with Global Foundries, who is building 300 mm wafers and targeting embedded memory applications

– Avalanche, Samsung, Spin Transfer, TDK, Toshiba, TSMC, UMC--plan to ship STT MRAM embedded product samples by 2018/2019.

– 1 Gb chips expected by the end of 2018, 256 Mb chips available now

• PRAM– Intel Optane NVMe products shipped in

2017.– Micron planning to introduce DIMM-based 3D

XPoint product– Intel introduced their Optane DIMM products

in June 201819© 2018 Coughlin Associates

Page 20: Data Apocalypse! - Storage Visions · 2018 KEYNOTES Andy Steinbach, Founder and CEO, Paradigm Shift AI Adam Roberts, Engineering Fellow, RISC-V Foundation and Western Digital Manish

High, Low and Baseline PB Emerging Memory Shipments

• Emerging NVM market could exceed $6B by 2023 (Emerging Memories are Poised to Explode, Coughlin Associates and Objective Analysis, http://www.tomcoughlin.com/techpapers.htm

20© 2018 Coughlin Associates

Page 21: Data Apocalypse! - Storage Visions · 2018 KEYNOTES Andy Steinbach, Founder and CEO, Paradigm Shift AI Adam Roberts, Engineering Fellow, RISC-V Foundation and Western Digital Manish

Digital Storage Capacity Projections• The growth and processing

of data will lead to the use of many types of digital storage

• SSDs will dominate for high performance storage and higher total revenue

• HDDs will be high capacity and used for colder storage

• Magnetic tape will be used by some organizations for the lowest cost (currently <1 cent/GB)

21© 2018 Coughlin Associates

Page 22: Data Apocalypse! - Storage Visions · 2018 KEYNOTES Andy Steinbach, Founder and CEO, Paradigm Shift AI Adam Roberts, Engineering Fellow, RISC-V Foundation and Western Digital Manish

Conclusions• Storage and memory requirements will explode in the

next few years, driven by video, 5G, IoT and AI• Storage and Memory Technologies need to evolve to

meet future needs with fast memory and cost effective storage

• The demand for lower latency will drive the use of solid state storage as primary storage in data centers and at the network edge

• Bulk cold storage will still reside in HDDs with true archives on magnetic tape or optical discs

• Emerging memories and new NVMe standards, including NVMe-oF will be important features in future storage systems. 22© 2018 Coughlin Associates

Page 23: Data Apocalypse! - Storage Visions · 2018 KEYNOTES Andy Steinbach, Founder and CEO, Paradigm Shift AI Adam Roberts, Engineering Fellow, RISC-V Foundation and Western Digital Manish

• The 3D X-Point technology is poised to impact DRAM production while STT MRAM will impact SRAM, NOR and some DRAM.

• Resistive RAM (ReRAM) appears to be a potential replacement for flash memory sometime in the next decade.

• The memories addressed in this 161-page report, containing 31 tables and 111 figures, include PCM, ReRAM, FeRAM and MRAM Technology as well as a variety of less mainstream technologies.

New Report on Emerging Memories

23© 2018 Coughlin Associates

Page 24: Data Apocalypse! - Storage Visions · 2018 KEYNOTES Andy Steinbach, Founder and CEO, Paradigm Shift AI Adam Roberts, Engineering Fellow, RISC-V Foundation and Western Digital Manish

24© 2018 Coughlin Associates

Page 25: Data Apocalypse! - Storage Visions · 2018 KEYNOTES Andy Steinbach, Founder and CEO, Paradigm Shift AI Adam Roberts, Engineering Fellow, RISC-V Foundation and Western Digital Manish

Thanks

25