© 2014 International Business Machines Corporation 1

OpenPOWER:Open Source für Hardware

Heiner Giefers

IBM Research – Zurichhgi@zurich.ibm.com

Open Source Business Forum und Awards 2016

Mittwoch, 26. Oktober 2016

Haus der Universität Bern

- Established in 1956

- Two Nobel Prizes (1986 and 1987)

- Today

~300 employees, ~3000 worldwide

40+ different nationalities

open innovation w/ 277 projects & 1900 partners in FP7, H2020, ...

IBM Research - Zurich

Today’s challenges demand innovation

Full system and stack

innovation required

Data holds

competitive value

Price/Performance

Moore’s Law

Processor

Technology

2000 2020

You are here

44 zettabytes

unstructured data

2010 2020

structured data

Data GrowthFirmware / OS

Accelerators

Software

Storage

Network

OpenPOWER, a catalyst for Open Innovation

The OpenPOWER Foundation creates an open ecosystem,

using the POWER Architecture to share expertise, investment, and

server-class intellectual property to serve the evolving needs of customers.

Performance of leading POWER architecture Broadens the capability and performance of the POWER platform

Open DevelopmentOpenPOWER enables greater innovation through

both open software and open hardware

Collaboration across multiple thought leadersCollaborative development model drives collective

thought leadership, simultaneously across multiple disciplines

OpenPOWER Foundation: 230+ Partners, 24 countries

Putting the “Open” in OpenPOWER

1. 2. 3.Open collaboration

and joint roadmaps

Open standards

and interfaces

Open hardware

and software

• Open technical membership organization. Welcoming new members in all areas

of the ecosystem.

• Different Membership Levels: Platinum, Gold, Silver, Associate & Academic. Annual fees ≤$100k (Free membership for ISVs and Associate/ Academic)

• Open development fosters innovation

• Joint roadmaps and joint development to accelerate time-to-market

Putting the “Open” in OpenPOWER

1. 2. 3.Open collaboration

and joint roadmaps

Open standards

and interfaces

Open hardware

and software

• 13 work groups developing technical specifications across the technology stack

• Free access to technical specs, design examples and documents

• POWER now supports Little Endian (ppc64le)

• Open accelerator interface: Coherent Accelerator Processor Interface (CAPI)

• OpenCAPI Consortium formed Oct. 2016 by AMD, Google, IBM, Mellanox, Micron.

OpenCAPI is an Open Interface that allows any microprocessor to attach to

• Coherent user-level accelerators and I/O devices

• Advanced memories

• Agnostic to processor architecture

Putting the “Open” in OpenPOWER

1. 2. 3.Open collaboration

and joint roadmaps

Open standards

and interfaces

Open hardware

and software

• POWER CPU IP licensable to members

• First “local” POWER derivative chip, POWERCORE CP1 (China)

• Open-sourcing IP for hardware accelerator design. CAPI “building blocks”

• Open-sourced (almost) complete firmware / OS stack [github.com/open-power]

• Open-sourcing many IBM tools, for example

• eCMD (IBM Systems hardware access API)

• Amester (whole system power measurement)

• Linux!

OpenPOWER Software Support

• 50+ IBM Innovation Centers, over 2,300 Linux ISVs developing on Power • Moving to little endian (almost complete)

OpenPOWER Core Technology Roadmap

2015 2016 2017

POWER8PCIe Gen3 & CAPI Interface

POWER8’NVLink & CAPI

POWER9Enhanced NVLink, OpenCAPI & PCIe Gen4

Connect-IBFDR Infiniband

PCIe Gen3

ConnectX-4EDR Infiniband

CAPI over PCIe Gen3

ConnectX-5Next-Gen Infiniband

Enhanced CAPI over PCIe Gen4Mellanox

Interconnect

IBM CPUs

NVIDIA GPUsKepler

PCIe Gen3Volta

Enhanced NVLinkPascalNVLink

GPU

FPGA

PCIe Gen3

1xGPU

FPGA

NVLINK

5x

GPUFPGA

2x

PCIe Gen4

25G Accelearator Link

7-10x

Accelerator Links

Coherent Accelerator Processor Interface (CAPI)

- Coherent read/write virtual memory access

- Data Caching

- Easier programming model

- Saves tens of thousands of instructions

- Enables applications not possible on I/O

PCIe

MemoryDevice

or Network

PSL

Memory Bus

CAPP

P8

Core

P8

Core

CAPI

Proxy

Core

POWER8 CPU PCIe Accelerator Card

FPGA

AFU 1

AFU 0

PSL = POWER Service

Layer

AFU = Accelerator

Functional Unit

CAPI Example: Workload Optimized SystemIBM Data Engine for No-SQL

Load Balancer

500GB Cache

Node

Today’s NoSQL in memory (x86)

Infrastructure Requirements

- Large Distributed (Scale out)

- Large Memory per node

- Networking Bandwidth Needs

- Load Balancing

Uplink

WWW

500GB Cache

Node500GB Cache

Node500GB Cache

Node500GB Cache

Node

Uplink

One POWER8

Server

Flash Array w/

up to 60TB

Differentiated NoSQL

(POWER8 + CAPI Flash)

Infrastructure Attributes

- 192 threads in 4U Server drawer

- 60 TB of flash memory per 4U drawer

- Shared Memory & Cache for dynamic tuning

- Elimination of I/O and Network Overhead

- Cluster solution in a box

WWW

24:1 Reduction in

infrastructure

2.4x Price reduction

12x Less Energy

6x Less rack pace CAPI

DRAM

CAPI Flash

PCIe Flash

Access Latency

More CAPI

Financial

L3 Order Book (Algo Logic)

Monte Carlo Risk Analysis (IBM)

Database

IBM Data Engine for No-SQL

(“CAPI-Flash”)

Erasure code for Hadoop

(IBM, Xilinx, Semptian)

SQL Accelerator (IBM Neteeza)

Key Value Store (KVS) (Xilinx)

Dynamic Time Warp Pattern Match (IBM)

Bitwise Encryption (DRC / SecurityFirst)

General Purpose

GZIP Compression (IBM)

Fast-Fourier Transfer (IBM)

Linear Algebra (Auviz)

JPEG Manipulation (ClusterTech)

Security

Bank Fraud Detection

In-Betweenness Djikstra (DRC)

Video Surveillance (SiliconScapes)

Digital DNA for forensics

(i-Abra)

Retail & Analytics

RegEx Text Analytics (IBM)

Mood Detection (SiliconScapes)

Real-Time Ad Auctions

(Algo-Logic)

Visually impaired assistance

(SiliconScapes)

Computer Vision & Learning

CV Library (Auviz)

People Identification

DNN Library (Auviz)

Activity Recognition (SiliconScapes)

Health Care

Light Activated Cancer Therapy

(U of Toronto)

Genomics Processing (Edico)

PairHMM Accelerator (IBM)

Non IBM-branded POWER Servers

Barreleye Gen1

GA 09/2016

POWER8 2-socket

mainboard, 04/2014

Many more systems available from:

+

Zaius POWER9

server (mockup)

Open Compute Project Server Design

- dual-socket POWER9 CPU

- DDR4 memory

- 48v Open Rack V2.0 compatible

- Open BMC

- OpenCAPIopencompute.org/wiki/Server/SpecsAndDesigns

openpowerfoundation.org/wp-content/uploads/2016/04/HardwareRevealFlyerFinal.pdf

Google's involvement in OpenPOWER

"We have ported our infrastructure onto the

POWER architecture. What that means is

that our toolchain supports POWER; for our

Google developers, enabling POWER for

their software applications is simply a matter

of modifying a config file and off they go.“

Maire Mahony

Google & Director OpenPOWER Foundation

IBM OpenPOWER Servers

DDR

115 GB/s

GPU GPU

NVLINK

80 GB/s

GPU GPU

NVLINK

80 GB/s

DDR

115 GB/s

IBM Power System S822LC

for Big Data (“Firestone”)

IBM Power System S822LC

for HPC (“Minsky”)

First IBM OpenPOWER System

- Dual 8- or 10-core P8

- Up to 3.32 GHz

- 230 GB/s sustained memory bandwidth

- Starting at $9,699

NVIDIA: Tesla P100 GPU with NVLink

Ubuntu by Canonical:

Launch OS supporting NVLink and Page

Migration Engine

Wistron: Platform co-design

Mellanox: InfiniBand/Ethernet NIC

HGST: Optional NVMe Adapters

Broadcom: Optional PCIe Adapters

QLogic: Optional Fiber Channel PCIe

Samsung: 2.5” SSDs

Hynix, Samsung, Micron: DDR Memory

IBM: POWER8 CPU with NVLink

IBM POWER in the Cloud

POWER8 available on SoftLayer

SaaSPaaSIaaSBare Metal

IBM Power Development Cloud

IBM Bluemix

IBM SaaS portfolio w/ 100+ offerings

SuperVessel: OpenPOWER Cloud

- Open cloud platform based on Power/OpenPOWER and OpenStack technology for

business partners, developers, and university students

- The labs include: Big Data, Internet of Things, cognitive computing, acceleration

(FPGA/GPU) and virtualization on POWER

- Accelerator Cloud @ZurichResearchLab

- Demo available: zhc2.zurich.ihost.com

PADC – Enhance OpenPOWER Ecosystem

• 3 PADC Centers (Power Acceleration and Design Center) involving IBM, NVIDIA and

Mellanox focused on accelerated applications and technical collaborations

• IBM HPC Benchmark center UK Science and Technology Facilities Council (STFC)

PADC to optimize Performance of OpenPOWER systems

for Modelling Simulation and Big Data Analytics

IBM PADC Montpellier joined center with NVIDIA and

Mellanox for technical collaboration, consulting,

application enablement, benchmarking, …

IBM PADC Boeblingen joined center with NVIDIA for

technical collaborations, consulting, application

enablement, system external access, …

IBM Poughkeepsie

POWER HPC

benchmark center

IBM has created 50+ innovation center to help ISVs port their

application to Linux on POWER. These centers provide:

- Technical skills and hardware access across multiple platforms,

local or remote, at little or no cost for migration to IBM platforms

- Qualify “ready for” marks to broaden marketing research

- Workshops, seminars, and more conducted by trained subject

matter experts.

Starting today…

Co-located with the OpenStack European Summit

http://openpowerfoundation.org/openpower-summit-europe/

Main Website openpowerfoundation.org

Heiner Giefers (hgi@zurich.ibm.com)Join the rebellion!

Lots of resources & support for Linux ISVs and Developers

Site Ox

Free On-demand cloud-based development platform

using Linux on POWER8 for 2 weekswww.siteox.com

IBM PartnerWorldTechnical Support

•IBM Innovation Centers

•Free access to Power Hardware

•Free porting assistance

•Free Eclipse-based development environmentwww.ibm.com/partnerworld/wps/servlet/ContentHandler/pw_com_pwp_partnerworld-program

IBM Innovation Centers

•All 50+ centers worldwide now support Linux on Power

•One-stop for ISVs, developers

•HW access, technical support, demos, toolkits, Hands-on

labswww.ibm.com/systems/power/software/linux/centers

IBM Power Development Cloud

Provide free access to Power hardware to ISVs for

Portingwww.ibm.com/partnerworld/wps/servlet/ContentHandler/stg_com_sys_power-development-platform

Regional Ecosystem Initiative – Recruiting Key

Solutions Greater China, North America, Europe

Middleware and Industry Solutions

IBM DeveloperWorks

Technical resources, community, blogs, toolkits, How to

articles, beta codewww.ibm.com/developerworks/linux/

IBM Watson Developer’s Cloud

Access to IBM Watson for developing cognitive

computing applicationswww.ibm.com/smarterplanet/us/en/ibmwatson/developers.html

IBM Migration Factory

Premier migration services for large applicationswww.ibm.com/systems/power/migratetoibm/index.html

Innovation Centers Provide End-to-End Assistance to ISVs

For more information ibm.com/partnerworld/iic For questions, send an email to iici@us.ibm.com

IBM Innovation Centers provide training and one-to-one guidance from building to marketing your solution.

• Technical skills and hardware access across

multiple platforms, local or remote, at little or

no cost for migration to IBM platforms

• Qualify "Ready for" marks to broaden

marketing reach

• Workshops, seminars, and more conducted by

trained subject matter experts.

All 50+ Innovation and Client Centers worldwide support Linux on Power

Latin America

• Mexico City

• Sao Paulo

North America

• Austin

• Cambridge• Chicago• Dallas• Silicon Valley• Toronto

Europe and Middle East• Amsterdam• Barcelona• Bratislava• Bucharest• Budapest• Copenhagen• Dublin• Ehningen• Hursley• Istanbul • Kiev• La Gaude

• London• Ljubljana• Milan• Moscow• Paris• Prague• Stockholm• Tel Aviv• Warsaw• Zurich

Africa • Casablanca• Johannesburg• Lagos• Nairobi

Japan

• Tokyo

Asia Pacific

• Bangalore

• Bangkok

• Ho Chi Minh City

• Kuala Lumpur

• Manila

• Seoul

• Shanghai

• Sydney

OpenPOWER Workgroups: Open Standards

Developer Platform

System SW

HW Architecture

Accelerator

Compliance

25g IO Compatibility

Memory

OpenPOWER I/O

CharterCompliance SpecificationDraft Review WG Spec

CompSTD

Charter

OpenPOWER ISA Profile V1IO Device Architecture V2Coherent Accel Intf Arch

OpenPOWER ISA Profile V2IO Device Architecture V3Coherent Accel Intf Arch

Charter P8 SP010Data

P8 2U2SReference

P8+ 1U1SReference

P8+ 2U2SReference

OPMB Intf. Spec V1Charter

CharterCAPI AFU Intf Spec V1

OpenCL SDK

CAPI AFU Intf Spec V2

Charter

CAPI LinuxSDK 64b ABI

Platform Ref

Sys I/O Enablement GuideCharter

Charter 25g IO Spec

FSI Specification FSI SpecCharter

Charter Pers Med

Charter Integrated Solutions Integrated Solutions

Personalized Medicine

SDK – Software Developer KitSP010 – Tyan OpenPOWER Customer Reference System

CAPI – Coherent Accelerator Processor Interface

AFU – Accelerator Function Unit

FSI – Field Replaceable Unit (FRU) Service Interface

OPMB – OpenPOWER Memory Bus

ABI – Application Binary Interface

2014 2015 2016

OpenPOWER Accelerators

Field Programmable

Gate Array (FPGA)

Graphics Processing

Unit (GPU)

Description

Reconfigurable hardware

Task customized, low latency, low

power

1000s of simple cores

High bandwidth, floating point, and

parallelism

Example

Use Cases

Compression, encryption, high speed

streaming, search, Monte Carlo

simulations

Neural networks, speech recognition,

chemistry, simulations, JAVA, Hadoop,

graphics, Monte Carlo

Power Chip

Integration

Coherent Accelerator Processor

Interface (CAPI)

NVIDA via PCIe x16

NVIDIA NVLink