NRB - BE MAINFRAME DAY 2017 - Z strategy
-
Upload
nrb -
Category
Devices & Hardware
-
view
232 -
download
5
Transcript of NRB - BE MAINFRAME DAY 2017 - Z strategy
IBM SystemsTechnical Eventsibm.com/training/events
Adam Sturges-BeerDirector z Software Sales Europe
IBM LinuxONEEmperor II
IBM z14
IBM z platform –Strategy & Evolution
© Copyright IBM Corporation 2017. Technical University/Symposia materials may not be reproduced in whole or in part without the prior written permission of IBM.
IBM Systems Technical Events – ibm.com/training/events
© 2017 IBM Corporation2IBM Z
Trademarks
The following are trademarks of the International Business Machines Corporation in the United States, other countries, or both.
The following are trademarks or registered trademarks of other companies.
Adobe, the Adobe logo, PostScript, and the PostScript logo are either registered trademarks or trademarks of Adobe Systems Incorporated in the United States, and/or other countries.Cell Broadband Engine is a trademark of Sony Computer Entertainment, Inc. in the United States, other countries, or both and is used under license therefrom. Java and all Java-based trademarks are trademarks of Sun Microsystems, Inc. in the United States, other countries, or both. Microsoft, Windows, Windows NT, and the Windows logo are trademarks of Microsoft Corporation in the United States, other countries, or both.Intel, Intel logo, Intel Inside, Intel Inside logo, Intel Centrino, Intel Centrino logo, Celeron, Intel Xeon, Intel SpeedStep, Itanium, and Pentium are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States and other countries.UNIX is a registered trademark of The Open Group in the United States and other countries. Linux is a registered trademark of Linus Torvalds in the United States, other countries, or both. ITIL is a registered trademark, and a registered community trademark of the Office of Government Commerce, and is registered in the U.S. Patent and Trademark Office.IT Infrastructure Library is a registered trademark of the Central Computer and Telecommunications Agency, which is now part of the Office of Government Commerce.
Not all common law marks used by IBM are listed on this page. Failure of a mark to appear does not mean that IBM does not use the mark nor does it mean that the product is not actively marketed or is not significant within its relevant market.
Those trademarks followed by ® are registered trademarks of IBM in the United States; all others are trademarks or common law marks of IBM in the United States.
For a more complete list of IBM Trademarks, see www.ibm.com/legal/copytrade.shtml: *BladeCenter®, CICS®, DataPower®, DB2®, e business(logo)®, ESCON, eServer, FICON®, IBM®, IBM (logo)®, IMS, MVS, OS/390®, POWER6®, POWER6+, POWER7®, Power Architecture®, PowerVM®, PureFlex, PureSystems, S/390®, ServerProven®, Sysplex Timer®, System p®, System p5, System x®, z Systems®, System z9®, System z10®, WebSphere®, X-Architecture®, z13™, z Systems™, z9®, z10, z/Architecture®, z/OS®, z/VM®, z/VSE®, zEnterprise®, zSeries®
© Copyright IBM Corporation 2017. Technical University/Symposia materials may not be reproduced in whole or in part without the prior written permission of IBM.
IBM Systems Technical Events – ibm.com/training/events
Please note
IBM’s statements regarding its plans, directions, and intent are subject to change or withdrawal without notice at IBM’s sole discretion.Information regarding potential future products is intended to outline our general product direction and it should not be relied on in making a purchasing decision.
The information mentioned regarding potential future products is not a commitment, promise, or legal obligation to deliver any material, code or functionality. Information about potential futureproducts may not be incorporated into any contract.
The development, release, and timing of any future features or functionality described for our products remains at our sole discretion.Performance is based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput or performance that any user will experience will vary depending upon many factors, including considerations such as the amount of multiprogramming in the user’s job stream, the I/O configuration, the storage configuration, and the workload processed. Therefore, no assurance can be given that an individual user will achieve results similar to those stated here.
3
© Copyright IBM Corporation 2017. Technical University/Symposia materials may not be reproduced in whole or in part without the prior written permission of IBM.
IBM Systems Technical Events – ibm.com/training/events
Notice and disclaimersCopyright © 2017 by International Business Machines Corporation (IBM). No part of this document may be reproduced or transmitted in any form without written permission from IBM.
U.S. Government Users Restricted Rights — use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM.Information in these presentations (including information relating to products that have not yetbeen announced by IBM) has been reviewed for accuracy as of the date of initial publication and could include unintentional technical or typographical errors. IBM shall have no responsibility to update this information. This document is distributed “as is” without any warranty, either express or implied. In no event shall IBM be liable for any damage arising from the use of this information, including but not limited to, loss of data, business interruption, loss of profit or loss of opportunity. IBM products and services are warranted according to the terms and conditions of the agreements under which they are provided.
IBM products are manufactured from new parts or new and used parts. In some cases, a product may not be new and may have been previously installed. Regardless, our warranty terms apply.”
Any statements regarding IBM's future direction, intent or product plans are subject to change or withdrawal without notice.Performance data contained herein was generally obtained in a controlled, isolated environments.Customer examplesare presented as illustrations of how those customers have used IBM products and the results they may have achieved. Actual performance, cost, savings or other results in other operating environments may vary.References in this document to IBM products, programs, or services does not imply that IBM intends to make such products, programs or services available in all countries in which IBM operatesor does business.
Workshops, sessions and associated materials may have been prepared by independent session speakers, and do not necessarily reflect the views of IBM. All materials and discussions are provided for informational purposes only, and are neither intended to, nor shall constitute legal or other guidance or advice to any individual participant or their specific situation.
It is the customer’s responsibility to insure its own compliance with legal requirements and to obtain advice of competent legal counsel as to the identification and interpretation of any relevant laws and regulatory requirements that may affect the customer’s business and any actions the customer may need to take to comply with such laws. IBM does not provide legal advice or represent or warrant that its services or products will ensure that the customer is in compliance with any law.
4
© Copyright IBM Corporation 2017. Technical University/Symposia materials may not be reproduced in whole or in part without the prior written permission of IBM.
IBM Systems Technical Events – ibm.com/training/events
Notice and disclaimers cont.
Information concerning non-IBM products was obtained from the suppliers of those products, their published announcements or other publicly available sources.IBM has not tested those products in connection with this publication and cannot confirm the accuracy of performance, compatibility or any other claims related to non-IBM products. Questions on the capabilities of non-IBM products should be addressed to the suppliers of those products. IBM does not warrant the quality of any third-party products, or the ability of any such third-party products to interoperate with IBM’s products. IBM expressly disclaims all warranties, expressed or implied, including but not limited to, the implied warranties of merchantability and fitness for a particular, purpose.The provision of the information contained herein is not intended to, and does not, grant any right or license under any IBM patents, copyrights, trademarks or other intellectual property right.
IBM, the IBM logo, ibm.com, AIX, BigInsights, Bluemix, CICS, Easy Tier, FlashCopy, FlashSystem, GDPS, GPFS, Guardium, HyperSwap, IBM Cloud Managed Services, IBM Elastic Storage, IBM FlashCore, IBM FlashSystem, IBM MobileFirst, IBM Power Systems, IBM PureSystems, IBM Spectrum, IBM Spectrum Accelerate, IBM Spectrum Archive, IBM Spectrum Control, IBM Spectrum Protect, IBM Spectrum Scale, IBM Spectrum Storage, IBM Spectrum Virtualize, IBM Watson, IBM Z, IBM z Systems, IBM z13, IMS, InfoSphere, Linear Tape File System, OMEGAMON, OpenPower, Parallel Sysplex, Power, POWER, POWER4, POWER7, POWER8, Power Series, Power Systems, Power Systems Software, PowerHA, PowerLinux, PowerVM, PureApplica- tion, RACF, Real-time Compression, Redbooks, RMF, SPSS, Storwize, Symphony, SystemMirror, System Storage, Tivoli, WebSphere, XIV, z Systems, z/OS, z/VM, z/VSE, zEnterprise and zSecure are trademarks of International Business Machines Corporation, registered in many jurisdictions worldwide. Other product and service names might be trademarks of IBM or other companies. A current list of IBM trademarks is available on the Web at "Copyright and trademark information" at: www.ibm.com/legal/copytrade.shtml.
Linux is a registered trademark of Linus Torvalds in the United States, other countries, or both. Java and all Java-based trademarks and logos are trademarks or registered trademarks of Oracle and/or its affiliates.
5
© 2017 IBM Corporation6IBM Z
IBM Z: Designed for Trusted Digital Experiences
Pervasive Encryption is the
New Standard
100% encryption of all data Zero application changes
Zero impact to service levelsProtect client and corporate from
internal and external threats
Analytics & Machine Learning for Continuous Intelligence Across
the Enterprise
Anticipate customer needs and embed insight in every business transaction
Dramatically faster lifecycle management of behavioral models with more memory
and greater processing capacityDerive impactful insights by combining IBM Z data with other structured and unstructured external data sources
Open Enterprise Cloud to Extend, Connect
and InnovateCut new service build time by 90% using
secure APIs on IBM Z and advanced DevOps
Seamlessly connect any service from public and private cloud with transactions
and data on IBM ZAccelerate innovation with an ecosystem
of partners to develop and manage enterprise wide applications leveraging 1000’s open source software packages
Container Pricing for IBM Z provides new flexibility for modern digital workloads
© 2017 IBM Corporation7IBM Z
IBM Z Technology Evolution
+294% CAGR in 17 years+369% for IFLs with SMT
(2000 – 2017)
10 x in 17 years(2000 – 2017)
512 x in 17 years(2000 – 2017)
+45% CAGR in 17 years+58% for IFLs with SMT
(2000 – 2017)
© 2017 IBM Corporation8IBM Z
IBM Z Life Cycle history
z196 & z114 withdrawn from
marketing on June 30, 2014
zEC12 & zBC12 withdrawn from marketing on December 31, 2016,
LIC upgrades on December 31, 2017,
All billing FC for CoD on June 30, 2018.
Emperor IIANN: Sept. 11, 2017GA: Sept. 13, 2017
IBM z14ANN: July 17, 2017GA: September 13, 2017
© 2017 IBM Corporation9IBM Z
Introducing the IBM z14§ Processor Units (PUs)
– 41 (49 for M05) PU cores per CPC drawer– 33, 69, 105, 141 or 170 PU cores available for characterization– Single thread capacity ~1832 MIPS– Up to 23 SAPs per system, standard – New on z14 is SAPs are SMT– 2 spares designated per system– 85 LPARs– Sub-capacity available for up to 33 CPs – 3 sub-capacity points– Enhanced performance for compression and crypto coprocessor
§Memory– RAIM Memory design– System Min of 256 GB - up to 8 TB / drawer - 192 GB Fixed HSA, standard – Up to 32 TB for System and up to 16 TB per LPAR (OS dependent)– IBM Virtual Flash Memory (replaces Flash Express)
§ I/O– New PCIe Gen 3 IBM zHyperLink technology– Last high end server to support InfiniBand Coupling Features – 16 GBps PCIe Gen 3 I/O Interconnects– 6 Logical Channel Subsystems (LCSSs) with 4 Sub-channel sets per LCSS
Model Customer PUs
Max Memory
M05 170 32 TB
M04 141 32 TB
M03 105 24 TB
M02 69 16 TB
M01 33 8 TB*
IBM z14Machine Type: 3906
Models: M01, M02, M03, M04, M05
© 2017 IBM Corporation10IBM Z
z14 Processor Features – zIIP to CP 2:1 ratio
1. At least one CP, IFL, or ICF must be purchased in every machine2. Two zIIPs may be purchased for each CP purchased if PUs are available. This remains true for sub-capacity CPs and for “banked” CPs.3. On an upgrade from zEC12, installed zAAPs are converted to zIIPs by default. (Option: Convert to another engine type)4. “uIFL” stands for Unassigned IFL5. The IFP is conceptually an additional, special purpose SAP – used by PCIe I/O features.
Model Drawers/ PUs CPs IFLs
uIFLs zIIPs ICFs StdSAPs
Optional SAPs
Std.Spares IFP
M01 1 x 41 0-33 0-330-32 0-22 0-33 5 0-4 2 1
M02 2 x 41 0-69 0-690-68 0-46 0-69 10 0-8 2 1
M03 3 x 41 0-105 0-1050-104 0-70 0-105 15 0-12 2 1
M04 4 x 41 0-141 0-1410-140 0-94 0-141 20 0-16 2 1
M05 4 x 49 0-170 0-1700-169 0-112 0-170 23 0-16 2 1
© 2017 IBM Corporation11IBM Z
Introducing the IBM LinuxONE Emperor II§ Processor Units (PUs)
– 41 (49 for LM5) PU cores per CPC drawer– 33, 69, 105, 141 or 170 IFL processors available for Linux workloads– 1 CP available (option) to support the GDPS Virtual Appliance – Single thread capacity ~1832 PCI– Up to 23 SAPs per system, standard – New on LinuxONE Emperor II is SAPs are
SMT– 2 spares designated per system– Up to 85 LPARs– Enhanced performance for compression and crypto coprocessor– Dynamic Partition Manager (DPM)
§Memory– RAIM Memory design– System Min of 256 GB - up to 8 TB / drawer - 192 GB Fixed HSA, standard – Up to 32 TB for System and up to 16 TB per LPAR (OS dependent)
§ I/O– Technology refresh of all I/O cards (FICON, OSA, RoCE)– 16 GBps PCIe Gen 3 I/O Interconnects– 6 Logical Channel Subsystems (LCSSs) with 4 Sub-channel sets per LCSS
Model Customer PUs
Max Memory
LM5 170 32 TB
LM4 141 32 TB
LM3 105 24 TB
LM2 69 16 TB
LM1 33 8 TB*
IBM LinuxONE Emperor IIMachine Type: 3906
Models: LM1, LM2, LM3, LM4, LM5
© 2017 IBM Corporation12IBM Z
Dynamic Partition Manager – At a Glance
Dynamic Partition Manager ModeA CPC can be in Standard PR/SM mode or Dynamic Partition Manager mode. Enable Dynamic Partition Manager mode with first IML.
Linux onlyA CPC running in Dynamic Partition Manager mode is Linux only. No z/OS, z/VM, z/VSE, z/TPF, IBM zAware support. FCP Storage only.
SimplificationProvide simplified, consumable, enhanced Partition life-cycle and integrated dynamic I/O management capabilities.
CloudProvides the technology foundation that enables IaaS and secure, private Clouds.
FIEInitial focus on First In Enterprise (FIE) customers with support for existing clients in a later stage.
“Dynamic Partition Manager” provides simplified IBM Z hardware and virtual infrastructure
management including integrated dynamic I/O management for FIE customers that run z/VM or
KVM on Z as a hypervisor and/or Linux on z as an Partition-hosted operating system.”
© 2017 IBM Corporation13IBM Z
Dynamic Partition Manager Management
© 2017 IBM Corporation14IBM Z
Secure Service ContainerThe Base Infrastructure to Host and Build Software Appliances
§ Provides simplified mechanism for fast deployment and management of packaged solutions§ Provides tamper protection during Appliance installation and runtime§ Ensure confidentiality of data and code running within the appliance – both at flight and at rest§ Management provided via Remote APIs (RESTful) and web interfaces§ Enables appliances to be delivered via distribution channels§ Usability improvements based on customer feedback§ Software Appliances: IBM zAware (IOAz), z/VSE Network Appliance
Services
Applications
Operating SystemManagem
ent
z13 GA2, z13s, z14LinuxONE
© 2017 IBM Corporation15IBM Z
Data Protection // Secure Service Container
CF
z/OS
z/OS z/OS
z/OS
SANNetwork
Storage System
LinuxONE/IBMZSecureServiceContainer
Extending the value of z hardware crypto
Protected-keyCPACF–keyvaluenotvisibleto
OSorapplication
LinuxONE / z Systems
Client Value Proposition:Simplified, fast deployment and management of packaged solutions
Tamper protection during Appliance installation and runtime
Confidentiality of data and code running within the Appliance both at flight and at rest
Restricts administrator access to workload and data
Secure Service Container architecture builds on the value z systems hardware crypto using a runtime environment designed to help clients reduce risk.
© 2017 IBM Corporation16IBM Z
IBM Secure Service Container Deployment OverviewDeployment in 5 steps
Appliance LPARSSC Mode
ApplianceInstaller
IBM Salesi.e. ShopZ
U/I
SWAppliance
U/I
reboot
Infrastructure (Software) Appliance
Appliance
Appliance Storage
SoftwareAppliance
A
SoftwareAppliance
BCustomer disk (ECKD)
2
45
1
3
1) Buy a Software Appliance (e.g. IOAz/zAware)
2) Download the Appliance image
3) Create and activate an appliance (SSC) LPAR
4) Deploy Appliance using Appliance Installer
5) Configure and use Appliance through REST API
or web U/I
© 2017 IBM Corporation17IBM Z
SSC Supported Appliances (z13, z13s, z14): z/VSE Network Appliance
Linux Fast Path - z/VSE IP Assist§ Customer has to:
- Download the LFP image based on Secure Service Container SDK
- Install / configure the image
§ Linux acts as a router for z/VSE§ No TCP/IP stack required on z/VSE§ No Linux distribution required
z14,z1
3GA
2,z13s
Application
TCP/IP
Stack
Application
TCP/IP
Stack
Application
LFPIm
ageb
asedon
SSCSD
K
z/VSELinux onzSystems z/VSE
z/VSE
Supervis
or
Kernel
z/VSE
Supervis
or
HyperSockets HyperSockets
Network
© 2017 IBM Corporation18IBM Z
SSC Supported Appliances (z13 GA2, z13s, z14): IBM zAware (IOAz)
• Provides anomaly detection, search and reporting • Identify unusual system behavior of z/OS and Linux on System z images• Analyze message logs for all servers in the enterprise from single browser in real-time
Monitored Clients
Linu
x on
Syst
em z
Web UI to monitor results
z/VM
Data from other
platforms
Monitored Clients
Linu
x on
Syst
em z
Linu
x on
Syst
em z
z/O
S
z/O
S
zAware(IOAz)
Integrated Analytics Software Virtual Appliance
IBMOpe
ratio
nsAna
lyticsforzSystem
sV3.1
IBM zAware not supported on z14 as firmware appliance.
© 2017 IBM Corporation19IBM Z
§ 14 nm Processor with improved SIMD, SMT§ 10 Cores per CP SCM design§ 5 or 6 CP SCMs per Drawer § Integrated I/O with PCIe Direct Attach§ Single System Controller Chip§ Simplified CPC Drawer SMP Fabric
z14 System Design Changes § Crypto Express6S§ OSA-Express6S § FICON Express16S+§ RoCE Express2§ IBM zHyperLink Express§ Coupling Express Long Reach§ Radiator Design improvements§ Expanded operating environment (ASHRAE Class A3)§ Thin doors (optional)
IBMz14
© 2017 IBM Corporation20IBM Z
IBM Z Processor Roadmap
Core 0
L3_0
L3_1
L2
CoPMCU
L2
Core 1
L3_0
L3_1
Core 2
L2
CoP GX
L2
Core 3
L3_0 Controller
L3_1 Controller
MCIOs
MCIOs
GXIOs
GXIOs
L3B
L3B
Core 0
L3_0
L3_1
L2
CoPMCU
L2
Core 1
L3_0
L3_1
Core 2
L2
CoP GX
L2
Core 3
L3_0 Controller
L3_1 Controller
MCIOs
MCIOs
GXIOs
GXIOs
L3B
L3B
z196/z1149/2010
zEC12/zBC128/2012
z147/2017
LeadershipSingleThread,EnhancedThroughput
Improvedout-of-order
Transactional Memory
DynamicOptimization
2GBpagesupport
StepFunctioninSystemCapacity
TopTierSingleThreadPerformance,System Capacity
AcceleratorIntegration
OutofOrderExecution
WaterCooling
PCIe I/OFabric
RAIM
EnhancedEnergyManagement
LeadershipSystemCapacityandPerformance
Improveddatacompression
Enhancedhardwareencryption
EnhancedSMT(2-way)
EnhancedSIMD
Pause-lessGarbageCollectionforJava
14nm
32nm45nm
6.1BTransistors
6-corech
ip
10-corechip
z13/z13s1/2015
LeadershipSystemCapacityandPerformance
Modularity&Scalability
SMT (2-way)
Doubleinstructionbandwidth
SIMD
BusinessAnalyticsOptimized
22nm
8-corech
ip
4-corech
ip
1.4Btransistors
2.75BTransistors
3.99BTransistors
© 2017 IBM Corporation21IBM Z
z14 System UpgradesIBMz14
IBMzEC12
IBMz13
z14 M0x Air
z14 M0x Water
zEC12 Air Yes YeszEC12 Water No Yes
z13 Air Yes Yesz13 Water No Yes
Note: Upgrading from z14 model M01-M04 to a model M05 is not supported. Factory build only.
IBMz14
© 2017 IBM Corporation22IBM Z
IBM Virtual Flash Memory (VFM) - Feature Code 0604IBM Virtual Flash Memory (VFM)
§ Replacement for IBM Flash Express I/O features – use z14 memory§ Up to 10% end to end performance improvement
‒ 1000X improvement in Read/Write latency§ Same use cases as IBM Flash Express:
§ Improve availability and performance during workload transition and spikes§ Faster and less disruptive diagnostics§ Resilient solution for overflow of MQ shared queues in Coupling Facility
§ Saves at least two PCIe I/O Drawer Slots, Less power consumption, Better performance.Reliability, Availability, Serviceability
§ If flexible memory is ordered, flexible memory for VFM is required.§ The memory associated with the VFM can be evacuated to another processor drawer along with
the “regular” customer memory.– Supported: Concurrent Drawer Add, Concurrent Drawer Repair, Concurrent Memory Add.
Increment Size: Up to four features/increments (1.5 TB, 3.0 TB, 4.5 TB, 6.0 TB)§ VFM is HSA-like memory
© 2017 IBM Corporation23IBM Z
§ Each PU SCM:– 14nm – One Memory Controller per CP Chip– Five DDR4 DIMM slots per Memory Controller: 15 total per
logical cluster§ Each drawer:
– Two logical CP clusters (0 and 1)– Five PU Chips: 41 active PUs – M01 – M04 – Six PU Chips: 49 Active PUs – M05– One SC Chip (672 MB L4 cache)– Populated DIMM slots: 25 DIMMs
to support up to 8 TB of addressable memory (10 TB RAIM) – Water cooling for PU SCMs, air cooled SC SCM– Two Flexible Support Processors– Ten fanout slots for PCIe I/O drawer fanouts or PCIe
coupling fanouts– Four fanout slots for PSIFB coupling link fanouts
z14 Processor Drawer (Top View)
Front
Rear
M05Only
SC
LogicalCluster0
LogicalCluster1
© 2017 IBM Corporation24IBM Z
80-way
1202 15033TB
384GB/Sec*
101-way
z196zEC12z13
141-way
SystemI/OBandwidth+832GB/Sec*
Memory32TB
PCIfor1-way1832
z14
1695
170-way
10TB
z14 Advanced System Design
SecurityResiliencyManageabilityIntegrationAcceleration
Memory capacity supports in-memory data processing, analytics, and extreme virtualization
Combine industry link speeds with massive connectivity
Grow system scale to support growing transaction rates and additional workloads
Growth in per-engine performance
© 2017 IBM Corporation25IBM Z
z14 Continues the CMOS Mainframe Heritage Begun in 1994
0
1000
2000
3000
4000
5000
6000
z900 z990 z9ec z10ec z196 zEC12 z13 z14
770MHz 1.2GHz1.7GHz
5.2 GHz 5.0GHz
2000z900
189nmSOI16Cores**Full64-bit
z/Architecture
2003z990
130nmSOI32Cores**SuperscalarModularSMP
2005z9EC
90nmSOI54Cores**Systemlevel
scaling
2010z196
45nmSOI80Cores**OOOcore
eDRAM cacheRAIMmemoryzBX integration
2008z10EC
65nmSOI64Cores**
High-freq core3-levelcache
MHz/GHz
1000
0
2000
3000
4000
5000
1202*+33%GHz+18%
902*+50%GHz
+159%
1695*+12%GHz-9%
31,826*+72%
111,556*+42%
5.5 GHz
1514*+26%GHz+6%
78,426*+50%
52,286*+64%
6000
2015z13
22nmSOI141Cores**SMT &SIMDUpto10TBof
memory
2012zEC12
32nmSOI101Cores**
OOO andeDRAMcacheimprovements
PCIe FlashArchextensions
forscaling**NumberofPUcoresforcustomeruse* MIPSTablesareNOTadequate formakingcomparisonsofIBMZprocessors.Additionalcapacityplanningrequired
2017z14
14nmSOI170Cores**
VFMzHyperLink
Upto32TBofmemory
SMTonSAP
4.4GHz
902*+50%GHz
+159%
31,826*+72%
1832*+8%GHz+4%
146,462*+31%
5.2GHz~10%forequalz13n-way~35%maxcapacity170-wayvs141-way(z13)SMTvsSingleThread~10–40%(average25%)- bothzIIP&IFL
SMTz14vs z13~15%(z/VMGuests)
z900 z990z9EC
z10ECz196
zEC12z13 z14
© 2017 IBM Corporation26IBM Z
z14 Processor Design§ Performance Enhancements
• Larger L1, L2, and L3 caches• New address translation design• Branch prediction innovations (z/OS and Linux aware)• Instruction pipeline optimizations• Increased floating-point compute bandwidth• 2nd-generation SMT (SAP support)
§ Architecture features• SIMD extensions for decimal operations and analytics
• Register-based BCD operations (Cobol)• Guarded Storage Facility
• Enables pause-less garbage collection for Java• Instruction Execution Protection Facility
• “No-execute” zones§ Compression co-processor§ Crypto co-processor
14nm SOI TechnologyUp to 10 active cores (PUs) per chip
System Control (SC) chip
© 2017 IBM Corporation27IBM Z
Guarded Storage Facility (GSF) on z14
§ Support allows an area of storage to be identified such that an Exit routine gets control if a reference is made to the storage
§ Allows Java exploitation to improve their garbage collection
‒ A less-pausing (Pause-Less) approach, not a no-pause approach
§ GSF is managed by new instructions that define Guarded Storage Controls and system code to maintain that control information across un-dispatch and re-dispatch
§ Function is provided on z/OS 2.2 and later on z14
– APAR OA51643 must be installed
– At z14 GA this facility is not available if running as z/VM guest
• Guest exploitation support for GSF will be available in z/VM 6.4 by YE 2017
© 2017 IBM Corporation28IBM Z
Pause-less Garbage Collection
Allows Java garbage collection to run concurrently with applications for more predictable response-times and high-performance transaction processingat-scale
Java Garbage Collection - Tuning made easy
Up to 3x better throughput for response-time constrained Service Level Agreements (SLAs)
Up to 10x better average GC pause-times IBM Java 8 SR5 + IBM z14’s Guarded Storage Facility allows GC to run in parallel with application.
Enable with: -Xgc:concurrentScavenge
© 2017 IBM Corporation29IBM Z
Pause-Less Garbage Collection: -Xgc:concurrentScavenge
More consistent and reduced GC pause times for response-time sensitive, large heap applications.Existing: All applications threads pause to allow GC to safely move objects in heap
Pause-Less GC: Short GC Pause Times, Application Threads run concurrently with GC.
MigrateObjects UpdateReferencesApp
Thread
AppThread
GCPauseTimeApp
Thread
AppThread
AppThread
MuchShorterGCPauseTimeApp
Thread
AppThread
MigrateRoot Set
AppThread
AppThreadGC
UpdateReference
UpdateReference
AppThread
AppThread
© 2017 IBM Corporation30IBM Z
Instruction Execution Protection (IEP)
§ IEP is a hardware function provide by z14 (based on DAT table entry bit) ‒ Bit 55 of the page and segment table entries has been defined as the instruction
execution protection (IEP) control bit§ RSM provides new function to request that non-executable memory be allocated
– Exploitation support new EXECUTABLE=NO option on IARV64 and STORAGE – Any attempt to execute will program-check
• Could be an indication of an attempt to violate system integrity§ RTM will write LOGREC record of any program-check that results from IEP§ Support will be for z/OS 2.2 and later running on z14
‒ APAR OA51015 must be installed‒ Toleration APAR will be provided for lower z/OS releases supported on z14‒ Function will not be available when running as a z/VM guest
© 2017 IBM Corporation31IBM Z
z14 Processor Design
§ Performance Enhancements§ Architecture features§ Compression co-processor
• Order-preserving compression• Support for compression of DB2 indices
• Improved compression ratios with Huffman coding• Faster compression and expansion (~20% to 30%)
§ Crypto co-processor• True Random Number generator• Support for SHA3 standard• RSA/ECC acceleration for asymmetric encryption• GCM (Galois Counter Mode) acceleration for symmetric encryption• Faster encryption and decryption
• 2X for most usage of AES• 6X for GCM
14nm SOI TechnologyUp to 10 active cores (PUs) per chip
System Control (SC) chip
© 2017 IBM Corporation32IBM Z
Order Preserving Compression (OPC)
Statement of Direction: Db2 plans to exploit z14 OPC to compress Db2 indexesIndex keys to be compressed (not RIDs)Goal: reduce number of index pages for a unique index by 30% or more.
§ Reduce DASD space for indexes, also reducing I/O and memory requirementsCompressed index keys remain ordered, so almost zero overhead for matching index access
§ Some CPU overhead for screening predicates, since keys will need to be decompressed
Software decompression provided for Db2 systems access compressed indexes from pre z14 machinesGoal: improved usability and compression compared to existing Db2 index compression technique with no CPU increase
© 2017 IBM Corporation33IBM Z
Huffman compression for Db2 Data pages
Db2 12 will compress data pages using z14 hardware support for Huffman with shorter variable length compression symbols (zPARM is set to HUFFMAN). § Current compression done in hardware but with less efficient fixed length
compression symbols.Benefits:
§ DASD space savings, I/O reduction and better local buffer pool efficiency for Db2 Tables.
§ Improved compression ratios with excellent performanceTooling: DSN1COMP is enhanced to give compression estimates for Huffman.
Note: this enhanced DB2 data compression is enabled by z14 on-chip hardware extensions and does not depend on the zEDC card.
© 2017 IBM Corporation34IBM Z
Co-processor compression (CMPSC)
§ New compression
algorithm fully
pipelined, ~2x
faster
§ Dedicated Co-Processor per Core
§ With small, dedicated dictionary cache
§ Connects to main cache-structure(better throughput for many dictionaries)
z13
§ Order Preserving compression in B-Trees and other index structures
§ Faster expansion algorithms (~20-30%)
§ Reduced overhead on short data
§ Huffman compression on top of CMPSC compression(Embedded in existing dictionary, reuse of generators)
zEC12 z14z196
§ Reduce compression/expansion overhead to enable more widespread exploitation§ Improve compression algorithms to compress more data better
Co-Processor§ Compression§ Expansion
§ Translation
© 2017 IBM Corporation35IBM Z
z14 Processor Design§ Performance Enhancements§ Architecture features§ Compression co-processor
• Order-preserving compression• Support for compression of DB2 indices
• Improved compression ratios with Huffman coding• Faster compression and expansion
§ Crypto co-processor• True Random Number generator• Support for SHA3 standard• RSA/ECC acceleration for asymmetric encryption• GCM (Galois Counter Mode) acceleration for symmetric encryption• Faster encryption and decryption
• 2X for most usage of AES• 6X for GCM
Z
14nm SOI TechnologyUp to 10 active cores (PUs) per chip
System Control (SC) chip
© 2017 IBM Corporation36IBM Z
Pervasive Encryption with IBM Z Enabled through tight platform integration
Protect Linux file systems and z/OS data sets using policy controlled encryption that is transparent to applications and databases
Data Set & File Encryption
Integrated Crypto Hardware
Hardware accelerated encryption on every core – CPACF (Central Processor Assist for Cryptographic Functions) PCIe Hardware Security Module (HSM) & Cryptographic Coprocessor – Crypto Express
Protect network traffic using standards based encryption from end to end, including encryption readiness technology to ensure that z/OS systems meet approved encryption criteria
Network Encryption
Protect z/OS Coupling Facility data end-to-end, using encryption that’s transparent to applications
Coupling Facility
Full disk encryption utilizes encrypting disk drives that protect data at rest when disk drives are retired, sent for repair or repurposed
Full Disk Encryption
Secure deployment of software appliances including tamper protection during installation and runtime, restricted administrator access, and encryption of data and code in-flight and at-rest
Secure Service Container
© 2017 IBM Corporation37IBM Z
Hardware Crypto support in IBM Z Architecture
CPACF
Rack Mounted or Tower
Trusted Key Entry
z14 CPCDrawers
Smart Cards
z14 PU SCM
Crypto Express6S
Smart Card Readers
PCIe I/O drawers
IBM z14
CPACF (CentralProcessorAssistforCryptographicFunctions)Performance improvements of up to 7x for selective encryption modes
Crypto Express6SPerformance improvements up to 2x
Industry exclusive “protected key” encryption
© 2017 IBM Corporation38IBM Z
Pervasive Encryption and Cryptographic functions can help youout when dealing with….
© 2017 IBM Corporation39IBM Z
IBM Sys tems | 6
The European Union has had data privacy regulation in place since 1995. A new set of rules have been published in April 2016 to take effect in May 2018. The new GDPR establishes common rules across Europe and gives individuals better control over their personal data held by the organizations.
General Data Protection Regulation (GDPR)
Objective Description
Establish data privacy as a fundamental right
The GDPR considers data privacy as a fundamental right of an individual, which includes a “right to the protection ”of their personal data. Anyone based in the EU, or anyone handling or targeting the personal data of an EU-based individual must have processes, technology, and automation to effectively protect personal data.
Clarify the responsibilities for EU data protection
The GDPR applies to anyone based in the EU, or anyone handling the personal data of an EU-based individual or targeting him/her by offering goods or services from outside the EU borders.
Define a baseline for data protection
To avoid fragmentation and ambiguity, GDPR has set a baseline for data protection by requiring anyone handling the personal data of an EU individual to follow the GDPR guidelines.
Elaborate on the data protection principles
The GDPR considers encryption as only one of the components of a broad security strategy, and mandates that organizations need to consider assessment, preventive, and detective controls based upon the sensitivity of the data they have.
Increase enforcement powers
EU aims to ensure the compliance with the GDPR by enforcing huge fines up to 4% of global annual revenue upon non-compliance.
© 2017 IBM Corporation40IBM Z
z14 is strategically aligned with Data Protection Use case : a Cyber attack occursCompany that holds data must detect and report the data breach to all end users
impacted within 72 hours …..except if the data are encrypted!So Encryption is not mandatory but will be essential to reduce Data breach reporting
and impact on company reputation
Today clients encrypt z Systems sensitive data in databases and use encryption software in distributed platforms for all data. But to encrypt , the company needs to:
• classify data, tag them , implement encryption engine• sometime modify application,• buy and manage Hardware and software for encryption for distributed platforms
With Pervasive Encryption, data is encrypted (in flight /at rest): no need for data classification and taggingz14 offers higher crypto performance to sustain Pervasive Encryption for all data
• 4x times more powerful than x86 (*)• reduced cost versus Software encryption• Help our clients to reach the highest level of security for their data
(*) estimation today
© 2017 IBM Corporation41IBM Z
CPACF CPACF
CPACF CPACF
Data Protection // Coupling Facility Encryption
z/OS
CF
CF
z/OS z/OS
SANNetwork
End-to-End encryption of CF Data:• Host Protected key CPACF Encryption
(High Performance / Low Latency)• Data encrypted in the host and remains
encrypted until decrypted by host• No application enablement required• List & Cache Structures only – No Lock!
Storage System
abc
***
***
XES
Client Value Proposition:Simplify and reduce cost of compliance by removing CF and CF data from compliance scope (i.e. ability to encrypt all CF data)
Protection of data in-flight and in-use (CF)
z/OS Parallel Sysplex Cluster
z/OS2.3
© 2017 IBM Corporation42IBM Z
How z14 with Pervasive Encryption is ideally positioned to assist your Organization for GDPR preparation
• IBM z14 offers security by design to help protect, secure and audit data simplifying & reducing the cost of encryption
• IBM® z Systems® Pervasive Encryption provides the comprehensive data protection your organization and your customers demand at reduced cost;
• It can be implemented using policy-based controls with low overhead• z/OS and Linux on z Systems provides transparent encryption of data at rest.
• IBM z14TM is designed to deliver a new level of encryption performance with enhanced CP Assist for Cryptographic Functions (CPACF), Crypto Express6S card and centralized secure keys management system.
© 2017 IBM Corporation43IBM Z
z14 helps you to prepare for GDPR requirements- Implementing an efficient security intelligence
IBM offers a portfolio of security solutions that could be deployed with z Systems Pervasive Encryption to cover a broader scope of security:• Privileged identity management:
• RACF®, IBM Multi-Factor Authentication for z/OS® and IBM Security Identity Governance and Intelligence allow you to govern, protect and audit users with elevated privileges
• Sensitive data protection:• IBM Security Guardium® and IBM Security Key Lifecycle Manager, along with z Systems Pervasive
Encryption, help defend and protect critical assets with encryption and intelligent data monitoring
• Integrated security intelligence:• IBM Security QRadar® and IBM Security zSecure™ Suite correlate huge amounts of security data to
uncover patterns of unusual activity. Then, they use real-time alerts to focus on the most critical security threats.
© 2017 IBM Corporation44IBM Z
Crypto functions in the dedicated co-processor
z13zEC12 z14
§ SHA-1/2~3.7X better throughput (on longer data)
§ AES-128/256~1.7X better throughput (on longer data)
§ Pseudo-random
number generator
§ AES-GCM§ SHA-3§ True random number
generator
§ Reduced overhead on short data (hashing and encryption)
§ ~6X throughput for GCM
§ Dedicated Co-Processor per Core
§ ~2x throughput
© 2017 IBM Corporation45IBM Z
Designed for DataI/O options that protect, access, share
Pervasive Encryption Getting to Data Accessing the Web Clustering to Protect
New CF Encryption
New Crypto Express6S
Enhanced Speed of CPACF
Payment Card Industry (PCI) HSM
New TKE 9.0
New zHyperLink ExpressNew IBM Virtual Flash
MemoryNew FICON Express16S+
zHPF – Extended Distance II
zEDC Express
New 10GbE RoCEExpress2
New OSA-Express6SHiperSocket
SMC-D
New Coupling Express LRICA SR
InfiniBand Coupling Links –LR and SR
Plus: improved CF scalability, constraint relief
and diagnostic enhancements
© 2017 IBM Corporation46IBM Z
Speed and Scale Getting to the Data
FICON Express16S+§ Up to 3x SIO/sec for small data transfer I/O
operations and 25% SIO/sec increase with mix of large sequential read and write data transfer options
§ Batch Elapsed time improves 17% running I/O intensive batch workloads versus same workload using FICON Express16S on a z13
§ Provides increased scalability by increasing number of devices per channel without degrading performance
zHyperLink Express
§ A new direct connect short distance link designed to deliver low latency connectivity between z14 and FICON® storage systems
§ zHyperLink improves application response time, cutting I/O sensitive workload response time by up to 50% without requiring application changes4
© 2017 IBM Corporation47IBM Z
Speed matters: Performance innovation for IBM ZUnleash your mainframe environment with DS8880 zHyperLink Express ®
zHyperLink will initially speed DB2 for z/OS transaction processing and later improve DB2 active Log throughput and VSAM applications.Feature Code: 0431
§ Min/Max, 0-16. Increment = 1 (2 ports)§ Maximum of 16 features (32 ports)§ Function ID Type = HYL§ Up to 127 Virtual Functions (VFs) per PCHID§ Point to point connection using PCIe Gen3§ Maximum distance: 150 meters
Reach 7x faster read access and 10x faster writes of data with zHyperLink Express technology Designed to accelerate DB2 for z/OS Log write by up to 5x.
§ Significantly improve DB2 transaction rate.Reads fast enough to serve data to DB2 without an undispatch during IOP
§ Improved Application and Middleware scaling
DB2V11orV12
z14
FICON
DS8880
FC 0431
z/OS2.1- z/OS2.3
DS8880R8.3
© 2017 IBM Corporation48IBM Z
zEnterprise Data Compression (zEDC) Usage
Value buy-in from IBM products across the product stack
3Q13
1Q14
3Q14
3Q15
3Q16
3Q17
zEDC Initial Support in z/OS V2R1z/OS SMF Logstream
Java Compression ClassesIBM Encryption Facility
QSAM/BSAM SupportSterling Connect:DirectV5.2
HSM/DSS SupportIBM HTTP Server
WebSphere MQ V8
z/OS 2.2 OpenSSHContent Manager OnDemand
Linux Distributions DB2
z/OS zFSFile system (z/OS 2.3)
zEDC should be installed on all
systems accessing
compressed data *
FC 0420
© 2017 IBM Corporation49IBM Z
Cornerstone for a Trust Economy: Open and Connected• In laboratory measurements using FICON Express16S+ (FEx16S+) within an IBM z14, I/O
intensive batch workloads will realize a 17% improvement in batch elapsed time due to FEx16S+ as compared to z13 FEx16S.
• I/O intensive batch workloads will realize an 35% improvement in batch elapsed time due to FEx16S+ as compared to z13 FEx8S.
Disclaimer:This performance data was measured in a controlled environment. The actual throughput or performance that any user will experience will vary depending upon considerations such as the amount of multiprogramming in the user's job stream, the I/O configuration, the storage configuration, and the workload processed.
© 2017 IBM Corporation50IBM Z
• zHyperLink Expressimprovesapplicationresponsetime,cuttingI/Osensitiveworkloadresponsetimebyupto50% withoutrequiringapplicationchanges.Disclaimer:This response timeestimate isbasedonIBMinternal measurementsandprojections thatassume75%ormoreoftheworkload response time isassociatedwith readDASDI/Oand thestoragesystemrandomreadcachehitratio isabove80%.Theactualperformancethatanyuserwill experiencemayvary.
• zHyperlink Expressisdesignedforupto10X lowerreadlatencythanHighPerformanceFICON.Disclaimer: Projectionsof readI/Olatencyare basedonI/Oservice timesandCPUqueueingdelays fromIBMinternalmeasurements.The actual performancethatanyuserwillexperience may vary.
• Inlaboratorymeasurements usingaIBMz14zHyperLink Express attachedtoaDS8886,Multi-Stream4KRead linklatencyisreducedbyupto5x as comparedtoz14FEx16S+attachedtoaDS8886withasingle16GbHostAdapterDisclaimer: Thisperformancedatawasmeasured inacontrolledenvironmentrunninganI/Odriverprogramunderz/OS.The actual linklatency thatanyuserwillexperience mayvary. Link latency onlyaccountsforaportionof I/Olatencyasexperienced byanapplication.Itref lects partof thebenef itthatzHyperLink providesforz/OS,middleware, andclientapplications.
Cornerstone for a Trust Economy: Open and Connected
NoI/OInterruptsNoDispatches
18-20usec
~100+usec
© 2017 IBM Corporation51IBM Z
Improved Speed for Development and Applications on z14
Compilers§ COBOL v6.2 fully support the Packed Decimal
Facility to reduce CPU usage for decimal intensive applications by up to 38%, and on average 19%
§ Automatic Binary Optimizer v1.3 reduces CPU usage of applications built with COBOL v4 (and below) without source recompilation by up to 47%
§ z/OS 2.3 XL C/C++ reduces CPU usage of compute intensive applications on average 13%
Java SDK 8 SR5§ Faster user response times for Java§ 4.2x improvement to AES-GCM crypto to enable
best-of-breed security for the API-economy using Java
§ Pause-less garbage collection baked into the processor, reducing pause times by up-to 3x for predictable high-perform transaction processing at-scale
§ 50+ new instructions on the z14 co-designed and exploited by Java
© 2017 IBM Corporation52IBM Z
Improvedspeedfordevelopmentandapplicationsonz14– Compilers
Cornerstone for a Trust Economy: Open and Connected
Disclaimer: The performance improvements are based on internal IBM lab measurements. Performance results for specific applications will vary depending on the source code, the compiler options specified, and other factors.
ComparisonofCPUReductionwithexploitationofthenewVector PackedDecimalFacilityABO1.3
vsABO1.2
ABO1.3(COBOL4.2)vs
COBOL4.2
PL/I5.2vs
PL/I5.1
V2R3XLC/C++vs
V2R2XLC/C++
Average Upto Average Upto Average Upto Average
ComputeIntensive 18% 37% 47% 80% 10% 40% 8%
ComparisonofCPUreductionforCOBOLV6.2with exploitationofthenewVectorPackedDecimalFacilityvsV6.1 vsV5.2 vsV4.2
Average Upto Average Upto Average UptoFloatingpointcomputeintensive 19% 38% 30% 67% 68% 94%Computeintensive 10% - 16% - 47% -
• z/OS V2R3 XL C/C++ compiler demonstrates on average 13% reduction in CPU time for floating point intensive applications on z14 over the same applications built with z/OS V2R2 XL C/C++ compiler on z14
Onz13,128-bitvectorregisters wereadded insupport ofSIMD.VPDFwasadded toz14toexploitsame vectorregistersmakingdecimal opsmoreefficient
© 2017 IBM Corporation53IBM Z
IBM z14 – Optimized for JavaPause-Less Garbage Collection
• Guarded Storage FacilityCryptographic Function (CPACF)
• Improved performance of crypto co-processors• GCM, SHA-3 hardware acceleration• True Random Number Generator
Single Instruction Multiple Data (SIMD)• Improved performance• 32-bit floating point enhancements• Packed Decimals support
New Instructions• Hot cache line hints• Arithmetic half-word operations
New 5.2 GHz 10-core Processor Chip672 MB L4 cache: Optimized for data servingImproved SMT-2 performance (zIIP + IFLs)
© 2017 IBM Corporation54IBM Z
IBM SDK, Java Tech. Edition, Version 8.0.5 (IBM Java 8 SR5)
IBM z14 exploitation• 50 new instructions exploited!
Pause-less Garbage Collection• Up to 10x reduction in GC pause times
Improved crypto performance for IBMJCE• AES-GCM block ciphering on z14• Higher quality True Random Number Generator to seed SecureRandom• Performance improvements in ECC, AES, SHA-1, SHA-2
New z14 instruction exploitation• Improved PackedDecimal API performance in Data Access Accelerator• Auto-SIMD acceleration for 32-bit binary floating point
Improved application ramp-up• Up-to 50% less CPU to ramp-up to steady-state
Upto24% throughputimprovementJavaonz14
Upto5.1x improvementwithSSLenabledapplicationswithAES-GCM
© 2017 IBM Corporation55IBM Z
z14: Pause-less Garbage CollectionJava Store Inventory and Point of Sale Application
Java GC-tuning made easier High scavenge pause times made this application a candidate for Pause-less GC
Up to 3x better throughput for response-time constrained Service Level Agreements (SLAs)
Up to 10x better average GC pause-times
(Controlled measurement environment, results may vary)IBMMonitoringandDiagnosticTools- GarbageCollectionandMemoryVisualizer
EnablePause-lessGCwith:• IBMJava8SR5ornewer• IBMz14’sGuardedStorageFacility• z/OS2.3orz/OS2.2withAPAROA51643
JVMoption: -Xgc:concurrentScavenge
© 2017 IBM Corporation56IBM Z
Liberty DayTrader 3 – z/OS – AES-GCM z13 vs z14
(Controlled measurement environment, results may vary)
IBMz14+Java8SR5AES-GCMcryptographyupto4.2xbetterthroughputoverz13+Java8SR3
IBMLiberty8.5.5.9withIBMJava8SR3,SR5IBMz13+IBMz14– zOS – 4zIIPSMT-2+1CPDayTrader3
© 2017 IBM Corporation57IBM Z
Liberty DayTrader 3 – Linux on Z – AES-GCM z13 vs z14
(Controlled measurement environment, results may vary)
IBMz14+Java8SR5AES-GCMcryptographyupto5.1xbetterthroughputoverz13+Java8SR3
IBMLiberty8.5.5.9withIBMJava8SR3,SR5IBMz13+IBMz14– SLES12SP1– 4IFLsSMT-2DayTrader3
© 2017 IBM Corporation58IBM Z
Liberty DayTrader 3 – Linux on Z – NoSSLIBM z14 vs Intel Broadwell
IBMLiberty8.5.5.9withDayTrader3withIBMJava8SR5IBMz14– SLES12SP1–4IFLsSMT-2IntelXeonE5-2690 v4 – RHEL 7.2 – 4 cores HT
IBMz14+Java8SR5upto1.6x betterthroughputoverIntelBroadwell
(Controlled measurement environment, results may vary)
© 2017 IBM Corporation59IBM Z
Liberty DayTrader 3 – Linux on Z – AES-GCMIBM z14 vs Intel Broadwell
(Controlled measurement environment, results may vary)IBMLiberty8.5.5.9withDayTrader3IBMz14withIBMJava8SR5– SLES12SP1– 4IFLsSMT-2IntelXeonE5-2690 v4 – Oracle Hotspot 8_131 – RHEL 7.2 – 4 cores HT
IBMz14+Java8SR5AES-GCMcryptographyupto2.6xbetterthroughputoverIntelBroadwell
© 2017 IBM Corporation60IBM Z
IBM Z: Designed for Trusted Digital Experiences
Pervasive Encryption is the
New Standard
100% encryption of all data Zero application changes
Zero impact to service levelsProtect client and corporate from
internal and external threats
Analytics & Machine Learning for Continuous Intelligence Across
the Enterprise
Anticipate customer needs and embed insight in every business transaction
Dramatically faster lifecycle management of behavioral models with more memory
and greater processing capacityDerive impactful insights by combining IBM Z data with other structured and unstructured external data sources
Open Enterprise Cloud to Extend, Connect
and InnovateCut new service build time by 90% using
secure APIs on IBM Z and advanced DevOps
Seamlessly connect any service from public and private cloud with transactions
and data on IBM ZAccelerate innovation with an ecosystem
of partners to develop and manage enterprise wide applications leveraging 1000’s open source software packages
Container Pricing for IBM Z provides new flexibility for modern digital workloads
© 2017 IBM Corporation61IBM Z
What’s new with Db2 for z/OS - Db2 12 HighlightsRedefining enterprise IT for digital business and the mobile app economy§ Scale and speed for the next era of mobile applications
• Super fast ingest rate -- over 11 Million Inserts per second for IOT, Mobile and Cloud*
• 280 trillion rows in a single Db2 table, with agile partition technology
• DRDA Fast Load for easier loading of data from distributed clients
§ In-Memory database• Advanced in-memory techniques in Db2 12 means faster
transactions with less CPU
§ Deliver analytical insights faster, expand to more applications
• 2-10x improvement for modern analytics workloads• Individual modern analytic queries may see up to 100x
improvement**• JSON data management improvements• SQL improvements such as SQL pagination, enhanced
MERGE, piece-wise DELETE
* Under dedicated environment using 12 way data sharing on z13, insert against one table (PBR/Member Cluster) from zLinux clients. All partitions were GBP dependent and logging enabled. Up to 11.7 million inserts per second without index, 5.3 million inserts per second with index defined. ** Modern analytics queries evaluated include SQL constructs such as UNION ALL, outer joins, complex expressions (CASE, CAST, scalar functions etc)
§ Easier to manage, higher availability• Db2aaS APIs and automation for self-service
provisioning of resources• Automatedadmin operations such as RUNSTATS• More schema and partition flexibility • TRANSFER OWNERSHIP for easier security admin• Dynamic SQL plan stability
§ The launch pad for Continuous Delivery
© 2017 IBM Corporation62IBM Z
Db2 for z/OS and IBM z14 Hardware SynergyDBMS Technology Leadership
§ Db2 for z/OS is differentiated in the marketplace through hw/sw integration
§ z14 includes several new hardware features which benefit Db2 workloads
§ Integration points for Db2:• Crypto hw acceleration for faster transparent data encryption• zHyperLink for ultra-fast Db2 log write I/O and database read
I/O• New hardware for improved data compression for Db2 tables• More large memory – up to 32TB single server• New hw for order-preserving compression for Db2 indexes
© 2017 IBM Corporation63IBM Z
ü acceleratemainframemodernizationinitiativesinvolvingBigDataü gainreal-timebusinessinsightsacrossz/OSandenterprisedataü eliminatecodingofcomplexz/OSappsviabuilt-inAPIsandinterfaces
§ ensuresdataissecure andin-place withreal-time datavirtualization
§ supportsHybridarchitectures (on-premises,Cloud,HadoopandMF)
§ broadAPI supportviaSQL,NoSQL,SOAP,andREST viaz/OSConnectEE
§ z/OSresidentoptimizationforimprovedperformanceandTCO
§ abstractionlayerforimprovedproductivity andbusinessagility
IBM Data Virtualization Manager for z/OSThe industry’s only Z-resident data virtualization technology!Virtualize z/OS data with other enterprise data sources in real-time without data movement to provide comprehensive information that is readily consumable by analytics, cloud and cognitive applications
Take action now!
Newest addition to IBM’s data virtualization portfolio
IBM Data Virtualization Manager
Common SQL Engine
Get startedYouTube channel – IBM Data Virtualization Manager for z/OS
AnnouncedOct32017,GenerallyAvailableNov3,2017
© 2017 IBM Corporation64IBM Z
Modernization
Faster, easier delivery of modern systems of
engagement (new web portals, mobile
apps, cloud initiatives)
Optimization
Reduce the cost/complexity of
accessing mainframe data
(existing ETL processes)
Real-time Analytics
Need for immediate insight into your customer or
business (customer needs/buying
preferences, reduce risk/fraud)
Data Virtualization Use Cases
© 2017 IBM Corporation65IBM Z
Data Virtualization Manager for z/OS
Data Virtualization Technology Accelerates Real Time Analytics
Predictive AnalyticsDiscovering patterns/meaning in data
Query AccelerationHigh-speed processing for complex Db2 queries
BI Solution with Access, Virtualization and Visualizationand Data Preparation
The four cornerstones of RTA againstdata-in-placehave common metadata maps to share and reuse
Universal Data AccessData Virtualization for all enterprise data -
on and off mainframe
DB2 Analytics Accelerator
QMF for z/OS
Machine Learningfor z/OS
Open Data Analytics for z/OS
© 2017 IBM Corporation66IBM Z
What’s new with IBM Machine Learning for z/OS
© 2017 IBM Corporation67IBM Z
Machine Learning for z/OScomplete E2E solution for quicker model development, deployment and management = Faster ROI
Convertinsightintoopportunityandopportunityintorevenue
DataScientist
ApplicationDeveloper
ML&ProductionEngineers
Hybridcloudapproach tomodellifecyclemanagement&collaboration
§ Platformagnosticmodeldevelopment
§ Leverageenterprisegradeopensourcesoftware
§ Real-time insightembeddedwithtransactions
§ Insightincorporatedfromanyplatform
§ Industryleadingencryption,security,reliability&availability
© 2017 IBM Corporation68IBM Z
IBM z Analytics Roadmap
IBMz/OSPlatformforApache Spark
IBMMachineLearningfor
z/OS
OptimizedDataLayer
AdvancedAnalyticsSolutions
DataAnalyticsProcessingengine,
languages/run-times,andlibrariestoenableanalyticssolutions
InfrastructureandAccelerators
z13Db2
AnalyticsAccelerator
1H2017 2H2017
IBMOpenDataAnalytics forz/OS
IBMMachineLearningforz/OS
OptimizedDataLayer
z14 Db2 AnalyticsAccelerator
vIDAA*
*VirtualAccelerator3QSOD
• ExploitationofPython• Full-lifecyclemanagementofPMMLmodels
• Improvedmodelgovernance• DSXEnhancements&Integration
• IBMz14– security,morememory,newinstructions,zHyperLink,newSWpricing
• NextgenerationAcceleratorandVirtualAcceleratorappliance
Db2forz/OS
• AnacondaandPythonruntimesandlibraries
• Improveddataaccess
© 2017 IBM Corporation69IBM Z
Data Ingest Data Processing
• Auto Data Preparation+
• Visualization libraries
Model Training
• Auto modelling (CADS/HPO)• Jupyter Notebook• Visual model builder (2.0 +)• Python/scikit learn/Spark
2.1.1 (IzODA)++• Model Training on Linux++
Deploy
• Single click deployment
• Multi-model version support+
• Batch deployment++
Live System
• Spark/MLEAP online scoring*
• PMML model online scoring*
• Runtime performance monitoring
• HA Scoring Service++• Evaluation/Feedback for
PMML models++
Data Scientists & Researchers
Machine Learning & Production Engineers
Data Engineers
Machine Learning & Production Engineers
• Data connector+
• Feedback data ingestion• Continuous model performance
monitoring• On-demand retraining+
The Machine Learning Workflow
• July release+• June release*
• Admin dashboard• Collaboration in
project+• Role based user
access control+• Sept release++
© 2017 IBM Corporation70IBM Z
Machine Learning for z/OS Roadmap - 2017
April 2017 June 2017 July 2017
• Download&Gocommoninstaller
• Jupyter onzsupport• SupportforapplicationclusteronLinuxonz
• ConsistentUserInterface experienceacrossmodelcreationanddeployment/management views
• PMMLscoringengine(SAS/RmodelsconformingtoPMMLstandardscanbesupported)
• MLeap scoringengine• Feedback dataingestiondirectlytoDb2forz/OS
• AdministrationDashboardforresourcemanagement directlyfromWebUserInterface
• Ondemandretraining• Multi-versionsupport
• Modelgovernancephase 1 – userandmodelaccesscontrol
• Visual modelbuilder 2.0• Supportforadditionaltransformers andalgorithms
• Autodatapreparation
Sep 2017
• SupportforPython/scikit learnwithIzODA
• Modelcreationandtrainingonx86withdeploymentandscoringremainingonz/OS• TrainwithScala/Python/Ronx86
• Batchdeployment• Monitoringandfeedback dataingestionforPMMLmodel
• Zerodowntimeforscoringservice
4Q 2017
• ModelTemplates – ITOAuse casesample• OnlinescoringserviceinCICSintegratedLiberty
• Remote SparkclusterSupport• Sklearn modelfeedback evaluation• Sandboxfordeploymentandscoring• Automaticretraining/redeployment• Completeservices inapplicationclusterinstalledonLinuxonZ
• Canvas forSpark• ODM(OperationalDecisionManager)integration
• Modelgovernance – audittrace• Automaticpathinvisualmodelbuilder• Securityenhancement forIzODA• 3rdpartyauthenticationproductwithMLforz/OS
• InstallationsimplificationbyzOSMF workflow
© 2017 IBM Corporation71IBM Z
Challenge• Integrating disparate/monolithic applications without needing specialized skills
and months of effort.• Maintaining timeliness & consistency of data across channels.• Difficult to pinpoint where the bottlenecks and problems are for hybrid apps.
How can we solve this problem?
HYBRID CLOUD
Use IBM Application Discovery to understand applications and IDz to refactor the code
Open business logic, data & transactions from any z/OS Sub-system with API’s via z/OS Connect Enterprise Edition in minutes
Automatically discover & publish APIs from z/OS Connect with API Connect.
Give application owners end-to-end view with IBM Omegamon for Application Performance Management
Understand&Plan Expose APIs ConsumeAPIs EndtoEnd
Monitoring
API and Service Enablement
LEVEL
© 2017 IBM Corporation72IBM Z
API Economy – Connected Mainframe: IBM z/OS Connect Enterprise Edition
Truly RESTful APIs to and from your mainframefor building microservices and succeeding in the API economy
APIs to and from the mainframe Comprehensive subsystem support Point-and-click API creation
Try for yourself: ibm.biz/ibmztrial
z/OS Connect EE allows you to:• Expose z data & services as RESTful APIs• Call external APIs from your mainframe applications (via API requester)IBM API Connect (API management gateway) to:• Publish APIs and Manage APIs access with keys• Monitor API usage for Charge back to developers • Perform Traffic management (can throttle requests & set rate limits in order to manage throughput)
Learn more: ibm.biz/zosconnectdc
© 2017 IBM Corporation73IBM Z
Blockchain Garage @ Boeblingen IBM LabBoeblingen labBlockchainGarage engagementmodel- Co-creation w/clients- Jointly designing thesolution- Then implementing apilot
>100clientworkshopsbyQ3’17- Leveraging commonpatters
experienced
IBMClientCenters(Boeblingen&Zurich) focusing onHighSecurityBlockchain Network(HSBN,as premiumoffering forour customers)developed afirstsetofassets extendingHyperledger Fabric withIBM-owned capabilities….
4IBMDataCenters w/IBMBlockchain Platformready(Frankfurt&London)
© 2017 IBM Corporation74IBM Z
Blockchain project @ Borsa Italiana (Italian Stock Exchange)
Borsa Italiana company websiteIBM company websitePress Release - LSEG links with IBM to build key blockchain solution for SME's Borsa Italiana, part of London Stock Exchange Group, has teamed up with IBM to build a blockchain solution digitising the issuance of securities for small and medium enterprises (SMEs) in Europe. Designed to simplify the tracking and management of shareholding information, the new system is focused on creating a distributed shared registry containing a record of all shareholder transactions, helping to open up new opportunities for trading and investing.Instead of having to deal with the paper trading certificates commonly issued to private companies today, unlisted European SMEs can look forward to enjoying a more digitised, streamlined and transparent process – giving issuers, regulators, investors and others increased insight into company information.Plus, this blockchain solution is aimed at giving the SMEs better access to credit and linking them into a broader and more mature ecosystem, so that they can set up new trading networks and obtain funding by sharing financial data in a security-rich and transparent public arena.Taking the leadThe system, built on the Hyperledger Fabric version 1.0 blockchain framework, is designed to help ensure that highly sensitive securities data can be shared amongstpermitted network participants while remaining secure and gated. It was developed in collaboration with IBM and is now undergoing an initial test phase with a small group of partnersand clients.Commenting on the project, Raffaele Jerusalmi, CEO, Borsa Italiana, said:"Through our work with IBM on this blockchain solution, Borsa Italiana is taking the lead in transforming the way European SMEs can manage their shareholderdata and at the same time expand credit access – all on a trusted digital platform."Chris Corrado, Group COO and CIO, LSEG, added:"LSEG is testing the use of blockchain technology in a financial business network where data segregation and confidentiality is vital. By working with IBM, a pioneerin enterprise-class blockchain solutions, we are committed to building, testing, and scaling our capabilities in emerging technologies over time."
© 2017 IBM Corporation75IBM Z
& finally…..Container Pricing for IBM Z
© 2017 IBM Corporation76IBM Z
z14 Announcement – Container Pricing for IBM Z
Container Pricing delivers line-of-sight pricing to specific solutions
Container Pricing for IBM Z will provide:– Greatly simplified software pricing for qualified solutions
– More flexible deployment optionsto support best technical fit, not driven by pricing
– Extremely competitive economics that are directly relevant to each solution
– Ability to combine different pricing metrics in the same logical partition
Container Pricing will initially support three key solutions:– Application Development and Test Solution – treble your DevTest capacity
– New Application Solution – better than cloud pricing for new z/OS applications
– Payments Pricing Solution – first of a kind pricing for the banking industry
© 2017 IBM Corporation77IBM Z
Container Pricing for IBM Z
ContainerPricingwillprovidesimplifiedsoftwarepricing,combiningflexibledeploymentoptionswithcompetitiveeconomicsthataredirectlyrelevanttothosesolutions.
ContainerPricingwillsimplifypricingandbillingontheIBMZplatform,bysupersedinganumberofexistingpriceofferingsandbyfullyautomating thebillingprocess.
Container Pricing will support qualified solutions on IBM z13 and z14 servers.
© 2017 IBM Corporation78IBM Z
Scope of Container Pricing for IBM Z
Container Pricing can scale from collocated solutions within existing LPARs, through to separate LPARs, up to multiple-LPAR solutions.
No direct impact to the cost of unrelated workloadsDeployment decisions can be optimized for technical excellence
• Optimized for technical requirements and preferences – not for pricing
Solution level metering and controls embedded in the operating system• Automatic reporting and billing – no Excel required
© 2017 IBM Corporation79IBM Z
Container Pricing for IBM Z – Key Concepts
the Container
• The pricing container is the method of measuring the scope of a workload for pricing
• Containers provide the pricing and billing infrastructure, not the actual pricing metrics
• There are no additional technical virtualisation layers that enable the container
the Solution
• It is the solution that runs inside the container that is priced
• Prices are specific to solutions and price points differ between solutions
• There are 3 different solutions that have been announced
ThecontaineristheinfrastructureforthepricingandbillingThesolutions arethespecificofferingsthataresoldandpriced.
© 2017 IBM Corporation80IBM Z
z14 Announcement – 3 supported solutions
IBM initially announces three solutions that will be enabled with Container Pricing:
The Application Development and Test Solution will provide highly competitive stand-alone pricing for z/OS based development and test workloads. Modern DevOps tooling can be optionally added at uniquely discounted prices.
The New Application Solution will provide a highly competitive stand-alone priced offering for new z/OS applications, such as CICS TS or WebSphere applications, that are not currently running on any Z platform server. This is the strategic replacement for the current zCAP and IWP priced offerings.
The Payments Solution will provide a ‘per payment’ pricing option for IBM Financial Transaction Manager for z/OS deployments. This new offering directly ties operational cost to business value by basing the price on the number of payments processed, rather than capacity used to process them.
© 2017 IBM Corporation81IBM Z
Application Development and Test Solution (DevTest)
Treble your DevTest capacity at no additional MLC cost
Three easy steps:
1. Agree your existing base DevTest workload size
2. Define your desired DevTest capacity (up to treble your existing base)
3. Pay no more for MLC for up to treble the agreed base capacity
You need enough OTC entitlement for the new base capacity
You can add new DevOps tooling at uniquely discounted prices
© 2017 IBM Corporation82IBM Z
New Application Solution
You can add new z/OS workloads, co-located with existing environments, and pay a highly-competitive stand-alone price
– Does not impact IBM pricing of other workloads
– You determine the size of the container
– Container size sets the billing for all capacity-priced IBM software
– For reference-based software, licensing is only to the container size
© 2017 IBM Corporation83IBM Z
Instant payments will dramatically shift
Payments Processing from batch to real time
Real Timeanalyticsanddata insight
Sub-SecondresponseforDCoperation
UnpredictablePeaks
Most bescalableVertically& Horizontally
Increaseddemands on ITsecurity
Continuous availability
0
5000
10000
15000
20000
25000
30000
35000
40000
45000
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
AddingPaymentsworkloadontoexistingmachineusageprofile
Existingmachineusageprofile Capacityrequirements forPayments
AcompetitivepriceperProductionPaymentprocessed
• Chargedmonthly,inarrears.• z/OSSWStack• zHW*(forHA&DR)
FTMzSWLicensing+zHW
payment*
UpFront Forlifeofterm
ClientCommitment IBMCommitment *zHW isoptional
ClientValue• Pay just for transactions processed. No peak/whitespace = zero ITwastage.• Cost predictability & consistency.• Costs linked directly to usage, and inherently to business adoption & growth rates.• Takes risk from client re uncertainty of volumes, business growth etc.• Production payments only charged. No cost for development/test.• Protect client from any perceived product inefficiencies (heavyMIPS burner).• Highly competitive price per payment.
PaymentsWorkloads=IBMZ
UtilityModel,On-Premise,onZ
• PaymentsWorkloads=IBMZtechnology• Capacitybasedpricingnotalways
competitive(forspiky,digitalworkloadprofile).
Payments on Z
© 2017 IBM Corporation84IBM Z
Technical enhancements to support Container Pricing
New Tenant Resource Group capability within z/OS Workload Manager (WLM)• Allows the metering and optional capping of workloads• Ability to map workloads directly to Container Pricing
Enhancements to SCRT to capture eligible Container Pricing workloads• Allows for billing of those solutions independently of traditional Sub-Capacity pricing
Additional enhancements to SMF, z/OSMF, RMF, SDSF• General support for Tenant Resource Group monitoring and tracking
You determine where to deploy using WLM: z/OS and SCRT do the rest
© 2017 IBM Corporation85IBM Z
Availability of Container Pricing
z/OS will be enhanced to support Container Pricing by year end 2017.
• z/OS enhancements will be enabled in z/OS v2.3 and z/OS v2.2.
• Plan for PTF availability: Mid-December 2017.
New FIXCAT for Container Pricing: IBM.Function.PricingInfrastructure • All required PTFs (enhancements and service) will specify this FIXCAT• This is a simple reference point to ensure all required service is applied
SCRT Support: • Container Pricing will require SCRT Java.
• Support will be available in December 2017 via:• PTF on z/OS V2R3.• SCRT web deliverable.
©2015 IBMCorporation86
86