Exploit PowerVM Features to Maximize...

of 33/33
Chris Churchey – Principal ATS Group, LLC [email protected] (610-574-0207) October 2013 Exploit PowerVM Features to Maximize Performance & Efficiencies © 2013 IBM Corporation
  • date post

    29-Jun-2020
  • Category

    Documents

  • view

    17
  • download

    4

Embed Size (px)

Transcript of Exploit PowerVM Features to Maximize...

  • Chris Churchey – Principal ATS Group, [email protected] (610-574-0207)October 2013

    Exploit PowerVM Features to Maximize Performance & Efficiencies

    © 2013 IBM Corporation

  • Exploit PowerVM Features to Maximize Performance & Efficiencies

    Exploit PowerVM Features to Maximize

    M lti l Sh d

    Exploit PowerVM Features to Maximize Performance & Efficiencies

    Multiple Shared Processor Pools (MSPP)

    © 2013 IBM Corporation2

  • Exploit PowerVM Features to Maximize Performance & Efficiencies

    What is MSPP?

    Group of physical processors

    Shared among multiple logical partitions

    The sum of the assigned capacity for each LPAR cannot exceed the total capacity of the The sum of the assigned capacity for each LPAR cannot exceed the total capacity of the processor group

    Applies to Power6 and above

    © 2013 IBM Corporation3

  • Exploit PowerVM Features to Maximize Performance & Efficiencies

    Why use MSPPs?

    Reduce software license (e.g. # of cores) costs by placing LPAR(s) in their own pool

    – Customers have reported saving $100K to >$8M a year

    Share the software license across LPAR(s) by placing them in the same pool (e g Float Share the software license across LPAR(s) by placing them in the same pool (e.g. Float across Prod & Dev)

    Limit a group of LPAR(s) to a combined MAX CPU consumption to protect others

    – Example:  Power 770 with 32 cores• Dev LPAR(s) pool Max CPU=5P d LPAR( ) l M CPU 32 (All)• Prod LPAR(s) pool Max CPU=32 (All)

    © 2013 IBM Corporation4

  • Exploit PowerVM Features to Maximize Performance & Efficiencies

    MSPP Analysis

    1. Identify candidate LPAR(s)

    – Software licensed by # of cores currently Dedicated or Capped, or license ALL cores on the server

    2 C ll t h i l CPU f did t LPAR( )2. Collect physical CPU usage for candidate LPAR(s)

    3. View the candidate LPAR(s) over a period of time

    4. Determine usage mix and observed Peaks

    – The pool’s Maximum Processing Units = “peak observed + projected growth + buffer”

    NOTE: Galileo Performance Explorer makes this easy using Virtual Groups to view candidate LPAR(s)!

    © 2013 IBM Corporation5

  • Exploit PowerVM Features to Maximize Performance & Efficiencies

    MSPP Analysis

    © 2013 IBM Corporation6

    p795 with 23 LPARs, peaking 23 cores

  • Exploit PowerVM Features to Maximize Performance & Efficiencies

    MSPP Analysis

    © 2013 IBM Corporation7

    Selected 7 Oracle LPARs, peaking 12 Cores

  • Exploit PowerVM Features to Maximize Performance & Efficiencies

    MSPP Analysis

    © 2013 IBM Corporation8

    “What If” Shared Pool Analysis

  • Exploit PowerVM Features to Maximize Performance & Efficiencies

    MSPP Analysis

    © 2013 IBM Corporation9

    Performance View of Pool 0 and Pool 1

  • Exploit PowerVM Features to Maximize Performance & Efficiencies

    MSPP Analysis

    © 2013 IBM Corporation10

    Detailed Performance View of Pool 1 (Oracle Pool)

  • Exploit PowerVM Features to Maximize Performance & Efficiencies

    MSPP Resources

    IBM PowerVM Virtualization Introduction and Configuration

    http://www.redbooks.ibm.com/abstracts/sg247940.html

    Exploiting IBM PowerVM Virtualization Features with IBM Cognos 8 Business Intelligence

    http://www.redbooks.ibm.com/abstracts/sg247842.html?Open

    Try it! MSPP Pools can be dynamically created move LPAR(s) in & out and Try it! MSPP Pools can be dynamically created, move LPAR(s) in & out, and increase/decrease MAX

    ATS can help analyze and implement MSPP

    © 2013 IBM Corporation11

  • Exploit PowerVM Features to Maximize Performance & Efficiencies

    Exploit PowerVM Features to Maximize

    Sh d Eth t

    Exploit PowerVM Features to Maximize Performance & Efficiencies

    Shared Ethernet Adapters (SEA)p ( )

    © 2013 IBM Corporation12

  • Exploit PowerVM Features to Maximize Performance & Efficiencies

    What is a SEA?

    Group Virtual I/O Server component that bridges a physical Ethernet adapter and Ethernet d tadapters

    LPAR(s) on the virtual network can share access to the physical network

    LPAR(s) on the virtual network can communicate with stand-alone servers and logical partitions on other systems

    Eliminates the need for each client logical partition to a dedicated physical adapter

    © 2013 IBM Corporation13

  • Exploit PowerVM Features to Maximize Performance & Efficiencies

    Why use SEAs?

    Required for Live Partition Mobility (LPM)

    Eliminate dedicated adapters to LPARs

    Reduce network switches ports and cabling Reduce network switches, ports and cabling

    Reduce # of adapters, thus reduce slots/IO-drawers

    Share network bandwidth across LPARs

    Balance CPU load across VIO’s (1 often 100% Busy)

    Maximize network throughput using ALL adapters

    © 2013 IBM Corporation14

  • Exploit PowerVM Features to Maximize Performance & Efficiencies

    SEA Options SEA-NIB (Network Interface Backup) + vSwitches

    – (2) Virtual Ethernet adapters per LPAR– EtherChannel used on Client LPAR to designate Primary VIO

    S i t t b l E /Odd LPAR t i E /Odd VIO– Script to balance Even/Odd LPAR to primary Even/Odd VIO– Preferred for Max Network Throughput and Availability– Multiple VLANs NOT required

    SEA-HA (High Availability)– (1) Virtual Ethernet adapter per LPAR– All LPAR(s) network goes through 1 VIO w/failover to 2nd VIO– 2nd VIO Ethernet ports idle, unused performance

    SEA-HA Load Sharing (aka Load Balancing)R i lti l VLAN hi h b l d b t VIO’– Requires multiple VLANs which are balanced between VIO’s

    – It chooses which VLANs go to which VIO’s– Requires manual ‘chdev’ to restart if failover

    © 2013 IBM Corporation15

  • Exploit PowerVM Features to Maximize Performance & Efficiencies

    SEA Architecture – NIB w/vSwitches

    1Gb (80-100MB/s) + 1Gb (80-100MB/s)Load Balance=200MB/s

    © 2013 IBM Corporation16

  • Exploit PowerVM Features to Maximize Performance & Efficiencies

    SEA Architecture – HA

    1Gb (80-100MB/s) 1Gb (80-100MB/s)Backup-Wasted

    © 2013 IBM Corporation17

  • Exploit PowerVM Features to Maximize Performance & Efficiencies

    SEA Architecture – HA Load Sharing

    1Gb (80-100MB/s) + 1Gb (80-100MB/s)Load Sharing=200MB/s

    © 2013 IBM Corporation18

    g

  • Exploit PowerVM Features to Maximize Performance & Efficiencies

    SEA Analysis

    1. Collect physical CPU and SEA usage for VIO LPARs

    View VIO LPARs over a period of time– View VIO LPARs over a period of time

    2. Look for:

    – 1 VIO with high/max CPU and other minimal– 1 VIO SEA at max throughput (flat line) and other minimal

    3. If using SEA-NIB today, balance script on all LPARs

    4. If using SEA-HA today, use Load Sharing feature

    – NOTE: Galileo Performance Explorer can display this performance information quickly and easily!

    © 2013 IBM Corporation19

  • Exploit PowerVM Features to Maximize Performance & Efficiencies

    SEA Analysis - NIB

    Host SEA Network Packet Send & Receive Throughput

    Host Physical CPU Utilization Summary

    © 2013 IBM Corporation20

  • Exploit PowerVM Features to Maximize Performance & Efficiencies

    SEA Analysis - HA Host SEA Network Packet Send & Receive

    Throughput Host Physical CPU Utilization Summary

    © 2013 IBM Corporation21

  • Exploit PowerVM Features to Maximize Performance & Efficiencies

    Exploit PowerVM Features to Maximize

    NPIV SCSI

    Exploit PowerVM Features to Maximize Performance & Efficiencies

    NPIV vs. vSCSIPerformance

    © 2013 IBM Corporation22

  • Exploit PowerVM Features to Maximize Performance & Efficiencies

    What is NPIV and vSCSI?

    NPIV Allows a single HBA to register multiple

    vSCSI A SCSI disk, or a volume or file in a VIO g g p

    WWPNs Each virtual server presents a different

    WWPN to the SAN Each virtual server will see its own

    ,Server that is exported to a virtual IO client LUNs implement a sub-set of the SCSI

    protocol Each virtual server will see its own unique storage

    protocol

    © 2013 IBM Corporation23

  • Exploit PowerVM Features to Maximize Performance & Efficiencies

    Why NPIV over vSCSI?

    Higher throughput from client LPAR

    Higher IOps from client LPAR

    Better hdisk Service Time from client LPAR

    Less CPU usage by the VIO LPAR

    Load Balance IO across HBAs from client LPAR

    © 2013 IBM Corporation24

  • Exploit PowerVM Features to Maximize Performance & Efficiencies

    NPIV vs. vSCSI Architecture

    © 2013 IBM Corporation25

  • Exploit PowerVM Features to Maximize Performance & Efficiencies

    NPIV/vSCSI Test configuration

    AIX LPAR (gvicaix71-10) on a p700 blade and IVM

    – (2) 8Gb HBA to V7000• (4) 100GB vdisks (LUNs) created…same mdisk/array group

    (vSCSI) =(2) 100GB LUNs mapped to VIO mkvdev to AIX LPAR– (vSCSI) =(2) 100GB LUNs mapped to VIO, mkvdev to AIX LPAR

    • hdisk3 and hdisk4 on gvicaix71-10

    – (vfc) =(2) 100GB LUNs mapped to (2) wwpn’s on AIX LPAR

    • hdisk1 and hdisk2 on gvicaix71-10

    ndisk64 Seq./Random Read/Write 4K/256K tests

    © 2013 IBM Corporation26

  • Exploit PowerVM Features to Maximize Performance & Efficiencies

    NPIV/vSCSI Test configuration

    © 2013 IBM Corporation27

  • Exploit PowerVM Features to Maximize Performance & Efficiencies

    NPIV vs. vSCSI IOps

    NPIV: Over 500 more IOps!

    SCSNPIV vSCSI

    © 2013 IBM Corporation28

  • Exploit PowerVM Features to Maximize Performance & Efficiencies

    NPIV vs. vSCSI Read Service-Times

    NPIV: 0.75msfaster!

    NPIV vSCSI

    © 2013 IBM Corporation29

  • Exploit PowerVM Features to Maximize Performance & Efficiencies

    NPIV vs. vSCSI Write Service-Times

    NPIV: 0.50msfaster!

    NPIV vSCSI

    © 2013 IBM Corporation30

  • Exploit PowerVM Features to Maximize Performance & Efficiencies

    Questions and AnswersQuestions and Answers

    © 2013 IBM Corporation31

  • Exploit PowerVM Features to Maximize Performance & Efficiencies

    We can help analyze and implement. Contact us!

    Check-out Galileo Performance Explorer™

    – Visit our booth for a hands-on demoComplimentary* no strings attached 6 months use for Conference attendees– Complimentary* no-strings attached 6 months use for Conference attendees

    – Budget-friendly subscription pricing request

    www.GalileoSuite.com

    © 2013 IBM Corporation32

    * First time Galileo user

  • Exploit PowerVM Features to Maximize Performance & Efficiencies

    Referenced Material

    IBM PowerVM Virtualization Introduction and Configurationhttp://www.redbooks.ibm.com/abstracts/sg247940.htmlhttp://www.redbooks.ibm.com/abstracts/sg247842.html (Managing and Monitoring)

    SEA‐NIB vs. SEA‐HA vs. SEA‐HA‐Load Sharinghttps://www.ibm.com/developerworks/mydeveloperworks/blogs/aixpert/entry/shared_ethernet_adapter_sea_failover_with_load_balancing198?lang=enhttps://www ibm com/developerworks/mydeveloperworks/blogs/AIXDownUnder/entry/shared ethernet adapter load sharinhttps://www.ibm.com/developerworks/mydeveloperworks/blogs/AIXDownUnder/entry/shared_ethernet_adapter_load_sharing_and_virtual_switches133?lang=en

    SEA‐NIB‐vSwitcheshttp://www‐03.ibm.com/support/techdocs/atsmastr.nsf/fe582a1e48331b5585256de50062ae1c/81c729a840b213b98625779e000722f4/$FIppLE/PowerVM‐VirtualSwitches‐091010.pdfhttp://ibmsystemsmag.blogs.com/aixchange/2011/09/higher‐availability‐for‐vio‐clients‐an‐alternative.html

    NPIVhttp://www.ibm.com/developerworks/aix/library/au‐NPIV/index.html

    Galileo Performance Explorerhttp://www.galileosuite.com

    © 2013 IBM Corporation33

    * First time Galileo user