CloudX on OpenStack

26
Tom Thirer, Sr. Director, Product Management Erez Cohen, Sr. Director, Cloud Program CloudX on OpenStack OpenStack Israel, June 2014

Transcript of CloudX on OpenStack

  • 1.Tom Thirer, Sr. Director, Product Management Erez Cohen, Sr. Director, Cloud Program CloudX on OpenStack OpenStack Israel, June 2014

2. 2014 Mellanox Technologies 2- Mellanox Confidential - Exponential Data Growth Best Interconnect Required 0.8 Zettabyte 2009 35 Zettabyte 2020 44X Source: IDC 3. 2014 Mellanox Technologies 3- Mellanox Confidential - The Future Depends on Fastest Interconnects 10Gb/s 40/56Gb/s1Gb/s 4. 2014 Mellanox Technologies 4- Mellanox Confidential - CloudX OpenCloud Architecture Cloud Software, Plug-Ins, Automation Mellanox Interconnect, Off-the Shelf Components 5. 2014 Mellanox Technologies 5- Mellanox Confidential - Leading Supplier of End-to-End Interconnect Solutions Virtual Protocol Interconnect Storage Front / Back-End Server / Compute Switch / Gateway 56G InfiniBand 56G InfiniBand 10/40/56GbE 10/40/56GbE Virtual Protocol Interconnect Host/Fabric SoftwareICs Switches/GatewaysAdapter Cards Cables/Modules Comprehensive End-to-End InfiniBand and Ethernet Portfolio Metro / WAN 6. 2014 Mellanox Technologies 6- Mellanox Confidential - Mellanox Advantages in the Cloud Performance Automation Scalability & Multi-tenancy 56Gb/s OpenStack Storage (Cinder) over RDMA SR-IOV accelerated performance VXLAN & NVGRE HW offloads Seamless Integration with Nova, Cinder and Neutron core projects Automated Deployment Compatible with leading OpenStack Vendors Supports Ethernet and InfiniBand Efficient network convergence End to end hardware based traffic isolation and security features Ethernet 7. 2014 Mellanox Technologies 7- Mellanox Confidential - OpenStack CloudX Physical Architecture Overview Hardware Off-the-shelf components - Servers, storage, interconnect, software Mellanox 40/56Gb/s interconnect - InfiniBand and Ethernet Solid State Drives (SSD) Latest CPU technology OpenStack components Nova compute Network controller node Storage node Cinder, Ceph Mellanox OpenStack plug-ins Deployment and operations software The Building Blocks for the Most Efficient Cloud Internet Compute Node 144 Compute Node 2 Compute Node 1 CentOS Linux + OFED Puppet-agent Nova-compute MLNX-Neuron-plugin-agent Controller Node 3 Act Storage Node 3 Act API Network 1Gb Eth Data Network External Network 1Gb Eth Cloud Management Network Controller Node 2 Act Controller Node 1 Act CentOS Linux + OFED Puppet-agent Nova-API Nova-scheduler Keystone Neutron-server MySQL Rabbit Storage Node 2 Act Storage Node 1 Act CentOS Linux + OFED + Ceph Puppet-agent Cinder-volume-agent Ceph-agent SAS HA HA Network Node 2 Pas Network Node 1 Act CentOS Linux + OFED Puppet-agent Neutron-Linux-Bridge Neutron-DHCP- agent Neutron-L3-agent Neutron-VPN-agent Mellanox UFM SDN Appliance - HA CloudX Deployment & Orchestration Server CentOS Linux + OFED Puppet Server PXE server Storage Options 8. 2014 Mellanox Technologies 8- Mellanox Confidential - 6200 1200 800 0 2000 4000 6000 8000 I/O Size - 64 [KB]Bandwidth [MB/s] SCSI Write Example, Linux KVM iSER 16 VMs Write 10GbE Fiber Channel - 8Gb Accelerating Cloud Performance Storage Overlay Networks Virtualization 2.5X 20X 6X 40 20 10 20 30 40 50 Message Size - 256 [bytes] Latency[us] VM-to-VM Latency Performance TCP ParaVirtualization RDMA Direct Access Fibre Channel 8Gb iSER 40GbE VMs Write 15 37.5 0 10 20 30 40 VXLAN Bandwidth [Gb/s] Bandwidth W/O Offload With Offload 9. 2014 Mellanox Technologies 9- Mellanox Confidential - Build Clouds with CloudX Mellanox provides our customers with more features that they couldnt get with other clouds. - Robert Rizika, CEO, ProfitBricks Public Clouds Private Clouds Cloud-in-a-Box 10. 2014 Mellanox Technologies 10- Mellanox Confidential - Mellanox CloudX World-Wide Deployments Run Your Applications on CloudX www.mellanox.com/cloudx 11. 2014 Mellanox Technologies 11- Mellanox Confidential - Comprehensive OpenStack Integration for Switch and Adapter Integrated with Major OpenStack Distributions In-Box With Havana and Ice House Neturon-ML2 support for mixed environment Ethernet Hardware support for performance and security (VXLAN, PV, SRIOV) Accelerating storage access by up to 5x OpenStack Plugins Create Seamless Integration , Control, & Management 12. 2014 Mellanox Technologies 12- Mellanox Confidential - Virtual Protocol Interconnect (VPI) Technology 64 ports 10GbE 36 ports 40/56GbE 48 10GbE + 12 40/56GbE 36 ports IB up to 56Gb/s 8 VPI subnets Mezzanine Card VPI Adapter VPI Switch Ethernet: 10/40/56 Gb/s InfiniBand:10/20/40/56 Gb/s Unified Fabric Manager Networking Storage Clustering Management Applications Acceleration Engines LOM Adapter Card 3.0 From data center to campus and metro connectivity Switch OS Layer 13. 2014 Mellanox Technologies 13- Mellanox Confidential - I/O Offload Frees Up CPU for Application Processing ~88% CPU Efficiency UserSpaceSystemSpace ~53% CPU Efficiency ~47% CPU Overhead/Idle ~12% CPU Overhead/Idle Without RDMA With RDMA and Offload UserSpaceSystemSpace 14. 2014 Mellanox Technologies 14- Mellanox Confidential - What is iSER? iSER iSCSI Extensions for RDMA Defined by IETF IP Storage WG Maps the iSCSI protocol over RDMA fabrics Leverages iSCSI management infrastructure Ethernet (RoCE) / InfiniBand SCSI Application Layer iSCSI iSER 15. 2014 Mellanox Technologies 15- Mellanox Confidential - Mellanox Accelerate OpenStack Cinder Storage Mellanox extends Cinder Project by adding iSCSI over RDMA (iSER) support Hypervisor (KVM) OS VM OS VM OS VM Adapter Open-iSCSI w iSER Compute Servers Switching Fabric iSCSI/iSER Target (tgt) Adapter Local Disks RDMA Cache Storage Servers OpenStack (Cinder) Utilizing OpenStack Built-in components and management Tools to accelerate storage access 1.3 5.5 0 1 2 3 4 5 6 iSCSI over TCP iSER GB/s Cinder / Volume Storage Performance * * iSER patches are available on OpenStack branch: https://github.com/mellanox/openstack 16. 2014 Mellanox Technologies 16- Mellanox Confidential - Cinder Demo Video TCP/IP Performance 17. 2014 Mellanox Technologies 17- Mellanox Confidential - Cinder Demo Video - Creating iSER volume 18. 2014 Mellanox Technologies 18- Mellanox Confidential - Cinder Demo Video iSER Performance 19. 2014 Mellanox Technologies 19- Mellanox Confidential - Server VM1 VM2 VM3 VM4 Overlay Networks: Shooting Star or Brave New World? Overlay Network Virtualization: Isolation, Simplicity, Scalability Virtual Domain 3 Virtual Domain 2 Virtual Domain 1 Physical View Server VM5 VM6 VM7 VM8 Mellanox SDN Switches & Routers Virtual View NVGRE/VXLAN Overlay Networks 20. 2014 Mellanox Technologies 20- Mellanox Confidential - Typical Overlay Network Deployment OS VM OS VM OS VM UDP OS VM BR0 BR1 VXLAN Overlay IP VNI100 VNI300Open vSwitch (OVS) Underlay Network (Layer 2 or Layer 3) Hypervisor vTap vTap vTap vTap OS VM OS VM OS VM UDP OS VM BR0 BR1 BR2 VXLAN Overlay IP VNI100 VNI200 VNI300Open vSwitch (OVS) Hypervisor vTap vTap vTap vTap vTap VxLAN Overlay (tenant) networks UDP BR0 BR1 VXLAN IP VNI200 VNI300 Router / NAT Software Gateway vEth1vEth0 Internet Gateway (Network) Nodes OVS SDN Manager e.g. OpenStack Neutron, ODL, VMware NSX Generated by the VM Generated by the Hypervisor VXLAN Packet Format 21. 2014 Mellanox Technologies 21- Mellanox Confidential - Cloud 2.0 Technologies Interconnect Offload Engines Challenge: Implementing overlay networks in software dramatically increases overheads and costs Solution: Use interconnect offload engines to handle all networking operations up to the VM Benefit: Reduce application cost, cloud CAPEX and OPEX The Foundation of Cloud 2.0 The Worlds First NVGRE / VXLAN Offloaded NIC 22. 2014 Mellanox Technologies 22- Mellanox Confidential - Cloud Overlay Acceleration Results With ConnectX-3 Pro 40GE 23. 2014 Mellanox Technologies 23- Mellanox Confidential - VXLAN Demo 24. 2014 Mellanox Technologies 24- Mellanox Confidential - Thank You Reduces the Cost of Using Compute and Storage Infrastructure Enables Applications to Use Much More Data at Real Time to Get Conclusions and Make Business Decisions Faster Test Your Applications on CloudX Platform Join the Growing CloudX Eco-System [email protected], www.mellanox.com/cloudx 25. 2014 Mellanox Technologies 25- Mellanox Confidential - Thank YouThank You 26. 2014 Mellanox Technologies 26- Mellanox Confidential - Mellanox Advantages Support more VMs per server Offload hypervisor CPU Overlay networks Unlimited scalability Record braking throughput Record braking IOPS Higher storage density Centralized management (e.g. SDN) I/O consolidation (one wire) 56Gb/s per port with RDMA 2us for VM to VM connectivity Low CPU utilization Higher Performance Cost Effective Storage Simplified and Integrated Solutions Higher Infrastructure Efficiency Maximizing Cloud Return on Investment