WHAT TWO DBAS WISH THEY KNEW BEFORE VIRTUALIZING ON OPENSTACK · description RnD Openstack B ... *...

21
Company Confidential - For Internal Use Only Copyright © 2013, SAS Institute Inc. All rights reserved. WHAT TWO DBAS WISH THEY KNEW BEFORE VIRTUALIZING ON OPENSTACK MASON MORRIS AND DOUG LIMING, SAS INSTITUTE INC.

Transcript of WHAT TWO DBAS WISH THEY KNEW BEFORE VIRTUALIZING ON OPENSTACK · description RnD Openstack B ... *...

Company Confidential - For Internal Use Only Copyright © 2013, SAS Institute Inc. All r ights reserved.

WHAT TWO DBAS WISH THEY KNEW BEFORE VIRTUALIZING ON OPENSTACK

MASON MORRIS AND DOUG LIMING, SAS INSTITUTE INC.

Company Confidential - For Internal Use Only Copyright © 2013, SAS Institute Inc. All r ights reserved.

EXAMPLE HPA CO-LOCATED

Controller

Client

Company Confidential - For Internal Use Only Copyright © 2013, SAS Institute Inc. All r ights reserved.

EXAMPLE HPA CO-LOCATED

Controller

Client

Company Confidential - For Internal Use Only Copyright © 2013, SAS Institute Inc. All r ights reserved.

EXAMPLE ASYMMETRIC

Controller

Client

Controller

Company Confidential - For Internal Use Only Copyright © 2013, SAS Institute Inc. All r ights reserved.

EXAMPLE NON CO-LOCATED

Controller

Client

Controller

Company Confidential - For Internal Use Only Copyright © 2013, SAS Institute Inc. All r ights reserved.

TERADATA

CLIENT

ORACLE

HADOOP

Company Confidential - For Internal Use Only Copyright © 2013, SAS Institute Inc. All r ights reserved.

HADOOP DISTROS HOW TO KEEP UP WITH ALL THE VERSIONS?

•  1.3.1 •  1.3.2 •  2.0 beta

•  4.0.1 •  4.1.0 •  4.2 •  4.2.1 •  4.3

Company Confidential - For Internal Use Only Copyright © 2013, SAS Institute Inc. All r ights reserved.

CHRISTMAS IN JULY

•  16 Dell 510s •  2 Dell 620s (controller) •  128GB RAM/ blade •  16 Core Xeon Processors •  2 TB disk space •  10 Gbps Ethernet (Chelsio)

Company Confidential - For Internal Use Only Copyright © 2013, SAS Institute Inc. All r ights reserved.

ROUTERS & SWITCHES CORNER YOUR NETWORK GUY

On B01axxxD0121vlan 3505name VLAN-10.124.5.0/24_RnD_Openstk_Avlan 3506name VLAN-10.124.6.0/24_RnD_Openstk_B

set interfaces xe-1/1/0 description "Uplink to B01axxxD0121nc0 3/23"set interfaces xe-1/1/0 enableset interfaces xe-1/1/0 mtu 9216set interfaces xe-1/1/0 unit 0 family ethernet-switching port-mode trunkset interfaces xe-1/1/0 unit 0 family ethernet-switching vlan members vlan3505set interfaces xe-1/1/0 unit 0 family ethernet-switching vlan members vlan3506set interfaces xe-1/1/0 unit 0 family ethernet-switching vlan members vlan37

interface Vlan3506ip address 10.124.6.1/24ip router eigrp 1ip pim sparse-modeip pim neighbor-policy PIM_neighbor_VLAN3506description RnD Openstack B - Douglas Liming - djc 7/11/2013no shutdown

interface Ethernet3/23description B01xxxxDBI14 Openstack Cluster for Douglas Liming - djc 7/11switchportswitchport mode trunkswitchport trunk allowed vlan 37,3505-3506no shutdown

Company Confidential - For Internal Use Only Copyright © 2013, SAS Institute Inc. All r ights reserved.

MORE NETWORKS PUBLIC OR PRIVATE OR WHAT?

•  2 NIC •  Private network (does not have to be addressable) •  Public network (API/ management network, addressable)

•  Make interface decisions early on. •  VLAN considerations

•  How many VMs? How many users?

Company Confidential - For Internal Use Only Copyright © 2013, SAS Institute Inc. All r ights reserved.

IN THE END NETWORK AND LAYOUT PLANNING

Company Confidential - For Internal Use Only Copyright © 2013, SAS Institute Inc. All r ights reserved.

2 DBA CENTOS INSTALL

•  Why CentOS? •  The docs say you can do a minimal install… don’t. •  Versioning is worth a second look (dnsmasq, Python) •  Storage decisions: cinder-volume (block storage), glance (object storage)

•  Ephemeral vs permanent •  Understand your storage scenarios early on

Company Confidential - For Internal Use Only Copyright © 2013, SAS Institute Inc. All r ights reserved.

OPENSTACK DECODER RING UNDERSTANDING THE VARIOUS PROJECTS

Company Confidential - For Internal Use Only Copyright © 2013, SAS Institute Inc. All r ights reserved.

INSTALLING & CONFIGURE POST-INFRASTRUCTURE

•  Read the manual, but don’t take a manual approach •  Know the OpenStack release schedule •  CLI vs Horizon Configuration •  Consider automatic deployment solutions

Company Confidential - For Internal Use Only Copyright © 2013, SAS Institute Inc. All r ights reserved.

PACKSTACK NIRVANA YOU’LL BARELY EVEN REMEMBER INSTALLING

•  Automating your deployment •  Answers file •  Puppet

•  Options for all-in-one or multi-node •  Easily add new nodes

Company Confidential - For Internal Use Only Copyright © 2013, SAS Institute Inc. All r ights reserved.

PACKSTACK (CONTINUED)

[root@hal ~]# packstack --answer-file=/tmp/openstackanswer.txt Welcome to Installer setup utility Packstack changed given value to required value /root/.ssh/id_rsa.pub Installing: Clean Up... [ DONE ] Setting up ssh keys... [ DONE ] Adding pre install manifest entries... [ DONE ] Installing time synchronization via NTP... [ DONE ] Adding MySQL manifest entries... [ DONE ] Adding QPID manifest entries... [ DONE ] Adding Keystone manifest entries... [ DONE ] Adding Glance Keystone manifest entries... [ DONE ]

Company Confidential - For Internal Use Only Copyright © 2013, SAS Institute Inc. All r ights reserved.

PACKSTACK ENDING LIKE:

10.124.6.12_postscript.pp : [ DONE ] 10.124.6.15_postscript.pp : [ DONE ] 10.124.6.16_postscript.pp : [ DONE ] 10.124.6.13_postscript.pp : [ DONE ] 10.124.6.10_postscript.pp : [ DONE ] [ DONE ] **** Installation completed successfully ****** Additional information: * To use the command line tools you need to source the file /root/keystonerc_admin created on 10.124.6.10 * To use the console, browse to http://10.124.6.10/dashboard * Kernel package with netns support has been installed on host 10.124.6.10. Because of the kernel update the host mentioned above requires reboot. * Kernel package with netns support has been installed on host 10.124.6.13. Because of the kernel update the host mentioned above requires reboot. * Kernel package with netns support has been installed on host 10.124.6.12. Because of the kernel update the host mentioned above requires reboot. * Kernel package with netns support has been installed on host 10.124.6.15. Because of the kernel update the host mentioned above requires reboot. * Kernel package with netns support has been installed on host 10.124.6.16. Because of the kernel update the host mentioned above requires reboot. * The installation log file is available at: /var/tmp/packstack/20130903-114024-RDZoA5/openstack-setup.log [root@hal ~]#

Company Confidential - For Internal Use Only Copyright © 2013, SAS Institute Inc. All r ights reserved.

YET ANOTHER PROJECT? WILL SAVANNA BE OUR HEROINE?

•  Open source hadoop cluster management tool backed by: •  RedHat •  Mirantis •  Hortonworks •  Others….

•  Allows for one click cluster deployment. •  Neutron not support (yet)

Company Confidential - For Internal Use Only Copyright © 2013, SAS Institute Inc. All r ights reserved.

Company Confidential - For Internal Use Only Copyright © 2013, SAS Institute Inc. All r ights reserved.

Company Confidential - For Internal Use Only Copyright © 2013, SAS Institute Inc. All r ights reserved.