WHAT TWO DBAS WISH THEY KNEW BEFORE VIRTUALIZING ON OPENSTACK · description RnD Openstack B ... *...

Post on 22-Jun-2018

216 views 0 download

Transcript of WHAT TWO DBAS WISH THEY KNEW BEFORE VIRTUALIZING ON OPENSTACK · description RnD Openstack B ... *...

Company Confidential - For Internal Use Only Copyright © 2013, SAS Institute Inc. All r ights reserved.

WHAT TWO DBAS WISH THEY KNEW BEFORE VIRTUALIZING ON OPENSTACK

MASON MORRIS AND DOUG LIMING, SAS INSTITUTE INC.

Company Confidential - For Internal Use Only Copyright © 2013, SAS Institute Inc. All r ights reserved.

EXAMPLE HPA CO-LOCATED

Controller

Client

Company Confidential - For Internal Use Only Copyright © 2013, SAS Institute Inc. All r ights reserved.

EXAMPLE HPA CO-LOCATED

Controller

Client

Company Confidential - For Internal Use Only Copyright © 2013, SAS Institute Inc. All r ights reserved.

EXAMPLE ASYMMETRIC

Controller

Client

Controller

Company Confidential - For Internal Use Only Copyright © 2013, SAS Institute Inc. All r ights reserved.

EXAMPLE NON CO-LOCATED

Controller

Client

Controller

Company Confidential - For Internal Use Only Copyright © 2013, SAS Institute Inc. All r ights reserved.

TERADATA

CLIENT

ORACLE

HADOOP

Company Confidential - For Internal Use Only Copyright © 2013, SAS Institute Inc. All r ights reserved.

HADOOP DISTROS HOW TO KEEP UP WITH ALL THE VERSIONS?

•  1.3.1 •  1.3.2 •  2.0 beta

•  4.0.1 •  4.1.0 •  4.2 •  4.2.1 •  4.3

Company Confidential - For Internal Use Only Copyright © 2013, SAS Institute Inc. All r ights reserved.

CHRISTMAS IN JULY

•  16 Dell 510s •  2 Dell 620s (controller) •  128GB RAM/ blade •  16 Core Xeon Processors •  2 TB disk space •  10 Gbps Ethernet (Chelsio)

Company Confidential - For Internal Use Only Copyright © 2013, SAS Institute Inc. All r ights reserved.

ROUTERS & SWITCHES CORNER YOUR NETWORK GUY

On B01axxxD0121vlan 3505name VLAN-10.124.5.0/24_RnD_Openstk_Avlan 3506name VLAN-10.124.6.0/24_RnD_Openstk_B

set interfaces xe-1/1/0 description "Uplink to B01axxxD0121nc0 3/23"set interfaces xe-1/1/0 enableset interfaces xe-1/1/0 mtu 9216set interfaces xe-1/1/0 unit 0 family ethernet-switching port-mode trunkset interfaces xe-1/1/0 unit 0 family ethernet-switching vlan members vlan3505set interfaces xe-1/1/0 unit 0 family ethernet-switching vlan members vlan3506set interfaces xe-1/1/0 unit 0 family ethernet-switching vlan members vlan37

interface Vlan3506ip address 10.124.6.1/24ip router eigrp 1ip pim sparse-modeip pim neighbor-policy PIM_neighbor_VLAN3506description RnD Openstack B - Douglas Liming - djc 7/11/2013no shutdown

interface Ethernet3/23description B01xxxxDBI14 Openstack Cluster for Douglas Liming - djc 7/11switchportswitchport mode trunkswitchport trunk allowed vlan 37,3505-3506no shutdown

Company Confidential - For Internal Use Only Copyright © 2013, SAS Institute Inc. All r ights reserved.

MORE NETWORKS PUBLIC OR PRIVATE OR WHAT?

•  2 NIC •  Private network (does not have to be addressable) •  Public network (API/ management network, addressable)

•  Make interface decisions early on. •  VLAN considerations

•  How many VMs? How many users?

Company Confidential - For Internal Use Only Copyright © 2013, SAS Institute Inc. All r ights reserved.

IN THE END NETWORK AND LAYOUT PLANNING

Company Confidential - For Internal Use Only Copyright © 2013, SAS Institute Inc. All r ights reserved.

2 DBA CENTOS INSTALL

•  Why CentOS? •  The docs say you can do a minimal install… don’t. •  Versioning is worth a second look (dnsmasq, Python) •  Storage decisions: cinder-volume (block storage), glance (object storage)

•  Ephemeral vs permanent •  Understand your storage scenarios early on

Company Confidential - For Internal Use Only Copyright © 2013, SAS Institute Inc. All r ights reserved.

OPENSTACK DECODER RING UNDERSTANDING THE VARIOUS PROJECTS

Company Confidential - For Internal Use Only Copyright © 2013, SAS Institute Inc. All r ights reserved.

INSTALLING & CONFIGURE POST-INFRASTRUCTURE

•  Read the manual, but don’t take a manual approach •  Know the OpenStack release schedule •  CLI vs Horizon Configuration •  Consider automatic deployment solutions

Company Confidential - For Internal Use Only Copyright © 2013, SAS Institute Inc. All r ights reserved.

PACKSTACK NIRVANA YOU’LL BARELY EVEN REMEMBER INSTALLING

•  Automating your deployment •  Answers file •  Puppet

•  Options for all-in-one or multi-node •  Easily add new nodes

Company Confidential - For Internal Use Only Copyright © 2013, SAS Institute Inc. All r ights reserved.

PACKSTACK (CONTINUED)

[root@hal ~]# packstack --answer-file=/tmp/openstackanswer.txt Welcome to Installer setup utility Packstack changed given value to required value /root/.ssh/id_rsa.pub Installing: Clean Up... [ DONE ] Setting up ssh keys... [ DONE ] Adding pre install manifest entries... [ DONE ] Installing time synchronization via NTP... [ DONE ] Adding MySQL manifest entries... [ DONE ] Adding QPID manifest entries... [ DONE ] Adding Keystone manifest entries... [ DONE ] Adding Glance Keystone manifest entries... [ DONE ]

Company Confidential - For Internal Use Only Copyright © 2013, SAS Institute Inc. All r ights reserved.

PACKSTACK ENDING LIKE:

10.124.6.12_postscript.pp : [ DONE ] 10.124.6.15_postscript.pp : [ DONE ] 10.124.6.16_postscript.pp : [ DONE ] 10.124.6.13_postscript.pp : [ DONE ] 10.124.6.10_postscript.pp : [ DONE ] [ DONE ] **** Installation completed successfully ****** Additional information: * To use the command line tools you need to source the file /root/keystonerc_admin created on 10.124.6.10 * To use the console, browse to http://10.124.6.10/dashboard * Kernel package with netns support has been installed on host 10.124.6.10. Because of the kernel update the host mentioned above requires reboot. * Kernel package with netns support has been installed on host 10.124.6.13. Because of the kernel update the host mentioned above requires reboot. * Kernel package with netns support has been installed on host 10.124.6.12. Because of the kernel update the host mentioned above requires reboot. * Kernel package with netns support has been installed on host 10.124.6.15. Because of the kernel update the host mentioned above requires reboot. * Kernel package with netns support has been installed on host 10.124.6.16. Because of the kernel update the host mentioned above requires reboot. * The installation log file is available at: /var/tmp/packstack/20130903-114024-RDZoA5/openstack-setup.log [root@hal ~]#

Company Confidential - For Internal Use Only Copyright © 2013, SAS Institute Inc. All r ights reserved.

YET ANOTHER PROJECT? WILL SAVANNA BE OUR HEROINE?

•  Open source hadoop cluster management tool backed by: •  RedHat •  Mirantis •  Hortonworks •  Others….

•  Allows for one click cluster deployment. •  Neutron not support (yet)

Company Confidential - For Internal Use Only Copyright © 2013, SAS Institute Inc. All r ights reserved.

Company Confidential - For Internal Use Only Copyright © 2013, SAS Institute Inc. All r ights reserved.

Company Confidential - For Internal Use Only Copyright © 2013, SAS Institute Inc. All r ights reserved.