WHAT TWO DBAS WISH THEY KNEW BEFORE VIRTUALIZING ON OPENSTACK · description RnD Openstack B ... *...
Transcript of WHAT TWO DBAS WISH THEY KNEW BEFORE VIRTUALIZING ON OPENSTACK · description RnD Openstack B ... *...
Company Confidential - For Internal Use Only Copyright © 2013, SAS Institute Inc. All r ights reserved.
WHAT TWO DBAS WISH THEY KNEW BEFORE VIRTUALIZING ON OPENSTACK
MASON MORRIS AND DOUG LIMING, SAS INSTITUTE INC.
Company Confidential - For Internal Use Only Copyright © 2013, SAS Institute Inc. All r ights reserved.
EXAMPLE HPA CO-LOCATED
Controller
Client
Company Confidential - For Internal Use Only Copyright © 2013, SAS Institute Inc. All r ights reserved.
EXAMPLE HPA CO-LOCATED
Controller
Client
Company Confidential - For Internal Use Only Copyright © 2013, SAS Institute Inc. All r ights reserved.
EXAMPLE ASYMMETRIC
Controller
Client
Controller
Company Confidential - For Internal Use Only Copyright © 2013, SAS Institute Inc. All r ights reserved.
EXAMPLE NON CO-LOCATED
Controller
Client
Controller
Company Confidential - For Internal Use Only Copyright © 2013, SAS Institute Inc. All r ights reserved.
TERADATA
CLIENT
ORACLE
HADOOP
Company Confidential - For Internal Use Only Copyright © 2013, SAS Institute Inc. All r ights reserved.
HADOOP DISTROS HOW TO KEEP UP WITH ALL THE VERSIONS?
• 1.3.1 • 1.3.2 • 2.0 beta
• 4.0.1 • 4.1.0 • 4.2 • 4.2.1 • 4.3
Company Confidential - For Internal Use Only Copyright © 2013, SAS Institute Inc. All r ights reserved.
CHRISTMAS IN JULY
• 16 Dell 510s • 2 Dell 620s (controller) • 128GB RAM/ blade • 16 Core Xeon Processors • 2 TB disk space • 10 Gbps Ethernet (Chelsio)
Company Confidential - For Internal Use Only Copyright © 2013, SAS Institute Inc. All r ights reserved.
ROUTERS & SWITCHES CORNER YOUR NETWORK GUY
On B01axxxD0121vlan 3505name VLAN-10.124.5.0/24_RnD_Openstk_Avlan 3506name VLAN-10.124.6.0/24_RnD_Openstk_B
set interfaces xe-1/1/0 description "Uplink to B01axxxD0121nc0 3/23"set interfaces xe-1/1/0 enableset interfaces xe-1/1/0 mtu 9216set interfaces xe-1/1/0 unit 0 family ethernet-switching port-mode trunkset interfaces xe-1/1/0 unit 0 family ethernet-switching vlan members vlan3505set interfaces xe-1/1/0 unit 0 family ethernet-switching vlan members vlan3506set interfaces xe-1/1/0 unit 0 family ethernet-switching vlan members vlan37
interface Vlan3506ip address 10.124.6.1/24ip router eigrp 1ip pim sparse-modeip pim neighbor-policy PIM_neighbor_VLAN3506description RnD Openstack B - Douglas Liming - djc 7/11/2013no shutdown
interface Ethernet3/23description B01xxxxDBI14 Openstack Cluster for Douglas Liming - djc 7/11switchportswitchport mode trunkswitchport trunk allowed vlan 37,3505-3506no shutdown
Company Confidential - For Internal Use Only Copyright © 2013, SAS Institute Inc. All r ights reserved.
MORE NETWORKS PUBLIC OR PRIVATE OR WHAT?
• 2 NIC • Private network (does not have to be addressable) • Public network (API/ management network, addressable)
• Make interface decisions early on. • VLAN considerations
• How many VMs? How many users?
Company Confidential - For Internal Use Only Copyright © 2013, SAS Institute Inc. All r ights reserved.
IN THE END NETWORK AND LAYOUT PLANNING
Company Confidential - For Internal Use Only Copyright © 2013, SAS Institute Inc. All r ights reserved.
2 DBA CENTOS INSTALL
• Why CentOS? • The docs say you can do a minimal install… don’t. • Versioning is worth a second look (dnsmasq, Python) • Storage decisions: cinder-volume (block storage), glance (object storage)
• Ephemeral vs permanent • Understand your storage scenarios early on
Company Confidential - For Internal Use Only Copyright © 2013, SAS Institute Inc. All r ights reserved.
OPENSTACK DECODER RING UNDERSTANDING THE VARIOUS PROJECTS
Company Confidential - For Internal Use Only Copyright © 2013, SAS Institute Inc. All r ights reserved.
INSTALLING & CONFIGURE POST-INFRASTRUCTURE
• Read the manual, but don’t take a manual approach • Know the OpenStack release schedule • CLI vs Horizon Configuration • Consider automatic deployment solutions
Company Confidential - For Internal Use Only Copyright © 2013, SAS Institute Inc. All r ights reserved.
PACKSTACK NIRVANA YOU’LL BARELY EVEN REMEMBER INSTALLING
• Automating your deployment • Answers file • Puppet
• Options for all-in-one or multi-node • Easily add new nodes
Company Confidential - For Internal Use Only Copyright © 2013, SAS Institute Inc. All r ights reserved.
PACKSTACK (CONTINUED)
[root@hal ~]# packstack --answer-file=/tmp/openstackanswer.txt Welcome to Installer setup utility Packstack changed given value to required value /root/.ssh/id_rsa.pub Installing: Clean Up... [ DONE ] Setting up ssh keys... [ DONE ] Adding pre install manifest entries... [ DONE ] Installing time synchronization via NTP... [ DONE ] Adding MySQL manifest entries... [ DONE ] Adding QPID manifest entries... [ DONE ] Adding Keystone manifest entries... [ DONE ] Adding Glance Keystone manifest entries... [ DONE ]
Company Confidential - For Internal Use Only Copyright © 2013, SAS Institute Inc. All r ights reserved.
PACKSTACK ENDING LIKE:
10.124.6.12_postscript.pp : [ DONE ] 10.124.6.15_postscript.pp : [ DONE ] 10.124.6.16_postscript.pp : [ DONE ] 10.124.6.13_postscript.pp : [ DONE ] 10.124.6.10_postscript.pp : [ DONE ] [ DONE ] **** Installation completed successfully ****** Additional information: * To use the command line tools you need to source the file /root/keystonerc_admin created on 10.124.6.10 * To use the console, browse to http://10.124.6.10/dashboard * Kernel package with netns support has been installed on host 10.124.6.10. Because of the kernel update the host mentioned above requires reboot. * Kernel package with netns support has been installed on host 10.124.6.13. Because of the kernel update the host mentioned above requires reboot. * Kernel package with netns support has been installed on host 10.124.6.12. Because of the kernel update the host mentioned above requires reboot. * Kernel package with netns support has been installed on host 10.124.6.15. Because of the kernel update the host mentioned above requires reboot. * Kernel package with netns support has been installed on host 10.124.6.16. Because of the kernel update the host mentioned above requires reboot. * The installation log file is available at: /var/tmp/packstack/20130903-114024-RDZoA5/openstack-setup.log [root@hal ~]#
Company Confidential - For Internal Use Only Copyright © 2013, SAS Institute Inc. All r ights reserved.
YET ANOTHER PROJECT? WILL SAVANNA BE OUR HEROINE?
• Open source hadoop cluster management tool backed by: • RedHat • Mirantis • Hortonworks • Others….
• Allows for one click cluster deployment. • Neutron not support (yet)
Company Confidential - For Internal Use Only Copyright © 2013, SAS Institute Inc. All r ights reserved.
Company Confidential - For Internal Use Only Copyright © 2013, SAS Institute Inc. All r ights reserved.