Shifting the Data Center - Red Hat...Shifting the Data Center Transitioning Red Hat IT to hybrid...
Transcript of Shifting the Data Center - Red Hat...Shifting the Data Center Transitioning Red Hat IT to hybrid...
![Page 1: Shifting the Data Center - Red Hat...Shifting the Data Center Transitioning Red Hat IT to hybrid cloud infrastructure using OpenStack and Ceph Storage Brian J. Atkisson, RHCA Principal](https://reader033.fdocuments.in/reader033/viewer/2022050600/5fa7bcfd0136100c9b1259c5/html5/thumbnails/1.jpg)
Shifting the Data Center
Transitioning Red Hat IT to hybrid cloud infrastructure using OpenStack and Ceph StorageBrian J. Atkisson, RHCAPrincipal Architect
Matt Carpenter, RHCEPrincipal Systems Administrator
May 9, 2019
![Page 2: Shifting the Data Center - Red Hat...Shifting the Data Center Transitioning Red Hat IT to hybrid cloud infrastructure using OpenStack and Ceph Storage Brian J. Atkisson, RHCA Principal](https://reader033.fdocuments.in/reader033/viewer/2022050600/5fa7bcfd0136100c9b1259c5/html5/thumbnails/2.jpg)
Roadmap illustrates conceptual “waypoints” that guide the work rather than specifying a detailed plan.
Our approach to digital transformation
![Page 3: Shifting the Data Center - Red Hat...Shifting the Data Center Transitioning Red Hat IT to hybrid cloud infrastructure using OpenStack and Ceph Storage Brian J. Atkisson, RHCA Principal](https://reader033.fdocuments.in/reader033/viewer/2022050600/5fa7bcfd0136100c9b1259c5/html5/thumbnails/3.jpg)
RED HAT ON RED HAT - SOLUTION + PRODUCT USEDIGITAL TRANSFORMATION
NEXT-GEN ARCHITECTURE, CULTURE, PROCESS
I.T. optimization Agile integration Hybrid cloud infrastructure
Cloud-native development
Automation
RED HAT SERVICES & SUPPORT
![Page 5: Shifting the Data Center - Red Hat...Shifting the Data Center Transitioning Red Hat IT to hybrid cloud infrastructure using OpenStack and Ceph Storage Brian J. Atkisson, RHCA Principal](https://reader033.fdocuments.in/reader033/viewer/2022050600/5fa7bcfd0136100c9b1259c5/html5/thumbnails/5.jpg)
Fast growing company
● Focus on business enablement and customer support
● Rapidly changing environment and organic growth○ New applications○ New technologies○ Tech debt
● Portfolio of applications often built on shoehorned systems○ Modern app layers on legacy infrastructure
![Page 6: Shifting the Data Center - Red Hat...Shifting the Data Center Transitioning Red Hat IT to hybrid cloud infrastructure using OpenStack and Ceph Storage Brian J. Atkisson, RHCA Principal](https://reader033.fdocuments.in/reader033/viewer/2022050600/5fa7bcfd0136100c9b1259c5/html5/thumbnails/6.jpg)
Legacy Environment(this might sound familiar)
![Page 7: Shifting the Data Center - Red Hat...Shifting the Data Center Transitioning Red Hat IT to hybrid cloud infrastructure using OpenStack and Ceph Storage Brian J. Atkisson, RHCA Principal](https://reader033.fdocuments.in/reader033/viewer/2022050600/5fa7bcfd0136100c9b1259c5/html5/thumbnails/7.jpg)
One data center to rule them all
● VMs and bare metal
● Config Management
● Appliances○ Storage○ Load balancers
● All eggs in one basket
![Page 8: Shifting the Data Center - Red Hat...Shifting the Data Center Transitioning Red Hat IT to hybrid cloud infrastructure using OpenStack and Ceph Storage Brian J. Atkisson, RHCA Principal](https://reader033.fdocuments.in/reader033/viewer/2022050600/5fa7bcfd0136100c9b1259c5/html5/thumbnails/8.jpg)
Automation Difficulties
● Many individual systems cobbled together
● Integration was the exception
● Automation meant screen-scraping and chaining APIs
![Page 9: Shifting the Data Center - Red Hat...Shifting the Data Center Transitioning Red Hat IT to hybrid cloud infrastructure using OpenStack and Ceph Storage Brian J. Atkisson, RHCA Principal](https://reader033.fdocuments.in/reader033/viewer/2022050600/5fa7bcfd0136100c9b1259c5/html5/thumbnails/9.jpg)
Excess Redundancy
● Infrastructure uptime was key
● Double/triple built○ Active/standby Networking○ Multiple RHV clusters○ Active/standby Storage heads
● Cold DR site
From the Department of Redundancy Department
https://xkcd.com/703/
![Page 10: Shifting the Data Center - Red Hat...Shifting the Data Center Transitioning Red Hat IT to hybrid cloud infrastructure using OpenStack and Ceph Storage Brian J. Atkisson, RHCA Principal](https://reader033.fdocuments.in/reader033/viewer/2022050600/5fa7bcfd0136100c9b1259c5/html5/thumbnails/10.jpg)
Application Architecture
● Applications assumed 100% infrastructure uptime
● Some would not tolerate device failovers
● Active/passive DBs○ Manual failback
![Page 11: Shifting the Data Center - Red Hat...Shifting the Data Center Transitioning Red Hat IT to hybrid cloud infrastructure using OpenStack and Ceph Storage Brian J. Atkisson, RHCA Principal](https://reader033.fdocuments.in/reader033/viewer/2022050600/5fa7bcfd0136100c9b1259c5/html5/thumbnails/11.jpg)
So this happened...
● HA services still resided in the same physical site
● DR failover unrealistic
● Application recovery took ages
![Page 12: Shifting the Data Center - Red Hat...Shifting the Data Center Transitioning Red Hat IT to hybrid cloud infrastructure using OpenStack and Ceph Storage Brian J. Atkisson, RHCA Principal](https://reader033.fdocuments.in/reader033/viewer/2022050600/5fa7bcfd0136100c9b1259c5/html5/thumbnails/12.jpg)
Public Cloud Options
● Some apps moved to public cloud vendors
● Extension of data center
● Worst of both worlds○ Named pets on someone
else’s hardware
![Page 13: Shifting the Data Center - Red Hat...Shifting the Data Center Transitioning Red Hat IT to hybrid cloud infrastructure using OpenStack and Ceph Storage Brian J. Atkisson, RHCA Principal](https://reader033.fdocuments.in/reader033/viewer/2022050600/5fa7bcfd0136100c9b1259c5/html5/thumbnails/13.jpg)
We could do better,let’s fix.
![Page 14: Shifting the Data Center - Red Hat...Shifting the Data Center Transitioning Red Hat IT to hybrid cloud infrastructure using OpenStack and Ceph Storage Brian J. Atkisson, RHCA Principal](https://reader033.fdocuments.in/reader033/viewer/2022050600/5fa7bcfd0136100c9b1259c5/html5/thumbnails/14.jpg)
Kill the DB Monolith
● Effort to move data away from massive SQL databases
● Broke tight integration with DB
● SOA work gave way to stateless NoSQL and RESTful API data patterns
![Page 15: Shifting the Data Center - Red Hat...Shifting the Data Center Transitioning Red Hat IT to hybrid cloud infrastructure using OpenStack and Ceph Storage Brian J. Atkisson, RHCA Principal](https://reader033.fdocuments.in/reader033/viewer/2022050600/5fa7bcfd0136100c9b1259c5/html5/thumbnails/15.jpg)
Single Sign On
● Deployed Red Hat SSO○ Remove authentication
responsibility from applications○ Handles session management
● Multisite○ MariaDB Galera○ Jboss Data Grid○ External User store
■ Mongo■ IdM
![Page 16: Shifting the Data Center - Red Hat...Shifting the Data Center Transitioning Red Hat IT to hybrid cloud infrastructure using OpenStack and Ceph Storage Brian J. Atkisson, RHCA Principal](https://reader033.fdocuments.in/reader033/viewer/2022050600/5fa7bcfd0136100c9b1259c5/html5/thumbnails/16.jpg)
OpenShift
● OpenShift changed deployment practices in a profound way
● Container-based design principles
● Migrating app tiers○ Decouple application from state and data
tiers
● Built-in Updates
![Page 17: Shifting the Data Center - Red Hat...Shifting the Data Center Transitioning Red Hat IT to hybrid cloud infrastructure using OpenStack and Ceph Storage Brian J. Atkisson, RHCA Principal](https://reader033.fdocuments.in/reader033/viewer/2022050600/5fa7bcfd0136100c9b1259c5/html5/thumbnails/17.jpg)
Multisite Active
![Page 18: Shifting the Data Center - Red Hat...Shifting the Data Center Transitioning Red Hat IT to hybrid cloud infrastructure using OpenStack and Ceph Storage Brian J. Atkisson, RHCA Principal](https://reader033.fdocuments.in/reader033/viewer/2022050600/5fa7bcfd0136100c9b1259c5/html5/thumbnails/18.jpg)
Development Pattern Prereqs
● Guard rails to ensure success
● Applications deployed on OpenShift○ Stateless○ Changes expected
● Session management delegated to SSO
● Loose coupling and/or microservices
● Graceful fault tolerance
![Page 19: Shifting the Data Center - Red Hat...Shifting the Data Center Transitioning Red Hat IT to hybrid cloud infrastructure using OpenStack and Ceph Storage Brian J. Atkisson, RHCA Principal](https://reader033.fdocuments.in/reader033/viewer/2022050600/5fa7bcfd0136100c9b1259c5/html5/thumbnails/19.jpg)
Multisite Routing Strategies
● CDN handles Global ServerLoad Balancing
● Geographic Proximity
● Edge servers allow foradvanced logic
![Page 20: Shifting the Data Center - Red Hat...Shifting the Data Center Transitioning Red Hat IT to hybrid cloud infrastructure using OpenStack and Ceph Storage Brian J. Atkisson, RHCA Principal](https://reader033.fdocuments.in/reader033/viewer/2022050600/5fa7bcfd0136100c9b1259c5/html5/thumbnails/20.jpg)
Multisite Data Strategies
● Synchronous data storage○ MariaDB Galera○ JBoss Data Grid
● Eventual consistency○ MongoDB○ Directory Server / IdM
● Storage file and block replication
![Page 21: Shifting the Data Center - Red Hat...Shifting the Data Center Transitioning Red Hat IT to hybrid cloud infrastructure using OpenStack and Ceph Storage Brian J. Atkisson, RHCA Principal](https://reader033.fdocuments.in/reader033/viewer/2022050600/5fa7bcfd0136100c9b1259c5/html5/thumbnails/21.jpg)
Multisite PaaS
● OpenShift deployed in three sites
● PaaS abstracted underlying infrastructure
● Front-end with a CDN
![Page 22: Shifting the Data Center - Red Hat...Shifting the Data Center Transitioning Red Hat IT to hybrid cloud infrastructure using OpenStack and Ceph Storage Brian J. Atkisson, RHCA Principal](https://reader033.fdocuments.in/reader033/viewer/2022050600/5fa7bcfd0136100c9b1259c5/html5/thumbnails/22.jpg)
OpenStack and Ceph
![Page 23: Shifting the Data Center - Red Hat...Shifting the Data Center Transitioning Red Hat IT to hybrid cloud infrastructure using OpenStack and Ceph Storage Brian J. Atkisson, RHCA Principal](https://reader033.fdocuments.in/reader033/viewer/2022050600/5fa7bcfd0136100c9b1259c5/html5/thumbnails/23.jpg)
Why OpenStack
● Faster Delivery of applications and services
● Vast automation potentials
● Empower development teams
● Infrastructure as code
● Lower cost through software-defined services
![Page 24: Shifting the Data Center - Red Hat...Shifting the Data Center Transitioning Red Hat IT to hybrid cloud infrastructure using OpenStack and Ceph Storage Brian J. Atkisson, RHCA Principal](https://reader033.fdocuments.in/reader033/viewer/2022050600/5fa7bcfd0136100c9b1259c5/html5/thumbnails/24.jpg)
One Leg on OpenStack● New data center
● Replace RHV with OpenStack
● Minimal appliances○ Load Balancer -> Octavia + proxy layer○ Storage -> Ceph
● RHHI-V cluster○ Bootstrapping○ Utility services
![Page 25: Shifting the Data Center - Red Hat...Shifting the Data Center Transitioning Red Hat IT to hybrid cloud infrastructure using OpenStack and Ceph Storage Brian J. Atkisson, RHCA Principal](https://reader033.fdocuments.in/reader033/viewer/2022050600/5fa7bcfd0136100c9b1259c5/html5/thumbnails/25.jpg)
OpenStack
● Not a virtualization solution
● Cloud ecosystem○ Including virtualization
● Software-Defined Data Center
● Integrated APIs and CLI tools
https://www.openstack.org/software/
![Page 26: Shifting the Data Center - Red Hat...Shifting the Data Center Transitioning Red Hat IT to hybrid cloud infrastructure using OpenStack and Ceph Storage Brian J. Atkisson, RHCA Principal](https://reader033.fdocuments.in/reader033/viewer/2022050600/5fa7bcfd0136100c9b1259c5/html5/thumbnails/26.jpg)
https://www.openstack.org/software/
![Page 27: Shifting the Data Center - Red Hat...Shifting the Data Center Transitioning Red Hat IT to hybrid cloud infrastructure using OpenStack and Ceph Storage Brian J. Atkisson, RHCA Principal](https://reader033.fdocuments.in/reader033/viewer/2022050600/5fa7bcfd0136100c9b1259c5/html5/thumbnails/27.jpg)
![Page 28: Shifting the Data Center - Red Hat...Shifting the Data Center Transitioning Red Hat IT to hybrid cloud infrastructure using OpenStack and Ceph Storage Brian J. Atkisson, RHCA Principal](https://reader033.fdocuments.in/reader033/viewer/2022050600/5fa7bcfd0136100c9b1259c5/html5/thumbnails/28.jpg)
Firewall Firewall
LB LB
Distrib. Switch
Distrib. Switch
Server Hardware
Storage Appliance
NETWORK
COMPUTE
STORAGE
Basic FirewallOSP Security GroupsOSP LBaaS (Octavia)
OSP SDN (Neutron)
OSP - Ceph
NETWORK
COMPUTE
STORAGE
OpenStack
Red Hat Virtualization
Server Hardware
OSP Compute ( Nova)
Distrib. Switch
Distrib. Switch
Legacy Stack
![Page 29: Shifting the Data Center - Red Hat...Shifting the Data Center Transitioning Red Hat IT to hybrid cloud infrastructure using OpenStack and Ceph Storage Brian J. Atkisson, RHCA Principal](https://reader033.fdocuments.in/reader033/viewer/2022050600/5fa7bcfd0136100c9b1259c5/html5/thumbnails/29.jpg)
OpenStack Director
![Page 30: Shifting the Data Center - Red Hat...Shifting the Data Center Transitioning Red Hat IT to hybrid cloud infrastructure using OpenStack and Ceph Storage Brian J. Atkisson, RHCA Principal](https://reader033.fdocuments.in/reader033/viewer/2022050600/5fa7bcfd0136100c9b1259c5/html5/thumbnails/30.jpg)
RHHI-V
● RHHI-V○ Integrated RHV + Gluster
● Hosts○ Director○ Red Hat IdM, DHCP, monitoring
● HA VMs and Snapshots
![Page 31: Shifting the Data Center - Red Hat...Shifting the Data Center Transitioning Red Hat IT to hybrid cloud infrastructure using OpenStack and Ceph Storage Brian J. Atkisson, RHCA Principal](https://reader033.fdocuments.in/reader033/viewer/2022050600/5fa7bcfd0136100c9b1259c5/html5/thumbnails/31.jpg)
OpenStack Overcloud
https://docs.openstack.org/tripleo-docs/latest/install/introduction/architecture.html
![Page 32: Shifting the Data Center - Red Hat...Shifting the Data Center Transitioning Red Hat IT to hybrid cloud infrastructure using OpenStack and Ceph Storage Brian J. Atkisson, RHCA Principal](https://reader033.fdocuments.in/reader033/viewer/2022050600/5fa7bcfd0136100c9b1259c5/html5/thumbnails/32.jpg)
![Page 33: Shifting the Data Center - Red Hat...Shifting the Data Center Transitioning Red Hat IT to hybrid cloud infrastructure using OpenStack and Ceph Storage Brian J. Atkisson, RHCA Principal](https://reader033.fdocuments.in/reader033/viewer/2022050600/5fa7bcfd0136100c9b1259c5/html5/thumbnails/33.jpg)
Solution Implementation
![Page 34: Shifting the Data Center - Red Hat...Shifting the Data Center Transitioning Red Hat IT to hybrid cloud infrastructure using OpenStack and Ceph Storage Brian J. Atkisson, RHCA Principal](https://reader033.fdocuments.in/reader033/viewer/2022050600/5fa7bcfd0136100c9b1259c5/html5/thumbnails/34.jpg)
Availability Zones
● Zones○ Failure domains○ Resource islands
● Separate racks, server hardware, upstream network gear, power circuits, etc.
● Taking down one AZ has no impact on others
● Three zones
![Page 35: Shifting the Data Center - Red Hat...Shifting the Data Center Transitioning Red Hat IT to hybrid cloud infrastructure using OpenStack and Ceph Storage Brian J. Atkisson, RHCA Principal](https://reader033.fdocuments.in/reader033/viewer/2022050600/5fa7bcfd0136100c9b1259c5/html5/thumbnails/35.jpg)
![Page 36: Shifting the Data Center - Red Hat...Shifting the Data Center Transitioning Red Hat IT to hybrid cloud infrastructure using OpenStack and Ceph Storage Brian J. Atkisson, RHCA Principal](https://reader033.fdocuments.in/reader033/viewer/2022050600/5fa7bcfd0136100c9b1259c5/html5/thumbnails/36.jpg)
Network Integration● Provider Networks
○ Stretched VLANs spanning availability zones○ Faster, shared resource
● Tenant Networks○ Private overlay networks○ Slower, more secure
● Security Groups
![Page 37: Shifting the Data Center - Red Hat...Shifting the Data Center Transitioning Red Hat IT to hybrid cloud infrastructure using OpenStack and Ceph Storage Brian J. Atkisson, RHCA Principal](https://reader033.fdocuments.in/reader033/viewer/2022050600/5fa7bcfd0136100c9b1259c5/html5/thumbnails/37.jpg)
Load Balancing - Octavia● Quick and simple OpenStack native load balancing
● Advanced logic in application tiers
● Individual Amphora provides failure domain separation
![Page 38: Shifting the Data Center - Red Hat...Shifting the Data Center Transitioning Red Hat IT to hybrid cloud infrastructure using OpenStack and Ceph Storage Brian J. Atkisson, RHCA Principal](https://reader033.fdocuments.in/reader033/viewer/2022050600/5fa7bcfd0136100c9b1259c5/html5/thumbnails/38.jpg)
Ceph Storage● Benefits
○ Software-defined○ Cheaper, reliable○ Scale-out○ Block, Object and File storage
● Use-cases○ VM disk storage○ Glance image storage
![Page 39: Shifting the Data Center - Red Hat...Shifting the Data Center Transitioning Red Hat IT to hybrid cloud infrastructure using OpenStack and Ceph Storage Brian J. Atkisson, RHCA Principal](https://reader033.fdocuments.in/reader033/viewer/2022050600/5fa7bcfd0136100c9b1259c5/html5/thumbnails/39.jpg)
Lessons Learned
![Page 40: Shifting the Data Center - Red Hat...Shifting the Data Center Transitioning Red Hat IT to hybrid cloud infrastructure using OpenStack and Ceph Storage Brian J. Atkisson, RHCA Principal](https://reader033.fdocuments.in/reader033/viewer/2022050600/5fa7bcfd0136100c9b1259c5/html5/thumbnails/40.jpg)
OSP Long Life Releases
● Historical cadence○ 1 - 2 major releases per
year● Long Life releases
○ 5 years of support■ 3 years production■ 2 years extended life
● Short Life releases○ 1 year of support
● We settled on OSP 13
![Page 41: Shifting the Data Center - Red Hat...Shifting the Data Center Transitioning Red Hat IT to hybrid cloud infrastructure using OpenStack and Ceph Storage Brian J. Atkisson, RHCA Principal](https://reader033.fdocuments.in/reader033/viewer/2022050600/5fa7bcfd0136100c9b1259c5/html5/thumbnails/41.jpg)
Use Cases
● OpenShift● Non-container workloads● Red Hat SSO
○ Multicast● Databases● IdM● LucidWorks● Legacy workloads
![Page 42: Shifting the Data Center - Red Hat...Shifting the Data Center Transitioning Red Hat IT to hybrid cloud infrastructure using OpenStack and Ceph Storage Brian J. Atkisson, RHCA Principal](https://reader033.fdocuments.in/reader033/viewer/2022050600/5fa7bcfd0136100c9b1259c5/html5/thumbnails/42.jpg)
IdM and Ansible Integration
● OpenStack Novajoin○ Native IdM integration○ Secures all endpoints automatically (~100
certs)
● Ansible for project provisioning○ Creates IdM host○ Provision VM, load balancer, storage○ Scale-up events○ Tower API endpoint for playbook
![Page 43: Shifting the Data Center - Red Hat...Shifting the Data Center Transitioning Red Hat IT to hybrid cloud infrastructure using OpenStack and Ceph Storage Brian J. Atkisson, RHCA Principal](https://reader033.fdocuments.in/reader033/viewer/2022050600/5fa7bcfd0136100c9b1259c5/html5/thumbnails/43.jpg)
Load Balancing
● TLS terminate and re-encrypt not supported in Octavia○ Drove some design, ie CDN & App tier
● Stretch VLANs between the AZs for Octavia○ One virtual IP(VIP) on all three AZs
● Embrace simple
![Page 44: Shifting the Data Center - Red Hat...Shifting the Data Center Transitioning Red Hat IT to hybrid cloud infrastructure using OpenStack and Ceph Storage Brian J. Atkisson, RHCA Principal](https://reader033.fdocuments.in/reader033/viewer/2022050600/5fa7bcfd0136100c9b1259c5/html5/thumbnails/44.jpg)
Autoscaling● Heat-based templates,
harder to implement auto scalingthan hoped
● Tooling is there for yourown solution
● Template-based provisioningaccelerates scaling
![Page 45: Shifting the Data Center - Red Hat...Shifting the Data Center Transitioning Red Hat IT to hybrid cloud infrastructure using OpenStack and Ceph Storage Brian J. Atkisson, RHCA Principal](https://reader033.fdocuments.in/reader033/viewer/2022050600/5fa7bcfd0136100c9b1259c5/html5/thumbnails/45.jpg)
Questions?
![Page 46: Shifting the Data Center - Red Hat...Shifting the Data Center Transitioning Red Hat IT to hybrid cloud infrastructure using OpenStack and Ceph Storage Brian J. Atkisson, RHCA Principal](https://reader033.fdocuments.in/reader033/viewer/2022050600/5fa7bcfd0136100c9b1259c5/html5/thumbnails/46.jpg)
RED HAT I.T.Powered by Red Hat Products
Ask us how it’s doneVisit us at the “Ask Me Anything” booth and ask us about
how we implement and deploy Red Hat products!
redhat.com/redhat-on-redhat
![Page 47: Shifting the Data Center - Red Hat...Shifting the Data Center Transitioning Red Hat IT to hybrid cloud infrastructure using OpenStack and Ceph Storage Brian J. Atkisson, RHCA Principal](https://reader033.fdocuments.in/reader033/viewer/2022050600/5fa7bcfd0136100c9b1259c5/html5/thumbnails/47.jpg)
Thurs, May 93:15 - 4:00pm Developing and running cloud-native apps on OpenShift in Red Hat's IT organization
Thurs, May 93:15 - 4:00pm Developing and deploying applications in a multisite hybrid cloud
![Page 48: Shifting the Data Center - Red Hat...Shifting the Data Center Transitioning Red Hat IT to hybrid cloud infrastructure using OpenStack and Ceph Storage Brian J. Atkisson, RHCA Principal](https://reader033.fdocuments.in/reader033/viewer/2022050600/5fa7bcfd0136100c9b1259c5/html5/thumbnails/48.jpg)