DC/OS - Meetupfiles.meetup.com/1714512/Mesosphere 101 Meetup (1).pdfDC/OS KERNEL APPLIES LESSONS...
13
© 2016 Mesosphere, Inc. All Rights Reserved. Deploying Applications on DC/OS Keith McClellan - Technical Lead, Federal Programs [email protected] Mesosphere Datacenter Operating System V6
Transcript of DC/OS - Meetupfiles.meetup.com/1714512/Mesosphere 101 Meetup (1).pdfDC/OS KERNEL APPLIES LESSONS...
© 2016 Mesosphere, Inc. All Rights Reserved.
Deploying Applications on DC/OS
Keith McClellan - Technical Lead, Federal [email protected]
Mesosphere Datacenter Operating System
V6
© 2016 Mesosphere, Inc. All Rights Reserved. 2
THE FUTURE IS ALREADY HERE...
...IT’S JUST NOT EVENLY DISTRIBUTED- WILLIAM FORD GIBSON
© 2016 Mesosphere, Inc. All Rights Reserved. 3
HYPERSCALE COMPUTING FOR MAINSTREAM ENTERPRISES
Definitive Apps
Enabling Technology
Unit of Management
NEW FORM FACTOR FOR DEVELOPING AND RUNNING APPS
Datacenter Operating System (DC/OS)
MAINFRAME
Data Processing
RISC Processor
Partition (LPAR)
PHYSICAL (x86)
ERP, CRM
X86 HW & OS
Physical Server
VIRTUAL
Web Client / Server
Hypervisor(Partitioning)
Logical Server (VM)
HYPERSCALE
Modern Distributed Apps:Big Data, Web Scale, IoT
Datacenter Operating System (Aggregation)
Logical Datacenter
© 2016 Mesosphere, Inc. All Rights Reserved.
DC/OS KERNEL APPLIES LESSONS FROM EARLY INNOVATORS
Tupperware/BistroBorg/Omega Apache Mesos and DC/OS
ProprietaryProprietary Open Source (Apache License)
~2007~2001 2009+
Production-proven Web Scale Cluster Managers
● Built at UC Berkeley AMPLab by Ben Hindman (Mesosphere Co-founder) ● Built in collaboration with Google to overcome some Borg Challenges● Production proven at scale +80K hosts @ Twitter
© 2016 Mesosphere, Inc. All Rights Reserved.
Functions & Logic
Microservices (in containers)
Big Data + Analytics Engines
Streaming
Batch
Machine Learning
Analytics
Search
Time Series
SQL / NoSQL
Databases
HYPERSCALE MEANS: MODERN APPLICATIONS
© 2016 Mesosphere, Inc. All Rights Reserved.
ANATOMY OF A MODERN APP
Data StorageBig Data Processing
X
X X... ...
Message Queue
... ... X
Anything else
Functions & Logic Big Data + Analytics Engines
© 2016 Mesosphere, Inc. All Rights Reserved.
CONTAINER ORCHESTRATIONHyperscale Computing Properties
REST
API
sDependencies Between Microservices Running Multiple Microservices-based Apps
© 2016 Mesosphere, Inc. All Rights Reserved.
IMPLICATIONS OF HYPERSCALE
VIRTUAL HYPERSCALE
Workload pooling
Deploying apps
Business continuity
Ensuring performance
● Partition physical servers to run multiple VMs
● Place some VMs in server pool (e.g., DB, App Svr, Web Svr)
● Restart VMs in right order
● Increase VM size; clear host of other VMs
● Aggregate a logical DC to run multiple distributed systems
● Launch hundreds of microservices; service discovery automation
● Scale distributed microservices programmatically
● Ensure microservices are fault tolerant and self-healing
© 2016 Mesosphere, Inc. All Rights Reserved.
Datacenter Operating System (DC/OS)
MODERN APPS RUNNING ON DC/OS
Abstraction & AggregationServers VMs Cloud (Azure / Amazon / GCE)
Single logical datacenter
App Functions Big Data + Analytics Engines
Data Storage Message QueueBig Data Processing
... ... ...... Two-level
scheduling
Container OrchestrationStateless and Stateful Services
Operations & Service Quality AutomationReactive, Self-Healing Infrastructure
Turnkey setup & operations
© 2016 Mesosphere, Inc. All Rights Reserved. 10
MESOSPHERE DC/OS: HYPERSCALE COMPUTING, ENTERPRISE AGILITY
Hybrid Infrastructure (Compute, Storage, Networking)
Modern Apps(Big Data built-in)
The Modern Cloud Stack
Containers & Microservices Orchestration
Mesosphere DC/OS(Mesos, Marathon, Datacenter Operations) HYPERSCALE OPERATIONS
Continuous Integration & Continuous Delivery
Common CI/CD Tools on Mesosphere DC/OS(GitHub, Jenkins) DEVELOPER AGILITY
Analytics & Database● Streaming, Pipelines, Search, ML● Relational, NoSQL, Data Warehouses
Mesosphere Infinity(Spark, Kafka, Cassandra, Akka) DATA AGILITY
© 2016 Mesosphere, Inc. All Rights Reserved.
DC/OS EXTENSIBILITY FAR BEYOND COMPETITION
Next Gen Application Support
Supported Infrastructure
On Premise
Public Cloud
Core Technology Mesos(Production proven)
Swarm(Under development)
Kubernetes(Nascent)
CoreOS Tectonic
Redhat OpenShift Cloud Foundry
Docker DUCP
Mesosphere DC/OS
Big Data (e.g., Hadoop, Spark, Storm)
Distributed Services(e.g., Kafka, Cassandra)
Extensible Architecture
Cloud Foundry(Production proven)
PaaS
Containers(e.g., Docker, rKt)
Strong Capability
Some Capability
Not Supported
Kubernetes(Nascent)
OpenShift(Production proven)
© 2016 Mesosphere, Inc. All Rights Reserved. 12
RECENT PARTNERSHIP ANNOUNCEMENTS
© 2016 Mesosphere, Inc. All Rights Reserved. 13
DEMO TIME!!!
Get DC/OS at dcos.io (Apache License)Demo code available at http://github.com/mesosphere/iot-demo
