Docker, DevOps and Cloud Storage on Amazon Web Services (AWS)

Docker and Cloud Storage on AWSJoey WrightSolutions Architect, SoftNAS

June 29, 2016

© 2016 SoftNAS, Inc.

Introducing Our Speaker


Joey Wright, Solutions Architect, SoftNAS

Housekeeping

Post your questions here

This session IS being recordedLinks to the recording and presentations will be provided later

To listen using your telephone select the ‘Telephone’ option. For local numbers click the ‘additional

numbers’ link.You will need to use the Access

Code and Audio PIN.

The audio for this webinar is available over VoIP. Just select

the use ‘Mic & Speakers’ option to listen to the webinar

through your computers speakers.

If you CAN NOT hear us, please check your

volume settings.

Webinar Audio1

2

3© 2016 SoftNAS, Inc.

Get My $100 AWS Credit!

First 100 attendees to register

(URL announced later)


Agenda

• Docker, DevOps and Cloud Storage

• Demo: Docker Persistent Storage on AWS

• Docker Storage Challenges• SoftNAS Cloud NAS Overview• Next Steps• Q&A


Docker, DevOps and Cloud Storage


Docker & DevOps Adoption• DevOps teams have doubled Docker usage in 2016• 80% of companies are adopting DevOps in some capacity

Container Storage Options

8

Storage Option Pros ConsDocker Internal Storage

• Simple• Shared by containers on same

host

• Temporary storage

Host Storage • Shared by containers on same host

• More configuration – container processes need appropriate read/write permissions

Network Storage• SoftNAS, NFS, iSCSI

• Shared universally within cluster • Requires careful UID/GID mapping (until cgroup user namespace work completed)

Cloud Storage• Block: AWS EBS• Object: AWS S3

• Block: shared in cluster, if minion info is public

• Object: Good for files that change infrequently; latency not an issue; accessed over HTTP w/ REST

• Block: requires low latency; problematic over WAN

• Object: requires software and access info for storage processes w/in container

AWS ECS (EC2 Container Service)

• Instant provisioning of new servers

• Multiple geographic areas to run servers with a standard interface

• Need to be in more than one zone and redundant across zones

Why DevOps Cares about Cloud Storage with Docker

• Configure once; run anything• Efficient, consistent, and repeatable lifecycle• Increased code quality • Inconsistencies eliminated: Dev/Test/Production/Customer

Environments• Supports segregation of duties• Improved speed and reliability: continuous

deployment/integration• Easier than VMs: containers improve performance, costs,

deployment, and portability

Docker Persistent Shared Storage

10

SoftNAS Cloud NAS

EBS/S3

Host OSHost OSHost OS

Linux Server


Poll 1:How is your company adopting DevOps?


Demo: Docker Persistent Storage on Amazon Web Services (AWS)


Docker Storage Challenges in the Public Cloud


14

• Persistent Storage– Container storage is temporary. How do I make it persistent?– Can’t natively share volumes across multiple Docker hosts

• Container Security– What are the security risks with using containers?

• Support– Will support be available 24/7?– Will I have 99.999% uptime?

• Lack of Resources and Expertise– We need help with implementing Docker. What are good resources for us?– I don’t have storage training. How can I use Docker for storage purposes?

Docker Storage Challenges


15

• Implement a dedicated data layer on VMs. Containers will directly across the network in a configuration similar to client/server application architecture.– This halfway house means that containers provide application

scalability, but there’s still a manual process in scaling the data layer.

• Using SoftNAS, you can share persistent storage between Docker containers and hosts

• Share snapshots of your data to S3 or elsewhere for use even after your Docker container has exited

Persistent Storage Challenges


Container Security Challenges

14

• Only use enhanced privileges where absolutely necessary with virtualized containers, and drop those privileges back to standard as soon as possible.

• Never leave privileges set as enhanced. The slight increase in internal latency required to set and reset enhanced privileges is worth it for the sake of greater overall security on the IT platform.

• Ensure the images you are running are up-to-date and do not contain versions of software with known vulnerabilities.

• Try to run services as non-root: If root must be used, be as careful here as you would be in the physical IT infrastructure. The container is not a sandbox -- it has holes all over it.© 2016 SoftNAS, Inc.

17

• Docker provides support with forums, a Knowledge Hub and an SLA-based Support System

• Ensure your cloud service provider has phone, chat and email support options available

• Read the SLAs from your cloud service provider and Docker. Scrutinize every detail.

• Public cloud providers are susceptible to outages. Use a third-party service through the Marketplace which guarantees 99.999% uptime (i.e. SoftNAS No Downtime Guarantee program)

Support, SLA and Uptime Challenges


18

• Opt for storage services that let you setup storage through a wizard-based system. No more storage PhDs needed!

Resource and Expertise Challenges


• Sign up for training directly from Docker (https://training.docker.com/)

https://training.docker.com/



Poll 2:What is your biggest challenge with Docker storage?


SoftNAS Cloud NAS Overview


How SoftNAS Benefits Docker

21

• Need for file sharing and advanced NAS features• Manage data for all containers in simple and powerful

storage solution• Available on-demand to meet IT and DevOps agile storage

needs• Snapshots and clones that work with stored container

output• Streamlines continuous deployment build-test-validate-

release cycles• Enhances security built into AWS• Protects mission-critical data in the cloud• No Downtime Guarantee – 99.999% uptime


Flexible, Adaptable Architecture

Linux Virtual Appliance

ARCHITECTURE INTEGRATION DATA SERVICES

• API and CLI• Cross data center• Cross-zone VPC• Easy

administration• File gateway• HTML5 Admin UI• Software filer• ZFS on Linux

• AWS• Azure• CenturyLink cloud• CIFS w/ Active

directory• FC SAN• iSCSI LUN• iSCSI SAN• NFS• S3 Objects• SSD• VMware vSphere

• Block replication• Cloud disks• Compression• Inline deduplication• Instant snapshots• Multi-level caching• Storage pools• Thin provisioning• Writable

SnapClones™• Encryption


23

SoftNAS Cloud NAS on AWS


• Enterprise-class NAS filer software appliances

• Installed both in Amazon EC2 and on-premises

• Allows for replication from on-premises to Amazon EC2 & vice versa

• Replication– SoftNAS deployed in EC2

as replication target using SnapReplicate

– Enables backup, disaster recovery & development environment scenarios

On-Premise Private Cloud

SoftNAS Cloud NAS

24

SoftNAS Products


SoftNAS Cloud NAS• Amazon Web Services (AWS)• Microsoft Azure• CenturyLink Cloud• VMware vSphere

SoftNAS for Service Providers• VMware vSphere

Multi-tenant NAS replacement for use with iSCSI and object storage

Public cloud NAS filer

On-premises cloud NAS filer

Technology Partners


Brands You Know Trust SoftNAS


Earn $100 AWS Credit!

First 100 attendees to register

http://bit.ly/docker-aws-webinar




Next Steps

28

• Learn More – bit.ly/softnas_aws

• SoftNAS Architecture on AWS White Paper – bit.ly/softnas-aws-wp

• Implementing SofNAS with Docker White Paper – http://bit.ly/docker-softnas-whitepaper

• Contact Us – softnas.com/contact

• Follow Us – @SoftNAS

Try It!

softnas.com/tryaws© 2016 SoftNAS, Inc.

http://bit.ly/softnas_aws

http://bit.ly/softnas-aws-wp

http://bit.ly/softnas-aws-wp

http://bit.ly/docker-softnas-whitepaper

http://bit.ly/docker-softnas-whitepaper

http://softnas.com/contact

http://twitter.com/softnas

http://twitter.com/softnas

Thank You


Docker, DevOps and Cloud Storage on Amazon Web Services (AWS)

Software

Transcript of Docker, DevOps and Cloud Storage on Amazon Web Services (AWS)