DevOps in the clouds

DevOps in the clouds

Alexey Migutsky : Senior Software Developer @ Lohika

What do we do?

What do we do?PaaS for BigData analytics in cloud environments.

Ubix.io

What do we use?

What do we use?

Scala

Python

Bash

Javascript

What do we use?

BDAS (Spark + Shark)

AWS

Black Voodoo Magic™

Velocipede™

Brains

What’s next?

What’s next?

DevOps WAT?

AWS

CI

Orchestration

What is DevOps?

What is DevOps?

- Methodology

- Agile Infrastructure

- Infrastructure == Code

- Automation

- « Unified pipeline »

How to DevOps?

How to DevOps?

- Continuous Integration

- Automate everything

- Declarative orchestration

- « Pipeline »

How come?

How come?

- AWS (cloud env)

- Startup

- Laziness

- « We wanna code! »

AWS

- EC2

- Route53

- DynamoDB

- S3

- IAM


- « micro cloud » per user

- Node per module

- Easy CI

- No multitenancy

- Velocipede™ deployment

CI

1. Github

2. Jenkins (scala, node.js,

tests)

3. S3

4. Velocipede™ deployments

CI How-To

« do work »

push code

push codepost-commit hook


build & test


build & test

store


build & test

store

take


build & test

store

take

deploy

Velocipede™

Velocipede™

1. Self-made legacy Python/Bash deployment scripts

2. Scala-based Web Service

3. No Chef, no Puppet, no hope…

Velocipede™

1. Deploy using local scripts (devs do this)

2. RESTful API calls (modules do this)

3. Deploy by client creation

Orchestration

Orchestration

Velocipede™ uses self-made AMIs

No Chef, no Puppet, no hope…

Ansible / Salt

Ansible / Salt

Apache jclouds

jclouds

jclouds

- Java-based cloud API

- 30 cloud providers

- « Portable abstractions »

Ansible

Ansible

- No master server and

agents

- SSH

- Simple DSL

- Python

- YAML « playbooks »

Salt

- Has master and « minions

»

- YAML « states »

- Simple DSL

- We found it a bit

complicated

That’s it!

That’s it!

Thanks

@mr_mig_bybit.ly/mr_mig

Technology