Greg Maxey - Electric Cloud - Process as Code: An Introduction to the ElectricFlow Automation DSL

© Electric Cloud | electric-cloud.com

Powering DevOps Automation and Continuous Delivery

Better software faster

Process as Code: An Introduction to the ElectricFlow Automation DSL


Outline

• Introduction• What is a DSL?• Why am I excited about EF DSL?• Some use case where EF DSL shines• Benefits of code-based software delivery• Introduction to EF DSL• EF DSL examples• EF DSL editor• Conclusion• Q&A


Who am I?

Greg MaxeySolutions Engineer at Electric Cloud, five yearsSoftware Delivery Automation@gpmaxey

A career in automation• Test and measurement• Signal processing and analysis• System level design• Integrated chip hardware design• Microprocessor and system on chip design• Network equipment testing


Show of hands

• How many of you are involved in software delivery?• Are your primary tools UIs? or• Are your primary tools code based / scripts?• Do you automate the automation?• How many of you are familiar with Electric Cloud?• How many of you are users or ElectricFlow?


My job – DevOps Integration and Orchestration

Infrastructure

Development Operations

Developers

Coding Local Builds Local Testing

Preflight

Build

SCM

CIBuild

ArtifactManageme

nt

QA/UAT•Provision Environment

•Deploy

•Testing

Staging

•Deploy•Smoke test

Production

Retr

iev

e

On Preflight Success

Changes

Chec

kout

Chec

kout

CheckoutPublis

h

Checkin Retr

iev

e

On successpromote &notify QA & UAT

On successnotify releaseteam

1

2

3

45

6

7 8 9

Debug Prod

Start Release Pipeline


Getting to software delivery automation

GovernanceOrchestration

Dev Ops

Infrastructure

Business process requirements and

constraints(SW Delivery

Specifications)

Applications / SW


DEVO

PSWhat Electric Cloud provides for Software Delivery

DEPLOY

ANY APP. ANY VERSION.

ANYWHERE.ANYTIME.

RELEASE

TRADITIONAL AND CD

PIPELINES AND RELEASES

BUILD/TEST

FLEXIBLE AND SCALABLE

AUTOMATION FOR DEV AND QA

OTHER

ORCHESTRATE ANY TOOLCHAIN OR PROCESS.

DSL, CLI, REST, SOAP, HTTP, API, SDK

Plugs right in to your existing tools

ElectricFlowDEVOPS AUTOMATION PLATFORM

SHARED CONTROL | SHARED VISIBILITY | SHARED RESOURCES

SCALABLEEXTENSIBLE SECURE

TRANSPARENTFLEXIBLE HYBRID CLOUD


Modern user experience


Application Model


What is a DSL?

A domain-specific language (DSL) is a computer language specialized to a particular application domain. This is in contrast to a general-purpose language (GPL), which is broadly applicable across domains, and lacks specialized features for a particular domain… DSLs can be further subdivided by the kind of language, and include domain-specific markup languages, domain-specific modeling languages (more generally, specification languages), and domain-specific programming languages.

- Wikipedia

https://en.wikipedia.org/wiki/Computer_language

https://en.wikipedia.org/wiki/Domain_(software_engineering)

https://en.wikipedia.org/wiki/General-purpose_language

https://en.wikipedia.org/wiki/Markup_language

https://en.wikipedia.org/wiki/Markup_language

https://en.wikipedia.org/wiki/Modeling_language

https://en.wikipedia.org/wiki/Modeling_language

https://en.wikipedia.org/wiki/Specification_language

https://en.wikipedia.org/wiki/Programming_language

https://en.wikipedia.org/wiki/Programming_language


Examples of DSLs

• HTML for webpage definition• MATLAB for mathematical

modeling• Verilog, SystemC, LISA for HW,

SoC and uProcessor design• Regex for text pattern matching• make for build automation• Chef recipes & Puppet manifests

for Infrastructure as Code

• But what for software delivery automation?


Anders Wallgren, CTO Electric Cloud

Why am I excited about DSL?

Electric Flow DSL

• Easy to learn• Compact• Declarative• Idempotent• Inheritance

Very fast model creation


How I used to code in ElectricFlow


Configuration Management build Manual Run Book1. PuTTY into VOB server2. Create dynamic view3. … (other VOB interactions)4. Create local copy on build machine5. Adjust permisions6. Modify registry7. Run build script8. … (other file manipulations)9. Start Linux VM10. Copy build to VM11. Create RPMs on VM12. Create check sum file13. Copy RPMs to build machine14. … (other file manipulations)15. Burn CD


Spin up a field-deployable datacenter

1. Do inventory of installation media2. Power up3. Verify networking is operational4. Install the base services and infrastructure software5. Install the main software components6. Perform functional test subworkflow activity7. Checkout XYZ functionality8. Test and checkout9. Verify component interoperability


Top level installation workflow


When models get large

Servers Services

TypeA svs1, svs2, svs3

TypeB svs1, svs4, svs5, svs6, svs7

TypeC svs8, svs9

TypeD svs8, svs10, svs11

TypeE svs12

… ..


Application Model


Onboard applications

Development Continuous Integration Continuous Deployment

Visual Studio.NET

Eclipse

Java

xCode

SCM

Code Analysis

BuildUnit Test

Arti

fact

Man

agem

ent

Release Pipeline

Deploy Target Containers

IIS Apprenda iOS

QA UAT PROD


Onboarding Parameters

[ { "name": "appName", "label": "Application Name", "description": "The name of the application to be onboarded", "defaultValue": "My Application" }, { "name": "sourceLocation", "label": "Source Code Location", "description": "SCM location for CI", "defaultValue": "http://gitlab.mycompany.com/apps/myapp.git" }, { "name": "stages", "label": "Stage names", "description": "Comma-separated list of stages for pipeline", "defaultValue": "Dev,QA,UAT,Staging,Prod" },…


Automating the automation


These use cases showed me the power of DSL

• Easier iterative model development• Data-driven model creation• Enable end-to-end process generation


Benefits of EF DSL to enterprise software delivery• Documented process• Executable specification• Ease onboarding of new and legacy projects and

teams• Ability to use mature code-based tools and

approaches• Create and manage very complex delivery processes• Enable working at scale with teams of thousands• Matching the right interface to the particular user


Benefits of Code-based approaches in general

• Leverage mature tool chains and best practices• IDEs• SCM / versioning• Modular design• Test-driven development• Static analysis and other code quality tools

• Ease of Refactoring• Sharing / Collaboration• Scales well• Easier data-driven approaches

Greg Maxey

Add logos


ElectricFlow Domain Specific Language, EF DSL• Groovy-based• Native access to ElectricFlow

platform• Supports entire EF API• Enables model authoring and

scripting

And as said before• Easy to learn• Compact• Declarative• Idempotent• Inheritance


ElectricFlow platform addresses Process AutomationEnd-to-end software delivery automation through graphical/Web interface• Centralized• Secure• High scalability• Visibility• Traceable• Fault tolerant


EF DSL Examples - DEMO

• Configuration Management Procedure• Onboarding legacy applications

Procedures Environment models Application models Pipeline delivery discipline

• Spinning up new projects Training set up


DEMO


Samples on Github


EF DSL IDE, Lite Editor - DEMO


DEMO


DSL IDE available on Github


Conclusion

When it comes to software delivery,

ElectricFlow UI is great for Visualization Medium Scale content authoring

For large-scale automating the automation EF DSL Gives full access to ElectricFlow platform Enables code-based authoring, or Process-as-Code


Thank youNetworking

Other Systems

ISV, Internet & Entertainment

Heavy Industry

Financial Services

Automotive Medical Devices

Semiconductor

Aerospace /Defense

Mobile Devices

Q&A

http://images.google.com/imgres?imgurl=http://www.htsalg.com/Bestill/ericsson_logo_darkblue.gif&imgrefurl=http://www.htsalg.com/Bestill/r290%20info.htm&h=658&w=3208&sz=29&hl=en&start=1&tbnid=J0BCxskKEjC_vM:&tbnh=31&tbnw=150&prev=/images?q=ericsson+logo&svnum=10&hl=en

http://images.google.com/imgres?imgurl=http://www.samsung.com/gr/presscenter/images/samsung-logo.jpg&imgrefurl=http://www.samsung.com/gr/presscenter/awards/index.htm&h=290&w=496&sz=15&hl=en&start=1&tbnid=evZTc_XRtk9rGM:&tbnh=76&tbnw=130&prev=/images?q=samsung+logo&svnum=10&hl=en&sa=X

http://images.google.com/imgres?imgurl=http://www.jazzsemi.com/images/services/cadence_logo1.gif&imgrefurl=http://www.jazzsemi.com/services/partners/cadence.shtml&h=138&w=280&sz=5&hl=en&start=1&tbnid=n4WQCNjZ-38tKM:&tbnh=56&tbnw=114&prev=/images?q=cadence+logo&svnum=10&hl=en

http://images.google.com/imgres?imgurl=http://www.swdinc.com/images/Delphi%20Logo.gif&imgrefurl=http://www.swdinc.com/dip_spin_specifications.htm&h=96&w=192&sz=3&hl=en&start=4&tbnid=1BFc3BLdQmvZeM:&tbnh=52&tbnw=103&prev=/images?q=delphi+logo&svnum=10&hl=en

http://images.google.com/imgres?imgurl=http://www.cellmaking.com/images/cell_phone_logos/texas-instruments.jpg&imgrefurl=http://www.cellmaking.com/cell_phone_brand_logos.html&h=160&w=200&sz=7&hl=en&start=1&tbnid=-1cY3MH1qEOLPM:&tbnh=83&tbnw=104&prev=/images?q=texas+instruments+logo&svnum=10&hl=en&sa=X

http://images.google.com/imgres?imgurl=http://www.iamjoshbrown.com/blog/wp-content/uploads/2007/01/DIRECTV.jpg&imgrefurl=http://www.iamjoshbrown.com/blog/2007/01/12/direct-tv-evil-empires-something-worse-than-wal-mart/&usg=__zegoP5a2X8KTc_f_UXZXzcwtH5g=&h=497&w=664&sz=105&hl=en&start=2&sig2=D5t7SaTR__5qwKxOBmgmJg&um=1&itbs=1&tbnid=Ll-sUrpjkNapuM:&tbnh=103&tbnw=138&prev=/images?q=directv&hl=en&rls=com.microsoft:en-us:IE-SearchBox&sa=N&um=1&ei=og0oS5K0GJWvlAeJ_oiVDQ

http://images.google.com/imgres?imgurl=http://www.mediabistro.com/news/original/GE%20Logo.jpg&imgrefurl=http://www.mediabistro.com/news/newsfeed/the_morning_newsfeed_081309_124251.asp&usg=__DmYTdmVzDIYkWfRsrWkNoxQmnC4=&h=250&w=250&sz=19&hl=en&start=1&um=1&itbs=1&tbnid=EFtg0twRh4QqHM:&tbnh=111&tbnw=111&prev=/images?q=general+electric+logo&um=1&hl=en&rls=com.microsoft:en-us:IE-SearchBox&tbs=isch:1

http://images.google.com/imgres?imgurl=http://www.mikesappliances.co.uk/images/Bosch-Logo-1.jpg&imgrefurl=http://www.mikesappliances.co.uk/&usg=__XfxhyZ2Aj8xSIzegkAmjEYJd-tM=&h=286&w=1000&sz=42&hl=en&start=2&um=1&itbs=1&tbnid=YMxBIsC8Kk3KHM:&tbnh=43&tbnw=149&prev=/images?q=bosch+logo&um=1&hl=en&sa=X&rls=com.microsoft:en-us:IE-SearchBox&tbs=isch:1

Greg Maxey - Electric Cloud - Process as Code: An Introduction to the ElectricFlow Automation DSL

Software

Transcript of Greg Maxey - Electric Cloud - Process as Code: An Introduction to the ElectricFlow Automation DSL