Active Commerce Product Build Automation - …€¦ · Active Commerce Product Build Automation ......

Active Commerce Product Build AutomationNick Wesselman

April 26, 2016

“Anything is possible with enough time and

PowerShell.”

• What is Active Commerce?

• Goals and challenges of automating our product builds

• How we did it

• What does it look like

Agenda

What is Active Commerce?

Native Sitecore E-commerce

Quick to Market via Theming

Flexible Architecture

Integration and Extension

Targeted at the Mid-market

Oracle/ATG

B2C B2B

SAP/Hybris

Micros Retail

Enterprise

Demandware

Digital River

NetSuite

EPiServer

Magneto

NetSuite/Venda

Shopify

InSite

Sitecore

Commerce

Version Compatibility

Customers

Partners

UNITED STATES CANADA NORWAY

AUSTRALIA

For more information

Stop by our table during lunch or

one of the breaks today

info@activecommerce.com

http://help.activecommerce.com

Automation Challenges and

What was our product build process?

Everything in one Solution

Supporting multiple Sitecore versions

master (SC72)

master-SC75

master-SC80

• Reduce time and error setting up environments (development, testing)

• Reduce time and error creating product releases

• Support multiple versions of Sitecore without forking /branching

• Allow plugins to be versioned and released independently

• Automation of testing

Goals for Automation Project

Setup Development Environment

• One PowerShell command for any Sitecore Version

• Easily toggle between Sitecore versions

• No forking for version-specific Sitecore logic

Product and Plugin Debug Builds

• On every checkin

Setup Test Environments

• Via configuration file / PowerShell command

Desired Process

Development Environment

Product Build

Test Environment

Processes

Source

CodeLocal Install

Source

CodeBuild Install

Sitecore

Package

Sitecore

PackageTest Install

• Items are important

• Items need to be deployed

• Installing Sitecore and dependent modules

• Build dependencies / lack of Sitecore nuget

• Maintenance tasks (publishing, links database, index rebuild)

Challenges – Sitecore build automation

• Supporting and testing on multiple versions of Sitecore

• Creating Sitecore Zip packages for product installation

• Additional installation steps

• Plugin builds that are dependent on product builds

• Integration tests (NUnit Web Test Runner)

Challenges – Active Commerce build automation

How we did it(and what it can

do for you)

Visual Studio

MSBuild

Team Development for Sitecore

NUnit Web Test Runner

PowerShell

Octopus Deploy

Azure Virtual Machines

Azure Blob Storage

Atlassian Bamboo

PowerShell

ProGet

SlowCheetah

Sitecore Instance Manager

Sitecore PowerShell Extensions

PowerShell

How we use it

• Separate solution for core product and each plugin

• Nuget for all dependencies

• Build properties for Sitecore version differences, populated by PowerShell scripts

• “Templated” solution structure for all plugins

What it can do for you

• Simplify dependency management via nuget

• Automate build activities using MSBuild

Tools – Visual Studio, Nuget and MSBuild

Using Build Properties

How we use it

• Source control of serialized items

• Building Update Packages for environment setup and product builds

• Dev Root > Web Root Builds

• Codegen of content Templates for Glass Mapper

• Allow distributed Sitecore development

• Automatic and GUI-based item synchronization with your Visual Studio solution

• Environment configuration replacement / management

• Automated validations against checked in templates and items

• Post-deployment operations (Publish, Links database, reindexing)

• Item merging

• Content file sync

• And much more…

Tools – Team Development for Sitecore

How we use it

• Private nuget repository for Sitecoreassemblies and other dependencies not on public nuget servers

• Debug and release product build references for plugins

• Symbol server for debugging product issues with plugins

• Version-specific Sitecore files and Web.config

• Used with a customized Sitecore NugetPackage Generator (Alen Pelin)

• Internal nuget server (or npm, or Bower, or chocolatey…)

Tools – ProGet

Nuget Packages

How we use it

• Transform base Sitecore Web.config to a Web.config with Active Commerce additions for specific Sitecore versions

• Transform Active Commerce configuration files for specific Sitecore versions

• Transform Sitecore + Active Commerce Web.config with plugin-specific adds

• XDT transforms for any config file

• Transform “unpatchable” base SitecoreWeb.config with your additions, before adding build-specific XDT transforms

Tools – SlowCheetah

SlowCheetah Use

How we use it

• Execute NUnit tests with a full Sitecore and HTTP context

• Some legacy tests that should become unit tests

• Some Sitecore/SES dependencies that make unit testing difficult

• Some true integration tests

• Results available as JSON – pull in via NUnitTestCaseSource

• Run integration tests

• Test code w/ Sitecore dependencies when FakeDB or similar tools not possible/practical

Tools – NUnit Web Test Runner

JSON Test Results

How we use it

• Invoke via custom PowerShell wrapper to create Sitecore instances for development, product build, and testing

• Install Sitecore Zip packages

• Customize SIM pipelines with PowerShell-based steps

• Redirect SIM output to the shell

• Manage Sitecore instances

• Install Sitecore Zip packages

• Backup/Restore Sitecore instances

• Export/Import Sitecore instances

• Tail Sitecore logs

• Generate Sitecore nuget packages

• Install MongoDB

• and more…

Tools – Sitecore Instance Manager

Wrapping and Extending SIM

• Invoking SIM classes directly

• Initializing SIM without its GUI

• Passing data to SIM steps via environment variables

• Deleting / cleaning up instances requires extra work

CAUTION: This turned out pretty hacky

How we use it

• SPE Remoting allows us to execute logic on a remote Sitecore instance

• Publishing

• Links DB Rebuild

• Index Rebuilds

• Initializing the Active Commerce database

• Script-based builds of Sitecore Zip packages

• Change your life

• Content maintenance / manipulation

• Custom reporting

• Data exports / imports

• Content Editor extensions (context menu, ribbon buttons, gutter…)

• Automation of almost anything inside Sitecore

Tools – Sitecore PowerShell Extensions

Sitecore PowerShell = MAGIC

How we use it

• Package our automation scripts, SIM, and build artifacts

• Securely deploy to product build or test environment using “tentacles” installed on the servers

• Invoke a deployment PowerShell script to create the environment

• Monitor script output

• Deployment automation

• Continuous Deployment

• Automate IIS and much more

• Blue-green deployment

• Integrate with your existing build system

Tools – Octopus Deploy

How we use it

• VMs for product build and test environments

• Multiple environments per VM

• Scripted to shut down / start up only during business hours

• Install and run Sitecore from Temporary Storage (much faster)

• VM option when you can’t run PaaS

Tools – Azure Virtual Machines (IaaS)

How we use it

• Cloud file storage for build dependencies and artifacts

• Sitecore and module installers, license files

• Base product Sitecore Zip packages (debug and release)

• Plugin Sitecore Zip packages (debug and release)

• AzCopy provides scriptable upload/download including delta synchronization

• Serving images or documents directly to a browser

• Storing files for distributed access

• Streaming video and audio

• Performing secure backup and disaster recovery

• Storing data for analysis by an on-premises or Azure-hosted service

Tools – Azure Blob Storage and AzCopy

How we use it

• Glue everything together

• Functions for common developer tasks, build steps

• Structured into a PowerShell Module

• Scripts managed in their own git repository

• PowerShell Tools for Visual Studio

• JSON files for global and instance configuration

• What can’t it do?

Tools – PowerShell PowerShell PowerShell

JSON Configuration

How we use it

• Triggered and scheduled builds

• Most steps just execute PowerShell

• Build dashboard

• Build reports in HipChat

• A nice build / continuous integration server if you are already drinking the Atlassian kool-aid

Tools – Atlassian Bamboo

What’s it look like?

Setup a new development environment for a Sitecore version

Initialize-AcDev -SitecoreVersion 8.1

Switch the active Sitecore version

Switch-SitecoreVersion -SitecoreVersion 7.2

The same for plugins

Initialize-AcPluginDev -ActiveCommerceVersion 3.3 -SitecoreVersion 8.1

Switch-AcPluginVersion -ActiveCommerceVersion 3.3 -SitecoreVersion 7.2

Install a new Active Commerce instance based on a predefined config

New-AcInstance -ConfigPath .\AC33SC81.json -InstanceName Sherpa

PowerShell Commands

Development Environment

Product Build in Bamboo

Test Environment Setup

• TeamCity (Build templates for plugins)

• Enhance SIM for easier scripting

• Move version-specific Sitecore logic to its own assembly

• Docker containers for product builds

• Selenium integration tests

Future Improvements

Acknowledgements

Pavel Veller

Brian Beckham

Adam Najmanowicz

Michael West

Vincent Séguin

Alen Pelin

Alexander Doroshenko

Jorge Lusar

Sean Kearney

Charles Turano

Alex de Groot

and more…

Thank you!

nw@activecommerce.com

@techphoria414

www.techphoria414.com

Active Commerce Product Build Automation - …€¦ · Active Commerce Product Build Automation ......

Documents

Transcript of Active Commerce Product Build Automation - …€¦ · Active Commerce Product Build Automation ......

The Conversational Commerce Platform Designed to Sell · Balancing Automation and the Human Touch // We build the right solution for you and your customers, combining Automation AI

Build your own MAD-LAB - for Mobile Test Automation

End To End Build Automation With Team Build

Profitable Ways to Build Links to E Commerce Websites

Simplifying Build Scripts With Gradle [Groovy based build automation]

Build Automation Epic’s Build Tools & Infrastructure Gerke Max Preussner max.preussner@epicgames.com.

Enterprise Automation: Canonical Automation for the€¦ · 1. System Automation – Back Up / Perforce Check-Points – ‘Nightly Build’ Feedback – Manufacturing Support 2.

Future Proofing your Marketing Automation: Build vs Buy

XPages build automation and testing

Build Cross-border E-commerce Overseas warehouse …

Implementation of an e-Commerce System for the Automation ...

Linc - Customer Care Automation - Grow Commerce Presentation

DevOps – IIB continuous build and deploy automation using ... · 1 DevOps – IIB continuous build and deploy automation using GitHub, Jenkins and JFrog Artifactory. Surendrakumar

Team Foundation Server Build Automation

AUTOBUILD Build and Deployment Automation Solution.

BUILD YOUR OWN RTL TOOLS - Verific Design Automation

II - Build Automation

Ministry of Commerce - CO Automation

BOSE - Josh Steckler - Automating Automation: Build environments, on-demand

Build Automation for Mobile