Building Universal Servers (On-prem meets Azure PAAS)

Automating visual software testing

BUILDINGUNIVERSALSERVERSON-PREM MEETS AZURE PAAS

Adam CarmiApplitools Co-Founder & CTO


ABOUT ME


AGENDA

• About Applitools

• Why Azure?

• Applitools’ universal server

• Q&A


WHAT IS VISUAL TESTING?

A quality assurance activity aimed to verify that a Graphical User Interface appears correctly to users


THE WORKFLOWDrive the AUT and take screenshots

Compare screenshots with baseline images

Report differences

Update the baseline


DEMO


AGENDA


• Why Azure?


• Q&A


OPERATIONAL REQUIREMENTS• A 30K tenant public cloud• 5M CPU and memory intensive tests / month• Multiple single tenant dedicated clouds• On-Prem installations• Massive image uploads that are rarely fully downloaded• 1Y data retention• Permanent availability• Growing 50% Q/Q


SYSTEM ARCHITECTURE

API Server

Tests, Image processing, Tasks, Auth, Admin, Externals, App

APP Server

Tests, Image processing, Tasks, Auth, Admin, Externals, App

SDK

Data+

State

Eyes Server (On-Prem / Azure Web-Role) User

APP

Tests


AZURE WEB-ROLEA collection of identical, auto-managed, load-balanced VMs that run IIS compatible web-applications• Same web-apps (binaries and resources)

• Same configuration


WHY AZURE WEB-ROLE?• Infinite scale and high availability• Extremely reliable• No hardware / OS maintenance concerns• Rolling deployments• Immediate emergency rollback to staging• A thin wrapper around a standard IIS web-site (VS Project)• .NET


AGENDA


• Why Azure?


• Q&A


APPLITOOLS’ UNIVERSAL SERVER• Design• Deployment• Runtime• Storage• Framework• Testability


DESIGN TOWARDS THE WEB-ROLE• Multiple stateless instances (scale-out, rolling

upgrades)• Optimistic concurrency and eventual consistency• Data partitioning• Automatic instance recycling• Transient local storage• Async long running tasks (hard timeouts)


BUT DEPEND ON AS FEW PAAS ARTIFACTS AS POSSIBLE...In order to keep the On-Prem deployment simple.


ON-PREM DEPLOYMENT


CLOUD-SERVICE DEFINITION

Packaging


• Deployed together with a cloud-service package• Initial instance count

• SSL certificate

• Configuration settings

CLOUD-SERVICE CONFIGURATION


PUBLISHING OPTIONS• Visual Studio• Azure management portal• REST APIs• Programmatically• Azure PowerShell


RUNTIME ABSTRACTION

IServiceRuntime• Access configuration settings

• Access local file storage paths

• Get the instance name (for logging)

• Register runtime event listeners


NOSQL?• Infinite storage• High availability• Speed• Pricing• No schema migration


NOSQL STORAGE ABSTRACTIONS

IObjectStore<T>, IByteStore, …

• Key/value based

• Atomic update/create with optimistic concurrency

• In-memory, File System, Entity Framework, Azure Table, Azure Blob implementations


STORAGE CONFIGURATIONWeb-Role

On-Prem


FRAMEWORK SERVICES

• Framework services are built on top of the storage abstraction• Access control

• Counters

• Named locks

• Notifications

• Long running tasks


TESTABILITY• Run any version of the server on your local machine

with a simple SVN update command.• Execute thousands of API tests in less than a minute by

using in-memory storage.• Easily debug local code changes step-by-step running

against production data.


SUMMARYUniversalScaleAvailabilityDeploymentTestabilityCost (storage)×Design complexity (storage, PaaS services)


QUESTIONS?

Adam CarmiApplitools Co-Founder & CTO

Building Universal Servers (On-prem meets Azure PAAS)

Software

Transcript of Building Universal Servers (On-prem meets Azure PAAS)