ActiveEon - Automate, Accelerate, Scale

29
Automate Accelerate & Scale IT for business Paris, Lyon, Sophia Antipolis, Sofia (Bulgaria), San Jose (USA)

Transcript of ActiveEon - Automate, Accelerate, Scale

Page 1: ActiveEon - Automate, Accelerate, Scale

Automate Accelerate & Scale

IT for business

Paris, Lyon, Sophia Antipolis, Sofia (Bulgaria), San Jose (USA)

Page 2: ActiveEon - Automate, Accelerate, Scale

ActiveEon is an Open Source ISV providing workload automation, digital transformation and virtualization solutions for business.Simulation, Big data & Automation generate the need for distributed, scheduled & parallelized workflows to create enterprise differentiation accelerating the Go-To-Market.Our ProActive solution include 3 products:• Workflows & Scheduling

A complete workload scheduler featuring a workflow orchestrator and a resource manager.

• Cloud AutomationAutomate the deployment and management of complex multi-VMs applications, including SDN.

• Parallel Scientific ToolboxToolboxes that allow the distribution and the acceleration of R Language, Spark, Hadoop, Matlab, Scilab.

Mission

Page 3: ActiveEon - Automate, Accelerate, Scale

Licensing, Support, Subscription

for Usage in Production

All the services you need

Consulting & Training

Integration & Development

Partnerships

Page 4: ActiveEon - Automate, Accelerate, Scale

Investors

PACA is the investment fund for regional co-

investment created in 2010 by the Provence

Alpes Côte d'Azur region to support the

emergence and development of local innovative

companies. This SAS, with 19.45 M €, was

supported Europe through funds Feder

(European regional development fund) for 50%

of its capital. Since July 2011, the fund, whose

management was entrusted to Turenne Capital,

has already invested in 24 innovative regional

companies for a total amount of € 8.9 million.

BA06 Accompaniment and 06 venture capital

funds Entrepreneurial Fund was created at the

initiative of the UPE06 (MEDEF, CGPME) to

meet a critical need, namely to enable the wealth

of creativity high potential of 06 to grow by

combining the winner Support / Equity couple

with contractors for creative entrepreneurs.

The Kima Ventures fund was created in 2010 by

Xavier Niel, founder of Iliad-Free and Jérémie

Berrebi, creator of Net2one.com to support

entrepreneurs. Its objective is to finance

innovative companies worldwide. Kima Ventures

promotes the growth of startups, supporting them

quickly and efficiently: financing of boot, pooling of

resources and access to a network of partners

and relationships in the world. Kima Ventures

invests in projects that meet a need and have a

realistic business model.

Nestadio Capital is an independent asset

management company approved by the FMA

(Financial Markets Authority) and created by

Florent de Kersauson. It manages FIP investing in

regional SMEs in Bretagne, Pays de la Loire,

Normandie and Poitou Charentes and FCPI

investing in European startups to global potential.

Nestadio Capital is today the only company to

have formed a strategic partnership with Microsoft

equity. It also launched the Silicon Valley Zgarage

acceleration program to help startups to invest in

the U.S. market.

Page 5: ActiveEon - Automate, Accelerate, Scale

Customers

Information

Technologies

Bio Tech

& HealthFinanceEngineering Aeronautics Energy

& Space

Media

Distribution,

IoT

Some Partners:

Page 6: ActiveEon - Automate, Accelerate, Scale

From Workflows to Scheduling to Hybrid Cloud Resources

Local machine

NetworkResources

BatchSchedulers

Clouds

Slurm

SGE

PBS

Multi Platforms

Processing & Automation Workflows

Scheduler

& Orchestration

Resource Management & Monitoring

Priority& Planning

ParallelExecutions

Error Managemen

t

MultiUsers

AnyLanguage

Secured Data Transfers

Third-partSchedulers

Services Chaining& Integration

Market ETL, ERP...

LSF

Page 7: ActiveEon - Automate, Accelerate, Scale

Workload management and Hybrid Cloud

SQL

AmazonRedshift

ProActiveAmazon EC2

AmazonCloudFront

AmazonRDS

ProActiveOn-Premise

AmazonS3

HT

TP

S

Planned

Workflows

CALENDAR

Page 8: ActiveEon - Automate, Accelerate, Scale

ProActive

Workflows & Scheduling

Why Scheduling ?Do more with less resources

Without ProActive

With ProActiveRoI = time + $

Page 9: ActiveEon - Automate, Accelerate, Scale

Synchronize and dispatch your workloads

Agents

Workflows & SchedulingArchitecture

Interfaces

</>

Workflow Studio Jobs console Resource Manager CLI, REST API & SDK

Open REST API

Workflows

Resource Manager

Scheduler & Orchestrator

MonitoringResource

ControlNode

Resource

Policies

Cloud

ConnectorsPlacement

Workflow

Mode

Script

EnginesDataspaces

Scheduling

PoliciesError

Management

Control &

Priorities

Page 10: ActiveEon - Automate, Accelerate, Scale

Control behavior on tasks or resource failure

Fix issue offline and retry task execution

Tasks can automatically be rescheduled in case of failure

Get email notification on task or job failure

ProActive - Fault toleranceoverview

Reschedule

Page 11: ActiveEon - Automate, Accelerate, Scale

From Workflow Studio or API,specify an On Task Error Policy:• At job level, to set a general behavior• At task level, to set a specific behavior

for a particular task

Select your policy of choice:• Cancel job• Pause task• Pause job• Continue execution

Then in case of task error,scheduler portal allows to:• Restart all In Error tasks for a job• Restart a single task

ProActive - Fault tolerancePause execution on error

1

2

3

Control your job behaviorin case of a task failure

Page 12: ActiveEon - Automate, Accelerate, Scale

Part of a workflow keeps on runningwhile an error occurred in a branch

ProActive - Fault toleranceKeep running in case of failure

Page 13: ActiveEon - Automate, Accelerate, Scale

ProActive Workflow Studio

Create workflows with heterogeneous tasks

Compose and chain applications with templates

Page 14: ActiveEon - Automate, Accelerate, Scale

Monitor applications and platform

Task• State (pending, running, faulty, done)

• Duration / Date

Job• Owner / Group• State• Duration / Date

Platform• Resource usage• Resource states

Your own application metric• From JMX / REST / Flat File

Through JMX, REST, WebUIExport task/job info in CSVExport platform info to Nagios

ProActiveMonitoring

Page 15: ActiveEon - Automate, Accelerate, Scale

Scheduler + All Calendar integration :• See the Scheduler Jobs in all your Calendars • Modify Job planning from all interfaces• Benefit from Automatic Synchronization between all interfaces

ProActiveCalendar Integration

Page 16: ActiveEon - Automate, Accelerate, Scale

ProActive Parallel

Scientific ToolboxWhy Scheduling ?Do more with less resources

Without ProActive

With ProActiveRoI = time + $

Page 17: ActiveEon - Automate, Accelerate, Scale

ProActive for Big DataGeneral Architecture

Interfaces

Automated Management & Monitoring of Applications and Services

</>

ProActive Toolbox Admin console Resource Manager CLI, REST API & SDK

Open REST API

Big Data Platforms

Integration for hybrid Big Data platforms

ProActive Cloud Watch .

Monitoring and Complex Event Processing (CEP)

ProActive Toolboxes

Control from scientific softwares

ProActive Cloud Connectors

Azure, AWS, IBM Bluemix, Google CE,

VMware, OpenStack, Docker, Kubernates

Page 18: ActiveEon - Automate, Accelerate, Scale

Big Data: On-Demand Hadoop, Spark & Flink with ActiveEon Cloud Automation

DA

TA

Anonymization

Identification

Correlation

Native Containers VMs Clouds

Knowledge

ProActive Resource Manager

Pro

Ac

tive

Au

tom

ati

on

Metrics

ProActive

WorkflowsIT Workload

Logs

Control & algorithms

ProActive

Automation

Actions

Files

Events

Page 19: ActiveEon - Automate, Accelerate, Scale

ProActiveDomain Specific Portals

Expose a domain specific portalto drive users to run their applications

Page 20: ActiveEon - Automate, Accelerate, Scale

ProActive

Cloud Automation

Page 21: ActiveEon - Automate, Accelerate, Scale

ProActive Cloud AutomationGeneral Architecture

Interfaces

Automated Management & Monitoring of Applications and Services

</>

User portal Admin console Workflow Studio CLI, REST API & SDK

Open REST API

Cloud Automation Service

Application & Service Manager

ProActive Cloud Watch .

Monitoring, rules and event correlation (CEP)

ProActive Workflow Catalog

Catalog of Services, Applications and Lifecycles

ProActive Cloud Connectors

Azure, AWS, IBM Bluemix, Google CE, VMware, OpenStack,

Docker, Kubernates

Page 22: ActiveEon - Automate, Accelerate, Scale

ProActive Cloud AutomationPortal

Page 23: ActiveEon - Automate, Accelerate, Scale

Organize your services into a catalog

and have your own marketplace

Deploy them on premise or in the cloud

with a single click

Cloud Automation: On-Demand Multi-Level Services

Page 24: ActiveEon - Automate, Accelerate, Scale

Cloud AutomationArchitecture with AWS

Interfaces

Integrate your workloads and dispatch them everywhere

</>

Workflow Studio Jobs console Resource Manager CLI, REST API & SDK

Open REST API

AmazonRedshift

ProActiveEC2

AmazonCloudFront

AmazonSQS

ProActiveOn-Premise

AmazonVPC3rd party

Service

Page 25: ActiveEon - Automate, Accelerate, Scale

Scalability & Performances

10 K Nodes

20 K Tasks

1 M Jobs

Page 26: ActiveEon - Automate, Accelerate, Scale

The scheduler/Resource manager is in capacity to dispatch workload

on 100 % of the nodes up to at least 10 000 nodes, and the CPU &

Memory consumption are reasonable and not an issue.

Scalability: 10 K Nodes

Page 27: ActiveEon - Automate, Accelerate, Scale

The Scheduler/Resource manager is in capacity to execute 20 K

Tasks with a neglectable and linear overhead.

Scalability: 20 K Tasks

27

Page 28: ActiveEon - Automate, Accelerate, Scale

Scheduler / Resource manager validated with at least 1

Million Pending Jobs

Scheduling Time up to x 100 Jobs is in the range of 10

ms.

Scheduling Time at 1 Million Pending Jobs is in the

range of 10 s (typically 4 seconds).

Scalability: 1 M. Jobs

Page 29: ActiveEon - Automate, Accelerate, Scale

@activeeon

[email protected]

+33 988 777 660Activeeon SASParis, Sophia Antipolis &

Worldwide on Azure Clouds, IBM Bluemix,

and with all our Partners

Automate Accelerate & Scale

IT for business