Webinar #10 - 19 April 2017 Isolates in the Cloud · Webinar #10 - 19 April 2017 Isolates in the...

Webinar #10 - 19 April 2017Isolates in the Cloud

Agenda

Agenda Quick introduction to Futures and

Isolates

Isolates Building and launching a Linux VM

with Dyalog APL on the Amazon Elastic Compute Cloud (EC2)

Isolates Building and launching a Linux VM

Starting 20 VM's and using them as isolate servers

Agenda Quick introduction to Futures and Isolates Building and launching a Linux VM

A quick demo of parallel each (ll.EachXin the isolate workspace since 16.0).

Quick Introduction to Isolates

iss←isolate.New¨3⍴⊂''

An isolate looks, tastes, and feelslike a namespace, except thatEach isolate appears as an extension of the workspace,but exists in a separate process.iss is a 3-element vector ofreferences to three isolates.

iss←isolate.New¨3⍴⊂''iss.X←(1 2 3) (4 5) 6

X←1 2 3

X←4 5

iss←isolate.New¨3⍴⊂''iss.X←(1 2 3) (4 5) 6

X←1 2 3

X←4 5

iss.((+⌿ ÷ ≢) X)iss.X←(1 2 3) (4 5) 6

X←1 2 3

X←4 5

iss.((+⌿ ÷ ≢) X)iss.X←(1 2 3) (4 5) 6

2 4.5 6

Isolate Demo

A 2-Core Computer

How isolates work

A DyalogApplication

Dyalog ProcessesComputers

A 2-Core Computer

How isolates work

A DyalogApplication

iss←isolate.New¨4⍴⊂⍬

A 2-Core Computer

How isolates work

A DyalogApplication

IsolateProcess 1

IsolateProcess 2

A 2-Core Computer

How isolates work

A DyalogApplication

IsolateProcess 1

IsolateProcess 2

TCP Sockets

A 2-Core Computer

How isolates work

A DyalogApplication

IsolateProcess 1

IsolateProcess 2

Isolate 1

Dyalog Processes Namespaces

Computers

TCP Sockets

A 2-Core Computer

How isolates work

A DyalogApplication

IsolateProcess 1

IsolateProcess 2

Isolate 1

Isolate 2

Computers

TCP Sockets

A 2-Core Computer

How isolates work

A DyalogApplication

IsolateProcess 1

IsolateProcess 2

Isolate 1

Isolate 2

Computers

TCP Sockets

Isolate 3

A 2-Core Computer

How isolates work

A DyalogApplication

IsolateProcess 1

IsolateProcess 2

Isolate 1

Isolate 2

1 2 3 4

Computers

TCP Sockets

Isolate 3

Isolate 4

A 2-Core Computer

How isolates work

A DyalogApplication

IsolateProcess 1

IsolateProcess 2

Isolate 1

Isolate 2

1 2 3 4

Computers

Another Computer

TCP Sockets

Isolate 3

Isolate 4

A 2-Core Computer

How isolates work

A DyalogApplication

IsolateProcess 1

IsolateProcess 2

Isolate 1

Isolate 2

1 2 3 4

Computers

Another Computer

TCP Sockets

Isolate 3

Isolate 4

StartServer 'ip=10.0.0.1'

A 2-Core Computer

How isolates work

A DyalogApplication

IsolateProcess 1

IsolateProcess 2

Isolate 1

Isolate 2

1 2 3 4

Computers

Another Computer

IsolateProcess 1

IsolateProcess 2 iss←isolate.New¨4⍴⊂⍬

TCP Sockets

Isolate 3

Isolate 4

A 2-Core Computer

How isolates work

A DyalogApplication

IsolateProcess 1

IsolateProcess 2

Isolate 1

Isolate 2

1 2 3 4

Computers

Another Computer

IsolateProcess 1

AddServer '10.0.0.2'

TCP Sockets

Isolate 3

Isolate 4

A 2-Core Computer

How isolates work

A DyalogApplication

IsolateProcess 1

IsolateProcess 2

Isolate 1

Isolate 2

1 2 3 4

Computers

Another Computer

IsolateProcess 1

TCP Sockets

Isolate 3

Isolate 4

A 2-Core Computer

How isolates work

A DyalogApplication

IsolateProcess 1

IsolateProcess 2

Isolate 1

Isolate 2

1 2 3 4

Computers

Another Computer

IsolateProcess 1

TCP Sockets

Isolate 3

Isolate 4

Isolate DemoFor more on isolates, see for example

"Parallel Programming in Dyalog APL"https://dyalog.tv/Dyalog14/?v=JvLWvyG7JEs

Agenda Quick introduction to isolates Building and launching a Linux VM

A quick demo of ll.EachX

Create an Amazon Machine Image (AMI)

Create an Amazon Machine Image (AMI) Select a base AMI with Ubuntu Linux installed

Create an Amazon Machine Image (AMI) Select a base AMI with Ubuntu Linux installed Configure Firewall

Create an Amazon Machine Image (AMI) Select a base AMI with Ubuntu Linux installed Configure Firewall Launch the VM

Create an Amazon Machine Image (AMI) Select a base AMI with Ubuntu Linux installed Configure Firewall Launch the VM Use WinSCP to copy Dyalog installer

Create an Amazon Machine Image (AMI) Select a base AMI with Ubuntu Linux installed Configure Firewall Launch the VM Use WinSCP to copy Dyalog installer Install Dyalog APL

Create an Amazon Machine Image (AMI) Select a base AMI with Ubuntu Linux installed Configure Firewall Launch the VM Use WinSCP to copy Dyalog installer Install Dyalog APL Use SSH to start Dyalog APL

Create an Amazon Machine Image (AMI) Select a base AMI with Ubuntu Linux installed Configure Firewall Launch the VM Use WinSCP to copy Dyalog installer Install Dyalog APL Use SSH to start Dyalog APL Connect to it with RIDE

Create an Amazon Machine Image (AMI) Select a base AMI with Ubuntu Linux installed Configure Firewall Launch the VM Use WinSCP to copy Dyalog installer Install Dyalog APL Use SSH to start Dyalog APL Connect to it with RIDE Save the new AMI

+ Max 20 simultaneous instances

Isolates in the CloudDyalog Processes NamespacesComputers

SSH SessionsTCP Sockets

A Windows Computer

Isolates in the CloudDyalog Processes NamespacesComputers

A Windows Computer

Isolates in the CloudA Dyalog

Application

Dyalog Processes NamespacesComputers

A Windows Computer

Application

SSH Sessions

IsolateProcess

TCP Sockets

A Windows Computer

Application

SSH Sessions

IsolateProcess

TCP Sockets

A Windows Computer

Application

SSH Sessions

IsolateProcess

TCP Sockets

A Windows Computer

Application

SSH Sessions

IsolateProcess

TCP Sockets

A Windows Computer

Application

Computers

SSH Sessions

IsolateProcess

TCP Sockets

A Windows Computer

Application

Computers

SSH Sessions

IsolateProcess

TCP Sockets

A Windows Computer

Application

Computers

SSH Sessions

IsolateProcess

TCP Sockets

A Windows Computer

Application

Computers

SSH Sessions

IsolateProcess

TCP Sockets

A Windows Computer

Application

Computers

SSH Sessions

IsolateProcess

TCP Sockets

A Windows Computer

Application

Computers

SSH Sessions

IsolateProcess

Two Per VM

TCP Sockets

A Windows Computer

Application

Computers

An AWS EC2 Linux VMStartServer 'ip=81.187.219.129'

SSH Sessions

IsolateProcess

Two Per VM

TCP Sockets

A Windows Computer

Application

Computers

An AWS EC2 Linux VM

IsolateProcess

SSH Sessions

IsolateProcess

Two Per VM

TCP Sockets

Another VMAnother VMAnother VMAnother VMAnother VMAnother VMAnother VMAnother VMAnother VMAnother VMAnother VMAnother VMAnother VMAnother VMAnother VMAnother VMAnother VMAnother VMAnother VMAnother VM A Windows Computer

Application

Computers

An AWS EC2 Linux VM

IsolateProcess

SSH Sessions

IsolateProcess

Two Per VM

TCP Sockets

Application

Computers

An AWS EC2 Linux VM

IsolateProcess

SSH Sessions

IsolateProcess

21 22 23 24

17 18 19 20

13 14 15 16

9 10 11 12

5 6 7 8

Two Per VM

TCP Sockets

Application

Computers

An AWS EC2 Linux VM

IsolateProcess

SSH Sessions

IsolateProcess

21 22 23 24

17 18 19 20

13 14 15 16

9 10 11 12

5 6 7 8

Two Per VM

TCP Sockets

Summary Dyalog is creating tools, frameworks and samples

for distributed / cloud computing, including• APLSSH client to securely start processes on remote machines• Running Isolates in the Cloud• Microservice Frameworks (e.g. JSONServer)• Docker / Container tools

DAAAS (Dyalog APL As A Service) coming soon• We will publish "premium" AMI's with Dyalog APL,

JSONServer and MiServer pre-installed• Pre-build Docker containers with Dyalog installed• Hardest problem is to decide on pricing

We aim to publish a reference architecture for scalable services.

Webinar 11 Thursday, May 17th at 15:00 UTC:

Creating and managing your own User Commands

Webinar #10 - 19 April 2017 Isolates in the Cloud · Webinar #10 - 19 April 2017 Isolates in the...

Documents

Transcript of Webinar #10 - 19 April 2017 Isolates in the Cloud · Webinar #10 - 19 April 2017 Isolates in the...

I-205 Toll Projects Webinar Presentation€¦ · Agenda Agenda Review and Webinar Tips Project Overview Equity for Toll Projects I-205 Toll Project Environmental Review I-205 Screening

Identification and Characterization of Salmonella Isolates ...isolates of Salmonella were obtained from the microbiology laboratory of a local broiler-chicken processor. Isolates were

National Webinar to Review Non-Discussion Agenda

2016 Orientation Webinar Stand Against Racism. Stand Against Racism Webinar Agenda Introduction History/Purpose/Goals…

Indo UK Webinar Agenda - asgct.org

SHARED AGENDA FOR SOCIAL AND BEHAVIOR CHANGE WEBINAR … · 2020. 1. 21. · SHARED AGENDA FOR SOCIAL AND BEHAVIOR CHANGE WEBINAR SERIES Increasing Coordinated Investment in Social

Pre-application Webinar Agenda PAR-13-029 Slides€¦ · NIH efforts to enhance the translation of basic ... Pre-application Webinar Agenda PAR-13-029 Slides

OPAC COMMITTEE AGENDA Webinar February 24, 2016 · OPAC COMMITTEE AGENDA Webinar February 24, 2016 ... ADOPT AGENDA ─ Moved by Joyce Fischer, ... Introduction to Jody Thomas, ...

InFire HTC speed Furnace Webinar. Webinar Agenda Features and Differences Installation Operation Support Topics.

Agenda for today’s webinar - Key Business Advisors€¦ · Agenda for today’s webinar Housekeeping In today’s webinar you will discover the following: Topic 1. Your obligation

Coronavirus Guidance Webinar · Webinar 29th April, 2020 The webinar will be starting shortly. Agenda • Poll • CBI Update • Testing • State of Trade Survey • Frank Elkins,

BJA NTTAC Justice Community Webinar: Crime Analysis · BJA NTTAC JUSTICE COMMUNITY WEBINAR AGENDA 2 Time Agenda Item 1:00 p.m. –1:05 p.m. Introduction ... • Prepare reports on

Webinar - REPPrepp.energy/wp-content/uploads/2018/12/Webinar... · Webinar. Agenda Welcome and introduction to AMDA Introduction to REPP Overview of IFC Performance Standards ...

Trichomonas vaginalis Isolates

TC and TIG public meeting presentation template · Data Collection Efforts: ... Group webinar Webinar ID: 290-145-947 Gorowebinar Webinar Participation . Today's Agenda . OF sr4È

Marine Industry Cluster Webinar Agendamiasf-member-mgt-center.wildapricot.org › Resources › Florida...0 Marine Industry Cluster Webinar Agenda Introduction to Webinar on Marine

2013 Consumer & Commercial Product Survey Consumer & Commercial Product Survey Webinar: October 15, 2014 Webinar Agenda ...

Webinar. Agenda Review of Webinar norms and tools Questions.

Phyto62n07 731 - APS Home...Berkeley pea isolates, three Japanese pea isolates, eight mulberry branch isolates of F. solani f. sp. pisi, and four ginseng root isolates were tested.

Chief Data Officer Agenda Webinar: How CDOs Should Work with Lawyers