Functional Programming in Serverless World€¦ · Using Node.js process API to spawn an executable...

35
Functional Programming in Serverless World Big Data Moscow 2018 (11.10.2018)

Transcript of Functional Programming in Serverless World€¦ · Using Node.js process API to spawn an executable...

Page 1: Functional Programming in Serverless World€¦ · Using Node.js process API to spawn an executable Handling events reported by subprocess and passing results to the AWS Lambda handler

Functional Programming in Serverless World

Big Data Moscow 2018 (11.10.2018)

Page 2: Functional Programming in Serverless World€¦ · Using Node.js process API to spawn an executable Handling events reported by subprocess and passing results to the AWS Lambda handler

~ # whoami (afronski)

✓ Co-founder and Functional Aficionadoat Pattern Match

Erlang, Elixir, Node.jsAWS (3 certificates)

✓ Co-organizer of Functional Miners

Page 3: Functional Programming in Serverless World€¦ · Using Node.js process API to spawn an executable Handling events reported by subprocess and passing results to the AWS Lambda handler
Page 4: Functional Programming in Serverless World€¦ · Using Node.js process API to spawn an executable Handling events reported by subprocess and passing results to the AWS Lambda handler

What is serverless?

Page 5: Functional Programming in Serverless World€¦ · Using Node.js process API to spawn an executable Handling events reported by subprocess and passing results to the AWS Lambda handler
Page 6: Functional Programming in Serverless World€¦ · Using Node.js process API to spawn an executable Handling events reported by subprocess and passing results to the AWS Lambda handler

There are servers

Page 7: Functional Programming in Serverless World€¦ · Using Node.js process API to spawn an executable Handling events reported by subprocess and passing results to the AWS Lambda handler

There are ops

Page 9: Functional Programming in Serverless World€¦ · Using Node.js process API to spawn an executable Handling events reported by subprocess and passing results to the AWS Lambda handler

Serverless

Back-end as a Service (BaaS)

Function as a Service (FaaS)

Page 10: Functional Programming in Serverless World€¦ · Using Node.js process API to spawn an executable Handling events reported by subprocess and passing results to the AWS Lambda handler

Incoming Event

Source Code Package Configuration

Function (Execution Unit)

RAM: 512 MB

RAM: 512 MB 0.5 GB

Real time: 120 msBill time: 200 ms (buckets by 100 ms)

Price: 0.00001667 GB * seconds

Cost: 0.00001667 * 0.5 GB * 0.2 s = 0.000001667 USD = 1.7 μUSD

Response

Page 11: Functional Programming in Serverless World€¦ · Using Node.js process API to spawn an executable Handling events reported by subprocess and passing results to the AWS Lambda handler

Whyserverless?

Page 12: Functional Programming in Serverless World€¦ · Using Node.js process API to spawn an executable Handling events reported by subprocess and passing results to the AWS Lambda handler

www.doc.ic.ac.uk/~rbc/papers/fse-serverless-17.pdf

Gojko Adzic - Designing for the Serverless Age (GOTO 2017)

Page 13: Functional Programming in Serverless World€¦ · Using Node.js process API to spawn an executable Handling events reported by subprocess and passing results to the AWS Lambda handler

Costs

Page 14: Functional Programming in Serverless World€¦ · Using Node.js process API to spawn an executable Handling events reported by subprocess and passing results to the AWS Lambda handler

Architecture[...] breaking the monolith into functions that could be independently deployed, meant that they were better able to split the team up to work on more things in parallel, and to deploy each feature separately.

Page 15: Functional Programming in Serverless World€¦ · Using Node.js process API to spawn an executable Handling events reported by subprocess and passing results to the AWS Lambda handler

Operations[…] so their estimate is that moving to Lambda gave an operational cost reduction of greater than 95% for a comparable amount of compute.

Page 16: Functional Programming in Serverless World€¦ · Using Node.js process API to spawn an executable Handling events reported by subprocess and passing results to the AWS Lambda handler
Page 17: Functional Programming in Serverless World€¦ · Using Node.js process API to spawn an executable Handling events reported by subprocess and passing results to the AWS Lambda handler

Technology

Page 18: Functional Programming in Serverless World€¦ · Using Node.js process API to spawn an executable Handling events reported by subprocess and passing results to the AWS Lambda handler
Page 19: Functional Programming in Serverless World€¦ · Using Node.js process API to spawn an executable Handling events reported by subprocess and passing results to the AWS Lambda handler
Page 20: Functional Programming in Serverless World€¦ · Using Node.js process API to spawn an executable Handling events reported by subprocess and passing results to the AWS Lambda handler

Shims

Using Node.js process API to spawn an

executable

Handling events reported by subprocess and passing results to

the AWS Lambda handler

Sending input arguments to the

spawned subprocess

Page 21: Functional Programming in Serverless World€¦ · Using Node.js process API to spawn an executable Handling events reported by subprocess and passing results to the AWS Lambda handler
Page 22: Functional Programming in Serverless World€¦ · Using Node.js process API to spawn an executable Handling events reported by subprocess and passing results to the AWS Lambda handler

Measurements

Page 23: Functional Programming in Serverless World€¦ · Using Node.js process API to spawn an executable Handling events reported by subprocess and passing results to the AWS Lambda handler

Test Scenarios1. Two endpoints:

a. Echoing incoming body.

b. Sieve of Eranthoses (naive implementation).

2. Package Size.

3. Memory Usage (dependent on input argument).

4. Execution Time (dependent on input argument).

5. Startup Time (cold start, no work done).

Page 24: Functional Programming in Serverless World€¦ · Using Node.js process API to spawn an executable Handling events reported by subprocess and passing results to the AWS Lambda handler
Page 25: Functional Programming in Serverless World€¦ · Using Node.js process API to spawn an executable Handling events reported by subprocess and passing results to the AWS Lambda handler
Page 26: Functional Programming in Serverless World€¦ · Using Node.js process API to spawn an executable Handling events reported by subprocess and passing results to the AWS Lambda handler

"Situated" Programs (from Rich Hickey's keynote at Clojure/Conj 2017)

Page 28: Functional Programming in Serverless World€¦ · Using Node.js process API to spawn an executable Handling events reported by subprocess and passing results to the AWS Lambda handler

Constraints

Page 29: Functional Programming in Serverless World€¦ · Using Node.js process API to spawn an executable Handling events reported by subprocess and passing results to the AWS Lambda handler

Constraints1. No knowledge about container and its reuse.

2. New approach requires new paths.

3. Limits everywhere!

4. Provider limitations.

5. VM optimizations required from the get go.

6. Beware the toolchain!

Page 30: Functional Programming in Serverless World€¦ · Using Node.js process API to spawn an executable Handling events reported by subprocess and passing results to the AWS Lambda handler

Summary

Page 31: Functional Programming in Serverless World€¦ · Using Node.js process API to spawn an executable Handling events reported by subprocess and passing results to the AWS Lambda handler

Safe default:F# on Azure or AWS

(.NET Core 2.0)

Page 32: Functional Programming in Serverless World€¦ · Using Node.js process API to spawn an executable Handling events reported by subprocess and passing results to the AWS Lambda handler

Tooling is King

Page 33: Functional Programming in Serverless World€¦ · Using Node.js process API to spawn an executable Handling events reported by subprocess and passing results to the AWS Lambda handler

Context is King

Page 34: Functional Programming in Serverless World€¦ · Using Node.js process API to spawn an executable Handling events reported by subprocess and passing results to the AWS Lambda handler

Thank you!Questions?

Page 35: Functional Programming in Serverless World€¦ · Using Node.js process API to spawn an executable Handling events reported by subprocess and passing results to the AWS Lambda handler

References

1. Our company - Pattern Match and my talks.2. Functional Miners meet-up (facebook, twitter, github, email, website).3. Serverless Architecture, Serverless (Martin Fowler’s articles).4. AWS Lambda, Google Cloud Functions, Azure Functions.5. Container Reuse in AWS Lambda, Serverless: Cold Start War.6. Running Executables in AWS Lambda.7. Serverless Computing: Economic and Architectural Impact.8. Why the JVM is a Good Choice for Serverless Computing.9. Droplr Serverless Revolution.

10. Optimizing Enterprise Economics with Serverless.11. Should I use AWS Lambda or EC2?12. AWS Lambda support for .NET Core 2.0.13. Repository with examples, scripts, and measurements.