Java and Containers – Make it Awesome !

2

About Me

● Ex Linux Kernel and glibc hacker● Eclipse OpenJ9 Cloud Optimization Architect● Maintain the AdoptOpenJDK community Docker Images for Eclipse

OpenJ9 and HotSpot● Interested in every aspect of running Java Apps in K8s including

Cloud Native as well as Legacy migration to Cloud

Dinakar Guniguntala (@dinogun)IBM Runtime Technologies

3

Demo Repo

https://github.com/dinogun/watson-springboot

4

What is AdoptOpenJDK

● AdoptOpenJDK provides prebuilt OpenJDK binaries from a fully open source set of build scripts and infrastructure.– https://adoptopenjdk.net

● Extensive testing as part of the CI pipeline.● REST API for scriptable downloads.● Docker Images published at https://hub.docker.com/_/adoptopenjdk

5

Step 1: Begin at the Beginning

Build !

6

Build Goals

● Size Matters – Small is Better !– Affects provisioning / deployment time– Consider Images based on Alpine Linux (5 MB vs 80 MB for Ubuntu)– Slim images (Cloud workloads use only a small subset)– Use jlink to use only the required modules (Java 9 onwards)

● Should be easy to maintain– Consider using standard build tool docker images (Eg. maven / gradle)– Use build tool plugins for Docker where possible

Java Version Latest Slim Alpine

Alpine-Slim

8 (JDK) 338 MB 213 MB 239 MB 98 MB

11 (JDK) 423 MB 354 MB 324 MB 239 MB

https://hub.docker.com/u/adoptopenjdk

7

Step 2: Expand and Flourish

Startup and Scale !

8

Startup Goals

Use of a Shared Class Cache helps reduce startup times by upto 40% -Xshareclasses

java -Xshareclasses:cacheDir=/opt/shareclasses -jar /opt/app/japp.jar

docker run -it -v /path/on/host/shareclasses/dir:/opt/shareclasses japp

-Xquickstart mode Good for very short running applications

9

Instant startup with CRIU !!

Startup time

checkpoint

restore

Time to restore

Instance 1

Time to firstresponse

Time to firstresponse

Instance 2

Instance 3Timeline

https://criu.org

10

Step 3: Keep it Steady

Container Aware !

11

Optimize at Runtime

Container Aware JVM– -XX:+UseContainerSupport to turn on this feature. (Default now

with the latest JVM)– Use -XX:MaxRAMPercentage and -XX:InitialRAMPercentage

instead of -Xmx and -Xms.– Runtime.availableProcessors() based on cgroup limits.

Heap = 2.4G

Container Mem = 3GContainer Mem = 2G

Heap = 1.6GHeap = 3.2G

Container Mem = 4G

-Xmx = 2G -Xmx = 2G-Xmx = 2G

-XX:MaxRAMPercentage=80

https://blog.openj9.org/2018/06/12/eclipse-openj9-in-containers/

12

Kruize: Right size and Optimize your Containers !

https://github.com/kruize/kruize

13

Step 4: Don’t Lose When You Snooze

Idle Aware !

14

Optimize at Idle Time

OpenJ9 reduces footprint on Idle– -XX:+IdleTuningGcOnIdle and

– -XX:+IdleTuningCompactOnIdle

https://developer.ibm.com/javasdk/2017/09/25/still-paying-unused-memory-java-app-idle/

15

Step 5: Crashing in the Cloud ? NP !

Javacores and Dumps

16

Get Debugging Info on the Fly !

Do you have to restart your containerized Java app to dump debugging info ?

NO !

– Use OpenJ9DiagnosticMXBean instead

17

Javacore Info

1CICONTINFO Running in container : TRUE1CICGRPINFO JVM support for cgroups enabled : TRUE…1CICGRPINFO Cgroup Information NULL -------------------------------------------------CICGRPINFO subsystem : cpu2CICGRPINFO cgroup name : /2CICGRPINFO CPU Period : 200000 microseconds2CICGRPINFO CPU Quota : 100000 microseconds2CICGRPINFO CPU Shares : 1024 2CICGRPINFO Period intervals elapsed count : 16 2CICGRPINFO Throttled count : 2 2CICGRPINFO Total throttle time : 164156409 nanoseconds2CICGRPINFO subsystem : cpuset2CICGRPINFO cgroup name : /2CICGRPINFO CPU exclusive : 0 2CICGRPINFO Mem exclusive : 0 2CICGRPINFO CPUs : 0-3 2CICGRPINFO Mems : 0 2CICGRPINFO subsystem : memory2CICGRPINFO cgroup name : /2CICGRPINFO Memory Limit : 2147483648 bytes2CICGRPINFO Memory + Swap Limit : 4294967296 bytes2CICGRPINFO Memory Usage : 31182848 bytes2CICGRPINFO Memory + Swap Usage : 31182848 bytes2CICGRPINFO Memory Max Usage : 31277056 bytes2CICGRPINFO Memory + Swap Max Usage : 31277056 bytes2CICGRPINFO Memory limit exceeded count : 0 2CICGRPINFO Memory + Swap limit exceeded count : 0 2CICGRPINFO OOM Killer Disabled : 0 2CICGRPINFO Under OOM : 0

$ docker run -m2g --cpu-quota="100000" --cpu-period="200000" -it openj9 java -Xdump:java:events=vmstop App

18

Useful Links

Demo– https://github.com/dinogun/watson-springboot

Eclipse OpenJ9 Sources– https://github.com/eclipse/openj9

Kruize – Right size and optimize your containers– https://github.com/kruize/kruize

AdoptOpenJDK Docker Images– https://hub.docker.com/r/adoptopenjdk/openjdk8-openj9/

CRIU - https://criu.org

Build / Package

Startup Running Idling Debugging

@dinogun

19

Qs@dinogun