BM Real-time Technologies for SUSE Linux Enterprise Real Time

IBM Real Time Technologies for SUSE® Linux Enterprise Real Time

Kerry KimMarketing [email protected]

Benjamin S. Vera-TudelaSr. Software [email protected]

© Novell, Inc. All rights reserved.2

Outline

Challenges and Trends

What is Real Time?

IBM Technologies for Real Time

SUSE® Linux Enterprise Real Time Extension

Real Time Benefits

Customers and Partners

Next Steps


Challenges

How can I …

• Use technology to be more responsive?

• Better utilize my resources?

• Cost effectively ensure QoS?

• Align IT to business priorities?


Trends

Proprietary Software

Technology Specialization

Embedded Real Time Computing

Open Source Software

Technology Consumerization

Enterprise Real Time Computing

What is Real Time?


What Is Real Time?

HardRealTime

(Ultra Predictability)

SoftRealTime

(Ultra Low Latency)


What Is Hard Real Time?

• A hard real time application has tasks which have hard, firm deadlines for completion of their computation and require hard scheduling guarantees from the operating system and hardware platform

– Granular timers

– Thread scheduling

– Interrupt handling

– Critical sections

– Memory management

– Hardware latencies


What Is Soft Real Time?

• A soft real time application has tasks which can tolerate some missed deadlines and does not typically require hard scheduling guarantees from the OS or hardware platform

– Garbage collection

– Compiler support

– Low latency Middleware


Where Is Real Time Important?

Where highly predictable or very fast response times are needed

Real time response times have broad industry appeal in:

– Energy and Utilities– Financial Services– Manufacturing

– Military and Defense– Telecommunications


Hard Real Time Use Cases

Manufacturing: Military and Defense:


Soft Real Time Use Cases

Financial Services: Telecommunications:


How Can Real Time Help?

IBM and Novell® can help you ...

• Be more responsive to changing business needs

• Better utilize your existing IT resources

• Ensure QoS cost effectively

• Better align IT to business priorities

IBM Technology for Real Time


IBM WebSphere® Real Time V2.0 for: SUSE® Linux Enterprise Real Time Extension

Real-time Linux

Select IBM System x Hardware

Compile

JavaArchive(JAR)

Bind

ClassCache

Real-timegarbage collector

Real-timeJIT

RTSJSupport

J9 VM

Java Standard Edition, Version6

Real-time feature Standard J9 component

• Java™ Standard Edition V6• Metronome RTGC

– Tunable garbage collector

• Compilation strategies for RT – Ahead of Time (AOT)– Just in Time (JIT)

• Real time specification for Java (JSR 1.0.2)

– Memory management– Thread management

• SLERT on Select Hardware– Enhanced for real

time workloads


Garbage Collection – Metronome

• Unique technology from IBM T.J. Watson Research– Garbage collection is scheduled as just another periodic

real time task

• Enables the use of off-the-shelf Java code– No need for specialized memory allocation schemes– Existing Java applications can experience latencies of up

to 1 ms without changes

Time

10 msSliding Window

Traditional

Real Time

Application

Garbage Collector


Compilation Strategies

• Compilation in Java is dynamic

– Code may be interpreted or compiled selectively through JIT

– JIT can run at unpredictable times and have unpredictable (although almost always positive) effect on performance

Compilejava code Jar Files AOT

Compile

Sample run with JIT

JIT compile log

OtherJar files

Realtimeexecution

BoundJar files

• For real time there are choices

Ahead-of-time (AOT) User-controlled JIT JIT-at-low-priority


Command Line Examples

• Metronome

– java -Xrealtime -Xgc:targetUtilization=80 yourApplication.class

• Ahead-of-Time

– javac -Xrealtime yourApplication.java

– jar -c yourApplication.jar yourApplication.class

– jxeinajar -Xrealtime yourApplication.jar -outPath aot

– java -Xrealtime -Xnojit -searchPath aot yourApplication.jar


Memory Management

• Partitions memory into non-garbage collected areas that allow special threads to run at priorities higher than that of the garbage collector

– Immortal memory> Areas allow allocated

objects to be accessible to all threads and never be collected

– Scoped memory> Areas can be created

and destroyed under programmer control with a specified maximum size intended for allocation

Heap ImmortalMemory

(includes globals)

Scope 1

Stack

Legal RTSJ Pointer

Legal, NHRT Inaccessible

Illegal RTSJ Pointer


Thread Management

• Predictable scheduler allows threads to execute based on their strict priorities– Real time threads

> May use the heap for memory allocations and are thus subject to garbage collection interrupts

– No-heap real time threads> Are not allowed to use the

heap and so are uninterrupted by garbage collection cycles

> Lowest latencies can be achieved by combining with scoped memory areas

10μs

100μs

1ms

10ms

100ms

1s

10s Real Time thread with Heapusing IBM Metronome real-time

garbage collector

NHRT thread With scopes


RTSJ Examples

for (int i = 0; i != NUMBER_OF_POOL_THREADS_PER_PRODUCTION_LINE; i++) { MyRunnable r = new MyRunnable();

NoHeapRealtimeThread t = new NoHeapRealtimeThread(new PriorityParameters(30), null, null, ImmortalMemory.instance().newInstance(MyObject.class), null, r); t.start();

}

final IndirectRef<MemoryArea> myMemRef = new IndirectRef<MemoryArea>(); /* The LTMemory object has to be created in a memory area that the

* NHRTs can access. */

ImmortalMemory.instance().enter(new Runnable() { public void run() {

myMemRef.ref = new LTMemory(10000000); }

});

final MemoryArea simMemArea = myMemRef.ref;

simMemArea.enter(new Runnable() { public void run() {

…

}

}


IBM WebSphere® Real Time V2.0 for SUSE® Linux Enterprise Server

• Java™ Standard Edition V6

• Metronome RTGC– Tunable garbage collector

• Compilation Strategies for RT – Ahead of Time (AOT)– Just in Time (JIT)

• SUSE® Linux Enterprise Server

• Compatible x86 Hardware

Standard Linux



Real-timeJIT

J9 VM

Java Standard Edition, Version6

Real-time feature

Standard J9 component


Combining WebSphere, Linux, and Java for Differentiated QoS• WebSphere Virtual Enterprise

with WebSphere Real Time– Java Standard Edition V6– Metronome RTGC– Compilation strategies for RT – On-demand router (ODR)

for priority routing

• SUSE® Linux Enterprise Server

• Compatible x86 Hardware

Standard Linux



J9 VM

WebSphere Virtual Enterprise

Real-time feature

Standard J9 component

On Demand Router

J9 VMWebSphere App Srv WebSphere App SrvWebSphere App Srv



Deciding Between Real Time Offerings

• Hard Real Time– If your goal is to achieve extreme

predictability all the time– Latency* (worst case):

> ≤ 1 ms using RT Java Threads> ≤ 200 μs using NHRTs

(equivalent to C/C++ latencies)

• Soft Real Time– If your goal is to improve

predictability most of the time– Latency*:

> ≤ 3 ms 99.999% of the times

*Latencies may vary depending upon system configuration and workload.

200μs 1ms 2ms 3ms


Other IBM Software for Soft Real Time

WebSphere MQ Low-Latency Messaging: A messaging transport that is highly optimized for the very high-volume, low-latency requirements of financial services firms. Applications include the high-speed delivery of market data, trade data, reference data and event data in or between front-, middle- and back-office operations. Characteristic applications require extremely low (sub-millisecond) latency and high message volumes (up to millions of messages per second).

SolidDB: Relational in-memory database software that delivers extreme speed, performing up to ten times faster than conventional databases. It uses the familiar SQL language to allow applications to achieve throughput of tens of thousands of transactions per second with response times measured in microseconds, while also providing applications with extreme data availability (along with sub-second failover to another instance of solidDB).


IBM System x Hardware Certified for: SUSE® Linux Enterprise Real Time Extension

• System Management Interrupts (SMIs) are used to perform a variety of tasks at the CPU level

– Report fatal and non-fatal hardware errors– Perform power management (thermal throttling, power capping)– SMIs introduce latencies that are hard to detect

• HS22, x3650 M2, x3550 M2, HS21 XM, LS22, LS21– Optimized to support real-time workloads through

SMI remediation> Moves non-fatal event handling to the OS> BIOS handles only fatal events> New OS service manages entering/exiting the SMI-free state

SUSE® Linux Enterprise Real Time Extension


SUSE® Linux Enterprise Real Time Extension What it Is

An extension to SUSE Linux Enterprise Server that converts the general purpose operating system into a real time operating system

A product specifically engineered to reduce the latency, increase the predictability and reliability of your time sensitive mission critical applications, and lower costs


SUSE® Linux Enterprise Real Time Extension How It Works

Before

After

Kernel

Process APre-empted

Process AContinues

Time

2 MicroSeconds

Ethernet

InfiniBand

Shielding Preemption

Infiniband High Resolution Timers


Customers and Partners


Thomson Reuters• Thomson Datafeeds – a hosted service that provides real time data from major global exchanges, and trading venue, options, international F/X, and consolidated order books

• Robust, scalable real time platform to power a high throughput, low latency, hosted market data feed service

• Real time OS that can easily be integrated with the other “best of breed” components of their market data feed platform

• SUSE® Linux Enterprise Real Time

• Successful launch and delivery of Thomson Datafeeds service• Scalable infrastructure that can easily grow as demand grows• Superior experience through one stop support for its software infrastructure

Workloads

BusinessIssues

Novell®

Solution

Results


ThyssenKrupp Electrical Steel• Shop floor planning, control, monitoring, analysis and automation systems used in the production of high-grade grain-oriented electrical steel

• Robust real time platform to optimize time-critical manufacturing process control systems, help maximize production yields, and meet ISO9001 certification standards

• Affordable solution using industry standard COTS components

• SUSE® Linux Enterprise Real Time

• Affordable, flexible solution that accurately measures 200+ distinct values for each meter of steel produced and is integrated with their quality management system

• Reliable 24x7 system that delivers guaranteed sub 30 millisecond response times to ensure high quality production

Workloads

BusinessIssues

Novell®

Solution

Results


UMB Financial Corporation• Identity verification and authentication system for UMB's online customers

• Ensure online banking customers have fast, predictable, and secure access to their confidential financial information

• Ensure SLA's are affordably met, even under unpredictable and variable system loads

• SUSE® Linux Enterprise Real Time• Novell® Identity Manager, Novell eDirectory™, iChain®, Audit, and Novell Access Manager™

• Increased performance 10% under light loads, and over 150% under heavy system loads

• Reduced number of servers needed to meet SLA's from 20 to 6 – a 70% reduction.

Workloads

BusinessIssues

Novell®

Solution

Results


Summary

IBM WebSphere with SUSE® Linux Enterprise Real Time Extension helps:

Reduce latency

Increase predictability

Increase reliability

... of time sensitive mission critical applications, helping firms to:

Respond rapidly

Increase availability

Lower costs


Next Steps

• Learn more– http://www.novell.com/realtime– http://www.ibm.com/linux/realtime.html

• Download eval– http://www.novell.com/products/realtime/eval.html– http://www.ibm.com/software/webservers/realtime/

• Contact us– Kerry Kim, [email protected]– Benjamin Vera-Tudela, [email protected]

http://www.novell.com/realtime

http://www.ibm.com/linux/realtime.html

http://www.novell.com/products/realtime/eval.html

https://www14.software.ibm.com/webapp/iwm/web/preLogin.do?source=swg-wsrt

mailto:[email protected]

mailto:[email protected]

© Copyright IBM Corporation 2010

IBM Corporation New Orchard RoadArmonk, NY 10504 U.S.A.

Produced in the United States of America 06-08 All Rights Reserved

IBM, the IBM logo and ibm.com are trademarks or registered trademarks of International Business Machines Corporation in the United States, other countries, or both. If these and other IBM trademarked terms are marked on their first occurrence in this information with a trademark symbol (® or ™), these symbols indicate U.S. registered or common law trademarks owned by IBM at the time this information was published. Such trademarks may also be registered or common law trademarks in other countries. A current list of IBM trademarks is available on the Web at "Copyright and trademark information" at www.ibm.com/legal/copytrade.shtml.

Java and all Java-based trademarks and logos are trademarks of Sun Microsystems, Inc. in the United States, other countries, or both.

Other company, product and service names may be trademarks or service marks of other companies.

References in this publication to IBM products and services do not imply that IBM intends to make them available in all countries in which IBM operates.

http://www.ibm.com/legal/copytrade.shtml






Unpublished Work of Novell, Inc. All Rights Reserved.This work is an unpublished work and contains confidential, proprietary, and trade secret information of Novell, Inc. Access to this work is restricted to Novell employees who have a need to know to perform tasks within the scope of their assignments. No part of this work may be practiced, performed, copied, distributed, revised, modified, translated, abridged, condensed, expanded, collected, or adapted without the prior written consent of Novell, Inc. Any use or exploitation of this work without authorization could subject the perpetrator to criminal and civil liability.

General DisclaimerThis document is not to be construed as a promise by any participating company to develop, deliver, or market a product. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. Novell, Inc. makes no representations or warranties with respect to the contents of this document, and specifically disclaims any express or implied warranties of merchantability or fitness for any particular purpose. The development, release, and timing of features or functionality described for Novell products remains at the sole discretion of Novell. Further, Novell, Inc. reserves the right to revise this document and to make changes to its content, at any time, without obligation to notify any person or entity of such revisions or changes. All Novell marks referenced in this presentation are trademarks or registered trademarks of Novell, Inc. in the United States and other countries. All third-party trademarks are the property of their respective owners.

BM Real-time Technologies for SUSE Linux Enterprise Real Time

Documents

Transcript of BM Real-time Technologies for SUSE Linux Enterprise Real Time