ODM and Rules - Semantic Enabled Complex Event Processing · OMG MDA and Class/Object/Data Models...

28
ODM and Rules - Semantic Enabled Complex Event Processing © 2009 TIBCO Software Inc., Sandpiper. Software Inc. All Rights Reserved. Paul Vincent, Business Optimization Group, TIBCO Software

Transcript of ODM and Rules - Semantic Enabled Complex Event Processing · OMG MDA and Class/Object/Data Models...

Page 1: ODM and Rules - Semantic Enabled Complex Event Processing · OMG MDA and Class/Object/Data Models Platform Computation Independent Models (CIM) SBVR Semantics for Business Vocabularies

ODM and Rules - Semantic Enabled Complex Event Processing

© 2009 TIBCO Software Inc., Sandpiper. Software Inc. All Rights Reserved.

Paul Vincent, Business Optimization Group, TIBCO Software

Page 2: ODM and Rules - Semantic Enabled Complex Event Processing · OMG MDA and Class/Object/Data Models Platform Computation Independent Models (CIM) SBVR Semantics for Business Vocabularies

Presenter

� Paul Vincent

• CTO, Business Rules and Complex Event Processing

• Contributor to standards (OMG PRR Co-Chair, W3C RIF)

• Contributor to Event Processing research – EPTS Reference Architecture Working Group co-chair

– EPTS Metamodelling Working Group co-chair

• Co-author http://tibcoblogs.com/cep/

© 2009 TIBCO Software Inc., Sandpiper Software, Inc.. 2

� TIBCO Software

• Largest independent software integration company

• 3,000 customers in 40 countries using SOA, BPM and Business Optimization

• Complex Event Processing one of the fast growing trends

Page 3: ODM and Rules - Semantic Enabled Complex Event Processing · OMG MDA and Class/Object/Data Models Platform Computation Independent Models (CIM) SBVR Semantics for Business Vocabularies

Agenda

1. Complex Event ProcessingWhat is it and where does it fit in the

IT and semantics worlds?

2. Semantic Processing and Real-time Event ProcessingHow can semantics assist in

real-world, real-time event processing?

© 2009 TIBCO Software Inc., Sandpiper Software, Inc.. 3

real-world, real-time event processing?

Page 4: ODM and Rules - Semantic Enabled Complex Event Processing · OMG MDA and Class/Object/Data Models Platform Computation Independent Models (CIM) SBVR Semantics for Business Vocabularies

Real-world Events

CustomerLogon

Base RateIncrease

CustomerChecks

“Close Account”Web Page

NewOrder

Contract

© 2009 TIBCO Software Inc., Sandpiper Software, Inc.. 4

OrderedItem

Arrives in Store

NewLiabilityAdded

RentalCar

Returned

ContractSubmitted

ContractReturnedthru EDIRental

CarCrashed

Mobile Callfrom [email protected]

Page 5: ODM and Rules - Semantic Enabled Complex Event Processing · OMG MDA and Class/Object/Data Models Platform Computation Independent Models (CIM) SBVR Semantics for Business Vocabularies

Where is the information?

CustomerLogon

Base RateIncrease

CustomerChecks

Close AccountWeb Page

NewOrder

Contract

© 2009 TIBCO Software Inc., Sandpiper Software, Inc.. 5

OrderedItem

Arrives in Store

NewLiabilityAdded

RentalCar

Returned

ContractSubmitted

ContractReturnedthru EDIRental

CarCrashed

Mobile Callfrom [email protected]

Page 6: ODM and Rules - Semantic Enabled Complex Event Processing · OMG MDA and Class/Object/Data Models Platform Computation Independent Models (CIM) SBVR Semantics for Business Vocabularies

Where is the information?

Fraud Risk!

Risk of CustomerDefection

CustomerCrossSell

Opportunity

Change inProduct Sales

Trend

Contract

© 2009 TIBCO Software Inc., Sandpiper Software, Inc.. 6

Stock Capacitytrending to

limit

ComplianceLimit

Approached

Customernow rated

Gold

ContractValidated

ContractValid

RentalContract Complete

Cell phonefraud alert

Page 7: ODM and Rules - Semantic Enabled Complex Event Processing · OMG MDA and Class/Object/Data Models Platform Computation Independent Models (CIM) SBVR Semantics for Business Vocabularies

The Event Cloud

� What meaning can we derive from the increasing

“cloud of events”?

� Can we infer important business events

by correlating events automatically + earlier,

regardless of source / type?

© 2009 TIBCO Software Inc., Sandpiper Software, Inc.. 7

regardless of source / type?

RFID events

SLA events

Supply chain events

Delivery events

HR events

Transport events

Page 8: ODM and Rules - Semantic Enabled Complex Event Processing · OMG MDA and Class/Object/Data Models Platform Computation Independent Models (CIM) SBVR Semantics for Business Vocabularies

Complex Event Processing

Sense and Respond

Track and Trace

© 2009 TIBCO Software Inc., Sandpiper Software, Inc.. 8

Situation Awareness

Page 9: ODM and Rules - Semantic Enabled Complex Event Processing · OMG MDA and Class/Object/Data Models Platform Computation Independent Models (CIM) SBVR Semantics for Business Vocabularies

What Does CEP Solve?

Potential Business Value

Business Event

Warnings precede threats

CEP provides quicker

response to complex

events

© 2009 TIBCO Software Inc., Sandpiper Software, Inc.. 9

Potential Business Value

Resulting Complex Event Measured

Root Cause / Correlation

Corrective Decision Made

Action Taken

Action time

Page 10: ODM and Rules - Semantic Enabled Complex Event Processing · OMG MDA and Class/Object/Data Models Platform Computation Independent Models (CIM) SBVR Semantics for Business Vocabularies

Implementing Complex Event Processing

Events InformationEvent and

Data

Structures

Access and Monitor the “Event Cloud”

Define complex events across events and existing data

Continuously

© 2009 TIBCO Software Inc., Sandpiper Software, Inc..

Event

ProcessingEvent

Storage

States and

Transitions

Inference

Rules

Sets and

Queries

Stored

Events

and

Data

via JMS, RV, MQ, TCP/IP, etc…

Continuously process events using procedural and declarative event processing elements

Page 11: ODM and Rules - Semantic Enabled Complex Event Processing · OMG MDA and Class/Object/Data Models Platform Computation Independent Models (CIM) SBVR Semantics for Business Vocabularies

Sample “IT Models” used in CEP

Event Model and Concept Modelfor static event and concept relationships

State Model for dynamic, time-based concept lifecycles

UML

Class

UML

Event

UML

State

© 2009 TIBCO Software Inc., Sandpiper Software, Inc..

Query Model for sets and windows of events and concepts

Rule Model for patterns of events and concepts

Decision Model for managed decision tables

UML

PRR

Page 12: ODM and Rules - Semantic Enabled Complex Event Processing · OMG MDA and Class/Object/Data Models Platform Computation Independent Models (CIM) SBVR Semantics for Business Vocabularies

OMG MDA and Class/Object/Data Models

Platform

Computation

Independent

Models (CIM)

SBVRSemantics for Business Vocabularies and Rules

OMG W3C

ODMOntology Definition Metamodel

OWLWeb Ontology Language

© 2009 TIBCO Software Inc., Sandpiper Software, Inc..

Platform

Independent

Models (PIM)

Platform

Specific

Models (PSM)

UML2

Class Models

SUN Java SQL MS .NET W3C WSDL W3C XML

With

platform-specific

extensions

W3C RDF

Page 13: ODM and Rules - Semantic Enabled Complex Event Processing · OMG MDA and Class/Object/Data Models Platform Computation Independent Models (CIM) SBVR Semantics for Business Vocabularies

OMG MDA and Rule Models

Platform

Computation

Independent

Models (CIM)

SBVRSemantics for Business Vocabularies and Rules

OMG W3C

OWLWeb Ontology Language

OCLObject Constraint Language

© 2009 TIBCO Software Inc., Sandpiper Software, Inc..

Platform

Independent

Models (PIM)

Platform

Specific

Models (PSM)

PRRProduction Rule Representation

RIFRule Interchange Format

BlazeILOGDROOLSJESSPega

Object Constraint Language

TIBCO

Page 14: ODM and Rules - Semantic Enabled Complex Event Processing · OMG MDA and Class/Object/Data Models Platform Computation Independent Models (CIM) SBVR Semantics for Business Vocabularies

MDA: OMG PRR

� Formal UML model for production rules

• Defined in UML

• Extends UML so production rules are

1st class citizens alongside objects

� Vendor-neutral UML-friendly rule representation

• Rules specified via tools, not manually!

objects

© 2009 TIBCO Software Inc., Sandpiper Software, Inc..

• Rules specified via tools, not manually!

� 2 rule “semantics” (types):

1. Forward chaining inference rules

(e.g. Rete-model)

2. Sequentially processed procedural rules

(e.g. scripts)

� Import/export for rule modeling

• XMI between UML tools and BREs

Page 15: ODM and Rules - Semantic Enabled Complex Event Processing · OMG MDA and Class/Object/Data Models Platform Computation Independent Models (CIM) SBVR Semantics for Business Vocabularies

PRR metamodel

� Ruleset = collection of Rule

� Rule is (for RuleVariables) if <Condition> then <Actions>

© 2009 TIBCO Software Inc., Sandpiper Software, Inc..

CEPComplex Patterns

Page 16: ODM and Rules - Semantic Enabled Complex Event Processing · OMG MDA and Class/Object/Data Models Platform Computation Independent Models (CIM) SBVR Semantics for Business Vocabularies

Agenda

1. Complex Event ProcessingWhat is it and where does it fit in the

IT and semantics worlds?

2. Semantic Processing and Real-time Event ProcessingHow can semantics assist in

real-world, real-time event processing?

© 2009 TIBCO Software Inc., Sandpiper Software, Inc.. 16

real-world, real-time event processing?

Page 17: ODM and Rules - Semantic Enabled Complex Event Processing · OMG MDA and Class/Object/Data Models Platform Computation Independent Models (CIM) SBVR Semantics for Business Vocabularies

Assumptions (1)

� Most IT processing uses conventional, “fixed” IT models

• Knowledge mapped to structured object-oriented structures that run in JVM etc efficiently: changes require recompilation

• Moving to knowledge-based models (e.g. RDF data) for existing applications is too expensive (abstraction, runtime, performance)

• New IT management capabilities sometimes use RDF/OWL to

© 2009 TIBCO Software Inc., Sandpiper Software, Inc.. 17

• New IT management capabilities sometimes use RDF/OWL to support dynamic enterprise views & reduce application change time

Page 18: ODM and Rules - Semantic Enabled Complex Event Processing · OMG MDA and Class/Object/Data Models Platform Computation Independent Models (CIM) SBVR Semantics for Business Vocabularies

Assumptions (2)

� Knowledge-based solutions may be most valuable when dealing with change / changeable entities / discovery or where flexibility is essential

• Business intelligence / discovery activities

• Complex cross-domain / cross-organizational information-based service delivery

• Software system development and maintenance

© 2009 TIBCO Software Inc., Sandpiper Software, Inc.. 18

• Software system development and maintenance

Page 19: ODM and Rules - Semantic Enabled Complex Event Processing · OMG MDA and Class/Object/Data Models Platform Computation Independent Models (CIM) SBVR Semantics for Business Vocabularies

Assumptions (3)

� Mitigated today in conventional IT systems through techniques like

• Declarative production rules

• BPM

• Event driven architecture (type of SOA)

© 2009 TIBCO Software Inc., Sandpiper Software, Inc.. 19

Page 20: ODM and Rules - Semantic Enabled Complex Event Processing · OMG MDA and Class/Object/Data Models Platform Computation Independent Models (CIM) SBVR Semantics for Business Vocabularies

Assumptions (4)

� Semantics help in the “software system – person” boundaries, to augment conventional approaches, increase scalability of rule sets, or where reuse potential is high

© 2009 TIBCO Software Inc., Sandpiper Software, Inc.. 20

Page 21: ODM and Rules - Semantic Enabled Complex Event Processing · OMG MDA and Class/Object/Data Models Platform Computation Independent Models (CIM) SBVR Semantics for Business Vocabularies

Definitions

An ontology specifies a rich, updatable and verifiable description of the

• Terminology, concepts, nomenclature

• Properties explicitly defining concepts

• Relations among concepts (hierarchical and lattice)

• Rules to distinguish concepts, refining definitions and relations (constraints, restrictions, regular expressions)

relevant to a particular domain or area of interest.

© 2009 TIBCO Software Inc., Sandpiper Software, Inc..

Page 22: ODM and Rules - Semantic Enabled Complex Event Processing · OMG MDA and Class/Object/Data Models Platform Computation Independent Models (CIM) SBVR Semantics for Business Vocabularies

Ontologies versus IT Models

Formal

OntologyUML

ODM

© 2009 TIBCO Software Inc., Sandpiper Software, Inc.. 22

IT levels of

ontology support

UML

Class

UML

EventUML

PRR

Queries

UML

State

Page 23: ODM and Rules - Semantic Enabled Complex Event Processing · OMG MDA and Class/Object/Data Models Platform Computation Independent Models (CIM) SBVR Semantics for Business Vocabularies

Ontologies driving CEP (1)

Event Model and Concept Modelfor static event and concept relationships

State Model for dynamic, time-based concept lifecycles

UML

Class

UML

Event

UML

State

Formal OntologyUML

ODM

OWLObject and event,

inheritance,

containment, &

reference

Knowledge of

classification

changes

over timeKnowledge of

constrained sets,

collection

definitions;

© 2009 TIBCO Software Inc., Sandpiper Software, Inc..

Query Model for sets and windows of events and concepts

Rule Model for patterns of events and concepts

Decision Model for managed decision tables

UML

PRR

definitions;

May change

over timeKnowledge of

filtered behaviors

across sets,

including

dynamic

classifications

Page 24: ODM and Rules - Semantic Enabled Complex Event Processing · OMG MDA and Class/Object/Data Models Platform Computation Independent Models (CIM) SBVR Semantics for Business Vocabularies

Ontologies driving CEP (2)

Event Model and Concept Modelfor static event and concept relationships

State Model for dynamic, time-based concept lifecycles

UML

Class

UML

Event

UML

State

Formal

Ontology

UML

ODM

OWL

Semantic processing of

event information,

leading to

• new event subtypes,

© 2009 TIBCO Software Inc., Sandpiper Software, Inc..

Query Model for sets and windows of events and concepts

Rule Model for patterns of events and concepts

Decision Model for managed decision tables

UML

PRR

• new event subtypes,

• new classifications,

• updated / new set

definitions,

• updated / new

production rules,

• updated / new

decisions

Page 25: ODM and Rules - Semantic Enabled Complex Event Processing · OMG MDA and Class/Object/Data Models Platform Computation Independent Models (CIM) SBVR Semantics for Business Vocabularies

Semantic Agent

Semantic CEP Architecture example

Event Sources

Event

Eve

nt

Bu

s

Business Event

Meta-Patterns

KB

Trend KB

Update Logic

Trend Analysis

& Machine Learning

Event Reclassification

& Re-aggregation

© 2009 TIBCO Software Inc., Sandpiper Software, Inc..

CEP

25

Event Consumers

EventHistoryEvent

Bus

Eve

nt

Bu

s

State Engine

Inference

Rule EngineRulebase

State Model

QueriesQuery Engine

Page 26: ODM and Rules - Semantic Enabled Complex Event Processing · OMG MDA and Class/Object/Data Models Platform Computation Independent Models (CIM) SBVR Semantics for Business Vocabularies

Example Semantic CEP roles

� Update object model and associated metadata (time to live, history depth, etc)

� Update rule parameters(new / revised classes and subclasses to look for, attribute ranges that are significant, etc)

� Update state model

© 2009 TIBCO Software Inc., Sandpiper Software, Inc.. 26

� Update state model(transition rule values, wait times for missing events, new conditions, eliminate invalidated states, etc)

Page 27: ODM and Rules - Semantic Enabled Complex Event Processing · OMG MDA and Class/Object/Data Models Platform Computation Independent Models (CIM) SBVR Semantics for Business Vocabularies

Example Semantic CEP Use Cases

procedure<<ontologyClass>>

Binary Increase Congestion (BIC)<<ontologyClass>>

High Speed TCP (HSTCP)<<ontologyClass>>

TCP Vegas<<ontologyClass>>

TCP Westwood<<ontologyClass>>

TCP New Reno<<ontologyClass>>

TCP Hybla<<ontologyClass>>

Explicit Congestion Notification<<ontologyClass>>

TCP Westwood Plus<<ontologyClass>>

Standard TCP<<ontologyClass>>

Transactional TCP<<ontologyClass>>

Equal Cost Multipath<<ontologyClass>>

Round Robin<<ontologyClass>>

Weighted Round Robin<<ontologyClass>>

Interface Round Robin<<ontologyClass>>

Random<<ontologyClass>>

Weighted Random<<ontologyClass>>

Least Connection Scheduling<<ontologyClass>>

Weighted Least Connection Scheduling<<ontologyClass>>

Locality Based Least Connection Scheduling<<ontologyClass>>

Shortest Expected Delay Scheduling<<ontologyClass>>

Differentiated Services<<ontologyClass>>

Class Based Queueing<<ontologyClass>>

Priority Based Queueing<<ontologyClass>>

Token Bucket Filtering<<ontologyClass>>

Hierarchical Token Bucket Filtering<<ontologyClass>>

Random Early Drop<<ontologyClass>>

Stochastic Fair Queueing<<ontologyClass>>

Algorithm<<ontologyClass>>

Forwarding Algorithm<<ontologyClass>>

Load Balancing Algorithm<<ontologyClass>>

Quality of Service (QoS) Algorithm<<ontologyClass>>

Congestion Control Algorithm<<ontologyClass>>

Flow Control Algorithm<<ontologyClass>>

Enhanced Search / Retrieval

Siderean, SchemaLogic, SDI Corporation

Driven User Access

based Custom Delivery

• Call Center / CRM Operations to identify conflicting Client Advisories

• Intelligence Analysis supporting research operations

• Semantically enhanced Fraud Detection and Financial Regulation

• IP Content Publication & Management for Media

© 2009 TIBCO Software Inc., Sandpiper Software, Inc.. 27

Valid Reference Knowledge BaseDomain Vocabulary (Ontology Components)

+ Reference Data

Document

Repository

Document RepositorySchema & Index

Document Mining & Extraction Service

Reference Vocabulary Drives Extraction

- UIMA-based services

- Verity, Inxight, other commercial

Document Content Mention / Cross-Reference

Archive

Semantically-Enhanced Search / Retrieval

-Siderean, SchemaLogic, SDI Corporation

Publish / Subscribe, Agent-Driven User Access

Preference / Role-based Custom Delivery

Policy KB

Page 28: ODM and Rules - Semantic Enabled Complex Event Processing · OMG MDA and Class/Object/Data Models Platform Computation Independent Models (CIM) SBVR Semantics for Business Vocabularies

Summary

� Complex Event Processing

• a “new kid” on the IT block

• using high-performance IT capabilities to provide a continuous event/data aggregation architecture

� Semantic Extensions

• new approaches to bridging the semantic / KR and conventional IT /

© 2009 TIBCO Software Inc., Sandpiper Software, Inc.. 28

• new approaches to bridging the semantic / KR and conventional IT / model-driven worlds

• convergence with modern IT solutions like CEP