Project SCI-Flex

28

description

Project SCI-Flex is a venture towards the integration of SOA and CEP. This is the final project presentation for Project SCI-Flex, done on 29th January 2009, at the Dept. of Computer Science & Engineering, University of Moratuwa.

Transcript of Project SCI-Flex

Page 1: Project SCI-Flex
Page 2: Project SCI-Flex

•SCI-FLEX IN ACTION

•WHY SCI-FLEX?

•WHAT IS SCI-FLEX?

•SCI-FLEX IMPLEMENTATION

•CHALLENGES OVERCOME

•MAJOR CAPABILITIES

•OTHER ACHIEVEMENTS

© Creative Commons Attribution-Share Alike 3.0 Unported License

Page 3: Project SCI-Flex

© Creative Commons Attribution-Share Alike 3.0 Unported License

Page 4: Project SCI-Flex

• MASSIVE AMOUNTS OF EVENTS OUT OF WHICH ONLY A VERY

SMALL AMOUNT IS USEFUL

• RAPIDLY CHANGING EVENT STREAM

• DYNAMICALLY IDENTIFY PATTERNS OR ANOMALIES AND

SPEEDY RESPONSE

• SCALABILITY & FLEXIBILITY

• INTEROPERABILITY AMONG DIFFERENT SYSTEMS

• MULTIPLE COMMUNICATION MEDIUMS

• CHANGE DYNAMICALLY & ADAPT TO RAPIDLY CHANGING

REQUIREMENTS

© Creative Commons Attribution-Share Alike 3.0 Unported License

Page 5: Project SCI-Flex

• MASSIVE AMOUNTS OF EVENTS OUT OF WHICH ONLY A VERY

SMALL AMOUNT IS USEFUL

• RAPIDLY CHANGING EVENT STREAM

• DYNAMICALLY IDENTIFY PATTERNS OR ANOMALIES AND

SPEEDY RESPONSE

• SCALABILITY & FLEXIBILITY

• INTEROPERABILITY AMONG DIFFERENT SYSTEMS

• MULTIPLE COMMUNICATION MEDIUMS

• CHANGE DYNAMICALLY & ADAPT TO RAPIDLY CHANGING

REQUIREMENTS

COMPLEX EVENT PROCESSING (CEP)

© Creative Commons Attribution-Share Alike 3.0 Unported License

Page 6: Project SCI-Flex

• MASSIVE AMOUNTS OF EVENTS OUT OF WHICH ONLY A VERY

SMALL AMOUNT IS USEFUL

• RAPIDLY CHANGING EVENT STREAM

• DYNAMICALLY IDENTIFY PATTERNS OR ANOMALIES AND

SPEEDY RESPONSE

• SCALABILITY & FLEXIBILITY

• INTEROPERABILITY AMONG DIFFERENT SYSTEMS

• MULTIPLE COMMUNICATION MEDIUMS

• CHANGE DYNAMICALLY & ADAPT TO RAPIDLY CHANGING

REQUIREMENTS

© Creative Commons Attribution-Share Alike 3.0 Unported License

Page 7: Project SCI-Flex

• MASSIVE AMOUNTS OF EVENTS OUT OF WHICH ONLY A VERY

SMALL AMOUNT IS USEFUL

• RAPIDLY CHANGING EVENT STREAM

• DYNAMICALLY IDENTIFY PATTERNS OR ANOMALIES AND

SPEEDY RESPONSE

• SCALABILITY & FLEXIBILITY

• INTEROPERABILITY AMONG DIFFERENT SYSTEMS

• MULTIPLE COMMUNICATION MEDIUMS

• CHANGE DYNAMICALLY & ADAPT TO RAPIDLY CHANGING

REQUIREMENTS

SERVICE ORIENTED ARCHITECTURE (SOA)

© Creative Commons Attribution-Share Alike 3.0 Unported License

Page 8: Project SCI-Flex

• SCALABILITY & FLEXIBILITY

• INTEROPERABILITY AMONG DIFFERENT SYSTEMS

• MULTIPLE COMMUNICATION MEDIUMS

• CHANGE DYNAMICALLY & ADAPT TO RAPIDLY CHANGING

REQUIREMENTS

• MASSIVE AMOUNTS OF EVENTS OUT OF WHICH ONLY A VERY

SMALL AMOUNT IS USEFUL

• RAPIDLY CHANGING EVENT STREAM

• DYNAMICALLY IDENTIFY PATTERNS OR ANOMALIES AND

SPEEDY RESPONSE

© Creative Commons Attribution-Share Alike 3.0 Unported License

Page 9: Project SCI-Flex

• MASSIVE AMOUNTS OF EVENTS OUT OF WHICH ONLY A VERY

SMALL AMOUNT IS USEFUL

• RAPIDLY CHANGING EVENT STREAM

• DYNAMICALLY IDENTIFY PATTERNS OR ANOMALIES AND

SPEEDY RESPONSE

• SCALABILITY & FLEXIBILITY

• INTEROPERABILITY AMONG DIFFERENT SYSTEMS

• MULTIPLE COMMUNICATION MEDIUMS

• CHANGE DYNAMICALLY & ADAPT TO RAPIDLY CHANGING

REQUIREMENTS

ENTERPRISE SERVICE BUS (ESB)

© Creative Commons Attribution-Share Alike 3.0 Unported License

Page 10: Project SCI-Flex

• SCALABILITY & FLEXIBILITY

• INTEROPERABILITY AMONG DIFFERENT SYSTEMS

• MULTIPLE COMMUNICATION MEDIUMS

• CHANGE DYNAMICALLY & ADAPT TO RAPIDLY CHANGING

REQUIREMENTS

• MASSIVE AMOUNTS OF EVENTS OUT OF WHICH ONLY A VERY

SMALL AMOUNT IS USEFUL

• RAPIDLY CHANGING EVENT STREAM

• DYNAMICALLY IDENTIFY PATTERNS OR ANOMALIES AND

SPEEDY RESPONSE

ESB

© Creative Commons Attribution-Share Alike 3.0 Unported License

Page 11: Project SCI-Flex

FLEXIBLE INTEGRATION

OF

SERVICE ORIENTED ARCHITECTURE (SOA) AND

COMPLEX EVENT PROCESSING (CEP)

ESBCEP

© Creative Commons Attribution-Share Alike 3.0 Unported License

Page 12: Project SCI-Flex

AIR TRAFFIC MANAGEMENT SYSTEMS

INTELLIGENT TRADING PLATFORMS

NETWORK TRAFFIC ANALYSIS

TRANSPORTATION SERVICE MANAGEMENT

© Creative Commons Attribution-Share Alike 3.0 Unported License

Page 13: Project SCI-Flex

• GREAT INTEREST TOWARDS THE MERGING OF SERVICE

ORIENTED ARCHITECTURE AND COMPLEX EVENT PROCESSING

CONCEPTS

• IBM RESEARCH

• APACHE CAMEL ESPER PLUG-IN

• MULTITUDE OF OPPORTUNITY

• BENEFITS OF COMPLEX EVENT PROCESSING IN EVENT DRIVEN

SERVICE ORIENTED ARCHITECTURE (EDA OVER SOA) SYSTEMS

© Creative Commons Attribution-Share Alike 3.0 Unported License

Page 14: Project SCI-Flex

• ENABLING COMPLEX EVENT PROCESSING IN A

SERVICE ORIENTED ARCHITECTURE

• PROVIDING ENTERPRISE LEVEL EVENTING SUPPORT

• PROVIDE USERS WITH THE CAPABILITY TO EASILY

MANAGE AND MONITOR ALL ACTIVITY

• FLEXIBILITY, SCALABILITY, INTEROPERABILITY

© Creative Commons Attribution-Share Alike 3.0 Unported License

Page 15: Project SCI-Flex

SYNAPSE ESB

SYNAPSE-ESPERMEDIATOR

EXTERNAL

EVENTS

ESPER

CEPSYSTEM

BACKEND

REGISTRY

SYNAPSE-ESPER

MEDIATOR ADMIN UI

EXECUTE

EVENTS

FETC

HED

IT

BR

OW

SE

JMS TRANSPORT

WITH MAP

MESSAGE SUPPORT

UNIFY

UNIFIED

EVENTS

© Creative Commons Attribution-Share Alike 3.0 Unported License

Page 16: Project SCI-Flex

SYNAPSE ESB

SYNAPSE-ESPER

MEDIATOR ESP

ER

EXTE

RN

AL

EVEN

TS

ADMIN UI

JMS

UNIFIED

EVENTS

BACKEND

REGISTRY

• CONCURRENCY SUPPORT

• SIMPLE CONFIGURATION

• EASY SETUP AND DEPLOYMENT

• TIGHT INTEGRATION WITH APACHE SYNAPSE

• ROBUST AND EXTENSIBLE INTERFACE

• HIGH PERFORMANCE, AND MAXIMUM USE OF

APACHE SYNAPSE'S PERFORMANCE

CAPABILITIES

• FITS WELL FOR MATURE EVENTING & EVENT

DRIVEN INFRASTRUCTURES

• BACK-END REGISTRY WITH CACHING

© Creative Commons Attribution-Share Alike 3.0 Unported License

Page 17: Project SCI-Flex

SYNAPSE ESB

SYNAPSE-ESPER

MEDIATOR ESP

ER

EXTE

RN

AL

EVEN

TS

ADMIN UI

JMS

UNIFIED

EVENTS

BACKEND

REGISTRY

• PERSISTENT SUBSCRIPTIONS

• QUERY BASED EVENT FILTERING

• XPATH / XQUERY

• SQL LIKE QUERIES

• ESPER QUERIES

• UNIFICATION OF MULTIPLE EVENT TYPES INTO A

SINGLE EVENT TYPE

• FLEXIBLE INTEGRATION WITH EXISTING SYSTEMS

• WSO2 ENTERPRISE SERVICE BUS

• APACHE SYNAPSE ENTERPRISE SERVICE BUS

© Creative Commons Attribution-Share Alike 3.0 Unported License

Page 18: Project SCI-Flex

SYNAPSE ESB

SYNAPSE-ESPER

MEDIATOR ESP

ER

EXTE

RN

AL

EVEN

TS

ADMIN UI

JMS

UNIFIED

EVENTS

BACKEND

REGISTRY

• FLEXIBLE INFRASTRUCTURE AND EASY

INTEGRATION TO EXISTING SYSTEMS.

• USEFULNESS SCOPES BEYOND THE DOMAIN OF

THE PROJECT

• FINANCIAL INFORMATION EXCHANGE

• RIGID INTERFACE ARCHITECTURE BASED ON

WELL KNOWN DESIGN PATTERNS

• STRATEGY, TEMPLATE, BUILDER

• EASY TO LEARN SAMPLES PROVIDED

• CUSTOMIZABILITY BASED ON REQUIREMENTS

© Creative Commons Attribution-Share Alike 3.0 Unported License

Page 19: Project SCI-Flex

SYNAPSE ESB

SYNAPSE-ESPER

MEDIATOR ESP

ER

EXTE

RN

AL

EVEN

TS

ADMIN UI

JMS

UNIFIED

EVENTS

BACKEND

REGISTRY

• POWERFUL MAP MESSAGE HANDLING

CAPABILITY ADDED TO EXISTING JMS INFRASTRUCTURE

• WORKS OUT OF THE BOX, WITH MINIMAL

CONFIGURATION REQUIREMENTS

• REUSE OF COMPONENTS THROUGH API EXTENSION

• ITERATIVE AND COLLABORATIVE AGILE

DEVELOPMENT METHODOLOGY

© Creative Commons Attribution-Share Alike 3.0 Unported License

Page 20: Project SCI-Flex

SYNAPSE ESB

SYNAPSE-ESPER

MEDIATOR ESP

ER

EXTE

RN

AL

EVEN

TS

ADMIN UI

JMS

UNIFIED

EVENTS

BACKEND

REGISTRY

• JSP (JAVA SERVER PAGES) FRONTEND DRIVEN

BY WEB-SERVICE (BACKEND)

• OSGI COMPLIANT

• FLEXIBLE INTEGRATION WITH WSO2 ENTERPRISE SERVICE BUS 2.0 (FIRST 3RD

PARTY COMPONENT FOR WSO2 ESB)

• LOGGING AND ANALYZING THE MEDIATOR

STATISTICS

• EASILY MANAGING THE SYNAPSE-ESPER

MEDIATION PROCESS

• MEDIATOR CONFIGURATION

© Creative Commons Attribution-Share Alike 3.0 Unported License

Page 21: Project SCI-Flex

• WSO2 ESB 2.0 USER INTERFACE (CARBON FRAMEWORK

BASED )DEPENDENCY

• OSGI INTEGRATION

• JAVA MESSAGING SYSTEM SUPPORT

• LACK OF DOCUMENTATION ON UNDERLYING INFRASTRUCTURE

COMPONENTS

• WSO2 CARBON 1.0

© Creative Commons Attribution-Share Alike 3.0 Unported License

Page 22: Project SCI-Flex

• USER INTERFACE FULLY DE-COUPLED FROM THE

UNDERLYING IMPLEMENTATION

• HIGH LEVEL OF SCALABILITY

• PERSISTENT SUBSCRIPTION MANAGEMENT

• CONSISTENT USER INTERFACE THROUGHOUT THE

SYSTEM AND SEAMLESS INTEGRATION WITH SYNAPSE

ENTERPRISE SERVICE BUS

• HIGH LEVEL OF RE-USE AND INTEGRATION OF

COMPONENTS

© Creative Commons Attribution-Share Alike 3.0 Unported License

Page 23: Project SCI-Flex

• SCI-FLEX WAS INTRODUCED BY MR. PAUL FREMANTLE IN A

WEBINAR AS ONE OF THE MAJOR SYNERGIES OF SYNAPSE

ENTERPRISE SERVICE BUS

• FIRST THIRD PARTY COMPONENT FOR WSO2 ESB 2.0

• MR. ASANKA ABEYSINGHE ALSO INCLUDED SCI-FLEX IN AN

ARTICLE ON FINANCIAL INFORMATION EXCHANGE

• QUALITY CODING ENSURED BY THE APPLICATION OF GLOBALLY

RECOGNIZED STANDARDS

• COMPREHENSIVE WEBSITE (WWW.SCI-FLEX.ORG) WITH ALL

RESOURCES AND GUIDANCE

• 2 RESEARCH PAPERS RELATED TO SCI-FLEX; ‘COMPLEX EVENT

PROCESSING IN A SERVICE ORIENTED ARCHITECTURE -BENEFITS’ &‘AUTONOMOUS EVENT DRIVEN ARCHITECTURE’

© Creative Commons Attribution-Share Alike 3.0 Unported License

Page 24: Project SCI-Flex

• INTEGRATION OF SCI-FLEX COMPONENTS TO REAL-WORLD PROJECTS

• XPATH QUERYING ACROSS HIERARCHICAL MAPS IN

JAXEN

• WS-TOPICS ENHANCEMENTS FOR EVENTING

• IMPROVING THE COVERAGE OF SAMPLES AND TESTS

© Creative Commons Attribution-Share Alike 3.0 Unported License

Page 25: Project SCI-Flex

• PROJECT STATISTICS (HTTP://WWW.OHLOH.NET/P/SCIFLEX)

• 20000+ LOC

• 3+ PERSON YEARS ESTIMATED EFFORT (COCOMO MODEL )

• LICENSING: • SCI-FLEX CORE COMPONENTS: APACHE 2.0 LICENSE,

• SCI-FLEX SYNAPSE-ESPER PLUG-IN: GNU GENERAL PUBLIC LICENSE 2.0

• ONLINE PRESENCE:

• GOOGLE CODE: HTTP://CODE.GOOGLE.COM/P/SCI-FLEX/

• MAIN PROJECT WEBSITE: HTTP://WWW.SCI-FLEX.ORG/

• GOOGLE GROUPS, MARKMAIL LIST ARCHIVES

• 100% OPEN SOURCE PROJECT UTILIZING AGILE METHODS

• AVAILABLE AS :• SVN CHECKOUT

• WEB DOWNLOAD

• MAVEN REPOSITORY

© Creative Commons Attribution-Share Alike 3.0 Unported License

Page 26: Project SCI-Flex

• DR. SHANTHA FERNANDO AND MR. INDIKA PERERA– DEPT. OF

COMPUTER SCIENCE & ENGINEERING, UNIVERSITY OF MORATUWA -PROJECT COORDINATORS

• DR. SANJIVA WEERAWARANA, CEO OF WSO2 – COORDINATOR

• MR. PAUL FREMANTLE (CO-FOUNDER & CTO, WSO2) – MENTOR & MAIN SUPERVISOR

• MR. ASANKA ABEYSINGHE (SOFTWARE ARCHITECT, WSO2)

• MR. SANJAYA KARUNASENA

• MRS. VISHAKA NANAYAKKARA, HEAD OF THE DEPARTMENT OF

COMPUTER SCIENCE AND ENGINEERING, UNIVERSITY OF MORATUWA

• PROF. GIHAN DIAS AND MR. CHAMARA DISANAYAKE, DEPARTMENT OF

COMPUTER SCIENCE AND ENGINEERING, UNIVERSITY OF MORATUWA – AID

IN OBTAINING RESOURCES FOR FINAL DEMONSTRATIONS

• MR. MAHENDRA PIRAVEENAN, MR. KISHAN WIMELAWARNE, AND MISS. UPULI GUNASINGHE; , DEPARTMENT OF COMPUTER SCIENCE AND

ENGINEERING, UNIVERSITY OF MORATUWA – PROJECT EVALUATIONS

• ENTIRE STAFF OF CSE (ACADEMIC & NON-ACADEMIC)

© Creative Commons Attribution-Share Alike 3.0 Unported License

Page 27: Project SCI-Flex
Page 28: Project SCI-Flex