Service-Oriented Grid Middleware HU Chun-Ming (On behalf of Mr. HUAI Jin-Peng) Beihang University...

Service-Oriented Grid Middleware

HU Chun-Ming (On behalf of Mr. HUAI Jin-Peng)Beihang University

CIAPR IV 2004Shanghai, P.R.China

May 21, 2004 HU Chun-ming: Service Oriented Grid Middleware 2

Agenda

• Backgrounds• Grid Computing & Service Grid• Service-Oriented Grid Middleware

– Grid Middleware in China– NSFC: Network-based Research Environment

• Related Works in Beihang University– Beihang University: A Brief Introduction– Related Works in Beihang University

• What to Do Next?


Opportunity of Grid Computing

openness dynamicdistributed

Geography DistributedLack of Centralized ControlHighly Autonomy

Open ProtocolsSystem and Apps ：

Heterogeneitydiversity

Node ： Connectivity

Provide new opportunity and challenge for information science technology


Evolvement of Internet-oriented Software

Host PC

Scope

NetworkApplication

WordProcessing

MathematicComputing

InternetApplication

Intranet

MainframeComputing

Client/Server

Client/Network

Internet

Evolvement of Computing Paradigm


Evolvement of Internet-oriented Software

compact loosecoupling

Scope

XML/HTTP

MOM

ORB

NetworkApps

HomogeneityApps

Program

Web Services

Services

Components

Objects

InternetApps

granularity/coupling

Evolvement of Access Methods


Past & Present:Contributions of Computing Technologies

• A New Approach to do Research– High Energy Physics– Earth Simulation– ……

• An Effective Manner to do Communication– E-Mail– FTP– WWW– ……– Help the R&D Cooperation by providing a convenient

Intercommunication Manner


Today’s R&D ActivitiesBrings New Requirements

• Collaboration in Wider Area:– Cross the boundary of Domain, Subject, Organization…– Share the Resource / Collaborate between Resources

Domain Typical Project Main Characteristic

high-energy physics

Long Experimental Period

High Volume of Experimental Data

Rapidly Aggregation and Sharing of Analysis result

Participation of scientists all over the world

Biologic

computing

Distributed storage of genic data

Diverse Data/Metadata Format

Dynamic Information


Summary

• So, It is necessary to give a better approach to:– SHARE the resource capacity in Wider Area.– COLLABORATE among more Resources to

solve “BIGGER” problems

– Give scientist a more EASY-TO-USE interface to help them using the environment with TRANSPARENCE.


Agenda






• In the past:– Computing capability: the only evaluation means

• In a network computing environment:– We need another dimension:

• SHARING & COLLABORATING Capability!

How to evaluate: the Value of Computing Technology to science research

Internet

VS

KFlops MFlops GFlops TFlops ComputingCapability



Sharing and cooperatingcapability

Computing capability

intranet extranet internet

MFlops

GFlops

TFlops

– X: Sharing and cooperating capability

– Y: Computing capability

Internet



Sharing and cooperating capability

Computing capability

intranet extranet internet

MFlops

GFlops

TFlops

Internet

Grid (for example, e-Science)


Grid Related Project


Grid Related Project

• Projects– PACI/DTF/EDTF

– Science Grid

– DoD GIG

– EU DataGrid

– UK e-Science

• Industry– CORBA,DCOM, J2EE, Web Services

– IBM: Business on Demand/Business Grid


Sharing & CollaborativeTwo Threads…

• Sharing of – Information:

• Enterprise Computing

• CORBA, COM, EJB.

– Computing Power:• Cluster, Metacomputing

• Computing Grid

• Key points!– Service-oriented

or Service-centric

– Middleware Network Computing

DistributedComputing

Distribute obj./component

CORBA DCOM Java/EJB

Web service

Service Oriented Computing

Parallel computingand

Distributed system

clusterMeta-computing

Computing grid


Conclusion

• 2 Threads are now merging…– Enterprise Computing – Grid Computing

• 2 Key Technology for Resource sharing and collaborating:– Service centered is an important technical trend

to construct large scale distributed system– Middleware is an important approach to bring

interoperation and integration to R&D resources


Knowledge GridData Grid

Conclusion

• Our points:– The GRID is an application pattern– The Web Services is a technical approach to realize the G

RID– Service Grid ： Using Web Services (or other service-orie

nted framework, eg.Jini) to make resources capability sharing & collaborating in a WIDE AREA NETWORK such as Internet.

• xxGrid?

Service Grid (as Infrastructure)Abstraction; Registry; Broker

ComputationalGrid Information

Grid

BioGridVirtual

ObservatoryCampus Grid

OtherApp Grid


Agenda



• Related Works in Beihang University– Beihang University: A Brief Introduction– E-Science Related Works in Beihang University



Grid Middleware in China

• What’s Middleware– Middle of the Apps & Resources

• Grid Middleware– Including:

• Software (Application) Server

• Common Services/Basic Services

• Toolkits

• Programming & Application Models (?)


Grid Middleware in China

• NSFC– Network-based Science Research Environment (NSFC e-Science Pro

ject)• Ministry of Science and Technology

– National High-tech Project (863)• CAS: VEGA• NUTD: GridDAEN

• Ministry of Education– ChinaGrid CGSP

• Chinese Academy of Science– China Science Data Grid (SDG)

• Other Works– Campus Grid: Tsinghua University: TG, HUST: HauU– ……


Agenda






Essence of the Project

Application demand’s Set

D(Demand)

Resource’s Set

R(Resource)

T

Dynamic Mapping between Set D & RTo achieve MAX VALUE of the whole system

Max (Wd *∑ benefit (D) + Wr * ∑ usage (R) )

M:D R

Forecasting &

Optimizing


Essence of the Project

Application demand’s Set

D(Demand)

Resource’s Set

R(Resource)

T

Dynamic Mapping between Set D & RTo achieve MAX VALUE of the whole system

Max (Wd *∑ benefit (D) + Wr * ∑ usage (R) )

M:D R

Forecasting &

Optimizing

Treating Resources as services： Masking the heterogenous resourcesServices Composition: Cooperative work of resourcesService-Oriented Architecture : loose coupling, dynamic compositionMiddleware: Simplify the development, deployment and management of system


Testing Environment of NSFC E-Science Project

• Testing Environment – Testing bed

• Network + Physical Resources

– Testing Software Infrastructure• Runtime

• Common Services

• Toolkits & API

• Programming (Application) Model

– Testing Applications


Testing Environment ——Testing Software Infrastructure

• The basic idea of software platform – Resources encapsulation – Service share – Cooperative work

• Dynamic binding between application and resources

• Service Composition: describe the complex job.

The integrate experimentation platformbased network of science activity environment

high-energy physics

Biology computing

Atmosphere inspection ……

Computing resources

Storage resources

Instrument and equipment

Software resources ……

Service share

Resources encapsulation




Service share Service share Service share


Testing Environment ——Testing Software Infrastructure

Resource Service Layer

Application Support Layer

User Supporting Layer

Security and

system Mngt.

Dev.Methods

& Tools

Applicationdevelopers

Platform managers

Computing resources

Storage resources


Software resources ……





Scientists(End User)

high-energy physics

Biology computing


Service shareService share Service share Service share


Testing Software Infrastructure——9 Key Technologies

Platfo

rmA

rchitectu

re

Resources Encapsulation &Service Runtime Management

Res. Integrating

Mngt.(MDS.) Common Services

(for Resource Sharing)

Service Composition & Collaboration

User Supporting Tech.(GUI, Portal, Programming model) D

om

ain A

pp

s D

evelop

men

t Meth

od

s&

Tech

no

log

ies

Ma

na

ge

men

t

Se

curity

high-energy physics

Biology computing


Computing resources

Storage resources


Softwareresources ……

guide assistant

support

compatible


Testing Software Infrastructure——3 Objectives

• Collaborate-able– Dynamic Relations between Resources– Multi-granularity Collaboration (Data, Service, Process

…)

• Manageable– Uniform Resource Abstraction– Management Architecture– Self-Orgnization, Self-Configration, Self-Optimization

• Trust-able– Trust Management: Policy based Access Control– Reliability: Fault-Detection, Fault-Tolerance, QoS Mngt.


Agenda






Beihang UniversityBeijing University of Aero. & Astro. (BUAA). Since 1952

• Founded in 1952, with Merger of the Aeronautical Departments of 8 Famous Universities, including Tsinghua University and Beiyang University.



• 1952 BIA: Beijing Institute of Aeronautics• 1988 BUAA: Beijing University of Aeronautics & Astronautics• 2002 BUAA: Beihang University



Now BUAA has evolved into a Multi-disciplined Research-oriented University of Science & Engineering with an emphasis on Aviation and Space Travel.

It is one of the important bases for educating and training High-Quality personnel and conducting scientific research in China.


Agenda






Related Works in BUAA

• Network Computing and Software– WebSASE: Web Service based Application S

upporting Environment– Grid middleware ： Web Service based Gri

d System —WebSASE4G

• Domain-Oriented Software Production Platform － SoftProLine

• Information Security


Web service and Grid computing

• Web service– a novel middleware in application data and funct

ion sharing on Internet. – a business application pattern on Internet – provides description ， index ,query, accessing, c

ommunication and interaction criterion through International standard open protocols （ i.e. UDDI 、 WSDL 、 SOAP and so on ）

– widely adopted/supported by enterprises.


WebSASE: An Overview

• Supporting simple Web service and complicated Web service applications

Web service complicated application Pattern

•use MVC pattern for reference to construct application

•Deal with business logic by Web service recursion nesting

•Provides means to concentrated exhibition and customization the users’ view

Model/Instance


WebSASE: Components & Using Scenario


WebSASE4G: An Overview

• What is WebSASE4G?– A web service-oriented Grid application supporting Environment

(WebSASE for Grid)– WebSASE (Web Services-based Application Supporting Environment)

Web service-oriented middleware and software running supporting environment which unifies application deployment, running, monitor and management

• WebSASE4G’s characters– Web service technology abstract based and realized grid services

including resource services, common services and domain services. – Realized unified grid services’ publication, running and

management ,providing open grid service running environment– Constructing grid service basic architecture which supporting resource

services, common services and domain services’ running


WebSASE4G: Components Architecture

Heterogeneous resource

[5]

GridserviceSecuritycontrol

mechanism

[4]

DistributedManagement

andMonitor

mechanism

Grid service

Common

Supporting

platform

Grid Resource

Image process

Grid application

biology information

remoteeducation

Mass data hydrodynamics

[1] Grid service representing 、mutual operation mechanism

And grid service container

[2]Metadata

And DistributedInformation

Servicearchitecture

[6] service data storage and Effective trans-Mission mechanism

[7] Grid service exhibition and unified accessing mechanism

[3] Grid job schedule and coordination mechanism

…

Grid Service Server Resource integration and service control

Grid Service Workflow EngineService-oriented job description,

schedule and running

Grid Service PortalEnd-user oriented interaction

GISA

providingUnified

Services view

CA&

SOAPSecure

communication

AMC+

Plugins GSDesigner

auxiliarytoolkit

Java-based SOG-API


WebSASE4G resource (service) and service instances status monitor

Web-based job schedule and implement monitor

WebSASE4G is a service-oriented, OGSA-based computing Environment which provides necessary running platform and auxiliary development toolkits.


WebSASE4G kernel system

UDDI server

Visual composed serviceModeling toolkit

BHU WSDesignerSimplifies gridServices development

WebSASE4G is a service-oriented, OGSA-based Grid supporting Platform which provides necessary runningplatform and auxiliary development toolkits developed by BUAA.


Grid application Aero & Astro Digital Museum

airplane exhibit hall

Realization technology Museum entrance

Grid technology

Multimedia technology

virtual realism technology

Human-machine interaction technolo

gy

Database technology DB DBDB

Human-machineinteraction

Mechanism


Domain-oriented Software Production Platform

• Gap Between Requirement and SA– Requirement project: describing the problem an

d restriction － what is it? – Software architecture ： providing the blue print

to problem solving － How ?

ProblemTransition and Coherent Evolution from Requir

ement Modeling to Software Architecture ？


• Software stipulations model GOP– GOP establishs graceful mapping between formaliz

ed stipulations and software design ； • Soft-bus based Multi-Engine Coordination A

rchitecture– Matching from software architecture to component – A domain-oriented software production platform—S

oftProLine– “Zero Programming” under Domain Model

SoftProLine


Network Security

• Design and analysis for network security protocols

• Access Control of distributed systems

• Secure group communication


A novel cryptographic protocol algebra model is Proposed

• A new algebra theory is built for describing the run and security of protocols. • Attack acts and security properties of protocols are characterized with algebraic and logic techniques.

We built the rigorous mathematical basis and developed a new approach to the formal analysis of security protocols

Network Security Results of security protocols


Protocol Murφ Brutus Athena STA SPANSPK 1706 1208 36 - 5NSSK - - 68 - 32TMN - 3327 - - 5

S.Kerberos - 3405 - - 6Andrew RPC - - 47 - 7

NSLPK - 146 19 60 29ISO 3-Pass - - 12 - 5

The efficiency of ACT-SPA

An efficient automatic analysis system (ACT-SPA) is developed

Network Security System for security protocols


IntegrationOur Aims...

Security and U

ser Managem

ent

System platform

Web service & Grid service running supporting plat

Software resource

Web service CORBA EJBOther

components

Operationsystem

databaseBasic

service

Service compose and management

Running tools Service schedule

Software producing plat for domain (Softproline)

Tools for registry

and deploy

Description for

Requirements

tools for Software

Developing

→Perfect Running Environment＋ Effective Software Development


Agenda






What to do next?

• Killer Applications over SOG– Large Scale Data Visualization?– E-Science for Scientists over China?– SDG?– IBM Business Grid?

• Yesterday: NGN = IP + QoS– What’s the “NGG” Job-oriented End-to-end Quality o

f Services In Service Grid• Physical Model for Service Computing

– Statistical Physical Model for Large Scale Network?– Behavior of Service Computing?

• SOA’s Rapid Develop Model & Method

Question?

Thanks!

Service-Oriented Grid Middleware HU Chun-Ming (On behalf of Mr. HUAI Jin-Peng) Beihang University...

Documents

Transcript of Service-Oriented Grid Middleware HU Chun-Ming (On behalf of Mr. HUAI Jin-Peng) Beihang University...