Advanced architecture for INTER-domain quality of service MONitoring, modelling and visualisation

/21/23

Advanced architecture for INTER-domain quality of service MONitoring,

modelling and visualisation

Project Review No.1

Brussels, Belgium March 12, 2003

IST-2001-34123 http://www.ist-intermon.org

/21/23

Outline

INTERMON Demo

Visual data mining

Modelling & Simulation

Monitoring & Measurements

Architecture

Project Overview

INTERMON partners

Stefan Michaelis (Uni Dortmund)WP6

Matthias Scheidegger (Uni Bern)WP5

Sandra Tartarelli (NEC)WP4

Mauro Gargiulo (CINI/ITEM)WP3

Ulrich Hofmann (Salzburg Research)WP1, WP2

/21/23

Consortium

Universities

and

Research Institutes

SalzburgResearch, Austria

Frauenhofer- FOKUS, Germany

Uni Bern, Switzerland

Uni Budapest, Hungary

Waterford Institute, Ireland

CINI/ITEM, Italy

Uni Dortmund

SAR

FOKUS

Uni Be

DTT-BUTE

WIT

CINI/ITEM

Uni Do

ISP and

Network Operators

T-Syst. Deutsche Telekom, Germ.

Telefonica, Spain

Telecom Italia Lab., Italy

T-NOVA

TID

TILAB

I&C

manufacturer

Siemens PSE, Austria

NEC Europe, Germany

SAG

NEC-E

/21/23

Role of partners

Architecture,delay meas.,topology tool,integr.

Hybrid modelling, simulation, integration

Time series modelling, ARIMA forecasting

Visual data mining, architecture, integration

Architecture, services, integration

Visual data mining, filters, VoIP model., integr.

FOKUS

Uni Be

BUTE

WIT

CINI/ITEM

Uni Do

Traffic analyser, user interface, integr,exploit.

Topology discovery, Modelling,Integr.,exploit.

Traffic Measurement, Modelling, Integration

T-NOVA

TID

TILAB

Requirements, VoIP scenarios, modelling IPFIX, standard., modelling, integr., exploit.

SAG

NEC-E

WP2 Leader

WP4 Leader

WP7 Leader

SAR WP1 LeaderCoord., fluid simul., mod.,DB,QoS tools,integr.

WP3 Leader

WP5 Leader

WP6 Leader

/21/23

Project Meetings and Co-Operation

Project Meetings Kick Off Meeting , Salzburg 4/2002 Project Meeting, Berlin 6/2002 Project Meeting, Waterford 9/2002 Project Meeting, Turin 11/2002 Project Meeting, Salzburg 2/2003

Concertation Meetings 6/2002 Brussels 3/2003 Brussels

Next Generation Networks (NGN) Activities IP QoS & MoMe Roadmap , Benchmarking 7-9/2002 NGNi MoMe Workshop 6/2002 Berlin

/21/23

Project Meetings and Co-Operation

Cluster Activities MoMe ( Monitoring & Measurement) Integration of AQUILA results into INTERMON IPS workshop presentations from AQUILA, CADENUS

Initiation by INTERMON of the first International Workshop on Inter-domain Performance and Simulation (IPS 2003) , Salzburg

20/21.2003

International cooperation with ITA Brazil, NCIT Canada tools used for education in ITA INTERMON exploitation for Tele-Haptics with NCIT

/21/23

Deliverables (all in time)

WP3Feb 03Architecture components and interactions (additional deliverable)

D4

WP6Dec 02Specification of visual data mining and user interface

D7

WP5Dec 02Specification of inter-domain QoS modelling and Simulation toolkit

D6

WP4Sept 02Specification of inter-domain QoS data base with policy controlled data collection

D5

WP4Sept 02Specification of Inter-Domain QoS Monitoring and structure discovery components

D3

WP3Aug 02System Architecture und SpecificationD2

WP2Jun 02Analysis and Requirements ReportD1

WPDateTitle

/21/23

Objectives

Enhance the inter-working of tools in large scale,

multi-domain Internet networks to support: QoS and traffic analysis and forecasting Network planning and traffic engineering

Collect, process and present (in an automatic fashion) information about: Network topology, Traffic flows, QoS, and SLA fulfillment

Integrating various components and methods: Topology detection and traffic measurement tools Distributed information base Measurements based analytical models and simulations ! Visual data mining techniques

/21/23

Tools, data base, interactions, architecture

Policy Controlled DataBaseAccess

Flexible Configurationof DataBase Sources

Visual Data miningTraffic MatrixQoS analysis

Monitoring Tools- active QoS- passive traffic, IPFIX

InterDomain topology discovery

Path structureBGP

Simulation Toolsusing measurement based

load models

Objectives (2)

/21/23

Project Highlights (1) INTERMON Toolkit

first experience feedback from the users ( ISP, I&C )

important step before integration (6/03)

Scalable and efficient Inter-Domain simulation technologies fluid using differential equations

hybrid integrating analytical models

time series data

Measurement based modelling and simulation trace based models (CBTM)

forecasting models (ARIMA considering outliers)

Design of an advanced inter-domain QoS analysis architecture with topology discovery, QoS and traffic monitoring, modelling, simulation and visual data mining using data base with policy control

/21/23

Project Highlights (2)

IPS Workshop 26 presentations distributed over 9 sessions

Contributions from European countries, but also US, Canada, Brazil

2 Tutorials

50 participants + students

Standardisation IPFIX PSAMP Contributed to the establishment of a new IETF WG (PSAMP) Co-chairing IETF PSAMP Submitted 1 Internet Drafts (2 versions) to IETF PSAMP

International research contributions

32 publications - www.ist-intermon.org

/21/23

Innovations (1)

Policy based Monitoring and Measurement Different kinds of QoS analysis need

different policies for tool interworking and data base access

Dependency of end-to-end QoS on inter-domain routing

Dependency of end-to-end QoS on inter-domain topology path

Inter-domain QoS inferencing

(tomography) from end-to-end

measurements and inter-domain

topology discovery

•IPFIX

• combination of tools for multivariate QoS & traffic analysis

• event detection /“outliers“

• INTERMON CM Toolset extension for QoS inferencing (tomography)

/21/23

Innovations (2)

Modelling, Simulation

Load modelsmeasurements <--> load models load models <--> simulation models

Structured load modelsclass based : monitor only heavy loadanalyse outliers

Measurement based QoS modelling and forecasting toolkit

modelling considering abnormal events?Novel forecasting models?VoIP Modelling

Measurement based modelling and simulation environmentby policy driven measurement

Measurement based modelling and forecasting toolkit

QoS prediction based on ARIMA and further models considering „outliers“

application model generators (VoIP,..) integration in CM Toolset

/21/23

Innovations (3)

Inter-Domainabstraction

Algorithm

no loss =>no feedbackin traffic (control)

sequentialtime seriessimulation

Time Series BasedSimulation Architecture/IPS 31-36/

ID-delay= corepropagation + ID-link delay

Hybridsimulation

ns2 with AnalyticalNetwork Cloud Models/IPS 21-30/

aggregated trafficload ->N-distribution

continousload ; usenumericalpower

Multi-Class signal flowmodel/IPS 37-50/

Simulation Models

/21/23

Innovations (4)

Visual data mining

Scalable and flexible data

preparation/visualisation

Customisable visual data mining for

application QoS in interdomain

environment

Spatial composition

Inter-domain traffic analysis

Generalised Pipline Concept - configurable filters, mappings and applications

Spatio-temporal QoS analysis (QoS patterns, „outliers“) for enhanced QoS provision

Flexible traffic matrix concept for inter-domain capacity planning

/21/23

New toolkits for the network operator and end user

Architecture which integrates components and their interfaces database

Interface to the user Command GUI

Visualisation

Management

Innovations must be validated

INTERMON toolkit

INTERMON database

XML interfaces and adapters

Flexible data source integration

Local-global controller

Configurable application integration

into INTERMON Toolkit-GUI

Statistical-, 2-,3-D Visualisation

Test bed

field trial

feedback loop to inter-domain modelling

Innovations (5)

/21/23

Achievements (1)

WP2 Requirements : D1 6/02 (Siemens) Intermon architecture and toolkit requirements - general concepts for tool

integration, policy based tool interaction and data base control

Architecture and INTERMON-integrated Toolkit requirements

Policy based monitoring, Modelling, Simulation, Visual data mining and data base

requirements

Application requirements

QoS / SLA monitoring, modelling, simulation and validation of applications

(VoIP, ..) in inter-domain environment

Border router traffic flow monitoring, modelling and simulation for traffic

engineering and capacity planning

Requirements for services and business scenarios

Cooperations (GEANT, ..)

Results presented at EURESCOM Conference

/21/23

Achievements (2)

WP3 Architecture D2 8/02 ( SR, FHG), D4 2/03 (CINI) D2 8/02 based on the Requirements deliverable

defines tools and their conceptual interfaces

specifies menus and configurable user interface

D4 2/03 Extended Architecture Deliverable March 2003 with implementation oriented view of the architecture and service concepts

global / local controller

abstractions from specific tools (e.g. different meters)

Information model for configuring an IETF IPFIX meter (which can serve to produce further contributions to the IETF)

dedicated presentation planned at today Review

/21/23

Achievements (3)

WP4 Policy controlled data collection&monitoring, database

D3 9/02 (NEC), D5 9/02 (SR) Specification of Inter-Domain QoS Monitoring and structure discovery

components IPFIX traffic measurementCM Toolset topology discovery

Specification of inter-domain QoS data base with policy controlled data collection

INTERMON data base

policy controlled usage of tools for QoS analysis

flexible configuration of data sources

/21/23

Achievements (4)

WP 5 : Modelling, Simulation D6 12/02 (UBE) Several novel simulation concepts and prototypes

=> see innovations

Inter-Domain modelsRouter and domain models based on neural networksModels of traffic aggregate behavior of several application typesPure analytical approach for QoS

Measurement based traffic modellingTrace based traffic model - CBTM method IPSApplication based models (VoIP for IP-Backbones) IPS

/21/23

Achievements (5)

Modelling and prediction of measured time series data of QoS parameters considering “outliers”

Usage of Box&Jenkins (or ARIMA) methodology (differencing the process to remove non-stationarity) and preliminary outliers eliminationIPS

Measurement based QoS forecastingARIMA considering outliers IPS

/21/23

Achievements (6)

WP 6 Visual Data Mining for inter-domain D7 12/02 (UDO)

Generalised filter pipeline concept for scalable and flexible data

preparation/visualisation

Visual data mining for inter-domain topology, traffic and QoSTopology

flexible configurable and parameterizable traffic matrix conversion to meet data

mining demands for traffic flow analysis IPS

spatio-temporal analysis based on statistical models and pattern analysis IPS

Modular user interface for tool integration

/21/23

Achievements (7)

WP 7 Rapid Prototyping Integration ( T-SYS)

First INTERMON integrated Toolkit version is working in a lot of facilities

Intention - development to get experience and to facilitate real usage and

experiments

INTERMON toolkit (current state, business scenarios, functions, future

work)

dedicated presentation planned at today Review

/21/23

Tools (Topology Discovery, Modelling, Simulation, Monitoring)

Controls -Topological and geographical mapping of tools and data bases

Data Base (INTERMON, other data sources)

Objects (Visual data

mining „dictionary“)

INTERMON results

stored in documents

INTERMON Toolkit

INTERMON integrated Toolkit

/21/23

Inter-domain Performance and Simulation Workshop (IPS)20/21.02.2003 Salzburg

www.ist-intermon.org/workshop

initiated by INTERMON project

next IPS 2004 Workshop in Budapest

further steps : IPS conference and IPS Forum for industry and research

/21/23

•lack of european research and projects in inter-domain issues to improve competiveness with rest of the world

•network tomography•interdomain routing•toplogy discovery•events, anomalies•QoS models

•IPS establishment•joint effort of research and industrial partners

•IPS experts from•different disciplines : internet engineers, mathematicians

IPS workshop motivation

/21/23

Standardisation

IETF Drafts

IETF IP Flow Information eXport (IPFIX) working group J. Quittek, T. Zseby, B. Claise, S. Zander:

Requirements for IP Flow Information Export

draft-ietf-ipfix-regs-09.txt, February 2003

IETF Packet Sampling (PSAMP)working group T. Zseby, M. Molina, F. Raspall:

Sampling and Filtering Techniques for IP Packet Selection

draft-ietf-psamp-sample-tech-01.txt, March 2003

J. Quittek

On the Relationship between PSAMP and IPFIX

draft-quittek-psamp-ipfix-01.txt, February 2003

/21/23

Next Steps and future Plans

Implementation - WP4, WP5, WP6 Integration WP7 - first steps 6/2003 Berlin Validation of Models Policy based QoS Analysis Specification Test Bed, Exploitation, Services and Business Scenarios European and international scenarios for INTERMON toolkit usage

Madrid, Salzburg, Berlin and other sites Brazil , Canada

Real Date : GEANT Policy based QoS Analysis Concepts Testscenario and Validation concepts

IPS workshop 2004 MoMe Cluster CeBit 2003 Hannover

/21/23

Outline

Project Overview (WP1)

Architecture (WP3)

Monitoring & Meas. (WP4)

Modelling & Simulation (WP5)

Visual Datamining (WP6)

INTERMON Demo

•Ulrich Hofmann (SalzburgResearch)

•Mauro Gargiulo (CINI/ITEM)

•Sandra Tartarelli ( NEC)

•Matthias Scheidegger ( Uni Bern)

•Stefan Michaelis ( Uni Dortmund)

•.......

/21/23

WP slides will be stored on this computer ( sunday) .... ....

/21/23

Outline


Architecture (WP3)




INTERMON Demo






•.......

/21/23


/21/23

Outline


Architecture (WP3)




INTERMON Demo






•.......

/21/23


/21/23

Outline


Architecture (WP3)




INTERMON Demo






•.......

/21/23


/21/23

Outline


Architecture (WP3)




INTERMON Demo






/21/23

demo slides will be stored on this computer ( sunday) .... ....

Advanced architecture for INTER-domain quality of service MONitoring, modelling and visualisation

Documents

Transcript of Advanced architecture for INTER-domain quality of service MONitoring, modelling and visualisation