A modular architecture for deploying self-adaptive traffic ... · A modular architecture for...

20
A modular architecture for deploying self-adaptive traffic sampling João Marco C. Silva Paulo M. Carvalho Solange Rito Lima Universidade do Minho Portugal

Transcript of A modular architecture for deploying self-adaptive traffic ... · A modular architecture for...

Page 1: A modular architecture for deploying self-adaptive traffic ... · A modular architecture for deploying self-adaptive traffic sampling AIMS 2014 • Systematic techniques ... CPU

A modular architecture for deploying self-adaptive traffic sampling

João Marco C. Silva Paulo M. Carvalho Solange Rito Lima

Universidade do Minho Portugal

Page 2: A modular architecture for deploying self-adaptive traffic ... · A modular architecture for deploying self-adaptive traffic sampling AIMS 2014 • Systematic techniques ... CPU

Introduction

• Traffic sampling plays a key role to achieve efficient network measurements

• to select a subset of packets which will be used to estimate network parameters, avoiding processing all network traffic

• Many sampling techniques have been proposed, but not deployed in measurement points

Universidade do Minho Portugal

A modular architecture for deploying self-adaptive traffic sampling AIMS 2014

Page 3: A modular architecture for deploying self-adaptive traffic ... · A modular architecture for deploying self-adaptive traffic sampling AIMS 2014 • Systematic techniques ... CPU

• Main issue: the balance between computational burden and accuracy

• Memory and CPU usage

• Volume of data stored and transmitted

• Accuracy in metric estimations

Universidade do Minho Portugal

Introduction

A modular architecture for deploying self-adaptive traffic sampling AIMS 2014

Page 4: A modular architecture for deploying self-adaptive traffic ... · A modular architecture for deploying self-adaptive traffic sampling AIMS 2014 • Systematic techniques ... CPU

• To deploy a modular and self-adaptive architecture able to accommodate the selection and configuration of sampling techniques according to the requirements of accuracy and resources available

Universidade do Minho Portugal

Objective

A modular architecture for deploying self-adaptive traffic sampling AIMS 2014

Page 5: A modular architecture for deploying self-adaptive traffic ... · A modular architecture for deploying self-adaptive traffic sampling AIMS 2014 • Systematic techniques ... CPU

Universidade do Minho Portugal

Measurement architecture

A modular architecture for deploying self-adaptive traffic sampling AIMS 2014

• Three layers design

• Management plane

• Sampling plane

• Network plane

• Modular components

• scalability

Page 6: A modular architecture for deploying self-adaptive traffic ... · A modular architecture for deploying self-adaptive traffic sampling AIMS 2014 • Systematic techniques ... CPU

Universidade do Minho Portugal

Measurement architecture

A modular architecture for deploying self-adaptive traffic sampling AIMS 2014

• Management plane

• measurement needs and constraints identification

• Sampling technique selection and configuration

• Self-adaptive behavior

Page 7: A modular architecture for deploying self-adaptive traffic ... · A modular architecture for deploying self-adaptive traffic sampling AIMS 2014 • Systematic techniques ... CPU

Universidade do Minho Portugal

Measurement architecture

A modular architecture for deploying self-adaptive traffic sampling AIMS 2014

• Sampling plane

• modular sampling framework

• resources analyzer

• aggregation and exporting

• IETF IPFIX

Page 8: A modular architecture for deploying self-adaptive traffic ... · A modular architecture for deploying self-adaptive traffic sampling AIMS 2014 • Systematic techniques ... CPU

• Sampling plane - framework

Universidade do Minho Portugal

A modular architecture for deploying self-adaptive traffic sampling AIMS 2014

Measurement architecture

Page 9: A modular architecture for deploying self-adaptive traffic ... · A modular architecture for deploying self-adaptive traffic sampling AIMS 2014 • Systematic techniques ... CPU

Universidade do Minho Portugal

Measurement architecture

A modular architecture for deploying self-adaptive traffic sampling AIMS 2014

• Network plane

• simple tasks

• traffic capture from network interface

• reporting unprocessed collected packets

Page 10: A modular architecture for deploying self-adaptive traffic ... · A modular architecture for deploying self-adaptive traffic sampling AIMS 2014 • Systematic techniques ... CPU

• Deployment of the sampling plane and network plane

• Quantitative comparison of the computational burden / accuracy of different sampling techniques

• in presence of similar workload

• to support the design of an efficient adaptive module

Universidade do Minho Portugal

Ongoing works

A modular architecture for deploying self-adaptive traffic sampling AIMS 2014

Page 11: A modular architecture for deploying self-adaptive traffic ... · A modular architecture for deploying self-adaptive traffic sampling AIMS 2014 • Systematic techniques ... CPU

Universidade do Minho Portugal

A modular architecture for deploying self-adaptive traffic sampling AIMS 2014

• Sampling techniques analyzed

• Systematic count-based (SystC)

• Systematic time-based (SystT)

• Random count-based (RandC)

• Adaptive linear prediction (LP)

• Multiadaptive (MuST)

Ongoing works

Page 12: A modular architecture for deploying self-adaptive traffic ... · A modular architecture for deploying self-adaptive traffic sampling AIMS 2014 • Systematic techniques ... CPU

Universidade do Minho Portugal

A modular architecture for deploying self-adaptive traffic sampling AIMS 2014

• Comparative parameters

• Computational weight

• CPU load, memory usage and volume of data

• Accuracy

• instantaneous throughput, mean throughput, mean packet size

• resorting to descriptive statistics

Ongoing works

Page 13: A modular architecture for deploying self-adaptive traffic ... · A modular architecture for deploying self-adaptive traffic sampling AIMS 2014 • Systematic techniques ... CPU

Universidade do Minho Portugal

A modular architecture for deploying self-adaptive traffic sampling AIMS 2014

• Systematic techniques - high workload scenario

1/8 1/16 1/32 1/64 1/128 1/256

MemoryCPU loadVolume of data

Sampling frequency

Com

puta

tiona

l wei

ght (

%)

020

4060

8010

0

100/500 100/1000 200/500 200/1000 500/1500 500/2500 500/3500

MemoryCPU loadVolume of data

Sampling frequency in milliseconds

Com

puta

tiona

l wei

ght (

%)

020

4060

8010

0

Count-based Time-based

Early results

Page 14: A modular architecture for deploying self-adaptive traffic ... · A modular architecture for deploying self-adaptive traffic sampling AIMS 2014 • Systematic techniques ... CPU

• Computational weight - high workload scenario

Universidade do Minho Portugal

A modular architecture for deploying self-adaptive traffic sampling AIMS 2014

Early results

Page 15: A modular architecture for deploying self-adaptive traffic ... · A modular architecture for deploying self-adaptive traffic sampling AIMS 2014 • Systematic techniques ... CPU

• Computational weight - all traffic scenarios

Universidade do Minho Portugal

Parameter SystC SystT RandC LP MuST

CPU load (%) 5.03 14.55 5.50 27.35 8.82

Memory (kBytes) 76566 95900 81222 82440 85295

CPU load (%) 10.80 17.95 16.86 96.68 10.72

Memory (kBytes) 80773 96410 84042 87698 84371

CPU load (%) 14.92 20.12 18.26 97.27 10.76

Memory (kBytes) 81801 90754 86163 85551 80765

Low

wor

kloa

dM

oder

ate

wor

kloa

dH

igh

wor

kloa

d

A modular architecture for deploying self-adaptive traffic sampling AIMS 2014

Early results

Page 16: A modular architecture for deploying self-adaptive traffic ... · A modular architecture for deploying self-adaptive traffic sampling AIMS 2014 • Systematic techniques ... CPU

• Volume of data - all traffic scenarios

Universidade do Minho Portugal

SystC SystT RandC LP MuST

HighModerateLow

Sampling technique

Volu

me

of d

ata

in M

Byte

s

020

4060

8010

0

SystC SystT RandC LP MuST

HighModerateLow

Sampling technique

Num

ber o

f pac

kets

050

000

1000

0015

0000

2000

00

Ratio SystC SystT RandC LP MuST

%CPU / MByte 1.40 0.20 1.73 1.71 0.45

%Memory / MByte 1.63 0.16 1.73 0.32 0.72

A modular architecture for deploying self-adaptive traffic sampling AIMS 2014

Early results

Page 17: A modular architecture for deploying self-adaptive traffic ... · A modular architecture for deploying self-adaptive traffic sampling AIMS 2014 • Systematic techniques ... CPU

• Accuracy

Universidade do Minho Portugal

Parameter Total SystC SystT RandC LP MuST

Mean throughput (Mbps) / MRE

3.90 3.72 / 0.04 3.70 / 0.04 3.66 / 0.05 3.85 / 0.01 3.81 / 0.02

Mean pkt size (Bytes) 377.58 387.87 375.65 371.39 390.32 386.70

Peak-to-average 4.00 3.90 4.03 4.07 3.87 3.91

Mean throughput (Mbps) / MRE

26.65 25.40 / 0.04 25.08 / 0.05 23.73 / 0.11 25.51 / 0.04 25.44 / 0.04

Mean pkt size (Bytes) 587.26 586.90 579.42 586.53 589.38 587.82

Peak-to-average 2.57 2.57 2.61 2.58 2.56 2.57

Mean throughput (Mbps) / MRE

68.79 65.54 / 0.04 64.06 / 0.06 65.05 / 0.05 64.28 / 0.06 68.47 / 0.004

Mean pkt size (Bytes) 648.59 647.95 633.33 643.15 635.49 652.36

Peak-to-average 2.33 2.33 2.39 2.35 2.38 2.32

Low

wor

kloa

dM

oder

ate

wor

kloa

dH

igh

wor

kloa

d

A modular architecture for deploying self-adaptive traffic sampling AIMS 2014

Early results

Page 18: A modular architecture for deploying self-adaptive traffic ... · A modular architecture for deploying self-adaptive traffic sampling AIMS 2014 • Systematic techniques ... CPU

Conclusions• Preliminary results evince the relevance of

tuning traffic sampling in order to meet distinct measurement needs and constraints

• Despite the extensive deployment of count-based techniques, the time-based approach achieves a better tradeoff volume of data / computational resources usage

Universidade do Minho Portugal

A modular architecture for deploying self-adaptive traffic sampling AIMS 2014

Page 19: A modular architecture for deploying self-adaptive traffic ... · A modular architecture for deploying self-adaptive traffic sampling AIMS 2014 • Systematic techniques ... CPU

• Deploy the adaptive controller module

• reactive

• threshold driven

• fuzzy logic driven

• proactive

• linear prediction

• nonlinear prediction

Universidade do Minho Portugal

Future work

A modular architecture for deploying self-adaptive traffic sampling AIMS 2014

Page 20: A modular architecture for deploying self-adaptive traffic ... · A modular architecture for deploying self-adaptive traffic sampling AIMS 2014 • Systematic techniques ... CPU

A modular architecture for deploying self-adaptive traffic sampling

João Marco C. Silva Paulo M. Carvalho Solange Rito Lima

Universidade do Minho Portugal