How to Improve Service Activation Testing & Assurance ... · NFV Driven Assurance Today’s...

© 2015 - Proprietary and Confidential Information of Telco Systems

| Leading the way to IT-aware networks | www.telco.com

How to Improve Service Activation Testing & Assurance Using NFV

http://www.linkedin.com/companies/166299?trk=ape_s000001e_1000http://twitter.com/TelcoSystemshttp://www.facebook.com/pages/Telco-Systems/82025012075http://www.youtube.com/TelcoSystemshttp://www.telco.com/blog/



NFV Driven Assurance

Today’s Presentation

Carrier-Grade Assurance Solutions: RFC2544, Y.1564, Y.1731

The Chasm: Application Perspective & User Experience

Bridging the Chasm: Ensuring End-to-End Customer Experience

NFV as an enabler for orchestrated and agile service activation testing and assurance

Speakers



Introduction

Link

Verification

Service

Verification

Application

Optimization

Carrier Ethernet Assurance: Network

Embedded & Hardware Accuracy

Application/End-User Perspective

On-Demand Testing & Assurance

Remote and without Truck Roll

Cost – Performance



About Telco Systems

Company Overview

• Leader of innovative edge solutions: CE 2.0 / MPLS / SDN & NFV

• 30+ years of edge networking expertise

• Among the first to launch SDN & NFV solutions

• 300,000 installations valued at $2.5 billion

• Deployed at over 200 service providers in 50 countries

Some of Our Customers

Our Ecosystem



About Netrounds

5

Company/solution Overview

• Founded in 2007

• Simplifying roll out and operations of quality-assured network services

• About 250 customers in three continents

Some of Our 250 Customers

Our Ecosystem



Poll | What is your current testing and assurance focus?

- Layer 1

- Layers 2/3

- Layers 4-7

- All

- None



CARRIER-GRADE TESTING &

ASSURANCETHE CHASM SLIDES

Current Solutions and the Next Step



OAM Management

Carrier-Grade Service Assurance

Service

Layer 2 Layer 3

Advanced Hardware based OAM

Accuracy | Scalability | Device Embedded

IEEE802.3ah

EFM

IEEE802.1ag

CFM ITU-T Y.1731 ITU-T Y.1564 TWAMP RFC2544

Link

Throughput

Back-to-Back

Loss

Latency



Service Assurance: From Service to Application

Carrier Ethernet SLA

Layer 2 & 3 Activation & Monitoring

RFC 2544, Y.1564

Y.1731, TWAMP

Hardware based Accuracy

No additional Equipment

On-Demand & Centrally Managed

The Next Steps

Links and services are according to SLA but applications fails

How to configure priorities and class of service

QoE testing and monitoring tools are expensive & require truck roll



HOW TO ENSURE GREAT CUSTOMER

EXPERIENCE END-TO-END THE CHASM SLIDES

Bridging the chasm



Y.1731, RFC2544, Y.1564 GOOD BUT DO NOT CAPTURE REAL USER

EXPERIENCEES

Statement:



OSI model perspective

L7: VoIP, Video, HTTP, DNS

L6: MPEG video

L5: SIP

L4: TCP (RFC6349), UDP

L3: IP (Y.1564, RFC2544, TWAMP)

L2: Ethernet (Y.1731, RFC2544, Y.1564)



RFC6349 – FRAMEWORK FOR TCP THROUGHPUT TESTING

Example 1



RFC 6349 - Framework for TCP Throughput Testing

“Network providers are coming to the realization that Layer ⅔ testing is not enough to adequately ensure end-users’ satisfaction.”

14



RFC 6349

Not just pushing data…

Stateful TCP!!!

• Path MTU (max packet size before fragmentation)

• Measure RTT (round-trip time)

• TCP connection throughput test • Transfer time ratio (%)

• TCP efficiency (%)

• Buffer delay (%)

15



WHEN STATEFUL TCP IS REQUIRED FOR VERIFYING QOS

Example 2



Example 2: Bandwidth distribution between queues

Example: Excess Bandwidth Allocation

Router(config)# policy-map VLAN

Router(config-pmap)# class BC

Router(config-pmap-c)# bandwidth percent 30

Router(config-pmap-c)# exit

Router(config-pmap)# class BE

Router(config-pmap-c)# bandwidth percent 50

...

How do you test this with

RFC2544/Y.1564?

30%

20%

50%

+ +

Weighted fair queuing

BE

BE+

BC



WHAT ABOUT VERIFYING VOIP, VIDEO (OTT, MULTICAST), INTERNET CONNECTIVITY?

Example 3



Real services



CASE STUDY - NEED FOR STATEFUL TCP TESTING/QOS PROFILING

Tier-1 Telecom Operator



Case study - Description

• Large Tier-1 telco with demanding customer

• L3VPN delivery across country borders

• Customer did their own tests – did not approve delivery (bw distribution between classes)

• No way to test/verify

• No revenues until approval

• Resources spent on this single case: About one man-month

• Resolution time: Many months…

21



Case study – Impact

• Biggest issues from telecom operator point of view • Credibility • Embarrassing not being able to verify, had to ask

customer • Customer dissatisfaction • Cost

• Cost only on fourth place! • Potential savings of testing directly?

• One man-month of efforts • Several months of outstanding revenues

22



Case study – Problem and facts (1)

• Problem?

• Issue with QoS profiles, bandwidth evenly distributed between three classes (33% each)

• Biggest benefit of solving the problem:

• Customer satisfaction

23




24

Total rate ok, distribution between classes NOT ok




• Facts:

• 95% of problems are QoS-related

• Majority of problems on links that span multiple network domains

25



Case study – Future plans

• More requirements from customers to include activation-test

• Start to offer enhanced test as a Value Added Service – cost sharing

• Orchestrated/automated

26



Netrounds

Operations staff

Physical infrastructure Virtual infrastructure

Partner OSS

Partner NFV Orchestrator

Telco

system

Open

Metro

Edge

vProbe SW Probe HW Probe

Netrounds Control Center

Netrounds Act ive Probes

Agent Probe For hypervisors and virtualized networks

For x86 bare metal servers and non-virtualized networks

Pre-installed x86 HW for tradit ional networks

For host platforms in end-user environments

V SW HW A

Data Storage

Visualization

Test Controller

Analytics

active traffic active traffic active traffic

management

Web Portal

Operations staff

Orchestration



Open Metro Edge Solution: CloudMetro Device

Core

Aggregation

Edge

Enterprise

SMB

IoT

Mobile

Carrier Ethernet: 2544, Y.1564, Y.1731 Intel x86 Blade: Netrounds vProbe

EdgeGenie Orchestrator: - OAM of Devices - vProbe VNF Deployment - Across network, On-demand



CloudMetro 100 | CE Switch & x86 NFV CPE



Summary | Next Generation Service Assurance

30

Application QoE Assurance is Currently available with NFV

Carrier Ethernet & QoE Assurance with Hybrid NFV Platform

Meet us at SDN World Congress in Dusseldorf next week

• Joint PoC on “Orchestrated assurance” with Cisco/Orange/Intel

• YouTube video - google “orchestrated assurance”

More about RFC6349 and QoS bandwidth distribution tests

• http://www.netrounds.com/blog/articles/2014/11/28/how-to-test-tcp-qos-rfc-6349-and-beyond/

More about D-NFV for IaaS and Service Assurance:

• http://www.telco.com/index.php?page=open-metro-edge

http://www.netrounds.com/blog/articles/2014/11/28/how-to-test-tcp-qos-rfc-6349-and-beyond/http://www.netrounds.com/blog/articles/2014/11/28/how-to-test-tcp-qos-rfc-6349-and-beyond/http://www.netrounds.com/blog/articles/2014/11/28/how-to-test-tcp-qos-rfc-6349-and-beyond/http://www.netrounds.com/blog/articles/2014/11/28/how-to-test-tcp-qos-rfc-6349-and-beyond/http://www.netrounds.com/blog/articles/2014/11/28/how-to-test-tcp-qos-rfc-6349-and-beyond/http://www.netrounds.com/blog/articles/2014/11/28/how-to-test-tcp-qos-rfc-6349-and-beyond/http://www.netrounds.com/blog/articles/2014/11/28/how-to-test-tcp-qos-rfc-6349-and-beyond/http://www.netrounds.com/blog/articles/2014/11/28/how-to-test-tcp-qos-rfc-6349-and-beyond/http://www.netrounds.com/blog/articles/2014/11/28/how-to-test-tcp-qos-rfc-6349-and-beyond/http://www.netrounds.com/blog/articles/2014/11/28/how-to-test-tcp-qos-rfc-6349-and-beyond/http://www.netrounds.com/blog/articles/2014/11/28/how-to-test-tcp-qos-rfc-6349-and-beyond/http://www.netrounds.com/blog/articles/2014/11/28/how-to-test-tcp-qos-rfc-6349-and-beyond/http://www.netrounds.com/blog/articles/2014/11/28/how-to-test-tcp-qos-rfc-6349-and-beyond/http://www.netrounds.com/blog/articles/2014/11/28/how-to-test-tcp-qos-rfc-6349-and-beyond/http://www.netrounds.com/blog/articles/2014/11/28/how-to-test-tcp-qos-rfc-6349-and-beyond/http://www.netrounds.com/blog/articles/2014/11/28/how-to-test-tcp-qos-rfc-6349-and-beyond/http://www.netrounds.com/blog/articles/2014/11/28/how-to-test-tcp-qos-rfc-6349-and-beyond/http://www.netrounds.com/blog/articles/2014/11/28/how-to-test-tcp-qos-rfc-6349-and-beyond/http://www.netrounds.com/blog/articles/2014/11/28/how-to-test-tcp-qos-rfc-6349-and-beyond/http://www.netrounds.com/blog/articles/2014/11/28/how-to-test-tcp-qos-rfc-6349-and-beyond/http://www.netrounds.com/blog/articles/2014/11/28/how-to-test-tcp-qos-rfc-6349-and-beyond/http://www.netrounds.com/blog/articles/2014/11/28/how-to-test-tcp-qos-rfc-6349-and-beyond/http://www.netrounds.com/blog/articles/2014/11/28/how-to-test-tcp-qos-rfc-6349-and-beyond/http://www.netrounds.com/blog/articles/2014/11/28/how-to-test-tcp-qos-rfc-6349-and-beyond/http://www.netrounds.com/blog/articles/2014/11/28/how-to-test-tcp-qos-rfc-6349-and-beyond/http://www.telco.com/index.php?page=open-metro-edgehttp://www.telco.com/index.php?page=open-metro-edgehttp://www.telco.com/index.php?page=open-metro-edgehttp://www.telco.com/index.php?page=open-metro-edgehttp://www.telco.com/index.php?page=open-metro-edgehttp://www.telco.com/index.php?page=open-metro-edgehttp://www.telco.com/index.php?page=open-metro-edge



Thank you!

Contact Us • Gal Ofel, Telco Systems [email protected]

• Marcus Friman, Netrounds, [email protected]
mailto:[email protected]:[email protected]

How to Improve Service Activation Testing & Assurance ... · NFV Driven Assurance Today’s...

Documents

Transcript of How to Improve Service Activation Testing & Assurance ... · NFV Driven Assurance Today’s...