[ ] ITU-TQSDG – DUBAI METHODOLOGIES AND TOOLS FOR AUDITING THE QUALITY OF SERVICE.
-
Upload
letitia-daniel -
Category
Documents
-
view
215 -
download
1
Transcript of [ ] ITU-TQSDG – DUBAI METHODOLOGIES AND TOOLS FOR AUDITING THE QUALITY OF SERVICE.
![Page 1: [ ] ITU-TQSDG – DUBAI METHODOLOGIES AND TOOLS FOR AUDITING THE QUALITY OF SERVICE.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d025503460f949d5d10/html5/thumbnails/1.jpg)
[ ]
ITU-TQSDG – DUBAI
METHODOLOGIES AND TOOLS FOR AUDITING THE QUALITY
OF SERVICE
![Page 2: [ ] ITU-TQSDG – DUBAI METHODOLOGIES AND TOOLS FOR AUDITING THE QUALITY OF SERVICE.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d025503460f949d5d10/html5/thumbnails/2.jpg)
[ ]
2
AGENDA
Technology changes
Testing techniques
Latest testing methodologies
Sharing experience
[ TOOLS AND METHODOLOGIES]
![Page 3: [ ] ITU-TQSDG – DUBAI METHODOLOGIES AND TOOLS FOR AUDITING THE QUALITY OF SERVICE.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d025503460f949d5d10/html5/thumbnails/3.jpg)
[ TOOLS AND METHODOLOGIES]
Faisal Ghazaleh ITU-T QSDG, Dubai, November 2014
![Page 4: [ ] ITU-TQSDG – DUBAI METHODOLOGIES AND TOOLS FOR AUDITING THE QUALITY OF SERVICE.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d025503460f949d5d10/html5/thumbnails/4.jpg)
[ TOOLS AND METHODOLOGIES]
Faisal Ghazaleh ITU-T QSDG, Dubai, November 2014
![Page 5: [ ] ITU-TQSDG – DUBAI METHODOLOGIES AND TOOLS FOR AUDITING THE QUALITY OF SERVICE.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d025503460f949d5d10/html5/thumbnails/5.jpg)
[ TOOLS AND METHODOLOGIES]
Faisal Ghazaleh ITU-T QSDG, Dubai, November 2014
![Page 6: [ ] ITU-TQSDG – DUBAI METHODOLOGIES AND TOOLS FOR AUDITING THE QUALITY OF SERVICE.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d025503460f949d5d10/html5/thumbnails/6.jpg)
Global Wearable Devices Traffic Impact: 51 Percent of Total Mobile Data Traffic Will Be 4G by 2018Mobile Data Traffic and Offload Traffic, 2018
Data Hungry Application Distribution Global Mobile Data Traffic Forecast by Region
MESSAGE: DATA TRAFFIC EXPLOSION
[ TOOLS AND METHODOLOGIES]
Faisal Ghazaleh ITU-T QSDG, Dubai, November 2014
![Page 7: [ ] ITU-TQSDG – DUBAI METHODOLOGIES AND TOOLS FOR AUDITING THE QUALITY OF SERVICE.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d025503460f949d5d10/html5/thumbnails/7.jpg)
Coverage/Interference control
Capacity management (capacity optimization/load balancing)
Customer expectations and demands
ANSWER: UNDERSTAND THE IMPACT OF THE NEED TO FOCUS ON CUSTOMERS
Subscribers focus on their perceived experience with offered service (e.g. voice, mobile video, gaming), and operators need to cost efficiently manage and control complex 4G networks while coping with high traffic growthThe wireless operators’ problem at its core:4G ecosystem deployments allow very high data rate apps efficiently delivered to a broad range of devices. This raises subscriber expectations for fixed-line-like service experience (where mobility is not an excuse). This is fundamentally driving the capacity (QoS) crunch inside the network. Therefore: operators face a continuous struggle to maintain high QoE with continual capacity constraints due to spectrum and cost limits. Solution: Customer experience centric network testing and monitoring, and network optimization process automation
Multi RAT
Multi core
IMS**
RCS*/Mobile Cloud
*IP Multimedia Subsystem**Rich Communication SuiteMESSAGE: User satisfaction vs. operators challenges
Faisal Ghazaleh ITU-T QSDG, Dubai, November 2014
![Page 8: [ ] ITU-TQSDG – DUBAI METHODOLOGIES AND TOOLS FOR AUDITING THE QUALITY OF SERVICE.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d025503460f949d5d10/html5/thumbnails/8.jpg)
[ TOOLS AND METHODOLOGIES]
Advance offerings and complicated networks
Keep the testing
methodology simple
Faisal Ghazaleh ITU-T QSDG, Dubai, November 2014
![Page 9: [ ] ITU-TQSDG – DUBAI METHODOLOGIES AND TOOLS FOR AUDITING THE QUALITY OF SERVICE.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d025503460f949d5d10/html5/thumbnails/9.jpg)
[ TOOLS AND METHODOLOGIES]
Reproducing the same environment requires to test like a customer using same
application on the same device in the geographical location of the customer.Faisal Ghazaleh ITU-T QSDG, Dubai, November 2014
![Page 10: [ ] ITU-TQSDG – DUBAI METHODOLOGIES AND TOOLS FOR AUDITING THE QUALITY OF SERVICE.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d025503460f949d5d10/html5/thumbnails/10.jpg)
QoE
KPIs
IEs
Moving closer to the QoECommon component
Automated testing and monitoring
Moving to the cost efficiency Moving to the could
Where the T&M is heading
CAPEX and OPEXMetrics
Licenses
[ TOOLS AND METHODOLOGIES]
Faisal Ghazaleh ITU-T QSDG, Dubai, November 2014
![Page 11: [ ] ITU-TQSDG – DUBAI METHODOLOGIES AND TOOLS FOR AUDITING THE QUALITY OF SERVICE.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d025503460f949d5d10/html5/thumbnails/11.jpg)
• KQIs/KPIs consistency across the different operators.• Time to publish the results and make available online.• Accuracy of the results.• Frequency of the test and cost of the benchmarking/auditing.• Varity of the offered services like VoLTE, OTT, VoHSPA, and video-audio services
RCS-e.
REGULATOR CHALLENGES
[ TOOLS AND METHODOLOGIES]
Faisal Ghazaleh ITU-T QSDG, Dubai, November 2014
![Page 12: [ ] ITU-TQSDG – DUBAI METHODOLOGIES AND TOOLS FOR AUDITING THE QUALITY OF SERVICE.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d025503460f949d5d10/html5/thumbnails/12.jpg)
[ ]
SHARING EXPERIENCE: UNFIED SOLUTION AND KPIS/QKIS
![Page 13: [ ] ITU-TQSDG – DUBAI METHODOLOGIES AND TOOLS FOR AUDITING THE QUALITY OF SERVICE.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d025503460f949d5d10/html5/thumbnails/13.jpg)
GLOBAL PRACTICIES BY TELECOM REGULATORS
Command TestLogfile
AUTOMATIC DATA PROCESSING WITH TEMS™ DISCOVERY
ENTERPRISE
FIELD DATA COLLECTION BY TEMS™
AUTOMATIC AND INVESTIGATION
[ TOOLS AND METHODOLOGIES]
PS
TN
Faisal Ghazaleh ITU-T QSDG, Dubai, November 2014
![Page 14: [ ] ITU-TQSDG – DUBAI METHODOLOGIES AND TOOLS FOR AUDITING THE QUALITY OF SERVICE.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d025503460f949d5d10/html5/thumbnails/14.jpg)
Command TestLogfile
GLOBAL PRACTICIES BY TELECOM REGULATORS
AUTOMATIC DATA PROCESSING WITH TEMS™ DISCOVERY
ENTERPRISE
FIELD DATA COLLECTION BY TEMS™
AUTOMATIC AND INVESTIGATION
[ TOOLS AND METHODOLOGIES]
PS
TN
Faisal Ghazaleh ITU-T QSDG, Dubai, November 2014
![Page 15: [ ] ITU-TQSDG – DUBAI METHODOLOGIES AND TOOLS FOR AUDITING THE QUALITY OF SERVICE.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d025503460f949d5d10/html5/thumbnails/15.jpg)
ANSWER: TEST THE NETWORKS LIKE A REAL CUSTOMER IS
USING IT: A CUSTOMER CENTRIC TESTING SOLUTION (ODM)
Laptop-based drive test solution
maintains control and coordination
through an On-Device Server
Server resides inside the terminal,
managing the supported services
(VoLTE, IP Logging, Call Control etc)
Repeatable “control scripts” supported
across multiple devices (repeatable
testing)
Enables testing of end user terminal
QoS settings and IP stack
characteristics
Provides framework for future
services to be added easily and
controlled by a single client (e.g. Blixt
implementation)
UE
On-Device Server
Se
rvic
e B
Ca
ll C
on
tro
l
Se
rvic
e A
Vo
LTE
Se
rvic
e M
IP L
og
gin
g
TCP/IP (SIP, RTP, etc)
QoS setting per service
QoS
First to test VoLTE-ViLTE as a user via on-device VoLTE client , test everything
ON Device
MESSAGE: testing philosophy: to be highly Innovative by designing measurement metrics suited to the 4G/5G world: ODM solution
Faisal Ghazaleh ITU-T QSDG, Dubai, November 2014
![Page 16: [ ] ITU-TQSDG – DUBAI METHODOLOGIES AND TOOLS FOR AUDITING THE QUALITY OF SERVICE.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d025503460f949d5d10/html5/thumbnails/16.jpg)
Use collected device data to benchmark your network performance against competitors.
Benchmark network coverage against competitors to ensure customers receive top-quality service indoor and outdoor.
BENCHMARK LIKE A USER
Quickly see subscriber experience issues using handset score that aggregates dropped and blocked calls, handover failure, downlink/uplink throughput analyses.
Aggregate handset data analytics. Clearly display the best and worst performing handsets using six key metrics.
Faisal Ghazaleh ITU-T QSDG, Dubai, November 2014
![Page 17: [ ] ITU-TQSDG – DUBAI METHODOLOGIES AND TOOLS FOR AUDITING THE QUALITY OF SERVICE.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d025503460f949d5d10/html5/thumbnails/17.jpg)
[ ]
SHARING EXPERIENCE: CUSTOMER AGENTS
![Page 18: [ ] ITU-TQSDG – DUBAI METHODOLOGIES AND TOOLS FOR AUDITING THE QUALITY OF SERVICE.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d025503460f949d5d10/html5/thumbnails/18.jpg)
• Monitor a targeted group of end users based on the complains like a users in a certain location/with a certain mobile phone.
• Regulators do not have access to the OSS data of the operators.• Interact with the end user right after the event.• Reaching the customer wherever they are across the country.
REGULATOR CHALLENGES
[ TOOLS AND METHODOLOGIES]
Faisal Ghazaleh ITU-T QSDG, Dubai, November 2014
![Page 19: [ ] ITU-TQSDG – DUBAI METHODOLOGIES AND TOOLS FOR AUDITING THE QUALITY OF SERVICE.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d025503460f949d5d10/html5/thumbnails/19.jpg)
Engineering targeting – visualized through heat-maps
19Faisal Ghazaleh ITU-T QSDG, Dubai, November 2014
GLOBAL PRACTICIES BY TELECOM REGULATORS
![Page 20: [ ] ITU-TQSDG – DUBAI METHODOLOGIES AND TOOLS FOR AUDITING THE QUALITY OF SERVICE.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d025503460f949d5d10/html5/thumbnails/20.jpg)
20
Indoor / Outdoor
Faisal Ghazaleh ITU-T QSDG, Dubai, November 2014
![Page 21: [ ] ITU-TQSDG – DUBAI METHODOLOGIES AND TOOLS FOR AUDITING THE QUALITY OF SERVICE.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d025503460f949d5d10/html5/thumbnails/21.jpg)
Single / Multi probe analysis
Test drill down and replay
Cell info on map
21
LIGHT drive testing
Faisal Ghazaleh ITU-T QSDG, Dubai, November 2014
![Page 22: [ ] ITU-TQSDG – DUBAI METHODOLOGIES AND TOOLS FOR AUDITING THE QUALITY OF SERVICE.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d025503460f949d5d10/html5/thumbnails/22.jpg)
Wide range of service testing in both interactive mode as well as a remote
controlled probe
22
Handset functionality
Faisal Ghazaleh ITU-T QSDG, Dubai, November 2014
![Page 23: [ ] ITU-TQSDG – DUBAI METHODOLOGIES AND TOOLS FOR AUDITING THE QUALITY OF SERVICE.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d025503460f949d5d10/html5/thumbnails/23.jpg)
[ ]
SHARING EXPERIENCE: INNOVATIE NEW KQIS
![Page 24: [ ] ITU-TQSDG – DUBAI METHODOLOGIES AND TOOLS FOR AUDITING THE QUALITY OF SERVICE.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d025503460f949d5d10/html5/thumbnails/24.jpg)
Throughput values for DL ABM correlate extremely well to FTP
For ABM, DL and UL throughput and delay are obtained simultaneously
BLIXT™ ABM COMPARED TO FTP (DL EXAMPLE)
FTP intrusiveness= 100%ABM intrusiveness* = 5%
95% less resources
LEGEND
Blixt actual PHY (low)
FTP actual PHY (high)
Blixt app layer throughput
FTP app layer throughputBlixt by Ascom © ASCOM 2014 24
![Page 25: [ ] ITU-TQSDG – DUBAI METHODOLOGIES AND TOOLS FOR AUDITING THE QUALITY OF SERVICE.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d025503460f949d5d10/html5/thumbnails/25.jpg)
25Blixt by Ascom © ASCOM 2014
ABM Accuracy AND LEVEL OF INTRUSIVENESS
Measurements done in a perfect radio environment
Effective zone of ABM
Less suitable
The accuracy displayed in the table on this slide is a comparison of the Blixt™ result as compared to the actual available bendwidth in the network under test. It is not a comparison with FTP!
FTP as a test method is likely to be significantly less accurate than Blixt™ under non-ideal conditions.
![Page 26: [ ] ITU-TQSDG – DUBAI METHODOLOGIES AND TOOLS FOR AUDITING THE QUALITY OF SERVICE.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d025503460f949d5d10/html5/thumbnails/26.jpg)
• “Is it not better to use FTP since it is a standard application and better
represents the user experience?” Answer: FTP is clearly not an application
commonly used by smartphone users. The objective of testing available
bandwidth is to determine this characteristic of the network, and not how well
FTP performs in the network on a specific device. This is essentially what the
FTP legacy method measures.
• “How do we know the results are accurate?” Answer: Other customers have
tested the technology and found it to be accurate, In reality, FTP is less likely to
give an accurate result as it is more susceptible to be negatively affected by
conditions of the test session not related to the available bandwidth.
• “We are happy with our current test methodology, why would we change?”
Answer: With legacy technologies such as 3G, FTP and similar legacy methods
may be perfectly adequate since the available bandwidth is modest. With LTE
bandwidth approaching or exceeding 100 Mbps, these legacy methods become
at best highly impractical and at worst impossible to use, for a variety of reasons.
Please see “Speedtest vs Blixt™” comparison.
Common Questions Answered
Blixt by Ascom © ASCOM 2014 26
![Page 27: [ ] ITU-TQSDG – DUBAI METHODOLOGIES AND TOOLS FOR AUDITING THE QUALITY OF SERVICE.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d025503460f949d5d10/html5/thumbnails/27.jpg)
CONCLUSIONS
PLEASE VISIT OUR WEBSITE:
http://
www.ascom.com/nt/en/index-nt/about-us-network-testing/nt-about-us-resources.htm/
White papers: VoLTE, Video Streaming, HetNets, Carrieir Aggregation
and...watch the space: eMBMS testing to come soon
Informa Webinar: Advanced testing with Ascom in LTE networks
Webinars: VoLTE
Dr. Irina Cotanis ITU-T QSDG, Dubai, November 2014
![Page 28: [ ] ITU-TQSDG – DUBAI METHODOLOGIES AND TOOLS FOR AUDITING THE QUALITY OF SERVICE.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d025503460f949d5d10/html5/thumbnails/28.jpg)
[ ]
QUESTIONS ?
![Page 29: [ ] ITU-TQSDG – DUBAI METHODOLOGIES AND TOOLS FOR AUDITING THE QUALITY OF SERVICE.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d025503460f949d5d10/html5/thumbnails/29.jpg)
[ ]
THANK YOU
Dr. Irina Cotanis ITU-T QSDG, Dubai, November 2014
![Page 30: [ ] ITU-TQSDG – DUBAI METHODOLOGIES AND TOOLS FOR AUDITING THE QUALITY OF SERVICE.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d025503460f949d5d10/html5/thumbnails/30.jpg)
CONCLUSIONSA FULL 24/7 QoE/QOS CYCLE SOLUTION FOR MOBILE NETWORK AND
SERVICES DESIGNED TO MEET CUSTOMERS’ SATISFACTION
Automated data correlation and presentation
Built-in best practices scripted data analytics provide automated root cause analysis
Providing network and customer experience -centric diagnoses for voice (VoLTE, OTT, VoHSPA), and video-audio services (OTT, RCS-e/Joyn)
My competitors’ customers (Benchmark)
My customers, real field agents
My Customer Experience Data
Automated “what,” “why” and engineer- trusted “how” scenarios
Dr. Irina Cotanis ITU-T QSDG, Dubai, November 2014