bës tni test. - umlaut...406 317 135 Operator 4 433 267 124 ˜ Shown total scores are rounded. 910...
Transcript of bës tni test. - umlaut...406 317 135 Operator 4 433 267 124 ˜ Shown total scores are rounded. 910...
For adding something on top of telecommunication services and network connectivity in Poland and reaching an overall score of 910 dots in the annual umlaut benchmarking survey we proudly award this certificate to
Poland T-Mobile
Score 910 of 1000 in TotalScore 323 of 340 in Voice ServicesScore 461 of 510 in Data ServicesScore 126 of 150 in Crowdsourced Quality
bëst in test.
Hakan EkmenChief Executive Officer Telecommunication umlaut
Measurement setupMeasurement Overview
Drivetest Voice Data
Device Samsung Galaxy S8 Samsung Galaxy S8
Test Cases Mobile-to-Mobile (M2M)Side1 (4G preferred: Volte) to Side2 (4G preferred: Volte)115 sec call window70 sec call duration15 sec call setup timeoutMulti-RAB traff ic injection on both sides
Data 4G preferred CAHTTP DL datastream 7sHTTP UL datastream 7sHTTP 3MB DL fi xed fi le transferHTTP 1MB UL fi xed fi le transferWeb Browsing - Kepler ETSI Ref. Page8 Live web pages (4 http / 4 https)2 YouTube HD video ~ 45s1 YouTube live stream ~ 45s
Mobility andRoute Types
Drive test 100%55% in Cities, 17% in Towns and 28% on Roads
Samples ~ 4500 per Operator ~ 3900 per Operator
Dates 27 measurement days12.01.2019. – 12.03.2019
Crowd DataAssessment
Crowd Coverage and User Download Speed: December 2018 till February 2019Crowd Data Service Availability: June 2018 till February 2019
2
umlaut certifi cate umlaut certifi cate
3
umlaut communications GmbH tested and measured the
performance of its voice and data services on smart-
phones in comparison to other LTE/UMTS/GSM mobile
radio networks in metropolitan and rural areas of Poland.
The audit was done as a performance benchmark
performed by umlaut communications between January
and March 2019 in cities and towns as well as on connec-
tion roads.
Dedicated measurements have been executed as drive
tests outdoors using a Samsung Galaxy S8 cat16 Smart-
phone 1000 Mbit/s Download / 105 Mbit/s Upload.
All data measurements have been performed in 4G
preferred mode. Voice measurements have been done in
4G/4G preferred mode on both sides, while call origin has
been alternated.
In addition crowdsourced performance data has been
collected and evaluated between June 2018 and February
2019.
The following pages provide a comparative overview ab-
out the performance results observed for the
different tested service types.s.
Testing areasDrive route
Testing areasCrowdsourcing tested area
22 % of population measured
40,4 % of populated areas
10000 kmmeasuring distance
26000 km2
size of tested area
Warsaw
Radom
TarnowTychy
Chorzow
Ruda Slaska
Plock
Gorzow Wielkopolski
Lublin
RzeszowKrakow
Bielsko-Biala
Wroclaw
Walbrzych Opole
Poznan
Bydgoszcz
GdanskKoszalin
Lodz
4
umlaut certifi cate umlaut certifi cate
5
Claims Methodology
The leader in mobile benchmarking, umlaut, has analy-
zed the mobile networks of Poland with regards to mobile
network performance. We measure smartphone voice and
data performance based on extensive drive-tests – from
major metropolitan areas to smaller cities and connection
roads.
We objectively define the routes and test methodolo-
gy and publish the results through certificates or public
benchmark reports.
As the de-facto industry standard, our benchmarking me-
thodology focuses on customer-perceived network quality
and covers a wide range of mobile services.
Today, more than 200 mobile networks in more than
120 countries are being evaluated by our unique scoring
methodology. It allows a technical analysis that is unpre-
cedented in its level of detail and enables comparisons
between the network performance and capability of each
mobile network. Our public benchmarks as well as the
certificate benchmarks help network operators to demon-
strate how well they are delivering wireless connections to
consumers, business users and enterprises and reveals the
areas of improvement.
Best in voiceT-Mobile Poland
Best in dataT-Mobile Poland
Best in testT-Mobile Poland
6
umlaut certifi cate umlaut certifi cate
7
Score and breakdown
Shown scores are rounded.
T-Mobile Poland achieved the highest overall score among competitors with 910 dots out of maximum 1000.
Total score
T-Mobile Operator 2 Operator 3 Operator 4
Voice max. 340 323 285 317 267
Cities Drivetest 204 96% 88% 95% 79%
Towns Drivetest 68 98% 90% 95% 79%
Roads Drivetest 68 90% 64% 88% 75%
Data max. 510 461 447 406 433
Cities Drivetest 306 93% 90% 80% 88%
Towns Drivetest 102 86% 90% 76% 82%
Roads Drivetest 102 89% 79% 82% 81%
Crowdsourced Quality max. 150 126 131 135 124
Crowd 150 84% 87% 90% 83%
Total 1000 910 863 858 824
The graphic indicates the score points achieved by the networks under test in the modules “Voice”, “Data Services” and
“Crowdsourced Quality”.
Total Score1000 Points
T-Mobile
461
323
126
Operator 2
447
285
131
Operator 3
406
317
135
Operator 4
433
267
124
- S
how
n to
tal s
core
s ar
e ro
und
ed.
910863 858
824
Voicemax. 340
Datamax. 510
Crowdmax. 150
Operator
8
umlaut certifi cate umlaut certifi cate
9
The following table indicates the achieved percentage of the maximum score in each of the diff erent data services.
Data Service Group max T-Mobile Operator 2 Operator 3 Operator 4
Cities
Web Browsing 68 97% 94% 89% 94%
File Download 85 89% 84% 81% 79%
File Upload 85 93% 90% 89% 94%
YouTube 68 93% 92% 58% 83%
Towns
Web Browsing 22,7 94% 94% 88% 91%
File Download 28,3 81% 85% 76% 76%
File Upload 28,3 89% 88% 86% 85%
YouTube 22,7 81% 95% 53% 75%
Roads
Web Browsing 22,7 93% 84% 91% 87%
File Download 28,3 88% 83% 86% 80%
File Upload 28,3 87% 69% 86% 83%
YouTube 22,7 87% 80% 63% 74%
Voice KPI overviewThe following table indicates the achieved values of all networks under test in each of the relevant Voice Key
Performance Indicators (KPIs) for the geographical categories “Cities”, “Towns” and “Roads”.
Voice Service Group Unit T-Mobile Operator 2 Operator 3 Operator 4
Cities
Qualifi er [%] 99,4 98,8 99,4 99,2
Call Setup Time [s] 1,9 3,2 2,3 7,2
Call Setup Time (P90) [s] 2,6 5,4 2,8 8,5
Speech Quality (AVG) [MOS-LQO] 4,2 4,2 3,9 3,5
Towns
Qualifi er [%] 99,7 99 99,4 99
Call Setup Time [s] 2 3 2,3 6,7
Call Setup Time (P90) [s] 2,6 5,2 2,8 8
Speech Quality (AVG) [MOS-LQO] 4,2 4,2 3,9 3,4
Roads
Qualifi er [%] 97,5 92,4 97,2 97,5
Call Setup Time [s] 2,1 3,5 2,3 7
Call Setup Time (P90) [s] 2,8 7,2 2,8 8,5
Speech Quality (AVG) [MOS-LQO] 4,1 4 3,8 3,4
10
umlaut certifi cate umlaut certifi cate
11
Data KPI overviewThe following table indicates the achieved values of all networks under test in each of the relevant Data Key Performance
Indicators (KPIs) for the geographical category “Cities”.
Data Cities KPI Name Unit T-Mobile Operator 2 Operator 3 Operator 4
HTTP Live Page DL
Qualifi er [%] 99,5 99,5 98,3 99,3
Time to fi rst Byte [ms] 263 312 304 273
KBytes fi rst second [KB] 797 682 726 689
HTTP Static Page DL
Qualifi er [%] 99,6 99,7 99,3 99,5
Overall Session Time [s] 1,3 1,4 1,7 1,3
HTTP fi le DL 3MB
Qualifi er [%] 99,9 99,7 99,3 99,6
Average Session Time [s] 1,3 1,8 2,0 2,6
90% faster than [kbit/s] 11819 8809 8591 4643
10% faster than [kbit/s] 64171 59701 54360 50209
HTTP fi le UL 1MB
Qualifi er [%] 99,7 99,1 99,3 100,0
Average Session Time [s] 0,7 0,8 0,8 0,7
90% faster than [kbit/s] 8791 7125 7443 9492
10% faster than [kbit/s] 22989 27064 25000 23669
HTTP DL FDTT 7s
Qualifi er [%] 99,9 99,5 98,4 99,8
Average Data Rate [kbit/s] 61408 47226 52320 30046
90% faster than [kbit/s] 12978 10282 10479 5450
10% faster than [kbit/s] 124668 97347 106473 64325
HTTP UL FDTT 7s
Qualifi er [%] 99,8 99,3 99,0 99,8
Average Data Rate [kbit/s] 27611 31060 26254 28946
90% faster than [kbit/s] 11380 9349 8620 11616
10% faster than [kbit/s] 39892 54293 39509 43661
YouTube
Start Time [s] 1,4 1,6 1,6 1,6
Playouts w/o interruptions [%] 99,6 99,6 99,1 98,3
AVG Resolution [p] 1074 1077 1072 1061
Qualifi er [%] 98,8 99,0 87,6 97,8
YouTube Live
Start Time [s] 2,1 2,2 2,5 2,2
Playouts w/o interruptions [%] 99,0 98,5 97,3 97,9
AVG Resolution [p] 1073 1073 1070 1047
Qualifi er [%] 98,8 98,8 97,7 97,3
Data Towns KPI Name Unit T-Mobile Operator 2 Operator 3 Operator 4
HTTP Live Page DL
Qualifi er [%] 99,4 99,6 98,8 99,2
Time to fi rst Byte [ms] 274 329 314 287
KBytes fi rst second [KB] 706 665 601 598
HTTP Static Page DL
Qualifi er [%] 99,5 99,8 99,1 99,6
Overall Session Time [s] 1,5 1,4 1,9 1,5
HTTP fi le DL 3MB
Qualifi er [%] 100,0 99,9 99,7 99,7
Average Session Time [s] 2,2 1,7 3,3 4,0
90% faster than [kbit/s] 5542 9838 4111 2725
10% faster than [kbit/s] 54770 58142 36821 43478
HTTP fi le UL 1MB
Qualifi er [%] 100,0 99,7 99,7 99,6
Average Session Time [s] 0,9 1,1 1,3 1,2
90% faster than [kbit/s] 6154 4611 4508 4367
10% faster than [kbit/s] 20888 24540 21209 21198
HTTP DL FDTT 7s
Qualifi er [%] 99,3 99,6 98,9 99,7
Average Data Rate [kbit/s] 38109 49340 32174 23548
90% faster than [kbit/s] 5600 11400 5886 3635
10% faster than [kbit/s] 85661 95590 68022 58660
HTTP UL FDTT 7s
Qualifi er [%] 99,7 99,9 100,0 99,4
Average Data Rate [kbit/s] 21335 23553 18649 20915
90% faster than [kbit/s] 6474 6346 4852 5612
10% faster than [kbit/s] 37416 48717 35203 36692
YouTube
Start Time [s] 1,6 1,6 1,9 1,9
Playouts w/o interruptions [%] 99,1 99,4 98,9 97,7
AVG Resolution [p] 1058 1073 1072 1038
Qualifi er [%] 96,6 99,2 87,2 96,6
YouTube Live
Start Time [s] 2,2 2,2 2,6 2,5
Playouts w/o interruptions [%] 98,6 99,2 97,6 96,7
AVG Resolution [p] 1044 1074 1051 1003
Qualifi er [%] 95,9 99,7 94,5 95,9
The following table indicates the achieved values of all networks under test in each of the relevant Data Key Performance
Indicators (KPIs) for the geographical category “Towns”.
12
umlaut certifi cate umlaut certifi cate
13
Data KPI overviewThe following table indicates the achieved values of all networks under test in each of the relevant Data Key Performance
Indicators (KPIs) for the geographical category “Roads”.
Data Roads KPI Name Unit T-Mobile Operator 2 Operator 3 Operator 4
HTTP Live Page DL
Qualifi er [%] 98,8 95,7 98,8 97,6
Time to fi rst Byte [ms] 283 308 308 305
KBytes fi rst second [KB] 705 688 650 618
HTTP Static Page DL
Qualifi er [%] 98,9 96,3 98,9 97,4
Overall Session Time [s] 1,5 1,5 1,8 1,6
HTTP fi le DL 3MB
Qualifi er [%] 99,7 96,8 99,7 99,0
Average Session Time [s] 2,5 2,3 3,2 4,3
90% faster than [kbit/s] 4410 5981 3922 2630
10% faster than [kbit/s] 54299 59113 44118 50526
HTTP fi le UL 1MB
Qualifi er [%] 99,3 94,7 99,1 98,5
Average Session Time [s] 1,4 1,8 1,4 1,6
90% faster than [kbit/s] 3441 2177 3576 2471
10% faster than [kbit/s] 20487 22112 22093 22284
HTTP DL FDTT 7s
Qualifi er [%] 99,4% 97,0% 98,7% 98,2%
Average Data Rate [kbit/s] 38406 48986 34969 27676
90% faster than [kbit/s] 4774 5558 4799 3082
10% faster than [kbit/s] 92909 105575 77177 70207
HTTP UL FDTT 7s
Qualifi er [%] 98,7 94,1 98,0 98,0
Average Data Rate [kbit/s] 18605 17650 18165 20351
90% faster than [kbit/s] 4487 1931 4056 2597
10% faster than [kbit/s] 34740 40125 35019 40915
YouTube
Start Time [s] 1,7 1,6 1,8 1,8
Playouts w/o interruptions [%] 98,3 99,2 98,0 96,6
AVG Resolution [p] 1038 1051 1062 1037
Qualifi er [%] 97,9 93,5 84,4 92,8
YouTube Live
Start Time [s] 2,3 2,1 2,6 2,3
Playouts w/o interruptions [%] 96,1 97,6 98,1 97,3
AVG Resolution [p] 1006 1053 1039 996
Qualifi er [%] 96,3 94,8 95,3 93,0
14
umlaut certifi cate
umlaut AG
Am Kraftversorgungsturm 3 · 52070 Aachen · Germany
Hakan Ekmen · Chief Executive Officer Telecommunication
cell +49 151 571 33 235 · [email protected]
www.umlaut.com