bës tni test. - umlaut...406 317 135 Operator 4 433 267 124 ˜ Shown total scores are rounded. 910...

9
For adding something on top of telecommunication services and network connectivity in Poland and reaching an overall score of 910 dots in the annual umlaut benchmarking survey we proudly award this certificate to Poland T-Mobile Score 910 of 1000 in Total Score 323 of 340 in Voice Services Score 461 of 510 in Data Services Score 126 of 150 in Crowdsourced Quality bëst in test. Hakan Ekmen Chief Executive Officer Telecommunication umlaut

Transcript of bës tni test. - umlaut...406 317 135 Operator 4 433 267 124 ˜ Shown total scores are rounded. 910...

Page 1: bës tni test. - umlaut...406 317 135 Operator 4 433 267 124 ˜ Shown total scores are rounded. 910 863 858 824 Voice max. 340 Data max. 510 Crowd max. 150 Operator 8 umlaut certifi

For adding something on top of telecommunication services and network connectivity in Poland and reaching an overall score of 910 dots in the annual umlaut benchmarking survey we proudly award this certificate to

Poland T-Mobile

Score 910 of 1000 in TotalScore 323 of 340 in Voice ServicesScore 461 of 510 in Data ServicesScore 126 of 150 in Crowdsourced Quality

bëst in test.

Hakan EkmenChief Executive Officer Telecommunication umlaut

Page 2: bës tni test. - umlaut...406 317 135 Operator 4 433 267 124 ˜ Shown total scores are rounded. 910 863 858 824 Voice max. 340 Data max. 510 Crowd max. 150 Operator 8 umlaut certifi

Measurement setupMeasurement Overview

Drivetest Voice Data

Device Samsung Galaxy S8 Samsung Galaxy S8

Test Cases Mobile-to-Mobile (M2M)Side1 (4G preferred: Volte) to Side2 (4G preferred: Volte)115 sec call window70 sec call duration15 sec call setup timeoutMulti-RAB traff ic injection on both sides

Data 4G preferred CAHTTP DL datastream 7sHTTP UL datastream 7sHTTP 3MB DL fi xed fi le transferHTTP 1MB UL fi xed fi le transferWeb Browsing - Kepler ETSI Ref. Page8 Live web pages (4 http / 4 https)2 YouTube HD video ~ 45s1 YouTube live stream ~ 45s

Mobility andRoute Types

Drive test 100%55% in Cities, 17% in Towns and 28% on Roads

Samples ~ 4500 per Operator ~ 3900 per Operator

Dates 27 measurement days12.01.2019. – 12.03.2019

Crowd DataAssessment

Crowd Coverage and User Download Speed: December 2018 till February 2019Crowd Data Service Availability: June 2018 till February 2019

2

umlaut certifi cate umlaut certifi cate

3

umlaut communications GmbH tested and measured the

performance of its voice and data services on smart-

phones in comparison to other LTE/UMTS/GSM mobile

radio networks in metropolitan and rural areas of Poland.

The audit was done as a performance benchmark

performed by umlaut communications between January

and March 2019 in cities and towns as well as on connec-

tion roads.

Dedicated measurements have been executed as drive

tests outdoors using a Samsung Galaxy S8 cat16 Smart-

phone 1000 Mbit/s Download / 105 Mbit/s Upload.

All data measurements have been performed in 4G

preferred mode. Voice measurements have been done in

4G/4G preferred mode on both sides, while call origin has

been alternated.

In addition crowdsourced performance data has been

collected and evaluated between June 2018 and February

2019.

The following pages provide a comparative overview ab-

out the performance results observed for the

different tested service types.s.

Page 3: bës tni test. - umlaut...406 317 135 Operator 4 433 267 124 ˜ Shown total scores are rounded. 910 863 858 824 Voice max. 340 Data max. 510 Crowd max. 150 Operator 8 umlaut certifi

Testing areasDrive route

Testing areasCrowdsourcing tested area

22 % of population measured

40,4 % of populated areas

10000 kmmeasuring distance

26000 km2

size of tested area

Warsaw

Radom

TarnowTychy

Chorzow

Ruda Slaska

Plock

Gorzow Wielkopolski

Lublin

RzeszowKrakow

Bielsko-Biala

Wroclaw

Walbrzych Opole

Poznan

Bydgoszcz

GdanskKoszalin

Lodz

4

umlaut certifi cate umlaut certifi cate

5

Page 4: bës tni test. - umlaut...406 317 135 Operator 4 433 267 124 ˜ Shown total scores are rounded. 910 863 858 824 Voice max. 340 Data max. 510 Crowd max. 150 Operator 8 umlaut certifi

Claims Methodology

The leader in mobile benchmarking, umlaut, has analy-

zed the mobile networks of Poland with regards to mobile

network performance. We measure smartphone voice and

data performance based on extensive drive-tests – from

major metropolitan areas to smaller cities and connection

roads.

We objectively define the routes and test methodolo-

gy and publish the results through certificates or public

benchmark reports.

As the de-facto industry standard, our benchmarking me-

thodology focuses on customer-perceived network quality

and covers a wide range of mobile services.

Today, more than 200 mobile networks in more than

120 countries are being evaluated by our unique scoring

methodology. It allows a technical analysis that is unpre-

cedented in its level of detail and enables comparisons

between the network performance and capability of each

mobile network. Our public benchmarks as well as the

certificate benchmarks help network operators to demon-

strate how well they are delivering wireless connections to

consumers, business users and enterprises and reveals the

areas of improvement.

Best in voiceT-Mobile Poland

Best in dataT-Mobile Poland

Best in testT-Mobile Poland

6

umlaut certifi cate umlaut certifi cate

7

Page 5: bës tni test. - umlaut...406 317 135 Operator 4 433 267 124 ˜ Shown total scores are rounded. 910 863 858 824 Voice max. 340 Data max. 510 Crowd max. 150 Operator 8 umlaut certifi

Score and breakdown

Shown scores are rounded.

T-Mobile Poland achieved the highest overall score among competitors with 910 dots out of maximum 1000.

Total score

T-Mobile Operator 2 Operator 3 Operator 4

Voice max. 340 323 285 317 267

Cities Drivetest 204 96% 88% 95% 79%

Towns Drivetest 68 98% 90% 95% 79%

Roads Drivetest 68 90% 64% 88% 75%

Data max. 510 461 447 406 433

Cities Drivetest 306 93% 90% 80% 88%

Towns Drivetest 102 86% 90% 76% 82%

Roads Drivetest 102 89% 79% 82% 81%

Crowdsourced Quality max. 150 126 131 135 124

Crowd 150 84% 87% 90% 83%

Total 1000 910 863 858 824

The graphic indicates the score points achieved by the networks under test in the modules “Voice”, “Data Services” and

“Crowdsourced Quality”.

Total Score1000 Points

T-Mobile

461

323

126

Operator 2

447

285

131

Operator 3

406

317

135

Operator 4

433

267

124

- S

how

n to

tal s

core

s ar

e ro

und

ed.

910863 858

824

Voicemax. 340

Datamax. 510

Crowdmax. 150

Operator

8

umlaut certifi cate umlaut certifi cate

9

Page 6: bës tni test. - umlaut...406 317 135 Operator 4 433 267 124 ˜ Shown total scores are rounded. 910 863 858 824 Voice max. 340 Data max. 510 Crowd max. 150 Operator 8 umlaut certifi

The following table indicates the achieved percentage of the maximum score in each of the diff erent data services.

Data Service Group max T-Mobile Operator 2 Operator 3 Operator 4

Cities

Web Browsing 68 97% 94% 89% 94%

File Download 85 89% 84% 81% 79%

File Upload 85 93% 90% 89% 94%

YouTube 68 93% 92% 58% 83%

Towns

Web Browsing 22,7 94% 94% 88% 91%

File Download 28,3 81% 85% 76% 76%

File Upload 28,3 89% 88% 86% 85%

YouTube 22,7 81% 95% 53% 75%

Roads

Web Browsing 22,7 93% 84% 91% 87%

File Download 28,3 88% 83% 86% 80%

File Upload 28,3 87% 69% 86% 83%

YouTube 22,7 87% 80% 63% 74%

Voice KPI overviewThe following table indicates the achieved values of all networks under test in each of the relevant Voice Key

Performance Indicators (KPIs) for the geographical categories “Cities”, “Towns” and “Roads”.

Voice Service Group Unit T-Mobile Operator 2 Operator 3 Operator 4

Cities

Qualifi er [%] 99,4 98,8 99,4 99,2

Call Setup Time [s] 1,9 3,2 2,3 7,2

Call Setup Time (P90) [s] 2,6 5,4 2,8 8,5

Speech Quality (AVG) [MOS-LQO] 4,2 4,2 3,9 3,5

Towns

Qualifi er [%] 99,7 99 99,4 99

Call Setup Time [s] 2 3 2,3 6,7

Call Setup Time (P90) [s] 2,6 5,2 2,8 8

Speech Quality (AVG) [MOS-LQO] 4,2 4,2 3,9 3,4

Roads

Qualifi er [%] 97,5 92,4 97,2 97,5

Call Setup Time [s] 2,1 3,5 2,3 7

Call Setup Time (P90) [s] 2,8 7,2 2,8 8,5

Speech Quality (AVG) [MOS-LQO] 4,1 4 3,8 3,4

10

umlaut certifi cate umlaut certifi cate

11

Page 7: bës tni test. - umlaut...406 317 135 Operator 4 433 267 124 ˜ Shown total scores are rounded. 910 863 858 824 Voice max. 340 Data max. 510 Crowd max. 150 Operator 8 umlaut certifi

Data KPI overviewThe following table indicates the achieved values of all networks under test in each of the relevant Data Key Performance

Indicators (KPIs) for the geographical category “Cities”.

Data Cities KPI Name Unit T-Mobile Operator 2 Operator 3 Operator 4

HTTP Live Page DL

Qualifi er [%] 99,5 99,5 98,3 99,3

Time to fi rst Byte [ms] 263 312 304 273

KBytes fi rst second [KB] 797 682 726 689

HTTP Static Page DL

Qualifi er [%] 99,6 99,7 99,3 99,5

Overall Session Time [s] 1,3 1,4 1,7 1,3

HTTP fi le DL 3MB

Qualifi er [%] 99,9 99,7 99,3 99,6

Average Session Time [s] 1,3 1,8 2,0 2,6

90% faster than [kbit/s] 11819 8809 8591 4643

10% faster than [kbit/s] 64171 59701 54360 50209

HTTP fi le UL 1MB

Qualifi er [%] 99,7 99,1 99,3 100,0

Average Session Time [s] 0,7 0,8 0,8 0,7

90% faster than [kbit/s] 8791 7125 7443 9492

10% faster than [kbit/s] 22989 27064 25000 23669

HTTP DL FDTT 7s

Qualifi er [%] 99,9 99,5 98,4 99,8

Average Data Rate [kbit/s] 61408 47226 52320 30046

90% faster than [kbit/s] 12978 10282 10479 5450

10% faster than [kbit/s] 124668 97347 106473 64325

HTTP UL FDTT 7s

Qualifi er [%] 99,8 99,3 99,0 99,8

Average Data Rate [kbit/s] 27611 31060 26254 28946

90% faster than [kbit/s] 11380 9349 8620 11616

10% faster than [kbit/s] 39892 54293 39509 43661

YouTube

Start Time [s] 1,4 1,6 1,6 1,6

Playouts w/o interruptions [%] 99,6 99,6 99,1 98,3

AVG Resolution [p] 1074 1077 1072 1061

Qualifi er [%] 98,8 99,0 87,6 97,8

YouTube Live

Start Time [s] 2,1 2,2 2,5 2,2

Playouts w/o interruptions [%] 99,0 98,5 97,3 97,9

AVG Resolution [p] 1073 1073 1070 1047

Qualifi er [%] 98,8 98,8 97,7 97,3

Data Towns KPI Name Unit T-Mobile Operator 2 Operator 3 Operator 4

HTTP Live Page DL

Qualifi er [%] 99,4 99,6 98,8 99,2

Time to fi rst Byte [ms] 274 329 314 287

KBytes fi rst second [KB] 706 665 601 598

HTTP Static Page DL

Qualifi er [%] 99,5 99,8 99,1 99,6

Overall Session Time [s] 1,5 1,4 1,9 1,5

HTTP fi le DL 3MB

Qualifi er [%] 100,0 99,9 99,7 99,7

Average Session Time [s] 2,2 1,7 3,3 4,0

90% faster than [kbit/s] 5542 9838 4111 2725

10% faster than [kbit/s] 54770 58142 36821 43478

HTTP fi le UL 1MB

Qualifi er [%] 100,0 99,7 99,7 99,6

Average Session Time [s] 0,9 1,1 1,3 1,2

90% faster than [kbit/s] 6154 4611 4508 4367

10% faster than [kbit/s] 20888 24540 21209 21198

HTTP DL FDTT 7s

Qualifi er [%] 99,3 99,6 98,9 99,7

Average Data Rate [kbit/s] 38109 49340 32174 23548

90% faster than [kbit/s] 5600 11400 5886 3635

10% faster than [kbit/s] 85661 95590 68022 58660

HTTP UL FDTT 7s

Qualifi er [%] 99,7 99,9 100,0 99,4

Average Data Rate [kbit/s] 21335 23553 18649 20915

90% faster than [kbit/s] 6474 6346 4852 5612

10% faster than [kbit/s] 37416 48717 35203 36692

YouTube

Start Time [s] 1,6 1,6 1,9 1,9

Playouts w/o interruptions [%] 99,1 99,4 98,9 97,7

AVG Resolution [p] 1058 1073 1072 1038

Qualifi er [%] 96,6 99,2 87,2 96,6

YouTube Live

Start Time [s] 2,2 2,2 2,6 2,5

Playouts w/o interruptions [%] 98,6 99,2 97,6 96,7

AVG Resolution [p] 1044 1074 1051 1003

Qualifi er [%] 95,9 99,7 94,5 95,9

The following table indicates the achieved values of all networks under test in each of the relevant Data Key Performance

Indicators (KPIs) for the geographical category “Towns”.

12

umlaut certifi cate umlaut certifi cate

13

Page 8: bës tni test. - umlaut...406 317 135 Operator 4 433 267 124 ˜ Shown total scores are rounded. 910 863 858 824 Voice max. 340 Data max. 510 Crowd max. 150 Operator 8 umlaut certifi

Data KPI overviewThe following table indicates the achieved values of all networks under test in each of the relevant Data Key Performance

Indicators (KPIs) for the geographical category “Roads”.

Data Roads KPI Name Unit T-Mobile Operator 2 Operator 3 Operator 4

HTTP Live Page DL

Qualifi er [%] 98,8 95,7 98,8 97,6

Time to fi rst Byte [ms] 283 308 308 305

KBytes fi rst second [KB] 705 688 650 618

HTTP Static Page DL

Qualifi er [%] 98,9 96,3 98,9 97,4

Overall Session Time [s] 1,5 1,5 1,8 1,6

HTTP fi le DL 3MB

Qualifi er [%] 99,7 96,8 99,7 99,0

Average Session Time [s] 2,5 2,3 3,2 4,3

90% faster than [kbit/s] 4410 5981 3922 2630

10% faster than [kbit/s] 54299 59113 44118 50526

HTTP fi le UL 1MB

Qualifi er [%] 99,3 94,7 99,1 98,5

Average Session Time [s] 1,4 1,8 1,4 1,6

90% faster than [kbit/s] 3441 2177 3576 2471

10% faster than [kbit/s] 20487 22112 22093 22284

HTTP DL FDTT 7s

Qualifi er [%] 99,4% 97,0% 98,7% 98,2%

Average Data Rate [kbit/s] 38406 48986 34969 27676

90% faster than [kbit/s] 4774 5558 4799 3082

10% faster than [kbit/s] 92909 105575 77177 70207

HTTP UL FDTT 7s

Qualifi er [%] 98,7 94,1 98,0 98,0

Average Data Rate [kbit/s] 18605 17650 18165 20351

90% faster than [kbit/s] 4487 1931 4056 2597

10% faster than [kbit/s] 34740 40125 35019 40915

YouTube

Start Time [s] 1,7 1,6 1,8 1,8

Playouts w/o interruptions [%] 98,3 99,2 98,0 96,6

AVG Resolution [p] 1038 1051 1062 1037

Qualifi er [%] 97,9 93,5 84,4 92,8

YouTube Live

Start Time [s] 2,3 2,1 2,6 2,3

Playouts w/o interruptions [%] 96,1 97,6 98,1 97,3

AVG Resolution [p] 1006 1053 1039 996

Qualifi er [%] 96,3 94,8 95,3 93,0

14

umlaut certifi cate

Page 9: bës tni test. - umlaut...406 317 135 Operator 4 433 267 124 ˜ Shown total scores are rounded. 910 863 858 824 Voice max. 340 Data max. 510 Crowd max. 150 Operator 8 umlaut certifi

umlaut AG

Am Kraftversorgungsturm 3 · 52070 Aachen · Germany

Hakan Ekmen · Chief Executive Officer Telecommunication

cell +49 151 571 33 235 · [email protected]

www.umlaut.com