Post on 02-Aug-2020
For adding something on top in Portugal and reaching an overall score of 931 dots in mobile network benchmarking survey we proudly award this certificate to
Vodafone Portugal
Score 931 out of 1000 in TotalScore 304 out of 320 in Voice ServicesScore 448 out of 480 in Data ServicesScore 179 out of 200 in Crowdsourced Quality
bëst in test.
Hakan EkmenChief Executive Officer Telecommunication
Mobile BenchmarkPortugal
01 20
Measurement setupMeasurement Overview
Drivetest Voice Data
Device Samsung Galaxy S9 Samsung Galaxy S9
Test Cases Mobile-to-Mobile (M2M)Channel1: Side1 (VoLTE) to Side2 (VoLTE) Channel2: Side1 (VoLTE) to Side2 (VoLTE) 115 sec call window70 sec call duration15 sec call setup timeoutMulti-RAB traff ic injection on both sides
Data 4G preferred CAHTTP DL datastream 7sHTTP UL datastream 7sHTTP 5MB DL fi xed fi le transferHTTP 2.5MB UL fi xed fi le transferWeb Browsing - Kepler ETSI Ref. Page10 Live web pages 3 YouTube HD video ~ 45s
Mobility andRoute Types
100% Drivetest53% in Cities, 16% in Towns and 31% on Roads
Samples ~ 12422 ~ 64306
Dates 14 measurement days14.01.2020 – 29.01.2020
Crowd DataAssessment
24 weeksCW32 2019 – CW03 2020
2
umlaut certifi cate umlaut certifi cate
3
umlaut tested and measured the performance of its voice
and data services on smartphones in comparison to other
LTE/UMTS/GSM mobile radio networks in metropolitan
and rural areas of Portugal.
The audit was done as a performance benchmark performed
by umlaut between 14.01.2020 and 29.01.2020 in cities and
towns as well as on connection roads.
Dedicated measurements have been executed as drive
tests outdoors using a Samsung Galaxy S9 cat16 Smart-
phone 1000 Mbit/s Download / 105 Mbit/s Upload.
All data measurements have been performed in 4G
preferred mode. Voice measurements have been done in
4G/4G preferred mode on both sides, while call origin has
been alternated.
In addition crowdsourced performance data has been
collected and evaluated between CW32 2019 and CW03
2020.
The following pages provide a comparative overview
about the performance results observed for the different
tested service types.
Testing areasDrive route
Testing areasCrowdsourcing based test area
LisboaAmadora
Agualva-Cacém
AlmadaBarreiro
Porto Rio Tinto
Braga
Viseu
Vila Nova de Gaia
18.7 % of population measured
84.2 % of populated areas Non-Urban
100.0 % of populated areas Urban
5446 kmmeasuring distance
66.878 km2
size of tested area
4
umlaut certifi cate umlaut certifi cate
5
Claims Methodology
The leader in mobile benchmarking, umlaut, has analyzed
the mobile networks of Portugal with regards to mobile
network performance. We measure smartphone voice and
data performance based on extensive drivetests – from
major metropolitan areas to smaller cities and connection
roads.
We objectively define the routes and test methodology
and publish the results through certificates or public
benchmark reports.
As the de-facto industry standard, our benchmarking
methodology focuses on customer-perceived network
quality and covers a wide range of mobile services.
Today, more than 200 mobile networks in more than
120 countries are being evaluated by our unique scoring
methodology. It allows a technical analysis that is unpre-
cedented in its level of detail and enables comparisons
between the network performance and capability of each
mobile network. Our public benchmarks as well as the
certificate benchmarks help network operators to demon-
strate how well they are delivering wireless connections to
consumers, business users and enterprises and reveals the
areas of improvement.
Best in crowd-sourced qualityVodafone
Best in voiceVodafone
Best in dataVodafone
Best in testVodafone
6
umlaut certifi cate umlaut certifi cate
7
Score and breakdown
Shown scores are rounded.
Vodafone achieved the highest overall score among competitors with 931 dots out of 1000.
Total score
Vodafone Operator 2 Operator 3
Voice max. 320 304 219 193
Cities Drivetest 192 96% 69% 64%
Towns Drivetest 64 96% 75% 45%
Roads Drivetest 64 92% 61% 64%
Data max. 480 448 403 429
Cities Drivetest 288 96% 84% 90%
Towns Drivetest 96 90% 86% 90%
Roads Drivetest 96 90% 80% 86%
Crowdsourced Quality max. 200 179 174 170
Crowd 200 89% 87% 85%
Total 1000 931 796 792
Overall score considering Voice, Data and Crowdsourcing.
Total Score1000 Dots
Operator 2
403
219
174
Operator 3
429
193
170
- S
how
n to
tal s
core
s ar
e ro
und
ed.
Vodafone
448
304
179
Voicemax. 320
Datamax. 480
Crowdmax. 200
Operator
931
796 792
8
umlaut certifi cate umlaut certifi cate
9
Achieved percentage of the maximum score in each of the diff erent data services. Achieved percentage of the maximum score in each of the diff erent crowdsourcing services.
Data Service Group max Vodafone Operator 2 Operator 3
Cities
Web Browsing 64,0 99% 96% 98%
File Download 80,0 93% 78% 87%
File Upload 80,0 95% 89% 85%
YouTube 64,0 96% 74% 93%
Towns
Web Browsing 21,3 98% 94% 97%
File Download 26,7 86% 77% 86%
File Upload 26,7 91% 89% 85%
YouTube 21,3 85% 85% 93%
Roads
Web Browsing 21,3 96% 91% 93%
File Download 26,7 90% 82% 89%
File Upload 26,7 87% 72% 78%
YouTube 21,3 90% 77% 86%
Crowd Service Group max Vodafone Operator 2 Operator 3
Country Operational Excellence 60 97% 97% 93%
Urban
Voice Coverage 13 95% 94% 96%
Data Coverage 17 98% 93% 94%
4G Coverage 29 76% 79% 71%
DL Data Speed 17 80% 68% 70%
UL Data Speed 8 83% 87% 71%
Non-urban (Benchmark view)
Voice Coverage 7 100% 100% 100%
Data Coverage 9 100% 99% 99%
4G Coverage 15 98% 97% 97%
DL Data Speed 9 73% 58% 65%
UL Data Speed 4 47% 41% 46%
Non-urban (Own network view)
Voice Coverage 2 99% 99% 99%
Data Coverage 2 100% 98% 98%
4G Coverage 4 97% 95% 93%
DL Data Speed 2 67% 53% 56%
UL Data Speed 1 40% 37% 39%
10
umlaut certifi cate umlaut certifi cate
11
Voice KPI overviewAchieved values of all networks under test in each of the relevant Voice Key Performance Indicators (KPIs) for the
geographical categories “Cities”, “Towns” and “Roads”.
Voice Service Group Unit Vodafone Operator 2 Operator 3
Cities
Qualifi er [%] 99,5 97,9 97,8
Call Setup Time [s] 1,5 4,9 6,1
Call Setup Time (P90) [s] 1,8 6,5 7,3
Speech Quality (AVG) [MOS-LQO] 4,4 3,5 3,3
Speech Quality (P10) [MOS-LQO] 3,7 2,7 2,6
Multirab connectivity [%] 98,4 70,6 75,4
Towns
Qualifi er [%] 99,4 98,8 95,4
Call Setup Time [s] 1,5 4,9 6,5
Call Setup Time (P90) [s] 1,8 6,2 8,4
Speech Quality (AVG) [MOS-LQO] 4,5 3,5 3,2
Speech Quality (P10) [MOS-LQO] 4,1 2,8 2,4
Multirab connectivity [%] 99,4 70,3 55,0
Roads
Qualifi er [%] 97,9 95,4 96,7
Call Setup Time [s] 1,6 5,5 6,1
Call Setup Time (P90) [s] 1,8 8,3 7,9
Speech Quality (AVG) [MOS-LQO] 4,4 3,5 3,3
Speech Quality (P10) [MOS-LQO] 3,8 2,7 2,4
Multirab connectivity [%] 97,7 58,6 68,6
Data Services KPI overviewAchieved values of all networks under test in each of the relevant Data Key Performance Indicators (KPIs) for the
geographical category “Cities”.
Data Cities KPI Name Unit Vodafone Operator 2 Operator 3
HTTP Live Page DL Smartphone
Qualifi er [%] 100,0 99,6 99,9
Overall Session Time [s] 0,9 1,1 1,0
HTTP Static Page DL Smartphone
Qualifi er [%] 99,9 99,7 99,8
Overall Session Time [s] 0,9 1,1 1,0
HTTP 5MB DL Smartphone
Qualifi er [%] 100,0 100,0 99,9
Average Session Time [s] 1,4 3,8 2,1
90% faster than [Mbit/s] 17,9 5,1 11,1
10% faster than [Mbit/s] 98,2 60,3 78,4
HTTP 2500KB UL Smartphone
Qualifi er [%] 99,9 99,9 99,4
Average Session Time [s] 1,3 1,5 2,3
90% faster than [Mbit/s] 10,3 8,8 5,1
10% faster than [Mbit/s] 43,3 37,2 31,4
HTTP DL FDTT
Qualifi er [%] 100,0 99,6 99,9
Average Data Rate [Mbit/s] 76,3 30,8 62,1
90% faster than [Mbit/s] 19,8 4,7 12,9
10% faster than [Mbit/s] 149,3 70,0 130,3
HTTP UL FDTT
Qualifi er [%] 99,8 99,5 99,3
Average Data Rate [Mbit/s] 34,8 22,1 26,6
90% faster than [Mbit/s] 11,2 8,5 5,8
10% faster than [Mbit/s] 60,2 28,5 52,6
YouTube
Qualifi er [%] 100,0 96,2 99,4
Start Time [s] 1,0 1,4 1,1
AVG Resolution [p] 919 893 916
YouTube LiveSmartphone
Qualifi er [%] 99,8 96,8 99,1
Start Time [s] 1,2 1,4 1,3
AVG Resolution [p] 1039 1004 1035
12
umlaut certifi cate umlaut certifi cate
13
Data Services KPI OverviewAchieved values of all networks under test in each of the relevant Data Key Performance Indicators (KPIs) for the
geographical category “Towns”.
Achieved values of all networks under test in each of the relevant Data Key Performance Indicators (KPIs) for the
geographical category “Roads”.
Data Towns KPI Name Unit Vodafone Operator 2 Operator 3
HTTP Live Page DL Smartphone
Qualifi er [%] 99,9 99,3 99,8
Overall Session Time [s] 1,0 1,1 1,0
HTTP Static Page DL Smartphone
Qualifi er [%] 100,0 99,3 99,8
Overall Session Time [s] 1,0 1,1 1,0
HTTP 5MB DL Smartphone
Qualifi er [%] 100,0 99,3 100,0
Average Session Time [s] 2,5 3,5 1,9
90% faster than [Mbit/s] 7,6 6,0 12,4
10% faster than [Mbit/s] 81,8 57,6 64,7
HTTP 2500KB UL Smartphone
Qualifi er [%] 100,0 100,0 99,7
Average Session Time [s] 1,7 1,6 2,0
90% faster than [Mbit/s] 7,0 8,4 5,7
10% faster than [Mbit/s] 35,4 33,8 27,0
HTTP DL FDTT
Qualifi er [%] 100,0 99,4 99,7
Average Data Rate [Mbit/s] 56,2 38,0 48,8
90% faster than [Mbit/s] 10,2 7,0 14,1
10% faster than [Mbit/s] 117,1 78,3 98,1
HTTP UL FDTT
Qualifi er [%] 99,7 100,0 99,3
Average Data Rate [Mbit/s] 26,2 20,7 21,4
90% faster than [Mbit/s] 7,5 6,1 5,8
10% faster than [Mbit/s] 52,7 28,6 39,8
YouTube
Qualifi er [%] 97,7 97,4 99,7
Start Time [s] 1,1 1,2 1,1
AVG Resolution [p] 913 885 920
YouTube LiveSmartphone
Qualifi er [%] 98,6 100,0 98,6
Start Time [s] 1,4 1,4 1,3
AVG Resolution [p] 1027 998 1037
Data Roads KPI Name Unit Vodafone Operator 2 Operator 3
HTTP Live Page DL Smartphone
Qualifi er [%] 99,5 98,5 98,6
Overall Session Time [s] 1,0 1,3 1,1
HTTP Static Page DL Smartphone
Qualifi er [%] 98,9 97,8 98,0
Overall Session Time [s] 1,1 1,3 1,1
HTTP 5MB DL Smartphone
Qualifi er [%] 99,0 99,0 99,0
Average Session Time [s] 2,8 4,5 3,5
90% faster than [Mbit/s] 8,0 4,4 7,1
10% faster than [Mbit/s] 58,1 48,4 64,2
HTTP 2500KB UL Smartphone
Qualifi er [%] 98,8 97,2 98,4
Average Session Time [s] 2,4 3,7 3,5
90% faster than [Mbit/s] 4,6 2,1 2,9
10% faster than [Mbit/s] 26,8 30,7 26,8
HTTP DL FDTT
Qualifi er [%] 99,2 98,8 98,6
Average Data Rate [Mbit/s] 36,7 26,4 40,9
90% faster than [Mbit/s] 8,2 4,1 8,7
10% faster than [Mbit/s] 77,6 66,2 83,7
HTTP UL FDTT
Qualifi er [%] 98,4 95,1 95,5
Average Data Rate [Mbit/s] 19,8 14,6 18,5
90% faster than [Mbit/s] 5,7 2,4 3,4
10% faster than [Mbit/s] 32,1 28,2 36,9
YouTube
Qualifi er [%] 98,1 93,9 97,0
Start Time [s] 1,2 1,6 1,3
AVG Resolution [p] 906 861 907
YouTube LiveSmartphone
Qualifi er [%] 98,0 95,9 96,8
Start Time [s] 1,4 1,6 1,4
AVG Resolution [p] 1025 972 1021
14
umlaut certifi cate umlaut certifi cate
15
Crowdsourced Quality KPI overviewAchieved values of all networks under test in each of the relevant Crowd Key Performance Indicators (KPIs) for the
geographical categories “country”, “urban” and “non-urban”.
Crowd Service Group Unit Vodafone Operator 2 Operator 3
CountryOperational Excellence
Degraded days [d] 1 1 2
Degraded periods [h] 2 3 8
Urban
4G Coverage Quality of Coverage [%] 94,1 94,6 92,7
Data Coverage Quality of Coverage [%] 99,6 99,0 99,2
DL Data Speed P90 EA Top Throughput [Mbit/s] 72.8 59.6 61.3
UL Data Speed P90 EA Top Throughput [Mbit/s] 22.3 23.8 17.8
Voice Coverage Quality of Coverage [%] 99,8 99,7 99,8
Non-urban (Benchmark view)
4G Coverage Test Area Coverage [%] 99,5 99,0 99,0
Data Coverage Test Area Coverage [%] 100,0 99,8 99,8
DL Data Speed P90 EA Top Throughput [Mbit/s] 28.3 23.3 25.5
UL Data Speed P90 EA Top Throughput [Mbit/s] 4.9 4.2 4.7
Voice Coverage Test Area Coverage [%] 100,0 100,0 100,0
Non-urban (Own network view)
4G Coverage Test Area Coverage [%] 99,2 98,6 97,9
Data Coverage Test Area Coverage [%] 99,9 99,6 99,6
DL Data Speed P90 EA Top Throughput [Mbit/s] 26.2 22.0 22.8
UL Data Speed P90 EA Top Throughput [Mbit/s] 4.0 3.8 3.9
Voice Coverage Test Area Coverage [%] 99,9 99,9 99,9
16
umlaut certifi cate
umlaut AG
Am Kraftversorgungsturm 3 · 52070 Aachen · Germany
Hakan Ekmen · Chief Executive Officer Telecommunication
cell +49 151 571 33 235 · hakan.ekmen@umlaut.com
www.umlaut.com