eletrorent.pdf
-
Upload
anis-federer -
Category
Documents
-
view
222 -
download
2
Transcript of eletrorent.pdf
-
8/18/2019 eletrorent.pdf
1/38
Introduction
Coverage LTE
Data 3G/ LTE
Data LTE
Voice LTE
9/Oct/2013 v1.0
LTE
Benchmarking measurements &technical analysis
Dominique Dubois, ElectroRent Stefan Engels, Commsquare
-
8/18/2019 eletrorent.pdf
2/38
Introduction
Coverage LTE
Data 3G/ LTE
Data LTE
Voice LTE
9/Oct/2013 v1.0
Commsquare
Mission & facts
2
Commsquare helps mobileoperators excel in terms of thequality of service they deliverto their customers.
“Network doctors”
Technology excellence
Focus on new technologies
End-to-end view
Independent partner
Founded in 2002
HQ in Belgium
Offices in GR & UK
40 engineers &consultants
30 customers, in BE, NL,
DE, LUX, CH, GR, ROM,BUL, TR, etc.
-
8/18/2019 eletrorent.pdf
3/38
Introduction
Coverage LTE
Data 3G/ LTE
Data LTE
Voice LTE
9/Oct/2013 v1.0
Commsquare
Services & Products
3
Hands-ontraining
Benchmarking
Services Products
DAP(data robot)
DataMon(Gn/S11 probe)
Competence areas:
RAT system
End-to-end
SW & IT
Benchmark approach:
Advancedconsultancy
DAP = active monitoring, test robot for data tests
DataMon = passive monitoring system
Both products are developed by Commsquare
Both products support 2G/3G/LTE
In-depth technical
analysis
Standard reporting
Measurements
-
8/18/2019 eletrorent.pdf
4/38
Introduction
Coverage LTE
Data 3G/ LTE
Data LTE
Voice LTE
9/Oct/2013 v1.0
Introduction
4
-
8/18/2019 eletrorent.pdf
5/38
Introduction
Coverage LTE
Data 3G/ LTE
Data LTE
Voice LTE
9/Oct/2013 v1.0
Disclaimer
5
The results in the presentation should not be generalised; the
results are just a snapshot (“moment-opname”).
Hence, based on these measurements one can’t claim “operator X
has the best LTE network”.
The results presented are a snapshot based on:
Three networks in roll-out undergoing fast changes
A very limited geographical area
A short measurement duration (2 days)
The main goal of this presentation is to demonstrate LTE
measurement and analysis capabilities.
-
8/18/2019 eletrorent.pdf
6/38
Introduction
Coverage LTE
Data 3G/ LTE
Data LTE
Voice LTE
9/Oct/2013 v1.0
Measurement setup
6
Drive test in Rotterdam & roads
26 & 27 Sep 2013
SwissQual Diversity
Huawei E392 & Win7 (data)
Samsung S3 (voice)PcTel scanner
-
8/18/2019 eletrorent.pdf
7/38
Introduction
Coverage LTE
Data 3G/ LTE
Data LTE
Voice LTE
9/Oct/2013 v1.0
LTE coverage
7
-
8/18/2019 eletrorent.pdf
8/38
Introduction
Coverage LTE
Data 3G/ LTE
Data LTE
Voice LTE
9/Oct/2013 v1.0
LTE coverage
Total coverage (800+1800MHz)
8
KPN coverage
extended,
contiguous &
indoor
VOD coverage
gaps: early-
stage roll-out
Deep Indoor: RSRP ≥ -90 dBm
Indoor: -90 dBm > RSRP ≥ -100 dBm
Coverage: -100 dBm > RSRP ≥ -116 dBm
No Coverage: RSRP < -116 dBm
VODKPN
-
8/18/2019 eletrorent.pdf
9/38
Introduction
Coverage LTE
Data 3G/ LTE
Data LTE
Voice LTE
9/Oct/2013 v1.0
LTE coverage
Coverage strategy (KPN)
9
KPN focus on
roll-out in
800MHz band
Very limited
1800
coverage
KPN
1800MHz
KPN800MHz
-
8/18/2019 eletrorent.pdf
10/38
Introduction
Coverage LTE
Data 3G/ LTE
Data LTE
Voice LTE
9/Oct/2013 v1.0
LTE coverage
Coverage strategy (VOD)
10
800Mhz band: 71 cells
VOD800MHz
VOD1800MHz
1800Mhz band: 102 cells
More cells, worse coverage
than 800-band
Both 800 and 1800-band roll-out in Rotterdam
-
8/18/2019 eletrorent.pdf
11/38
Introduction
Coverage LTE
Data 3G/ LTE
Data LTE
Voice LTE
9/Oct/2013 v1.0
2G/3G/LTE data
11
-
8/18/2019 eletrorent.pdf
12/38
Introduction
Coverage LTE
Data 3G/ LTE
Data LTE
Voice LTE
9/Oct/2013 v1.0
This is a snapshot for networks in fast changeLimited to Rotterdam & roads during only 2 days
Results are not network-wide relevant
2G/3G/LTE data
Summary KPIs
12
Data Summary KPN T-Mobile Vodafone
FTP download (Mbps) average 20.3 3.9 11.7
FTP upload (Mbps) average 13.8 1.3 7.3
Ping 40 bytes (ms) median 31 79 49Web Kepler (s) median 1.67 5.31 1.85
Kepler success rate 98.63% 97.60% 96.60%
Dominant Technology LTE HSPA LTE
-
8/18/2019 eletrorent.pdf
13/38
Introduction
Coverage LTE
Data 3G/ LTE
Data LTE
Voice LTE
9/Oct/2013 v1.0
KPN: 100% use of LTE
T-Mobile: HSPA (14Mbps) is dominant technology
VOD: 82% LTE usage
2G/3G/LTE data
Technology breakdown
13
-
8/18/2019 eletrorent.pdf
14/38
Introduction
Coverage LTE
Data 3G/ LTE
Data LTE
Voice LTE
9/Oct/2013 v1.0
LTE data
14
-
8/18/2019 eletrorent.pdf
15/38
Introduction
Coverage LTE
Data 3G/ LTE
Data LTE
Voice LTE
9/Oct/2013 v1.0
This is a snapshot for 2 networks in fast change
Limited to Rotterdam & roads during only 2 daysResults are not network-wide relevant
LTE data
Summary KPIs
15
Data Summary KPN NL Vodafone NL
FTP download (Mbps) average 20.3 13.0
FTP upload (Mbps) average 13.8 8.6
Ping 40 bytes (ms) median 31 46Web Kepler (s) median 1.67 1.79
Kepler success rate 98.63% 98.20%
-
8/18/2019 eletrorent.pdf
16/38
Introduction
Coverage LTE
Data 3G/ LTE
Data LTE
Voice LTE
9/Oct/2013 v1.0
KPN
LTE800 service
dominant
LTE1800 only in
Delft
VOD
LTE1800 service
in Rotterdam
although LTE800coverage better
Still UMTS2100
on roads
LTE data
Technology & band usage
16
VODKPN
Each dot on the map represents an FTP download or upload test
-
8/18/2019 eletrorent.pdf
17/38
Introduction
Coverage LTE
Data 3G/ LTE
Data LTE
Voice LTE
9/Oct/2013 v1.0
KPN: 100% use of LTE
Mainly 10MHz BW
LTE800
VOD: 82% LTE usage
Mainly 15MHz BW
LTE1800
LTE data
Technology breakdown
17
KPN
97%
3%
26%
74%
0%
20%
40%
60%
80%
100%
10MHz 20MHz 10Mhz 15MHz
800 1800 800 1800
KPN NL Vodafone NL
Band and Bandwidth
VOD
-
8/18/2019 eletrorent.pdf
18/38
Introduction
Coverage LTE
Data 3G/ LTE
Data LTE
Voice LTE
9/Oct/2013 v1.0
VOD 38% below 10Mbps
KPN only 7% below 10Mbps
LTE data
Download performance
18
-
8/18/2019 eletrorent.pdf
19/38
Introduction
Coverage LTE
Data 3G/ LTE
Data LTE
Voice LTE
9/Oct/2013 v1.0
VOD: typical case download
-
8/18/2019 eletrorent.pdf
20/38
Introduction
Coverage LTE
Data 3G/ LTE
Data LTE
Voice LTE
9/Oct/2013 v1.0
VOD 38% below 5Mbps
KPN only 5% below 5Mbps
LTE data
Upload performance
20
-
8/18/2019 eletrorent.pdf
21/38
Introduction
Coverage LTE
Data 3G/ LTE
Data LTE
Voice LTE
9/Oct/2013 v1.0
LTE data
Web browsing
21
1.67s 1.79s
Median page download time - Kepler
KPN
95% in 2s
VOD
80% in 2s
95% in 2.5s
VOD: all browsing sessions >2s have download
-
8/18/2019 eletrorent.pdf
22/38
Introduction
Coverage LTE
Data 3G/ LTE
Data LTE
Voice LTE
9/Oct/2013 v1.0
LTE data
Ping performance
22
Ping tested with
data stick on Win-7
computer
(SwissQual test)
WARNING: ping is
not the best delay
test method
TCP SYN-ACK is
VOD has wide
distribution
31ms 46ms
-
8/18/2019 eletrorent.pdf
23/38
Introduction
Coverage LTE
Data 3G/ LTE
Data LTE
Voice LTE
9/Oct/2013 v1.0
KPNMore security but public IP address
VOD
Less security but private IP address
LTE data
Security
23
KPN NL Vodafone NL
Authentication Yes No
AS Security Yes Yes
NAS Security Yes No
PDN Address Public, IPv4 Private, IPv4
Max bit-rate for downl (Mbps) 156 102
Max bit-rate for upl (Mbps) 78 51
-
8/18/2019 eletrorent.pdf
24/38
Introduction
Coverage LTE
Data 3G/ LTE
Data LTE
Voice LTE
9/Oct/2013 v1.0
The data results mainly demonstrate 2 networks in a
different stage in their roll-out (in the area tested)
KPN network in a more mature stage (in tested area) More & contiguous coverage (based on LTE800)
Better throughput & web browsing experience
VOD at early commercial stage (in tested area)
Improvement possible in coverage & parameter tuning
Some limitations observed (backhaul?)
Bandwidth of 15MHz (LTE1800) has higher potential
LTE data
Conclusion
24
-
8/18/2019 eletrorent.pdf
25/38
Introduction
Coverage LTE
Data 3G/ LTE
Data LTE
Voice LTE
9/Oct/2013 v1.0
LTE data
Benelux benchmark
25
Data Summary KPN NL Vodafone NL Benelux
FTP download (Mbps) average 20.3 13.0 21.6
FTP upload (Mbps) average 13.8 8.6 12.5
Ping 40 bytes (ms) median 31 46 20
Web Kepler (s) median 1.67 1.76 1.36
Kepler success rate 98.63% 98.20% 99.50%
Comparison with good & more mature network in
Benelux, also LTE1800
-
8/18/2019 eletrorent.pdf
26/38
Introduction
Coverage LTE
Data 3G/ LTE
Data LTE
Voice LTE
9/Oct/2013 v1.0
LTE voice
26
-
8/18/2019 eletrorent.pdf
27/38
Introduction
Coverage LTE
Data 3G/ LTE
Data LTE
Voice LTE
9/Oct/2013 v1.0
Limited drive tests in Rotterdam (no roads)
During 1.5 hours on 27/Sep
100% LTE coverage for both KPN & VOD
Test setup
SwissQual Diversity rel 13, Samsung Galaxy S3
Only calls from mobile to fixed line (“speaking clock”)
Test script
Call setup (dial)
Disconnect (stop) call after 5 sec
Wait 30s before start of next call
LTE voice
Test setup
27
-
8/18/2019 eletrorent.pdf
28/38
Introduction
Coverage LTE
Data 3G/ LTE
Data LTE
Voice LTE
9/Oct/2013 v1.0
CS-fall-back implementation
During call setup, mobile is pushed to 3G or 2G network
At call end, mobile returns to LTE
Redirection to 3G maintains data; redirection to 2G stops data
LTE voice
CS-fall-back & KPIs
28
UE on 2G or 3G
Call setup time Return to LTE
Idle / UE on LTEIdle / UE on LTE
UE in call
User
dial
Ringing
tone
End of
call
C S - F a l l - B a c k
-
8/18/2019 eletrorent.pdf
29/38
Introduction
Coverage LTE
Data 3G/ LTE
Data LTE
Voice LTE
9/Oct/2013 v1.0
LTE voice
Summary
29
CS-FB Summary KPN NL Vodafone NL
Call setup time (s) average 5.63 4.28
CSFB setup success average 100% 100%
Time to return to LTE (s) average 7.7 0.8
-
8/18/2019 eletrorent.pdf
30/38
Introduction
Coverage LTE
Data 3G/ LTE
Data LTE
Voice LTE
9/Oct/2013 v1.0
Excellent call setup
Both networks achieve
100% success for roughly
150 tests
Most calls set-up on LTE
97% (KPN) and 95%
(VOD) respectively
LTE voice
Call setup success rate
30
-
8/18/2019 eletrorent.pdf
31/38
Introduction
Coverage LTE
Data 3G/ LTE
Data LTE
Voice LTE
9/Oct/2013 v1.0
Different strategy
KPN: fall-back to 3G (UTRAN)
VOD: fall-back to 2G (GERAN)
And 1 call to 3G (UTRAN)
LTE voice
CS-FB strategy
31
VOD
VOD
KPN
-
8/18/2019 eletrorent.pdf
32/38
Introduction
Coverage LTE
Data 3G/ LTE
Data LTE
Voice LTE
9/Oct/2013 v1.0
LTE voice
Call setup time
32
VOD average setup time
4.28s
KPN average setup time
5.68s
Different strategy
KPN redirects to 1st
carrier on 3G
VOD redirects to
explicit list of ARFCNson 2G (=a few cells)
VOD
KPN
VOD
4.28s
KPN
5.68s
-
8/18/2019 eletrorent.pdf
33/38
Introduction
Coverage LTE
Data 3G/ LTE
Data LTE
Voice LTE
9/Oct/2013 v1.0
LTE voice
Time to return to LTE
33
KPN: typical performance
Majority returns in 7s
90% returns within 10s
Technical: KPN mobile returns to
idle mode in UTRAN; UE thenreturns to LTE
VOD: very fast return
Fastest in Benelux
99% returns in 1s
Technical: VOD includes redirection
info to LTE in the GERAN release
message
VOD
KPN
If KPN implements same feature,
then it can possibly achieve same
performance
-
8/18/2019 eletrorent.pdf
34/38
Introduction
Coverage LTE
Data 3G/ LTE
Data LTE
Voice LTE
9/Oct/2013 v1.0
LTE voice
Conclusions
34
Call setup on LTE is excellent on both networks
KPN has slower setup & return times
Fall-back to 3G network
Data sessions can be maintained during voice callFaster setup & return possible when introducing features
VOD has fastest call setup time & return to LTE
Fall-back to 2G
Fast thanks to features on 2G
At the expense of breaking data sessions during voice call
-
8/18/2019 eletrorent.pdf
35/38
Introduction
Coverage LTE
Data 3G/ LTE
Data LTE
Voice LTE
9/Oct/2013 v1.0
LTE voice
Benelux benchmark
35
Comparison with more mature network in Benelux,
also LTE1800
CS-FB Summary KPN NL Vodafone NL Benelux
Call setup time (s) average 5.63 4.28 6-8
CSFB setup success average 100% 100% ~98%
Time to return to LTE (s) average 7.7 0.8 8-10
-
8/18/2019 eletrorent.pdf
36/38
Introduction
Coverage LTE
Data 3G/ LTE
Data LTE
Voice LTE
9/Oct/2013 v1.0
Conclusion
36
-
8/18/2019 eletrorent.pdf
37/38
Introduction
Coverage LTE
Data 3G/ LTE
Data LTE
Voice LTE
9/Oct/2013 v1.0
Overall conclusion
37
We have
Demonstrated typical LTE benchmarking measurements
Scratched the surface of technical analyses
REMINDER: results are a snapshot and shouldn’t begeneralised
LTE networks in Rotterdam and surroundings are in fast
roll-out & change:
Data performance is close to international benchmarks for KPN
but not for VOD
Voice performance is very good for both, and in particular good
for VOD
-
8/18/2019 eletrorent.pdf
38/38
Introduction
Coverage LTE
Data 3G/ LTE
Data LTE
Voice LTE
Contact details
Dominique Dubois Stefan Engels (presenter)
[email protected] [email protected]
www.electrorent-europe.com www.commsquare.com
38
mailto:[email protected]:[email protected]://www.electrorent-europe.com/http://www.commsquare.com/http://www.commsquare.com/http://www.electrorent-europe.com/http://www.electrorent-europe.com/http://www.electrorent-europe.com/mailto:[email protected]:[email protected]