For Rohtak - TRAI

INDEPENDENT DRIVE TEST REPORT

For

Rohtak2018

November

NORTH ZONE

Key Performance Indicators: All TSPs have met the Drop Call Rate (DCR)

benchmark of 2%. All TSPs have met the Call Setup Success Rate (CSSR) of

95%.

The Independent Drive Test has been carried out by M/s PhiMetrics Technologies Pvt. Ltd. on behalf of TRAI

in Rohtak City & adjoining areas from 9:00 AM to 9:00 PM; 14th November to 16st November 2018. The drive test

covered an drive route of 308 KMs & 5 hotspot over a period of 3 days. Approximately 330 calls were made for each of

the 11 networks: five 2G networks, five 3G networks and one LTE network covering 6 unique TSPs

Data SummaryVoice SummaryOverview

Service Specifications

Download 2G (Locked) - 500KB, 3G (Dual) - 20 MB, 4G (Free) - 40 MB

Upload 2G (Locked) - 100KB, 3G (Dual) - 5 MB, 4G (Free) - 10 MB

Web Browsing 3 links of e/m commerce website www.amazon.in, www.flipkart.com and PayTm

Video Streaming 130 sec clip

Latency 32 Bytes on www.google.com

Overview:Telecom Regulatory Authority of India has been entrusted with the task of laying down the standards of quality of service to be provided by

the service providers and ensuring its enforcement; and also TRAI is responsible for conducting the periodical audit of such services

provided by the service providers so as to protect the interest of the consumers of telecommunications service

TRAI is regularly monitoring the performance of Telecom Service Providers (TSP) against the benchmarks for the various Quality of Service

(QoS) parameters laid down by the Authority. TSPs submit Performance Monitoring Reports to TRAI every quarter. TRAI also undertakes

audit and assessment of Quality of Service through independent agencies to verify the Quality of Service claimed. The Audit agencies

conduct sample ‘Drive tests’ across various cities in the country as part of audit and assessment of the TSPs’ performance.

In view of complaints on call drops and other network quality issues, on behalf of TRAI, an Independent Drive Test (IDT) was conducted by

PhiMetrics Technologies Pvt. Ltd. From 14th November to 16th November 2018 covering various locations in Rohtak City & surrounding

region. The performance of Airtel, BSNL, Idea, Tata, Vodafone and Jio were monitored across various technologies (2G, 3G, and 4G). The

drive test route was defined on the basis of several factors that include - areas from where call drop complaints are commonly received;

areas of heavy usage; residential areas away from arterial roads; office areas; areas where previous Drive tests showed network issues;

etc.

The test results obtained from these drive tests were utilized to assess the network quality for Voice and Data services in terms of

Voice: Coverage, Quality, Handover Success Rate, Call Setup Success Rate, Drop Call Rate and Block Call Rate.

Data: Download and Upload Throughputs, Web Browsing Delay, Video Streaming Delay and Latency

Drive Test Details For Udaipur:

Independent Drive test was conducted for a period of 3 days from 14th November to 16st November 2018 in Rohtak city & surrounding

areas from 9:00 AM to 9:00 PM. Calls were made for 90 sec duration with wait time of 10 sec between calls in all technologies.

Voice Tests: The drive test covered a drive route of approximately 308 KMs over a period of 2 day from 14th November to 15th November

2018. Approximately 330 calls were made for each of the 11 networks: five 2G (Lock Mode) networks, five 3G (Dual mode) networks and

one VoLTE network covering 6 unique TSPs.* In case of multiple call failure in similar geo location in given period of 60secs has been counted as one call failure

Data Tests: Data Tests were performed at 4 static locations for 1 day on 16th November 2018; five 2G (Lock mode) networks, five 3G (Dual

mode) networks and Four 4G (Free mode) networks covering 6 unique TSPs were tested.* For Voice and Data KPI’s, 2G measurement is done with UE locked on 2G, 3G measurement is done with UE in Dual mode (2G & 3G) and 4G measurement is done with

UE in Free Mode.

* 3G KPI’s which are calculated from UE in Dual Mode (2G & 3G) includes samples and events of 2G.

* 4G KPI’s which are calculated from the UE in Free Mode included samples and events of 2G & 3G.

Overview Details

Overview

of 28

Voice Test Drive Route - Rohtak Data Service testing across 5 Static Locations

Blo

ck C

all

Ra

te (%

)

3G

Ne

two

rkV

oLT

E

2G

Ne

two

rk

QoS compliance of the TSPs in Rohtak for Voice across technologies 2G/3G/4G-VoLTE is given below:

Not meeting Benchmark

Voice CallsKey Observations

Voice Summary Page 3 of 28

Dro

p C

all

Ra

te (%

)

3G

Ne

two

rkV

oLT

E

2G

Ne

two

rk

a) All TSPs have met the 2% QOS benchmark of Drop Call Rate (DCR%) .

b) Call Block Rate (CBR%) benchmark of 3% was achieved by all TSP’s except Idea 3G.

c) NA (Not Applicable ) in CSFB failure for those TSP ,doesn't have 4G technology.

KPI2G Networks

Airtel BSNL Idea Tata VodafoneSDCCH Congestion% 0.28% 0.00% 0.32% 0.27% 0.00%

TCH Congestion % 0.00% 0.56% 0.00% 0.55% 0.58%

KPI3G Networks

Airtel BSNL Idea Tata Vodafone

CSFB Failure % 0.30% NA 0.92% NA 0.85%

SDCCH Congestion% 0.00% 0.00% 0.00% 0.00% 0.00%

RRC Congestion% 0.60% 0.00% 4.00% 0.28% 0.29%

SDCCH & RRC Congestion% 0.60% 0.00% 4.00% 0.28% 0.29%

TCH Congestion % 0.00% 0.00% 0.00% 0.00% 0.00%

RAB Congestion % 0.00% 0.30% 0.00% 0.00% 0.00%

TCH & RAB Congestion % 0.00% 0.30% 0.00% 0.00% 0.00%

0.61

0.91

1.62

0.00

1.45

Airtel

BSNL

Idea

Tata

Vodafone

0.28

0.84

0.32

0.28

0.29

Airtel

BSNL

Idea

Tata

Vodafone

0.28

0.56

0.32

0.82

0.58

Airtel

BSNL

Idea

Tata

Vodafone

0.90

0.30

4.92

0.28

1.14

Airtel

BSNL

Idea

Tata

Vodafone

0.00Jio

0.30Jio

Benchmark

3%

Benchmark

2%

3%

Benchmark

2%

Benchmark

Voice Calls

a) Percentage of coverage samples for 2G ≥ -85 dBm.

b) Percentage of coverage samples for 2G ≥ -85 dBm, 3G ≥ -90 dBm & LTE ≥ -110 dBm.

c) Percentage of time spent on 3G network:

d) Percentage of RLT >=48:

e) Average CST Second

Coverage

TSPs2G


Coverage% 93.04% 86.75% 90.96% 93.38% 90.92%

Key Observations

Voice Summary Page 4 of 28

TSPs3G VoLTE

Airtel BSNL Idea Tata Vodafone Jio

Coverage % 81.53% 77.13% 85.44% 86.91% 90.39% 94.79%

TSPs2G


%RLT >=48 0.00% 91.74% 0.01% 0.00% 0.00%

TSPs3G


Time Spent on 3G% 74.64% 56.99% 76.61% 67.32% 77.94%

TSPs2G


CST(sec) 2.70 2.19 2.72 3.01 3.08

TSPs

3G V0LTE

Airtel BSNL Idea Tata VodafoneJio

CST(sec) 3.03 2.30 4.02 2.42 3.20 0.50

Data

Services Static

Data Summary

Data Download and Upload Performance (Mbps)

Data was tested at 4 locations .Following services were tested: Data Download/Upload, Latency (www.google.com), Video

Streaming (YouTube) and Web browsing (Flipkart, Amazon, PayTm)

Key Observations

of 28

4G Network:

3G Network:

Download Throughput Upload Throughput

1.93

2.57

1.34

2.24

2.51

Airtel

BSNL

Idea

Tata

Vodafone

0.61

1.13

0.69

0.78

1.08

Latency (msec)

136

178

185

206

180

Airtel

BSNL

Idea

Tata

Voda

3G Network


7.63

4.84

2.04

1.83

Airtel

Idea

Jio

Vodafone

3.21

3.77

1.89

3.45

87

83

113

81

4G Network

Airtel

Idea

Jio

Vodafone

Streaming (sec)

Streaming Delay further broken into 2 parameters which form the end-user perception to assess consistency on Video

streaming.

• Initial Start time

• Interruption time while playing the video.

Web browsing experience is the average time taken to fully load the websites tested.

Video Streaming Performance (130 sec YouTube video sample sizes)

Video Streaming

Avg. Initial Start Time (sec)

Avg. Interruption Time (sec)

Web Page Download Time (sec)

Data

Services Static Key Observations

Data Summary of 28

3G 4G

Airtel BSNL Idea Tata Vodafone Airtel Idea Jio Vodafone

3.09 2.29 2.88 2.78 1.53 1.28 2.12 2.41 2.36

0.32 0.54 1.62 3.36 1.32

3.09

2.61

3.42

4.40

1.53

Airtel

BSNL

Idea

Tata

Vodafone

3G Network

12.79

14.13

14.78

15.00

14.60

Airtel

BSNL

Idea

Tata

Vodafone

3G Network

1.28

2.12

5.77

3.68

4G Network

Airtel

Idea

Jio

Vodafone

Airtel

Idea

Jio

Vodafone

12.39

11.44

11.81

11.09

4G Network

Data

Services Dynamic

Data Summary

Data Download and Upload Performance (Mbps)

Data was tested between one location to another location .Following services were tested: Data Download/Upload, Latency

(www.google.com), Video Streaming (YouTube) and Web browsing (Flipkart, Amazon, PayTm)

Key Observations

of 28

4G Network:

3G Network:


1.08

2.77

1.04

1.57

2.27

Airtel

BSNL

Idea

Tata

Vodafone

0.61

1.21

0.95

0.91

0.47

Latency (msec)

108

131

82

175

181

Airtel

BSNL

Idea

Tata

Vodafone

3G Network

Airtel

Idea

Jio

Vodafone


5.83

3.41

3.07

1.47

Airtel

Idea

Jio

Vodafone

3.39

2.55

2.15

2.93

96

92

71

92

4G Network

Streaming (sec)

Streaming Delay further broken into 2 parameters which form the end-user perception to assess consistency on Video

streaming.

• Initial Start time

• Interruption time while playing the video.

Web browsing experience is the average time taken to fully load the websites tested.

Video Streaming Performance (130 sec YouTube video sample sizes)

Video Streaming

Avg. Initial Start Time (sec)

Avg. Interruption Time (sec)

Web Page Download Time (sec)

Data

Services Dynamic Key Observations

Data Summary of 28

3G 4G


2.42 2.99 1.24 3.46 1.46 1.34 2.65 3.78 2.74

1.03 1.07 1.55 3.34

3.45

2.99

1.24

4.53

1.46

Airtel

BSNL

Idea

Tata

Vodafone

3G Network

12.48

11.74

12.93

14.08

14.68

Airtel

BSNL

Idea

Tata

Vodafone

3G Network

1.34

4.20

3.78

6.08

4G Network

Airtel

Idea

Jio

Vodafone

Airtel

Idea

Jio

Vodafone

12.98

11.91

10.51

12.06

4G Network

SummaryCity Level Summary

Summary Page 9 of 28

Voice Call2G


Call Attempt 361 359 310 365 345

Blocked Call Rate (%) 0.28% 0.56% 0.32% 0.82% 0.58%

CSSR% (Accessibility) 99.72% 99.44% 99.68% 99.18% 99.42%

Drop Call Rate (%) 0.28% 0.84% 0.32% 0.28% 0.29%

Mobility HOSR (%) 98.54% 98.95% 99.42% 96.98% 98.76%

Rx Quality (%) 98.12% 97.94% 97.82% 98.68% 97.42%

Voice Call3G VoLTE

Airtel BSNL Idea Tata Vodafone Jio

Call Attempt 332 331 325 353 350 338

Blocked Call Rate (%) 0.90% 0.30% 4.92% 0.28% 1.14% 0.00%

CSSR% (Accessibility) 99.10% 99.70% 95.08% 99.72% 98.86% 100.00%

Drop Call Rate (%) 0.61% 0.91% 1.62% 0.00% 1.45% 0.30%

Mobility HOSR (%) 99.74% 99.63% 99.95% 99.73% 99.97% 99.68%

Rx Quality (%) 96.36% 98.37% 89.61% 97.73% 94.06% 88.13%

Summary of 28

SummaryCity Level Summary(contd.)

Data Services2G


Download Throughput

(Kbps)134.69 156.39 95.54 129.78 76.53

Upload Throughput

(kbps)143.30 120.68 82.94 125.16 88.50

Web Browsing Delay

(sec)37.28 40.79 34.74 29.11 25.69

Latency

(msec)315 289 252 357 224

Data Services3G 4G


Download Throughput

(Mbps)1.93 2.57 1.34 2.24 2.51 7.63 4.84 2.04 1.83

Upload Throughput

(Mbps) 0.61 1.13 0.69 0.78 1.08 3.21 3.77 1.89 3.45

Web Browsing Delay

(sec)12.79 14.13 14.78 15.00 14.60 12.39 11.44 11.81 11.09

Video Streaming Delay

(sec)3.09 2.61 3.42 4.40 1.53 1.28 2.12 5.77 3.68

Latency

(msec)136 178 185 206 180 87 83 113 81

Data Services3G 4G


Download Throughput

(Mbps)1.08 2.77 1.04 1.57 2.28 5.83 3.41 3.07 1.47

Upload Throughput

(Mbps) 0.61 1.21 0.95 0.91 0.47 3.39 2.55 2.15 2.93

Web Browsing Delay

(sec)12.48 11.74 12.93 14.08 14.68 12.98 11.91 10.51 12.06


(sec)3.45 2.99 1.24 4.53 1.46 1.34 4.20 3.78 6.08

Latency

(msec)108 131 82 175 181 96 92 71 92

Data Test - Stationary

Data Test - Mobility

a) TO (Timeout) for Failed data test .

Summary of 28


Row Labels2G


Download Throughput

(Kbps)83.55 176.20 101.28 89.81 42.86

Upload Throughput (kbps) 118.24 145.02 80.97 153.63 49.37

Web Browsing Delay (sec) 29.58 46.14 28.03 28.37 20.43

Latency (msec) 357 414 311 421 255

Row Labels3G 4G


Download Throughput

(Mbps)0.77 0.53 0.53 1.44 1.80 4.11 4.11 2.29 1.26

Upload Throughput (Mbps) 0.64 0.65 0.65 0.71 0.29 0.56 0.56 2.11 2.39

Web Browsing Delay (sec) 13.01 17.53 17.53 13.53 22.69 14.24 14.24 8.73 12.34


(sec)3.94 8.71 8.71 2.74 TO 2.00 2.00 9.87 5.52

Latency (msec) 186 207 207 176 319 102 102 65 86

Huda Complex Park2G


Download Throughput

(Kbps)150.58 151.88 187.54 185.68 78.76



Latency (msec) 334 156 97 260 214

Huda Complex Park3G 4G


Download Throughput

(Mbps)4.36 4.48 4.43 3.65 4.43 4.14 3.18 5.80 3.18




(sec)1.50 1.29 1.46 1.98 1.46 0.98 1.71 1.48 1.71

Latency (msec) 103 177 129 158 129 86 80 74 80

Summary of 28


New Bus Stand2G


Download Throughput

(Kbps)151.70 59.09 92.84 130.86 69.43



Latency (msec) 230 476 318 325 224

New Bus Stand3G 4G


Download Throughput

(Mbps)2.82 0.88 2.82 4.29 2.88 16.50 1.71 0.50 1.71




(sec)1.21 1.34 1.21 1.94 1.70 0.83 4.31 TO 8.87

Latency (msec) 105 235 105 152 117 87 71 70 71

PGI2G


Download Throughput

(Kbps)110.55 204.87 28.51 53.98 58.41



Latency (msec) 321 290 337 679 223

PGI3G 4G


Download Throughput

(Mbps)0.81 2.70 0.31 0.69 0.31 10.84 10.84 0.60 0.66




(sec)2.79 1.33 TO 6.83 TO 1.04 1.04 TO TO

Latency (msec) 104 163 446 245 446 78 78 284 TO

Coverage Details

Summary

of 28

City Level Summary(contd.)

Railway Station2G


Download Throughput

(Kbps)160.04 189.88 69.42 163.28 121.97



Latency (msec) 325 150 198 334 206

Railway Station3G 4G


Download Throughput

(Mbps)0.34 4.28 0.34 1.16 3.92 2.58 3.24 1.04 3.24




(sec)11.80 1.57 TO 11.75 1.46 1.53 1.57 6.03 1.57

Latency (msec) 283 114 283 481 128 83 87 79 87

RF Coverage relates to the geographical footprint within the system that has sufficient RF signal strength to provide for a call/data session. The

Coverage rate of an TSP is calculated on the basis of % of samples in which the Rx level ≥ -85 dBm, RSCP is ≥ -90 dBm & RSRP ≥ -110dBm.

The details are as follows.

Airtel 2G

I. Coverage Details

Coverage Details of 28

TSPCoverage

Rate

Airtel 2G 93.04%

BSNL 2G 86.75%

Idea 2G 90.96%

Tata 2G 93.38%

Vodafone 2G 90.92%

Airtel Dual(2G/3G) 81.53%

BSNL Dual(2G/3G) 77.13%

Idea Dual(2G/3G) 85.44%

Tata Dual(2G/3G) 86.91%

Vodafone Dual(2G/3G) 90.39%

Jio VoLTE 94.79%

0%

25%

50%

75%

100%

Air

tel 2

G

BS

NL

2G

Idea

2G

Tata

2G

Vo

da

fon

e 2

G

Air

tel D

ua

l(2

G/

3G

)

BS

NL

Du

al(

2G

/3

G)

Idea

Du

al(

2G

/3

G)

Tata

Du

al(

2G

/3

G)

Vo

da

fon

e D

ua

l(2

G/

3G

)

Jio

Vo

LTE

Coverage Distribution

2G : -85 to Min/ Dual (2G/3G) : -90 to Min/ VoLTE : -110 to -130 dBm 2G : -75 to -85dBm/ Dual (2G/3G) : -80 to -90 dBm/ VoLTE : -95 to -110 dBm

2G : -65 to -75dBm/ Dual (2G/3G) : -70 to -80 dBm/ VoLTE : -80 to -95 dBm 2G : 0 to 65dBm/ Dual (2G/3G) : 0 to -70 dBm/ VoLTE : 0 to -80 dBm

BSNL 2G

Idea 2G


I. Coverage Details (contd.)



Tata 2G

Vodafone 2G

Airtel Dual (2G/3G)



BSNL Dual (2G/3G)

Idea Dual (2G/3G)



Tata Dual (2G/3G)



Jio VoLTE

Vodafone Dual (2G/3G)

TSP Rx Quality

Airtel 2G 98.12%

BSNL 2G 97.94%

Idea 2G 97.82%

Tata 2G 98.68%

Vodafone 2G 97.42%

Airtel Dual(2G/3G) 96.36%

BSNL Dual(2G/3G) 98.37%

Idea Dual(2G/3G) 89.61%

Tata Dual(2G/3G) 97.73%

Vodafone Dual(2G/3G) 94.06%

Jio VoLTE 88.13%

0.00%

25.00%

50.00%

75.00%

100.00%

Air

tel 2

G

BS

NL

2G

Idea

2G

Tata

2G

Vo

da

fon

e 2

G

Air

tel

Du

al(

2G

/3

G)

BS

NL

Du

al(

2G

/3

G)

Idea

Du

al(

2G

/3

G)

Tata

Du

al(

2G

/3

G)

Vo

da

fon

eDu

al(

2G

/3

G)

Jio

Vo

LTE

Rx Quality Distribution

RxQual ≤5, EcNo ≥-14 dBm, FER≤ 4%, SINR >0 RxQual >5, EcNo <-14 dBm, FER > 4%, SINR ≤0

For measuring voice quality, as per the QoS norms, RxQual <=5 for GSM TSPs, EcNo >= -14 dBm for 3G TSP sand SINR >0 in case of VoLTE is

considered to be good, where as quality beyond this benchmark is considered to be bad. The benchmark should usually be ≥ 95%.

TSPs not meeting the Benchmark

Airtel 2G

II. Quality Details

Quality Details of 28

II. Quality Details (contd.)


BSNL 2G

Idea 2G



Tata 2G

Vodafone 2G



Airtel Dual (2G/3G)

BSNL Dual (2G/3G)



Tata Dual (2G/3G)

Idea Dual (2G/3G)



Jio VoLTE

Vodafone Dual (2G/3G)

TSP % Time on 3G

Airtel 3G 74.64%

BSNL3G 56.99%

Idea 3G 76.61%

Tata 3G 67.32%

Vodafone 3G 77.94%

0.00%

25.00%

50.00%

75.00%

100.00%

Air

tel 3

G

BS

NL

3G

Idea

3G

Tata

3G

Vo

da

fon

e 3

G

Technology Distribution

% Time on 3G % Time on 2G

III. Technology Details

Technology Details of 28

Airtel 3G

III. Technology Details(contd.)


BSNL 3G

Idea 3G

III. Technology Details(contd.)


Tata 3G

Vodafone 3G

For Rohtak - TRAI

Documents

Transcript of For Rohtak - TRAI