Specification and key points for gprs&edge cqt&dt v1.1

41
HUAWEI TECHNOLOGIES CO., LTD. www.huawei.com HUAWEI Confidential Security Level: Specifications and Key Points for GPRS/EDGE CQT&DT Test V1.1

Transcript of Specification and key points for gprs&edge cqt&dt v1.1

Page 1: Specification and key points for gprs&edge cqt&dt v1.1

HUAWEI TECHNOLOGIES CO., LTD.

www.huawei.com

HUAWEI Confidential

Security Level:

Specifications and Key Points for GPRS/EDGE CQT&DT Test

V1.1

Page 2: Specification and key points for gprs&edge cqt&dt v1.1

HUAWEI TECHNOLOGIES CO., LTD. Page 2HUAWEI Confidential

DT test is the most direct approach to obtain network information. DT tests on GPRS services in the network can collect a serial of network data for RNO projects. By analyzing the collected network data, you can find and correct the existing problems in the network, thus improving the overall quality of the network.

Correct and effective DT tests on GPRS services can provide basis for our future work.

Introduction

Page 3: Specification and key points for gprs&edge cqt&dt v1.1

HUAWEI TECHNOLOGIES CO., LTD. Page 3HUAWEI Confidential

Content

Chapter 1: Test Preparations

Chapter 2: Test Specifications

Chapter 3: Test Instances

Page 4: Specification and key points for gprs&edge cqt&dt v1.1

HUAWEI TECHNOLOGIES CO., LTD. Page 4HUAWEI Confidential

Key Points for Test PreparationSite test

Environment detection

Test terminals

Test software

FTP servers used for test

Page 5: Specification and key points for gprs&edge cqt&dt v1.1

HUAWEI TECHNOLOGIES CO., LTD. Page 5HUAWEI Confidential

Key Point 1: On-site Environment Detection

Selection of test cells

Perform lock frequency test to avoid handovers

Select the best test route

Selection of test time segments

Select non-hot spot cells for the test

Signal level in the service cell – signal level in neighbor ≥20dB

Page 6: Specification and key points for gprs&edge cqt&dt v1.1

HUAWEI TECHNOLOGIES CO., LTD. Page 6HUAWEI Confidential

Key Point 2: Requirements for Test Terminals

•Composition of typical drive test equipment

Information of SIM cardMultislot capability

Connected to the laptop

Disconnected with other networksClose network access tasksChange TCP window in the register table

Set GPS correctly

Page 7: Specification and key points for gprs&edge cqt&dt v1.1

HUAWEI TECHNOLOGIES CO., LTD. Page 7HUAWEI Confidential

Key Points 2: Requirements for Test Terminals

Peak throughput in PDP context setting

NCK mode on LLC layerACK mode on RLC layer

•SIM cards used for test

Page 8: Specification and key points for gprs&edge cqt&dt v1.1

HUAWEI TECHNOLOGIES CO., LTD. Page 8HUAWEI Confidential

Key Point 3: FTP Server Used for Test

Test FTP address provided by the

operator

•Select FTP servers with reliable performance for test

Page 9: Specification and key points for gprs&edge cqt&dt v1.1

HUAWEI TECHNOLOGIES CO., LTD. Page 9HUAWEI Confidential

key Point 4: Selection of Test Software

Drive test software used by Huawei

Genex Probe

Ericsson TEMS Investigation

Pilot Premier

CDS

Page 10: Specification and key points for gprs&edge cqt&dt v1.1

HUAWEI TECHNOLOGIES CO., LTD. Page 10HUAWEI Confidential

key Point 4: Selection of Test Software

Pilot Premier

Page 11: Specification and key points for gprs&edge cqt&dt v1.1

HUAWEI TECHNOLOGIES CO., LTD. Page 11HUAWEI Confidential

key Point 4: Selection of Test Software

TEMS Investigation

Page 12: Specification and key points for gprs&edge cqt&dt v1.1

HUAWEI TECHNOLOGIES CO., LTD. Page 12HUAWEI Confidential

Test software Installation Interface Workbench Test item Test script Report output Stability

TEMS Complex FriendlyComplete

varietyMany

Can be

edited

Various/

complexGood

PremierComparatively

complexCommon Single Few Fixed Single/simple

No

response

often

key Point 4: Selection of Test Software

Pilot PremierTEMS

InvestigationVS

Page 13: Specification and key points for gprs&edge cqt&dt v1.1

HUAWEI TECHNOLOGIES CO., LTD. Page 13HUAWEI Confidential

Content

Chapter 1 Test Preparations

Chapter 2 Test Specifications

Chapter 3 Test Instances

Page 14: Specification and key points for gprs&edge cqt&dt v1.1

HUAWEI TECHNOLOGIES CO., LTD. Page 14HUAWEI Confidential

Test Items

Test specifications

CQT DT

Attach

Ping

WAP

FTP

Cell reselection

WEB

FTP

WAP

RAU

Coverage rate

Page 15: Specification and key points for gprs&edge cqt&dt v1.1

HUAWEI TECHNOLOGIES CO., LTD. Page 15HUAWEI Confidential

GPRS Attach Test

Test method

Perform this test through multiple logging on to GPRS network

Key indexes

Attach success rate

Average attach time

Attach success rate = (Successful GPRS attaches/Total GPRS attach attempts) x100%

Average attach time = Total time for successful GPRS attches/Times for successful GPRS attaches

Page 16: Specification and key points for gprs&edge cqt&dt v1.1

HUAWEI TECHNOLOGIES CO., LTD. Page 16HUAWEI Confidential

GPRS Attach Test GPRS Attach interface for TEMS test

detach

attach

Page 17: Specification and key points for gprs&edge cqt&dt v1.1

HUAWEI TECHNOLOGIES CO., LTD. Page 17HUAWEI Confidential

Ping Test

Test method

Perform Ping test in the sites of GGSN LAN with the customized of package length

Key indexes

Ping success rate

Average Ping delay

Ping success rate = (Successful Pings/Ping attempts x 100%

Average Ping delay = Sum of time for successful Pings/Successful Pings

Page 18: Specification and key points for gprs&edge cqt&dt v1.1

HUAWEI TECHNOLOGIES CO., LTD. Page 18HUAWEI Confidential

Ping Test

Edit interface of TEMS test script

Packet length: 32 byte

Times for test

Page 19: Specification and key points for gprs&edge cqt&dt v1.1

HUAWEI TECHNOLOGIES CO., LTD. Page 19HUAWEI Confidential

Ping Test

Result of Ping test

Page 20: Specification and key points for gprs&edge cqt&dt v1.1

HUAWEI TECHNOLOGIES CO., LTD. Page 20HUAWEI Confidential

WAP Test

Test method

WAP site login test or WAP page refresh test

Key indexes

PDP activation success rate

Average time for PDP activation

PDP activation success rate: successful PDP activations/Total PDP activation attempts ×100%

Average time for PDP activation: Sum of time for successful PDP activations/Successful PDP activations

Page 21: Specification and key points for gprs&edge cqt&dt v1.1

HUAWEI TECHNOLOGIES CO., LTD. Page 21HUAWEI Confidential

WAP Test Test interface

Page 22: Specification and key points for gprs&edge cqt&dt v1.1

HUAWEI TECHNOLOGIES CO., LTD. Page 22HUAWEI Confidential

FTP Download Test

Test method

Upload/download files with customized length on the specified server

Key index

FTP download rate on application layer

FTP download rate on application layer = Data amount (Byte) actually downloaded/Actual time (s) for download

Page 23: Specification and key points for gprs&edge cqt&dt v1.1

HUAWEI TECHNOLOGIES CO., LTD. Page 23HUAWEI Confidential

FTP Download Test Test method

Page 24: Specification and key points for gprs&edge cqt&dt v1.1

HUAWEI TECHNOLOGIES CO., LTD. Page 24HUAWEI Confidential

Mail Download/Upload Test in WEB Mode

Test method

Upload a 100-kByte mail once

Download a 500-kByte mail once

Key indexes

Upload rate on application layer

Download rate of application layer

Upload rate on application layer = Data amount (Byte) actually uploaded/Actual time (s) for upload

Download rate on application layer = Data amount (Byte) actually downloaded/Actual time (s) for download

Page 25: Specification and key points for gprs&edge cqt&dt v1.1

HUAWEI TECHNOLOGIES CO., LTD. Page 25HUAWEI Confidential

DT Test

1. WAP site login success rate

2. Average time for WAP first page displa

y

3. WAP page refresh success rate

4. WAP page refresh duration

5. WAP download success rate

6. WAP download rate

7. Average RAU time interval

8. Average RAU distance interval

9. Average cell reselection time interval

10. Average cell reselection distance interv

al

11. Coverage rate

12. Call drop rate

13. FTP download rate

Main contents for DT test

Page 26: Specification and key points for gprs&edge cqt&dt v1.1

HUAWEI TECHNOLOGIES CO., LTD. Page 26HUAWEI Confidential

DT Test

Serial number

Record items of DT test Definition of item

1 WAP site login success rate Successful WAP site logins/WAP site login attempts ×100%

2 Average time for WAP first page display Sum of time for successful WAP first page display/Successful WAP first page displays

3 WAP page refresh success rate Successful WAP page refreshes/WAP page refresh attempts ×100%

4 WAP page refresh duration Sum of time for successful WAP page refresh/Successful WAP page refreshes

5 WAP download success rateSuccessful WAP ringtones and graphics downloads/WAP ringtones and graphics download attempts ×100%

6 WAP download rate Data amount (Byte) downloaded successfully/Time (s) for successful downloads

7 Average RAU time interval Total RAU times/Total test time (s)

8 Average RAU distance interval Total RAU times/Total test distance (Km)

9 Average cell reselection time interval Total cell reselection times/Total test time (s)

10Average cell reselection distance interval

Total cell reselection times/Total test distance (Km)

11 Coverage rate GPRS coverage distance (Km)/Total test distance (Km) X100%

12 Call drop rate Call drops/Total FTP download attempts X100%

13 FTP download rate Total data amount of FTP download/Total time for FTP download (s)

Record items of DT test and their definitions

Page 27: Specification and key points for gprs&edge cqt&dt v1.1

HUAWEI TECHNOLOGIES CO., LTD. Page 27HUAWEI Confidential

DT Test Cell reselection

Page 28: Specification and key points for gprs&edge cqt&dt v1.1

HUAWEI TECHNOLOGIES CO., LTD. Page 28HUAWEI Confidential

DT Test Inter-routing area reselection

Page 29: Specification and key points for gprs&edge cqt&dt v1.1

HUAWEI TECHNOLOGIES CO., LTD. Page 29HUAWEI Confidential

Content

Chapter 1 Test Preparations

Chapter 2 Test Specifications

Chapter 3 Test Instances

Page 30: Specification and key points for gprs&edge cqt&dt v1.1

HUAWEI TECHNOLOGIES CO., LTD. Page 30HUAWEI Confidential

GPRS Network Optimization Test in Nantong

Test comparison before and after the cutover in some business halls of

Rudong county

Serial number

Name of business hall

ATTACH duration PDP activation duration PING delay FTP download rate k/s

Before cutover

After cutover

Before cutover

After cutover

Before cutover After cutoverBefore cutover

After cutover

1 Nanyu business hall 1893 1802 1170 611 1792 1522 3.56 3.74

2 Shidian business hall 4136 1846 1576 772 1696 918 2.9 3.58

3 Tongye garden 1770 1880 856 755 1479 1245 4.78 4.32

4 Yinquan business hall 1583 2267 895 739 959 1086 4.92 4.29

5 Sunyao business hall 1880 1924 878 898 1068 941 4.73 4.1

6 Huanzhen business hall 1577 2217 993 795 957 1372 5.02 3.97

7 Linghe business hall 1875 1975 909 814 1430 943 3.86 3.55

8 Shiping business hall 1679 1882 1194 751 1261 927 3.3 4.27

9 Tongdian business hall 1621 1867 942 767 914 955 3.31 4.42

10 Huafeng business hall 1609 1782 934 746 903 990 4.42 4.76

11 Xiangtai business hall 2029 2345 896 753 836 998 5 4.54

12 Mianchang business hall 1828 1815 932 753 1603 929 5.09 4.64

Page 31: Specification and key points for gprs&edge cqt&dt v1.1

HUAWEI TECHNOLOGIES CO., LTD. Page 31HUAWEI Confidential

GPRS Network Optimization Test in Baiyin

Test contents

GPRS DT test in main trunk roads

GPRS CQT test in main downtown areas

Test tools

SAGEM OT190

Nokia 6230

Motorola A760

Stopwatch

Laptop

Test software

DingLi Pilot Premier

Page 32: Specification and key points for gprs&edge cqt&dt v1.1

HUAWEI TECHNOLOGIES CO., LTD. Page 32HUAWEI Confidential

Test itemTest result of

HuaweiTest result before the optimization

Test result after the

optimization

Attach testAttach success rate 100.00% 95.00% 97.00%

Average time (s) 2.0325 1.81 1.77

PDP activation testPDP activation success rate 100.00% 97.00% 100.00%

Average PDP activation time (s) 2.1279 0.86 0.81

PING testSuccess rate 99.00% 95.00% 97.00%

Average delay (s) 2.1336 1.63 1.46

FTP test FTP download (KB/S) 3.0546 3.2 3.52

WAP test

WAP login success rate 94.00% 99.70% 100.00%

Time for first page display (s) 10.7626 9.28 6.01

Refresh success rate 100.00% 100.00% 100.00%

Time for page refresh (s) 4.7886 5.74 4.33

Graphics and ringtones download success rate

99.00% 99.00% 100.00%

Graphics and ringtones download rate (Kb/s)

11.5432 17.8 18.9

KJava testMobile KJava download rate (Kb/s) 12.6173 15.5 15.9

Mobile KJava download success rate 84.00% 96.20% 96.00%

SMS testSMS test success rate 100.00% 100.00% 100.00%

SMS end-to-end delay 4.3042 5.2 5.3

MMS test

Push message success rate 100.00% 100.00% 100.00%

Average Push message delay 8.7660 6.5 6.2

Color message end-to-end success rate 87.50% 97.30% 97.00%

CQT Test Result

Page 33: Specification and key points for gprs&edge cqt&dt v1.1

HUAWEI TECHNOLOGIES CO., LTD. Page 33HUAWEI Confidential

Summary of DT Test Results

Test type Test ItemTest result before the

optimizationTest result after the

optimization

WAP testWAP site login success rate 97.50% 98.50%

Time for WAP first page display 15.38 13.56

FTP test

Mileage without coverage 0 0

Coverage rate 100.00% 100.00%

Attempted downloads 37 42

Call drops 0 0

Call drop rate 0.00% 0.00%

Average throughput rate (KB/s) on application layer

2.34 2.77

Page 34: Specification and key points for gprs&edge cqt&dt v1.1

HUAWEI TECHNOLOGIES CO., LTD. Page 34HUAWEI Confidential

Test Analysis 1 Coverage of RXlevel (RxLevFull) in GPRS network

Page 35: Specification and key points for gprs&edge cqt&dt v1.1

HUAWEI TECHNOLOGIES CO., LTD. Page 35HUAWEI Confidential

Test Analysis 2 Distribution of downlink RLC BLERs in GPRS network

Page 36: Specification and key points for gprs&edge cqt&dt v1.1

HUAWEI TECHNOLOGIES CO., LTD. Page 36HUAWEI Confidential

Test Analysis 3 Having no cell for direct coverage, the area between two BTSs has a high bit error rate.

A

Page 37: Specification and key points for gprs&edge cqt&dt v1.1

HUAWEI TECHNOLOGIES CO., LTD. Page 37HUAWEI Confidential

Test Analysis 4 Distribution of downlink PDCH channels in GPRS network

Page 38: Specification and key points for gprs&edge cqt&dt v1.1

HUAWEI TECHNOLOGIES CO., LTD. Page 38HUAWEI Confidential

Test Analysis 5

A

There are only two downlink PDCH channels in area A and it affects the download rate.

Page 39: Specification and key points for gprs&edge cqt&dt v1.1

HUAWEI TECHNOLOGIES CO., LTD. Page 39HUAWEI Confidential

Test Analysis 6 Distribution of Downlink CS Coding Modes in GPRS Network

Page 40: Specification and key points for gprs&edge cqt&dt v1.1

HUAWEI TECHNOLOGIES CO., LTD. Page 40HUAWEI Confidential

Test Analysis 7 Distribution of Cell Reselection in GPRS Network

Page 41: Specification and key points for gprs&edge cqt&dt v1.1

HUAWEI TECHNOLOGIES CO., LTD. Page 41HUAWEI Confidential

Thank You