AZQ Android 2G/3G/4G Test Tool Presentation 2014

26
OVERVIEW SHOWCASE ROADMAP KPI LIST AZENQOS PORTFOLIO ANDROID DASHBOARD REPLAY 1

Transcript of AZQ Android 2G/3G/4G Test Tool Presentation 2014

Page 1: AZQ Android 2G/3G/4G Test Tool Presentation 2014

OVERVIEW SHOWCASE ROADMAP KPI LIST

AZENQOS PORTFOLIO

ANDROID DASHBOARD REPLAY

1

Page 2: AZQ Android 2G/3G/4G Test Tool Presentation 2014

SERVER DASHBOARD ANDROID

TEST REPORT ANALYZE

Drive Test Engineer

Static Box Nationwide

Automatic Unit in Vehicles

Central Log Dashboard

Central Unit Control

Root Cause Analysis

Export to ACTIX & Gladiator

TEST,UPLOAD AND GET ACTIONABLE DRIVE TEST DATA & REPORT IN 10 MINUTES!

OVERVIEW

Automatic Report

PC REPLAY

Benchmark

2

Page 3: AZQ Android 2G/3G/4G Test Tool Presentation 2014

TEST REPORT ANALYZE

OVERVIEW

S5 SM-G900F

DRIVE TEST GRADE ON LOCAL PHONES

Runs on locally AZQ-certified Qualcomm Android Devices Runs on < 250 USD phone (Xperia E3) to flagship (Galaxy S5) Same grade of L3 & Radio data as hand tools from US & EU

Cell Functions LTE cell lock/WCDMA SC stay etc.

Record PCAP logs for full IP & radio analysis

Standard Test Scripts Voice , FTP , HTTP , SMS , PING etc.

User Experience Test Scripts Line , OOKLA , YouTube etc.

Officially licensed by Qualcomm

3

Page 4: AZQ Android 2G/3G/4G Test Tool Presentation 2014

TEST REPORT ANALYZE

OVERVIEW

THE OPTIMIZATION DATA & CELL FUNCTIONS ENGINEER NEEDS 4

Page 5: AZQ Android 2G/3G/4G Test Tool Presentation 2014

TEST REPORT ANALYZE

OVERVIEW

API BASED USERS’ PERSPECTIVE TEST 5

Page 6: AZQ Android 2G/3G/4G Test Tool Presentation 2014

TEST REPORT ANALYZE

OVERVIEW

RADIO & L3 COLLECTED AS STANDARD

PCAP OPTIONAL

6

Page 7: AZQ Android 2G/3G/4G Test Tool Presentation 2014

TEST REPORT ANALYZE

OVERVIEW

Sony Xperia E3

AUTOMATIC TEST

THE AUTOMATIC MODE OF AZENQOS ANDROID Mode 1 Unit starts test when power is plugged in and upload when power is unplugged Mode 2 Unit can also test based on time & day of week assigned from the dashboard

Deployed on affordable devices like Xperia E3, entire country can be benchmarked 24/7 affordably

Provides the same actionable drive test grade data and function whether deployed on Xperia E3 or Galaxy S5

Successful pan-country deployment in India & Thailand

7

Page 8: AZQ Android 2G/3G/4G Test Tool Presentation 2014

TEST REPORT ANALYZE

OVERVIEW

UPLOADED LOGS ARE TURNED INTO REPORTS IN MINUTES

COVERAGE

PERFORMANCE

PROBLEMS

SCORING

.KML .CSV .EXCEL .MIF

ACTIONABLE DATA FOR EVERY TEST

8

Page 9: AZQ Android 2G/3G/4G Test Tool Presentation 2014

TEST REPORT ANALYZE

OVERVIEW

IN THE REPORT : COVERAGE OF KEY PARAMETERS

COVERAGE PERFORMANCE PROBLEMS SCORING

OUTDOORS

INDOORS

9

Page 10: AZQ Android 2G/3G/4G Test Tool Presentation 2014

COVERAGE PERFORMANCE PROBLEMS SCORING

TEST REPORT ANALYZE

OVERVIEW

IN THE REPORT : PERFORMANCE OF NETWORK & SERVICES KPI

10

Page 11: AZQ Android 2G/3G/4G Test Tool Presentation 2014

COVERAGE PERFORMANCE PROBLEMS SCORING

TEST REPORT ANALYZE

OVERVIEW

IN THE REPORT : PROBLEMS AND CAUSES SUMMARY

11

Page 12: AZQ Android 2G/3G/4G Test Tool Presentation 2014

COVERAGE PERFORMANCE PROBLEMS SCORING

TEST REPORT ANALYZE

OVERVIEW

IN THE REPORT : SCORECARD FOR EASY NETWORK TEST & ROLLOUT

12

Page 13: AZQ Android 2G/3G/4G Test Tool Presentation 2014

TEST REPORT ANALYZE

OVERVIEW

DOWNLOAD LOG TO ANALYZE ROOT CAUSE ON PC 13

Page 14: AZQ Android 2G/3G/4G Test Tool Presentation 2014

TEST REPORT ANALYZE

OVERVIEW

REPLAY LOGS , VIEW L3 MESSAGES AND RADIO PARAMETERS 14

Page 15: AZQ Android 2G/3G/4G Test Tool Presentation 2014

TEST REPORT ANALYZE

OVERVIEW

CREATE BENCHMARK REPORTS 15

Page 16: AZQ Android 2G/3G/4G Test Tool Presentation 2014

TEST REPORT ANALYZE

OVERVIEW

Easier : Easy to use by non-engineers Cheaper : Local phones for large scale deployment World-Class : Deep Radio parameters , Locking functions

Faster : Report creation is now automated into minutes Visualized : Systematic Coverage , Performance, Problems, Scoring for each and every test Centralized : Testing can be done by anyone and doesn’t require skill or time back to create reports.

Comprehensive : Automatic report does for 80% of the work but engineers can still deep dive for optimization & troubleshooting Personalized : Create their own template report if required

16

Page 17: AZQ Android 2G/3G/4G Test Tool Presentation 2014

ASIA AFRICA USA

SHOWCASE

BLUE : CURRENT CUSTOMER , RED : UNDERGOING TRIAL & DEMO 17

Page 18: AZQ Android 2G/3G/4G Test Tool Presentation 2014

ROADMAP

VOLTE Undergoing development, target Q1 2015 TDD-LTE Key parameters developed, currently testing with Bharti in India, target Q1 2015

FDD-LTE LTE metrics derived from L3 Messages and L1 parameters/states for better root cause analysis, target Q2 2015

SIP decoding and tighter integration for future IP network testing, Q2 2015

WI-FI layer messages & offloading for LTE and WCDMA under feasibility study

2015 LTE & AIPN FOCUS

RADIO & REPLAY ANDROID DASHBOARD

18

Page 19: AZQ Android 2G/3G/4G Test Tool Presentation 2014

ROADMAP

CUSTOMER CENTRIC TEST Email undergoing development, other tests (Facebook, whatsapp, VDO streaming etc) TABLET Integration with test devices for benchmark testing

NEW DEVICES SAMSUNG GALAXY NOTE 4 and NEXUS 6 on current roadmap

NO ROOTING method of installation for selected newer devices (currently support S5,Nexus 5, E3)

NON-RADIO & NON-QUALCOMM DEVICES Can execute SIP, PCAP and other service testing without L3 and radio messages.

2015 SERVICE TESTING,NEW DEVICES SUPPORT

RADIO & REPLAY ANDROID DASHBOARD

19

Page 20: AZQ Android 2G/3G/4G Test Tool Presentation 2014

ROADMAP

OPENSTREETMAP OpenStreetMap integration into automatic test report ROOT CAUSE ANALYSIS Overshoot, signal black hole, cross sector

ALARM & TICKET When test results fail below threshold KPI

MORE VISIBLE Coverage, Problems, Performance, Scoring matrix

2015 AUTOMATION & BIG PICTURE VISUALIZATION

RADIO & REPLAY ANDROID DASHBOARD

20

Page 21: AZQ Android 2G/3G/4G Test Tool Presentation 2014

KPI LIST

GSM

RADIO SERVICE

21

SERVING CGI BSIC ARFCN BCCH RxLev Full (dBm) RxLev Sub (dBm) RxQual Full RxQual Sub TA TxPwr DSC Ciphering Algorithm Vocoder FER Speech Codec RX Speech Codec TX TCH Band C/I Worst C/I Worst ARFCN

C/I C/I Per ARFCN C/I Avg Neighbor Cell ID Neighbor Cell ID (Hex) Neighbor BSIC Neighbor ARFCN Neighbor RxLev (dBm) Neighbor C1 Neighbor C2 Neighbor Cellname Neighbor Band GSM RR State State GSM MISSING NEIGHBOR Band Index Radio link timeout

Data Bearer Mode Data LAC Data RAC Attach Duration PDP Context Activation Duration PDP Context De-Activation Duration RLC DL Throughput RLC UL Throughput DL Coding Scheme UL Coding Scheme DL Timeslot Used UL Timeslot Used GPRS C/I RLC BLER

Page 22: AZQ Android 2G/3G/4G Test Tool Presentation 2014

KPI LIST

WCDMA/HSDPA

RADIO SERVICE

22

SERVING CGI EC/IO RSCP TxPower Max TxPower RSSI BLER Average RRC State A Set UARCFN A Set CellID A Set SC A Set EC/IO A Set RSCP M Set UARCFN M Set CellID M Set SC M Set EC/IO M Set RSCP

D Set UARCFN D Set CellID D Set SC D Set EC/IO D Set RSCP Scheduled Rate Served Rate Final HS-DSCH Throuhput SBLER SBLER on 1st Transmission Retransmission Rate HS-DSCH Code Used AVG. MOD QPSK/16QAM/64QAM% HSDPA CQI HSDPA Meas. N. Slots HSDPA N.Demod Attempt HSDPA N.Demod Valid

HSDPA HS-SCCH Usage% HSPA+ CQI B HSPA+ CQI A HSPA+ CQI DC Pri.Carrier HSPA+ CQI DC Sec.Carrier HSPA+ Dual Carrier On / On % HSPA+ 2TB Requested % HSPA+ 1TB Requested % HSPA+ 64QAM Configured HSPA+ MIMO_Enabled HSPA+ UE_Category

Page 23: AZQ Android 2G/3G/4G Test Tool Presentation 2014

KPI LIST

WCDMA/HSUPA

RADIO SERVICE

23

AVG Raw Throughput AVG Scheduled Throughput Final E-DPDCH Throughput HSUPA SBLER% HSUPA TTI HSUPA Happy bit TTIs(%) HSUPA New transmission(%) HSUPA Retransmission(%) HSUPA DTX(%) HSUPA AVG AGCH HSUPA AVG SGI HSUPA N NACK after max retrans HSUPA N MAC Resets HSUPA Power Limited TTIs HSUPA Serv. Grant TTIs HSUPA Buffer Limited TTIs HSUPA Buffer Empty TTIs HSUPA Scheduled/Non scheduled buffer empty TTIs

Page 24: AZQ Android 2G/3G/4G Test Tool Presentation 2014

KPI LIST

LTE

RADIO SERVICE

24

Band EARFCN PCI RSRP RSRQ SINR RX(0) SINR RX(1) RSSI Tx Power Timing Advance Transmission Mode RRC State Allowed Access MNC MCC TAC Cell ID E NodeB ID

DL EARFCN UL EARFCN DL BANDWIDTH UL BANDWIDTH Serving Cell Band Serving Cell PCI Serving Cell RSRP Serving Cell RSRQ Neighbor Cell Band Neighbor Cell PCI Neighbor Cell RSRP Neighbor Cell RSRQ RRC State L1 PSDSCH Throughput Transmission mode (RRC-tm) Transmission mode Current Serving PCI RNTI Type/RNTI ID

Serv N Tx / Rx Ant Spatial Rank / Rank Indicatior CQI N RBs Allocated / Max DL Bandwidth Time Scheduled % Stream(0) Block Size Bits Stream(0) Modulation Traffic to pilot ratio Stream(1) Block Size Bits Stream(1) Modulation BLER N Sub-bands

Page 25: AZQ Android 2G/3G/4G Test Tool Presentation 2014

KPI LIST

Wi-Fi

RADIO SERVICE

25

BSSID SSID Wifi RSSI IP Addr. Link speed MAC Addr. Encryption Freq Channel ISP Scanned BSSID Scanned SSID Scanned Freq Scanned Encryption Scanned Level Scanned Channel

Page 26: AZQ Android 2G/3G/4G Test Tool Presentation 2014

OVERVIEW SHOWCASE ROADMAP KPI LIST

THANK YOU

ANDROID DASHBOARD REPLAY

26