BSS Troubleshooting Guide

8/12/2019 BSS Troubleshooting Guide

1/28

1 BSC

2 RNC


2/28

3 TRANSMISSION

4 BTS


3/28

OSS connectivity down - both x.25 down

One X.25 down

NSEI Down

BVCI Down

Zero Voice calls on particular Cell

Unit re-start

SIGNALLING LINK OVERLOAD

SIGNALLING LINK DOWN

SIGNALLING LINK ACTIVATION OR RESTORATION FAILURE

SIGNALLING LINK SET DOWN

GPRS/EDGE LOAD IS VERY HIGH IN PCU OF PSE

BTS AND TC UNSYNCHRONIZATION CLEAR CALLS ON ABIS INTERFACEWDU FAULTY

STMU FAULTY

MCMU RESTART

BCSU RESTART

BCSU SWITCHOVER

Iu-CS link down

Both Iu-PS links down

One Iu-PS link down

BASE STATION FAULTY

BASE STATION OPERATION DEGRADED

BASE STATION NOTIFICATION

CELL FAULTY

CELL OPERATION DEGRADED

CELL NOTIFICATION

BASE STATION LICENCE NOTIFICATION

BASE STATION TRANSMISSION ALARM

BEATING WCDMA BTS ALARM

FAILURE IN WCDMA WBTS O&M CONNECTIONRNW O&M SCENARIO FAILURE

WCDMA CELL OUT OF USE

HSDPA CONFIGURATION FAILED

WCDMA BTS DEDICATED MEASUREMENT FAILURE

HSUPA FAILURE IN WCEL

WCDMA BASE STATION OUT OF USE

BSS TROUBLESHOOTING GUIDE


4/28

BFD Down in AXC (Tellabs)

3G Sites down

2G or 3G sites down (Mw ring collapsed)

2G/3G multiple sites down

SYNCHRONISATION IS MISSING

Some Subscribers not able to latch on TATA network from specific handsets

Rx levels differ too much between main and diversity antennas, RSSI detected Rx signal difference exceeding

EXxx TRX module cooling fan s report no rotation,ESMA System module cooling fan s report no rotation

ERxx DDU module has detected VSWR above minor limit at anten


5/28

S. No. ProblemAlarm No. at

BSCAlarm Description / Comments Catergory

2175OSI CLNS LINKAGE NOT

AVAILABLE

2175OSI CLNS LINKAGE NOT

AVAILABLE

3315

ALL NETWORK SERVICE

ENTITIES UNAVAILABLE

Servicea

ffecting

non-Servicea

ffecting

Non-

Service

affecting

ng

Servicea

ffecting

OSS connectivity

down - both x.25

down

One X.25 down

1

2

NSEI Down3


6/28

13 DISK FAILURE 2860 DISK FAILURE

Zero Voice calls

on particular Cell7738

BTS WITH NO

TRANSACTIONS

GPRS/EDGE

LOAD IS VERY

HIGH IN PCU OF

PSE

Servicea

ffec

10SIGNALLING

LINK SET DOWN

SIGNALLING

LINK DOWN8

11

9

SIGNALLING

LINK

ACTIVATION OR

RESTORATION

FAILURE

7SIGNALLING

LINK OVERLOAD

1072SIGNALLING LINK OUT

OF SERVICE

2072

FAILURE IN SIGNALLING

LINK ACTIVATION OR

RESTORATION

26SIGNALLING LINK LOAD

OVER THRESHOLD

5

4 BVCI Down

Se

rvicea

ffecting

12

BTS AND TC

UNSYNCHRONIZ

ATION CLEAR

CALLS ON ABIS

INTERFACE

2993

BTS AND TC

UNSYNCHRONIZATION

CLEAR CALLS ON ABIS

INTERFACE

2070 LINK SET UNAVAILABLE

3415GPRS/EDGE LOAD IS

VERY HIGH IN PCU OF

PSE

Service

affecting

Non-Service

affecting


7/28

15 STMU FAULTY 2794HW BLOCK FAILURE IN

PLUG-IN UNIT

Se

rviceT

hreatening

16 MCMU RESTART2692

0690,1001

INCORRECT WORKING

STATE

working State Changed ,

Unit restarted

ServiceT

hreatening

WDU FAULTY 2861, 2692

NO ACCESS TO DISK

,INCORRECT WORKING

STATE

non-Servicea

ffecting

14


8/28

17 BCSU RESTART

2692

0690

1001

INCORRECT WORKINGSTATE

working State Changed ,

Unit restartedServicea

ffec

ting

18BCSU

SWITCHOVER

2692

0690

1001

INCORRECT WORKING

STATE

working State Changed

Unit Restarted

ServiceT

hreatening

19

Loss of

Synchronization

in BSC

2,641Failure in

Synchronization Signal

ServiceT

hreatening


9/28

Affect / Steps to be follow for troubleshoot

1. Check the signalling links states at MSS end. s gna ng n s n se own means

-3. Send local engineer at BSC site

4. Check BSC end Mux status & alarm. 1st: Mux

unmanaged - check alarm at connected Mux, Powerissue at BSC site. 2. Mux managed - check alarm at

Mux & verify the power status for BSC.

5. Login BSC via VDU / LANU. Check the alarms &

current computer unit status, if login is possible.In

case login is not possible ,get login through OMU CPU

and check the status of OMU and other computer

units.If we will not get the login through OMU also

,raise the emergency and follow steps as per with

care team recommandation.

1. Check the signalling links states at MSS end. ,

3. Check the Transmission path - Is there any alarm in

X.25 E1 path / path broken, then re-route path &

check X.25 links status.

5. If media ok, Send local engineer at BSC site.

7. If BSC not login via VDU / LANU than login through

CPU of OMU unit and check the status: after login ask

for password then login ok, or if continuously

restarting phase means OMU unit faulty. Do as per

care team recommendations.

1. Check the Transmission path - Is there any alarm in

X.25 E1 path / path broken.. ec e a arms. o en rese e .

Data traffic affect, down

Check no. of NESI's down, if down all - Trace PCU IP

from SGSN & find last hop address & check media

B/W that hop to BSC

If only some NSEI down (one or two) follow below

steps

1. Check the PCU - BCSU combination

2. Ping SGSN (PAPU) IP from that BCSU-PCU

3. Trace PCU IP from SGSN

4. Shift the traffic (DAP) to other PCU-BCSU. ur ng rs agnose a . . agnose o

Data traffic affect, down

1. GENA toggle & check status.


10/28

2. Check PCU-BCSU combination: a n case a par cu ar - com na on: s

- -

- -(c) BCSU switchover.

(d) PAPU re-set / switchover .

Check hardware, cabling & commissioning

A signalling link has failed and changed state from IN

SERVICE to OUT OF SERVICE, or its initial alignment

attempt has failed.

Check the Transmission path ere are o er pa ava a e, s gna ng n s pa

-

The activation or restoration of a signalling link fails.

Signalling transmission capacity decreased.

Check the Transmission path ,

-All signalling links in the signalling link set are

- .

ec or e en o en connec v y or e ers

Check GPRS/EDGE load & balance the load by

reallocate the DAPs

Impact: Call drop, Quality degradation, Call muting

,

e sys em as e ec e a ser ous error a may

have been caused by the hard disk or the SCSI

controller plug-in unit breaking down.Saving data into

the hard disk or reading data from the hard disk

Check UP/DL quality, path imbalance/VSWR/RSSI

This notice appears repeatedly - consider adding more

signalling links

,

timeslot mapping between bts and bsc should be

checked. if mapping is fine, timeslot bypassing should

be checked for the problem BTS/TRX, and if it iscoming on more than one timeslot, and everything

else is fine, trx should be replaced and call test should

be done on all time slots after replacement. If it is

Thershold value need to be change or PCU addition

require if load balancing ok.


11/28

Impact: No hard disk Redundancy, Measurements

might be affected.

1. Check the status of STMU with ZUSI:STMU:;

commands. Check the current & History alarms &

Site/aters outage if any related to faulty STMU.

2. Check the supplementary information of alarms &

work as per information .

3. Clear the faulty tag with ZUST command and

observe.

4. Check the alarms of ET/ transmission and set loss

with ZYWI command.

5. Temperature condition need to check at BSC

location.

6. Check the STMU cabling and if required replace the

Hardware.

1. Check the status of computer units with

ZUSI:COMP:; commands. Check the current & History

alarms.


work as per information (switchover / diagnose).

3. check ZIGO & ZUDH.

4. Change the state of MCMU to SE-NH and perform

the JOJI of all cards og MCMU and GSW .after

Diagonise the unit and check.

4. if problem repeates on same MCMU ,replace the

hardware with help of alarm info.

5. Perform the diagonistics of that MCMU /EMB and

make it in working State.

6. If no alarm found or problem occur on different -

different units with same alarm Number it may be a

SW bug.

Note : Kindly note before switchoff the MCMUrespective MCMU and EMB should be in SE-NH state

also during any hardware replacement check the

Jumper setting of the card.during any hardware

replacement check the Jumper setting of the card.

. ec e s a e w :; comman s . arm

history and current alarm should be checked. If it is

one WDU or both WDU are in BL-SY state .

2. Perform the JOJI of harddisk ( with JOJI the HDSAM

) and DCAR card .perform the OMU restart and check


12/28



alarms.




4. if problem repeates on same BCSU ,replace thehardware with help of alarm info.

5. Perform the diagonistics of the BCSU with both

MCMU and make it in working State.

6. Check the BVCI state and lapd States


different units with same alarm Number it may be a

SW bug.

Note : During any hardware replacement check the

Jumper setting of the card accordingly.



alarms.

2. Check the supplementary information of alarm &



4. if problem repeates on same BCSU ,replace the

hardware with help of alarm info.

5. Perform the diagonistics of the BCSU with both

MCMU and make it in working State.

6. Check the BVCI and Lapd state.


different units with same alarm Number it may be aSW bug.

Note : During any hardware replacement check the

Jumper setting of the card accordingly.

1. Check the ZDRI :; command output with Current

alarms.

2. Check the ET alarms on Sync ET .

3. Disconnect the all sync with ZDRC command

,setthe ossilator control word value to 32000 on both

CLS and reconnect the all sync inputs with correct

priority.

Note : If any BSC is out of Sync ,there will be slip on allETs of that BSC .


13/28

S. No. ProblemAlarm No.

at RNC

arm

Description / Cateagory Impact

4

BASE STATION

FAULTY7650

No connection

to Flexi

transport

submodule

SA Transmission to NodeB will be affected

BTS reference

clock missingSD

Service will be affected based on the

degradtion threshold level

BTS RNC/I-

HSPA interface

signalling linkfailure

SA NBAP/AAL2 signalling link failure

System module

failureSA

NodeB Capacity may be reduced/NodeB

totally may not be opreational

3

LINK SET

UNAVAILABLE

SA

NSA No Data traffic outage

LINK SETUNAVAILABLE SA RNC Total Outage

LINK SET

UNAVAILABLE RNC data traffic outage

5

One Iu-PS link

down2070

BASE STATION

OPERATION

DEGRADED

7651

1 Iu-CS link down 2070

2Both Iu-PS links

down2070


14/28

BTS requires

restart because

license status

has changed

SA Mentioned licence feature will not work

BTS time not

corrected

NSA BTS time will not be correct

Difference

between BTS

master clock

and reference

frequency

NSABTS frequecy deviates from IuB

referecne

Fan failure NSA Temparature will be increased

Heatingelement not

working

SA

Heating from the heating element is

not available. The module temperature

may not reach the working level or

may reach it very slowly

Temperature

alarmSA

Depending on severity BTS Capacity

may be reduced/BTS totally may not be

opreational

Failure inoptical RP3

interface

Depending on severity BTS Capacitymay be reduced/BTS totally may not be

opreational

Incompatible

SW version

detected



opreational

RF module

failure

Sectors will be affected depends on

severity

VSWR alarm



opreational

RF module

failureSA Sectors Operation will be degraded

Rx signal level

failureNSA Sectors Operation will be degraded

SA

8CELL OPERATION

DEGRADED7654

CELL FAULTY 7653

6

7

BASE STATION

NOTIFICATION7652


15/28

9

CELL

NOTIFICATION7655

Radio resources

switched offSA Cell will be down

HW capacity

too low for

feature 308,

Licence BasedBTS channel c

NSA

The licenses are granted but cannot be

used. Some of the licensed features are

not available.

Licence missing

00000001125,

Flexi WCDMA

BTS 60W Power

License

SA Sector down

Licence missing

0000000306,

HSDPA 16QAM

SW Licence

Support

SA SDPA Traffic will affect

Licence missing

0000000307,

HSDPA

Proportional

Fair Resource

Pac

NSA Degradation

Licence missing

0000000649,

Shared HSDPA

Scheduler for

Baseband

NSA Degradation

Verification of

target ID failed3 times.

SA Degradation of system module

License missing

for feature

Additional 2 E1,

T1, JT1

interface o

Service Degraded

SA

7661

BASE STATION

TRANSMISSION

ALARM

7665

10

11

BASE STATION

LICENCE

NOTIFICATION


16/28

License missing

for feature

UBR+.

Cell Down

12

BEATING WCDMA

BTS ALARM7740 (blank) NSA Repeatation of any alarm causes

13

FAILURE INWCDMA WBTS

O&M

CONNECTION

7750 (blank) NSABTS Cannot be logined remotly &

Measurements will not be updated

AAL2 path

unblock not

accomplished

Cell Down

BCCH

information

updating has

failed

Cell Down

Common

channel

deletion has

failed

Cell Down

NBAP interface

type unknown

failure

Cell Down

Block resourcerequest, normal

priority

Sector down

Common

measurement

failure scenario

Sector down

NBAP link

failureSector down

Resource statusindication, cell

disabled

Sector down

WCEL state not

WOSector down

WCEL state not

WO after setupWhen Site Down Or Sector Down

SA

SA

RNW O&M

SCENARIO FAILURE7761

WCDMA CELL OUT

OF USE7771

14

15


17/28

RNC internal

errorService Degraded

WBTS rejects

the

configuration

Service Degraded

17

WCDMA BTS

DEDICATED

MEASUREMENT

FAILURE

7778 SA DCN state - Disable Or Cell Faulty

A unit (or units),taking care of HSUPA

traffic in the WCEL can be faulty





19

WCDMA BASESTATION OUT OF

USE

7786 (blank) SA WBTS will be down

16

18 SA

SD

HSDPA

CONFIGURATION

FAILED

7772

HSUPA FAILURE IN

WCEL7780


18/28

Possible Causes Solution

ects: ommunication wit

1. Check the unit status for any

failure and check the current

and histor alarms. ing trace contro p ane an

. ec ssoc a on se an

4. Check connectivity B/W end trace

IP to MSS.ec s: ommun ca on w o


failure and check the current

and history alarms. ng race con ro p ane

. ec ssoc a on se an

. ec connectivity en trace

Affects: Communication with one


failure and check the current. ng race con ro p ane

. ec ssociation set an

. e c connec v y en race

Malfunction of Transport Module in

System Module

Reset System Module/Replace

Transport Module in System Module

Site Clock E1 having errors / AISClock E1 Interface needs to be check

& Check the SYNC of TXN side

Transmission break or fluctuationsCheck transmission configurations

and paths

Abnormal functioning of FSM Reset FSM/Replace FSM



19/28

After licence installation BTS not

given restartRestart BTS.

NTP Server IP mismatchCheck NTP server IP it should be

same as RNC OMS IP

DAC Valure variations Set DAC value to standard value

H/W FaultyCheck working status of Fans or

replcae FAN units in FSM

The heater control connection of theFSM is faulty, there is no heater or

the heater is faulty.

Check whether the heating element

exists at all./ Check the heatercontrol connection and that the

heater is working./ Replace the

alarming component.

The internal temperature of the RF

Module or System Module exceeds

the threshold value, or the ambient

temperature of the module(s) is

outside the specified limits.

Check the FAN units in FSM/FRGP

Abnormal/ failure in optical cable

between FSM & FRGP

Check the Optical cable connectonbetween FSM & FRGP/Reset

FSM/Replace cable.

SW Mismatch of BTSRecomission BTS with Correct SW

version

Abnormal functioning of FRGPReset FRGP/FSM/Check interface

cables/Replace FRGP

High VSWRCheck the VSWR, should be less than

1.3

Abnormal functioning of FRGPReset FRGP/FSM/Check interface

cables/Replace FRGP

The RX signal level is less than -

112dBm or the difference between

the maximum and minimum power

levels of all RX antennas in the same

cell and sector is more than the limit

(4 dB).

Check the VSWR & Antenna cables


20/28

As per configuration H/W

mismatch/unavailability

Check the cell configration & H/W

availbilty at site

The HW capacity is too low to

support all licenses of an optional

feature.

Call to GNSC CM Delete the licenses

or insert new hardware.

During NodeB commissioning seleted

60W power for sector.

Login to nodeB and change

parameters of sector power to 20W

HSDPA License Missing Or Cell Down Call to GNSC CM get it clear

License missing License missing

License missing License missing

Hanged/config issue/comm issue Hanged/config issue/comm issue

This basic license missingGNSC has to load this basic license

from Netact


21/28

HSDPA License MissingGNSC has to load this basic license

from Netact

Repeatation of any alarm causesCancels once causing Alarm is

cleared

DCN Configuration mismimatch in

NodeB/RNC/tellabs

To be checked DCN Configrations at

RNC/NodeB/Tellabs

CoCo/ATM Configuration Mismatches

between NodeB/RNC/Tellabs

To be checked CoCo/ATM

Configuration Mismatches between

NodeB/RNC/Tellabs





NodeB/RNC/Tellabs





NodeB/RNC/Tellabs





NodeB/RNC/Tellabs

Cell Down Need to check WCELL/WBTS alarm





Cell Down Once Node-b is up, alarm will clear


22/28

Cell Down / Interface Down Or H/W

configuration In Node-B

Node-B Lock & Unlock Or Restart

Node-B / Cross check & Rectify

Node-B H/W Configuration --All This

action based on Sublimentory

information of Alarm

Cell Down / Interface Down Or H/W

configuration In Node-B

Node-B Lock & Unlock Or Restart

Node-B / Cross check Node-B H/W

Configuration --All This action based

on supplementary Alarm Info.

DCN connected E1 Interface needs to

be cross check

DCN Interface / Lock all the cells

under the BCF and delete & Re-

create COCO configuration and

unlock all the cells / If required Site

reset has to be given ( Anlaysis based

on supplementary info)

Cell DownA unit (or units),taking care of HSUPA






CNBAP/BRM BreakCheck the transmission path &Configuration between NodeB to

RNC


23/28

S. No. Problem Alarm No. at BSC Alarm Description / Comments Catergory

5 M/W Link Problem

No Alarm observed in the

link, except RSL dip at one

end.

At one end, RSL of the link is OK, on

other end it dips to -90dBm.

No typical alarm observed in the link.

ServiceT

hreatning

32G or 3G sites down

(Mw ring collapsed)

Service

affecting

42G/3G multiple sites

down

Service

affecting

Fault rate monitoring & PCM failures

Fault rate monitoring & PCM failures

1BFD Down in AXC

(Tellabs)

Service

Degradation

2 3G Sites downService

affecting

7665 BFD down

Base Station out use


24/28


BFD down or fluctutating in AXC & data traffic shifted to ATM,

Cause HSPA fallback enabled. Checked txn media as well as ISA

card or reset Mux ISA card to restore BFD.

Need to check utilization of GE ports, If broadcast packets incresing

then need to check the txn- media & ISA card.

Deimplement trails for culprits ISA & raplace ISA ASAP.

Downs sites need to be check belongs particular AXC card or Mux

particular STM-1 port. Need to check alarms on port, If any alarm

appears then switch to redundant port to restore sites

If the CPU utilization for both Main & Spare IFMcard are hign then

remove one by one & inserted Main card to reduce CPU utilization.

Atlast switched CDC card from main to redundant card.

Need to check alrams on ALU mux port during ring collapsed at

both end.

Need to ping connecting IDU from GNOC to check alarms & w.r.t

appeared alarms we identify either power issue or hardware fault

Enginners need to send at site with hardware for further trouble

shooting.

Sites need to be indentified on particular MUX

Core mux malfunctioning at BSC/RNC location

2G & 3G site database shared with all CTLs

Impact: Microwave Link gets down

Reason of the problem: Normally in this type of scenario, ODU of

the link (at the end where RSL is OK) is misbehaving.

Its transmitor gets off, stops

radiating. But, it receives the signal properly.

Troubleshooting: ODU to be replaced


25/28

S. No. Problem BTS Type Alarm

No. at

BSC

Alarm Description / Comments

2 a)Some Subscribers were not able

to latch on TATA network from

specific handsets.While Same

Handsets were running fine with

IDEA or any other operator from a

perticular site

(N_UW_NRA_001,Muzzafarnagar)

Flexi Edge

BTS

Observation:At Problematic

location/Premises(N_UW_NRA_001,Muzzafa

rnagar) there are two NSN equipments

serving for IDEA/TATA.No alarm was found

on problematic site.

3 Rx levels differ too much between

main and diversity antennas, RSSI

detected Rx signal difference

exceeding threshold

Flexi 7607 Rx levels differ too much between main and

diversity antennas,

RSSI Value is high than 10.

1 SYNCHRONISATION IS MISSING

All External Q1 device fail to

respond

Flexi/MR 7787 DFCA not working in that particular Site,One

more Observation:Site will continously

restart when DFCA is enabled in the site

5 a)ERxx DDU module has detected

VSWR above minor limit at anten

Flexi/MR 7607 VSWR limit is high than 1.5 for Minor alarm

and >2.7 for major alarm

4 EXxx TRX module cooling fan s

report no rotation,ESMA System

module cooling fan s report no

rotation

Flexi 7607 TRX cooling fan not rotate

ESMA cooling Fan not rotate


26/28


27/28

Catergory Affect / Steps to be follow for troubleshoot

Service affecting Activities steps as follow:-

1.Firstly we Check Infra condition of the site

2.Check the BTS configuration of the site ,properly check weather there is

any alarm in site,But no service affecting/Service degrading alarm found

3.After that we check DAC value,RSSI comparision value and VSWR value

with Site master but problem not resolved.

4.Change the PLMN allowed from 1 upto 7.

5.Replaced the ESMA card.

6.Shift BCCH to another TRX and check

7.Shift BCCH to another TRX and check.

8.Swapping of TRX's from other perfet site to problamatic site and

check.

9.Site deletion and further recreation done still no improvement found

10.Rehome the site BCF-22 Muzaffarna ar BSC to Meerut -1 BSC with

1.First step to check the site is down or not (ZEOL)

2.if site is working with DFCA unsync and LMU is in stand by mode (ZEFL)

than visit the site

3.Check the parameters such as LMU area parameter,DFCA disabled orenabled

4.Check ESLA cable connectivity between ESMA to LMU ,if found any

Service

Degrading

1.Check the RSSI measurements with BTS Manager.

2.Check the BTS RF cables and connections.Check the antenna and RX

cabling.

3.If the antenna and RX cabling are faulty, correct the problem and run

TRX test to cancel the alarm.

4.Check and measure VSWR of the antenna lines.

Service affecting

1.90% there is a chance of Over heating or Room tempurature high inside

shelter

2.if there in an issue of tempurature resolve the issue along with IP

3.Check that the fan unit cable is correctly connect to DTRX/ESMA

4.Check that there are no obstacles preventing the fan(s) from rotating

5.Clean the fan unit of dust and/or dirt

6.if problem is still presist then Replace the fan unit

service affecting 1.Measure VSWR value with Site Master ,If value is found high then

second step is to see the fault via Distance to fault location .

2.According to distance found, replace connector,Jumper ,Anteena ordamaged feeder cable

3.With external test equipment check VSWR of the antenna line. Repeat

step 1 if the measurement is again high

Service

Degrading

D:\userdata\alekar\Desktop\BSS Fault


28/28

BCF Alarm Guide

l l

BSS Troubleshooting Guide

Documents

Transcript of BSS Troubleshooting Guide