Keynote SIGOS Product Portfolio

� � ��

��

��

20YEARS

Key

note SIGOS

1989 - 2009

3

Testing is our Competence

Keynote SIGOS was

founded under the

name of SIGOS back in

1989. For two decades

we have been sup-

porting the mobile

networks, including most

of the World's Top Twenty operators, ensur-

ing and improving their Quality of Service

and helping them to both discover new

opportunities and launch new services. In

other words, we have helped our network

customers to continuously improve the

experience of their own customers, driving

up customer satisfaction and retention.

We are doing this through providing flagship

solutions for active End-to-End Testing to

the telecommunications industry. Since we

have dedicated ourselves totally to this

speciality we always have to be top notch

in what we do.

The development of our product portfolio

also reflects the development of telecommu-

nications itself: we started with testing of

fixed line services, expanded our intelligent

testing solutions towards mobile telecommu-

nications in 2G and 3G. Of course we won't

stop there: we will continuously strengthen

our customers’ position through providing

more than just basic mobile operator testing

services. Next generation network including

VoIP quality testing, revenue assurance and

Drive Service Testing are good examples of

solutions that go beyond the verification

of standard services.

Today, Keynote SIGOS offers the most tho-

rough active End-to-End Testing solutions

in the market.

We have a clear business focus, close co-

operation with our customer base and an

established and experienced team. Telecom-

munications is a relatively young business

but we can proudly look back on two

decades of success.

Keynote SIGOS

20YEARS

Keynote SIGO

S

1989 - 2009

Keynoottee SSIIGGO

S

"��"�"?"��9

��)�3

"��;66%��

�� ! ��!��"

= �� %% �� 1

",66%� �� "��:�� 1

#��"��"

"9"�� @

99"��2

9�#�%�� 9��

�� %��&��9 � ��

�$��%

�� :�>��6��

�,�&�� %� ��*

>��A, %�� 1

>��:�� 2

��!�

��"��/�"B�"0 ��

=% ��=�� 4�

��&�� 4�

C;�� 44

C�#=��D�� 4*

C8;+��41

"�� 42

>�)��%�6&�� *�

>�)��A, %�� *�

"��:��:��/��%�E-� �,��0

�6��"�� 2

�� %�6�� # �� 2

"�99,%��6%�3�� 2

��' �� 2

� 6&�� %��' ��

9�),% ��E"� % #�%��

�� ,��9 � ��

�� )��

�� )��

��"�F,��E��%"��,��,��

� � " '��

��-�2�& � ��",66��

��6��E;% � ��

�"��:��;�� 9��

�� &#� �) �� 4

�9 ��3��6�� 4

"��+�� 6&�� *

"��+�� 6&��G�* ��:�"��:��G**&

!��"��"

��),�� 1

G��)�3

�,�� 9 6G11

"�9=�3��G*2

�&��H��9�#�%�;

'

��'�� %"��:��

��'�� %"��:�� 14

"��%��

��%�� ((

��+�� ((

8 ��4�� ((

�+B�;9�8 ��(1

"��6��

��:�"��:�� **

$ �)��"� ,% �� *1

"�9=�3�� *2

��:��,�;��,� �� (�

�� 6 �� (�

�=�%%�� )� ��>��'�� (�

�� (4

��#�,�)�� /��0�� (4

�%�# %�� A, %��/�A0 �� (*

%�# %��

�,�#�,�)�� (2

�,��

�,�� 11

6

SITE TEST SYSTEM

Whether you require a stand-alone test solution

or you wish to span your testing facilities around

the globe at multiple locations: from Keynote

SIGOS solutions you can always expect scalability,

integrity and great expertise reflected in our

solutions and professional services.

With the Keynote SIGOS SITE Test System –

comprising sophisticated hardware and software

solutions – network operators are enabled to

host and work with their own testing facilities.

Key here is the ability to easily integrate into

the existing network infrastructure realities.

Interfaces to complementary solutions, e.g.

monitoring systems, are provided so that SITE

can be exactly matched to your specific

requirements.

The SITE Test System’s architecture is completely

modular. Only the modules that are needed for

the given tasks needs to be purchased. Our

Senior Telco Experts will be happy to discuss

your requirements.

GlobalRoamer

Keynote SIGOS Managed Global Infrastructure and Test SystemFor Outbound Roaming

With GlobalRoamer, Keynote SIGOS offers the

most extensive infrastructure for automated

outbound roaming testing world-wide. We provide

our customers with an extensive network of

testing facilities around the globe, hosted by

Keynote SIGOS. GlobalRoamer customers can

use this sophisticated testing infrastructure

through a web based user interface.

All that is required is a web browser and access

to the internet. Simply log on with your password

and set up your test schedules without worrying

about a thing. However, Keynote SIGOS can

also provide a fully managed roaming test

service so that all that you really need to do

is look at the results.

We at Keynote SIGOS are always there for our

customers: in each phase of your testing

requirements we provide you with well

experienced and specifically trained personnel,

whether it be for project implementation,

maintenance, managed services, training or

solution consulting. All our Professional Services

can be customized to your specific needs.

For instance, with different levels of Managed

Services, we can help our customers with the

management, operation and administration of

tests. Our services are completely customizable

and scalable: we are handling complete SITE

systems for customers as well as we manage

small occasional testing projects. Just as you

please.

Professional Services

Solution Consulting, Managed Services and More – Flexibleand Customizable

Keynote SIGOS

> Introduction

Your Own Scalable and Highly Flexible Testing Infrastructure

7

Keynote SIGOS

> Introduction

The solution is fully automated testing with SITE:Keynote SIGOS has developed the most advanced

automated test system available on the market,

providing precise and easy to use automated testing

throughout the entire network.

Today, network operators are confronted with an extremely dynamic market

and the challenges of keeping up with new technology, permanent surveillance

of Service Level Agreements (SLA) and reducing costs whilst maintaining

customer satisfaction. To fulfil these challenges preventive and permanent

testing is required. These tests can be both labour-intensive and extremely

costly and for those reasons are frequently neglected.

Cost-Saving Automated TestingAvoid imprecise, time consuming and labour intensive manual tests

SurveillanceContinuous and precise monitoring of service availability, quality (KQI)

and performance (KPI)

Service Quality ManagementPrecise measurement of service availability, performance and quality

ReportingHighly flexible, dynamic and automated reporting and alarming environment

ScalabilityFrom small stand-alone to network-wide distributed systems

Central SIM MultiplexingTo use infinite numbers of SIM Cards at various locations

Graphical User InterfaceUser-friendly, drag-and-drop graphical interface with rollover help text

Flexible User AccessPermission based access via Internet, LAN and XML

Open InterfacesFor seamless integration and combination of existing and new tools

Customising EnvironmentTest case editor to create and adapt tests to specific customer needs

The Keynote SIGOS platform for

first-class Quality of Service

8

SITE Test System

ISUPMAP Gb GSM

SCCP TCAP IuCS

GSM AINAP

CAP IuPS

Core Network Internet

WLAN

BlackBerry

a / bS0UCP SMPPSMTP/IMAP

WAP via IPMMS via IP

EthernetS2m

DSL

Mobile Network

HSPA*

Specific Interfaces

SITE Overview

SIT

E T

EST

SYSTE

M

CIMD

Central Open DatabasesTo ensure maximum performance, the SITE System

uses an open SQL-based database. All configuration

information, test results, measurements and KPIs

are stored logically, to provide a clear measurement

and reporting capability. Using powerful filter

functionality any database listing can be easily

modified and a multi-format export function allows

the sharing of data with other network support

tools.

Test InterfacesSITE supports GSM/GPRS Um, UMTS Uu, HSDPA,

HSUPA, EDGE, CDMA2000, PSTN a/b, ISDN S0, S2m,

GSM A, GSM Gb, ISUP, GSM-R, WLAN, IuCS, IuPS,

Ethernet, DSL, SMPP/UCP/CIMD, MM7.

Open SystemSITE is an open system and can be easily integrated

into existing test environments. Existing equipment

may be directly linked to SITE and controlled and

monitored via the XML system interface.

In addition, current software updates, configuration

modifications or problem resolution are quickly

and reliably performed by Keynote SIGOS.

SIM MultiplexingSITE can handle thousands of SIM and USIM

cards in cascade-style SIM card boards. The

subscriber information of a SIM card is read out

by the system and transmitted via a LAN/WAN

network to any test location required. The SIM

authentication procedure is handled virtually between

the wireless interface in any location and the real

SIM stored in the central Multiplexer unit.

* with possibility of Layer 3 protocol trace feature/monitoring

GSM/GPRS Um

UMTS Uu* GSM-R

CDMA2000EDGE

PBX

PSTN

ISDN GSMA

Gb GSM ISUP

LAN / WAN

lu CS lu PSsupporting thousands of SIM cards serving

Um, Uu and SS7-Interfaces (A, …)

CentralUnit

SIMMultiplexer

Compact LocalUnits

Local Units

Clients

UMTS Uu

GSM /GPRS Um GSM/GPRS

Interfaces UMTSInterface

MM7

9

SITE Overview

Graphical User InterfaceThe SITE User Interface enables easy system

operation and administration via either the intranet

or internet. The Web GUI client is used for

configuration of tests and reports as well as for

administrative system configuration. The system

can be accessed simultaneously by various parties,

each with configurable user rights. The SITE User

Interface provides a user friendly, drag-and-drop

environment to arrange, copy and edit test and

report elements, within a directory tree and folder

system. The Web enabled User Interface enables

a flexible access to the system, for example, by

technicians from remote locations.

The XML interface is used as an integration interface

to exchange input and output data with other

network test or management infrastructure.

The modularity and scalability of SITE permits

optimum system adaptation to customer

requirements. Portable and Stand-Alone Systems

for implementation in test laboratories are just as

possible as the provision of a distributed system

to cover the geography of an entire live network.

The modules of the SITE system are the Central

Unit, SIM Multiplexer and Local Units. Local Units

may be connected by permanent IP – but fast,

problem oriented, deployment of local units

independent of permanent IP is just as possible.

There are Wireless Local Units (WLU) and Mobile

Local Units (MLU) to increase deployment flexibility.

The IP connection is vital to the system and is

therefore constantly monitored by SITE. The test

system may be upgraded as required by new

applications, functions and test interfaces.

Modularity & Scalability

Dynamic Resource Management

SITE can execute tests at any time desired. Via the

scheduler window a single or group of tests can

be defined once or periodically, based on very

flexible selection criteria of date, day, time, frequency

and number of repetitions. To avoid any resource

conflict, an intelligent resource management system

controls access to interfaces and SIM cards, assuring

a smooth operation and maximum test parallelism.

The selfmanagement checks system components

regularly and generates an alarm (SNMP-Trap) in

the event of failure.

SIT

E T

EST

SYSTE

M

10

DATA SafetySITE redundant is a solution for reliable high

availability. The main concept is the mirroring of

the hard disk partition over TCP, based on the

standard Linux High-Availability option. It observes

the operating system, databases and processes.

If a component crashes a power failure happens

or anything is stopped manually, then a switchover

to the second system will be initiated.

SITE Backup Solution is very important in the case

of a damaged or corrupt database, SITE installation

or hard disk. It is based on Arkeia’s “Enterprise

Backup Solutions”. Keynote SIGOS provides this

backup software with a pre-configured backup

strategy for the SITE Central Unit. Special features

are scheduled backups, incremental and

differentiating backup, as well as tape

administration.

Test Sequences & Control StructuresTo mimic the typical usage, of say a mobile network

customer, a test sequence feature can be used for

a series of different service tests after a single

Location Update. Control Structures provide logical

operators like: List based ‘FOR EACH’, condition

based ‘WHILE and REPEAT’, and time based ‘WAIT’

functions. These features save valuable resource

time and significantly increase the testing throughput

and efficiency of the system.

Test Case EditorSITE provides large libraries of Test Cases for main

network services in various formats with detailed

parameter options. To create customized own Test

Cases with the assembly of various test steps via

a user-friendly drag-and-drop mechanism SITE

provides it’s Test Case Editor environment. Complex

scenarios can be quickly built to enable the testing

of new network services.

Test Case RecorderThis SITE tool allows intuitive recording of browsing

actions taking handset characteristics into account.

Mobile and provider specific web and WAP pages

are retrieved from the network via the test probes

during recording sessions to get a feel for real

download behaviour and latency. Traces are shown

live while the developer is browsing. The test case

can be evaluated before saving the entire browsing

session by replay during creation. Full feature

support by the Test Case Editor makes later

adaptation of recorded browsing sessions easy. It

is like having full and instant remote control access

to a specific handset in a remote location – with

no need to travel anywhere to use it.

UTF-8 Character SupportThe UTF-8 feature enables the full encoding for

e-mail, web pages, & other places where characters

are stored or streamed. SITE test cases support

full encoding for SMS, WAP and MMS parameters.

All parameters in the Test Case Editor can be filled

with UTF-8 characters unless no specific presets

are given. So an SMS text or html link can be

searched and checked with UTF-8. SITE Reporting

shows all possible values: conventional as well as

UTF-8 entries.

Benefit: Wealth of language specific characters can

be supported, e.g. Latin, Greek & Coptic, Cyrillic,

Armenian, Hebrew, Arabic, Syrian, Bengali, Thai,

Myanmar, Georgian …

SIT

E T

EST

SYSTE

M

SITE Overview

11

SITE Reporting enables users to create, view

and forward multiple reports. These reports are

generated from measurements collected in the

report database. These reports can either be

based on SIGOS standard Key Performance

Indicators (KPIs), on KPIs according to ETSI

standards or on individual customized KPIs.

This report creation is by means of an easy

drag-and-drop configuration functionality. SITE

Reporting offers the possibility to visualize test

results in various illustration tools, serving

even specific presentation and monitoring

needs. Flexible standard charts and diagrams

as well as enhanced functionalities like

“percentile”, “ad hoc reporting” and “derive to”

can be immediately generated from recorded

KPI data. Real time alarming is also embedded:

resulting alarm notifications are automatically

distributed e.g. via SMS, e-mail, SNMP, etc. to

defined recipients. Users can define flexible

threshold-settings, counters, severity triggering

points, etc. when alarms should be generated

or cleared.

Reports can be illustrated in different ways,

either charts in various formats; markers, bars,

lines etc, or by matrix tables to provide a fast

color coded overview of vital services or

specific KPIs.

Reporting and Alarming

Reporting is fully integrated in SITE

Service Area Monitoring

Dashboard

Matrix Report

SITE Overview

> Reporting and Alarming

Your benefits

Automated testing: avoid expensive and time consuming manual testsIncrease reliability of the mobile network, thereby increasing ARPUIncrease customer satisfactionMonitoring and measuring of service availability and quality Ensuring SLAs with precise KPIsScalable architecture: from stand-alone to geographically distributed systemsCentral SIM Multiplexing No “SIM card traveling”Quick detection of problems by rapid parallel testing of all network servicesIn addition to standard SITE reporting, many powerful reporting features are available

ReportDefinition

alarming

KPI Databases

PostReporting

OnlineReporting

MeasurementsStrategy / KPI design

Raw-Measurements(Input and Output)

real timereporting

Test Executions

Test Execution on different locations

SIT

E T

EST

SYSTE

M

12

Service Area Monitoring is divided in two panels:

SERVICE View

The Service View is the GUI for Service AreaMonitoring application. Users are able to seethe status of network elements in theNetwork / Service model graphically.

DETAILS View

The Details View offers further information foreach unit in the Service View, such as:Name, Alarm Aggregation Method, Commentsand Assigned Alarms.

Service Area Monitoring

The SITE Service Area Monitoring application is

used to visualize mobile network services that

target a specific Service Area. Alarms that are

generated by the failure or degraded performance

of services can now be linked to a specific

network element within the operator’s

infrastructure. This function is implemented by

careful correlation between the specific elements

used within a Test Case execution, and the overall

network topology which has supported the Test

Case scenario that generated the alarm or

measurement. An example could be a WAP test

initiated from a wireless interface located at

Latitude (x), Longitude (y). The topology for this

scenario would use specific BTS/node B, BSC/RNC

infrastructure, assigned to an MSC/SGSN reaching

finally a specific content portal.

Each network information and trace is processed

to provide significant data of the actual network

performance and functionality, finally combined

to a total service area view.

Test Execution System SITE KPI Database Reporting/Alarming Service Monitoring Engine

Alarms

Test Execution Results (Traces) Report/Alarm View Service View

Drill Down #1Drill Down #2

Test DefinitionsSchedules

Report DefinitionsAlarm Thresholds

Alarm CorrelationNetwork/ServiceTopology

SIT

E T

EST

SYSTE

M

SITE Overview

> Reporting Additions

13

Matrix ReportMatrix Report environment allows the user to

view Key Performance Indicator (KPI) data as a

numerical value, which can be easily color coded

to provide a quick, easy to understand overview

of network performance. Service KPIs can

therefore be displayed in a format which is

especially useful for Network Management and

Operations personnel.

Matrix_Multi mode, allows for a table of different

KPIs as the “Y-Axis” to be configured, in relation

to another KPI as the “X-Axis”.

The right example displays the average results

of a tested service, where three different

measurement KPIs, (Success, Failure and

Incomplete) have been tracked against different

PLMNs. By placing the cursor above a selected

cell within the Matrix, additional information can

be gained regarding the displayed statistic. As

with all report charts available in SITE, a “drill

down” process is also available to gain access

to detailed individual test data when required.

Matrix_Single mode allows for the tracking of

one Key Performance Indicator (KPI) , in relation

to two other KPIs in a matrix. Alarm thresholds

can easily be set to provide a distinctive color

output to ensure that possible error conditions

can be quickly seen and understood. In the left

example, the Rx (Receive) Value is the single KPI

represented, against day of the week and different

interface types and their current locations.

DashboardThis GUI system tool provides a simplified intelligent

interface to SITE reporting. It is interesting especially

for the people responsible for the service who

want to work intuitively without any training effort.

KPIs can easily be filtered and individually stored

in a few clicks. Individual configurations allow

additional, more customer-oriented, data analysis.

Fast and easy drill down to individual traces is

possible directly from the Dashboard.

SITE Overview

> Reporting Additions

SIT

E T

EST

SYSTE

M

SITE TEST SYSTEM

SIT

E T

EST

SYSTE

M

Various Technologies – ONE Test System: SITE

14

15

SIT

E T

EST

SYSTE

M

Given all these challenges how can you

ensure top quality end user experience

avoid revenue leakage

safeguard SLA compliance

The answer is “Active End-to-End Service

Quality Testing and Revenue Assurance” with

Keynote SIGOS.

SITE Test Applications

> End-to-End testing

SIT

E T

EST

SYSTE

M In a highly competitive market, such as the tele-

communications industry, providing and

maintaining highest quality to end customers

is key to sustainable competitive advantage.

With customers having multiple options at hand,

poor quality – even the occasional drop of

quality – can have immediate consequences.

Switching between operators never has been

easier and through mobile number portability

a classical barrier to switching long has fallen.

First class service quality has many influencing

factors not all being under immediate control

of the operator. Identification of weak points

can be difficult and remain undiscovered while

the effects still are being carried into the market.

Often goes along hidden revenue leakage as

for example through the fraudulent and

undiscovered usage of SIM boxes. Safeguarding

compliance of service level agreements is another

example that requires active testing.

Even the basic call in fact is not exactly basic:

prepaid subscribers, which make the majority

of most mobile network's customer base, typically

involve complex intelligent network support

and interaction with a ‘hot billing’ credit database.

Also supplementary services like Call Forwarding,

Call Waiting, Call Barring, Call Hold, CLIP/CLIR

are multi-switched calls which need complex

interaction with the subscriber profile.

Infrastructure growth or changes require that

core network configuration data between mobile

to mobile and between mobile and fixed line

is correctly maintained.

Active End-to-End service quality testing and

revenue assurance with Keynote SIGOS enables

operators to identify weak points and to get in

control over aspects normally out of direct reach.

From slipping into the role of end customers

and experiencing service quality from different

angles to preventive testing, as it is required

when new services are introduced. With Keynote

SIGOS’ SITE Test System and its comprehensive

test applications and concepts, operators always

have the right tool available.

Why End-to-End Service Testing?

Customers’ View

Quality of Service

Quality of Service on the move

Service reaction time

Revenue Assurance

CDR Compare

Prepaid account check

Voucher booking

Defined Conditions

Defined time /duration

Defined data volume

Defined period

Exact KPI control

Immediate Reaction

Immediate fail detection

Clear alarm situation

Advantages of active End-to-End Testing

Preventive Testing

New Components

Service Introduction

Regression tests

Roaming Tests

IREG tests

Outbound roaming

16

What about your Text Message Service?

SMS is the worldwide killer application

for network operators.

This simple network application results

in a large percentage of turnover for each

network operator. However, this important

revenue stream also requires constant

monitoring and possible improvement in

quality of service. SMS, as simple as it

may look, when monitored continuously,

often suffers from long delivery durations,

modification of content or missing text

with multiple SMS messages.

Regular tests are therefore required to

maintain a high standard of quality and

to improve customer satisfaction.

Phot

o ©

T-M

obile

AG

17

IP IPIP

CIMDUCPSMPP

SMSCBSC BSC

SITE Test System

Features

Simulation of real subscriber behaviour

Interfaces: GSM/GPRS Um, UMTS Uu, Iu CS,

CDMA2000, GSM A,

SMPP / UCP / CIMD via LAN (TCP/ IP)

Central SIM Multiplexer: infinite number

of SIM cards can be managed

Protocol test GSM 03.40, MO/MT

Resource allocation for different users or groups

Check functionality of SMSC

Check SM Service functionality

at peak times

Transmission time KPI

Available SMS KPIs:

SMS send duration

SMS deliver duration

SMS end-to-end duration


> SMS

SIT

E T

EST

SYSTE

M

Multimedia Messaging Services are vital

to the network operators younger and

higher ARPU (Average Revenue Per User)

customers. With its complex functional

combination of SMS and GPRS it is easy

for the service to become unavailable in

a complex mobile network that is always

being upgraded or optimized.

In order to gain acceptance as a useful

service and drive frequent use by the

subscribers errors should be avoided

from the beginning, as once a service

does not work subscribers turn away

from it. Therefore, to aquire a high

reputation for Quality of Services (QoS),

regular tests are essential.

Test your services proactively via the

automatated SITE MMS Test capability,

and guarantee your subscribers a high

standard of quality!

Success with MMS!

18

Features


Interfaces: GSM/GPRS Um, GSM A, GSM Gb,

UMTS Uu, HSDPA, HSUPA, EDGE, Iu CS, Iu PS

CDMA2000, MM7

Detailed test reports incl. WAP WTP/WSP

decoding



Resource allocation for different

users or groups

No MM storage limitations

MM to legacy handset tests

User definable test messages

MO/MT transmission of multipart MMs

Segmentation and reassembly supported

Expandable library of MMS test messages

Logging of all relevant timestamps


> MMS

SIT

E T

EST

SYSTE

M

Phot

o ©

T-M

obile

AG

MMS Test Cases

19

Example Test Case MMS_MO_MT

Orig.MMS Client

TargetMMS Client

Orig. MMSProxy-Relay

Target MMSProxy-Relay

WSP/HTTP GET.req

M-Retrieve.conf

Time passes

M-Send.req

M-Send.conf M-Notification.ind

M-NotifyResp.ind

M-Acknowledge.ind

M-Delivery.ind

Available MMS KPIs:

GPRS attach duration

PDP context activation duration

PDP IP UP duration

MMS send duration

MMS fetch duration

MMS push arrival to receive MMS

duration

MMS connection to send duration

MMS send to push arrival duration

MMS end-to-end duration

> MMS

MMS_MOSending of an MMS message to any externalnumbers or e-mail address

MMS_MTReceiving MMS via corresponding WAP Pageafter SMS notification

MMS_MO_MTSending and receiving of an MMS (notificationand download via WTP or WHTTP protocol stack)

MMS_MO_ToEmail_Retrieval Via MobileSending of an MMS message to an e-mailaddress and fetching the correspondinge-mail message via POP3/IMAP

MMS_MO_ToLegacySending of an MMS to a subscriber which hasno MMS capabilities configured by thenetwork operator

Others on Request

Interactions occuringbeyond MMSM are not

in this document’s scope

Interactions occuringbeyond MMSM are not

in this document’s scope

SIT

E T

EST

SYSTE

M

20

Can your customers chat via

Mobile Instant Messaging?

Keynote SIGOS offers Mobile IM test cases based

on OMA, optimized to customer requirements.

Operators who test with SITE can get KPIs about:

registration at the IM server

successful login

“get presence”-information of other users

and whether two parties can “see” each other

text message receipt from IM server

successful logout from the IM server

Instant Messaging – the real time text

based communication between two or

more participants – is well known on the

desktop, like Skype, ICQ, MSN etc. This

instant messaging (IM) has made the

leap from the PC to the mobile phone

connecting friends, peers, colleagues

while they are on the go.

To get connected to either fixed IM users

or mobile IM users, Java applets installed

on mobiles deliver branded user interfaces

that reflect the operator-owned mobile

IM community or the most popular

Internet IM services. A single client gives

access to multiple IM systems and can

transmit and receive presence information.

The clients are compliant to the Open

Mobile Alliance (OMA) Instant Messaging

and Presence Service (IMPS). Which also

means the needed IM protocol for mobile

devices is defined by the OMA.


> Mobile Instant Messaging

SIT

E T

EST

SYSTE

M

21

Make Premium Content download apremium customer experience andtest your Digital Rights Management

Phot

o ©

T-M

obile

AG


> Digital Rights Management

Digital Rights Management (DRM) is an

important enabler for billing of premium

priced content, e.g. ring tones. To cater

for fast and flexible service creation the

Open Mobile Alliance (OMA) defined

application-level protocols and behaviors

needed to provide powerful as well as

reliable content download functionality.

The scheme is implemented on most

multi-media phones and is intended to

be used by mobile content providers to

control access to their products.

The whole Digital Rights Management

process is relatively complex and could

introduce multiple risks of malfunction.

At the same time, the effect of a possible

error can be disastrous: unhappy

customers if a fault occurs during the

download and billing process of the

premium priced content.

With special SITE Test Cases for the

verification of your Digital Rights

Management you can avoid undesirable

surprises for your customers and test the

entire procedure according to OMA

specifications. So that your customers

will call their download experience a

premium one.

The purpose of DRM is to enable controlled

purchase and usage of digital media objects.

The Open Mobile Alliance (OMA) has defined

Digital Rights Management specifications for

the mobile world:

Forward Lock (prevents the user from

unlawful forwarding of protected content)

Combined Delivery

(combined rights object / media object)

Separate Delivery (separated rights object

+ encrypted media object)

Digital Rights Management is a complex

process. Users expect seamless proce-

dures when downloading premium content.

Ensure your customers will call their

download experience a premium one.

SIT

E T

EST

SYSTE

M

Interactive Voice Response services (IVR)

used, for example, during Voicemail

access, are a common feature of everyday

life. The situations in which people

communicate with services such as

customer care systems via IVR servers

will increase continuously.

Testing these systems is essential for

network operators to assure the quality

of their services and thus keep their

customers. IVR systems are sophisticated

and extremely difficult to test on a

continuous and reliable basis. At present,

complicated test runs in which employees

must manually test IVR systems are to

a large extent standard practice.

Keynote SIGOS innovation has created a

tool that can wholly automate this task.

The IVR tester is designed so that even

the most sophisticated speech menus

may be recorded and recognized based

on a library of voice prompts.

Do your voice response serviceswork correctly?

22

Features



CDMA2000, PSTN, ISDN So, S2m, GSM A

and ISUP

Scalable architecture: from stand-alone

system to widely distributed system

Detailed IVR test reports



Testing IVR trees

Voice mailbox tests


users or groups

Announcement comparison based on

voice prompts

Easy integration of new voice prompts

DTMF and voice stimulation

Customer specific extension

Several languages available

Language independent


> IVR

SIT

E T

EST

SYSTE

M

IVR systems need to be checked in respect to:Availability of voice services

Correctness of announcement

The structure of the entire IVR system

Available IVR KPIs

Recognized prompt

Recognized prompt parts examples

Keynote SIGOS IVR Test System Procedure

calling service number

recording announcement 1

sending DTMF/WAV

recording announcement 2

sending DTMF/ WAV

recording announcement n. . .

23

> IVR

Available IVR KPIs:

Call Duration

Duration of played audio file

Length of recognized reference prompt

Duration of recognition process

Recognition confidence of best recognizedreference prompt

Recorded audio file location

Real duration of recording

Announcementcomparisonwith Prompt

library

Announcementcomparisonwith Prompt

library

SITE IVR Tester

SITE IVR Tester

SITE IVR Tester

IVR System

IVR System

IVR SystemSIT

E T

EST

SYSTE

M

Phot

o ©

T-M

obile

AG

24

The “push-to-talk” services turn mobile

phones into walkie-talkies with unlimited

range.

Mobile users like businessmen, delivery

companies and taxi drivers can connect

in a “walkie-talkie-style” at the touch of

a button.

Push-to-Talk over Cellular (PoC) a real-

time, direct, 1-to-1 and 1-to-many voice

communication service is mandatory for

today’s cellular networks. Companies,

especially those needing to be in constant

touch with several teams and locations,

will soon discover PoC to be the most

efficient solution. The benefit of radio-

style communication, especially

broadcasting to many users, makes it

much more convenient than many phone

calls or even call conferencing.

Be sure your Push-to-Talk service meets

the high quality and reliability required.

Back to the Future with Push-to-Talk

Features


Interfaces: GSM/GPRS Um, GSM Gb,

UMTS Uu, HSDPA, HSUPA, EDGE, Iu PS,

CDMA2000



Test 1-to-1 or 1-to-many communication

Play and record speech data

Emulating mobiles like Nokia 5140

and similar

Real End-to-End Testing of

real-time-always-on voice service

Check SIP (Session Initiated Protocol) Control

Plane of the PoC Application Server

Check RTP (Real-time Transfer Protocol) User

Plane of the PoC Application Server


> Push-to-Talk

SIT

E T

EST

SYSTE

M

25

QoS testing solution for PoC:

Test PoC availability

Check Communication between

UE and PoC server

Check control plane

Handling SIP sessions which are

used to establish and maintain

the connection between PoC-enabled handsets

(Interface: UE and PoC server via UDP)

Registration, authentication and

authorization at PoC server

Group attachment

Check user plane

Speech data transmission

Send and receive speech data

in AMR format to/from

other group members

Handling of RTCP messages

SITE Test System

LAN/WAN

IP Network

PoC Application Server

RTPUser Plane

SIPControl Plane

> Push-to-Talk

Available PoC KPIs*:

Registration Failure Ratio

Registration Time

Session Initialization Failure Ratio [%]

Session Initialization Time [s]

Floor Request Failure Ratio [%]

Floor Request Time [s]

Stop-Talking Timer Failure Ratio [%]

Stop-Talking Time [s]

Session Cut-off Ratio [%]

Session Setup Time [s]

Voice Delay (in session) [s]

Voice Delay (first) [s]

Audio Quality

* Reference: ETSI/STQ_Mobile(05)06TD06

SIM Multiplexer

Um, Uu

Central Unit

SIP + RTP messages viavia Um, Uu

SIT

E T

EST

SYSTE

M

Voice Quality is, and will remain the major

key performance indicator for each

operator’s network quality. This is

recognized by subscribers and operators

alike.

Bad voice quality generates short holding

times and repeated attempts, and

immediately sets a poor level of

satisfaction with the user. Furthermore,

international Voice Quality tests can reveal

crucial quality information of different

network carriers, the usage of IP routing

or SIM boxes. Therefore, verification of

voice quality is essential. Subjective tests,

where human beings would have to score

the quality of sound samples in a listening

laboratory environment are expensive.

Automated test methods with the

intention to mimic subjective tests, allow

for a cost effective and consistent

alternative to subjective testing, either

on a referenced or an unreferenced basis.

Do you offer excellent Voice Quality?

26

Referenced Voice Quality (PESQ)

Unreferenced Voice Quality (3SQM)

Features



CDMA2000, VoIP, PSTN, ISDN S0, S2m,

GSM A, ISUP, LAN/WLAN



Customer specific audio reference files

are easy to ingrate

Objective MOS Voice Quality result values

from 1-5 (bad, poor, fair, good, excellent)

Many further measurements


> Voice Quality

SIT

E T

EST

SYSTE

M

Call from A-Side to B-Side and perform speech

quality check, by playing an audio reference file

from A-Side to B-Side and check the received

audio signal with its reference using the

standardized PESQ algorithm. One crucial result

measurement is called ‘mean opinion score’

(MOS) and the result values can be interpreted

from ‘bad’ to ‘excellent’.

27

> Voice Quality

Available Voice Quality KPIs:

MOS_Lq

MOS_Noise

MOS_P8001

MOS_Speech

Background Noise

Average delay

Measurements e.g.: MOS value background noise delays attenuation …

optionally:

A BA B

Impairment GradeExcellent 5Good 4Fair 3Poor 2Bad 1

=

play Audio File record

A-Side

Reference Audio File

B-Side

Reference Audio File

PESQAlgorithm

Recorded Audio File

Unreferenced Voice Quality Testing(3SQM™)SITE also supports the Single Sided Speech Quality

Measure 3SQM™ (ITU-T P.563) for advanced non-

intrusive voice quality testing. The technology behind

3SQM™ is also based on a generic perceptual approach

and so is independent from the network technology

being assessed.

In comparison to intrusive measurement techniques,

such as P.862/PESQ, 3SQM™ is based on single ended

measurements. In consequence, accuracy may not be

as high but measurements can be made at almost

any point in the network with any real-world speech

signal.

Referenced Voice Quality Testing (PESQ)Referenced SITE Voice Quality testing is based

on the ITU-T P.862 standard via the PESQ

algorithm (PESQ = Perceptual Evaluation of

Speech Quality). PESQ forms the state-of-the-

art technique and international standard for

automated advanced perceptual voice quality

analysis, comparing actual test results with an

audio reference. Referenced Voice Quality Testing

provides a very high level of accuracy.

SIT

E T

EST

SYSTE

M

28

Voice over IP

SITE Central Unit

With the Voice over IP testing capabilities

of the SITE Test System, it is possible to

perform real time end-to-end active

VoIP-testing to determine the customer’s

experience of the service.

Testing Voice QualityAlthough Voice Quality is vitally important

for any type of network that routes voice

traffic, the shift from dedicated circuits

to the efficiency of IP based traffic, brings

its own problems with regard to the end

customer’s perception of performance.

The possibilities for Delay, Jitter and

Packet Loss over an IP based infrastructure,

means the network operator must con-

stantly check the Voice Quality metrics

to ensure that problems are detected

before they cause major disturbances

and dissatisfac-tion to the customers. As

well as ensuring that end-to-end connec-

tions can be established, maintained in

a speech state for the required test period

and success-fully cleared down, the quality

of real sound samples needs to be

checked throughout the “speech” phase

of the connection.

This is why SITE supports voice quality

testing according to the PESQ algorithm

recommended in the ITU-T P.862 standard.

Fixed NetworkISDN S0, S2m


> VoIP

SIT

E T

EST

SYSTE

M

Operator Network

LAN

DSL-Router

DSL-Modem DSL-Modem

DSL-Router

EthernetIPIP

PSTN / ISDN

Location nCLU

Location 1CLU

IPFixed NetworkISDN S0, S2m

IP

Available VoIP KPIs:

The Mean Opinion Score /Perceptual Evaluation ofSpeech Quality (MOS / PESQ)

Delay

RTP Jitter

RTP Packet Loss

PSTN / ISDN

Over the air IP data services offer

subscribers a highly flexible way to

connect to a rich world of internet based

services like Email, Instant Messaging,

websites, VoIP and much more.

GPRS represents the first step towards

a faster access provided via EDGE, UMTS,

HSPA (HSDPA / HSUPA). Whilst there are

gains in flexibility the technologies need

to be supervised and maintained leading

to added costs and higher labor content.

To increase revenue and service quality

SITE offers data tests to access all

available technologies via dedicated

interfaces to reveal service performance

and functionality problems.

Do you meet your subscribers’ demands withGPRS, EDGE, UMTS and HSPA Data Services?

Service precedence

Availability and reliability

Access speed and delay

Throughput, RTD and idiosyncrasies

And much more ...

29

Available data KPIs:



PDP setup connect duration

PDP IP UP duration

CSD dial in duration

CSD connect assign IP duration

Download: download duration, download rate, throughput, session time


Interfaces: GPRS Um, GSM Gb, EDGE,

UMTS Uu, HSDPA, HSUPA, Iu PS, CDMA2000,

Ethernet IP, DSL





Detailed test reports

Pro-active testing

HSDPA throughput: theoretical download

maximum 7.2 Mbps; Cat. 6, 8 and 12

HSUPA throughput: theoretical upload

maximum 2.0 Mbps; Cat. 3 and 5

HTTP, FTP, SMTP, WAP

Measuring transfer rates

Roaming aspects covered

Features


> GPRS IP (CS / PS)

SIT

E TE

ST

SYSTE

M

30

BlackBerry is today’s leading wireless

connectivity solution for a large number

of mobile professionals like enterprise

and governmental organizations

worldwide.

It allows users to stay connected with

secure and wireless access to e-mail,

corporate data, calendar and web, to

easily manage all their communication

and information from a single BlackBerry

device whenever and wherever required.

BlackBerry eliminates the hassles of dial-

up by moving mobile data to a “push”

architecture.

Especially for mobile professionals, it is

vital that the network operator provides

the highest levels of quality and reliability.

BlackBerry, your network’s sweetest fruit?


Interfaces: GSM/GPRS Um, UMTS Uu, HSDPA,

HSUPA, TCP/ IP

Real End-to-End testing of BlackBerry

‘push’ service

Testing carried out using a commercial

BlackBerry device

Check sending and receiving e-mails

Check the BlackBerry device integrated

email features

Using BlackBerry devices with a java application

for reflector code – for sending emails

Management notification and reporting

Features


> BlackBerry

SIT

E TE

ST

SYSTE

M

31

QoS testing solution for BlackBerry:

Sending a message from SITE test system to a BlackBerry

device via mobile operator’s network

Important: time synchronisation for time KPIs

BlackBerry device receives e-mails from the SITE test

system per “push” from the RIM Server and it immediately

responds to the sender with a receive timestamp

SITE extracts timestamp details from the e-mail and

processes them to measurements which can give delivery

delay or success rates in both directions

Phot

o ©

T-M

obile

AG

IP Networkwith POP3, IMAPor SMTP Servers

Mobile Operator’s Network

SITE Test System

RIMServer

BlackBerrydevice

SITE e-mailTest Case

Push 1. part of e-mail

(more parts of e-mail)

e-mail [email protected]

e-mail [email protected] with timestamps

(optional)

RIM Mail Server

PLMN

BlackBerry devicewith java application

for reflector code

> BlackBerry

Available BlackBerry KPIs:

Send time

Receive time

Round trip time

Battery level of the device

Battery temperature of the device

SIT

E T

EST

SYSTE

M

32

For many users the iPhone and the 3G

iPhone opened a new era of mobile

phone interaction and services. The unique

combination of multimedia contents,

intuitive multi-touch display controls,

accelerometer and much more created

also a demand for new operator services

dedicated only for a single group of

subscribers.

Operators around the world specify this

group of iPhone users as high-tech –

high potential customers with a distinctive

technology and quality demand. The

unique services offered for this iPhone

customer base like the Visual Voice Mail

Box create additional quality process

demands at each network operator.

The Keynote SIGOS SITE System offers

dedicated iPhone tests to simply fit into

all QoS test procedures performed via

SITE without any additional effort. At the

same time measurements and KPIs

provide clear evidence of the service

availability and performance focussed on

this group of high-tech – high potential

customers.

Up to the hype with iPhone tests

Read the target address from the SMS and openconnectivity via APN to the Visual Voice Mailbox Server

Download the new message from the VisualVoice Mailbox Server to the device

Receive an SMS notification for a new message

Phot

o ©

T-M

obile

AG

executed every e.g. 15 minutes

Available iPhone Visual Voicemail KPIs:

duration

Failure Rates


> iPhone

SIT

E T

EST

SYSTE

M

Leave a reference message on the Visual Voice Mailbox Server

Test before yourcredibility breaks down!

Wireless Application Protocol technology,

and its correct functionality are vital to

today’s mobile networks and the need

to increase the amount of data usage by

customers. To attract and maintain

customers as data users requires that

content must be interesting and up to

date, which creates risk with the constant

change of Portal structure and individual

page format.

Keynote SIGOS has designed the WAP

1.x /2.0 Test Cases to prevent the drama

of a protracted breakdown in operation

becoming reality and to indentify

unavailable pages or incorrect links,

thereby reinforcing the subscriber’s

existing trust and acceptance of WAP

services.

What about the reliabilityof your WAP services?

33


Interfaces: GSM/GPRS Um, GSM Gb,

UMTS Uu, HSDPA, HSUPA, EDGE, Iu PS,

CDMA2000






Testing availability of WAP portals

Resource allocation for different users

or groups

Request pages over WAP 1.x or WAP 2.0

WML/XHTML/CSS decoding

Content check

Location based services

Throughput measurements

WTP/WSP/W-HTTP traces

Features

Available WAP KPIs:




PDP IP UP duration

WAP get duration


> WAP

SIT

E T

EST

SYSTE

M

What about mobile Internet browsing?

34

The combination of high throughput

protocols such as WLAN, EDGE and HSDPA

along with the variety of today’s multi-

functional, big screen handsets open

many new possibilities. The network

operators need to ensure that accessing

the internet directly via http, https and

ftp via a mobile device, provides a similar

experience to the customer as their home

or office fixed network internet connection.

Response, accessibility, Throughput and

so on are major performance indicators

for monitoring the quality of service. In

addition, the SITE Web Browsing test can

access websites, fill in forms, receive

cookies, initiate secure transactions,

download contents etc.

Be sure your service is at its peak in

coping with today’s demands!

Features


Interfaces: GSM /GPRS Um, GSM Gb, UMTS Uu,

HSDPA, HSUPA, EDGE, Iu PS, CDMA2000,

WLAN, Ethernet

Simulation of different browsers,

e.g. Netscape, MSIE, Mozilla Firefox



Chains of user interaction on a web

application, e.g. a full e-commerce session

HTTP post/get request methods

HTTPS (SSL) for secure transactions

Cookie handling

Follow links both by name or URL


> Web Browsing, IP

SIT

E T

EST

SYSTE

M

Testing Servicessuch as:

Send and Check e-mail

Send MMS and SMS over a Web Portal

Check Cookies

Limited check of HTML page content (keywords, images)

HTML parsing

35

Example: Send MMS to a non MMS compatible mobileClient (A) sends MMS to Mobile (B).

(B) receives an SMS notification with a Web Link possibly with password.

(B) starts a Web session by sending this Web Link (URL) to an operator Web Portal.

Web Portal responses and asks (B) for his authentication.

(B) sends authentication (e.g. mobile no., possibly with password).

Web Portal responses with MMS.

Available Web Browsing KPIs:




PDP IP UP duration

Web Browsing duration

> Web Browsing, IP

Client (B)

Receive legacynotification per SMS

Extract Web Link

MMS Client (A)

Send MMS

OperatorsWeb PortalMobile Web Browser

Authentication

URL response

(with html form)

URL request

Start BrowserSession

URL response (with MMS)

SITE

1.

2.

4.

6.

5.

3.

UMTS UuGSM Um

1.

2.

4.

6.

5.

3.

SIT

E T

EST

SYSTE

M

Phot

o ©

T-M

obile

AG

Business at every location, direct e-mail

and internet is today’s life. Due to this,

the number of worldwide Wireless LAN

(WLAN) access points and users is

continuously growing. Many mobile

network operators offer this type of

convenient internet access to their

customers. The existing customer SIM

card is the preferred most secure solution

for identification and authentication to

this service.

If customers discover that the service is

unreliable or inconvenient to use, they

will soon retreat. In a competitive market

it is essential to maximize quality,

reliability and usability along with the

fastest possible time to market. With

SITE WLAN it’s easy to test the availability,

the access and the performance of hot

spots in a flexible, continuous and

accurate way.

Wireless LAN for mobile operators –Test the availability and services!

36


> WLAN

SIT

E TE

ST

SYSTE

M

Testing Servicessuch as:

Search for available WLAN networks in

the hot spot area

Entering SSID of WLAN network

Entering WEP network key

Receiving IP address via DHCP

Receiving DNS servers and default IP

gateway from the backbone IP network

Payment/Billing procedures

SITE Test System Architecture for WLANwith CU, CLU, GSM-Probe, SIM Multiplexer and the components of public networks

like hot-spots with Internet access and public terrestrial mobile network with backbone.

37

Features




Interfaces: WLAN

WLAN 802.11

SSID – Network search

WLAN authentication

Payment/Billing


Available WLAN KPIs:

Number of packets sent

Number of packets received

round trip delay

> WLAN

DHCP: Dynamic host configuration protocolDNS: Domain name systemSSID: Service Set Id

(Identifies the WLAN network to attach)WEP: Wired Equivalent Privacy

(Encryption/Security mechanism for WLAN)

SITECentral Unit

SIM Multiplexer

Access Point Server

CompactLocal Unit

HotSpot

Um, Uu Probe

WLAN Probe

PLMN

Internet

Um, Uu

LAN

WLANSIT

E T

EST

SYSTE

M

What about your streaming applications?

38

Today, almost every major event, e.g.

sport, news or society events can be

accessed via real-time multimedia streams

on a mobile phone. These multimedia

applications become more and more

important in the wireless and mobile

community.

To make sure that customers can enjoy

these new and exciting premium services,

it is most important to guarantee an

impeccable streaming service. Using the

industry standard protocols RTP and RTSP

the SITE system is up-to-date with the

latest technology. Scheduled and contin-

uous tests make sure that multimedia

streams deliver the desired contents and

the required quality even to the largest

possible groups.

Features


Interfaces: GSM/GPRS Um, GSM Gb, UMTS Uu,

HSDPA, HSUPA, WLAN, EDGE, Iu PS, CDMA2000

Simulation of different browsers,

e.g. Mozilla Firefox, Netscape, MSIE

Central SIM Multiplexer: infinite

number of SIM cards can be managed

Parallel subsessions per stream,

e.g. video and audio

Send streamed multimedia over IP

TCP or UDP transport protocols

Measurement interval in multiple

of 100 milliseconds

Used industry standard RTP/RTSP


> Streaming

SIT

E T

EST

SYSTE

M

SITE Architecture for StreamingBecause higher bandwidth rates have become available to

mobile users the use of real time multimedia applications

has grown dramatically. To ensure the mobile customer enjoys

a positive experience, the streaming data transfer has to be

tested with SITE Streaming. For the solution an RTP/RTSP

client is used to download the data (e.g. audio and video).

39

RTSP / RTPRTSP (Real Time Streaming Protocol) is a client-server

multimedia presentation control protocol, designed to address

the needs for efficient delivery of streamed multimedia over

IP networks. The actual transmission is done by the Real-

time Transport Protocol (RTP).

> Streaming

Available Streaming KPIs:




PDP IP UP duration

RTSP packets loss percent video

RTSP packets loss percent audio

RTSP packets received video

RTSP packets received audio

SIM Multiplexer

WLANAccess Point

RTSP Server

CompactLocal Unit

GSMProbe

WLAN Probe

SITECentral Unit

Test Case

GPRS

IP

Socket Interface

RTP

RTSP

UDP

LAN/DSL/WLAN

PLMN

Internet

LAN

WLAN

SIT

E T

EST

SYSTE

M

40

High quality for Video Telephony using

3G UMTS is an absolute must, without

which it is used perhaps once, and then

never again by your customers!

A high expectation regarding quality of

service is set by the mobile UMTS

subscriber, as the premium cost invoked

by use of the service will always

increase customer sensitivity. Due to

competitive pressure, It is mandatory for

wireless service providers to increase

their subscriber’s average revenue

quickly by successfully launching new

services such as video telephony. At the

same time, they must also maintain the

same stable, consistent quality their

customers have come to expect.

The implementation of this technology

often involves complex interaction

between network nodes supplied by

different manufacturers, and therefore

constant automated testing should be

applied to check initial configurations,

and then provide long term monitoring

of the service.

Do you provide reliable video telephonyin 3G UMTS?

SITE provides the solution to

easily ensure the availability of

your video telephony service,

and to maintain its efficiency

and quality.

Features


Interfaces: UMTS Uu, HSDPA, HSUPA



Real End-to-End (mobile-to-mobile)

Video Telephony

Usage of SITE’s standard 3G interfaces – no

special hardware required

Usage of standardized or customer

specific video/audio sequences

Usage of a market leading protocol stack


> Video Telephony

SIT

E T

EST

SYSTE

M

41

Specific test case results: Detailed Error Codes from the VT stacks

VT setup time

Measurements for data quality (delays, drops)

Trace information for advanced analysis

Video telephony with SITEVideo Telephony is a key service for 3G. Mobile

VT is based on 3G-324M/H.324M protocol

stack which is the “mobile” extension of the

H.324 stack. Currently the only reliable way for

VT calls is to use a 64 kbps circuit-switched

connection to avoid delays as much as

possible. So VT is a real high performance

service for mobile networks and it is currently

only possible via 3G networks.

Phot

o ©

T-M

obile

AG

PLMN

> Video Telephony

3G UMTS Probe 3G UMTS Probe

Available Video telephony KPIs:

Video send duration

Video call duration

Video file size

H245 setup duration A

H245 setup duration B

Audio send duration

H223 setup duration A

H223 setup duration B

CS Bearer establish duration

Call Control H.324Mstack

Call ControlH.324Mstack

Test case Test case

SITE Test System

Video-codingH.263

MPEG-4

Voice CodingAMR

Control ProtocolH.245

MultimediaMultiplexing

H.223

SIT

E T

EST

SYSTE

M

42

UMTS opens a new world of possibilities

with multimedia applications. Customized

infotainment like streaming video, video

messaging, mobile TV and video

telephony offer a unique opportunity to

create a market for highly personalized

and truly inimitable mobility services.

For mobile customers the quality of

services is decisive for acceptance;

especially for motion picture based

services, quality is the key factor to

success.

SITE delivers perceptual quality measure-

ments to reproduce the subscriber’s

quality impression mapped to the mean

opinion score (MOS), similar to other

quality tests.

Be sure that your network’s new multi-

media applications are more then just

moving colour pixels.

Is your network Video Quality excellent?

Features


Interfaces: UMTS Uu, HSDPA, HSUPA



Customer specific video reference files

are easy to integrate

Real End-to-End Testing of real-time video

services (video telephony, video streaming,

video messaging)

Objective MOS Video Quality result values

from 1-5 (bad, poor, fair, good, excellent)

Many further measurements

PEVQ analysis is based on human model of

visual perception


> Video Quality

SIT

E T

EST

SYSTE

M

43

QoS testing solution for Video Quality:

Send a video file from A-Side to B-Side. Perform

Video Quality check by playing a video reference

file from A-Side to B-Side and check the received

video signals against the reference video signals

using the standardized PEVQ algorithm.

One crucial result KPI is the objective ‘mean

opinion score’ (MOS). The scale values can be

interpreted from bad to excellent.

Phot

o ©

T-M

obile

AG

> Video Quality

=

Available KPIs e.g.:

MOS value

delays

brightness

contrast

distortion indicators

…

play Video File record

A-Side

Reference Video File

B-Side

Reference Video File

PEVQAlgorithm

Recorded Video File

Impairment GradeExcellent 5Good 4Fair 3Poor 2Bad 1

SIT

E T

EST

SYSTE

M

44

SITE solution is a powerful tool to

guarantee Service Assurance and generate

leading KPIs for operator networks. Quality

of subscriber’s experience is not only

driven by static service usage but also

by service deployment on the move.

Mobility truly represents subscribers’

experience in the network.

To cover the mobility aspect SITE offers

the capability to calculate KPIs for moving

subscribers performing end-to-end services

in addition to static subscriber probes.

These mobility tests are geared for

vehicles like taxis, trucks or trains.

Consequently they are called SITE ‘Drive

Service Tests’. Equivalent to the static

Local Units SITE collects a variety of

network measurements from moving

subscriber probes, so-called Mobile Local

Units (MLU). The information is processed

to KPIs and displayed on a brightly

coloured geographic map.

Drive Service TestingWhat’s your customers’ experience on the move?

Enhanced Service Assurance:

Independent view of end-to-end

quality for static & moving customers

Customer Experience:

Reproduce customer’s experience

on the move

Geographic View:

of your network quality – KPIs

displayed on map

Features

Autonomous System

No engineer needs to be present in the vehicle

Easy Installation and Removal

Once the MLU has been installed, no

further human interaction required

Network Optimization

Troubleshooting & optimization for new

technology networks

Benchmarking

Comparison with quality of competitors’ networks

Interfaces

All SITE air interface probes supported

Investment Protection

Compatible extension to existing SITE solution

securing current investment into Keynote

SIGOS products

SITE Test Concepts

> Drive Service Testing

SIT

E T

EST

SYSTE

M

45

Functionality of Drive Service Testing

The Mobile Local Unit (MLU) is connected to

the electronic board system of a vehicle. In case

of cars the MLU is automatically started once

the engine is started.

Fully automated test cases, even beyond the

automation grade of previous SITE System

ensure that absolutely no human interaction is

required after first installation in a vehicle and

test case set up of an MLU.

> Drive Service Testing

As no permanent IP connection between MLU

and Central Unit can be guaranteed all the time,

since there will be gaps in coverage, the

communication is realized via an e-mail server.

The MLU sends its results and receives additional

administrative commands via e-mails.

SIT

E T

EST

SYSTE

M

Clients

GPS Position

Customer’sMap Server

Central Unit

SIM Multiplexer

Static LU

Mobile LUin train

Permanent IP Connection

Non-Permanent IP Connection

Mobile LUin car

LAN/WAN

Geographic View (GIS)

46

The opportunity for mobile operators to

sell exciting new mobile content and

handsets is enormous, but the variety of

available services like MMS, Video

Streaming and Web Browsing may cause

problems when using different handsets.

How can these new devices and services

be properly tested in a cost-effective way

that ultimately leads to increased

revenue and customer satisfaction?

We can help you with a powerful

tool to test all your services, simulating

the large variety of handsets in your

network. – No labour intensive and high

cost manual testing!

Do handsets work perfectlyin your mobile network?

Features

Simulation of real subscriber behaviourCentral SIM Multiplexer: infinite numberof SIM cards can be managedInterfaces: GSM/GPRS Um, GSM Gb, UMTS Uu,HSDPA, HSUPA, EDGE, Iu PSReal End-to-End content test of available handsets on the marketValidation of received contents withmobile profiles

Database with a large collection of mobiledevices and their relevant parametersNew customer or country specific handsetscan easily be integratedSupport of many services: e.g. WAP1.x /WML,WAP2.0/XHTML, MMS, Video Streaming(e.g. Mobile TV)

SITE Test Concepts

> Handset Simulation

SIT

E T

EST

SYSTE

M

47

Handsets need to be testedSITE tests specific handset characteristics against

network services and device specific monitoring

of pages with fixed content/ URLs. The following

important content questions are validated:

Color Support

Check if device is capable of displaying colored images

Image Size

Comparison of all downloaded images with maximum height and width of the device

Content Support

Check (based on HTTP/WTP accept header) if device can decode downloaded content

Data Format

Check if the downloaded content is valid

Phot

o ©

T-M

obile

AG

SITE Test Case RecorderThis recorder is an easy tool for intuitive creation

of test cases e.g. WAP, Web Browsing or whatever

you need. It is particularly for use in handset

simulation tests. Each click on a hyperlink

creates a URL download test step and a trace

of all browser actions, like HTTP-GET-Requests,

which are shown live whilst the developer is

browsing. (See also chapter “Overview”)

> Handset Simulation

SITE Test System

LAN/WAN

via UMTS UuGSM/GPRS Um

GSM Gb, HSDPA,HSUPA, EDGE

ContentServer

WAPProxy/Gateway

MMSCSIM Multiplexer

Central Unit

Local Unit

Your benefits

Intuitive Recording of browsing actions

=> No drag ‘n’ drop anymore

Support of HTML forms

Easy creation & adaptation of browsing sessions

SITE integrated

Received page content at a glance

KPIs for each browsing action

User defined measurements / KPIs can be

added with SITE Test Case Editor

Whole session can be ‘Replayed’ during

development to evaluate the test case

SIT

E T

EST

SYSTE

M

The trace of the recorded sessionis shown live during development

SIM Box Detection –Make sure your roaming revenues are not being detoured

The fraudulent usage of SIM boxes

remains a big issue to various

network operators around the world.

The revenue leakage caused often

stays unnoticed, hence no or only

little action is taken.

SIM boxes have multiple negative effects

on operators, roaming hub providers and

customers alike, e.g.:

revenue loss due to call redirection

roaming calls are intercepted, redirected

and terminated whilst being re-conducted

via the fraudulent SIM box, creating a

cost / revenue shifting along the way

revenue loss due to service inaccessibility

SIM boxes have the negative effect that

multiple popular services, e.g. voice

mailbox, may not be available. Revenue

loss and unhappy customers is the

consequence

revenue loss through missing callbacks

due to the redirection of calls none or

wrong CLIs will be displayed at the

recipient’s side; immediate impact is the

inability to “call back” resulting in a

significant loss of roaming revenue

image loss through bad QoS

SIM boxes redirect calls over inadequate,

highly compressed IP connections,

resulting in poor voice quality. Call setup

time is extended which also leads to the

impression of an overall bad roaming

QoS of the home network operator.

SITE Test Concepts

> SIM Box Detection

SIT

E T

EST

SYSTE

M

Features

Reliable detection of SIM boxes

Preserve the revenues you are entitled to

Cost-effective concept for SIM box detection

Ensure first-class end user experience through

quick elimination of SIM boxes

Hight test density possible while avoiding

network congestions

www.keynote-sigos.com

Pho

to ©

T-M

obile

AG

49

SIM Box Detection is a fully implemented

feature. The concept follows a very cost-

effective strategy: at the first step, SIM Box

Detection tests generate results without the

necessity to establish a speech channel. This

allows a high test density without possible

network congestion. These results lay the

foundation for step two: narrowing down the

probability of SIM boxes being in operation

on certain routes by identifying suspicious

MSISDNs. Once SIM boxes have been

identified, the operator can then block these

suspicious SIMs. Trace files and additional

tools provide the option to identify the actual

SIM box location, allowing operators to fight

back on revenue.

SIM Box Detection in two steps

Situation:The A-Party at the visited country (VPMN)

calls the B-party at the home country (HPMN)

> SIM Box Detection

notOK

SIM box

Network

Network

ASubscriber

BSubscriber

ASubscriber

BSubscriber

Visited Country (VPMN)OK

Network Network

Home Country (HPMN)

Detour

Visited Country (VPMN) Home Country (HPMN)

Detour situation:The international call is intercepted and terminated by a SIM box located in your home country (HPMN). The

call is transferred to the B-party by a SIM box, e.g. transforming the original international call into a domestic

call whilst bypassing your network.

Normal situation:The call is being forwarded through an international roaming network and terminated at your home network (HPMN).

Internationalcall transfer

Internationalcall transfer

SIT

E T

EST

SYSTE

M

For all network operators Revenue

Assurance is of major importance. The

operator must provide fair and accurate

billing to the customer and also avoid

revenue leakage from services being

incorrectly rated and invoiced. In most

countries accuracy of metering and

billing is mandatory to comply with legal

regulations.

Money makes the world go round –what happens if the networks metering, rating and

billing is not correct?

50

Call Generation

CDR Comparison

Billing and Rating Verification

How to guarantee

correct billing?Today manual tests only provide

inaccurate, untrustworthy and in most

cases very expensive results. To ensure

correct billing a precise and reliable

Revenue Assurance system is essential.

With SITE scheduled, continuous testing

of all services provides maximum

assurance that all calls are being

correctly billed.

Features


Interfaces: GMS/GPRS Um, GSM Gb, UMTS Uu,

HSDPA, HSUPA, CDMA2000, ISDN S0, GSM A,

ISUP, INAP





CDR generation

CDR comparison

Billing and Rating

Invoice comparison

Resource allocation for different users or groups


Revenue stream audit

Covering billing aspects of outbound roaming

SITE Test Concepts

> Revenue Assurance

SIT

E T

EST

SYSTE

M

51

Time based Calls (e.g. speech)

A NumberB NumberCall Type

Begin of call for both filesDifference of begin of callCall duration for both filesDifference of call duration

Volume based Calls (e.g. GPRS-data)


Begin of call for both filesDifference of begin of callData Volume for both filesDifference of data volume

Event based Calls (e.g. SMS)


Time stamp from both files

SITE generates and compares output data like:

The SITE Call Detail Record (CDR) Comparison

provides a mechanism to match MSC call

records against SITE generated CDRs. Thus, the

correctness can be verified. Discrepancies

between the MSC CDR and the corresponding

SITE KPIs are calculated. And tolerances of CDR-

pair differences can be passed or failed. Thus

an independent means of minimizing Revenue

Leakage and ensuring the end customer is

subject to a fair and legally compliant charging

process. Scenarios such as basic call, SMS etc.

are used to generate CDRs from the network

elements. These standard network CDRs are

handled by the operators Mediation, Rating and

Billing Systems.

CDR Comparison

* Customization required

Operator CDRs SITE CDRs

CDR Comparison

Filter*

CDR Import* CDR Import

(unrated)(rated/unrated)

TariffModel*

RatingBilling Verification

Live Network

Unrated CDRsRated CDRs

> Revenue Assurance – CDR Comparison

Mediation Systems

Live CDRs

Comparison Results

Reference CDRs

Reports

CDRs

CDRPostprocessing

Test Call Generation

SITE Test System

Actual Customer Usage

Billing

SITE

TariffModel

SIT

E T

EST

SYSTE

M

52

With the SITE Billing and Rating concept the

actual price of a test case scenario dependent

upon the defined customer price plan can be

generated. This allows a simple comparison to

be made with the actual bill generated by the

network’s billing system.

With this concept there are test cases for the

services like basic call, SMS, MMS, WAP and

HTTP which write their own independently

measured CDRs into a data table. The billing

job then takes these CDRs during a specified

time period, and rates them according to the

pricing plan of the specific subscriber (Tariff

Model). The calculated price for each Test Case

is then written to the rated reference CDR table.

Furthermore, the reference of the invoice total

for a given period, is calculated and returned

as a result of the billing job. Then the live

invoice total is calculated and compared with

the reference invoice. Thus SITE Invoice

comparison creates measurements indicating

the correctness or discrepancies of invoices.

SITE CDR Comparison, including the price

comparison, can be used to identify the CDRs

that cause billing discrepancies.

The trace of the billing job can be viewed with

the SITE User Interface. This trace contains on

each line the rating (price) information

generated for each of the CDRs within the

billing job. Other details include the Service

Type and the event related time stamps. The

trace also contains the invoice total for the

whole billing job.

Billing and Rating Verification

A central part of SITE Billing and Rating concept

is the implementation of the price plans. A table

driven Tariff Model is built to replicate the price

plans and billing rules of the network operator.

The tables can be easily modified later, in the

case of changes to the price plan or associated

rules.

The billing job is defined and scheduled in the

same way as normal test cases. For the

parameterization of the billing job the user has

to provide a subscriber number, a tariff name

and a time period for which the bill shall be

created.

The SITE Billing and Rating concept again

enhances the Return on Investment (ROI) for

the SITE system. Now another vitally important

department, Revenue Assurance (RA), can also

become a user of the SITE system to perform

essential checks on the billing process.

The screenshot shows an example of a trace

SITE Test Concepts

> Revenue Assurance – Billing and Rating

SIT

E T

EST

SYSTE

M

Today, subscribers expect all frequently

used mobile services to work reliably

everywhere in the world. Thus, the quality

and availability of services inside and

outside the home network becomes

increasingly important in the battle for

customers.

A large list of international roaming

agreements seems to be the key to

success.

However, most operators simply suffer

from a lack of manpower to perform all

IREG specified test sets like IR 24, 26,

27, 29, 32, 35, 50 and 60 for often well

over 200 Roaming partners.

The Keynote SIGOS distributed test

system covers the complete network

and locations, even abroad with

remote test probes and virtual SIM

card transfer.

What about your inbound roaming services?

Keynote SIGOS has facilitated IREG testing to run periodically and automatically,

using all your roaming partner SIM cards. All sets of IREG tests will generate

an ITU-T standardized report for all your roaming partners.

For Outbound Roaming see chapter “Global Roamer”

Features


Interfaces: GSM/GPRS Um, GSM Gb, GSM A,

UMTS Uu, HSDPA, HSUPA, EDGE,

lu CS, lu PS, PSTN, ISDN So





Detailed IREG reports


users or groups

Tests according: IREG 24, 26, 27, 29, 32,

35, 50, 60 from GSM MoU

Available Roaming KPIs:

Roaming – IREG

Barring: barring activation durationbarring deactivation duration

Forwarding: forwarding activation durationforwarding deactivation duration

SMS MO MT: SMS send durationSMS deliver durationSMS end-to-end duration

Basic call: call setup alert durationcall establish duration

SITE Test Concepts

> Roaming – Inbound Roaming (IREG)

53

SIT

E T

EST

SYSTE

M

54

The newly defined GRQ (Global Roaming

Quality) / IR.81 standards – developed

by the GSMA in co-operation with selected

partners like Keynote SIGOS – provides

a comprehensive framework for pro-active

testing, reactive monitoring and assurance

of end-to-end roaming services quality.

Key to a global perspective on roaming

quality is consistency of measurements

and thus comparability between home

network and visited networks, regardless

of monitoring and testing methods used.

Consistency and comparability of QoS

tests for Inbound and Outbound Roaming

With SITE and GlobalRoamer,

Keynote SIGOS covers all

specified parameters / KPIs of

IREG – IR.81 for active roaming

end-to-end testing.What are the GRQ Quality of Service Parameters?

About 40 parameters / KPIs have been identified by defining

5 stages of service usage for Voice, Data and SMS:

Network access

Service accessibility

Connection establishment

Connection sustainability

Connection quality

As an additional service Keynote SIGOS

offers special managed service packages

on GlobalRoamer. With these you can

introduce the standardized GSMA SLA

monitoring approach without administra-

tive or engineering effort on your part.

SITE Test Concepts

> Global Roaming Quality (GRQ)

SIT

E T

EST

SYSTE

M

Both mobile network operatorscan monitor and test on baseof standard parameters thatfollowed a comparison of SLAsand KPIs for QoS.

Roaming SLA

BA

RoamingQoS

Standard monitoringmethods e.g. daily, monthly

Parameters

KPIa

KPIb

KPIc

1 2 3 4

Mobile Network Operator A

RoamingQoS

Standard monitoringmethods e.g. daily, monthly

Parameters 1 2 3 4

Mobile Network Operator B

ReconciliationCompare results Problem Reporting Troubleshooting Escalation

KPIa

KPIb

KPIc

55

Iu CS / Iu PS over IPfor testing circuit and packet switchedcore network components (e.g. MSC and SGSN)

MAPHLR and VLR Test Suite, specified byKeynote SIGOS

IN/CAMEL TESTSfor SSP and SCP on CAP or INAP

SS7for SCCP, TCAP and ISUP

ISUP INTERCONNECTION, CONFORMANCEITU-T Q.784 & Q.788ETSI ETS 300 356-31/32/33 Basic CallsETSI ETS 300 356-34/35/36 Suppl. Services

GSM – Gbfor testing core network components of GPRSpacket domain (e.g. SGSN)

GSM – A (BSSAP)for testing of MSCs

SITE Protocol Test

SITE Protocol Test

SITE is a flexible solution, which offers an

extensive library of available test cases, that

fit with the majority of services defined in the

mobile network standards and popular

implementations of other additional network

features. These tests enable operators to test

the End-to-End functionality of their network.

However, it may be necessary for a network

operator to examine the detailed signalling

protocols that support their services, or

implement a non-standard interconnection

between internal network nodes or external

network operators.

Core Network TestingKeynote SIGOS offers core network protocol

tests on various core network interfaces in GSM,

GPRS, UMTS and IN environments which are

available with the SITE test system.

Protocol tests are needed to analyse the

network’s behaviour in detail and to reach a

high degree of interoperability between networks

and network components. Keynote SIGOS

engineers have developed test applications on

SITE and have supported various network

operators and vendors with its integration tests.

Layer 3 TraceKeynote SIGOS offers 3G Layer 3 tracing which

is very important for core network testing. The

primary goal is to get a deeper insight into the

message flow and the protocol data exchanged

between mobile station and network. On most

Qualcomm-based 3G probes traces of the Layer

3 (NAS) signalling messages exchanged are

recorded.

Keynote SIGOS supplements the 3G Layer 3

NAS tracing with selectively recorded information

from Radio Resource Control (RRC) signalling

messages, employing appropriate protocol

filtering techniques.

SIT

E T

EST

SYSTE

M

Improve your IN / CAMEL test strategy!

Keynote SIGOS offers you a fully

automated IN / CAMEL test system for

preparing your own network

for Camel roaming requirements

End-to-End testing with real

roaming partners

preparing your IN platform (SSP, SCP)

CAMEL is the keyword for

intelligent service roaming

within GSM, GPRS and

UMTS networks.

For the differentiation of mobile market

competitors the IN services play a major

role. Above all, the customers demand a

roaming capability that functions exactly

as it would in the home environment.

With most networks having a majority of

Prepaid customers, and the special billing

requirements and checks that must be

made by the home network, the testing

of CAMEL is an essential requirement for

the mobile operator.

56

Your benefits

Reduction of testing effort for IN/CAMEL tests

Preparation of the own network components

for inbound and outbound roaming

(SCP and SSP with high quality)

Simulation of the complete foreign

PLMN at CAP, INAP, MAP, ISUP for inbound

and outbound roaming

Full test system control for simulation

of end-user behaviour at Um

No real roaming partner’s network required

Excluding protocol problems before

End-to-End tests

Automated re-execution for regression tests

Fully automated IR.32 tests

SITE Protocol Testing

> IN / CAMEL

SIT

E T

EST

SYSTE

M

Testing of IN/CAMEL in the UMTS-GSM-ISDN network environment

The introduction of IN or CAMEL based services

affects various interfaces of the network. In

order to reduce the implementation risks of

services, all involved components have to be

tested on the related internal interfaces of the

network. For this kind of core network protocol

tests, the simulation of several components is

necessary.

The figure below points out which interfaces

and network components should be tested for

introducing IN or CAMEL services.

According to the network architecture Keynote

SIGOS has developed test scenarios for tests

on all relevant interfaces adjacent to the

GSM/GPRS/ISDN core networks. These kind of

tests allow the vendor or network provider to

test either single network components or their

own network without any real connection to

other networks.

The SITE Test System offers simulation and tests

of IN/CAMEL on the interfaces UMTS Uu,

GSM/GPRS Um, ISDN S0, ISDN ISUP, GSM MAP

(3), GSM A, GSM Gb, CAP and INAP.

57

Test interfaces

Core network protocoltests with SITE

Um

MAP

CAP

MAP

ISUP

ISDN S0a/b

ISUP CAP INAPGSM A

MAP

MAP

GSM Gb

A orISUP Gb

CSE /SCP

INAP

MSC/SSPSGSN/SSP

MSC/SSP

CAPHLR

Fixed Network

SGSN/SSP

A orISUP

Test System SITE IN/CAMEL

Gb

> IN / CAMEL

SIT

E T

EST

SYSTE

M

58

GlobalRoamer – the easiest way to solveyour Roaming Test needs

Test the service availability and performance for

your customers when they roam to other networks

The ChallengeCustomers demand and expect a high

quality and reliable service from their

chosen network operator and a similar

seamless experience regardless of where

they are currently in the world.

By introducing new technologies and

services like Streaming, Video

Telephony, UMTS and HSDPA, networks

become more and more complex,

interference-prone and increasingly

complicated to administer.

Permanent surveillance of roaming

networks is indispensable but inevitably

extremely complicated due to the lack

of operational visibility of the roaming

partners networks.

Centralized SIM Multiplexing technologymakes your SIMs travel the world!All services can be tested (speech, data,messaging...)Web-based, secure and convenientuser interfaceDaily e-mail reportsFlexible scheduling of test campaigns(once only, periodically)

Daily /weekly/monthly reporting –graphical displayAutomated alarming based on yourthreshold settingsCDRs, KPIs and traces for billing andtroubleshooting

Features

GlobalRoamer

> Outbound Roaming

Glo

bal

Roa

mer

The SolutionGlobalRoamer allows you to verify that all

services are available to your roaming customers

worldwide. By means of the Keynote SIGOS SIM

Multiplexing technology your SIMs are capable

of being virtually transmitted to any of our

extensive global network of remote test stations

where the actual testing is performed.

Tests can be generated on an individual

immediate ad-hoc basis, or as a fully automated

group of tests via the flexible test case scheduler.

Sophisticated reporting facilities enable the

visualization of the results, which can be

generated at any required time or sent

periodically via email reporting.

59

All you have to do is:

Send your test SIM cards to Keynote SIGOS!

Access the worldwide test network via the internet!

Define and start tests and collect the results!

> Outbound Roaming

Increased roaming revenue due to betterservice availability and performanceIncreased Roaming Customer SatisfactionNo CAPEXReduce your mean-time-to-repair inidentifying/resolving problems24 hour testing possibleFull worldwide control of Roaming tests soRoaming partners’ support is not needed

Test of new roaming services beforecommercial launchComplete overview of outbound Roamingperformance at any timeReduced costs for manual testing

Benefits

Glo

bal

Roam

er

SIM Multiplexer

60

Ad-Hoc testing and pro-active monitoring

in one combined solution!

GlobalRoamer provides a very powerful test

environment for network or service engineers:

Secure web-based, ad-hoc and periodic

testing environment

Ultimate flexibility in terms of parameter

setting and SIM card selection

Extensive library of predefined test cases,

easily adaptable

Targeted troubleshooting and detailed analysis

based on call traces and CDRs

GlobalRoamer provides automated,

pro-active testing of roaming services:

Pro-active monitoring assures optimal

service for your outbound roamers

Continuous network surveillance with

graphical reports

Predefined management reports based on

the most important KPIs

Ultimate flexibility in report generation and

threshold setting

Tailored service view sorted by geography,

operator and service

Automated e-mail alarms directly to the

technical engineer

Automated e-mail reports

GlobalRoamer

> Outbound Roaming

Glo

bal

Roam

er

SMS, MMS, WAP, GPRS, UMTS, HSPA, Voice & Video Quality, CLI

delivery, CF to mailbox, Prepaid CAMEL, USSD call back, PLMN selection

The GlobalRoamer deployment is ongoing with new locations added continuously.

Please contact us for the current installation base!

Worldwide testingToday you can already test over 250 mobile networks worldwide in more than 90 countries.

Currently covered are the following countries:

AfghanistanAlgeriaAngolaArgentinaAustraliaAustriaBahamasBahrainBangladeshBarbadosBelarusBelgiumBermudaBosnia andHerzegovinaBrazilBruneiBulgariaCambodiaCanada

Cape VerdeChileChinaColombiaCook IslandsCosta RicaCroatiaCyprusCzech RepublicDenmarkDom. RepublicEgyptEstoniaFiji IslandsFinlandFranceGermanyGreeceHong KongHungary

IcelandIndia IndonesiaIrelandIsraelItalyJamaicaJapanJordanKoreaLa ReunionLebanonLichtensteinLithuaniaLuxembourgMacedoniaMadagascarMalaysiaMauritaniaMexico

MoroccoNetherlandsNew ZealandNigeriaNorwayPakistanPanamaPeruPhilippinesPolandPortugalRomaniaRussiaSaudi ArabiaSerbiaSingaporeSlovakiaSloveniaSouth AfricaSpain

Sri LankaSwedenSwitzerlandTaiwanTajikistanThailandTunisiaTurkeyTurkmenistanTurks andCaicos IslandsUKUkraineUnited ArabEmiratesUSAUzbekistanVenezuelaVietnam

Who benefits from GlobalRoamer?There are several departments which will benefit from GlobalRoamer.

Keynote SIGOS helps to solve questions!

Over 250 networks can be tested today

Management:

How to increase and protect highly profitable

roaming revenue whilst improving quality for

premium customers?

Network operations:

How to keep expected roaming services

working to expectation whilst CAPEX budget

is being squeezed?

Core network and service engineering:

How to ensure new roaming services work at

launch?

Service quality:

How to measure the actual experience of

highest value roaming customers?

Customer Care:

How to troubleshoot roaming problems

in real-time?

Revenue assurance:

How to verify that the TAP files from roaming

partners are correct?

61

> Outbound Roaming

Glo

bal

Roam

er

62

Gerrit Raymakers(Vodafone NL)

“…The biggest profit we yield by using

GlobalRoamer is the improvement of our GPRS

roaming service. By testing this service on a

daily basis we were able to notice disturbances

prior to customer complaints being reported.

Before we had GlobalRoamer, these tests had

to be done manually; in other words we had

to contact other operators and ask them to

perform these tests. This proved to be very

time-consuming and the frequency of these

tests were at a much lower rate than with

GlobalRoamer.

[…] Our experience has taught us that network

changes can lead to serious roaming problems

and, of course, you want to detect these as

soon as possible in order that the customers

are less inconvenienced.

To summarize, we can say that we are

enthusiastic about GlobalRoamer. It has helped

us in several cases to detect network errors

and because we were able to identify those

errors at an early stage we were able to

decrease the resolve time.”

Ilse De Kee (Base Belgium)

“Using GlobalRoamer, we realized that the

success rate of our CAMEL calls was only

around 50%! Additional to that, we then

realized that another 50% of the successful

tests weren’t billed! Thanks to GlobalRoamer,

we could detect this and immediately take the

respective actions.”

Kjartan Briem(OG Vodafone Iceland)

“The chart demonstrates how we could

decrease the amount of Roaming errors.

This improvement was a combination of three

actions: the automatic roaming testing with

the GlobalRoamer service, a new international

carrier connection and the ASR measurements

on international links.”

What our customers say

Registered roaming problems

Num

ber of

pro

blem

sJu

l

Aug

Sep

Oct

Nov Dec Jan

Feb

Mar

Apr

May Jun Jul

Aug

Sep

Oct

Nov

GlobalRoamer

> Outbound Roaming

Glo

bal

Roam

er

In the liberalized and highly innovative and fast paced

telecommunications market, new products and services

are introduced at very short notice. This means that

complex processes have to be constantly adjusted,

thus generating a need for testing and quality

measurement with independent, reliable and trustworthy

solutions.

The introduction of new services, especially in respect

of being on time and budget, depends on the efficiency

of testing and the availability of appropriate service

quality management tools.

Professional ServicesWe at Keynote SIGOS are striving to support our

customers in each and every phase of their testing

requirements. Under the umbrella of “Keynote SIGOS

Professional Services” we provide a focussed collection

of support and consulting services.

project implementation

training

maintenance

system hosting

managed services

solution consulting

Professional Services –for an error-free network!

63


> Your Needs – Our Services

Pro

fess

ional

Ser

vice

s

Maintenance contracts offer support through

multiple channels: hotline support, on-site

or remote support. Of course, maintenance

of hard- and software components is

included as well.

Training on our solutions can be provided

either on site or at our headquarters in

Germany, and can be supplemented by

web-aided meetings. We offer training

tailored to users or administrators or we

develop specific training schedules

according to your requirements.

64

System Hosting refers to our world-wide

roaming test infrastructure GlobalRoamer.

Customers gain access to this extensive

and comprehensive network for roaming

testing and do not need to worry about a

thing.

During Project Implementation we assist

you in determining the best possible

solution for your requirements. With our

expertise gained over two decades in the

implementation of large-scale as well as

niche projects we will help you find the

optimal solution for efficient and successful

project realization.



Pro

fess

ional

Ser

vice

s


ProjectImplementation

(SITE)

MaintenanceContract(SITE)

Hosted System(GlobalRoamer)

TrainingManagedServices

SolutionConsulting

With different levels of Managed Services

packages we take further load off our

customers’ shoulders: let Keynote SIGOS

manage the operation and / or administra-

tion of your tests. This can be either on a

project basis on special occasions, e. g.

Olympic Games, or as part of your supply

chain on a long-term basis.

Our experts are available for Solution

Consulting at any stage of your project.

From systems integration to project

management to development of test

concepts and coaching during and after

project implementation. You can always

rely on our expertise.

65


Test Specification and DevelopmentNetwork Component Tests (Protocol Tests)

SIM Tests and Tests for SIM Toolkit Applications

Service Tests (End-to-End Service)

Mobile Phone Type Approval Tests (2G, 3G)

TTCN Specification & Validation

SW Development

Service Development

(specifications and reviews)

System and Network Integration

• UMTS – Network Integration and

Interoperability GSM-UMTS

• Interconnection (fixed, wireless)

Outsourced Test Services for:

• Acceptance Tests for Networks

• Type Approval Tests for Mobiles

(GSM, GPRS, UMTS)

• Network Launch Tests

• Service Tests (GSM, GPRS, UMTS, IN, IP)

• International Roaming Tests

• Billing Tests (fixed, wireless network)

Engineering Services

Senior Consulting Services

Standardisation (ETSI, ITU-T)

Test Strategies

Process Optimisation

Network Management & Network Optimising

Project Management

Pro

fess

ional

Ser

vice

s

�6��

�6��

�6��

�,�� ,��

;%# ��

;,��

=�%��,

=��

=,%� ��

��

�7��&��6�

��

��

�(�$�

�6��

;��

� � )

�&�%�

� � �, �

��,�, �

�";

)�!%��(!%��

�6��

�6��

-��% �)

-� ��

��

��

$,��

��% �)

9��

��#��!

�6��

� �7 ��

��& )

�,��

�6��

;7��# �I �

= &� ��

=,�� - ��

��=� 77 :�%%�

�� 6��'��

��6�

#��

!��

!,� ��

9 % ��

9 ,��

+��

+��

� %��

" ,)�;� #�

"�� 8��

"�,�&;'��

& �

�6�� 6��

;��% �6��

��

�,��

�6��

��

��% �)

�� %�

! 7 �&��

8,3� #,��

9 ��)��

9 %�

+��&��% �)�

��,� %

��

�,��

"��#�

"%�: ��

"%�:��

"6 ��

9 ) � ��

�;�

�� )

< #�

�6��

;'�& ��

= ��% )��&

� #�)�

�&��

$��

��)�

��)��

9 % ��

� ��

"�� 6��

"��8 ��

� ��

�& �% �)

>��

+��<� % �)

;,�� %�

�6�� 6��

�6��

�6�� 6��

�6��

"��7��% �)

�,��

�!

��

��

��

!��"��" #$!%��&�'�� (�)��*��+,�� #��

-��.*�/�0��(�12��- 3.*�/�0��(�12�4((��'�5��

��

Keynote SIGOS Product Portfolio

Documents

Transcript of Keynote SIGOS Product Portfolio