[email protected] Huang Shifu Wen Yongxin on TTCN-3 2/a... · 2013-01-15 · HUAWEI...
Transcript of [email protected] Huang Shifu Wen Yongxin on TTCN-3 2/a... · 2013-01-15 · HUAWEI...
HU
AW
EI T
EC
HN
OL
OG
IES C
O., L
TD
.
ww
w.huaw
ei.com
Huaw
ei Confidential
Security Level:
Wen
YongxinHuang Shifu
Testing Technology Research Dept, A
&S
wenyongxin@
huawei.com
A keyw
ord-driven service testing fram
ework based
on TT
CN
-3
HU
AW
EI T
EC
HN
OL
OG
IES C
O., L
TD
.Page 2
Huaw
ei Confidential
Contents
�S
ervice testing
�T
TC
N-3 &
AW
solution
�T
ypical application
�B
enefits
�F
uture work
HU
AW
EI T
EC
HN
OL
OG
IES C
O., L
TD
.Page 3
Huaw
ei Confidential
Service testing –
characteristics
�M
any protocols are
involved
�T
esters care little about
the protocol details
HU
AW
EI T
EC
HN
OL
OG
IES C
O., L
TD
.Page 4
Huaw
ei Confidential
Service testing –
Why T
TC
N-3
�S
pecial language designed for
testing
�E
specially on protocol
conformance testing
�S
imulation of netw
ork elements
by the parallel components
HU
AW
EI T
EC
HN
OL
OG
IES C
O., L
TD
.Page 5
Huaw
ei Confidential
Service testing –
Difficulties
�R
equire more program
ming skill
�H
igh cost of script-based test case maintenances
�W
ithout a test AP
I specification, It is easy to bring
too many A
PIs, w
hich is difficult to use .
HU
AW
EI T
EC
HN
OL
OG
IES C
O., L
TD
.Page 6
Huaw
ei Confidential
Contents
�S
ervice testing �
TT
CN
-3 & A
W solution
�O
verview�
Fram
ework
�P
resentation layer�
Script generator
�E
xecution layer�
Application area
�T
ypical application�
Benefits
�F
uture work
HU
AW
EI T
EC
HN
OL
OG
IES C
O., L
TD
.Page 7
Huaw
ei Confidential
TT
CN
-3 & A
Wsolution –
Overview
�A
ction word (A
W ) is a
methodology of keyw
ord-driven
testing from H
uawei
�A
3rd generation of automatic
testing
�S
eparates test design from
test execution
�G
raphical format of test case.
�E
asy to create and maintain
TE
Executable S
ystem
Test
execution
SU
TT
E
TD
E
AW
list
TA
E
HU
AW
EI T
EC
HN
OL
OG
IES C
O., L
TD
.Page 8
Huaw
ei Confidential
TT
CN
-3 & A
Wsolution –
Fram
ework
Presentation
LayerG
T3000
G T
R
Script G
enerator
ExecutionLayer
Socket
TT
CN
TT
CN
- -3 3
Platform
Platform
Coding Infrastructure
AW
Implem
entation
SU
T
AW
test caseT
est reporting
Requirem
ent R
equirement
and test caseand test casem
anagement
managem
ent
HU
AW
EI T
EC
HN
OL
OG
IES C
O., L
TD
.Page 9
Huaw
ei Confidential
TT
CN
-3 & A
Wsolution –
Presentation Layer
�S
upports both tabular formatand graphical form
at
Different to E
TS
I standard
Ease of com
plex value assignment
�S
imilar to real test environm
ent
User friendly
�E
xtensible
Can be extended by C
++
,Delphi
HU
AW
EI T
EC
HN
OL
OG
IES C
O., L
TD
.Page 10
Huaw
ei Confidential
1. Testcase
& A
WT
est steps
paramters
of the
“number assign”
AW
AW
T
ree
HU
AW
EI T
EC
HN
OL
OG
IES C
O., L
TD
.Page 11
Huaw
ei Confidential
2.User interface
Click
Click
Role
Role
HU
AW
EI T
EC
HN
OL
OG
IES C
O., L
TD
.Page 12
Huaw
ei Confidential
TT
CN
-3 & A
Wsolution –
Script G
enerator
�C
onvert tabular test case into TT
CN
-3 script
�E
ach TT
CN
-3 AW
has only one parameter, containing a
ll the AW
parameters in a string, it also supports optional p
arameters:
paramA
{valueA} param
B{valueB
} paramC
{valueC} param
D{valueD
}…
�G
enerate PT
Cs
to simulate different netw
ork elements
surrounds
the SU
T
HU
AW
EI T
EC
HN
OL
OG
IES C
O., L
TD
.Page 13
Huaw
ei Confidential
1. Convert T
abular AW
to TT
CN
-3 function
One param
eter contains all the tabular param
eter value
HU
AW
EI T
EC
HN
OL
OG
IES C
O., L
TD
.Page 14
Huaw
ei Confidential
2. PT
Cs
simulate different netw
ork elements
two P
TC
s
HU
AW
EI T
EC
HN
OL
OG
IES C
O., L
TD
.Page 15
Huaw
ei Confidential
3. Convert tabular test case to T
TC
N-3 test case
Preshell
CaseS
tep
PostS
hell
HU
AW
EI T
EC
HN
OL
OG
IES C
O., L
TD
.Page 16
Huaw
ei Confidential
TT
CN
-3 & A
W solution –
Execution Layer
AW
AW
Implem
entation
PA
PA
SA
SA Telnet,F
TP
,DB
SIP
SIP
MS
RP
MS
RP
RT
PR
TP
… …
GT
RG
TR
�A
ction Word Im
plementation
implem
ents AW
function with
TT
CN
-3
�P
rotocol library
implem
ents protocol stacks like
SIP
stack, with T
TC
N-3
�C
omm
on library
implem
ents comm
on operations
on database, file, telnet, ftp, etc,
with T
TC
N-3 / C
++
(PA
) /TC
L
PT
Cs
PT
Cs
for handling for handling
different protocolsdifferent protocols
HU
AW
EI T
EC
HN
OL
OG
IES C
O., L
TD
.Page 17
Huaw
ei Confidential
TT
CN
-3 & A
W solution –
Application A
rea
�A
dapt to service testing
�N
ot recomm
ended for protocol testing/ AP
I testing
�G
ood to test service that is :
driven by many protocols
stable, less than 10% changing w
ould be perfect
(so that the A
W test cases can be inherited )
HU
AW
EI T
EC
HN
OL
OG
IES C
O., L
TD
.Page 18
Huaw
ei Confidential
Contents
�S
ervice Testing
�T
TC
N-3 &
AW
solution
�T
ypical application
�B
enefits
�F
uture work
HU
AW
EI T
EC
HN
OL
OG
IES C
O., L
TD
.Page 19
Huaw
ei Confidential
Typical application
–T
est scenario
�A
User dialed a virtual num
ber
�T
he AS
called the office phone
and the home telephone at the
same tim
e
�T
he home telephone is picked
up
Softsw
itch
AS
MR
S
sip
sipsip sip
sip
�H
ere , we use T
TC
N-3 &
AW
to simulate
Softsw
itchand
MR
S to test the A
S
SUT
SUT
HU
AW
EI T
EC
HN
OL
OG
IES C
O., L
TD
.Page 20
Huaw
ei Confidential
Typical application –
Test system
details
�T
TC
N-3 S
IP P
rotocol
Stack handles sip
message and S
IP
transaction, dialog,
etc.
�S
ervice AW
are
TT
CN
-3 functions
that simulate the
Softsw
itch(caller,
callee) and MR
S
actions
AS
Caller
Callee
MR
S
TT
CN
-3 SIP
Protocol S
tack
Service
AW
SIP
AP
IT
est T
est systemsystem
SUT
SUT
HU
AW
EI T
EC
HN
OL
OG
IES C
O., L
TD
.Page 21
Huaw
ei Confidential
Typical application –
Dem
o Testcase
Caller
AS
Callee
MR
Sinvite
invite
200
invite
ack
200
200
ack
ack
bye
200
Call flow
HU
AW
EI T
EC
HN
OL
OG
IES C
O., L
TD
.Page 22
Huaw
ei Confidential
Contents
�S
ervice Testing
�T
TC
N-3 &
AW
solution
�T
ypical application
�B
enefits
�F
uture work
HU
AW
EI T
EC
HN
OL
OG
IES C
O., L
TD
.Page 23
Huaw
ei Confidential
Benefits
0
50
100
150
200
250
300
2005
2006
2007
Total users
Total users
Total test cases
Total test cases
0
5000
10000
15000
20000
25000
30000
35000
40000
45000
20052006
2007
HU
AW
EI T
EC
HN
OL
OG
IES C
O., L
TD
.Page 24
Huaw
ei Confidential
Contents
�S
ervice Testing
�T
TC
N-3 &
AW
solution
�T
ypical application
�B
enefits
�F
uture work
HU
AW
EI T
EC
HN
OL
OG
IES C
O., L
TD
.Page 25
Huaw
ei Confidential
Future w
ork
�A
W design w
ith layers
High level A
W can be im
plemented by low
er level
AW
s
�O
bject oriented AW
design
With object oriented design, it is sim
ilar to real
entity
�Integrate A
W im
plemented in C
++/ TC
L/ java
Share A
W pool largely
HU
AW
EI T
EC
HN
OL
OG
IES C
O., L
TD
.Page 26
Huaw
ei Confidential
Thank you!