Professional Documents
Culture Documents
DLMS
DLM
Prepared By Reviewed By
Kamal Dev K R
Revision Date
Test Results
Total Test Cases
Total Test Cases Tested
Total Test Cases Passed
Total Test Cases Passed With Comments
Total Test Cases Failed
Total Test Cases Blocked
Pass Percentage
Page 1
Revision
Page 2
Revision
DLMS Client
DLMS
Approved By Date Revision
Thu 19 Jun 14 0
Page 3
Revision
Page 4
Revision
Revision
0
Page 5
Revision
Page 6
Functionality test
Page 7
Functionality test
Page 8
Functionality test
Enable Unsloicited
Retry interval
Page 9
Functionality test
Page 10
Functionality test
Page 11
Functionality test
Page 12
Functionality test
Systitle X
Page 13
Functionality test
Page 14
Functionality test
decryptFunPtr CRYPT_CALLBACK X
hashFunPtr HASH_CALLBACK X
22 k eventCbk EVENT_CALLBACK X
23 registerPushCallback pushCbk PUSH_CALLBACK X
Page 15
Functionality test
Do Check
P1 = 5 Sec Verify that server return valid client handle.
(d)UDP
(d)UDP
P2 = 60 Sec Verify that server return valid client handle.
(d)UDP
(d)UDP
Page 16
Functionality test
Page 17
Functionality test
Page 18
Functionality test
Page 19
Functionality test
Page 20
Functionality test
P2=255.255.255.255.255.255 success
P1=1 and handled properly.
P1=1 success(action request as well as data)
P2=105 success(action request as well as data)
P3=1 success(action request as well as data)
P4 = 2 success(action request as well as data)
P5 = 32767 success(action request as well as data)
in all cases(action request as well as data)
P1=1 and handled properly.
N1 =255 Verify that function return failure.
N1 > Max Attribute of IC. Repeat for all IC Verify function return failure
P1=0 '0' in the request
P2=1 '1' in the request
N1=255 Verify function return failure
P1=0 (unconfirmed) immediately without waiting for response
P2=1 (confirmed) response from server
N1=255 Function return failure
Test cases where action response contain data
Page 21
Functionality test
Page 22
Functionality test
Page 23
Functionality test
P1=X properly
P1=X
P1=X properly.
P1=X properly.
Page 24
Functionality test
Verdict Comment
Pass Valid client handle is returned
Pass Successful communication established
Pass Timeout error occurred
Pass Valid client handle is returned
-
Pass Timeout error occurred
10% test case(above) Pass Successful communication established
FAILS clientApp.h
- clientApp.h
- clientApp.h
Fail valid client handle is not returned
Pass AARQ Failed.Returned 4354.
Pass Valid client handle is returned
Only TCP mode being checked
Only TCP mode being checked
Only TCP mode being checked
Only TCP mode being checked
Only TCP mode being checked
Only TCP mode being checked
Only TCP mode being checked
Only TCP mode being checked
Only TCP mode being checked
Only TCP mode being checked
Only TCP mode being checked
Pass Valid client handle is returned
Only TCP mode being checked
Only TCP mode being checked
Pass Valid client handle is returned
Only TCP mode being checked
Only TCP mode being checked
Pass Init Client failed.
Pass Valid client handle is returned
SUCCESS Checked for pre-established, IC 7 attr 1 GET - TCP
SUCCESS (NO_SPACE_COSEM)
Pass Valid client handle is returned
PASS in TCP
>P1 Invalid. <P1 success
Pass Valid client handle is returned
Invalid
Invalid
Pass Init Client failed.
Pass Client handle is unique
Already done
Already done
Page 25
Functionality test
PASS
Page 26
Functionality test
SUCCESS
3.2.1 setparams aarq, send aarq Event/push received successfully from the server.
3.2.2 a push comes Event/push received successfully from the server.
3.2.3 call close port
PASS
PASS Setting parameters for AARQ failed. Returned 4353
PASS AARQ failed. Returned 2
PASS - Ranjitha
PASS
PASS (With Logical name with ciphering)
supported.
supported.
supported.
PASS
supported.
supported.
supported.
PASS
PASS
PASS
PASS
PASS logical name with ciphering
PASS Security policy 3- GET success
PASS
PASS
PASS 24,1 followed by 16,1
PASS Security policy 3- GET success
-
PASS
PASS
PASS
PASS
-
PASS
PASS
-
PASS
PASS
-
PASS
PASS
-
PASS
(NA)
(NA)
PASS AARQ failed. Returned 1
PASS
(NA)
(NA)
PASS AARQ failed. Returned 1
Page 27
Functionality test
PASS
PASS
PASS No error message
PASS
(NA)
(NA)
PASS GET Failed. Returned 4621
PASS
22792 GET IC7, attr 1 -success; SET ic 3, att 2 fails (4353)
PASS GET IC7, attr 1 -success; SET ic 3, att 2 fails (4353)
PASS GET IC7, attr 1 -success; SET ic 3, att 2 success
PASS GET IC7, attr 1 -success; SET ic 3, att 2 fails (4353)
PASS GET IC7, attr 1 -success; SET ic 3, att 2 fails (4353)
PASS GET IC7, attr 1 -success; SET ic 3, att 2 fails (4353)
Fails GET success
PASS
PASS No data
PASS Segmentation fault
PASS
supported.
PASS
supported.
PASS Invalid choice for Application Context
PASS
PASS
supported.
PASS
PASS GET failed, returned 4.
PASS
PASS Returns 4455 (LIB_CLIENT_IC_ERR)
PASS GET failed, returned 4.
PASS For IC 7 attr 2, tested IC versions 0,1
PASS
PASS GET failed. Returned 2
PASS GET failed. Returned 3
PASS by entry- tested.
-
-
-
-
-
-
-
-
-
-
Page 28
Functionality test
-
-
-
-
-
-
-
-
-
PASS
PASS
Fails GET success
-
-
PASS
PASS Segmentation fault
PASS Segmentation fault
PASS
supported
PASS
supported
PASS Invalid choice for Application Context
PASS
PASS
PASS Returned 4354
PASS
PASS Action failed. Returned 4353
PASS Segmentation fault
PASS
supported
FAILS
supported
PASS
PASS
PASS Returned 4353
PASS
PASS
Page 29
Functionality test
PASS
supported
PASS
PASS IC 105 observed in packet sent
PASS
INVALID Returned 4455 (LIB_CLIENT_IC_ERR)
PASS IC 32767 observed in packet sent
PASS tested with IC 3
PASS
FAILS Action success
FAILS Action success for method 27, ic 7.
PASS
PASS
FAILS Action success
PASS
FAILS Returns 3 or 9
FAILS Action success
-
PASS
FAILS Function returns success.
FAILS Function returns success.
PASS
PASS
PASS
PASS
PASS
PASS
PASS
PASS
PASS
PASS
PASS
PASS
INVALID
PASS
Page 30
Functionality test
PASS
PASS Association failed .Returned 4353.
FAILS Client Crashes
PASS
PASS
PASS
FAILS Client Crashes
PASS
PASS
PASS
PASS
PASS Bug 22882
PASS
(NA)
(NA)
PASS
(NA)
(NA)
(NA)
(NA)
(NA)
(NA)
(NA)
(NA)
(NA)
(NA)
(NA)
(NA)
(NA)
(NA)
(NA)
(NA)
(NA)
(NA)
(NA)
(NA)
(NA)
(NA)
(NA)
(NA)
(NA)
(NA)
(NA)
(NA)
(NA)
(NA)
(NA)
(NA)
(NA)
(NA)
(NA)
(NA)
(NA)
(NA)
Page 31
Functionality test
(NA)
(NA)
(NA)
(NA)
(NA)
(NA)
(NA)
(NA)
(NA)
(NA)
(NA)
(NA)
(NA)
(NA)
(NA)
(NA)
(NA)
(NA)
(NA)
(NA)
(NA)
(NA)
(NA)
(NA)
(NA)
PASS
(NA)
(NA)
(NA)
(NA)
(NA)
(NA)
(NA)
(NA)
(NA)
(NA)
(NA)
PASS
PASS
PASS
(NA)
(NA)
(NA)
(NA)
(NA)
(NA)
(NA)
PASS
PASS
FAILS Client Crashes
Already done
PASS
PASS
PASS
(NA)
(NA)
(NA)
(NA)
(NA)
Page 32
Functionality test
(NA)
(NA)
PASS
PASS
PASS
PASS GET fails. Returned 4622
PASS Segmentation fault Added comment in 22816 BUG
PASS Segmentation fault Added comment in 22816 BUG
PASS Segmentation fault Added comment in 22816 BUG
PASS ACTION failed, returned 12.
Fail Bug 22860
Fail Bug 22860
PASS Error 4362 means No space Cosem
Fail Bug 22863
Fail Bug 22869
PASS
-
-
FAILS 20 attr 5 pass.
FAILS attr 2 >127.
PASS >65535)
FAILS GET fails for IC 1 attr 2, >127. SET Pass.
PASS
PASS
Already done
Page 33
Functionality test
Status
Page 34
Functionality test
No bug reported
Page 35
Functionality test
= 13 Verified. Fixed
= 13
= 2048
= 2048
Entered = 65535
BUG 22802 HOLD
Page 36
Functionality test
Page 37
Functionality test
:Verified fixed
Page 38
Functionality test
Verified. Fixed
Verified. Fixed
Page 39
Data specific testing
Page 40
Data specific testing
Result Comments
Make sure client returns correct data to user Pass Correct data is returned by client.
Make sure client returns correct data to user Pass Correct data is returned by client.
Make sure client returns correct data to user Pass Correct data is returned by client.
Make sure client returns correct data to user Pass Correct data is returned by client.
Make sure client returns correct data to user Pass Correct data is returned by client.
Make sure client returns correct data to user Pass Correct data is returned by client.
Make sure client returns correct data to user Fail
does not attempt to free NULL data not tested
Make sure cleanup free all allocated pointers not tested
negative test not tested
negative test not tested
negative test not tested
Make sure client returns correct data to user Pass Correct data is returned by client.
Make sure set request does not encode parameter Pass Correct data is returned by client.
parameter Pass Correct data is returned by client.
and return correct data to user including parameter Pass Correct data is returned by client.
Ensure Get and Set is Success Pass Get and Set is success.
Ensure Get and Set is Success Pass Get and Set is success.
Ensure Get and Set is Success Not supported
Ensure Get is success Not supported
Ensure Get is success Fails Get fails returned 4364
Fails Set failed. Action success
Make sure get is success and proper Pass Get success
Make sure set is success and proper Pass Set success
Make sure get is success low priority
Make sure set is success low priority
Make sure get is success Pass Get success
Make sure set is success Not supported
Make sure get is success Pass Get success
Make sure set is success Pass Set success
Make sure get is success Pass Get success.
Make sure set is success Pass Set success.
Page 41
Data specific testing
Page 42
System testing
Windows XP 32 bit
Windows XP 64 bit
Windows 7 32 bit
Windows 7 64 bit
Windows 8 32 bit
Windows 8 64 bit
Linux 32 bit
Linux 64 bit
Virtual OS – Windows 7 32 bit
Virtual OS – Windows 7 64 bit
Virtual OS – Linux 32 bit
Virtual OS – Linux 64 bit
Page 43
Unsolicited
setParamsUnsolicitedCommunication
Page 44
Unsolicited
Page 45
Unsolicited
Page 46
Unsolicited
Verdict Comment
PASS
PASS
PASS 4602
FAILS BUG 22807 VERIFIED FIXED
PASS services choice
PASS Returned 4602
PASS Set failed: 4602
PASS
PASS connect….
PASS
PASS
FAILS PUSH fails.
Invalid
Invalid
FAILS successful 0x0F)
FAILS validated. BUG 22909 NEW
FAILS
INVALID
INVALID
INVALID
PASS 4602
PASS 4603
PASS Returned 4602
FAILS
PASS
PASS
PASS
PASS
PASS
PASS
Fails:Function
returns success
PASS
PASS
Page 47
Unsolicited
PASS
FAILS
PASS
PASS
PASS
returns success
PASS
PASS
PASS
returns success
PASS
PASS
PASS
PASS
Page 48
New Modifications
Sl. No. Module
Pre-established Description
1 association
2
3
4
5
6
7
8
9
10
11 Arguments
12 passing to
13 setParamsAARQ(
14 ) (Lowest Level)
15 }
16
17 Add new Datatype
18 ProfileBuffer Write
19
20
21
Profile-Selective
22 reset Methods
23
24 Compact Array
25
26
27New ICs to be supportedActive UNI / TS
28 Tariff Plan IC
29 8192
RF - Sub Address
30 (RF Module
31 Secondary
32 Address)
33
34
35 PPP Setup
36
37
38
39 Ipv4 Setup
40
41
42 IC 29 v2
43 autoconnect
44
45
46
47
48
IPv6 Setup
Page 49
New Modifications
49 IPv6 Setup
Network Status
50 PP3 (PP3
51 Network Status)
52 IC 65 – Parameter
53 Monitor
54
55 class_id: 62
56 Compact frame
57 assignment
58
59 IC-18 Image
60 transfer
61
62
63 IC15 Version 2
Set
64 with list /Multiple reference
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
Page 50
New Modifications
90
91
92
93
94 Push
95
96
97
98
99
100
101
102
103 GMAC Security Tag
104 Auth Tag of 8 bytes
105 Command buffer
106 Auto reconnect.
107 max_no_of_conn_re
108
109 retry_delay
110 Ciphering
111
112
113
Page 51
New Modifications
114 Push Data Queue.
115
116
117
118
119
120
121
122
123 compact Frame
124
125
126
Page 52
New Modifications
Test case
Do a pre established association. Issue a GET request from the client. Verify that GET is success
is success
Do a pre established association. Issue a SET request from the client. Verify that SET is success
SET is success
Do a pre established association. Issue a SET request from the client. Verify that SET is success
ACTION is success
unsolicited is enabled
unsolicited is enabled
unsolicited is enabled
unsolicited is enabled
in client. Verify that client communication continues with the pre set parameters
NOT released.
Repeat test cases 1 to 12 with Low level pre established association
Repeat test cases 1 to 12 with High level with Gmac security pre established association
server in the correct order.
server
Issue an EXECUTE request for an IC with compact date time. Verify that the request is successful.
Issue a normal SET request for IC 7 with normal array. Verify that SET is successful.
Issue a normal SET WITH BLOCK request for IC 7 with normal array. Verify that SET is successful.
Issue a SET request for IC 7 with COMPACT array. Verify that SET is successful.
Issue a SET WITH BLOCK request for IC 7 with COMPACT array. Verify that SET is successful.
selected is only affected and the rest of the buffer is not affected.
selected is only affected and the rest of the buffer is not affected.
Issue a GET request for IC 7 with COMPACT array. Verify that GET is successful.
Issue a GET WITH BLOCK request for IC 7 with COMPACT array. Verify that GET is successful.
successful.
Issue a GET request for an IC 8192 Attribute 1 . Verify that GET is successful. Repeat for other
attributes.
attribute 3,4,and 5
from
Issueserver
a GETare handled
request for properly
an IC 73Attribute 1 . Verify that GET is successful. Repeat for other
attributes.
attribute 3,4,and 5
serveraare
Issue GET handled
request properly
for an IC 44 Attribute 1 . Verify that GET is successful. Repeat for other
attributes.
attribute 3,4,and 5
serveraare
Issue GET handled
request properly
for an IC 42Attribute 1 . Verify that GET is successful. Repeat for other
attributes.
attribute 4,5,6,7,8,9 and 10
server are handled properly. Repeat the test for attribute 2 also.
handled
Issue a GETproperly. Repeat
request for anthe
ICtest for methods
29 Attribute 2 and that
1 . Verify 3. GET is successful. Repeat for other
attributes.
attribute 4,5 and 6
server are handled properly.
Issue aanGET
EXECUTE
requestrequest
for an ICfor48
anAttribute
IC 29 method 1.Verify
1 . Verify that method
that GET is executed
is successful. successfully..
Repeat for other
attributes.
attribute 4,5,6,7,8, and 9.
server are handled properly. Repeat the test for attribute 2 also.
Repeat the test for methods 2 and 3.
communication is smooth.
Page 53
New Modifications
Verify
Issue atimeout/ auto reconnect
GET request for an IC over IP V6
47 Attr1 1. communication
Verify that GET is success. Repeat for attributes
2,3,4,5,6,7, and 8.
serveraare
Issue GET handled
requestproperly.
for an IC Repeat the test
65 Attribute 1 .for attribute
Verify 2,3,4,5
that GET ,6,7 and8 also.
is successful. Repeat for other
attributes.
SET request
Issue a GET request for
for an
an IC
IC 65,attribute2
62 Attribute 1. .Verify
Verifythat
thatSET
GETisissuccessful.
successful. Repeat for other
attributes.
error from server are handled properly.
successfully and the error is handled.
the test
Issue in server
a GET withfor
request logical
an ICname datatype1 is
18 Attribute octet-string
. Verify [9] and
that GET utf8-stringRepeat
is successful. [12] for other
attributes.
Issue a SET request for an IC 18,attribute 5 . Verify that SET is successful.
Repeat for methods
Issue a GET request2,for3 an
andIC4 15 Attribute 1 . Verify that GET is successful. Repeat for other
attributes.
Issue a SET request for an IC 15,attribute 10 . Verify that SET is successful.
Repeat
Issue for methods
a GET 2, 5 and
WITH LIST with 6different attributes of the same IC . Verify that the responses are
processed by client successfully.
processed by client successfully.
transfer . Verify that the responses are processed by client successfully.
compact arrays . Verify that the responses are processed by client successfully.
selective access . Verify that the responses are processed by client successfully.
responses are processed by client successfully.
responses are processed by client successfully.
successfully.
invalid attributes . Verify that the responses are processed by client successfully.
processed by client successfully.
processed by client successfully.
processed by client successfully.
BLOCK . Verify that the responses are processed by client successfully.
compact arrays . Verify that the responses are processed by client successfully.
selective access . Verify that the responses are processed by client successfully.
responses are processed by client successfully.
responses are processed by client successfully.
successfully.
invalid attributes . Verify that the responses are processed by client successfully.
with list - number of descriptors:
1. Get request with list(N-descriptors; N>1). Check for received response : get with list N-1
2. Get request with list(N-descriptors; N>1) receive response : get with list N+1
3. Get request with list(N-descriptors; N>1) receive response : get with list 0
4. Get request with list(N-descriptors; N>1) receive response : get with list 1
2. Get request with list(N-descriptors; N>1) receive response : get with list(N-descriptors) all failure
Page 54
New Modifications
3. Get request with list(N-descriptors; N>1) receive response : get with list(N-descriptors) all but
one success
4. Get request with list(N-descriptors; N>1) receive response : get with list(N-descriptors) all but
one failure
5. Get request with list(N-descriptors; N>1) receive response : get with list(N-descriptors) all
success and all NULL data
Timeouts:
1. Get with list with block : After a few successfull blocks, client gets timeout
3.Get with block : After second last block(one more block remain), client gets timeout
Get request with list(N-descriptors; N>1) receive response : get with list 1
access, SET, SET With Block, GET WITH LIST and SET WITH LIST.
access, SET, SET With Block, GET WITH LIST and SET WITH LIST.
with selective access, SET, SET With Block, GET WITH LIST and SET WITH LIST.
BLOCK, GET with selective access, SET, SET With Block, GET WITH LIST and SET WITH LIST.
BLOCK, GET with selective access, SET, SET With Block, GET WITH LIST and SET WITH LIST.
WITH LIST.
Associate with security level Authentication and encryption . Provide a user given invalid frame
counter for a GET request . Verify that server responds with NACK with the correct frame counter.
Verify that client processes the NACK and issues the same request with correct frame counter.
correct frame counter.
further requests.
further requests.
the client. Do the test cases in 'Unsolicited' sheet.
processed at the client. Do the test cases in 'Unsolicited' sheet.
processed at the client. Do the test cases in 'Unsolicited' sheet.
successfully processed at the client. Do the test cases in 'Unsolicited' sheet.
Page 55
New Modifications
SET, EXECUTE, GET WITH BLOCK, SET WITH BLOCK, SET WITH LIST , GET WITH LIST
SET, EXECUTE, GET WITH BLOCK, SET WITH BLOCK, SET WITH LIST , GET WITH LIST
LIST
LIST
decoded properly .
decoded properly .
decoded properly .
message is decoded properly .
Pass a RLRE message to the client. Verify that the client decodes the packet .
decode the frame and data is displayed
discards the frame with proper error passed to the application.
Pass a PUSH message as compact frame with correct ASN to the client. Verify that the client
decode the frame and data is displayed
discards the frame with proper error passed to the application.
Page 56
New Modifications
Comments Test Comments
SUCCESS
SUCCESS
SUCCESS
SUCCESS
SUCCESS
SUCCESS
SUCCESS
SUCCESS
SUCCESS
SUCCESS
Verified(failed) FAILED (BUG ID 22802 &22803)
SUCCESS
SUCCESS
SUCCESS
DO this test for Ic SUCCESS (Tested for IC 8,2,1,4,5)
DO this test for Ic SUCCESS (Tested for IC 8,2,1,4,5)
DO this test for Ic SUCCESS (Tested for IC 8)
SUCCESS
SUCCESS
SUCCESS
SUCCESS
SUCCESS
SUCCESS
SUCCESS
SUCCESS
SUCCESS
PASS
PASS. SET success for 2,3,4,5
PASS
PASS
PASS
PASS
PASS
PASS
PASS
PASS
PASS
PASS
PASS
PASS
PASS
PASS
PASS
PASS
PASS
PASS
PASS
Not Supported
Page 57
New Modifications
Not Supported
PASS
PASS
PASS
PASS
PASS
Page 58
New Modifications
SUCCESS
SUCCESS
Verified(failed) FAILED
Verified(failed) FAILED
Verified(failed) FAILED
SUCCESS
SUCCESS
} SUCCESS
SUCCESS
SUCCESS
SUCCESS
SUCCESS
SUCCESS
SUCCESS
SUCCESS
SUCCESS
Page 59
Please refer UNI-
TS-11-2-
Data_Model.en.v_
0_1.pdf and
provide compact
frames Compact New Modifications
Frame 17 -
Content of push SUCCESS(No validation added for APDU size )
A ,Compact SUCCESS(No validation added for APDU size )
Frame 18 - SUCCESS(No validation added for APDU size )
Content of push SUCCESS(No validation added for APDU size )
B ,Compact SUCCESS
Frame 19 - SUCCESS
Content of push
SUCCESS
C ,Compact
Frame 20 - SUCCESS
Content of push SUCCESS
D and Compact SUCCESS Tested upto CF5(No validation for Payload length )
Frame 21 - CF21 - SUCCESS(ERROR 4353)
Session Error
for push
messages SUCCESS
SUCCESS
Page 60
New Modifications
REQUEST
Page 61
New Modifications
Page 62
New Modifications
Verified (SUCCESS)
Verified (SUCCESS)
Page 63
Sl. No Function Do
1 Pre-established AA
established AA
Send RLRQ while idle
Close port while idle
Send aarq for pre-established AA
8 after timeout)
12 Performance
(1)server make socket connection
(2)server push data
(3)server disconnect
go back to (1)
15 LN ciphering
16 LN no ciphering
17 HLS - if pass3(f(CtoS) fails
18 length = 0
19 300-500 servers
Verified(Failed)
Error code 4
Error Code 1
Error Code 1
Verified (SUCCE
Returned 4621
SET failed.
N_RESULT)
GET failed,
returned
4622(UNKNOW
N_RESULT)
Returned 4354
Returned 4354
4622
4353
4353
4353
AARQ failed.
Returned 4454
(LIB_CLIENT_
ERR_AUTH)
No data
Status
SUCCESS
FAILED(Windows)
SUCCESS
SUCCESS
SUCCESS
SUCCESS
SUCCESS
SUCCESS
SUCCESS
SUCCESS
SUCCESS
SUCCESS
SUCCESS CLIENT RETURNED ERROR CODE 5
SUCCESS
CLIENT RETURNED LIB_CLIENT_ERR_AUTH
SUCCESS
SUCCESS
SUCCESS
SUCCESS
SUCCESS
SUCCESS
SUCCESS
SUCCESS
SUCCESS
SUCCESS
SUCCESS
PASS
PASS
PASS
PASS
PASS
PASS
PASS
PASS
SUCCESS
Bug
22905 :Display not
proper in Client Verified Fixed