Read without ads and support Scribd by becoming a Scribd Premium Reader.
See Premium Plans
 
1
This is the Unified Testing Criteria (UTC) against which Android applications canbe tested.It follows the same format as the UTC for Java ME applications, and has beencompiled by members of the Unified Testing Initiative (UTI).The UTC will be updated on an ongoing basis as a result of input from thecommunity and changing platform requirements. UTI welcomes input via the UTIblog at www.unifiedtestinginitiative.org/blog  Please note that whereas applications that pass the Java ME UTC can then gainthe Java Verified Signature through UTI’s Java Verified programme, there is noknown testing and validation programme for Android apps. However, if your Android apps pass the relevant tests outlined within this UTC, you can beconfident that they will have reached a high quality standard.The tests should be performed on a device to which a factory reset has beenapplied prior to the installation of the application to be tested. This will ensure thatthere is a known base with only pre-installed applications and any errors will beattributable to the application under test.It is not within the scope of these criteria to be able to test the performance of theapplication on devices with multiple applications installed.
 
Unified Testing Criteria
 
for 
Android
applicationsversion 1.0: March 2011
 
 
2
Test definitions1
 
Install and Launch....................................................................................... 4
 
1.1
 
OTA install ........................................................................................ 4
 
1.2
 
Long Launch Time ........................................................................... 5
 
2
 
Memory Use................................................................................................. 6
 
2.1
 
Memory during run .......................................................................... 6
 
3
 
Connectivity................................................................................................. 7
 
3.1
 
Invalid web access setup ................................................................ 7
 
3.2
 
Send/receive data ............................................................................. 8
 
3.3
 
Network delays and loss of connection ......................................... 9
 
3.4
 
Network connectivity – Airplane mode ......................................... 10
 
4
 
Event Handling.......................................................................................... 11
 
4.1
 
Messaging auto start ..................................................................... 11
 
4.2
 
Message queuing ........................................................................... 12
 
4.3
 
Timed event expiry ......................................................................... 13
 
4.4
 
Timed event expiry during suspend ............................................. 14
 
4.5
 
Timed event expiry during application exit .................................. 15
 
5
 
Messaging & calls...................................................................................... 16
 
5.1
 
Send ................................................................................................ 16
 
5.2
 
Receive ........................................................................................... 17
 
5.3
 
Incoming call .................................................................................. 18
 
6
 
External Influence...................................................................................... 19
 
6.1
 
Memory card insertion ................................................................... 19
 
6.2
 
Memory card insertion and removal ............................................. 20
 
6.3
 
Memory card screen behaviour..................................................... 21
 
7
 
User Interface............................................................................................. 22
 
7.1
 
Readability ...................................................................................... 22
 
7.2
 
Read time ........................................................................................ 23
 
7.3
 
Screen repainting ........................................................................... 24
 
7.4
 
Consistency .................................................................................... 25
 
7.5
 
Key layout ease of use ................................................................... 26
 
7.6
 
Application speed .......................................................................... 27
 
7.7
 
Error messages .............................................................................. 28
 
7.8
 
Function progress .......................................................................... 29
 
7.9
 
Actions while rendering ................................................................. 30
 
7.10
 
Multiple display format handling................................................... 31
 
7.11
 
Differing screen sizes .................................................................... 32
 
7.12
 
Multiple format input handling ...................................................... 33
 
7.13
 
Accelerometer/motion sensor responses .................................... 34
 
7.14
 
Spelling errors ................................................................................ 35
 
7.15
 
Technical text errors ...................................................................... 36
 
8
 
Language.................................................................................................... 37
 
8.1
 
Correct operation ........................................................................... 37
 
8.2
 
Manual selection ............................................................................ 38
 
8.3
 
Supported formats ......................................................................... 39
 
8.4
 
International characters ................................................................. 40
 
9
 
Performance............................................................................................... 41
 
9.1
 
Suspend/resume from main menu ................................................ 41
 
9.2
 
Suspend while executing............................................................... 42
 
9.3
 
Resume ........................................................................................... 43
 
9.4
 
Influence on terminal system features ......................................... 44
 
9.5
 
Resource sharing - database ........................................................ 46
 
10
 
Media.......................................................................................................... 47
 
10.1
 
Application mute option ................................................................ 47
 
 
3
10.2
 
Settings statuses understandable ................................................ 48
 
10.3
 
Settings do not impair application ................................................ 49
 
10.4
 
Settings combinations ................................................................... 50
 
10.5
 
Saving settings............................................................................... 51
 
10.6
 
Specific functions .......................................................................... 52
 
11
 
Menu........................................................................................................... 53
 
11.1
 
Help and about ............................................................................... 53
 
11.2
 
Valid actions ................................................................................... 55
 
12
 
Functionality.............................................................................................. 56
 
12.1
 
Functionality sanity check............................................................. 56
 
12.2
 
Application hidden features .......................................................... 57
 
13
 
Keys............................................................................................................ 58
 
13.1
 
Scrolling in menus ......................................................................... 58
 
13.2
 
Selection key .................................................................................. 59
 
13.3
 
Text field scrolling ......................................................................... 60
 
13.4
 
Pause .............................................................................................. 61
 
13.5
 
Simultaneous key presses ............................................................ 62
 
13.6
 
Multi key presses ........................................................................... 63
 
14
 
Device Specific Tests................................................................................ 64
 
14.1
 
Device close ................................................................................... 64
 
14.2
 
Device open .................................................................................... 65
 
15
 
Stability...................................................................................................... 66
 
15.1
 
Application stability ....................................................................... 66
 
15.2
 
Application behaviour after forced close ..................................... 67
 
16
 
Data Handling............................................................................................ 68
 
16.1
 
Save game state ............................................................................. 68
 
16.2
 
Data deletion .................................................................................. 69
 
16.3
 
Modify record ................................................................................. 70
 
17
 
Security...................................................................................................... 71
 
17.1
 
Encryption ...................................................................................... 71
 
17.2
 
Passwords ...................................................................................... 72
 
Search
Search History:
Searching...
Result 00 of 00
00 results for result for
  • p.
    • Notes
    Load more