Professional Documents
Culture Documents
SwissQual License AG
Allmendweg 8 CH-4528 Zuchwil Switzerland
t +41 32 686 65 65 f +41 32 686 65 66 e info@swissqual.com
www.swissqual.com
No part of this publication may be copied, distributed, transmitted, transcribed, stored in a retrieval system, or translated
into any human or computer language without the prior written permission of SwissQual AG.
Confidential materials.
All information in this document is regarded as commercial valuable, protected and privileged intellectual property, and is
provided under the terms of existing Non-Disclosure Agreements or as commercial-in-confidence material.
When you refer to a SwissQual technology or product, you must acknowledge the respective text or logo trademark
somewhere in your text.
SwissQual, Seven.Five, SQuad, QualiPoc, NetQual, VQuad, Diversity as well as the following logos are
registered trademarks of SwissQual AG.
Diversity Explorer, Diversity Ranger, Diversity Unattended, NiNA+, NiNA, NQAgent, NQComm, NQDI,
NQTM, NQView, NQWeb, QPControl, QPView, QualiPoc Freerider, QualiPoc iQ, QualiPoc Mobile,
QualiPoc Static, QualiWatch-M, QualiWatch-S, SystemInspector, TestManager, VMon, VQuad-HD are
trademarks of SwissQual AG.
SwissQual acknowledges the following trademarks for company names and products:
Adobe, Adobe Acrobat, and Adobe Postscript are trademarks of Adobe Systems Incorporated.
Intel, Intel Itanium, Intel Pentium, and Intel Xeon are trademarks or registered trademarks of Intel Corporation.
Microsoft, Microsoft Windows, Microsoft Windows NT, and Windows Vista are either registered trademarks or
trademarks of Microsoft Corporation in the United States and/or other countries U.S.
Contents
1 Introduction .......................................................................................................................................... 1
Overview of Speech and Video Call Tests ............................................................................................ 1
A-Side and B-Side Tests ....................................................................................................................... 2
Video Call Tests ............................................................................................................................... 2
Call Direction .................................................................................................................................... 3
Sample Direction During a Test ....................................................................................................... 4
Sequence of Call Setup and Playing Samples................................................................................. 4
Call to Any Number Test ....................................................................................................................... 5
Call to Diversity Voice Server Test ........................................................................................................ 5
A Abbreviations ..................................................................................................................................... 18
Figures
Figure 1-1 Overview of a speech call test ......................................................................................................... 3
Figure 1-2 Call direction for a 2:1 MOC/MTC ratio ............................................................................................ 4
Figure 1-3 Sample direction during a measurement ......................................................................................... 4
Figure 1-4 Sequence of tones and samples ...................................................................................................... 5
Figure 2-1 Creating a new A-Side or B-Side test .............................................................................................. 7
Figure 2-2 Main Job edit view for an A-Side or B-Side test............................................................................... 7
Figure 2-3 General settings for an A-Side or B-Side test .................................................................................. 8
Figure 2-4 Total test duration for A-Side or B-Side test .................................................................................... 9
Figure 2-5 Reference sample settings ............................................................................................................. 10
Figure 2-6 Timing options for an A-Side or B-Side test ................................................................................... 10
Figure 2-7 Log view for a Speech or Video Call test ....................................................................................... 13
Figure 3-1 Creating a new Call to any number test ......................................................................................... 15
Figure 3-2 Main settings for a Call to any number test .................................................................................... 15
Figure 3-3 General settings for a Call to any number test............................................................................... 16
Figure 3-4 Main settings for Call to any number test ....................................................................................... 16
Tables
Contents | ii
CONFIDENTIAL MATERIALS
QualiPoc 10.6 Speech and Video Test Description
2000 - 2011 SwissQual AG
Table 2-1 Description of the settings on the main Job edit view for an A-Side or B-side test ........................... 7
Table 2-2 Description of general settings for an A-Side and B-Side test .......................................................... 8
Table 2-3 Description of the reference sample settings .................................................................................. 10
Table 2-4 Description of the timing options for an A-Side or B-Side test ........................................................ 10
Table 2-5 Description of events in the Log view for a Speech or Video Call test............................................ 13
Table 3-1 Description of the settings in the main Job Edit view for a Call to any number job ....................... 15
Table 3-2 Description of the General settings for a Call to any number test ................................................... 16
Table A-1 Description of abbreviations ............................................................................................................ 18
Contents | iii
CONFIDENTIAL MATERIALS
QualiPoc 10.6 Speech and Video Test Description
2000 - 2011 SwissQual AG
1 Introduction
The QualiPoc 10.6 Speech and Video Test Description provides an overview of the following types of
QualiPoc Speech and Video Call/Streaming tests:
Speech: A-Side and B-Side LQ assessment tests
Call to any number (access test)
Video call test (access test)
Video call to any number (access test)
Note: For a description of the abbreviations in this document, see the "Abbreviations" section on page
18.
Intrusive, that is, double-ended tests, require a dedicated channel in the test system. The test transmits a
predefined reference signal through this channel. The test assesses the quality of the calls by comparing the
originating call signal (A-Side) to the received call signal (B-Side).
Non-intrusive tests, that is, single-ended tests do not require a dedicated channel in the test system. These
tests assess an unknown sample and do not occupy network resources to the same extent that intrusive
tests do.
Note: To calculate the MOS speech quality, QualiPoc sends a predefined reference audio sample over
the network.
Speech Call Test: Assesses the functionality and quality of voice calls on a network. You can start
the call on an A-Side or a B-Side device, which can be a mobile phone or a Diversity voice server.
You can also use a dedicated service number, that is, IVR, for either side of the test.
Call to Diversity Voice Server: Standard speech test where the Voice Call Server is controlled with
DTMF tones that are sent to an ISDN or PSTN device that is connected to the server. You need to
use this test if your Voice Call Server does not have access to an IP enabled network.
Note: Before the test starts, the A-Side device sets up a full configuration call to select the test on the B-
Side and to synchronize the measurement windows of both sides.
Call to Any Number Test: Simple variant of the standard speech test that sets up a call for a
specified amount of time. This test does not assess the speech quality of the call.
Video Call Test: Same as the standard speech test except that the call is a video call instead of a
voice call. This test cannot record the call.
Video Call to Any Number: Same as the Call to any number test except that the call is a video call
instead of a voice call.
Chapter 1 | Introduction 1
CONFIDENTIAL MATERIALS
QualiPoc 10.6 Speech and Video Test Description
2000 - 2011 SwissQual AG
Recorded sample is compared to a local reference and MOS quality value is calculated.
Calling device terminates the call
This sequence repeats for the amount of cycles, that is, window duration that you specify for the test. For
more information on test settings, see the "Configuring an A-Side or B-Side Speech or Video Call Test"
chapter on page 7.
Configuration calls are required for Mobile to Mobile and Mobile to Diversity Voice Server B-Side devices
while the following tests do not require a configuration call:
Call to any number
Call to Answering Station or Service Number (IVR)
Figure 1-1 on page 3 provides an overview of a speech call test. The general flow of a speech call is similar
on the A-Side and B-Side devices except for the call and the sample directions.
st
Each test starts with the 1 call setup delay which is followed by a consecutive series of call windows, that is,
cycles. These two parameters are the same on both sides of the test.
Note: On a trace capable phone, the call starts with trace capability setup which is followed by the actual
test phase, that is, 1st call setup delay and the call windows.
The behaviour of the test inside the call windows is determined by the job settings that you specify and the
st
network conditions. For a successful test, the call connects before the 1 call setup delay expires and
terminates before the guard time ends. The guard time ensures that the call successfully terminates at the
end of the test cycle.
If the first call setup fails and the call terminates when the timeout is reached, the test attempts to reconnect
after the amount of time that you specify. However, if this attempt exceeds the guard time, the call
disconnects.
Chapter 1 | Introduction 2
CONFIDENTIAL MATERIALS
QualiPoc 10.6 Speech and Video Test Description
2000 - 2011 SwissQual AG
Call duration
Connect
Start
dial
Max. Call
Setup Time
Call duration
Start Connect
Start dial #2 Disconnect
dial because
Guard Time
Disconnect
because
failed
Call Direction
The call direction of A-Side and B-Side tests is specified by Mobile Originated Call (MOC) and Mobile
Terminated Call (MTC) values respectively.
For example, if the MOC/MTC ratio is 2:1, the A-Side device initiates the call in the first two call windows
while the B-Side device initiates the call in the third call window. Similarly, the B-Side device terminates the
call in the first two call windows while the A-Side device terminates the call in the third call window. The test
Chapter 1 | Introduction 3
CONFIDENTIAL MATERIALS
QualiPoc 10.6 Speech and Video Test Description
2000 - 2011 SwissQual AG
repeats this call direction sequence for the duration of the measurement.
A-
Sample Interval Call
Sample Interval Sample Interval
B-
Sample Interval Call
Sample Interval Sample Interval
Chapter 1 | Introduction 4
CONFIDENTIAL MATERIALS
QualiPoc 10.6 Speech and Video Test Description
2000 - 2011 SwissQual AG
Connect
Synch
Start Speech sample
dial Speech sample
Twitcher &
Cocodjojo
Note: For standard answering machines, this delay is 7 seconds. The delay must provide the phone
enough time to play the sample and to switch between the phone application and the QPAEngine after
the connection is established.
WAV reference speech sample: Plays 2.6 seconds after the synchronization sample start. The
voice starts on the reference sample after two seconds of silence, so the actual delay is 2.8 seconds
for the standard sample. The length of the interval in which the speech sample repeated plays
depends on the length of the sample, for example, a 5 second sample corresponds to a 20 second
interval and a 6 second sample corresponds to a 25 second interval.
Note: For the Video Call to Any Number Test, QualiPoc attempts to establish a video call with the
receiving end.
Chapter 1 | Introduction 5
CONFIDENTIAL MATERIALS
QualiPoc 10.6 Speech and Video Test Description
2000 - 2011 SwissQual AG
Chapter 1 | Introduction 6
CONFIDENTIAL MATERIALS
QualiPoc 10.6 Speech and Video Test Description
2000 - 2011 SwissQual AG
Note: For a video call, select Options > Job handling > Video Call/Streaming.
Tip: If the view contains an existing job, you can select the job, select Options > Duplicate, and then
select Options > Edit.
Figure 2-2 Main Job edit view for an A-Side or B-Side test
Table 2-1 Description of the settings on the main Job edit view for an A-Side or B-side test
Setting Description
Job Name Name of the test
General settings Specifies the duration, cycle, and general timings for the test.
Tests Select an existing test or create a new test
Timings Specifies the detailed timings of the tests such as the MOC:MTC ratio or Window
duration.
b Select Job Name, enter a name for the job, and then select OK.
3. Select Options > General settings, specify the general options for the test, and then select Back.
Setting Description
Enter the maximum measurement time for the test after which the test
Duration
automatically stops. To disable this feature, enter 0.
Enter the maximum number of call windows for the test. To disable this
feature, enter 0.
Cycles
Note: If you specify a maximum number of cycles and a maximum
duration, the test stops when one of the maximum values is reached.
A-Sides IMEI (last 8 Enter the last 8 digits of the International Mobile Equipment Identity of the
digits) A-Side mobile phone.
(B-Side test only) To determine the IMEI of a Nokia phone, type *#06#
Setting Description
Select one of the following B side device types:
Answering Station: Select this type if you do not want the B-Side
device to generate measurement files
QualiPoc Unit: Mobile phone with QPAEngine software
When the B-Side test starts, QualiPoc generates a unique job
identifier so that NQDI can synchronize the measurement results
B side type
from both sides. You need to type this identifier on the A-Side
(A-Side test only) phone when the test starts.
Diversity Voice Server: B-Side device is a voice server
Voice Server Job-ID Enter a unique number to identify the test. This ID is validated when you
(For Diversity Voice Server save the job.
B-side type)
For the Qp_Default reference sample, this value must be 14500 ms. For
Record hang over [ms]
other reference samples, this value must be 18500 ms.
Enter the amount of time in seconds for the call setup procedure. QualiPoc
Average call setup [s] uses this value to calculate the remaining time for the tests within a call.
This value has a direct impact on the Total Duration of the test.
4. Select Tests, and then select Options > Add > New Test.
Note: You cannot specify the Total test duration value. This value is automatically calculated based on
the Test seq. repetition, Record hang over, and Average call setup values as well as the reference
sample that you choose. You can use this value to help you to determine the call window for the test.
Setting Description
Select the reference sample in the list that you want to use for the test.
Reference sample
This list only shows the samples that are installed on the phone.
Select the direction that you want the sample to travel during the call. The receiving
Sample Direction
side compares the sample with a corresponding copy to assess the speech quality.
Save WAV files Select the types of WAV files that you want to save on the phone.
LQ <= Enter the cutoff Listening Quality value for the LQ dependent WAV files that you
(LQ Dependent want to save.
WAV files only)
7. Select Timings, specify the timing options for the test, and then select Back.
Setting Description
Enter the call direction during the test in the form of a ratio. For example,
the call direction for a 1:0 ratio, that is, MOC only, is A-Side to B-Side while
a 1:1 ratio causes the call direction to reverse in each call window.
Note: If you specify a MOC only call direction, that is, a 1:0 ratio, the test
MOC:MTC - Ratio
starts with a configuration call to synchronize the measurement windows on
both devices.
For a detailed description of this ratio, see the "Call Direction" section on
page 3.
Setting Description
Enter the amount of time in seconds for the call window during which one
more call setups can occur. If a call setup fails, the test attempts the setup
repeatedly until the window duration expires. QualiPoc automatically
Window duration [s] terminates a call that exceed the window duration.
The call window must be long enough to accommodate the 1st call setup
delay, the call duration, the guard time, and an additional three seconds.
Select On to automatically disconnect the call after the call duration that you
Use call duration
specify.
Call duration [s] Enter the amount of time in seconds between the Dial and Disconnect
(Only if Use call duration is commands. This amount cannot exceed the Window duration minus the
set to On) Guard time.
Enter the amount of time in seconds to wait between the last call
Pause duration [s]
termination and the next Dial command.
Enter the amount of time in seconds for the test to wait before the first call
1st call setup delay [s]
setup. If the time expires before the call connects, the test ends.
Enter the amount of time in seconds for the buffer time at the end of the call
Guard time [s]
window during which QualiPoc disconnects the call.
Enter the amount of time in seconds during which the test does not
No call setup time [s] reattempt a call. This set point in time occurs at the end of each call
window.
Enter the amount of time in seconds for the test to wait between a failed test
Pause after failed calls [s]
and a call reattempt.
Specifies the number of consecutive failed calls after which a call reattempt
is made.
Max failed calls
Note: This setting does not apply to dropped calls.
Enter the amount of time in seconds to wait after the test reaches the Max
Pause after max. failed
failed calls limit.
Enter the maximum amount of time in seconds for the test to try to establish
Max. call setup time [s] a call. If the test does not establish a call within this time, the call fails and
the test proceeds to the next call.
Enter the amount of time in seconds to wait for a call to occur before the
No connection timeout [s]
test stops.
To copy the configuration file to the Diversity Voice Server without a connection
1. Connect your phone to your PC.
Connect the data cable to the PC and then connect the other end of the cable to the phone.
Enable Bluetooth connectivity on your phone and on your computer.
Note: SwissQual ships most mobile phones with Bluetooth enabled. If you need to enable Bluetooth,
consult the manufacturer manuals for your phone and your computer.
2. Copy the following B-Side device configuration file from your phone to your computer:
C:\data\QualiPoc\DataTest\Jobs\VoiceServer\Job_123.ini
3. Copy the Job_123.ini file to the following location on the Diversity Voice Server:
C:\Documents and settings\All users\Application data\SwissQual\Diversity\Tasks\
PreDefinedJobs
Important: The three digit number in the filename must be unique on the server. This number is
transmitted during the configuration call as in-band DTMF tones to identify the job that the Diversity
Voice Server has to start.
Note: NQDI uses this ID to match the measurement files from both sides of the test when you import the
files into the NQDI database.
Log View
Event Description
ACK! Indicates correct acknowledge in a config call.
B Side Connected Indicates, that the phone was able to establish a call to the B-Side.
Call terminated A call has been locally terminated due to the job parameters.
Cell_Id: 0x3933 Indicates a change of the serving cell with the new Cell Id in hex format.
Config Call (x) Indicates a starting config call, as side x
Connect Failed The phone was not able to establish a call to the B-Side within the specified time
frame.
CONNECT! Indicates correct connect information in a config call.
Create XXMF Tones Creating a DTMF or SQMF sequence.
> Dropped Call lost due to some local or remote fault.
hh:mm:ss Cycle #xx Indicates the beginning of the xx-th call window.
MOC (outgoing) Denote the direction of the calls inside this call window.
MTC (incoming)
Playing DTMF Tones Transmitting a DTMF tone sequence to the Diversity Voice Server to select the B-
Side test.
Rec. Complete A complete speech sampled has been recorded and is now ready to be analyzed.
Rec... Recording of a sample starts.
Playing SQMF Tones Transmitting a SQMF tone sequence to the Diversity Voice Server to select the B-
Side test. This tone is required if the voice server did not receive to the DTMF
tones as some network operators filter out the DTMF tones in a call.
SQuad failed: -20 A signal was not found during the recording and MOS analysis failed.
(A-Side and B-Side
speech tests only)
SQuad failed: -30 Signal recording is incomplete so the MOS analysis failed due to lost
(A-Side and B-Side synchronization.
speech tests only)
SQUAD LQ: x.xx Analysis of the speech sample was successful. The value displayed is the MOS
(A-Side and B-Side value.
speech tests only)
Event Description
SQUAD Analysis of the speech sample has started.
(A-Side and B-Side
speech tests only)
Synch: xxMF-xx; A multi-frequency code that is used for recording synchronization has been
(A-Side and B-Side detected. Xx indicates the type and digits that were found.
speech tests only)
VMON failed: -20 A signal was not found during the recording and MOS analysis failed.
(Video Call on Nokia
N80 only)
VMON failed: -30 Signal recording is incomplete so the MOS analysis failed due to lost
(Video Call on Nokia synchronization.
N80 only)
VMON LQ: x.xx Analysis of the speech sample was successful. The value displayed is the MOS
(Video Call on Nokia value.
N80 only)
VMON Analysis of the speech sample has started.
(Video Call on Nokia
N80 only)
Important: If QPControl in advanced mode cannot end the current cycle and play the "stop" sample
within 50 seconds, QPControl forces a stop. The voice server restarts the task after the test duration
expires or when you start a new configuration call. Such a scenario can occur if the samples finish
playing and recording before the call duration expires.
Note: For a video call, select Options > Job handling > Video Call/Streaming.
Tip: If the view contains an existing job, you can select the job, select Options > Duplicate, and then
select Options > Edit.
Setting Description
b Select Job Name, enter a name for the job, and then select OK.
3. Select General settings, specify the timing options for the test, and then select Back.
Setting Description
Duration Enter the maximum measurement time for the test after which the test
automatically stops. To disable this feature, enter 0.
Cycles Enter the maximum number of cycles, that is, call windows, for the test. To
disable this feature, enter 0.
Pause between cycles Enter the amount of time in seconds to wait between test cycles.
Max. connect timeout Enter the amount of time in seconds
4. Select Tests, and then select Options > Add > New Test.
5. Select Options > Change.
2. Select a test category in the list, for example, Call to any number.
3. Select a test in the list and then select Start.
A Abbreviations
Table A-1 Description of abbreviations
Abbreviation Description
DTMF Dual-tone multi-frequency
GSM Global System for Mobile Communications
IP Internet Protocol
ISDN Integrated Services Digital Network
IVR Interactive Voice Response is an interactive technology that allows a computer to detect
voice and keypad inputs.
LQ Listening Quality on a five-point MOS (Mean Opinion Score) scale. The value 1 refers
to bad quality, the value 5 means excellent. By practical reasons, objective measures
for LQ are limited at 4.5, which indicate that the signal to be measured is identical to the
used reference signal.
MOC Mobile-Originated Call (synonym for the calling side), used for the MOC:MTC Ratio in
the Intrusive Job timings
MOC-only This is indicated if the MOC:MTC Ratio in the Intrusive Job timings is set to 1:0
MOS Mean Opinion Score, Value of the listening quality
MTC Mobile-Terminated Call (synonym for the call terminating side ), used for the MOC:MTC
Ratio in the Intrusive Job timings
NQTM TestManager
PSTN Public Switched Telephone Network
QPA QualiPoc Active Engine
UMTS Universal Mobile Telephone System
WAV Waveform audio format
Appendix A | Abbreviations 18
CONFIDENTIAL MATERIALS