You are on page 1of 22

WHEN QUALITY MATTERS

QualiPoc 10.6 Speech and Video


Test Description
April 2011

SwissQual License AG
Allmendweg 8 CH-4528 Zuchwil Switzerland
t +41 32 686 65 65 f +41 32 686 65 66 e info@swissqual.com
www.swissqual.com

Part Number: 16-100-200549-1 Rev 10.6


SwissQual has made every effort to ensure that eventual instructions contained in the document are adequate and free
of errors and omissions. SwissQual will, if necessary, explain issues which may not be covered by the documents.
SwissQuals liability for any errors in the documents is limited to the correction of errors and the aforementioned advisory
services.

Copyright 2000 - 2011 SwissQual AG. All rights reserved.

No part of this publication may be copied, distributed, transmitted, transcribed, stored in a retrieval system, or translated
into any human or computer language without the prior written permission of SwissQual AG.

Confidential materials.

All information in this document is regarded as commercial valuable, protected and privileged intellectual property, and is
provided under the terms of existing Non-Disclosure Agreements or as commercial-in-confidence material.

When you refer to a SwissQual technology or product, you must acknowledge the respective text or logo trademark
somewhere in your text.

SwissQual, Seven.Five, SQuad, QualiPoc, NetQual, VQuad, Diversity as well as the following logos are
registered trademarks of SwissQual AG.

Diversity Explorer, Diversity Ranger, Diversity Unattended, NiNA+, NiNA, NQAgent, NQComm, NQDI,
NQTM, NQView, NQWeb, QPControl, QPView, QualiPoc Freerider, QualiPoc iQ, QualiPoc Mobile,
QualiPoc Static, QualiWatch-M, QualiWatch-S, SystemInspector, TestManager, VMon, VQuad-HD are
trademarks of SwissQual AG.

SwissQual acknowledges the following trademarks for company names and products:

Adobe, Adobe Acrobat, and Adobe Postscript are trademarks of Adobe Systems Incorporated.

Apple is a trademark of Apple Computer, Inc.

DIMENSION, LATITUDE, and OPTIPLEX are registered trademarks of Dell Inc.

ELEKTROBIT is a registered trademark of Elektrobit Group Plc.

Google is a registered trademark of Google Inc.

Intel, Intel Itanium, Intel Pentium, and Intel Xeon are trademarks or registered trademarks of Intel Corporation.

INTERNET EXPLORER, SMARTPHONE, TABLET are registered trademarks of Microsoft Corporation.

Java is a U.S. trademark of Sun Microsystems, Inc.

Linux is a registered trademark of Linus Torvalds.

Microsoft, Microsoft Windows, Microsoft Windows NT, and Windows Vista are either registered trademarks or
trademarks of Microsoft Corporation in the United States and/or other countries U.S.

NOKIA is a registered trademark of Nokia Corporation.

Oracle is a registered US trademark of Oracle Corporation, Redwood City, California.

SAMSUNG is a registered trademark of Samsung Corporation.

SIERRA WIRELESS is a registered trademark of Sierra Wireless, Inc.

TRIMBLE is a registered trademark of Trimble Navigation Limited.

U-BLOX is a registered trademark of u-blox Holding AG.

UNIX is a registered trademark of The Open Group.


QualiPoc 10.6 Speech and Video Test Description
2000 - 2011 SwissQual AG

Contents
1 Introduction .......................................................................................................................................... 1
Overview of Speech and Video Call Tests ............................................................................................ 1
A-Side and B-Side Tests ....................................................................................................................... 2
Video Call Tests ............................................................................................................................... 2
Call Direction .................................................................................................................................... 3
Sample Direction During a Test ....................................................................................................... 4
Sequence of Call Setup and Playing Samples................................................................................. 4
Call to Any Number Test ....................................................................................................................... 5
Call to Diversity Voice Server Test ........................................................................................................ 5

2 Configuring an A-Side or B-Side Speech or Video Call Test .......................................................... 7


Configuring a Diversity Voice Server as a B-Side Device .............................................................. 11
Starting a Double-Ended Speech or Video Call Test .......................................................................... 12
Monitoring a Speech or Video Call Test .............................................................................................. 12
Log View ......................................................................................................................................... 13

3 Configuring a Speech or Video Call to Any Number Test ............................................................. 15


Starting a Call to Any Number Test ..................................................................................................... 16
Monitoring a Call to Any Number Test................................................................................................. 17

A Abbreviations ..................................................................................................................................... 18

Figures
Figure 1-1 Overview of a speech call test ......................................................................................................... 3
Figure 1-2 Call direction for a 2:1 MOC/MTC ratio ............................................................................................ 4
Figure 1-3 Sample direction during a measurement ......................................................................................... 4
Figure 1-4 Sequence of tones and samples ...................................................................................................... 5
Figure 2-1 Creating a new A-Side or B-Side test .............................................................................................. 7
Figure 2-2 Main Job edit view for an A-Side or B-Side test............................................................................... 7
Figure 2-3 General settings for an A-Side or B-Side test .................................................................................. 8
Figure 2-4 Total test duration for A-Side or B-Side test .................................................................................... 9
Figure 2-5 Reference sample settings ............................................................................................................. 10
Figure 2-6 Timing options for an A-Side or B-Side test ................................................................................... 10
Figure 2-7 Log view for a Speech or Video Call test ....................................................................................... 13
Figure 3-1 Creating a new Call to any number test ......................................................................................... 15
Figure 3-2 Main settings for a Call to any number test .................................................................................... 15
Figure 3-3 General settings for a Call to any number test............................................................................... 16
Figure 3-4 Main settings for Call to any number test ....................................................................................... 16

Tables

Contents | ii
CONFIDENTIAL MATERIALS
QualiPoc 10.6 Speech and Video Test Description
2000 - 2011 SwissQual AG

Table 2-1 Description of the settings on the main Job edit view for an A-Side or B-side test ........................... 7
Table 2-2 Description of general settings for an A-Side and B-Side test .......................................................... 8
Table 2-3 Description of the reference sample settings .................................................................................. 10
Table 2-4 Description of the timing options for an A-Side or B-Side test ........................................................ 10
Table 2-5 Description of events in the Log view for a Speech or Video Call test............................................ 13
Table 3-1 Description of the settings in the main Job Edit view for a Call to any number job ....................... 15
Table 3-2 Description of the General settings for a Call to any number test ................................................... 16
Table A-1 Description of abbreviations ............................................................................................................ 18

Contents | iii
CONFIDENTIAL MATERIALS
QualiPoc 10.6 Speech and Video Test Description
2000 - 2011 SwissQual AG

1 Introduction
The QualiPoc 10.6 Speech and Video Test Description provides an overview of the following types of
QualiPoc Speech and Video Call/Streaming tests:
Speech: A-Side and B-Side LQ assessment tests
Call to any number (access test)
Video call test (access test)
Video call to any number (access test)

Note: For a description of the abbreviations in this document, see the "Abbreviations" section on page
18.

Intrusive, that is, double-ended tests, require a dedicated channel in the test system. The test transmits a
predefined reference signal through this channel. The test assesses the quality of the calls by comparing the
originating call signal (A-Side) to the received call signal (B-Side).
Non-intrusive tests, that is, single-ended tests do not require a dedicated channel in the test system. These
tests assess an unknown sample and do not occupy network resources to the same extent that intrusive
tests do.

Overview of Speech and Video Call Tests


You can perform the following QualiPoc Speech Call tests to assess the functionality and quality of speech
calls on a network.

Note: To calculate the MOS speech quality, QualiPoc sends a predefined reference audio sample over
the network.

Speech Call Test: Assesses the functionality and quality of voice calls on a network. You can start
the call on an A-Side or a B-Side device, which can be a mobile phone or a Diversity voice server.
You can also use a dedicated service number, that is, IVR, for either side of the test.
Call to Diversity Voice Server: Standard speech test where the Voice Call Server is controlled with
DTMF tones that are sent to an ISDN or PSTN device that is connected to the server. You need to
use this test if your Voice Call Server does not have access to an IP enabled network.

Note: Before the test starts, the A-Side device sets up a full configuration call to select the test on the B-
Side and to synchronize the measurement windows of both sides.

Call to Any Number Test: Simple variant of the standard speech test that sets up a call for a
specified amount of time. This test does not assess the speech quality of the call.
Video Call Test: Same as the standard speech test except that the call is a video call instead of a
voice call. This test cannot record the call.
Video Call to Any Number: Same as the Call to any number test except that the call is a video call
instead of a voice call.

Chapter 1 | Introduction 1
CONFIDENTIAL MATERIALS
QualiPoc 10.6 Speech and Video Test Description
2000 - 2011 SwissQual AG

A-Side and B-Side Tests


During a double-ended speech or video call test, the following sequence of events occurs:
One device initiates a configuration call to the other device
Other device sends a synchronization tone to the calling device
Calling device synchronizes to the tone and the sample sequence starts on both devices
One device starts to play a speech or video sample
Other device records the sample

Note: Video call tests cannot record the sample.

Recorded sample is compared to a local reference and MOS quality value is calculated.
Calling device terminates the call
This sequence repeats for the amount of cycles, that is, window duration that you specify for the test. For
more information on test settings, see the "Configuring an A-Side or B-Side Speech or Video Call Test"
chapter on page 7.
Configuration calls are required for Mobile to Mobile and Mobile to Diversity Voice Server B-Side devices
while the following tests do not require a configuration call:
Call to any number
Call to Answering Station or Service Number (IVR)
Figure 1-1 on page 3 provides an overview of a speech call test. The general flow of a speech call is similar
on the A-Side and B-Side devices except for the call and the sample directions.
st
Each test starts with the 1 call setup delay which is followed by a consecutive series of call windows, that is,
cycles. These two parameters are the same on both sides of the test.

Note: On a trace capable phone, the call starts with trace capability setup which is followed by the actual
test phase, that is, 1st call setup delay and the call windows.

The behaviour of the test inside the call windows is determined by the job settings that you specify and the
st
network conditions. For a successful test, the call connects before the 1 call setup delay expires and
terminates before the guard time ends. The guard time ensures that the call successfully terminates at the
end of the test cycle.
If the first call setup fails and the call terminates when the timeout is reached, the test attempts to reconnect
after the amount of time that you specify. However, if this attempt exceeds the guard time, the call
disconnects.

Video Call Tests


The test flow for Video call is exactly the same as for the speech call test. The main difference is that the call
is a video call instead of a speech call.
A Video Call Test establishes a Video Call and calculates the video quality of the presented video display.
This test can only be done on trace-capable phones. To establish a Video Call there must be a 3G Network
available.
A Video Call Test with video quality evaluation (MOS-Value) must establish the call to a Video Call Server
which transmits a predefined video sample to the A-Side. In combination with NQTM such a test can be
easily configured and run automatically.

Chapter 1 | Introduction 2
CONFIDENTIAL MATERIALS
QualiPoc 10.6 Speech and Video Test Description
2000 - 2011 SwissQual AG

Trace setup 1st Call


(10sec) , Setup Delay
only on
TRACE
mobiles
Window
duration Window Window
duration duration

Call Window Call Window Call Window

Overall Job duration

Call duration

Call Setup Call Window


Call Guard Time

Connect
Start
dial

Max. Call
Setup Time
Call duration

Call Setup Pause Call


Call Window
Setup Call Guard Time

Start Connect
Start dial #2 Disconnect
dial because
Guard Time
Disconnect
because
failed

Figure 1-1 Overview of a speech call test

Call Direction
The call direction of A-Side and B-Side tests is specified by Mobile Originated Call (MOC) and Mobile
Terminated Call (MTC) values respectively.

Parameter Ratio X Value


MOC-only MOC/MTC = X:0 (X>0)
MOC/MTC MOC/MTC = 1:X (X>0)
MTC-only MOC/MTC = 0:X (X>0)

For example, if the MOC/MTC ratio is 2:1, the A-Side device initiates the call in the first two call windows
while the B-Side device initiates the call in the third call window. Similarly, the B-Side device terminates the
call in the first two call windows while the A-Side device terminates the call in the third call window. The test

Chapter 1 | Introduction 3
CONFIDENTIAL MATERIALS
QualiPoc 10.6 Speech and Video Test Description
2000 - 2011 SwissQual AG

repeats this call direction sequence for the duration of the measurement.

Trace setup 1st Call


(10sec) , Setup Delay
only on
TRACE
mobiles

Call Window Call Window Call Window


A-

Call Window Call Window Call Window


B-

Figure 1-2 Call direction for a 2:1 MOC/MTC ratio

Sample Direction During a Test


During a double-ended test one side plays a sample and the other side listens for and measures the quality
of the sample. The sample direction can either be from A to B, where the A-Side device plays the sample
and B-Side device listens for the sample or from B to A, where B plays the sample and A listens for the
sample. The test repeats this sample direction for the duration of the measurement.

Note: Each test is equal to one speech sample.

A-
Sample Interval Call
Sample Interval Sample Interval

B-
Sample Interval Call
Sample Interval Sample Interval

Figure 1-3 Sample direction during a measurement

Sequence of Call Setup and Playing Samples


After a successful call setup, the test plays a defined sequence of sounds on the called side. The A-Side
searches for this BD-DTMF sequence, that is, synchronization tone and then starts to record and evaluate
the speech samples.

Chapter 1 | Introduction 4
CONFIDENTIAL MATERIALS
QualiPoc 10.6 Speech and Video Test Description
2000 - 2011 SwissQual AG

Connect
Synch
Start Speech sample
dial Speech sample
Twitcher &
Cocodjojo

Call Setup Call Window


Call
Sample Sample

Sample Interval Sample Interval


Connect
to
Synch Synch to
Sample
delay

Figure 1-4 Sequence of tones and samples


The called side plays the following sequence of tones and samples:
Twitcher and Cocodjojo sample: Serves as line opener for QualiPoc
Synchronization sample: Combination of four multi-frequency tones, namely a regular DTMF B-
Tone and D-Tone as well as two higher frequency tones that are outside of the DTMF-frequency
range which trigger the recording start on QualiPoc phones. This reference sample is played after
the Connect to synch delay that you specify.

Note: For standard answering machines, this delay is 7 seconds. The delay must provide the phone
enough time to play the sample and to switch between the phone application and the QPAEngine after
the connection is established.

WAV reference speech sample: Plays 2.6 seconds after the synchronization sample start. The
voice starts on the reference sample after two seconds of silence, so the actual delay is 2.8 seconds
for the standard sample. The length of the interval in which the speech sample repeated plays
depends on the length of the sample, for example, a 5 second sample corresponds to a 20 second
interval and a 6 second sample corresponds to a 25 second interval.

Call to Any Number Test


The Call to Any Number test procedure is the same as the speech tests that are described in the "A-Side
and B-Side Tests" section on page 2 except for the following differences:
Call duration is limited to 60 seconds if you use Test Manager to configure the test
Test has only one pause value, which is also used as the value for the guard time

Note: For the Video Call to Any Number Test, QualiPoc attempts to establish a video call with the
receiving end.

Call to Diversity Voice Server Test


The Call to Diversity voice server test procedure is similar to the speech tests that are described in the "A-
Side and B-Side Tests" section on page 2. The only difference is that the configuration call uses in-band
DTMF tones to select the corresponding test and in a second sequence, to synchronize the call windows for
the measurement.

Chapter 1 | Introduction 5
CONFIDENTIAL MATERIALS
QualiPoc 10.6 Speech and Video Test Description
2000 - 2011 SwissQual AG

Chapter 1 | Introduction 6
CONFIDENTIAL MATERIALS
QualiPoc 10.6 Speech and Video Test Description
2000 - 2011 SwissQual AG

2 Configuring an A-Side or B-Side Speech or Video Call Test


This chapter describes how to manually configure an A-Side or B-Side speech or video call in the
QPAEngine software on your phone. The B-Side device can be a mobile phone, a Diversity Voice Server, or
s a specially configured service number, that is, answering station.
The configuration of the A-Side and B-Side devices is identical. The only difference is the Job ID that
QualiPoc automatically assigns the B-Side test.

To manually create an A-Side or B-Side call test


1. Start QPAEngine on the phone and select Options > Job handling > Speech Call, and then select Call
MOS (A-Side) or Call MOS (B-Side).

Note: For a video call, select Options > Job handling > Video Call/Streaming.

Figure 2-1 Creating a new A-Side or B-Side test


2. Specify the basic job settings.
a Select Options > Create New.

Tip: If the view contains an existing job, you can select the job, select Options > Duplicate, and then
select Options > Edit.

Figure 2-2 Main Job edit view for an A-Side or B-Side test
Table 2-1 Description of the settings on the main Job edit view for an A-Side or B-side test

Setting Description
Job Name Name of the test
General settings Specifies the duration, cycle, and general timings for the test.
Tests Select an existing test or create a new test
Timings Specifies the detailed timings of the tests such as the MOC:MTC ratio or Window
duration.

Chapter 2 | Configuring an A-Side or B-Side Speech or Video Call Test 7


CONFIDENTIAL MATERIALS
QualiPoc 10.6 Speech and Video Test Description
2000 - 2011 SwissQual AG

b Select Job Name, enter a name for the job, and then select OK.
3. Select Options > General settings, specify the general options for the test, and then select Back.

Figure 2-3 General settings for an A-Side or B-Side test


Table 2-2 Description of general settings for an A-Side and B-Side test

Setting Description
Enter the maximum measurement time for the test after which the test
Duration
automatically stops. To disable this feature, enter 0.
Enter the maximum number of call windows for the test. To disable this
feature, enter 0.
Cycles
Note: If you specify a maximum number of cycles and a maximum
duration, the test stops when one of the maximum values is reached.

A number Enter the phone number for the A-Side device.


B number Enter the phone number for the B-Side device.
Test seq. repetition Enter the number of times to repeat the test sequence.

A-Sides IMEI (last 8 Enter the last 8 digits of the International Mobile Equipment Identity of the
digits) A-Side mobile phone.
(B-Side test only) To determine the IMEI of a Nokia phone, type *#06#

Chapter 2 | Configuring an A-Side or B-Side Speech or Video Call Test 8


CONFIDENTIAL MATERIALS
QualiPoc 10.6 Speech and Video Test Description
2000 - 2011 SwissQual AG

Setting Description
Select one of the following B side device types:
Answering Station: Select this type if you do not want the B-Side
device to generate measurement files
QualiPoc Unit: Mobile phone with QPAEngine software
When the B-Side test starts, QualiPoc generates a unique job
identifier so that NQDI can synchronize the measurement results
B side type
from both sides. You need to type this identifier on the A-Side
(A-Side test only) phone when the test starts.
Diversity Voice Server: B-Side device is a voice server

Note: For information on how to configure the Diversity Voice Server as


a B-Side device, see the "Configuring an A-Side or B-Side Speech or
Video Call Test" on page 7.

Voice Server Job-ID Enter a unique number to identify the test. This ID is validated when you
(For Diversity Voice Server save the job.
B-side type)
For the Qp_Default reference sample, this value must be 14500 ms. For
Record hang over [ms]
other reference samples, this value must be 18500 ms.
Enter the amount of time in seconds for the call setup procedure. QualiPoc
Average call setup [s] uses this value to calculate the remaining time for the tests within a call.
This value has a direct impact on the Total Duration of the test.

4. Select Tests, and then select Options > Add > New Test.

Note: You cannot specify the Total test duration value. This value is automatically calculated based on
the Test seq. repetition, Record hang over, and Average call setup values as well as the reference
sample that you choose. You can use this value to help you to determine the call window for the test.

Figure 2-4 Total test duration for A-Side or B-Side test


5. Select Options > Change.
6. Select the test, for example, Test 1:Speech, specify the reference sample settings, select Back, and
then select Back.

Chapter 2 | Configuring an A-Side or B-Side Speech or Video Call Test 9


CONFIDENTIAL MATERIALS
QualiPoc 10.6 Speech and Video Test Description
2000 - 2011 SwissQual AG

Figure 2-5 Reference sample settings


Table 2-3 Description of the reference sample settings

Setting Description
Select the reference sample in the list that you want to use for the test.
Reference sample
This list only shows the samples that are installed on the phone.
Select the direction that you want the sample to travel during the call. The receiving
Sample Direction
side compares the sample with a corresponding copy to assess the speech quality.
Save WAV files Select the types of WAV files that you want to save on the phone.
LQ <= Enter the cutoff Listening Quality value for the LQ dependent WAV files that you
(LQ Dependent want to save.
WAV files only)

7. Select Timings, specify the timing options for the test, and then select Back.

Figure 2-6 Timing options for an A-Side or B-Side test


Table 2-4 Description of the timing options for an A-Side or B-Side test

Setting Description

Enter the call direction during the test in the form of a ratio. For example,
the call direction for a 1:0 ratio, that is, MOC only, is A-Side to B-Side while
a 1:1 ratio causes the call direction to reverse in each call window.

Note: If you specify a MOC only call direction, that is, a 1:0 ratio, the test
MOC:MTC - Ratio
starts with a configuration call to synchronize the measurement windows on
both devices.

For a detailed description of this ratio, see the "Call Direction" section on
page 3.

Chapter 2 | Configuring an A-Side or B-Side Speech or Video Call Test 10


CONFIDENTIAL MATERIALS
QualiPoc 10.6 Speech and Video Test Description
2000 - 2011 SwissQual AG

Setting Description

Enter the amount of time in seconds for the call window during which one
more call setups can occur. If a call setup fails, the test attempts the setup
repeatedly until the window duration expires. QualiPoc automatically
Window duration [s] terminates a call that exceed the window duration.
The call window must be long enough to accommodate the 1st call setup
delay, the call duration, the guard time, and an additional three seconds.

Select On to automatically disconnect the call after the call duration that you
Use call duration
specify.
Call duration [s] Enter the amount of time in seconds between the Dial and Disconnect
(Only if Use call duration is commands. This amount cannot exceed the Window duration minus the
set to On) Guard time.

Enter the amount of time in seconds to wait between the last call
Pause duration [s]
termination and the next Dial command.
Enter the amount of time in seconds for the test to wait before the first call
1st call setup delay [s]
setup. If the time expires before the call connects, the test ends.
Enter the amount of time in seconds for the buffer time at the end of the call
Guard time [s]
window during which QualiPoc disconnects the call.
Enter the amount of time in seconds during which the test does not
No call setup time [s] reattempt a call. This set point in time occurs at the end of each call
window.
Enter the amount of time in seconds for the test to wait between a failed test
Pause after failed calls [s]
and a call reattempt.
Specifies the number of consecutive failed calls after which a call reattempt
is made.
Max failed calls
Note: This setting does not apply to dropped calls.

Enter the amount of time in seconds to wait after the test reaches the Max
Pause after max. failed
failed calls limit.
Enter the maximum amount of time in seconds for the test to try to establish
Max. call setup time [s] a call. If the test does not establish a call within this time, the call fails and
the test proceeds to the next call.
Enter the amount of time in seconds to wait for a call to occur before the
No connection timeout [s]
test stops.

8. Select Back, and in the save dialog box, select Yes.

Configuring a Diversity Voice Server as a B-Side Device


After you create and save a Call-MOS (A-Side) test that uses a Diversity Voice Server as a B-Side device,
you need to copy the configuration file from the phone to the server.

To copy the configuration file to the Diversity Voice Server without a connection
1. Connect your phone to your PC.
Connect the data cable to the PC and then connect the other end of the cable to the phone.
Enable Bluetooth connectivity on your phone and on your computer.

Note: SwissQual ships most mobile phones with Bluetooth enabled. If you need to enable Bluetooth,

Chapter 2 | Configuring an A-Side or B-Side Speech or Video Call Test 11


CONFIDENTIAL MATERIALS
QualiPoc 10.6 Speech and Video Test Description
2000 - 2011 SwissQual AG

consult the manufacturer manuals for your phone and your computer.

2. Copy the following B-Side device configuration file from your phone to your computer:
C:\data\QualiPoc\DataTest\Jobs\VoiceServer\Job_123.ini
3. Copy the Job_123.ini file to the following location on the Diversity Voice Server:
C:\Documents and settings\All users\Application data\SwissQual\Diversity\Tasks\
PreDefinedJobs

Important: The three digit number in the filename must be unique on the server. This number is
transmitted during the configuration call as in-band DTMF tones to identify the job that the Diversity
Voice Server has to start.

Starting a Double-Ended Speech or Video Call Test


At the start of a Data Call test, QualiPoc opens a GPRS session through the access point that you
configured for QPAEngine on the phone. For information on how to configure an access point, see Manual -
QualiPoc SW - Active Engine.pdf.
QualiPoc uses an adapted version of the Squad LQ algorithm to calculate the MOS of the speech samples
that are received. Depending on the processing power of the phone, the algorithm takes 5 to 15 seconds to
calculate the MOS. The amount of time between two speech samples is 20 to 30 seconds is determined by
the length of the reference sample.

To manually start a double-ended Speech or Video Call test in QPAEngine


1. On the B-Side device, start the B-Side test.
a In QPAEngine, select Options > Start a job > Choose from List > Speech Call.

Note: For a video call, select Video Call/Streaming.

b Select Call-MOS (B-Side) and select Start.


c Take note of the Job ID for the B-Side test in the Status view.
2. On the A-Side device, start the A-Side test.
a In QPAEngine, select Options > Start a job > Choose from List > Speech Call.
b Select Call-MOS (A-Side) and select Start.
c In the Start Job view, select Yes.
d In the TID from BSide Job box, enter the Job ID from the Status view of the B-Side test, and then
select OK.

Note: NQDI uses this ID to match the measurement files from both sides of the test when you import the
files into the NQDI database.

Monitoring a Speech or Video Call Test


This section describes the events that you can monitor during a Speech or Video Call test. The events in
Table 2-5 are for A-Side, B-Side, and Call to any number speech and video call tests as well as Diversity
Voice Server tests.

Chapter 2 | Configuring an A-Side or B-Side Speech or Video Call Test 12


CONFIDENTIAL MATERIALS
QualiPoc 10.6 Speech and Video Test Description
2000 - 2011 SwissQual AG

Log View

Figure 2-7 Log view for a Speech or Video Call test


Table 2-5 Description of events in the Log view for a Speech or Video Call test

Event Description
ACK! Indicates correct acknowledge in a config call.
B Side Connected Indicates, that the phone was able to establish a call to the B-Side.
Call terminated A call has been locally terminated due to the job parameters.
Cell_Id: 0x3933 Indicates a change of the serving cell with the new Cell Id in hex format.
Config Call (x) Indicates a starting config call, as side x
Connect Failed The phone was not able to establish a call to the B-Side within the specified time
frame.
CONNECT! Indicates correct connect information in a config call.
Create XXMF Tones Creating a DTMF or SQMF sequence.
> Dropped Call lost due to some local or remote fault.
hh:mm:ss Cycle #xx Indicates the beginning of the xx-th call window.
MOC (outgoing) Denote the direction of the calls inside this call window.
MTC (incoming)
Playing DTMF Tones Transmitting a DTMF tone sequence to the Diversity Voice Server to select the B-
Side test.
Rec. Complete A complete speech sampled has been recorded and is now ready to be analyzed.
Rec... Recording of a sample starts.
Playing SQMF Tones Transmitting a SQMF tone sequence to the Diversity Voice Server to select the B-
Side test. This tone is required if the voice server did not receive to the DTMF
tones as some network operators filter out the DTMF tones in a call.
SQuad failed: -20 A signal was not found during the recording and MOS analysis failed.
(A-Side and B-Side
speech tests only)
SQuad failed: -30 Signal recording is incomplete so the MOS analysis failed due to lost
(A-Side and B-Side synchronization.
speech tests only)
SQUAD LQ: x.xx Analysis of the speech sample was successful. The value displayed is the MOS
(A-Side and B-Side value.
speech tests only)

Chapter 2 | Configuring an A-Side or B-Side Speech or Video Call Test 13


CONFIDENTIAL MATERIALS
QualiPoc 10.6 Speech and Video Test Description
2000 - 2011 SwissQual AG

Event Description
SQUAD Analysis of the speech sample has started.
(A-Side and B-Side
speech tests only)
Synch: xxMF-xx; A multi-frequency code that is used for recording synchronization has been
(A-Side and B-Side detected. Xx indicates the type and digits that were found.
speech tests only)
VMON failed: -20 A signal was not found during the recording and MOS analysis failed.
(Video Call on Nokia
N80 only)
VMON failed: -30 Signal recording is incomplete so the MOS analysis failed due to lost
(Video Call on Nokia synchronization.
N80 only)
VMON LQ: x.xx Analysis of the speech sample was successful. The value displayed is the MOS
(Video Call on Nokia value.
N80 only)
VMON Analysis of the speech sample has started.
(Video Call on Nokia
N80 only)

Stopping a Call to a Diversity Voice Server without a Connection


If you stop a test on the phone that involves the Diversity Voice Server, QPAEngine plays a "stop" reference
sample instead of a speech sample, and then exits the test. Upon receipt of the "stop" sample, the voice
server component of the test automatically stops.

Important: If QPControl in advanced mode cannot end the current cycle and play the "stop" sample
within 50 seconds, QPControl forces a stop. The voice server restarts the task after the test duration
expires or when you start a new configuration call. Such a scenario can occur if the samples finish
playing and recording before the call duration expires.

Chapter 2 | Configuring an A-Side or B-Side Speech or Video Call Test 14


CONFIDENTIAL MATERIALS
QualiPoc 10.6 Speech and Video Test Description
2000 - 2011 SwissQual AG

3 Configuring a Speech or Video Call to Any Number Test


This section describes how to manually configure a Speech or video Call to Any Number test in the
QPAEngine software on your phone.
You only need to configure the test on the A-Side device. Although you do not need a dedicated B-Side
device, the device that receives the call must be able to answer the call and hold the connection until the A-
Side phone terminates the call. The Call to Any Number test does not perform a speech quality assessment.

To manually create a Call to Any Number test


1. Start QPAEngine on the phone and select Options > Job handling > Speech Call > Call to any
number.

Note: For a video call, select Options > Job handling > Video Call/Streaming.

Figure 3-1 Creating a new Call to any number test


2. Specify the basic job settings.
a Select Options > Create new.

Tip: If the view contains an existing job, you can select the job, select Options > Duplicate, and then
select Options > Edit.

Figure 3-2 Main settings for a Call to any number test


Table 3-1 Description of the settings in the main Job Edit view for a Call to any number job

Setting Description

Job Name Name of the test


General settings Specifies the duration, cycle, and timings for the test.
Tests Select an existing test or create a new test

b Select Job Name, enter a name for the job, and then select OK.

Chapter 3 | Configuring a Speech or Video Call to Any Number Test 15


CONFIDENTIAL MATERIALS
QualiPoc 10.6 Speech and Video Test Description
2000 - 2011 SwissQual AG

3. Select General settings, specify the timing options for the test, and then select Back.

Figure 3-3 General settings for a Call to any number test


Table 3-2 Description of the General settings for a Call to any number test

Setting Description

Duration Enter the maximum measurement time for the test after which the test
automatically stops. To disable this feature, enter 0.
Cycles Enter the maximum number of cycles, that is, call windows, for the test. To
disable this feature, enter 0.

Note: If you specify a maximum number of cycles and a maximum


duration, the test stops when one of the maximum values is reached.

Pause between cycles Enter the amount of time in seconds to wait between test cycles.
Max. connect timeout Enter the amount of time in seconds

4. Select Tests, and then select Options > Add > New Test.
5. Select Options > Change.

Figure 3-4 Main settings for Call to any number test


6. Select Duration, enter the amount of time for the call in seconds, and then select OK.
7. Select Number, enter the phone number to call, and then select OK.
8. Select Back, and in the save dialog box, select Yes.

Starting a Call to Any Number Test


At the start of a Data Call test, QualiPoc opens a GPRS session through the access point that you
configured for QPAEngine on the phone. For information on how to configure an access point, see Manual -
QualiPoc SW - Active Engine.pdf.

Chapter 3 | Configuring a Speech or Video Call to Any Number Test 16


CONFIDENTIAL MATERIALS
QualiPoc 10.6 Speech and Video Test Description
2000 - 2011 SwissQual AG

To manually start a Call to any number test in QPAEngine


1. Select Options > Start a job > Choose from List > Speech Call.

Note: For a video call, select Video Call/Streaming.

2. Select a test category in the list, for example, Call to any number.
3. Select a test in the list and then select Start.

Monitoring a Call to Any Number Test


For a description of the events that you can monitor during a Call to any number test, see the "Monitoring a
Speech or Video Call Test" section on page 12.

Chapter 3 | Configuring a Speech or Video Call to Any Number Test 17


CONFIDENTIAL MATERIALS
QualiPoc 10.6 Speech and Video Test Description
2000 - 2011 SwissQual AG

A Abbreviations
Table A-1 Description of abbreviations

Abbreviation Description
DTMF Dual-tone multi-frequency
GSM Global System for Mobile Communications
IP Internet Protocol
ISDN Integrated Services Digital Network
IVR Interactive Voice Response is an interactive technology that allows a computer to detect
voice and keypad inputs.
LQ Listening Quality on a five-point MOS (Mean Opinion Score) scale. The value 1 refers
to bad quality, the value 5 means excellent. By practical reasons, objective measures
for LQ are limited at 4.5, which indicate that the signal to be measured is identical to the
used reference signal.
MOC Mobile-Originated Call (synonym for the calling side), used for the MOC:MTC Ratio in
the Intrusive Job timings
MOC-only This is indicated if the MOC:MTC Ratio in the Intrusive Job timings is set to 1:0
MOS Mean Opinion Score, Value of the listening quality
MTC Mobile-Terminated Call (synonym for the call terminating side ), used for the MOC:MTC
Ratio in the Intrusive Job timings
NQTM TestManager
PSTN Public Switched Telephone Network
QPA QualiPoc Active Engine
UMTS Universal Mobile Telephone System
WAV Waveform audio format

Appendix A | Abbreviations 18
CONFIDENTIAL MATERIALS

You might also like