UNITED REPUBLIC OF TANZANIA

Ministry of Health, Community

Development, Gender, Elderly and
Children

PST 06210
Operational
Research
NTA Level 6
Semester 2
March 2019

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide i
 Copyright © Ministry of Health, Community Development, Gender, Elderly and Children – 2019

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide ii
Table of Contents
Background iv
Acknowledgment vi
Introduction viii
Abbreviations xi
Session 1: Basic Statistical Concepts 1
Session 2: Basic Biostatistics Data 7
Session 3: Data Presentation 13
Session 4: Establishing Trends in Health Care 23
Session 5: Basic Concept of Research 32
Session 6:Classification of Research 36
Session 7: Procedures for Conducting Operational Research48
Session 8: Identification of Research Problem 55
Session 9: Analysis and Statement of the Problem 69
Session 10: Literature Review in Research 80
Session 11: Research Objectives and Questions 88
Session 12: Review of Study Types/Designs 98
Session 13: Research Sampling 104
Session 14: Determining Sample Size 117
Session 15: Research Ethics 124
Session 16: Developing Research Tools 131
Session 17: Pre-Testing the Research Tools 173
Session 18: Data Collection Plan 182
Session 19: Research Budget 197
Session 20: Data Collection 207
Session 21: Data Collection - Field Work Activities 216
Session 22: Data Processing 219
Session 23: Data Analysis 227
Session 24: Research Report Writing 244
Session 25: Methods for Dissemination of Research Findings 260

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide iii
Background
There is currently an ever-increasing demand for pharmaceutical personnel in Tanzania.
This is due to expanding investment in public and private pharmaceutical sector. Shortage of
trained pharmaceutical human resource contributes to poor quality of pharmaceutical
services and low access to medicines in the country (GIZ, 2012).
Through Public-Private-Partnership (PPP) the Pharmacy Council (PC) together with
Development Partners (DPs) in Germany and Pharmaceutical Training Institutions (PTIs)
worked together to address the shortage of human resource for pharmacy by designing a
project named “Supporting Training Institutions for Improved Pharmaceutical Services in
Tanzania” in order to improve quality and capacity of PTIs in training.
CSSC prepared a Multi-actor Partnership (MAP) project proposal on how to sustain and
strengthen health care in Tanzania through improvement of pharmaceutical training and an
inter-institutional coordination of actors. This will harmonize and improve access to quality
pharmaceutical service in Tanzania.
The project has a various key stakeholders like; CSSC, NACTE, PC, TCU, CEDHA and
Pharmaceutical Training Institutions (PTIs). Through this project, few PTIs will receive
infrastructural improvements to increase the quantitative and qualitative capacities (CUHAS,
RUCU and KSP). Furthermore this project will train Pharmaceutical tutors from different
PTIs on teaching and assessment methods in Tanzania and thus improved health delivery
through increased qualified human resource.
It was also observed that in the previous stakeholder’s meetings there was a need for the
development of training manuals and assessment plans for NTA Level 5 & 6, in order to
support the establishment and implementation of the curriculum in PTIs. During MAP kick-
off workshop done in February 2018, Stakeholders agreed that there was a need for
development of the said manuals and it was among the highest priority in Pharmacy
education in Tanzania. Therefore this project aims at developing facilitator’s guide and
assessment plans for NTA Level 5 & 6.
Pharmacy Council, CSSC and action medeor developed the Terms of Reference and selected
a qualified service provider with experience in material development to develop the
mentioned training manuals and assessment plan. Centre for Educational Development in
Health Arusha (CEDHA) was selected and offered a contract to develop Facilitators guide for
NTA level 5 & 6 and assessment plan.
Centre for Educational Development in Health Arusha (CEDHA) was offered a leading role
with the instructions to include experts who have developed teaching materials for NTA
Level 4. These experts are primarily experienced pharmaceutical and non-pharmaceutical
tutors.
The mode of operation used by CEDHA to develop facilitator’s guide and assessment plan
was participatory approach which included a number of activities through various workshops

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide iv
such as planning, and orientation of material development. After these preliminary
workshops, experts developed materials individually and in-groups. Thereafter, developed
draft materials were reviewed, edited and formatted and draft one was finalized and shared to
stakeholders for inputs.
Finally, CEDHA submitted the finalized Facilitator’s guides and assessment plans for NTA
level 5 and 6 to CSSC for endorsement, printing, dissemination and sharing with relevant
authorities.
There are 12 modules for NTA level 6 making 12 Facilitator guides and one Practicum guide.

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide v
Acknowledgment
The development of standardized training materials of a competence-based curriculum for
pharmaceutical sciences has been accomplished through involvement of different
stakeholders.

Special thanks go to the Pharmacy Council for spearheading the harmonization of training
materials in the pharmacy after noticing that training institutions in Tanzania were using
different curricula and train their students differently.

I would also like to extend my gratitude to Christian Social Service Commission (CSSC) for
their tireless efforts to mobilize funds from development partners (German Ministry of Industry
and action medeor). It is through the implementation of the Multi-Actors Partnership (MAP)
project, CSSC has been able to provide the financial and technical support needed during the
development of this training material.

Many thanks go to the Centre for Educational Development in Health Arusha (CEDHA)
experts on health material development and training who coordinated the development of
these module sessions particularly Ms. Diana H. Gamuya for her commitment in coordinating
and facilitating the planning and development to its completion.

Particular acknowledgements are sent to Mr. Dickson Mtalitinya and Members from the
secretariat of National Council for Technical Education (NACTE) for facilitating and
providing their expertise to the success of this work.
It will be unfair if I will not recognize the efforts and contributions of all CEDHA supportive
staff that made this process a success; accountant, secretary, drivers and printers

Finally, I very much appreciate the contributions of the tutors and content experts
representing PTIs, hospitals, and other health training institutions. Their participation in
meetings and workshops, and their input in the development of this training
manual/facilitators guide have been invaluable.

These participants are listed with our gratitude below:

Ms. Elizabeth Shekalaghe Registrar, Pharmacy Council of Tanzania

Dr. Fadhili Lyimo Assistant Director Allied Health, MoHCDGEC
Mr. Dennis Busuguli MoHCDGEC
Dr. Jacqueline Uriyo Acting Principal, CEDHA
Dr. Sungwa N. Kabissi Project Manager - MAP, CSSC
Dr. Loishooki S. Laizer CEDHA
Ms. Diana H. Gamuya CEDHA
Mr. Dickson Mtalitinya SIBS
Ms. Grace Mallange PC
Mr. Wensaa Muro KSP
___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide vi
Mr. John Mmassy CSSC
Ms. Emily Mwakibolwa Pharmacy Council
Mr. Samwel M. Zakayo Pharmacy Council
Mr. Godfrey Komba NACTE
Mr. Samweli Mdallingwa NACTE
Dr. Catherine Jincen CEDHA
Mr. Daniel Muhochi CEDHA
Dr. Byera Shwekerela CEDHA
Dr. Johannes Lukumay CEDHA
Dr. Mwandu Jiyenze CEDHA
Dr. Peter Sala CEDHA
Mr. Stephano Kiberiti CEDHA
Mr. Amani Phillip HKMU
Mr. John M. Bitoro CUHAS
Mr. Omary Mejjah CUHAS
Mr. Karol Marwa CUHAS
Mr. Raphael Matinde CUHAS
Mr. Rajabu I. Amiri MUHAS
Mr. Peter Njalale MUHAS
Ms. Tumaini H. Lyombe MUHAS
Ms. Dilisi J. Makawia KSP
Mr. Richard P. Mmassy KSP
Mr. Nemes Uisso RAS-KLM
Mr. Gaspar Baltazary RuCU
Mr. Goodluck Mdugi RuCU
Mr. Godfrey A. Pharaoh SIBS
Mr. Joel M.Selestine SIBS
Mr. Jimmy M. Mulee SIBS
Mr. Evalist Shileki DECOHAS
Mr. Eliabu Mshashi KIUT

Dr. Loishooki S. Laizer

Director of Human Resources Development
Ministry of Health, Community Development, Gender, Elderly and Children

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide vii
Introduction
Module Overview

This module content is a guide for tutors of Pharmaceutical schools for training of students.
The session contents are based on sub-enabling outcomes and their related tasks of the
curriculum for Basic Technician Course in Pharmaceutical Sciences. The module sub-
enabling outcomes and their related tasks are as indicated in the in the Basic Technician
Certificate in Pharmaceutical Sciences (NTA Level 6) Curriculum

Target Audience

This module is intended for use primarily by tutors of pharmaceutical schools. The module’s
sessions give guidance on the time, activities and provide information on how to teach the
session. The sessions include different activities which focus on increasing students’
knowledge, skills and attitudes.

Organization of the Module

The module consists of twenty-five (25) sessions; each session is divided into several parts as
indicated below:

 Session Title: The name of the session

 Total Session Time: The estimated time for teaching the session, indicated in minutes
 Pre-requisites: A module or session which needs to be covered before teaching the
session.
 Learning Tasks: Statements which indicate what the student is expected to learn by the
end of the session
 Resources Needed: All resources needed for the session are listed including handouts
and worksheets
 Session Overview: The session overview box lists the steps, time for each step, the
activity or method used in each step and the step title
 Session Content: All the session contents are divided into steps. Each step has a heading
and an estimated time to teach that step as shown in the overview box. Also, this section
includes instructions for the tutor and activities with their instructions to be done during
teaching of the contents
 Key Points: Key messages for concluding the session contents at the end of a session
This step summarizes the main points and ideas from the session, based on the learning
tasks of the session
 Evaluation: The last section of the session consists of short questions based on the
learning tasks to check the understanding of students.
 Handouts: Additional information which can be used in the classroom while teaching or
later for students’ further learning. Handouts are used to provide extra information related
to the session topic that cannot fit into the session time. Handouts can be used by the
students to study material on their own and to refer to them after the session. Sometimes,

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide viii
 a handout will have questions or an exercise for the participants including the answers to
the questions.

Instructions for Use and Facilitators Preparation

 Tutors are expected to use the module as a guide to train students in the classroom and
skills laboratory
 The contents of the modules are the basis for teaching and learning dispensing.
 Use the session contents as a guide
 The tutors are therefore advised to read each session and the relevant handouts and
worksheets as preparation before facilitating the session
 Tutors need to prepare all the resources, as indicated in the resource section or any other
item, for an effective teaching and learning process
 Plan a schedule (timetable) of the training activities
 Facilitators are expected to be innovative to make the teaching and learning process
effective
 Read the sessions before facilitation; make sure you understand the contents in order to
clarify points during facilitation
 Time allocated is estimated, but you are advised to follow the time as much as possible,
and adjust as needed
 Use session activities and exercises suggested in the sessions as a guide
 Always involve students in their own learning. When students are involved, they learn
more effectively
 Facilitators are encouraged to use real life examples to make learning more realistic
 Make use of appropriate reference materials and teaching resources available locally

Preparation with Handouts and Worksheets

 Go through the session and identify handouts and worksheets needed for the session
 Reproduce pages of these handouts and worksheets for student use while teaching the
session. This will enable students to refer to handouts and worksheets during the session
in the class. You can reproduce enough copies for students or for sharing
 Give clear instructions to students on the student activity in order for the students to
follow the instructions of the activity
 Refer students to the specific page in the student manual as instructed in the facilitator
guide

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide ix
Using Students Manual When Teaching

 The student manual is a document which has the same content as the facilitator guide,
which excludes facilitator instructions and answers for exercises.
 The student manual is for assisting students to learn effectively and acts as a reference
document during and after teaching the session
 Some of the activities included in facilitator guide are in the student manual without
facilitator instructions

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide x
Abbreviations
AIDS Acquired Immune Deficiency Syndrome
CA Continuous Assessment
CBHC Community Based Health Care
CEDHA Centre for Educational Development in Health Arusha
CME Continue in – service medical education
COSTECH Commission Science and Technology
CSSC Christian Social Service Commission
CUHAS Catholic University of Health and Allied Science
DIC Drug information center
DIC Drug information center
DMO District Medical Officer
DTC Drug therapeutic committee
EM Essential medicine
EML Essential medicines list
HIV Human Immunodeficiency Virus
INN International non-proprietary name
LCD Liquid Crystal Device
MAP Multi actor partnership
MRCC Medical Research Coordinating
MUHAS Muhimbili University of Health and Allied Science
NACTE National Council for Technical Education
Nat HREC National Health Research Ethics Committee
NEMLT National essential medicine list
NID National Immunization Day
NTA National Technical Award
OTC Over the counter
PTIs Pharmaceutical Training Institutions
RA Regulatory authority
RuCU Ruaha Catholic University
SIBS Spring Institute for Business and Science
STG’s Standard treatment guidelines
TFDA Tanzania food and drug authority
UNICEF United Nations International Children’s Emergency Fund
USAID United States Agency for International Development
WHO World Health Organization

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide xi
Session 1: Basic Statistical Concepts

Total Session Time: 120 minutes

Prerequisites
 None

Learning Tasks
By the end of this session students are expected to be able to:
 Define common terms used in biostatistics
 Explain the importance of different measures in statistics
 Explain the application of statistics in data analysis

Resources Needed
 Flip charts, marker pens, and masking tape
 Black/white board and chalk/whiteboard markers
 Computer and LCD Projector

SESSION OVERVIEW
Activity/
Step Time Content
Method
1 5 minutes Presentation Introduction, Learning Tasks
30 minutes Presentation Definitions of common terms in
2
Brainstorm Biostatistics
45minutes Presentation Importance of Different Measures in
3
Buzzing Statistics
30minutes Presentation
4 Application of Statistics in Data Analysis
Brainstorming
5 05minutes Presentation Key Points

6 05 minutes Presentation Evaluation

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 1
SESSION CONTENTS

STEP1: Presentation of Session Title and Learning Tasks (5 minutes)

READ or ASK students to read the learning tasks and clarify

ASK students if they have any questions before continuing

STEP 2: Definition of common terms in Biostatistics (30 minutes)

Activity: Buzzing (5 minutes)

ASK students to pair up and buzz on the following question for 2 minutes

 What is biostatistics?

ALLOW few pairs to respond and let other pairs to add on points not mentioned

WRITE their response on the flip chart/board

CLARIFY and SUMMARIZE by using the content below

 Biostatistics can be defined as the application of statistics to biological problems.

 Many biomedical scientists consider it to mean the application of statistics specifically to
medical problems.
 For this group of people, therefore, biostatistics and medical statistics are synonymous

Other terms:
 Statistics can be defined in two forms:
o First “statistics” as a “noun” means a descriptive measure computed from data of a
sample i.e. numerical statement - information that is available in numbers). Examples
of this include:
 Hospital data on the number of admissions for some condition in a period
 How much drug (e.g. Amoxicillin capsules) is distributed to health units -
hospitals, health centers and dispensaries
 This first part of the subject is usually referred to as descriptive statistics
o Secondly “statistics” as a “discipline” is a field of study concerned with:
 Collecting, organizing and summarizing and analysis of data in a systematic way.
 Drawing of inferences about a population on the basis of only a part of the
population targeted.
 This second part, which, provides objective means of drawing conclusions,
constitutes inferential statistics

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 2
 Population
o A collection of entities.
o A statistical population means the largest collection of entities in which we have an
interest.
o Example we may be interested in looking at how may health facilities are given
Amoxil in district X?
 Sample
o Part of a population.
o Example number of health centers given Amoxil capsules.

 Central tendency
o Measures of central tendency provide a summary measure that attempts to describe
data with a single value that represents the middle or center of its distribution.
o There are three main measures of central tendency:
 the mean,
 median and
 mode

Mean, arithmetic mean (X or M):

 The mean of a data set is also known as the average value
 The sum of the scores in a distribution divided by the number of scores in the distribution.
It is the most commonly used measure of central tendency.
 It is often reported with its companion statistic, the standard deviation, which shows how
far things vary from the average.

Median (Mdn):
 The midpoint or number in a distribution having 50% of the scores above it and 50% of
the scores below it.
 The median of a data set is the value that is at the middle of a data set arranged from
smallest to largest
 If there are an odd number of scores, the median is the middle score.

Mode (Mo):
 The number that occurs most frequently in a distribution of scores or numbers
 The mode is the most common observation of a data set, or the value in the data set that
occurs most frequently.

Quartile
 A measure of statistical dispersion which divides a frequency distribution into equal
groups each containing the same fraction of the total population
 The first quartile (designated Q1) is the lower and cuts off the lowest 25% of data (the
25th percentile)
___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 3
 The second quartile (Q2), or the median, cuts the data set in half (the 50th percentile)
 The third quartile (Q3) cuts off highest 25% of data, or the lowest 75% (the 75th
percentile)

Variations
 Range (Ra): The difference between the highest and lowest scores in a distribution; a
measure of variability.
 Standard deviation (SD): The most stable measure of variability, it takes into account
each and every score in a normal distribution. This descriptive statistic assesses how far
individual scores vary in standard unit lengths from its midpoint of 0. For all normal
distributions, 95% of the area is within 1.96 standard deviations of the mean.
 Variance (SD2): A measure of the dispersion of a set of data points around their mean
value. It is a mathematical expectation of the average squared deviations from the mean.

STEP 3: Importance of Measures in Statistics (45 minutes)

Activity: Buzzing (5 minutes)

ASK students to pair up and buzz on the following questions for 2 minutes
 What are the importance of different measures in statistics

ALLOW few pairs to respond and let other pairs to add on points not mentioned

WRITE their responses on the flipchart or board

CLARIFY and SUMMARIZE by using the content below

 The following are importance of different measures in statistics

o Measures of central tendency (Mean, Median, and Mode) in statistics
are important because of the following reasons:
 To find representative value: Measures of central tendency or averages; give us
one value for the distribution and this value represents the entire distribution
 Central tendency is very useful in psychology. It helps to know what is normal or
'average' for a set of data. It also condenses the data set down to one representative
value, which is useful when working with large amounts of data
 The mean is an important measure because it incorporates the score from every
subject in the research study
o Measures of dispersion (Range of the Data, Variance, Standard Deviation and
Quartiles) in statistics are important because of the following reasons:
 Variation is a measure of statistical dispersion
 Quartile divides a range of data or population into four equal parts

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 4
STEP 4: Application of Statistics in Data Analysis (30Minutes)
 Statistics is the mathematical science involving the collection, analysis and interpretation
of data.
 The following are application of statistics:
o To assess risk in the pharmaceutical industries.
o To study biological phenomena and observations by means of statistical analysis
o To develop new insights and understanding of performance
o Serves as the foundation and logic of interventions made in the interest of public
health and preventive medicine.
o In clinical trials to arrive at optimal or near optimal solutions to complex problems
 To quantify drug use
 Statistics is an important tool in pharmacological research that is used to
summarize (descriptive statistics) experimental data in terms of central tendency
(mean or median) and variance
o It enables us to conduct hypothesis testing (to determine whether the pharmacological
effect of one drug is superior to another)
o Very helpful in formulating experimental design and drawing appropriate inferences
from the collected data

STEP 5: Key Points (5 minutes)

 Biostatistics can be defined as the application of statistics to biological problems
 Common terms in biostatistics are biostatistics, Statistics, mean, mode, median, Quartile
and Variations
 The importance of different measures in statistics is to give one value for the distribution
and this value represents the entire distribution, to know what is normal or 'average' for a
set of data and variations from normal.

STEP 6: Evaluation (5 minutes)

 What is the importance of different measures in statistics (central tendency, quartile and
variations)?
 What is the application of statistics in data analysis?

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 5
References

Anderson, D.R., Sweeney, D.J., Williams, T.A., Freeman, J. & Shoesmith, E. (2007).
Basic Statistics and epidemiology (2001). A practical guide, Radcliffe Medical Press,
United Kingdom

Beaglehole R, Bonita R and Kjellstrom (1993) Basic epidemiology, World Health

Organization, Geneva

Kazaura, M. R., Makwaya, C. K., Masanja, C. M. and Mpembeni, R.C. (1997). Lecture notesin
Biostatistics, manual of biostatistics: Muhimbili University College of Health Sciences,
Dar es Salaam

Polit, D. F and Beck, C. T (2004) Nursing Research – Principles and Methods, 7th Edition:
Lippincott Williams & Wilkins, Philadelphia

Rao, J. S., & Richard, J. (2002). An introduction to biostatistics-a manual for students in
helthsciences (3rd. Ed): New Delhi, India: Prentice-Hall of India Pvt.Ltd

Rosner B (2010): Fundamental of Biostatistics (7th Ed.): Boston, USA: Cengage Learning

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 6
Session 2: Basic Biostatistics Data

Total Session Time: 120 minutes

Prerequisites
 None

Learning Tasks
By the end of this session students are expected to be able to:
 Define data
 Mention characteristics of data
 Explain sources of data
 Describe types of data
 Explain the quality of data

Resources Needed
 Flip charts, marker pens, and masking tape
 Black/white board and chalk/whiteboard markers
 Computer and LCD Projector

SESSION OVERVIEW

Activity/
Step Time Content
Method
1 05 minutes Presentation Introduction, Learning Tasks
10 minutes Brainstorm
2 Definition of Data
Presentation
3 25 minutes Presentation
Characteristic of Data
25 minutes Buzzing
4 Presentation Sources of Data

15 minutes Buzzing
5 Types of Data
Presentation

6 30 minutes Presentation
The Quality of Data
7 05 minutes Presentation Key Points

8 05 minutes Presentation Evaluation

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 7
SESSION CONTENTS

STEP1: Presentation of Session Title and Learning Tasks (5 minutes)

READ or ASK students to read the learning tasks and clarify

ASK students if they have any questions before continuing

STEP 2: Definition of Data (10 minutes)

Activity: Brainstorming (5 minutes)

Ask students to pair and brainstorm on the following question:

 What is Data?

ALLOWS few students to respond

WRITE their responses on the flipchart or board

CLARIFY and SUMMARIZE by using the content below

 Data is defined as the raw information from which statistics are created
o Put in the reverse, statistics provide an interpretation and summary of data.
 When it means statistical data, it refers to numerical descriptions of things.

STEP 3: Characteristic of Data (25 minutes)

 The following are characteristics of statistical data:
o They must be in aggregates
o They must be affected to a marked extent by a multiplicity of
causes.
o They must be enumerated or estimated according to a reasonable standard of accuracy
o They must have been collected in a systematic manner for a predetermined purpose.
o They must be placed in relation to each other. That is, they
must be comparable

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 8
STEP 4: Sources of Data (25 minutes)
 Sources of data include:
o Vital events register
This includes data on live-births, deaths, marriages and migration. This
register should ideally provide a comprehensive coverage of the whole
district/country. It is usually used to calculate demographic indicators such as infant
and under-five mortality rate
o National Population Census
This is an important source of demographic, social and economic data. These data
form the denominator in the calculation of many quantifiable health indicators.
National population census provides total population and age structure, which is not
easy to obtain through any other method.
o Routine data collection from health facilities
Routine data collection from health facilities is a good source of information for
disease, specifically morbidity and mortality data. This is because the information
is obtained from active cases and the data are collected by a professional, qualified
person.
o Sentinel surveillance
This is a system in which data is collected routinely from selected health facilities
or communities. It is very useful in obtaining specific morbidity data in a more
detailed form, particularly endemic diseases and those under special control
programmes, with an improved accuracy compared with routine data collection
system
o Surveys
A survey is very useful for evaluation because it can be done in a shorter time and
obtains a lot of detailed representative data. Surveys have the advantage of providing
timely and relevant information. Often surveys are done in the community, and hence
become more representative of the real situation than data obtained from health
facilities e.g. Demographic and health survey
o Reports and documents
A lot of reports and documents with useful information are produced daily in the
ministries of health, in training and research institutions.
o Scientific research
Research findings are usually of very high quality and can be useful in medium and
long term planning of health services. Comparatively, researches are more focused on
the subject matter than other sources of information
o External sources
o Data are collected by individual research workers or by other organizations through
sample surveys or experiments, keeping in view the objectives of the study in your
environment

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 9
STEP 5: Types of Data (15 minutes)
Activity: Buzzing (10 minutes)

ASK students to pair up and buzz on the following question for 2 minutes

 What are the types of statistics commonly used to support decision making in provision of
pharmaceutical services?

ALLOW few pairs to respond and let other pairs to add on points not mentioned

WRITE their response on the flip chart/board

CLARIFY and SUMMARIZE by using the content below

 They are two types of statistical data:
o Primary Data
 Primary data means the raw data (data without fabrication or not tailored data)
which has just been collected from the source and has not gone any kind of
statistical treatment like sorting and tabulation
 Primary data is collected firsthand by a researcher (organization, person,
authority, agency or party etc.) through experiments, surveys, questionnaires,
focus groups, conducting interviews and taking (required) measurements
o Secondary Data
 Secondary data is readily available (collected by someone else) and is available to the
public through publications, journals and newspapers

STEP 6: The Quality of Data (30 minutes)

Data quality refers to the condition of a set of values of qualitative or quantitative variables.
 Data is considered of high quality if it is fit for intended uses in operations, decision
making and planning.
 Seven characteristics of quality data
o Timeliness: For data to become useful for decision-making it must reach the manager
at the appropriate time. Data on drug stock-outs and overstock should reach the
management before the meeting to make decisions on the type and amount of drugs to
procure for the next month.
o Accuracy: Data collected should be accurate enough for the manager to have
confidence in using it. However, despite the need for a high level of accuracy, it
should be borne in mind that any effort to increase the level of accuracy will be met
with an increase in the cost of collecting and processing that data. However, the level
of accuracy required in the day-to-day decision-making and planning is not as
stringent as may be required in scientific research.

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 10
 o Appropriateness: Data collected should be appropriate for the intended objectives.
Inappropriate data will not be used and may become an unnecessary extra burden for
health workers. Whereas the higher level requires strategic information to make
policy decisions, the lower level requires technical information to make management
decisions.
o User-friendliness: Data should therefore be presented in a user-friendly format to
enable decision makers to interpret and use it for decision-making. Charts, maps and
graphs convey the message better than complex tables and narratives.
o Comprehensiveness: Data should be comprehensive with enough details to allow for
decision making. A pharmacist would need to be informed on not only the type of
drug that went out of stock but also the form of drug, e.g. syrup, tablets or injectables.
o Simplicity: The process of data collection and analyses should therefore be fairly
simplified and only the necessary data should be collected on a daily basis. It should
always be borne in mind that the majority of lower level health worker have had no
training in statistics.
o Accessibility: Information emanating from the data should be accessible to managers
at all levels to facilitate decision–making, and stored properly for easy retrieval. It
should reach the manager in a timely manner, depending on the type of decisions
made.

STEP 7: Key Points (5 minutes)

 Data is defined as the raw information from which statistics are created
 They are two types of statistical data: Primary Data and Secondary Data
 Quality data is considered to be timely available, accurate, complete, appropriate,
comprehensive, simple, accessible and user friendly

STEP 8: Evaluation (5 minutes)

 What is data?
 What are characteristics of data?
 What are the sources of data?
 What are the qualities of good data?

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 11
References

Anderson, D.R., Sweeney, D.J., Williams, T.A., Freeman, J. & Shoesmith, E. (2007).
Basic Statistics and epidemiology (2001). A practical guide, Radcliffe Medical Press,
United Kingdom

Beaglehole R, Bonita R and Kjellstrom (1993) Basic epidemiology, World Health

Organization, Geneva

Kazaura, M. R., Makwaya, C. K., Masanja, C. M. and Mpembeni, R.C. (1997). Lecture notesin
Biostatistics, manual of biostatistics: Muhimbili University College of Health Sciences,
Dar es Salaam

Polit, D. F and Beck, C. T (2004) Nursing Research – Principles and Methods, 7th Edition:
Lippincott Williams & Wilkins, Philadelphia

Rao, J. S., & Richard, J. (2002). An introduction to biostatistics-a manual for students in
helthsciences (3rd. Ed): New Delhi, India: Prentice-Hall of India Pvt.Ltd

Rosner B (2010): Fundamental of Biostatistics (7th Ed.): Boston, USA: Cengage Learning

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 12
Session 3: Data Presentation

Total Session Time: 120 minutes+ 120 minutes Assignment

Prerequisites
 None

Learning Tasks
By the end of this session students are expected to be able to:
 Define data presentation
 Describe methods of data presentation
 Explain the use of data presentation methods

Resources Needed
 Flip charts, marker pens, and masking tape
 Black/white board and chalk/whiteboard markers
 Computer and LCD projector

SESSION OVERVIEW

Activity/
Step Time Content
Method
1 05 minutes Presentation Introduction, Learning Tasks
15 minutes Brainstorming
2 Definition of Data Presentation
Presentation
40 minutes
3 Presentation Methods of Data Presentation
40 minutes Presentation
4 Use of Data Presentation Methods
Buzzing
5 10 minutes Presentation Key Points

6 10 minutes Presentation Evaluation

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 13
SESSION CONTENTS

STEP1: Presentation of Session Title and Learning Tasks (5 minutes)

READ or ASK students to read the learning tasks and clarify

ASK students if they have any questions before continuing

STEP 2: Definition of Data Presentation (15 minutes)

Activity: Brainstorming (5 minutes)

Ask students to pair up and brainstorm on the following question:

 What is data presentation?

ALLOW few students to respond?

WRITE their responses on the flip chart/ board

CLARIFY and SUMMARISE by using the content below

 Data presentation refers to the organization of data into tables, graphs or charts, so that
the logical and statistical conclusions can be derived from the collected measurements

STEP 3: Methods of Data Presentation (40 minutes)

 Data may be presented in three methods, i.e. textual, tabular or graphical
o Textual – presentation of data in words (text)
o Tabular – a systematic organization of data into columns and rows (a table)
o Graphical – presentation of data using graphs
 Data can be presented as:
o frequency distributions
o percentages
o proportions
o ratios and rates
o figures (graph, tables, charts
o measures of central tendency (mean, mode and median)

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 14
 Frequency distribution
o Frequency distribution is description of data presented in tabular form so that data
will be more manageable.
o It gives frequency in each value that appears in data
o counts number of responses in category
e.g. Frequency of categorical data
Frequency distribution of course students according to sex

Sex of course students Number of course students

Male 34

Female 27

Total 61

 Frequency distribution of numerical data

o Frequency distribution of numerical data is similar to that of categorical data except
here data have to be grouped in categories
o Example Weights (in kg) of 17 pharmaceutical students on enrolment at KCMC
School of Pharmacy (KSP) (45,43,45,47,54,53,62,38,54,34,45,53,56,42,51, 62,61)
o Procedures
 Select group for grouping these data (selected Groups (31-40; 41-50; 51-60; 61-
70)
 Count number of measurement (wt. of pharmaceutical students) in each group:
31-40 II (34, 38)
41-50 IIIIII (42, 43, 45, 45, 45, 47)
51-60 IIIIII (51, 53, 53, 54, 54, 56)
61-70 III (61, 62, 62)

 Add up and check the total

 Rules for grouping data

o Groups must not overlap, to avoid confusion
o There must be continuity from one group to the other (no gaps)
o Groups must range from the lowest to the highest measurements
o Groups should normally be of equal width

 Percentages
o Is number of units in the sample with a certain characteristics divided by total of units
in the sample multiplied by 100
___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 15
 o May also be called Relative frequencies
o Standardizes the data and make it easier to compare with similar data obtained in
another sample of different size or origin
o E.g. weight of 17 pharmaceutical students at KCMC school of Pharmacy on
enrolment

Weight Number of Relative frequency(percent)

(Kg) pharmaceutical
students

31-40 12 26.7

41-50 17 37.8

51-60 11 24.4

61-70 5 11.1

Total 45 100
 For calculating percentage Remember:
o Don’t include missing numbers and not applicable in calculation.
o Don’t know' is special category that should not counted as missing data.
o Should not be used if total is less than 30, as one unit makes a big difference in terms
of percentage
 Proportions
o Sometimes relative frequency are expressed in proportion instead of percentages
o Definition: proportion is numerical expression that compares one party of study units
to the whole.
o Can be expressed in fraction or decimal
Numerator is part of denominator
e.g. Calculate proportion of modules studied in first semester
 Ratio
o Is numerical expression that indicates relationship in quantity or amount or size
between two or more parts. Numerator is not part of denominator
e.g. Ratio of module studied in first semester to module to be studied in second
semester
 Rates
o Is quantity or amount or degree of event or disease measured over specified period.
e.g. Birth rate = number of live birth per 1000 population over period of one year
 Figures
o Figures make the descriptive data more readable when you have many tables
For categorical data use
o Bar charts
o Pie charts
 For numerical data use

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 16
 o Histograms
o Line graphs
o Scatter diagrams
o Maps

 Bar charts
o Is simplest and most effective means of illustrating qualitative data
o Bars can either be horizontal or vertical
o The bars are not connected
e.g.57 Adolescents from Kaloleni streets in Arusha were asked the following
question: How often have you used cannabis for the past one year? This was
closed question with the following possible answers
o Frequently (more than 5 times), Occasionally (3 to 5 times), rarely (1 to 2 times) and
never

Categories Number Percentage

Frequently 7 12.2

Occasionally 9 15.8

Rarely 10 17.5

Never 31 54.4

Total 57 100

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 17
 Pie charts
o Provides quick view of data presented in different form.
 Used in qualitative number with few categories to avoid congestion

 Histograms
o Numerical data are often presented in histograms
o Are similar to bar charts however the difference is that in histogram ‘the bars’ are
connected (as long as there is no gap between the data where as in bar charts the bars
are not connected as the different categories are distinct entitles)

 Line graphs
o Useful for numerical data if you want to show Trend over time
o It is easy to show two or more distribution in one graph as long as difference between
lines are easy to distinguish e.g. age distribution between males and females

STEP 4: Use of Data Presentation Methods (35 minutes)

Activity: Buzzing (5 minutes)

ASK students to pair up and buzz on the following question for 2 minutes

 What are the conditions in which methods of data presentation are used?

ALLOW few pairs to respond and let other pairs to add on points not mentioned

WRITE their response on the flip chart/board

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 18
CLARIFY and SUMMARIZE by using the content below

Conditions in which the following methods of data presentation are used

 Frequency distributions
o Frequency distributions are used for both qualitative and quantitative data.
o A frequency distribution of data can be shown in a table or graph.
o Some common methods of showing frequency distributions include frequency tables,
histograms or bar charts.
o A frequency table is a simple way to display the number of occurrences of a particular
value or characteristic.
o Statistical hypothesis testing is founded on the assessment of differences and
similarities between frequency distributions
o In Cross tabulation
o In Cumulative frequency
 Percentages
o Useful in expressing the relative frequency of survey responses
o In Comparison of groups
o As a fraction
o In advertisement, e.g. shops advertise discounts on products. These discounts are
percentages
 Proportions
o A proportion is simply a statement that two ratios are equal.
o Uses cross products to find a missing term in a proportion
o Used when administering medication

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 19
 Ratios and rates
o A ratio is a numerical expression which indicates the relationship in quantity, amount
or size between two or more parts. Example the ratio of males to females is 22:33, or 2:3.
o A rate is the quantity, amount or degree of a disease or event measured over a
specified period
o Commonly used rates in the health sector are:
 Birth Rate - The number of live births per 1000 population over a period of one
year
 Death Rate - The number of deaths per 1000 population over a period of one
year
 Infant Mortality Rate (IMR) - The number of deaths of infants under one-year
deaths of age per 1000 live births over a period of one year
 Maternal Mortality Rate (MMR) - The number of maternal pregnancy-related in
one year per 100,000 total births in the same year
 Incidence Rate - The number of new cases per population over a specific period
of time (usually a year)
 Prevalence Rate - The number of existing cases per population over a specific
period of time (usually a year)
 Figures (graph, tables, charts)
o Graph:
 Line graphs can also be used to compare changes over the same period of time for
more than one group.
 Bar graphs are used to compare things between different groups or to track
changes over time (trends)
 The purpose of a graph is to present data that are too numerous or complicated to
be described adequately in the text and in less space
o Tables:
 Show the number of times that data with certain characteristics occur in a data set
 Tells how many or what proportion of a group has each value or range of value
out of all possible values
o Pie charts:
 Pie charts are best to use when you are trying to compare parts of a whole. They
do not show changes over time.

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 20
STEP 5: Key Points (10 minutes)
 Data can be presented as: Frequency distributions, percentage, proportions, ratios and
rates, Figures (graph, tables, charts, and Measures of central tendency (mean ,mode and
median)
 Bar charts are simplest and most effective means of illustrating qualitative data
 Frequency distributions are used for both qualitative and quantitative data

STEP 6: Evaluation (10 minutes)

 What are the methods of data presentation?
 What information should be presented in figures?

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 21
References

Anderson, D.R., Sweeney, D.J., Williams, T.A., Freeman, J. & Shoesmith, E. (2007).
Basic Statistics and epidemiology (2001). A practical guide, Radcliffe Medical Press,
United Kingdom

Beaglehole R, Bonita R and Kjellstrom (1993) Basic epidemiology, World Health

Organization, Geneva

Kazaura, M. R., Makwaya, C. K., Masanja, C. M. and Mpembeni, R.C. (1997). Lecture notesin
Biostatistics, manual of biostatistics: Muhimbili University College of Health Sciences,
Dar es Salaam

Polit, D. F and Beck, C. T (2004) Nursing Research – Principles and Methods, (7th Ed):
Lippincott Williams & Wilkins, Philadelphia

Rao, J. S., & Richard, J. (2002). An introduction to biostatistics-a manual for students in
helthsciences (3rd. Ed): New Delhi, India: Prentice-Hall of India Pvt.Ltd

Rosner B (2010): Fundamental of Biostatistics (7th Ed.): Boston, USA: Cengage Learning

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 22
Session 4: Establishing Trends in Health Care

Total Session Time: 120 minutes

Prerequisites
 None

Learning Tasks
By the end of this session students are expected to be able to:
 List tables and graphs used to determine trend
 Generate tables and graphs
 Interpret tables and graphs

Resources Needed
 Flip charts, marker pens, and masking tape
 Black/white board and chalk/whiteboard markers
 Computer and LCD Projector

SESSION OVERVIEW

Activity/
Step Time Content
Method
1 05 minutes Presentation Introduction, Learning Tasks

Presentation Tables and Graph used to Determine Trend

2 15 minutes
Buzzing
60 minutes Presentation Generation of Tables and Graphs
3 Small group
discussion
4 30 minutes Presentation Interpretation of Tables and Graphs

5 05 minutes Presentation Key Points

6 05 minutes Presentation Evaluation

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 23
SESSION CONTENTS

STEP1: Presentation of Session Title and Learning Tasks (5 minutes)

READ or ASK students to read the learning tasks and clarify

ASK students if they have any questions before continuing

STEP 2: Tables and Graph Used to Determine Trend (15 minutes)

Activity: Buzzing (5 minutes)

ASK students to pair up and buzz on the following question for 2 minutes

 Which tables and Graphs are used to determine Trend?

ALLOW few pairs to respond and let other pairs to add on points not mentioned

WRITE their response on the flip chart/board

CLARIFY and SUMMARIZE by using the content below

 Tables and Graphs used to determine trend are:

o Line graphs
o Bar graph
o Histogram
o Frequency polygon
o Frequency curve
o Cumulative frequency

STEP 3: Generation of Tables and Graphs (55 minutes)

Activity: Small group (15 minutes)

DIVIDE students into groups of 5-6 people

ASK students in their small groups to answer the following questions
How do you generate tables and graphs to determine Trends?

ALLOW one group to present and let other groups to add on points not mentioned.

WRITE their response on the flip chart/board

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 24
CLARIFY and SUMMARIZE by using the following content

 Table
A table is a drawing having columns and rows that facilitate representation of large
amount of data in an attractive easy to read and organized manner.
Steps to make a table
o Name your table – write a title of the table at the top of the paper
o Decide how many rows and columns you need
o Insert/draw a table using the computer
o Label your columns and rows
o Record the data you have in the columns and rows
o When making cross-tabulations, check that the column and row counts correspond to
the frequency counts for each variable.
o Also check that the grand total in the table corresponds to the number of subjects in the
sample. Example of a table
Table 1.: Type of health worker by residence
Residence Type of Health Worker Total
Doctors Pharmacists
Rural 10 (16%) 69 (38%) 79 (33%)
Urban 51 (84%) 113 (62%) 164 (67%)
Total 61 (100%) 182 (100%) 243 (100%)

 Line graph
o A line graph is a diagram that shows a line joining several points, or a line that shows
the relationship between the points.
o A line graph can be taken as xy plane, where there will be an independent variable
and a dependent variable
o It specifies how the two variables are related to each other and vary with respect to
one another.
o Mostly, the independent variable is taken on the x-axis while the dependent variable
on the y-axis.

 Steps to Make a Line Graph:

o Step 1: Use the data from the table to choose an appropriate scale
The table given below shows the weights of a child in months
SNo. Age in Months Weight (Kg)
A. 1 38
B. 3 41
C. 5 43
D. 7 49
E. 9 51

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 25
 F. 11 54

o Step 2: Draw and label the scale on the vertical and horizontal axis
o Step 3: List the each item and locate the points on the graph
o Step 4: Connect the points with line segments
 You can see a line plotted through two points say A and B on the following graph
 The data given on table above has been summarized in the form of a line graph as
follows:

Line graph have one or more lines plotted on the graph. They are very useful for showing change over time

 Bar Graph
o Bar graph is drawn on an x-y graph and it has labeled horizontal or vertical bars that
show different values.
• The size, length and color of the bars represent different values.
• Bar graph is very useful for non-continuous data and it helps in comparing or
contrasting the size of the different categories of the data provided
• Let’s take an example of the bar diagram and compare the pass percentage of a
school 90%, 100% and 60% during the year 2000, 2001 and 2002 respectively

 Frequency Polygon

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 26
 o The frequency polygon has most of the properties of a histogram, with an extra
feature
o Here the mid-point of each class of the x-axis is marked
o Then the midpoints and the frequencies are taken as the plotting point
o These points are connected using line segments
o We also complete the graph, that is, it's closed by joining to the x-axis.
o Frequency polygon gives a less accurate representation of the distribution, than a
histogram, as it represents the frequency of each class by a single point not by the
whole class interval
o Let’s consider a data table and let’s try to draw frequency polygon of it
o Draw a graph by using data given below:

Class interval Frequency

0-10 1
10-20 3
20-30 6
30-40 4
40-50 2

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 27
 Step 1: First we need the mid-point of the class interval

Class interval Mid-point Frequency

0-10 5 1
10-20 14 3
20-30 25 6
30-40 35 4
40-50 45 2

Step 2: Then draw frequency polygon

 Histogram
o Histogram is the most accurate graph that represents a frequency distribution
o In the histogram the scores are spread uniformly over the entire class interval
o The class intervals are plotted on the x-axis and the frequencies on the y-axis
o Each interval is represented by a separate rectangle

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 28
 o To plot this take the class limits on the x-axis and the frequency on the y-axis.
o On the x-axis, the scale can be 10 units whereas on the y-axis the scale can be 1 unit.

STEP 4: Interpretation of Tables and Graphs (30 minutes)

Activity: Brainstorming (10 minutes)

Ask students to brainstorm on the following question:

What is the difference between tables and graphs?

ALLOW few students to respond?

WRITE their responses on the flip chart/ board

CLARIFY and SUMMARISE by using the content below

 Frequency distribution
o A frequency shows the number of times that data with particular characteristics occur
in a data set.
o The distribution tells how many or what proportion of the group has each value or a
range of values out of all possible values
 Bar chart
o the frequency of each group is represented by the length of the corresponding bar
o the height of the bar over a period represents the figure for the corresponding period
 Histogram
o read erected rectangles over class interval representing the frequencies of the class
interval
___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 29
 o the frequency distributions of each grouped data by areas (height and width), e.g. the
frequency distribution of patients presenting with a certain condition in a given
period, with the patient grouped into 5-years block
 Pie chart
o compare individual category with the total
o depicts each category as a slice of pie with the size of each slice varying according to
its proportion of the whole pie
 Frequency polygon
o see variations in increase and decrease over time or seasons

STEP 5: Key Points (5 minutes)

 Tables and graph used to determine trend include line graphs, bar graph and histogram
 A line graph is a diagram that shows a line joining several points, or a line that shows
the relationship between the points
 Histogram is the most accurate graph that represents a frequency distribution

STEP 6: Evaluation (5 minutes)

 What tables and Graph are used to determine trend?
 What is a bar graph?
 What is a line graph?

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 30
References

Anderson, D.R., Sweeney, D.J., Williams, T.A., Freeman, J. & Shoesmith, E. (2007).
Basic Statistics and epidemiology (2001). A practical guide, Radcliffe Medical Press,
United Kingdom

Beaglehole R, Bonita R and Kjellstrom (1993) Basic epidemiology, World Health

Organization, Geneva

Kazaura, M. R., Makwaya, C. K., Masanja, C. M. and Mpembeni, R.C. (1997). Lecture notesin
Biostatistics, manual of biostatistics: Muhimbili University College of Health Sciences,
Dar es Salaam

Polit, D. F and Beck, C. T (2004) Nursing Research – Principles and Methods, (7th Ed):
Lippincott Williams & Wilkins, Philadelphia

Rao, J. S., & Richard, J. (2002). An introduction to biostatistics-a manual for students in
helthsciences (3rd. Ed): New Delhi, India: Prentice-Hall of India Pvt.Ltd

Rosner B (2010): Fundamental of Biostatistics (7th Ed.): Boston, USA: Cengage Learning

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 31
Session 5: Basic Concept of Research

Total Session Time: 120 minutes

Prerequisites
 None

Learning Tasks
By the end of this session students are expected to be able to:
 Define research
 Outline the importance of research in pharmaceutical services
 Explain the application of research concepts in pharmaceutical services

Resources Needed
 Flip charts, marker pens, and masking tape
 Black/white board and chalk/whiteboard markers
 Computer and LCD Projector

SESSION OVERVIEW

Activity/
Step Time Content
Method
1. 05 minutes Presentation Introduction, Learning Tasks
Presentation
2. 20 minutes Definition of Research
Brainstorming

Presentation
Importance of Research in
3. 35 minutes Buzzing Pharmaceutical Services

Presentation
4. Application of Research Concepts in
50 minutes Small group discussion Pharmaceutical Services
5. 05 minutes Presentation Key Points
6. 05 minutes Presentation Evaluation

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 32
SESSION CONTENTS

STEP1: Presentation of Session Title and Learning Tasks (5 minutes)

READ or ASK students to read the learning tasks and clarify

ASK students if they have any questions before continuing

STEP 2: Definitions of Research (20 minutes)

Activity: Brainstorming (10 minutes)

Ask students to brainstorm on the following question:

 What is research?

ALLOW few students to respond?

WRITE their responses on the flip chart/ board

CLARIFY and SUMMARISE by using the content below

 Research:
o A careful and systematic process of inquiry to find answers to problem of interest.
o It is a systematic process of collection, analysis and interpretation of data to answer a
research question or solve a problem
o Includes use of facts, use of theories, data analysis, sampling, doing an experiment
o To do research is to investigate the problem systematically and thoroughly to
Solve problem of interest.
o Human instinct to inquiry, to know, to know more, to explore, to find out, to explain,
to overcome a problem
o An on-going process
o How we live today is partly due to research

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 33
STEP 3: Importance of research in Pharmaceutical Services (35 minutes)

Activity: Buzzing (5 minutes)

ASK students to pair up and buzz on the following question for 2 minutes

 What is the importance of research in pharmaceutical services?

ALLOW few pairs to respond and let other pairs to add on points not mentioned

WRITE their response on the flip chart/board

CLARIFY and SUMMARIZE by using the content below

 Pharmaceutical personnel in all settings can engage more fully in research in order to
o Improve patient outcomes and further develop the profession.
o Inform workforce development, education, practice and commissioning decisions.
o Clinical advances resulting from research help improve the care of patients
o Research findings assist in developing new roles and practice models for
clinical pharmacists.
o Its aim is to support evidence-based policy and practice decisions
where pharmacists are employed or medicines are prescribed or used

STEP 4: Application of Research Concepts in Pharmaceutical Services

(50 minutes)

Activity: Small group discussion (30 minutes)

DIVIDE students in small manageable groups of 5-6 students

ASK them to discuss on how they can apply research in pharmaceutical services (15 minutes)

ALLOW one group to present and let other groups to add on points not mentioned

WRITE their response on the flip chart/board

CLARIFY and SUMMARIZE by using the content below

 Application of Research Concepts in Pharmaceutical services

o Focuses on examining how and why people access pharmacy services, how much care
costs, and what happens to patients as a result of this care.
___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 34
 o Health policy and governance
o Quality assurance and safety
o Medicine access and rational use
o Quality, safety & standards (e.g. vaccines and biological)
o Strengthening the services, they provide through:
 Building the evidence base for developing and commissioning new services
 Improving patient care
 Contributing to the knowledge base within health service research more widely
 Gaining both professionally and personally in the process

STEP 6: Key Points (5 minutes)

 Research is the systematic collection, analysis, and interpretation of data in order to
answer a certain question or solve a problem
 Areas in pharmaceutical services that need research: may include health policy and
governance, quality assurance and safety, rational use of drugs

STEP 7: Evaluation (5 minutes)

 What is research?
 What is the application of research in pharmaceutical services?

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 35
References

Anderson, D.R., Sweeney, D.J., Williams, T.A., Freeman, J. & Shoesmith, E. (2007).
Basic Statistics and epidemiology (2001). A practical guide, Radcliffe Medical Press,
United Kingdom

Beaglehole R, Bonita R and Kjellstrom (1993) Basic epidemiology, World Health

Organization, Geneva

Kazaura, M. R., Makwaya, C. K., Masanja, C. M. and Mpembeni, R.C. (1997). Lecture notesin
Biostatistics, manual of biostatistics: Muhimbili University College of Health Sciences,
Dar es Salaam

Polit, D. F and Beck, C. T (2004) Nursing Research – Principles and Methods, (7th Ed):
Lippincott Williams & Wilkins, Philadelphia

Rao, J. S., & Richard, J. (2002). An introduction to biostatistics-a manual for students in
helthsciences (3rd. Ed): New Delhi, India: Prentice-Hall of India Pvt.Ltd

Rosner B (2010): Fundamental of Biostatistics (7th Ed.): Boston, USA: Cengage Learning

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 36
Session 6: Classification of Research
Total Session Time: 120 minutes

Prerequisites
 None

Learning Tasks
By the end of this session students are expected to be able to:
 Identify classes of research
 Describe study designs for classes of research identified
 Explain the uses and limitations of each study design
 Identify the most appropriate study design for the research proposal you are developing

Resources Needed
 Flip charts, marker pens, and masking tape
 Black/white board and chalk/whiteboard markers
 Computer and LCD Projector

SESSION OVERVIEW

Activity/
Step Time Content
Method

1 05 minutes Presentation Introduction, Learning Tasks

Presentation Classes of research

2 15 minutes
Brainstorming
Presentation Study designs
3 40 minutes
Buzzing

Uses and Limitations of each Study design

3 30 minutes Presentation
Buzzing
4 20 minutes Presentation Appropriate Study design for the Research Proposal
5 05 minutes Presentation Key Points
6 05 minutes Presentation Evaluation

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 37
SESSION CONTENTS

STEP1 Presentation of Session Title and Learning Tasks (5 minutes):

READ or ASK students to read the learning tasks and clarify

ASK students if they have any questions before continuing

STEP 2: Study Types Most Used in Research (35 minutes)

Activity: Brainstorming (5 minutes)

Ask students to brainstorm on the following questions:

 What are the research classifications most used in research?

ALLOW few students to respond?

WRITE their responses on the flip chart/ board

CLARIFY and SUMMARISE by using the content below

Research can be classified into several categories according to the nature and purpose of the
study and other attributes.

 Types of Research Methods According to the Purpose of the Study

o Applied research which is also referred to as an action research,
o Basic research also called fundamental or pure research.

 Types of Research Methods According to Nature of the Study

Descriptive, analytical and Experimental studies or interventional studies
o Descriptive research usually involves surveys and studies that aim to identify the
facts.
o In other words, it deals with the “description of the state of affairs as it is at present”,
and there is no control over variables in descriptive research.

o Observational or Analytical research uses facts or information already available and

analyze these in order to make a critical evaluation of the material”.

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 38
 o Experimental or interventional studies are ones where researchers introduce an
intervention and study the effects. Experimental studies are usually randomized,
meaning the subjects are grouped by chance. Randomized controlled trial (RCT):
Eligible people are randomly assigned to one of two or more groups.
 Types of Research according to Research Design
o Two groups; Exploratory and Conclusive.
o Exploratory studies only aim to explore the research area and they do not attempt to
offer final and conclusive answers to research questions.
o Conclusive studies, on the contrary, aim to provide final and conclusive answers to
research questions.
o Quantitative or qualitative

STEP 3: Uses and Limitations of Each Study Type (40 minutes)

Activity: Buzzing (5 minutes)

ASK students to, select one study type then pair up and buzz on the following question for 2
minutes

 What are the uses of the selected study type?

ALLOW few pairs to respond and let other pairs to add on points not mentioned

WRITE their response on the flip chart/board

CLARIFY and SUMMARIZE by using the content below

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 39
 Basic (fundamental/pure) research
Uses
o Basic research aims to improve scientific theories for improved understanding or
prediction of natural or other phenomena.
o Applied research, in turn, uses scientific theories to develop technology or techniques
to intervene and alter natural or other phenomena.
o Though often driven by curiosity, basic research fuels applied science's innovations.
Limitations
o Does not usually generate findings that have immediate applications in a practical
level.
o Fundamental research is driven by curiosity and the desire to expand knowledge in
specific research area

 Applied (operational) research

Uses
o Operations research is a discipline that deals with the application of advanced
analytical methods to help make better decisions.
o It uses scientific processes and knowledge as the means to achieve a practical or
useful result
o Uses knowledge and skills in creative ways to solve complex problems and have an
impact on critical decisions
Limitations
o Costly: Operation Research (OR) is very costly.
o Not realistic: Operation Research experts make very complex models for solving
problems. These models may not be realistic
o Complex: Operation Research is a complex concept

 Quantitative research
Uses
o Provides statistical, mathematical, or numerical results
o Tends to analyze phenomena in terms of trends and frequencies
o Quantitative research is based on the measurement of quantity or amount.
o It is applicable to phenomena that can be expressed in terms of quantity.
o Quantitative research is inquiry into an identified problem, based on testing a theory,
measured with numbers, and analyzed using statistical techniques.
o The goal of quantitative methods is to determine whether the predictive
generalizations of a theory hold true.
Limitations
o Research quality is heavily dependent on the individual skills of the researcher
o More easily influenced by the researcher's personal biases and idiosyncrasies.
o Rigor is more difficult to maintain, assess, and demonstrate

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 40
 Qualitative research
Uses
o Can provide full picture of answers and reasons behind them(ethnographic)
o Can be used to inform answers to social issues
o Find ways to improve qualitative things like customers satisfaction, health
professional's opinions
o It aims to develop concepts that aid in the understanding of natural phenomena with
emphasis on the meaning, experiences and views of the students
Limitations
o Time consuming process
o Labour intensive approach in sorting, coding data etc
o Observer may be biased when interpreting
o Not easy to make comparison
o No result verification in qualitative research

 Exploratory studies
Uses
o It is a small-scale study of relatively short duration, which is carried out when little is
known about a situation or a problem.
o It may include description as well as comparison.
o Used for Small scale studies
o Gathers information about unfamiliar phenomenon
o Results give insight to a problem before a large-scale study is designed
Limitations
o Interpretation of findings is judgmental
o Uses small samples which may not be representative

 Descriptive studies
Uses
o involves describing the characteristics of a particular situation, event or case
o Can be carried out on a small or large scale
o Small scale, descriptive case studies
o provide quite useful insight into a problem
o Less expensive
o describe in-depth the characteristics of one or a limited number of ‘cases’ e.g. patient;
village

 Analytical
Uses
o An analytical study attempts to establish causes or risk factors for certain problems.

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 41
 o Is done by comparing two or more groups some of which have or develop the
problem and some of which have not
o Describe phenomena, and
o Analyze relationship between phenomena and other variables
(determinants/association
Limitations
o Only describe phenomena: e.g. Person, Place, Time
o No analysis of determinants/association e.g. Cross-sectional descriptive
o Low response rate

 Comparative or analytical studies

An analytical study attempts to establish causes or risk factors for certain problems. It
compares two or more groups, some of which have or develop the problem and some of
which have not It uses Cross-sectional comparative studies, Case-control studies and
Cohort studies

 Analytical studies
Cross-sectional studies
Uses
o Quick and cheap
o Can reveal various exposures, as first step in investigating the cause
o Repeated measures can depict(represent) trend
o Data useful in assessing health care needs
Limitation
o Not possible to determine if the exposure preceded the outcome

 Cross-sectional comparative studies

Uses
o Aim at describing phenomenon and compare groups or determine factors influencing
the phenomenon
o Done at one point in time
o Measurement of exposure and effect are done at the same time
o Quick and cheap,
o Can elucidate various exposures, as first step in investigating cause,
o Repeated measures can depict trend,
o Produce data useful in assessing health care needs

Limitations
o Not possible to determine if the exposure preceded the outcome (temporal
relationship)

 Case-control studies
___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 42
 In a case-control study the investigator compares one group among whom the problem
that he wishes to investigate is present (e.g. adverse drug reactions) and another group
called a control or comparison group, where the problem is absent, in order to find out
what factors have contributed to the problem

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 43
 Uses
o Useful for generating/ test hypothesis
o Cheap and quick
o Makes use of comparison (control group)
o Can study more than one risk factor
o Useful for rare disease or long latent period

Limitations
o Data on exposure might be inaccurate and biased
o Difficult to make precise selection of control group
o Retrospective – cannot separate cause and effect
o Cannot be used for rare exposure
o You cannot calculate incidence (you do not know when disease occurred

 Cohort studies
o In a cohort study, a group of individuals that is exposed to a risk factor (study group)
is compared to a group of individuals not exposed to the risk factor (control group)
o Aim at determining risk factors for diseases/outcome
o At the start identify two groups
 With exposure to a risk factor (exposed)
 Without exposure (no-n exposed)
 Both groups have not developed the disease/outcome at the start
 Follow over time
 At the end, analyses disease/outcome occurrence in both groups and compare

Limitations
o Needs to get complete and accurate information about exposure and outcome for all
individuals
o Time consuming, expensive
o Inefficient in evaluating rare diseases
o Loss of follow up affect validity of results

STEP 4: Appropriate Study Type for the Research Proposal (20 minutes)
Depending on the existing state of knowledge about a problem that is being studied, different
types of questions may be asked which require different study designs. Some examples are
given in the following matrix.

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 44
State of knowledge Type of research Type of study

of the problem Questions

 Knowing that a problem  What is the nature/  Exploratory studies, or
exists but knowing little magnitude of the Descriptive studies:
about its characteristics problem?
or possible causes  Who is affected?  Descriptive case studies
How do the affected  Cross-sectional surveys
people behave?
What do they know,
believe, and think about
the problem and its
causes?
 Suspecting that certain  Are certain factors  Analytical (comparative)
factors contribute to the indeed studies
problem associated with the  Cross-sectional
problem? comparative studies
(e.g., is lack of pre-
 Case-control studies
school education related
to low school  Cohort studies
performance? Is low
fibre diet related to
carcinoma of the large
intestine?)
 Having established that  What is the cause of the  Cohort studies
certain factors are problem?  Experimental or quasi-
associated with the experimental studies
problem: desiring to  Will the removal of a
establish the extent to particular factor prevent
which a particular factor or reduce the problem
causes or contributes to (e.g., stopping smoking,
the problem. providing safe water)
 Having sufficient  What is the effect of a  Experimental or quasi-
knowledge about cause(s) particular experimental studies
to develop and assess an intervention/strategy
intervention which would (e.g., treating with a
prevent, control or solve particular drug; being
the problem. exposed to a certain type
of health education)
 Which of two alternate
___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 45
 strategies gives better
results? Which strategy
is most cost-effective?

Source: Varkevisser et al: Designing and Conducting Health Systems Research Projects, Vol. 2 Part I.

 The type of study chosen depends on:

o The type of problem,
o The knowledge already available about the problem
o Resources available for the study

STEP 5: Key Points (5 minutes)

 Study types most used in research include basic (fundamental) research, applied
(operational) research, quantitative research, and Qualitative research

 Depending on the existing state of knowledge about a problem that is being studied,
different types of questions may be asked which require different study designs

STEP 6: Evaluation (5 minutes)

 What are the study types used in Research?
 What are the uses and limitations of cohort study?

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 46
References

References

Anderson, D.R., Sweeney, D.J., Williams, T.A., Freeman, J. & Shoesmith, E. (2007).
Basic Statistics and epidemiology (2001). A practical guide, Radcliffe Medical Press,
United Kingdom

Beaglehole R, Bonita R and Kjellstrom (1993) Basic epidemiology, World Health

Organization, Geneva

Kazaura, M. R., Makwaya, C. K., Masanja, C. M. and Mpembeni, R.C. (1997). Lecture notesin
Biostatistics, manual of biostatistics: Muhimbili University College of Health Sciences,
Dar es Salaam

Polit, D. F and Beck, C. T (2004) Nursing Research – Principles and Methods, (7th Ed):
Lippincott Williams & Wilkins, Philadelphia

Rao, J. S., & Richard, J. (2002). An introduction to biostatistics-a manual for students in
helthsciences (3rd. Ed): New Delhi, India: Prentice-Hall of India Pvt.Ltd

Rosner B (2010): Fundamental of Biostatistics (7th Ed.): Boston, USA: Cengage Learning

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 47
Session 7: Procedures for Conducting Operational
Research

Total Session Time: 120 minutes

Prerequisites
 None

Learning Tasks
By the end of this session students are expected to be able to:
 Outline the major characteristics of research
 Identify essential guidelines in conducting operational research
 Describe procedural steps for conducting operational research

Resources Needed
 Flip charts, marker pens, and masking tape
 Black/white board and chalk/whiteboard markers
 Computer and LCD Projector

SESSION OVERVIEW

Activity/
Step Time Content
Method
1. Introduction, Learning Tasks
05 minutes Presentation

2. Presentation Major characteristics of research

15 minutes
Brain storming
3. Presentation Essential guidelines for conducting operational
30 minutes Buzzing research
60 minutes Presentation Procedural steps for conducting operational research
4.
Group
discussion
5. 05 minutes Presentation Key Points
6. 05 minutes
Presentation Evaluation

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 48
SESSION CONTENTS

STEP1: Presentation of Session Title and Learning Tasks (5 minutes)

READ or ASK students to read the learning tasks and clarify

ASK students if they have any questions before continuing

STEP 2: Major Characteristics of Research (15 minutes)

Activity: Brainstorming (5 minutes)

ASK students to brainstorm on the following question for 3minutes

 What are the major characteristics of operational research?

ALLOW few to respond

WRITE their response on the flip chart/board

CLARIFY and SUMMARIZE by using the content below

Operational research encompasses a wide range of problem-solving

techniques and methods applied in the pursuit of improved decision-making and
efficiency. Therefore, it must have certain characteristics as follows:
 It demands a clear statement of the problem.
 It requires clear objectives and a plan (it is not aimlessly looking for something in the
hopes that you will come across a solution).
 It builds on existing data, using both positive and negative findings.
 New data should be systematically collected and analyzed to answer the original research
objectives.

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 49
STEP 3: Essential Guidelines for Conducting Operational Research
(30 minutes)
Activity: Buzzing (5 minutes)

ASK students to pair up and buzz on the following question for 2 minutes

 What are the essential guidelines for conducting operational research?

ALLOW few pairs to respond and let other pairs to add on points not mentioned

WRITE their responses on the flip chart/whiteboard

CLARIFY and SUMMARIZE by using the content below

Operational research is undertaken primarily to provide information to support decision-

making that can improve the functioning of the health system. Some essential guidelines for
success include:
 It should focus on priority problems in health care.
 It should be action-oriented, i.e., aimed at developing solutions.
 An integrated multi-disciplinary approach is required, i.e., research approaches from
many disciplines are needed since health is affected by the broader context of socio-
economic development.
 The research should be participatory in nature, involving all parties concerned (from
policymakers to community members) in all stages of the proposal.
 Research must be timely. Otherwise, it loses its purpose.
 Emphasis should be placed on comparatively simple, short-term research designs
which are likely to yield practical results relatively quickly.
 It should be cost-effective operational research should focus, to a large extent, on low-
cost studies that can be undertaken by management and service personnel in the course of
daily activities.
 Results should be presented in formats most useful for administrators, decision-
makers and the community.
 Evaluation of the research undertaken should concentrate on its ability to influence
policy, improve services and ultimately lead to better health

STEP 4: Procedural Steps for Conducting Operational Research (60

minutes)
Activity: Small Group Discussion (20 minutes)

DIVIDE students into small manageable groups

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 50
ASK students to discuss on the following question
 ‘What steps to follow in conducting operational research?

ALLOW students to discuss for 10 minutes

ALLOW few groups to present and the rest to add points not mentioned

CLARIFY and SUMMARIZE by using the contents on the flow chart below

 Research Proposal: A document written by a scientist that describes in detail the

program for a proposed scientific investigation.
 It can be envisaged as the process (step by step guidelines) of planning and giving
structure to the prospective research, with the fina1 aim of increasing the validity of the
research.
 It is a written submission to spell out the nature of the design and the means and strategies
that are going to be used in a logic format.
 Purpose of Research Proposal
o Provides a defined topic scope for researching.
o Helps you to understand further how to address the technical problems of writing
research.
There are several steps to follow in chronological order in writing a research proposal:
 Step 1; Select, analyze and state the research problem
This step involves

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 51
 o identification of the problem
o Problem prioritization
o Problem analysis
o Stating the problem
 Step 2: Review literature and other available information
 Step 3; Formulate Objectives

 Step 4; Develop research methodology

o variables
o types of study
o data collection techniques
o sampling
o plan for data collection
o plan for data processing and analysis
o ethical consideration
o pretest/pilot study
 Step 5: Prepare the work plan
 Step 6: Identification of resources required and preparation of a budget
 Step 7: Plan for project administration and utilization of results
 Step 8 Collect data in the field (implement the proposal)
 Step 9: Analyze collected data and interpret results
 Step 10: Prepare and present a final report of the research findings, including
recommendations
 Step 11: Prepare plan of action for implementation of recommendations

Writing Introduction to Research Proposal

This is written when all sections of the proposal have been completed. The introduction leads
the reader from a general subject area to a particular topic of inquiry.
 It establishes the scope, context, and significance of the research being conducted by
summarizing current understanding and background information about the topic, stating
the purpose of the work in the form of the research problem supported by:
o a hypothesis or a set of questions,
o explaining briefly the methodological approach used to examine the research
problem,
o highlighting the potential outcomes your study can reveal, and
o outlining the remaining structure and organization of the paper
 Think of the introduction as a mental road map that must answer for the reader these four
questions:
o What was I studying?
o Why was this topic important to investigate?

o What did we know about this topic before I did this study?
___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 52
 o How will this study advance new knowledge or new ways of understanding?

 According to Reyes, there are three overarching goals of a good introduction:

o First, ensure that you summarize prior studies about the topic in a manner that lays a
foundation for understanding the research problem
o Second, explain how your study specifically addresses gaps in the literature,
insufficient consideration of the topic, or other deficiency in the literature

o third, note the broader theoretical, empirical, and/or policy contributions and
implications of your research

STEP 5: Key Points

 Operational research focuses on priority problems, it is action-oriented, uses multi-
disciplinary approach, is participatory, should be timely and cost effective,
 Operational research is done systematically step by step and there are several steps to be
followed when implementing it.

STEP 6: Evaluation

 What are the characteristics of an operational plan?

 What are the steps to be followed in implementing operational research?

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 53
References

Anderson, D.R., Sweeney, D.J., Williams, T.A., Freeman, J. & Shoesmith, E. (2007).
Basic Statistics and epidemiology (2001). A practical guide, Radcliffe Medical Press,
United Kingdom

Beaglehole R, Bonita R and Kjellstrom (1993) Basic epidemiology, World Health

Organization, Geneva

Kazaura, M. R., Makwaya, C. K., Masanja, C. M. and Mpembeni, R.C. (1997). Lecture notesin
Biostatistics, manual of biostatistics: Muhimbili University College of Health Sciences,
Dar es Salaam

Polit, D. F and Beck, C. T (2004) Nursing Research – Principles and Methods, (7th Ed):
Lippincott Williams & Wilkins, Philadelphia

Rao, J. S., & Richard, J. (2002). An introduction to biostatistics-a manual for students in
helthsciences (3rd. Ed): New Delhi, India: Prentice-Hall of India Pvt.Ltd

Rosner B (2010): Fundamental of Biostatistics (7th Ed.): Boston, USA: Cengage Learning

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 54
Session 8: Identification of Research Problem

Total Session Time: 120 minutes + 240 minutes of Individual Assignment

Prerequisites
 None

Learning Tasks
By the end of this session students are expected to be able to:
 Define research problem
 Identify research problems
 Outline conditions for a problem to be researchable
 Explain criteria for selecting a research topic
 Explain how to prioritize topic for research

Resources Needed
 Flip charts, marker pens, and masking tape
 Black/white board and chalk/whiteboard markers
 Computer and LCD Projector
 Handout 8.1: Research Problem Identification
 Handout 8.2: Examples of Research and Non-Research Problems
 Handout 8.3: Prioritizing Health Problems for Operational Research

SESSION OVERVIEW

Activity/
Step Time Content
Method
1 05 minutes Presentation Introduction, Learning Tasks
Presentation Definition of research problem
2 05 minutes
Brainstorming
Presentation Identification of research problem
3 30 minutes
Buzzing
Presentation Conditions for a problem to be
4 10 minutes
researchable
Presentation Criteria for selecting a research problem
5 55 minutes
Small group discussion
6 05 minutes Presentation Key Points
7 05 minutes Presentation Evaluation
8 05 minutes Presentation Assignment: Identification and selection of
problem for research proposal
___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 55
___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 56
SESSION CONTENTS

STEP1: Presentation of Session Title and Learning Tasks (5 minutes)

READ or ASK students to read the learning tasks and clarify

ASK students if they have any questions before continuing

STEP 2: Definition of Research Problem (5 minutes)

Activity: Brainstorming (3 minutes)

Ask students to brainstorm on the following question:

 What is a research problem?

ALLOW few students to respond

WRITE their responses on the flip chart/ board

CLARIFY and SUMMARISE by using the content below

 Identification and formulation of research problem is the first step of research process
 A research problem is:
o a definite or clear expression [statement] about an area of concern,
o a condition to be improved upon,
o a difficulty to be eliminated, or a troubling question that exists in scholarly literature,
in theory, or within existing practice that points to a need for meaningful
understanding and deliberate investigation.
o A question that a researcher wants to answer or a problem to be solved

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 57
STEP 3: Identification of Problems for Research (30 minutes)

Activity: Buzzing (5 minutes)

ASK students to pair up and buzz on the following question for 2 minutes

 What methods can you use to identify problems for research in your profession?

ALLOW few pairs to respond and let other pairs to add on points not mentioned

WRITE their responses on the flip chart/whiteboard

CLARIFY and SUMMARIZE by using the content below

Research problems can be identified through:

 Personal experiences
 Practical experiences
 Review of records/reports
 Critical appraisal of literature
 Previous research
 Existing theories
 Consumer/user feedback
 Performance improvement
 Social issues
 Management meetings
 Brainstorming

STEP 4: Conditions for a problem to be researchable (10 minutes)

Whether a problem situation requires research depends on three conditions:
 There should be a perceived difference or discrepancy between what exists and the
ideal or planned situation
 The reason(s) for this difference should be unclear (so that it makes sense to develop
research questions)
 There should be more than one possible answer to a question or more than one
solution to the problem.

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 58
STEP 5: Criteria for Selecting Health-Related Problems to be Given
Priority in Research (55 minutes)
Activity: Small Group Discussion (20 minutes)

DIVIDE students into small manageable groups

ASK students to discuss on the following question

 ‘What are criteria for selecting health – related problems?

ALLOW students to discuss for 10 minutes

ALLOW few groups to present and the rest to add points not mentioned

CLARIFY and SUMMARIZE by using the contents below

 When there are many potential topics for research, a decision should be made to select
one, which is of high priority
 To do so, we need to compare the topics using some criteria.
 The following are useful criteria:
o Relevance
o Avoidance of duplication
o Urgency of data (timeliness)
o Political acceptability of study
o Feasibility of study
o Applicability of results
o Ethical acceptability
 Each criterion has the rating scale to enable one to decide which problem to select.
The following are the criteria and their rating scales
 Relevance
o the topic should be relevant
o How large or widespread is the problem?
o Who is affected?
o How severe is the problem?

Rating scale (scores)

1 = Not relevant
2 = Relevant
3 = Very relevant

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 59
 Avoidance of duplication
We should avoid duplicating what is already well established
o Check literature to see if the topic has been researched in the same area or elsewhere.
o If so, ask whether there are issues that remain to be investigated

Rating scale (scores)

1= Sufficient information available
2 = Some information available but major issues not covered
3 = No sound information available
 Urgency of data (timeliness)
o How urgently are the results needed?
o Consider which research should be done first and which can be done later

Rating scale (scores)

1= Information not urgently needed
2 = Information could be used right away but a delay of some months would be
acceptable
3 = Information very urgently needed for use
 Political acceptability of study
Is the topic supported by the local/national authorities?

Rating scale (scores)

1=Topic not acceptable
2=Topic slightly acceptable
3=Topic fully acceptable

 Feasibility of study
o Can the study be done with the available resources?
o Consider human, material, financial, time

Rating scale (scores)

1= Study not feasible
2= Study feasible
3= Study very feasible
 Applicability of results
Is it likely that the recommendations from the study will be implemented?

Rating scale (scores)

1=No chance of being implemented
2=Some chance of being implemented
3=Good chance of being implemented
___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 60
 Ethical acceptability
o Is the study going to cause ethical concerns?
o Acceptability by research students;
o Can consent to participate be easily obtained?
o Will the students be injured in any way?

Rating scale (scores)

1=Major ethical problems
2=Minor ethical problems
3=No ethical problems

After carefully assessing and scoring the topics based on the criteria, select one with
the highest score.

STEP 4: Key Points (5 minutes)

 When there are many potential topics for research, a decision should be made to select
one, which is of high priority
 After carefully assessing and scoring your topics and problem based on the criteria, select
the one with the highest score

STEP 5: Evaluation (5 minutes)

 What are criteria for selecting health-related problems?
 What is a group consensus technique used to set priorities for research?

STEP 6: Assignment (10 minutes)

Activity: Take Home Individual Assignment (10 minutes)

ASK each student to work on the following Assignment

 Select an appropriate problem for your research proposal

ALLOCATE time for students to do the assignments and submit

REFER students to recommended reference

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 61
 Handout 8.1: Research Problem Identification
 Problem Identification
o Finding a problem is not difficult but identifying one for the purpose of research is not
always easy.
o Identifying a problem situation is the first essential step in designing a research
proposal, but it must then be followed by a process of problem definition.
o The research problem identified must be defined in terms of its occurrence, intensity,
distribution, and other measures for which data are already available.
o The aim is to determine all that is currently known about the problem and the reason
it exists.
o All research is set in motion by the existence of a problem.
o A problem is a perceived difficulty, a feeling of discomfort about the way things are,
or a discrepancy between what someone believes should be the situation and what the
situation is in reality.
o While problems are the initiating force behind research, not all problems require
research.
o A potential research situation arises when three conditions exist:
 A perceived discrepancy exists between what is and what should be.
 A question exists about why there is a discrepancy.
 At least two possible and plausible answers exist to the question.
 If there is only one possible and plausible answer to the question about the
discrepancy, then a research situation does not exist.
 Problem Justification
o After the problem is identified, it is necessary next to justify the importance of the
problem. Research often is expensive and time consuming.
o Find out why the problem you wish to study is important.
Ask yourself the following questions: Can you justify your selection of the research
problem? Can you convince others that the problem is important?
 What to Do: Justifying the Selection of a Research Problem
o In justifying the importance of a research problem, it is helpful to ask yourself a series
of questions and then try to answer each of them.
 Is the problem you wish to study a current and timely one?
 Does the problem exist now? How widespread is the problem? Are many areas
and many people affected by the problem?
 Does the problem affect key populations, such as youth, people living with
HIV/AIDS (PLHA), mothers, or children?

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 62
  Does the problem relate to ongoing program activities?
 Does the problem relate to broad social, economic, and health issues, such as
unemployment, income distribution, poverty, the status of women, or education?
 Who else is concerned about the problem? Are top government officials
concerned? Are medical doctors or other professionals concerned?
o Review your answers to these questions, and arrange them into one or two paragraphs
that justify the importance of the research problem.
o Start by discussing the broad issues that justify the problem and then begin to focus
on the more specific issues related to a particular population group or geographical
setting.
 Sample Research Problem Justification
o Over time, millions of HIV-infected people in Africa and elsewhere in the world are
developing HIV-related illnesses. In most African countries, hospitals, clinics, and
other formal health care institutions simply cannot cope with the large numbers of
people in need of physical care and social and psychological support.
o In some hospitals, well over half of the beds are already occupied by AIDS patients.
In some countries the figure is as high as 70 percent of all hospital beds. This is a
problem of great concern to health care planners, as well as to the Ministry of
Finance, which simply does not have the resources to build new facilities or train
large numbers of new providers.
o The problem of providing care and support for PLHA is particularly challenging in
rural areas because there are relatively few health facilities or adequately trained
providers available. In this situation, an alternative is to provide care, support, and
treatment in the homes of those with AIDS. How to do this in a cost-effective manner
while simultaneously providing high-quality services is a challenge.
o New models of delivering care and support services in rural areas need to be
developed and tested to improve the quality of life for PLHA.
o Without effective new approaches, large numbers of people with AIDS will suffer
physical and psychological pain that might otherwise be avoided or at least lessened.
 Comments on the Sample Justification:
o The first paragraph establishes the dimensions of the problem. The large number of
people with AIDS cannot be adequately treated or supported by the formal health care
system, which is already overwhelmed in many countries.
o The second paragraph notes that the problem is particularly acute in rural areas, where
health facilities and providers are relatively few in number. An alternative is to
provide services to PLHA in their homes. The important question is how to do this.
o The paragraph ends by saying that without the development of new approaches to
care and support, large numbers of PLHA will needlessly suffer.

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 63
 Handout 8.2: Examples of Research and Non-Research Problems

Example of a Non-Research Problem

 Problem Situation
o A recent situation analysis assessment of a hospital in District A found that 125 HIV
positive adults were coming to the hospital every day as part of a DOTS program to
take medication for tuberculosis (TB). But last month’s service statistics from the
hospital’s DOTS program revealed that for one entire week, none of the 125 patients
received any medication.
o Discrepancy
All 125 patients should be receiving a daily treatment for TB, but all 125 did not
receive a single treatment for an entire week last month.
o Problem Question
What factor or factors are responsible for 125 patients’ failing to receive any
treatment for their TB for an entire week?
o Answer
 During the week when the patients did not receive daily TB treatments, a very
heavy rainstorm caused flooding that washed out several roads and destroyed a
major bridge that is used to bring supplies to the district hospital. Because of the
flooding and the destroyed bridge, the hospital ran out of TB medication, and a
resupply truck could not reach the hospital for one week while the bridge was
being repaired.
 In this example, a problem situation exists, but the reason for the problem is
already known. Therefore, assuming that all the facts are correct, there is no
reason to conduct research on the factors associated with the break in the supply
of daily TB medication for 125 patients.
 Nonetheless, there may very well be a need to conduct research on the question of
why the supply logistics system is incapable of providing medication during the
rainy season, when it is known that roads and bridges are frequently damaged.

 Problem Situation
o A recent provincial study revealed great differences among villages in the
prevalence of HIV-positive persons. Despite the fact that all villages receive the
same level of health education and services from the Ministry of Health, some
___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 64
 villages have an HIV prevalence rate as high as 32 percent among adults from 15
to 49 years old, while other villages have a rate as low as 6 percent.

o Discrepancy
In a relatively small geographic area, you would expect that all villages should
have approximately the same sero-prevalence rate but, in fact, there is great
variation among villages.

o Problem Question
Which factors are responsible for the geographic variation in HIV prevalence
among villages?

o Possible Answers
 Villages differ in their socioeconomic environments, and these differences
influence the context within which HIV is transmitted.
 Some are stable agricultural villages, while some are mobile fishing
communities.
 Some villages are located on major roads and have easy access to market
towns; others are more remote with very difficult access to market centers.
Some villages
 have schools, health clinics, electricity, and a good water supply, while others
do not have these advantages.
 These and many other social, economic, and cultural differences affect the
context within which sexual relations take place and HIV is transmitted.
 Villages differ in individual and institutional support for HIV/AIDS
prevention, care and support programs.
 In some villages, influential local leaders strongly support sexual behavior
change and condom distribution programs.
 In other villages, people are resistant to these programs, and there is
substantial stigma and discrimination associated with HIV/AIDS.
 In some villages, there are very active anti-AIDS clubs for youth, strong
PLHA organizations, and effective orphan care NGOs.
 In other villages these institutions are absent. These differences in
individual
commitment to and institutional support for HIV/AIDS programs affect the
sexual behavior of individuals, the use of condoms, the level of stigma and
discrimination, and the transmission of HIV.
o While the problem situation presented above is clear, the possible and plausible
reasons for the problem are complex. Several of these reasons have been
described, but it is very likely there are many more.
o In situations such as this one, the researcher must devote considerable time and
attention to identifying and clearly defining the problem situation before any

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 65
 potential solutions to the problem can be tested experimentally through a
longitudinal operations research study.
o The aim of clearly identifying and defining a problem situation is to focus the
research on the most important aspects of a problem that can be changed through a
program intervention.

Handout 8.3: Prioritizing Health Problems for Operational Research

 Relevance
o The topic you choose should be a priority problem.
o Questions to be asked include:
 How large or widespread is the problem?
 Who is affected?
 How severe is the problem?
o If you do not consider a topic relevant, it is not worthwhile to continue rating it. In
that case you should drop it from your list.
o Try to think of serious health problems that affect a great number of people or of the
most serious problems that are faced by clinicians in the area of your work.
o Also, consider the question of who perceives the problem as important. Health
managers, health staff and community members may each look at the same problem
from different perspectives.
o Community members, for example, may give a higher priority to economic concerns
than to certain public health problems.
o To ensure full participation of all parties concerned, it is advisable to define the
problem in such a way that all have an interest in solving it. Even within villages,
opinions may differ on how important a problem is.
o It is therefore obligatory to discuss the problem with community leaders, as well as
peripheral villagers, males as well as females, rich and poor, exploring their
perceptions of the problem.

 Avoidance of Duplication
o Before you decide to carry out a study, it is important that you find out whether the
suggested topic has been investigated before, either within the proposed study area or
in another area with similar conditions.
o If the topic has been researched, the results should be reviewed to explore whether
major questions that deserve further investigation remain unanswered. If not, another
topic should be chosen.
o Also, consider carefully whether you can find answers to the problem in already

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 66
 available, unpublished information or just by using your common sense. If so, you
should drop the topic from your list.

 Urgency of Required Solution (Timeliness)

o How urgently are the results needed for making a decision or developing interventions
at various levels (from community to policy)? Consider which research should be
done first and which can be done later.
 Political Acceptability
o In general, it is advisable to research a topic which has the interest and support of the
Local/national authorities. This will increase the chance that the results of the study
will be implemented.

o Under certain circumstances, however, you may feel that a study is required to show
that the government's policy needs adjustment. If so, you should make an extra effort
to involve the policy-makers concerned at an early stage, in order to limit the chances
for confrontation later.

 Feasibility
o Look at the complexity of the problem and the resources you will require to carry out
your study and time required for intervention. Thought should be given first to
manpower, time, equipment and money that are locally available.

o In situations where the local resources necessary to carry out the processes are not
sufficient, you might consider resources available at the national level. Finally,
explore the possibility of obtaining technical and financial assistance from external
sources.
 Applicability of Possible Results/Recommendations
o Is it likely that the recommendations from the study will be applied? This will depend
not only on the management capability within the team and the blessing of the
authorities but also on the availability of resources for implementing the
recommendations.
o Likewise, the opinion of the potential clients and of responsible staff will influence
the implementation of recommendations.

 Ethical Acceptability
o We should always consider the possibility that we may inflict harm on others while
carrying out research or any intervention.
o Therefore, consider important ethical issues such as:
 How Cultural sensitivity must be given careful consideration.
 Informed consent be obtained from the research subjects.
 Will the condition of the subjects be taken into account? For example, if
individuals are identified during the study who require treatment, will this
treatment be given?
___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 67
  What if such treatment interferes with your study results?
• Will the results be shared with those who are being studied?
• Will the results be helpful in improving the lives or health of those studied?
 Scales for rating research topics
These criteria can be measured by the following rating scales:
o Relevance
1. = Not relevant
2. = Relevant
3. = Very relevant
o Avoidance of duplication
1. = Sufficient information already available
2. = Some information available but major issues not covered

3. = No sound information available on which to base problem-solving

o Urgency
1. = Information not urgently needed
2. = Information could be used right away but delay of some months would be
acceptable
3. = Data very urgently needed for decision-making
o Political Acceptability
1. = Topic not acceptable to high level policymakers
2. = Topic more or less acceptable
3. = Topic fully acceptable
o Feasibility
1. = Study not feasible, considering available resources
2. = Study feasible, considering available resources
3. = Study very feasible, considering available resources
o Applicability
1. = No chance of recommendations being implemented
2. = Some chance of recommendations being implemented
3. = Good chance of recommendations being implemented
o Ethical acceptability
1. = Major ethical problems
2. = Minor ethical problems
3. = No ethical problems

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 68
Session 9: Analysis and Statement of the Problem

Total Session Time: 120 minutes

Prerequisites
 None

Learning Tasks
By the end of this session students are expected to be able to:
 Identify factors contributed to the problem.
 Clarify the relationship between the problem and contributing factors.
 Decide on the scope and focus of the research
 Formulate the problem statement

Resources Needed
 Flip charts, marker pens, and masking tape
 Black/white board and chalk/whiteboard markers
 Computer and LCD Projector
 Handout 9.1: Formulating the Problem Statement
 Handout 9.2: Sample Problem Analysis Diagram

SESSION OVERVIEW

Ste Activity/
Time Content
p Method
1 05 minutes Presentation Introduction, Learning Tasks
Presentation Factors Contributed to the Problem.
2 30 minutes
Group discussion
3 Presentation Relationship Between the Problem and
15 minutes Brainstorming Contributing Factors.

4 10 minutes Presentation The Scope and Focus of the Research

45minutes Presentation Formulation of the Problem Statement

5
Group discussion
6 05 minutes Presentation Key Points

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 69
7 05 minutes Presentation Evaluation
8 05 minutes Presentation Assignment

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 70
SESSION CONTENTS

STEP1: Presentation of Session Title and Learning Tasks (5 minutes)

READ or ASK students to read the learning tasks and clarify

ASK students if they have any questions before continuing

STEP 2: Factors Contributed to the Problem (30 minutes)

Activity: Small Group Discussion (20 minutes)

DIVIDE students into small manageable groups

ASK students to discuss on the following question

 ‘What are the factors contributed to the problem you have selected?

ALLOW students to discuss for 10 minutes

ALLOW few groups to present and the rest to add points not mentioned

CLARIFY and SUMMARIZE by using the contents below

Analyzing the problem is a very crucial step in designing the research because it:
 Enables those concerned to pool their knowledge of the problem
 Clarifies the problem and the possible factors that may be contributing to it
 Facilitates decisions concerning the focus and scope of the research
 The factors contributed to the problem
o You have to specify and describe the core problem you selected after prioritization
 Quantify the selected problem. After identifying the core problem, you should:
o Identify factors that may have contributed to the problem.
o Clarify the relationship between the problem and contributing factors
o It is helpful to visualize these inter relationships in the form of a diagram.
o The basic principles of constructing such a diagram are illustrated below

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 71
 Identify further contributing factors.
o Extend the problem analysis diagram further by identifying additional factors that
could have contributed to or aggravated the problem.
o It may be possible to identify several ‘generations’ of predisposing factors, by asking
‘but why’
 Organise related factors together into larger categories and develop final draft diagram.
For example
o Many researchers group contributing factors into four main categories:
 Socio-cultural factors
 Economic factors
 Service-related factors
 Disease-related factors

STEP 3: Relationship Between the Problem and Contributing Factors

(15 minutes)
Activity: Buzzing (5 minutes)

ASK students to pair up and buzz on the following question for 2 minutes

 What is the relationship between the problem and contributing factors?

ALLOW few pairs to respond and let other pairs to add on points not mentioned

WRITE their response on the flip chart/board

CLARIFY and SUMMARIZE by using the content below

 The relationships between contributing factors and the problem can be indicated by
arrows
o One-way arrow (for cause-effect relationships) or
___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 72
 o Two-way arrows (for mutual relationships)
 The core problem can be identified by drawing a double line around it

STEP 4: The Scope and Focus of the Research (10 minutes)

 Scoping is figuring out what, exactly, to explore for a study
 Decide on the focus and scope of the research
 Not necessary to research on all factors if too many

STEP 5: Formulation of the Problem Statement (45 minutes)

Activity: Small Group Discussion (25 minutes)

DIVIDE students into small manageable groups

ASK students to formulate statement of the problem they have selected from prioritization

ALLOW them to discuss for 15 minutes

ALLOW few groups to present and the rest to add points not mentioned

CLARIFY and SUMMARIZE by using the contents below

What information should be included in the statement of the problem?

 A brief description of socio-economic and cultural characteristics and an overview of health
status and the health-care system in the country/district in as far as these are relevant to the
problem. Include a few illustrative statistics, if available, to help describe the context in
which the problem occurs.
 A concise description of the nature of the problem (the discrepancy between what is and
what should be) and of the size, distribution and severity of the problem (who is affected,
where, since when, and what are the consequences for those affected and for the services).
For a descriptive study you will elaborate the different components of the problem.
 An analysis of the major factors that may influence the problem and a discussion of why
certain factors need more investigation if the problem is to be fully understood.
 A brief description of any solutions to the problem that have been tried in the past, how
well they have worked, and why further research is needed (justification for your study).
 A description of the type of information expected to result from the project and how this
information will be used to help solve the problem.
 If necessary, a short list of definitions of crucial concepts used in the statement of the
problem.
Writing the statement of the problem
 List the major points plan to include in the problem statement and rearrange them, if

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 73
 necessary, before preparing the written text for the problem statement.
 Use available reports to help specify their problem, and to search for information they do
not have. Part of the literature review, if not all, may be included in the statement of the
problem.
 Preparation of the written problem statement can be done in small groups or individually,
 The description of relevant socio-economic, cultural and health characteristics of the
country and/or district in which the study takes place can be best done at the end, after a
thorough description of the problem, to avoid irrelevant background data. It will be placed
at the beginning of the problem statement.

STEP 6: Key Points (5 minutes)

 Many researchers group contributing factors into four main categories: socio-cultural,
economic factors, service-related factors and disease-related factors
 The core problem can be identified by drawing a double line around it
 Formulation of the problem statement is derived from analysis of the problem, reviewing
report, literature and other relevant information available.

STEP 7: Evaluation (5 minutes)

 What is the relationship between the problem and contributing factors?
 What information do you need to include in the statement of problem?

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 74
STEP 8: Assignment (5 minutes)

Activity: Take Home Individual Assignment (5 minutes)

ASK each student to work on the following Assignment

 Write the statement of the problem you have identified for a research proposal

ALLOCATE time for students to do the assignments and submit

REFER students to recommended reference

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 75
References
Hardon A, Boonmongkon P, and Streefland P. et al (editors)(2001). Applied Health research,
Anthropology of health and health care (3rd Ed.): Amsterdam, The Netherlands: Het
Spinhuis Publishers,

Kothari C.R (1985). Research Methodology – Methods and techniques, (2nd ed): New Delhi,
India: Wiley Eastern Limited

Varkevisser, C. M, Pathmanathan, I and Brownlee, A (1991). Designing and Conducting

Health Systems Research Projects, Vol. 2 Part I.:Ottawa, Canada: IDRC

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 76
 Handout 9.1 Formulating the problem Statement
 Importance of a Well-Defined Problem
o A poorly defined research problem leads to confusion.
o A well-defined research problem statement leads to:
 Statement of research objectives
 Hypotheses
 Definition of key variables
 Selection of a methodology for measuring the variables
 Foundation for the further development of the research proposal
 Ease in finding find information and reports of similar studies from which your
own study design can benefit
 Systematic justification for undertaking the proposed research, and what the
 researcher he/she hope to achieve with the study results
 This is important to highlight when you present your project to community
members, health staff, relevant ministries and donor agencies who need to support
your study or give their consent.
 Statement of the Problem Includes:
o Identification, definition, and justification of the research problem
o One of the most important first tasks of research is to identify and clearly define the
problem you wish to study.
o If you are uncertain about the research problem or if you are not clear in your own
mind about what you want to study, others who read your proposal will also be
uncertain.
o Problem Identification and definition
o While it is always possible to guess why a problem exists, guesses are often wrong
and usually do not provide a firm basis for designing a research study.
o A far better way to define a problem situation is to review relevant literature, examine
current service statistics, seek educated opinions from persons concerned about the
problem, and obtain probable reasons for the problem from social, economic, or
health theory.
o Follow this general procedure when identifying and defining a problem situation:
 Start with a simple statement of the problem situation.
 Add details as you review the literature, review theoretical concepts, and
investigate the problem in greater depth.
 Simplify the focus by identifying the most important aspects of the problem that
are researchable.
 Make a first attempt at identifying the problem situation by using the following format:
o Problem Situation: Write a small, simple paragraph that identifies the problem.
___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 77
 o Discrepancy: State the discrepancy between what is and what should be.
o Problem Question: Write down the central problem question.
o Possible Answers: Write two or more plausible answers to the problem question.
 From the available research literature, health and behavioral theory, current service
 statistics, educated opinions and other sources of information, try to add details to the
problem situation you have just identified. Look for theoretical concepts and operational
variables that you may have missed. List these concepts and variables on a piece of paper
as you come across them. Try to answer
 the following questions:
o What are the incidence and prevalence of the problem?
o Which geographic areas are affected by the problem? Which population groups are
affected by the problem?
o What are the findings of other research studies?
o What has been done to overcome the problem in the past?
o How successful were past efforts to overcome the problem?
o What seem to be major unanswered questions about the problem?
 With the information you have collected from a literature review and other sources,
rewrite your statement identifying and defining the problem. Use the format described
above:
o Problem Situation, Discrepancy, Problem Question, and Possible Answers
o Add details that help to define the problem but organize the information. Try to
establish the boundaries of the problem.
o Focus your attention on the most important, researchable aspects of the problem.
 Have one or more colleagues read your final statement identifying and defining the
problem situation. If they are unclear about the problem situation or cannot describe the
discrepancy between what is and what should be, then go back to the beginning and start
all over again.

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 78
 Handout 9.2: Sample Problem Diagram

Figure below shows the initial problem diagram on Irrational drug use

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 79
Session 10: Literature Review in Research

Total Session Time: 120 minutes + 240 minutes Assignment

Prerequisites
 None

Learning Tasks
By the end of this session students are expected to be able to:
 Describe the reasons for reviewing available literature
 Identify the resources that are available for carrying out such a review
 Prepare index cards for summarization of important information obtained from literature
 Prepare a review of literature pertaining to research topic

Resources Needed
 Flip charts, marker pens, and masking tape
 Black/white board and chalk/whiteboard markers
 Computer and LCD Projector

SESSION OVERVIEW

Activity/
Step Time Content
Method

1 05 minutes Presentation Introduction, Learning Tasks

Presentation
2 15 minutes Reasons for Reviewing Available Literature
Buzzing
Presentation Identification of Resources that are Available
3 10 minutes
Brainstorming for Carrying out Literature Review.
Presentation
4 55 minutes Lecture Summarizing Important Information
discussion Obtained from Index Cards

5 20 minutes Presentation Review of Literature Pertaining to Research

Topic
6 05 minutes Presentation Key Points
7 05 minutes Presentation Evaluation
8 05 minutes Presentation Individual Assignment

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 80
SESSION CONTENTS

STEP1: Presentation of Session Title and Learning Tasks (5 minutes)

READ or ASK students to read the learning tasks and clarify

ASK students if they have any questions before continuing

STEP 2: Reasons for Reviewing Available Literature (15 minutes)

Activity: Small Group Discussion (5 minutes)

DIVIDE students into small manageable groups

ASK students to discuss on the following question

 What are the reasons for reviewing literature?

ALLOW students to discuss for 2 minutes

ALLOW few groups to present and the rest to add points not mentioned

CLARIFY and SUMMARIZE by using the contents below

 A literature review is the reading of the work of others before starting your research and
doing a summary about previous studies on the topic.
 A literature review provides a helpful guide to a topic.
 The focus of a literature review is to summarize and synthesize the arguments and ideas
of others without adding new contributions.
 A researcher needs to find out what has been done already, and build on that foundation,
because scientific research is cumulative.
o This involves determining what has been done and what still needs to be done, and
examining what books and professional journals have already revealed in your area
or country, or in other areas/countries with similar problems/context.
 It prevents you from duplicating work that has been done before.
 It helps you to find out what others have learned and reported on the problem you want to
study. This may assist you in refining your statement of the problem.
 It helps you to become more familiar with the various research approaches that might be
used in your study.
 It should provide you with convincing arguments for why your particular research project is
needed.

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 81
STEP 3: Identification of Resources that are Available for Carrying Out
Literature Review (10 minutes)

Activity: Buzzing (5 minutes)

ASK students to pair up and buzz on the following question for 2 minutes

 ‘What are the resources available for carrying out literature review?

ALLOW few pairs to respond and let other pairs to add on points not mentioned

WRITE their response on the flip chart/board

CLARIFY and SUMMARIZE by using the content below

 Resources that are available for carrying out literature review include:
o People (individuals or groups, organizations)
o Publications (books which compile research information, journals (hard or electronic
copies)
o Unpublished information [grey literature) e.g. Dissertation, research reports not in
journals, computer data base
o Supervisors and fellow students
 Sources could be at different levels of administrative system
o Community level, district and regional levels and provincial level
o National levels – e.g. national libraries, Ministries of Health, central statistics, etc.
o International levels – UNICEF, WHO, USAID, etc.; including computerized search
for international literature

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 82
Sources of Information at Various Levels of Administrative System

SN Administrative level Example of resource

1  Opinions, beliefs of key informants (through
Community and district
interviews), in addition to written sources
or provincial levels
 Clinic- and hospital- based data from routine
statistics, registers
 Clinical observations, reports of critical incidents
 Local surveys, annual service reports
 Statistics issued at provincial and district levels
 Newspapers, books, articles, mimeographed
reports, etc.

2. National Level  Articles from national journals, books identified

during literature searches at university and other
national libraries, WHO, UNICEF libraries, etc.
 Special collections, e.g., newspaper clippings,
archival records, library or congress collections
 Documentation, reports and raw data from:
The Ministry of Health (e.g., 5-year plans)
central statistical offices
Non-governmental organizations

 Information from:
3. International level  Bilateral and multilateral organisations (e.g.,
IDRC, USAID, UNICEF, WHO);
 Computerised searches for international literature
(from national library or international
institutions).

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 83
STEP 4: Summarizing Important Information Obtained from Index Cards
(55 minutes)

 Strategy 1: What to do with identified information

o Read through
o Summarize the content relevant to your study (use index card)
Note pertinent information
 Title of article
 Author
 Title of Journal/Book, Page, Year, etc (see later)
 Aim of study
 Methodology
 Major findings
 Utility of information
 Write the literature review section
 Prepare list of references

 Strategy 2: What to do with identified information

o Organize in groups of related information/themes
o Sequence the information – from far to near (for each theme) e.g. India-Africa-East
Africa-Tanzania
o Write coherently using your own words (be writing not citing); use past tense
o Cite sources properly using recommended style
 Writing a Literature Review
o Organize your notes in groups of related statements according to which aspect of the
problem they touch upon (e.g., community factors, service factors, etc.).
o Use your problem analysis diagram as a framework (and adapt the diagram in turn as
you find more literature).
o Decide in which order you want to discuss the various issues.
 Where Do You Put Which Information?
o Some literature can be used to describe the local context (district, region, country) or
problem.
o All facts mentioned need a source, except some general and well known statements.
o For the description of the selected problem, use all available raw or published
literature.
o Literature from other countries or regions may be used to illustrate your point.
 If these sources are many, you may have a separate section on international
literature.
o More complex studies using theoretical models should have a separate section
discussing

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 84
 these models, which could come after the section of statement of the problem.
o When drafting the background section or the statement of the problem, usually do not
describe sources one by one. Instead, write a coherent discussion in your own words,
using all relevant literature linked to each other.
o It is possible to cite several sources for one statement. Reference all the literature
referred to in your review.
o At the end of your paper, list your references in order, using the format described
above.
o In research proposals, the references come before the annexes.
o Select one style of references (such as Vancouver, Harvard, etc.) and use it
consistently for citations and reference lists in your proposal.

 Bias in Literature
o Bias: A distortion of the available information in such a way that it reflects opinions
or conclusions which do not represent the real situation.
o Understanding the various types of bias helps to be critical of the existing literature.
o If you have reservations about certain references or if you find conflicting opinions in
the literature, then discuss these openly and critically. Such a critical attitude may
help you to avoid biases in your study.
o Common types of bias in literature include:
 Playing down controversies and differences in one's own study results.
 Restricting references to those that support the point of view of the author.
 Drawing far reaching conclusions from preliminary or shaky research results or
making sweeping generalizations from just one case or small study.

STEP 5: Review of Literature Pertaining to Research Topic (20 minutes)

Review of literature pertaining to research topic avoiding the following:
 Plagiarism (pretending information is yours) is defined as:
o An object (language, words, text, diagram, graphs, ideas)
o which has been taken from a source (books, journals, internet, not just text)
o by an agent (person, student, academician)
o without adequate acknowledgement of sources
o with or without intention to deceive
 Bias in literature review
o Suppressing/omitting controversies/ conflicting opinion or differences
o Using author supportive references only
o Over concluding/ generalisation from inadequate data - one case or small study or
poor design
 Such types of bias may have serious ethical implication (may affect people’s health; take
researcher to court)

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 85
STEP 6: Key Points (05 minutes)
 Literature review or search is “a systematic and thorough search of all types of published
literature in order to identify as many items as possible that are relevant to a particular
topic”
 Resources that are available for carrying out such a review are people, publications,
unpublished information, supervisors and fellow students

STEP 7: Evaluation (5 minutes)

 What are the reasons for reviewing available literature?
 What are the resources that are available for carrying out literature review?

STEP 8: Individual assignment (5 minutes)

Activity: Take Home Individual Assignment (5minutes)

ASK individual students to work on the following Assignment

 Review and write literature for the problem of your research proposal

ALLOCATE time for students to do the assignments and submit

REFER students to recommended reference

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 86
References

References
Hardon A, Boonmongkon P, and Streefland P. et al (editors)(2001). Applied Health research,
Anthropology of health and health care (3rd Ed.): Amsterdam, The Netherlands: Het
Spinhuis Publishers,

Kothari C.R (1985). Research Methodology – Methods and techniques, (2nd ed): New Delhi,
India: Wiley Eastern Limited

Varkevisser, C. M, Pathmanathan, I and Brownlee, A (1991). Designing and Conducting

Health Systems Research Projects, Vol. 2 Part I.:Ottawa, Canada: IDRC

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 87
Session 11: Research Objectives and Questions

Total Session Time: 120 minutes + 240 minutes assignment

Prerequisites
 None

Learning Tasks
By the end of this session students are expected to be able to:
 Define general and specific objectives
 Outline the characteristics of research objectives
 State the difference between general and specific objectives
 Prepare research objectives in an appropriate format for the project you are developing
 Develop research questions appropriate for the study

Resources Needed
 Flip charts, marker pens, and masking tape
 Black/white board and chalk/whiteboard markers
 Computer and LCD Projector
 Handout 11.1: Broad and Specific Objectives

SESSION OVERVIEW

Activity/
Step Time Content
Method
1 05 minutes Presentation Introduction, Learning Tasks
10 minutes Presentation
2 Definition of General and Specific Objectives
Brainstorming
10 minutes Presentation
3 Characteristics of Research Objectives
Brainstorming
Presentation The Difference Between General and Specific
4 20 minutes
Buzzing Objectives
35 minutes Presentation
5 Preparation of Research Objectives
Lecture discussion

6 Development of Research Questions

25 minutes Presentation
05 minutes
7 Presentation Key Points
8 05 minutes Presentation Evaluation
9 05 minutes Presentation Assignment
___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 88
SESSION CONTENTS

STEP1: Presentation of Session Title and Learning Tasks (5 minutes)

READ or ASK students to read the learning tasks and clarify

ASK students if they have any questions before continuing

STEP 2: Definition of General and Specific Objectives (10 minutes)

Activity: Buzzing (5 minutes)

ASK students to pair up and buzz on the following questions for 2 minutes

 What is an objective?

ALLOW few pairs to respond and let other pairs to add on points not mentioned

WRITE their response on the flip chart/board

CLARIFY and SUMMARIZE by using the content below

 Research studies should include a statement of
o Broad objective
o Specific objectives
o Hypotheses (except in the case of purely exploratory or descriptive studies)
 Objectives: Summary of what is intended to be achieved by the study.
 General objective also known as Broad objective
o The objective of a research project summarizes what is to be achieved by the study.
o The general objective of a study states what is expected to be achieved by the study in
general terms.
o It is possible (and advisable) to break down a general objective into smaller, logically
connected parts. These are normally referred to as specific objectives.
o Related to core problem
o Shows target population and place
o Use action verb
o Normally only one per study
 Specific objectives
o Explain the broad objective in specific
o Should systematically address:
 The various aspects of the problem’
 Key factors that are assumed to influence or cause the problem.
___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 89
  They should specify what you will do in your study, where and for what purpose.
 Usually focuses on quantifying or specifying the problem

 Hypothesis
o Statement/a specific prediction about the nature and expected direction of
the relationship between two or more variables that permit empirical testing.
 Why should research objectives be developed?
o To clarify and focus your intentions /focus the study (narrowing it down to essentials).
o To have a basis for measuring your achievements at the end of the study.
o To avoid the collection of data which are not strictly necessary for understanding and
solving the problem, you have identified.
o To organize the study in clearly defined parts or phases.
o To facilitate the development of your research methodology and orient the collection,
analysis, interpretation and utilization of data.

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 90
STEP 3: Characteristics of Research Objectives (10 minutes)

Activity: Brainstorming (3 minutes)

Ask students to brainstorm on the following question:

 What are characteristics of research objectives?

ALLOW few students to respond?

WRITE their responses on the flip chart/ board

CLARIFY and SUMMARISE by using the content below

 Objectives must be SMART.

o S = Specific: Specifying exactly what you are going to do, where, and for what
purpose.
o M= Measurable: Can be evaluated.
o A = Action oriented.
o R = Realistic: Considering local conditions can be done.
o T = Time bound: When exactly will the activities be carried out? Pharmaceutical
services dispensaries, then the general objective of the study could be to identify the
reasons for this low utilization pharmaceutical services dispensaries in Mongoro
district, in order to find solutions.
 Formulating Specific Objectives
o Specific objectives should systematically address the various aspects of the problem
as defined under 'Statement of the Problem’ and the key factors that are assumed to
influence or cause the problem.
o They should specify what you will do in your study, where and for what purpose.
 The first specific objective usually focuses on quantifying or specifying the problem.
 It may be helpful to use the diagram as a point of departure and check whether the
problem and all major, directly contributing factors (analytic study) or major components
(descriptive or evaluation study) have been covered by the objectives.
 An objective indicating how the results will be used should be included in every
operational study, either as part of the general objective or as a specific objective.

Refer students to Handout 11.1: Broad and Specific Objectives

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 91
 How to State Objectives
o It should cover the different aspects of the problem and its contributing factors in a
coherent way and in a logical sequence.
o Are clearly phrased in operational terms, specifying exactly what you are going to do,
where, and for what purpose.
o Are realistic considering local conditions.
o Use action verbs that are specific enough to be evaluated.
 Examples of action verbs are, to determine, to reduce, to compare, to verify, to
calculate, to describe, and to establish.
o Avoid the use of vague non-action verbs such as, to appreciate, to understand, or to
study.
o Example of a Broad Objective: To determine factors associated with irrational
prescribing habits in district A.
o Examples of Specific objectives from the above broad objectives
 To determine the magnitude of irrational prescribing habits in district A.
 To identify number of drugs prescribed per prescription
 To verify the availability of appropriate reference materials e.g.STG at
prescriber’s office
 To assess availability of essential drugs in the past 3 months
 Hypothesis
o It is ideally a prediction of an expected relationship between one or more factors and
the problem under study which can be tested.
o Are appropriate for field intervention or evaluation studies.
o Exploratory studies do not normally require hypothesis because they generally do not
test relationships between variables.
o Two types of research hypothesis are Null hypothesis and Alternative hypothesis

o A Null Hypothesis is the one that is stated in negation form. It indicates that there is no
relationship between variables. It is donated as (Ho). Example: Improved prescribing
habits have no effect in rational use of drugs
 Alternation hypothesis (working hypothesis) is stated to indicate the actual
expectation.
 It is donated as (H1).
 Improved prescribing habits improves rational use of drugs.

 Difference between Null Hypothesis and Alternative Hypothesis

o The Null Hypothesis denies the existence of any significant differences between any
compared values and stresses that even when such differences are observed, they have
occurred by chance.
o The Alternative Hypothesis is formulated in a way as to reject the null hypothesis.

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 92
 o It states that there is a significant cause of the observed differences between
compared values and that the difference did not happen by chance.

STEP 4: The Difference Between General and Specific Objectives

(20 minutes)

Activity: Buzzing (5 minutes)

ASK students to pair up and buzz on the following question for 2 minutes

 ‘What are the differences between broad and specific objectives?

ALLOW few pairs to respond and let other pairs to add on points not mentioned

WRITE their response on the flip chart/board

CLARIFY and SUMMARIZE by using the content below

 General objectives are broad and long-term while specific objectives are short term
and narrow in focus

 The general objective is met through accomplishing each of the specific objectives.
Specific objectives is to specify what really you want to concentrate with or what you
want to do, show the main point you are focusing to

STEP 5: Preparation of Research Objectives in an Appropriate Format for

the Developed Project (35 minutes)
 Take care that the objectives of your study:
o Cover the different aspects of the problem and its contributing factors in a coherent
way and in a logical sequence
o Are clearly phrased in operational terms, specifying exactly what you are going to do,
where, and for what purpose;
o Are realistic considering local conditions; and
o Use action verbs that are specific enough to be evaluated
 Examples of action verbs are to determine, to compare, to verify, to calculate, to
describe, and to establish
 Avoid the use of vague non-action verbs such as: to appreciate, to understand, or
to study
o It is not necessary to develop an objective for every single contributing factor

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 93
STEP 6: Development of Research Questions Appropriate for the Study
(25 minutes)
Research question: Statement that identifies the phenomenon, situation or certain
Characteristics to be studied?

 It's essential to develop a research questions that you're interested in or care about in order
to focus your research
For example,
o Researching a broad topic such as "business management" is difficult since there may
be hundreds of sources on all aspects of business management.
o On the other hand, a focused question such as "What are the pros and cons of
Japanese management style?" is easier to research and can be covered more fully and
in more depth.
o How do you develop a usable research question?
 Choose an appropriate topic or issue for your research, one that actually can be
researched
 Then list all of the questions that you'd like answered yourself.
 Choose the best question, one that is neither too broad nor too narrow.
 Sometimes the number of sources you find will help you discover whether your research
question is too broad, too narrow, or okay?
 If you know a lot about the topic, you can develop a research question based on your own
knowledge. If you feel you don't know much about the topic, think again.
 It's a good idea to evaluate your research question and to ask for feedback on your
research question.
 Once you complete your list, review your questions in order to choose a usable one that is
neither too broad nor too narrow.
 In this case, the best research question is "three"
o Question "one" is too narrow, since it can be answered with a simple statistic
o Question "two" is too broad; it implies that the researcher will cover many tactics for
reducing the problem of irrational drug use that could be used throughout the country
o Question "three," on the other hand, is focused enough to research in some depth

STEP 7: Key Points (5 minutes)

 Writing introduction to research proposal leads the reader from a general subject area to a
topic of inquiry
 The general objective of a study states what is expected to be achieved by the study in
general terms Specific objectives explain the broad objective in specific

STEP 8: Evaluation (5 minutes)

 What is objective?
 What are general and specific objectives?
___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 94
 What are the characteristics of research objectives?
STEP 9: Assignment (5 minutes)

Activity: Take Home Individual Assignment (05 minutes)

DIVIDE students in groups or individuals

ASK the students to work on the following Assignment

 Formulate broad and specific research objectives, hypothesis and questions for your
research proposal

ALLOCATE time for students to do the assignments and submit

REFER students to recommended reference

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 95
References
Hardon A, Boonmongkon P, and Streefland P. et al (editors)(2001). Applied Health research,
Anthropology of health and health care (3rd Ed.): Amsterdam, The Netherlands: Het
Spinhuis Publishers,

Kothari C.R (1985). Research Methodology – Methods and techniques, (2nd ed): New Delhi,
India: Wiley Eastern Limited

Varkevisser, C. M, Pathmanathan, I and Brownlee, A (1991). Designing and Conducting

Health Systems Research Projects, Vol. 2 Part I.:Ottawa, Canada: IDRC

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 96
 Handout 11.2: Examples of Broad and Specific Objectives

First Example

 A study into the cost and quality of home-based care for HIV/AIDS patients and their
communities in Tanzania, was developed. It had its general
objective:
o To explore to what extent Community Home-Based Care (CHBC) projects in
Tanzania provide adequate, affordable and sustainable care of good quality to people
with HIV/AIDS, and to identify ways in which these services can be improved.

o It was split up in the following specific objectives:

 To identify economic, psychosocial and other needs of patients and their families
affected by AIDS.
 To determine the extent to which formal and informal support systems address
these needs from the viewpoint of service providers as well as patients.
 To determine the economic costs of CHBC to the patient and family as well as to
the formal CHBC programme.
 To relate the calculated costs to the quality of care provided to the patient by the
family and to the family/patient by the CHBC programme.
 To determine how improved CHBC and informal support networks can contribute
to the needs of persons with AIDS and other chronically and terminally ill
patients.
 To use the findings to make recommendations on the improvement of CHBC to
home care providers, donors and other concerned organisations, including
government.
 In the example given above, the needs of AIDS patients and their relatives for care and
support have been defined in the first objective. The objectives which follow concentrate
on adequacy, cost and quality of care provided whereas the last two objectives specify
possible improvements with respect to CHBC, and to whom the results and
recommendations of the study will be fed back

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 97
Session 12: Review of Study Types/Designs

Total Session Time: 120 minutes

Prerequisites
 None

Learning Tasks
By the end of this session students are expected to be able to:
 Describe the study types most used in research
 Explain uses and limitation of each study type most used in research
 Describe how the study design can influence the validity and reliability of the study result
 Identify the most appropriate study design for research proposal being developed

Resources Needed
 Flip charts, marker pens, and masking tape
 Black/white board and chalk/whiteboard markers
 Computer and LCD Projector

SESSION OVERVIEW

Activity/
Step Time Content
Method

1 05 minutes Presentation Introduction, Learning Tasks

Presentation
2 40 minutes Study Types Most Used in Research
Brainstorming
Presentation Uses and Limitation of Study Types most Used in
3 35 minutes
Buzzing Research

4 15 minutes Presentation Influence of Study Design on the Validity and

Reliability of the Study Result
10 minutes Presentation
5 Identification of the Most Appropriate Study Design
for Research Proposal being developed
6 05 minutes Presentation Key Points
7 05 minutes Presentation Evaluation
8 05 minutes Presentation Assignment

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 98
SESSION CONTENTS

STEP1: Presentation of Session Title and Learning Tasks (5 minutes)

READ or ASK students to read the learning tasks and clarify

ASK students if they have any questions before continuing

STEP 2: Study Types Most Used in Research (10 minutes)

Activity: Brainstorming (10 minutes)

Ask students to brainstorm on the following question:

 What study types are mostly used in research?

ALLOW few students to respond?

WRITE their responses on the flip chart/ board

CLARIFY and SUMMARISE by using the content below

REFER SESSION 6

STEP 3: Uses and Limitation of Each Study Type Most Used in Research
(10 minutes)

Activity: Buzzing (5 minutes)

ASK students to pair up and buzz on the following question for 2 minutes

 ‘What are the uses and limitation of each study type most used in research?

ALLOW few pairs to respond and let other pairs to add on points not mentioned

WRITE their response on the flip chart/board

CLARIFY and SUMMARIZE by using the content in SESSION 6

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 99
___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
100
STEP 4: Influence of Study Design on the Validity and Reliability of the
Study Result (15 minutes)
 Validity: means that your scientific observations actually measure
what they intend to
measure (your conclusions are true).
o Internal validity: Difference in the dependent variable is actually a
result of the
o independent variable.
o External validity: Results of the study are generalizable to other
groups and
environments outside the experimental setting.

 Reliability: means that someone else using the same method in the
same circumstances
should be able to obtain the same findings (your findings are
repeatable).
o Reliability (repeatability) refers to the possibility to replicate
(repeat) the observations
and is related to the precision of the instrument used for scientific
observations.
o Validity refers to the soundness of the observations and to the
accurateness of the data collected by the research
method/instrument.

STEP 5: Identification of the Most Appropriate Study Design for Research

(10 Minutes)
 Consider:
o Nature of the problem/topic
o State of knowledge about the problem/topic
o Resources available
o Skills of the researcher

STEP 6: Key Points (5 minutes)

 A descriptive study involves describing the characteristics of a particular situation, event
or case
 An analytical study attempts to establish causes or risk factors for certain problems
 Any study designs used, should give valid and reliable findings

STEP 7: Evaluation (5 minutes)

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
101
 What study types are most used in research?
 What will you consider when selecting study design for research proposal?

STEP 8: Assignment (5 minutes)

Activity: Take Home Individual Assignment (5 minutes)

ASK each student to select an appropriate study type/design for a research proposal being
developed

ALLOCATE time for students to do the assignment and submit

REFER students to recommended reference

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
102
References
Hardon A, Boonmongkon P, and Streefland P. et al (2001). Applied Health research,
Anthropology of health and health care, (3rd Ed) Amsterdam, The Netherlands: Het
Spinhuis Publishers

Beaglehole R, Bonita R and Kjellstrom (1993) Basic epidemiology: Geneva, Switzerland:

World Health Organization,

Kothari C.R (1985). Research Methodology – Methods and techniques, (2nd ed); New Delhi,
India; Wiley Eastern Limited

Stewart A (2001). Basic Statistics and epidemiology, A practical guide,; London, United
Kingdom: Radcliffe Medical Press,

Varkevisser, C. M, Pathmanathan, I and Brownlee, A (1991). Designing and Conducting

Health Systems Research Projects, Vol. 2 Part I: Ottawa, Canada: IDRC

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
103
Session 13: Research Sampling

Total Session Time: 120 minutes + 240 minutes assignment

Prerequisites
 None

Learning Tasks
By the end of this session students are expected to be able to:
 Define the common terms used in sampling
 Identify the population(s) to be studied
 Describe common methods of sampling
 Explain reasons for sampling
 Describe source of bias in sampling that should be avoided

Resources Needed
 Flip charts, marker pens, and masking tape
 Black/white board and chalk/whiteboard markers
 Computer and LCD Projector
 Handout 13.1: Types of sampling methods and when to use it

SESSION OVERVIEW

Activity/
Step Time Content
Method
1 05 minutes Presentation Introduction, Learning Tasks

2 20 minutes Presentation Definition of the Common Terms Used in Sampling

20 minutes Presentation Identification of the Population(s) to be Studied

3
Buzzing
35 minutes Presentation
4 Group Common Methods of Sampling
discussion
5 10 minutes Presentation Reasons for Sampling

6 15 minutes Presentation Source of Bias in Sampling that Should be Avoided

7 05 minutes Presentation Key Points

8 05 minutes Presentation Evaluation
9 05 minutes Presentation Assignment
___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
104
SESSION CONTENTS

STEP1: Presentation of Session Title and Learning Tasks (5 minutes)

READ or ASK students to read the learning tasks and clarify

ASK students if they have any questions before continuing

STEP 2: Definition of Common Terms Used in Sampling (20 minutes)

 Sampling: Process of selecting a number of study units from a defined study population.
o For studies which involve only small numbers of people all of them can be included
in the investigation.
o For research which focuses on a large population, for practical reasons, it is only
possible to include some of its members in the investigation. It is important to draw a
sample from the total population.
 Sampling unit
o A single section selected to research and gather statistics of the whole.
o For example, when studying a group of college students, a single student could be a
sampling unit.
o Unit of selection in the sampling process, e.g. Person, a school, a household, etc.
 Sampling frame
o a list of units from which a sample is to be picked
 Sampling fraction (sampling ratio)
o a proportion of sampling units to be picked from a specified sampling frame
= number units in a sample
number of units in sampling frame
 Sampling interval
o An interval at which units are picked from a sampling frame when systematic
sampling is done.

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
105
STEP 3: Identifying the Population (s) to be Studied (20 minutes)
Activity: Buzzing (5 minutes)

ASK students to pair up and buzz on the following question for 2 minutes

 ‘What is study population?

ALLOW few pairs to respond and let other pairs to add on points not mentioned

WRITE their response on the flip chart/board

CLARIFY and SUMMARIZE by using the content below

 Study population
o Collective of study units for which the values of the varieties of interest could
possibly be determined.
o In identifying the population(s) to be studied we must consider the following questions:
 What is the group of people (STUDY POPULATION) we are interested in from
which we want to draw a sample?
 How many people do we need in our sample?
 How will these people be selected?
 Sample is a subset of study population selected to participate in the research when
whole study population cannot be reached
o The study population has to be clearly defined (for example, according to age, sex, and
residence.) Otherwise we cannot do the sampling
o Each study population consists of STUDY UNITS. The way we define our study
population and our study unit depends on the problem we want to investigate and on the
objectives of the study

 Representativeness
o If researchers want to draw conclusions which are valid for the whole study
population, which requires a quantitative study design, they should take care to draw a
sample in such a way that it is representative of that population.

o A representative sample has all the important characteristics of the population from
which it is drawn

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
106
Figure 1: Relationship between population and sample

STEP 4: Common Methods of Sampling (35 minutes)

Activity: Small Group Discussion (20 minutes)

DIVIDE students into small manageable groups

ASK students to discuss on the following question

 What are the common methods of sampling?

ALLOW students to discuss for 10 minutes

ALLOW few groups to present and the rest to add points not mentioned

CLARIFY and SUMMARIZE by using the contents below

 The common methods of sampling are:

 Two types of sampling probability and non-probability
o Non-probability
o Probability (random sampling)

 Probability Sampling (Quantitative Data)

o Involves using random selection procedures, to ensure that each unit of the sample is
___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
107
 chosen on the basis of chance.
o All units of the study population should have an equal, or at least a known chance of
being included in the sample.
o Requires listing of all study units exist or can be compiled. This listing is called the
sampling frame.
 Types of random or probability sampling
o Simple random sampling
o Systematic sampling
o Stratified sampling
o Cluster sampling
o Multistage sampling
 Simple Random Sampling
To select a simple random sample, you need to:
o Make or search for an existing numbered list of all the units in the population from
which you want to draw a sample (sampling frame).
o Decide on the size of the sample.
o Select required number of sampling units, using a lottery method.
o For example, a simple random sample of 50 students is to be selected from a school of
250 students. Using a list of all 250 students, each student is given a number (1 to
250), and these numbers are written on small pieces of paper. All the 250 papers are
put in a box, after which the box is shaken vigorously, to ensure randomization. Then
50 papers are taken out of the box, and the numbers are recorded. The students
belonging to these numbers will constitute the sample.
 Systematic Sampling
o Individuals are chosen at regular intervals (for example every fifth) from the sampling
frame.
o Ideally a number to tell where to start selecting individuals from the list is randomly
selected.

For example, a systematic sample is to be selected from 1200 students of a school. The
sample size selected is 100. The sampling fraction is:
100 (= sample size) = 1
1200 (= study population) 12
The sampling interval is therefore 12.
The number of the first student to be included in the sample is chosen randomly

 Stratified Sampling
o If it is important that the sample includes representative study units of small groups
with specific characteristics, then sampling frame must be divided into groups, or
strata, according to these characteristics.

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
108
 o For example, residents from urban and rural areas, or different religious or ethnic
group
o Random or systematic samples of a pre-determined size will have to be obtained from
each group (stratum).

 Cluster Sampling
o The selection of groups of study units (clusters) instead of the selection of study units
individually.
o Clusters are often geographic units (e.g. districts, villages) or organizational units (e.g.
clinics, training groups).

 Multi-Stage Sampling
o A multi-stage sampling procedure is carried out in phases and it usually involves
more than one sampling method. Example selecting one region out of 26 then select 4
councils out of 7 in the selected region. In the 4 selected councils, the researcher
selects 3 wards out of 8 then two villages are selected from the 3 wards. The selection
method in each stage could be random or systematic.

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
109
 Sampling Methods for Qualitative Data (Non-probability)
 Non-probability sampling is:
o Unequal chance of being included in the sample (nonrandom)
o It is a sampling process in which the samples are selected for specific purpose with a
predetermined basis for of selection
o Purposeful sampling strategies for qualitative studies
o Extreme case sampling
o Maximum variation sampling
o Homogeneous sampling
o Critical case sampling
o Snowball or chain sampling
 Sample size: Number of subjects selected to represent a given study population
o Sample Size in Qualitative Studies
 There are no fixed rules for sample size in qualitative research.
 The size of the sample depends on what you try to find out, and from what
different informants or perspectives
o If you want to explore how you can involve mothers in your HC catchment area
you try to find that out. For example:
 effectively in early detection and treatment of pneumonia, you might decide to
conduct some FGDs to assess mothers’ knowledge, attitudes and practices with
respect to antimalarials.
 You could start with two FGDs among lowly educated mothers and two among
mothers with more education (who usually are of higher socio-economic status).
o If research objective is more complex e.g., attitudes of males and females towards
family planning, and has policy implications for a larger area, your sample will be
bigger. You might start with four FGDs, two among males and two among females,
subdivided according to socio-economic status.
 In exploratory studies, the sample size is therefore estimated beforehand as precisely as
possible, but not determined.

 Tips for Determining Sample Size

o The desirable sample size depends on the expected variation in the data (of the most
important variables).
o The more varied the data are the larger the sample size needed to attain the desired
level of accuracy.
 The desirable sample size also depends on the number of cells in the cross tabulations.
 A rough guideline is to have at least 5 to 10 study units per cell. For example:
o After conducting FGDs and in-depth interviews in the study on attitudes of men and
women towards family planning you might decide to conduct a bigger survey.
o If the exploratory study revealed that age and education appear to be important factors
___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
110
 determining FP use, compare FP use in groups with different levels of education and
of different ages.
o If you split each of these variables up in three categories, and you select four
categories of informants (male users/ spouses of female users; female users; male
non-users, female non-users) you would have 12 cells in each table. In order to obtain
5-10 answers per cell you would require 60-120 informants in each research area.
 The eventual sample size is usually a compromise between what is desirable and what is
feasible.

Refer students to Handout 13.1: Types of sampling and when to use it

STEP 5: Reasons for Sampling (15 minutes)

Reasons for sampling
 Sampling is necessary when the study population is very big and the resources are not
adequate to reach everyone in the population
 To avoid or minimize bias
 Sampling can save time and money. A sample study is usually less expensive than a
census study and produces results at a relatively faster speed.
 Sampling may enable more accurate measurements for a sample study is generally
conducted by trained and experienced investigators.
 Sampling remains the only way when population contains infinitely many members.
 Sampling remains the only choice when a test involves the destruction of the item under
study
 Sampling usually enables to estimate the sampling errors and, thus, assists in obtaining
information concerning some characteristic of the population

STEP 6: Sources of Bias in Sampling that Should be Avoided (15 minutes)

 Bias refers to systematic error in sampling procedures, which leads to a distortion in the
results of the Study can be a consequence of improper sampling procedures, which result
in the sample not being representative of the study population.
 There are several possible sources of bias that may arise when sampling. The most well
known source is non-response.
o The bigger the non-response rate, the more necessary it becomes to take remedial
action.
o It is important in any study to mention the non-response rate and to honestly discuss
whether and how the non-response might have influenced the results.
 Some Biases in Sampling
o Studying volunteers only: The fact that volunteers are motivated to participate in the
study may mean that they are also different from the study population on the factors
being studied.

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
111
 o It is better to avoid using non-random selection procedures that introduce such an
element of choice.
 Sampling of registered patients only: Patients reporting to a clinic are likely to differ
systematically from people seeking alternative treatments.
 Missing cases of short duration: In studies of the prevalence of disease, cases of short
duration are more likely to be missed. This may mean missing fatal cases, cases with
short illness episodes and mild cases.
 Seasonal bias: Problem under study, for example, malnutrition, exhibits different
characteristics in different seasons of the year. For this reason, data should be collected on
the prevalence and distribution of malnutrition in a community during all seasons rather
than just at one point in time.
 Tarmac bias: Study areas are often selected because they are easily accessible by car.
 These areas are likely to be systematically different from more inaccessible areas.

 Ways to Reduce the Possibility of Bias

o Data collection tools (including written introductions for the interviewers to use with
potential respondents) should be pre-tested. If necessary, adjustments should be made
to ensure better co-operation.
o If non-response is due to absence of the subjects, follow-up of non-respondents may
be considered.
o If non-response is due to refusal to co-operate, an extra, separate study of non-
respondents may be considered in order to identify to what extent they differ from
respondents.
o Another strategy is to include additional people in the sample, so that non-respondents
who were absent during data collection can be replaced. This can only be justified if
their absence was very unlikely to be related to the topic being studied.
o The bigger the non-response rate, the more necessary it becomes to take remedial
action.
o It is important in any study to mention the non-response rate and to honestly discuss
whether and how the non-response might have influenced the results.

STEP 7: Key Points (5 minutes)

 Sampling is the process of selecting a number of study units from a defined study
population
 BIAS in sampling is a systematic error in sampling procedures which leads to a distortion
in the results of the study

STEP 8: Evaluation (5 minutes)

 What are reasons for sampling?
 What are source of bias in sampling that should be avoided?

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
112
STEP 9: Assignment (5 minutes

Activity: Take Home Individual Assignment (05 minutes)

ASK each student to select to identify population to be studied and the sampling technique
for a research proposal being developed

ALLOCATE time for student to do the assignment and submit

REFER students to recommended reference

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
113
References
Hardon A, Boonmongkon P, and Streefland P. et al (2001). Applied Health research,
Anthropology of health and health care, (3rd Ed) Amsterdam, The Netherlands: Het
Spinhuis Publishers

Beaglehole R, Bonita R and Kjellstrom (1993) Basic epidemiology: Geneva, Switzerland:

World Health Organization,

Kothari C.R (1985). Research Methodology – Methods and techniques, (2nd ed); New Delhi,
India; Wiley Eastern Limited

Stewart A (2001). Basic Statistics and epidemiology, A practical guide,; London, United
Kingdom: Radcliffe Medical Press,

Varkevisser, C. M, Pathmanathan, I and Brownlee, A (1991). Designing and Conducting

Health Systems Research Projects, Vol. 2 Part I: Ottawa, Canada: IDRC

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
114
___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
115
 Handout 13.1: Types of sampling and when to use it

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
116
Session 14: Determining Sample Size

Total Session Time: 120 minutes + 60 minutes assignment

Prerequisites
 None

Learning Tasks
By the end of this session students are expected to be able to:
 List the issues to consider when deciding on sample size
 Calculate the sample size (desirable)
 Determine the sample size(s) most appropriate for the research design (feasible)

Resources Needed
 Flip charts, marker pens, and masking tape
 Black/white board and chalk/whiteboard markers
 Computer and LCD Projector

SESSION OVERVIEW

Activity/
Step Time Content
Method
1 05 minutes Presentation Introduction, Learning Tasks
Presentation
2 15 minutes Issues to Consider when Deciding on Sample Size
Buzzing
50 minutes Presentation
3 Calculation of the Sample Size (Desirable)
Brainstorming

4 35 minutes Presentation Determination of Sample Size(s) Most Appropriate

for the Research Design (Feasible)

5 Key Points
05 minutes Presentation
6 05 minutes Presentation Evaluation
7 05 minutes Presentation Assignment

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
117
SESSION CONTENTS

STEP1: Presentation of Session Title and Learning Tasks (5 minutes)

READ or ASK students to read the learning tasks and clarify

ASK students if they have any questions before continuing

STEP 2: Issues to Consider when Deciding on Sample Size (15 minutes)

Activity: Buzzing (5 minutes)

ASK students to pair up and buzz on the following question for 2 minutes:

 What issues should be considered when deciding on sample size?

ALLOW few pairs to respond and let other pairs to add on points not mentioned

WRITE their response on the flip chart/board

CLARIFY and SUMMARIZE by using the content below

 There are no fixed rules for sample size in qualitative research. The size of the sample
depends on WHAT you try to find out, WHY you try to find out, and HOW you are going
to use the data
 the sample size depends on the type of problem investigated, required precision and to a
certain extent, the resource available
 If your research objective is more complex e.g., attitudes of males and females towards
family planning, and has policy implications for a larger area, your sample will be bigger.
 Very few studies use the whole population (Census)
 Most studies use a subset of a population (Sample)
 How big should a sample be?
 Too large or too little sample is unethical:
 Too large: waste resources
 Too little: Inconclusive results

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
118
STEP 3: Calculation of the Sample Size (Desirable) (50 minutes)
Activity: Brainstorming (10 minutes)

Ask students to brainstorm on the following question:

 ‘What is the desirable sample size?

ALLOW few students to respond?

WRITE their responses on the flip chart/ board

CLARIFY and SUMMARISE by using the content below

 Desirable sample size is that calculated using standard formulae

 The following general rules may help to determine the desirable sample size of any
given study:
o The desirable sample size depends on the expected variation in the data (of the most
important variables): the more varied the data are, the larger the sample size we would
need to attain the desired level of accuracy.

o The desirable sample size also depends on the number of cells we will have in the
cross-tabulations which we need to analyze the results.
 A rough guideline is to have at least 5 to 10 study units per cell

o How big can be calculated. Still, the desirable sample size cannot always be achieved
for lack of resources such as time, manpower and money.
 This constraint applies to quantitative as well as qualitative studies
 Therefore, the eventual sample size is usually a compromise between what is
desirable and what is feasible
o Sample size calculations
` The following steps should be taken:
 Estimate how big the proportion might be (say 80%)
 Choose the margin of error you will allow in the estimate of the proportion (say +
10%). This means that, if in the survey indeed 80% of the children are found to be
vaccinated, this proportion will probably be between 70 and 90% in the whole
study population from which the sample was drawn.
 Choose the precision with which you want to be confident that the vaccination
coverage in the whole population is indeed between 70 and 90%. You can never be
100% sure. Do you want to be 95% sure? Or 99%?

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
119
 o Formulae

N = z2PQ
d2
N = Minimum sample size
Z = Constant, Standard normal deviate (1.96 for 95% Confidence level)
P = Population proportion with characteristic of interest
Q=1–P
d = Acceptable Margin of error

STEP 4: Determination of Sample Size(s) Most Appropriate for the

Research Design (Feasible) (35minutes)
 The feasible sample size determination
o Is not calculated, depends on available resources (human, time, money, transport)
 Availability of finance: in practice, size of the sample depends upon the amount of
money available for the study purposes. This factor should be kept in view while
determining the size of sample for large samples result in increasing the cost of
sampling estimates
o Depends on expected variation in the data: the more varied the data are, the larger the
sample size one would need to attain the same level of accuracy
o Depends on the number of cells one will have in the cross-tabulations required to
analyze the result
 A rough guideline is to have at least 20-30 study units per cell
o Eventual sample size – is a compromise between desirable and feasible
o Nature of study: If items are to be intensively and continuously studied, the sample
should be small. For a general survey the size of the sample should be large, but a
small sample is considered appropriate in technical surveys.
o Type of sampling: Sampling technique plays an important part in determining the size
of the sample. A small random sample is appropriate to be much superior to a larger
but badly selected
.
STEP 5: Key Points (5 minutes)
 There are no fixed rules for sample size in qualitative research.
 Eventual sample size is a compromise between desirable and feasible

STEP 6: Evaluation (5 minutes)

 What are issues to consider when deciding on sample size?
 What is the sample size(s) most appropriate for the research design (feasible)?
___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
120
STEP 7: Assignment (5 minutes)
Activity: Take Home Assignment (5 minutes)

DIVIDE students in groups or individuals

ASK the students to work on the following Assignment

Determine the sample size of the research proposal being developed

ALLOCATE time for students to do the assignments and submit

REFER students to recommended reference

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
121
References

References
Hardon A, Boonmongkon P, and Streefland P. et al (2001). Applied Health research,
Anthropology of health and health care, (3rd Ed) Amsterdam, The Netherlands: Het
Spinhuis Publishers

Beaglehole R, Bonita R and Kjellstrom (1993) Basic epidemiology: Geneva, Switzerland:

World Health Organization,

Kothari C.R (1985). Research Methodology – Methods and techniques, (2nd ed); New Delhi,
India; Wiley Eastern Limited

Stewart A (2001). Basic Statistics and epidemiology, A practical guide,; London, United
Kingdom: Radcliffe Medical Press,

Varkevisser, C. M, Pathmanathan, I and Brownlee, A (1991). Designing and Conducting

Health Systems Research Projects, Vol. 2 Part I: Ottawa, Canada: IDRC

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
122
___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
123
Session 15: Research Ethics

Total Session Time: 60 minutes +240 minutes assignment

Prerequisites
 None

Learning Tasks
By the end of this session students are expected to be able to:
 Define research ethics
 Identify areas of research requiring ethical clearance
 Describe procedure for research ethical clearance

Resources Needed
 Flip charts, marker pens, and masking tape
 Black/white board and chalk/whiteboard markers
 Computer and LCD Projector

SESSION OVERVIEW

Activity/
Step Time Content
Method

1 05 minutes Presentation Introduction, Learning Tasks

2 10 minutes Presentation Definition of Research Ethics

10 minutes Presentation Areas of research requiring ethical clearance
3
Buzzing
20 minutes Presentation Procedure for Research Ethical Clearance
4
Brainstorming
5 05 minutes Presentation Key Points
6 05 minutes Presentation Evaluation
7 05 Presentation Assignment

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
124
SESSION CONTENTS

STEP1: Presentation of Session Title and Learning Tasks (5 minutes)

READ or ASK students to read the learning tasks and clarify

ASK students if they have any questions before continuing

STEP 2: Definition of Research Ethics (10 Minutes)

 Research ethics
o Research Ethics is defined here to be the ethics of the planning, conducting, and
reporting of research
o It is clear that research ethics should include: Protections of human and animal
subjects.
o “"ethics": is defined as norms for conduct that distinguish between acceptable and
unacceptable behavior”.

 STEP 3: Identification of areas of research requiring ethical clearance

(10 minutes)

Activity: Buzzing (5 minutes)

ASK students to pair up and buzz on the following question for 2 minutes

 ‘Which areas of research require ethical clearance?

ALLOW few students to respond

WRITE their responses on flipchart or board

CLARIFY and SUMMARIZE by using the content below

 In developing data collection techniques, it is important to consider whether the research
procedures are likely to cause any physical or emotional harm.
 Harm may be caused, by:
o Violating informants’ right to privacy, by posing sensitive questions or by gaining
access to records which may contain personal data.
o Observing the behavior of informants without them being aware
o Allowing personal information (which informants would want to be kept private) to
___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
125
 be made public.
o Failing to observe/respect certain cultural values, traditions or taboos valued by your
informants. Using human biological tissue, using human in trial of drugs.

 Several methods for dealing with ethical issues are recommended:

o Obtaining informed consent before the study or the interview begins.
o Do not explore sensitive issues before a good relationship has been established with
the informant.
o Ensure the confidentiality of the data obtained.
Learning enough about the culture of informants to ensure it is respected during the
o data collection process.
If sensitive questions are asked, for example, about family planning or sexual
practices, or about opinions of patients on the health services provided, it is advisable
to omit names and addresses from the questionnaires.
o Inform participants that they are free to withdraw from the study at any point

STEP 4: Procedure for Research Ethical Clearance (20 Minutes)

Activity: Brainstorming (5 minutes)

ASK students to pair up and buzz on the following question for 2 minutes

 ‘What are procedures for research ethical clearance?

ALLOW few students to respond

WRITE their responses on flipchart or board

CLARIFY and SUMMARIZE by using the content below

 Health research coordination in Tanzania is under the Medical Research Coordinating
Committee (MRCC). MRCC is the national health research coordinating body that
ensures all health research follows the national health ethics requirements.

 Procedure for research ethical clearance

o The whole process of receiving, reviewing and approving the protocols takes a
maximum of 6 weeks
o National Health Research Ethics Committee (NatHREC) carries research monitoring
by on-site visits in collaboration with district and regional medical authorities.
In this regard, copies of certificates of cleared research proposals are sent to
respective District and Regional Medical Officers where research is to be carried out.
o Research certificate approval is renewed annually, and PIs are required to submit
progress reports biannually.
___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
126
 o To publish the findings, the principal investigator will have to seek permission from
the National Institute for Medical Research.
o All proposed health research in Tanzania must get an Institutional Ethical approval at
the host institution where the research will be based.
o In case there is no any Institutional Ethics Committee, the approval will be sought
from the NatHREC.
o For all health research involving external collaborators (non-Tanzanians), the
researchers must apply for the Institutional Ethical Clearance as well as the National
Ethics Clearance.
o Non-Tanzanian researchers are required by law to get Research Clearance and
Research Permit from the Tanzania Commission for Science and Technology
(COSTECH) (www.costech.or.tz).
o Protocols for Clinical trials to be conducted in Tanzania are reviewed by another
specialized sub-committee, Clinical Trials Sub-Committee.
 This sub-committee has nine members and meets monthly and reports to the
NatHREC.
o Clinical trials are required to also obtain a Clinical Trials Certificate from Tanzania
Food and Drug Authority (www.tfda.or.tz) before the commencement of the study.
 Application procedures
o Applicants for research clearance are required to submit application form, Curriculum
vitae, Research proposal and three passport size photographs preferably two months
before commencement of research.
o Permits are given for a period of one year and can be renewed for similar period
provided satisfactory progress reports for the previous periods are received by
COSTECH.
o If and when these formalities have been satisfactorily completed (which may take
several months) applicant will receive a formal written offer of a research clearance.
o Applicant should not make any irreversible preparations to leave for Tanzania unless
and until he/she receives this offer letter.
o Soon after obtaining a research permit, the researcher will be required to proceed to
the Immigration Department and apply for class C residence permit.

STEP 5: Key Points (5 minutes)

 Research Ethics is defined here to be the ethics of the planning, conduct, and reporting of
research
 As we develop our data collection techniques and implement research, we need to
consider whether our research procedures are likely to cause any physical or emotional
harm
 Applicants for research clearance are required to submit application form, Curriculum
vitae, Research proposal and three passport size photographs preferably two months
before commencement of research

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
127
STEP 6: Evaluation (5 minutes)
 What is research ethics?
 What ethical issues are involved in the implementation of research?

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
128
STEP 7: Assignment (5 minutes)

Activity: Take Home Assignment (5 minutes)

DIVIDE students in groups or individuals

 ASK the students to work on the following Assignment

Identify ethical issues you will follow when conducting the research, you are developing

ALLOCATE time for students to do the assignments and submit

REFER students to recommended reference

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
129
References
National Institute of Medical Research (2014) 2ND Edition. Standard Operating Procedures
for the National Health Research Ethics Committee, Dar es Salaam, Tanzania
http://www.nimr.or.tz/wp-content/uploads/2018/11/SOPS-2014-KEY-NatHREAC-SOPs-
Final-17th-June-2014.pdf

Mashalla, Y.J.S., Shija, J.K., Kitua, A.Y., Mwaikambo, E., Kohi, Y.M., Ndossi, G.D.,
Malecela, M., Mboera, L.E.G. (2009) Second edition. Guidelines of Ethics for
Health Research in Tanzania, Tanzania National Health Research Forum, Dar es
Salaam, Tanzania

Hardon A, Boonmongkon P, and Streefland P. et al (editors) (2001). Applied Health research,

Anthropology of health and health care, third revised edition,, Het Spinhuis
Publishers, The Netherlands

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
130
Session 16: Developing Research Tools

Total Session Time: 120 minutes+240 minutes assignment

Prerequisites
 None

Learning Tasks
By the end of this session students are expected to be able to:
 List common research tools
 Identify appropriate data-collection techniques
 Prepare data-collection tools
 Conduct out an interview

Resources Needed
 Flip charts, marker pens, and masking tape
 Black/white board and chalk/whiteboard markers
 Computer and LCD Projector
 Handout 16.1: Overview of data collection techniques
 Handout 16.2: Advantages and disadvantages of various data collection tools
 Handout 16.3: Focus Group Discussion (FGD)
 Handout 16.4: Functions of FGD Facilitator

SESSION OVERVIEW

Activity/
Step Time Content
Method
1 05 minutes Presentation Introduction, Learning Tasks
Presentation Common Research Tools
2 10 minutes
Buzzing
3 10 minutes Presentation Identification of Data-Collection Techniques
4 45 minutes Presentation Preparation for Data-Collection Tools
35 minutes Presentation Conducting an Interview
5
Brainstorming
6 05 minutes Presentation Key points
7 05 minutes Presentation Evaluation
8 05 minutes Presentation Assignment

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
131
___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
132
SESSION CONTENTS

STEP1: Presentation of Session Title and Learning Tasks (5 minutes)

READ or ASK students to read the learning tasks and clarify

ASK students if they have any questions before continuing

STEP 2: Common Research Tools (10 minutes)

Activity: Buzzing (5 minutes)

ASK students to pair up and buzz on the following question for 2 minutes:

 What are common research tools?

ALLOW few pairs to respond and let other pairs to add on points not mentioned

WRITE their response on the flip chart/board

CLARIFY and SUMMARIZE by using the content below

 The quality of research depends on the quality of the data collection

tools. The common tools used include questionnaire for interview and
checklist
 Interviewing and administering questionnaires are probably the most
commonly used
research techniques.
 Designing good questioning and interviewing tools forms an important
and time-consuming phase in the development of most research
proposals.
 The following questions should be considered before designing the
tools
o What exactly do we want to know, according to the objectives and
variables we have?
o Is questioning the right technique to obtain all answers, or
additional techniques, such
as observations or analyses of records are needed?
o Who to ask questions and what techniques will be used?

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
133
 o Do you understand the topic sufficiently to design a questionnaire,
or
o Do you need some loosely structured interviews with key informants
or a focus group
discussion first to orientate ourselves?
o Are your informants mainly literate or illiterate?
o How large is the sample that will be interviewed?
 Before examining the steps in designing a questionnaire, review the
types of questions
used in interviews.
 Depending on how questions are asked and recorded distinguish two
major possibilities:
o Open-ended questions, (allowing for completely open as well as
partially categorized
answers).
o Closed questions.
 Completely Open-Ended Questions
o Open-Ended Questions permit free responses which should be
recorded in the
respondents’ own words.
o Open questions are useful for obtaining in-depth information on
 Facts with which the researcher is not very familiar.
 Opinions, attitudes and suggestions of informants, or Sensitive
issues.

 Advantages of Completely Open-Ended Questions

o Allow you to probe more deeply into issues of interest being raised.
o Issues not previously thought of when planning the study may be
explored, thus providing valuable new insights on the problem.
o Information provided in the respondents’ own words might be useful
as examples or
illustrations, which add interest to the final report.

 Risks of Completely Open-Ended Questions

o Skilled interviewers are needed to get the discussion started and
focused on relevant
issues and to record all information collected.
o A big risk is incomplete recording of all relevant issues covered in
the discussion.
o Analysis is time-consuming and requires experience; otherwise
important data may be
___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
134
 Lost
 Suggestions to Improve Use of Completely Open-Ended Questions
o Thoroughly train and supervise the interviewers or select
experienced research assistants.
o Prepare a list of further questions to keep at hand to use to probe
for answer(s) in a
systematic way.
o Pre-test open-ended questions and, if possible, pre-categorize the
most common responses

 Partially Categorized Questions

o In interviews questions are often asked as open-ended questions,
but to facilitate
recording and analysis, some answers can be pre-categorized. For
example: ‘How did you become a member of the Village Health
Committee?’
Details stated:
1.
Volunteered......................................................................................... 􀂃
2. Elected at a community
meeting.......................................................... 􀂃
3. Nominated by community
leaders.........................................................􀂃
4. Nominated by the health
staff............................................................... 􀂃
5. Other
(specify): ........................................................................................................ 􀂃
In this case the first four categories of answers are known, but there
may be other possibilities.
Therefore, there is a category ‘other’ where other answers can
be recorded. During the analysis, these responses can still be
further categorized.
o For open-ended questions, more than one answer is usually allowed.

 Advantages of Pre-Categorized Answers

o Answers can be recorded quickly
o Analysis is easier
 Risks of Pre-Categorized Answers
o If one pre-categorizes too early, a lot of interesting and valuable
information may never be recorded or may end up in the category
‘other’.

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
135
 o Interviewers may try to force the information into the categories
that are listed and, by
merely ticking, this additional valuable information will be lost.
o Interviewers may stop after receiving the first answer, whereas
more than one response could be applicable.
o Sometimes, if the respondent hesitates in answering, the
interviewer may be tempted to present some possible answers,
thereby causing bias.
o Frequently, questionnaires have very little space for recording full
responses under “other”, forcing the interviewer to write down a
response that summarizes the respondent’s answer, thereby losing
valuable information.

 Minimization of Risks Associated with Pre-Categorized Answers

o Clear guidelines have to be provided to interviewers on important
issues
For example: If a question leads to an interesting discussion, it
should be completely written down
o Interviewers should be trained to solicit discussion
o Categorize questions for which all possible categories of responses
are known, e.g., some health practices (Antimalarial use: currently
using, ever used, and never used).
o These questions, when used, will always be followed by other
questions asking for elaboration on reasons and conditions for use
or non-use of the practice.

 Closed Questions
o Closed questions have a list of possible options or answers from
which the respondents must choose.
o Closed questions are most commonly used for background variables
such as age, marital status or education, in case of age and
education take the exact values and categorize them during data
analysis.
For example:
 What is your opinion on the following statement: (Circle one
response).
 Women who are pregnant do not use antimalarial
 Strongly agree
 Agree
 Not sure/no opinion
 Disagree
 Strongly disagree
___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
136
 Used if one is only interested in certain aspects of an issue and does
not want to waste
time obtaining more information than one needs.
For example:
 A researcher who is only interested in the sources of protein in a
family diet
may ask:
o Did you eat any of the following foods yesterday?’ (Circle yes if at
least one item in
each set of items is eaten.)
 Peas, beans, lentils Yes No
 Fish or meat Yes No
 Eggs Yes No
 Milk or cheese Yes No
 Insects Yes No
 Advantages of Closed Questions
o It saves time
o Comparing responses of different groups, or of the same group over
time, becomes easier
 Risks of Closed Questions
o In case of illiterate respondents, the interviewer may be tempted to
read the list of
possible answers in the given sequence, thereby influencing the
choice of response and introducing bias.
o Take objectives and variables as a starting point.
o Decide what questions will be needed to measure or (in the case of
qualitative studies) to define your variables and reach your
objectives.
o Formulate one or more questions that will provide the information
needed for each
variable.
o Check whether each question measures one thing at a time.
o Avoid leading questions.
 A question is leading if it suggests a certain answer.
 For example: Do you think that people have to give bribes at
hospital X to be seen by a doctor? Hardly leaves room for ‘no’ or
for other options.
 A better question would be: Have you recently visited hospital X?
 This would be followed by a series of other probing questions
such as:
• By whom were you seen?
• What were the complaints?
___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
137
 o Ask sensitive questions in a socially acceptable way.
 Questions relating to abortion, sexual practices of adolescents, or
AIDS and mental illness in the family are usually sensitive.
o Sequencing the questions: design your interview schedule or
questionnaire to be
‘informant friendly’.
The sequence of questions must be logical for the informant and
allow, as much as possible, for a ‘natural’ conversation, even in
more structured interviews.
 Formatting the questionnaire: When you finalize your questionnaire, be
sure that:
o A separate, introductory page is attached to each questionnaire,
explaining the
purpose of the study, requesting the informant’s consent to be
interviewed and
assuring confidentiality of the data obtained.
o Each questionnaire has a heading and space to insert the number,
date and location of
the interview, and, if required, the name of the informant.
o Layout is such that questions belonging together appear together
visually.
o If the questionnaire is long, use subheadings for groups of
questions.
o Sufficient space is provided for answers to open-ended questions,
categories such as
‘other’ and for comments on pre-categorized questions.
o Boxes for pre-categorized answers are placed in a consistent
manner (e.g., on the right
half of the page).
 Translation
o If interviews will be conducted in one or more local languages, the
questionnaire
should be translated in order to standardize the way questions will
be asked.
o After having it translated you should have it retranslated into the
original language by
a different person.
o Compare the two versions for differences and make decisions
concerning the final
o phrasing of difficult concepts.
 Self-Administered (Written) Questionnaires

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
138
 o All steps discussed above apply to written questionnaires as well as
to
guides/questionnaires used in interviews.
o Self-administered questionnaires are most commonly used in large-
scale surveys using predominantly pre-categorized answers among
literate study populations.
o In exploratory studies which require intensive interaction with
informants in order to gain better insight in an issue,
o Written questionnaires may sometimes be useful in small-scale
studies on sensitive
topics.
They are usually combined with other tools e.g. FGD on sensitive issues like sexual
behavior.

 Checklists
o Checklists can be used to systematically observe human behavior or
the condition of
specific equipment (e.g. fridge, expiring dates of medicines, or
completeness of records).
o Observations can be relatively open or can be predetermined
comparisons of reality
against fixed standards.
o The objectives of the study determine the content of a checklist.
o A checklist includes all the items or points that must be considered
during an observation in the field, or when extracting data from
existing records.

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
139
STEP 3: Identification of Data-Collection Techniques (10 minutes)

Activity: Buzzing (5 minutes)

ASK students to pair up and buzz on the following question for 2 minutes

 ‘What are data collection techniques?

ALLOW few students to respond

WRITE their responses on flipchart or board

CLARIFY and SUMMARIZE by using the contents below

 Data collection techniques refer to a variety of methods which are used to gather
information for the study.
 Data collection techniques allow to systematically collect information about the objects of
study (people, objects, phenomena) and about the settings in which they occur.
 In the collection of data, we have to be systematic.
 If data are collected haphazardly then it will be difficult to answer our research questions
in a conclusive way. Example of haphazard data collection: During a nutrition survey
three different weighing scales were used in three villages.
o The researchers did not record which scales were used in which village.
o After completion of the survey it was discovered that the scales were not standardized
and indicated different weights when weighing the same child.
o It was therefore impossible to conclude in which village malnutrition was most
prevalent.
 Common Data Collection Techniques in Use
o Reviewing documents
o Observing/observation
o Interviewing (face-to-face)
o Administering written questionnaires
o Focus group discussions
 Reviewing Documents
o Documents to be reviewed can be obtained from dispensary, health
center, and hospital records.
For example:

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
140
 o Analysis of the information routinely collected by health facilities
can be very useful for identifying problems such as flows of drug
supply or dispensing
o Other sources of data may be:
 Health Information Management System, census,
 Unpublished reports and publications in archives and libraries or
in offices,
 Newspapers and published case histories
 Advantages of Reviewing Documents
o It is inexpensive, because data is already there
o It Permits examination of trends over the past
 Limitations of Reviewing Documents
o Data are not always easily accessible
o Ethical issues concerning confidentiality may arise
o Information may be inaccurate or incomplete

 Observation Technique
o Observation is a technique that involves systematically selecting,
watching and recording behavior and characteristics of living
beings, objects or phenomena
o Observation of human behavior is a much-used data collection
technique
o It can be undertaken in different ways:
 Participant observation: The observer takes part in the situation
he or she observes
 For example, a doctor hospitalized with a broken hip, who now
observes hospital procedures from within.
o Non-participant observation: The observer watches the situation,
openly or concealed,
but does not participate.
o Observation becomes a scientific tool and method of data collection
for the researcher, when:
 It serves a formulated research purpose.
 Is systematically planned and recorded.
 Is subjected to checks and controls on validity and reliability
 Advantages of Observation Method
o Subjective bias is eliminated, if observation is accurately done
o The information relates to what is currently happening
o Not complicated by either past behavior or future intentions or
attitudes.

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
141
 o Independent of respondent’s willingness to respond and hence less
demanding on active cooperation on the part of the respondents
o Suitable in studies which deal with subjects who are not capable of
giving verbal reports of their feelings for one reason or the other

 Limitations of Observation Method

o It is an expensive method
o Information provided by this method is very limited
o Sometimes unforeseen events may interfere with the observational
task
o Some subjects are rarely accessible to direct observation
o If subjects know that they are being observed, they may change
their behavior

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
142
 Interviewing Technique
o An interview is a data-collection technique that involves oral
questioning of respondents, either individually or as a group
o Requires a person known as the interviewer asking questions in a
face-to-face contact to the interviewee or through other means of
communication like telephone
o Answers to the questions posed during an interview can be recorded
by writing them
down (either during the interview itself or immediately after the
interview) or by tape-recording the responses, or by a combination
of both

 Advantages of the Interview Method

o Detailed information can be obtained
o Interviewer could overcome resistance of the respondent, if any.
 Provides flexibility to the interviewer to restructure, clarify, or
add probe questions
 Observation can also be applied during interview
 Is suitable for use with both literates and illiterates
 Has higher response rate than written questionnaires
 The interviewer can collect supplementary information about the
respondent’s personal characteristics and environment.
 Limitations of Interview
o It is very expensive and time consuming especially when the sample
is large
o Chances of Interviewer as well as interviewee’s bias are high
o People with certain high-level positions like officials or executives
may not be easily
approachable under this method and to that extent the data may
prove inadequate
o Creating effective rapport with the interviewee may be a difficult
o Some subjects may demand incentives during data collection
process
o There may be a language barrier between an interviewer and
interviewee
 Pre-Requisites and Basic Tenets of Interviewing
o Interviewers should be carefully selected and trained
o They must possess technical competence (interviewing and
interpersonal skills)

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
143
 o They should be able to create an atmosphere of trust and
confidence
 Written Questionnaires
o A written questionnaire (also referred to as self-administered
questionnaire) is a data
collection method in which written questions are presented that are
to be answered by the respondents in written form. The questions
can be either open-ended or closed (with pre categorized answers).
o A written questionnaire can be administered in different ways, such
as by:
 Sending questionnaires by mail with clear instructions on how to
answer the questions
 and asking for mailed responses;
 Gathering all or part of the respondents in one place at one time,
giving oral or written instructions, and letting the respondents fill
out the questionnaires; or
 Hand-delivering questionnaires to respondents and collecting
them later
 Advantages of Questionnaires
o Low cost when study is large
o Free from interviewer bias
o Respondents have adequate time to give out their answers
o Respondents, who are not easily approachable, can be reached
o Used in large studies
o Permits anonymity and may result in more honest responses.

 Limitations of Questionnaires
o Low rate of return of the duly filled in questionnaires
o Bias due to non-response is undetermined
o Used only when respondents are educated and cooperating
o Control over questionnaire may be lost
o Not flexible once the questionnaire has been dispatched out
o Ambiguous replies or omissions creating difficult in interpretation
o Slowest method of all when mailing is used
 Focus Group Discussions (FGD)
o FGD allows a group of 6 - 12 informants to freely discuss a certain
subject with the guidance of a facilitator or reporter during which
group members talk freely and spontaneously about a certain topic.
o Characteristics and Uses of Focus Group Discussions
 A FGD is a qualitative method.
 A FGD aims to be more than a question-answer interaction.
___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
144
  The idea is that group members discuss the topic among
themselves, with guidance from the facilitator.
o FGD techniques can be used to:
 Focus research and develop relevant research hypotheses by
exploring in greater
depth the problem to be investigated and its possible causes.
 Formulate appropriate questions for more structured, larger scale
surveys.
 Develop appropriate messages for health education programmes
and later evaluate the messages for clarity
 Explore controversial topics. For example: Sexual behavior is a
controversial topic in the sense that males and females judge
sexual relations and sexuality often from very different
perspectives.
o Advantages of FGD
 The researcher can interact with the participants, pose, follow up
questions or ask
questions that probe more deeply.
 Results can be easier to understand than complicated statistical
data.
 The researcher can get information from non-verbal responses
such as facial expressions or body language.
 Information is provided more quickly than if people were
interviewed separately.
 Limitations of FGD
o The small sample size means the groups might not be a good
representation of the larger population
o Group discussions can be difficult to steer and control, so time can
be lost to irrelevant topics
o Respondents can feel peer pressure to give similar answers to the
moderators’ questions
o The moderator’s skills in phrasing questions along with setting can
affect responses and skew results

Summary of Data collection Techniques and Tools

Data Collection Techniques Tools
• Using available information • Checklist, data compilation
forms
• Observing • Eyes and other senses,
pen/paper, watch, scales,
microscope…
• Administering written question •
___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
145
 questionnaire • Questionnaire
• Focus Group Discussion (FGD) • FGD Guide

 Bias in data collection

Bias: Is a distortion in the collected data so that it does not represent
reality
 Sources of Bias
o Defective instruments
Questionnaires
 Fixed or closed questions on topics about which little is known
(often asking the ‘wrong things’).
 Open-ended questions without guidelines on how to ask (or to
answer) them vaguely phrased questions
 Leading questions that cause the respondent to believe one
answer would be preferred over another or questions placed in
an illogical order
o Weighing scales or other measuring equipment that are not
standardized
o These sources of bias can be prevented by:
 Carefully planning the data collection process
 By pre-testing the data collection tools
o Observer bias
 Can easily occur when conducting observations or utilizing
loosely structured group or individual interviews.
 There is a risk that the data collector will only see or hear things
in which she or he is interested or will miss information that is
critical to the research.
o Effect of the interview on the informant
The informant may mistrust the intention of the interview and avoid certain
questions or give misleading answers.
 For example: in a survey on alcoholism you ask school children:
‘
 Does your father sometimes get drunk?’ Many will probably
deny that he does, even if it is true
o Such bias can be reduced by:
 Adequately introducing the purpose of the study to informants.
 Phrasing questions on sensitive issues in a positive way.
 Taking sufficient time for the interview and by assuring
informants that the data collected will be confidential.
o Information bias
 Sometimes the information itself has weaknesses.

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
146
  Medical records may have many blanks or be unreadable. This
tells something about the quality of the data and has to be
recorded.
 For example, in a compliance of TB drugs study the percentage
of non-compliant patient with an incomplete or missing address
should be calculated.
o Another common information bias is due to gaps in people’s memory
this is called
memory or recall bias.
 For example: A mother may not remember all details of her child’s
last diarrhea
episode and of the treatment she gave two or three months
afterwards.
 For such common diseases it is advisable to limit the period of
recall, asking, for
example, ‘Has your child had diarrhea over the past two weeks?’

STEP 4: Preparation for Data-Collection Tools (45 minutes)

 Questionnaires and interview schedules are used to collect information for quantitative
research
 The steps of designing them are the same even though they are used for different data
collection techniques; i.e. Self-administered questionnaire and interviewing respectively
 Before designing questionnaires consider the following:
o Study objectives and variables
o Be clear of what you want to know or measure.
o Ascertain whether all required information is going to be obtained by questioning
only or not
o How much is known about the problem being investigated. Familiar? Unfamiliar?
his determines whether closed/open questions should be used.
o The number of subjects to be studied. This determines how much of open/closed
questions to be used
 Open-ended (free response) questions: respondents are not given options to choose; theyy
answer in their own words
 Closed questions (fixed alternatives): respondents are given alternative answers to choose
from
 Requirements of the research questions
o Should measure the variable under study
o Should be ones to which respondents are expected to know the answers
o Should be clear and unambiguous
o phrased in simple language; avoid technical terms
o Contain one idea only

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
147
 o Should not be offensive
o Should not suggest an answer (leading)
 Steps in designing tools (questionnaire):
o first step: Deciding on the content
 Refer to the study objectives and variables
 Think of the question(s) needed to measure the variable
o Second step: Formulating the questions
 Formulate one (or more) question (s) that will provide the required information
 Make sure that the questions satisfies the requirements discussed earlier
o Third step: Sequencing the questions
 Arrange them in a logical sequence to allow a natural discussion (consumer
friendly)
 Begin with non-sensitive questions and pose the sensitive ones later
o Fourth step: Formatting the questionnaire
Questionnaires normally have two major sections
 Introductory section. This precedes the questions and have the following contents
• Heading
• Serial number
• Date of interview
• Place of interview
• Name of interviewer
• Name/code of respondents
o Questions section. This bears the questions and the following should be
ensured
 Related questions should appear together
 There is sufficient space for respondents to fill in their responses to open-ended
questions
 The boxes for pre-categorized responses are placed in consistent manner
 There are reserved boxes for computer coding for computer aided data analysis
 Formatting should ensure that the questionnaire is user friendly
o Fifth step: Translation
 Translation of the questionnaire into language familiar to all respondents should
be done if the original version is in a different language.
o Sixth step: Pretesting
 Before embarking on actual data collection,, it is important to check whether the
questionnaire gathers the information expected and whether both the interviewer
and interviewee feel at ease with it.
 Data compilation forms

o Designing data collection forms involves

 Step 1: Clarifying the specific needs of your application
 Step 2: Identifying the information you want to work with
___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
148
  Step 3: Then devising a design that best meets your need
 Checklist
o A checklist is a tool for identifying the presence or absence of conceptual knowledge,
skills, or behaviors
o Developing a checklist involves the following steps
Step 1: Review the learning outcome and associated criteria for success
 State the level of success required for the checklist to be considered completed, In
most cases, all items must be checked
 Decide on the response such as “Yes” or “No”, or simply have a box to be
checked once the item has been completed
Step 2: From a procedure, process, or task description list, pick those items that
are required for a good performance or product
 Itemize task descriptions in one column and
 Provide a space beside each item in a second column to check off the
completion of the task
 Group similar items or order them sequentially—keep as short as possible
 Highlight critical steps, checkpoints, or indicators of success
Step 4: Write clear instructions for the observer
Step 5: Review the task descriptions for details and clarity
Step 6: Format the checklist
Step 7: Ask for feedback from other instructors before using it with learners
o Checklists are used for identifying whether key tasks in a procedure, process, or
activity have been done in complete and in a systematic manner.

STEP 5: Conducting an Interview (35 minutes)

Activity: Brainstorming (10 minutes)

Ask students to brainstorm on the following question:

 What are procedures for conducting interviews?

ALLOW few students to respond?

WRITE their responses on the flip chart/ board

CLARIFY and SUMMARISE by using the content below

 Procedures for conducting interviews include:

o The interviewer-informant relationship and interview conditions

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
149
 o An interviewer needs to have the skills of turning an informant into a partner
Partnership between interviewer and informant implies that the interviewer will try to
minimize the social distance between him/herself and the informant
o a researcher has to invest in the relationship
o First she /he has to be clear to the informant about the purpose of the interview and
the study.
 Enough information should be given to raise the interest of informants and to
enable them to judge whether they would like to participate or not.
 Consent has to be obtained before the interview
o Second: Interviewers should try to blend in the environment. In order to do so:
 Clothing of interviewers should be culturally acceptable and as simple as possible
 Sitting arrangements for interviewer(s) and informant(s) should preferably be at
the same height
 Gender relations have to be respected.
 an interviewer should show interest in what the informant says, be at ease (never
in a hurry); Make the informant feel at ease
 The environment should also be supportive of the interview situation.
 Anything which disturbs (noise, other people listening, a formal surrounding)
should if possible be avoided
 Tape recording may be an enabling or a disturbing environmental factor in the
interview
 Informants should be asked for their consent before use
o Third: The interviewer’s tasks
 The interviewer has a number of other tasks:
 Posing questions
 Evaluating answers and probing for elaboration or more precision in case of a
superficial or invalid answer
 Noting down answers
 Leading the discussion, but at the same time encouraging the informant to give
spontaneous information relevant to the topic by letting him/her talk
 Keeping control over the interview
 At the end, the interviewer should summarize the interview
 after-interview' discussions and questions should always be recorded, like all
spontaneous information, because discussions can shed light on complicated, not
yet fully clear issues from many preceding interviews.
o Fourth: Training the research team/assistants
 Research assistants should be taught basic interview techniques, such as:
 Asking questions in a neutral manner
 Not showing by words or expression what answers one expects
 Not showing agreement, disagreement or surprise
 Recording answers to open questions precisely as they are provided, without
sifting or interpreting them
___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
150
STEP 6: Key Points (5 minutes)
 Common research tools are interview guides, questionnaires, collecting forms and
checklists
 Common data collection techniques include; interview, self-administration of
questionnaire, FGD , review of information available and Observation
 Questionnaires and interview schedules are used to collect information for quantitative
research
 An interviewer needs to have the skills of turning an informant into a partner

STEP 7: Evaluation (5 minutes)

 What are common research tools?
 What are data collection techniques?
 What are steps in conducting out an interview?

STEP 8: Assignment (5 minutes)

Activity: Take Home Assignment (05 minutes)

DIVIDE students in groups or individuals

ASK the students to work on the following Assignment

 Prepare your data-collection tools (instruments), taking care that you cover all important
variables. Refer to the matrix with data collection techniques and responsible tools
 Take care that you have an optimal mix between open-ended and pre-categorized questions.
 Discuss the possibilities for bias, which may occur when using the data-collection tools. Try
to avoid bias as much as possible.

ALLOCATE time for students to do the assignment and submit

REFER students to recommended reference

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
151
References
Hardon A, Boonmongkon P, and Streefland P. et al (2001). Applied Health research,
Anthropology of health and health care, (3rd Ed) Amsterdam, The Netherlands: Het
Spinhuis Publishers

Beaglehole R, Bonita R and Kjellstrom (1993) Basic epidemiology: Geneva, Switzerland:

World Health Organization,

Kothari C.R (1985). Research Methodology – Methods and techniques, (2nd ed); New Delhi,
India; Wiley Eastern Limited

Stewart A (2001). Basic Statistics and epidemiology, A practical guide,; London, United
Kingdom: Radcliffe Medical Press,

Varkevisser, C. M, Pathmanathan, I and Brownlee, A (1991). Designing and Conducting

Health Systems Research Projects, Vol. 2 Part I: Ottawa, Canada: IDRC

Polit, D. F and Beck, C. T (2004). Nursing Research – Principles and Methods, (7th Ed):
Philadelphi, USA: Lippincott Williams & Wilkins,

Empire State College (2018). Questions or feedback about ESC's Online Writing Center
https://www.esc.edu/online-writing-center/resources/research/research-paper-steps/
developing-questions/

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
152
 Handout 16.1: Overview of Data Collection Techniques
 Data collection techniques refer to a variety of methods which are used to gather
information for the study.
 Data collection techniques allow to systematically collect information about the objects of
study (people, objects, phenomena) and about the settings in which they occur.
 In the collection of data, we have to be systematic.
 If data are collected haphazardly then it will be difficult to answer research questions
in a conclusive way.
 Common Data Collection Techniques in Use
o Reviewing documents
o Observing/observation
o Interviewing (face-to-face)
o Administering written questionnaires
o Focus group discussions
 Reviewing Documents
o Documents to be reviewed can be obtained from dispensary, health center, and
hospital records.
 For example, analysis of the information routinely collected by health facilities
can be very useful for identifying problems such as flows of drug supply or
increases in the incidence of certain diseases.
o Other sources of data may be Health Information Management System, census,
unpublished reports and publications in archives and libraries or in offices,
newspapers
and published case histories
 Limitations of Reviewing Documents
o Data are not always easily accessible.
o Ethical issues concerning confidentiality may arise.
o Information may be inaccurate or incomplete.
 Observation Technique
o Observation is a technique that involves systematically selecting, watching and
recording behavior and characteristics of living beings, objects or phenomena.
o Observation of human behavior is a much-used data collection technique.
It can be undertaken in different ways:
 Participant observation: The observer takes part in the situation he or she
observes.
• For example, a doctor hospitalized with a broken hip, who now observes
hospital procedures from within.
___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
153
 o Non-participant observation: The observer watches the situation, openly or concealed,
but does not participate.
 Observation becomes a scientific tool and method of data collection for the researcher,
when:
o It serves a formulated research purpose.
o Is systematically planned and recorded.
o Is subjected to checks and controls on validity and reliability.
 Advantages of Observation Method
o Subjective bias is eliminated, if observation is accurately done.
o The information relates to what is currently happening.
o Not complicated by either past behavior or future intentions or attitudes.
o Independent of respondent’s willingness to respond and hence less demanding on
active cooperation on the part of the respondents.
o Suitable in studies which deal with subjects who are not capable of giving verbal
reports of their feelings for one reason or the other.
 Limitations of Observation Method
o It is an expensive method
o Information provided by this method is very limited
o Sometimes unforeseen events may interfere with the observational task
o Some subjects are rarely accessible to direct observation
o If subjects know that they are being observed, they may change their behaviour
 Interviewing Technique
o An interview is a data-collection technique that involves oral questioning of
respondents, either individually or as a group.
o Requires a person known as the interviewer asking questions in a face-to-face contact
to the interviewee or through other means of communication like telephone.
 Limitations of Reviewing Documents
o Data are not always easily accessible.
o Ethical issues concerning confidentiality may arise.
o Information may be inaccurate or incomplete.
 Observation Technique
o Observation is a technique that involves systematically selecting, watching and
recording behavior and characteristics of living beings, objects or phenomena.
o Observation of human behavior is a much-used data collection technique.
o It can be undertaken in different ways:
 Participant observation: The observer takes part in the situation he or she
observes.
• For example, a doctor hospitalized with a broken hip, who now observes
hospital procedures from within.
o Non-participant observation: The observer watches the situation, openly or
concealed, but does not participate.
___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
154
 Observation becomes a scientific tool and method of data collection for the researcher,
when:
o It serves a formulated research purpose.
o Is systematically planned and recorded.
o Is subjected to checks and controls on validity and reliability.
 Advantages of Observation Method
o Subjective bias is eliminated, if observation is accurately done.
o The information relates to what is currently happening.
o Not complicated by either past behavior or future intentions or attitudes.
o Independent of respondent’s willingness to respond and hence less demanding on
active cooperation on the part of the respondents.
o Suitable in studies which deal with subjects who are not capable of giving verbal
reports of their feelings for one reason or the other.
 Limitations of Observation Method
o It is an expensive method
o Information provided by this method is very limited
o Sometimes unforeseen events may interfere with the observational task
o Some subjects are rarely accessible to direct observation
o If subjects know that they are being observed, they may change their behavior
 Interviewing Technique
o An interview is a data-collection technique that involves oral questioning of
respondents, either individually or as a group.
o Requires a person known as the interviewer asking questions in a face-to-face contact
to the interviewee or through other means of communication like telephone.
o Answers to the questions posed during an interview can be recorded by writing them
down (either during the interview itself or immediately after the interview) or by tape-
recording the responses, or by a combination of both.
 Advantages of the Interview Method
o Detailed information can be obtained.
o Interviewer could overcome resistance of the respondent, if any.
o Provides flexibility to the interviewer to restructure, clarify, or add probe questions.
o Observation can also be applied during interview.
o Is suitable for use with both literates and illiterates.
o Has higher response rate than written questionnaires.
o The interviewer can collect supplementary information about the respondent’s
personal characteristics and environment.
 Limitations of Interview
o It is very expensive and time consuming especially when the sample is large.
o Chances of Interviewer as well as interviewee’s bias are high.
o People with certain high level positions like officials or executives may not be easily.
approachable under this method and to that extent the data may prove inadequate.
___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
155
 o Creating effective rapport with the interviewee may be a difficult.
o Some subjects may demand incentives during data collection process.
o There may be a language barrier between an interviewer and interviewee.
 Pre-Requisites and Basic Tenets of Interviewing
o Interviewers should be carefully selected and trained
o They must possess technical competence (interviewing and interpersonal skills)
o They should be able to create an atmosphere of trust and confidence
 Written Questionnaires
o A written questionnaire (also referred to as self-administered questionnaire) is a data
o collection method in which written questions are presented that are to be answered by
the respondents in written form. The questions can be either open-ended or closed
(with pre categorized answers).
o A written questionnaire can be administered in different ways, such as by:
 Sending questionnaires by mail with clear instructions on how to answer the
questions and asking for mailed responses;
 Gathering all or part of the respondents in one place at one time, giving oral or
written instructions, and letting the respondents fill out the questionnaires; or
 Hand-delivering questionnaires to respondents and collecting them later.
 Advantages of Questionnaires
o Low cost when study is large
o Free from interviewer bias
o Respondents have adequate time to give out their answers
o Respondents, who are not easily approachable, can be reached
o Used in large studies
o Permits anonymity and may result in more honest responses.
 Limitations of Questionnaires
o Low rate of return of the duly filled in questionnaires
o Bias due to non-response is undetermined
o Used only when respondents are educated and cooperating
o Control over questionnaire may be lost
o Not flexible once the questionnaire has been dispatched out
o Ambiguous replies or omissions creating difficult in interpretation
o Slowest method of all when mailing is used
 Focus Group Discussions (FGD)
o FGD allows a group of 6 - 12 informants to freely discuss a certain subject with the
guidance of a facilitator or reporter during which group members talk freely and
spontaneously about a certain topic.
 Characteristics and Uses of Focus Group Discussions
o A FGD is a qualitative method.
o A FGD aims to be more than a question-answer interaction.

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
156
 o The idea is that group members discuss the topic among themselves, with guidance
from the facilitator.
o FGD techniques can be used to:
 Focus research and develop relevant research hypotheses by exploring in greater
depth the problem to be investigated and its possible causes.
 Formulate appropriate questions for more structured, larger scale surveys.
 Help understand and solve unexpected problems in interventions.
 Develop appropriate messages for health education programmes and later evaluate
the messages for clarity.
 Explore controversial topics. For example: Sexual behavior is a controversial
topic in the sense that males and females judge sexual relations and sexuality
often from very different perspectives.
 Advantages of FGD
o The researcher can interact with the participants, pose, follow up questions or ask
questions that probe more deeply.
o Results can be easier to understand than complicated statistical data.
o The researcher can get information from non-verbal responses such as facial
expressions or body language.
o Information is provided more quickly than if people were interviewed separately.
 Limitations of FGD
o The small sample size means the groups might not be a good representation of the
larger population
o Group discussions can be difficult to steer and control, so time can be lost to
irrelevant topics
o Respondents can feel peer pressure to give similar answers to the moderators’
questions
o The moderators skills in phrasing questions along with setting can affect responses
and skew results

 Advantage of using Available Information Usually there is a large amount of data that has
already been collected by others, although it may not necessarily have been analyzed or
published. Locating these sources and retrieving the information is a good starting point
in any data collection effort. For example,
o Analysis of the information routinely collected by health facilities can be very useful
for identifying problems in certain interventions or in flows of drug supply, or for
identifying increases in the incidence of certain diseases.
o Analysis of health information system data, census data, unpublished reports and
publications in archives and libraries or in offices at the various levels of health and
health-related services, this may be a study in itself. Usually, however, it forms part of
a study in which other data collection techniques are also used.

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
157
 o The use of key informants is another important technique to gain access to available
information. Key informants could be knowledgeable community leaders or health
staff at various levels and one or two informative members of the target group (e.g.,
adolescents on their sexual behavior). They can be involved in various stages of the
research, from the statement of the problem to analysis of the data and development
of recommendations.
o Other sources of available data are newspapers and published case histories, e.g.,
patients suffering from serious diseases, or their relatives, telling their experiences
and how they cope.
o The advantage of using existing data is that: Collection is inexpensive. However, it is
sometimes difficult to gain access to the records or reports required, and the data may
not always be complete and precise enough, or too disorganized.
Note:
 In order to retrieve the data from available sources, the researcher will have to
design an instrument such as a checklist or compilation sheet.
 In designing such instruments, it is important to inspect the layout of the source
documents from which the data is to be extracted.
 For health information system (HIS) data, for example, the data compilation sheet
should be designed in such a way that the items of data can be transferred in the
order in which the items appear in the source document. This will save time and
reduce error.
 Interviewing
o An interview is a data-collection technique that involves oral questioning of
respondents, either individually or as a group. Answers to the questions posed during
an interview can be recorded by writing them down (either during the interview itself
or immediately after the interview) or by tape-recording the responses, or by a
combination of both.
o Interviews can be conducted with varying degrees of flexibility. The two extremes,
high and low degree of flexibility, are described below:
 High degree of flexibility:
• For example: When studying sensitive issues such as teenage pregnancy and
abortions, the investigator may use a list of topics rather than fixed questions.
• These may, e.g., include how teenagers started sexual intercourse, the
responsibilities girls and their partners take to prevent pregnancy (if at all),
and the actions they take in the event of unwanted pregnancies.
• The investigator should have an additional list of topics ready when the
respondent falls silent, (e.g., when asked about abortion methods used, who
made the decision and who paid).
• The sequence of topics should be determined by the flow of discussion. It is
often possible to come back to a topic discussed earlier in a later stage of the
interview.

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
158
 • The unstructured or loosely structured method of asking questions can be used
for interviewing individuals as well as groups of key informants.
• A flexible method of interviewing is useful if a researcher has as yet little
understanding of the problem or situation he is investigating, or if the topic is
sensitive. It is frequently applied in exploratory studies.
• The instrument used may be called an interview guide or interview schedule.*
• Low degree of flexibility:
o Less flexible methods of interviewing are useful when the researcher is
relatively knowledgeable about expected answers or when the number of
respondents being interviewed is relatively large.
o Then questionnaires may be used with a fixed list of questions in a
standard sequence, which have mainly fixed or pre-categorized answers.
o For example: After a number of observations on the (hygienic) behavior of
women drawing water at a well and some key informant interviews on the
use and maintenance of the wells, one may conduct a larger survey on
water use and satisfaction with the quantity and quality of the water.
 Administering Written Questionnaires
o A written questionnaire (also referred to as self-administered questionnaire) is a data
collection tool in which written questions are presented that are to be answered by the
respondents in written form. A written questionnaire can be administered in different
ways, such as by:
o Sending questionnaires by mail with clear instructions on how to answer the questions
and asking for mailed responses;
o Gathering all or part of the respondents in one place at one time, giving oral or written
instructions, and letting the respondents fill out the questionnaires; or hand-delivering
questionnaires to respondents and collecting them later.
o The questions can be either open-ended or closed (with pre-categorized answers).
 Projective Techniques
o When a researcher uses projective techniques, she/he asks an informant to react to
some kind of visual or verbal stimulus. For example:
 An informant may be provided with a rough outline of the body and be asked to
draw her or his perception of the conception or onset of an illness.
 Another example of a projective technique is the presentation of a hypothetical
question or an incomplete sentence or case/study to an informant (‘story with a
gap’).
o A researcher may ask the informant to complete in writing sentences such as:
 If I were to discover that my neighbor had TB, I would ...;
 If my wife were to propose that I use condoms, I would...
 Or (s) he may ask the informant: Suppose your child suffered from diarrhea, what
would you do?
o Such techniques can easily be combined with semi-structured interviews or written
questionnaires. They are also very useful in FGDs to get people’s opinion on sensitive
___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
159
 issues.
o Mapping and Scaling
 Mapping is a valuable technique for visually displaying relationships and
resources.
 In a water supply project for example:
• Mapping is invaluable. It can be used to present the placement of wells,
distance of the homes from the wells, other water systems, etc. It gives
researchers a good overview of the physical situation and may help to
highlight relationships hitherto unrecognized.
• Mapping a community is also very useful and often indispensable as a pre-
stage to sampling.
• Scaling is a technique that allows researchers through their respondents to
categorize certain variables that they would not be able to rank themselves.
• For example, they may ask their informant(s) to bring certain types of herbal
medicine and ask them to arrange these into piles according to their
usefulness. The informants would then be asked to explain the logic of their
ranking.
 Mapping and scaling may be used as participatory techniques in rapid appraisals
or situation analyses. Rapid appraisal techniques and participatory research are
approaches often used in health systems research.

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
160
 Handout 16.2: Advantages and disadvantages of using various
data collection tools
Table for advantages and disadvantages of using various data collection tools

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
161
 Corlien, Pathmanathan, & Brownlee. (2003).

Handout 16.3: Focus group discussions

 Uses of Focus Group Discussions
o Help understand and solve unexpected problems in interventions. For example:
 In District X, the recent national (polio) immunization days (NID) showed widely
different coverage’s per village (50-90%) and in a number of villages a marked
decrease in coverage was observed compared to last year.
 Eight FGD decrease were held with villages’ mothers, two in town, three in rural
with a marked in NID coverage and three in villages with a high coverage
throughout.
 It appeared that overall; the concept NID had raised confusion.
 Most people believed that this mass campaign strengthened the children’s
immunity
 Against any (childhood) disease, including Malaria and Respiratory Tract
Infections.
 In the villages with a low NID coverage there had been a high incidence of
malaria in
 Children immediately after the previous NID campaign and several children
died.
 Mothers therefore believed that the NID campaign was useless.
 Develop appropriate messages for health education programmes and later evaluate
the messages for clarity.
 For example: A rural health clinic wanted to develop a health education
programme focused on weaning problems most often encountered by mothers in
the surrounding villages and what to do about them.
 The focus group discussion could be used for exploring relevant local concepts as
well as for testing drafts when developing the messages.
 The messages should be developed and tested in different socio-economic groups
of mothers, as weaning practices may differ with income, means of subsistence
and education of the mothers. Also ethnic differences may have to be taken into
account.
o Explore controversial topics.
 For example: Sexual behavior is a controversial topic in the sense that males and
females judge sexual relations and sexuality often from very different
perspectives.
 Sexual education has to take this difference into account.

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
162
  Through FGDs, first with females, then with males, and then with a mixed group
to confront both sexes with the different outcomes of the separate discussions
(listed on flip charts) it becomes easier to bring these differences in the open.
Especially for teenagers, who may have many stereotypes about the other sex or
be reluctant to discuss the topic openly (particularly girls), such a ‘multi-stage’
approach is useful.
 Strengths and Limitations of FDG
o Implementation of FGDs is an iterative process; each focus group discussion builds
on the previous one, with a slightly elaborated or better-focused set of themes for
discussion.
o Provided the groups have been well chosen, in terms of composition and number (see
o below), FGDs can be a powerful research tool which provides valuable spontaneous
information in a short period of time and at relatively low cost.
o FGD should not be used for quantitative purposes, such as the testing of hypotheses or
the generalization of findings for larger areas, which would require more elaborate
surveys.
o However, FGDs can profitably complement such surveys or other, qualitative
techniques.
o Depending on the topic, it may be risky to use FGDs as a single tool.
o In group discussions, people tend to center their opinions on the most common ones,
on ‘social norms. In reality, opinions and behavior may be more diverse. Therefore it
is advisable to combine FGDs with at least some key informant and in-depth
interviews.
o Explicitly soliciting other views during FGDs should be routine as well.
o In case of very sensitive topics, such as sexual behavior or coping with HIV/AIDS,
FGDs may also have their limitations, as group members may hesitate to air their
feelings and experiences freely.
o One possible remedy is the selection of students who do not know each other (e.g.,
selection of children from different schools in FGDs about adolescent sexual
behavior), while assuring absolute confidentiality.
o It may also help to alternate the FGD with other methods, for example, to precede it
by a self-developed role play on sexual behavior, or to administer a written
questionnaire immediately after the FGD with open questions on sexual behavior in
which the students can anonymously state all their questions and problems. This
worked in Tanzania and Nepal.
 How to Conduct a Focus Group Discussion
o Determine the purpose
 A FGD can be regarded as a mini-study. It therefore requires one or two clear
objectives.
 These objectives will guide the research team in the formulation of discussion
questions.

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
163
 o Situation analysis
 Any FGD requires good knowledge of local conditions. Communities are seldom
or never homogeneous. There are always differences between community
members, for example in education, political power, gender, economic status and
ethnic group.
 These differences will be reflected in their perceptions of the problems they suffer
from and possible solutions.
 A researcher must be aware of these differences, otherwise (s)he may miss
important groups of students or obtain a hotchpotch of information.
 Similarly, she/she must know which key persons or organizations could be good
entry points for the selection of students in the FGDs (e.g.: women’s groups,
parent associations, youth clubs, etc.).
 For example: In an intervention study on sexual health among out-of-school youth
in an urban area, the researcher first planned some interviews with key informants.
 He selected the leaders of a political youth club and of a Christian youth club and
some teachers, with whom he thoroughly discussed his research topic.
• Through them he came in contact with youth of different backgrounds. He let
each of the three groups, separated into boys and girls, draw maps of the town
and asked them to mark places which they thought riskful in terms of sexual
behavior (easy contacts, unprotected sex).
• The drawings formed a good basis for further FGDs but also helped him to
identify wider networks of adolescents at risk who had to be included in the
study.
 Points to be Considered when Preparing the FGD
o Recruitment of students: Students should be roughly of the same socio-economic
group or have a similar background in relation to the issue under investigation. The
age and sexual composition of the group should facilitate free discussion.
o Selection of students: If you are an outsider in the research area, you may have to rely
on your key informants for the first selection of students in FGDs.
o Your key informants to whom you have explained thoroughly the purpose and the
process of the FGD might each suggest some individuals who could be invited to a
focus group discussion.
o Another way of getting students is to conveniently select individuals in a systematic
way, to try and ensure a range of views.
o You might, for example, ask every third or fourth person you find. This method might
be more suitable in urban areas.
o Physical arrangements:
 Communication and interaction during the FGD should be encouraged in every
way possible. Arrange the chairs in a circle. Make sure that there will be no
disturbances, sufficient quietness, adequate lighting, etc.

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
164
  Try to hold the FGD in a neutral setting which encourages students to freely
express their views. A health center, for example, is not a good place to discuss
traditional medical beliefs or preferences for other types of treatment.
 Preparation of a discussion guide:
o There should be a written list of topics to be covered, formulated as a series of open-
ended questions.
o Guides for different groups gathered to discuss the same subject may vary slightly,
depending on their knowledge or attitudes and how the subject should first be
explored with them.
 Conducting the session
o One of the members of the research team should act as ‘facilitator’ or ‘moderator’ for
the focus group discussion.
o One should serve as ‘recorder’.
o The facilitator should preferably be as close as possible to the students in their
characteristics (same sex, roughly same age).

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
165
 Handout 16.4: Function of Focus Group Facilitator
 Functions of the Facilitator of the FDG ( Focus Discussion group)
o The facilitator should NOT act as an expert on the topic. His or her role is to stimulate
and support discussion.
o Introduce the session
 Introduce yourself as facilitator and introduce the recorder.
 Let students introduce themselves with whatever names they wish to use.
 Put the students at ease and explain the purpose of the FGD, the kind of
information needed, and how the information will be used (for the planning of a
health programmes, an education programmes).
 Ask permission to use a tape-recorder, let people hear their own voices before the
session starts.
 You might offer drinks and allow some informal discussion before the actual
session starts.
o Encourage discussion
 Be enthusiastic, lively, and humorous and show your interest in the groups’ ideas.
 Formulate questions and encourage as many students as possible to express their
views.
 Remember there are no ‘right’ or ‘wrong’ answers.
 React neutrally to both verbal and non-verbal responses.
o Encourage involvement
o Avoid a question-and-answer session. Some useful techniques include:
 Asking for clarification: ‘Can you tell me more about...?’
 Reorienting the discussion when it goes ‘off the track’: Saying: ‘Wait, how does
 this relate to...?’
 Saying: ‘Interesting point, but how about...?’
 Using one student’s remark to direct a question to another, for example, ‘Mrs. X
said ..., but how about you, Mrs. Y?’
 When dealing with a dominant participant, avoiding eye contact or turning
 slightly away to discourage the person from speaking, or thanking the person
and changing the subject.
 When dealing with a reluctant participant, using the person’s name, requesting
his/her opinion, making more frequent eye contact to encourage his/her
participation is important.
o Deal correctly with sensitive issues.
o If you notice that the discussion stops when dealing with a sensitive topic, you could

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
166
 o ask students (if literate) to anonymously write down their responses or opinions on the
topic.
o Alternatively, you could summarize for the group some of the opinions from previous
focus group discussions, focusing on one or two major contrasting opinions.
o Still another strategy is to form sub-groups, and to get a member of the sub-group to
summarize and present the opinions of their sub-group members after which the
whole group can still discuss these opinions.
o Build rapport, empathize
o Observe non-verbal communication.
o Ask yourself, ‘What are they saying? What does it mean to them?’
o Be aware of your own tone of voice, facial expressions, body language, and those of
the students.
o Avoid being placed in the role of expert
o When asked for your ideas or views by a respondent, remember that you are not there
o to educate or inform.
o Direct the questions back to the group by saying: ‘What do you think’, ‘What would
you do?’
o Set aside time, if necessary, after the session to give students the information they
have asked for.
o Do not try to comment on everything that is being said.
o Don’t feel you have to say something during every pause in the discussion.
o Wait a little and see what happens.
o Control the rhythm of the meeting, but in an unobtrusive way
o Listen carefully and move the discussion from topic to topic. Subtly control the time
allocated to various topics so as to maintain interest.
o If students spontaneously jump from one topic to another, let the discussion continue
for a while since useful additional information may surface; then summarize the
points brought up and reorient the discussion.
o Take time at the end of the meeting to summarize, check for agreement and thank the
Students
o Summarize the main issues brought up, check whether all agree and ask for additional
comments.
o Thank the students and let them know that their ideas have been a valuable
contribution and will be used for planning the proposed research, intervention, or
health education materials.
o Listen for additional comments and spontaneous discussions which occur after the
meeting has been closed.
 Functions of the Recorder
o The recorder should keep a record of the content of the discussion as well as
emotional reactions and important aspects of group interaction.

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
167
 o Assessment of the emotional tone of the meeting and the group process will enable
you to judge the validity of the information collected during the FGD.
o Items to be recorded include:
 Date, time, place
 Names and characteristics of students
 General description of the group dynamics (level of participation, presence of a
dominant participant, level of interest)
 Opinions of students, recorded as much as possible in their own words, especially
for key statements
 Emotional aspects (e.g., reluctance, strong feelings attached to certain opinions)
 Vocabulary used - particularly in FGDs that are intended to assist in developing
questionnaires or health education materials
 Spontaneous relevant discussions during breaks or after the meeting has been
closed
o It is highly recommended that a tape-recorder be used to assist in capturing
information. Even if a tape-recorder is used, notes should be taken as well, in case the
machine malfunctions and so that information will be available immediately after the
session for discussion.
o If there is no reliable tape-recorder available, it is advisable to have two recorders.
o A supplementary role for the recorder could be to assist the facilitator (if necessary)
by drawing his or her attention to: missed comments from students missed topics (the
recorder should have a copy of the discussion guide during the FGD)
 Number and Duration of Sessions
o Number of sessions. The number of focus group sessions to be conducted depends
upon project needs, resources, and whether new information is still coming from the
sessions, (that is, whether contrasting views within and between various groups in the
community are still emerging). If not, you may stop.
o One should plan to conduct at least two FGDs for each sub-group (for example, two
for males and two for females). Otherwise you have no way of assessing whether the
information you get from the first FGD is representative for that group.

 Duration
o A focus group session typically lasts up to an hour and a half.
o Generally, the first session with a particular type of group is longer than the following
ones because all of the information is new.
o Thereafter, if all the groups have a similar opinion on particular
topics, the facilitator may be able to move the discussion along more quickly to other
topics which still elicit new points of view.

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
168
Session 17: Pre-Testing the Research Tools

Total Session Time: 60 minutes + 240 minutes assignment

Prerequisites
 None

Learning Tasks
By the end of this session students are expected to be able to:
 Define pretest and pilot study
 Outline reasons for pretest
 Describe the components of a pre-test
 Plan and carry out pre-test of research components

Resources Needed
 Flip charts, marker pens, and masking tape
 Black/white board and chalk/whiteboard markers
 Computer and LCD Projector
 Handout 17.1: Summary of points to assess during a pre-test or pilot study

SESSION OVERVIEW

Activity/
Step Time Content
Method
05 Introduction, Learning Tasks
1. Presentation
minutes
05 Presentation Definition of Pre-test and pilot study
2.
minutes Brainstorming
Presentation Reasons for pretesting
10
3. Lecture
minutes
discussion
15 Presentation Components of a Pre-Test and Pilot Study
4.
minutes Buzzing
10 Presentation
5. Planning and Carrying out Pre-Test of Research
minutes Buzzing Components
05
6. Presentation Key Points
minutes
05
7. Presentation Evaluation
minutes
8. 05 Presentation Assignment
___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
169
 minutes

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
170
SESSION CONTENTS

STEP1: Presentation of Session Title and Learning Tasks (5 minutes)

READ or ASK students to read the learning tasks and clarify

ASK students if they have any questions before continuing

STEP 2: Definition of a Pre-Test or Pilot Study (05 minutes)

Activity: Brainstorming (2 minutes)

Ask students to brainstorm on the following questions:

 What are the components of pre-test tools or pilot study?

ALLOWS few students to respond

WRITE their responses on the flipchart or board

CLARIFY and SUMMARIZE by using the content below

 A pre-test
o Refers to a small-scale trial of particular research components
 A pilot study
o is the process of carrying out a preliminary study, going through the entire research
procedure with a small sample

STEP 3: Reasons for Pre-Testing (10 minutes)

 Help to identify potential problems in the proposed study.

 Enables, if necessary, to revise the methods and logistics of data collection before starting
the actual field works.
 As a result, a good deal of time, effort and money can be saved.
 Pre-testing is simpler and less time-consuming and costly than conducting an entire pilot
study.

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
171
STEP 4:Components of Pre-Testing (15 minutes)

Activity: Buzzing (5 minutes)

Ask students to buzz on the following question:

 What are the components of pre-test?

ALLOWS few students to respond

WRITE their responses on the flipchart or board

CLARIFY and SUMMARIZE by using the content below

 The components of research to be pre-test include:

o Reactions of the respondents to the research procedures
o The data-collection tools
o Sampling procedures
o Staffing and activities of the research team
o Procedures for data processing and analysis
o The proposed work plan and budget for research activities
 Reactions of the respondents to the research procedures
o Availability of the study population
o Study population daily work schedules
o Acceptability of the methods used
o Acceptability of the questions asked
o willingness of the respondents to answer the question
 The data-collection tools
o Whether the tools can collect the information you need and whether they are reliable
o How much time is needed to collect data
o Whether there is any need to revise the format or presentation of interview
guides/questionnaires e.g.
 Sequencing
 Wording
 Translation
 Space for answers
 Sampling procedures
o Instructions followed
o Time need to locate respondents

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
172
 Staffing and activities of the research team
o training
o Logistics
o team work
 Procedures for data processing and analysis
 work plan and budget for research activities

STEP 4: Planning and Carrying Out Pre-Tests of Research Components

(10 minutes)
Activity: Buzzing (5 minutes)

ASK students to pair up and buzz on the following question for 2 minutes

 What are the components of research that should be assessed during the pre-testing?

ALLOW few students to respond

WRITE their responses on flipchart or board

CLARIFY and SUMMARIZE by using the content below

Components of research to be assessed during the pre-testing

 During training
o The reactions
o Appropriateness of study type(s) and research tools
o Format and wording of questionnaires and interview schedules
o Accuracy of the translations
o The time
o Sampling procedures
Data processing and analysis.

 Pre-test in the actual research area

o What difficulties do you expect in the implementation of your proposal?
o Inexperience with a certain data-collection technique
o Which parts of your study will be most costly and time-consuming?

 It is highly recommended that you analyse the data collected during the pre-test right
away

STEP 5: Key Points (5 minutes)

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
173
 A pre-test refers to a small-scale trial of particular research components
 A pilot study is the process of carrying out a preliminary study, going through the entire
research procedure with a small sample
 It is highly recommended that you the pre-test some components of your study

STEP 6: Evaluation (5 minutes)

 What is a pre-test?
 What is pilot study?
 What research components are to be pre-tested?

STEP 7: Take Home Assignment (5 minutes)

Activity: Take Home Assignment (5 minutes)

DIVIDE students in groups or individuals

ASK the students to work on the following Assignment

 Identify what aspects of the study you would like to pre-test in your research area and why,
with whom, when and where.
 Summarize this information in one or two paragraphs in your research proposal.

ALLOCATE time for students to do the assignment and submit

REFER students to recommended reference

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
174
References
Hardon A, Boonmongkon P, and Streefland P. et al (2001). Applied Health research,
Anthropology of health and health care, (3rd Ed) Amsterdam, The Netherlands: Het
Spinhuis Publishers

Beaglehole R, Bonita R and Kjellstrom (1993) Basic epidemiology: Geneva, Switzerland:

World Health Organization,

Kothari C.R (1985). Research Methodology – Methods and techniques, (2nd ed); New Delhi,
India; Wiley Eastern Limited

Stewart A (2001). Basic Statistics and epidemiology, A practical guide,; London, United
Kingdom: Radcliffe Medical Press,

Varkevisser, C. M, Pathmanathan, I and Brownlee, A (1991). Designing and Conducting

Health Systems Research Projects, Vol. 2 Part I: Ottawa, Canada: IDRC

Polit, D. F and Beck, C. T (2004). Nursing Research – Principles and Methods, (7th Ed):
Philadelphi, USA: Lippincott Williams & Wilkins

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
175
 Handout 17.1: Summary of points to assess during a pre-test or pilot study

1. Reactions of respondents to your Acceptable Not Suggestions

research procedures acceptable

Availability of sample needed for full

study

Work schedules of population that may

affect their availability

Desire of population to participate

Acceptability of questions

Clarity of the language used

Acceptable
2. The data-collection tools Not Suggestions
acceptable

Whether the tools provide the

information you need and are reliable

The time needed for administering each

of the data-collection tools

Presentation of questions and format of

questionnaire

Accuracy of translation

Pre-categorising of questions

Coding system and coding guidelines

Handling and administering the tools

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
176
3. Sampling procedures Acceptable Not Suggestions
acceptable

Whether the instructions to obtain the

sample are used uniformly by all staff

The time needed to locate the

individuals to be included in the study

4. Preparation and effectiveness of Acceptable Not Suggestions

research team acceptable

Adequacy of staff training

Output of each team member

Team dynamics

Reliability of tools when administered

by different team members

Accuracy of interpretation

Appropriateness of plan for supervision

5. Procedures for data processing Acceptable Not Suggestions

and analysis acceptable

Use of data master sheets

Effectiveness of data quality control

Appropriateness of statistical
procedures

Ease of data interpretation

6. Schedule for research activities Acceptable Not Suggestions

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
177
 acceptable

Amount of time allowed for:

field trips for data collection

Supervision

Administration

analysis of data

Sequence of activities

Source: Corlien, Pathmanathan, & Brownlee. (2003).

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
178
Session 18: Data Collection Plan

Total Session Time: 120 minutes + 240 minutes assignment

Prerequisites
 None

Learning Tasks
By the end of this session students are expected to be able to:
 Describe problems that may arise during data collection and how they may be solved.
 Prepare a plan for data collection for the developed research proposal
 Determine the various tasks of the staff needed for research
 Prepare a work schedule (GANTT chart)
 Draw a work schedule (GANTT chart)

Resources Needed
 Flip charts, marker pens, and masking tape
 Black/white board and chalk/whiteboard markers
 Computer and LCD Projector
 Handout 18.1: Example of a GANTT
 Handout 18.2: Example of a work schedule

SESSION OVERVIEW
Activity/
Step Time Content
Method
1 05 minutes Presentation Introduction, Learning Tasks
Presentation
2 15 minutes Typical Problems that May Arise During Data
Buzzing Collection and Solutions.

3 10 minutes Presentation Preparation of a Plan for Data Collection for the

Developed Research Proposal
Presentation
4 25 minutes Group Determination of Various Tasks of the Staff Needed for
discussion Research
5 Presentation Preparation of a Work Schedule (GANTT Chart)
25 minutes
6 Presentation Drawing a Work Schedule (GANTT Chart)
25 minutes

7 05 minutes Presentation Key Points

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
179
 8 05 minutes Presentation Evaluation

9 05 minutes Presentation Assignment

SESSION CONTENTS

STEP 1: Presentation of Session Title and Learning Tasks (5 minutes)

READ or ASK students to read the learning tasks and clarify

ASK students if they have any questions before continuing

STEP 2: Typical Problems that May Arise During Data Collection and
Solutions (15 minutes)

Activity: Buzzing (5 minutes)

ASK students to pair up and buzz on the following question for 2 minutes

ASK What problems may arise during data collection and their solutions

ALLOWS few students to respond

WRITE their responses on the flipchart or board

CLARIFY and SUMMARIZE by using the content below

 Possible problems
Sources of data distortion (bias) that might include:
o Deviations from the sampling procedures set out in the proposal.
o Variability or bias in observations or measurements made because
 Research assistants are placed under too much stress
 Inadequate supervision of research assistants.
 Questionnaire not filled in completely
 Solutions
o Training research assistant
o Pretest instrument
o Adequate supervision of data collection
o Revise method to check quality of data
___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
180
 o Prior anticipation of problems that might occur and prepare plan to overcome them

STEP 3: Preparation of a Plan for Data Collection for the Developed

Research Proposal (10 minutes)
 A Plan for Data Collection
o Listing the tasks that have to be carried out, and who should be
involved,
o Making a rough estimate of the time needed for the different parts
of the study
o Identifying the most appropriate period in which to carry out the
research.
o Scheduling the different activities that have to be carried out each
week in a work plan.
 Pre-Testing
o Before the proposal development is finished, a pre-test of the data
collection and data
analysis procedures should be made.
o The advantages of conducting a pre-test before the proposal is that
we can draft the work plan and budget based on more realistic
estimates, as well as revise the data collection tools before we
submit the proposal for approval.
o However, further pre-testing and planning of the research have to
be done in the field.
 Stages in the Data Collection Process
o Stage 1: Permission to proceed
o Stage 2: Data collection
o Stage 3: Data handling
 Stage 1: Permission to Proceed
o Consent must be obtained from the relevant authorities, individuals
and the community in which the project is to be carried out.
 This may involve organizing meetings at national or provincial
level, at district and at village level.
o For clinical studies this may also involve obtaining written informed
consent.
o The principal investigator will be responsible for obtaining
permission to proceed at the various levels.
o The Health Research Unit in the Ministry of Health or the institution
organizing the
course may assist in obtaining permission from the national level.
 Stage 2: Data Collection

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
181
 o During data collection consider:
 Logistics: who will collect what, when and with what resources
 Quality control (data must be reliable and valid)
o When allocating tasks for data collection, it is recommended that
first list type of data
required.
o Identify who could best implement each of the tasks.
 If it is clear earlier that your research team will not be able to
carry out the entire
study by itself
 Plan to look for research assistants to assist in relatively simple
but time-consuming tasks.
Consider the following:
 Time for Data Collection
o Think about how long will it take to collect data for each component
of the Study?
 The time required to reach the study area(s)
 The time required locating the study units (persons, groups,
records), search for
specific informants (e.g., users or defaulters of a specific service)
 It might take more time to locate informants than to interview
them; consider the number of visits required per study unit.
o Calculate the number of interviews that can be carried out per
person per day (e.g. 4)
o Calculate the number of days needed to carry out the interviews.
For example: You need to do 200 interviews
o Your research team of 5 people can do 5 x 4 = 20 interviews per
day
o You will need 200:20 = 10 days for the interviews
 Calculate the time needed for the other parts of the study, (for
example, 10 days)
 Determine how much time you can devote to the study.
o Since the research team usually consists of very busy people, it is
unlikely that team
members can spend more than 30 working days on the entire study:
o 5 days for preparation (including pre-testing and finalizing
questionnaires)
o 20 days actual field work
o 5 days data processing + preliminary analysis
 Think of when should the data be collected? The type of data to be
collected and the

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
182
 demands of the project will determine the actual time needed for the
data collection
 Consider:
o Availability of research team members and research assistants
o The appropriate season(s) to conduct the field work (if the problem
is season-related
or if data collection would be difficult during certain periods)
o Accessibility and availability of the sampled population
o Public holidays and vacation periods
 Stage 3: Data Handling
o Develop a clear procedure for handling and storing data
o Number questionnaires and other research tools. Decide if this
should be done at the time of the interview or at the time the
questionnaires are stored.
o Each tool used will get its own numbers starting from 1. If some
data sets are linked,
e.g., you interview leprosy patients as well as their relatives and
neighbors to analyze
their interaction and possible stigma from different perspectives,
better link the
numbers.
o Identify the person responsible for storing data and the place where
it will be stored.
o Decide how data should be stored.
o Record forms should be kept in the sequence in which they have
been numbered. In what sequence should data be collected?
o Other issues to consider during data collection
 In general, it is advisable to start with analysis of data that is
already available.
 data to be drawn from different sources but in one locality should
be collected at the same time.
 It is extremely important that the data collected are of good
quality (reliable and valid).

 Possible sources of data distortion (bias) that should try to prevent,

include:
o Deviations from the sampling procedures set out in the proposal.
o Variability or bias in observations or measurements made because:
 Subject changes his/her behavior
 Use of unstandardized weighing scales or inaccurate or no
guidelines for interviewing.

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
183
  Variation in researchers’ observations (observer variability) in
what they
observe or measure.
Variations in criteria for measurement or for categorizing answers;
changed them during the study.
 Measures to ensure good quality of data
o Prepare a field work manual for the research team as a whole,
including:
o Guidelines on sampling procedures and what to do if respondents
are not available or to co-operate.
o A clear explanation of the purpose and procedures of the study
which should be used to introduce each interview
o Instruction sheets on how to ask certain questions and how to
record

STEP 4: Determination of Various Tasks of the Staff Needed for Research

(25 minutes)

Activity: Small Group Discussion (5 minutes)

DIVIDE students into small manageable groups

ASK students to discuss on the following question

 What are various tasks for the staff needed for research you are developing?

ALLOW few students to respond

WRITE their responses on flipchart or board

CLARIFY and SUMMARIZE by using the contents below

 When allocating tasks for data collection, it is recommended that you first list them.
 Then you may identify who could best implement each of the tasks as example given
in the following matrix.

Task To be carried out by

Reviewing record (hospital + HCs) Research team, with research assistant

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
184
 Focus group discussions with health staff
Research team
before and after individual staff interviews

Individual health staff interviews Research team

Shadowing RCH nurses Principal investigator

Interviews with mothers (community-based)

Research team, with research assistants
before and after delivery

STEP 5: Preparation of a Work Schedule (Gantt chart) (25 minutes)

 How to Develop a Work Schedule
o Review and revise, if necessary, the list of tasks you prepared for your plan for data
collection.
o Add to the list other tasks you must complete not related to data collection (such as
clearance of proposal; data analysis and report writing; and feedback to authorities
and target group).
o Number all tasks.
o Make revisions, if required
o Preparing a work schedule (Gantt chart)
o Step 1: Consider:
 The time required to reach the study area(s);
 The time required to locate the study units (persons, groups, records);
 If you have to search for specific informants (e.g., users or defaulters of a specific
service) it might take more time to locate informants than to interview them.)
 The number of visits required per study unit.
• For some studies it may be necessary to visit informants a number of times,
for example, follow-up of pregnant mothers or malnourished children
 Time needed for follow-up of non-respondents should also be considered.
o Step 2: Calculate the number of interviews that can be carried out per person per day
(e.g., 4)
o Step 3: Calculate the number of days needed to carry out the interviews.
For example:
 you need to do 200 interviews
 your research team of 5 people each can do 4 interviews per day
 you will need how many days for the interviews
o Step 4: Calculate the time needed for the other parts of the study, (for example, 10
days)
o Step 5: Determine how much time you can devote to the study. It is unlikely that team
members can spend more than 30 working days on the entire study
 5 days for preparation (including pre-testing and finalizing questionnaires)
 20 days actual field work

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
185
  5 days data processing and preliminary analysis
Refer students to Handout 18. 1: Example of a GANTT

STEP 6: Drawing a Work Schedule (Gantt chart) (25 minutes)

 A Gantt chart is a chart that shows all of the different sub-tasks of a project and how they
relate to each other in terms of time. It's a way of displaying project schedule, and it helps
get the work done on time.
 It shows all of the tasks that need to be done, the amount of time each task is expected to
take, the time frames in which individual tasks are to be completed, and the relationship
between various tasks.
 This way, everything gets done on schedule, and you never waste time waiting for a task
to be completed that should have been done already.
 The Gantt chart should indicate
 The task to be performed
o Who is responsible for the task
o The time each task is expected to take
o The length of each task is shown by a bar that extends over the number of days, weeks
or months the task is expected to take

Refer students to Handout 18.2: Example of a Work Schedule

STEP 7: Key Points (5 minutes)

 Problems that may arise during data collection are sources of data distortion (bias)
 The Gantt chart is planning tool which depicts graphically the order in which various
tasks must be completed and the duration of each activity
 When allocating tasks for data collection, it is recommended that you first list them, then
you may identify who could best implement each of the tasks

STEP 8: Evaluation (5 minutes)

 What are the tasks of research staff?
 What are typical problems that may arise during data collection?
 What steps are in preparing a work schedule (Gantt chart)?

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
186
STEP 9: Assignment (5 minutes)

Activity: Take Home Assignment (5 minutes)

DIVIDE students in groups or individuals

ASK the students to work on the following Assignment

 Prepare a plan of action for conducting the research you are developing.
 Summarize it in a work schedule or GANTT chart

ALLOCATE time for students to do the assignments and submit

REFER students to recommended reference

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
187
References
Hardon A, Boonmongkon P, and Streefland P. et al (2001). Applied Health research,
Anthropology of health and health care, (3rd Ed) Amsterdam, The Netherlands: Het
Spinhuis Publishers

Beaglehole R, Bonita R and Kjellstrom (1993) Basic epidemiology: Geneva, Switzerland:

World Health Organization,

Kothari C.R (1985). Research Methodology – Methods and techniques, (2nd ed); New Delhi,
India; Wiley Eastern Limited

Stewart A (2001). Basic Statistics and epidemiology, A practical guide,; London, United
Kingdom: Radcliffe Medical Press,

Varkevisser, C. M, Pathmanathan, I and Brownlee, A (1991). Designing and Conducting

Health Systems Research Projects, Vol. 2 Part I: Ottawa, Canada: IDRC

Polit, D. F and Beck, C. T (2004). Nursing Research – Principles and Methods, (7th Ed):
Philadelphi, USA: Lippincott Williams & Wilkins,

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
188
 Handout 18.1: Example of a GANTT

Corlien, Pathmanathan, & Brownlee. (2003).

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
189
___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
190
 Handout 18.2: Example of a Work Schedule

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
191
Corlien, Pathmanathan, & Brownlee. (2003).

Session 19: Research Budget

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
192
Total Session Time: 120 minutes + 240 minutes assignment

Prerequisites
 None

Learning Tasks
By the end of this session students are expected to be able to:
 Identify the important points to be considered when starting to plan for data collection
 Determine what resources are available and needed to carry out the research
 Describe the activities of the research
 Cost the research activities, materials and supplies required

Resources Needed
 Flip charts, marker pens, and masking tape
 Black/white board and chalk/whiteboard markers
 Computer and LCD Projector

SESSION OVERVIEW
Activity/
Step Time Content
Method
1 05 minutes Presentation Introduction, Learning Objectives
Identification of Important Points to be
Presentation
2 15 minutes Considered when Starting to Plan for Data
Buzzing
Collection
Presentation Determination of Resources Available and
3
10 minutes Brainstorming Needed to Carry Out the Research
4 25 minutes Presentation Activities of the Research
50 minutes Presentation
Costing the Research Activities, Materials
5 Group
and Supplies Required
discussion
6 05 minutes Presentation Key Points

7 05 minutes Presentation Evaluation

8 05 minutes Presentation Assignment

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
193
SESSION CONTENTS

STEP1: Presentation of Session Title and Learning Tasks (5 minutes)

READ or ASK students to read the learning tasks and clarify

ASK students if they have any questions before continuing

STEP 2: Identification of Important Points to be Considered when Starting

to Plan for Data Collection (15 minutes)

Activity: Buzzing (5 minutes)

ASK students to pair up and buzz on the following question for 2 minutes:

 What are the important points to be considered when starting to plan for data collection?

ALLOW few pairs to respond and let other pairs to add on points not mentioned

WRITE their response on the flip chart/board

CLARIFY and SUMMARIZE by using the content below

 The most important points to be considered when starting to plan for data collection:
o It should be simple, realistic, and easily understood by those directly involved.
o It should cover the preparatory and the implementation phases of the project, as well
as data analysis, reporting, dissemination and utilization of results.
o The activities covered should include training, technical or research tasks;
administrative, secretarial and other support tasks.
o The realities of local customs (local holidays, festivals) and working hours should be
considered, when preparing the work plan.
o Also, seasonal changes and their effect on travel, work habits, and on the topic you
are studying (such as incidence of disease or nutritional status), should be kept in
mind as the schedule is planned.

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
194
STEP 3: Determination of Resources Available and Needed to Carry Out
the Research (10 minutes)
 Base on the work plan
 Specify for each activity in the work plan, what resources and inputs are required
 For each resource determine unit cost and, number of units to get the total cost

STEP 4: The Activities of the Research (30 minutes)

 Research activities include:
o Finalize research proposal and submit to ethical committee for clearance
o Translate questionnaires, typing, multiplying
o Recruit research assistants
o Obtain clearance and orient of DMOs, health institutions and village health workers
o Train research assistants
o Pre-test study
o Collect data
o Process data and make preliminary interpretation
o Analyze data and write report
o Disseminate and discuss research findings and preliminary recommendations with
community members, health staff
o Disseminate and discuss of research findings and preliminary recommendations with
policymakers/managers/ others
o Draft preliminary plan of action
o Hold meetings with policy makers/managers/others to discuss plan of action for
implementing recommendations
o Follow up on implementation of plan of action

STEP 5: Costing the Research Activities, Materials and Supplies Required

(50 minutes)
Activity: Small Group Discussion (5 minutes)

DIVIDE students into small manageable groups

ASK students to discuss on the following question

 What research activities, materials and supplies required in the study need to be
budgeted?

ALLOW few students to respond

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
195
WRITE their responses on flipchart or board

CLARIFY and SUMMARIZE by using the contents below

 Purpose of a Budget
o A detailed budget will help to identify which resources are already locally available
and
which additional resources may be required.
o The process of budget design will encourage you to consider aspects of the work plan
you
have not thought about before
o Serve as a useful reminder of activities planned, as your research gets underway.
 Budget Preparation
o A complete budget is not prepared until the final stage of project planning.
 Cost is usually a major limiting factor and therefore must always be kept in mind
during planning so that your proposals will not have an unrealistically high
budget.
o Remember that both ministries and donor agencies usually set limits for research
project
o budgets.
o The use of locally available resources increases the feasibility of the project from a
financial
point of view.
 Categories for a Budget
o Funds for personnel allowances for researchers, and assistants during training
research
assistants, field work piloting and actual study
o Funds for secretarial services e.g. typing the proposal and questionnaires, final report
and
dissemination
o Funds for transport number of visits and kilometers to be covered, funds for supplies.
o Stationary and lunch for those attending FGD, meetings
o 5% for emergency
 Making Reasonable Estimates in a Budget
o Do not underestimate the time needed to complete project tasks in ‘the real world’.
o Include a 5% emergency fund if you fear that you might have budgeted for the
activities
rather conservatively.
 If inclusion of a contingency fund is not allowed, an alternative is to slightly over-
budget in major categories.

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
196
 Budget Justification
o It is not sufficient to present a budget without explanation.
o The budget justification follows the budget as an explanatory note justifying briefly,
in the context of the proposal, why the various items in the budget are required.
o Give clear explanations concerning why items that may seem questionable or that are
particularly costly are needed and discuss how complicated expenses have been
calculated.
 If a strong budget justification has been prepared then, it is less likely that
essential items will be cut during proposal review.
 How to Reduce Budgets
o Explore whether other health-related institutions are willing to temporarily assign or
second personnel to the project.
o When possible, use local rather than outside personnel. If consultants are needed at
the
beginning, train local personnel as soon as possible to take over their work.
o Explore the use of students or community volunteers, where appropriate.
o Plan for strict control of project expenditures, such as those for vehicle use, supplies.
The budget justification follows the budget as an explanatory note justifying briefly,
in the
context of the proposal, why the various items in the budget are required.
o Give clear explanations concerning why items that may seem questionable or that are
particularly costly are needed and discuss how complicated expenses have been
calculated.
 If a strong budget justification has been prepared then, it is less likely that
essential items will be cut during proposal review.

 Example of a field budget: Costs involved in fieldwork

Category Unit Cost Multiplying Cost
(Tsh) Factors (Tsh)
ALLOWANCES
a. Researchers (5)
b. Research assistants (5)
c. Secretary (1)
d. Drivers (2)
e. Facilitator (1)
f. Evaluation pilot study
Subtotal (I)

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
197
Transport Costs

Subtotal (II)

Supplies
Subtotal (III)
Total (I+II+III)
5% Contingency
Grand Total

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
198
 The type of budget format to be used may vary depending upon whether the budget will
be supported by your own organization or submitted to the Ministry of Health or a donor
organization.
o Most donor organizations have their own special project forms, which include a
budget format (budget format)
o Keep in mind the tendency to underestimate the time needed to complete project tasks
in ‘the real world’
o If the budget is for a period longer than a year, build in allowances for inflation before
the project begins and in subsequent years by increasing costs by a set percentage
(budget preparation)
o It is not sufficient to present a budget without explanation (Budget justification)
o When possible, use local rather than outside personnel to reduce cost
 Obtaining funding for projects
o To conduct research, it is usually necessary to obtain funding for the research project.
In addition to preparing a good research proposal, the following strategies are useful
for researchers who need to obtain their own funding:
o Familiarize yourself with the policies and priorities of funding agencies. Such
policies and priorities may be:
o Identify the procedures, deadlines and formats that are relevant to each agency.
o Obtain written approval and support from relevant local and national health
authorities and submit this together with your proposal.
o If you are a beginning researcher, associate yourself with an established researcher.
Host agencies scrutinize the ‘credibility’ of the researcher to whom funds are
allocated. Such credibility is based on previous projects that have been successfully
completed.
o Build up your own list of successfully completed projects (i.e., your own reports,
publications, etc.).

STEP 6: Key Points (5 minutes)

 Plan for data collection should be simple, realistic, and easily understood by those
directly involved.
 To conduct research, it is usually necessary to obtain funding for the research project
 The type of budget format to be used may vary depending upon whether the budget will
be supported by your own organization or submitted to the Ministry of Health or a donor
organization

STEP 7: Evaluation (5 minutes)

 What are the most important points to consider when starting planning for research
budget?
 What resources are available and needed for preparation of research budget?
___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
199
STEP 8: Home Take Assignment (5 minutes)

Activity: Take Home Assignment (5 minutes)

DIVIDE students in groups or individuals

ASK the students to work on the following Assignment

Prepare the budget for conducting the research you are developing

ALLOCATE time for students to do the assignments and submit

REFER students to recommended reference

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
200
References
Hardon A, Boonmongkon P, and Streefland P. et al (2001). Applied Health research,
Anthropology of health and health care, (3rd Ed) Amsterdam, The Netherlands: Het
Spinhuis Publishers

Beaglehole R, Bonita R and Kjellstrom (1993) Basic epidemiology: Geneva, Switzerland:

World Health Organization,

Kothari C.R (1985). Research Methodology – Methods and techniques, (2nd ed); New Delhi,
India; Wiley Eastern Limited

Stewart A (2001). Basic Statistics and epidemiology, A practical guide,; London, United
Kingdom: Radcliffe Medical Press,

Varkevisser, C. M, Pathmanathan, I and Brownlee, A (1991). Designing and Conducting

Health Systems Research Projects, Vol. 2 Part I: Ottawa, Canada: IDRC

Polit, D. F and Beck, C. T (2004). Nursing Research – Principles and Methods, (7th Ed):
Philadelphi, USA: Lippincott Williams & Wilkins,

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
201
___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
202
Session 20: Data Collection

Total Session Time: 60 minutes + 360 minutes

Prerequisites
 None

Learning Tasks
By the end of this session students are expected to be able to:
 Review previous data-collection techniques
 State the uses and limitations of different data collection methods
 Mention issues to consider in selecting data collection methods
 List advantages of using a combination of different data collection techniques
 Explain difference between data collection methods and tools
 Identify various sources of bias in data collection and ways of preventing

Resources Needed
 Flip charts, marker pens, and masking tape
 Black/white board and chalk/whiteboard markers
 Computer and LCD

SESSION OVERVIEW
Activity/
Step Time Content
Method
1 05 minutes Presentation Introduction, Learning Tasks
Presentation
2 10 minutes Various Data-Collection Techniques
Buzzing
Presentation
3 Group The Uses and Limitations of Different Data
35 minutes discussion Collection Methods

4 Presentation Issues to Consider in Selecting Data Collection

10 minutes Methods

5 Presentation Advantages of Using a Combination of Different

10 minutes Data Collection Techniques

6 Presentation Difference between Data Collection

25 minutes Methods/techniques and Tools

7 Presentation Sources of Bias in Data Collection and Ways of

15 minutes Preventing
___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
203
 8 05 minutes Presentation Key Points
9 05 minutes Presentation Evaluation

SESSION CONTENTS

STEP1: Presentation of Session Title and Learning Tasks (5 minutes)

READ or ASK students to read the learning tasks and clarify

ASK students if they have any questions before continuing

STEP 2: Various Data-Collection Techniques (10 minutes)

Activity: Buzzing (5 minutes)

ASK students to pair up and buzz on the following question for 2 minutes

 What are various data-collection techniques

ALLOWS few students to respond

WRITE their responses on the flipchart or board

CLARIFY and SUMMARIZE by using the content below

 Data-collection techniques
o Use of available information
o Observation
o Interview
o Administering a questionnaire
o Focus group discussion
o In-depth interview

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
204
STEP 3: Uses and Limitations of Different Data Collection Methods (35
minutes)

Activity: Small Group Discussion (20 minutes)

DIVIDE students into small manageable groups

ASK students to discuss on the following question

 What are the uses and limitations of different data collection methods?

ALLOW students to discuss for 10 minutes

ALLOW few groups to present and the rest to add points not mentioned

CLARIFY and SUMMARIZE by using the contents below

 Use of available information

o Means: Looking into records and extracting information
o Advantages
 Cheaper since information is already there
 Doesn't depend on respondent’s willingness to respond
 Allow observation of trend

o Disadvantages
 May be difficult to access the data
 Information may be incomplete or imprecise
 Ethical concerns regarding confidentiality may arise
 Observation
o Means: Watching and recording, no talking with respondent
o advantages
 Gives information of what is currently happening
 Doesn't depend on respondent’s willingness to respond
 Disadvantages
 Observer may notice only what interests him/her (bias)
 Presence of observer may influence behaviour of respondent
 Ethical concerns regarding confidentiality may arise
 Interview
o Means: Asking a respondent questions orally
o Advantages
___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
205
  Can be used for illiterates
 Allows clarification of questions
 Higher response rate
o Disadvantages
 Expensive (time, human resources)
 Presence of interviewer may influence response
 Administering a questionnaire
o Means: giving respondents written questions (questionnaire) so that they read the
questions themselves and provide answers
o Advantages
 Quick and cheap, no many research assistants needed
 Allows anonymity, hence more honest responses
o disadvantages
 Require literate respondents
 Response rate could be low
 Questions may be misunderstood by respondents
 Some respondents may choose responses simply because they saw it there,
otherwise they wouldn't have thought of it
 Focus group discussion
o Means: A discussion of a topic by a group of selected persons guided by a facilitator
o Advantages
 Flexibility to explore new issues that arises
 Findings are more believable
 Relatively cheaper
o Disadvantage
 Discussion could base on irrelevant issues
 Minority opinion may not be expressed
 Difficult to analyse the data
 Require highly trained moderator
 In-depth interview
o Means: A person to person conversation in order to gain insight into people's
thoughts, feelings, and behaviour on important issues
o Advantages
 Collects large amount of data quickly
 Allows clarification of issues
o Disadvantages
 Needs skilled interviewer
 Data difficult to analyse
 Views could be subjective

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
206
STEP 4: Issues to Consider in Selecting Data Collection Methods (10
Minutes)
 Objectives of the study
 Nature of required information (quantitative or qualitative)
 Resources available (time, money, personnel)
 Acceptability of the method by respondents

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
207
STEP 5: Advantages of Using a Combination of Different Data Collection
Techniques (10 minutes)
 Data collection techniques can complement each other.
 A skillful use of a combination of different techniques can reduce the chance of bias and
give a more comprehensive understanding of the topic under study.
 Researchers often use a combination of flexible and less flexible research techniques.
 Flexible techniques include:
o Loosely structured interviews using open-ended questions.
o Focus group discussions.
o Participant observations are also called qualitative research techniques.
o They produce qualitative data that is often recorded in narrative form.

 Qualitative Research Techniques

o Involve the identification and exploration of a number of often mutually related
variables that give insight in human behavior (motivations, opinions, attitudes), in the
nature and causes of certain problems and in the consequences of the problems for
those affected.
o In qualitative technique why, what and how are important questions.
 Quantitative Research Techniques
o Quantitative technique is used to quantify the size, distribution, and association of
certain variables in a study population.
o In quantitative research techniques, how many? How often? and how significant? are
important questions.
o Structured questionnaires that enable the researcher to quantify pre- or post-
categorized answers to questions are an example of quantitative research techniques.
 The answers to questions can be counted and expressed numerically.
 Both qualitative and quantitative research techniques are often used within a single study.
 In research it is common to use more than one data collection technique.
o Example: Observation and interview
 This allows better understanding of the issue being studied and avoidance of bias

STEP 6: Difference Between Data Collection Methods and Tools (25

minutes)
 Data collection instruments and tools are things that are used in collecting information.
o Example of instrument: Data compilation form, interview guide, etc.
o Example of tool: Pen, weighing scale
 Different techniques need different instruments and tools
Technique Instrument/tool Tool

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
208
 Use of available information Data compilation form Eye, pen
Observation Checklist Eye, pen
Interview Interview schedule, guide Ears, pen, recorder

Administering a Questionnaire Pen

questionnaire
Focus Group Discussion FGD guide Recorder, notebook, pen
(FGD)

STEP 7: Sources of Bias in Data Collection and Ways of Preventing (15

Minutes)
 Sources of bias:
o Defective instruments or tools
o Interviewers and observers – different data collectors eliciting different information
o Effect of the interview – respondents mistrust the interview intention, thus dodge the
questions
o Information bias – incomplete record, respondents being unable to recall
 Ways to Reduce the Possibility of Bias:
o Data collection tools (including written introductions for the interviewers to use with
potential respondents) should be pre-tested. If necessary, adjustments should be made
to ensure better co-operation.
o If non-response is due to absence of the subjects, follow-up of non-respondents may
be considered.
o If non-response is due to refusal to co-operate, an extra, separate study of non-
respondents may be considered in order to identify to what extent they differ from
respondents.
o Another strategy is to include additional people in the sample, so that non-respondents
who were absent during data collection can be replaced. This can only be justified if
their absence was very unlikely to be related to the topic being studied.
o The bigger the non-response rate, the more necessary it becomes to take remedial
action.
o It is important in any study to mention the non-response rate and to honestly discuss
whether and how the non-response might have influenced the results.
STEP 8: Key Points (5 minutes)
 Data collection methods include; use of available information, observation, interview
administering questionnaires, focus group discussion, in-depth interview
 Sources of bias in data collection may arise from tools, interviewer and information
recorded
 Data collection instruments and tools are things that are used in collecting information

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
209
STEP 9: Evaluation (5 minutes)
 What data-collection methods/techniques are commonly used?
 What to consider in selecting data collection methods?
 What are sources of bias in data collection?

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
210
References
Hardon A, Boonmongkon P, and Streefland P. et al (2001). Applied Health research,
Anthropology of health and health care, (3rd Ed) Amsterdam, The Netherlands: Het
Spinhuis Publishers

Beaglehole R, Bonita R and Kjellstrom (1993) Basic epidemiology: Geneva, Switzerland:

World Health Organization,

Kothari C.R (1985). Research Methodology – Methods and techniques, (2nd ed); New Delhi,
India; Wiley Eastern Limited

Stewart A (2001). Basic Statistics and epidemiology, A practical guide,; London, United
Kingdom: Radcliffe Medical Press,

Varkevisser, C. M, Pathmanathan, I and Brownlee, A (1991). Designing and Conducting

Health Systems Research Projects, Vol. 2 Part I: Ottawa, Canada: IDRC

Polit, D. F and Beck, C. T (2004). Nursing Research – Principles and Methods, (7th Ed):
Philadelphi, USA: Lippincott Williams & Wilkins,

Kazaura, M. R., Makwaya, C. K., Masanja, C. M. and Mpembeni, R.C.(1997). Lecture

notesinBiostatistics, manual of biostatistics, Muhimbili University College of Health
Sciences, Dar es Salaam

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
211
Session 21: Data Collection - Field Work Activities

Total Session Time: 480 minutes

Prerequisites
 None

Learning Tasks
By the end of this session students are expected to be able to:
 Identify activities to be done before data collection
 Collect data
 Process data while in the field

Resources Needed
 Flip charts, marker pens, and masking tape
 Black/white board and chalk/whiteboard markers
 Computer and LCD Projector

SESSION OVERVIEW

Activity/
Step Time Content
Method
1. Introduction, Learning Tasks
05 minutes Presentation

2. Presentation
15 minutes Activities to be done before data collection
Buzzing
Presentation
3. Data collection
20 minutes Lecture
discussion
4. Presentation
10 minutes Brainstorming Data processing
5. 05 minutes
Presentation Key Points

6. 05 minutes
Presentation Evaluation

7. 05 minutes
Presentation Field wok –data collection

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
212
SESSION CONTENTS

STEP1: Presentation of Session Title and Learning Tasks (5 minutes)

READ or ASK students to read the learning tasks and clarify

ASK students if they have any questions before continuing

STEP 2: Activities to be Done before Data Collection

Activity: Buzzing (5 minutes)

ASK students to pair up and buzz on the following question for 2 minutes

 What are the activities to be done before data collection?

ALLOWS few groups to respond

WRITE their responses on the flipchart or board

CLARIFY and SUMMARIZE by using the content below

 Briefing managers, health service personnel and community members concerned

 Identifying and obtaining resources for the study
 Reviewing availability of subjects and information
 Organizing logistics for data collection
 Preparing field work manuals (if necessary)
 Training of research team members, including assistants
 Conducting the pre-test in the research location, with preliminary data analysis and
revision of data-collection tools (if was not done)

STEP 3: Data Collection

Having obtained permission for the study, and having
 obtained the necessary resources,
 trained the team members,
 organized the logistics, and
 Pre-tested and modified the data-collection tools and procedures, the data collection can
now be carried out.
___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
213
STEP 4: Data Processing
After collecting and sorting the data, all data should be checked for errors. The content may
be converted into codes or keywords for processing by computer or using master sheets.
The steps during this process include:
1. Editing/cleaning,
2. Categorizing and coding,
3. Summarizing data on data master sheets, or
4. If a computer is used, writing instructions to the computer analyst concerning data input
and analysis.

STEP 5: Key Points

 Before one collects data, preparation is very important in terms of informing relevant
authorities and seeking permission, preparing logistics and thing of staring data
processing while in the field.

STEP 6: Evaluation
 What are the important preparations one will do before embarking in data collection?

STEP 7: Field work – data collection

Arrange areas for students to go and collect data using tools and techniques they have
identified.

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
214
References

Hardon A, Boonmongkon P, and Streefland P. et al (2001). Applied Health research,

Anthropology of health and health care, (3rd Ed) Amsterdam, The Netherlands: Het
Spinhuis Publishers

Beaglehole R, Bonita R and Kjellstrom (1993) Basic epidemiology: Geneva, Switzerland:

World Health Organization,

Kothari C.R (1985). Research Methodology – Methods and techniques, (2nd ed); New Delhi,
India; Wiley Eastern Limited

Stewart A (2001). Basic Statistics and epidemiology, A practical guide,; London, United
Kingdom: Radcliffe Medical Press,

Varkevisser, C. M, Pathmanathan, I and Brownlee, A (1991). Designing and Conducting

Health Systems Research Projects, Vol. 2 Part I: Ottawa, Canada: IDRC

Polit, D. F and Beck, C. T (2004). Nursing Research – Principles and Methods, (7th Ed):
Philadelphi, USA: Lippincott Williams & Wilkins,

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
215
___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
216
Session 22: Data Processing

Total Session Time: 120 minutes + 240 minutes assignment

Prerequisites
 None

Learning Tasks
By the end of this session students are expected to be able to:
 Categorize the data
 Code the data
 Summarize the data in data master sheets
 Compile the data manually without master sheets

Resources Needed
 Flip charts, marker pens, and masking tape
 Black/white board and chalk/whiteboard markers
 Computer and LCD Projector

SESSION OVERVIEW

Activity/
Step Time Content
Method
1 05 minutes Presentation Introduction, Learning Tasks
Presentation
2 20 minutes Group Categorizing the Data
discussion
20 minutes Presentation
3 Coding the Data
Brainstorming
30 minutes
4 Presentation Summarizing the Data in Data Master Sheets
35 minutes
5 Presentation Compiling the Data Manually without Master Sheets
6 05 minutes Presentation Key Points
7 05 minutes Presentation Evaluation

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
217
SESSION CONTENTS

STEP1: Presentation of Session Title and Learning Tasks (5 minutes)

READ or ASK students to read the learning tasks and clarify
ASK students if they have any questions before continuing

STEP 2: Categorizing the Data (20 minutes)

Activity: Small Group Discussion (20 minutes)

DIVIDE students into small manageable groups

ASK students to discuss on the following question

 How are the data categorized?

ALLOW students to discuss for 10 minutes

ALLOW few groups to present and the rest to add points not mentioned

CLARIFY and SUMMARIZE by using the contents below

 In data processing following important issues should be considered:

o Sorting data
o Performing quality-control checks
o Data processing
o Data analysis
 Sorting Data
o An appropriate system for sorting the data is important for facilitating subsequent
processing and analysis.
o If you have different study populations (for example village health workers, village
health committees and the general population), number the questionnaires separately.
o In a comparative study sort the data right after collection into the two or three groups
that will be compared during data analysis.
 Performing Quality Control Checks
o Checked in the field to ensure that all the information has been properly collected and
recorded.
o Before and during data processing, the information should be checked again for
completeness and internal consistency.

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
218
 o If a questionnaire has not been filled in completely you will have missing data for
some of the variables.
o If there are many missing data in a particular questionnaire, the decision may be to
exclude the whole questionnaire from further analysis.
o If an inconsistency is clearly due to a mistake made by the researcher/research
assistant
o For example, if a person in an earlier question is recorded as being a non-smoker,
whereas all other questions reveal that he is smoking, it may still be possible to check
with the person who conducted the interview and to correct the answer.
 If the inconsistency is less clearly a mistake in recording, it may be possible (in a small
scale study) to return to the respondent and ask for clarification.
 If it is not possible to correct information that is clearly inconsistent, consider excluding
this particular part of the data from further processing and analysis as it will affect the
validity of the study.
 If a certain question produces unclear answers throughout, the whole question should be
excluded from further analysis. (Normally, however, you would discover such a problem
during the pre-test and change the wording of the question.)
 The Questions to be answered before Processing
o Have the data been sorted appropriately?
o Have questionnaires been numbered?
o Major categories of informants distinguished?
o Have quality checks been performed? For completeness and consistency of
information?
o Has all qualitative data been categorized as far as possible?
 Data Processing – Quantitative Data
o Decide on the method for processing and analyzing data from questionnaires
 Manually, using data master sheets or manual compilation of the questionnaires
 By computer, for example, using micro-computer and existing software or self-
written programmes for data analysis
 Data processing in both cases involves
o Categorizing/classifying the data
o Coding
o Summarizing the data in data master sheets, manual compilation without master
o sheets, or data entry and verification by computer
 Categorizing/Classifying Data
o Decisions have to be made concerning how to categorize responses.
o Categorical variables that are investigated through closed questions or observation,
the categories are decided earlier.
o In interviews the answers to open-ended questions, the answers can be pre-
categorized to a certain extent, depending on the knowledge of possible answers that
may be given.

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
219
  Answers that are difficult or impossible to categorize may be put in a separate
residual category called ‘others’, but this category should not contain more than
5% of the answers obtained.
 For numerical variables, the data are often better collected without any pre-categorization.
 If you do not exactly know the range and the dispersion of the different values of these
variables when you collect your sample (e.g., home-clinic distance for out-patients, or
income), decisions concerning how to categorize and code the data at the time you
develop your tools may be premature.
 If you notice during data analysis that your categories had been wrongly chosen you
cannot reclassify the data anymore.

STEP 3: Coding the Data (20 minutes)

Activity: Brainstorming (05 minutes)

Ask students to brainstorm on the following question:

 How are the data coded?

ALLOW few students to respond?

WRITE their responses on the flip chart/ board

CLARIFY and SUMMARISE by using the content below

 Coding
o If the data will be entered in a computer for subsequent processing and analysis, it is
essential to develop a coding system.
o For computer analysis, each category of a variable can be coded with a letter, group of
letters or word, or be given a number. For example, the answer ‘yes’ may be coded as
‘Y’ or 1; ‘no’ as ‘N’ or 2 and ‘no response’ or ‘unknown’ as 'Ú' or 9.
o The codes should be entered on the questionnaires (or checklists) themselves.
o When finalising your questionnaire, for each question you should insert a box for the
code in the right margin of the page.
o These boxes should not be used by the interviewer. They are only filled in afterwards
during data processing.
o Take care that you have as many boxes as the number of digits in each code.
o If analysis is done by hand using data master sheets, it is useful to code your data as
well
o Coding conventions

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
220
 o Common responses should have the same code in each question, as this minimizes
mistakes by coders.
o For example
Yes (or positive response) code - Y or 1

No (or negative response) code - N or 2

Don't know code - D or 8

No response/unknown code - U or 9

 Codes for open-ended questions (in questionnaires) can be done only after examining a
sample of (say 20) questionnaires.
o You may group similar types of responses into single categories, so as to limit their
number to at most 6 or 7.
o If there are too many categories it is difficult to analyse the data.
 Remember that the personnel responsible for computer analysis should be consulted very
early in the study

STEP 4: Summarizing the Data in Data Master Sheets (30 Minutes)

Data master sheets
 On a data master sheet all the answers of individual respondents are entered by hand. You
would need several sheets to include all answers.
 Enter the different codes for one question in one column instead of having different
columns of which you tick one
No Education (Q3) Occupation (Q4)

Y/N Highest level Still in Self Head HH

school
Years Type

1 Y 4 PS N 1 3
2 Y 9 SS N 4 NA
3 N NA NA NA 5 NA
4 U PS Y 0 2
 In any small-scale study processed by hand in which groups will be compared, a different
master sheet should be made for each of those groups, e.g., good and poor compliers to
treatment.
 As gender is an important cross-cutting theme, it is usually also advisable to subdivide
males and females within each of the groups that are being compared

STEP 5: Compiling the Data Manually without Master Sheets (35 Minutes)
___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
221
 When the sample is small (say less than 30) and the collected data is limited, it might be
more efficient to do the compilation manually
 Certain procedures will help to ensure accuracy and speed.
o If only one person is doing the compilation use manual sorting.
o If a team of 2 persons work together use either manual sorting or tally counting.
 Manual sorting can be used only if data on each subject is on a different sheet of paper/
entered in a separate questionnaire.
 In manual sorting the basic procedure is to:
o Take one question at a time, for example, ‘use of health facility’,
o Sort the questionnaires into different piles representing the various responses to the
question, e.g., hospital/ health center/ traditional practitioners) and
o Count the number in each pile.
 To do tally counting the basic procedure is:
o One member of the compiling team reads out the information while the other records
it in the form of a tally (e.g., III representing 3 subjects)
o Tally count for no more than two variables at one time (e.g., sex plus type of facility
used)
o After tally counting, add the tallies and record the number of subjects in each group.
 Then doing either manual or tally counting, check the total number of subjects/responses
in each question to make sure that there has been no omission or double count
 It should be noted that hand tallying is often used in combination with master sheet
analysis when the relationship between two or three variables needs to be established, or
details analyzed

STEP 6: Key Points (5 minutes)

 It is often most efficient to summarise the raw research data in a so-called data master
sheet, to facilitate data analysis
 If the data will be entered in a computer for subsequent processing and analysis, it is
essential to develop a coding system
 When the sample is small (say less than 30) and the collected data is limited, do the
compilation manually

STEP 7: Evaluation (5 minutes)

 How are the data categorised?
 How are the data coded?
 How are the data Summarised?

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
222
References
Hardon A, Boonmongkon P, and Streefland P. et al (2001). Applied Health research,
Anthropology of health and health care, (3rd Ed) Amsterdam, The Netherlands: Het
Spinhuis Publishers

Beaglehole R, Bonita R and Kjellstrom (1993) Basic epidemiology: Geneva, Switzerland:

World Health Organization,

Kothari C.R (1985). Research Methodology – Methods and techniques, (2nd ed); New Delhi,
India; Wiley Eastern Limited

Stewart A (2001). Basic Statistics and epidemiology, A practical guide,; London, United
Kingdom: Radcliffe Medical Press,

Varkevisser, C. M, Pathmanathan, I and Brownlee, A (1991). Designing and Conducting

Health Systems Research Projects, Vol. 2 Part I: Ottawa, Canada: IDRC

Polit, D. F and Beck, C. T (2004). Nursing Research – Principles and Methods, (7th Ed):
Philadelphi, USA: Lippincott Williams & Wilkins,

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
223
Session 23: Data Analysis
Total Session Time: 120 minutes

Prerequisites
 None

Learning Tasks
By the end of this session students are expected to be able to:
 Describe data in terms of frequency distribution, percentages and proportion
 Use figures to present data.
 Explain the difference between mean, mode and median
 Calculate the frequencies, percentages, proportion, ratios, rates means, medians, modes
for major variables.
 Identify variables that are necessary for analysis of the collected data

Resources Needed
 Flip charts, marker pens, and masking tape
 Black/white board and chalk/whiteboard markers
 Computer and LCD Projector

SESSION OVERVIEW
Activity/
Step Time Content
Method
1 05 minutes Presentation Introduction, Learning Tasks
Presentation Description of Data in Terms of Frequency
2 15 minutes
Brainstorming Distribution, Percentages and Proportion
10 minutes
3 Presentation Using Figures to Present Data.
20minutes Presentation
4 Group Difference Between Mean, Mode and Median
discussion
20 minutes
Calculation of the Frequencies, Percentages,
5 Presentation Proportion, Ratios, Rates Means, Medians, Modes for
Major Variables.
40 minutes
6 Presentation Identification of Variables that are Necessary for
Analysis of the Collected Data
___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
224
7 05 minutes Presentation Key Points
8 05 minutes Presentation Evaluation

SESSION CONTENTS

STEP1: Presentation of Session Title and Learning Tasks (5 minutes)

READ or ASK students to read the learning tasks and clarify

ASK students if they have any questions before continuing

STEP 2: Description of Data in Terms of Frequency Distribution,

Percentages and Proportion (10 minutes)

Activity: Brainstorming (5 minutes)

Ask students to brainstorm on the following question

 What is frequency distribution, percentages and proportion?

ALLOWS few students to respond

WRITE their responses on the flipchart or board

CLARIFY and SUMMARISE by using the content below

 Data analysis involves the production and interpretation of frequencies, tables, graphs,
etc., that describe the data.
o Frequency counts
 From the data master sheets, simple tables can be made with frequency counts for
each variable.
 A frequency count is an enumeration of how often a certain measurement or a
certain answer to a specific question occurs.
 For example
Smokers 51
Non-smokers 93
Total 144
 If numbers are large enough it is better to calculate the frequency distribution in
percentages (relative frequencies):
 51/144 x 100 = 35% are smokers and 93/144 x 100 = 65% non-smokers.

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
225
  This makes it easier to compare groups than when only absolute numbers are
given. In other words, percentages standardize the data.
 It is usually necessary to summarize the data from numerical variables by dividing them
into categories. This process may include the following steps:
o Inspect all the figures: What is their range? (The range is the difference between the
largest and the smallest measurement.)
o Divide the range into three to five categories. You can either aim at having a
reasonable number in each category (e.g. 0-2 km, 3-4 km, 5-9 km, 10+ km for home-
clinic distance) or you can define the categories in such a way that they are each equal
in size (e.g., 20-29 years, 30-39 years, 40-49 years, etc.)
o Construct a table indicating how data are grouped and count the number of
observations in each group.

STEP 3: Using Figures to Present Data (10 minutes)

 Figures
o Figures make the descriptive data more readable when you have many tables
o Numerical data
 Histograms
 Line graphs
 Scatter diagrams
 maps

o Categorical data
 Bar charts
 Pie charts
 Bar charts
o Is simplest and most effective means of illustrating qualitative data
o Bars can either be horizontal or vertical
o Eg.57 Adolescents from Kaloleni streets in Arusha were asked the following question:
How often have you used cannabis for the past one year? This was closed question
with the following possible answers

o Frequently (more than 5 times), Occasionally ( 3 to 5 times), rarely (1 to 2

times)and never
Categories Number Percentage

Frequently 7 12.2

Occasionally 9 15.8

Rarely 10 17.5

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
226
 Never 31 54.4

Total 57 100

 Pie charts
o Provides quick view of data presented in different form.
o Used in qualitative number with few categories to avoid congestion

 Histograms
o Numerical data are often presented in histograms

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
227
 o Which are similar to bar charts important difference is that in histogram ‘the bars’ are
connected (as long as there is no gap between the data where as in bar charts are not
connected as the different categories are distinct entitles)
 Line graphs
o Particularly useful for numerical data if you want to show Trend over time
o It is easy to show two or more distribution in one graph as long as difference between
lines are easy to distinguish e.g. age distribution between males and females

STEP 4: The Difference Between Mean, Mode and Median (30 minutes)

Activity: Small Group Discussion (20 minutes)

DIVIDE students into small manageable groups

ASK students to discuss on the following question

 What is the difference between mean, mode and median?

ALLOW students to discuss for 10 minutes

ALLOW few groups to present and the rest to add points not mentioned

CLARIFY and SUMMARIZE by using the contents below

 Mean
o The mean of a data set is also known as the average value. It is calculated by dividing
the sum of all values in a data set by the number of values.
o So, in a data set of 1, 2, 2, 3, 4, 5, we would calculate the mean by adding the values
(1+2+2+3+4+5) and dividing by the total number of values (6). Our mean then is
17/5, which equals 3.4
 Mode
o The mode is the most common observation of a data set, or the value in the data set
that occurs most frequently.
o The example of the mode in 1, 2, 2, 3, 4, 5, is 2
o The mode is an appropriate measure to use with categorical data

 Median
o The median of a data set is the value that is at the middle of a data set arranged from
smallest to largest.
o In the data set 1, 2, 3, 4, 5, the median is 3.

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
228
 o In a data set with an even number of observations, the median is calculated by
dividing the sum of the two middle values by two. So in: 1, 2, 2, 3, 4, 5, the median is
(2+3)/2, which equals 2.5.
o The median is appropriate to use with ordinal variables, and with interval variables
with a skewed distribution

STEP 5: Calculation of the Frequencies, Percentages, Proportion, Ratios,

Rates, Means, Medians, Modes for Major Variables (35 minutes)
 Frequency distribution
o Frequency distribution is description of data presented in tabular form.
o Gives frequency in each value appears in data
o Count number of response in category
o E.g. Frequency of categorical nominal data
 Distribution of course students according to sex

Sex course students Number of course students

Male 34

Female 27

Total 61

 Frequency distribution of numerical data

o Frequency distribution of numerical data is similar to that of categorical data except
here data have to be grouped in categories
o E.g. Weights (in kg) of 17 nursing students on enrolment at Kibong’oto Nursing
school (45,43,45,47,54,53,62,38,54,34,45,53,56,42,51, 62,61)
o Procedures
 Select group for grouping these data (selected Groups (31-40; 41-50; 51-60; 61-
70)
 Count number of measurement (wt. of nurses) in each group:
31-40 II (34, 38)
41-50 IIIIII (42, 43, 45, 45, 45, 47)
51-60 IIIIII (51, 53, 53, 54, 54, 56)
61-70 III (61, 62, 62)
 Add up and check totals.

 Rules for grouping data

o Groups must not overlap, to avoid confusion
o There must be continuity from one group to the other (no gaps)
___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
229
 o Groups must range from the lowest to the highest measurements
o Groups should normally be of equal width
 Percentages
o is number of units in the sample with a certain characteristics divided by total of units
in the sample multiplied by 100
o May also be called Relative frequencies
o Standardizes the data and make it easier to compare with similar data obtained in
another sample of different size or origin
o E.g. weight of 17 Pharmacy students at KSP school on enrolment

Weight(Kg) Number of Pharmacy Relative frequency

students (percent)

31-40 12 26.7

41-50 17 37.8

51-60 11 24.4

61-70 5 11.1

Total 45 100

 For calculating percentage Remember:

o Don’t include missing numbers and not applicable in calculation.
o Don’t know' is special category that should not counted as missing data.
o Should not be used if total is less than 30, as one unit makes a big difference in terms
of percentage
 Proportions
o Sometimes relative frequency are expressed in proportion instead of percentages
o Definition: proportion is numerical expression that compares one party of study units
to the whole.
o Can be expressed in fraction or decimal
 Numerator is part of denominator
• E.g. Calculate proportion of modules studied in first semester
 Ratio
o It is numerical expression that indicates relationship in quantity or amount or size
between two or more parts.
___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
230
  Numerator is not part of denominator
Example: Ratio of module studied in first semester to module to be studied in
second semester
 Rates
o Is quantity or amount or degree of event or disease measured over specified period of
time.
o E.g. Birth rate = number of live birth per 1000 population over period of one year

STEP 6: Identification of Variables that are Necessary for Analysis of the

Collected Data (40 minutes)
 Variables: A characteristic of a person, object or phenomenon, which can take on
different
values. These may be in the form of numbers (e.g. age) or non-numerical
characteristics (e.g.
sex).
o Variables are something that varies or logical groupings of
attributes.
 Attributes: Are characteristics or qualities that describe an object or categories that
make up a
variable.
o Variables and attributes are the derived from the concepts and they
are part of the
operational definition for measurement.
Figure…: Variables and Attributes
Variables Attributes
Age Young
Gender Female
Occupation Lecturer
Race Chinese
Social Class Low
Economic class High

 Dependent variable: Used to describe or measure the problem under

study.
 Independent variable: Used to describe or measure the factors that are
assumed to cause
or at least to influence the problem. Refers to cause, it is what you (or
nature) manipulate.
 Confounding factors: Something that provides an alternative
explanation for an
exposure-condition association.
o To be a confounder

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
231
  A risk factor must be associated with the risk factor under study.
 It must also be a risk factor for the condition/problem being
investigated.
 A potential confounder is any factor that is believed to have a
real effect on the risk of the problem under study e.g. smoking, age,
socioeconomic status and
education level

Types of Variables and scales

 To find associations between the problem and contributing factors, it is
important to carefully define the problem and each of the factors
identified when analyzing the problem
 This is done by formulating variables both dependent (outcome
/problem) variable and independent variables (factors influencing the
outcome or problem)
Numerical Variables
o When the values of the variables are expressed in numbers
Example of a variable in the form of numbers is person’s age.
The variable ‘age’ can take on different values since a person
can be 20 years old, 35 years old and so on.
 Weigh (expressed in kilograms or in pounds)
 Homes-clinic distance (expressed in kilometers or in
minutes walking distance);
 Monthly income (expressed in dollars, Shillings)
 Number of children (e.g. 1,2)

 Categorical Variables
o Some variables may be expressed in categories. For example, the
variable sex has two
distinct categories, male and female.
Figure: Example of categorical variable
Variable Categories
Colour Red, blue, green, yellow
Main type of staple food Maize, rice, millet, cassava
Types of drugs Antibiotics, anti-
inflammatory

 Numerical variables can either be continuous or discrete.

o Continuous: With this type of data, one can develop more and more
accurate
measurements depending on the instrument used. For example,
height in centimeters
___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
232
 (2.546 cm or 2.543216 cm) and Temperature in degrees Celsius
(37.20 c or 37.190).
o Discrete: These are variables in which numbers can only take full
values, e.g.
number of visits to a clinic (0, 1, 2, 3, and 4). Number of sexual
partners (0, 1, 2, 3, 4,
and 5).

 Categorical variables: Can either be Ordinal or Nominal

o Ordinal variables: These are grouped variables that are ordered or
ranked in increasing or decreasing order. For example:
 High income (above $3000 per month), middle income ($1000-
$3000 per month), and low income (less than 1000 USD per
months).
 Disability: no disability, partial disability, serious or total
disability.
 Seriousness of a disease: severe, moderate, mild.
 Agreement with a statement: fully agree, partially agree, and
fully disagree.
o Nominal variables: The groups in these variables do not have an
order or ranking. For example
 Sex: Male, female.
 Main food crops: Maize, millet, rice.
 Religion: Christian, Muslim, Hindu, Buddhism.

 Factors Rephrased as Variables

o Most of what we call factors are variables which have negative
values.
o Contributing factors in negative phrase are such as lack of
knowledge.
o Example:

Factor Variables
 Long waiting time Waiting time
 Absence of drugs Availability of drugs
 Lack of supervision Frequency of supervision

o Quantitative variables:
 Variables which have definitive quantitative values (age in years-
24 year or 4 years or weight or height) and can be manipulated
according to the rules of mathematics.

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
233
  Ordinal variables: Variables which do not have numerical values
but can be graded (e.g. level of education as primary school,
advanced diploma and bachelor’s degree or quality of services as
poor, average, good).
 Nominal qualitative variables or attributes (do not belong to
either of the above) examples are marital status-married, single,
divorced or gender as male or female.
 For a selected research problem, you may find that you are
interested on many variables, but to make a research
manageable, pick few of them and leave others.

 Causes and Associations and Confounding Because in health research

you often look for causal explanations, it is important to make a
distinction between dependent and independent variables.
 Whether a variable is dependent or independent is determined by, the
statement of the
problem and the objectives of the study.
 It is therefore important when designing an analytical study to clearly
state which
variable is the dependent and which the independent ones are.
 possible causes of problems, in scientific language is same as
to speak of associations between variables, unless a causal relationship
can be proven.
 Confounding variable: Is associated with the problem and with a
possible cause of the
problem.
o A confounding variable may either strengthen or weaken the
apparent relationship
between the problem and a possible cause.

Figure : Cause and Effect/outcome

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
234
 In order to give a true picture of cause and effect, possible confounding
variables must be
considered, either at planning stage or while doing data analysis.
For example:
o A relationship is shown between compliance with antimalaria
treatment and severe malaria in under-five children. However,
mother’s education may be related to compliance with the
treatment and severe malaria.
o Mother’s education is a potential confounding variable. In order to
give a true picture
of the relationship between compliance with the treatment and
severe malaria in under five children, the influence of mother’s
education should be controlled.
o This could either be done in the research design, e.g., by selecting
only mothers with a
specific level of education, or it can be taken into account in the
analysis of the
findings. Then the relation between compliance with antimalaria and
severe malaria would be analyzed separately for mothers with different
levels of education.

Figure ; Compliance with antimalaria treatment and Severe malaria

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
235
 Background Variables
o Related to a number of independent variables, so they influence the
problem indirectly
o In almost every study, background variables appear, such as Age,
sex, educational level, socio-economic status, marital status and
religion.
 Only background variables important to the study should be
measured.
 Background variables are notorious ‘confounders.

STEP 7: Key Points (5 minutes)

 Data analysis involves the production and interpretation of frequencies, tables,
, etc., that describe the data
 Figures make the descriptive data more readable when you have many tables
 Frequency distribution is description of data presented in tabular form

STEP 8: Evaluation (5 minutes)

 What figures are used to present data?
 What is variable?

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
236
References

Hardon A, Boonmongkon P, and Streefland P. et al (2001). Applied Health research,

Anthropology of health and health care, (3rd Ed) Amsterdam, The Netherlands: Het
Spinhuis Publishers

Beaglehole R, Bonita R and Kjellstrom (1993) Basic epidemiology: Geneva, Switzerland:

World Health Organization,

Kothari C.R (1985). Research Methodology – Methods and techniques, (2nd ed); New Delhi,
India; Wiley Eastern Limited

Stewart A (2001). Basic Statistics and epidemiology, A practical guide,; London, United
Kingdom: Radcliffe Medical Press,

Varkevisser, C. M, Pathmanathan, I and Brownlee, A (1991). Designing and Conducting

Health Systems Research Projects, Vol. 2 Part I: Ottawa, Canada: IDRC

Polit, D. F and Beck, C. T (2004). Nursing Research – Principles and Methods, (7th Ed):
Philadelphi, USA: Lippincott Williams & Wilkins,

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
237
Session 24: Research Report Writing

Total Session Time: 120 minutes

Prerequisites
 None

Learning Tasks
By the end of this session students are expected to be able to:
 List the main components of a research report
 Make an outline of research report
 Write drafts of report in stages
 Check the final draft of report for completeness
 Draft recommendations for action based on research findings

Resources Needed
 Flip charts, marker pens, and masking tape
 Black/white board and chalk/whiteboard markers
 Computer and LCD Projector

SESSION OVERVIEW

Activity/
Step Time Content
Method
1 05 minutes Presentation Introduction, Learning Tasks
Presentation The Main Components of a Research Report
2 15 minutes
Brainstorming
40 minutes Presentation An Outline of Research Report.
3 Group
discussion
4 30 minutes Presentation Drafts of Report in Stages.

5 10 minutes Presentation Checking the Final Draft for Completeness

10 minutes Recommendations for Action Based on Research
6 Presentation
Findings
7 05 minutes Presentation Key Points
8 05 minutes Presentation Evaluation

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
238
SESSION CONTENTS

STEP1: Presentation of Session Title and Learning Tasks (5 minutes)

READ or ASK students to read the learning tasks and clarify

ASK students if they have any questions before continuing

STEP 2: The Main Components of a Research Report (15 minutes)

Activity: Brainstorming (10 minutes)

Ask students to brainstorm on the following question:

 What are the main components of a research report?

ALLOW few students to respond?

WRITE their responses on the flip chart/ board

CLARIFY and SUMMARISE by using the content below

 The research report outline should contain the following components in the following
order:
o Title and Cover Page
o Summary of Study Design, Findings and Recommendations
o Acknowledgements
o Table of Contents
o List of tables, figures (optional)
o List of abbreviations (optional)
o Introduction (statement of the problem in its local context, including relevant
literature)
o Objectives
o Methodology
o Research Findings
o Discussion
o Conclusions and Recommendations
o References
o Annexes (data collection tools; tables)
___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
239
 Note: When assigning page numbers to the report, components bullet number 1-6 use
small Roman Numerals (For example: i, ii, iii, iv, v…).
 Introduction (Component number 7), is Page 1 of the actual report.
 The findings, discussion of findings, conclusions and recommendations will form the
most substantial part of the report, which has to be written from scratch.
 It is strongly advised that start with the findings, discussion and conclusions.
 Write each component in stages as follows:
o Create an outline
o Write Introduction
o Write the Objectives
o Write the Methodology
o Write your Findings
o Discuss your Findings
o Write conclusions and recommendations
o References
o Annex
o Summary
o Acknowledgement
o Table of contents
o Title and Cover page

STEP 3: An Outline of Research Report (40 minutes)

Activity: Small Group Discussion (20 minutes)

DIVIDE students into small manageable groups

ASK students to discuss on the following question

 What is an outline of a research report?

ALLOW students to discuss for 10 minutes

ALLOW few groups to present and the rest to add points not mentioned

CLARIFY and SUMMARIZE by using the following contents

 An outline of a research report:

o Cover page
 The cover page should contain the
 Title
___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
240
  The names of the authors with their titles and positions,
 The institution that is publishing the report, (e.g., Research Unit, Ministry of
Health) and
 The month and year of publication.
 The title in line with the broad objectives
o Abstract/Summary
 The summary should be written only after the first or even the second draft of the
report has been completed. It should contain:
 A very brief description of the problem (WHY this study was needed)
 The main objectives (WHAT has been studied)
 The place of study (WHERE)
 The type of study and methods used (HOW)
 Major findings and conclusions, followed by
 The major (or all) recommendations
 The summary will be the first part of the study that will be read.
o Acknowledgements
 It is good practice to thank those who supported you technically or financially in the
design and implementation of your study.
 Also, your employer who has allowed you to invest time in the study and the
respondents may be acknowledged.
 Acknowledgements are usually placed right after the title page or at the end of the
report, before the references
o Table of contents
 It provides the reader a quick overview of the major sections of your report, with page
references
 List of tables, figures
 List of abbreviations (optional)
 The table of contents and lists of tables, figures, abbreviations should be prepared last

o Chapter 1: Introduction
 Contains
 Background information
 Statement of the problem
 Literature review collected during the implementation of the study
o Chapter 2: Objectives
 The general and specific objectives should be included as stated in the proposal.
 You can adjust them slightly for style and sequence.
 If you have not been able to meet some of the objectives state them in the
methodology section and in the discussion of the findings.
o Chapter 3: Methodology Should be described in detail and include a description of:
 The study type
 The study population(s), sampling method(s) and the size of the sample(s)
___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
241
  Major study variables
 Data-collection techniques and tools used for the different study populations
 Ethical consideration
o Chapter 4: Research findings
 The systematic presentation of research findings in relation to the research objectives
is the crucial part of a report.
 The description of findings should offer a good combination or triangulation of data
from qualitative and quantitative components of the study
 There are two different ways in presentation of findings:
 `An integrated presentation of all data by objective
o As you listed all data by objective this should be easy.
o These integrated presentations will be a compilation of tables, graphs,
narrative interpretation and illustrative quotes from in-depth interviews or
FGDs

Presentation of data by research instrument

o Analyze the data by instrument and integrate the findings only in the
discussion.
o Separate analysis is indicated for objectives that are covered by distinct study
populations using specific instruments
o The list of data by objective will help you to decide how to organise the
presentation of data.
o When all data have been analysed, a detailed OUTLINE has to be made for
the presentation of the findings. This will help the decision-making on how to
organize the data
o Chapter 5: Discussion, the findings can now be discussed by
 Objective or by cluster of related variables or themes,
 The discussion should also include findings from other related studies that support or
contradict your own
o Chapter 6: Conclusions and Recommendations
 They should follow logically from the discussion of the findings
 Conclusions should be short
 It should follow the sequence in which the findings have been presented.
 The recommendations should be summarized according to the groups towards which
they are directed (specific), e.g. Policy-makers, managers, communities, students etc.
o References
 APA
o Annexes or Appendices
 They should contain any additional information needed to enable professionals to
follow your research procedures and data analysis. Examples:
 Tables referred to in the text but not included in order to keep the report short;
 Lists of hospitals, districts, villages etc. That participated in the study
___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
242
  Questionnaires or check lists used for data collection.

STEP 4: Write Drafts of study Report in Stages (10 minutes)

 Cover page
o The cover page should contain the title, the names of the authors
with their titles and
positions, the institution that is publishing the report, (e.g.
Pharmacy Council of the MOH Tanzania), the month and year of
publication.
o The title could consist of a challenging statement or question,
followed by an informative subtitle covering the content of the study
and indicating the area where the study was implemented.
 Summary
o The summary should be written only after the first or even the
second draft of the report has been completed.
o It should contain:
 A very brief description of the problem (why this study was
needed)
 The main objectives (what has been studied)
 The place of study (where)
 The type of study and methods used (how)
 Major findings and conclusions, followed by
 The major (or all) recommendations
 The summary will be the first (and for busy health decision makers
most likely the only)
part of your study that will be read.
 Several drafts have to be made, each discussed by the research team
as a whole.
o If you collaborated with various groups during the drafting and
implementation of the
research proposal, then consider writing different summaries for
each of these groups.
o For example, you may prepare different summaries
 For policy makers and health managers
 For health staff of lower levels
 For community members
 For the public at large (newspaper, TV)
o In a later stage you may write articles in scientific journals
 Acknowledgements
o Thank those who supported technically or financially in the design
and implementation of your study.

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
243
 o Acknowledgements are usually placed right after the title page or at
the end of the report, before the references.
 Table of Contents
o A table of contents is essential
o It provides the reader a quick overview of the major sections of your
report, with page
references, so that she/he can go through the report in a different
order or skip certain
sections.
 List of Tables, Figures
o If there are many tables or figures, then they may be listed in a
table of contents type of format with page numbers.
 List of Abbreviations (optional)
o If abbreviations or acronyms are used in the report, these should be
stated in full in the text the first time they are mentioned
o If there are many, then they should be listed in alphabetical order as
well
o The list can be placed before the first chapter of the report.
o The table of contents and lists of tables, figures, abbreviations
should be prepared last
o A t this time include the page numbers of all chapters and sub-
sections in the table of
contents.
 Finalize the numbering of figures and tables and include all
abbreviations.
 Chapter 1: Introduction
o Should contain relevant (environmental/ administrative/ economic/
social) background data about the country, the health status of the
population, and health service data which are related to the
problem that has been studied.
o The statement of the problem should follow
o Relevant literature collected during the implementation of the
study.
o It should contain a paragraph on what you hope to achieve with the
results of the study.
 Chapter 2: Objectives
o The general and specific objectives should be included as stated in
the proposal.
o If you have not been able to meet some of the objectives this should
be stated in the
methodology section and in the discussion of the findings.
___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
244
 o The objectives form the HEART of your study. They determined the
methodology you chose and will determine how you structure the
reporting of your findings.

 Chapter 3: Methodology
o The methodology you followed for the collection of your data should
be described in
detail. This section should include a description of:
 The study type;
 Major study themes or variables (a more detailed list of variables
on which data was collected may be annexed);
 The study population(s), sampling method(s) and the size of the
sample(s);
 Data-collection techniques used for the different study
populations; how the data was collected and by whom;
 Procedures used for data analysis, including statistical tests (if
applicable)

 Chapter 4: Research Findings

o The systematic presentation of the findings in relation to the
research objectives is the
crucial part of your report.
o The description of findings should offer a good combination or
triangulation of data from qualitative and quantitative components
of the study.
o Prepare an outline for the whole report, taking the main components
of a research report as a point of departure.
o An outline should contain:
 The headings of the main sections of the report
 The headings of subsections,
 The points to be made in each section
 A list of tables figures and/or quotes to illustrate each section
o Example of the outline of the chapter 4 on Research Findings

 4.1 Description of the sample: (e.g., location, age, marital

status, education, social economic status, of mothers; age and
sex of children weight/measured by research area).
 4.2 Extent and seasonal variation of malnutrition in district X
 4.3 Possible causes of malnutrition
 4.3.1 Limited availability of food
 4.3.2 Non-optimal utilization of available food

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
245
  4.3.3 High prevalence of communicable diseases
 4.3.4 Limited access to Reproductive and Child Health (RCH)
and weaknesses in RCH/nutrition services
o The system of numbering is flexible and can be extended according
to need with further headings or subheadings.
o The outline for the chapter on findings will predictably be the most
elaborated.
o The first section under findings is usually a description of the study
population.
o If different study populations have been studied, then provide a
short description of each group before presenting the data
pertaining to these informants.
o Depending on the study design, provide more information on the
problem studied (size, distribution, characteristics).
o In an analytic study, the degree to which different independent
variables influence the problem has be discussed.
o Tables and figures in the text need numbers and clear titles.
o Include only those tables and figures that present main findings and
need more elaborate discussion in the text.
o The first draft of your findings is never final.
o Therefore, you might concentrate primarily on content rather than
on style.
o Nevertheless, it is advisable to structure the text from the beginning
in paragraph
.
 Chapter 5: Discussion
o The findings can be discussed by objective or by cluster of related
variables or themes, which should lead to conclusions and possible
recommendations.
o The discussion may include findings from other related studies that
support or contradict your own.

 Chapter 6: Conclusions and Recommendations

o The conclusions and recommendations should follow logically from
the discussion of the findings.
o Conclusions can be short, as they have already been elaborately
discussed in chapter 5.
o As the discussion will follow the sequence in which the findings have
been presented
(which in turn depends on your objectives) the conclusions should
logically follow the
___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
246
 Specific objectives
o The recommendations may be summarized according to the groups
towards which they are directed, for example:
 Policy-makers
 Health and health-related managers at district or lower level
 Health and health-related staff who could implement the
activities
 Potential clients
 The community at large
o Remember that action-oriented groups are most interested in this
section.
o In making recommendations, use not only the findings of the study,
but also supportive information from other sources.
o The recommendations should take into consideration the local
characteristics of the health system, constraints, feasibility and
usefulness of the proposed solutions.
o They should be discussed with all concerned before they are
finalized.
o If the recommendations are short (roughly one page), include them
all in the summary
and omit them as a separate section in Chapter 6 in order to avoid
repetition.

 References
o The references in your text can be numbered in the sequence in
which they appear in the report and then listed in this order in the
list of references (Vancouver system).
o Another possibility is the Harvard system of listing in brackets the
author’s name(s) in the text followed by the date of the publication
and page number, for example:
 Annexes or Appendices
o The annexes should contain any additional information needed to
enable professionals to follow your research procedures and data
analysis.
o Information that would be useful to special categories of readers but
is not of interest to the average reader can be included in annexes.
o Examples of information that can be presented in annexes are:
 Tables referred to in the text but not included in order to keep
the report short;
 lists of hospitals, districts, villages etc. that participated in the
study;

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
247
  Questionnaires or check lists used for data collection.
 Revising and Finalizing the Text
o When a first draft of the findings, discussion and conclusions has
been completed, all
working group members should read it critically and make
comments.
o The following questions should be kept in mind when reading the
draft
 Have all important findings been included?
 Do the conclusions follow logically from the findings?
 If some of the findings contradict each other, has this been
discussed and explained, if possible?
 Have weaknesses in the methodology, if any, been revealed?
 Are there any overlaps in the draft that have to be removed?
 Is it possible to condense the content?
 In general, a text gains by shortening. Some parts less relevant for action may be
included in the annex Check if descriptive paragraphs may be shortened and
introduced or finished by a concluding sentence.
 Do data in the text agree with data in the tables?
 Are all tables consistent (with the same number of informants per
variable), are they numbered in sequence, and do they have
clear titles and headings?
 Is the sequence of paragraphs and subsections logical and
coherent?
 Is there a smooth connection between successive paragraphs
and sections?
 Is the phrasing of findings and conclusions precise and clear?
 For a final check on readability you might skim through the pages and
read the first
sentences of each paragraph. If this gives a clear impression of the
organization and
results of the study, then one may conclude that you did the best you
could.

STEP 5: Checking the Final Draft for Completeness (10 minutes)

 At the outset, researcher must invariably satisfy himself that
o The data are appropriate, trustworthy adequate for drawing inferences;
o The data reflect good homogeneity;
o Proper analysis has been done through statistical methods
 While rewriting and polishing one should check the report for
o Weaknesses in logical development or presentation.

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
248
  See whether the material, as it is presented, has unity and cohesion;
 The researcher should give due attention to the fact that in his rough draft he has
been consistent or not.
 The researcher should check the mechanics of writing—grammar, spelling and
usage
 The report being written in a concise and objective style and in simple language,
 Vague expressions has been the researcher has to avoid abstract terminology and
technical jargon
 Checking whether the format has been followed
 Revising and finalizing the text
o When a first draft of the findings, discussion and conclusions has been completed, all
working group members and facilitators should read it critically and make comments.
o The following questions should be kept in mind when reading the draft:
 Have all important findings been included?
 Do the conclusions follow logically from the findings?
 Have weaknesses in the methodology, if any, been revealed?
 Are there any overlaps in the draft that have to be removed?
 Is it possible to condense the content?
 Do data in the text agree with data in the tables and figures? Are all tables and
figures consistent (with the same number of informants per variable), are they
numbered in sequence, and do they have clear titles and headings?
 Is the sequence of paragraphs and subsections logical and coherent? Is there a
smooth connection between successive paragraphs and sections? Is the phrasing of
findings and conclusions precise and clear?

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
249
STEP 6: Drafting Recommendations for Operational Research Findings
(10 Minutes)
 Recommendations
o They should follow logically from the discussion of the findings
o It should follow the sequence in which the findings have been presented.
o The recommendations should be summarised according to the groups towards which
they are directed (specific), e.g.
 Policy-makers, managers, communities, students etc.

STEP 7: Key Points (10 minutes)

 Research report is normally written in stages starting with clarifying the nature of the
planned report, and its intended audience
 Recommendations should follow logically from the discussion of the findings

STEP 8: Evaluation (10 minutes)

 What are the main components of a research report?
 What is an outline of a research report?

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
250
Hardon A, Boonmongkon P, and Streefland P. et al (2001). Applied Health research,
Anthropology of health and health care, (3rd Ed) Amsterdam, The Netherlands: Het
Spinhuis Publishers

Beaglehole R, Bonita R and Kjellstrom (1993) Basic epidemiology: Geneva, Switzerland:

World Health Organization,

Kothari C.R (1985). Research Methodology – Methods and techniques, (2nd ed); New Delhi,
India; Wiley Eastern Limited

Stewart A (2001). Basic Statistics and epidemiology, A practical guide,; London, United
Kingdom: Radcliffe Medical Press,

Varkevisser, C. M, Pathmanathan, I and Brownlee, A (1991). Designing and Conducting

Health Systems Research Projects, Vol. 2 Part I: Ottawa, Canada: IDRC

Polit, D. F and Beck, C. T (2004). Nursing Research – Principles and Methods, (7th Ed):
Philadelphi, USA: Lippincott Williams & Wilkins,

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
251
Session 25: Methods for Dissemination of Research
Findings

Total Session Time: Time: 120 minutes

Prerequisites
 None

Learning Tasks
By the end of this session students are expected to be able to:
 Define dissemination of research findings
 List various dissemination channel and tools
 Describe dissemination strategy of research finings
 List dissemination content of research findings

Resources Needed
 Flip charts, marker pens, and masking tape
 Black/white board and chalk/whiteboard markers
 Computer and LCD Projector

SESSION OVERVIEW

Activity/
Step Time Content
Method
1 05 minutes Presentation Introduction, Learning Tasks
Presentation
2 10 minutes Definition of Dissemination of Research Findings
Buzzing
40 minutes Presentation
3 Group Dissemination Channel and Tools
discussion
35 minutes
4 Presentation Dissemination Strategy of Research Findings
10 minutes
5 Presentation Dissemination Content of Research Findings
6 05 minutes Presentation Key Points
7 05 minutes Presentation Evaluation

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
252
SESSION CONTENTS

STEP1: Presentation of Session Title and Learning Tasks (5 minutes)

READ or ASK students to read the learning tasks and clarify

ASK students if they have any questions before continuing

STEP 2: Definition of Dissemination of Research Findings (10 minutes)

Activity: Buzzing (5 minutes)

ASK students to pair up and buzz on the following question for 2 minutes:
 What is dissemination of research findings?

ALLOW few pairs to respond and let other pairs to add on points not mentioned

WRITE their response on the flip chart/board

CLARIFY and SUMMARIZE by using the content below

 Dissemination is defined as, “A planned process that involves consideration of target

audiences and the settings in which research findings are to be received and, where
appropriate, communicating and interacting with wider policy and health service
audiences in ways that will facilitate research uptake in decision-making”

STEP 3: Dissemination Channel and Tools (40minutes)

Activity: Small Group Discussion (20 minutes)

DIVIDE students into small manageable groups

ASK students to discuss on the following question

 What are dissemination channels and tools of research findings?

ALLOW students to discuss for 10 minutes

ALLOW few groups to present and the rest to add points not mentioned

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
253
CLARIFY and SUMMARIZE by using the contents below

 The following are dissemination channels

o Community meetings
o Interpersonal communication
o Local events
o Web sites
o Email messages
o Project team conference/meetings
o Policy briefs
o Dissemination workshops
o Technical reports
o Scientific seminars
o Mass media
o Scientific publication
o Communication of research findings
 Some of the channels and their instruments are shown as follows:

Information channels Instruments

Community/Village Report summaries
meetings Overheads
Posters
Oral explanation
Discussion
Regular meetings Discussion,reports
Personal briefings
Mass media Mass media materials for schools, newspaper articles and
radio broadcasts on planned and implemented activities

 Select appropriate information channels

o Interpersonal communication
 Partners identified should normally be informed through interpersonal
communication.
o Regular meeting
 The DHMT would be best approached at a regular meeting. Similarly, a meeting
of village leaders could be easily convened, together with VDC and VHC
members, VHW religions leaders and representatives of women’s groups
o Personal briefings
 Personal briefings would have to be organized between research team members

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
254
 and the Ministry of Health Community Development Gender Elderly And
Children
o Mass media
 When action is planned, one should also think of the mass media as information
channel:
 Newspapers,
 Radio,
 TV,
 Posters.
o These are effective in disseminating information to a wide range of audiences
o Mass media and interpersonal channels may fruitfully complement each other

o Identify key contact persons in each news organization, including reporters who cover
the area of your research,
 Approach them through a letter to the news editor including relevant information
about your study
o Existing summaries of the study may be used
o Articles in research journals
o Presentation of research results to interested students and staff
To present results from research at ‘research days’ to a selected group of health
managers and health researchers

STEP 4: Dissemination Strategy of Research Findings (35 minutes)

 Planning for the Dissemination, Communication and Utilization of Research Results
o The beneficiaries of research are not only the health professionals. Promote and
increase the utilization of the research results among all potential users, varying from
community members to donor agencies.
 Plan on how the results of the study could be used.
 Think of who will be interested in the Results?
o Depending on the topic selected, the results may be useful to the community, staff and
managers of health and health-related services and to researchers and donor agencies
in your own local area, as well as others.
o Research team and program should benefit from the results, as they have developed
the proposal to help solve one of their own priority problems.
 Strategies to Ensure the Results of the Study will be Used
o Involve relevant authorities, staff and community members in the selection of the
topic and in the definition of your problem.
o List two or three major recommendations you expect to obtain from the study
o Identify who should be involved in their implementation.
o Distinguish between two categories of people who should be involved.
 Those who authorize you to implement the recommendations.
 Partners in the implementation process.
___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
255
 Identify which communication channels already exist which can be used to discuss and
disseminate results.
 Channels for discussing and disseminating results may include
o Provincial or district development team meetings.
o Provincial or district health team meetings.
o Supervisory visits to health facilities involved, staff meetings.
o Mobile clinics or other health activities carried out in villages included in the study,
monthly meetings of village health workers when they collect drugs, meetings of
village health committees.
 Determine what written materials should be prepared to keep relevant parties informed.
 They may include:
o A one to two-page summary of the project proposal that includes details on expected
results to distribute when you introduce the project to policy makers and staff
concerned.
o An introductory statement to use with interview guides and questionnaires, explaining
to informants the purpose and procedures of the study, as well as expected results.
 A progress report of four to five pages, including preliminary findings and
recommendations, should be prepared for presentation of the data analysis and report
writing workshop.
o Used to inform authorities that will be crucial to utilization of project results.
 To obtain feedback from decision makers and target groups in the community, you will
need a different summary, concentrating in simple words on the findings and preliminary
recommendations that directly concern them.
 Make sure that summaries of your findings and preliminary recommendations are adapted
to the level of understanding and interests of different audiences
o This will increase their motivation to provide thorough feedback and to participate in
the implementation of the final recommendations collectively agreed up on.
 Determine whether additional actions should be taken or mechanisms developed to
discuss the study results with all parties concerned and obtain their input, approval and
co-operation for the implementation of the recommendations
 Key Steps
o Develop and use a systematic dissemination and communication strategy for reaching
different audiences of potential users.
o Present the research results to all stakeholders and obtain feedback on findings and
recommendations.
o Develop a plan of action to promote the implementation of the recommendations that
o resulted from the study.

STEP 5: Dissemination Contents of Research Findings (10 minutes)

 Technical issues
 Societal issues

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
256
 Ethical issues
 Personnel/organizational issues

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
257
STEP 6: Key Points (5 minutes)
 A strategy for dissemination and communication to promote utilization of research
findings should be developed, taking into account the major contributing factors and
proposed actions to solve it
 The consideration of appropriate channels is an essential step, the types of
communications tools that are practical, reach the right audiences and within the available
budgets

STEP 7: Evaluation (5 minutes)

 What are dissemination channels?
 What are dissemination contents?
 What are dissemination strategy?

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
258
References
World Health Organization (2014). Disseminating the Research Findings, module 5, WHO
Document Production Services, Geneva, Switzerland.
(https://www.who.int/tdr/publications/year/2014/participant-workbook5_030414.pdf
accessed 15/12/2018)

Hardon A, Boonmongkon P, and Streefland P. et al (2001). Applied Health research,

Anthropology of health and health care, (3rd Ed) Amsterdam, The Netherlands: Het
Spinhuis Publishers

Beaglehole R, Bonita R and Kjellstrom (1993) Basic epidemiology: Geneva, Switzerland:

World Health Organization,

Kothari C.R (1985). Research Methodology – Methods and techniques, (2nd ed); New Delhi,
India; Wiley Eastern Limited

Stewart A (2001). Basic Statistics and epidemiology, A practical guide,; London, United
Kingdom: Radcliffe Medical Press,

Varkevisser, C. M, Pathmanathan, I and Brownlee, A (1991). Designing and Conducting

Health Systems Research Projects, Vol. 2 Part I: Ottawa, Canada: IDRC

Polit, D. F and Beck, C. T (2004). Nursing Research – Principles and Methods, (7th Ed):
Philadelphi, USA: Lippincott Williams & Wilkins,

___________________________________________________________________________
PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide
259