You are on page 1of 29

KV INSTITUTE OF MANAGEMENT AND INFORMATION STUDIES

BA4205-BUSINESS RESEARCH METHODS


UNIT- 2 RESEARCH DESIGN AND MEASUREMENT
Research design – Definition – types of research design – exploratory and causal research design
Descriptive and experimental design – different types of experimental design – Validity of findings –
internal and external validity – Variables in Research – Measurement and scaling – Different scales –
Construction of instrument – Validity and Reliability of instrument

TABLE OF CONTENTS

2.1 INTRODUCTION ............................................................................................................... 2

2.2 MEANING .......................................................................................................................... 2


2.3 ESSENTIALS OF RESEARCH DESIGN………………………………………………...2
2.4 COMPONENTS OF RESEARCH DESIGN DECISIONS………………………………..3

2.5 IMPORTANT FEATURES OF RESEARCH DESIGN .................................................... 3

2.6 NEED FOR RESEARCH DESIGIN ................................................................................... 4

2.7 FEATURES OF GOOD DESIGN…………………………………………………………4

2.8 TYPES OF RESEARCH DESIGN ..................................................................................... 5

2.9 VALIDITY OF RESEARCH DESIGN ............................................................................. 11

2.10VARIABLES IN RESEARCH ......................................................................................... 13

2.11 SCAILING ………………………………………………………………………………17

2.12 VALIDITY AND RELIABITLITY OF AN INSTRUEMENT………………………….24

This material is proprietary to KV Institute of Management, a Nationally Ranked B-School in Coimbatore and cannot be copied or duplicated for use
outside of KV. Violators will face infringement proceedings of copyright laws. Page: 1 of 26
KV INSTITUTE OF MANAGEMENT AND INFORMATION STUDIES
BA5202-BUSINESS RESEARCH METHODS

UNIT II
2.1 INTRODUCTION
A research design is a “Blue Print” for collection, measurement and analysis of data. It is a outlines how
the research will be carried out. It provides answers to various questions like - What techniques will be
used to gather data. What kind of sampling will be used? How, time and cost, constraints be dealt with?
Etc.
With the completion of the initial phase of the research process, the researcher turns to designing a
research design to formally identify the appropriate sources of data. This is done in order that any
researcher who embarks on a research project should have a blueprint of how he is going to undertake
scientifically the data collection process. The framework developed to control the collection of data
is called research design.

Research design is an absolute essentiality in research irrespective of the type of research (e.g.,
exploratory or descriptive), as it ensures that the data collected is appropriate, economical and accurate.

This also ensures that the research project conducted is effectively and efficiently done. A sufficiently
formulated research design would ensure that the information gathered is consistent with the study
objectives and that the data are collected by accurate procedures. Since, research designs germinate from
the objectives, the accuracy and adequacy of a research design depends on the unambiguous framing of
the objectives

2.2 MEANING
A research design is the arrangement of conditions for collection and analysis of data in a manner
that aims to combine relevance to research purpose with economy in procedure.

A research design is a conceptual structure within which research is conducted; it constitutes the
blue print for the collection, measurement and analysis of data.
An activity and time based plan.
A plan always based on the research question.
A guide for selecting sources and types of information.
A framework for specifying the relationship among the study‟s variable.
A procedural outline for every research activity.

DEFINITION:
According to Claire Seltltiz and others “A research design is the arrangement of conditions for
collection and analysis of data in a manner that aims to combine relevance to the research purpose with
economy in procedure”
Pauline V.Young “A research design is the logical and systematic planning and directing a piece of
research”
2.3 Essentials of Research Design
 The design should be an activity and time based plan
 It is always based on research question
 It guides the selection of sources and types of information

This material is proprietary to KV Institute of Management, a Nationally Ranked B-School in Coimbatore and cannot be copied or duplicated for use
outside of KV. Violators will face infringement proceedings of copyright laws. Page: 2 of 26
KV INSTITUTE OF MANAGEMENT AND INFORMATION STUDIES
BA5202-BUSINESS RESEARCH METHODS

 It indicates a framework for specifying the relationship among the study’s variables
 Outlines procedures for every research activity
 It must be appropriate, efficient and economical
 It should be flexible
 It must be adequate
2.4 COMPONENTS OF RESEARCH DESIGN DECISIONS
 What is the study about?
 Why is the study being made?
 Where will the study be carried out?
 What type of data is required?
 Where can the required data be found?
 What time period the study includes?
 What will be the sample design?
 What techniques of data collection to be used?
 How will the data be analyzed?
 In what style the report be prepared?

RESEARCH DESIGN
Sampling design: The sampling design deals with the method of selecting items to be observed for the
given study
Observational Design: The observational design relates to the conditions under which the observations
are to be made
Statistical design: The statistical design concerns with the question of how many items are to be
observed and how the information and data gathered are to be analyzed.
Operational design: The operational design deals with the techniques by which the procedures
specified in the sampling, statistical and observational designs can be carried out.

2.5 IMPORTANT FEATURES OF RESEARCH DESIGN


It is a plan that specifies the sources and types of information relevant to the research problem.
It is a strategy specifying which approach will be used for gathering and analyzing the
data.
It includes the time and cost budget since most studies are done under these two constraints.

Research design must, contain –


A clear statement of the research problem;
Procedures and techniques to be used for gathering information; The
population to be studied; and
Methods to be used in processing and
Analyzing data

This material is proprietary to KV Institute of Management, a Nationally Ranked B-School in Coimbatore and cannot be copied or duplicated for use
outside of KV. Violators will face infringement proceedings of copyright laws. Page: 3 of 26
KV INSTITUTE OF MANAGEMENT AND INFORMATION STUDIES
BA5202-BUSINESS RESEARCH METHODS

2.6 NEED FOR RESEARCH DESIGN


Research Design is needed because it facilitates the smooth sailing of the various research
operations, thereby making research as efficient as possible yielding maximal information with
minimal expenditure of effort, time and money.
It stands for advance planning of the methods in collecting relevant data and techniques to be
used in their analysis, keeping in view the objective of the research and the availability of staff, time
and money.
The design helps the researcher to organize his ideas in a form whereby it will be possible for
him to look for flaws and inadequacies.

2.7 FEATURES OF GOOD DESIGN


 A good design is often characterized by flexible, appropriate, efficient and economical.
 The design which minimizes bias and maximizes the reliability of the data collected and
analyzed is considered a good design.
 The design which gives the smallest experimental error is supposed to be the best design in
many investigations.
 A research design which yields maximal information and provides an opportunity for
considering many different aspects of a problem is considered most appropriate and efficient
design in respect of many research problems.
 The question of good design is related to the purpose or objective of the research problem and
also with the nature of the problem to be studied.
 One single design cannot serve the purpose of all types of research problems.

A research design appropriate for a particular research problem, usually involves the consideration of
the following factors:
i. The means of obtaining information;
ii. The availability and skills of the researcher and his staff, if any;
iii. The objective of the problem to be studied;
iv. The nature of the problem to be studied; and
v. The availability of time and money for the research work.

This material is proprietary to KV Institute of Management, a Nationally Ranked B-School in Coimbatore and cannot be copied or duplicated for use
outside of KV. Violators will face infringement proceedings of copyright laws. Page: 4 of 26
KV INSTITUTE OF MANAGEMENT AND INFORMATION STUDIES
BA5202-BUSINESS RESEARCH METHODS

2.8 TYPES OF RESEARCH DESIGN

Three traditional categories of research design:


• Exploratory
• Descriptive
• Experimental
The choice of the most appropriate design depends largely on the objectives of the research.

Three types of research design are established according to the nature of the research objectives or
types of research. They are:

Exploratory design; and


Conclusive design. (Descriptive research and casual research)
Experimental design

Exploratory Research Design


It is appropriate when the research objective is to provide insights into
(i) identifying the problems or opportunities
(ii) defining the problem more precisely,
(iii) gaining deeper insights into the variables operating in a situation
(iv) identifying relevant courses of action
(v) establishing priorities regarding the potential significance of a problems or opportunities
(vi) gaining additional insights before an approach can be developed and
(vii) gathering information on the problems associated with doing conclusive research. Much
research has been of an exploratory nature; emphasising on finding practices or policies that
needed changing and on developing possible alternatives.

On examination of the objectives of exploratory research, it is well understood that it could be used at
the initial stages of the decision making process. It allows the marketer to gain a greater understanding
of something that the researcher doesn‟t know enough about. This helps the decision maker and the
researcher in situations when they have inadequate knowledge of the problem situation and/or
alternative courses of action. In short, exploratory research is used in the absence of tried models and
definite concepts.

Exploratory research could also be used in conjunction with other research. As mentioned below, since
it is used as a first step in the research process, defining the problem, other designs will be used later as
steps to solve the problem. For instance, it could be used in situations when a firm finds the going gets
tough in terms of sales volume, the researcher may develop use exploratory research to develop
probable explanations. Analysis of data generated using exploratory research is essentially abstraction
and generalization. Abstraction refers to translation of the empirical observations, measurements etc.
into concepts; generalization means arranging the material so that it focuses on those structures that are
common to all or most of the cases.

This material is proprietary to KV Institute of Management, a Nationally Ranked B-School in Coimbatore and cannot be copied or duplicated for use
outside of KV. Violators will face infringement proceedings of copyright laws. Page: 5 of 26
KV INSTITUTE OF MANAGEMENT AND INFORMATION STUDIES
BA5202-BUSINESS RESEARCH METHODS

The exploratory research design is best characterised by its flexibility and versatility. This is so,
because of the absence of the non-imperativeness of a structure in its design. It predominantly involves
imagination, creativity, and ingenuity of the researcher. Examples of exploratory research are:

 survey of experts to validate an instrument;


 pilot studies conducted to perform reliability check on a questionnaire;
 use of secondary data in order to analyse it in a qualitative way;
 qualitative research.

This material is proprietary to KV Institute of Management, a Nationally Ranked B-School in Coimbatore and cannot be copied or duplicated for use
outside of KV. Violators will face infringement proceedings of copyright laws. Page: 6 of 26
KV INSTITUTE OF MANAGEMENT AND INFORMATION STUDIES
BA5202-BUSINESS RESEARCH METHODS

Conclusive Research Design


It involves providing information on evaluation of alternative courses of action and selecting one from
among a number available to the researcher. Conclusive research is again classified as:

(i) Descriptive research, and


(ii) Causal research.

(i) Descriptive Research: It is simple to understand as the name itself suggests that it involves
describing something, for example:

(a) market conditions;


(b)characteristics or functions;
(c) estimate the percentage of customers in a particular group exhibiting the same purchase
behaviour;
(d) perceptions of product characteristics; and
(e) to predict the pattern of behaviour of characteristic versus the other

Majority of research studies are descriptive studies. As research studies involve investigating the
customers/consumers, collection of data includes interrogating the respondents in the market and data
available from secondary data sources. However, it cannot be concluded that descriptive studies should
be simply fact-gathering process. Descriptive study deals with the respondents in the market and
hence, extreme caution has to be exercised in developing this study. Much planning should be done,
objectives should be clear than exploratory studies.

In descriptive research, the data is collected for a specific and definite purpose and involves analysis
and interpretation by the researcher. The major difference between exploratory and descriptive
research is that descriptive research is characterised by the formulation of specific objectives. The
success of descriptive studies depends on the degree to which a specific hypothesis acts as a guide.

Descriptive studies restrict flexibility and versatility as compared to exploratory research. It involves a
higher degree of formal design specifying the methods for selecting the sources of information and for
collecting data from those sources. Formal design is required in order to ensure that the description
covers all phases desired. It is also required to restrain collection of unnecessary data. Descriptive
studies require a clear specification of the who, when, where, what, why and how.

While designing a descriptive research, the researcher should also have sufficient knowledge on the
nature and type of statistical techniques he/she is going to use. This will greatly help to have the right
design in place. Mostly descriptive studies are conducted using questionnaire, structured interviews
and observations. The results of description studies are directly used for marketing decisions.

Descriptive studies are again classified into two types:

(a) Longitudinal
(b) Cross sectional

This material is proprietary to KV Institute of Management, a Nationally Ranked B-School in Coimbatore and cannot be copied or duplicated for use
outside of KV. Violators will face infringement proceedings of copyright laws. Page: 7 of 26
KV INSTITUTE OF MANAGEMENT AND INFORMATION STUDIES
BA5202-BUSINESS RESEARCH METHODS
(a) Longitudinal research relies on panel data and panel methods. It involves fixing a panel
consisting of fixed sample of subjects that are measured repeatedly. The panel members are
those who have agreed to provide information at a specific intervals over an extended period.
For example, data obtained from panels formed to provide information on market shares are
based on an extended period of time, but also allow the researcher to examine changes in
market share over time. New members may be included in the panel as an when there is a
dropout of the existing members or to maintain representativeness.
Panel data is analytical and possess advantages with respect to the information collected in the study.
They are also considered to be more accurate than cross sectional data because panel data better handle
the problem associated with the errors that arise in reporting past behaviour and the errors that arise
because of the necessary interaction between interviewer and respondent.

(b) Cross-sectional research is the most predominantly and frequently used descriptive research
design in marketing. It involves a sample of elements from the population of interest. The
sample elements are measured on a number of characteristics. There are two types of cross-
sectional studies:

 Field studies and


 Surveys

It may appear that field studies and surveys are no different but the same. However, for practical
reasons, they are classified into two categories cross sectional research. The fundamental difference
lies in the depth of what these research cover. While survey has a larger scope, field study has greater
depth. Survey attempts to be representative of some known universe and filed study is less concerned
with the generation of large representative samples and is more concerned with the in-depth study of a
few typical situations.

Cross sectional design may be either single or multiple cross sectional design depending on the
number of samples drawn from a population. In single cross sectional design, only one sample
respondents is drawn whereas in multiple cross sectional designs, there are two or more samples of
respondents. A type of multiple cross sectional design of special interest is Cohort analysis.

Cohort analysis consists of a series of surveys conducted at appropriate time intervals, where the
cohort serves as the basic unit of analysis. A cohort is a group of respondents who experience the same
event within the same time interval.

(a) Case Study: This study involves intensive study of a relatively small number of cases. In this
method, much emphasis is on obtaining a complete description and understanding of factors in
each case, regardless of the number involved. It could be used significantly, particularly when
one is seeking help on a problem in which interrelationships of number of factors are involved,
and in which it is difficult to understand the individual factors without considering them in
their relationships with each other. As in the case of exploratory research, case method is also
used in conjunction with exploratory research as first step in a research process. It is of prime
value when the researcher is seeking help on a market problem in which the interrelationships
of a number of factors are involved, and in which it is difficult to understand the individual
factors without considering them in their relationships with each other.

This material is proprietary to KV Institute of Management, a Nationally Ranked B-School in Coimbatore and cannot be copied or duplicated for use
outside of KV. Violators will face infringement proceedings of copyright laws. Page: 8 of 26
KV INSTITUTE OF MANAGEMENT AND INFORMATION STUDIES
BA5202-BUSINESS RESEARCH METHODS

(ii) Causal research: It is used to obtain evidence of cause-and-effect relationships with is


otherwise known as the independent-dependent relationship or the predictive relationships.
This is an important type of research useful for marketers as this allows marketers to base
their decision on assumed causal relationships. Causal research is done in the following
situations:

(a) To identify which variables are the cause and which are the effect. In statistical terms, causal
variables are called independent variables and effectual variables are called dependent
variables.

(b) To determine the nature of the relationship between the causal variables and the effect to be
predicted.

Causal research requires a strong degree of planning on the design as its success depends on the
structure of the design.

Experimental Research Design

• An experiment is defined as manipulating (changing values/situations) one or more independent


variables to see how the dependent variable(s) is/are affected, while also controlling the affects of
additional extraneous variables.
– Independent variables: - that over which the researcher has control and wishes to manipulate i.e.
package size, ad copy, price
– Dependent variables: - that over which the researcher has little to no direct control, but has a strong
interest in testing i.e. sales, profit, market share.
– Extraneous variables: - those that may affect a dependent variable but are not independent variable

Experimental Design -An experimental design is a procedure for devising an experimental setting such
that a change in the dependent variable may be solely attributed to a change in an independent variable.

Types of Experiment Research Design


Informal experimental Design

Before and after without control design


This is the simplest type of experiment. In this design, a single test group of area is selected and the
dependent variable is measured before the introduction of the treatment (X). The treatment is introduced
and the dependent variable is measured again after the treatment (Y). Used in Laboratory research. The
effect of the treatment shall be the difference in magnitudes. i.e
Treatment Effect = Y – X
Where Y = the magnitude after the treatment is given and X = the magnitude before the treatment is
given.
For example: Let us have a group of salesman measure their sales, before giving them training (Period
I). Now train this group of salesman and again measure their sales (Period II). Thus the effectiveness can
be measured by the difference in their sales values.
i.e Sales in Period (II) – Sales in period (I)
This material is proprietary to KV Institute of Management, a Nationally Ranked B-School in Coimbatore and cannot be copied or duplicated for use
outside of KV. Violators will face infringement proceedings of copyright laws. Page: 7 of 26
KV INSTITUTE OF MANAGEMENT AND INFORMATION STUDIES
BA5202-BUSINESS RESEARCH METHODS

After only with control design


In this design two groups or areas (test area and control area) are selected and the treatment is
introduced into the test area only. The dependent variable is then measured in both the areas at the
same time. Treatment effect is measured by subtracting value of dependent variable in control area
from its value in test area.
Assumption that two areas behavior is same towards the phenomenon considered

Treatment Effect = Y - Z

Where Y= Level of phenomenon AFTER treatment in Test area


X = Level of phenomenon WITHOUT treatment in control area

Before and After with Control design.


- Two areas are selected and the dependent variable is measured in both for an identical period
time before the treatment.
- Treatment is then introduced in test area only.
- Dependent variable is then measured in both for the same period.
Difference is measured then.

This material is proprietary to KV Institute of Management, a Nationally Ranked B-School in Coimbatore and cannot be copied or duplicated for use
outside of KV. Violators will face infringement proceedings of copyright laws. Page: 8 of 26
KV INSTITUTE OF MANAGEMENT AND INFORMATION STUDIES
BA5202-BUSINESS RESEARCH METHODS

- Two time periods


Time period I Time period II
Test area X treatment Y
Control area V Z

Treatment Effect = (Y – X) – (Z - V)

Formal Experimental Design


These designs allow for statistical control and analysis of the external variables. Advantages include
the possibility to manipulate the effect of more than level of independent variable on the dependent
variable; to control the effect of extraneous variable(s) and to examine the effect of more than one
independent variable.

Completely Randomized Block (CRB)


This design is the simplest type possible; treatments are applied to the experimental unit through
a chance process. This design is most appropriate to certain types of animal or laboratory experiments.
The design is the most efficient in situations in which there is little variability among the units
associated with the position of the experimental area, age, vigor, or other identifiable sources.
This design is used when a researcher investigates the effect of one independent variable on the
dependent variable, where the independent variable is required to be measured on a nominal scale.
Here the basic assumption is that there are no differences in the test units, i.e. all the test units
are treated alike and are randomly assigned to the test groups.
It is flexible with regard to the physical arrangement of the experimental units, maximizes the
degrees of freedom for estimating experimental error, and minimizes the F value required for statistical
significance.

The disadvantage is that there are often identifiable sources of variation among the experimental units,
so that other designs, when skillfully employed, usually are capable of reducing the variability we call
experimental error, which makes it possible to detect smaller, significantly different treatment effects.

Any number of treatments may be tested in this design. It is desirable, but not essential, to
assign the same number of experimental units to each treatment.
Randomized Complete Block design (RCBD)
This design is an extension of the Completely Block Design
In a randomized block experiment for a field test, the experimental area is divided into a number

This material is proprietary to KV Institute of Management, a Nationally Ranked B-School in Coimbatore and cannot be copied or duplicated for use
outside of KV. Violators will face infringement proceedings of copyright laws. Page: 9 of 26
KV INSTITUTE OF MANAGEMENT AND INFORMATION STUDIES
BA5202-BUSINESS RESEARCH METHODS
of blocks of land, there being as many blocks as there are to be replications.
Each replication consists of as many plots as there are variables (varieties or chemical
treatments) to be tested. It essential that the variables be distributed in the replications at random,
subject to the restriction that each may occur only once in each replication.

This arrangement insures that each variable has an equal chance of being tested on a particular plot.

In a RCBD the treatments are assigned at random to a group of experimental units called the block or
replication.

Block is the preferable term, as it avoids confusion with replications of the completely randomized
design.

The object is to keep the variability among experimental units within a block as small as possible and
to maximize differences among blocks.

A block should consist of experimental units that are as uniform as possible. To achieve uniformity,
experimental units may be classified on the basis of age, weight, general vigor, prior knowledge of
gaining or yielding ability, or some distance.

Blocks can be kept compact by placing plots, usually long and narrow in shape, close together. The
number of treatments should be as few as possible and still meet the objectives of the experiment.

It is not necessary that each block be the same shape, but in field experiments with crops, this is the
most desirable. Experiments can be designed with differences in block shapes due to geography but
this can increase within geography.

Latin Square Design (LSD)

Very frequently used in agricultural research. Latin square is used when there are two major
extraneous factors. The layout of the design is square. Here the treatment on each subject are tested
one at a time, in a sequence, and the treatment is rotated so that one extraneous factor will have an
effect on the other.
For example if we want to judge the effect of five different varieties of fertilizers on the yield of wheat.
The two extraneous factors here are fertility of land and varying seeds.
Field is divided into 5*5 parts and each extraneous factor is taken at one axis
Fertility level
I II III IV V
Seeds X1 A B C D E
X2 B C D E A

Difference X3 C D E A B

X4 D E A B C
X5 E A B C D

This material is proprietary to KV Institute of Management, a Nationally Ranked B-School in Coimbatore and cannot be copied or duplicated for use
outside of KV. Violators will face infringement proceedings of copyright laws. Page: 9 of 26
KV INSTITUTE OF MANAGEMENT AND INFORMATION STUDIES
BA5202-BUSINESS RESEARCH METHODS
Example: Two extraneous variables 1 Fertility level and 2 Seeds difference Five types of fertilizers: A,
B, C, D, E

Research is to find out the most effective fertilizer


In a LSD the randomization of treatments is restricted further by grouping them into columns as
well as rows. Thus it is possible to remove variability from experimental error associated with both
these effects.
Each treatment occurs the same number of times (usually once) in each row and column. The
design will afford a more precise comparison of treatment effects than the randomized block design
only if there is appreciable variation associated with the columns.
Rows and columns may refer to the special distribution of experimental units or to the order in
which treatments are performed.
Consider, for example, an experiment designed to test four seed treatments where individual
plots are to be single rows throughout the experimental area. A seeder with four planter units is to be
used. Planter units may different in seeding rate. To remove planter effect, each seed treatment can be
assigned to a different seeder unit in each of four blocks so that each treatment is seeded the same
number of times by each seeding unit.

A Latin square requires at least as many replications as there are treatments and therefore is not
practical for experiments with a large number of treatments. Most commonly used Latin squares are
those having four to eight treatments with a single experimental unit per treatment in each column and
row.

FACTORIAL DESIGN
While only one variable is tested in the Latin Square Design, Factorial design permits the
researcher to test two or more variables at the same time. It allows the interaction between two
variables.
Factorial design helps to determine the effect of each of the variables and measure the
interacting effect of many variables.
This is specially useful in several economic and social phenomena where there are large number
of factors affect a particular problem.
Two types of factorial design are:

Effect of varying two factors on


the
Simple factorial dependent variable

Complex
More than two
factorial factors.
design

This material is proprietary to KV Institute of Management, a Nationally Ranked B-School in Coimbatore and cannot be copied or duplicated for use
outside of KV. Violators will face infringement proceedings of copyright laws. Page: 10 of 26
KV INSTITUTE OF MANAGEMENT AND INFORMATION STUDIES
BA5202-BUSINESS RESEARCH METHODS

I. Simple Factorial design


• In case of simple factorial designs the effects of varying two factors on the dependent variable
are considered.
• Simple factorial design is also termed as a „two – factor – factorial design‟.
• Simple factorial design may either be a 2 x 2 simple factorial design or it may be 3x4 or 5x3.
• Some simple factorial designs are

Experimental variable

Control Variable Treatment A Treatment B


Level1 Cell 1 Cell 5
Level 2 Cell 3 Cell 4

I .Complex Factorial Design


Experiments with more than two factors at a time involve the use of complex factorial design.
Treatment and control variable both have different levels.

Experimental Variable Treat A Treat B


Level1 level2 level 1 level 2
Control level1 I III IV VII
Variable level2 II IV VI VIII

To determine the main effects of the experimental variable, the researcher must necessarily combined
mean of Cell I, II, III, IV
Advantages of factorial design
They provide equivalent accuracy with less labour and as such are a source of economy.
The researcher can determine the main effects of two (in simple factorial design) or more (in
case of complex factorial design) factors (or variables) in one single experiment.
The determination of interaction effects is possible in case of factorial designs.

2.9 VALIDITY OF RESEARCH DESIGN


Validity refers to the strength and the accuracy of a research design. Two types of validity in a
research design viz
Internal Validity
Internal validity describes the ability of the research design to unambiguously test the research
hypothesis. Internal validity refers to the extent to which one can accurately state that the
independent variable is responsible for the observed effect in the dependent variable and no other
variable is responsible for the effect.

This material is proprietary to KV Institute of Management, a Nationally Ranked B-School in Coimbatore and cannot be copied or duplicated for use
outside of KV. Violators will face infringement proceedings of copyright laws. Page: 11 of 26
KV INSTITUTE OF MANAGEMENT AND INFORMATION STUDIES
BA5202-BUSINESS RESEARCH METHODS
If the effect on dependent variable is only due to variation in the independent variable, then we
may conclude that the internal validity is achieved.
To achieve high internal validity, a researcher must consider all the factors that affect the
dependent variable and control them appropriately. It ensures that these factors do not interface
with the results.
Internal validity is only relevant in studies that aim at establishing casual relationship. It is not
relevant in most of the exploratory, observational or descriptive studies.

Threats of internal validity

Histor
y

Maturatio
n

Testin
g

Selection
of
responden
Statistical
Regression

Experiment
al Mortality

Instrument
change

History
History refers to the events that are beyond the control of the experiment. These events may change the
attitude of the respondents irrespective of whether the independent variable is changed or not. Thus it
is impossible to determine whether any change on the dependent variable is due to the independent
variable or the historical event.

Maturation
Subjects change during the course of the experiment or even between measurements. For example,
young children might mature and their ability to concentrate may change as they grow up. Both
permanent changes, such as physical growth and temporary ones like fatigue, provide "natural"

This material is proprietary to KV Institute of Management, a Nationally Ranked B-School in Coimbatore and cannot be copied or duplicated for use
outside of KV. Violators will face infringement proceedings of copyright laws. Page: 12 of 26
KV INSTITUTE OF MANAGEMENT AND INFORMATION STUDIES
BA5202-BUSINESS RESEARCH METHODS
alternative explanations; thus, they may change the way a subject would react to the independent
variable. So upon completion of the study, the researcher may not be able to determine if the cause
of the discrepancy is due to time or the independent variable.

REPEATED TESTING (ALSO REFERRED TO AS TESTING EFFECTS)


Repeatedly measuring the participants may lead to bias. Participants may remember the correct
answers or may be conditioned to know that they are being tested. Repeatedly taking (the same or
similar) intelligence tests usually leads to score gains, but instead of concluding that the
underlying skills have changed for good, this threat to Internal Validity provides good rival
hypotheses.
SELECTION OF RESPONDENTS
The inappropriate selection of respondents may lead to bias in experimental design. If the selected
respondents are not uniform, inadvertent randomization may take place leading to bias.

STATISTICAL REGRESSION
The statistical regression refers to the bias that may crop in due to some respondents giving
extreme responses. This bias is known as error sum of squares in statistical regression analysis.

EXPERIMENTAL MORTALITY
This can occur when the respondents drop out during the experiment especially in the experiment
involving pre – test and post – test. The same respondents who take up the pre-test may not be
available for the post-test. This results in excluding the entire pre – test data from the analysis
dropped – out respondents.

INSTRUMENT CHANGE (INSTRUMENTALITY)


The instrument used during the testing process can change the experiment. This also refers to
observers being more concentrated or primed, or having unconsciously changed the criteria they use to
make judgments. This can also be an issue with self-report measures given at different times. In this
case the impact may be mitigated through the use of retrospective pretesting. If any instrumentation
changes occur, the internal validity of the main conclusion is affected, as alternative explanations are
readily available.

EXTERNAL VALIDITY
External validity is related to generalisability of the findings/results. It refers to the degree of
generalisability of the conclusions to other situations. In other words, external validity is the degree to
which the conclusions in the study for a given population could be made applicable to other
populations or other situations.
It is noted that more the internal validity for an experiment lesser will be its external validity. It is
because when steps are taken to increase the degree of internal validity, it leads to controlling of many
other variables (such as extraneous variables), which are not under the scope of the study but can still
influence the casual relationship between variables under the study. The end result is that it limits the
generalisability of findings.

2.10 VARIABLES IN RESEARCH


A business research study, invariable involves study of characteristics of an individual/item/unit entity

This material is proprietary to KV Institute of Management, a Nationally Ranked B-School in Coimbatore and cannot be copied or duplicated for use
outside of KV. Violators will face infringement proceedings of copyright laws. Page: 13 of 26
KV INSTITUTE OF MANAGEMENT AND INFORMATION STUDIES
BA5202-BUSINESS RESEARCH METHODS
etc. These characteristics are represented by variables.
As the name suggests a variable changes values for different individual/item at the same time (e.g.
Income of individuals for the year 2009-10, prices of stocks on a day) or for the same individual/item
at different time (income for an individual, sales of a company).
For example, the income of an individual is a quantitative variable, gender is a qualitative variable. In
a study, data is generally collected for relevant variables. These are classified into

1. Independent variable
2. Dependent variable
3. Moderating variable
4. Intervening variable
5. Extraneous variable
6. Continuous variable
7. Non-continuous/Discrete variable

Independent variable
Independent variable, also known as explanatory variable.
It is a variable which influences or explains the variation in the other variables, under
consideration, in the study. The value of this variable can be decided or controlled by the researcher.
The researcher can increase or decrease the value of the independent variable to assess its
impact.
For example the increase in advertisement leads to increase in sales, then the advertisement
expenses is considered as an independent variable. or
If a company increases the number of its branches, it will increase the business as well as
manpower in the company. The number of branches in this study is termed as independent variable.
In the research relating to studying the relationship between two variables, the independent
variable influencing the dependent variable is also called „casual‟ (as it causes change in dependent
variable) or „explanatory‟ variable (as it explains the change in the dependent variable).

Dependent variable
A dependent variable is one which depends on an independent variable defined in a study.
For example, „Expenditure on R&D‟ could be taken as independent variable in pharmaceutical firms,
and sales could be termed as dependent variable (on expenditure on R&D).

The value of dependent variable is not manipulated or controlled in a research study; it changes
due to the change in the independent variable.

Moderating variable
In a study involving an independent variable and a dependent variable, a relationship could be
established through a variable. However we may come across a third variables, which is not an
independent variable but forms strong contingent or contextual effect on the relationship of the
independent and dependent variables, is called as Moderating variable.

For example let us consider a relationship between training and performance in an organisation. We
may consider training as an independent variable and performance as a dependent variable. The
variable „WILLINGNESS TO LEARN‟ is neither an independent variable nor a dependent variable,
but has a strong effect on the relationship between training and performance. Those employees who

This material is proprietary to KV Institute of Management, a Nationally Ranked B-School in Coimbatore and cannot be copied or duplicated for use
outside of KV. Violators will face infringement proceedings of copyright laws. Page: 14 of 26
KV INSTITUTE OF MANAGEMENT AND INFORMATION STUDIES
BA5202-BUSINESS RESEARCH METHODS
are more willing to learn, will grasp the training effectively, and in turn will improve the performance.
But if the employees are not willing to learn, even if they are trained, it may not improve their
performance.
In this case „willingness to learn‟ becomes the moderating variable.

This material is proprietary to KV Institute of Management, a Nationally Ranked B-School in Coimbatore and cannot be copied or duplicated for use
outside of KV. Violators will face infringement proceedings of copyright laws. Page: 15 of 26
KV INSTITUTE OF MANAGEMENT AND INFORMATION STUDIES
BA5202-BUSINESS RESEARCH METHODS

Intervening variable
In a study involving independent and dependent variables, there could be a variable/factor which might
affect the dependent variable, but it cannot directly observed or measure. For example the sales for a
retail store might increase with increasing discounts (eg. 2%, 3% 5% etc), and a relationship could
be established. Suppose, a scheme is introduced that monthly prizes will be given to randomly selected
customers, this might increase the sales of a store but it cannot be measured; but its impact can be
observed. This, monthly prizes scheme is an intervening factor. If the total amount of prizes offered
(say Rs.10 lakh) is indicated, and the amount is a variable, then this could be considered as intervening
variable, and one could study its impact.

Extraneous Variable
Independent variables that are not related to the purpose of the study, but may affect the
dependant variable are termed as extraneous variable.
Extraneous variable is one that is outside or external to the situation under study, and its impact
on dependent variable is beyond the scope of the study.
Suppose the researcher wants to test the hypothesis that there is a relationship between children‟s
gains in social studies achievement and their self-concepts.
In this case social studies achievement is a dependant variable and their self-concepts is an
independent variable.
Intelligence may as well affect the social studies achievement, but since it is not related to the
purpose of the study undertaken by the researcher, it is termed as an extraneous variable.
Multiple variables

It is possible to have experiments in which you have multiple variables. There may be more than one
dependent variable and/or independent variable. This is especially true if you are conducting an
experiment with multiple stages or sets of procedures. In these experiments, there may be more than
one set of measurements with different variables.
Example: You are interested in finding out which color, type, and smell of flowers are preferred by
butterflies for pollination. You randomly choose an area you know to be inhabited by butterflies and
note all the species of flowers in that area. You want to measure pollination of flowers by butterflies,
so your dependent variable is pollination by butterflies. The independent variables are flower color,
type, and smell. You will need to specify relationships for each of these independent variables with the
dependent variable.

Continuous variable
Phenomena which can take on quantitatively different values even in decimal points are called
“continuous variables”.
Continuous variable is one which, when measured, can assume any real value (even in decimal
points)
Eg: Age is an example of continuous variables

Non – Continuous Variables/Discrete variable


But all variables are not continuous variables. If the variables can only express in
integer values, they are non-continuous variables.

Eg:. Number of children is an example non-continuous variables.

This material is proprietary to KV Institute of Management, a Nationally Ranked B-School in Coimbatore and cannot be copied or duplicated for use
outside of KV. Violators will face infringement proceedings of copyright laws. Page: 16 of 26
KV INSTITUTE OF MANAGEMENT AND INFORMATION STUDIES
BA5202-BUSINESS RESEARCH METHODS

PERFECT MEASUREMENT
Research should always be based on absolutely correct, defectless and errorless measuring
instruments, tools or procedures of measurement. For this purpose the acceptability of a measuring
instrument should be tested on the principles of adherence to the standards of perfect reliability,
confirmed practicality and verified validity. The reliability of an instrument can be ensured when it
conforms to certain prescribed norms. It is not the physical form or shape but it is the accuracy of the
prescribed standard content of the instrument that leads to acceptability. An instrument should be
conveniently usable with verifiable validity. Perfection in measurement can be achieved if a
researcher, at the outset, carries out appropriately, the prescribed tests of reliability, practical
acceptability and validity of his tools of measurement.

Errors in Measurement
Errors in the course of measurement can be traced to a number of factors such as carelessness,
negligence, ignorance in the usage of the instruments. If appropriate and defectless instruments are
used and care is taken in the process of measurement, only then can accuracy in research be ensured.

In regard to survey-work, where the researcher obtains information through interviews, it is necessary,
to judge as to whether the respondent is providing accurate facts or is biased. As situational factors
also influence measurement, it is imperative that the researcher adopts his measuring procedures
accordingly.

Research findings and conclusions can be reliable and acceptable if they are based on sound analysis
carried out through appropriate procedures of error-free and perfect measuring tools.

2.11SCALING TECHNIQUES

A well-designed research problem constitutes a well designed measurement process. The process of
measurement is a fundamental aspect of any research. This is the step where you actually try to find
out the reality by measuring it. Decision makers are more interested as the steps prior to this step are
purely descriptive, and, this is the step where actual quantification happens.

Developing effective measures of marketing is not an easy task. The measures should be devoid of
measurement errors. There may be disastrous situations where the marketer may be confused with the
findings of the data. If he is well aware of the confounding results, then he may discard the findings
the emerge from the data analysis. This requires lot of wisdom and knowledge in identifying if the data
that resulted from the measurement is consistent, unambiguous etc., But unfortunately, marketers may
not be interested in knowing or rather would not know the type of scales used to measure the aspects
involved in the marketing problem. Any decision made based on the findings would lot of negative
implications on the organisation. Hence, it is very imperative that the researcher is wise enough to
develop measurement scales that capture the right property with appropriately.

The scaling techniques employed in research could be broadly classified into comparative and non
comparative scale. Comparative scales as its name indicate derive their name from the fact that all
ratings are comparisons involving relative judgments. It involves direct comparison of stimulus
objects. It contains only ordinal or rank order properties. It is also otherwise called non metric scales in
that it does not allow any numerical operations on it against all that could be applied on interval and

This material is proprietary to KV Institute of Management, a Nationally Ranked B-School in Coimbatore and cannot be copied or duplicated for use
outside of KV. Violators will face infringement proceedings of copyright laws. Page: 17 of 26
KV INSTITUTE OF MANAGEMENT AND INFORMATION STUDIES
BA5202-BUSINESS RESEARCH METHODS

ratio scales. Comparative scales involve the direct comparison of stimulus objects.

COMPARATIVE SCALING TECHNIQUES


Comparative scaling techniques consist of:

a) Paired comparison scaling


b) Rank order scaling
c) Constant sum scaling and
d) Q-sort.

Paired Comparison Scaling


Paired comparison scaling as its name indicates involves presentation of two objects and asking the
respondents to select one according to some criteria. The data are obtained using ordinal scale. For
example, a respondent may be asked to indicate his/her preference for TVs in a paired manner.

Paired comparison data can be analysed in several ways. In the above example, the researcher can
calculate the percentage of respondents who prefer one particular brand of TV over the other. Under
the assumption of transitivity, data generated using paired comparison technique could be converted to
a rank order. Transitivity of preference implies that if a respondent prefers brand X over brand Y, and
brand Y is preferred to Z, then brand X is preferred to Z. This may be done by determining the number
of times each brand is preferred by preference, from most to least preferred.

Paired comparison technique is useful when the number of brands is limited, as it requires direct
comparison and overt choice. However, it is not so, that possible comparison could not be made, but
comparisons would become so much unwieldy.

The most common method of taste testing is done by paired comparison where the consumer may be,
for example, asked to taste two different brands of soft drinks and select the one with the most
appealing taste.

Rank Order Scaling


This is another popular comparative scaling technique. In rank order scaling is done by presenting the
respondents with several objects simultaneously and asked to order or rank them based on a particular
criterion. For example, the customers may rank their preference for TVs among several brands. In this
scaling technique, ordinal scale is used. The consumers may be asked to rank several brands of
television in an order, 1 being the most preferred brand, followed by 2, 3 and so on. Like paired
comparison, it is also comparative in nature.

Data generated using this technique are employed with conjoint analysis because of the discriminatory
potential of the scaling, stimulating the consumers to discriminate one brand from the other.

Under the assumptions of transitivity, rank order can be converted to equivalent paired comparison
data, and vice versa.

Constant Sum Scaling


This technique allows the respondents to allocate a constant sum of units, such as points, rupees or
among a set of stimulus objects with respect to some criterion. The technique involves asking the
This material is proprietary to KV Institute of Management, a Nationally Ranked B-School in Coimbatore and cannot be copied or duplicated for use
outside of KV. Violators will face infringement proceedings of copyright laws. Page: 18 of 26
KV INSTITUTE OF MANAGEMENT AND INFORMATION STUDIES
BA5202-BUSINESS RESEARCH METHODS
respondents to assign 10 points to attributes of a sports utility vehicle. If the attribute is unimportant,
then the respondents would want to enter zero.

The attributes are scaled by counting the points assigned to each one by al the respondents and
dividing the number of respondents. This predominantly uses ordinal because of its comparative nature
and the resulting lack of generalisability. Constant sum scaling has advantage in that it allows for
discrimination among stimulus objects without requiring too much time. Its advantage involves
allocation of more or fewer units than those specified.

Q-Sort
Q-sort refers to discriminating among a relatively large number of objects quickly. This technique uses
a rank order procedure in which objects are sorted into piles based on similarity with respect to some
criterion. A typical example quoted in Malhotra (2004) is as follows:

Respondents are given 100 attitude statements on individual cards and asked to place them into 11
piles, ranging from „most highly agreed with‟ to „least highly agreed with‟. The number of objects tobe
sorted should not be less than 60 nor more than 140: 60 to 90 objects is a reasonable range. The
number of objects to be placed in each pile is pre-specified, often to result in a roughly normal
distribution of objects over the whole set.

NON-COMPARATIVE SCALING TECHNIQUES


Non-comparative scales or otherwise called as nomadic scales because only one object is evaluated at
a time. Researchers use this scale allowing respondents to employ whatever rating standard seems
appropriate to them and not specified by the researcher. The respondents do not compare the object
being rated either to another object or to some specified standard set by the researcher. Non-
comparative techniques use continuous and itemized rating scales.

In such scales, each object is scaled independently of the other objects in the stimulus set, the resulting
data is generally assumed to be interval or ratio scale.

Continuous Rating Scale


This is also otherwise called as graphic rating scale. This is a type of scale that offers respondents a
form of continuum (such as a line) on which to provide a rating of an object. Researchers develop
continuous rating scale allowing the respondents to indicate their rating by placing a mark at the
appropriate point on a line that runs from one end of the criterion variable to the other or a set of
predetermined response categories. Here the respondents need not select marks already set the
researcher.

There are several variations that are possible. The line may be vertical or horizontal; it may be
unmarked or marked; if marked, the divisions may be few or as many as in the thermometer scale; the
scale points may be in the form of numbers or brief descriptions. Three versions are normally used as
given in the table below:

Examples of continuous rating scale


Please evaluate the service quality of a restaurant by placing an x at the position on the horizontal line
that most reflects your feelings

This material is proprietary to KV Institute of Management, a Nationally Ranked B-School in Coimbatore and cannot be copied or duplicated for use
outside of KV. Violators will face infringement proceedings of copyright laws. Page: 19 of 26
KV INSTITUTE OF MANAGEMENT AND INFORMATION STUDIES
BA5202-BUSINESS RESEARCH METHODS
Empathy
The worst

The best

Continuous rating scales are easy to construct, however, the scoring may be cumbersome and
unreliable. With the advent of computers in research, they are increasingly used, though, they
otherwise provide little new information.

Itemised Rating Scales

This scale is similar to the graphic scale in that the individuals make their judgement independently,
without the benefit of direct comparison. The respondents are provided with a scale that has a number
or brief description associated with each category. This scale allows the respondents to choose from a
more limited number of categories, usually five to seven, although 10 or more are rarely used. The
categories are ordered in terms of scale position; and the respondents are required to select the
specified category that best describes the object being rated. The categories are given verbal
description, although this is not absolutely necessary. These scales are widely used in research and
nowadays, more complex types such as multi-item rating scales are used. There are few variants
among itemised rating scales. They are Likert, Semantic differential and stapel scales.

Likert Scale

This scale is named after Renis Likert. This is the most widely used scale in research, in particular, in
testing models. Several research studies are done using Likert scale. The respondents require to
indicate a degree of agreement of disagreement with each of a series of statements about the stimulus
objects. Example of a portion of a popularly used Likert scale to measure tangibility of service is given
below.

Listed below are the tangibility of service rendered by a bank is given below. Please indicate how
strongly you agree or disagree with each by using the following scale

1 = Strongly disagree

2 = Disagree

3 = Neither agree nor disagree

4 = Agree

5 = Strongly agree

To analyse the data generated using this scale, each statement is assigned a numerical score, ranging
either from -2 to +2 through a zero or 1 to 5. The analysis can be conducted item wise or a total score
(summated) or a mean can be calculated for each respondent by summing or averaging across items. It
is important in Likert scale that a consistent scoring procedure so that a high score reflects favourable
response and a low score reflects unfavourable response. Any deviation in the form of reverse coding

This material is proprietary to KV Institute of Management, a Nationally Ranked B-School in Coimbatore and cannot be copied or duplicated for use
outside of KV. Violators will face infringement proceedings of copyright laws. Page: 20 of 26
KV INSTITUTE OF MANAGEMENT AND INFORMATION STUDIES
BA5202-BUSINESS RESEARCH METHODS
where the lowest value is given to a favourable response and highest value is given to an unfavourable
response should be clearly specified by the researcher. Usually, reverse coding is used when the
statements indicate a negative concept and when used with other statements, reverse coding would
give a positive effect.

Semantic Differential Scale

Semantic differential scale is a popular scaling technique next to Likert scale. In this scale, the
respondents associate their response with bipolar labels that have semantic meaning. The respondents
rate objects on a number of itemised, seven point rating scales bounded at each end by one of two
bipolar adjectives such as “Excellent” and “Very bad”. The respondents indicate their response
choosing the one that best describes their choice.

The points are marked either from - 3 to +3 through a zero or from 1 to 7. The middle value may be
treated as a neutral position. The value zero in the first type is the neutral point and 4 in the second
type is the neutral point. The resulting data are commonly analysed through profile analysis. In such
analysis, the means or median values on each rating scale are calculated and compared by plotting or
statistical analysis. This would help the researcher to determine the overall differences and similarities
among the objects.

To assess differences across segments of respondents, the researcher can compare mean responses of
different segments. This data generated using this scale could be employed with summary statistics
such mean, though, there is a controversy on the employment of mean on this scale. Mean is typical of
Interval and ratio scales whereas this scale theoretically is an ordinal scale. However, looking beyond
this objection by statisticians, researchers invariably apply all statistical techniques on this scale. The
following example illustrates semantic differential scales

1) Pleasant unpleasant
2) Aggressive submissive
3) Exciting unexciting

Staple Scale

This scale is named after Jan Stapel, who developed it. This is a unipolar rating scale with in general
10 categories number from -5 to +5 without a neutral point (zero). This scale is usually presented
vertically and respondents choose their response based on how accurately or inaccurately each item
describes the object by selecting an appropriate numerical response category. The higher number
indicates more accurate description of the object and lower number indicates lower description of the
object. An example is given below:

+5

+4

+3

+2

This material is proprietary to KV Institute of Management, a Nationally Ranked B-School in Coimbatore and cannot be copied or duplicated for use
outside of KV. Violators will face infringement proceedings of copyright laws. Page: 21 of 26
KV INSTITUTE OF MANAGEMENT AND INFORMATION STUDIES
BA5202-BUSINESS RESEARCH METHODS

+1

High tangibility of service

-1

-2

-3

-4

-5

The data generated using staple scale could be analysed in the same way as semantic differential scale.
The main advantage of Stapel Scale is that it does not require a pretest of the adjectives or phrases to
ensure true bipolarity, and it can be administered over the telephone.

THE MEASUREMENT PROCESS


Measurement is defined as the assignment of numbers to characteristics of objects or events according
to rules. The definition of measurement clearly states that the researcher should know that the
measurement scale measures the characteristics of the objects or event and not the objects or events.

Further, to make the measurement process effective, the relationships existing among the objects or
events in the empirical system should directly correspond to the rules of the number system. If this
correspondence is misrepresented, measurement error has occurred. The term number indicates the
application of numbers to various aspects measured in the measurement process. Data analysis is a
statistical process done on the data generated using scales. Hence, all measures should be converted
into quantitative terms by applying numbers. However, the definition of measurement imposes certain
restrictions on the type of numerical manipulations admissible.

The numerical application on all measurements and the analysis of numbers using mathematical or
statistics involve one or more of the four characteristics of number system. Measurement of any
property could be fitted into any of these characteristics.

LEVELS OF MEASUREMENT
Researchers normally use four level of measurement scales. They are:

a) Nominal scale
b) Ordinal scale
c) Interval scale
d) Ratio scale

Nominal Scale
Nominal scale are categorical scales used to identify, label or categories objects or persons or events.

This material is proprietary to KV Institute of Management, a Nationally Ranked B-School in Coimbatore and cannot be copied or duplicated for use
outside of KV. Violators will face infringement proceedings of copyright laws. Page: 22 of 26
KV INSTITUTE OF MANAGEMENT AND INFORMATION STUDIES
BA5202-BUSINESS RESEARCH METHODS
A familiar example is the use of alternative numbering system by our Physical Education Teacher in
our school days to engage us in a game. The teacher as a result would form two groups one labelled 1
and the other 2. The numbers 1 and 2 are assigned to two groups and the members belonging to group
1 would exclusively be a part of group 1 and the members belonging to group 2 would exclusively be a
part of group 2. However, assigning the numbers does not indicate any order or position to the group it
represents. Interchanging the numbers otherwise would also result in the same effect in that, the order
or position would not change.

Nominal scales are the lowest form of measurement. The simple rule to be followed while developing
a nominal scale: Do not assign the same numerals to different objects or events or different numbers to
the same object or event. In marketing nominal scales are used substantially in many occasions. For
example, nominal scale is used to identify and classify brands, sales regions, awareness of brands,
working status of women etc.,

On data generated using nominal scale, the type of statistical analysis appropriate are mode,
percentages, and the chi-square test. Mode alone could be used as a measure of central tendency. Mean
and median could be employed on nominal data since they involve higher level properties of the
number system. Researchers should be careful enough to identify the type of scales before they apply
any statistical technique. The researcher may not be able to make any meaning inference from the
mean or median value obtained from nominal data.

Ordinal Scale
Ordinal scale is a ranking scale that indicates ordered relationship among the objects or events. It
involves assigning numbers to objects to indicate the relative extent to which the objects possess some
characteristic. It measure whether an object or event has the same characteristic than some other object
or event. It is an improvement over nominal scale in that it indicates an order. However, this scale does
not indicate on how much more or less of the characteristic various objects or events possess. The term
how much refers to ranks that it do not indicate if the second rank is a close second or a poor second to
the first rank.

Data generated using ordinal scale appears as ranks where the object which has ranked first has more
of the characteristic as compared to those objects ranked second or third. Hence, the important feature
of ordinal scale over nominal scale is that it indicates relative position, not the magnitude of the
difference between the objects. In research, ordinal scales are used to measure relative attitudes,
opinions, perceptions etc., Most data collected by the process of interrogating people have ordinal
properties. To illustrate, a marketer may be interested in knowing the preference of the customers
across various brands. The customers may be requested to rank the products in terms of their
preference for the products.

The numbers assigned to a particular object or event can never be changed in ordinal scales. Any
violation of this principle would result in confounding results by the researcher. Mean is not an
appropriate statistic for ordinal scale.

Interval Scale
Interval scale is otherwise called as rating scale. It involves the use of numbers to rate objects or
events. It interval scales, numerically equal distances on the scale represent equal values in the
characteristic being measured. Interval scale is an advancement over the ordinal scale that it has all the

This material is proprietary to KV Institute of Management, a Nationally Ranked B-School in Coimbatore and cannot be copied or duplicated for use
outside of KV. Violators will face infringement proceedings of copyright laws. Page: 23 of 26
KV INSTITUTE OF MANAGEMENT AND INFORMATION STUDIES
BA5202-BUSINESS RESEARCH METHODS
properties of an ordinal scale plus it allows the researcher to compare the differences between objects.
It also possesses the property of equality of difference between each levels of measurement. The
feature of this scale is that the difference between any two scale values is identical to the difference
between any other two adjacent values of an interval scale. Examples of interval scales are the
Fahrenheit and Celsius scales.

Interval scales also place restriction on the assignment of values to the scale points. The zero that could
be assignment is a arbitrary zero rather than a natural zero. Arbitration involves freedom to place the
zero value on any point. There is a constant or equal interval between scale values.

In research, most of the research on attitudes, opinions and perceptions are done using scales treated as
interval scales. All statistical techniques that are employed on nominal and ordinal scales could also be
employed on data generated using interval scales.

Ratio Scales
Ratio scales differ from interval scales in that it has a natural/absolute zero. It possesses all the
properties of the normal, ordinal and interval scales. Data generated using ratio scales may be
identified, classified into categories, ranked and compared with others properties. It could also be
expressed in terms of relativity in that one can be expressed in terms of a division of the other. Hence,
it may be called as relative scales.

Ratio scales have great many number of application in research. They include sales, market share,
costs, ages, and number of customers. In all these cases, natural zero exists. All statistical techniques
can be applied on ratio data.

2.13 VALIDITY AND RELIABILITY OF AN INSTRUMENT


TESTS OF SOUND MEASUREMENT
Sound measurement must meet the tests of validity, reliability and practicality. In fact, these are the
three major considerations one should use in evaluating a measurement tool. “Validity refers to the
extent to which a test measures what we actually wish to measure. Reliability has to do with the
accuracy and precision of a measurement procedure ... Practicality is concerned with a wide range of
factors of economy, convenience, and interpretability ...” We briefly take up the relevant details
concerning these tests of sound measurement.
Test of Validity
Validity is the most critical criterion and indicates the degree to which an instrument measures what it
is supposed to measure. Validity can also be thought of as utility. In other words, validity is the extent to
which differences found with a measuring instrument reflect true differences among those being tested.
But the question arises: how can one determine validity without direct confirming knowledge? The
answer may be that we seek other relevant evidence that confirms the answers we have found with our
measuring tool. What is relevant, evidence often depends upon the nature of the research problem and the
judgement of the researcher. But one can certainly consider three types of validity in this connection:
(i) Content validity;
(ii) Criterion-related validityand
(iii) Construct validity.

This material is proprietary to KV Institute of Management, a Nationally Ranked B-School in Coimbatore and cannot be copied or duplicated for use
outside of KV. Violators will face infringement proceedings of copyright laws. Page: 24 of 26
KV INSTITUTE OF MANAGEMENT AND INFORMATION STUDIES
BA5202-BUSINESS RESEARCH METHODS
(i) Content validity is the extent to which a measuring instrument provides adequate coverage
of the topic under study. If the instrument contains a representative sample of the universe, the
content validity is good. Its determination is primarily judgemental and intuitive. It can also be
determined by using a panel of persons who shall judge how well the measuring instrument meets
the standards, but there is no numerical way to express it.
(i) Criterion-related validity relates to our ability to predict some outcome or estimate the
existence of some current condition. This form of validity reflects the success of measures used
for some empirical estimating purpose. The concerned criterion must possess the following
qualities:
Relevance: (A criterion is relevant if it is defined in terms we judge to be the proper measure.)
Freedom from bias: (Freedom from bias is attained when the criterion gives each subject an
equal opportunity to score well.)
Reliability: (A reliable criterion is stable or reproducible.)
Availability: (The information specified by the criterion must be available.)
In fact, a Criterion-related validity is a broad term that actually refers to
(i) Predictive validity and
(ii) Concurrent validity.
The former refers to the usefulness of a test in predicting some future performance whereas
the latter refers to the usefulness of a test in closely relating to other measures of known validity.
Criterion-related validity is expressed as the coefficient of correlation between test scores and
some measure of future performance or between test scores and scores on another measure of
known validity.
Construct validity is the most complex and abstract. A measure is said to possess construct validity to
the degree that it confirms to predicted correlations with other theoretical propositions. Construct
validity is the degree to which scores on a test can be accounted for by the explanatory constructs of a
sound theory. For determining construct validity, we associate a set of other propositions with the results
received from using our measurement instrument. If measurements on our devised scale correlate in a
predicted way with these other propositions, we can conclude that there is some constructvalidity.
If the above stated criteria and tests are met with, we may state that our measuring instrument is
valid and will result in correct measurement; otherwise we shall have to look for more information
and/or resort to exercise of judgement.

Test of Reliability
The test of reliability is another important test of sound measurement. A measuring instrument is
reliable if it provides consistent results. Reliable measuring instrument does contribute to validity, but a
reliable instrument need not be a valid instrument. For instance, a scale that consistently overweighs
objects by five kgs., is a reliable scale, but it does not give a valid measure of weight. But the other
way is not true i.e., a valid instrument is always reliable. Accordingly reliability is not as valuable as
validity, but it is easier to assess reliability in comparison to validity. If the quality of reliability is
satisfied by an instrument, then while using it we can be confident that the transient and situational
factors are not interfering.

This material is proprietary to KV Institute of Management, a Nationally Ranked B-School in Coimbatore and cannot be copied or duplicated for use
outside of KV. Violators will face infringement proceedings of copyright laws. Page: 25 of 26
KV INSTITUTE OF MANAGEMENT AND INFORMATION STUDIES
BA5202-BUSINESS RESEARCH METHODS
Two aspects of reliability viz., stability and equivalence deserve special mention. The stability
aspect is concerned with securing consistent results with repeated measurements of the same person
and with the same instrument. We usually determine the degree of stability by comparing the results
of repeated measurements. The equivalence aspect considers how much error may get introduced
by different investigators or different samples of the items being studied. A good way to test for the
equivalence of measurements by two investigators is to compare their observations of the same
events. Reliability can be improved in the following two ways:
(i) By standardising the conditions under which the measurement takes place i.e., we must
ensure that external sources of variation such as boredom, fatigue, etc., are minimized to the
extent possible. That will improve stabilityaspect.
(i) By carefully designed directions for measurement with no variation from group to group, by
using trained and motivated persons to conduct the research and also by broadening the sample of
items used. This will improve equivalenceaspect.

Test of Practicality
The practicality characteristic of a measuring instrument can be judged in terms of economy,
convenience and interpretability. From the operational point of view, the measuring instrument ought to be
practical i.e., it should be economical, convenient and interpretable. Economy consideration suggests
that some trade-off is needed between the ideal research project and that which the budget can afford. The
length of measuring instrument is an important area where economic pressures are quickly felt.
Although more items give greater reliability as stated earlier, but in the interest of limiting the interview or
observation time, we have to take only few items for our study purpose. Similarly, data-collection
methods to be used are also dependent at times upon economic factors.
Convenience test suggests that the measuring instrument should be easy to administer. For this purpose one
should give due attention to the proper layout of the measuring instrument. For instance, a
questionnaire, with clear instructions (illustrated by examples), is certainly more effective and easier to
complete than one which lacks these features. Interpretability consideration is especially important
when persons other than the designers of the test are to interpret the results. The measuring instrument, in
order to be interpretable, must be supplemented by
(a) Detailed instructions for administering the test;
(b) Scoring keys;
(c) Evidence about the reliability and Guides for using the test and for interpreting results.

This material is proprietary to KV Institute of Management, a Nationally Ranked B-School in Coimbatore and cannot be copied or duplicated for use
outside of KV. Violators will face infringement proceedings of copyright laws. Page: 26 of 26

You might also like