Professional Documents
Culture Documents
Introduction to Research
and Research Methods
INTRODUCTION TO RESEARCH
Research and experimental development is formal work
undertaken systematically to increase the stock of knowledge,
including knowledge of humanity, culture and society, and the use of
this stock of knowledge to devise new applications (OECD (2002)
Frascati Manual: proposed standard practice for surveys on research
and experimental development, 6th edition. It is used to establish or
confirm facts, reaffirm the results of previous work, solve new or
existing problems, support theorems, or develop new theories. A
research project may also be an expansion on past work in the field.
To test the validity of instruments, procedures, or experiments,
research may replicate elements of prior projects, or the project as a
whole. The primary purposes of basic research (as opposed to applied
research) are documentation, discovery, interpretation, or the research
and development of methods and systems for the advancement of
human knowledge. Approaches to research depend on epistemologies,
which vary considerably both within and between humanities and
sciences.
Research has been defined in a number of different ways.
1. A broad definition of research is given by Martyn Shuttleworth -
2 Introduction to Research and Research Methods
Introduction to Methodology
A methodology is usually a guideline system for solving a problem,
with specific components such as phases, tasks, methods, techniques
and tools. It can be defined also as follows:
1. "The analysis of the principles of methods, rules, and postulates
employed by a discipline";
2. "The systematic study of methods that are, can be, or have been
applied within a discipline";
3. "The study or description of methods".
A methodology can be considered to include multiple methods,
each as applied to various facets of the whole scope of the
methodology. The research can be divided between two parts, they
are qualitative research and quantitative research.
Generally speaking, methodology does not describe specific
methods despite the attention given to the nature and kinds of processes
to be followed in a given procedure or in attaining an objective. When
proper to a study of methodology, such processes constitute a
constructive generic framework; thus they may be broken down in
sub-processes, combined, or their sequence changed.
4 Introduction to Research and Research Methods
RESEARCH METHODS
To understand the use of statistics, one needs to know a little bit
about experimental design or how a researcher conducts investigations.
A little knowledge about methodology will provide us with a place to
hang our statistics. In other words, statistics are not numbers that
just appear out of nowhere. Rather, the numbers (data) are generated
out of research. Statistics are merely a tool to help us answer research
questions. As such, an understanding of methodology will facilitate
our understanding of basic statistics.
Validity
A key concept relevant to a discussion of research methodology
is that of validity. When an individual asks, "Is this study valid?", they
are questioning the validity of at least one aspect of the study. There
are four types of validity that can be discussed in relation to research
and statistics. Thus, when discussing the validity of a study, one
must be specific as to which type of validity is under discussion.
Therefore, the answer to the question asked above might be that the
study is valid in relation to one type of validity but invalid in relation to
another type of validity.
Each of the four types of validity will be briefly defined and
described below. Be aware that this represents a cursory discussion
of the concept of validity. Each type of validity has many threats
which can pose a problem in a research study. Examples, but not an
exhaustive discussion, of threats to each validity will be provided.
For a comprehensive discussion of the four types of validity, the
threats associated with each type of validity, and additional validity
issues see Cook and Campbell (1979).
Statistical Conclusion Validity: Unfortunately, without a
background in basic statistics, this type of validity is difficult to
understand. According to Cook and Campbell (1979), "statistical
conclusion validity refers to inferences about whether it is reasonable
to presume covariation given a specified alpha level and the obtained
variances (p. 41)." Essentially, the question that is being asked is -
"Are the variables under study related?" or "Is variable A correlated
(does it covary) with Variable B?". If a study has good statistical
conclusion validity, we should be relatively certain that the answer to
Introduction to Research and Research Methods 5
if I had conducted this study in the past or if I redo this study in the
future?" If I can not answer "yes" to each of these questions, then the
external validity of my study is threatened.
Types of Research Studies
There are four major classifications of research designs. These
include observational research, correlational research, true
experiments, and quasi-experiments. Each of these will be discussed
further below.
Observational research: There are many types of studies which
could be defined as observational research including case studies,
ethnographic studies, ethological studies, etc. The primary
characteristic of each of these types of studies is that phenomena are
being observed and recorded. Often times, the studies are qualitative
in nature. For example, a psychological case study would entail
extensive notes based on observations of and interviews with the
client. A detailed report with analysis would be written and reported
constituting the study of this individual case. These studies may also
be qualitative in nature or include qualitative components in the
research. For example, an ethological study of primate behavior in
the wild may include measures of behavior durations ie. the amount
of time an animal engaged in a specified behavior. This measure of
time would be qualitative.
Correlational research: In general, correlational research examines
the covariation of two or more variables. For example, the early
research on cigarette smoking examine the covariation of cigarette
smoking and a variety of lung diseases. These two variable, smoking
and lung disease were found to covary together.
Correlational research can be accomplished by a variety of
techniques which include the collection of empirical data. Often times,
correlational research is considered type of observational research as
nothing is manipulated by the experimenter or individual conducting
the research. For example, the early studies on cigarette smoking did
not manipulate how many cigarettes were smoked. The researcher
only collected the data on the two variables. Nothing was controlled
by the researchers.
It is important to not that correlational research is not causal
research. In other words, we can not make statements concerning
Introduction to Research and Research Methods 7
cause and effect on the basis of this type of research. There are two
major reasons why we can not make cause and effect statements.
First, we don¹t know the direction of the cause. Second, a third
variable may be involved of which we are not aware. An example
may help clarify these points.
In major clinical depressions, the neurotransmitters serotonin and/
or norepinephrine have been found to be depleted (Coppen, 1967;
Schildkraut & Kety, 1967). In other words, low levels of these two
neurotransmitters have been found to be associated with increased
levels of clinical depression. However, while we know that the two
variables covary - a relationship exists - we do not know if a causal
relationship exists. Thus, it is unclear whether a depletion in serotonin/
norepinephrine cause depression or whether depression causes a
depletion is neurotransmitter levels. This demonstrates the first
problem with correlational research; we don't know the direction of
the cause. Second, a third variable has been uncovered which may be
affecting both of the variables under study. The number of receptors
on the postsynaptic neuron has been found to be increased in
depression (Segal, Kuczenski, & Mandell, 1974; Ventulani, Staqarz,
Dingell, & Sulser, 1976). Thus, it is possible that the increased number
of receptors on the postsynaptic neuron is actually responsible for
the relationship between neurotransmitter levels and depression. As
you can see from the discussion above, one can not make a simple
cause and effect statement concerning neurotransmitter levels and
depression based on correlational research. To reiterate, it is
inappropriate in correlational research to make statements concerning
cause and effect.
True Experiments: The true experiment is often thought of as a
laboratory study. However, this is not always the case. A true
experiment is defined as an experiment conducted where an effort is
made to impose control over all other variables except the one under
study. It is often easier to impose this sort of control in a laboratory
setting. Thus, true experiments have often been erroneously identified
as laboratory studies.
To understand the nature of the experiment, we must first define
a few terms:
1. Experimental or treatment group - this is the group that receives
the experimental treatment, manipulation, or is different from the
control group on the variable under study..
8 Introduction to Research and Research Methods
Qualitative research
Understanding of human behavior and the reasons that govern
such behavior. Asking a broad question and collecting word-type data
that is analyzed searching for themes. This type of research looks to
describe a population without attempting to quantifiably measure
variables or look to potential relationships between variables. It is
viewed as more restrictive in testing hypotheses because it can be
expensive and time consuming, and typically limited to a single set of
research subjects. Qualitative research is often used as a method of
Introduction to Research and Research Methods 15
Quantitative research
Systematic empirical investigation of quantitative properties and
phenomena and their relationships. Asking a narrow question and
collecting numerical data to analyze utilizing statistical methods. The
quantitative research designs are experimental, correlational, and
survey (or descriptive). Statistics derived from quantitative research
can be used to establish the existence of associative or causal
relationships between variables.
The Quantitative data collection methods rely on random sampling
and structured data collection instruments that fit diverse experiences
into predetermined response categories. These methods produce results
that are easy to summarize, compare, and generalize. Quantitative
research is concerned with testing hypotheses derived from theory
and/or being able to estimate the size of a phenomenon of interest.
Depending on the research question, participants may be randomly
assigned to different treatments (this is the only way that a quantitative
study can be considered a true experiment). If this is not feasible, the
researcher may collect data on participant and situational
characteristics in order to statistically control for their influence on
the dependent, or outcome, variable. If the intent is to generalize from
the research participants to a larger population, the researcher will
employ probability sampling to select participants.
Bibliometrics
Bibliometrics is a type of research method used in library and
information science. It utilizes quantitative analysis and statistics to
describe patterns of publication within a given field or body of literature.
Researchers may use bibliometric methods of evaluation to determine
the influence of a single writer, for example, or to describe the
relationship between two or more writers or works. One common
way of conducting bibliometric research is to use the Social Science
Citation Index, the Science Citation Index or the Arts and Humanities
Citation Index to trace citations.
16 Introduction to Research and Research Methods
Laws of Bibliometrics
One of the main areas in bibliometric research concerns the
application of bibliometric laws. The three most commonly used laws
in bibliometrics are: Lotka's law of scientific productivity, Bradford's
law of scatter, and Zipf's law of word occurrence.
Lotka's Law
Lotka's Law describes the frequency of publication by authors in
a given field. It states that " . . . the number (of authors) making n
contributions is about 1/n² of those making one; and the proportion of
all contributors, that make a single contribution, is about 60 percent"
(Lotka 1926, cited in Potter 1988). This means that out of all the
authors in a given field, 60 percent will have just one publication, and
15 percent will have two publications (1/2² times .60). 7 percent of
authors will have three publications (1/3² times .60), and so on.
According to Lotka's Law of scientific productivity, only six percent
of the authors in a field will produce more than 10 articles. Lotka's
Law, when applied to large bodies of literature over a fairly long period
of time, can be accurate in general, but not statistically exact. It is
often used to estimate the frequency with which authors will appear
in an online catalog (Potter 1988).
Bradford's Law
Bradford's Law serves as a general guideline to librarians in
determining the number of core journals in any given field. It states
that journals in a single field can be divided into three parts, each
containing the same number of articles: 1) a core of journals on the
subject, relatively few in number, that produces approximately one-
third of all the articles, 2) a second zone, containing the same number
of articles as the first, but a greater number of journals, and 3) a third
zone, containing the same number of articles as the second, but a still
greater number of journals. The mathematical relationship of the
number of journals in the core to the first zone is a constant n and to
the second zone the relationship is n². Bradford expressed this
relationship as 1:n:n². Bradford formulated his law after studying a
bibliography of geophysics, covering 326 journals in the field. He
discovered that 9 journals contained 429 articles, 59 contained 499
Introduction to Research and Research Methods 17
the number of times the author has been cited by others. One possible
drawback of this approach is that authors may be citing the single
author in a negative context (saying that the author doesn't know
what s/he's talking about, for instance) (Osareh 1996).
Co-citation Coupling
Co-citation coupling is a method used to establish a subject
similarity between two documents. If papers A and B are both cited
by paper C, they may be said to be related to one another, even though
they don't directly cite each other. If papers A and B are both cited by
many other papers, they have a stronger relationship. The more papers
they are cited by, the stronger their relationship is.
Bibliographic Coupling
Bibliographic coupling operates on a similar principle, but in a
way it is the mirror image of co-citation coupling. Bibliographic coupling
links two papers that cite the same articles, so that if papers A and B
both cite paper C, they may be said to be related, even though they
don't directly cite each other. The more papers they both cite, the
stronger their relationship is.
Web Applications of Bibliometrics
Recently, a new growth area in bibliometrics has been in the
emerging field of webmetrics, or cybermetrics as it is often called.
Webmetrics can be defined as using of bibliometric techniques in
order to study the relationship of different sites on the World Wide
Web. Such techniques may also be used to map out (called "scientific
mapping" in traditional bibliometric research) areas of the Web that
appear to be most useful or influential, based on the number of times
they are hyperlinked to other Web sites.
Survey Methods
The survey is a non-experimental, descriptive research method.
Surveys can be useful when a researcher wants to collect data on
phenomena that cannot be directly observed (such as opinions on
library services). Surveys are used extensively in library and
information science to assess attitudes and characteristics of a wide
range of subjects, from the quality of user-system interfaces to library
Introduction to Research and Research Methods 19
DISCOURSE ANALYSIS
It is difficult to give a single definition of Critical or Discourse
Analysis as a research method. Indeed, rather than providing a particular
method, Discourse Analysis can be characterized as a way of
approaching and thinking about a problem. In this sense, Discourse
Analysis is neither a qualitative nor a quantitative research method,
but a manner of questioning the basic assumptions of quantitative and
qualitative research methods. Discourse Analysis does not provide a
tangible answer to problems based on scientific research, but it enables
access to the ontological and epistemological assumptions behind a
project, a statement, a method of research, or - to provide an example
from the field of Library and Information Science - a system of
classification. In other words, Discourse Analysis will enable to reveal
the hidden motivations behind a text or behind the choice of a particular
method of research to interpret that text. Expressed in today's more
trendy vocabulary, Critical or Discourse Analysis is nothing more
than a deconstructive reading and interpretation of a problem or text
(while keeping in mind that postmodern theories conceive of every
interpretation of reality and, therefore, of reality itself as a text. Every
text is conditioned and inscribes itself within a given discourse, thus
the term Discourse Analysis). Discourse Analysis will, thus, not provide
absolute answers to a specific problem, but enable us to understand
the conditions behind a specific "problem" and make us realize that
the essence of that "problem", and its resolution, lie in its assumptions;
the very assumptions that enable the existence of that "problem". By
enabling us to make these assumption explicit, Discourse Analysis
aims at allowing us to view the "problem" from a higher stance and to
gain a comprehensive view of the "problem" and ourselves in relation
to that "problem". Discourse Analysis is meant to provide a higher
awareness of the hidden motivations in others and ourselves and,
therefore, enable us to solve concrete problems - not by providing
unequivocal answers, but by making us ask ontological and
epistemological questions.
Though critical thinking about and analysis of situations/texts is
as ancient as mankind or philosophy itself, and no method or theory
as such, Discourse Analysis is generally perceived as the product of
the postmodern period. The reason for this is that while other periods
or philosophies are generally characterized by a belief-system or
28 Introduction to Research and Research Methods
principle that the meaning of each word depends on its place in the
total system of language.
Though limited to literature, this definition from the Dictionary of
Concepts in Literary Criticism and Theory provides an understanding
of what Structuralism or Structural Analysis is about. The French
theorist Roland Barthes expands this definition by characterizing
Structuralism in terms of its reconstitutive activity:
"The goal of all structuralist activity, whether reflexive or poetic,
is to reconstruct an 'object,' in such a way as to manifest thereby the
rules of functioning (the 'functions') of this object. The structure is
therefore actually a simulacrum of the object, but it is a directed,
interested simulacrum, since the imitated object makes something
appear which remained invisible or, if one prefers, unintelligible in the
natural object" (Barthes, 1963).
For Jean-Marie Benoist,
"An analysis is structural if, and only if, it displays the content as
a model, i.e., if it can isolate a formal set of elements and relations in
terms of which it is possible to argue without entering upon the
significance of the given content" (Benoist, 8).
In other words, Structuralism is not concerned with the content
of a text or any other kind of system; rather, it analyzes and explores
the structures underlying the text or system, which make the content
possible. One of the leading principles of Structuralism is that the
form defines the content ("form is content"). That is, that the
underlying structure of a text or system, which presents and organizes
the content, determines the nature of that content as well as its message
or communicated information. Thus Structuralism analyzes how
meaning is possible and how it is transmitted - regardless of the actual
meaning.
According to Claude Levy-Strauss, as well as other Structuralist
thinkers in linguistics, anthropology, psychology, and biology (as well
as other disciplines), the human mind structured to operate in certain
ways and which determines the way we think and operate, regardless
of the discipline we are working, the culture we are living in, or the
language that we speak. The view that there is in man an innate,
genetically, transmitted and determined mechanism that acts as a
structuring force is one underlying premises of Structuralism and,
30 Introduction to Research and Research Methods