I want to test a wound treatment or educational program in my clinical setting with patient

groups that are convenient or that already exist, How do I do it?

Implementing & evaluating wound research conducted using quasi-experimental designs
AAWC WocSpec Research Committee, Barbara M. Bates-Jensen, PhD, RN
ABSTRACT QUASI-EXPERIMENTAL
PURPOSE: To provide information on how to evaluate and improve METHODS
methodology of wound research conducted using quasi-experimental designs.
BACKGROUND: Research methodology is concerned with how a study’s The purpose of quasi-experimental research is to
design is implemented and how the research is conducted. Methodology approximate the conditions of the true experiment in
determines the quality of the data generated by the study and specifies: when
a setting which does not allow the control and/or
and how often data are collected, construction of data collection measures, who
data is collected from, how data is analyzed, and how findings are presented. manipulation of all relevant variables. Quasi-
Study design is a part of research methodology but not the only part.
METHODS: Quasi-experimental studies include: pretest posttest nonequivalent experimental research designs:
group design, time series design, and non-equivalent before-after design. The  answer questions using as much of an
purpose of quasi-experimental research is to approximate the conditions of the
experimental approach as possible in a clinical
true experiment in a setting which does not allow the control and/or
manipulation of all relevant variables. The researcher must clearly understand setting
what compromises exist in the internal and external validity of the design and
 follow basic experimental steps but do not
proceed within these limitations. We use quasi-experimental designs in the
clinical setting when control of all variables is not possible. Quasi-experimental include randomization and may not control other
designs are better than pre-experimental studies in that they use a method of
variables; uses existing or convenient groups
comparing groups. They are limited in that they fail to randomize the groups.
This research is characterized by methods of partial control based on a careful Quasi-experimental research designs include:
identification of factors influencing both internal and external validity. Methods of
1. Pretest posttest nonequivalent group design
increasing the strength of quasi-experimental wound studies are outlined.
CONCLUSIONS: Quasi-experimental designs follow true experimental steps 2. Time series design
but typically do not control all variables and do not include randomization. The
aim of quasi-experimental design is to evaluate the influence of a variable on 3. Non-equivalent before-after design
one group and not on another. Limitations relate to the researcher’s attention to
internal and external validity. Methods to improve the quality of wound research Pretest Posttest Nonequivalent
using quasi-experimental designs include attending to internal validity or did the
treatment make the difference in this specific instance rather than other factors?
And external validity or to what populations, settings, or treatment variables can
Group Designs
this observed effect be generalized?
Treatment Group O1 X O2
BACKGROUND Control Group O1 O2
Research methodology determines the quality of O1 = Pre observation measurement or Pretest
the data collected in a study, it concerns how the X = Wound Treatment or Educational Program
design is implemented and specifies: O2 = Post observation measurement or Posttest
 when and how often data are collected  A strong and widely used quasi-experimental design.
 development of data collection measures &  Differs from true experiments because there is no
instruments randomization, the groups are not equal.
 who data is collected from (the sample)  Comparing pretest results can show the level of
 how data are analyzed equivalence between the groups.
 how findings are presented. Time Series Designs
Whether or not study results are really the result of
the variable on the group under investigation in the Treatment Group O1 O2 O3 X O4 O5
study (internal validity) and not some other variable
Control Group O1 O2 O3 O4 O5
AND
Whether or not the study results can be expected O1 –O3= Pre observation measurements or Pretests
to be the same with other groups of people X = Wound Treatment or Educational Program
O4 –O6 = Post observation measurement s or Posttests
(external validity) are issues that are addressed by
methodology.  To determine the influence of a variable introduced
Research design is an important part of after a series of initial observations
methodology. Study design is a part of research  Differs from true experiments because there is no
randomization, the groups are not equal.
methodology but not the only part.
 Comparing pretest results can show the level of
equivalence between the groups.
Nonequivalent Before-after
Designs
Treatment Group 1 O1 X O2
Treatment Group 2 O1 X O2
O1 = Pre observation measurement or Pretest
X = Wound Treatment or Educational Program
O2 = Post observation measurement or Posttest
 Two groups with known differences before the study
begins are tested and compared.
 The same treatment is done for both groups and
differences in posttests are assumed to be related to the
difference in the two groups.
Improving Quasi-experimental
studies: Internal Validity
Internal Validity asks the question: did, in fact, the
experimental treatments make a difference in this specific
instance?
• 8 classes of extraneous variables which, if not
controlled, may produce effects that can be confused with
the effects of the experimental treatment:
1. History: Did something happen between the first and
second measurements in addition to the treatment
which might affect the measurement?
 Use a control group.
2. Maturation: the process of growing, developing,
aging or maturing which takes place in the individual
during the study period.
 Use a control group.
3. Pre-testing: the effect created on the second
measurement by having a measurement before the
experiment (the pre-test).
O6
 Use additional groups that do not receive the
pretest or experimental treatment. These groups
O6
are in addition to the regular control group.
4. Instrumentation: changes in measurement due to
changes in instrumentation calibration or changes in
the observers.
 Use a control group. Use quality control monitoring
during the study to help detect/control changes in
instrument use/measurement. Include reliability
testing throughout the study, include instrument
calibration and adequate training.
5. Statistical Regression: occurs when groups have
been selected based on extreme scores.
 Use a control group and randomization . Select
groups that are not at the extreme of characteristics.
6. Selection: biases resulting from the differential
selection of subjects.
 Use of randomization procedures and pretesting can
help by determining the presence or knowledge that
exist before the treatment.
7. Experimental Mortality: the differential loss of
subjects from the comparison groups.
 Use pretesting as subjects can be removed from the
entire comparison by removing their pretest.
8. Selection-Maturation Interaction: interaction effects
between the selection and maturation which can be
mistaken for the effects of the experimental variable.
 Use a control group and randomization
Quasi-experimental studies:
External Validity
External Validity asks the question: to what
populations, settings, treatment, and measurement
variables can this effect be generalized?
• Just like internal validity, 4 classes of variables which, if
not controlled, may produce effects that can only be
attributed to the specific sample, setting, and procedures
in the current study. Thus, there is no way to use the
findings with other groups.
1. Interaction effects of Selection and the experimental
variable. Subjects selected from a small group or one
with particular characteristics can’t be generalized to
any larger group.
2. Reactive or Interaction effect of Pretesting- the
pretesting modifies the subjects in such a way that
they respond to the experimental treatment differently
than will un-pretested persons making them
unrepresentative of the population.
3. Reactive effects of experimental procedures arising
from the experimental setting which will not occur in
non-experimental settings.
4. Multiple-Treatment Interference effects due to
multiple treatments applied to the same subjects so
the findings can only be generalized to persons
exposed to the same treatments in the same order of
presentation.