You are on page 1of 6

Journal of Orthopaedic & Sports Physical Therapy

2001;31(12):753-738

A Clinician's Guide to Specification and


Sampling
Kathryn E. Roach, PhD, PT'

This article will describe and discuss the implications of various steps in the process of Inclusion Criteria for the Target
selecting a sample for a research study and should assist clinicians in deciding whether and Population
how to apply specific research findings to clinical care. 1 Orthop Sports Phys Ther 2001;31:
753-758. A target population is the over-
Downloaded from www.jospt.org at on March 21, 2021. For personal use only. No other uses without permission.

all group to which the researcher


Key Words: nonprobability sampling, probability sampling, specification hopes to generalize the findings
of the study. The target popula-
tion is specified by listing the in-
clusion criteria, that is, the charac-
vidence-based practice is possible only if clinicians are will- teristics of patients who are eligi-
Copyright © 2001 Journal of Orthopaedic & Sports Physical Therapy®. All rights reserved.

ing to use findings from research studies to make clinical ble to be included in the study
decisions concerning the individual patients in our care." (Table 1).s.4.7 Because the results
Applying research findings from the group of subjects used of studies should be considered
in a study (the sample) to patients with similar characteris- applicable only to the same types
tics (the target population) in the clinic is a multistep process. Initially, of patients as those studied, clini-
clinicians must decide whether their patients are comparable to the cians seeking to use a research
type of patients described in the study.".Vhe clinician's patient must be study as the basis for a clinical de-
sufficiently similar to the subjects in the research study for the research cision should examine the inclu-
to be relevant to clinical decisions. Second, the clinician must decide sion criteria carefully. For exam-
Journal of Orthopaedic & Sports Physical Therapy®

whether the process used to select study participants produced a sample ple, the findings of a study includ-
of subjects that was representative of the target pop~lation.~," Finally, ing only female subjects over the
the data must be interpreted to decide whether conclusions can be age of 65 may not be particularly
reached about the target population based on information contained in useful in making clinical decisions
the sample.' This final step uses statistical inference, which is based on about men between the ages of 18
the assumption that the study sample is a randomly selected subset of and 25. Similarly, the findings of a
the target population. This assumption is often violated in clinical re- study conducted using subjects
search s t u d i e ~and
, ~ clinicians must therefore decide how closely the with mild Parkinson's disease may
sample used in the study approximates a random sample. not be very helpful to a clinician
treating individuals with advanced
SPECIFICATION Parkinson's disease.

A population is a group of persons, objects, or events that meet a


Exclusion Criteria
specified set of ~riteria.'.'~~,"pecificationis the process by which a re-
searcher defines the population being studied"," in terms of inclusion Having specified those subjects
and exclusion criteria. Typically, 2 types of populations are specified who are eligible to participate in a
when describing a research study, the target population and the accessi- research study (inclusion criteria),
ble population.-'J the researcher must also decide
what subject characteristics would
I Associate professor and associate director for research, University of Miami School of Medicine,
require the subject to be excluded
Department of Orthopaedics and Rehabilitation, 5915 Ponce de Leon Boulevard, 5th Floor, Coral from the study (Table 1).:3.4.7
Some
Gables, FL 33 146-2406, E-mail: keroachbmiami.edu subjects must be excluded in or-
TABLE 1. Specification.
Inclusion Criteria
-

Target Population Accessible Population Exclusion Criteria

Age Time period Factors intetfering with data quality


Gender Geographic location Factors interfering with interpretation
Ethnic group Factors contraindicating intervention
Clinical characteristics Ethical considerations
Disease severity Unwilling to participate

der to preserve the credibility of the study. Unfortu- C l i n i c - l ~ s ~n dc c m i h l ~poj)zclntions Cl in ic-based ac-
nately, researchers must often decide on a compro- cessible populations are defined by the geographic
mise between study feasibility and study generalizabil- location of the clinical facility and the time frame
ity.3.4.7For example, if one of the primary outcome during which subjects are recruited. Compared to
measures for a research study requires that the s u b community-based accessible populations, clinic-based
jects follow complex directions to perform a physical accessible populations have the advantage of contain-
task, subjects who cannot follow such directions be- ing a relatively large proportion of potential subjects
cause of cognitive problems must be eliminated from with the desired clinical characteristic^.^ For this rea-
the study. If a planned exercise intervention might son, it is usually much easier and less expensive to
be dangerous for subjects with brittle diabetes, then select subjects from a clinic-based accessible popula-
such subject5 would need to be dismissed. Sihjects tion. Unfortunately, subjects selected from a clinic-
Downloaded from www.jospt.org at on March 21, 2021. For personal use only. No other uses without permission.

may also be excluded for ethical reasons; for in- based population may differ from the target popula-
stance, pregnant women are often excluded because tion in important and predictable ways.
of possible risk to the unborn child. First, characteristics of the clinic may greatly influ-
Excli~sioncriteria are also important to the re- ence the attributes of the patients treated there. For
searcher in order to ensrlre that the findings of the example, patients treated in a tertiary care medical
Copyright © 2001 Journal of Orthopaedic & Sports Physical Therapy®. All rights reserved.

study are valid. Subjects with characteristics that center have often been examined and referred by
would interfere with interpreting the study findings physicians practicing in smaller community hospitals.
must be excluded. Excli~sioncriteria are also impor- Therefore, patients referred to tertiary care centers
tant to a clinician attempting to utilize the findings may tend to have more severe or complicated disease
of a research article to inform clinical practice. If the of longer duration. A sample drawn from such a cen-
design of the study required the researcher to elimi- ter w o d d produce a distorted picture of the features
nate subjects who have characteristics similar to those and prognosis of the disease being studied.
under the clinician's care, the value of the study's A second problem with clinic-based samples is that
findings may be s~tbstantiallyreduced. For example, not all individuals with problems such as low back
Journal of Orthopaedic & Sports Physical Therapy®

a therapist working with patients with cognitive p r o h pain seek medical attention. Subjects selected from a
lems might find it difficult to utilize the findings of a clinic population may differ from sihjects selected
study in which subjects with cognitive problems were from a community sample on those psychosocial,
exchtded. Again, it is u p to the clinician to decide to economic, and disease severity factors that are relat-
what extent the exclusion criteria have diminished ed to seeking and receiving medical attention for
the value of the study for informing clinical practice. their condition. This type of problem is lessened for
conditions, such as hip fracture, for which inpatient
Inclusion Criteria for the Accessible Population medical care is invariably provided.
C o m m t ~ n i t ? - / ~nccpssilh
d poj,~tlntion The alterna-
Although it would be ideal to draw a sample di- tive, commimity-based accessible populations are
rectly from the entire target population, in most composed of individuals in their own homes and de-
cases this is impossible to do. Pragmatically, research fined by a geographic region and a time frame.4
must be performed on subjects in some specific loca- Samples randomly drawn from community-based ac-
tion and during a designated period of time. The ac- cessible populations are unaffected hy factors that
cessible population is the portion of the target popu- determine where and when individuals seek health
lation that is available to a particular researcher for care for a particular problem. Community-based
study..'J The accessible population is specified by stat- (also called population-based) samples are represen-
ing inclusion criteria dealing with geographic loca- tative of a geographic region. Because this type of
tion and time frame:'.' It is from this accessible p o p sample is representative of a geographic region, com-
ulation that the sample of si~hjectsis actually drawn. munity-based samples are much more accurate than
There are 2 primary types of accessible populations clinic-based samples in determining the need for
used in clinical research, clinic-based and communi- clinical services in a defined community.
ty-based..' There are, however, a number of problems associ-

J Orrhop Sports Phys Thrr.\'olu~ne 31 .Nunihc.r 12.Drcr1nher 2001


ated with community-based samples. Because there TABLE 2. Sampling strategies.
are political, economic, and cultural differences Probability sampling Nonprobability sampling
among various regions of the country, findings from Simple random sampling Convenience sampling
one region may not necessarily be generalizable to Systematic sampling Purposive sampling
another. Another difficulty with using community- Stratified random sampling Snowball sampling
based accessible populations is the time and cost re- Disproportional sampling Consecutive sampling
quired to generate a sufficiently large number of in- Cluster (multistage) sampling
dividuals with a particular disease. The size of the
sample required to produce the desired number of
subjects with a particular disease depends on the subjects are chosen on the basis of something other
prevalence of the disease in the population. A prob- than random election.^,^
lem, such as low back pain, that has a high frequen-
cy of occurrence in the general population is more Probability Sampling
practical to study using a community-based sample
than is a relatively uncommon disease, such as multi- Although error is always possible when sampling
ple myeloma. T h e cost of using a community-based by chance, a randomly drawn sample is considered
sample is decreased if the required data can be col- unbiased in that it has a good chance of reflecting
lected by mail or telephone. Because the time and the characteristics of the accessible population from
money required to collect data by mail o r phone is which it was The size of the sample is
much lower than that required to collect data in per- more important in reducing the possibility of ran-
son, it is more economically feasible to draw a large dom sampling error than is the proportion of the
Downloaded from www.jospt.org at on March 21, 2021. For personal use only. No other uses without permission.

sample when this type of data collection is employed. population represented by the sample." All of statisti-
In interpreting and applying the findings of a re- cal inference, both estimation and hypothesis testing,
search study, the clinician must judge how well the is based on the assumption that the sample being ex-
accessible population represents the target popula- amined was formed through some type of random
tion. For example, a research study with a target process.' There are many strategies for producing a
Copyright © 2001 Journal of Orthopaedic & Sports Physical Therapy®. All rights reserved.

population of individuals with occupational low back random sample. However, all of these strategies re-
pain might have used an accessible population of all quire the availability of a list of all the members of
workers seen in an occupational health clinic at a the accessible population, which is called a sampling
steel mill in Michigan during 1970-1975. A clinician frame." Compiling a valid sampling frame may often
treating occupational low back pain in migrant work- be the most difficult and timeconsuming aspect of
ers in southern California in 2001 may decide that random sampling." Consequently, researchers often
the findings from this study are relevant to his prac- use existing sanlpling frames because they are readily
tice to the extent that the study dealt with issues that accessible, even if they are less valid. For example, a
are unaffected by time period (1970s vs 200 1 ) and researcher who wanted to investigate the attitudes
Journal of Orthopaedic & Sports Physical Therapy®

geography (Michigan vs Southern California). How- and beliefs about evidence-based practice held by
ever, it is possible that some of the study findings physical therapists in the United States could use the
would not be relevant because there are too many readily available list of members of the American
clinically important differences between the 2 time Physical Therilpy Association (APTA). In doing so,
periods and the 2 geographic locations. however, the researcher would be making an assump
tion that the members of the APTA were sufficiently
representative of all licensed physical therapists that
SAMPLING STRATEGIES results, based on the sample of APTA members,
could be used to draw inferences concerning all li-
Once the target and accessible populations are de- censed physical therapist^. It is up to the clinician to
fined by specifying the inclusion and exclusion crite- decide whether such assumptions are warranted.
ria, the researcher must decide how to select a subset Simf)lP random snmf)ling The most basic type of
of individuals from the accessible population for in- probability sampling is simple random sampling. In a
clusion in the study. There are 2 broad categories of simple random sample, all subjects have the same
sampling techniques, probability sampling and non- chance of participating in the st~dy.'.~.".~ This a p
probability sampling (Table 2).'.".' proach requires a random process, such as drawing
In probability sampling every member of the acces- slips of paper or using a random number table, to
sible population has a specific chance, or probability, draw a sample of a particular size from a valid sam-
of being included in the sample..'.".' Probability sam- pling For example, if a researcher wanted
ples are created through a process of random selec- to investigate the attitudes and beliefs held by physi-
tion and, for this reason, are also called random sam- cal therapists in the United States about evidence-
p l e ~ . ~ .The
" . ~ other method used to draw samples is based practice, the researcher could obtain a list of
nonprobability sampling. In this type of sampling, all licensed physical therapists in the United States by

.
J Ortliop Sports Phys Thcr *\'o111mc.31 N~tnikr12 llcce~nher2001
contacting the licensing body in each state. The re- those who live in more rural states. However, she
searcher would then need to eliminate duplicate en- might be concerned that a simple random sample
tries for individuals licensed in more than 1 state so would contain too few subjects from rural states be-
that all therapists were listed only once, ensuring an cause those states contribute a relatively smaller num-
equal probability of selection. The final sampling ber of therapists to the total number of licensed
frame would consist of a numbered list of all li- physical therapists in the United States. In order to
censed therapists in the United States. A random ensure that the sample contained an adequate num-
number table could then be used to generate a list ber of physical therapists from rural states, the re-
of numbers of the subjects selected to participate. A searcher could employ a technique known as dispro-
list of the therapists linked to the numbers selected portional sampling. In disproportional sampling, the
would be compiled. The resulting list of therapists sampling frame is divided into subgroups based on
would represent the sample for the study. the characteristic of intere~t.~."..'
In this example, the
Sjstmatir sam/)ling Systematic sampling can also researcher would have to decide which states were
be used to draw a random sample from a sampling urban and which were rural and group them accord-
frame. A systematic sample is formed by first dividing ingly. The researcher then would draw a sample of
the total number of subjects in the sampling frame equal size from each group. Because one subgroup
by the number of subjects to be selected in the sam- (rural) is much smaller than the other (urban), this
ple. This number represents the interval between se- sample will not reflect the true population propor-
lected subjects. The researcher then picks a random tion of the therapists in these subgroups. Therefore,
starting point and selects periodically consecutive if a sample is formed in this manner, the attitudes
subjects based on the predetermined interval.".".' and beliefs of the rural group will be overrepresent-
Downloaded from www.jospt.org at on March 21, 2021. For personal use only. No other uses without permission.

Stratifi~drandom and dis~of)ortional sam/)ling ed in the sample when it is examined as a whole.


Sometimes a researcher thinks it is important for cer- The effect of disproportional sampling can be con-
tain subject characteristics to be represented in the trolled by weighting the data so that the contribution
sample in the same proportion as they are in the ac- of members of various subgroups reflects their pro-
cessible population. For example, the researcher portion in the sampling frame (accessible popula-
Copyright © 2001 Journal of Orthopaedic & Sports Physical Therapy®. All rights reserved.

might want to ensure that the sample reflects the tion). For example, if the mean age of therapists in
geographic distribution of physical therapists in the the rural subgroup were much younger than the
United States. If 10% of physical therapists in the mean age of therapists in the urban group, an at-
United States reside in California, then 10% of the tempt to estimate the average age of physical thera-
physical therapists in the sample should reside in pists licensed in the United States using the type of
California. Proportionate representation can be ac- disproportional sample described would produce an
complished using stratified random In estimate that was younger than it should be because
the case of stratified random sampling, the sampling rural therapists contributed more to the sample aver-
frame is divided into strata, or groups, based on age than to the population average. This problem
Journal of Orthopaedic & Sports Physical Therapy®

some characteristic. In our example, the characteris- can be corrected by using the appropriate propor-
tic of interest would be state of residence. In using tional weights. The weights are calculated by deter-
this technique, the researcher would first determine mining the probability that any 1 member of a sub-
the percenmge of physical therapists residing in each group would be selected if simple random sampling
state. Given the percentage for each state and the were used. The weight assigned to a subject in a par-
overall sample size, the researcher would then calcu- ticular subgroup is the inverse of the probability that
late the number of therapists that should be selected a member of that subgroup would be selected using
from each state. The researcher would then use ei- simple random sampling. When these weights are
ther simple random sampling o r systematic sampling used, the sample means are unbiased estimates of
to select the correct number of subjects from each the population means.
state. The final sample would be a random sample Clustm sampling or multistag~sampling Some-
that was guaranteed to have the same proportion of times, it is simply impossible to construct a sampling
subjects from each state as the sampling frame (ac- frame at the individual subject level. For example, it
cessible population). would be very difficult for a researcher to investigate
A similar approach can be used when the research- the attitudes and beliefs about evidence-based prac-
e r is concerned that subjects with certain characteris- tice held by physical therapists in the United States
tics will not appear in the sample in sufficient num- practicing in the acute care setting because there is
ber to allow for adequate comparisons. If subgroups n o available sampling frame. However, it is still possi-
within the population are considerably unequal in ble to select a random sample of these therapists us-
size, random sampling may produce too few subjects ing cluster sampling, o r multistage ampl ling.^,",.' This
within certain subgroups. For example, a researcher form of sampling depends on linking members of
might want to compare the attitudes and beliefs of the target population to some established groupings
physical therapists living in more urban states to that can be sampled. For example, it is possible to

756 .
J Orthop Sports Phvs Ther .\hlume 31 Numher 12. December 2001
compile a list of all the counties in the United States dom assignment to treatment or control condition is
and then use a random process to select a specific a much more important determinant of the validity
number of counties. Once the counties were select- of a clinical trial than is random selection of s u b
ed, a list of the acute care hospitals in each county jects.".'
could be generated using public information. The Purjlosiw samjding Purposive, or judgmental,
researcher could then compile a list of acute care sampling represents another type of nonprobability
hospitals across all the sampled counties and select a sampling. This hQe of sampling involves purposely
random sample of hospitals from this composite list. selecting those members of the accessible population
Then using the random sample of hospitals, the re- judged to be most appropriate for the study, even
searcher could contact the director of rehabilitation though the sample selected may not be representa-
at each hospital to obtain a list of all physical thera- tive of either the accessible or target population^.^.'
pists practicing in acute care. Assuming the therapists For example, subjects may be selected because they
working at the hospitals agreed to have their names are known to be very tolerant, compliant, o r cooper-
released, a list of all physical therapists practicing in ative. Unfortunately, findings that an intervention is
acute care at the sampled hospitals could be com- effective or well-tolerated by this type of subject may
piled and a random sample of therapists could be se- not be very useful in deciding whether to use the in-
lected from the list. Therapists selected would consti- tervention with a more usual group of patients.
tute a random sample of physical therapists practic- Snowball samjding Snowball sampling is another
ing in acute care settings in the United States. form of nonprobability sampling. Subjects recruited
during the early phases of the study are asked to
Nonprobability Sampling help identify other individuals who might meet the
Downloaded from www.jospt.org at on March 21, 2021. For personal use only. No other uses without permission.

criteria for admission to the study.' Because this type


C o n v m i m c ~samj~ling A convenience, or acciden- of sampling depends on social contacts, it tends to
tal sample, is formed by taking those members of the produce a group of subjects who are fairly similar to
accessible population who are easily available.".' For one another and, therefore, less representative of the
example, consider an accessible population consist- entire accessible population.
Copyright © 2001 Journal of Orthopaedic & Sports Physical Therapy®. All rights reserved.

ing of patients attending a university-based osteoar- Cons~cutiv~ sampling A consecutive sample in-
thritis clinic Monday and Wednesday mornings from volves enrolling every subject who meets the selec-
7 :00 to 11:0O AM and Friday afternoons from 1:OO to tion criteria during a specified time Use of
5:OO PM. A researcher who has time available on Fri- consecutive sampling is essentially the same as enrol-
day afternoons for recruiting subjects may enroll ling the entire accessible population. Such a sample
only subjects who attend the clinic on Friday after- should be highly representative of the accessible p o p
noons. The subjects he recruits would comprise a ulation, unless there are periodic fluctuations in the
convenience sample. A problem with convenience type of patient seen at the clinical site and the time
samples is that they are biased relative to the very frame for recruitment is too short to accommodate
Journal of Orthopaedic & Sports Physical Therapy®

factors that made the subjects convenient. Subjects these fluctuations. If a clinical research study utilizes
who schedule clinic visits on Friday afternoon might consecutive sampling, then the clinician only needs
differ on factors such as age, employment status, dis- to decide how well the accessible population repre-
ease severity, and even religion from subjects who sents the target population in order to judge the a p
schedule early Monday o r Wednesday morning visits. plicability of the research findings.
A sample drawn in this manner would not necessarily
represent all of the patients seen by this clinic. SAMPLING BIAS
Volunteers represent another kind of convenience
sample. Studies that recruit subjects bv advertising A probability sample is considered unbiased in
for volunteers may form samples that differ substan- that it has a good chance of reflecting the charac-
tially from the accessible population from which teristics of the accessible population from which it
these volunteers are drawn. Volunteers may tend to was drawn.'.-'.".' In contrast, nonprobability samples
be both mentally and physically healthier than non- are frequently subject to sampling bias. Sampling
volunteers and may also tend to have fewer work and bias occurs when the individuals selected for a sam-
care giving responsibilities." The nature of the bias ple either over- o r underrepresent population attri-
introduced by using volunteers in a study largely de- butes that are related to the phenomenon of inter-
pends on the research question. It is important to e~t.~.".'For example, if purposive sampling is used to
note that the subjects enrolled in clinical trials are al- select subjects who will strictly adhere to a home ex-
ways voli~nteers,~ and there may be many important ercise program and if strict adherence to the pro-
differences between individuals who will agree to gram is critical to produce the desired change in
participate in a clinical trial and those who will not. functional mobility, then the sample will be biased
Although the use of volunteers in a clinical trial may in a way that will affect the outcome of the study. If,
sometimes limit generalization of the findings, ran- in fact, the typical patient does not follow the home

J Orthop Sports Phvs Ther .\'cdume 31 .Number 12. December 2001


exercise program as closely as the research subjects mine if the researchers adhered strictly to their own
did, then the typical patients may achieve less satis- inclusion and exclusion criteria. It is also important
factory results than did the study participants be- to determine if a large proportion of the subjects
cause the subjects used in the study d o not well r e p dropped out o r failed to respond, leaving a biased
resent the type patient for whom the program may sample.
be prescribed. If it appears that the sample used in the study is
Even probability samples can have problems with acceptably close to the planned sample, the clinician
sampling bias if too many subjects withdraw from the must decide whether the sample represents the p o p
sample. Sampling bias also occurs when there is a ulation of interest fairly. It is important to determine
high nonresponse o r drop out rate in a study.".".' Al- if the researchers used some form of probability sam-
though the researchers may have used random sam- pling and if they did not, what biases were intro-
pling to draw the initial sample, if more than a p duced? It is also important to determine whether
proximately 25% of the sample drops out o r fails to there were differences between the accessible popu-
respond to a phone o r mail questionnaire, the re- lation and the target population that might be rele-
maining portion of the sample may be biased. Fre- vant to the individual patient?
quently, subjects who drop out o r fail to respond dif- If the clinician decides that the findings of the
fer in important ways from subjects who d o not. Re- study may be appropriately generalized to the tar-
moving subjects from the sample who have character- get population and if the clinician's patient is a
istics associated with not responding o r dropping out member of that target population, then the clini-
causes those characteristics to be underrepresented cian can use the findings of the research study to
in the remaining sample. The sample is, therefore, assist in making clinical decisions concerning this
Downloaded from www.jospt.org at on March 21, 2021. For personal use only. No other uses without permission.

n o longer representative of the accessible popula- individual patient.


tion. For example, if a researcher was studying natu-
ral history of occupational low back pain by follow-
REFERENCES
ing a cohort of workers for 5 years, a certain propor-
1. Daniel WW. Biostatistics: A Foundation for Analysis in The
tion of the workers would probably be lost to follow- Health Sciences. New York, NY: JohnWiley & Sons; 1999.
Copyright © 2001 Journal of Orthopaedic & Sports Physical Therapy®. All rights reserved.

up before the stiidy was completed. If a large 2. Fletcher RH, Fletcher SW, Wagner EH. Clinical Epidemi-
proportion of the subjects lost to follow-up disap ology: The Essentials. Baltimore, Md: Williams & Wilkins;
peared because they stopped working due to back 1996.
pain, the findings of the study would be severely bi- 3. Friedman LM, Furberg CD, DeMets DL. Fundamentals of
Clinical Trials. 2nd ed. St. Louis, Mo: Mosby Year Book;
ased. 1985.
4. Hulley SB, Cummings SR. Designing Clinical Research.
Baltimore, Md: Williams & Wilkins; 1988.
SUMMARY 5. Kelsey JL, Thompson WD, Evans AS. Methods of sampling
and estimation of sample size. In: Methods in Observa-
How does a clinician decide whether to use the tional Epidemiology. New York, NY: Oxford University
Journal of Orthopaedic & Sports Physical Therapy®

findings of a research study to assist in clinical deci- Press; 1986: 254-284.


sion making for an individual patient? It is necessary 6. Levy PS, Lemeshow S. Sampling for Health Professionals.
Belmont, Calif: Lifetime Learning Publications; 1980.
to determine if the patient seeking care is a member 7. Portney LG, Watkins MP. Sampling. In: Foundations of
of the target population for the study. This requires Clinical Research: Application to Practice. Upper Saddle
examining whether the patient meets the inclusion River, NJ: Prentice Hall Health; 2000.
and exclusion criteria specified by the researchers. If 8. Sackett DL, Haynes RB, Guyatt GH, Tugwell P. Clinical Ep-
the patient is a member of the target population, idemiology: A Basic Science for Clinical Medicine. Boston,
Md: Little Brown; 1991.
then the clinician must decide if it is appropriate to 9. Sackett DL, Richardson WS, Rosenberg W, Haynes RB. Ev-
draw conclusions about the target population based idence-based Medicine: How to Practice & Teach EBM.
on the findings of the study. It is important to deter- New York, NY: Churchill Livingstone; 1997.

.
J Orthop Sports Phvs Thcr-\'olume 31 Numhcr 12. December 2001

You might also like