You are on page 1of 36

Standards for Tests and Measurements in Physical

Therapy Practice
Jules M Rothstein, Suzann K Campbell, John L
Echternach, Alan M Jette, Harry G Knecht, Steven J
Rose and on behalf of the Task Force on Standards for
Measurement in Physical Therapy
PHYS THER. 1991; 71:589-622.

The online version of this article, along with updated information and services, can be
found online at: http://ptjournal.apta.org/content/71/8/589

Collections This article, along with others on similar topics, appears


in the following collection(s):
Policies, Positions, and Standards
Professional Issues
Tests and Measurements
e-Letters To submit an e-Letter on this article, click here or click on
"Submit a response" in the right-hand menu under
"Responses" in the online version of this article.
E-mail alerts Sign up here to receive free e-mail alerts

Downloaded from http://ptjournal.apta.org/ by guest on July 1, 2014


Standards for Tests and Measurements in
Physical Therapy Practice

[Task Force on Standardsfor Measurement in Physical Ther-


apy. Standards for tests and measurements in physical therapy
practice. Phys Ther. 1991;71:5@-622..]

Task Force Members Table of Contents

Members of the American Physical Therapy Association's


Task Force on Standards for Measurement in Physical
Therapy: Preface. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . ,590
..

Jules M Rothstein, PhD, PT, is Professor and Head, Depart- Dedication. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .,591
.
ment of Physical Therapy (M/C 898), University of Illinois at
Chicago, and Chief of Physical Therapy Services, University Introduction. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . ,592
..
of Illinois Hospital, 1919 W Taylor St, Chicago, IL 60612
Glossary of Terms Used in the Standards . . . . . . . . . . .,595
(USA).

Suzann K Campbell, PhD, PT,FAF'TA, is Professor, Depan- Standards for Primary Test Purveyors. . . . . . . . . . . . . . . ..598
ment of Physical Therapy, University of Illinois at Chicago.
Standards for Secondary Test Purveyors . . . . . . . . . . . . .,604
John L Ekhternach, EdD, PT, is Chairman, School of Commu-
nity Health Professions and Physical Therapy, Old Dominion Standards for Tertiary Test Purveyors. ............... ,609
University, Norfolk, VA 23539-0288.
Standards for Test Users . . . . . . . . . . . . . . . . . . . . . . . . . . . . .613
.
Alan M Jlette,PhD, PT, is Senior Research Scientist, New En-
gland Research Institute Inc, 9 Galen St, Watertown, MA Standards for Ensuring Integrity in
02172. Measurement Research. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . ,620
.

Harry G Knecht, EdD, PT, is Director of Research, Ortho- Index . . . . . . . . . . . . . . . . . . . . . ..


... . . . . . . . . . . . . . . . . . . . . ..622
sport Inc, 7736 W Madison St, Forest Park, IL 60130, and As-
sociate Professor (Emeritus), Department of Physical Ther-
apy, Uni.versity of Illinois at Chicago.

Steven J Rose, PhD, PT, FAF'TA, was Associate Director for


Research, Division of Physical Therapy, University of Miami A primer o n measurement, produced to complement the
School of Medicine, 5915 Ponce de Leon Blvd, Coral Gables, Standards for Tests and Measurements in Physical Ther-
FL 33146, at the time the Task Force on Standards for Mea- apy Practice, will be published by the American Physical
surement in Physical Therapy convened. Dr Rose died on Therapy Association in late 1991.
April 4, 1989.

Physical. Therapy/Volume 71, Number 8/August 1991


Downloaded from http://ptjournal.apta.org/ by guest on July 1, 2014
The Standards for Tests and Measurements in Physical tion of purpose. These traits are needed at a time when
Therapy Practice is a cohesive and well-organized docu- many might forsake the quality inherent in consistency of
ment, complete with operational definitions and primer. measurement for the speed and sloppiness so often en-
During a first reading, one might readily conclude that sconced in uncontrolled profit rampages. What are our
the entire work is an academic treatise, esoteric in nature options? One can choose to ignore the Standards for
and dedicated to a select handful of clinicians with the Tests and Measurements i n Physical Therapy Practice, not
intellectual capacity and interest to glean meaning from out of disrespect or even ignorance, but out of indiffer-
its organization. These Standards, however, represent far ence. The consequences are patently clear. Our failure to
more than can be processed by a cursory glance or a pre- implement these Standards could diminish the singularity
occupied mind. of our identity-not only among ourselves and our medi-
cal colleagues, but also, more relevantly, among those
As defined by the Board of Directors of the American who must render decisions about our services and liveli-
Physical Therapy Association (November 1984), a stan- hood. On the other hand, a conscientious effort to com-
dard is an approved, binding, general statement of re- prehend, digest, and implement our adopted Standards is
quirement used to judge quality of action or activity. As a true precursor in our quest to stand alone as a unique
such, standards are accessible to the lay and health pro- and esoteric profession. So seek wisdom and guidance
fessional public for their scrutiny and criticism. To mature from these Standards, recognizing that their intent is nei-
from concept to finality, therefore, implies a honing pro- ther total compliance nor comprehension at a first read-
cess of utmost delicateness and comprehension, for to ing, but absorption and integration into practice upon
expose our standards of measurements and tests to those multiple readings. In the final analysis, those medical
who may judge us is to reveal an identity perhaps un- services that will stand the test of time will be character-
known to or misunderstood by such parties. At a time in ized by comprehensible quantification performed with
which physical therapists seek greater autonomy in clini- uncompromising quality.
cal decision making, standards indeed d o become the
palettes from which our destiny is stroked. Steven L W o g PhD, P7; FAPTA
Chairman, Advisoly Council o n Research to
With this perspective in mind, a task force of the Commit- the Board of Directors, APTA
tee on Research was created in 1987 to develop standards
for tests and measures used commonly in physical ther-
apy practice. This task force, coordinated by Jules
Rothstein, included Suzann Campbell, John Echternach,
Alan Jette, Harry Knecht, and the late Steven Rose. The The need for and value of standards for tests and mea-
group sought to produce standards that addressed logical surements is clear-physical therapists must have a more
requirements for measurement, reproduction of test re- scientific basis for practice. We test and measure in our
sults, and interpretation and use of such results. All mate- daily practice, yet the validity and reliability of some of
rials were reviewed by representatives of Sections and these tests may be questioned. With this document, we
Specialty Councils; physical therapists primarily in educa- have guidelines to determine the quality of our tests and
tion, research, or practice environments; and external ex- measurements.
perts. Collectively, these professionals recognized that we
are at risk in any working environment unless our tests Measurements are fundamental to the practice of physical
and measurements are creditable and specifically identifi- therapy. We need to sit back and look at what we d o each
able with our clinical activities. Standards were needed to day, and strive for the quality we are capable of provid-
improve the quality of our practice, lend a unifying per- ing. Meaningful and useful measurements are important if
spective to the instruction of measurements to our stu- we, as physical therapists, are to be recognized as credi-
dents, and enhance the rigor of our research activities. ble health care providers.
The standards necessary to meet these requirements had
to be unique to physical therapy and easily associated Achieving a high quality of physical therapy practice re-
with our professional skills by practitioners, faculty, and quires us to evaluate the client, selecting and administer-
students; medical groups who have vested interests in the ing a variety of tests and measurements. We take our find-
quality of physical rehabilitation services; and third-party ings, interpret the data, and establish a baseline for the
payers who assess the rigor of our interventions and the client's status. We then develop plans for therapeutic in-
meaning of our quantitative values. tervention that will achieve the goals we have set for the
client. But how objective and accurate are these findings?
After 4 years and untold hours of labor, these Standards How reliable? How valid? Can we select the appropriate
are a reality. They promote consistency and imply unifica- interventions if our assessments are in question?

Physical TherapyNolume 71, Number 8/August 1991


Downloaded from http://ptjournal.apta.org/ by guest on July 1, 2014
Standards provide the foundation for assessment of the
quality of our practice. We use a variety of quality assur-
Dedk8tlon
ance methodologies to determine the degree to which
the standards are met, and we take actions to improve the
The members of the American Physical Therapy As-
care when standards are not met. Quality assurance is the
sociation's Task Force on Measurement dedicate this
responsibility of every physical therapist, as well as the
document to Dr Steven J Rose, who died before the
responsibility of the profession as a whole. Quality assur-
document was completed. Dr Rose was a visionary
ance co~~tinues to be an evolving process. The tools may
within physical therapy. He saw the need for stan-
change, but the objective remains the same: to improve
dards for tests and measurements and welcomed
patient care.
the creation of a task force. He gladly accepted a
position on the task force, despite the fact that he
The physical therapy evaluation is the foundation for the
was ill. During the early phases of writing this docu-
measurement of the outcome of our therapeutic interven-
ment, he displayed remarkable courage, overcoming
tion. And we must measure these outcomes. In the past,
pain and disability to attend meetings. He was a vig-
quality assurance activities have focused more on the
orous participant in discussions. We note with pride
structun: and process of our services. With the spiraling
his remarks that his excitement about this project
cost of health care in the United States, we must demon-
led him to work longer and harder than he thought
strate the effectiveness and efficiency of our treatment.
he could and that, in the midst of task force busi-
Quality assurance studies with an outcome focus can pro-
ness, he even forgot about his pain and fatigue. Dr
vide a measure of our progress toward achieving that
Rose's brilliant mind, his penchant for playing the
goal. devil's advocate, and his commitment to excellence
were missed in the latter stages of this project. His
We have our Standards of Practice adopted by the House spirit, however, remains in his many contributions
of Delegates of the American Physical Therapy Associa-
to the Standards and accompanying documents and
tion, and these standards assist us in our quality assurance
in the way these documents attempt to combine
mechanisms. Now, we have the Standardsfor Tests and
science and practice, Dr Rose's two great loves.
Measuremats in Physical Therapy Practice to assist us in
ensuring the quality of our physical therapy evaluation.
Clinicians must take these criteria and try to incorporate
them into their daily practice.

The Task Force on Standards for Measurement in Physical


Therapy has completed a complex task in advancing our
knowledge and has provided a cornerstone of objective,
reliable, and standardized tests and measurements. The
Task Force members are to be commended for their hard
work.

Elizabeth Gaynor, MS, PT


Chairperson, Committee on Physical Therapy Practice

Physical TherapyNolume 71, Number 8/August 1991


Downloaded from http://ptjournal.apta.org/ by guest on July 1, 2014
This is an age when documentation, efficacy, and cost-
effectiveness are increasingly important to those who con-
Examination of physical therapy practice demonstrates the trol the reimbursement for all of health care, including
growing importance of measurement. Walking through a physical therapy. Measurement will play an increasing
physical therapy clinic, you may observe a patient's range role in determining who gets paid for doing what to
of motion being measured, or you may see a therapist whom, and for how long. Documentation with measure-
testing the inspiratory capacity of a patient. Other thera- ments of high quality may be the only way we physical
pists may be measuring the developmental status of a therapists can ensure that our services will be available to
child or the accessory motion of the knee joint in a post- persons who need these services. Physical therapy as a
surgical patient. Still other therapists may be measuring form of health care is at risk unless the results of physical
the functional status of a patient with hemiplegia. Physical therapy are judged to be worthwhile, not only by physical
therapists need to obtain measurements because they therapists and consumers of physical therapy, but also by
make decisions, offer consultative opinions, and docu- third-party payers and corporate-world purchasers of
ment changes in patient status. health care. Some or much of what is being done in
physical therapy could be denied reimbursement if we do
This document, Standardsfor Tests and Measurements in not satisfactorily document the efficacy and cost-
Physical Therapy Practice, has been prepared because of effectiveness of treatment. Without such reimbursement,
the growing importance of measurement in physical ther- physical therapy services could be denied to the very peo-
apy. Measurements are taken to provide information, but ple who need our services the most. Proper attention to
the result may be misinformation if the quality of mea- the quality of measurement in clinical practice will, there-
surements is not ensured. The purpose of this document fore, not only ensure our profession's continued growth
is to provide standards that will help ensure the quality of but also protect our patients.
measurements. These Standards are tools for practition-
ers. They are designed to provide guidelines that practi- Growth in the profession of physical therapy has taken
tioners can use when they take measurements. The Stan- place even though our profession has had no accepted
dards are meant to represent the best in measurement standards for measurement and despite the fact that few
and are not intended to hinder practice by establishing education programs have prepared new therapists to un-
rigid rules that interfere with patient care. The Standards derstand what constitutes good measurement. Continued
also demonstrate to society the commitment of physical growth cannot be ensured unless the state of our mea-
therapists to practice in a credible and scientific manner. surements changes-and unless it changes soon. In March
The Standards reflect our profession's humanistic commit- of 1986, the Board of Directors of the American Physical
ment to provide the highest quality of care to our pa- Therapy Association (APTA) recognized the need to im-
tients. The Standards include a section on research. The prove the state of measurement in physical therapy. The
Standards, however, are primarily related to practice. Board made improved measurement a major goal of the
They set how measurements should be used in clinical Association.
practice. Through the use of the Standards, therapists can,
in their practice settings, deliver more effective care and Because resources in clinical measurement were limited,
document the results of treatment. the Board called upon the Research Committee to de-
velop a proposal for the development of Standards for
As clinicians, we cannot practice unless we take measure- Measurement in Physical Therapy. In August of 1987, the
ments. We need measurements in order to classify and Research Committee, after consulting with experts on
describe patients, plan treatments, predict outcomes, doc- clinical measurement, developed a proposal for the devel-
ument the results of treatments, determine the effective- opment of Standards for Measurement in Physical Ther-
ness of treatments, and determine when to refer patients apy. In November of 1987, the Board funded the proposal
to other practitioners. We may wonder how much more and made a commitment to a 2-year effort that would cul-
effectively we might practice if we knew more about our minate in the publication of these Standards. The Task
measurements, for example, if we knew when we should Force on Standards for Measurement in Physical Therapy
rely on our measurements and when we should seek was appointed to carry out this mission.
confirming information. In addition to needing measure-
ments for decision making, we need measurements in Physical therapy is not the first profession to recognize
order to document what we are doing. In the face of the need to improve the quality of its measurements. The
shrinking resources for health care, society is no longer American Psychological Association (APA) has been pub-
willing to accept on good faith alone the benefit of what lishing monographs on standards in testing since 1954.
we physical therapists do for our patients. Even widely The American Educational Research Association and the
accepted treatments may, in the future, become suspect if National Council on Measurement in Education joined
the measurements that justlfy these treatments are shown forces with the APA in the mid-1960s and formed a joint
to be questionable. committee that wrote Standards for Educational and Psy-
chological Tests and Manuals. A 1966 version of the Stan-

Physical Therapyffolume 71, Number 8/August 1991


Downloaded from http://ptjournal.apta.org/ by guest on July 1, 2014
dards has been revised twice, with the most recent edi- selves. The primer is an independent, but complemen-
tion published in 1985. tary, document for the Standards.

One of the first acts of the Task Force members was to The Standards include a glossary. The glossary defines
examine the APA manual. The APA Standards are a pri- terms as they are used in the Standards. The glossary al-
mary source of information on measurement. The mem- lows readers to see how these terms were used by the
bers of the Task Force agreed, however, that while the authors of the Standards. The Task Force made every ef-
APA document contained a great deal of useful informa- fort to avoid creating new terms and to avoid using jar-
tion, it was not directly applicable to physical therapy. gon. The glossary is meant solely as a source for materials
Many of the measurement problems in physical therapy in the Standards; it is not a general measurement glossary.
are unique. Physical therapists use measurements that are Wherever possible, the terms used and defined are those
based on the behavioral, biological, and physical sciences. commonly found in the measurement literature. Clini-
The scope of measurements in physical therapy is extraor- cians may find many of the terms unfamiliar at first, but
dinary. Questionnaires are used by therapists, as are man- the Task Force believes that, through use of the glossary
ual muscle testing, developmental testing, postural evalua- and the primer, the Standards can be understood and
tions, instrumented muscle testing, movement analysis, used by all therapists. The Task Force also recognizes that
and a whole variety of other tests. Instruments vary from many physical therapists will have to make a commitment
paper and pencil, to the therapist's hands, to complex of time and effort to learn these new terms and to learn
computer-based machines with elaborate peripheral de- about measurement. In the future, these terms will be
vices. We concluded that clinicians needed standards writ- more commonplace in the clinical literature of physical
ten by physical therapists for physical therapy practition- therapy.
ers. The Task Force, therefore, set out to develop
Standards specifically for physical therapy. In developing The Standards are meant to foster the continued growth
these Standards, the Task Force was aware that most phys- of high-quality care in physical therapy. They are highly
ical therapists receive little or no training in the science specific in describing what should be done to ensure
of measurement. The Task Force agreed that the final meaningful and useful measurements. Part of the Stan-
document must be sufficiently comprehensive to cover dards provides long-overdue guidance to persons devel-
the vast expanse of physical therapy measurements and oping tests and to persons teaching about testing. No
that it nnust also be practical. longer will clinicians independently have to ask purveyors
of tests to supply vital information. The Standards specify
The process of developing standards began with the en- what the providers should provide.
tire Task Force considering philosophical and practical
issues cluring 2 days of often heated, and always thor- The Standards consist of five sections. The first three
ough, discussion. After the Task Force worked out basic sections specify what is expected of test purveyors.
concepts, the writing of the Standards was delegated to a Three categories of purveyors are described: primary
three-rnember Working Group (Jules M Rothstein, Task purveyors, who originate tests; secondary purveyors,
Force coordinator; John L Echternach; and Harry G who conduct research and advocate the use of tests;
Knecht;,. The Working Group developed a draft document and tertiary purveyors, who are teachers. The fourth
that was initially reviewed by the rest of the Task Force. section contains the Standards for Test Users-physical
The draft was revised. The present version has been re- therapists. The fifth section describes standards for en-
vised on feedback from the physical therapy community, suring integrity in measurement studies. This last sec-
as well as on feedback from other interested parties and tion is adapted from the APTA's Standards for Integrity
from experts on measurement. in Physical Therapy Research.

In the training of physical therapists, measurement has all The Task Force originally had hoped to generate a series
too often been equated with research. Concerns about of guidelines that would be few in number and "user
the quality of measurements are, at times mistakenly, friendly." Early versions of the Standards proved that this
thought to relate to research and not to practice. Because was impossible. Attempts to generate fewer sections and a
therapists need help with the basic science of measure- more multipurpose document resulted in a cumbersome
ment, a primer on measurement has been prepared to set of standards that was difficult to apply. Because this is
comp1r:ment the Standards. The purposes of the primer the first document of its type in physical therapy and be-
are to provide physical therapists with explanations of cause of the nature of the subject, we found that the Stan-
basic concepts and to explore issues related to mea- dards needed to be comprehensive and to contain de-
surement. Eugene Michels, who began work with the tailed specifications. We found that when we attempted to
Task Force as an APTA staff member, wrote the initial produce briefer versions of the Standards and when we
draft of the primer. The primer is a tool that can be attempted to use fewer measurement terms, our drafts
used to help understand not only the Standards, but were unclear and could not be used as references. The
also is:jues related to tests and measurements them- Standards, although they are advisory, may read like a
rule book. Such books are not easily read, nor are they

Physical Therapynolume 71, Number 8/August 1991


Downloaded from http://ptjournal.apta.org/ by guest on July 1, 2014
commonly read from cover to cover. We chose to sepa- practice cannot wait and testing will usually have to p r o
rate the Standards into sections, each for a specific audi- ceed; however, physical therapists should be aware of and
ence. For example, physical therapists will usually be act- should acknowledge the limitations of the measurements
ing as test users and should read and consult the section they are using. The Standards should also heighten an
designed for them. Therapists may, however, on occasion awareness that the business of measurement should not
want to know what they should expect from purveyors of be taken casually. The development of tests and measure-
tests. When this need is recognized, they can consult the ments takes commitment and is often an arduous process
appropriate purveyor section. that is marked by periods of testing and refinement.
Therefore, although tests cannot necessarily meet all of
In the Standards, the word "must" appears frequently. the Standards, it is the responsibility of all persons p r o
The Task Force consciously adopted the use of this word mating and using tests and measurements to make sure
to provide a clear message about measurement. This mes- that reasonably acceptable adherence to the Standards
sage is that physical therapists who make decisions about occurs and that future efforts will be made at refinement.
measurements and their uses should understand that the
use of the best measurements possible is obligatory. It is This document is open to review. The published Stan-
equally important to understand other ideas in this con- dardsfor Tests and Measurements in Physical T%erapy
text. There is no intention to have anyone act as an en- Practice represent only the beginning of an important
forcer of the Standards. The Standards represent an ideal; effort. As the Standards continue to evolve, we hope that
they represent a guide that therapists can use in their pro- physical therapists will aid that endeavor by sharing with
fessional conduct. Measurements in physical therapy will us their impressions and experiences with the Standards.
improve when each therapist considers his or her own
responsibility regarding the Standards. We believe that the Standards will become an essential
part of physical therapy practice. Knowledge of measure-
The Standards provide a framework for professional deci- ment is no less important for clinical practice than is
sions. They are optimal guidelines, not fixed, inviolate knowledge of anatomy, kinesiology, physiology, or psy-
rules. Because standards are by their very nature state- chology. All of these areas, including measurement, pro-
ments of optimal characteristics, there is still considerable vide the scientific foundation for effective clinical practice.
room for judgment.* Task Force members believe that These are the profession's Standards, and, as such, they
measurements that fail to meet the Standards are less than are a means of ensuring better care for our patients and
ideal and that every effort should be made to avoid using of ensuring that physical therapists play an important role
such measurements. When that is not possible, clinical in the delivery of health care services.

*The Standards are not intended to codify, explain, modify, or replace


any pan of the ethical principles in the APTA's Code of Ethics or any of
the interpretations in the Guidefor Professional Conduct, which is
issued by the Association's Judicial Committee.

Physical Therapyllrolume 71, Number 8/August 1991


Downloaded from http://ptjournal.apta.org/ by guest on July 1, 2014
Glossary of Terms Used in the Standards Content validity: see validity

The glossary describes terms as they are used in the Stan- Criterion-based (criterion-related) validity: see
dards. The glossary is not meant to be all-inclusive, but validity
rather to provide definitions for the terms as they are
used in the Standards. For further information about the Data: synonymous with measurements (see
terms, related concepts, o r other terms used in measure- measurement)
ment, consult the Primer.
Derived measurement: a measurement of an attribute
Alternate-forms (parallel-forms) reliability: see that is obtained as the result of a mathematical operation
reliability applied to an existing measurement of some other at-
tribute; an example is the measurement of leg-length dif-
Assessment: measurement, quantification, o r placing a
value or label on something; assessment is often confused
ference, which is derived by subtracting one leg-lengthi,
measurement from another
-
with evaluation; an assessment results from the act of as-
sessing (see evaluation and examination) Evaluation: a judgment based on a measurement; often
confused with assessment and examination (see assess-
Attribute: a variable; a characteristic o r quality that is m e n t and examination); evaluations are judgments of
measured the value or worth of something

Classification (categorization): assignment of an indi- Fxamination: a test or a group of tests used for the pur-
vidual or an entity to a group; assignment is based on pose of obtaining measurements o r data (see assess-
rules; groups are defined so that they allow all pertinent m e n t and evaluation)
entities or individuals to belong to the defined groups
(classes or categories are exhaustive) and so that they False negatives: persons who test negatively for some
allow entities or individuals to belong to only one possi- attribute but who, in fact, have that attribute (see t r u e
ble group (classes or categories are mutually exclusive) negatives)

Clinical decision: a determination that relates to direct False positives: persons who test positively for some
patient care, indirect patient care, acceptance of patients attribute but who, in fact, do not have that attribute (see
for trea.tment, and whether patients should be referred to t r u e positives)
other practitioners (this definition is modified from that
presented by Charles Magistro at a conference on Clinical Instrument: a machine, a questionnaire, or any device
Decisic~nMaking held under APTA auspices in October that is used as part of, or as a test to obtain, measure-
1988 in Lake of the Ozarks, Missouri); a diagnosis that ments
leads a therapist to take an action is a form of a clinical
decision; clinical decisions result in actions; when direct Internal consistency: see reliability
supporting evidence for clinical decisions is lacking, such
decisions are based on clinical opinions Intertester reliability: see reliability

Clinical opinion: a belief or idea that a physical thera- Intratester reliability: see reliability
pist holds regarding a patient; this opinion may be based
on the use of tests and measurements, but is not directly Measure: the act of obtaining a measurement (datum)
supported by evidence relating to those tests and mea-
suremt:nts; clinical opinions are based on the therapist's Measurement: the numeral assigned to an object, event,
evaluation of available information; clinical decisions (ie, or person or the class (category) to which an object,
determinations that cause the therapist to take an action) event, or person is assigned according to rules
that are based on the therapist's synthesis of information
are based on the clinical opinions of that therapist Normalization: a process that yields a new or trans-
formed measurement that is mathematically derived to
Concurrent validity: see validity change the distribution of measurements; normalization
procedures are often used to change the distribution of
Construct: a concept developed for the purpose of mea- data to make the distribution more congruent with a bell-
surement; support for the construct is through logical shaped (or normal) curve
argumentation based on the theoretical and research evi-
dence (see construct validity listed under validity) Objective measurement: a measurement that is not
affected by some aspect of the person obtaining the rnea-
Construct validity: see validity surement; the opposite of a subjective measurement (see
subjective measurement); measurements cannot be

Physical TherapyNolume 71, Number 8/August 1991


Downloaded from http://ptjournal.apta.org/ by guest on July 1, 2014
totally objective, because the term "objective" relates to Secondary purveyor: any researcher o r other person
the reliability of measurements, especially the intertester who publishes a scholarly work that examines aspects
reliability; objectivity and reliability are measured along a of tests and who, in that scholarly work, suggests (advo-
continuum cates) that a test be used; a secondary purveyor is not
the initial source of information on a test (ie, did not
Operational definition: a set of procedures that guides supply the manual or the original information on the
the process of obtaining a measurement; includes descrip- test) (see purveyor, primary purveyor, and ter-
tions of the attribute that is to be measured, the condi- tiarypurveyor)
tions under which the measurement is to be taken, and
the actions that are to be taken in order to obtain the Tertiarypurveyor:any person who teaches or pre-
measurement pares instructional material that describes specific tests
or specific uses of measurements; this definition in-
Parallel-forms (alternate-forms) reliability: see cludes, but is not limited to, persons teaching in aca-
reliability demic institutions, clinical educators, and continuing
educators who are not acting in the role of primary or
Practicality of a test: the usefulness of a test based on secondary purveyors (see purveyor,primary pur-
issues relating to personnel, time, equipment, cost of ad- veyor, and secondary purveyor)
ministration, and impact on the person taking a test
Reactivity: the degree to which the process of taking a
Predictive validity: see validity test affects a measurement or other measurements taken
on the same person in the future; examples are learning
Predictive value of a measurement: the degree of and physiological effects of taking tests
certainty that can be associated with a positive or negative
finding (measurement) obtained on a diagnostic test; the Reliability: the consistency or repeatability of measure-
predictive value of a positive measurement is the ratio ments; the degree to which measurements are error-free
formed by dividing the number of true positives by the and the degree to which repeated measurements will
number of all positive findings; the predictive value of a agree
negative measurement is the ratio formed by dividing the
number of true negatives by the number of all negative I n t d colzststency: the extent to which items or
findings elements that contribute to a measurement reflect one
basic phenomenon or dimension
Prescriptive validity: see validity
Intertester reliability: the consistency o r equiva-
Primary purveyor: see purveyor lence of measurements when more than one person
takes the measurements; indicates agreement of mea-
Purveyor: any person (or organization) who develops a surements taken by different examiners
test or any person (or organization) who offers, promotes,
or requires the use of a test; a purveyor is also a person Inwatester reliability: the consistency o r equiva-
who advocates use of specific tests through the publica- lence of measurements when one person takes re-
tion of research or scholarly articles or through teaching peated measurements separated in time; indicates
agreement in measurements over time
Primary putveyor: a person who develops, pro-
motes, or requires the use of tests; this definition in- ParalCeJ-fms (alternate-forms)reliability: the
cludes persons within clinical institutions who require consistency or agreement of measurements obtained
the use of specific tests; persons who conduct continu- with different (alternative) forms of a test; indicates
ing education courses in which a major component whether measurements obtained with different forms of
involves the advocacy of the use of specific testing pro- a test can be used interchangeably
cedures are primary purveyors; any person (or organi-
zation) who promotes (advocates) the use of tests by Test-retestreliability: the consistency of repeated
selling testing equipment, manuals, books, or similar measurements separated in time; indicates stability
materials is a primary purveyor; in the case of books or (reliability) over time
articles that serve as test manuals, the primary pur-
veyor is the author; persons who sell instruments Score (grade): the numeric (quantitative) or verbal
that may be used for testing, but who do not de- (qualitative) descriptor used to characterize the result of a
scribe or advocate specific testing procedures, are test; a score is a measurement (see measurement)
not purveyors (see purveyor, secondarypur-
veyor, and tertiary purveyor) Secondary purveyor: see purveyor

52 / 596 Physical TherapyNolume 71, Number 8/August 1991


Downloaded from http://ptjournal.apta.org/ by guest on July 1, 2014
Sensitivity of a test: an indication of how well a diag- Transformation of measurements: the application of a
nostic test identifies people who should have a positive mathematical operation for the purpose of changing the
finding; the numerical representation of sensitivity is a value or distribution of measurements, such as is done in
ratio formed by dividing the number of persons with a the process of standardization or normalization
true-positive response on a test by the number of persons
who should have had a positive response (ie, the number T r u e negatives: persons who test negatively for some
of persons who are known to have properties that would attribute and who, in fact, do not have that attribute (see
indicate that they should test positive) false negatives)

Specificgty of a test: an indication of how well a diag- T r u e positives: persons who test positively for some
nostic test identifies people who should have a negative attribute and who, in fact, have that attribute (see false
finding; the numerical representation of specificity is a positives)
ratio formed by dividing the number of persons with a
true-negative response on a test by the number of per- Validity: the degree to which a useful (meaningful) inter-
sons who should have had a negative response (ie, the pretation can be inferred from a measurement
number of persons who are known to have properties
that would indicate that they should test negative) Concurrent validity: a form of criterion-based valid-
ity in which an inferred interpretation is justified by
Standardization: a process by which a score is con- comparing a measurement with supporting evidence
verted (transformed) into a relative score by using indices that was obtained at approximately the same time as
of central tendency and variability; a commonly used stan- the measurement being validated
dardized score is the z score; the term "standardization"
is also used to describe the process of systematization of Construct validity: the conceptual (theoretical) basis
the methods used to obtain a measurement; the process for using a measurement to make an inferred interpre-
of standardization, however, does not ensure reliability, tation; evidence for construct validity is through logical
because reliability can only be determined through the argumentation based on theoretical and research evi-
collectic~nof data (see reliability) dence (see construct)

Subjective measurement: a measurement that is af- Content validity: a form of validity that deals with
fected by some aspect of the person obtaining the mea- the extent to which a measurement is judged to reflect
surement (contrasts with objective measurement); sub- the meaningful elements of a construct and not any
jectivity relates to the reliability of measurements, extraneous elements
especially the intertester reliability; the more subjective
the measurement, the less reliable the measurement; sub- Criterion-based (criterion-related) validity:
jectivity, like reliability, is measured along a continuum three forms of criterion-based validity exist: concur-
rent validity, predictive validity, and prescriptive va-
Tertiary purveyor: see purveyor lidity; the common element is that, with each of
these forms of validity, the correctness of an inferred
Test: a procedure or set of procedures that is used to interpretation can b e tested by comparing a mea-
obtain measurements (data); the procedures may require surement with either a different measurement o r
the use of instruments data obtained by other forms of testing

Test manual: a booklet or book prepared by a primary Predictive validity: a form of criterion-based validity
test purveyor to guide the process of obtaining a mea- in which an inferred interpretation is justified by com-
surement and to provide documentation and justification paring a measurement with supporting evidence that is
for the test obtained at a later point in time; examines the justifica-
tion of using a measurement to say something about
Test setting: the environment in which a test is given, future events or conditions
including the physical setting and the characteristics of
that setting Prescriptive validity: a form of criterion-based
validity in which the inferred interpretation of a
Test uset: one who chooses tests, interprets test scores, measurement is the determination of the form of
or makes decisions based on test scores (this definition is treatment a person is to receive; prescriptive validity
from Standardsfor Educational and Psychological Tests; is justified based on the successful outcome of the
Ammencan Psychological Association, Washington, DC, chosen treatment
1974, page 1)

Test-retest reliability: see reliability

Physical TherapyNolume 71, Number 8/August 1991


Downloaded from http://ptjournal.apta.org/ by guest on July 1, 2014
Standards for Tests and Measurements in P4. Test manuals provided by primary purveyors must
Physlcal Therapy Practlce include operational definitions.

Standards for Primary Test P4.1. Operational definitions of attributes that the test
Purveyors (indicated with a P) measures must be provided in the test manual.

The Standards in this section describe requirements for P4.2. Operational definitions of terms used to describe
primary purveyors of tests. The following is the definition the population for whom the test is intended
of a primary purveyor. must be provided in the test manual.

P r t m a r y p u w e y o r : a person who develops, pro- P4.3. Operational definitions of terms used to describe
motes, or requires the use of tests; this definition in- potential test users must be provided in the test 1
cludes persons within clinical institutions who require manual.
the use of specific tests; persons who conduct continu-
ing education courses in which a major component P4.4. Operational definitions of terms used to describe
involves the advocacy of the use of specific testing pro- components of the test o r test instruments must
cedures are primary purveyors; any person (or organi- be provided in the test manual.
zation) who promotes (advocates) the use of tests by
selling testing equipment, manuals, books, or similar P4.5. Operational definitions of any unique terms cre-
f
materials is a primary purveyor; in the case of books o r ated by the primary purveyor must be provided
articles that serve as test manuals, the primary purveyor in the test manual.
is the author; persons who sell instruments that may be
used for testing, but who d o not describe or advocate P4.6. Operational definitions of any terms used in a
specific testing procedures, are not purveyors (see noncustomary (unusual) manner by the primary %
purveyor, s e c o n d a r y purveyor, and t e r t h r y p u r - purveyor must be provided in the test manual.
veyor) I,
P5. Test manuals provided by primary purveyors must
Organhtion of the Standards for Primary Purveyors: include descriptions of the populations for whom the
Primary purveyors are obliged to provide documentation tests are designed. Descriptions of subjects for whom
of essential elements for the tests and measurements they the tests should not be used and descriptions of sub-
are promoting. Documentation should be in the form of a jects for whom the tests should be used with caution
test manual. Most of the Standards for primary purveyors must be included.
describe the elements that should be included in test man-
uals. Qualitative requirements for the information to be P6. Test manuals provided by primary purveyors must
included in the manuals are presented within sections that include descriptions of procedures that will ensure
describe what should be included in the test manuals. safe test administration. Safety procedures must be
enumerated and should include specific instructions
PI. Persons o r organizations should not become primary as to when the test should be terminated if a subject
test purveyors unless they are prepared to adhere to has an adverse response.
the Standards.
P7. Test manuals provided by primary purveyors must
P2. Primary purveyors of tests must provide test manuals. include descriptions of the qualifications and compe-
Books that contain major sections dealing with tests tencies needed by test users. These descriptions
and include materials that promote and advocate the should include statements regarding potential conse-
use of tests are considered test manuals, and all stan- quences of unqualified users administering the test.
dards for test manuals apply to these books. Primary
purveyors are responsible for the quality (accuracy) P8. Test manuals provided by primary purveyors should
of all information in their manuals and must make describe how potential test users can obtain the com-
every effort to ensure that information in the manuals petencies necessary to administer the tests.
is in compliance with the Standards (eg, research
studies cited are in accordance with the Standards). P9. Test manuals provided by primary purveyors should
include narrative chronological accounts of the devel-
P3. Test manuals provided by primary purveyors must opment of the tests, including descriptions of the
include descriptions of the theoretical bases of the development of any instruments associated with the
tests and measurements, including discussions of the tests.
evidence supporting the construct validity and the
content validity of the measurements. The purpose of P9.l. A description of the test developer(s) must be
the test must be clearly described. provided in the narrative account in the test
manual.

Physical TherapyPJolume 71, Number 8/August 1991


Downloaded from http://ptjournal.apta.org/ by guest on July 1, 2014
P9.2. A description of the setting(s) in which the P11.4. Descriptions must be provided in the test man-
test was developed must be provided in the ual of test conditions, behaviors of persons tak-
test manual. ing the test, and other factors that could make
the validity of the measurements questionable.
P9.3. Documentation of the sources for any items,
components, o r elements used in the test must P11.5. Descriptions must be provided in the test man-
be provided in the narrative account in the test ual of how the test user must manipulate o r
manual. process information in order to obtain the de-
sired measurements.
P9.4. A summary description of the history of the test,
including where and how the test has been used, P11.6. Descriptions and instructions must be provided
must be provided in the narrative account in the in the test manual for the use of any instru-
test manual. ments required to obtain the desired measure-
ments. This information must include, where
P9.5. Descriptions of any revisions of the test and ex- appropriate, machine settings and any other
planations of why revisions were made in the user-selected options. The test manual must
test must be provided in the narrative account in include descriptions of the effects of all options
the test manual. on the measurements and the consequences of
selecting the incorrect options.
P10. Test manuals provided by primary purveyors
must include descriptions of the test and associ- P11.7. If instruments are used as pan of the test, the
ated instruments. test manual must include descriptions of how
the devices are calibrated. A means of testing
P1O.l..Documentation of relevant technical informa- calibration must be described in the test man-
tion regarding performance characteristics of ual. If calibration is needed, instructions must
any machines, recording devices, transducers, be provided regarding a course of action to be
computer interfaces, and similar instruments taken.
must be provided in the test manual.
P11.8. Descriptions must be provided in the test man-
P10.2. Descriptions of how instruments used in the ual of variations in the test procedures that are
test manipulate or process information in order available to the test user. Descriptions of varia-
to obtain the desired measurements must be tions that are known not to impair the quality
provided in the test manual. of the measurements and descriptions of varia-
tions that are known to lead to measurements
P11. Test manuals provided by primary purveyors must of questionable validity must be included.
include instructions for administering the tests de-
scribed in the manual. These instructions must in- P11.9. Background information must be provided in
clude descriptions of all equipment and activities the test manual so that test users have the
needed for obtaining, recording, interpreting, and knowledge to obtain any derived measurements
reporting the measurements. o r categorizations necessary for interpretation
of the measurements.
P1l.l. Guidelines must be provided in the test manual
as to what information and instructions should P1l.lO. Warnings must be provided in the test manual
be given to the person being tested. In order to regarding the misuse of the measurements.
allow test users to answer questions about the Common errors in interpretation of the ob-
test and related topics, adequate information tained measurements must b e described.
about the test should be provided in the test
manual. P12. Test manuals provided by primary purveyors must
include discussions of reactivity.
P11.2. Guidelines should be provided in the test man-
ual as to what actions persons administering the P12.1. Discussion of the degree to which administra-
test can take to minimize the effects of extrane- tion of the test afFects the measurements ob-
ous factors on test performance. tained from that test or any subsequent tests
must be provided in the test manual.
P11.3. Descriptions must be provided in the test man-
ual of the physical settings in which tests should P12.2. Discussion of the degree to which administra-
be given and the possible effects of conducting tion of the test may cause a change in the per-
the test in other settings. son taking the test must be provided in the test
manual. Discussions of side effects, aftereffects,

Physical TherapyNolume 71, Number 8/August 1991


Downloaded from http://ptjournal.apta.org/ by guest on July 1, 2014
and the effects of fatigue, learning, pain, and s o P14.1. Descriptions of who conducted the reliability
forth may be included. research must b e provided in the test manual.

P13. Test manuals provided by primary purveyors must P14.2. Descriptions of where the reliability research
include evidence for all relevant forms of reliability was conducted must b e provided in the test
and related information for the measurements de- manual.
scribed in the test manual.
P14.3. Descriptions of the sample(s) studied in the
P13.1. Descriptions of how information related to reli- reliability research must be provided in the test
ability was collected must be provided in the manual.
test manual, and all relevant references to peer-
reviewed publications must be supplied. P14.3.1. Descriptions must b e provided in the test
manual of how the sample studied in the
P13.2. Evidence relating to reliability must b e reported reliability research was selected.
in the test manual in a way that describes the
errors associated with common uses of the P14.3.2. The number of subjects studied in the reli-
measurements. ability research must be specified in the q

test manual.
P13.2.1. Intratester reliability estimates (indices)
4
must be reported in the test manual. P14.3.3. Descriptions of relevant clinical characteris-
Within-day and between-day studies should tics of the sample studied in the reliability
have been conducted in a clinical context research must be provided in the test man-
consistent with the intended use of the ual. A discussion of how the sample is rep-
measurements. Intratester reliability should resentative of the population for whom the
be reported in the test manual for all forms test is intended should b e included in the
of measurements, including self- test manual.
administered tests. L
P14.4. Descriptions of persons who obtained the
P13.2.2. Intertester reliability estimates (indices) measurements in the reliability research
must b e reported in the test manual. In- (ie, those who were in the role of test users)
tertester reliability studies should have must be provided in the test manual. De-
been conducted in a clinical context scriptions of their qualifications, competen-
consistent with the intended use of the cies, and experiences with the test should be
measurements. included. Any special information o r training
given to test users prior to their obtaining
P13.2.3. Internal consistency coefficients (or factor the measurements in the study should b e
structures) must be reported in the test described in the test manual.
manual when there is a need to demon-
strate that items o r elements contributing P14.5. Descriptions of the methods and research
to a measurement reflect one basic phe- design used in the reliability studies must be
nomenon o r dimension. Studies of internal provided in the test manual. The specific
consistency should have been conducted in types of reliability that were investigated
a clinical context consistent with the in- must b e specified.
tended use of the measurements.
P14.6. Descriptions of the statistics used to derive reli-
P13.2.4. Parallel-forms (alternative-forms) reliability ability estimates and the rationale for their use
must be reported in the test manual if must b e provided in the test manual. When
more than one version of the test is being methodologically appropriate, reports of confi-
described. Studies of parallel-forms reliabil- dence intervals and standard errors of measure-
ity should have been conducted in a clini- ments should b e included in the test manual.
cal context consistent with the intended use Examples of how the reliability estimates are to
of the measurements. b e used as part of data interpretation should be
included. Reliability estimates should b e accom-
P14. Test manuals provided by primary purveyors should panied by reports of regression data (ie, slopes
include descriptions of all research studies into the and intercepts) when appropriate for the statis-
reliability of the measurements described in the tical analysis.
manual, and all relevant references to peer-
reviewed publications must be supplied. P15. Test manuals provided by primary purveyors must
include evidence for all relevant forms of validity

Physical TherapyNolume 71, Number WAugust 1991


Downloaded from http://ptjournal.apta.org/ by guest on July 1, 2014
and related information for the measurements de- with another measurement (the criterion)
scribed in the manuals. All relevant references to unless the criterion measurement has been
peer-reviewed publications must be supplied. shown to be valid (ie, it has been justified
for use as a criterion).
P15.1. Descriptions of how information related to va-
lidity was collected must be provided in the test P15.2.5. Evidence for prescriptive validity must
manual, and references to all relevant peer- be provided in the test manual when the
reviewed publications must be supplied in the primary purveyor contends that the mea-
test manual. surements can be used to determine the
choice of treatment. This evidence must
P15.2. Evidence relating to validity must be reported be based on research indicating that
in the test manual in a way that describes the treatment chosen on the basis of the
errors associated with common uses of the measurement is effective. Documentation
measurements. of the effectiveness of treatment in the
test manual must be based on the use of
P15.2.1.The construct validity (theoretical basis) for valid measurements.
the use of the measurement must be dis-
cussed in the test manual. Experimental P16. Test manuals provided by primary purveyors should
evidence as well as logical arguments for include descriptions of all research studies into the
the intended use of the measurements validity of the measurements (see standard P15 for
should be provided in the test manual. details on requirements for validity studies).

P15.2.2. The content validity of the measurements P16.1. Descriptions of who conducted the validity re-
must be discussed in the test manual. Ex- search must be provided in the test manual.
perimental evidence as well as logical argu-
ments for the content validity of the mea- P16.2. Descriptions of where the validity research was
surements should be provided in the test conducted must be provided in the test manual.
manual.
P16.3. Descriptions of the sample(s) studied in the
P15.2.3. Evidence for concurrent validity must be validity research must be provided in the test
provided in the test manual when the pri- manual.
mary purveyor contends that the measure-
ments can be used to make inferences P16.3.1. Descriptions of how the sample in the va-
about the current status of an attribute at lidity research was selected must be pro-
the time the measurements are obtained or vided in the test manual.
shortly thereafter. This evidence must in-
clude logical and experimental data to sup- P16.3.2. The number of subjects studied in the va-
port the use of other measurements as cri- lidity research must be specified in the test
teria to justify a concurrent inference. The manual.
primary purveyor should not make claims
in the test manual for concurrent validity P16.3.3. Descriptions of relevant clinical characteris-
by comparing the measurement of interest tics of the sample studied in the validity
with another measurement (the criterion) research must be provided in the test man-
unless the criterion measurement has been ual. A discussion should be provided in the
shown to be valid (ie, it has been justified test manual of how the sample is repre-
for use as a criterion). sentative of the population for whom the
test is intended.
P15.2.4. Evidence for predictive validity must be
provided in the test manual when the pri- P16.4. Descriptions of persons who obtained the
mary purveyor contends that the measure- measurements in the validity research (ie,
ments can be used at the time they are ob- those who were in the role of test users)
tained to make inferences about the future must be provided in the test manual. De-
status of an attribute. This evidence must scriptions of their qualifications, competen-
include logical and experimental data to cies, and experiences with the test should be
support the use of other measurements as included. Any special information or training
criteria to justify a predictive inference. The given to test users prior to their obtaining
primary purveyor should not make claims the measurements in the study should be
in the test manual for predictive validity by described in the test manual.
comparing the measurement of interest

Physical Therapyllrolume 71, Number 8IAugust 1991


Downloaded from http://ptjournal.apta.org/ by guest on July 1, 2014
P16.5. Descriptions of the methods and research de- P18.3.1. Descriptions must be provided in the test
sign used in the validity studies must be pro- manual of how the sample used to obtain
vided in the test manual. The specific types of the normative data was selected.
validity that were investigated must be specified
in the test manual. P18.3.2. The number of subjects studied to obtain
the normative data should be specified in
P16.6. Descriptions of the statistics used to derive va- the test manual.
lidity estimates and the rationale for their use
must be provided in the test manual. Examples P18.3.3. Evidence must be presented in the test
of how the validity estimates are to be used as manual to explain how the sample used to
part of data interpretation should be included obtain normative data is characteristic of
in the test manual. Reports of estimates of valid- the population for whom the measurement
ity in the test manual should be accompanied is intended to b e used.
by reports of regression data (ie, slopes and
intercepts) and the standard error of the esti- P18.3.4. Descriptions of relevant clinical characteris- >

mate when methodologically appropriate. tics of the sample used to obtain the nor-
mative data must be provided in the test
P17. Primary purveyors who claim that measurements manual. These descriptions should include
can be used to classrfy persons into diagnostic reports of the central tendencies, variabili- @
groups based on the presence o r absence of a find- ties, and distributions of the data on rele-
ing (eg, cut scores o r tests that result in determina- vant clinical, demographic, and anthropo-
tions of negative or positive findings) must include metric (physical) characteristics.
in their test manuals the essential elements that al-
low for interpretation of these findings. In reporting P18.4. Descriptions of persons who took the measure-
these elements, the same standards as described for ments used to obtain the normative data (ie,
reports of validity must b e followed. those who were in the role of test users) must \
be provided in the test manual. The test manual
P17.1. Percentages of false positives and false negatives should include descriptions of test users' quali-
must be reported in the test manual. fications, competencies, and experiences with
the test. Any special information o r training
P17.2. Sensitivity of the test must be reported in the given to test users prior to their taking the mea-
test manual. surements in the study should be described in
the test manual.
P17.3. Specificity of the test must be reported in the
test manual. P18.5. Descriptions of the methods and research
design used to obtain the normative data
P17.4. Predictive values of positive and negative find- must be provided in the test manual. Norma-
ings (measurements) obtained with the test tive data should b e obtained using the same
must be reported in the test manual. measurement procedures that are described
in the manual. If other versions of the test
P18. Test manuals provided by primary purveyors must were used to obtain the normative data, o r if
include normative data when measurements are to other scales were used, there must be a dis-
be interpreted in terms of how an individual mea- cussion of how the normative data relate to
surement compares with measurements obtained the data that can b e obtained using the test
on other persons (ie, when the data are norm- described in the manual.
referenced).
P18.6. A complete discussion of limitations in the use
P18.1. Descriptions of who obtained the normative of the supplied normative data must be p r o
data must be provided in the test manual. vided in the test manual. The discussion may
include, but should not be limited to, consider-
P18.2. Descriptions of where the normative data were ations of whether the normative data relate to a
obtained must be provided in the test manual. particular local area, facility, ethnic group, age
group, o r gender.
P18.3. Descriptions of the sample studied to obtain
the normative data must be provided in the test P18.7. Details on any data transformations (eg, any
manual. standardization o r normalization procedures)
used in obtaining o r preparing the normative
data must be provided in the test manual.

Physical Therapyllrolume 71, Number 8/August 1931


Downloaded from http://ptjournal.apta.org/ by guest on July 1, 2014
P18.8. Primary purveyors who describe measurements sons for whom a test may represent some psycho-
that are based on interval o r ratio scales should logical or physical risk.
present in the test manual as part of the norma-
tive data standard scores or percentiles with P21. Test manuals provided by primary purveyors must
accompanying measures of central tendency include descriptions of all special groups for whom
and variability. Data for clinically meaningful the test is contraindicated or known to lead to mea-
subgroups should be similarly reported in the surements of questionable validity.
test manual.
P22. Test manuals provided by primary purveyors must
P18.9. Primary purveyors who describe measurements include descriptions of a mechanism by which test
that are based on ordinal or nominal scales users can communicate with the primary purveyor
should present in the test manual normative regarding the test. The mechanism should allow the
data in the form of the proportion of persons user to seek further information, share observations
in the population who can be expected to be- and results, or report problems.
long to each group and subgroup. Data for clin-
ically meaningful subgroups should be similarly P23. Test manuals provided by primary purveyors must
reported in the test manual. include a bibliography that provides references spe-
cific to the test and pertinent to the content of the
Pl9. Test manuals provided by primary purveyors must test. The bibliography must be organized in such a
include information that will enable a user to judge manner that references supporting the scientific
the practicality of obtaining the measurements. basis for the test are differentiated from references
dealing tangentially with the test or simply reporting
P19.1. Descriptions of the number and types of per- that the test has been used.
sonnel needed to administer the test must be
provided in the test manual. P24. A primary purveyor's promotional material for a test
or measurement must not make claims that exceed
Pl9.2. Estimates of the time required to administer the what can be justified by existing research. When
test should be provided in the test manual. information about a test or measurement is pro-
vided in promotional material, that material should
P19.3. Descriptions of any additional equipment or meet the same standards of accuracy and freedom
supplies needed to obtain the measurements from misleading impressions that apply to the test
should be provided in the test manual. manual (this standard is based on that found in the
Standardsfor Educational and Psychological Tests:
P19.4. Descriptions of any potential impact on the per- American Psychological Association, Washington,
son taking the test, in terms of the person's DC, 1974, page 10). Any primary purveyor who
time and effort required and any other special chooses to discuss the tests or measurements of
requirements, should be provided in the test another purveyor in promotional materials should
manual. do so only while maintaining the same standards of
accuracy and freedom from misleading impressions
P19.5. Descriptions of any potential risks or hazards, that apply to the tests manual.
and means for reducing the risks and hazards,
to persons taking the test or administering the P25. Primary purveyors should make every reasonable
test must be provided in the test manual. effort to notify test users and potential users of any
modifications or revisions in tests or test manuals.
P20. Test manuals provided by primary purveyors must
include discussions of any special considerations P26. Primary purveyors who administer tests as part of
concerning the test and resulting measurements. test development must make every reasonable effort
For example, subgroups for whom measurements to observe the Standards for Test Users.
may be invalid should be identified, as should per-

Physical TherapyRolume 71, Number 8/August 1991


Downloaded from http://ptjournal.apta.org/ by guest on July 1, 2014
Standards for Secondary S4. Secondary purveyors must include in all of their re-
Test Purveyors (indicated with an S) search reports o r scholarly papers sufficient detail to
allow for replication of their research.
The Standards in this section describe requirements for
secondary purveyors of tests. The following is the defini- S5. Secondary purveyors must include descriptions of the
tion of a secondary purveyor. theoretical bases for the test and measurements they
discuss in research reports o r scholarly papers. A dis-
Seconclarypurveyor: any researcher o r other person cussion of the evidence relating to the construct va-
who publishes a scholarly work that examines aspects lidity and the content validity of the measurements
of tests and who, in that scholarly work, suggests (advo- should be included. The purpose of the test must be
cates) that a test be used; a secondary purveyor is not clearly described. The length of these discussions
the initial source of information on a test (ie, did not should be to the extent allowed in the publication in
supply the manual o r the original information on the which the report will o r may appear.
test) (see purveyor, p r i m a r y purveyor, and ter-
ttary Purveyor) S6. Secondary purveyors should include, to the extent
allowed in the publication in which their report will
Organization o f the Standards for Secondary Pur- o r may appear, operational definitions related to all
veyors: Secondary purveyors may have limitations im- aspects of the tests and measurements they discuss.
posed upon them regarding the information they can sup-
ply in published reports. The Standards have been written S6.1. Operational definitions of attributes that the test
in a way that takes into account these limitations. How- measures must be provided in reports by sec-
ever, the Standards d o list the elements that should be ondary purveyors.
included in written materials prepared by secondary pur-
veyors. Using the Standards as a guide, secondary purvey- S6.2. Operational definitions must be provided for
ors may, when publication limitations are too stringent, terms used to describe the population for
have to decide whether the integrity of their reports may whom the test is intended in reports by sec-
be excessively compromised by the requirements for ondary purveyors.
publication. Secondary purveyors are obligated to recon-
sider whether, in the face of such limitations, they choose S6.3. Operational definitions of terms used to describe
to remain secondary purveyors. potential test users must be provided in reports
by secondary purveyors.
S1. Persons o r organizations should not become second-
ary test purveyors (ie, advocates of using tests) unless S6.4. Operational definitions of terms used to describe
they are prepared to adhere to the Standards. A components of the test o r test instruments must
scholarly publication that describes tests o r uses of be provided in reports by secondary purveyors.
tests does not make an author a test purveyor unless
advocacy of specific test use is part of that publica- S6.5. Operational definitions of any unique terms cre-
tion. Care should be taken in such publications to ated by the secondary purveyor must be pro-
differentiate analysis, research, and discussion from vided in reports by secondary purveyors.
advocacy.
S6.6. Operational definitions of any terms used in a
S2. Secondary purveyors who advocate the use of tests o r noncustomary (unusual) manner by the second-
measurements must be prepared to support that ad- ary purveyor must be provided in reports by sec-
vocacy. In journal articles, the advocacy should not ondary purveyors.
exceed what can be supported through documenta-
tion. Secondary purveyors, therefore, should be S7. Research reports o r scholarly papers written by sec-
aware of the limitations imposed by journals publish- ondary purveyors must include, to the extent allowed
ing their reports. Secondary purveyors who publish in the publication in which the report will o r may
in other forums o r who are not presenting a research appear, a description of the population for whom the
report should attempt to supply more information test is designed. Descriptions, based on research of
than can be expected in a typical published research the secondary purveyor, of subjects for whom the test
report. should not be used and descriptions of subjects for
whom the test should be used with caution should
Secondary purveyors must include in all their re- be included.
search reports o r scholarly papers the basic elements
that will ensure credibility Secondary purveyors S8. Research reports o r scholarly papers written by sec-
should make every reasonable effort to publish their ondary purveyors should include, to the extent al-
reports in peer-reviewed journals, which ordinarily lowed in the publication in which the report will or
require the basic elements for credibility. may appear, descriptions of the qualifications and

Physical TherapyNolume 71, Number 81August 1991


Downloaded from http://ptjournal.apta.org/ by guest on July 1, 2014
competencies of persons who use (administer) the persons taking the test, and other factors that
tests being discussed. could make the validity of the measurements
questionable.
S9. Research reports or scholarly papers written by sec-
ondary purveyors should include, to the extent al- S11.4. Research reports or scholarly papers written by
lowed in the publication in which the report will or secondary purveyors should include descrip-
may appear, a brief account of the development of tions of how the data were manipulated or
the test being discussed. processed in order to obtain the measurement
being discussed.
S10. Research reports or scholarly papers written by sec-
ondary purveyors must include, to the extent al- S11.5. Research reports or scholarly papers written by
lowed in the publication in which the report will or secondary purveyors should include descrip-
may appear, a description of the test being dis- tions and instructions of how instruments were
cussed and associated instruments. used to obtain the measurements being dis-
cussed. This information must include, where
S1O.l. Documentation of relevant technical informa- appropriate, machine settings and any other
tion regarding performance characteristics of user-selected options. A discussion of the possl-
any machines, recording devices, transducers, ble effects of any option on the measurements
computer interfaces, and similar instruments and the consequences of selecting the incorrect
must be provided in reports by secondary pur- options should be included.
veyors. Regardless of whether this information
is published, a secondary purveyor must, upon S11.6. Secondary purveyors who describe the use of
request, be prepared to provide this informa- instruments in their reports should include de-
tion by personal communication. scriptions of how the instruments used to ob-
tain the measurements are calibrated.
S10.2. Research reports or scholarly papers written by
secondary purveyors must include descriptions S11.7. Research reports or scholarly papers written by
of how instruments manipulate or process in- secondary purveyors should include sufficient
formation in order to obtain the measurements background information so that readers can
being discussed. understand how any derived measurements or
categorizations were made, especially if this in-
S11. Research reports or scholarly papers written by sec- formation is necessary for interpretation of the
ondary purveyors must include instructions for con- measurements.
ducting the test being discussed. These instructions
must include, to the extent allowed in the publica- S11.8. Research reports or scholarly papers written by
tion in which the report will or may appear, de- secondary purveyors must include warnings
scriptions of all activities needed for obtaining mea- regarding misuse of the measurements being
surements, for recording measurements, and for discussed. If research indicates that common
interpreting measurements. Regardless of whether errors in interpretation of test data can occur,
this information is published, a secondary purveyor secondary purveyors must describe these errors
must, upon request, be prepared to provide this in their reports.
information by personal communication.
S12. Research reports or scholarly papers written by
S1l.l.. Research reports or scholarly papers written by secondary purveyors should include, to the ex-
secondary purveyors should include guidelines tent allowed in the publication in which the re-
on the information that is to be given to the port will or may appear, discussions of special
persons being tested. These guidelines should considerations concerning the test and measure-
include the instructions given to the persons ments being discussed.
being tested.
S12.1. Secondary purveyors should include discussions
S11.2. Research reports or scholarly papers written by of reactivity in their reports.
secondary purveyors should include descrip-
tions of the physical settings in which the test S12.1.1. Research reports or scholarly papers writ-
should be given and the possible effects of con- ten by secondary purveyors should include
ducting the test in other settings. discussions of the degree to which adminis-
tration of the test being discussed alfects
S11.3. Research reports or scholarly papers written the measurement obtained from that test or
by secondary purveyors should include de- any subsequent tests.
scriptions of test conditions, behaviors of

Physical TherapyNolume 71, Number 8/August 1991


Downloaded from http://ptjournal.apta.org/ by guest on July 1, 2014
S12.1.2. Research reports o r scholarly papers writ- studies. The specific types of reliability being
ten by secondary purveyors should include investigated must be specified.
discussions of the degree to which adminis-
tration of the test being discussed may S13.5. Research reports on reliability written by sec-
cause a change in the person taking the ondary purveyors must include a description of
test. Discussions of side effects, after effects, the statistics used to derive reliability estimates.
and the effects of fatigue, learning, pain, The rationale for the use of these statistics must
and so forth may be included. be provided. When methodologically appropri-
ate, reports of confidence intervals and standard
S13. Secondary purveyors who author research reports errors of measurement should be included. Ex-
or scholarly papers that examine reliability must amples of how the reliability estimates are to be
include in those reports, to the extent allowed in used as part of data interpretation should be
the publication in which the report will or may ap- included. A reliability estimate should be ac-
pear, essential elements that would allow for inter- companied by a report of regression data (ie,
pretation of the report. slopes and intercepts) when appropriate for the
statistical analysis.
S13.1. Research reports or scholarly papers on reliabil-
ity written by secondary purveyors should in- S14. Secondary purveyors who author research reports
clude a thorough and critical review of what is o r scholarly papers that examine validity must in-
known about the reliability and the validity of clude in those reports, to the extent allowed in the
the measurements being discussed. publication in which the report will o r may appear,
elements that allow for interpretation of the report.
,513.2. Research reports or scholarly papers on reliabil-
ity written by secondary purveyors must include S14.1. Research reports or scholarly papers on validity
a detailed description of the sample studied. written by secondary purveyors should include
a thorough and critical review of what is known
S13.2.1. Research reports or scholarly papers on reli- about the reliability and the validity of the mea-
ability written by secondaw purveyors must surements being discussed.
include descriptions of how the sample stud-
ied in the reliability research was selected. S14.2. Research reports o n validity written by sec-
ondary purveyors must include descriptions
S13.2.2. Research reports o r scholarly papers on of the methods and research designs used in
reliability written by secondary purveyors their studies. The specific types of validity
must specify the number of subjects stud- investigated must be specified by the second-
ied. ary purveyor. Descriptions of the sample(s)
studied in the validity research must be pro-
S13.2.3. Research reports o r scholarly papers on vided. These descriptions should include the
reliability written by secondary purveyors number of subjects studied and how these
must include descriptions of relevant clini- subjects were selected.
cal characteristics of the sample studied. A
discussion of how the sample is repre- S14.3. Research reports or scholarly papers written by
sentative of the population for whom the secondary purveyors must include evidence of
test is intended should be provided by the validity to support each inferential use of the
secondary purveyor. measurement suggested by the secondary pur-
veyor. The design must be appropriate to sup-
S13.3. Research reports or scholarly papers written by port arguments for the presence of each rele-
secondary purveyors must include descriptions vant type of validity.
of persons who obtained the measurements in
reliability studies (ie, those who were in the
role of test users). Descriptions of the test users'
S14.4. Research reports on validity written by second-
ary purveyors must include descriptions of the
-
qualifications, competencies, and experiences statistics used to derive validity estimates. The
?
with the test should be included. Information o r rationale for the use of these statistics must be
special training given to test users prior to their provided. When methodologically appropriate,
obtaining the measurements in the study should reports of confidence intervals and standard fi

be described by the secondary purveyor. errors of the estimate should be included. Ex- Ir
amples of how the validity estimates are to be
S13.4. Research reports on reliability written by sec- used as part of data interpretation should be
ondary purveyors must include descriptions of included Validity estimates should be accompa-
the methods and research designs used in their nied by reports of regression data (ie, slopes

Physical TherapyNolume 71, Number 8/August 1991


Downloaded from http://ptjournal.apta.org/ by guest on July 1, 2014
and intercepts) when appropriate for the statisti- S15.2. Sensitivity of the test must be described in re-
cal analysis. ports by secondary purveyors.

S14.5. Secondary purveyors who state in research re- S15.3. Specificity of the test must be described in re-
ports or scholarly papers that measurements ports by secondary purveyors.
can be used to make inferences about the cur-
rent status of an attribute at the time the mea- S15.4. Predictive values of positive and negative
surements are obtained or shortly thereafter findings (measurements) obtained with the
must include logical and experimental data to test must b e described in reports by second-
support the use of other measurements as crite- ary purveyors.
ria to justify these concurrent inferences. Sec-
ondary purveyors should not make claims for S16. Secondary purveyors who include normative data in
concurrent validity by comparing the measure- their reports must include, to the extent allowed in
ment of interest with another measurement (the the publication in which the report will or may ap-
criterion) unless the criterion measurement has pear, essential elements required for the interpreta-
been shown to be valid (ie, it has been justified tion of these normative data.
for use as a criterion).
S16.1. Secondary purveyors must describe who (ie, the
S14.6. Secondary purveyors who state in research re- researcher) obtained the normative data they
ports or scholarly papers that measurements report.
can be used at the time they are obtained to
make inferences about the future status of an S16.2. Secondary purveyors must describe in their re-
attribute must include logical and experimental ports where the normative data were obtained.
data to support the use of other measurements
as criteria to justlfy these predictive inferences. S16.3. Secondary purveyors must describe in their re-
Secondary purveyors should not make claims ports the sample studied to obtain the norma-
for predictive validity by comparing the mea- tive data.
surement of interest with another measurement
(the criterion) unless the criterion measure- S16.3.1. Secondary purveyors must describe in their
ment has been shown to be valid (ie, it has reports how the sample used to obtain the
been justified for use as a criterion). normative data was selected.

S14.7. Secondary purveyors who state in research re- S16.3.2. Secondary purveyors must specify in their
ports or scholarly papers that measurements reports the number of subjects studied to
can be used to determine the choice of treat- obtain the normative data.
ment (ie, prescriptive validity) must base these
statements on research indicating that treatment S16.3.3. Secondary purveyors must explain in their
chosen on the basis of the measurement is reports how the sample used to obtain the
effective. Documentation of the effectiveness of normative data is characteristic of the popu-
treatment must be based on the use of valid lation for whom the measurement is in-
measurements and should be included in re- tended to be used.
ports by the secondary purveyors.
S16.3.4. Secondary purveyors must describe in their
S15. Secondary purveyors who claim in research reports reports relevant clinical characteristics of
or scholarly papers that measurements can be used the sample used to obtain the normative
to classify persons into diagnostic groups based on data. These descriptions should include
the presence or absence of a finding (eg, cut scores reports of the central tendencies, variabili-
or tests that result in determinations of negative or ties, and distributions of the data on rele-
positive findings) must report the essential elements vant clinical, demographic, and anthropo-
that allow for interpretation of these findings. In metric (physical) characteristics.
reporting these elements, the same standards as de-
scribed for reports of validity must be followed. This 516.4. Secondary purveyors must describe in their re-
information should be supplied to the extent al- ports the persons who took the measurements
lowed in the publication in which the report will o r used to obtain the normative data (ie, those
may appear. who were in the role of test users). Descrip-
tions of test users' qualifications, competencies,
S15.1. Percentages of false positives and false nega- and experiences with the test should be in-
tives must be described in reports by second- cluded. Any special information o r training
ary purveyors. given to test users prior to their obtaining the

Physical Therapyllrolume 71, Number 8/August 1991


Downloaded from http://ptjournal.apta.org/ by guest on July 1, 2014
measurements in the study should be described dures) used in obtaining and preparing the nor-
by the secondary purveyor. mative data they are reporting.

S16.5. Secondary purveyors must describe in their re- S16.8. Secondary purveyors who report normative data
ports the methods and research designs used to for measurements that are based on interval or
obtain the normative data. Normative data ratio scales should present as part of the norma-
should be obtained using the same measure- tive data standard scores o r percentiles with
ment procedures that are described in the re- accompanying measures of central tendency and
port. If other versions of the test were used to variability. Data for clinically meaningful sub-
obtain the normative data, o r if other scales groups should be similarly reported.
were used, there must be a discussion of how
the normative data relate to the data that can be S16.9. Secondary purveyors who report normative
obtained using the test described in the report. data for measurements that are based on or-
dinal o r nominal scales should present the
S16.6. Secondary purveyors must supply in their re- normative data in the form of the proportion
ports a complete discussion of limitations in the of persons in the population who can be ex-
use of the normative data they report. The dis- pected to belong to each group and sub- \

cussion may include, but should not be limited group. Data for clinically meaningful sub-
to, considerations of whether the normative groups should be similarly reported.
data relate to a particular local area, facility, eth-
nic group, age group, o r gender. S17. Advocacy by secondary purveyors for the use of a
measurement must not exceed a level that can be
S16.7. Secondary purveyors must supply in their re- supported by the research of the secondary pur-
ports details on any data transformations (eg, veyor o r by other published data.
any standardization o r normalization proce-

Physical TherapyNolume 71, Number 8/August 1991


Downloaded from http://ptjournal.apta.org/ by guest on July 1, 2014
Standards for Tertiary Test T2.4. Tertiary purveyors must understand the different
Purveyors (indicated wjth a T ) levels of measurement (ie, nominal, ordinal, in-
terval, and ratio) and the mathematical opera-
The Standards in this section describe requirements for tions that are appropriate for each level.
tertiary purveyors of tests. The following is the definition
of a tertiary purveyor. T2.5. Tertiary purveyors must understand types of
reliability and validity and how these qualities
Tertiary p u w e y o r : any person who teaches or pre- relate to clinical decisions and other uses of
pares instructional material that describes specific tests measurements.
or specific uses of measurements; this definition in-
cludes, but is not limited to, persons teaching in aca- T2.6. Tertiary purveyors must understand the methods
demic institutions, clinical educators, and continuing used to assess reliability and validity (eg, statistics
educators who are not acting in the role of primary o r and research designs).
secondary purveyors (see purveyor, p r i m a r y p u r -
veyor, and s e c o n d a r y purveyor) T2.7. Tertiary purveyors must understand the relation-
ship between reliability and validity and the dif-
Organization of t h e Standards for Tertiary Purvey- ferences between the two qualities.
ors: Tertiary purveyors have two primary obligations: to
understand tests and measurements in general and to T2.8. Tertiary purveyors must understand what consti-
have specific knowledge about the tests they discuss. The tutes meaningful normative data and how such
first pan of these Standards describes general knowledge data can be used.
that a tertiary purveyor should have, and many of the sub-
sequent Standards describe what information a tertiary T2.9. Tertiary purveyors must understand the differ-
purveyor should supply for each test the tertiary purveyor ences between objective measurements and sub-
discusse.~.Tertiary purveyors, because they interact with jective measurements and the implications of
potential test users, must be prepared to provide addi- using each type of measurement.
tional information to these potential users upon request.
Some of' the Standards describe the type of information T2.10. Tertiary purveyors must understand the mean-
that a tertiary purveyor should be prepared to supply dur- ing and use of the terms "false negatives," "false
ing discl~ssions. positives," "true negatives," "true positives,"
"predictive value of a measurement," "specifici-
TI. Persons should not become tertiary purveyors un- ty of a test," and "sensitivity of a test."
less they are prepared to adhere to the Standards
and unless they understand the requirements for T2.11. Tertiary purveyors must understand the impor-
primary and secondary purveyors. Persons should tance of knowing the technical specifications of
also not become tertiary purveyors unless they instruments.
understand the requirements for test users and are
willing to assist potential test users in complying T2.12. Tertiary purveyors must understand the impor-
with those Standards. tance of calibrating instruments.

T2. Ten:iary purveyors must have a basic knowledge of T2.13. Tertiary purveyors must understand the meth-
the theory and principles of tests and measurements. ods and effects of normalizing o r standardizing
measurements.
T2.1. Tertiary purveyors must understand what con-
stitutes a measurement, what constitutes a T2.14. Tertiary purveyors must understand the mean-
test, and the role of instruments in obtaining ing and implications of reactivity to tests.
measurements.
T3. Tertiary purveyors should promulgate the Standards
T2.2. Tertiary purveyors must understand the differ- for Test Users and, in their teaching, should provide
ences between clinical opinions (impressions) potential test users with the necessary tools and in-
that are not based on valid measurements and formation so that these potential test users can ad-
inferences that are based on the use of valid here to user standards.
measurements.
T4. Tertiary purveyors, when discussing a test, must pro-
T2.3. Tertiary purveyors must understand what consti- vide descriptions of the theoretical bases for the test
tutes an operational definition and the impor- and must discuss evidence relating to construct and
tance of using operational definitions. content validity.

Physical Therapyflolume 71, Number 8/August 1991


Downloaded from http://ptjournal.apta.org/ by guest on July 1, 2014
T5. Tertiary purveyors must provide all relevant opera- tion for whom the test is intended must also
tional definitions during their discussions of a test. be discussed.
P.

T5.1. Tertiary purveyors must provide operational defi- T8.3. Tertiary purveyors must discuss limitations in the
nitions for attributes that the test measures. normative data. This discussion may include, but
should not be limited to, considerations of
T5.2. Tertiary purveyors must provide operational defi- whether the data relate to one local area, facility,
nitions for terms used to describe the population ethnic group, age group, o r gender.
for whom the test is intended.
T8.4. Tertiary purveyors must discuss details on any
T5.3. Tertiary purveyors must provide operational defi- data transformations used and whether any stan-
nitions for terms used to describe potential test dardization o r normalization procedures were
users. used in generating the normative data.

T5.4. Tertiary purveyors must provide operational defi- T8.5. Tertiary purveyors who discuss measurements
nitions for terms used to describe components that are interval o r ratio scaled must provide
of the test o r test instrument. standard scores o r percentiles with measure- t
ments of central tendency and variability, if these
T5.5. Tertiary purveyors must provide operational defi- data are available. Data for meaningful subgroups
nitions for any terms created by purveyors. should be similarly reported. If these data are
lacking, the tertiary purveyor should discuss the
T5.6. Tertiary purveyors must provide operational defi- limitations in the use of the normative data.
nitions for any terms they use in a noncustomary I

manner. T8.6. Tertiary purveyors who discuss measurements \


that are ordinal or nominal scaled o r who de-
T5.7. Tertiary purveyors must provide operational defi- scribe classifications must provide normative data
nitions for any terms they modified o r created. in terms of the proportion of persons in the k
population that can be expected to belong to
T6. Tertiary purveyors, during discussions of a test, must each group, if this information is available. Data
provide a description of the population for which the for meaningful subgroups should be similarly
test is designed. Descriptions of subjects for whom reported. If these data are lacking, the tertiary
the test should not be used and descriptions of sub- purveyor should discuss the limitations in the
jects for whom the test should be used with caution use of the normative data.
should be included.
T9. Tertiary purveyors, in discussing a specific test, must
T7. Tertiary purveyors have an obligation to review criti- provide descriptions of the qualifications and compe-
cally what is known about the reliability and validity tencies needed by the test user to administer that
of tests that they discuss, including how statistics test.
were used to assess reliability and validity. Tertiary
purveyors must also be prepared to answer questions T10. Tertiary purveyors, when discussing a specific test, "4
of potential test users regarding reliability and valid- should provide a brief account of the development
ity studies and statistics used in these studes. of the test.

T8. Tertiary purveyors must provide all information that T11. Tertiary purveyors, in discussing a specific test, must ",
js available when they convey or discuss normative provide descriptions of the test and instruments
data. associated with the test.

T8.1.Tertiary purveyors must describe the methods T1l.l Tertiary purveyors must discuss available docu-
used to obtain the sample that was used to ob- mentation of relevant technical information re-
tain the normative data. The generalizability of garding performance characteristics of any ma-
the normative data must be characterized relative chines, recording devices, transducers, computer
to the sampling method. interfaces, and similar instruments. The tertiary
%
purveyor should identify the source of this doc-
T8.2. Tertiary purveyors must describe the sample umentation. If documentation is not available,
studied (eg, the number of subjects and the the tertiary purveyor must discuss the implica- I
distributions of relevant clinical, demographic, tions and limitations of using such instruments.
and anthropometric [physical] characteristics).
How this group is characteristic of the popula- T11.2.Tertiary purveyors must describe how instru-
ments used in the test manipulate or process

Physical Therapyllrolume 71, Number 8/August 1991


i
Downloaded from http://ptjournal.apta.org/ by guest on July 1, 2014 i
information in order to obtain the measure- lead to measurements of questionable validity
ments, if this information is available. Tertiary must be included.
purveyors should identify the source of this
information. If this information is not available, T12.8. Tertiary purveyors must provide background
the tertiary purveyor must discuss the implica- information so that potential test users will have
tions and limitations of using such instruments. the knowledge to obtain any derived measure-
ments o r categorization necessary for interpre-
T12. Tertiary purveyors must provide instructions for tation of the measurements.
administering all tests that they teach to potential
test users. These instructions must include descrip- T13. Tertiary purveyors must provide warnings regard-
tions of the sources for test manuals as well as all ing misuse of the measurements they discuss.
equipment and activities needed for obtaining, re- Common errors in interpretation of the measure-
cording, and interpreting the measurements. ments must be described. If research o r the ter-
tiary purveyor's experience indicates that errors
T12.1. Tertiary purveyors must provide guidelines for in interpretation of test data can occur, then
what information and instructions are to be these errors should b e described.
given to the person being tested. Information
about the test should be provided that will al- T14. Tertiary purveyors must discuss the implications of
low the potential test user to answer questions reactivity when discussing a test.
about the test and related subjects.
T14.1. Tertiary purveyors must discuss the degree to
T12.2. Tertiary purveyors must describe the physical which administration of the test affects the mea-
settings in which the test should be given and surement obtained from that test o r any subse-
the possible effects of conducting the test in quent tests.
other settings.
T14.2. Tertiary purveyors must discuss the degree to
T12.3. Tertiary purveyors must describe conditions, which administration of the test may cause a
behaviors of persons taking the test, or other change in the person taking the test. Discus-
factors that could make the validity of the mea- sions of side effects, aftereffects, fatigue, learn-
surements questionable. ing, and so forth may be included.

T12.4. Tertiary purveyors must describe how the test T15. Tertiary purveyors must include in their discussions
user must manipulate o r process information in of a test descriptions of all special groups for whom
order to obtain the desired measurements. the test is contraindicated o r known to lead to mea-
surements of questionable validity.
T12.5. Tertiary purveyors must provide instructions to
potential test users for use of any instruments T16. Tertiary purveyors, when discussing measurements
required to obtain the desired measurements. used to classify persons into groups based on the
These instructions, where appropriate, must presence o r absence of a diagnostic finding (eg, use
include machine settings and any other user- of cut scores o r tests to determine a positive o r neg-
selected options. Descriptions of the effects of ative finding), must discuss the limitations of these
all options on the measurements and the conse- measurements.
quences of selecting the incorrect options
should be included. T16.1. Tertiary purveyors must report the percentages
of false positives and false negatives for the
T12.6. Tertiary purveyors who discuss tests that in- measurements they discuss. If this information
volve the use of instruments must describe how is not available, tertiary purveyors must dlscuss
the instruments are calibrated. A means of test- the limitations of using these measurements.
ing calibration must be described. If calibration
is needed, the tertiary purveyor must provide T16.2. Tertiary purveyors must report the sensitivity of
instructions regarding a course of action to be the tests they discuss. If this information is not
taken. available, tertiary purveyors must discuss the
limitations of using these tests.
T12.7. Tertiary purveyors must describe variations in
the test procedures that are available to the test T16.3. Tertiary purveyors must report the specificity of
user. Descriptions of variations that are known the tests they discuss. If this information is not
not to impair the quality of the measurements available, tertiary purveyors must discuss the
and descriptions of variations that are known to limitations of using these tests.

Physical 'TherapyNolume 71, Number 8/August 1991


Downloaded from http://ptjournal.apta.org/ by guest on July 1, 2014
T16.4. Tertiary purveyors must report the predictive warn potential test users of common errors that the
values of positive and negative findings for the purveyors know occur in clinical practice. Strategies
measurements they discuss. If this information for avoiding these errors should be discussed.
is not available, tertiary purveyors must discuss
the limitations of using these measurements. T20. Tertiary purveyors must discuss with potential test
users how results of tests must be reported. Tertiary
T17. Tertiary purveyors, when they discuss a test, must purveyors must discuss what information is essential
identlfy any way in which their versions of the test in reports.
differ from published versions of the test. Tertiary
purveyors must also discuss how these variations T21. Tertiary purveyors must discuss with potential test
can affect the measurement and the uses of the users the difference between clinical opinions and
measurement. A tertiary purveyor who modifies a interpretations that are based solely on valid mea-
test becomes a primary purveyor and must meet the surements. The tertiary purveyor must also provide
Standards specified for primary purveyors. examples of how clinical opinions may be differen-
tiated from test findings in clinical reports and other I

T18. Tertiary purveyors must provide information that communications.


will enable potential test users to understand the t
limitations of tests that do not meet the Standards. T22. Tertiary purveyors must assist potential test users in
Tertiary purveyors must make potential test users understanding the role of specific measurements in
aware of the limited justifiable inferences that can the clinical decision-making process. Tertiary pur-
be made from tests that d o not meet the Standards. veyors must characterize whether existing research
justifies conclusions based on single tests or
T19. Tertiary purveyors must discuss with potential test whether clinical decisions should be the result of
users issues related to the interpretation of the mea- the synthesis of multiple measurements.
surements they discuss. Tertiary purveyors must

Physical Therapyllrolume 71, Number 8/August 1991


Downloaded from http://ptjournal.apta.org/ by guest on July 1, 2014 u
Standards for Test Users U3.6. Test users must understand types of reliability and
(indicated with a U) validity and how these qualities relate to clinical
decisions and other uses of measurements.
The Standards in this section describe requirements for
test users. The following is the definition of a test user. U3.7. Test users must have a basic understanding of
the methods used to assess reliability and validity
Test user: one who chooses tests, interprets test (eg, statistics and research designs).
scores, or makes decisions based on test scores (this
definition is from Standards for Educational a n d Psy- U3.8. Test users must understand the relationship be-
chological Tests. American Psychological Asociation, tween reliability and validity and the differences
Washington, DC, 1974, page 1) between the two qualities.

Organization of the Standards for Test Users: Four U3.9. Test users must understand what constitutes
basic types of Standards are found in the Standards for meaningful normative data and how such data
Test Users. The Standards listed first detail the general can be used.
knowledge that a test user must have. The majority of the
Standards in this section deal with specific requirements U3.10. Test users must understand the differences be-
that a user should consider when performing specific tween objective measurements and subjective
tests. These Standards include issues relating to the measurements and the implications of using
choice of tests, the performance of testing, observing the each type of measurement.
rights of test takers, and the use of obtained measure-
ments. The last two Standards, U44 and U45, describe the U3.11. Test users must understand the meaning and
requirements test users should observe in interpreting use of the terms "false negatives," "false posi-
and reporting test results. tives," "true negatives," "true positives," "pre-
dictive value of a measurement," "specificity of
U1. Persons should not become test users unless they a test," and "sensitivity of a test."
are prepared to adhere to the Standards and under-
stand the requirements for test purveyors. U3.12. Test users must understand the importance
of knowing the technical specifications of
U2. Test users must have a basic understanding of local, instruments.
state, and federal laws governing the use of tests in
their practice settings. U3.13. Test users must understand the importance of
calibrating instruments.
U3. Test users must have a basic knowledge of the the-
ory and principles of tests and measurements. U3.14. Test users must have a basic understanding of
the methods and effects of normalizing or stan-
U3.1. Test users must understand what constitutes a dardizing measurements.
measurement, what constitutes a test, and the
role of instruments in obtaining measurements. U3.15. Test users must understand the meaning and
implications of reactivity to tests.
U3.2. Test users must understand the differences be-
tween clinical opinions (impressions) that are U4. Test users must have background knowledge in ba-
not based on valid measurements and inferences sic, applied, and clinical sciences related to the selec-
that are based on the use of valid measurements. tion, administration, and interpretation of each test
they use.
U3.3. Test users must understand what constitutes an
operational definition and the importance of U5. Test users must understand the theoretical bases
using operational definitions. (construct and content validity) for the tests they use,
and they must have knowledge about the attribute
U3.4. Test users must understand the different levels (characteristic) being measured.
of measurement (ie, nominal, ordinal, interval,
and ratio) and the mathematical operations that U6. Test users must be familiar with the development of
are appropriate for each level. tests that they use and the test settings in which
those tests have been developed and used.
U3.5. Test users must understand types of validity and
how these types of validity relate to the use of U7. Test users must understand how a test they are using
measurements. relates to similar tests o r previous versions of the
same test.

Physical TherapyNolume 71, Number 8/August 1991


Downloaded from http://ptjournal.apta.org/ by guest on July 1, 2014
US. Test users must be able to justify the selection of U12. Test users must be able to determine before they
tests they use. Test users must also be prepared to use a test whether they have the ability to adminis-
supply logical arguments to justrfy the rejection of ter that test. This determination should be based on
tests they choose not to use. an understanding of the test user's own skills and
knowledge (competency) as compared with the
U8.1. Test users must consider the safety of subjects in competencies described by the test purveyor.
selecting tests and should consider the benefits
to be obtained from a test in view of potential U12.1. Test users must be able to describe the poten-
risks to the subject. tial consequences of administering a test that
they d o not have the skills o r knowledge to
U8.2. Test users should consider the practicality of the administer.
test (eg, personnel, time, equipment, cost of ad-
ministration, and impact on the person taking U12.2. Test users who have doubts about their ability
the test) in selecting tests and in planning exami- to administer a test should report this informa-
nation procedures. tion when they report test results (eg, their res-
ervations about the quality of their measure-
U9. Test users must be able to identify their sources of ments should be discussed).
information regarding tests they use. Test users must
be able to speclfy where they obtained information U13. Test users must follow instructions provided by
(eg, rationale and directions) for selecting and con- purveyors for all tests they administer.
ducting a test.
U13.1. Test users must understand instructions for
U9.1. Test users should not cite a test manual as a administering all tests that they use. Test us-
source of information unless they have person- ers must b e able to describe all of the
ally examined a complete copy of the test man- equipment and activities needed for obtain-
ual. Test users should not conduct tests unless ing, recording, and interpreting the measure-
they have examined all relevant sections of a ments. Test users must be able to identify
complete copy of the test manual. the source of the instructions.

U10. Test users must understand all operational defini- U13.2. Test users who deviate from accepted direc-
tions related to tests they use. tions for obtaining a measurement should not
use published data o r documentation relative
U1O.l. Test users must understand the operational to reliability and validity to justify their use of
definitions for attributes that the test measures. the measurement.

U10.2. Test users must understand the operational U14. Test users must know what information and instruc-
definitions for terms used to describe the pop- tions are to be given to the person being tested.
ulation for whom the test is intended. Test users should be able to answer questions
about the test and related subjects.
U10.3. Test users must understand the operational
definitions for terms used to describe potential U14.1. Test users who do not give the purveyor's spec-
test users. ified instructions to persons being tested, o r
test users who are unable to give these instruc-
U10.4. Test users must understand the operational tions, should not use published data o r docu- c
definitions for terms used to describe compo- mentation relative to reliability and validity to
nents of the test o r test instruments. justrfy their use of the measurements.

U10.5. Test users must understand the operational U15. Test users must know the physical settings in which
definitions for any terms created by purveyors the test should be given and the possible effects of
of the test. conducting the test in other settings.

U10.6. Test users must be able to identify and under- U16. Test users must be able to identify any conditions
stand the operational definitions for any terms o r behaviors in the person being tested that may
used in a noncustomary manner. compromise the reliability o r validity of their mea-
surements (eg, if a modified position must be used
U11. Test users must be able to describe the population in manual muscle testing because of a deformity).
for whom the test was designed. Test users must be Test users who observe such conditions or behav-
able to relate this description to the persons they iors should note these observations in their reports
are testing. of any resultant measurements. Test users who be-

Physical TherapyNolume 71, Number 8/August 191


Downloaded from http://ptjournal.apta.org/ by guest on July 1, 2014
lieve that the effect on their measurements could Test users have a responsibility to suggest further
be significant should include a discussion of the testing when they have serious concerns about
implications of these observations in their reports. the quality of the measurements they obtain o r
when they believe that other tests o r other per-
U17. Test users must have a basic understanding of the sonnel can be used to obtain better measure-
instruments they use as part of a test. ments.

U17.1. Test users must know relevant technical infor- U23. Test users who are required to derive o r trans-
mation regarding performance characteristics of form measurements must have sufficient training
any machines, recording devices, transducers, and knowledge to derive o r transform those
computer interfaces, and similar instruments measurements. Test users must have the back-
they use. Test users should be able to identify ground information and skills needed to derive
the source of this information. If this informa- measurements o r make categorizations necessary
tion is not available, the test user must be able for interpretation of their measurements (eg,
to discuss the implications and limitations of how to normalize o r standardize a score o r how
using such instruments. to classify a measurement).

U17.2. Test users must b e able to describe how in- U24. Test users must be aware of any normative data for
struments they use manipulate or process the measurements they are obtaining (see Standard
information in order to obtain measure- U44.3 for guidelines on using normative data to
ments. Test users should identify the source interpret measurements; see Standard U45.10 for
of this information. If this information is not guidelines on reporting measurements related to
available, the test user must be able to dis- normative data). Test users should be able to evalu-
cuss the implications and limitations of using ate critically normative data and use the data for
such instruments. clinical decision making.

U18. Test users must know how to use any instruments U25. Test users must make every effort to control the
required to obtain the desired measurements. This environment (test setting) in which they test in or-
Standard includes, where appropriate, the test user der to maintain consistent conditions between tests.
knowing how to choose machine settings and other These efforts are needed to ensure that the validity
user-selected options. Test users must be able to and reliability of a measurement are not compro-
discuss the effects of all options on their measure- mised.
ments and the consequences of selecting the incor-
rect options. U26. Test users must make every effort when personal
information is being obtained to control the envi-
U19. Test users must be able to describe how instru- ronment (test setting) in which they administer tests
ments they use for a test are calibrated, including in order to preserve the privacy of the person tak-
the means of testing calibration. Test users must ing the test.
know the course of action to be taken when cali-
bration is needed. U27. Test users must be able to discuss common errors
in the interpretation of the measurements they use.
U20. Test users, for all the tests they use, should be able
to describe variations in the test procedures that are U28. Test users must make every effort to minimize the
available. Test users must be able to describe varia- effects of reactivity associated with the tests they
tions that are known not to impair the quality of the use.
measurements and those variations that are known
t o lead to measurements of questionable validity. U29. Test users should report to the purveyor of the
test any problems regarding a test o r any associ-
U21. Test users who deviate from accepted directions for ated instruments.
obtaining a measurement should not use published
data o r documentation relative to reliability and U30. Test users should communicate with other test us-
validity to justify their use of the measurement. ers and purveyors regarding their experiences with
tests.
U21.1. Test users who administer tests in settings
other than those recommended by the pur- U31. Test users must avoid giving persons prior knowl-
veyor should not use published data o r docu- edge about the natqre of a test when such knowl-
mentation relative to reliability and validity to edge is known to compromise the validity of the
justify their use of the measurement. measurements.

Physical Therapyllrolume 71, Number 8/August 1991


Downloaded from http://ptjournal.apta.org/ by guest on July 1, 2014
U32. Test users are responsible for maintaining confiden- test user's clinical opinion; it is not based
tiality of test results. Confidentiality of results on the validated use of the measurement.
should be in accordance with standard practices in The test user does not violate the rights
the institution o r community in which the test user of the person taking the test by having o r
obtains the measurements. Results should not be presenting clinical opinions, but would
shared with any persons (or organizations) who are violate the person's rights by contending
known to be unwilling to respect the right of confi- that the measurement could be used to
dentiality of the person who was tested. infer malingering.)

U33. Test users should not share results of tests with per- U35. Test users must maintain records in such a man-
sons (or organizations) who are likely to misuse ner that information about tests and measure-
that information. ments is accurate and is not likely to be distorted
o r lost. Abbreviations used in communications
U34. Test users must respect the rights of persons whom should be limited to those that appear in estab-
they test. lished references.

U34.1. Test users must respect the right of persons to U36. Test users have a responsibility to report inappro-
refuse to be tested. Test users must allow per- priate test use to proper authorities.
sons to discontinue participation in any test at
any time without recrimination or prejudice U36.1. Test users who know that a person's rights are
against that person. not being observed during testing must make
every effort to change that situation.
U34.2. Test users must inform persons whom they test
of potential risks and benefits that persons may U37. Test users should select tests based on what is
experience as a result of taking the test. best for the person being tested. Test selection
based on considerations of personal benefit to
U34.3. Test users must respect the right of persons the test user, test purveyor, or the referring prac-
being tested to know the results of tests, the titioner is inappropriate.
interpretations of those test results, and with
whom the test results will be shared. The right U38. Test users, in clinical practice, should avoid the use
of the person to know the results of tests does of tests that were designed solely for research pur-
not imply that all test users must personally poses. Such tests, when theyare used in the clinical
supply this information. In some cases, test re- setting, should be identified in all reports as re-
sults may be supplied by the professional who search tests that have not necessarily been shown to
originated a referral or who is coordinating be reliable or valid in clinical use.
treatment.
U39. Test users should not assign persons to conduct
U34.4. Test users who fail to adhere to the Standards tests unless they know that such persons are quali-
and who use tests inappropriately, especially in fied to conduct the tests.
terms of drawing unwarranted conclusions
from results, violate the rights of persons being U40. Test users should not make promotional claims for
tested. their testing procedures that are not supported by
research literature.
U34.4.1. Test users who misrepresent their clinical
opinions as being based on test results U40.1. Test users are responsible for the critical evalu-
when evidence for such opinions is not ation of all claims of test purveyors and should
found in the research literature violate the not merely repeat the claims of purveyors with-
rights of persons taking tests. (For exam- out critical evaluation of these claims.
ple: A test user may use a battery of tests to
determine the ability of a patient with low U41. Test users should assist in the development and
back pain to function in an industrial envi- refinement of testing procedures by sharing their
ronment. In this hypothetical example, the knowledge of tests and assisting in the collection of
test battery yields a measurement that is data where appropriate.
supposed to predict the type of work that
the patient may d o safely. There is, in this U42. Test users have a responsibility to periodically re-
example, evidence for the validity of this view the test procedures they and their colleagues
inference. However, based on the test us- use in their institutions (practice settings) to ensure
er's observations, the test user concludes that appropriate use of measurements is being
that the patient is malingering. This is the

Physical Therapyllrolume 71, Number 8lAugust 1991


Downloaded from http://ptjournal.apta.org/ by guest on July 1, 2014
made and that the rights of persons tested are be- U44.3.1. Test users should use all available informa-
ing observed. tion when using normative data for inter-
pretations of measurements.
U42.1. Test users, as pan of their periodic review of
test procedures, should examine whether the U44.3.1.1. Test users using normative data should
normative data they are using appear to relate interpret any measurement that is in-
to their clinical setting. terval or ratio scaled in terms of how
that measurement relates to measures
U42.2. Test users, as pan of their periodic review of of central tendency, measures of vari-
test procedures, should attempt to estimate the ability, and percentiles.
reliability of measurements in their practice
settings. All forms of reliability relevant to the U44.3.1.2. Test users using normative data should
practice settings should be assessed. interpret any measurement that is nomi-
nal o r ordinal scaled in terms of the pro-
U43. Test users who use tests that d o not meet the portion of persons in the population that
Standards should be aware that these tests d o can be expected to belong to the same
not meet the Standards. Test users, therefore, classification.
should interpret results of these tests with cau-
tion and share these reservations with all per- U44.4. Test users must consider the limitations of their
sons who receive test results. measurements when they classify persons into
diagnostic groups based on the presence or
U44. Test users must follow the basic rules and princi- absence of a finding (eg, use of cut scores or
ples of measurement when they interpret results of tests to determine a positive o r negative find-
tests they use. (The following Standards provide ing). Test users should use all available data in
guidelines for interpreting measurements. These making their interpretations.
Standards are not meant to supersede o r in any way
modify the requirements specified elsewhere in the U44.4.1. Test users must consider the percentages
Standards for Test Users.) of false positives and false negatives for a
diagnostic test when interpreting measure-
U44.1. Test users must limit their interpretations of ments. If this information is not available,
measurements to the inferences for which test users should understand the limitations
those measurements have been shown to be of making interpretations based on their
valid. measurements.

U44.2. Test users must consider the error associated U44.4.2. Test users must consider the sensitivity
with their measurements when they interpret of the diagnostic test they are using
their test results. Reliability and validity esti- when they interpret their measurements.
mates should be considered when the test user If this information is not available, test
makes interpretations of measurements. (For users should understand the limitations
example: Reliability studies have indicated that of making interpretations based on their
a measurement varies as much as 10% between measurements.
repeated tests. Therefore, a change of less than
10% on that measurement may be due, at least U44.4.3. Test users must consider the specificity
in pan, to measurement error. Test users who of the diagnostic test they are using
note changes the second time they take mea- when they interpret their measurements.
surements should consider, before they make If this information is not available, test
interpretations, that the change may not reflect users should understand the limitations
real change, but may be due solely to measure- of making interpretations based on their
ment error.) measurements.

U44.3. Test users must consider whether normative U44.4.4. Test users must consider the predictive
data are available for the measurements they values of positive and negative findings
interpret. Test users must consider the when they interpret their measurements
sources of the normative data and how appli- obtained with a diagnostic test. If this infor-
cable these data are to the measurements mation is not available, test users should
they are interpreting. understand the limitations of making inter-
pretations based on their measurements.

Physical TherapyNolume 71, Number 8/August 1991


Downloaded from http://ptjournal.apta.org/ by guest on July 1, 2014
U44.5. Test users must avoid overinterpreting the re- U45.4. Test users, in reporting test results, should use
sults of their tests. Test users are responsible terms in a customary manner o r describe how
for understanding both the certainty and the terms are being used daerently. Test users
uncertainty with which they can make judg- should justify deviations from commonly ac-
ments based on their measurements. cepted uses of terms in their reports.

U44.6. Test users must consider whether changes (eg, U45.5. Test users must consider estimates of reliability
attributable to development o r learning) in the and validity when reporting test results. Test
person being tested may alter performance on users should report estimates of the errors as-
subsequent tests. Test users, when appropriate, sociated with a measurement when they report
should discuss in their reports of test results test results. (For example: Reliability studies
the possibility of change in the future. Test us- have indicated that a measurement varies as
ers should not imply that a test result repre- much as 10% between repeated measurements.
sents an immutable state when there is reason Therefore, a change of less than 10% may be
to believe that the test result may differ if the due, at least in part, to measurement error. Test
test is repeated at some future time. users who note changes the second time they
take measurements, in reporting such measure-
U44.7. Test users must consider the conditions under ments, should also report that the change in
which they conduct tests and the extent to the measurement may not reflect real change.
which results are generalizable to other test The change may be solely due to measurement
situations (eg, testing in other places o r at error. A report of the reliability estimate o r
other times). standard error, in this case, would be useful in
the test user's report.)
U44.8. Test users must identify whether their interpre-
tations are based on the results of multiple U45.6. Test users should include warnings about com-
measurements obtained with the same test o r mon misinterpretations of their measurements
on the results of a single measurement. in reports of their measurements.

U44.9. Test users must identify whether any of their U45.7. Test users should report any significant effects
interpretations are not supported by research of reactivity when they report the results of
evidence of validity. Such interpretations must their tests.
be clearly identified as being based on the test
user's personal opinion. U45.8. Test users who use a variation of a test must
indicate, when they report test results, that a
U45. Test users reporting the results of tests must supply variation was used. The test users must note
adequate information so that these results can be whether they believe that the variation may
understood. (The following Standards provide have affected the quality of their measurements.
guidelines for reporting about measurements. Test users who believe the variation had a sig-
These Standards are not meant to supersede or in nificant effect on the measurements should dis-
any way modify the requirements specified else- cuss this belief in all reports of test results.
where in the Standards for Test Users.)
U45.9. Test users should report any aspect of the test
U45.1.Test users should specify, when more than one that may cast doubt on test results (eg, ways in
form of a test exists, the specific form of the which the person tested differed from the pop-
test used when they report their results. ulation for which the test was designed o r any
observation the test user made during testing).
U45.2. Test users should report measurements in the
form specified by the purveyor's instructions. U45.10. Test users, in reports of test results, should
Test users should justify any deviations from relate their measurements to normative data,
standard methods of reporting. if available. Test users should report the
source of the normative data they use and, if
U45.3. Test users should use only the terms that are necessary, discuss how applicable the data are
defined in test manuals or in other support- to the measurements they are reporting (see
ing literature when they discuss tests o r Standard U44.3 for guidelines on using nor-
measurements. Descriptive terms that are not mative data to interpret measurements).
defined should be avoided, because such
terms may encourage inappropriate interpre- U45.10.1. Test users using normative data, when
tation of results. they report test results, should report
all information necessary to understand

Physical TherapyNolume 71, Number 8/August 1991


Downloaded from http://ptjournal.apta.org/ by guest on July 1, 2014
the test user's interpretation of the U45.12. Test users who base their interpretations of
measurements. test results on the mean of multiple measure-
ments should note this fact in their reports of
U45.10.1.1. Test users using normative data for test results. Test users should justify the use of
measurements that are interval o r the mean of multiple measurements in clinical
ratio scaled should report their test reports, if this is not customary practice.
results in terms of how the measure-
ments relate to measures of central U45.13. Test users who base their interpretations on a
tendency, measures of variability, and single measurement chosen from a group of
percentiles. measurements (eg, the best of three trials)
should note this fact when they report test
2J45.10.1.2.Test users who report classifications results. Test users, in their reports, should
in their test results should also report justify the use of the single measurement and
the proportion of persons in the pop- the criteria used to select the measurement, if
ulation who can be expected to be- this is not customw practice.
long to that classification. The test
user, if requested, should be able to U45.14. Test users who base their interpretations on
cite the source of the data used to the results of a variety of tests should note this
determine the proportions. fact when they discuss their measurements.
Test users should justify their selection of the
U45.11. Test users reporting the results of their tests in reporting test results.
tests should indicate whether any data were
transformed (normalized or standardized). U45.15. Test users should note in their reports of test
Test users, in their reports, should justify results the specific criteria they use for clinical
the use of transformations, if this is not cus- decisions. When a specific measurement (eg,
tomary practice. cut score) is used for a clinical decision, the
test user, in all reports, should justify the use
of that specific measurement.

Physical TherapyNolume 71, Number 8/August 1991


Downloaded from http://ptjournal.apta.org/ by guest on July 1, 2014
Standards for Ensuring integrity jects' legally authorized representatives must
in Measurement Research authorize, in writing, the release of this infor-
(indicated with an R)+ mation. This information includes any data o r
recorded images of the subjects.
R1. Physical therapists who conduct measurement re-
search should maximize the integrity of their work R4. Physical therapists who conduct measurement re-
by following the guidelines set forth in the Standards search are expected to ensure the privacy of subjects
for Tests and Measurements sections on primary and during the course of their measurement research.
secondary purveyors.s Therapists, if more than one subject must be present
during a test session, should ensure that each subject
R2. Physical therapists must ensure that subjects in mea- has the maximum possible privacy.
surement studies are volunteers and that no coercion
or deception was used to entice subjects to volun- R5. Physical therapists who conduct measurement re-
teer. Participation of each volunteer should be based search must minimize the risk of physical, psycholog-
on the subject's (or the subject's legally authorized ical, o r social harm to their subjects.
representative's) understanding of the nature of the
study and its expected risks and benefits. R6. Physical therapists who conduct measurement re-
search must be guided at all times by a concern for
R2.1. Physical therapists who conduct measurement the physical, psychological, and social well-being of
research must obtain, in writing, informed con- their subjects.
sent from subjects o r the subjects' legal repre-
sentatives before the subjects participate in stud- R7. Physical therapists who use patients as subjects dur-
ies. The form of the consent must be in accord ing measurement research must comply with the
with appropriate laws, regulations, and institu- applicable laws regulating the practice of physical
tional requirements. therapy in the jurisdiction in which the study is tak-
ing place.
R2.2. Physical therapists who conduct measurement
research must assure their subjects or the sub- R8. Physical therapists must make every effort to comply
jects' legal representatives, in writing, of the sub- with the requirements governing the approval and
jects' right to withdraw consent and discontinue conduct of measurement research within the institu-
participation in the measurement study. Such tional o r organizational setting in which they conduct
withdrawal should not result in any prejudice research. If the setting has no requirements govern-
against or negative impact upon the subject. ing the approval of proposals for measurement stud-
ies, physical therapists should assist in developing
R2.3. Physical therapists who obtain informed consent and implementing such requirements.
as part of measurement research must inform
their subjects o r the subjects' legal representa- R9. Physical therapists who seek institutional approval
tives, in writing, of the extent to which confiden- and external funding for measurement research must
tiality will be maintained. provide accurate information to institutional review
boards, funding agencies, and other relevant groups.
R3. Physical therapists must ensure that information
about subjects obtained during measurement re- R10. Physical therapists who conduct measurement re-
search is recorded, stored, and reported in ways that search that has been approved by an institutional
protect the subjects' right to confidentiality. review board o r a funding agency are obligated to
adhere to the approved protocol and to deviate
R3.1. Physical therapists who conduct measurement from that protocol only in accordance with the poli-
research, before they use any information cies of the board o r agency that granted approval.
about the subjects, must inform their subjects
o r the subjects' legal representatives about R11. Physical therapists who conduct measurement re-
this planned action. The subjects or the sub- search must ensure that reports of their studies are
accurate and represent only the work that was done
in the study.
+These Standards are adapted from the document Integrr'ty in Physical
Therapy Research, which was approved by the APTA Board of Directors R12. Physical therapists must conduct measurement re-
in March 1985 and modified in November 1987.
search in such a way that the prospect of financial
$The Standards for Ensuring Integrity in Measurement Research de- gain o r past financial assistance to the investigators
scribe specific requirements that should be met by researchers. Re- o r their institutions has no influence on the results
searchers may be primary o r secondary test purveyors and will, almost
always, be test users; therefore, researchers must comply with all rele- o r the manner in which the results are reported.
vant Standards described in those sections.

Physical Therapyllrolume 71, Number 81August 1991


Downloaded from http://ptjournal.apta.org/ by guest on July 1, 2014
R12.1. Physical therapists must report all sources of R17. Physical therapists must describe, in written reports
financial support for a study when the results of of measurement studies, all relevant information in
their study are published. adequate detail so that readers may replicate the
study.
R13. Physical therapists must make every effort to share
information about their measurement studies and R18. Physical therapists must describe, in written reports
findings in an appropriate manner. of measurement studies, steps that were taken to
comply with governmental and institutional regula-
R13.1. Physical therapists should submit formal re- tions governing research in the setting in which the
search reports to journals in which the study was carried out. The report should include
manuscript will be subjected to meaningful descriptions of the steps that were taken to ensure
peer review. subjects' rights.

R13.2. Physical therapists should honor the requests of R19. Physical therapists who are participating in measure-
professional colleagues for access to their mea- ment studies must dissociate themselves from any
surement research data. activities that are unethical or unlawful. Physical
therapists must make every effort to take corrective
R14. Physical therapists must have a thorough knowledge action when they encounter unethical, unlawful, or
of measurement theory and pertinent professional incompetent acts in the conduct of measurement
and scientific literature before they conduct mea- research. In addition, they are obligated to report
surement studies. Measurement studies must be any unethical, unlawful, or incompetent acts of any
carried out with due consideration given to this person to the appropriate authorities.
bcdy of knowledge.
R20. Physical therapists must assist the profession in doc-
R15. Physical therapists who conduct measurement re- umenting the integrity of measurement research.
search are obligated to know their personal limita- Physical therapists called upon to assist in inquiries
tions and to know when to seek consultation and about any measurement research should cooperate.
peer review of their research plans before they be- There should be no recriminations against any per-
gin data collection. son called upon to serve as an investigator. A per-
son should not investigate any other person's work
R16. Physical therapists, in written reports of measure- unless that person possesses the necessary knowl-
ment studies, must ensure that all references are edge and skills to evaluate objectively all available
correct and that citations are used appropriately. data.
References must directly support information in the
sentence in which the references are cited. If the
references supply indirect support for the state-
ment, this support should be indicated.

Physical Therapyllrolume 71, Number 81August 1991


Downloaded from http://ptjournal.apta.org/ by guest on July 1, 2014
Index to Standards Instructions 590, 598, 599, 605, 611,614, Reactivity 596, 599,605, 609, 611, 613, 615,
618,622 618, 622
A
I n s t r u m e n t 595-599, 604, 605, 609411, 613, R e c o r d s 616, 622
A l t e r n a t e - f o r m s reliability 595, 596, 600, 615, 622 R e f e r e n c e s 593,600, 601,604,616, 621,622
622
I n t e g r i t y 593,604, 620422 R e g r e s s i o n 600, 602, 606, 622
A m e r i c a n Physical T h e r a p y Associa-
I n t e r n a l c o n s i s t e n c y 595, 596, 600, 622 R e l i a b i l i t y 590, 591, 595597,600,606,609,
tion 589-595, 620, 622
I n t e r p r e t a t i o n 590, 597,599,600, 6 0 2 , 6 0 5 610, 613415, 617,618, 622
A s s e s s m e n t 590, 591, 595, 622
607, 611415,617419, 622 R e p o r t s 600, 602, 604408, 611,612, 614,616,
A t t r i b u t e 595598, 601, 604, 607, 610, 613,
I n t e r t e s t e r reliability 595597, 600, 622 618-622
614,622
I n t e r v a l 600, 603, 606610, 613, 617, 619, 622 R e s e a r c h 590, 592,593, 595598, 600409,
B I n t r a t e s t e r r e l i a b i l i t y 595, 596, 600, 622 611413, 616, 618,620422
B i b l i o g r a p h y 603,622 Rights 613, 616, 621,622
L
Books 593, 596598, 622 Risk 592, 603, 620, 622
L e v e k o f m e a s u r e m e n t 609, 613, 622
C Limitations 594, 602, 604, 608, 610412, 615, 5
C a l i b r a t i o n 599, 605, 609, 611,613, 615, 622 617, 621, 622 S a m p l e 600-602, 606, 607, 610, 622
C a t e g o r i z a t i o n 595, 599,605,611, 615, 622 S c o r e (grade) 596597,610,613,615, 622
M
Classification 595,610, 617, 619, 622
M a n u a l 593, 596-604, 614, 618, 622 S e c o n d a r y purveyor 593, 536, 598,604-
Classification (categorization) 595, 622 609, 620, 622
M e a s u r e 590,595,622
C l i n i c a l decision making 590, 592, 595, S e n s i t i v i t y o f a t e s t 597, 602,607, 609, 611,
M e a s u r e m e n t 589-622
597,609, 612, 613, 615, 619, 622 617,622
C W c a l opinion 595, 622 N S e t t i n g s 592, 597-599, 605, 611, 613417,620,
C o n c l u s i o n s 612, 616, 622 N o m h d 602,608-610, 613, 617, 622 622
C o n c u r r e n t v a l i d i t y 595, 597, 601, 607, N o r m - r e f e r e n c e d 602,622 Skills 614, 615, 621, 622
622 N o r m a l i z a t i o n 595, 597,602, 608-610, 613, Specificity o f a t e s t 597, 602, 607,609,611,
C o n f i d e n t i a l i t y 615, 620, 622 615, 619,622 613, 617, 622
C o n s t r u c t 595, 597,598, 601,604,609, 613, N o r m a t i v e data 602, 603, 607410, 613, 615, S t a n d a r d error o f the e s t i m a t e 600, 602,
622 617419, 622 606,608, 610, 615, 618, 622
C o n s t r u c t validity 595, 597, 598,601,604, S t a n d a r d i z a t i o n 597, 602, 608-610,615,
0
609,613,622 617, 618, 622
O b j e c t i v e m e a s u r e m e n t 591, 595,597, k
C o n t e n t v a l i d i t y 595, 597, 598, 601, 604, Statistics 600, 602,606,607,609,610,622
609,613,622
0,613,622 S u b j e c t i v e m e a s u r e m e n t 595, 597,609,
Operational d e f i n i t i o n 596, 598, 604, 609,
C r i t e r i o n - b a s e d validity 595, 597, 622 613,622
610, 613, 614, 622
C u t score 602, 607,611,617,619,622
Ordinal 603, 608-610, 613, 617, 622 T
D a t a 590,595, 597,60&603,605611,613-
615, 617419, 621,622 P T e r m s 593-596, 602404,609, 610,613,614,
P a r a l l e l - f o r m s (alternate-forms) reli- 616618, 622
D e r i v e d m e a s u r e m e n t 595.622 $+

a b i l i t y 595, 596,600, 622 T e r t i a r y purveyor 593, 596598, 609412,


E 622
P h y s i c a l t h e r a p i s t 5 9 ~ ~ 5 9620422
5,
E n t i t y 595,622 T e s t 589-593, 59-20, 622
Population 598, 600404, 606608, 610, 614,
E r r o r 536, 599, 600,602, 605,606, 611, 612, T e s t manual 597403, 614, 618, 622
617, 619, 622
617,618, 622 %
'
Practicality o f a t e s t 596, 603, 614, 622 T e s t setting 597, 615, 622
E v a l u a t i o n 591, 595,616, 622
P r e d i c t i v e validity 596, 597,601, 607, 622 T e s t user 594, 597403,606,607, 609419,
E x a m i n a t i o n 592,595,614,622 622
Predictive v a l u e o f a m e a s u r e m e n t
F 596,602, 609, 612, 613, 617, 622 Test-retest reliability 596, 597, 622
F a l s e n e g a t i v e s 595,597, 602,607, 609, 611, P r e s c r i p t i v e validity 596, 597, 601,607, T r a n s f o r m a t i o n 595, 597, 602, 608, 610,
613, 617,622 622 615, 619, 622
F a l s e p o s i t i v e s 595, 597, 602, 607, 609, 611, Primary purveyor 593, 596603, 609, 612, T r u e n e g a t i v e s 595-597, 609, 613, 622
613, 617, 622 620,622 T r u e p o s i t i v e s 595-597, 609, 613, 622
F i n a n d 62C-622 Privacy 616, 620, 622
v i
I Purveyor 593, 594, 596616, 618, 620, 622
Validity 590, 59-07, 609411, 613418, 622
Inferences 601, 606, 607, 609,612, 613, 616, R
617, 622 W
R a t i o 596, 597, 603, 608-610, 613, 617, 619,
Institutional review 620, 622 Withdrawal 620, 622
622

Physical TherapyNolume 71, Number 8/August 1991


Downloaded from http://ptjournal.apta.org/ by guest on July 1, 2014
Standards for Tests and Measurements in Physical
Therapy Practice
Jules M Rothstein, Suzann K Campbell, John L
Echternach, Alan M Jette, Harry G Knecht, Steven J
Rose and on behalf of the Task Force on Standards for
Measurement in Physical Therapy
PHYS THER. 1991; 71:589-622.

Cited by This article has been cited by 21 HighWire-hosted


articles:
http://ptjournal.apta.org/content/71/8/589#otherarticles
Subscription http://ptjournal.apta.org/subscriptions/
Information
Permissions and Reprints http://ptjournal.apta.org/site/misc/terms.xhtml
Information for Authors http://ptjournal.apta.org/site/misc/ifora.xhtml

Downloaded from http://ptjournal.apta.org/ by guest on July 1, 2014

You might also like