You are on page 1of 32

APA GUIDELINES

for Psychological Assessment


and Evaluation
APA TASK FORCE ON PSYCHOLOGICAL ASSESSMENT
AND EVALUATION GUIDELINES

APPROVED BY APA COUNCIL OF REPRESENTATIVES


MARCH 2020

APA | Guidelines for Psychological Assessment and Evaluation I


Copyright © 2020 by the American Psychological Association. This material may be reproduced and distributed without permission provided that
acknowledgment is given to the American Psychological Association. This material may not be reprinted, translated, or distributed electronically without
prior permission in writing from the publisher. For permission, contact APA, Rights and Permissions, 750 First Street, NE, Washington, DC 20002-4242.

This document will expire as APA policy in 10 years (2030). Correspondence regarding the APA Guidelines for Psychological Assessment and Evaluation
should be addressed to the American Psychological Association, 750 First Street, NE, Washington, 20002-4242.

Suggested Citation
American Psychological Association, APA Task Force on Psychological Assessment and Evaluation Guidelines. (2020). APA Guidelines for Psychological
Assessment and Evaluation. Retrieved from https://www.apa.org/about/policy/guidelines-psychological-assessment-evaluation.pdf

II APA | Guidelines for Psychological Assessment and Evaluation


APA GUIDELINES
for Psychological Assessment
and Evaluation
APA TASK FORCE ON PSYCHOLOGICAL ASSESSMENT
AND EVALUATION GUIDELINES

APPROVED BY APA COUNCIL OF REPRESENTATIVES


MARCH 2020

Task Force Workgroup APA Staff

Linda F. Campbell, PhD (co-chair) Michael J. Cuttler, PhD, ABPP Catherine L. Grus, PhD
University of Georgia Law Enforcement Services, Inc. Chief Education Officer
Education Directorate
Lisa D. Stanford, PhD, ABPP (co-chair) Stephen T. DeMers, EdD
Akron Children’s Hospital University of Kentucky C. Vaile Wright, PhD
Senior Director, Health Care Innovation
Vincent C. Alfonso, PhD Giselle A. Hass, PsyD, ABAP
Practice Directorate
Gonzaga University, School of Education Independent Practice
AUT H O R’S NOTE
This document was developed by representatives from the Board of Professional Affairs, the
Committee on Psychological Tests and Assessment, the Committee for the Advancement of
Professional Psychology, the Committee on Professional Practice and Standards, the Board
of Educational Affairs, and the Association of State and Provincial Psychology Boards in col-
laboration with APA staff. The work group included Vincent C. Alfonso, PhD; Linda F. Campbell,
PhD (co-chair); Michael J. Cuttler, PhD, ABPP; Stephen T. DeMers, EdD; Giselle A. Hass, PsyD,
ABAP; Lisa D. Stanford, PhD, ABPP (co-chair); and APA staff members Catherine L. Grus, PhD,
and C. Vaile Wright, PhD.
The work group also acknowledges the earlier contributions from April Harris-Britt, PhD,
representing the Board for the Advancement of Psychology in the Public Interest, and several
members of CPTA who made substantive contributions to Guideline 5. The work group
extends its appreciation to the APA staff members who facilitated the work of the guideline,
including Marianne Ernesto, Mary G. Hardiman, MS, and Sarah A. Rose..
TAB L E O F C O NT ENTS
Introduction3

Scope4

Audience and Stakeholders 4

Statement Distinguishing Between Guidelines and Standards 4

Compatibility With APA Ethics Code 4

Definition of Terms 5

Documentation of Need/Public Benefit 5

Development of the Guidelines 6

Selection of Evidence 7

Competence9

Psychometric and Measurement Knowledge 14

Selection, Administration, and Scoring of Tests 16

Diverse, Underrepresented, and Vulnerable Populations 18

Training and Supervisory Qualifications and Role 21

Technology22

References25

APA | Guidelines for Psychological Assessment and Evaluation  1


2 APA | Guidelines for Psychological Assessment and Evaluation
I NTR O DUCT IO N
The purpose of the American Psychological Association (APA) Guidelines for Psychological
Assessment and Evaluation (PAE) is to assist and inform psychologists of best practice when
psychological instruments, including psychometric tests and collateral information, are used
within the practice of psychological assessment and/or evaluation. As the discipline of psy-
chology has expanded, the application of psychological assessment has also developed in
response to new areas of practice. Integrated medical and primary care, online assessment
and scoring, and global initiatives are examples of these new areas. Since the last publication
of test user qualifications guidelines (APA, 2001), neuropsychology, forensic psychology,
cognitive science, consulting, industrial/organizational, integrated health, and other fields
have evolved into more defined and recognized specific areas of practice with developing
professional practice guidelines, standards of practice, and identified consistency with the
APA Ethics Code (APA, 2017a). Commensurate with the growth and varied expertise in the
assessment field is the need for (a) core knowledge and skills that are essential for all psy-
chologists whose assessment services impact individuals, groups, organizations, and the
public and (b) specific domains of expertise within the field requiring additional knowledge,
skills, and clinical experience to address the expansion of assessment service delivery across
new populations and settings. These guidelines focus on the core knowledge and skills that
psychologists, including those in specialty areas of practice, should strive to possess to
deliver assessment services competently. Additionally, the purpose of these guidelines is to
inform clients/patients, the public, other professionals collaborating with psychologists, reg-
ulatory bodies, and training programs of the qualification expected to acquire professional
competency as defined by the APA Ethics Code and to maintain high professional standards
of practice. The guidelines apply to standardized tests of ability, aptitude, achievement, atti-
tudes, interests, personality, cognitive functioning, mental health, and other construct
domains.
APA’s (2001) “Guidelines for Test User Qualifications” were responsive to the identified
problem of misuse of tests within the United States and internationally. The competence of
the test users was the primary reason for concern, and the International Test Commission
(2001) and several other countries have issued guidelines to address this concern. Compe-
tence of test users continues to be a growing problem despite the development of multiple
guidelines, procedures, and standards. The current guidelines focus on two areas identified
as deficits in the 2001 guidelines: the need for greater specificity of assessment constructs
and foundational knowledge, and the need to address the expanded and more specialized
roles of psychologists using assessment and evaluation tools in various clinical and other
professional settings.

APA | Guidelines for Psychological Assessment and Evaluation  3


• Those who generate, use, interpret, and/or give feedback to those
Scope who have been evaluated.

• Test developers, who generate test content and are involved in


The scope of the APA PAE Guidelines addresses the use of psycholog-
collecting evidence for psychometric reliability, validity in pre-
ical instruments, including psychometric tests and collateral data
dicting key outcomes, and equity across different subgroups of
when used within the context of psychological assessment, and
interest.
focuses on (a) assessment procedures, (b) professional competen-
cies in psychological assessment and evaluation, and (c) assess- • Educators and trainers who are responsible for instruction on
ment knowledge competencies. There are several topics that are psychological assessment, testing, and evaluation.
outside the scope of these guidelines. These include, but are not
• Employers who use assessments to make personnel decisions.
limited to, an in-depth treatment of technology-based assessments,
test security, and the use of assessments for certification and licen- • The public, test takers, and those impacted by test results given
sure. These PAE guidelines apply to all assessment procedures to others.
whether or not the tests are referenced by psychological terminol-
• Legislative and regulatory bodies that make decisions about or
ogy (e.g., psychological testing) and apply to any assessment and
monitor psychological assessment and evaluation.
evaluation procedures (e.g., job selection, performance appraisals,
clinical assessment of mental health status, psychoeducational/ • Relevant professional psychology associations.
multifactored evaluation of learning issues) that could result in psy-
chological distress for the individual being assessed, result in the
diagnosis of a deficit, or impact the individual’s well-being. The
guidelines apply broadly to professional competencies of psycholo- Statement Distinguishing Between Guidelines
gists conducting assessments and evaluations, including selection and Standards
and evaluation of tests used, test administration, scoring, interpre-
tation, report writing and feedback, and work within the limits of The term guidelines refers to statements that suggest or recommend
documented training and experience with specific tests used. specific professional behavior, endeavor, or conduct for psycholo-
Psychologists strive to meet the knowledge and skill-based compe- gists. Guidelines differ from standards. Standards are mandatory
tencies established to set a high standard in psychological practice and thus may be accompanied by an enforcement mechanism (e.g.,
such as professional and ethical decision-making, rights of test tak- the Ethical Principles of Psychologists and Code of Conduct; APA, 2017a).
ers, justification for use of tests, sensitivity to diversity, and technical By contrast, guidelines are aspirational in intent; they are not man-
knowledge of tests used. The individual guidelines address clinical datory, definitive, or exhaustive. They aim to facilitate the continued
and knowledge competencies that are recommended to psycholo- systematic development of the professional and to promote a high
gists, and seek to inform psychologists’ understanding of the scope level of professional practice by psychologists. A set of guidelines
of assessment practice in psychological testing. may not apply to every professional and clinical situation within the
scope of that set. As a result, guidelines are not intended to take
precedence over the professional judgments of psychologists that
are based on the scientific and professional knowledge of the field
Audience and Stakeholders and the ethics code. Further, federal and state laws also supersede
guidelines.
The APA PAE guidelines are important for those directly involved in These guidelines are professional practice guidelines that are
the process of testing, assessment, and evaluation, including the applied to the practice of psychology and not to specific treatments
following: that may be used in the practice of psychology. Professional practice
• Psychologists who directly conduct assessments, such as admin- guidelines are directed to practitioners and are intended to provide
ister, score, and accurately interpret tests, compose reports, or aspirational guidance in ethical and professional decision-making in
give feedback or any component thereof. professional practice.

• Psychology students pursuing a higher degree.

• Those responsible for selecting psychological tests, assessing the


need, determining the use of tests, and making recommendations. Compatibility With APA Ethics Code
• Those who purchase and/or oversee the acquisition and mainte- These guidelines are consistent with the current APA Ethics Code
nance of psychological assessment tools and procedures. (APA, 2017a). The guidelines are also consistent with and acknowl-
• Those who supervise others in conducting aspects of assessment edge other relevant APA policy such as the Standards of Accreditation
and those who work under the oversight of a higher credentialed for Health Service Psychology (APA, Commission on Accreditation,
person. 2015), the Standards for Educational and Psychological Testing
(American Educational Research Association [AERA] et al., 2014),
and the Professional Practice Guidelines: Guidance for Developers and
Users (APA, 2015b).

4 APA | Guidelines for Psychological Assessment and Evaluation


Definition of Terms Documentation of Need/Public Benefit

ASSESSMENT QUALIFICATIONS AVOIDANCE OF HARM


The term assessment qualifications refers to the combination of Psychological testing, assessment, and evaluation is a core compo-
knowledge, skills, abilities, training, experience, and practice creden- nent of psychological practice, treatment planning, and subsequent
tials that are deemed desirable for the use of psychological tests and decisions regarding those served. Psychologists are guided by pro-
assessment materials. However, the term describes two types of fessional standards of practice in engaging in psychological testing,
qualifications: (a) generic assessment knowledge and skills neces- assessment, and evaluation to be compliant with competency
sary for typical uses of tests and (b) specific qualification for the expectations and to avoid harm to clients. Guidelines for psycholog-
responsible use of tests in specific settings and for specific purposes ical assessment and evaluation are important for use by psycholo-
(APA, 2001). gists to aspire to fair, respectful, and competent service delivery and
treatment of examinees.
ASSESSMENT
EMERGING UNDERSERVED OR VULNERABLE CLIENT
The term assessment refers to a complex activity integrating knowl-
POPULATIONS
edge, clinical judgment, reliable collateral information (e.g., observa-
tion, semistructured or structured interviews, third-party report), and The population served by psychologists continues to reflect the shift
psychometric constructs with expertise in an area of professional of focus to underserved, rural, older adult, immigrant and refugee,
practice or application. Psychological assessment is a problem-solv- and other vulnerable populations. Ongoing research and empirical
ing process of identifying and using relevant information about indi- evidence support the need to recognize culture, language, ethnicity,
viduals, groups, or institutions for the purpose of decision-making and socioeconomic status, gender, disability, and other forms of human
recommendations (APA, 2001). This includes sensitivity toward the diversity in decisions regarding service delivery. Several factors
inclusion of diverse and underserved populations. contribute to one’s ability to conduct an assessment, formulate
differential diagnoses, and develop contextually and culturally rele-
EVALUATION vant treatment recommendations: choice of test instruments, rela-
tive weight of multiple data points, and contextual factors relevant
Although the terms evaluation and assessment are often used inter-
to decision-making all must be considered when assessing the
changeably, evaluation is a component and often end product of the
increasingly diverse population that psychologists serve. Guidelines
assessment process.
are important in identifying expectations for competent service to
varied populations.
PSYCHOLOGICAL TESTING
Psychological tests are defined as any psychometrically derived mea- PUBLIC INFORMATION
surement instrument that assesses the psychological constructs in
Adoption of assessment qualifications and competencies for psy-
which a structured sample of an examinee’s behavior in a specified
chologists provides the public with identifiable information regard-
domain is obtained and subsequently quantified, scored, interpreted,
ing training, evaluation, supervision, and competence of those from
and synthesized using a standardized process for the purpose of
whom they seek services. In turn, competency in assessment pro-
evaluative conclusion or recommendation (AERA et al., 2014).
tects the recipients of assessment services by clarifying appropriate
According to these AERA, APA, and National Council on
assessment processes and supporting quality in assessment service
Measurement in Education (NCME) standards, although tests may
delivery, validity and accuracy of psychological reports, and appro-
differ vastly in terms of item and presentation design, response
priate use of assessment results. Further, professional practice
format, and purpose, the commonality across all test instruments is
guidelines are not legal or regulatory documents and are not enforce-
that the process by which the subject’s responses are evaluated and
able by law or through professional association codes of ethics.
scored is standardized. In addition, other instruments that can be
Guidelines rather serve as an aspirational template from which
included in psychological assessment protocols where subject
psychologists can identify decision-making factors for assessment
responses are aggregated and scored in a standardized fashion, such
determinations for protection of the public and in conformance with
as structured diagnostic interviewing systems (e.g., Structured Clini-
the standard of within the profession of psychology.
cal Interview for DSM-5 Disorders, Clinician Version; First et al., 2016)
and/or structured life history (i.e., biodata; Oswald et al., 2004)
PROFESSIONAL GUIDANCE
inventories and other job performance prediction instruments
(Schmidt & Hunter, 1998) developed using psychological assessment Advances in Knowledge and Practice. Research and ongoing studies
principles and used with concurrent declarations of generalized continue to expansively and specifically increase our understanding
predictive utility in similar settings, also fall within the purview of the of human behavior, cognition, and affect. As a means of measure-
AERA/APA/NCME standards. ment and evaluation of these factors, existing psychological tests are
revised, and newly developed tests are designed to improve accu-
racy and validity of testing. Professional practice guidelines are

APA | Guidelines for Psychological Assessment and Evaluation 5


necessary to assist psychologists in their professional development LEGAL AND REGULATORY MATTERS
and ongoing commitment to be knowledgeable in current and
Laws. Changes in federal and state laws or absence of applicable laws
improved means of assessment.
often generate the need for guidelines. Assessment user credentials
Specialized Areas of Practice. Psychology has continued to grow
and scope of practice in testing, assessment, and evaluation have
into new areas of practice and into multidisciplinary roles across differ-
been the subject of new legislation, particularly at the state, provin-
ent settings and specialties (e.g., forensics, neuropsychology, geropsy-
cial, and territorial jurisdictional levels. Guidelines for psychologists
chology, technology, integrated and primary care). Specialized areas
conducting assessment will provide an important resource for those
of practice call upon psychologists to be competent in specific aspects
who practice in jurisdictions that have revised or created new regu-
of testing and evaluation that may extend beyond traditional and
lations as well as for psychologists in those jurisdictions that have
general areas of assessment. Guidelines apply to all psychologists and
not specifically addressed testing, assessment, and evaluation.
therefore provide a common set of practice expectations that include
Court Decisions and Case Law. Periodically, federal laws make
those engaging in specialized practice. Guidelines offer information
changes that affect the practice of psychology (e.g., qualification
and education not only for those engaging in specialized assessment
as an expert witness). Psychological assessment is often an integral
but also for all psychologists to have an informed understanding of
part of forensic evaluation. Guidelines for assessment and evalua-
practice in multiple areas of specialization.
tion can serve as an important deliberative component for the deter-
Specialized Populations. Professional practice guidelines express
mination of expert status (e.g., Daubert v. Dow Pharmaceuticals),
broad and general expectations for psychologists conducting assess-
special education eligibility (e.g., Individuals with Disabilities
ments and evaluations, increase awareness of individual differences
Education Act), and disability determination (e.g., Social Security
that may affect assessment, and assist psychologists in differentiating
Administration). Psychologists who have used test instruments and
general assessment principles and practices from those specific to
other means of assessment related to a court case or eligibility
specialized settings. Psychologists, by virtue of core training, are
decision are supported by the profession’s endorsement of assess-
expected to demonstrate general assessment competency. However,
ment guidelines.
those who work with populations with distinct characteristics or in a
service delivery context that may require specialized knowledge and
skills will benefit from guidelines that specify the fields of knowledges
and skills appropriate for specialized populations and settings. Development of the Guidelines
Professional Risk-Management. Professional practice guidelines
lend direction to psychologists in those areas not governed by federal The APA 2001 Guidelines for Test User Qualifications were scheduled
or state regulations. Therefore, these guidelines assist psychologists to expire in 2016. During the 2016 Spring Consolidated meeting, the
in understanding the parameters of practice for assessment and evalu- Board of Professional Affairs (BPA) and the Committee on
ation in those circumstances when regulation have not been developed. Psychological Tests and Assessment (CPTA), which are the two
Guidelines may also provide documentation for best practice for oversight groups for these guidelines, proposed the formation of a
protection of psychologists in litigious situations. working group to identify competencies necessary for test users that
Development of New Technology. The APA (2013) Guidelines for would address the misuse of psychological tests. The item was dis-
the Practice of Telepsychology identify ethical factors in telepsychology cussed during the 2016 Spring and Fall Consolidated meetings, and
practice (e.g., competence, informed consent, standards of care, a recommendation was made by BPA, CPTA, and the Committee for
testing and assessment). The Guidelines for PAE are a critical compan- the Advancement of Professional Psychology (CAPP) to (a) endorse
ion document to the telepsychology guidelines, as they will assist a working group with the purpose of developing professional prac-
and inform psychologists who are contemplating and/or actively tice guidelines and (b) to expand the working group to include rep-
adapting existing assessment protocols to online and other electron- resentatives from the Board for the Advancement of Psychology in
ically enhanced technology platforms. the Public Interest and the Board of Educational Affairs. Additionally,
Changing Social Norms. Provision of psychological services has a representative from the Association of State and Provincial
been affected by increasingly diverse populations (e.g., gender, socio- Psychology Boards was included.
economic status, race, ethnicity), electronic communication, increased The BPA, CPTA, CAPP, and APA staff identified the importance
access to information via social media, and other factors that affect of a consensus document that (a) includes competencies, (b) incor-
the context of assessment and qualifications for assessments. Publish- porates training and experience criteria, and (c) addresses the
ers are preparing online versions of traditional assessment instruments setting-specific nature of psychological assessment as it relates to
and are encouraging practitioners to use automated applications such these qualifications and competencies. These criteria are central to
as online administration, scoring, and interpretation. Professional the mission and scope of the document and the guidelines.
practice guidelines addressing assessment competency will support The reasonable options for going forward were to develop a new
these evolving changes from traditional practice in a competent and document or to revise the 2001 Guidelines. The Committee on
effective manner in response to the expanding scope of assessment Professional Practice and Standards reviewed a 2009 proposal to
in integrated health, services through teleconferencing, services to revise the 2001 guidelines and determined that, given the prescribed
diverse populations, and forensic settings. format and structure of the 2015 document, Professional Practice
Guidelines: Guidance for Developers and Users, revision would be a more
extensive project than commissioning a newly developed document.
A decision was made by the work group to develop a new consensus

6 APA | Guidelines for Psychological Assessment and Evaluation


document of guidelines in the current 2015 format and structure. A
significant identified need for new guidelines was the importance of
application to clinical and health practice areas, which was not
achieved in the 2001 guidelines.
The working group was composed of seven members who repre-
sented and were appointed by the aforementioned groups. The
funding for the project was provided by the APA Practice
Directorate.

Selection of Evidence

The working group relied on prior documentation relevant to guide-


line development, including the Guidelines for Test User Qualifications
(APA, 2001) and peer-reviewed publications from a diverse range of
related topics on assessment, testing, competencies, and relevant
policies and procedures. Given the setting-specific nature, purpose
and scope, population targets, diversity factors, and desired educa-
tion and training experience of psychological assessment, other
approved guidelines and association policies were used.

APA | Guidelines for Psychological Assessment and Evaluation  7


APA Guidelines for
Psychological Assessment
and Evaluation
CO M PETENCE

GUIDELINE 1 but not competent to use the same tests to skills for the purpose of expansion of scope
Psychologists who conduct determine competency to stand trial. of practice. These means may include, but
psychological testing, assessment, Competency is determined by both techni- are not limited to, postdoctoral courses,
cal mastery over a particular test and the targeted continuing education (CE), super-
and evaluation strive to develop
appropriately identified need for the test in vision, and consultation. Engagement in
and maintain their own competence. the overall purpose of the assessment. assessment and evaluation often has limita-
This includes competence with (Illustrations of these diverse areas of exper- tions based on licensure, professional
selection, use, interpretation, tise that share testing elements are noted in education, and training. Psychologists are
integration of findings, Guideline 4.) encouraged to seek appropriate proficiency
Assessments are typically accompa- and/or board-level certifications through a
communication of results,
nied by referral questions. Psychologists peer-review process when such certifica-
and application of measures. tions are available and related specifically to
seek to acquire the competency to deter-
mine the need and the purpose for assess- the psychologists’ area(s) of specialized
Rationale
ment, the characteristics of the examinee, assessment practice(s). Section 9 of the
Competence is defined as “demonstrable and the context and setting for the assess- APA (2017a) Ethical Principles of Psycholo-
elements or components of performance ment typically through clinical interviews, gists and Code of Conduct delineates
(knowledge, skills, and attitudes in their psychometric data (e.g., cognitive, person- standards of practice when performed by
integration)” (Kaslow et al., 2009, p. 34). ality, performance, learning, memory, psychologists but does not directly address
Competence can be diminished through executive functioning) and collateral or assessment competency.
not only failure of adequate initial training supplemental materials (e.g., socioemo-
but also failure to self-monitor adaptation tional measures). Without complete under- Application
to revisions, new instruments and methods, standing of the need and purpose for the Profession-wide and specialty-specific
and general advancements in assessment. assessment, the characteristics of the competencies are recognized and refer-
The competency movement referenced as examinee, the appropriateness of the enced by quality assurance documents and
the “culture of competency” additionally instruments chosen, and the context and entities in psychology (e.g., Ethical
specifies a “culture of assessment” outlin- setting in which assessment occurs, inter- Principles and Code of Conduct: APA,
ing the importance of self-assessed com- pretation and application of the results of 2017a; Standards of Accreditation: APA,
petence (Roberts et al., 2005). Continual the assessment are more likely to be limited COA, 2015; Association of State and
monitoring and self-assessment of compe- and/or inaccurate. Provincial Psychology Boards, 2014) and in
tency boundaries are important in meeting In addition to technical and clinical specific areas of practice (e.g., Hessen et al.,
standards of practice defined elsewhere. competence, aspired-to professional compe- 2018). Assessment is identified as a pro-
Rapid and ongoing development of instru- tence encompasses (a) skilled communica- fession-wide competency in these and
ments, procedures, norming advancements, tion with the examinee or client that other quality assurance measures.
technology, and evolving evidence-based promotes an effective working relationship; Profession-wide competencies are evalu-
practices can render a once-competent (b) the commitment to explain the risks, ated by the criteria of whether they are
psychologist examiner to unethical prac- benefits, and possible outcomes of assess- observable, measurable, and quantifiable.
tice through habituation of patterns and ment, including in high-stakes scenarios, to This consistency is necessary to maintain
personal preferences in assessment proce- the best of the examiner’s knowledge and continuity and objectivity across and within
dure and application. understanding; and (c) demonstration of competencies. Assessment competency
The complexity, breadth, and diversity respect for the recipients of services and the entails several functional competencies
of psychological testing, assessment, and commitment to nondiscrimination and that include but are not limited to selection,
evaluation necessitate a distinct delineation equity in professional practice. The need, use, interpretation, report of results, and
of areas of expertise. That is, psychologists purpose, and referral question are core use of results in response to the purpose of
consider their boundaries of expertise and elements in assessment decision-making; the assessment.
practice within the legal, ethical, and profes- however, an environmental scan of the Selection of tests or evaluation measures.
sional scope of practice and competence of context in which the examinee or client is Psychologists seek to become knowledge-
those boundaries. Psychologists strive to functioning related to the reason for assess- able of the psychometric characteristics of
understand the limits of their expertise ment is typically considered a critical compo- test instruments as well as other factors
when the same instruments may be used for nent of psychologists’ competence. likely to impact the applicability of specific
different purposes. Psychologists may be Psychologists attempt to identify the test instruments and evaluation measures
competent to administer measures of cogni- most effective means by which they may to the assessment question at hand (e.g.,
tive ability for the purpose of psychoeduca- remain competent in continued areas of reading levels, physical requirements,
tional determinations of a learning disability expertise as well as in the acquisition of new cultural background, characteristics of the

APA | Guidelines for Psychological Assessment and Evaluation 9


standardization/normative group). Similarly, and as such they are encouraged to include errors based on preconceived beliefs, and/
psychologists strive to maintain appropriate all additive data sources in drawing conclu- or other intervening factors such as anchor-
knowledge of the context and environment sions, inferences, and decisions. ing effects (i.e., overweighting initial data),
in which the assessment is to be performed, Integration of data. Psychologists seek attribution effects (i.e., favoring data from
as well as any additional relevant factors the competency to integrate all data points one source over another), and/or confirma-
that might affect outcome and recommen- and other form of findings in the writing or tion effects (i.e., selectively weighting data
dations. In addition, psychologists are encour- oral reporting of results. Multiple data points based on personally held beliefs). An excel-
aged to obtain and to review carefully available include but are not limited to standardized lent and thorough discussion of these and
collateral and supplemental information such tests, clinical interview, collateral reporting, other biases effecting psychological assess-
as treatment histories, previous assessments, behavioral checklists, environmental ment that affect accurate interpretability of
third-party observations, and/or perfor- context, and client variables. Integration of multiple data can be found in Reynolds and
mance reviews for consideration and incorpo- data points is a distinct skill from interpre- Suzuki (2013).
ration when reaching conclusions and/or tation but results in interpretation and the Reporting results. Psychologists typically
making recommendations. Other factors to formation of case conceptualization, which deliver assessment results through a written
be considered in selection of measurement advances decision-making and initial forma- report often enhanced by oral explanation,
instruments may include characteristics of tion of recommendations. The weighting of depending on context and purpose. Because
the examinee, appropriateness of the norma- data points in the integration of data is a the functional definition of scores often
tive group, cultural relevance, and alignment process that considers the cultural, ethnic, employs terminology that may not be in the
of the test instrument construct with the and other diversity variables that influence typical vernacular of examinees and recipi-
purpose of the testing. the context and interpretation of data points. ents of assessment feedback, psychologists
Use. Fidelity to the purpose and use of Interpretation. To accurately interpret are encouraged to become aware of the
a given instrument are often critical to the findings, psychologists strive to understand meaning of scores that underlie the interpre-
validity of a test instrument as well as the the conceptual meaning of scores and the tation and strive to describe findings in a
accuracy of the assessment results. As such, technical range of interpretation of any given report in a suitably interpretable manner.
psychologists consider the reason for set of individual scores (see Section 2 of these Psychologists seek to become aware of the
testing as well as the anticipated contribu- guidelines). Accurate interpretation is depen- preferred language of the report recipient(s),
tion of the selected test or battery to the dent on the psychologist’s ability to integrate reading level, and general ability to compre-
operative referral question and/or process multiple sources of data points. Insofar as hend the information.
to which the results will be applied. In this primary sources of data can be inconsistent Psychological reports typically include
regard, specific examples of the utility of rendering a clear determination difficult, a summary section that integrates key
assessment measures are often prescribed psychologists seek to develop the knowledge elements from the findings in relation to the
in the technical manual of an instrument, and skills to critically evaluate these apparent purpose for the assessment and cohesively
and as such, psychologists strive to data inconsistencies and arrive at the most presents the information in an organized,
thoroughly and critically evaluate the appli- viable interpretation of the data that serves comprehensible, and interpretable manner.
cability and/or supporting scientific the purpose of the assessment accurately Psychologists attempt to develop the skills
evidence for use of a given instrument in (Hopwood & Bornstein, 2014). to create summaries of the key findings and
settings that differ substantially from those Psychologists aspire to reflect accuracy to identify recommendations based on the
specified by the publisher. in their interpretation of test and assess- summaries that are recognized in the field
Psychologists understand that test ment instrument results and to carefully as effective treatment components.
instruments are not typically used as singular consider and control potential sources of Psychologists aspire to develop the compe-
measures but rather are integrated with other error and/or bias, particularly when these tency to construct comprehensive evidence-
standard measures as well as nonstandard- errors may contribute to a diagnosis, recom- based recommendations, recognized in the
ized yet valuable data points (e.g., collateral mendation, disposition, or other high-stakes field, that address possible treatments or
interviews, behavioral checklists, paper decisions (e.g., custody, employment, accommodations resulting from the
review of prior documents). Tests and other guardianship determination, competence findings. Psychologists working in profi-
measurement instruments can be cited in the and decisional capacity, disability compen- ciency areas that result in disposition, selec-
technical manual for multiple uses. Psychol- sation, incarceration). In this regard, errors tion, third-party decisions, and other
ogists remain aware that although their area in reporting assessment results can include high-stakes assessment purposes are
of expertise may support use of a test for a overinterpretation, inconsistent interpreta- encouraged to develop competencies
particular purpose, other uses of the test may tion, selective interpretation, and/or other commensurate with their areas of specialty
fall outside the psychologists’ scope of misinterpretations of results. Although practice and expertise.
competence. Similarly, psychologists are sources of these errors can be attributable Explanation of use and implementation.
advised that assessment is most comprehen- to lack of technical knowledge, the most Psychologists seek to develop the compe-
sive and accurate when multiple data points common sources of bias effecting interpre- tency to explain to the recipients of the
are used to arrive at a determination (e.g., tation of psychological assessment data report or findings how the recommenda-
diagnosis, recommendation, disposition), include distortions and subjective weighting tions derived from the summaries can or

10 APA | Guidelines for Psychological Assessment and Evaluation


will be used to accomplish the purpose of graduate training. The APA Ethics Code Psychologists will be mindful that compe-
the assessment. The various areas of (APA, 2017a), the AERA et al. (2014), and tency evolves as subject matter matures
specialty or proficiency in psychology can other professional associations delineate over time and that acquisition and mainte-
render significantly different findings and standards of practice in assessment, mea- nance of competency is an ongoing process
recommendations or can render similar surement, and evaluation. The APA Ethics that requires self-assessment and aware-
findings and summaries that result in very Code requires that psychologists practice ness of contemporary standards of practice.
different recommendations and are imple- within their boundaries of competence The ongoing process of self-assessment
mented in significantly different ways. The (APA, 2017a) and that psychologists in includes attention to the potential
scores and summaries of cognitive tests of practice who seek to expand their scope of emergence of complex interpersonal
intelligence, executive functioning, memory, practice in assessment undertake relevant dynamics between client and assessor (e.g.,
achievement, and personality could be the education, training, supervised experience, Bram & Peebles, 2014; Yalof, 2019).
same for two people, yet the recommenda- consultation, or study (APA, 2017a).
tions and implementation could differ Assessment, among other specialty Application
depending on the purpose of the assess- and proficiency areas in psychology, has
Psychologists who wish to acquire or main-
ment (e.g., psychoeducational, child evolved over recent years given the expan-
tain competence in assessment recognize
custody, competency to stand trial, sion of specialty practice in assessment and the importance of foundational competen-
preemployment screening, fitness for duty evaluation (e.g., psychoeducational, foren- cies and special focus competencies. With
evaluations management selection, sic, child custody, geropsychology, person- the exception of specialists in neuropsy-
diagnostic classification, developmental ality, neuropsychological, development). chology (Hessen et al., 2018; Roper et al.,
disability, workers’ compensation, and New and revised testing instruments and 2018 Smith, 2019), a trajectory has not yet
immigration hardship waivers). Psycholo- materials continue to develop given psycho-
gists are best advised to self-monitor their been established for the acquisition of com-
metric improvements (e.g., norming petency. These foundational areas are
professional boundaries to appropriately methods), research findings on learning,
conduct the elements of assessment or described as including measurement theory
motivation, memory, and other factors. and psychometrics, the components of con-
evaluation within their scope of practice.
Knowledge, skills, and attitude that would ducting assessments (e.g., selection,
meet standards of practice at an earlier time administration, and scoring), integration of
would likely be inadequate in contemporary data points, interpretation of scores, con-
practice. Not only the acquisition of compe- ceptualization, and communication of
tence but the maintenance of competence results and recommendations. Psychologists
GUIDELINE 2 is typically required by the aforementioned may acquire foundational knowledge
Psychologists who conduct standards of practice. That is, failure to gain through coursework, webinars, self-study,
psychological testing, assessment, initial competency and failure to maintain CE, and other sources. These areas of foun-
and evaluation seek appropriate competency may both result in unethical dational assessment factors are well
practice (APA, 2017a). described in several documents: PAE
training and supervised experience
The means by which psychologists Guidelines (this document), the AERA Code
in relevant aspects of testing,
competently expand scope of practice post of Ethics, the Recommended Competencies
assessment, and psychological formal training may occur through CE, for Users of Psychologist Tests, the NCME,
evaluation. seminars, supervised experience, and and the Standards for Educational and
consultation. Further, the recent and devel- Psychological Testing.
Rationale oping application of technology to knowl- Psychologists consider the
Training programs of recent years incorpo- edge and skills acquisition (e.g., webinars, decision-making factors that meet the
rate competency expectations for assess- online CE) increases opportunities for standards of practice in their select subject
ment and conducting psychological testing self-directed study. Psychologists attempt matter area. Psychologists who identify an
that reflect accreditation standards, ethical to identify the most effective means through area of expanded scope of practice strive to
standards, jurisdictional laws, and regula- which to gain the desired set of competen- determine their existing level of competency
tions (e.g., Hessen et al., 2018). Psychologists cies. Psychologists who want to expand as well as the knowledge and skills to be
in practice have experienced variable qual- their scope of practice in psychoeduca- attained. This determination can be made
ity and content in initial graduate training tional assessment are likely to pursue a through consultation with those who are
and subsequent CE, proficiency acquisition, somewhat different set of knowledge and recognized for their practice in that area of
or self-directed access to education and skills than those who wish to conduct foren- expertise. Multiple methods of acquiring
training. That is, a trajectory has not been sic evaluations, acceding, however, to the knowledge and skills can be adopted to
established for the acquisition of compe- point of common foundational principles include coursework, workshops, webinars,
tence, the maintenance of competence, and standards. and other CE that is specifically focused on
supervised work experience, or criteri- Assessment is a fluid and dynamic the target area of practice. Psychologists are
on-based expectations for practitioners activity that calls for focused and ongoing encouraged to develop their specialty skills
who expand their scope of practice post attention to maintenance of competence. through subject matter instruction and

APA | Guidelines for Psychological Assessment and Evaluation  1 1


education (e.g., forensics, child custody) examinee. Existing ethical and legal obliga- Psychologists also strive to prevent or min-
coupled with consultation. The subject tions to prevent negative impact stems from imize misuse of assessment results that can
matter component of competency frequently the recognition that all tests and measure- be anticipated and to correct misuse or
includes supervised experience. Knowledge ment procedures have both appropriate and misinterpretation of assessment findings
of the subject matter is integrated with skill inappropriate uses depending on purpose that come to their attention following the
development, typically under consultation or and setting of the assessment, the limita- release of this material.
supervision of an expert in the area. tions of the test or assessment procedure to Psychological assessments are
Psychologists comply with the APA address that purpose in that setting, the typically used in the hope of gaining infor-
(2017a) Ethical Principles of Psychologists and characteristics of the test taker in relation to mation that can direct an intervention,
Code of Conduct. Section 2, Competence, the normative sample that supports the ameliorate a problem or difficulty, gain
specifically delineates the importance of valid interpretation of the test results, and insight into abilities and skills, or inform
relevant education, training, supervised the human confidence that can be placed in decision-making. Sometimes the results of
experience, and consultation when expand- the interpretation of the results obtained for psychological assessment reveal findings
ing scope of practice into areas new to that client in that setting for that purpose. In that could be seen as detrimental to the
psychologists. Further, the maintenance of addition, psychologists remain alert to any interests of the examinee achieving their
competence requires ongoing effort to meet ethical and, in some cases, legal obligation goals or problematic in some way unrelated
the standard of practice. Failure to maintain to protect the client from misuse or misrep- to the original purpose. Where appropriate,
competence can result in inadvertent resentation of the data. Further, psycholo- psychologists strive to obtain informed
practice beyond the data necessary to gists may find themselves called upon to consent, which may include capacity to
substantiate findings, inappropriate use of guard against reports generated by consent and freedom to withdraw, such that
instruments, and inaccurate interpretation. untrained individuals who could misunder- the examinee understands that the results
Psychologists recognize the importance of stand or misuse this information in such a of assessment may not provide the desired
fair and equitable treatment in conducting way that could harm a client, a recipient of outcome and, depending on the context of
test results such as an employer, a court, or the assessment, may not be protected from
assessments with diverse and underrepre-
a health care system or test publisher. unwanted disclosure. There may be such
sented populations. They strive to use
Copyrights on proprietary assessment instances in which safeguards should be
methods that are age and language appro-
material are designed to be unavailable to taken if the disclosure of the purpose of
priate and, when needed, employ the
individuals without proper training and eth- testing will spoil or influence the results.
services of professional interpreters to
ical obligations to maintain security. These safeguards might include debriefing
achieve more accurate assessment results.
after the assessment rather than full disclo-
Application sure prior to beginning the assessment. For
example, an individual who agrees to
Psychologists strive to understand and undergo psychological assessment to
maintain their competence in the selection, demonstrate appropriateness for advance-
GUIDELINE 3 administration, and interpretation of psy- ment in their job may not receive the individ-
Psychologists who conduct chological tests as well as their client’s ual’s desired result, and results would be
psychological testing, assessment, ability to engage in and understand fully the shared with the potential employer. The
assessment process including the potential examinee agrees to release the results of the
and evaluation strive to be mindful
risks and negative outcomes that could assessment to their employer as a condition
of the potential negative impact result in addition to any positive benefits of employment. The results of the assess-
and subsequent outcome of those they may be seeking. Psychological tests ment reveal significant difficulties in job-re-
measures on clients/patients/ are continually changing through test revi- lated abilities that might not only preclude
examinees/employees, supervisees, sions, research findings about appropriate promotion but even threaten their continued
other professionals, and the or inappropriate applications or unantici- employment. This highlights the need to
pated complications, or threats to validity in recognize that there are many consumers to
general public.
using the test with a particular client popu- assessment results, including an employer
lation or for a particular purpose or in a or organizational client. The psychologist is
Rationale
particular setting. Psychologists assume an typically expected to seek the client’s
Psychologists recognize their ethical and, in appropriate degree of responsibility to informed consent and full understanding of
some situations, legal obligations regarding understand the strengths and weaknesses the range of outcomes that could result from
the prevention of negative impact that of all assessment procedures they employ, the assessment and the potential recipients
could result from their selection, adminis- to use the latest versions or forms of all who might gain access to the results before
tration, interpretation, or reporting of results tests and procedures, and to seek informa- consent is given.
from psychological tests and measurements. tion and understanding about any limita- Psychologists strive to use tests appro-
The exception to this may be forensic evalu- tions or concerns in using the tests they priately and to understand the strengths and
ations, which often require an independent have selected with the client in the setting weaknesses of the assessment procedures
opinion that may negatively impact the and for the purpose of their assessment. they use and to correct any misuse they

12 APA | Guidelines for Psychological Assessment and Evaluation


discover not only for the benefit of the client specific. A competent psychologist main- knowing how to select, administer, and
being assessed or the client or agency or tains a foundational fund of knowledge and interpret a psychological test of cognitive
sponsor requesting the evaluation but also to skill about tests and test procedures in ability, academic achievement, or emotional
maintain the reputation of the profession of general (e.g., validity, reliability, normative adjustment and functioning but also seeks
psychology and the public’s confidence that population) that supports selection and use to know and understand special education
psychologists are competent, current, and of a test instrument or assessment proce- law and requirements around eligibility for
responsible in their selection, administration, dure in a given situation. However, a specific services (Wright & Wright, 2015), as well as
and interpretation of assessment procedures. individual is rarely, if ever, a competent user the student’s cultural context, the classroom
of psychological assessment in all the set- context, and how it affects manifestation of
tings and contexts where assessment tools learning and adjustment difficulties. In
are used. Psychologists strive to develop the addition, a suitable level of knowledge about
contextual knowledge and skill to be com- best practices in classroom methods is
GUIDELINE 4 petent in one or perhaps two of the primary important to make helpful and appropriate
arenas where psychological tests are recommendations of educational interven-
Psychologists strive to consider the
employed. These primary arenas may tions based on test data gleaned from the
multiple and global settings (e.g., change as the profession evolves and/or as use of psychological tests.
forensic, education, integrated care) the professional in question develops addi- In the employment/coaching area of
in which services are being provided. tional skills and experience. At present, the practice, the competent user of psycholog-
following areas of professional practice ical tests strives to understand the purpose
Rationale tend to be the primary areas in the use of of any evaluation, who is the client, who has
psychological assessment: clinical, forensic, a legal right to access the results of an
Psychological tests are used in a variety of
neuropsychology, police and public safety assessment, and whether the procedures
settings for a variety of purposes. Validity is
psychology, educational/school psychol- selected to be used provide sufficient
not a unitary property of the test instrument.
ogy, geropsychology, industrial and organi- reliability and validity for this purpose and
Rather, validity evidence is evaluated within
zational psychology, employment selection/ this client in this context. Psychologists
the context of these multiple settings and
coaching, and integrated health care. working in this area seek to understand
purposes. In addition, most tests are devel-
Each of these practice settings calls for employment law and the legal standards for
oped within a cultural or regional context
the psychologist to develop adequate knowl- what constitutes employment discrimina-
where the test developer has an intended
edge of practice standards, legal standards, tion versus assessment of job appropriate
target population of test takers for a specific
collaborative professional roles and desired aptitudes and skills.
purpose. The psychologist, however, strives
purposes, methods and outcomes that call With clinical service providers and
to recognize when the selection and use of
for the use of psychological tests and proce- those working in health care delivery
this instrument deviates from the expected or
dures. For example, a psychologist working in systems, the competent psychologist strives
intended purpose and recognize the signifi-
a forensic setting is expected to be not only to understand how the results of any
cance and implications of such deviations.
suitably competent in their knowledge of psychological assessment will be used so
The psychologist considers these deviations
psychological testing, individual differences, that the appropriateness of that use can be
when interpreting test results for a particular
psychopathology, and other aspects of evaluated and any cautions or limitations in
client and reporting results for a specific pur-
psychological theory and research but also use of the findings can be noted in any report.
pose and within a specific context. These
appropriately knowledgeable about the legal In systems of integrated care where psychol-
deviations can include not only using a test in
context in which the results of their psycho- ogists work as part of a multidisciplinary
a setting for which it was not designed (e.g., a
logical testing will be reported and used. team, the psychologist strives to make sure
broad assessment of academic achievement
Depending on their area of practice, a compe- that the presentation of assessment results
intended as a screening tool for adults used
tent forensic psychologist might be expected is understandable for the other team
for diagnostic assessment of a child’s learn-
to know courtroom procedure; rules of members as well as the client and presented
ing difficulties) but also using a test designed,
evidence; rules of jury selection; or legal in such a way that any possible complica-
developed, and normed in one country or
definition or elements of terms such as insan- tions or limitations in the interpretation of
region of the world in a different country or
ity, dangerousness, and consciousness of guilt the findings is made known and addressed
region. The psychologist strives to under-
(Weiner & Otto, 2014). The work of neuro- in the report.
stand the significance of such cultural and
psychologists may, at times, overlap with the Psychologists also strive to be mindful of
linguistic deviations and to acknowledge
work of forensic psychology (Demakis, 2012), the problems associated with the increasing
possible influences, including limitations and
calling for attention to both legal and clinical use of the psychological tests globally, includ-
potential errors, in their use and interpreta-
issues associated with this type of special- ing delivering tests across legal boundaries of
tion of tests.
ized assessment. states, provinces, territories, or countries. In
Similarly, a psychologist working in a some instances, using psychological tests
Application
school environment with a task of identifying across legal boundaries, such as states in the
Competence in psychological assessment children in need of special educational same country, may provoke a concern about
is typically situation specific or setting services not only strives to be competent in intentionally or unintentionally circumventing

APA | Guidelines for Psychological Assessment and Evaluation 1 3


mechanisms of public protection such as adequately in this population, then such use appropriate based on empirical evidence that
state licensing laws but not necessarily issues of psychological tests across legal boundar- the normative sampling, the language or
about validity or appropriateness of the test ies may be not only inconsistent with regula- translation used, the administration proce-
use. In some situations where tests are given tory standards but may also wind up being dures employed, and the clarity and accuracy
to test taker populations that were not repre- deemed invalid, incompetent, and unethical. of the results reported are legal, reliable, valid,
sented in the normative sample, or where no Psychologists seek to use psychological and appropriate.
validity studies are available to demonstrate tests only in contexts and with populations
that the same constructs are being assessed and for purposes that are valid and

P SYCH O METRI C AND MEASUR EMENT K NOWL EDG E

GUIDELINE 5 scales, especially those that are norm refer- some manner and presented as normative
Psychologists who provide enced. Common descriptive statistics comparative or standardized scores. As
psychological testing, assessment, relevant in this regard include measures of such, knowledge of the process and assump-
central tendency (e.g., mean, median, and tions through which these groupings and
and evaluation demonstrate
mode) and measures of variation (e.g., transformations are created is typically
knowledge in and seek to variance and standard deviation). Likewise, considered essential for proficient test use.
appropriately apply psychometric correlations and other indices of association Reliability/Precision and Measurement
principles and measurement (e.g., chi-square) are commonly used for Error. According to the AERA et al. Standards,
science as well as the effects of examining the degree of convergence or the reliability/precision of scores depends
external sources of variability such divergence between two or more test score on how much scores vary across replications
scales, whereas frequency distributions of of a testing procedure, and analyses of
as context, setting, purpose, and
scores describe the varying levels of the reliability/precision depend on the kinds of
population. construct or other predicted criterion variability allowed in the testing procedure
outcome found in groups of test takers. (e.g., over tasks, contexts, raters) and the
Rationale Test Theory. Critical evaluation of the proposed interpretation of the test scores.
The organization, as well as some text and efficacy and applicability of individual test Several approaches to the estimation of
references that appear in this section, has instruments to the assessment question at reliability/precision of test scores (e.g.,
been sourced from the Recommended hand, as well as the confidence with which Haertel, 2006) vary in their applicability and
Competencies for Users of Psychological Tests, results may be interpreted and conclusions appropriateness across measurement situa-
originated by the APA CPTA in 2015. To drawn, requires working knowledge of the tions. Psychologists are encouraged to
effectively choose, administer, interpret, fundamental theories and techniques of test become familiar with various approaches to
and evaluate psychometric instruments, construction. Competency in this regard reliability/precision estimation, factors that
practitioners are encouraged to maintain typically includes knowledge of the concep- influence the index (or set of indexes) of
thorough and current working knowledge of tual foundations, assumptions, and exten- reliability/precision that is appropriate for
the psychometric principles that underlie sions of the basic premises of classical test their given situation, factors that can influ-
the design and utility of the test instruments theory (Kline, 2000), such as item difficulty, ence the magnitude of those indexes, and
they use. The primary components of this item discrimination, item and test informa- professional standards pertinent to assess-
knowledge are described under the follow- tion functions, latent trait or ability parame- ing the reliability/precision of test scores
ing headings. ters, generalizability theory (Brennan, 2001), (see Chapter 2 in AERA et al., 2014).
Descriptive Statistics. Descriptive statis- and/or item response theory when appro- Validity and Meaning of Test Scores.
tics are the foundational components of test priate (Embretson & Reise, 2000). In this According to the AERA et al. (2014)
construction and interpretation. Psycholo- regard, psychologists strive to understand Standards, validity refers to “the degree to
gists should be familiar with the basic the advantages and disadvantages of these which evidence and theory support the
descriptive functions defining the composi- test theories in operationalizing the interpretations of test scores for proposed
tion and distribution of standardization construct being measured to ensure appro- uses of tests” (p. 11). Thus, psychologists
samples upon which instruments are based priate inferences are made. strive to understand that validity is not an
and apply that knowledge when choosing Scaled Scores and Transformations. inherent property of a test but rather refers
instruments and/or interpreting individual Individual results of most tests are derived to the degree to which evidence and theory
results. Similarly, suitable knowledge of the from item responses, which are grouped support the use of a test for a particular
characteristics of means and standard together in some manner to form scales and purpose. In evaluating tests for a particular
deviations is critical when comparing then subsequently either reported as raw purpose, psychologists should become
individual performance on various test scores or transformed mathematically in suitably aware of the five sources of validity

14 APA | Guidelines for Psychological Assessment and Evaluation


evidence described by the AERA et al. indices of association degree of conver- standardization sample(s) on whom the test
Standards: validity evidence based on test gence or divergence found in groups of test was originally constructed. Thus, psycholo-
content, response processes, internal struc- takers, as well as other basic statistical gists strive to remain cognizant of the
ture, relations to other variables, and testing principles, may be found in Keller (2006). In specific setting in which a test will be used,
consequences. For a valid inference to be addition, a comprehensive review of funda- particularly if this setting differs from the
drawn based on a test score, psychologists mental measures of association as well as original setting or purpose for which the test
are encouraged to demonstrate that the various models of prediction and test con- was designed. Similarly, when a test is used
scores generated are directly, demonstrably, struction prediction may be found in for purposes that differ from those investi-
and consistently related to the outcome or Bandalos (2018). gated by the test developer, and/or when the
purpose for which the test instrument is Psychologists strive to understand and characteristics of the population tested
used. Conclusions and/or recommenda- know when to apply the various methods for differ from the characteristics of the publish-
tions resulting from use of instruments are representing test information (e.g., achieve- er’s standardization sample, psychologists
expected to be fair; minimize bias; and are ment/mastery levels, diagnostic classifica- are encouraged to evaluate the validity
consistent with applicable standards of tions, raw scores, standard scores, percentiles). evidence for this specific use.
practice, policies, and laws. Relevant concepts include types of scales,
In addition to seeking an understand- types of scores (e.g., raw, transformed,
ing the different sources of validity evidence, percentile, standard, norm-referenced, crite-
psychologists strive to develop an under- rion-referenced), scale score equating, and
standing of strategies for obtaining, evaluat- methods for establishing cut scores (e.g.,
ing, and establishing each source of validity Cizek & Bunch, 2007). Psychologists are also
evidence; the limits of any one source of encouraged to be aware of the advantages
validity evidence; and the implications of and disadvantages of automated scoring.
how different sources of evidence can be There is no absolute standard for estab-
integrated into a comprehensive validity lishing that an inference one desires to make
argument to support the use of a test for a based on test scores is “valid” for a particular
particular purpose (Kane, 1992, 2013). purpose. Thus, psychologists strive to be
The test developer and the test users able to locate and evaluate available validity
may be considered jointly responsible for evidence to judge the suitability of using a
development and evaluation of validity test for an intended purpose. Psychologists
evidence to support the use of a test for a seek to consider the positive and negative
particular purpose, especially when the test consequences of test administration and
is used in a specialized setting and/or with a score use, to help in ensuring that the testing
specific population whose characteristics process will provide more good (e.g.,
may differ from the original population or diagnostic information that is useful for
setting upon which the test was originally educational or clinical purposes) than harm
developed. Similarly, when interpreting test (e.g., negative stereotyping) to examinees.
results in settings and with populations that In addition to the AERA et al. (2014)
differ from those studied by the test devel- Standards, guidance for evaluating the valid-
oper, psychologists strive to account for the ity of the use of a test for a particular purpose
measurement effects likely to be associated can be found in the Principles for the Valida-
with these differences and report these differ- tion and Use of Personnel Selection Procedures
ences (e.g., restrictions in range and base rate (Society for Industrial and Organizational
of outcome criterion; Finn, 2009). Psychology, 2018) as well as in federal
employment statutes such as the Civil
Application Rights Act Title VII (1964, 1991) and Part
1607 of the Equal Employment Opportunity
Psychologists may familiarize themselves
Commission (1978), and the Americans
with basic statistical principles related to
with Disabilities Act (1990).
test validation by reviewing available
When psychologists evaluate the valid-
knowledge sources and/or CE opportuni-
ity of inferences drawn from test scores, it is
ties. In this regard, although certainly not
typically for use of scores in a given setting
the only source available, an excellent prac-
or with a given group of individuals. Valida-
tical review of descriptive statistics, includ-
tion evidence presented by test developers
ing measures of central tendency, variation
and publishers primarily addresses the use
characterization of normal curves and fre-
of the test scores for specific stated proposes
quency distributions, correlations and other
and with subject cohorts similar to the

APA | Guidelines for Psychological Assessment and Evaluation  1 5


SELECTI ON, ADMI NI STR AT IO N,
A N D S CORI NG OF TES TS

GUIDELINE 6 Application • Make sure the tool is accessible, appro-


Psychologists who conduct priate for the purpose, and in the lan-
To choose the best test or instrument for the
psychological testing, assessment, guage that one would need to use, within
testing, assessment, or evaluation purpose
the context of evidence-based practice.
and evaluation endeavor to select for the population, setting, and context at
(a) assessment tools that hand, psychologists strive to determine who • Become familiar with the administration
demonstrate sufficient validity they are evaluating, for what reason, where, instructions, scoring, and accurate com-
and under what conditions, as well as what pletion of test protocols and record forms.
evidence for their uses, sufficient
domains are to be addressed. The more A thorough review of the items also pro-
score reliability, and sound information gathered prior to the testing, vides psychologists with an opportunity
psychometric properties and (b) assessment, or evaluation and an under- to evaluate the content validity of the
measures that are fair and standing of these characteristics or variables instrument with particular reference to
appropriate for the evaluation should assist in selecting a reliable and valid the referral question and/or the purpose
purpose, population, setting, and test or instrument to use among the myriad to which the results will be applied.
ones available commercially or in research.
context at hand. • Practice and observe the administration
Choosing a test or instrument may seem
of an instrument with an appropriate
daunting, but there are ways to make deci-
Rationale colleague. There is no better way to learn
sions efficiently. For example, knowing the
a test or instrument than to be the exam-
Psychologists seek to provide assessment question(s) to be answered ahead of time
inee and know what it is like to be asked
services only within the boundaries of their shortens the selection time. Consulting with
to solve problems, rate behavior, or dis-
competence that is based on their educa- colleagues who conduct testing, assess-
close personal information.
tion, training, supervised experience, con- ments, or evaluations or who are engaged in
sultation, study, and professional experience. test or instrument development or research • Attend training seminars or workshops
Psychological testing and other assessment in a particular area may prove very beneficial. with the test or instrument’s author(s) or
procedures are areas of professional prac- Psychologists are encouraged to experts in the field.
tice in which psychologists have been become familiar with the psychometric
• Explore publishers’ websites for up-to-
trained and are uniquely qualified to con- properties of any test or instrument they use
date information on their tests and
duct. Psychologists are thus encouraged to to make screening, diagnostic, or interven-
instruments.
be knowledgeable about and account for tion decisions and/or status recommenda-
the impact of test results in diverse popula- tions. Psychometric characteristics of tests • Join a professional listserv where intel-
tions and across different settings, as well and other instruments include but are not lectual discussions take place.
as the limitations of measures even when limited to standardization, reliability, and
• Attend a graduate class or several ses-
guidelines are followed for test selection. validity. These psychometric characteristics
sions of a course to learn about new
When conducting assessments and evalua- are foundational to decision-making and
developments in evaluation or to learn
tions, psychologists are aware of the form the basis of interpretation. The follow-
about specific tests or instruments.
responsibility that may be ascribed to them ing steps, adapted from Alfonso (2004), may
for the appropriate choice of measures that be considered by psychologists to assist in Several tests and measurement texts and
reflect evidence-based practice, sound psy- selecting the best test or instrument to use: resources are available for psychologists to
chometric properties, and awareness of the • Read and evaluate reviews of the tests or update their psychometric knowledge base
context, including patient characteristics, instruments and research studies that and test, assessment, or evaluation skills.
that can impact test results. Careful and used them, including meta-analyses, sys- Some examples include Bandalos (2018);
informed measurement selection benefits tematic reviews, and specialized practice Graham et al. (2013); Psychological Testing:
the intended examinees by ensuring valid parameters, in addition to edited hand- Principles, Applications, and Issues (Kaplan &
assessment, fair utility of results, and gen- books and volumes on assessment. Saccuzzo, 2017); and Standards for
eration of recommendations that are appli- Educational and Psychological Testing
cable to the intended context. These • Read the test or instrument publisher’s (AERA et al., 2014). Reading or even perus-
guidelines are consistent with the standards technical manual(s) and review carefully ing these resources can be helpful when
articulated in the most recent edition of the design, standardization sample(s) evaluating the psychometric properties of
Standards for Educational and Psychological characteristics, descriptive statistics of tests and other instruments and in selecting
Testing (AERA et al., 2014). standardization sample(s), composition the best one to answer the referral ques-
and independence of scales, and support- tions and address the purpose of the testing,
ing evidence of validity and reliability. assessment, or evaluation.

16 APA | Guidelines for Psychological Assessment and Evaluation


GUIDELINE 7 It is the psychologist’s challenge to inte- by a particular test can be particularly
Psychologists who conduct grate data from multiple sources. This pro- important considerations in test selection.
psychological testing, assessment, cess includes drawing upon research, theory, There is also increasing literature to indi-
and clinical experience in situations where cate the importance of assessing effort,
and evaluation strive to use multiple
different data sources are seemingly incon- both in symptom presentation and with
sources of relevant and reliable gruent (Bram & Peebles, 2014). Likewise, suboptimal performance, when conduct-
clinical information collected psychologists strive to recognize the advis- ing psychological testing. Examinees may
according to established principles ability of using multiple methods more underperform for many reasons, and not
and methods of assessment. often than not. For example, standardized, adequately assessing effort limits the
norm-referenced tests, interviews, behavior interpretation of test results. Without sys-
Rationale observations, performance-based mea- tematically assessing effort, it becomes
sures, patient–examiner relationship, and difficult to discern if variability and pat-
Individual performance on psychological rating scales are some methods that may terns of test results reflect actual perfor-
tests is only one piece of assessment and is assist in gathering the information needed mance or the influence of low effort,
conceptualized in a context of presenting to address the concerns of the client. It may motivation, or some other factor besides
concerns, reason for referral, background, be rare but nonetheless important to test, ability. Psychologists strive to conduct
course of illness, influential factors, and pop- assess, or evaluate clients across settings assessment in adherence with standard-
ulation-specific contributions that are such as school, home, and place of work. ized administration procedures to support
secured from multiple sources. These may Psychologists should strive to be aware of valid interpretations of norms, classifica-
include clinical interview with the examinee, situation-specific behavior and to address tion decisions, comparisons, and other test
clinical interview with sources other than the the possibility or variable functioning based score–based inferences and applicable to
examinee, completion of valid self-report on setting. Psychologists attempt to remain the circumstances. Adhering to standard-
and third-party report measures, observa- cognizant of the importance of interpreting ized testing conditions will minimize con-
tion of behavior, and review of relevant tests and measures in a way that is consis- founds that could lead to misinterpretations
records. Additionally, psychologists strive to tent with their intended use, empirical liter- of test results. Psychologists are also
recognize that more than one reliable and ature, and other evidence-based factors. encouraged to judiciously test the limits of
valid measure is appropriate to assess all standardized administration when doing
relevant domains of functioning to examine so is necessary to answer referral ques-
convergence and deviation of findings. tions, determine meaningful treatment
Convergence and divergence of information implications, and/or clarify conditions
from multiple sources informs the assess- under which functioning varies (see Bram
GUIDELINE 8
ment process and increases confidence in & Peebles, 2014).
and appropriate utility of test results (AERA Psychologists who conduct
et al., 2014). Information from multiple psychological testing, assessment, Application
resources is valuable and useful but may not and evaluation strive to be aware of
be feasible in some situations. Psychologists strive to select the most
the need for test selection, scoring,
appropriate test or instrument for a spe-
and administration to reflect the
Application cific purpose and seek to cultivate knowl-
appropriate normative comparison, edge of testing, assessment, or evaluation
Best practices in testing, assessment, and situational influences, effort, and practice in the context area and associ-
evaluation suggest a multisource, multi-
standardized administration as ated norms when more than one norma-
method, and multisetting approach because tive set is available. Knowledge of test or
indicated.
human behavior and functioning are highly instrument characteristics such as psy-
complex (Sattler, 2014). Typically but not chometric properties (presented earlier),
Rationale
always, the younger the client, the more basis in theory and research, and norma-
variable behavior is with different people In psychological assessment and testing, tive data (where appropriate) is typically
and across settings (Bracken & Theodore, in psychologists recognize the importance of expected to influence test selection. For
press). Similarly, it is not uncommon to considering age, gender, ethnicity, primary example, normative data or decision rules
obtain moderate to markedly different rat- language, and individual influences when may not be accurate when (a) important
ings from various individuals in the client’s selecting and administering appropriate features of the client are not represented
life. Thus, multiple sources including par- tests. This procedure allows for valid nor- in the norm group, (b) administration or
ents, extended family members, colleagues, mative comparisons, classifications, ipsa- scoring procedures do not follow those
supervisors, teachers, and sometimes com- tive profiles, and other interpretations to used in standardizing the test or instru-
munity members are typically considered inform recommendations based on test ment, (c) characteristics of the test or
important in the testing, assessment, or results. Additionally, the agedness of the instrument may affect its utility for the
evaluation process (Achenbach, 2017; norms and the continued relevance and situation (e.g., ceiling and floor effects),
Burns & Haynes, 2006; Stage et al., 2006). definition of the constructs being measured (d) the test or instrument contains tasks

APA | Guidelines for Psychological Assessment and Evaluation  1 7


that are not culturally relevant to the cli- or instrument under consideration, the be alert to common mistakes, which include
ent, or (e) the validity evidence does not definition of the construct that the test or (a) miscalculation of base and ceiling, (b)
support decisions made on the basis of instrument purports to measure, and the simple arithmetic errors, (c) reversal and
the obtained data. In these cases, alterna- definition of the test or instrument purpose discontinuance mistakes, (d) failure to record
tive instruments and/or other data and its intended context of use. examinee comments in addition to scores,
sources might be considered. Standardized administration is most and (e) imprecise timing on timed tests.
Psychologists strive to remain aware of important in that the validity of the responses Knowledge about procedural require-
the importance of integrating examinee leading to data points may be compromised ments, confidentiality of information,
motivation and standardized assessment when adherence to standardization is not communication of results, and security are
of effort (e.g., symptom validity testing, met. Important points that contribute to important for many applications, as is knowl-
performance validity testing) into perfor- standardization of administration include (a) edge of standardized administration and
mance interpretation. a high level of knowledge of instructions scoring procedures and understanding a
Psychologists seek an understanding given the presentational variance within psychologist’s ethical and legal responsibili-
of how the construction, administration, instrument; (b) awareness of instructions on ties and the legal rights of test takers. Psychol-
scoring, and interpretation of tests or feedback, query, prompts, and response to ogists are encouraged to understand the legal
other instruments match the purpose of questions; (c) facility with supplemental and ethical issues related to the release of
testing. Mismatches in these dimensions material and audio/visual components; (d) test data, including issues of confidentiality,
between the selected test or instrument inclusion of behavioral observations; and (e) depending on the context of the testing,
and the testing purpose are important compliance with equipment and placement assessment, or evaluation and the character-
factors that psychologists strive to consider, of materials. istics of the client such as motivation or effort
as these may invalidate usual interpretation Scoring of responses lends itself to error expended to perform successfully. Psycholo-
of a client’s performance. For psychologists more than most other aspects of testing in gists strive to be able to explain results and
to select an appropriate test or instrument that there is often little uniformity within limitations to diverse audiences, and to
for a particular use, it is important that they instrument and errors in scoring are unforgiv- include in the report the purpose of the test,
seek to understand and consider the ing in that the examiner cannot typically assessment, or evaluation and the setting in
intended use of any scores, the method and return to make corrections but rather the which it occurred.
procedures used to develop or revise the test subtest becomes spoiled. Examiners strive to

D IVERSE, UNDERREPR ESENT ED,


A N D VULNERAB LE P OP UL AT IO NS

GUIDELINE 9 assessment services to individuals goes and interpretation may be influenced by


Psychologists who conduct beyond the consideration of individual differ- individual diversity factors (e.g., age, dis-
psychological testing, assessment, ences and includes a conceptual framework ability, race, ethnicity, gender, religion/spir-
that limits inferences on the sole basis of ituality, sexual orientation and gender
and evaluation strive to practice
group labels as to include the social and cul- diversity, social class, language, accultura-
with cultural competence. tural world of the client and the intersection- tion, immigration/refugee status; APA,
ality of the client’s identities, as well as the 2017b) and also to consider the intersection
Rationale influence of cultural identities of client and of cultural identities. Given the current
The foundation to the integration of individ- examiner in the therapeutic relationship or abundance of scholarship related to race/
ual differences and cultural identity to psy- any evaluative setting. Psychologists strive ethnicity as well as the scholarship focused
chological assessment is based on the value to understand how culture can interact with on other identity groups (e.g., age, disability,
that every person assessed should have an every aspect of the assessment process and race, ethnicity, gender, religion/spirituality,
opportunity to demonstrate their standing that they adapt their practices as needed. sexual orientation and gender diversity,
on the talents, capacities, and traits being social class, language, immigration/refugee
assessed without being impeded by con- Application status; APA, 2017b), psychologists have
struct irrelevant sources. Therefore, psychol- strong scientific resources and frameworks
Psychologists strive to gain knowledge of
ogists endeavor to select and use instruments, to consider when conducting psychological
the cultural identities of their clients and the
assessment techniques, interpretations, and assessments. Psychologists endeavor to
state-of-the-art literature regarding the
analysis that do not introduce, perpetuate, or learn about their own cultural identities and
best fit of the client with assessment proce-
contribute to biased or unfair results. cultural attitudes and beliefs to minimize
dures and instruments. Psychologists strive
Providing multiculturally competent the negative influence of these issues in
to consider how test administration, results,

18 APA | Guidelines for Psychological Assessment and Evaluation


their professional competence with diverse authority, factors that limit the generaliz- impacts standard validity, by consulting
clients. Psychologists cultivate an under- ability of findings derived from most psy- experts or studying research that docu-
standing that achieving cultural compe- chological instruments (Sue & Sue, 2013). ments the use of the test with the examin-
tence is a lifelong process that involves, in Similarly, the test construct may function ee’s specific group. Examiners strive to
addition to acquiring cultural knowledge, differently in different populations, with obtain the training to competently assess
continuous cultural humility (Hook & research accumulating to suggest that the individuals from diverse groups and learn
Watkins, 2015), self-awareness and evalua- scores of some instruments did not capture about the range of testing procedures’ appli-
tion of the attitudes, values, interactions, the intended psychopathology and unique cability across diverse groups. Psychologists
and power dynamics with the clients. When cultural differences across groups (Janssen, aspire to understand their own worldviews
the use of gender, race, and ethnicity is 2011; Kim et al., 2009; Kim et al., 2011). and sociocultural histories’ impact on the
restricted in the testing, scoring, interpreta- Cultural factors, attitudes, and attitudes, beliefs, and values they hold with
tion, or analysis by legal requirements in demographic characteristics of the examinee individuals with characteristics different
certain fields (e.g., employment), examin- also impact the applicability of the standard from their own and consider how these fac-
ers endeavor to familiarize themselves with administration and related factors of the tors impact their approach to assessment,
legal and regulatory requirements to use assessment process, such as the relationship interpretation of psychological test data,
test information in a manner consistent between examiner and examinee (Butcher et use of labels, and clinical decisions.
with those regulatory standards. al., 2016). For instance, test-taking demands
that are irrelevant to the construct being
measured and that impact an individual’s
ability to demonstrate their ability such as
education, mastery of the test language, GUIDELINE 11
GUIDELINE 10 diverse values, expectations, acculturation,
Psychologists who conduct
and psychosocial stresses derived from their
Psychologists who conduct psychological testing, assessment,
minority status may compromise the
psychological testing, assessment, and evaluation endeavor to
test-taking performance and subsequently
and evaluation aspire to ensure render the findings invalid (Diaz-Santos & recognize the nature of and
awareness of individual differences, Hough, 2016). Personal values, expectations, relationship among individual,
various forms of biases or potential and attitudes of the examiner equally have cohort, and group differences.
biases, cultural attitudes, been found to impact the judgment of
examiners to the point that it may diminish Rationale
population appropriate norms, and
the accuracy of their test selection, use, and
potential misuse of data. Assessment and interpretation of psycho-
interpretations (APA, 2003).
logical tests involve an understanding of the
Rationale similarities and differences within the
Application
Research in many areas of specialty and examinee, the cohort to which the exam-
When choosing a test to administer, exam- inee belongs, and the group norm samples
proficiency has established that demo-
iners endeavor to use the available informa- used in test construction. Some norm-refer-
graphic and individual factors such as race,
tion regarding the test psychometric enced tests (i.e., using standard, scaled,
ethnicity, gender, age, geography, dominant
properties, including measurement equiva- percentile and T-scores) imply categories of
language, socioeconomic status, and cul-
lence and standardization sample, to evalu- score deviation based on comparisons of
tural variables of the examinee exert an
ate the fit with the examinee’s individual the participants’ performance with norma-
important impact on the validity and reli-
and demographic characteristics. Examiners tive data. Scores that are outside the broad
ability of results of psychological tests
strive to become familiar with the examin- range of average in a normal distribution
(Sandoval et al., 1998). These individual
ee’s culture and subcultural context to com- may be classified as deviant from the mean.
factors, to the extent that they make the
pare with the culture of the normative Due to the inherent limitations in the diver-
examinee deviate from the test’s normative
sample and the test development and sity and variability of a test normative sam-
standards, may modify the way in which
decide if the test will afford a fair assess- ple, there is a potential that the
personal characteristics will be manifested
ment. Examiners strive to avoid using a test characteristics of an individual examinee
or are interpreted by the examiner and may
in a manner or for a purpose not supported are poorly represented or are completely
provide a profile that is completely at odds
by evidence-base studies. When having to absent in the normative group. This means
with the reality of the examinee. Individuals
modify a test or administration procedure that individuals who are not appropriately
from nondominant cultural, racial/ethnic,
to fit the characteristics of an examinee, represented in the normative sample (e.g.,
and other identity groups have been found
examiners aspire to consider the impact of due to cultural, racial, age, and ethnic differ-
to demonstrate unique presentation of
those changes on the test results. Similarly, ences) have a greater chance of misinter-
symptoms, have different awareness and
examiners aspire to understand the cultural pretation of their performance because of
explanation of psychological distress, and
idiosyncrasies in performance and response different individual and cultural characteris-
are more likely to distrust providers and
style, including cultural response bias that tics rather than poor performance.

APA | Guidelines for Psychological Assessment and Evaluation 1 9


Even when the individual examinee can GUIDELINE 12 the Trail Making Test, would be interpreted
be placed within a cohort of the general Psychologists who conduct as indicating impairment if norms for
normative group in characteristics such as psychological testing, assessment, younger people were used. The growth in
race, ethnicity, gender, education, or the older adult population means that many
and evaluation seek to consider the
geographic issues, it is inevitable that psychologists who do not have specialized
members from certain minority or vulnera- unique issues that may arise when training in assessment of older adults may
ble groups will still differ in some variables. test instruments and assessment encounter older individuals in a variety of
For instance, it has been found that most test approaches designed for specific settings. There are important issues such as
norms do not include information regarding populations are used with diverse the necessity for test norms specific to older
the socioeconomic status of the population populations. adults including subgroups such as those
(Dana, 2001). Socioeconomic status has older than age 85 and those with low educa-
been found to be a variable that, in cases of Rationale tional attainment or low-quality educational
high socioeconomic status, eliminates experiences because of historical social
racial/ethnic differences in certain psycho- Psychological assessment instruments and problems such as segregation.
logical instruments (Beiser & Gotowiec, interpretive methods are culture specific Psychologists are encouraged to recog-
2000; Thakker et al., 1999). Similarly, many because they are developed from a specific nize that a psychological test needs to have
neuropsychological test norms were devel- sociocultural context, most often Western. established research-based validity and
oped without sufficient numbers of older This cultural context is also explicitly or reliability in the culture and language in
adults. Older adults are at high risk of being implicitly linked to the individual character- which it was constructed before it can be
misclassified as having significant impair- istics represented in the population used in considered appropriate for adaptation in
ment when age, education, and race/ethnic- the test standardization and may be less other languages and cultures, which may be
ity specific norms are not used (Miller et al., applicable to groups with other characteris- necessary for clients with less acculturation
2015; Schneider et al., 2015). tics and cultures. Assessment techniques, to the Western society and whose English is
data-generating procedures, and standard- not the dominant language (Butcher et al.,
Application ized instruments designed for a specific 2016). Tests can often be translated, adapted,
population have their validity and reliability and renormed in diverse cultural and
Psychologists strive to consider the examin- tied to this normative group and cannot be demographic groups following strict guide-
ee’s individual and demographic charac- assumed to apply to other groups unless lines for translation, construct analysis, and
teristics when choosing a test to administer, they undergo adaptations and validity, reli- norming to ensure that alternative versions
vis-à-vis the test’s normative sample to ability, and measurement equivalence have of the test are equivalent to the original.
assess the test appropriateness to the been tested across culturally diverse sam- When a test administration or proto-
examinee. Psychologists aspire to under- ple groups (APA, 2017b). col requires translation to match the
stand the test manual information regard- Psychologists endeavor to use only language dominance of the examinee
ing the characteristics of the sample, the properly up-to-date normed, standardized, because a test version in the client’s
procedures for examining between-groups and translated measures chosen specifically language and with appropriate cultural
differences in test performance, and use based on the client’s ethnic group, accultur- characteristics has not been developed, a
the meaning of this information when con- ation level, language proficiency, education number of strict guidelines have been
sidering the scores of an examinee and the level, socioeconomic status, age, disability recommended by the International Test
interpretation of tests results. Examiners status, and other relevant demographic Commission (2017). These translations
strive to culturally contextualize tests factors. Recent advances in psychometrics can include trained professionals conduct-
results with examinees who do not closely have made significant progress examining ing forward and back translations focused
match the characteristics of the normative the measurement equivalence and differen- on meaning including local and cultural
group. Psychologists endeavor to consult tial item functioning between individuals context. Nevertheless, those translated
or review scientific literature that helps from groups different from the reference tests or protocols, if not normed, may
them understand the potential limitations population for which the test was found to produce less meaningful results.
and risks of using certain normative cate- be reliable. There are many psychological
gories on examinees from a minority or tests with strong scientific basis for applica- Application
vulnerable group. tion with Western diverse groups with
adequate levels of acculturation and English Although it is nearly impossible to match a
language dominance. test or assessment instrument to all the
For many areas of assessment, includ- diverse characteristics of the client/
ing cognitive function, it is important for patient/examinee, psychologists endeavor
psychologists to strive to use age-appropri- to familiarize themselves with the charac-
ate test norms. For example, slowed process- teristics and cultural origin of their instru-
ing speed is a normal part of cognitive aging. ments in order to decide whether the test
As a result, average scores for older adults taker would be fairly assessed and fairly
on tests requiring fast performance, such as compared with the normative group. In

20 APA | Guidelines for Psychological Assessment and Evaluation


particular, psychologists strive to use test Psychologists are encouraged to famil- When the evaluation requires the use
versions that better match the most prom- iarize themselves with the characteristics of of nonresearched accommodations or
inent characteristics and culture of the translated versions when they need to use modifications of the test administration,
examinee. One method to advance accept- them, including the impact of language stimuli, or method to accommodate the
able levels of matching is to include a psy- adaptations on the construct of the test. client’s needs or characteristics, the
chological examination with a thorough Examiners attempt to avoid choosing trans- psychologist seeks to make the appropriate
psychosocial interview that provides the lations that have not been researched regard- adjustment to the interpretations and
client information necessary to match to ing whether they show results that have report this caveat in the report of findings
the best possible instruments. different meaning across groups (AERA et al., with a detailed description of the modified
Psychologists endeavor to assess the 2014). Moreover, psychologists strive to circumstances.
language dominance and capacity of avoid using ad hoc translations. When Psychologists strive to incorporate in
nonmonolingual clients to determine the assessing the applicability of an instrument the interpretation and conceptualization of
appropriateness of the intended assessment that has not been adapted to the character- test results the cultural factors that have
instrument. Psychologists strive to interpret istics of the client (e.g., culture of origin, been found to impact psychological assess-
and report the results of the assessment acculturation, language dominance, ethnicity, ments, including issues such as historical
within a cultural context, and when in doubt, education, gender, age), psychologists trauma effects, spirituality, traditional belief
psychologists may consult with experts at endeavor to find literature or pilot studies that systems, collectivistic orientation, and
any time of the assessment process in order allow them to assess the validity of the test acculturation.
to ensure cultural competence (Aceve- for the specific client/examinee including the
do-Polakovich et al., 2007). differences in performance (APA, 2017b).

TR A IN ING AND S UPERVIS O RY


Q UA LIFI CATI ONS AND R O L E

GUIDELINE 13 introducing the standards of practice in include specific knowledge, skills, and appli-
Psychologists who educate and assessment as expectations of competence. cation experiences beyond general program-
train others in testing, assessment, Those who teach assessment strive to be matic requirements. These may include
knowledgeable of the standards of practice, coursework in psychometrics, cognition and
and evaluation strive to maintain
test instruments and their applicability, intelligence, administration and interpreta-
their own competence in training ongoing revisions of assessment and evalua- tion of performance-based and self-report
and supervision and competency in tion measures, and new methods of assess- measures of personality, integration of data,
assessment practice. ment and evaluation that are applicable to and reporting of results and the application
the populations for whom psychologists or of findings to recommendations and treat-
Rationale their students are providing services. As ment. Psychologists who educate and train
articulated in the APA Guidelines for Clinical students strive to be aware of the develop-
Consistent with the APA Ethics Code, psy-
Supervision in Health Service Psychology, mental competency expectations of stu-
chologists not only develop competence but
psychologists who supervise are encouraged dents at the practicum, internship, and
make efforts to ensure they maintain compe-
to include supervision in their efforts to readiness for practice levels (APA, 2012).
tence (2.03 Maintaining Competence; APA,
maintain competence (APA, 2015a). Psychologists who teach assessment and
2017a). Such efforts should optimally be
evaluation but do not provide the experien-
deliberate given studies have found that the
Application tial practicum or clinical experience are
rapid increase in the amount of information
encouraged to ensure that the external
available leads to a decreased ability to keep A primary mechanism through which psy-
supervisors meet the professional practice
up to date (Neimeyer, Taylor, & Rozensky, chologists can maintain their competence is
and knowledge-based competencies that
2012). Training and supervision are consid- through participation in CE or continuing
they are expected to supervise.
ered core competencies in health service professional development (Neimeyer et al.,
Psychologists who train and supervise
psychology that require deliberate training 2014). At their most effective, such programs
students, employees, and others consider
(Falender et al., 2004). Further, the APA include both a didactic component and an
engaging in CE that specifically focuses on
Standards of Accreditation for Health Service interactive component (Neimeyer, Taylor, &
advancements in the teaching, supervision,
Psychology require training in assessment as Cox, 2012). Psychologists who educate and
and practice of testing, assessment, and
a profession-wide competency. Licensing train students strive to remain aware of and
evaluation. Consultation and supervision of
boards may view training and supervision as to meet the current profession-wide compe-
supervision are often effective mechanisms
the practice of psychology, thereby tency expectations in assessment that
to maintain one’s competence. Psychologists

APA | Guidelines for Psychological Assessment and Evaluation  21


are mindful of the recommendation in the GUIDELINE 14 Application
Guidelines for Clinical Supervision in Health Psychologists who supervise Psychologists who supervise individuals
Service Psychology (APA, 2015a) that, employees or individuals who lack who will engage in testing, assessment, or
Education and training in supervision
training in testing, assessment, and evaluation are first encouraged to gain
should include the following: models and
evaluation strive to ensure that understanding of the relevant legal and reg-
theories of supervision; modalities; relation-
supervision ultimately provides ulatory documents that dictate allowable
ship formation, maintenance, rupture and
scope of practice for the supervisee’s profes-
repair; diversity and multiculturalism; examinees/clients with testing,
sion. Next, a baseline understanding of the
feedback, evaluation; management of assessment, and evaluation that supervisee’s level of competence can be
supervisee’s emotional reactivity and inter- meets the ethical and professional obtained. Self-report from the supervisee is
personal behavior; reflective practice; appli-
standard of care and scope of typically considered a necessary, but not
cation of ethical and legal standards;
practice. sufficient, method to assess competence.
decision making regarding gatekeeping; and
The supervisor strives to observe the individ-
considerations of developmental level of the
Rationale ual conducting the testing, assessment, or
trainee. (p. 36)
evaluation with someone other than a
Several sections of the APA Ethics Code patient/client to make decisions about level
speak to the needs to ensure that psycholo- of competence and need for training.
gists only delegate work to others who they Although training might include didactic
know have the requisite competencies to presentations or readings, ideally the individ-
perform such work (2.05 Delegation of ual who is supervised could watch the super-
Work to Others; APA, 2017a). Further, psy- visor engage in the activity they will be
chologists specifically do not allow testing, conducting and then the supervisor could
assessment, or evaluation to be done by watch the individual. Further, psychologists
unqualified persons, except when con- strive to ensure that assessment of contin-
ducted for training purposes and with ued competence is conducted at regular
appropriate supervision (9.07 Assessment intervals to ensure fidelity to the require-
by Unqualified Persons; APA, 2017a). ments for proper administration.

TECH N OL OGY

GUIDELINE 15 in more recent times, this use has expanded essential criteria for evaluating technology
Psychologists who use technology to include internet-based administration enhanced measures are reliability, validity,
when testing, assessing, or platforms facilitating access to multiple test and fairness.
instruments, some of which are electronic
evaluating psychological status
presentations of traditional (legacy) psycho- Application
strive to remain aware of metric instruments originally designed for
technological advances; of the Inasmuch as computer technology, test
paper-and-pencil administration. Other
instrument usage, and new instrument
influence of technology on assessment instruments are specifically
design are constantly evolving, the respon-
assessment; and of standard designed for electronic presentation, taking
sibilities and challenges to the psychologist
practice, laws, and regulations in advantage of the unique presentation,
practitioner using these modalities are
response, reporting, and data-gathering
telepsychology. likewise substantial. Insofar as many or
capabilities of this medium (Butcher, 2006;
most (legacy) tests are now electronically
Butcher et al., 2009; Way & Robin, 2016).
Rationale mediated in one way or another in regard to
Finally, and most recently, advances in com-
scoring, administration, and/or interpreta-
In the past 50 years, advances in technology puter technology, big data analysis, and
tion (Wahlstrom, 2017), when using legacy
have greatly impacted the field of psycholog- gaming design have facilitated the emer-
tests adapted for electronic presentation,
ical assessment (Butcher, 2006). Originally, gence of completely new paradigms of
psychologists are encouraged to review
use of computers in psychological assess- assessment using interactive video for tradi-
with care available information and valida-
ment practice was primarily limited to auto- tional interviews and/or real-time role-play
tion evidence documenting the process
mated scoring of paper-and-pencil tests, simulations, virtual reality exercises, big
through which these instruments have been
reporting of scores on these tests, and occa- data analysis, and other specialized diag-
adapted, including issues of equivalence in
sionally presentation of simple interpretative nostic techniques (Wahlstrom, 2017). As
regard to internal consistency, predictive
hypotheses based on these scores. However, with all other tests and assessments, the

22 APA | Guidelines for Psychological Assessment and Evaluation


validity, and/or interpretation across al., 2014; Butcher et al., 2009; Wahlstrom, strongly encouraged to review/access this
modalities (Butcher et al., 2009). 2017). Psychologists are also encouraged to resource periodically to maintain requisite
It should also be noted that use of consider potential pitfalls of comput- knowledge and competence in critical tech-
assessment instruments incorporating er-based assessment and computer-gener- nology-related areas.
elements of interactive real-time video is also ated results (e.g., potential disruption of the In addition, certain organizations are
likely to fall within the purview of telepsychol- diagnostic alliance; see Rosen et al., 2016). dedicated to the development and presen-
ogy and, in this regard, psychologists are tation of training programs in computer
strongly encouraged to be familiar with the technology focusing on education and
Guidelines for the Practice of Telepsychology psychology. For example, the Association for
(APA, 2013), as many of the issues described the Advancement of Computing in Educa-
in those guidelines are likely to be directly GUIDELINE 16 tion maintains a searchable database of
relevant to use of these instruments. more than 100,000 articles and abstracts in
Psychologists who conduct services
Insofar as some concern has been computer technology.
using technology for online or
expressed regarding the use of adapted Last, psychologists whose assessment
legacy tests (i.e., those developed and in-person testing, assessment, and practices are deeply rooted in technology
standardized prior to electronic enhance- evaluation make every effort to and/or are in positions of primary responsi-
ments in administration, scoring, and inter- ensure their own competency. bility for developing and maintaining
pretation), it is important to ascertain the technology-based assessment programs
degree to which assumptions are based on Rationale and products within their organizations may
the results of electronically presented tests. wish to consider advanced training leading
The past 20 years have seen explosive
Psychologists strive to evaluate carefully the to formal certification in various informa-
growth and development in various areas of
publisher’s technical manual data in regard tion-technology-related functions.
information technology (IT). Developments
to equivalence or norms, effects of electronic
in areas of new hardware, software, network-
presentation, and/or scoring, as well as
ing, and data storage have become ubiqui-
validation of interpretative predictions
tous in everyday life and, as such, have
made on the basis of electronically admin-
directly impacted the practice of psychology
istered and scored version of the test in GUIDELINE 17
in general and psychological assessment in
question (Butcher et al., 2009). Individuals
particular (Montag et al., 2016). Concurrent Psychologists who use technology-
differ substantially in their technology
with these developments, the prevalence based assessment instruments are
experience and proficiency. These differ-
and sophistication of security threats and encouraged to take reasonable steps
ences have important implications for the
breaches of data integrity have also greatly to ensure the security, transmission,
administration and interpretation of technol-
accelerated. Similarly, as the number of psy-
ogy-based measures. For example, older storage, and disposal of data.
chologists and frequency of technological
adults have less technology experience and Psychologists also strive to ensure
utilization within psychological testing and
proficiency compared with younger adults
assessment escalates, the need to achieve that security measures are in place
(Czaja et al., 2019). The reliability, validity,
and maintain technological competence is to protect data and information
and acceptability of technology-based
critical to maintaining professional compe- related to their clients/patients/
measures must be examined in diverse
tence in general as well as standards of ethi- examinees from unintended access,
populations, including in older adults.
cal practice (Lustgarten, 2015; Rigg, 2018).
Psychologists endeavor to recognize misuse, or disclosure.
Considering the preceding, psychologists are
that it is also important that instruments
strongly encouraged to develop and/or
primarily designed to take advantage of Rationale
enhance their competence in technology by
opportunities and advances in computer
seeking out available technical and training Psychologists using testing and assessment
technology have been carefully researched
resources and/or CE opportunities in com- instruments and processes that are techno-
regarding fundamental scientific utility for
puter science and technology. logically involved for scoring, administra-
measurement and interpretation of results.
tion, or interpretation and/or who gather
Similarly, when evaluating new instruments
Application and store assessment responses and other
and assessment procedures designed exclu-
client information are strongly advised to
sively for electronic presentation, psycholo- The APA and APA Services, Inc. provide
periodically review their current practices in
gists strive to review carefully the test information about building and maintaining
regard to data protection, storage, and pro-
manual and/or detailed documentation of a technology infrastructure for psychology
tection of client confidentiality.
the underlying technical information practices and a list of available resources for
The 21st century has brought with it
describing the rationale, construction, psychologists with regard to software
significant increases in technology and
response characteristics, internal consis- reviews, privacy and security, automation,
advances in accessibility (Lustgarten, 2015).
tency, and validation evidence supporting and basic technology. Psychologists who
Psychological tests, and other assessment
use of the instrument and fairness (AERA et provide services using technology are
instruments and processes that utilize this

APA | Guidelines for Psychological Assessment and Evaluation  23


technology, do so within the context of a social engineering exploits are used to
rapidly growing and changing threat persuade employees and others to bypass
environment as well. As such, in addition to established security protocols. A number of
maintaining general competence in techno- commercially available education and train-
logical areas impacting practice, it is partic- ing programs are also for use by employees
ularly important for psychologists in general and others with access to confidential infor-
and assessment practitioners in particular mation. These programs teach participants
to strive to be aware of threats to data integ- to recognize phishing emails and other
rity and client confidentiality. common social engineering exploits, and
In response to this growing threat they periodically include unannounced
environment, in recent years a number of audits and exercises using white flag
federal and state rules and regulations have (unannounced program generated) exploits.
been enacted that directly impact the In addition, certain national and inter-
storage of data and protection of confiden- national technology organizations have
tiality. Compliance with federal and state established listings of best practices and
privacy laws and regulations can also be general standards. Psychologists are encour-
expected to intersect with areas of ethical aged to be aware of the existence of:
practice as well as with APA (2007) • The International Organization for
record-keeping guidelines. As such, psychol- Standardization (ISO)
ogists are encouraged to maintain knowl-
edge and competence in these areas as well. » ISO is an independent nongovern-
Manipulation through human interac- mental international organization
tion and social engineering is a common with a membership of 164  national
source of initiation of data breaches (Tetri & standards bodies.
Vuorinen, 2013). As such, psychologists » ISO/IEC 27001 is the best-known
strive to ensure ongoing training and regular standard in the ISO family of stan-
review of all practice employees and/or dards providing requirements for an
others with access to confidential informa- information security management
tion as an essential component of any system.
practice security plan.
Finally, a number of institutional guide- » ISO 15408 ISO/IEC 15408-1:2009
lines, best practices and standards for establishes the general concepts and
protecting security, data integrity, and confi- principles of IT security evaluation and
dentiality have been developed by APA and specifies the general model of evalua-
various technological organizations. Psychol- tion given by various parts of ISO/IEC
ogists using technologically involved tests 15408, which in its entirety is meant to
and other assessment processes are strongly be used as the basis for evaluation of
advised to integrate these practices and security properties of IT products.
standards within their routines and practices. • Standard of Good Practice

Application » The Standard of Good Practice for


Information Security, published by the
In addition to the APA Ethics Code (APA, Information Security Forum, is a busi-
2017a) and the Record Keeping Guidelines ness-focused, practical, and compre-
(APA, 2007), and the laws and regulations hensive guide to identifying and
on privacy and confidentiality, Lustgarten managing information security risks in
(2015) suggested a number of best prac- organizations and their supply chains.
tices for protecting both data and client
confidentiality, including the development • National Institute of Standards of
of a threat model, encryption, use of HIPAA- Technology, under the U.S. Department
compliant cloud providers, use of two-fac- of Commerce (NIST).
tor authentication, use of “air gapped” » NIST implements practical cyberse-
(stand-alone, non-networked, or inter- curity and privacy through outreach
net-connected) computers, and review of and effective application of stan-
informed consent procedures. dards and best practices necessary
Ferreira and Teles (2019) studied and for the United States to adopt cyber-
reviewed the way email phishing and other security capabilities.

24 APA | Guidelines for Psychological Assessment and Evaluation


RE FERE NCES
Acevedo-Polakovich, I. D., Reynaga-Abiko, G., Garriott, P. O., Derefinko, K. J., Wimsatt, Butcher, J. N., Hass, G. A., & Paulson, J. A. (2016). Clinical assessment in international
M. K., Gudonis, L. C., & Brown, T. L. (2007). Beyond instrument selection: settings. In F. T. L. Leong, D. Bartram, F. Cheung, K. F. Geisinger, & D. Iliescu (Eds.),
Cultural considerations in the psychological assessment of U.S. Latinas/os. The ITC international handbook of testing and assessment (pp. 217-230). Oxford
Professional Psychology: Research and Practice, 38(4), 375–384. http://dx.doi. University Press.
org/10.1037/0735-7028.38.4.375 Butcher, J. N., Perry J. N., & Dean, B. L. (2009). Computer-based assessment. In J. N.
Achenbach, T. M. (2017). Future directions for clinical research, services, and training: Butcher (Ed.), Oxford handbook of personality assessment (pp. 163-182). Oxford
Evidence-based assessment across informants, cultures, and dimensional University Press.
hierarchies. Journal of Clinical Child and Adolescent Psychology, 46, 159–169. Civil Rights Act of 1964, Pub. L. No. 88-352, 78 Stat. 241 (1964).
Alfonso, V. C. (2004, July). How to be an educated consumer of assessment Civil Rights Act of 1991, Pub. L. No. 102-166, 105 Stat. 1071 (1991).
instruments: Brief Cizek, G. J., & Bunch, M. B. (2007). Standard setting: A guide to establishing and
tips for practitioners. The Score, 26, 10–11. evaluating performance standards on tests. Sage.
American Educational Research Association, American Psychological Association, & Czaja, S. J., Boot, W. R., Charness, N., & Rogers, W. A. (2019). Designing for older adults:
National Council on Measurement in Education. (2014). Standards for educational Principles and
and psychological testing. American Educational Research Association. creative human factors approaches. CRC Press.
American Psychological Association. (2001). Guidelines for test user qualifications. Dana, R. H. (2001). Clinical diagnosis of multicultural populations in the United States.
American Psychologist, 56(12), 1099–1113. https://doi.org/10.1037//0003- In L. A. Suzuki, J. G. Ponterotto, & P. J. Meller (Eds.), Handbook of multicultural
066X.56.12.1099 assessment: Clinical, psychological, and educational applications (2nd ed., pp.
American Psychological Association. (2003). Guidelines on multicultural education, 101–131). Jossey-Bass.
training, research, practice, and organizational change for psychologists. American Demakis, G. J. (Ed.) (2012). Civil capacities in clinical neuropsychology: Research findings
Psychologist, 58(5), 377–402. https://doi.org/10.1037/0003-066X.58.5.377 and practical applications. Oxford University Press.
American Psychological Association. (2007). Record keeping guidelines. American Diaz-Santos, M., & Hough, S. (2016). Cultural competence guidelines for
Psychologist, 62(9), 993–1004. https://doi.org/10.1037/0003-066X.62.9.993 neuropsychology trainees and professionals: Working with ethnically
American Psychological Association. (2012, July). Benchmarks evaluation system diverse individuals. In F. R. Ferraro (Ed.), Minority and cross-cultural aspects of
[Webpage]. https://www.apa.org/ed/graduate/benchmarks-evaluation-system. neuropsychological assessment: Enduring and emerging trends (2nd ed., pp. 11–33).
aspx Taylor & Francis.
American Psychological Association. (2013). Guidelines for the practice of Embretson, S. E., & Reise, S. P. (2000). Item response theory for psychologists. Erlbaum.
telepsychology. https://www.apa.org/practice/guidelines/telepsychology Equal Employment Opportunity Commission. (1978). Code of federal regulations: Part
American Psychological Association. (2015a). Guidelines for clinical supervision in 1607-uniform guidelines on employee selection procedures. https://www.govinfo.gov/
health service psychology. American Psychologist, 70(1), 33–46. http://dx.doi. content/pkg/CFR-2017-title29-vol4/xml/CFR-2017-title29-vol4-part1607.xml
org/10.1037/a0038112 Falender, C. A., Erickson Cornish, J. A., Goodyear, R., Hatcher, R., Kaslow, N. J.,
American Psychological Association. (2015b). Professional practice guidelines: Leventhal, G., Shafranske, E., & Sigmon, S. T. (2004). Defining competencies in
Guidance for developers and users. American Psychologist, 70(9), 823–831. http:// psychology supervision: A consensus statement. Journal of Clinical Psychology,
dx.doi.org/10.1037/a0039644 60(7), 771–785. https://doi.org/10.1002/jclp.20013
American Psychological Association. (2017a). Ethical principles of psychologists and Ferreira, A., & Teles, S. (2019). Persuasion: How phishing emails can influence users
code of conduct (2002, amended effective June 1, 2010, and January 1, 2017). and bypass security measures. International Journal of Human-Computer Studies,
http://www.apa.org/ethics/code/index.aspx 125, 19–31. https://doi.org/10.1016/j.ijhcs.2018.12.004
American Psychological Association. (2017b). Multicultural guidelines: An ecological Finn, S. E. (2009). Incorporating base-rate information in daily clinical decision
approach to context, identity, and intersectionality. http://www.apa.org/about/ making. In J. N. Butcher (Ed.), Oxford handbook of personality assessment (pp.
policy/multicultural-guidelines.pdf 140–149). Oxford University Press.
American Psychological Association, Commission on Accreditation. (2015). Standards First, M. B., Williams, J. B. W., Karg, R. S., & Spitzer, R. L. (2016). Structured Clinical
of accreditation for health service psychology. http://www.apa.org/ed/accreditation/ Interview for
about/policies/standards-of-accreditation.pdf DSM-5 Disorders, Clinician Version (SCID-5-CV). American Psychiatric Association.
Americans With Disabilities Act of 1990, 42 U.S.C. § 12101 et seq. (1990). Graham, J. R., Naglieri, J. A., & Weiner, I. B. (Eds.). (2013). Handbook of psychology:
Association of State and Provincial Psychology Boards. (2014). Report of the Assessment psychology (pp. 82–113). Wiley & Sons.
competency assessment task force. https://cdn.ymaws.com/www.asppb.net/ Haertel, E. H. (2006). Reliability. In R. L. Brennan (Ed.), Educational measurement (4th
resource/resmgr/eppp_2/2017_asppb_competencies_exp.pdf ed., pp. 65–110). Praeger.
Bandalos, D. L. (2018). Measurement theory and application for the social sciences. Hessen, E., Hokkanen, L., Ponsford, J., van Zandvoort, M., Watts, A., Evans, J., &
Guilford Press. Haaland, K. Y. (2018). Core competencies in clinical neuropsychology training
Beiser, M., & Gotowiec, A. (2000). Accounting for native/non-native differences in across the world. Clinical Neuropsychologist, 32, 642–656.
IQ scores. Psychology in the Schools, 37(3), 237–252. https://doi.org/10.1002/ Hook, J. N., & Watkins, C. E., Jr. (2015). Cultural humility: The cornerstone of positive
(SICI)1520-6807(200005)37:3<237::AID-PITS4>3.0.CO;2-N contact with culturally different individuals and groups? American Psychologist,
Bracken, B. A., & Theodore, L. A. (in press). Clinical observation of preschool 70(7), 661–662. http://dx.doi.org/10.1037/a0038965
assessment behavior. In V. C. Alfonso, B. A. Braken, & R. J. Nagle (Eds.), Hopwood, C. J., & Bornstein, R. F. (Eds.). (2014). Multimethod clinical assessment.
Psychoeducational assessment of preschool children (5th ed.). CRC Press. Guilford.
Bram, A. D., & Peebles, M. (2014). Psychological testing that matters: Creating a road International Test Commission. (2001). ITC guidelines on test use. International
map for effective treatment. American Psychological Association. Journal of Testing, 1(2), 93–114.
Brennan, R. L. (2001). Generalizability theory. Springer-Verlag. International Test Commission. (2017). ITC guidelines for translating and adapting
Burns, G. L., & Haynes, S. N. (2006). Clinical psychology: Construct validation with tests (2nd ed.). http://www.InTestCom.org
multiple sources of information and multiple settings. In M. Eid & E. Diener (Eds.), Janssen, R. (2011). Using a differential item functioning approach to investigate
Handbook of multimethod measurement in psychology (pp. 401–418). American measurement invariance. In E. Davidov, P. Schmidt, & J. Billiet (Eds.), Cross-cultural
Psychological Association. analysis: Methods and applications (pp. 415–432). Routledge.
Butcher, J. N. (2006). Assessment in clinical psychology: A perspective on the past, Kane, M. (1992). An argument-based approach to validation. Psychological Bulletin,
present challenges, and future prospects. Clinical Psychology: Science and Practice, 112(3), 527-535. http://dx.doi.org/10.1037/0033-2909.112.3.527
13(3), 205–209. http://dx.doi.org/10.1111/j.1468-2850.2006.00025.x Kane, M. (2013). Validating the interpretations and uses of test scores. Journal of
Education Measurement, 50(1), 1–73. https://doi.org/10.1111/jedm.12000

APA | Guidelines for Psychological Assessment and Evaluation 25


Kaplan, R. M., & Saccuzzo, D. P. (2017). Psychological testing: Principles, applications, & Schneider, A. L., Sharrett, A. R., Gottesman, R. F., Coresh, J., Coker, L., Wruck, L., Selnes,
issues. Cengage Learning. O. A., Deal, J., Knopman, D., & Mosley, T. H. (2015). Normative data for eight
Kaslow, N. J., Grus, C. L., Campbell, L. F., Fouad, N. A., Hatcher, R. L., & Rodolfa, E. R. neuropsychological tests in older blacks and whites from the atherosclerosis risk
(2009). Competency assessment toolkit for professional psychology. Training in communities (ARIC) study. Alzheimer Disease and Associated Disorders, 29(1),
and Education in Professional Psychology, 3(4, Suppl.), S27–S45. http://dx.doi. 32–44.
org/10.1037/a0015833 Smith, G. (Clinical Neuropsychology Synarchy). (2019). Education and training in
Keller, D. K. (2006). The tao of statistics: A path to understanding (with no math). Sage. clinical neuropsychology: Recent developments and documents from the clinical
Kim, G., Chiriboga, D. A., & Jang, Y. (2009). Cultural equivalence in depressive neuropsychology synarchy. Archives of Clinical Neuropsychology, 34, 418–431.
symptoms in older white, black, and Mexican-American adults. Journal of the Society for Industrial and Organizational Psychology. (2003). Principles for the
American Geriatrics Society, 57(5), 790–796. https://doi.org/10.1111/j.1532- validation and use of personnel selection procedures (4th ed.). Author.
5415.2009.02188.x Stage, S. A., Jackson, H. G., Moscovitz, K., Erickson, M. J., Thurman, S. O., Jessee, W.,
Kim, G., DeCoster, J., Huang, C.-H., & Chiriboga, D. A. (2011). Race/ethnicity and & Olson, E. M. (2006). Using multimethod-multisource functional behavioral
the factor structure of the Center for Epidemiologic Studies Depression Scale: A assessment for students with behavior disabilities. School Psychology Review, 35,
meta-analysis. Cultural Diversity and Ethnic Minority Psychology, 17(4), 381–396. 451–471.
http://dx.doi.org/10.1037/a0025434 Sue, D. W., & Sue, D. (2013). Counseling the culturally diverse: Theory & practice (6th
Kline, P. (2000). The handbook of psychological testing (2nd ed.). Routledge. ed.). Wiley & Sons.
Lustgarten, S. D. (2015). Emerging ethical threats to client privacy in cloud Tetri, P., & Vuorinen, J. (2013). Dissecting social engineering. Behaviour & Information
communication and data storage. Professional Psychology: Research and Practice, Technology, 32(10), 1014–1023. https://doi.org/10.1080/0144929X.2013.763860
46(3), 154–160. http://dx.doi.org/10.1037/pro0000018 Thakker, J., Ward, T., & Strongman, K. T. (1999). Mental disorder and cross-cultural
Miller, I. N., Himali, J. J., Beiser, A. S., Murabito, J. M., Seshadri, S., Wolf, P. A., & Au, R. psychology: A constructivist perspective. Clinical Psychology Review, 19(7),
(2015). Normative 843–874. https://doi.org/10.1016/S0272-7358(98)00077-4
data for the cognitively intact oldest-old: The Framingham Heart Study. Experimental Wahlstrom, D. (2017). Technology and computerized assessments: Current state
Aging Research, 41(4), 386–409. and future directions. In S. S. Bush, G. J. Demakis, & M. L. Rohling (Eds.), APA
Montag, C., Duke, E., & Markowetz, A. (2016). Toward psychoinformatics: Computer handbook of forensic neuropsychology (pp. 463–476). American Psychological
science meets psychology. Computational and Mathematical Methods in Medicine, Association.
2016, Article 2983685. http://dx.doi.org/10.1155/2016/2983685 Way, W., & Robin, F. (2016). The history of computer-based testing. In C. S. Wells &
Neimeyer, G. J., Taylor, J. M. & Cox, D. R. (2012). On hope and possibility: Does M. Faulkner-Bond (Eds)., Educational measurement: From foundations to future (pp.
continuing professional development contribute to ongoing competence? 185–208). Guilford Press.
Professional Psychology: Research and Practice, 43(5), 476–486. https://doi. Weiner, I. B., & Otto, R. K. (Eds.). (2014). Handbook of forensic psychology (4th ed).
org/10.1037/a0029613 Wiley.
Neimeyer, G. J., Taylor, J. M., & Rozensky, R. H. (2012). The diminishing durability Wright, P. W. D., & Wright, P. D. (2015). Special education law (2nd ed.). House Harbor
of knowledge in professional psychology: A Delphi Poll of specialties and Law Press.
proficiencies. Professional Psychology: Research and Practice, 43(4), 364–371. Yalof, J. (2019). When the assessor’s limits are tested: Enactments and the
https://doi.org/10.1037/a0028698 assessment frame in psychological testing. Journal of Personality Assessment.
Neimeyer, G. J., Taylor, J. M., Rozensky, R. H., & Cox, D. R. (2014). The diminishing Advance online publication. http://doi.org/10.1080/00223891.2019.1613241
durability of knowledge in professional psychology: A second look at
specializations. Professional Psychology: Research and Practice, 45(2), 92–98.
https://doi.org/10.1037/a0036176
Oswald, F. L., Schmitt, N., Kim, B. H., Ramsay, L. J., & Gillespie, M. A. (2004).
Developing a biodata
measure and situational judgment inventory as predictors of college student
performance. Journal of Applied Psychology, 89(2), 187–207. http://dx.doi.
org/10.1037/0021-9010.89.2.187
Reynolds, C. R., & Suzuki, L. A. (2013). Bias in psychological assessment: An empirical
review and recommendations. In J. R. Graham, J. A. Naglieri, & I. B. Weiner
(Eds.), Handbook of psychology: Assessment psychology (pp. 82–113). Wiley & Sons.
Rigg, T. (2018). The ethical considerations of storing client information online.
Professional Psychology: Research and Practice, 49(5-6), 332–335. http://dx.doi.
org/10.1037/pro0000217
Roberts, M. C., Borden, K. A., Christiansen, M. D., & Lopez, S. J. (2005). Fostering
a culture shift: Assessment of competence in the education and careers of
professional psychologists. Professional Psychology: Research and Practice, 36(4),
355–361. http://dx.doi.org/10.1037/0735-7028.36.4.355
Roper, B. L., Block, C. K., Osborn, K., & Ready, R. E. (2018). Education and training
for clinical neuropsychologists in integrated care settings. Archives of Clinical
Neuropsychology, 33(3), 263–268.
Rosen, D. C., Nakash, O., & Alegria, M. (2016). The impact of computer use on
therapeutic alliance and continuance in care during the mental health intake.
Psychotherapy, 53, 117–123. http://doi.org/10.1037/pst0000022
Sandoval, J. H., Frisby, C. L., Geisinger, K. F., Ramos-Grenier, J., & Scheuneman, J.
D. (Eds.). (1998). Test interpretation and diversity: Achieving equity in assessment.
American Psychological Association.
Sattler, J. M. (2014). Foundations of behavioral, social, and clinical assessment of children
(5th ed.). Author.
Schmidt, F. L., & Hunter, J. E. (1998). The validity and utility of selection methods
in personnel psychology: Practical and theoretical implications of 85 years
of research findings. Psychological Bulletin, 124(2), 262–274. https://doi.
org/10.1037/0033-2909.124.2.262

26 APA | Guidelines for Psychological Assessment and Evaluation


APA | Guidelines for Psychological Assessment and Evaluation  27
28 APA | Guidelines for Psychological Assessment and Evaluation

You might also like