You are on page 1of 5

AT EDUCATION Shane Caswell, PhD, ATC, Report Editor

An Instrument for Measurement


of Clinical Instructor Behaviors
Christine A. Lauber, EdD, ATC, LAT and Clyde B. Killian, PhD, PT • University of
Indianapolis

CLINICAL EDUCATION is a critical compo- provide data that demonstrate outcomes


nent of athletic training education; it provides related to this quality and effectiveness in a
students with opportunities to apply skills in comprehensive assessment plan. In addition
real situations while fostering clinical reason- to student evaluation of clinical instructors,
ing skills.1,2 Additionally, clinical education ATEP program administrators should evalu-
fosters a unique relationship between clini- ate the effectiveness of clinical instructors.
cal instructors and students that facilitates Moreover, each ACI should be given the
student learning of cognitive knowledge and opportunity for self-assessment of his or her
psychomotor skills and effectiveness as an ACI.
fosters the develop- Administrators of ATEPs often develop
Key Points ment of professional and share tools for evaluation of clinical
Athletic training education program admin- behaviors that are fun- instruction that may not be psychometri-
istrators should evaluate clinical instructor damental for the prac- cally sound. Instruments that provide valid
effectiveness on the basis of sound mea- tice of athletic training. and reliable data are essential for mea-
surement procedures. Thus, clinical instructor surement of clinical instructor behaviors.
behaviors are key com- Healthcare professions such as medicine,4-7
Categories of clinical instructor behaviors ponents of the profes- nursing,8-10 dentistry,11,12 and nurse anes-
include Interpersonal and Professional sional development of thesia13 have developed tools with sound
behaviors. athletic training stu- psychometric properties to assess the effec-
dents. tiveness of clinical instruction and clinical
Use of a psychometrically sound instrument The Commission instructor behaviors, while athletic training
can identify ACI development needs. on Accreditation of has modified observational tools.14 Recently,
Athletic Training Edu- Weidner and Henning15 established stan-
cation (CAATE) Stan- dards and criteria for selection, retention,
dards for the Accreditation of Entry-Level Ath- and evaluation of ACIs, which have been
letic Training Education Programs3 includes found important and applicable to a variety
standards related to the training and respon- of clinical education settings.16 The purpose
sibilities of an Approved Clinical Instructor of this report is twofold: (a) to describe the
(ACI). Additionally, the Standards3 indicate process that we followed to develop an
that Athletic Training Education Programs instrument that demonstrates reliable and
(ATEP) must include measures of the quality valid properties for evaluation of ACIs and
and effectiveness of clinical instruction and (b) to discuss its practical applications for

© 2009 Human Kinetics • Att 14(1), pp. 16-20

16  january 2009 Athletic Therapy Today


ATEP administrators and ACIs to identify areas of We asked the panel to review both the five-category
strength and weakness. and four-category models. For each model, we asked
the panel to (a) review the behavior statements in
Clinical Instructor Behavior Instrument each category and to determine whether or not the
statements belong to its assigned conceptual category,
Initial Development and (b) provide a label for the category. If a statement
Based on a review of the health professions education loaded on more than one category or did not load on
literature, the Clinical Instructor Behavior Instrument any category, we asked the panel to determine whether
(CIBI) was developed to identify the relative impor- or not the statement described an important clinical
tance of various clinical instructor behaviors. The instructor behavior and to place the statement in a
initial survey contained 30 behavior statements that category where it conceptually belongs. Each member
were grouped into five categories: (a) evaluative, (b) of the panel indicated that all 30 behavior statements
instructional, (c) interpersonal, (d) personal, and (e) were important.
professional. Each category contained six behavior
statements. In previously published research using Final Analysis
this survey, 75 program directors and 242 clinical After reviewing the expert panel’s feedback, three
instructors rated the importance of each behavior categories of behavior statements emerged; however,
Downloaded by Florida Intl University on 09/23/16, Volume 14, Article Number 1

statement on a Likert Scale (1 = least important, 5 we did not find profound differences in behavior
= most important).17 The initial CIBI demonstrated a statements among the three categories. The three
high level of internal consistency (Cronbach’s alpha = categories were then collapsed into two categories,
0.94. Reliability values for the five behavior categories which were reviewed again by the panel of experts to
ranged from 0.73–0.85). A panel of experts attested (a) determine whether or not the statements belong to
to its face validity and content validity. its assigned category and (b) to provide a label for the
category. The final instrument identifies two catego-
Clinical Instructor Behavior Category Analysis ries of clinical instructor behaviors to provide clarity
We performed factor analysis to determine whether or in interpretation and sound psychometric properties.
not the 30 behavior statements could be grouped into Each category consists of 15 separate statements that
the five categories indicated by the literature. Recom- identify “interpersonal” or “professional” behaviors
mended load cut-off points range from 0.30 to 0.55.18 (Table 1). The Cronbach’s alpha for both of the two
Because we wanted statements to be substantially categories indicates high reliability (Interpersonal =
representative of a concept, we chose an 0.40 criterion. 0.90; Professional = 0.90). Deletion of any statement
The five-category model accounted for 55% of the from either category would not increase the reliability.
variance, but several behavior statements loaded on To further demonstrate that these two categories rep-
more than one category (>0.40) or did not meet our resent different concepts, the Wilcoxon Signed-Ranks
criteria to load on a category. The behavior statement, Test revealed a large difference between the two cat-
“demonstrates honesty when working with students egories (z = -7.353; p < .001). Figure 1 provides a
and athletes/patients,” loaded as its own category. summary of the Clinical Instructor Behavior Instrument
To determine whether or not the statements could development process.
be reduced to four categories, we performed another
analysis, which indicated that several statements
Discussion
loaded on more than one category. Thus, further survey
refinement was needed. The CIBI is a psychometrically sound instrument that
quantifies interpersonal and professional behaviors
Expert Panel Review that are important to program directors and clinical
To determine whether or not behavior statements instructors. The interpersonal behaviors identified by
could be categorized into a more meaningful and the CIBI pertain to interaction between the ACI and
practical framework, five athletic training educators the student and characteristics that are associated
and clinical instructors served as a panel of experts. with personality. Interpersonal behaviors can also be

Athletic Therapy Today january 2009  17


Table 1. Important Clinical Instructor Behaviors
Interpersonal Behaviors Professional Behaviors
Demonstrates honesty when working with students and Explains procedures clearly.
athletes/patients.
Displays a sense of humor. Demonstrates clinical skills for students.
Demonstrates interest in athletes and their care. Facilitates students’ awareness of their own professional
responsibility.
Demonstrates flexibility when working with students. Provides useful and constructive feedback.
Corrects students tactfully without belittling them. Explains the basis for actions and decisions.
Demonstrates self-control and patience. Provides practice opportunities for students.
Demonstrates enthusiasm for teaching and athletic Demonstrates objectivity and fairness in the evaluation of
training. the student.
Maintains an atmosphere that allows expression of Observes and assesses student clinical performance
Downloaded by Florida Intl University on 09/23/16, Volume 14, Article Number 1

opinions. frequently.
Encourages students to feel free to ask questions or Demonstrates clinical knowledge, competence,
to ask for help. and judgment.
Is available and accessible to students when needed. Relates underlying theory to athletic training clinical
practice.
Exhibits a genuine interest in the student. Stimulates student problem solving and critical thinking.
Demonstrates confidence in and respect for the student. Provides specific suggestions for student improvement.
Accepts responsibility for own actions. Acts as a professional role model.
Is friendly and outgoing when working with students. Answers student questions clearly and precisely.
Provides support and encouragement to students. Defines clearly the expectations of students.

characterized as humanistic attributes in that they


Implications
portray personal values such as integrity and honesty.
Additionally, these behaviors relate to provision of a
for Athletic Training Educators
caring and open atmosphere for learning. After per- In addition to tools used in the healthcare professions
forming the initial factor analysis, we were surprised to and the standards created by Weidner and Henning,15
find that the statement, “demonstrates honesty when the CIBI provides a tool for ATEP administrators to
working with students and athletes/patients,” loaded as evaluate clinical instruction effectiveness and a tool for
a separate distinct factor. Weidner and Henning16 found ACIs to perform self-assessment of clinical instruction.
the ACI standard of legal and ethical behavior to be the Program directors and clinical education coordinators
most crucial standard of the seven standards that they are encouraged to use this tool to provide feedback
developed. It is apparent that ATEP directors and ACIs to ACIs. After completing the CIBI, program admin-
view honesty as a critically important behavior. istrators are better able to identify specific topics to
The professional behaviors identified by the CIBI address in continuing ACI training and for individual
relate to the teaching, evaluative, and mentoring roles ACI development. By evaluating ACIs in two broad cat-
of the ACI. These professional behaviors may be more egories, program administrators can more efficiently
easily developed and may be more modifiable than inter- identify areas of strength and weakness. Program
personal behaviors. Personal continuing education and administrators can rate specific behaviors in the two
ACI training sessions might address professional behav- categories to improve teaching, rather than having to
iors through review of literature pertaining to teaching, interpret ratings for a greater number of categories.
learning, and developing mentoring relationships. After reviewing the five-category model, a program

18  january 2009 Athletic Therapy Today


Downloaded by Florida Intl University on 09/23/16, Volume 14, Article Number 1

Figure 1 Summary of the clinical instructor behavior instrument development.

director serving on our expert panel stated, “I don’t nesses. This information provides a framework for
like the categories – too many options.” ACIs to select continuing education options that will
ACIs can use the tool for self-assessment of address areas of weakness or perceived need, and
interpersonal and professional strengths and weak- they will have valid information to make suggestions

Athletic Therapy Today january 2009  19


or professional behaviors that may be demonstrated
Table 2. Likert Scale Sugges- by ACIs. It may be tempting for ATEP administrators
tions for Practical Application to have students use the CIBI for evaluation of their
Program Director ACIs, but it was developed using ATEP directors and
The clinical instructor demonstrates the appropriate ACIs who may see the importance of interpersonal
behavior and does not need development. and professional behaviors differently than students
view them. 
Strongly disagree
Disagree
References
Neither agree nor disagree
1. Gaberson KB, Oermann MH. Clinical Teaching in Nursing. New York:
Agree Springer Publishing Company; 1999:12-21,57-75.
Strongly agree 2. Reilly DE, Oermann MH. Clinical Teaching in Nursing Education. 2nd
ed. New York: National League for Nursing; 1992:109-117,151-155.
The behavior is a strength. 3. Commission on Accreditation of Athletic Training Education. Stan-
dards for the accreditation of entry-level athletic training education
Strongly disagree programs. Available at http://caate.net/documents/standards.12.7.07.
pdf. Accessed August 11, 2008.
Disagree 4. Miller MD. Factorial validity of a clinical teaching scale. Educ Psychol
Downloaded by Florida Intl University on 09/23/16, Volume 14, Article Number 1

Neither agree nor disagree Meas. 1982;42:1141-1147.


5. Shellenberger S, Mahan JM. A factor analytic study of teaching in off-
Agree campus general practice clerkships. Med Educ. 1982;16:151-155.
Strongly agree 6. Litzelman DK, Stratos GA, Marriott DJ, Skeff KM. Factorial validation
of a widely disseminated educational framework for evaluating clinical
Clinical Instructor teachers. Acad Med. 1998;73:688-695.
7. Copeland HL, Hewson MG. Developing and testing an instrument to
I am confident in my ability to demonstrate the measure the effectiveness of clinical teaching in an academic medical
behavior, and do not need development. center. Acad Med. 2000;75:161-166.
8. Zimmerman L, Westfall J. The development and validation of a
Strongly disagree scale measuring effective clinical teaching behaviors. J Nurs Educ.
1988;27:272-277.
Disagree 9. Fong CM, McCauley GT. Measuring the nursing, teaching, and interper-
Neither agree nor disagree sonal effectiveness of clinical instructors. J Nurs Educ. 1993;32:325-
328.
Agree 10. Reeve MM. Development of an instrument to measure effectiveness
Strongly agree of clinical instructors. J Nurs Educ. 1994;33:15-20.
11. Myers B. Beliefs of dental faculty and students about effective clinical
The behavior is a strength. teaching behaviors. J Dent Educ. 1977;41:68-76.
12. Romberg E. A factor analysis of students’ ratings of clinical teaching.
Strongly disagree J Dent Educ. 1984;48:258-262.
Disagree 13. Haag GP, Schoeps NB. Development of a reliable nurse anesthesia
clinical instructor evaluation instrument. AANA J. 1993;61:158-164.
Neither agree nor disagree 14. Stemmans CL, Gangstead SK. A psychometric investigation of the
Agree clinical instruction analysis tool-athletic training II. Percept Mot Skills.
2000;91:1040-1044.
Strongly agree 15. Weidner TG, Henning JM. Development of standards and criteria for
the selection, training, and evaluation of athletic training approved
clinical instructors. J Athl Train. 2004;39:335-343.
for ­continuing ACI workshops that will best meet their 16. Weidner TG, Henning JM. Importance and applicability of approved
clinical instructor standards and criteria to certified athletic trainers in
needs. Additionally, ACIs can consult with program different clinical education settings. J Athl Train. 2005;40:326-332.
administrators for access to resources that will further 17. Lauber CA, Toth PE, Leary PA, Martin RD, Killian CB. Program directors’
their development. and clinical instructors’ perceptions of important clinical-instructor
behavior categories in the delivery of athletic training clinical instruc-
The original Likert Scale used to test the CIBI will tion. J Athl Train. 2003;38:336-341.
need modification to address the needs of ATEP admin- 18. Munro BH. Statistical Methods for Health Care Research. 5th ed. Phila-
istrators and for its use in ACI self-assessment. Table 2 delphia: Lippincott Williams & Wilkens; 2005:332.

provides examples of scales that may be useful to mea-


Christine Lauber is associate professor of athletic training and clinical
sure ACI strengths and weaknesses. Although the CIBI education coordinator at the University of Indianapolis.
demonstrates sound psychometric properties, it may Clyde Killian is an associate professor in the Krannert School of Physi-
not adequately assess the full range of interpersonal cal Therapy at the University of Indianapolis.

20  january 2009 Athletic Therapy Today

You might also like