1

Evaluation Instrument

Jared L. Fowler

Kennesaw State University

ITEC 7460: Professional Learning & Technology Innovation

Dr. Jabari Cain

December 7, 2020
 2

Evaluation Instrument

The effectiveness and quality of professional learning can be increased through well-designed
evaluations (Learning Forward, n.d.). This evaluation instrument could be used to assess the
impact of professional development and, thereby, improve its effectiveness for future sessions.

Level 1 - Participants’ Reaction

Following the first technology coaching session, the teacher’s perception of the professional
development would be evaluated by the use of a Plus/Minus survey. This survey would consist
of three simple, open-ended questions either provided on a handout or through an online
survey, such as Google Forms.

Exit Ticket
1. Plus: What positive takeaways or highlights do you have from the session?
2. Minus: Things you didn’t like, or feel could have been better.
3. Interesting: Was there an “aha” moment in the session?

Level 2 - Participants’ Learning

Guskey (2016) states, “professional learning leaders need to outline indicators of successful
learning before activities begin (p. 34). To identify the level of learning which occurred in the
session, the teacher will or should complete a K-W-L chart and a follow-up survey on the
technology or strategy being presented. The first two sections of the chart would be completed
prior to the session. The last section of the chart would be completed immediately following the
session. A follow-up survey consisting of 3 questions will be sent approximately 24 hours from
the conclusion of the training once the teacher has had time to reflect on the session. Examining
this data will help improve the content, format, and organization of professional development
(Guskey, 2016, p. 34).

K-W-L Chart

K - What I Know. W - What I Want to know. L - What I Learned.

 3

Survey Questions
1. What did you learn from the coaching session?
2. On a scale of 1 - 4 (1 - definitely not, 2 - not likely, 3 - possibly, 4 - definitely) how likely
are you to try this technology/strategy in your classroom?
3. What support could I, or the school, provide to help you implement this strategy in your
classroom?

Level 3 - Organizational Support and Change

Teachers will be surveyed approximately two weeks following the conclusion of the coaching
session to determine the level of organizational support. Organizations should distribute
resources equally to accomplish individual, team, school, and school system goals (Learning
Forward, n.d.). Guskey (2016) states the data gathered from the survey would be used to
“document and improve organizational support for professional learning…. inform future change
initiatives” (p. 35).

Survey Questions
1. What resources have been provided to you to help with the implementation of this
technology/strategy?
2. How has the school supported the implementation of this technology/strategy?
3. Do you require any additional support to successfully implement this
technology/strategy?

Level 4

Accurately determining the level of implementation comes from direct observations (Guskey,
2016, p. 35). The coach will utilize the rubric below to assess the level of implementation of the
technology/strategy. Following the observation, the coach will interview the teacher about
his/her perception of their level of implementation. The coach will provide feedback based on
the observation. According to the Standards for Professional Learning (Learning Forward, n.d.),
“Feedback about progress toward expected practices provides encouragement to sustain the
desired changes over time.” The data gathered from the observation and interview will be used
to “restructure future programs and activities to facilitate better, more consistent implementation”
(Guskey, 2016, p. 35).
 4

Observation Rubric

Level 1 Level 2 Level 3 Level 4

The teacher has not The teacher minimally The teacher moderately The teacher
implemented the implements the implements the successfully implements
technology or strategy technology or strategy technology or strategy the technology or
covered in the coaching covered in the coaching covered in the coaching strategy covered in the
session. session. Additional session. Occasional coaching session.
coaching is required. coaching is Coaching will be
recommended. provided only by
request.

Interview Questions
1. How did you implement the technology/strategy learned from the coaching session?
2. How did the coaching session change your implementation or practice of the
technology/strategy?

Level 5

Measure of student learning is the basis of the final level of evaluation. According to Guskey
(2016), “evaluators should always include multiple sources of evidence” (p. 35). Therefore, pre-
and post-assessment data would be collected from the students. Data on technology usage can
be collected to evaluate the impact on student learning. If there is evidence an impact on
student learning, the level of association between impact and student learning must be
determined if possible. Teachers and students can be interviewed to determine their perception
of the value of coaching provided.

Teacher Interview Questions

1. How did the students respond to the implementation of this technology/strategy?
2. How was student learning impacted?

Student Interview Questions

1. How did the technology/strategy of _________________ affect your learning?
2. Would you like to use the technology/strategy again in future lessons?
3. Do you have suggestions for how the teacher could improve the use of the
technology/strategy in the future?
 5

Resources

Guskey, T. R. (2016). Gauge impact with 5 levels of data. The Learning Professional, 37(1), 32-

37.

Learning Forward. (n.d.). Standards for professional learning. Oxford, OH.

https://learningforward.org/standards-for-professional-learning/