Shelly Richardson

Twitter Team Professional Development Forum

Project Evaluation Plan

Primary Evaluation Goals

The goal of this program evaluation is to measure the effectiveness of the course
design in promoting community building in an online environment. Course effectiveness
is measured by assessing the course introduction, learning outcomes, learner
assessment tools, learner interaction, course technology and usability.
Evaluation Components and Methodology
Based on knowledge gained in the EDTECH Evaluation course, the development of a
program evaluation plan should include both formative and summative assessment
components. The following evaluation tools will be implemented in the Twitter Team
Professional Development forum:

A pre-course evaluation with stakeholders based on the evaluation rubric.

Included in this evaluation will be an area for essay format feedback, allowing
stakeholders the opportunity to offer suggestions for improvement

A mid-unit evaluation of course based on the evaluation rubric will gather

learner feedback data. Included in this evaluation will be an area for essay
format feedback, allowing learners the opportunity to offer suggestions for
improvement. This is placed mid-unit so that formative changes can be made,
if necessary.

A post-course evaluation with learners and stakeholders, based on the

evaluation rubric. Included in this evaluation will be an area for essay format
feedback, allowing learners and stakeholders the opportunity to offer
suggestions for improvement.

Assessment Instruments
The assessment instruments being used for program evaluation are an evaluation
rubric created (See Appendix I) for this purpose and surveys that are built-in structural
components in the Canvas Learning Management System.
Evaluation Method Criteria
The creation of the K-State Libraries Twitter Team Professional Development Forum
is the follow-up step in the K-State Libraries Twitter Program. In the fall of 2014, a
goals-based evaluation of this program was conducted that surveyed the library
Twitter followers. This evaluation produced results based on user perceived

"usefulness" of the Twitter Program objectives. As the Twitter Team creates the
information disseminated to the library Twitter followers, it is logical that they should
be aware of the Twitter Program Objectives. One of the goals of this forum is to create
a familiarity and understanding of these objectives.
As the 2014 Twitter Program evaluation was structured on a goals-based
methodology, it is logical that the K-State Libraries Twitter Team Professional
Development Forum also use this method. Boulmetis and Dutwin describe the goalsbased method of evaluation as, "any type of evaluation based on the knowledge of-and reference to--the goals and objectives of the program, person or product." (p.109)
Therefore, not only will the participant knowledge of the Twitter Program objectives be
measured, we will also measure community building participation in this course.
An evaluation rubric has been created based on both the Quality Matters Standards
for Higher Education, Fifth Edition, and the specific learning outcomes of this
professional development forum. The rubric focuses on gathering data that measures
effectiveness of the course introduction, learning outcomes, student assessment
tools, learner interaction, course technology and usability.

References
Boulmetis, J., & Dutwin, P. (2011). The ABCs of evaluation: Timeless techniques for
program and project managers (3rd ed.). San Francisco: Jossey-Bass.
Higher Ed Program Rubric | Quality Matters. (2013). Retrieved April 14, 2015, from
https://www.qualitymatters.org/rubric

Appendix I
Evaluation Rubric for K-State Libraries Professional Development Forum
https://drive.google.com/file/d/0B2JR19YBZHuFNTlEVlY5a3dzMUE/view?usp=sharin
g