G3658-1W

Revised February 2008

Planning a Program Evaluation: Worksheet

Steps in Program Evaluation

1.
Engage stakeholders

2.
Focus

Manage  Describe 3.
program-logic
the Collect
model
evaluation data
 Define
purpose
 Identify 4.
 Human  Determine sources
Subjects use/users Analyze &
 Select
Protection  Determine method(s) interpret
 Timeline key questions
 Pilot test  Process data
 Responsibilities  Select 5.
 Set schedule  Analyze
 Budget indicators Use
 Determine  Interpret data
 Determine
sample  Share findings
design  What did you
learn? and lessons
learned
 What are the
limitations?  Use in decision
making
 Determine next
steps

Standards of evaluation:
• Utility • Feasibility • Propriety •Accuracy

University of Wisconsin-Extension • Cooperative Extension • Program Development & Evaluation

UW-Extension provides equal opportunities in employment and programming, including Title IX and ADA.
© 2006 by the Board of Regents of the University of Wisconsin System http://www.uwex.edu/ces/pdande
 Engage Stakeholders
Who should be involved?
Students or participants. Teachers, administrators or coordinators.

How might they be engaged?

Staff meetings, email correspondence, volunteering, survey questionnaires

Focus the Evaluation

What are you going to evaluate? Describe program (logic model).
Goals achievement, participants’ suggestions for the Program’s improvement

What is the purpose of the evaluation?

The purpose of this evaluation is to evaluate the level of satisfaction of clients
with the Intermediate Spanish Program and what aspects should be improved.

Who will use the evaluation? How will they use it?
Who/users How will they use the information?
To assess the effectiveness of the
Administrators, coordinators, and
program and make changes ( if
teachers
necessary) to help teachers meet the
goals and improve student’s
achievement and satisfaction

What questions will the evaluation seek to answer?

1. Is the program content of Intermediate Spanish up-to-date?_____
2. Is the program level appropriate for most students?_____
3. Are objectives, competencies, or tasks satisfactory stated?____
4. Is the program presented in a logical sequence?_____
5. Are you satisfied with the program have basic elements, such as
those listed below?
6. What aspects of the program require improvement?
7. Do the outcomes achieved match the goals?
8. Is there evidence of effectiveness available regarding the program?

What information do you need to answer the questions?

What I wish to know Indicators – How will I know it?

University of Wisconsin-Extension • Cooperative Extension • Program Development & Evaluation

UW-Extension provides equal opportunities in employment and programming, including Title IX and ADA.
© 2006 by the Board of Regents of the University of Wisconsin System http://www.uwex.edu/ces/pdande
I need to obtain students’ responses to
the survey questionnaire and their
Answers to multiple choice and scale
suggestions for the improvement of the
rate questions.
Intermediate Spanish Program

Knowledge, beliefs, opinions, reactions

When is the evaluation needed?

December 5th, 2009

What evaluation design will you use?

Formative evaluation: A goal-based evaluation design combined with the
improvement model.

Collect the information

What sources of information will you use?

Program Kit, Division PowerPoint, Questionnaire.

Existing information:

Students or participants (clientele) of The Community

People: Center Neighborhood in Ottawa. Teachers or instructors
will also participate.
Pictorial records and
Program Kit, Division PowerPoint,
observations:

What data collection method(s) will you use?

x Survey Document review

Interview Testimonials
Observation Expert panel
Group techniques Simulated problems or situations
Case study Journal, log, diary
Tests Unobtrusive measures
Photos, videos Other (list)

University of Wisconsin-Extension • Cooperative Extension • Program Development & Evaluation

UW-Extension provides equal opportunities in employment and programming, including Title IX and ADA.
© 2006 by the Board of Regents of the University of Wisconsin System http://www.uwex.edu/ces/pdande
Instrumentation: What is needed to record the information?

Questionnaire.

When will you collect data for each method you’ve chosen?
Before During Immediately
Method program program after Later
Survey – questionnaire (online) x

Will a sample be used?

No
Ye
x If yes, describe the procedure you will use.
s
Survey Questionnaire will be applied on a sample of students; and after
corrections and improvements to the instrument, with a larger sample. Interview
with a small sample of students and teachers.
Pilot testing: when, where, how?

October 2009 – Community Center – proofreading and applying the questionnaire

University of Wisconsin-Extension • Cooperative Extension • Program Development & Evaluation

UW-Extension provides equal opportunities in employment and programming, including Title IX and ADA.
© 2006 by the Board of Regents of the University of Wisconsin System http://www.uwex.edu/ces/pdande
 Analyze and Interpret
How will the data be analyzed?
It might include measures of central tendency (averages -
Data analysis
methods:
mean, median and mode). Web site will do it
electronically. Writing a list of suggestions.
Who responsible: The administrator

How will the information be interpreted—by whom?

The instructor

What did you learn? What are the limitations?

There is no way to verify that the questions are answered truthfully.

Use the Information

How will the evaluation be communicated and shared?
To whom When/where/how to present
Report of evaluation & Online Questionnaire December 6th – Community Center – Online

Next steps?

Collection & Analysis of data – Evaluation of evaluation program – evaluation of results

Manage the evaluation Standards

Human subject’s protection Utility
Management chart Feasibility
Timeline Propriety
x Responsibilities x Accuracy
Budget

Authors: Taylor-Powell, E.; Steele, S.; and Douglah, M.

University of Wisconsin-Extension • Cooperative Extension • Program Development & Evaluation
UW-Extension provides equal opportunities in employment and programming, including Title IX and ADA.
© 2006 by the Board of Regents of the University of Wisconsin System http://www.uwex.edu/ces/pdande