Program Evaluation

Myths About Program Evaluation

1. Many people assume that evaluation is a pointless activity that results in
a swarm of dull facts and meaningless conclusions. When program
evaluation methods were chosen mostly on the basis of reaching total
scientific precision, dependability, and validity, this was an issue with
evaluations in the past. This method frequently resulted in a large amount
of data from which very carefully picked conclusions were drawn. The use
of broad generalizations and recommendations was avoided. As a result,
assessment reports tended to restate the obvious, leaving program
administrators dissatisfied and doubtful of evaluation's overall value. More
recently (especially as a result of Michael Patton's development of
utilization-focused evaluation), evaluation has focused on utility, relevance
and practicality at least as much as scientific validity.

2. Many individuals feel that assessment is all about showing a program's

success or failure. This myth implies that success is defined by putting in
place the ideal program and never having to speak to employees,
customers, or clients again because the program will function flawlessly on
its own. This isn't anything that happens in real life. Maintaining an open
mind to criticism and changing the program as needed is the key to
success. This continuous input is provided by evaluation.

3. Many people believe that evaluation is a one-of-a-kind, sophisticated

procedure that takes place at a specific time and in a specific method, and
that virtually always involves the engagement of outside experts. Many
people assume that phrases like validity and reliability must be properly
understood. They are not required to do so. They must examine what data
they require to make current judgments about program challenges or
requirements. They must also be willing to put up the effort to figure out
what is truly going on. Many people conduct some type of program
assessment on a regular basis; they just don't do it in a formal way, so
they don't get the most out of their efforts or come to incorrect conclusions
(some evaluators would disagree that this is program evaluation if not
done methodically). As a result, they miss out on valuable possibilities to
make a bigger impact on their customers and clients, or to get more bang
for their dollars.

What is Program Evaluation?

We'll start with the question, "What is a program?" Typically, organizations
work backwards from their mission to determine a number of broad
objectives that must be met in order to achieve their mission. Each of
these objectives is frequently turned into a program in nonprofits.
Nonprofit programs are structured approaches to providing certain services
to constituencies, such as clients, consumers, and patients. Programs must
be assessed to see whether or not they are beneficial to constituents. A
program in a for-profit organization is typically a one-time effort to create a
new product or series of products.

So, what is program evaluation, exactly? Program assessment is the

process of gathering information on a program or a specific aspect of a
program in order to make program-related choices. Needs assessments,
accreditation, cost/benefit analysis, effectiveness, efficiency, formative,
summative, goal-based, process, outcomes, and other types of evaluation
can all be included in a program evaluation. The type of evaluation you
conduct to improve your programs is determined by what you want to
learn about it.