Program Evaluation Assignment Week 4

By
Devon Saggers
PADM S688: Program Evaluation
University of Alaska Southeast
Instructor: Dr. Kathlene DiLorenzo
June 11, 2023
running head: WEEK 4 ASSIGNMENT

Chapter 8 Summary

Chapter 8 discusses the dynamics of designing an evaluation by describing

the evaluation process consisting of designing, evaluation methods/tools, and the
evaluation matrix. At the beginning of the chapter, the author explains why it is
important to have an evaluation methodology based on a strong emphasis on attribution
and design rigor because we want to be sure if a program that is being implemented is
either working effectively or not, to ensure that financial resources are not being wasted.
If you are studying only a single group of individuals in a single environment and they
are the only ones being evaluated, then the researcher recommends using the single
group design combined with an effective logic model to demonstrate a theoretical
association between the program and long-term outcomes. Using a comparison-group
design is most desired for evaluation projects that involve two or more groups; however,
this type of design methodology will yield meaningless results if a compassion
community is not carefully chosen based on key attributes of that community. Finally,
the author describes that most rigorous evaluation methodology called a true
experiment. It involves the researcher designing a comparison group rather than
selecting a group to evaluate that already exists. The author also mentions that certain
techniques can enrich an evaluation design such as using repeated measures which
involves collecting data elements at various time points during your project, longitudinal
data which is collected over a extend time span, as well as using logic models and case
studies. The author also describes mainstream collection methods that can be used in
an evaluation study such as qualitative methods which rely on non-numerical data such
as interviews, focus groups, observations, portfolios, and case studies. She also
describes quantitative methods that rely on numerical data such as assessments, test,
and surveys, while mixed methodology employs both qualitative and quantitative
methods.

What I learned

One thing I learned from this chapter is that it is not always possible to employ
either a qualitative or quantitative study methodology exclusively. In certain cases,
especially when dealing with studies involving people, it is best to employ both methods.
The other thing I have learnt from this study is that without an effective logic model, it
will be difficult to come to a conclusion that honestly states that the evaluation program
is a success, especially since a logic model can reveal latent nuances that can really
skew your results.

1
running head: WEEK 4 ASSIGNMENT

References

Giancola, S. P. (20200103). Program Evaluation: Embedding Evaluation into Program

Design and Development. [[VitalSource Bookshelf version]]. Retrieved from
vbk://9781506357454