Program Evaluation 1

Program Evaluation

Name

Course

Date
 Program Evaluation 2

Question 1

The logic model will prove as an easy way for the philanthropists to establish what the

nonprofit does and how it affects the community. The logic model is developed through several

steps. The logic model is often used as a tool for program planning. It is also used for the

implementation and performance management. The model defines how the program will

function and links the output of the theoretical assumptions and processes of the program1. The

logic model will be created through several steps:

i. Target population - Individuals who will benefit or gain from the program.

ii. Underlying assumptions - The theoretical basis of how the program will work. It involves

assumptions on participants, environment, and the staff.

iii. Resources or challenges - Describes the resources available to achieve program

objectives.

iv. Activities - Interventions or services availed to achieve program objectives.

v. Output - Products or activities such as how the individuals are assisted.

vi. Outcomes - Benefits are arising from the program activities.

Table 1: Logic model

Target Assumptions Inputs/ Activities Outputs Outcomes

Population resources

1
Frechtling, J. A. 2007. Logic Modeling Methods in Program Evaluation. Vol. 5. New York: Jossey-Bass Inc Pub. 10-
60
 Program Evaluation 3

Homeless The individuals do Funding Providing: Reduction of Short-term

people not have any from donors Food homeless Prevention of

relatives or a place labor Clothing individuals crime, drug

to live (Volunteer Shelter dealing, school

and paid) Job Reduction of dropout

The organization has Equipment training risk factors Increased support

sufficient resources Childcare for the homeless

to cater to most Improvement of Intermediate

homeless protective Increase in

individuals factors employability

Provision of Reduction in rates

food, housing, of homelessness

and clothing Long-term

A decreasing rate

Increased of homelessness

childcare in the community

services Provision of

services for the

homeless

The logic model guides evaluation as it details what the program will do and its

objectives. It is beneficial as it outlines the relationships between activities, results, and

resources, and how they are related to the program. It also provides a means to make
 Program Evaluation 4

assumptions about the project in an explicit manner. Specifically, gaining stakeholder agreement

means that they will support the specifics of the logic model. It is a way to ascertain program

effectiveness. Furthermore, some stakeholders would want to look at how the program operates

before they can support it2. It would ensure that the program meets their needs.

Question 2

English as a Second Language (ESL) program is a complex activity to evaluate. I will

apply several strategies to recruit, enroll, and retain sufficient numbers of ESL students and

adults for the comparison group to be used in the evaluation. Recruitment and retaining the

individuals for the comparison group will first begin by considering various variables to enroll

the participants. These includes the background, communication skills among the learners,

interpersonal qualities, training and supervision. These variables will be used to limit the number

of participants required for the comparison group and ensure that they are eligible. The pretest

group comprises of top scores in ESL. The post-test group is comprised of the second measure.

The control group are the participants who act as the standard for comparing if the ESL has any

impact. Furthermore, the pretest-posttest control group design will involve the XO notation. O is

an observation while X is the ESL program. R is defined as the subjects randomly assigned to

groups. The design is as follows:

2
Frechtling, J. A. 2007. Logic Modeling Methods in Program Evaluation. Vol. 5. New York: Jossey-Bass Inc Pub. 10-
109
 Program Evaluation 5

The input will involve the background which will consider their experience with English

in the past. Furthermore, the variable in regards to communication skills will look at how the

ESL program has affected the participants3. Interpersonal qualities will also be considered to

determine how the students interact, considering they are still learners of English. Finally,

training and supervision will look at how the program is carried out, and the mechanisms in pace

to ensure its effectiveness. The output is how the ELS program affects the learners. Finally, the

outcome is the advantage of the program or the arising benefits. A major pitfall arising during

the recruiting and retaining recruitment and retention of participants arises from characteristics

inherent in the sample. It would influence them not to the participant. The various issues that

influence them to decline participation include fear, being busy, apathy, suspicion, and

unpleasantness. In the case of busy participants, as would be the case with the adults, they should

be encouraged to make time for the study. On the other hand, the participants who decline to

participate due to privacy issues can be assured of the confidentiality of the study. Suspicion is

also dealt with by using professional and conversational tone. The unpleasant feelings can be

addressed by providing an opportunity for another attempt in future. Finally, issues of fear can

be resolved by carrying out the study based on the terms of the participant.

Question 3

A survey is an effective evaluation tool. The survey being created as an evaluation of the

activities of the Small Business Office of the National Institute of Health. The creation of the

survey will involve the representation stage. The survey seeks to look at the specific attributes of

the business owners who attend the monthly seminar. The first step entails choosing the target

3
Wholey, J. S., H. P. Hatry, and K. E. Newcomer. 2010. Handbook of Practical Program Evaluation. Vol. 19. New
York: John Wiley & Sons. 49-151.
 Program Evaluation 6

population. For example, the small businesses are the target population. The second step is the

sampling frame. It is where the specific participants are accessed from the larger target

population. The contact information will be used as part of the sampling frame4. The next sample

is accessing the sample. These are the businesses that are part of the survey. Specifically, a

proper sample will be obtained from the randomly picking seventy phone numbers from the

contact information recorded by the office. The next step entails choosing the respondents,

which comprise about 50 individuals who represent the businesses. Finally, the post-survey

adjustment is carried out5. It consists of 50 representative businesses. The survey questions that

would be posed to the participants would seek to determine the effectiveness of the program. An

example of survey question is; Does the seminar encourage repeat attendance? How has the

seminar been of benefit? The steps outlined will prove beneficial in creating a conclusive survey.

The validity and reliability of the data will be guaranteed by using contact information that is

valid (internal validity). Furthermore, the selection of participants will be random in nature. A

focus group will also be used comprised of a few businesses. It would ensure that the data of the

research represents what it is intended to (external validity).

4
Frechtling, J. A. 2007. Logic Modeling Methods in Program Evaluation. Vol. 5. New York: Jossey-Bass Inc Pub. 10-
109
5
Wholey, J. S., H. P. Hatry, and K. E. Newcomer. 2010. Handbook of Practical Program Evaluation. Vol. 19. New
York: John Wiley & Sons. 49-151.
 Program Evaluation 7

References

Frechtling, J. A. 2007. Logic Modeling Methods in Program Evaluation. Vol. 5. New York:

Jossey-Bass Inc Pub.

Wholey, J. S., H. P. Hatry, and K. E. Newcomer. 2010. Handbook of Practical Program

Evaluation. Vol. 19. New York: John Wiley & Sons.