This document outlines 11 key evaluation questions for the HOPE program along with the evaluation type, data type, data collection methods, data analysis methods, and level of analysis for each question. The questions focus on outcomes and impacts of the program including the number of children reached, quantitative and qualitative data on student success and community impact, challenges faced and successes achieved by the program, examples of student empowerment, feedback received, promotion within the community, plans for improvement, effectiveness compared to other programs, and future goals. Data collection methods include interviews, archives, questionnaires/surveys, and indirect sources, with analysis including descriptive, critical, interpretive, and thematic approaches.
This document outlines 11 key evaluation questions for the HOPE program along with the evaluation type, data type, data collection methods, data analysis methods, and level of analysis for each question. The questions focus on outcomes and impacts of the program including the number of children reached, quantitative and qualitative data on student success and community impact, challenges faced and successes achieved by the program, examples of student empowerment, feedback received, promotion within the community, plans for improvement, effectiveness compared to other programs, and future goals. Data collection methods include interviews, archives, questionnaires/surveys, and indirect sources, with analysis including descriptive, critical, interpretive, and thematic approaches.
This document outlines 11 key evaluation questions for the HOPE program along with the evaluation type, data type, data collection methods, data analysis methods, and level of analysis for each question. The questions focus on outcomes and impacts of the program including the number of children reached, quantitative and qualitative data on student success and community impact, challenges faced and successes achieved by the program, examples of student empowerment, feedback received, promotion within the community, plans for improvement, effectiveness compared to other programs, and future goals. Data collection methods include interviews, archives, questionnaires/surveys, and indirect sources, with analysis including descriptive, critical, interpretive, and thematic approaches.
Key Evaluation Evaluation Data Collection Data Analysis Level of
Questions Type/Data Type Methods Analysis
1) How many Outcome/Summative Interviews: -Develop -Descriptive children does Conduct interviews with system to Analysis HOPE aim to Quantitative program stakeholders organize data reach in the to determine the -Code future? estimated numerical responses to figure of program numerical participants the HOPE values. program wishes to -Take notes reach in the future. and record the value of each response. 2) What Outcome/Summative Archive Data: -Develop -Critical quantitative data Investigate past records system to Analysis have you Quantitative of student achievement organize data recorded that including test scores -Code supports student and other measurable responses to success? records demonstrating numerical improvement and values. success. -Take notes and record the value of each response. 3) What Outcome/Summative Questionnaires/Surveys: -Reading: -Critical qualitative data Distribute extract Analysis have you Qualitative questionnaires to meaning from received program officials asking the text ensuring your for information they -Memo-ing: positive impact have or are aware of Record on the that has demonstrated observations community? positive influence from and thoughts the HOPE program into about the text the local community. -Coding: Identify the data you are analyzing. 4) What have Outcome/Summative Interviews: -Reading: -Critical been the biggest Interview all impacted extract Analysis challenges facing Qualitative members of the meaning from your program to determine the text organization? which challenges and -Memo-ing: obstacles have been the Record most difficult for the observations program to overcome and thoughts about the text -Coding: Identify the data you are analyzing. 5) What have Outcome/Summative Archive Data: -Develop -Critical been the Investigate past records system to Analysis greatest Quantitative of student achievement organize data successes of this including test scores -Code program? and other measurable responses to records demonstrating numerical improvement and values. success. -Take notes and record the value of each response. 6) What are Impact/Formative Interviews: -Reading: -Interpretive some specific Distribute interviews to extract Analysis examples of Qualitative past and current meaning from student program participants to the text empowerment engage the level and -Memo-ing: this program has degree to which Record achieved? students have observations empowered. and thoughts about the text -Coding: Identify the data you are analyzing. 7) Have you Outcome/Summative Questionnaires/Surveys: -Reading: -Interpretive received any Interview program extract Analysis negative Qualitative participants and meaning from feedback from stakeholders to seek the text other programs any negative feedback -Memo-ing: or community they may or may not Record members? have received over the observations lifetime of the program. and thoughts about the text -Coding: Identify the data you are analyzing. 8) How have you Outcome/Summative Questionnaires/Surveys: -Develop -Descriptive promoted your Distribute system to Analysis organization Qualitative questionnaires seeking organize data within the direct evidence of how -Code community? the HOPE initiative has responses to promoted its program including any events numerical and promotional values. activities. -Take notes and record the value of each response. 9) How do you Outcome/Summative Interviews: -Reading: -Descriptive plan to improve Hold Interviews with extract Analysis your current Qualitative program officials to meaning from operational determine specific the text methods? insights and plans to -Memo-ing: improve the quality and Record content of the program. observations and thoughts about the text -Coding: Identify the data you are analyzing. 10) How Outcome/Summative Indirect Sources: -Reading: -Critical effective is HOPE Engage with members extract Analysis in comparison Qualitative outside of the program meaning from with alternative to seek information and the text programs? public opinion about -Memo-ing: the effectiveness of Record HOPE in relation to observations similar programs in the and thoughts community. about the text -Coding: Identify the data you are analyzing. 11) What are the Outcome/Summative Interviews: -Reading: -Critical future goals of Conduct interviews with extract Analysis the program and Qualitative stakeholders to meaning from what does HOPE determine future goals the text plan to and program theories -Memo-ing: accomplish in for HOPE and what Record the next year? specific achievements observations they wish to accomplish and thoughts over the next year. about the text -Coding: Identify the data you are analyzing. 12) How are the Impact/Formative Observations: -Develop -Descriptive students Observe and monitor system to Analysis responding to Quantitative students over a organize data the lessons? significant period -Code recording measurable responses to progress with their numerical English skills. values. -Take notes and record the value of each response. 13) Are there Impact/Formative Interviews: -Reading: -Critical any restrictions Conduct interviews with extract Analysis from the Qualitative the students to meaning from students? determine any the text obstacles or barriers, if -Memo-ing: any, that are preventing Record them from achieving observations personal success in the and thoughts program. about the text -Coding: Identify the data you are analyzing. 14) Are students Impact/Formative Observations: -Reading: -Critical improving their Monitor the students extract Analysis language skills? Qualitative over time and log any meaning from improvements they may the text have made with their, -Memo-ing: reading, writing, Record speaking skills etc. observations and thoughts about the text -Coding: Identify the data you are analyzing. 15) Are students Impact/Formative Questionnaires/Surveys: -Reading: -Critical becoming more Conduct surveys with extract Analysis motivated to Qualitative the students to meaning from learn? determine whether the text they are being -Memo-ing: motivated by the Record program and how observations engaged they are with and thoughts the materials and about the text lessons they are -Coding: involved with. Identify the data you are analyzing. 16) What are the Impact/Formative Archive Data: -Develop -Critical data from test Investigate past records system to Analysis scores that Quantitative of student achievement organize data demonstrate including test scores -Code improvement? and other measurable responses to records demonstrating numerical improvement and values. success. -Take notes and record the value of each response. 17) Are their Impact/Formative Observations: -Reading: -Critical noticeable shifts Monitor the students extract Analysis in the student's Qualitative over time and log any meaning from reading, writing, improvements they may the text and speaking have made with their, -Memo-ing: capabilities? reading, writing, Record speaking skills etc. observations and thoughts about the text -Coding: Identify the data you are analyzing.