For this assignment, we were to conduct and write a short report of a personally conducted evaluation project on a real (not hypothetical) program or project. I planned and conducted an actual small-scale evaluation of a small program or project in my school. I gathered and used real data from my school for my report.
For this assignment, we were to conduct and write a short report of a personally conducted evaluation project on a real (not hypothetical) program or project. I planned and conducted an actual small-scale evaluation of a small program or project in my school. I gathered and used real data from my school for my report.
For this assignment, we were to conduct and write a short report of a personally conducted evaluation project on a real (not hypothetical) program or project. I planned and conducted an actual small-scale evaluation of a small program or project in my school. I gathered and used real data from my school for my report.
LMD School recently received iPads for all the teachers to use and integrate into their teaching. At the time of evaluation, each classroom only had one iPad. The teachers were given an iPad in December 2013 and were also provided with a list of educational apps to help get them started. Teachers were instructed by administration to integrate the iPad into their teaching and organization (i.e., lesson planning). The objectives of this program are to: identify and demonstrate the use of iPad tools and resources when teaching, develop at least 2-3 iPad integrated lessons based on grade specific content and curriculum per month, and determine an increase in student engagement from the use of the iPad based on his/her participation. The purpose of this evaluation is to determine that each teacher is meeting the program objectives established by the school administration. The steps involved in this evaluation include four components: teachers create 2-3 iPad integrated lessons, teacher pre-survey, teacher post-survey, and assess/survey student engagement. Teachers create an iPad integrated lesson and must submit the lesson to administration at least 3 days prior to the lesson being taught. Surveys will be given at the beginning of the evaluation to determine if the teachers comfort and knowledge level with the iPad. The survey results will help determine if the objectives are being met. Professional development/training will be offered to help teachers integrate iPads into their lessons. The evaluation found that student engagement increased with iPad use. Results showed that well over half of the responding students indicated they were more interested in the lesson with the teacher using the iPad. In the student survey, 60.7% of students indicated they felt more connected to the lesson when the iPad was used. The evaluation also showed that teacher iPad integration increased after professional development sessions. It indicated that over half of the teachers sometimes find it difficult to integrate the iPad into their teaching. Teachers also responded in this survey with 38.7% stating that student engagement increased with the iPad. Description of the Program Evaluated
The Teacher iPad Program involves the teachers and students at LMD School. Teachers were given the iPads as a result of a fundraising event. Teachers received their iPads in December 2013. This allowed time for them to use and gain comfort in using the iPad before student iPads are purchased the next year. Teachers were encouraged to explore and test out items during winter break, as well as with the students in class. This program began in December 2013 and goes through June 2014. In February, teachers were given the program objectives to work toward achieving by June. The intent of the program is that it is run on an individual basis, meaning each teacher has the freedom to determine the use of the iPad within the lesson based on the subject area being taught.
2
To achieve the goal and objectives of the program, teachers are required to create 2-3 iPad integrated lessons a month, per program objectives. The teachers were also provided with a list of educational apps to get them started on thinking how to integrate the iPads back in December 2013. Teachers are required to use a lesson plan book app to encourage more use of the iPad. Teachers were given a survey to see if they are using the iPad, increasing student engagement, and meeting program objectives. A survey will be given at the beginning of the evaluation to determine the teachers comfort and knowledge level with the iPad. If determined that teachers are not meeting program goals and objectives, teachers can be provided with training and opportunities for professional development to help fill gaps. This will provide the teachers with examples of how to integrate the technology and ask questions. Another survey will be given at the end of the evaluation to determine if program objectives are being met after 3-4 months of iPad integration. Program Objectives Teachers were instructed by administration to integrate the iPad into their teaching and organization (i.e., lesson planning). At the time of evaluation, the LMD School is currently limited to one per classroom. The teacher iPad program objectives are listed below. Teachers will be able to: Identify and demonstrate the use of iPad tools and resources when teaching. Develop at least 2-3 iPad integrated lessons based on grade specific content and curriculum per month. Determine an increase in student engagement from the use of the iPad based on his/her participation. Program Components The Teacher iPad Program materials include the iPad and list of program objectives. Other materials that may have been included in lessons are based on teacher need and discretion. The program is run on an individual basis, meaning each teacher has the freedom to determine the use of the iPad within the lesson based on the subject area being taught. There are four main components to this evaluation: 1. teachers are required to create 2-3 iPad integrated lessons a month and submit these plans to administration, 2. teacher pre-survey of iPad use, 3. teacher post-survey of iPad use, and 4. assess or survey student learning and engagement in iPad lessons. Teachers create an iPad integrated lesson and must submit the lesson to administration at least 3 days prior to the lesson being taught. Teachers are also encouraged to use a
3
lesson planning app on the iPad for a more consistent use and familiarity with the device. This also allows for easier lesson submission for the integrated lessons. Surveys will be given at the beginning of the evaluation to determine the teachers comfort and knowledge level with the iPad. Results of the survey will help administration determine if teachers need additional training and opportunities for professional development to help teachers reach program objectives. Professional development will help provide the teachers with examples and opportunities to learn how to integrate the iPad and ask questions. Another survey will be given at the end of the evaluation to determine if the professional development opportunities benefited them in their teaching and to see if they are meeting program objectives. To help teachers determine if the iPad was successful in the lesson, they were encouraged to informally assess student participation for an increase in engagement and/or survey the students to see if they enjoyed the lesson. Evaluation Method
Participants The participants of this evaluation consisted of the teaching staff at LMD School. The teaching staff consists of 35 teachers whose teaching areas range from preschool to 8 th
grade and also includes art, music, technology, and P.E. teachers. Each of these teachers was given an iPad to use in their classroom. The stakeholders for this program are LMD school administration, Principal Amber Johansen and Assistant Principal Jennifer Arnold. They provided the evaluator with the program goals, details of the program, and expected outcomes. The administration met with the evaluator at the beginning and end of the evaluation to discuss survey results. Procedures The Teacher iPad Program began in December 2013 when teachers received their iPads. The evaluation started with a discussion between the evaluator and LMD School administration to discuss the program objectives for this evaluation. Once the objectives were adjusted for the evaluation, a discussion of the types of questions to be included in the teacher and student evaluations was held. The responses to these surveys will help determine the success of the iPad implementation. The surveys will also help determine if program objectives were met since questions were based around them. The teacher pre-survey was created after initial discussions with administration and distributed in mid-February 2014. This pre-survey will provide data and results on how teachers are using and implementing the iPad so far. It will also help determine how much additional training and professional development is needed. Training sessions and professional development will be offered from February March 2014. Training sessions involved teachers sharing apps they have found and what they have learned
4
with the iPads. Professional development included one day with two different sessions by Apple representatives, session descriptions can be found in Appendix E. About three months after the program started, the evaluator met with administration to share and discuss any possible changes that needed to be made to the teacher post- survey and student survey. After changes were made, the surveys were distributed. The surveys will provide data on the success of teacher iPad use and suggestions for the future iPad integration. Data Sources Teacher Attitudes An electronic pre-survey was distributed to all 35 teachers in the school in mid-February 2014, which can be found in Appendix C. This survey gave the teachers the opportunity to provide feedback on their attitudes of using the iPad in their teaching thus far. Teachers were given the opportunity to provide their attitudes and suggestions for improvement with the program. There was an 89% response to this pre-survey. An electronic post-survey was distributed to all 35 teachers in the school in mid-April 2014, which can be found in Appendix D. This survey gave the teachers the opportunity to provide feedback on their attitudes of using the iPad in their teaching since the last survey in February. Teachers were given the opportunity to provide their attitudes and suggestions. There was a 91% response to this post-survey. Student Attitudes An electronic survey was distributed to all students (K-8), which can be found in Appendix B. Students were given 3 days to fill out this survey. This survey gave the students the opportunity to provide feedback on their attitudes towards iPad use, attitude towards their teachers use of iPads, and engagement in lessons. The results were used to determine the overall student attitudes and whether or not the iPad lessons increased student engagement. Out of the maximum allowed responses, there was a 61% student response to this survey. Results
Teacher Attitudes Teacher iPad Use Pre-Survey All 35 teachers at LMD School were sent the pre-survey and 31 teachers responded. This survey shows the teachers feedback on their attitudes of using the iPad in their teaching thus far. Teachers were given the opportunity to provide their attitudes and suggestions. All teachers stated that the provided list of educational apps helped them get started. At this point in the program, 28 of the responding teachers said they were already integrating their iPad into their teaching. Of the responding teachers, 90% said
5
they needed more training and professional development to be able to integrate the iPad into their teaching. The following tables summarize data collected from the survey.
Teacher iPad Use Post-Survey All 35 teachers at LMD School were sent the pre-survey and 32 teachers responded. This survey shows the teachers feedback on their attitudes of using the iPad in their teaching since the pre-survey. Teachers were given the opportunity to provide their attitudes and suggestions. All teachers stated that they integrate their iPad into their teaching and 50% said they now use an app for as their lesson plan book. All responding teachers stated that their lessons have improved since integrating their iPad. Even though 90% of the teachers said the training and professional development helped them integrate the iPad, many suggested additional ways to gain more training or professional development. Suggestions for more training included: more Apple training sessions, podcasts, websites, question/answer session, and sharing sessions with staff. The following tables summarize data collected from the survey. 6 18 7 0 5 10 15 20 Yes Sometimes No Do you find it difficult to create the required 2-3 iPad lessons per month? Number of teachers 28.13% 65.63% 6.25% 0% 10% 20% 30% 40% 50% 60% 70% Yes Occasionally No Do you notice an increase in student engagement from the use of the iPad based on his/her participation? % of teachers
6
Student Attitudes All students in K-8 were sent this survey to fill out within a 3 day period. This survey gave the students the opportunity to provide feedback on their attitudes towards iPad use, attitude towards their teachers use of iPads, and engagement in lessons. Of the responding students, 95% of students indicated that they liked the iPad integrated lesson. Also, 82% of students stated that their teacher used the iPad for most of the lesson. The following tables summarize data collected from the survey. 1 20 11 0 5 10 15 20 25 Yes Sometimes No Do you find it difficult to create the required 2-3 iPad lessons per month? Number of teachers 38.71% 61.29% 0.00% 0% 10% 20% 30% 40% 50% 60% 70% Yes Occasionally No Do you notice an increase in student engagement from the use of the iPad based on his/her participation? % of teachers 29 3 0 5 10 15 20 25 30 35 Yes No Do you feel the additional training and professional development helped you to properly integrate the iPad into your classroom? Number of teachers
7
Table 1.1: Student responses to iPad use in school Strongly Agree Agree Neutral Disagree Strongly Disagree The iPad allows me to learn in different ways. 16.4% 67.2% 16.4% 0% 0% The iPad makes learning more fun. 27.9% 65.6% 6.6% 0% 0% I feel more connected to the lesson when the iPad is used. 24.6% 60.7% 14.8% 0% 0%
Table 1.2: Student responses to teacher iPad use Strongly Agree Agree Neutral Disagree Strongly Disagree My teacher uses the iPad in at least 2 lessons per month. 11.5% 47.5% 24.6% 16.4% 0% My teacher makes learning fun with the iPad. 16.4% 68.9% 14.8% 0% 0% My teacher keeps my attention more when using the iPad. 16.4% 70.5% 13.1% 0% 0% 2 5 8 7 8 7 8 9 7 K 1st 2nd 3rd 4th 5th 6th 7th 8th 0 2 4 6 8 10 Number of student responses per grade Number of students 56 5 0 10 20 30 40 50 60 Yes No Were you more interested in the lesson because your teacher was using the iPad? Number of students
8
Discussion
The purpose of this evaluation is to determine that each teacher is meeting the program objectives established by the school administration. Objectives include developing iPad integrated lessons, demonstrating iPad tools when teaching, and increasing student engagement. The program is run on an individual basis, meaning each teacher has the freedom to determine the use of the iPad within the lesson based on the subject area being taught. The evaluation results showed that student engagement increased with iPad use. Well over half of the responding students indicated that they were more interested in the lesson with the teacher using the iPad. Also according to results, teacher integration increased after professional development. It indicated that over half of the teachers sometimes find it difficult to integrate the iPad into their teaching. The teachers were given a pre-survey in mid-February. The results of this showed that 23% of the teachers said they do not find it difficult to integrate the iPad and 58% of teachers also indicated that sometimes it can be difficult to integrate the iPad. Teachers also responded in this survey with 28.1% stating that student engagement increased with the iPad. In mid-April, the post-survey was given to teachers. The results of this survey showed an 11% increase of the teachers that found it easier to integrate the iPad. In the post- survey, 34% of teachers said they do not find it difficult to integrate the iPad. It also showed 62% of teachers said that sometimes it can be difficult to integrate the iPad. Teachers also responded in this survey with 38.7% stating that student engagement increased with the iPad. Students were given a survey to complete based on teacher iPad use. In the student survey, 92% of students said they felt more interested in the lesson with the addition of the iPad and 60.7% of students indicated they felt more connected to the lesson when the iPad was used. 70.5% of students also indicated in the survey that the teacher kept their attention more when using the iPad. Although this program is meeting the established objectives, one suggestion can be made to help meet and exceed objectives: Hold training and professional development sessions at least once a month. Based on the results of the evaluation, teachers are creating 2-3 iPad lessons per month, but many teachers still struggle with this as stated by the 62% that still find it difficult to integrate. Overall, the evaluation results showed that student engagement increased with iPad use and teachers comfort with integration increased after professional development. The purpose of this evaluation is to determine that each teacher is meeting the program objectives established by the school administration. The results and data of this evaluation support and show that the purpose was indeed met, although areas could be improved. Based on the post-survey, 34% of teachers stated that they did not find it difficult to integrate the iPad 2-3 times a month. This shows that several teachers found the professional development to be helpful in their future lesson planning. Although, 62% of teachers stated they sometimes find it difficult to integrate the iPad 2-3 times a
9
month. One suggestion to help teachers integrate the iPad is to hold training and professional development sessions at least once a month. Based on the student survey, 92% of students said they felt more interested in the lesson with the addition of the iPad and 60.7% of students indicated they felt more connected to the lesson when the iPad was used. This shows that the students are more excited and interested in learning when the iPad was included. Results also show that 68% of responding students found the lessons to be more fun with the addition of the iPad. Based on results of this evaluation teachers are meeting the established objectives for this program, but can improve the number of teachers that have no difficulties integrating by offering more professional development. Project Cost
The total cost of this evaluation is detailed in Appendix A. It includes one evaluator for ten days of work, supplies, communication, and travel. The 10 days included time for the creation and distribution of survey materials and analysis of the survey information. The site visits included meetings with administration at the beginning and end of the evaluation, as well as time to meet with staff and students to explain and distribute surveys.
10
Appendix A Copy of Invoice
11
Appendix B Student iPad Survey
Survey can be found at this link: https://www.surveymonkey.com/s/9NC7V9L
12
Appendix C Teacher iPad Use Pre-Survey
Survey can be found at this link: https://www.surveymonkey.com/s/9NBTBJL
13
Appendix D Teacher iPad Use Post-Survey
Survey can be found at this link: https://www.surveymonkey.com/s/9F2XJWN