Professional Documents
Culture Documents
net/publication/329017623
CITATION READS
1 248
1 author:
Yasser E. Ibrahim
Prince Sultan University
52 PUBLICATIONS 249 CITATIONS
SEE PROFILE
Some of the authors of this publication are also working on these related projects:
Structural response of reinforced concrete structures under blast loads View project
All content following this page was uploaded by Yasser E. Ibrahim on 13 February 2020.
Student evaluation of teaching is considered one of the main elements in assessing the quality and effectiveness of teaching
of a faculty member. In most cases, the student evaluation is conducted at the end of the semester to assess all aspects of the
course in terms of performance of the instructor and adequacy of the teaching resources. However, student evaluation of a
course at the end of the semester may not necessarily reflect the actual performance of the instructor, as it may be affected by
other factors such as the grading style of the instructor and the grade expected by the student upon completing the course.
In this regard, there is a need to better assess the teaching effectiveness, especially in cases where student evaluation is used
as the primary criterion for assessing the faculty member. In this research, an approach was adopted to assess the teaching
effectiveness whereby the student evaluation at the end of the course is complimented by another one mid-way as well as
classroom observation conducted by the department chair. This approach was tested on thirteen undergraduate courses in
the Engineering Management program for different program years. A total number of 346 students participated in the
evaluation of teaching effectiveness. The results obtained from the three evaluations mentioned above were compared and
the grades of the students in these courses were considered to investigate their effect on the students’ evaluations. The
integrated evaluation that combines and averages the three evaluations minimizes the misleading effect of traditional SET,
normally conducted at the end of the course, which is sometimes affected by the grades expected by students. The whole
process gives a clear picture and appears promising as a comprehensive assessment tool of teaching effectiveness.
Keywords: teaching effectiveness; class observation; students evaluation; assessment
Many researchers attempted to define the noticeable was conducted by the department chair using
characteristics of good instructors from the stu- another special survey. Both surveys were devel-
dents’ perspective. Anderson et al. [12] stated that oped and adopted by the department. Both the
doctoral students reported that the most important feedback from the mid-way SET and the peer
characteristics of instructors are being responsive, observation were sent to the instructor for his
student-centered, ethical, professional and enthu- consideration in order to enhance the teaching and
siastic. Al-Mohaimeed and Khan [14] reported that learning process. Another SET was conducted for
medicine students showed their appreciation and the same courses at the end of the semester using the
admirations for those instructors who show respect university standard survey. In this study, the results
to their students, demonstrate expertise in the sub- of the two SETs and peer observation were analyzed
ject, understand/relate to students and apply good alongside the grades achieved by the students in
communication skills. On the other hand, having a these courses to investigate their effect on SET.
sense of humor, giving high grades, sharing personal
experience and dressing up appropriately were least 2. Methodology
valued by the students. Xiao and Dyson [15]
reported that Chinese students considered the The common practice of evaluating teaching is to
traits of: knowledge, responsibility, effective teach- seek students’ feedback about their courses at some
ing and encouragement and facilitation of indepen- time during the last two weeks of classes. Typical
dent, critical thinking to be the most valuable evaluations include many items and aspects of
characteristics of accounting instructors. teaching, such as the clarity of syllabus, assessment
The perception of good teaching differs among methods and course objectives from the beginning,
disciplines. In fields with difficult applications, such availability of resources, availability of the instruc-
as engineering, good teaching is perceived through tor during office hours, commitment of the instruc-
knowledge application and integration [16, 17]. On tor in his teaching, class times, use of technology, the
the other hand, in fields with soft applications, such enthusiasm of the instructor and the way he/she
as social work, stress protocols and procedures are treats students. Other items may affect the valuation
the most valued items for good teaching [18, 19]. of the instructor, including the relevance of the
A study conducted at a graduate college of course to the student’s major, expected grade by
education [20] revealed that the year of study in a the student, effort exerted from the student during
degree program affects the perception of good the course compared to other courses and the
teaching from the students’ perspective. First-year innovative techniques used in teaching. Passive
students considered instruction style to be the most students may prefer classical teaching methods
important aspect of good teaching; conversely, the that rely on one-way lecturing from the instructor
personal relationship between the instructor and the to students and do not like to be involved in
students was the most important for second-year teaching/learning processes using small groups or
students. Older and more mature students value the flipped class techniques. Appendix A shows the
long-term student development more than younger form used for final SET at the end of courses
students do. Gender, age and the type of the higher under consideration in this study.
education institute all affect the students’ perception For these reasons, there is always a need to
of good teaching [21]. incorporate other methods of evaluation besides
Peer observation of classrooms is an efficient way students’ feedback such as peer observations,
to measure the effectiveness of teaching. It can be whereby the instructor is evaluated by another
used besides the SET in order to provide compre- faculty member to evaluate aspects not considered
hensive assessment of teaching. Peer observation or not effectively evaluated by the students. To this
plays an important role in enhancing the teaching end, a teaching observation form was adapted by
through reflections and thoughts of the observer, the Engineering Management Department from the
who should have ample knowledge and experience Peer Observation Guidelines and Recommenda-
to play this role. Evaluation of the peer observer tions for developed initially by the University of
should not be rendered personal or subjective and Minnesota [24]. The form is presented in Appendix
no conflict of interest should be assured [22, 23]. B. The evaluation consists of three main sections:
In this research, an integral teaching evaluation content of the lecture, the delivery of the lecture and
process is applied considering 13 undergraduate the environment of the classroom. The evaluation
courses in the Engineering Management Curricu- has fourteen items covering these three sections. The
lum. The process included three different evaluation overall evaluation is the average score of these
items considering (1, 2) SET and (3) peer observa- fourteen items. After the classroom observation,
tion. First, a mid-way SET was conducted using a the form is filled with a score for each item besides
special survey. At the same time, peer observation comments addressing the strength and weakness
1824 Yasser E. Ibrahim
1 11 15 11 1 2 3.80
2 8 9 18 11 3 3.16
3 5 11 12 0 1 3.66
4 12 18 16 10 1 3.53
5 19 14 7 0 1 4.22
6 1 7 9 9 1 2.93
7 7 0 26 0 0 3.42
8 4 6 7 0 0 3.82
9 4 8 11 7 1 3.23
10 4 6 2 1 0 4.00
11 3 12 3 0 0 4.00
12 10 5 8 11 0 3.41
13 16 7 0 0 0 4.70
Fig. 1. Relationship between mid-way survey and chair observa- Fig. 2. Relationship between the SET at the end of the course and
tion (Conducted at same time). the grade average.
courses. It is worth mentioning that the courses is also can be related to the low grade average
that had distinct effect of students’ grade on the obtained (3.42 out of 4.0)
SET were in the early stage of the curriculum Integrating the three evaluations presented above
(second year). This indicates the effect of student can form a better platform towards a more
level in the curriculum on their evaluation. comprehensive assessment of the instructor and
Apparently, senior students care more about the can be more reflective of the teaching effective-
delivery of the course than their grades. ness; this can help avoid the misleading effect of
In some courses, it was noticed that the mid-way the grades on the SET. This integrated method is
SET and chair observation were very close while recommended, especially if the contract renewal
the final SET was considerably low, which are and promotion of the faculty member depend
obvious in course number 7 in the third year. This heavily on the SET. The integrated evaluation is
1826 Yasser E. Ibrahim
References
1. P. Hooper and J. Page, Measuring teaching effectiveness by
student evaluation, Issues in Accounting Education, 1986, pp.
56–64.
2. S. Darwin, What contemporary work are student ratings
Fig. 3. Relationship between the SET at mid-way and at the end of actually doing in higher education? Studies in Educational
the course and the chair observation. Evaluation, 54, 2016, pp. 13–21.
3. J. D. Newton, Using student evaluation of teaching in
administrative control: the validity problem, Journal of
calculated by averaging the three evaluations; Accounting Education, 6(1), 1988, pp. 1–14.
4. B. L. Steward, S. K. Mickelson and T. J. Brumm, Continuous
mid, final and chair observations as shown in Engineering Course Improvement through Synergistic use of
Table 3. The integrated evaluation differs from Multiple Assessment, International Journal of Engineering
the traditional SET value by around 12% in one of Education, 21(2), 2005, pp. 277–287.
5. K. A. Villanueva, S. A. Brown, N. P. Pitterson, D. S. Hurwitz
the courses. Although this course didn’t experi- and A. Sitomer, Teaching Evaluation Practices in Engineer-
ence the lowest grade average (3.42 out of 5.0) but ing Programs: Current Approaches and Usefulness, Interna-
it was somehow affected by the relatively low tional Journal of Engineering Education, 33(4), 2017, pp.
1317–1334.
grade average. Table 3 shows also the overall 6. D. Chalmers. A review of Australian and international
SET, which is calculated by averaging the tradi- quality systems and indicators of learning and teaching.
tional SET at the end of the course and the mid- Strawberry Hills: The Carrick Institute for Learning and
Teaching in Higher Education, 2007.
evaluation. This overall SET gives more rational 7. A. C. M. Moskal, S. J. Stein and C. Golding, Can you
evaluation. The difference between the SET value increase teacher engagement with evaluation simply by
between the mid and final evaluation reached improving the evaluation system? Assessment and Evaluation
in Higher Education, 41(2), 2017, pp. 286–300.
around 12% in one of the courses. 8. P. Spooren and W. Christiaens, I liked your course because I
believe in (the power of) student evaluations of teaching
(SET). Students’ perceptions of a teaching evaluation pro-
4. Conclusion cess and their relationships with SET scores, Studies in
Educational Evaluation, 54, 2017, pp. 43–49.
9. P. A. Koushki, A. Christoforou, A. M. Larkin and A. Al-
Student evaluation of teaching, SET, is a tool used roomi, Engineering Students’ Attitudes towards Teaching
for assessing the teaching effectiveness and instruc- and Teachers, International Journal of Engineering Educa-
tor’s evaluation for performance assessment. An tion, 21(3), 2005, pp. 424–433.
10. H. G. Murray, Student evaluation of teaching: Has it made a
integrated approach for the valuation of the teach- difference? Annual meeting of the society for teaching and
ing effectiveness is introduced for better assessment. learning in higher education, Charlottetown, Prince Edward
The approach considers the SET at mid-way and at Island, 2005.
11. P. Spooren, B. Brockx and D. Mortelmans. On the validity of
the end of the course as well as peer observation student evaluation of teaching the state of the art, Review of
using well designed surveys. The study is based on Educational Research, 83(4), 2013, pp. 598–642.
thirteen undergraduate courses in the Engineering 12. M. Anderson, J. M. Ingram, B. J. Buford, R. Rosli, M. L.
Bledsoe and A. J. Onwuegbuzie, Doctoral students’ percep-
Management Department. The results showed the tions of characteristics of effective college teachers: A mixed
effectiveness of the proposed approach and how it analysis, International Journal of Doctoral Studies, 7, 2012,
can avoid the misleading effect of the final students’ pp. 279–309.
13. D. Kember and A. Wong, Implications for evaluation from a
grades. Moreover, the mid-way evaluation is con- study of students’ perceptions of good and poor teaching, A.
sidered as preliminary assessment of the teaching Higher Education, 40(1), 2000, pp. 69–97.
effectiveness and it helps the instructor to take 14. A. A. Al-Mohaimeed and N. Z. Khan, Perceptions of Saudi
medical students on the qualities of effective teachers: A
corrective steps to fix the weak aspects that are cross-sectional study, Saudi Medical Journal, 35(2), 2014,
early detected and raised by students. pp. 183–188.
Based on this approach and results obtained, a 15. J. Z. Xiao, and J. R. Dyson, Chinese students’ perceptions of
good accounting teaching, Accounting Education, 8, 1999,
mathematical model can be developed to capture pp. 341–361.
the effect of grades obtained by students and hence 16. R. Neumann, Disciplinary differences and university teach-
corrections factors can be obtained in order to ing, Studies in Higher Education, 26, 2011, pp. 135–146.
17. R. Neumann, S. Parry and T. Becher, Teaching and learning
adjust the evaluation of the instructors conduced in their disciplinary context, Studies in Higher Education, 27,
at the end of the course, as being practiced every- 2002, pp. 405–417.
where in higher education, so that the effect of high 18. T. Becher, Quality assurance and disciplinary differences,
Australian Universities’ Review, 37(1), 1994, pp. 4–7.
grades and level of the course is eliminated or 19. T. Becher and P. Trowler, Academic tribes and territories:
minimized. This can be further investigated through Intellectual enquiry and the culture of disciplines, 2nd ed.
Integrated Evaluation of Teaching Effectiveness: A Case Study 1827
Ballmoor and Phil: The Society for Research into Higher 22. R. Berk, Survey of 12 Strategies to Measure Teaching
Education & Open University Press, 2001. Effectiveness, International Journal of Teaching and Learning
20. M. Miron and M. Mevorach, The good professor as per- in Higher Education, 17(1), 2005, pp. 48–62.
ceived by experienced teachers who are graduate students, 23. Z. S. Siddiqui, C. Diana and E. Sandra, Twelve tips for peer
Journal of Education and Training Studies, 2(3), 2014, pp. 82– observation of teaching. Med. Teach., 29, 2007, pp. 297–300.
87. 24. University of Minnesota, Peer Observation Guidelines and
21. F. N. Alhija, Teaching in higher education: Good teaching Recommendations, Office of Human Resources, 2013: http://
through students’ lens, Studies in Educational Evaluation, 54, www1.umn.edu/ohr/teachlearn/resources/peer/guidelines/
2017, pp. 4–12.
Yasser E. Ibrahim is an associate professor and chairman of the department of Engineering Management at Prince Sultan
University since 2015. He served as the chairman of committee for the teaching award of College of Engineering for last two
years. He has several conference and journal publications in the area of engineering education. His other research area
includes seismic resistant structures and structural response under different dynamic loads. He got his PhD in Civil and
Environmental Engineering from Virginia Tech. in 2005.
Comment