Inter-rater reliability is a way to measure the level of agreement between multiple

raters or judges. It deals with the topic of rating system implementation uniformity. Inter-
rater reliability can be evaluated by using a number of different statistics.
This process needed to make sure the data collected is authentic and correct. The data
collected test through observation or research against the data obtained or else conduct a
review using data collected with assistance some people related to the field of study.
In this study triangulation was used for the validity and reliability of the data
qualitative. This strategy is used to improve the study's qualitative data's validity and
reliability. The data from this study was shared with my two classmates in order to test the
data's dependability. Table below show the theme explanation and the agreement between
two rater.
Agreement
Themes Explanation
Rater A Rater B
Q1: There is positive and negative perception Agree Agree
Teachers’ about the online teaching and learning depends
perception on the situation that face by a teacher.

Q2: The teachers think that in this time of

pandemic is the best way to teach the students Agree Agree
but to conduct it is very hard especially in rural
area and the student’s family can’t afford a
gadget.

Q3: The teachers also agree that this system

improve their skills and knowledge about online Agree Agree
teaching and learning.

Q4: The traditional way of face-to-face is better Agree Agree

than online learning.

Q5: Online learning looks easy to be understood Agree Agree

conceptually, but also has difficulties for
implementing.
 Q6: Easy to use. Agree Disagree
(Hard and it
necessitates a
great deal of
patience)
Q7: The teachers try everything to attract the Agree Agree
students interesting and involvement in teaching
and learning process.

Q8: The teachers even gave reward (Credit Agree

Agree
reload) to the students so that they can join the
next class.

Motivation Q9: The teachers willing to learn new knowledge

about using many types of application (canva, Agree Agree
quizizz, google form, Youtube, Telegram etc.) to
help them to delivery and prepare teaching
materials.

Q10: Some of the teachers which is in rural area Agree

Agree
taking risk to went to the student’s house or
village to give them module.
Teachers’ Q11: The teachers do in their very best to interact Agree Agree
role with the students by sending a personal message
to the parents.

Q12: Build a good relationship with the parents Agree Agree

because parents also play an important role in the
system.

Q13: Guide the students to master any topic that Agree Agree
the students weak.

Q14: Try every way to help the students to learn.

 (Module, activity book, project etc.) Agree Agree
Q15: No one ever expecting the pandemic so Agree Agree
teacher should always ready for the worse.

Q16: Learn how to use Google classroom,

Edmodo, Zoom meeting, teaching through media Agree Agree
social and so on in order to help the students.

Q17: Not 100 % ready mentally and emotionally.

The teachers improvise their online teaching
delivery through sharing session with other Agree Agree
Teachers’
teachers.
readiness

Q18: Ready to responds the students any time. Disagree Disagree

(Set maximal (Teacher also
time to human and
respond the have their
students) own family to
manage, set
time to
respond the
students)
Teachers’ Q19: Difficult to determine the students Agree Agree
challenges understanding and level.

Q20: Problem submission of homework from the Agree Agree

students.

Q21: The teachers were unable to conduct online

learning effectively due to a breakdown in the Agree Agree
internet connection and other technical issues.

Q22: Parents did not co-operate to help their Disagree Agree

children. (It’s not only
 the parent but
the students
also)

Q23:Teachers must devote a significant amount

of time to online learning, and it has a negative Agree Agree
impact on their emotional well-being.

Q24: Distractions from the environment. Agree Agree

Q25: Lack of access to facilities, internet Agree Agree

connection and gadget.
Table 5: Inter-rater reliability

The data then calculated to determine the validity and reliability. If the raters agrees,
IRR is (or 100%) and if everyone disagrees, IRR is 0 (0%). The result is 88% which the data
is valid.

Table 6: Calculation of Inter-Rater Reliability