You are on page 1of 10

Studies in Educational Evaluation 72 (2022) 101118

Contents lists available at ScienceDirect

Studies in Educational Evaluation


journal homepage: www.elsevier.com/locate/stueduc

Students’ experiences of fairness in summative assessment: A study in a


higher education context
Ali Darabi Bazvand a, b, *, Amirhossein Rasooli b
a
Department of English, Catholic University in Erbil, Erbil, Iraq
b
Department of Educational Psychology, University of Alberta, Edmonton, Canada

A R T I C L E I N F O A B S T R A C T

Keywords: Given that assessment outcomes during higher education courses highly determine the recognition students
Classroom assessment receive from their instructors, classmates, and educational community, the scrutiny of fairness in assessments is
Fairness in assessment critical to ensure positive student experiences and psychosocial outcomes. Despite the enormous influence of
Higher education
assessment on student learning, research on various dimensions of fairness in assessment in higher education is
Students’ experiences of fairness
Summative assessment
yet to receive adequate attention. This study has examined the postgraduate university students’ articulated
experiences of fairness in summative assessments within the higher education context of Iran. Based on the
participants’ qualitative responses, two themes were identified that constituted students’ perceptions of un­
fairness: ‘equity’ and ‘interactional fairness’. Furthermore, students reported suggestions to promote fairness of
assessments in higher education contexts that included themes such as ‘the need for balancing power and col­
lective knowledge in the assessment practices’ and ‘the need to create an advocacy body to defend the rights of
students for fair assessments’. These findings highlight the attention to the factors driving students’ perceptions
of unfairness and mechanisms for enhancing fair assessment practices within a university context.

1. Introduction students’ articulated experiences of fairness as the basis to contribute to


addressing this gap.
Fairness is an underpinning quality of assessment. In higher educa­ Prior studies on fairness in assessment in higher education essentially
tion, fairness in assessment impacts students’ cognitive and socio- adopted quantitative survey methods to examine students’ perceptions
emotional learning (Chory-Assad, 2002; Rasooli, DeLuca, Rasegh, & of fairness in various domains, including assessment methods (Burger,
Fathi, 2019), perceptions of effective feedback (Lizzio & Wilson, 2008; 2017; Mauldin, 2009; O’Neill, 2017; Sambell, McDowell, & Brown,
Seevers, Rowe, & Skinner, 2014), and evaluation of instructors’ effec­ 1997), feedback (Lizzio & Wilson, 2008), grading (Nesbit & Burton,
tiveness (Gotlieb, 2009; Tata, 1999). Given that assessment outcomes 2006), cheating (Pitt & Winstone, 2018), test fairness (Zlatkin-­
during higher education courses highly determine the recognition stu­ Troitschanskaia et al., 2019), as well as the relationship between per­
dents receive from their instructors, classmates, and educational com­ ceptions of fairness and outcome variables. Students’ perceived fairness
munity, the scrutiny of fairness in assessments is critical to ensure of assessment methods has received relatively more attention than other
positive student experiences and psychosocial outcomes (Grace, 2017). domains, signaling the major direction of fairness research within
Assessment outcomes also certify the knowledge and skills students have assessment in higher education (Lizzio & Wilson, 2008; Nesbit & Burton,
sufficiently mastered in their relevant areas of expertise, opening the 2006; O’Neill, 2017).
gates for students’ future employment pathways. Thus, it is conceivable Despite the promising efforts to conceptualize and empirically
that students would consider fairness in assessment as fundamental to investigate fairness in prior studies, more research is needed to focus
receive the outcomes and recognitions they deserve during and after directly on fairness in interpreting students’ perceptions using relevant
higher education. Despite the enormous influence of assessment on theories. Recent reviews of fairness research have shown that fewer
student outcomes, research on various dimensions of fairness in studies have employed theories to investigate fairness in assessment
assessment in higher education is yet to receive adequate attention contexts (Nisbet, 2017; Rasooli, Zandi, & DeLuca, 2019; Tierney, 2013),
(Grace, 2017; Nesbit & Burton, 2006). This study aimed to explore calling for identifying relevant theoretical foundations. Scholars have

* Corresponding author.
E-mail addresses: ali.darabi@cue.edu.krd (A. Darabi Bazvand), amir.rasooli@queensu.ca (A. Rasooli).

https://doi.org/10.1016/j.stueduc.2021.101118
Received 9 June 2021; Received in revised form 20 November 2021; Accepted 3 December 2021
Available online 6 December 2021
0191-491X/© 2021 Elsevier Ltd. All rights reserved.
A. Darabi Bazvand and A. Rasooli Studies in Educational Evaluation 72 (2022) 101118

suggested social psychology theory as a sound theoretical foundation for perceived classroom assessment environment using a survey and
examining fairness in assessment (Grace, 2017; Rasooli, Zandi et al., included an explicit item focusing on fairness (e.g., In this class, the
2019). Social psychology theory posits that students’ perceptions are assessment results do not fairly reflect the effort put in studying the subject.).
impacted by their fairness evaluations of outcome distributions, pro­ Dorman and colleagues have used Perceptions of Assessment Task In­
cedures for these distributions, and the quality of interactions (e.g., ventory and conceptualized students’ assessment-related task concep­
respect) and communication of information during outcome distribu­ tions into five dimensions: (a) congruence with planned learning (i.e.,
tions (e.g., justifications of information (Adams, 1965; Bies & Moag, alignment of assessment tasks and objectives), (b) authenticity (i.e.,
1986; Kazemi, 2016; Leventhal, 1980; Resh & Sabbagh, 2016). tasks reflecting real situations), (c) student consultation (i.e., student
Building on social psychology theory, continued studies are needed involvement), (d) transparency (i.e., clear assessment tasks), and (e)
to examine students’ perceptions of fairness in higher education con­ diversity (i.e., equal opportunity o complete tasks). Fairness was
texts. Moreover, additional research has called for delineating students’ explicitly measured in congruence with planned learning dimension
perceptions of assessment qualities and dimensions, including fairness using three items (e.g., My assessment in science is a fair indicator of my
across educational cultures (Fletcher, Meyer, Anderson, Johnston, & work.). The third major direction of research was developed by Pekrun
Rees, 2012; McMillan, 2016). In line with these research calls, we and colleagues examining emotions about assessment using Test Emo­
explored Iranian university students’ perceptions of assessment fairness tions Questionnaire and Achievement Emotions Questionnaire (e.g., Pekrun,
using social psychology theory. As previous studies (Ahmadi, 2021; Goetz, Frenzel, Barchfeld, & Perry, 2011). While fairness has not yet
Rasooli, DeLuca et al., 2019) have found that students remained silent been investigated in this major research direction, recent qualitative
and selected inaction as the most frequent response to unfair and un­ research showed that students reported multiple emotions, including
democratic assessments due to power imbalance, this study explored hope, anxiety, and joy in response to assessment fairness (Rasooli,
what suggestions students might consider for enhancing fairness of as­ DeLuca et al., 2019).
sessments within higher education. To that end, this study was guided Providing his analytical contributions to the literature, McMillan
by the following two research questions: (2016) contended that students’ perceptions of assessment could be
understood in three phases, including before, during, and after assess­
1) What are students’ articulated experiences of unfairness in assess­ ment. He placed fairness in the after-assessment phase, articulating that
ment in higher education? once students are informed about the assessment results, they develop
2) What are students’ suggestions to enhance fairness in assessment in fairness perceptions that have been influenced by these results as well as
higher education? students’ affective responses such as satisfaction, distress, and/or fear.
However, he did not provide details into the conceptions of fairness,
2. Literature review given that the reviewed three major research directions in his synthesis
had not also provided explicit theories to interpret fairness.
2.1. Major research directions on students’ perceptions of assessment and The additional major direction of research identified in this literature
fairness was conducted by Flores and colleagues (e.g., Flores, Veiga Simão,
Barros, & Pereira, 2015; Pereira, Flores, & Niklasson., 2016). In their
Research on students’ perceptions of assessment has provided initial study, Flores and colleagues have used multiple methods to investigate
evidence mapping out fairness in various domains in higher education. students’ perceptions of fairness as a key assessment dimension. Flores
Such research is recently growing to examine how students interpret and et al. (2015) surveyed 378 undergraduate students’ perceptions of
engage with assessment processes and outcomes, including fairness as a fairness, effectiveness, and feedback of assessment methods in two
basis to enhance their learning (Brown, 2021; McMillan, 2016; universities in Portugal. Fairness was measured with two items (e.g.,
Struyven, Dochy, & Janssens, 2005). In this literature, fairness has been learner-centered assessment methods such as portfolios are fairer than
given scattered attention as a component of students’ perceptions of traditional ones.). Students assessed with learning-centered methods
assessment. In an early synthesis of 36 empirical studies focusing on tended to perceive assessment to be more equitable and effective. Per­
students’ perceptions of assessment, Struyven et al. (2005) reported that eira et al. (2016) reviewed 30 studies published in Assessment and
most students, particularly those with poorer learning skills, preferred to Evaluation in Higher Education journal to identify what is known about
receive multiple-choice tests as they seemed easier. However, other assessment in higher education in Europe after installing the Bologna
students considered alternative assessments fairer because they were process. These studies drew attention to three key findings: 1) assess­
more authentic, valued their efforts, promoted effective feedback, and ment method, its effectiveness, and assessment fairness influence stu­
were more transparent. dents’ learning, 2) the use of self-and peer-assessment enhances
In a more analytical review a decade later, McMillan (2016) argued formative assessment, and 3) assessment practices are influenced by the
for additional research to delineate students’ perceptions of assessment, teaching and learning environments. This body of research also attests to
including fairness and their associated relationships with the significance of fairness in students’ perceptions, alluding to more
achievement-related constructs (see also McInerney et al., 2009). substantive engagement with theories of fairness to empirically examine
McMillan (2016) summarized three significant directions of research on this topic in higher education contexts.
students’ perceptions of assessment. The first direction is conducted by
Brown and colleagues, focusing on investigating students’ conceptions 2.2. Individual studies focusing on students’ perceptions of assessment
using the Student Conceptions of Assessment survey to scaffold students’ and fairness
self-regulation (e.g., Brown, 2011, 2021; Brown, Irving, Peterson, &
Hirschfeld, 2009). Students’ conceptions of assessment included four A growing body of individual studies has begun to examine fairness
dimensions: (a) assessment improves learning, (b) assessment makes in assessment in higher education empirically. Five of these studies used
students and schools accountable, (c) assessment is beneficial, and (d) social psychology theory to examine students’ perceptions of fairness in
assessment is irrelevant. Fairness was measured in this survey directly assessment (Burger, 2017; Lizzio & Wilson, 2008; Nesbit & Burton,
with an item (e.g., assessment is unfair to students). While not explicitly 2006; O’Neill, 2017; Tripp, Jiang, Olson, & Graso, 2019), with an
stated, unfairness perceptions can also be an underpinning reason for additional study identifying fairness as a key component of students’
‘assessment is irrelevant’ dimension (Daniels & Poth, 2017). perceived fairness in inductive analysis of qualitative data (Iannone &
The second major direction of research was conducted by Alkharusi Simpson, 2017). Social psychology theory considers students’ percep­
and colleagues (e.g., Alkharusi, 2011) and Dorman and colleagues (e.g., tions of fairness as influenced by three dimensions of distributive, pro­
Dorman & Knightley, 2006). Alkharusi (2011) has examined students’ cedural, and interactional justice and their impact on individuals’

2
A. Darabi Bazvand and A. Rasooli Studies in Educational Evaluation 72 (2022) 101118

psychosocial outcomes (Kazemi, 2016; Resh & Sabbagh, 2016). completion of a thesis. Every semester lasts for 17 weeks, and a credit
Distributive justice refers to students’ perceptions of fairness of outcome system is applied in which one weekly hour of lectures is required for
distributions such as grades using principles such as equity (Adams, one credit. In general, M.A. students in ELT should obtain 28–32 credits
1965). The principle of equity suggests that students would come up for graduation. University instructors offer their courses in line with
with the perception of unfairness if they think they did not receive the ELT’s overall curriculum; however, they have freedom in their syllabi
outcome (e.g., grade) they deserved based on the analysis of their con­ and approaches to teaching and assessment in the courses. The in­
tributions (e.g., effort) and assessment mechanisms. Procedural justice structors highly rely on summative exams for grading student work
refers to students’ perceptions of fairness of procedures for outcome (ranging from 0 to 20) and occasionally use other methods such as
distributions such as grading procedures, including principles such as projects, essays, and term papers (Rasian, 2009). In the M.A. program,
transparency, voice, and consistency (Leventhal, 1980). Finally, inter­ the cut-score is 12, and students’ average should not be less than 14 to be
actional justice includes two facets: interpersonal and informational allowed to take the next semester’s courses. It is expected that the ELT
justice. Interpersonal justice refers to students’ perceptions of the graduates work in the English language teaching jobs within public and
quality of interactions (e.g., respect) and informational justice refers to private schools and institutes.
the amount and quality of communication of information during the
outcome distributions (e.g., justifications of information) (Bies & Moag, 3.2. Research design
1986). Based on specific contexts of judgments (e.g., grading, feedback),
students use the relevant principles in these dimensions to arrive at the This research consists of two parts, namely students’ experiences of
perceptions of fairness. unfairness and their suggestions to improve fairness. For the first part, we
For example, Burger (2017) examined the departmental-level impact employed phenomenology as a well-established research design to
of assessment methods (i.e., essays vs. examinations) on students’ per­ analyze individuals’ perceptions about a phenomenon, including uni­
ceptions of procedural and informational justice of grading. Surveying versity students’ experiences of fairness in assessment (Creswell & Poth,
around 1500 students from across 48 university departments in Ger­ 2018; Moustakas, 1994). Using this method, we utilized a hybrid
many, the authors found that students within the departmental culture approach with social psychology as a guiding theoretical framework and
of essay-based examinations reported a more positive perception of inductive analysis to identify the emerging themes. Concerning the
control over grading procedures. However, these students reported second part, namely participants’ suggestions to enhance fairness, we
lower perceptions of fairness for the validity and accuracy of grading conducted an inductive thematic analysis (Patton, 2002) to identify the
procedures for essay-based examinations. Perceptions of informational themes embedded in the data.
justice were also higher in essay-based examinations. In another study,
Nesbit and Burton (2006) investigated 88 postgraduate students’ per­ 3.3. Setting and participants
ceptions of fairness in grading and their self-efficacy and satisfaction at a
university in Australia. Students’ perceptions of fairness were found to After receiving the faculty review of the proposal for research quality
impact their self-efficacy and satisfaction significantly. For example, and ethical adherence, the first researcher received clearance from the
students with a passing grade but fairness concerns showed lower relevant Deputy of Education department at a public university to pur­
self-efficacy. Yet, in another study, Lizzio and Wilson (2008) reported sue participant recruitment. Students were approached in classroom
that students identified fairness (i.e., providing clear, reasonable, and time with the instructors’ permission. They were given information
consistent information) as a key dimension of effective feedback. Ian­ about the study and the email of the first researcher to contact if they
none and Simpson (2017) also qualitatively surveyed the impact of were willing to participate. Adopting a purposive sampling method, we
disciplinary fields (i.e., math vs. education) on students’ perceptions of recruited a total of 18 M.A. students in the ELT program. The use of
summative assessment at a university in the U.K. Students interpreted purposive sampling allows the researcher to identify and select (groups
fairness of summative assessment to include diverse methods (a range of of) individuals that are particularly knowledgeable or have ample ex­
methods from multiple-choice exams to projects) to reflect students’ periences about a phenomenon (Creswell & Creswell, 2017). Given that
preferences in showing what they know. Combined, these studies pro­ a relatively homogenous group of participants are required for a
vided initial evidence mapping out students’ perceptions of fairness in phenomenological work (Creswell, Hanson, Clark Plano, & Morales,
various assessment domains in higher education. 2007), second-year participants were recruited because they had expe­
Given the prevalence and significance of fairness in students’ per­ rienced assessments in the first-year course at the graduate level. This
ceptions of assessment, and recommendations to examine students’ measure was undertaken because first-year students might have had less
assessment perceptions across different educational cultures (Fletcher exposure to the assessment protocols used in graduate programs. Ten of
et al., 2012), the present study focused on Iranian students’ perceptions the participants were male, and 8 were females, with an average age of
of fairness and their suggestions to enhance fairness in assessment. 28. More information about students’ demography can be found in
Table 1.
3. Method

3.1. Context of the study

This study was conducted at a public university in Iran. Tertiary


Table 1
education is divided into four levels in Iran, namely Associate Diploma
Demographic Information of the MA Participants.
(A.A.), Bachelor of Arts (B.A.), Master of Arts (M.A.), and Doctor of
Philosophy (Ph.D.). The Ministry of Science, Research, and Technology Participants Gender Age Participants Gender Age

(MSRT) regulates the number of credits, the overall curriculum S1 F 27 S 10 M 33


including courses, and cut-off grading scores for students to be eligible to S2 M 32 S 11 F 42
S3 M 32 S 12 F 32
receive a license of completion in their relevant study programs. Of
S4 F 31 S 13 M 29
relevance to the focus of this study, the M.A. program in English Lan­ S5 M 38 S 14 M 36
guage Teaching (ELT) entails showing sufficient expertise in applied S6 F 26 S 15 M 35
linguistics courses such as language teaching, material development, S7 F 29 S 16 F 24
linguistics, second language assessment, and research methodology. S8 M 45 S 17 F 25
S9 M 35 S 18 M 24
This program lasts two to three academic years and requires the

3
A. Darabi Bazvand and A. Rasooli Studies in Educational Evaluation 72 (2022) 101118

3.4. Data collection readings, the initial significant statements pertaining directly to the
participants’ experiences of unfairness were highlighted based on the
A reflective statement questionnaire was used to collect the data in key quotations. Next, clusters of meaning were identified and formu­
this study. A reflective statement is employed when participants are lated from each significant statement. Then based on the clustering of
encouraged to reflect on and describe an experience about a phenome­ formulated meanings, two important themes (i.e., equity and interac­
non (Moustakas, 1994). This method was recommended and used in tional fairness) were generated. Consider the following example, illus­
prior literature to encourage participants to reflect on and describe their trating the data analysis procedure: “Once we had a final exam and I
experiences and perceptions of fairness in classroom assessment (Gao, arrived late. After I explained the reason, the instructor treated me like kids”
Liu, & Yin, 2021; Horan, Chory, & Goodboy, 2010). This method can be (S6). This experience was characterized as a ‘significant statement’ with
used in verbal or written format depending on the preference of the the formulated meaning of instructors may be inconsiderate of students’
participants. Therefore, we asked about the participants’ preferences to special circumstances, thus representing the sub-theme of administration
share their experiences of unfairness and suggestions to enhance fairness condition within the equity theme. In total, two themes and eight asso­
in the verbal or written format. Ten participants selected to write their ciated subthemes were identified for students’ experiences of unfairness.
responses, while eight chose to provide verbal responses. The first Tables 2 and 3 present the themes, subthemes, relevant examples, and
researcher conducted the verbal questionnaire. Participants were given frequencies for students’ perceptions of unfairness. In Table 2, some
two open-ended prompts and were asked to share their responses. selected examples articulated by students, the significant statements,
Prompts have been used in prior assessment studies to elicit partici­ formulated meanings, and associated subthemes are presented.
pants’ broad and in-depth interpretations of assessment issues such as In Table 3, the frequencies for each theme and associated subthemes
fairness (Cheng & DeLuca, 2011; Murillo & Hidalgo, 2017, 2020; are tallied. The theme frequency is an aggregate of the frequencies of all
Rasooli, DeLuca et al., 2019). subthemes associated with the relevant theme.
To identify themes for students’ suggestions to improve fairness, we
Prompt A: Please report your experiences of unfairness in assessment
conducted an inductive thematic analysis. We followed several steps
that you have had during your graduate courses in higher education.
recommended by Marshall and Rossman (2016). In the first step, we
Prompt B: Please provide any possible suggestions you may think
read and reread the statements to grasp a general sense of the data
useful for enhancing fairness in assessment in higher education.
(Creswell & Creswell, 2017; Marshall & Rossman, 2016). Later, we
Participants were first asked to read the prompts and ask questions organized the data by listing the collected information on note cards and
about the clarity of the ideas and vocabulary used. One of the re­ then ‘winnowing’ the data (Guest, MacQueen, & Namey, 2012), a pro­
searchers would then provide clarity over the meaning of each prompt. cess of highlighting some important data and discarding the unimpor­
Once participants felt confident in their understanding of the prompts, tant parts of it (Marshall & Rossman, 2016). By way of illustration,
they were asked to provide as many examples as they could recollect in within the present study, we noticed that some of the participants
response to the first prompt and provide their possible suggestions to the offered suggestions for improving large-scale evaluation for graduate
second prompt. The researchers did not provide any cues during the programs in Iran. Since we felt this statement was irrelevant to the focus
verbal and written reflective statements to ensure that students’ in­ of this study, we discarded it. Next, we started coding the actual data (in
terpretations of fairness and assessment were reported inductively, vivo codes) by bracketing text segments (chunks) and writing a word
representing how students conceive of assessment and fairness in higher representing a theme in the margins (Rossman & Rallis, 2012). After­
education. ward, we analyzed the reflective writings and their corresponding invivo
The first researcher met with each participant at a convenient place codes for the data to identify the most important themes and their cor­
at the university campus to collect the reflective statements. After responding sub-themes. The themes that were most relevant to the
gaining their verbal consent to participate in this study, the first students’ suggestions were inductively generated. The following
researcher handed out the prompts in a written format to the partici­ example represents the data analysis procedure: “I think university
pants. Participants were ensured that their responses would remain
confidential, and fully informed about the final results if they expressed
wanted a summary. Table 2
Selected Examples of Themes, and Associated Subthemes for Unfairness
The voices of participants who selected to respond to the prompts
Perceptions.
verbally were recorded, and the written statements were collected from
the participants that selected to respond in the written format. If par­ Significant Formulated Sub-themes Themes
statements meanings
ticipants needed guidance during data collection, the first researcher
was conveniently accessible to offer support. On average, participants Sometimes instructors Instructors may Administration
started talking while disturb some condition
with verbal responses took 5− 10 min, and participants with written
we were having the students while sitting
statements took 10− 15 min to complete their responses. Given that exam. (S1). for exams
Equity
participants were proficient in Persian and English, they were given a In my linguistics exam,
Instructors may use Multiple-
choice to provide their reflections in either language. All participants all of the questions
a single type of assessment
completed the written accounts in English. In the verbal accounts, both were multiple-
assessment procedures
choice. (S12)
Persian and English were used. The researchers who were proficient in After asking a question
both Persian and English with expertise in applied linguistics translated about the exam Instructors may
Disrespectful
the Persian quotations verbatim to English. The researchers ensured the results, our disregard students’
feedback
validity of the back translations by co-translating the quotations. instructor laughed at questions
me (S8).
Once we had a final Interactional
exam and arrived fairness
3.5. Data analysis late. After I
Instructors may be
inconsiderate of Disrespectful
explained the
students’ special treatment
To analyze the first prompt (students’ experiences of unfairness), we reason, the
circumstances
followed Moustakas’s (1994) systematic data analysis procedures in instructor treated me
like kids (S6).
phenomenology. First, the researchers read and reread the participants’
statements to grasp the overall meaning of unfair experiences the par­
ticipants recollected. Once the data were fully grasped by iterative

4
A. Darabi Bazvand and A. Rasooli Studies in Educational Evaluation 72 (2022) 101118

Table 3 4.1. Students’ articulated experiences of unfairness


Theme and sub-theme frequencies for perceptions of unfairness.
Themes and sub-themes Frequency 4.1.1. Equity
Several students articulated equity concerns (18 statements) around
Theme 1: Equity 18
Sub-them 1: lack of multiple assessment opportunities 7 varied summative assessment issues such as lack of multiple assessment
Sub-them 2: inappropriate assessment administration conditions 8 opportunities, inappropriate assessment administration conditions, and
Sub-them 3: a mismatch in students’ interpretations of what grades 3 a mismatch in students’ interpretations of what grades should represent.
should represent Participants in this study expressed unfairness because the instructors
Theme 2: Interactional fairness 27
Sub-theme 1: treated them disrespectfully 7
relied heavily on using a single assessment type (i.e., exams) in grading
Sub-theme 2: accused them of wrongdoing 3 student work. They argued for multiple assessment opportunities and
Sub-theme 3: were unresponsive to their questions 4 methods because they believed that this diversity provides a more
Sub-theme 4: did not respect student privacy in communicating grades 8 equitable portrait of student achievement. Students with different
Sub-theme 5: were untransparent in providing feedback 5
learning styles and characteristics can also show their learning based on
assessment methods fitting with their strengths. A participant shared an
instructors would refer to additional sources of knowledge for test develop­ unfair experience from a multiple-choice exam.
ment. I mean that some test makers should put their minds and experiences In my linguistics exam, all of the questions were multiple-choice. Unfor­
with students to design high-quality tests.” This suggestion was character­ tunately, our instructors, most of the time use multiple-choice questions
ized as containing the sub-theme of collective knowledge in test develop­ instead of multiple evaluations in the end-of-course exams. Some students
ment within the theme of the need for balancing power and collective and I feel much more comfortable with essay-type questions, and some
knowledge in assessment practices. In total, two themes of balancing power others may perform better on multiple-choice tests. So using different
and collective knowledge and establishing an advocacy body and six asso­ types of questions in the same test or exam may solve this problem. (S11)
ciated subthemes were identified for students’ suggestions to enhance
fairness. Table 4 presents the themes, relevant subthemes, and fre­ Two factors contributed to students’ perceptions of unfairness in
quencies for each theme. Similar suggestions were tallied to calculate summative exam administration conditions: (a) noise, (b) timing.
the frequency for each subtheme. The frequencies represent the number Several participants experienced unfairness because a few instructors
of suggestions articulated by students about each subtheme. The theme would talk to each other during the exam administration that distracted
frequency is an aggregate of the frequencies of all subthemes associated students. These talks were often about irrelevant issues to the exam
with the relevant theme. content, and students would also remain silent in response to this un­
The trustworthiness of the data analysis procedure was supported fairness due to power imbalance stakes.
through peer debriefing and member checking (Marshall & Rossman,
Sometimes instructors started talking while we were having the exam.
2016). In peer debriefing, we received feedback from an expert
They discouraged us by talking about business affairs and sometimes
colleague on fairness and assessment and refined the data analysis
distracted our attention by unnecessary movements while taking the test.
accordingly. The member checking strategy was used by giving
(S1)
one-third of the final themes and subthemes to the participants to check
if their intended interpretations were closely represented. Five partici­ Another source of inequity in test administration was timing. Several
pants accepted to do member checking and were supportive of the data participants reported unfair experiences because they were supposed to
interpretations. Combined, this multi-perspective scrutiny of the data sit for the exams for 3 h without any breaks, leading to lower perfor­
enriched the data analysis procedure and enhanced the quality and mance, frustration, and boredom. A participant stated an experience
dependability of data interpretation. where such a lengthy examination provoked an inequitable
performance.
4. Results
To be honest, I am not satisfied with the timing condition while taking the
Results for the overall themes and associated sub-themes relevant to final exams. Sometimes, there are many questions to answer with a time
students’ perceptions of unfairness and their suggestions to enhance allocation of 3 h. Although we are expected to be tested on multiple skills
fairness in assessments are presented below (see Tables 3 & 4 for and tasks to demonstrate our full potential in our performance, lengthy
detailed information). Given that researchers aimed to inquire students’ time would lead to fatigue and frustration. (S14)
inductive interpretations of fairness in assessment, it was found that A few participants also pointed out examples where the length of
almost all participants in this study perceived fairness about summative time for completing the exam was inadequate vis-à-vis exam content and
assessments. While this finding can result from the saliency of summa­ expectations.
tive assessment in students’ interpretations of fairness, it can also sug­
gest the summative culture of assessments in higher education. Unfortunately, university instructors, on some occasions, do not allocate
the appropriate time for the exam content they develop. There exists a
mismatch between the amount of time allocated and the real-time needed
to finish the exam. Sometimes the time is not enough, and sometimes it is
more than enough. What I can say is that there is inconsistency. (S7)
Table 4 While the previous examples represented experiences of inadequate
Theme and sub-theme frequency for students’ suggestions for fairness.
time for all students, there were comments from a few students with
Themes and sub-themes Frequency accommodation needs that focused on the lack of attention to their
Theme 1: Balanced power and collective knowledge 12 needs concerning the time length for an exam. For example, a student
Sub-theme 1: Student voice 2 complained about inadequate test accommodation such as an inequi­
Sub-theme 2: Having power to resist defensiveness 3 table amount of time allocated and inappropriate facilities in the
Sub-theme 3: Collective knowledge in test development 7
(summative exam) session that impacted the exam performance.
Theme 2: Advocacy body 15
Sub-theme 1: Defending the rights 7
Overall my grades are not good though I always do my best on most of the
Sub-theme 2: Instructor accountability 3
Sub-theme 3: Test review body 5 final exams. The main reason is that I am a left-handed student and am

5
A. Darabi Bazvand and A. Rasooli Studies in Educational Evaluation 72 (2022) 101118

very slow at writing and answering essay-type questions. Unfortunately, paper. Finally, he was convinced, but I got offended by how he did not
instructors do not consider this and do not give me more time. (S3) trust me. (S9)

A few students also experienced unfairness because there was a Unresponsiveness to students’ questions was another issue that
mismatch in their expectations of what a grade should represent and the several students articulated about unfairness in assessment interactions.
instructors’ interpretations of the meaning of grades. For example, a A student shared an example where an instructor did not care to attend
student reported that she could not attend the classroom regularly but to his question.
performed well in the summative exam. Yet, to her surprise, she received
After our instructor returned the exam papers, I asked a question
a less than deserved grade because the instructor valued student effort
regarding the final exam, which was unclear. The instructor ignored me,
and classroom participation throughout the course.
and at first, I thought he didn’t hear me, but by asking the question for the
Due to some personal problems, I was not able to attend the lectures second time, I understood that he did not care. I got disappointed. (S16)
regularly. However, I performed well on the final exam for the discourse
Privacy of exam information was raised a couple of times by par­
lecture. When our professor returned our exam results, to my surprise, I
ticipants. Students reported experiences of unfairness in which their
recognized that my grade was lower than what I expected. After his
instructors announced the summative exam results in public. Given the
explanation, I understood that he has considered students’ efforts and
recognition messages that grades carry over, a few of our participants
attendance as part of the final grades, which I think is unfair. (S15)
were concerned that a public announcement of grades puts pressure on
Another student perceived unfairness because his grade was students with lower grades.
incomparable to the expectation he had. This student perceived his
I remember that our university instructors announced the scores in the
grade as inequitable by comparing his grade with a similar student with
classroom, making them public to other classmates by reading them. As
a better grade in a different course, presumably having a similar ability
far as I am concerned, it is not fair to publicize students’ scores in front of
level. This student also attributed this inequity to the inconsistency in
the class. I think instructors should consider this and respect the students’
summative assessment decisions across the same course instructors.
privacy. (S13)
Based on my experience of taking the assessment course last year, I My research methodology instructor returned the exam papers. Still,
remember that my friend and I took the same course with two professors. before distributing them, she called the students by names and passed out
After we finished the final exam, our results were released on the uni­ scored papers to students in order of highest to lowest points earned. As far
versity website. As far as I was concerned, I performed well in the exam, as I was concerned, it was no problem, but it was considered unfair for
but my grade was unsatisfactory compared to my friend who had the same some ladies. They did not want their scores to be publicized. (S2)
course as another professor. When I complained, my professor justified
Lack of transparency in feedback marked another subtheme associ­
this by claiming that students’ work is rarely perfect, and therefore we
ated with students’ perceived unfairness in summative assessments.
may not give you perfect scores. (S8)
Several participants shared experiences of lack of transparency in which
the instructors (a) did not return the exam papers with feedback and (b)
4.1.2. Interactional fairness did not provide clear, actionable feedback.
Several participants reported interpersonal and informational expe­
In most of the end-of-the-semester exams in my university, university
riences (27 statements), where their instructors did not treat them
instructors do not return the corrected papers. It is so natural and normal
respectfully, accused them of wrongdoing, were unresponsive to their
that students themselves have accepted this as true. In my view, first, the
questions, did not respect student privacy in communicating grades, and
answers to the test items should be returned to the students. Secondly,
were not transparent in providing feedback. In addition, several students
instructors are expected to provide crystal clear explanations and justi­
shared experiences of disrespectful feedback that they had in response to
fication for their scores. (S5)
their questions. A student, for example, stated that an instructor
embarrassed her because of her question. A few students also shared another important issue resulting from a
lack of transparency in providing information about the exam content
I had a very bitter experience with the final exam when my research
and criteria. These students recollected unfair experiences because the
methodology instructor disrespected me. After asking him a question
instructors had used surprise items at the end of semester examinations.
about the exam results, he laughed at me, saying that you asked one of the
These surprise items undermined transparency and contributed to unfair
most important questions in the world, indirectly saying you are stupid.
student outcomes. The experiences of unfairness were exacerbated when
(S12)
instructors did not take steps to remove these items.
Another student shared an experience of disrespectful treatment
I think the inclusion of any unfamiliar item in the final exam is due to a
because of their late arrival to an exam. This student perceived unfair­
lack of transparency in exam criteria and exam content. I remember once
ness because the instructor did not consider her special circumstances
I was well prepared for the linguistics exam, but when I sat for the exam
and was not flexible in this condition.
and had a look at the first question, I went blank for a couple of minutes.
I remember once we had a final exam in discourse analysis. I arrived late,
At first, I got disappointed because I was not able to answer the first
and the instructor refused to let me sit for the exam. After I explained the bus
question. However, I heard my classmates whispering and complaining
was late, he treated me like a kid by shouting that this is the last time you are
about the first question as a surprise item. Even after the exam results
late. (S10)
were released on the website, our instructor’s feedback about the unfa­
Some participants reported unfair experiences because the in­
miliar items was neither transparent nor justifiable. (S7)
structors accused them of wrongdoing. In the following example, a
student recollected how his instructor did not believe that he had Overall, inequity and interactional unfairness represented the two
completed the term paper. themes influencing students’ perceptions of unfairness in summative
assessment. Students articulated unfairness perceptions due to lack of
When I submitted my research paper, our instructor glanced at it and said,
multiple assessment opportunities, interferences with assessment
this is a very nice piece of work, but I am not sure you have made it by
administration conditions, and the misalignment in grade interpreta­
yourself. He accused me of plagiarism. After a long discussion, he asked
tion. They also shared informational and interpersonal content of
me some questions about the content to make sure I have written that term
grades, exams, and feedback that deteriorated perceptions of assessment

6
A. Darabi Bazvand and A. Rasooli Studies in Educational Evaluation 72 (2022) 101118

fairness. of this question if the assessment satisfies the quality requirements. So an


advocacy body may somehow attend to this problem. (S13)
4.2. Students’ suggestions to enhance fairness in assessment
Some students also stated a void in the university governance for
holding the instructors accountable for the fairness and quality of their
Several students offered two important themes to enhance the fair­
summative assessments. A student did not recollect a memory where an
ness of summative assessments: (a) the need to use balancing power and
instructor was held accountable for poor assessment practice.
collective knowledge in assessment practices (b) the need to create an
advocacy body within an institution to defend the rights of students. I do not remember when a responsible agency within the university
scrutinizes the content of the poor assessment developed by an instructor.
4.2.1. The need for balancing power and collective knowledge in assessment Even if we raised the issue in the education office, no one took action to do
practices so. This may be the main reason for the instructors’ lack of responsibility
In this theme, students expressed that they were hardly given any for the end-of-semester exams. (S12)
opportunities to voice their complaints about assessment development
process. Students’ lack of power to resent the test misuses and assess­ From students’ perspectives, it appeared that university instructors
ment malpractices was an overriding concern. Recognizing the power are only expected to create summative assessments and grade student
imbalance involved, they suggested reconsidering students’ voice in work on a scheduled timeline offered by the university guidelines.
power relations: Unfortunately, I can say that universities have a low expectation of in­
structors concerning the quality of their assessments. Therefore, they do not
In assessment practices, particularly in the end-of-semester exams, stu­ claim any responsibility for the tests and end-of-semester exams they develop
dents do not have any power. Our rights to talk about test misuses have to evaluate students’ achievement for the academic semester in the classroom.
largely been ignored. Most university instructors don’t let students express The only responsibility is developing a test, whatever the content, and letting
their opinions concerning tests’ content and methods. So my suggestion is the students pass without receiving any complaints and criticism from stu­
that university students should be empowered in assessment practices. dents regarding the assessment results. They do not assume responsibility for
(S12) the quality of the tests they develop. (S14)
Moreover, students suggested that they need to have the power to The only thing that the university instructors hold themselves accountable
resist the defensiveness of university instructors. Two participants for is submitting the final exam questions on time. However, they do not
commented: claim any responsibility for the quality of the exam content. They may
Unfortunately, most university instructors are against criticisms of the also submit the graded papers on time before students complain, but no
exam methods. That’s why I never criticize my instructors’ exams. For this matter how many students pass or fail with no responsibility to answer the
reason, I suggest that top management in higher education create policies and students’ complaints about the exam results. (S15)
mechanisms to give more power to students to criticize instructors’ assessment
malpractices. (S17) Some students maintained that an independent body, including some
experts, should scrutinize the quality of assessments and represent stu­
In the summative assessment practices, university instructors do not value dents’ voices for fairer assessments with university governance. There­
the voices of students. For example, one of my classmate’s voices about fore, these students argued for a test review body in the university that
the summative assessment process was suppressed by our instructor. The could undertake the quality review for summative assessments and
instructor told him, you are not in a position to comment on my way of consider students’ voices.
assessment. (S6)
I think an independent body or group is required to defend the rights of
Most student participants highlighted that relying on an individual students. My fundamental reason for such a view is that they can scru­
test maker in the test development process contributes to inappropriate tinize the quality of the test content, test method, and test administration.
decisions since an individual’s knowledge is inadequate. Therefore, they They can meticulously go into the test and report the unfair practices of
opted for deploying the principle of collective knowledge in developing instructors to the institutions of higher education. Based on my experi­
assessments. The two following examples illustrate the demand for ences, students are more or less the victims of unfair practices of in­
collective knowledge in developing assessments. structors’ assessments. (S18)
If university instructors intend to get more satisfactory results, they need
to refer to collective and additional sources of knowledge. I mean that some Overall, students highlighted mechanisms and suggestions to
instructors should put their minds and experiences with students to design enhance the fairness of summative assessments in higher education by
high-quality tests. (S10) leveraging a balance of power and collective knowledge in assessment
practices and creating an advocacy body to review test content and
Based on my own experiences, I can tell you that when instructors benefit consider students’ voices. Combined, these mechanisms provide for
from additional knowledge resources such as colleagues, students, and students’ rights for fair assessments.
parents to design their summative assessments, the effects of these as­
sessments are more positive and constructive. Unfortunately, in our 5. Discussion
context, this is not the case. (S4)
Fairness has been a central issue in students’ interpretations of
various assessment domains in higher education (Burger, 2017; Grace,
4.2.2. The need to create an advocacy body to defend the rights of students
2017; Sambell et al., 1997). While the current literature signifies the
Another important theme emerging from the students’ suggestions
prevalence of fairness concerns in students’ perceptions across various
pertained to establishing an ‘advocacy group’ to support students’ rights
domains, additional direct research on conceptualizing and empirically
for fair assessments. Several students articulated that this advocacy
investigating fairness in assessment is needed within higher education
group is needed because most students are not aware of their rights for a
contexts. This study drew on empirical data and social psychology the­
fair and quality assessment.
ory to provide additional evidence in how students perceive unfairness
It is a reality that most of the students do not know much about the basic in assessment and what suggestions they propose to enhance fairness in
features of a good assessment. When they assess, they may not be aware assessment in higher education contexts.

7
A. Darabi Bazvand and A. Rasooli Studies in Educational Evaluation 72 (2022) 101118

5.1. Students’ experiences of unfairness and principles for upholding fairness in assessment literature and stan­
dards, it appears that there is a little mobilization of the existing
Students’ experiences of unfairness in this study heavily centered on recognized principles of assessment fairness into higher education
summative assessment issues and pertained to their perceptions of classrooms. Given the need for the professional development of in­
inequity and interactional unfairness. Prior research in Iran and inter­ structors in assessment in higher education instructors, it seems that
nationally has attested that assessment in higher education contexts is centers for teaching and learning or relevant sectors can hold workshops
often summative to grade students’ achievement (Ahmadi, 2021; Pan­ and courses to promote fairness in assessments within universities.
adero, Fraile, Fernandez Ruiz, Castilla-Estevez, & Ruiz, 2019). While a These workshops are feasible and timely given the repeated empirical
wide variety of summative assessment methods such as exams, projects, findings suggesting students’ widespread perceptions of unfairness
coursework, and tests are used to arrive at final grades, summative as­ internationally and educators’ priority in promoting fair assessments
sessments in the form of examinations are prevalent in higher education (Rasooli et al., 2018).
institutions worldwide (Brown, 2021; Gan, Leung, He, & Nang, 2019).
Similarly, most participants in this study interpreted fairness in assess­ 5.2. Students’ suggestions to enhance fairness
ments concerning tests and summative examinations at the end of the
course. These findings support that the ‘culture of assessment’ (Shepard, The need for an advocacy group and collective knowledge for pro­
2001) in higher education is oriented toward summative assessment that moting students’ right to fair assessments was highlighted by the study
also influences the ways students interpret fairness in assessments. participants as a mechanism for enhancing fair assessments in higher
Participants in this study did not articulate experiences regarding education contexts. This advocacy body can, inter alia, promote fairness
peer assessment, self-assessment, and other alternative forms of assess­ in assessment development, review the fairness of assessments, educate
ment, considering the dominant examination-based culture of assess­ university instructors about fairness in assessments, receive students’
ment they had experienced. Ahmadi (2021) showed that university assessment complaints, and supervise institutional and instructor
student participants in Iran did not consider alternative assessments accountability. One possible justification for establishing such an
such as peer assessment as fair for grading purposes (still showing the advocacy body, as stated by participants, is that students may not have
interpretation of peer assessment with a grading lens) and tended to the fundamental knowledge of the principles of quality to evaluate as­
favor instructor-based assessments. While more efforts are now being sessments. Specifically, the educational assessment experts and spe­
invested into promoting assessment for learning culture in higher edu­ cialists can undertake the leadership of this advocacy group and
cation using feedback-driven assessment (Carless & Boud, 2018) and highlight the significance of assessment education at their universities.
peer feedback versus peer grading (Panadero, 2016), the findings of this In addition, establishing an expert advocacy group to monitor the
study coupled with prior studies point to additional efforts to move to­ assessment practices creates a “democratic environment wherein test
ward this direction. A key component for this direction is actively takers’ vantage points and concerns are counted” (Shohamy, 1997, p.
considering students’ perceptions and interpretations of assessment and 345).
fairness as mechanisms for creating meaningful changes. While students Given that participants suggested reliance on collective knowledge
in this study did not mention assessment for learning as fairer methods and students’ involvement in the assessment process, such involvement
given the lack of such assessments in their lived experiences, they felt may contribute to democratic and fair assessment in the form of multiple
the need for changes in summative assessments by articulating their assessments such as self- and peer-assessments (Klenowski, 2014; Pan­
unfair experiences and suggesting directions to enhance fairness in adero, 2016). In addition, this involvement may enhance students’
summative assessments. power to have agency and control over the assessment methods and
Participants in this study interpreted inequity of assessments lacking procedures in the classroom. This shift in power balance requires a
multiple assessment opportunities, being exposed to inappropriate cultural shift in how power in assessment is internalized by students and
assessment administration conditions, and experiencing misaligned and enacted by university instructors. As stated by a student participant in
inconsistent grading practices. Previous research in assessment has this study coupled with prior findings (Rasooli, DeLuca et al., 2019),
identified multiple assessment opportunities as a key component of fair university students in Iran seem to have internalized ‘assessment being
assessments (Gipps & Stobart, 2009; Tierney, 2013). Herman and Cook done to them’ (Klenowski, 2014) as ‘normal’ and avoid dissenting to the
(2019) proposed fairness in treatment during assessment (i.e., excluding instructors due to consequential stakes. The shift in existing culture may
inappropriate assessment administration conditions in the context of need continued conversations with students to understand their assess­
this study) as one of the four core issues of fairness in classroom ment rights for fairer assessments. On the other hand, the instructors
assessment. Inconsistent and misaligned interpretations of grading who were themselves the student victims of assessment culture that
across students and instructors were also found in prior social psychol­ favored their instructors would need assessment education to get
ogy literature and grading literature as a recurrent theme of unfairness familiar with how the power can be distributed in the assessment pro­
for students (Cheng, DeLuca, Braund, Yan, & Rasooli, 2020; Rasooli, cess. This cultural shift in understanding the issue of power in assess­
DeLuca et al., 2019). The results for the interactional fairness theme ment can work toward a fairer and democratic assessment that relies on
were also resonant with prior findings in assessment fairness. Partici­ collective knowledge. This shift is relatively supported by researchers
pants in this study coupled with students in prior studies considered (Young, 2011), arguing that every individual involved in education is
disrespectful treatment (Cowie, 2015; Tierney, 2015), accusation of responsible for reducing bias during classes and during the assessment,
wrongdoing (Čiuladienė & Račelytė, 2016; Horan et al., 2010), unre­ since systemic inequality results from interactions across individuals.
sponsiveness to students’ questions (Buttner, 2004), privacy in Combined, the identified themes in this study provide additional
communicating grades (Tierney, 2015), and lack of transparency in empirical evidence into interpreting students’ perceptions of fairness in
feedback provision (Lizzio & Wilson, 2008) as key components of unfair classroom assessment and provide suggestions offered by students as a
perceptions. Overall, participants in this study deemed equity and basis to enhance fairer practices in university assessment contexts.
interactional justice as relevant social psychological principles in their
evaluation of fairness in summative assessment contexts. Prior studies 6. Conclusion
have also noted the saliency of interactional justice and equity in
shaping students’ perceptions of fairness in classroom assessment This study leveraged the qualitative data from 18 participants’ re­
(Rasooli, Zandi, & DeLuca, 2018). flections on their experiences and suggestions on fairness to provide
While the findings of this study in parallel with prior literature have additional empirical evidence to the growing area of research on fairness
persistently noted these practices as unfair and recommended practices in classroom assessment. This study particularly focused on Iranian

8
A. Darabi Bazvand and A. Rasooli Studies in Educational Evaluation 72 (2022) 101118

university students’ perceptions of fairness to contribute to the theory Cowie, B. (2015). Equity, ethics, and engagement: Principles for quality formative
assessment in primary science classrooms. In C. Milne, K. Tobin, & D. DeGennaro
and practices of fairness in higher education contexts. Participants’
(Eds.), Sociocultural studies and implications for science education (pp. 117–133).
perceptions of unfairness were largely related to summative assessment, Netherlands: Springer.
and they discussed collective knowledge and advocacy group as bases to Creswell, J. W., & Creswell, J. D. (2017). Research design: Qualitative, quantitative, and
promote fair practices in university assessments. These findings point to mixed methods approach. Sage publications.
Creswell, J. W., & Poth, C. N. (2018). Qualitative inquiry and research design: Choosing
further research on fairness in assessment across cultures to identify how among five approaches (4th ed.). Thousand Oaks, CA: Sage.
students perceive fairness in assessment as a basis to enhance fair, Creswell, J. W., Hanson, W. E., Clark Plano, V. L., & Morales, A. (2007). Qualitative
equitable, and inclusive practices in higher education. research designs: Selection and implementation. The Counseling Psychologist, 35,
236–264. https://doi.org/10.1177/0011000006287390
While the present study’s findings brought into fore some significant Daniels, L. M., & Poth, C. A. (2017). Relationships between pre-service teachers’
insights for fairness in summative assessment in the context of higher conceptions of assessment, approaches to instruction, and assessment: An
education in Iran, some limitations may lay the groundwork for further achievement goal theory perspective. Educational Psychology, 37, 835–853. https://
doi.org/10.1080/01443410.2017.1293800
research. First, as the current study’s participants were only 18 M.A. Dorman, J. P., & Knightley, W. M. (2006). Development and validation of an instrument
students selected from a public university, further studies with larger to assess secondary school students’ perceptions of assessment tasks. Educational
samples and different higher education degrees (i.e., B.A. and PH.D.) at Studies, 32, 47–58. https://doi.org/10.1080/03055690500415951
Fletcher, R. B., Meyer, L. H., Anderson, H., Johnston, P., & Rees, M. (2012). Faculty and
various universities across the country can be carried out to achieve a students conceptions of assessment in higher education. Higher Education, 64,
more comprehensive understanding of fairness in classroom assessment 119–133. https://doi.org/10.1007/s10734-011-9484-1
in higher education. Additionally, as the present study’s design was Flores, M. A., Veiga Simão, A. M., Barros, A., & Pereira, D. (2015). Perceptions of
effectiveness, fairness and feedback of assessment methods: A study in higher
qualitative, future studies can triangulate reflective statement ques­
education. Studies in Higher Education, 40, 1523–1534. https://doi.org/10.1080/
tionnaire with interview and observational methods to provide deeper 03075079.2014.881348
and broader understandings of students’ perceptions of fairness in Gan, Z., Leung, C., He, J., & Nang, H. (2019). Classroom assessment practices and
higher education. Finally, as the study’s findings highlighted the sig­ learning motivation: A case study of Chinese EFL students. TESOL Quarterly, 53,
514–529. https://doi.org/10.1002/test.476
nificance of empowering students in classroom assessment, more studies Gao, R., Liu, J., & Yin, B. (2021). An Expanded ethical decision-making model to resolve
are needed to identify the critical aspects of democratic and fair as­ ethical dilemmas in assessment. Studies in Educational Evaluation, 68, Article 100978.
sessments based on the suggestions and recommendations offered by https://doi.org/10.1016/j.stueduc.2021.100978
Gipps, C., & Stobart, G. (2009). Fairness in assessment. In C. Wyatt-Smith, & J. Cumming
different stakeholders such as policymakers, university administrators, (Eds.), Educational assessment in the 21st century (pp. 105–118). London: Springer.
and university instructors. These suggestions would provide additional Gotlieb, J. (2009). Justice in the classroom and students’ evaluations of marketing
multi-perspective insights for promoting fair assessment practices in professors’ teaching effectiveness: An extension of prior research using attribution
theory. Marketing Education Review, 19, 1–14. https://doi.org/10.1080/
higher education. 10528008.2009.11489069
Grace, C. C. (2017). Exploring the potential for and promise of incorporating distributive
References and procedural justices into post-secondary assessment of student learning. Teaching
in Higher Education, 22, 304–317. https://doi.org/10.1080/
13562517.2016.1248388
Adams, J. S. (1965). Inequity in social exchange. In L. Berkowitz (Ed.), Advances in
Guest, G., MacQueen, K. M., & Namey, E. E. (2012). Applied thematic analysis. Thousand
experimental social psychology (Vol. 2, pp. 267–299). New York: Academic Press.
Oaks, CA: Sage.
Ahmadi, R. (2021). Students’ perceptions of student voice in assessment within the
Herman, J., & Cook, L. (2019). Fairness in classroom assessment. In S. M. Brookhart, &
context of Iran: The dynamics of culture, power relations, and student knowledge.
J. H. McMillan (Eds.), Classroom assessment and educational measurement (pp.
Higher Education Research & Development, 1–15. https://doi.org/10.1080/
243–264). New York: Routledge.
07294360.2021.1882401
Horan, S. M., Chory, R., & Goodboy, A. (2010). Understanding students’ classroom
Alkharusi, H. (2011). Development and datametric properties of a scale measuring
justice experiences and responses. Communication Education, 59, 453–474. https://
students’ perceptions of the classroom assessment environment. Online Submission, 4,
doi.org/10.1080/03634523.2010.487282
105–120.
Iannone, P., & Simpson, A. (2017). University students’ perceptions of summative
Bies, R. J., & Moag, J. S. (1986). Interactional justice: Communication criteria of fairness.
assessment: The role of context. Journal of Further and Higher Education, 41, 785–801.
In R. J. Lewicki, B. H. Sheppard, & M. H. Bazerman (Eds.), Research on negotiation in
https://doi.org/10.1080/0309877X.2016.1177172
organizations (Vol. 1, pp. 43–55). Greenwich, CT: JAI Press.
Kazemi, A. (2016). Examining the interplay of justice perceptions motivation, and school
Brown, G. T. (2021). Student conceptions of assessment: Regulatory responses to our
achievement among secondary school students. Social Justice Research, 29, 103–118.
practices. ECNU Review of Education. https://doi.org/10.1177/
https://doi.org/10.1007/s11211-016-0261-2
20965311211007869, 20965311211007869.
Klenowski, V. (2014). Towards fairer assessment. Australian Educational Researcher, 41,
Brown, G. T. L. (2011). Self-regulation of assessment beliefs and attitudes: A review of
445–470. https://doi.org/10.1007/s13384-013-0132-x
the students’ conceptions of assessment inventory. Educational Psychology, 31,
Leventhal, G. (1980). What should be done with equity theory? New approaches to the
731–748. https://doi.org/10.1080/01443410.2011.599836
study of justice in social relationships. In K. Gergen, M. Greenberg, & R. Willis (Eds.),
Brown, G. T., Irving, S. E., Peterson, E. R., & Hirschfeld, G. H. (2009). Use of
Social exchange: Advances in theory and research (Vol. 9, pp. 27–55). New York:
interactive–Informal assessment practices: New Zealand secondary students’
Plenum Press.
conceptions of assessment. Learning and Instruction, 19, 97–111. https://doi.org/
Lizzio, A., & Wilson, K. (2008). Feedback on assessment: Students’ perceptions of quality
10.1016/j.learninstruc.2008.02.003
and effectiveness. Assessment and Evaluation in Higher Education, 33, 263–275.
Burger, R. (2017). Student perceptions of the fairness of grading procedures: A multilevel
https://doi.org/10.1080/02602930701292548
investigation of the role of the academic environment. Higher Education, 74,
Marshall, C., & Rossman, G. B. (2016). Designing qualitative research (6th ed.). Thousand
301–320. https://doi.org/10.1007/s10734-016-0049-1
Oaks, CA: Sage.
Buttner, E. H. (2004). How do we “dis” students?: A model of (dis)respectful business
Mauldin, R. K. (2009). Gendered perceptions of learning and fairness when choice
instructor behavior. Journal of Management Education, 28, 319–334. https://doi.org/
between exam types is offered. Active Learning in Higher Education, 10, 253–264.
10.1177/1052562903252656
https://doi.org/10.1177/1469787409343191
Carless, D., & Boud, D. (2018). The development of student feedback literacy: Enabling
McInerney, D. M., Brown, G. T. L., & Liem, G. A. D. (Eds.). (2009). Student perspectives on
uptake of feedback. Assessment and Evaluation in Higher Education, 43, 1315–1325.
assessment. Charlotte, NC: Information Age.
https://doi.org/10.1080/02602938.2018.1463354
McMillan, J. H. (2016). Section discussion: Student perceptions of assessment. In
Cheng, L., & DeLuca, C. (2011). Voices from test-Takers: Further evidence for language
G. T. L. Brown, & L. R. Harris (Eds.), Handbook of human and social conditions in
assessment validation and use. Educational Assessment, 16, 104–122. https://doi.org/
assessment (pp. 237–260). New York, NY: Routledge.
10.1080/10627197.2011.584042
Moustakas, C. (1994). Phenomenological research methods. Sage publications.
Cheng, L., DeLuca, C., Braund, H., Yan, W., & Rasooli, A. (2020). Teachers’ grading
Murillo, F. J., & Hidalgo, N. (2017). Students’ conceptions about a fair assessment of
decisions and practices across cultures: Exploring the value, consistency, and
their learning. Studies in Educational Evaluation, 53, 10–16. https://doi.org/10.1016/
construction of grades across Canadian and Chinese secondary schools. Studies in
j.stueduc.2017.01.001
Educational Evaluation, 67, Article 100928. https://doi.org/10.1016/j.
Murillo, F. J., & Hidalgo, N. (2020). Fair student assessment: A phenomenographic study
stueduc.2020.100928
on teachers’ conceptions. Studies in Educational Evaluation, 65, 1–10. https://doi.org/
Chory-Assad, R. (2002). Classroom justice: Perceptions of fairness as a predictor of
10.1016/j.stueduc.2020.100860
student motivation, learning, and aggression. Communication Quarterly, 50, 58–77.
Nesbit, P. L., & Burton, S. (2006). Student justice perceptions following assignment
https://doi.org/10.1080/01463370209385646
feedback. Assessment and Evaluation in Higher Education, 31, 655–670. https://doi.
Čiuladienė, G., & Račelytė, D. (2016). Perceived unfairness in teacher-student conflict
org/10.1080/02602930600760868
situations: Students’ point of view. Polish Journal of Applied Psychology, 14, 49–66.
Nisbet, I. (2017). Fairness takes centre stage. Assessment in Education Principles Policy and
https://doi.org/10.1515/pjap-2015-0049
Practice, 1–7. https://doi.org/10.1080/0969594X.2017.1358151

9
A. Darabi Bazvand and A. Rasooli Studies in Educational Evaluation 72 (2022) 101118

O’Neill, G. (2017). “It’s not fair! Students and staff views on the equity of the procedures Seevers, M. T., Rowe, W. J., & Skinner, S. J. (2014). Praise in public, criticize in private?
and outcomes of students’ choice of assessment methods. Irish Educational Studies, An assessment of performance feedback transparency in a classroom setting.
36, 221–236. https://doi.org/10.1080/03323315.2017.1324805 Marketing Education Review, 24, 85–100. https://doi.org/10.2753/MER1052-
Panadero, E. (2016). Is it safe? Social, interpersonal, and human effects of peer 8008240201
assessment: A review and future directions. In G. T. L. Brown, & L. R. Harris (Eds.), Shepard, L. (2001). The role of classroom assessment in teaching and learning. In
Handbook of human and social conditions in assessment (pp. 247–266). New York: V. Richardson (Ed.), Handbook of research on teaching (4th edition, pp. 1066–1101).
Routledge. Washington, DC: AERA.
Panadero, E., Fraile, J., Fernandez Ruiz, J., Castilla-Estevez, D., & Ruiz, M. A. (2019). Shohamy, E. (1997). Testing methods, testing consequences: Are they ethical? Are they
Spanish university assessment practices: Examination tradition with diversity by fair? Language Testing, 14, 340–349. https://doi.org/10.1177/
faculty. Assessment and Evaluation in Higher Education, 44, 379–397. https://doi.org/ 026553229701400310
10.1080/02602938.2018.1512553 Struyven, K., Dochy, F., & Janssens, S. (2005). Students’ perceptions about evaluation
Patton, M. Q. (2002). Qualitative evaluation and research methods (3rd ed.). Newbury Park, and assessment in higher education: A review. Assessment and Evaluation in Higher
CA: Sage Publications, Inc. Education, 30, 325–341. https://doi.org/10.1080/02602930500099102
Pekrun, R., Goetz, T., Frenzel, A. C., Barchfeld, P., & Perry, R. P. (2011). Measuring Tata, J. (1999). Grade distributions, grading procedures, and students’ evaluations of
emotions in students’ learning and performance: The achievement emotions instructors: A justice perspective. The Journal of Psychology Interdisciplinary and
questionnaire (AEQ). Contemporary Educational Psychology, 36, 36–48. https://doi. Applied, 133, 263–271. https://doi.org/10.1080/00223989909599739
org/10.1016/j.cedpsych.2010.10.002 Tierney, R. (2013). Fairness in classroom assessment. In J. H. McMillan (Ed.), Ed.). Sage
Pereira, D., Flores, M., & Niklasson, L. (2016). Assessment revisited: A review of research handbook of research on classroom assessment (pp. 125–144). Thousand Oaks, CA:
in assessment and evaluation in higher education. Assessment and Evaluation in Higher SAGE Publications.
Education, 41, 1008–1032. https://doi.org/10.1080/02602938.2015.1055233 Tierney, R. (2015). Altered grades: A grey zone in the ethics of classroom assessment.
Pitt, E., & Winstone, N. (2018). The impact of anonymous marking on students’ Assessment Matters, 8, 5–30. https://doi.org/10.18296/am.0002
perceptions of fairness, feedback, and relationships with lecturers. Assessment and Tripp, T. M., Jiang, L., Olson, K., & Graso, M. (2019). The fair process effect in the
Evaluation in Higher Education, 43, 1183–1193. https://doi.org/10.1080/ classroom: Reducing the influence of grades on student evaluations of teachers.
02602938.2018.1437594 Journal of Marketing Education, 41, 173–184. https://doi.org/10.1177/
Rasian, Z. (2009). Higher education governance in developing countries, challenges, and 0273475318772618
recommendations: Iran as a case study. Nonpartisan Education Review/Essays, 5, Young, I. M. (2011). Justice and the politics of difference. Princeton University Press.
1–18. Zlatkin-Troitschanskaia, O., Schlax, J., Jitomirski, J., Happ, R., Kühling-Thees, C.,
Rasooli, A., Zandi, H., & DeLuca, C. (2018). Re-conceptualizing classroom assessment Brückner, S., et al. (2019). Ethics and fairness in assessing learning outcomes in
fairness: A systematic meta-ethnography of assessment literature and beyond. Studies higher education. Higher Education Policy, 32, 537–556. https://doi.org/10.1057/
in Educational Evaluation, 56, 164–181. https://doi.org/10.1016/j. s41307-019-00149-x
stueduc.2017.12.008
Rasooli, A., DeLuca, C., Rasegh, A., & Fathi, S. (2019). Students’ critical incidents of
Ali Darabi Bazvand received his PH.D in Applied Linguistics from Shiraz University, Iran.
fairness in classroom assessment: An empirical study. Social Psychology of Education,
Currently he is a faculty member at Catholic University in Erbil (CUE), Iraq. His research
22, 701–722. https://doi.org/10.1007/s11218-019-09491-9
interests include language assessment literacy, classroom assessment, academic writing,
Rasooli, A., Zandi, H., & DeLuca, C. (2019). Conceptualising fairness in classroom
and corpus linguistics. He has published in some national and international Scopus and ISI-
assessment: Exploring the value of organisational justice theory. Assessment in
indexed journals.
Education Principles Policy and Practice, 26, 584–611. https://doi.org/10.1080/
0969594X.2019.1593105
Resh, N., & Sabbagh, C. (2016). Justice and education. In C. Sabbagh, & M. Schmitt Amirhossein Rasooli received his PhD in Educational Assessment and Measurement from
(Eds.), Handbook of social justice theory and research (pp. 349–367). New York: Queen’s University, Canada. Currently, he is a Killam Postdoctoral Fellow at Center for
Springer. Research in Applied Measurement and Evaluation at the Department of Educational Psy­
Rossman, G. B., & Rallis, S. F. (2012). Learning in the field: An introduction to qualitative chology, University of Alberta. He continues his research on exploring fairness and equity
research (3rd ed.). Thousand Oaks, CA: Sage. in assessment and education within K-12 and higher education contexts
Sambell, K., McDowell, L., & Brown, S. (1997). “But is it fair?”: An exploratory study of
student perceptions of the consequential validity of assessment. Studies in Educational
Evaluation, 23, 349–371. https://doi.org/10.1016/S0191-491X(97)86215-3

10

You might also like