Professional Documents
Culture Documents
To cite this article: Miguel Arevalillo-Herráez (2014) Impact evaluation of reactive assessment
strategies to address social loafing by promoting student cooperation and encouraging
mutual support, Innovations in Education and Teaching International, 51:5, 523-532, DOI:
10.1080/14703297.2013.785646
Taylor & Francis makes every effort to ensure the accuracy of all the information (the
“Content”) contained in the publications on our platform. However, Taylor & Francis,
our agents, and our licensors make no representations or warranties whatsoever as to
the accuracy, completeness, or suitability for any purpose of the Content. Any opinions
and views expressed in this publication are the opinions and views of the authors,
and are not the views of or endorsed by Taylor & Francis. The accuracy of the Content
should not be relied upon and should be independently verified with primary sources
of information. Taylor and Francis shall not be liable for any losses, actions, claims,
proceedings, demands, costs, expenses, damages, and other liabilities whatsoever or
howsoever caused arising directly or indirectly in connection with, in relation to or arising
out of the use of the Content.
This article may be used for research, teaching, and private study purposes. Any
substantial or systematic reproduction, redistribution, reselling, loan, sub-licensing,
systematic supply, or distribution in any form to anyone is expressly forbidden. Terms &
Conditions of access and use can be found at http://www.tandfonline.com/page/terms-
and-conditions
Downloaded by [University Of Maryland] at 05:43 20 October 2014
Innovations in Education and Teaching International, 2014
Vol. 51, No. 5, 523–532, http://dx.doi.org/10.1080/14703297.2013.785646
Cooperative work is an effective strategy when team members are kept motivated
Downloaded by [University Of Maryland] at 05:43 20 October 2014
and collaborate towards the achievement of a common goal. However, social loaf-
ing may significantly reduce educational gains. In this article, we analyse whether
assessment-based reactive strategies that exploit existing emotional relationships
between the team members are effective as a response to unequal commitment in
cooperative tasks. In particular, an adaptive negotiation process that permits
students to improve their grades by improving future scores obtained by free
riders is suggested. Findings support that these types of strategies may have a
great impact in fostering peer tutoring, student cooperation and mutual support.
Keywords: cooperative work; team agreement; equal commitment; social
loafing; assessment
1. Introduction
Positive effects of cooperative learning on student achievement have been reported
by many researchers, and there exists a vast literature on describing significant
improvements in transferrable skills when cooperative strategies are used in the
classroom (e.g. Awang, 2006; Ballantine & Larres, 2007). However, despite the
general consensus that cooperative learning experiences promote greater mastery
and retention and have many other positive effects (Humphreys, Johnson, &
Johnson, 1982), the tendency of individuals to put forth less effort when they are
part of a group is a major difficulty in the application of cooperative learning
approaches in the classroom. This is also known as social loafing; and it is the
focus of many complaints voiced by students regarding unsatisfactory team-based
experiences (Brooks & Ammons, 2003).
In this article, we present an integrated assessment method to address social loaf-
ing that combines commonly used preventive schemes with other reactive
approaches to both ensure individual accountability and encourage further coopera-
tion when unequal commitment is discovered. Despite the large number of research
studies describing ways to establish individual accountability and analysing their
overall effect in student achievement, not that many works analyse possible
responses when these do not produce the expected results. When part of (or all) the
collaborative work takes place outside the classroom, the presence of ‘shirkers’ may
seriously affect the group performance, and ultimately end in personal disputes. To
diminish this effect, we use an assessment strategy which aims at encouraging an
*Email: Miguel.Arevalillo@uv.es
The assessment technique presented in the article draws on previous research that
reports on the positive impact of mutual support and peer tutoring on learning results.
On the one hand, the level of commitment members have to one another and to the
group’s success is considered a key factor in achieving a high-group performance and
learning gains (Johnson & Johnson, 2009). To this end, several authors have remarked
on the importance of planning activities that require all students to contribute to the
task (positive task interdependence), help each other and promote each other’s learn-
ing (Johnson & Johnson, 2000; King, 2002; Slavin, 1996). This importance is
supported by a number of studies which evidence that tasks designed in this way lead
to the development of more complex thinking and problem-solving skills (e.g. Gillies,
2008; Morgan, 2003). In particular, motivational perspectives on cooperative learning
seek situations in which the only way group members can attain their personal goals
is if the group is successful. In this way, group members must help their team mates
to do whatever helps the group to succeed. This is commonly achieved by rewarding
groups according to the sum of individual performances (Slavin, 1993).
On the other hand, peer tutoring has been identified as one of the elements which
underpin the success of cooperative approaches. The effect of verbal explanations on
both tutors and tutees has been extensively studied (e.g. Oortwijn, Boekaerts,
Vedder, & Strijnos, 2008; Topping, 2005). These works concluded that tutoring not
only boosts the learning gains of the tutees, but also that of the tutors. In this respect,
O'Donnell and Dansereau (1992) reported that although students receiving explana-
tions learn more than those who worked alone, the students who gain the most from
cooperative activities are peer tutors. This effect can partially be attributed to the
cognitive restructuring and elaboration processes that necessarily take place when
explaining the material to someone else. These processes help memory retention and
relating concepts to other information already in memory (Wittrock, 1986).
others, this has a strong motivational effect and the other team members may
reduce their own effort (Mulvey & Klein, 1998). A major concern with this typi-
cal approach happens when significant differences exist between the scores
obtained by each member in a team in their respective individual assessments. In
general, this is a clear signal that their participation was poorly balanced and indi-
cates that corrective action may be required.
not only aims at encouraging the participation of students not initially engaging in
the group task, but also at improving the achievement level of the other group
members who have already shown their commitment. The method combines
adaptive negotiation with an integrated cooperative strategy and uses social pressure
to further encourage cooperation when unequal commitment is detected. The impact
of the assessment method on the students’ performance is then studied.
group dynamics (Bacon, Stewart, & Silver, 1999) and it is generally preferable to
random assignment (Chapman et al., 2006). In our case, we allowed students to
group themselves and maintain the group structure throughout the duration of the
module, to benefit from existing relationships between students. In this way, friend-
ship and existing social relationships between students will play in favour of the
strategy, increasing the social cohesiveness of the team. Moreover, as group assign-
ment was decided by the students, any excuses related to it could rightly be rejected
straight away. We have chosen a group size of three members to avoid the
production blocking that occurs as group size increases, as each person has less
opportunity to participate (Diehl & Stroebe, 1987). Still, groups of two and four
students have been accepted in exceptional circumstances, especially when the
number of students did not allow forming all teams with exactly three members.
Secondly, all students have to take an individual quiz at the end of each learning
Downloaded by [University Of Maryland] at 05:43 20 October 2014
unit. This quiz follows a format consistent with the collaborative activities
performed, and most questions are variations of some which appeared in the group-
based exercises. This makes it extremely rare that a student who participates in the
group work obtains a low grade, and makes it unusual that students who do not
participate gain a high score. The student grade for each learning unit is then deter-
mined by averaging the individual score with the geometric average of the grades
obtained by all team members. The geometric average is used because differences
between the scores of the team members are penalised more than by using the
standard average. This grading scheme aims to prevent social loafing, avoiding
‘shirkers’ and establishing individual accountability. Other alternative methods with
a similar purpose have also been proposed in the literature, such as choosing a
group member at random to represent the group and assign all members a grade
that depends upon the selected member’s performance (Slavin, 1996). Such strate-
gies that reward groups based on the sum of individual performances are commonly
used by authors who defend a motivational perspective on cooperative learning.
The shared dependence on both one’s own and the team’s grade contributes to
avoiding the ‘sucker’ role. On one hand, the individual grade obtained by the free
rider acts in detriment to the other members, which causes them not to accept the
situation. On the other hand, the role of the free rider is also made difficult, as the
student’s own grade is also given a relevant weight in the computation of the final
mark. This scheme leads to a different grade for each team member and contributes
to minimising the negative motivational effect that happens in these situations.
Thirdly, when unequal commitment is detected, corrective action is taken. This
consists of an adaptive negotiation stage that proceeds as follows: The group is
gathered and a proposal to improve their grades is suggested. This generally
consists of reducing the impact of the lowest score in the last quiz, but increasing
the impact of the score of the member who obtained it in subsequent quizzes. It
is made clear that this is a one-off opportunity that they are free to accept or
reject, and they are given one day to respond. Prior existing social relationships
between the students will contribute to create a social pressure at both ends to
accept the proposal. On one side, it will be more likely that the free rider will be
willing to make an extra effort to compensate the others, whose individual score
has increased to the detriment of the group. On the other side, the students who
actually did the work should also be more willing to help the free rider to get a
better score in the subsequent quizzes, seeing an opportunity to discard a low
grade from their records. This justifies that the proposal for agreement was
Innovations in Education and Teaching International 527
accepted in all cases. In addition, the adaptive negotiation stage also helps build a
closer student–lecturer relation, and to form a more supportive perception of the
lecturer’s role. Once the group has accepted the deal, they have to think about
the best strategy to improve their grades, and they soon realise that this is by
helping the student who obtained the lowest score (the weakest student from now
on). In this way, a triple benefit is obtained. First, the weakest student is
supported by the rest of the group, upon whom most of the attention is concen-
trated. That student increases their effort because they feel that they cannot fail
their team mates. Second, by supporting the weakest student, the rest of the
members learn, by explaining, a technique which has already demonstrated posi-
tive effects on the learning process (Ploetzner, Dillenbourg, Praier, & Traum,
1999). Explanations contribute to developing a number of transferrable skills, such
as communication, creativity, autonomous learning, synthesis and information
Downloaded by [University Of Maryland] at 05:43 20 October 2014
3. Results
At an average class size of 27 students per year, we have had the opportunity
to analyse the data produced by a total of 18 groups during a two-year period.
Thirteen of these were composed of three members, three with two members
and the remaining two had four students. Each year, four cooperative assign-
ments were set, each having its own corresponding individual quiz. Of the 18
groups, significant differences in the student scores achieved in the first quiz
were observed in six cases. This only happened in two groups in the second
quiz, and differed from the first. In all eight cases, they were proposed a
scheme by which they could improve their grades. This implied reducing the
weight of the lowest score but increasing the weight of the score obtained by
the weakest student in the subsequent quizzes. The proposal was accepted in all
instances. A total of six students dropped out of the course, and they were all
in two groups. Their scores have not been considered in the analysis presented
in this section.
All scores presented in this section refer to individual scores, and are given accord-
ing to the Spanish grading system, a scale from 0 to 10, with 10 representing the
highest score and 5 the minimum passing grade. Team scores have not been used
because the alteration of grades that happened as a consequence of the agreements
would certainly play in our interest and not be an appropriate measure of student
performance.
528 M. Arevalillo-Herráez
detect social loafing. Average scores in this case correspond to a total of nine
students (three groups). Scores for groups that dropped the course at an intermediate
stage have not been considered. The results are shown in Figure 2 and evidence the
contagious negative effect of social loafing on the individual grades, which decrease
as the course progresses.
Table 1. Average scores obtained in each quiz. A – Students in groups with no significant
score differences in first nor second quiz. B – Students in groups with significant score
differences in first quiz. C – Students in groups with significant score differences in the
second quiz.
Group (see table caption) First quiz Second quiz Third quiz Fourth quiz
A 6.48 6.25 6.30 6.24
B 5.02 7.18 7.76 7.87
C 5.00 4.42 6.73 6.53
Innovations in Education and Teaching International 529
Figure 2. Average scores obtained in each quiz by students in groups with significant score
differences in first quiz. Scores when using adaptive negotiation and when not.
Table 2. Average scores obtained in each quiz. A – Weakest students in groups with
Downloaded by [University Of Maryland] at 05:43 20 October 2014
significant score differences in first quiz. B – Students other than the weakest ones in groups
with significant score differences in first quiz. C – Weakest students in groups with
significant score differences in second quiz. D – Students other than the weakest ones in
groups with significant score differences in second quiz.
Group (see table caption) First quiz Second quiz Third quiz Fourth quiz
A 1.82 6.67 7.32 7.10
B 6.62 7.43 7.98 8.26
C 4.70 1.95 7.40 6.95
D 5.15 5.65 6.40 6.33
this was achieved by making the final student’s grade dependent upon the scores
achieved by the rest of the team members on a series of individual quizzes. Another
common strategy consists of naming a representative for the group and assigning all
members a grade that depends on the selected member’s score.
While these assessment methods have proven successful in cooperative contexts,
they can all be considered as preventive strategies. Although they discourage social
loafing, they can be made more effective if they are endorsed by other reactive
strategies that supplement them when they do not yield the expected results. One
such method is to promote mutual support when significantly unequal commitment
is detected, by establishing agreements that focus on low achievers and aim at
fostering a higher interdependence among the team members. These agreements
allow teams to compensate for low scores obtained in quizzes by the weakest
member, provided that they are able to improve his/her performance. In this way,
Downloaded by [University Of Maryland] at 05:43 20 October 2014
the effort made to help the weakest member results in a benefit for the entire group.
On one hand, the performance of the weakest student improves because of the extra
support provided by the rest of the team, which is encouraged because it works for
their own benefit. On the other hand, the effort made by the rest of the team
members also yields better results for everyone, in part because of the learning
benefits derived from cooperation and the explanations provided to the weakest
student. In fact, most of the success achieved by the reactive strategy can be
ascribed to the peer tutoring which is triggered as a consequence of the adaptive
negotiation. This suggests undertaking further research to determine in which way
similar strategies can be applied to groups which are, in principle, working well.
Another positive result derived from the use of the strategy has been a substan-
tial reduction in the drop rates. We believe that this has been produced mainly as a
result of increased mutual student support, this time enhanced by the pre-existing
social relations fostered by the member assignment method. This would also
partially explain why only entire groups dropped the module.
In addition, the fact that the majority of the weakest students expressed that the
pre-existing friendship was the factor that contributed the most to their improvement
suggests that the exploitation of social pressure in cooperative contexts is an issue
which should be explored further. In particular, the social value, cost and profit associ-
ated with the student’s effort in a cooperative environment should be evaluated from a
psychological perspective and their implications in learning should be studied in
greater detail.
In general, most collaborative learning methods are underpinned by assessment-
based preventive methods aiming at encouraging cooperation and avoiding the free
rider problem. We believe that reactive methods should be given a greater rele-
vance, and these should be supported by motivational techniques as opposed to
punishment. In this article, an adaptive negotiation strategy that exploits existing
social relationships has shown positive results in combating social loafing, promot-
ing student cooperation and encouraging mutual support. However, this is just an
example that assessment-based reactive methods may yield a great impact on
student performance. Further research is required to study the effect of other reac-
tive methods and judge on their suitability.
Acknowledgements
The author would like to thank funding from the Vice-rectorate of European
Convergence and Quality of the University of Valencia, through projects Finestra Oberta
Innovations in Education and Teaching International 531
Notes on contributor
Miguel Arevalillo-Herráez received the first degree in Computing from the Technical
University of Valencia, Spain, in 1993; the BSc in Computing from Liverpool John Moores
University, UK, in 1994; and the PgCert in Teaching and Learning in Higher Education and
the PhD degree in 1997, both also from Liverpool John Moores University, UK. On this
same year, he gained accreditation as a teacher in HE by the Staff and Educational
Development Association and became a senior lecturer at Liverpool John Moores University.
In 1999, he left to work for private industry for a one-year period, and came back to
academy in 2000. He was the program leader for the computing and business degrees at the
Mediterranean University of Science and Technology until 2006. From this year, he works
as a lecturer in the University of Valencia (Spain). His research now concentrates in
Education and Applied Artificial Intelligence.
Downloaded by [University Of Maryland] at 05:43 20 October 2014
References
Arevalillo-Herráez, M., & Claver, J. M. (2011). Assessment technique to encourage coopera-
tive learning in a computer programming course. International Journal of Engineering
Education, 27, 867–874.
Awang, M. (2006). Cooperative learning in reservoir simulation classes: Overcoming dispa-
rate entry skills. Journal of Science Education and Technology, 15, 220–226.
Bacon, D. R., Stewart, K. A., & Silver, W. S. (1999). Lessons from the best and worst
student team experiences: How a teacher can make the difference. Journal of Manage-
ment Education, 23, 467–488.
Ballantine, J., & Larres, P. M. (2007). Cooperative learning: A pedagogy to improve
students’ generic skills? Education and Training, 49, 126–137.
Bargh, J. A., & Schul, Y. (1980). On the cognitive benefits of teaching. Journal of Educa-
tional Psychology, 72, 593–604.
Blowers, P. (2003). Using student skill self-assessment to get balanced groups for group
projects. College Teaching, 50, 106–110.
Brooks, C. M., & Ammons, J. L. (2003). Free riding in group projects and the effects of
timing, frequency, and specificity of criteria in peer assessments. The Journal of Educa-
tion for Business, 78, 268–272.
Chapman, K. J., Meuter, M., Toy, D., & Wright, L. (2006). Can’t we pick our own groups?
The influence of group selection method on group dynamics and outcomes. Journal of
Management Education, 30, 557–569.
Diehl, M., & Stroebe, W. (1987). Productivity loss in brainstorming groups: Toward the
solution of a riddle. Journal of Personality and Social Psychology, 53, 497–509.
Gillies, M. R. (2008). The effects of cooperative learning on junior high school students’
behaviours, discourse and learning during a science-based learning activity. School
Psychology International, 29, 328–347.
Humphreys, B., Johnson, R. T., & Johnson, D. W. (1982). Effects of cooperative, competi-
tive, and individualistic learning on students’ achievement in science class. Journal of
Research in Science Teaching, 19, 351–356.
Johnson, D. W., & Johnson, R. (2000). Cooperative learning, values, and culturally plural
classrooms. In M. Leicester, C. Modgil, & S. Modgil (Eds.), Education, culture and
values (pp. 15–28). London: Falmer Press.
Johnson, D. W., & Johnson, F. P. (2009). Joining together. Group theory and group skills
(10th ed.). New Jersey, NJ: Pearson.
King, A. (2002). Structuring peer interaction to promote high-level cognitive processing.
Theory into Practice, 41, 33–40.
Morgan, B. (2003). Cooperative learning in higher education: Undergraduate student reflec-
tions on group examinations for group grades. College Student Journal, 37, 40–50.
Mulvey, P. W., & Klein, H. J. (1998). The impact of perceived loafing and collective effi-
cacy on group goal processes and group performance. Organizational Behaviour and
Human Decision Processes, 74, 62–87.
532 M. Arevalillo-Herráez