You are on page 1of 11

American Journal of Orthopsychiatry  2010 American Orthopsychiatric Association

2010, Vol. 80, No. 1, 124–134 DOI: 10.1111/j.1939-0025.2010.01015.x

Bullying in School: Evaluation and Dissemination


of the Olweus Bullying Prevention Program
Dan Olweus Susan P. Limber
University of Bergen Clemson University

The nature and extent of bullying among school children is discussed, and recent attention
to the phenomenon by researchers, the media, and policy makers is noted. The Olweus
Bullying Prevention Program (OBPP) is a comprehensive, school-wide program that was
designed to reduce bullying and achieve better peer relations among students in elemen-
tary, middle, and junior high school grades. Several large-scale studies from Norway are
reviewed, which provide compelling evidence of the program’s effectiveness in Norwegian
schools. Studies that have evaluated the OBPP in diverse settings in the United States
have not been uniformly consistent, but they have shown that the OBPP has had a posi-
tive impact on students’ self-reported involvement in bullying and antisocial behavior.
Efforts to disseminate the OBPP in Norway and the United States are discussed.

For 2 years, Johnny, a quiet 13-year-old, was a human plaything for Swearer, 2004; Juvonen & Graham, 2001; Smith, Pepler, &
some of his classmates. The teenagers badgered Johnny for money, Rigby, 2004; Smith et al., 1999; Stassen Berger, 2007). By way
forced him to swallow weeds and drink milk mixed with detergent, of illustration, a search of the PsycINFO database (using the
beat him up in the rest room and tied a string around his neck, lead- term bully) revealed only four books, journal articles, chapters,
ing him around as a ‘‘pet.’’ When Johnny’s torturers were interro-
or dissertations on the topic of bullying in 1988. By 2001, there
gated about the bullying, they said they pursued their victim because
it was fun. (newspaper clipping cited in Olweus, 1993a, p. 7)
were 123, and there have been more than 150 published each
year since 2004.
This short newspaper clipping gives a dismal picture of the In the United States, this increased attention has been fueled
cruelty children and youth can show toward one another under by some highly publicized school shootings (most notably those
certain conditions. It demonstrates what a nightmare that life at at Columbine High School in 1999) in which the tragic events
school can be for a victimized student—often without the par- have been linked to bully ⁄ victim problems among the students
ents or the teachers knowing what the victim is experiencing. involved (Anderson et al., 2001; Vossekuil, Fein, Reddy, &
Bullying among schoolchildren is a very old phenomenon. Modzeleski, 2002). State-level legislative attention to bullying
Though many are acquainted with the problem, it was not until has also been dramatic post-Columbine. In 1999, there were no
fairly recently (the early 1970s) that the phenomenon was made state laws addressing bullying among students; within 3 years,
the object of more systematic research (Olweus, 1973, 1978). there were 15. As of this writing, there are 41.
For a number of years, these efforts were largely confined to In this article, we will provide a brief overview of the phe-
Scandinavia. In the late 1980s and the 1990s, however, bullying nomenon of bullying, including its definition, nature, and
among school children also attracted attention in several other prevalence. Our main focus, however, will be on the inter-
countries, including Japan, Great Britain, the Netherlands, Can- vention work against bully ⁄ victim problems that has been
ada, the United States, and Australia (for references, see Smith conducted with the Olweus Bullying Prevention Program
& Brain, 2000). In the past decade, there has been an explosion (OBPP) in Norway over the past 25 years and more recently
of interest in bullying, in terms of research, intervention, and in the United States. That review includes an overview of
attention by the media and policy makers (e.g., Espelage & the program, its research base, and efforts to disseminate the
model.
This article is based on papers presented in March–April 2009 at the
Greenville Family Symposium, at which the first author delivered an The Nature and Prevalence of Bullying
invited lecture in commemoration of the establishment of an endowed
distinguished professorship in his honor in the Institute on Family and In the mid-1980s, the first author (Olweus, 1986, 1993a)
Neighborhood Life at Clemson University. The second author, who was developed the following definition of bullying: ‘‘A student is
appointed as the first holder of the chair, also presented an invited ple- being bullied or victimized when he or she is exposed, repeatedly
nary lecture. and over time, to negative actions on the part of one or more
Correspondence concerning this article should be addressed to Susan other students’’ (Olweus, 1993a. p. 9). Negative actions can be
P. Limber, Institute on Family and Neighborhood Life, Clemson carried out by physical contact, by words, or in other ways,
University, 158 Poole Agricultural Center, Clemson, SC 29634-0132. such as gestures or intentional exclusion from a group.
Electronic mail may be sent to slimber@clemson.edu.

124
BULLYING IN SCHOOL 125

Expressed in more everyday language, bullying can be charac- students (bullied ‘‘two or three times a month’’ or more often)
terized as intentional, repeated, negative (unpleasant or hurtful) had increased by approximately 50% since 1983, and (b) the
behavior by one or more persons directed against a person who percentage of students who were involved in the most serious
has difficulty defending himself or herself. According to this def- forms of bullying problems (i.e., bullying ⁄ being bullied at least
inition, which has gained considerable acceptance among once per week) had increased by 65%.
researchers and practitioners alike (Smith & Brain, 2000), the Using the two global questions of the Olweus questionnaire, a
phenomenon of bullying can thus be described as aggressive recent large-scale survey of 11- to 15-year-olds in 40 countries
behavior or intentional harm doing that is carried out repeat- (Craig et al., 2009) revealed that 26% of adolescents had been
edly and over time in an interpersonal relationship characterized involved in bullying with some regularity (‘‘two to three times a
by an actual or perceived imbalance of power or strength. month’’ or more often)—10.7% as ‘‘bullies only,’’ 12.6% as
It is worth noting that much bullying occurs without apparent ‘‘victims only,’’ and 3.6% as ‘‘bully ⁄ victims.’’ Among American
provocation on the part of the person being targeted. This defi- youth in this sample, 22.2% of boys and 16.6% of girls reported
nition makes clear that bullying can be considered a form of regular involvement in bullying. Notably, there were dramatic
abuse, and sometimes the term peer abuse is used as a label of differences in bullying rates across the 40 countries surveyed
the phenomenon. What sets bullying apart from other forms of (e.g., a fivefold difference was observed between countries in the
abuse, such as child abuse and domestic violence, is the context prevalence of bullying among boys, and a sevenfold difference
in which it occurs and the relationship of the parties involved. was observed for girls’ involvement in bullying). These differ-
ences probably reflect social and cultural differences in bullying
itself (or the interpretation of the term) and in the implementa-
Prevalence of Bullying
tion of policies and programs to address bullying (Craig et al.,
The earliest estimates of bullying prevalence were based on 2009).
surveys of more than 130,000 Norwegian students conducted in
1983, using an early version of the Olweus Bully ⁄ Victim Ques-
A Brief Note About the Origins of Bullying
tionnaire (Olweus, 1986, 1996, 2010; Solberg & Olweus, 2003).
Problems
Olweus found that that 15% of the students in elementary and
lower secondary schools (Grades 3–10, roughly corresponding Analyses of the causes of bully ⁄ victim problems must be pur-
to ages 8 through 16) in Norway were involved in bully ⁄ victim sued on several different levels. Individual personality character-
problems with some regularity—either as bullies only, victims istics or typical reaction patterns, in combination with physical
only, or bully ⁄ victims (Olweus, 1993a). This percentage repre- strength or weakness in the case of boys, are important for the
sented one student out of seven. Approximately 9% were vic- development of these problems in individual students. At the
tims of bullying, 6%–7% bullied other students, and 1.5% of same time, environmental factors such as the attitudes, routines,
the students were both victim and bully (approximately 17% of and behavior of adults in the school environment play a major
the victims). A large-scale survey in 2001 (Olweus, 1996, 2002) role in determining the extent to which the problems will mani-
revealed two disturbing trends: (a) the percentage of victimized fest themselves in a classroom or a school.

Figure 1. Bullying circle.


126 OLWEUS AND LIMBER

Furthermore, most bullying incidents directly or indirectly were compared across three points in time (Olweus, 1991, 1997,
involve children and youth other than the victimized child and 2005; Olweus & Alsaker, 1991). At Time 1, participants
his or her perpetrators, as depicted in the Bullying Circle in belonged to 112 classes in Grades 5–8 from 28 elementary and
Figure 1 (Olweus, 2001a, 2001b). Consequently, the behavior 14 junior high schools in Bergen, Norway.
and attitudes of relevant peers, as manifested in group mecha- The empirical evaluation results revealed marked reductions
nisms and processes, are also important to consider. in student self-reports of bully ⁄ victim problems. In the 1983–
1984 evaluation, the relative reduction for being bullied was
62.0% (from 10.0% to 3.8%) and 33.0% for bullying other
Bullying as an Issue of Human Rights
students (from 7.6% to 5.1%) after 8 months of intervention.
Several decades of research confirm that children and adoles- Results for the 1983–1985 evaluation (after 20 months of
cents who are exposed to bullying are likely to be seriously intervention) revealed reductions of 64.0% in rates of being
affected by this experience in a number of ways. Bullied children bullied (from 10.0% to 3.6%) and reductions of 52.6% (from
tend to suffer from elevated levels of depression, anxiety, poor 7.6% to 3.6%) in rates of bullying others (Olweus, 1991,
self-esteem, social isolation, psychosomatic problems, and sui- 1997). Similar results were obtained for peer rating variables
cidal ideation (e.g., Espelage & Swearer, 2004; Hawker & Boul- and teacher ratings of bully ⁄ victim problems at the classroom
ton, 2000; Juvonen & Graham, 2001; Olweus, 1978, 1993a; level.
Stassen Berger, 2007). Recent research shows that victimized A clear dosage–response relationship also was observed. The
children may develop even more severe mental health problems classes in which essential components of the program had been
such as psychotic symptoms (Schreier et al., 2009). Many of the implemented experienced greater reductions in bullying prob-
problems incurred in childhood or adolescence are likely to con- lems (Olweus & Alsaker, 1991; Olweus & Kallestad, in press).
tinue into young or middle adulthood (e.g., Fosse, 2006; Olw- Finally, the study revealed reductions in self-reports of gen-
eus, 1993b). eral antisocial behavior (vandalism, theft, and truancy) and
Against this background and from the perspective of interna- improvements in the social climate of the class, including
tional human rights law (e.g., Convention on the Rights of the improvements in students’ satisfaction with school life,
Child [CRC], 1989; Universal Declaration of Human Rights, improved order and discipline, more positive social relation-
1948), it is natural to argue that is a fundamental human right ships, and a more positive attitude toward school. A number of
for a child to be safe in school and to be spared the oppression possible alternative explanations of the positive findings were
and repeated humiliation implied in bullying. As stated in the carefully considered and could be safely ruled out or treated as
CRC (1989), governments must ‘‘take all appropriate legislative, highly unlikely (Olweus, 1991).
administrative, social, and educational means to protect the
child from all forms of physical or mental violence, injury or
Brief Description of the OBPP
abuse, neglect or negligent treatment, maltreatment or exploita-
tion . . . while in the care of parent(s), legal guardian(s), or any The primary goals of the OBPP are to reduce existing bully-
person who has the care of the child’’ (art. 19, § 1, emphasis ing problems among students at school, prevent the develop-
added). ment of new bullying problems, and achieve better peer
A number of studies also indicate that children who bully relations at school (Olweus, 1993a; Olweus, Limber, & Mihalic,
others are at considerable risk of engaging in other troubling, 1999; Olweus et al., 2007). These goals are pursued through a
antisocial and violent behavior both in the short and long term restructuring of the school environment. This restructuring is
(Sourander et al., 2007, and references above). Accordingly, intended to reduce opportunities and rewards for engaging in
even though the primary reason for initiating systematic anti- bullying and to build a sense of community among students and
bullying work in school is consideration of bullied students, it adults within the school environment (Olweus, 1993a, 2001b;
also is important to counteract bullying for the sake of the per- Olweus et al., 2007).
petrators. The OBPP is based on four key principles. Adults at school
(and ideally, at home) should (a) show warmth and positive
interest in their students; (b) set firm limits to unacceptable
The OBPP: Development and Initial Evaluation
behavior; (c) use consistent nonphysical, nonhostile negative
In 1983, after three adolescent boys in Norway committed sui- consequences when rules are broken; and (d) function as
cide, as a likely consequence of severe bullying by peers, the Nor- authorities and positive role models (Olweus, 1993a, 2001b;
wegian Ministry of Education initiated a national campaign Olweus et al., 2007). These principles have been translated into
against bullying in schools. What has later become known as the a number of specific interventions at four levels: the school, the
OBPP was developed and initially evaluated within this context. classroom, the individual, and, in some contexts, the commu-
The OBPP was initially implemented in the First Bergen Pro- nity.
ject Against Bullying, a longitudinal study that followed Although these principles and the components of the OBPP
approximately 2,500 school children over a period of 2.5 years, have remained largely unchanged, ongoing research and experi-
from 1983 to 1985. Because the project was part of a national ence in the field have led to some adaptations of the program to
campaign, it was not possible to conduct an experimental study help ensure that it fits different cultural contexts. Table 1 sum-
with schools or classes randomly assigned to treatment and con- marizes the components of the OBPP, as implemented in the
trol conditions. Instead, an extended selection cohorts design United States. (For a description of these components, see Olw-
was utilized in which same-aged students from the same schools eus & Limber, 2007, 2010.)
BULLYING IN SCHOOL 127

Table 1. Components of the Olweus Bullying Prevention Program

School-level components
Establish a Bullying Prevention Coordinating Committee (BPCC)
Conduct trainings for the BPCC and all staff
Administer the Olweus Bullying Questionnaire (Grades 3–12)
Hold staff discussion group meetings
Introduce the school rules against bullying
Review and refine the school’s supervisory system
Hold a school-wide kick-off event to launch the program
Involve parents
Classroom-level components
Post and enforce school-wide rules against bullying
Hold regular (weekly) class meetings to discuss bullying and related
topics
Hold class-level meetings with students’ parents
Individual-level components
Supervise students’ activities
Ensure that all staff intervene on the spot when bullying is observed
Figure 2. Percentage bullied students 2001–2003. Elementary Grades
Meet with students involved in bullying (separately for those who are
4–7.
bullied and who bully)
Meet with parents of involved students
Develop individual intervention plans for involved students, as needed
Community-level components evaluation projects carried out between 2001 and 2003 in
Involve community members on the Bullying Prevention connection with a new national initiative. In 2000, the Depart-
Coordinating Committee ment of Education and Research and the Department of Chil-
Develop school–community partnerships to support the school’s
dren and Family Affairs decided to offer the OBPP to all
program
Help to spread antibullying messages and principles of best practice in
Norwegian comprehensive schools (Grades 1–10) over a period
the community of several years.
From an evaluation perspective, this new national initiative
has provided a unique opportunity to examine the effects of
the OBPP on very large samples of students and schools
Subsequent Evaluations of the OBPP
under ordinary conditions (i.e., without special efforts in terms
of staff input or other resources) in the context of large-scale
The Outcome Evaluations
dissemination (Flay et al., 2005). All of the training of instruc-
Subsequent to the initial evaluation of the OBPP in the First tors was undertaken by specially trained colleagues from the
Bergen Project, six follow-up outcome evaluations involving Olweus Group Against Bullying and Antisocial Behavior at
more than 20,000 students from more than 150 schools have the Research Center for Health Promotion, University of
been conducted in Norway. All of these evaluations have used Bergen.
dichotomized or graded self-report items or scales from the Data were analyzed using the extended selection cohorts
Olweus Bullying Questionnaire (Olweus, 1996, 2007; Solberg & design, in which developmental or maturational effects are con-
Olweus, 2003) as dependent variables. As argued in another trolled (Olweus, 2005). Key results are shown in Figures 2 and
context (Olweus, 2010), data from a well-constructed question- 3. The upper curve of Figure 2 portrays the baseline percentages
naire are often the best indicator of change in levels of bullying of bullied students in Grades 4 through 7 from five different
in intervention studies. cohorts of schools that conducted their introductory surveys in
The program has also been evaluated in several diverse the period from October 2001 to October 2003. To date, we
communities in the United States, including rural South Car- have primarily focused our evaluation analyses on the first three
olina (Limber, Nation, Tracy, Melton, & Flerx, 2004; Melton of these cohorts.
et al., 1998), inner-city Philadelphia (Black & Jackson, 2007), The percentages of students (in the same grades and schools)
suburban Chula Vista, California (Pagliocca, Limber, & Ha- who reported being bullied 1 year later, when the schools had
shima, 2007), and Washington state (Bauer, Lozano, & Riv- used the OBPP for approximately 8 months, are shown in the
ara, 2007). Evaluations in other European countries are also lower curve of Figure 2. The two data points from each cohort
underway. of schools are connected with an arrow.
The percentage of bullied students in the first cohort of schools
(n = 8,388 students from 56 schools) was 15.2% while at follow-
Research-Based Evaluations of the OBPP in
up 1 year later (n = 8,299) this percentage was 10.2%, a relative
Norway 2001–2003
reduction of 33%. The relative reductions for the two consecutive
Although two Norwegian evaluation projects with positive cohorts of schools were approximately 34%, from 14.0%
results were conducted in the late 1990s (the New Bergen Project (n = 4,083 students from 46 schools) to 9.2% (n = 4,089) for
and the First Oslo Project; see Olweus & Limber, 2010), our the second cohort, and from 13.2% (n = 8,238 students from 58
focus here will be on the three large-scale implementation and schools) to 8.7% (n = 8,483) for the third cohort.
128 OLWEUS AND LIMBER

Norwegian Evaluation Studies Involving


Students in Grades 8–10
Implementation of the OBPP in schools with students in
Grades 4 through 7 has consistently produced positive
results, a record that appears to be relatively unique in an
international perspective (see Smith et al., 2004; Ttofi & Far-
rington, 2009; Ttofi, Farrington, & Baldry, 2008). Positive
results have also been obtained with students from junior
high lower secondary school grades (8–10) in Norway,
although less consistently and sometimes with weaker effects.
For example, in the First Oslo Project, there was a 32%
reduction among ninth graders in the percentage of bullied
students between Time 1 and Time 2 (Olweus & Limber,
2010). Similarly, in the First Bergen Project, positive results
were obtained for the junior high school cohort (Grade 8)
after 8 and 20 months of intervention, respectively (see, e.g.,
Figure 3. Percentage bullying students 2001–2003. Elementary Grades Olweus, 1991, 1997, where the designation Grade 7 corre-
4–7. sponds to Grade 8 in the United States and today’s Norwe-
gian school system).
In the context of the New National Initiative, results for these
As illustrated in Figure 3, the pattern of results for bullying grades at the 1-year follow-up (Time 2) have been more vari-
other students is very similar to what was reported for being able, sometimes producing positive results, at other times show-
bullied, but at a lower level. The relative reductions for this ing no or small differences between the Time 1 and Time 2
variable for the three cohorts of schools were 37% (from 5.7% assessments. However, in a recent study following 14 schools
to 3.6%), 48% (from 5.9% to 3.1%), and 49% (from 5.1% to with Grades 8 and 9 over a 2-year period from 2001 to 2003,
2.6%), respectively. Similar results were obtained when the data the results at Time 3, after 20 months of intervention, showed a
were analyzed separately for the two genders, the four grades, relative reduction of 27.5% in the percentage of bullied stu-
and when an even stricter criterion (‘‘about once a week’’ or dents. Similar results were obtained for bullying other students,
more often) was used in classifying students as being bullied or with a relative reduction of 31.1%. In contrast, the reductions
bullying other students. Similar positive results were also from Time 1 to Time 2 were quite small for both variables.
obtained with regard to summary scales of all different forms of Although these results are based on a relatively small number of
bullying and of special subscales, such as direct bullying and schools, they suggest that it may take longer time to produce
indirect ⁄ relational bullying (social isolation and rumor spread- positive results in Grades 8–10 than in lower grades (see also
ing). All of these findings were statistically highly significant. Smith & Sharp, 1994; Stevens, de Bourdeaudhuij, & Van Oost,
Moreover, as explained elsewhere in detail (Olweus, 2005; Olw- 2000).
eus & Limber, 2010), because of the structure of the design with
different cohorts of schools entering the program at different
Outcome Studies in the United States
time points, one can safely rule out the possibility that the posi-
tive results were a consequence of ‘‘historical events,’’ such as Several studies have evaluated the effectiveness of the OBPP
special media attention or general time trends rather than effects in diverse elementary and middle school populations in the Uni-
of the OBPP. ted States. Findings will be summarized briefly.
For 14 of the 24 Oslo schools from the first cohort, we have
data for five assessments, from October 2001 to October 2006, South Carolina. The first evaluation of the OBPP in the
involving approximately 3,000 students per assessment. The ini- United States took place in the mid-1990s and involved elemen-
tial rate of being bullied was 14.0%, which decreased to 9.8% tary and middle schools in six primarily rural school districts in
after 1 year of intervention and to 8.4% by 2006. This change South Carolina (Limber et al., 2004; Melton et al., 1998; Olweus
represents a 40% relative reduction from the baseline value. & Limber, 2010). The sample was largely African American
Similarly, the rate of bullying others decreased from 5.5% in (school districts ranged from 46% to 95% African American)
2001, to 2.8% in 2002, and to 2.7% in 2006, a relative reduction and of low socioeconomic status.
of 50.9%. After 7 months of program implementation, significant
These results are particularly significant because it has been Time · Group (intervention vs. comparison) interactions were
shown (e.g., Beelman, Pfingsten, & Lösel, 1994) that many pro- documented for several indices of bullying others. For example,
gram effects are short-lived and are found to be considerably in intervention schools, there was a 16% decrease in the per-
reduced when even slightly longer term effects have been exam- centages of students who indicated they had bullied others sev-
ined. The reported results show that the effects of the OBPP can eral times or more often within the school term, whereas there
be long-lasting and suggest that the intervention schools had was a 12% increase in rates of bullying among students in com-
been able to change their ‘‘culture’’ and ability to counteract parison schools, resulting in an overall relative reduction of
bullying in a more permanent way. approximately 28%.
BULLYING IN SCHOOL 129

Similarly, there was an increase over time in the frequency


Summary of Evaluations and Next Steps
of self-reported antisocial behavior among students in compari-
son schools. For the intervention students, there was either no A number of large-scale studies from Norway provide com-
increase or a slower rate of increase with regard to measures pelling evidence of the program’s effectiveness in Norwegian
of general delinquency, vandalism, school misbehavior, and schools. Studies that have evaluated the OBPP in diverse set-
sanctions for school misbehavior. Thus, the program appeared tings in the United States have not been uniformly consistent.
to slow the age-related rate of increase in students’ involve- However, the thrust of the findings in the U.S. studies has been
ment in antisocial behavior. There were no significant changes that the OBPP has had a positive impact on students’ self-
in the frequency with which students reported being bullied. reported bullying behavior (Limber et al., 2004; Melton et al.,
The program continued one additional year, but it unfortu- 1998), antisocial involvement (Limber et al., 2004), being bullied
nately was implemented with such low degrees of fidelity that (Bauer et al., 2007, for White children), and propensities to
it no longer could be considered a faithful implementation of report victimization to adults (Pagliocca et al., 2007). Observa-
the model. tional techniques showed marked decreases in relational and
physical bullying (Black & Jackson, 2007). Additional outcome
Pennsylvania. Black and Jackson (2007) evaluated the studies of the OBPP are underway in the United States and
effectiveness of the OBPP in six large public elementary and other countries, which will provide useful information about the
middle schools in inner-city Philadelphia over 4 years of imple- effectiveness of the program in diverse cultural contexts and
mentation. Researchers used an observational measure to assess with varying degrees of implementation fidelity.
Bullying Incident Density (a checklist of bullying behaviors that Several school-based antibullying programs inspired by the
included physical, verbal, and emotional bullying). Observations OBPP have been implemented and evaluated in a variety of
of elementary students took place at recess, while observations countries, including Belgium (Stevens, Van Oost, & de Bour-
of middle school students took place during lunch. Bullying deaudhuij, 2004; Stevens et al., 2000), Canada (Pepler, Craig,
Incident Density decreased 45% over the course of 4 years— O’Connell, Atlas, & Charach, 2004; Pepler, Craig, Ziegler, &
from 65 incidents at baseline to 36 incidents per 100 student Charach, 1994), Germany (Hanewinkel, 2004), and the United
hours. Unfortunately, because of substantial attrition in the Kingdom (Eslea & Smith, 1998; Smith, Sharp, Eslea, & Thomp-
number of students responding to the Olweus Bully ⁄ Victim son, 2004; Whitney, Rivers, Smith, & Sharp, 1994), with some-
Questionnaire, conclusions about possible changes in self- what mixed results. It is important to note that these studies
reports cannot be drawn. cannot be seen as replications of the OBPP. The programs
implemented have deviated considerably, but to different
Washington. Bauer et al. (2007) evaluated the OBPP degrees, from the OBPP in terms of program components and
using a nonrandomized controlled study with 10 middle schools model of implementation (Olweus & Limber, 2010).
(7 intervention, 3 control). Using the Olweus Bully ⁄ Victim
Questionnaire, researchers found significant program effects for
Dissemination of the OBPP: Successes and
relational victimization and physical victimization among White
Challenges
students. However, they failed to find similar program effects
for students of other races and ethnicities. In addition, they
Dissemination of the OBPP in Norway
observed overall positive program effects with regard to stu-
dents’ perceptions that other students actively intervened in bul- In building the organization and infrastructure for the previ-
lying incidents. ously mentioned national initiative in Norway, two overriding
principles guided the work. First, we sought to ensure that the
California. Pagliocca et al. (2007) evaluated the effective- program was implemented with reasonable fidelity (quality con-
ness of the OBPP in three elementary schools in a suburban trol). Second, we endeavored to implement the program in a
community in southern California. The researchers used a selec- number of schools or communities in a relatively limited period
tion cohorts design to assess program effects over a 3-year per- of time.
iod, based on anonymous surveys of students (using the Olweus To accommodate both of these principles, a four-level strat-
Bully ⁄ Victim Questionnaire), teachers, and parents. Self-reports egy of dissemination, a kind of ‘‘train-the-trainer’’ model, is
of being bullied decreased 21% after 1 year and 14% after used. The Olweus Group trains and supervises specially selected
2 years; self-reports of bullying others decreased 8% after 1 year instructor candidates who train and supervise ‘‘key persons’’
and 17% after 2 years. from a number of schools (a maximum of five schools per
Other findings included increases in bullied students’ propen- instructor candidate). These key persons are then responsible
sities to tell a teacher about their bullying (Time 1 vs. Time 3), for leading recurrent staff discussion groups at each participat-
students’ perceptions that teachers and other adults try to stop ing school.
bullying (Time 1 vs. Time 2), teachers’ perceptions that there The training of the instructor candidates consists of 11–12
were clear rules about bullying (Time 1 and Time 3), and teach- whole-day assemblies distributed over a period of 12–18
ers’ beliefs that they knew how to respond to bullying (78% months. During the interval between whole-day meetings, the
increase between Time 1 and Time 3). There also were marked instructor candidates receive ongoing consultation via telephone
increases in teachers’ perceptions that the school’s bullying poli- or e-mail with members of the Olweus Group. After having suc-
cies had been communicated clearly to students, parents, teach- cessfully completed the training period, the instructor candidates
ers, and nonteaching staff (by 72%–97%). are assigned status as certified Olweus instructor for a period of
130 OLWEUS AND LIMBER

2 years. The instructor can then be recertified after having ful- North America. At the same time, they have striven to imple-
filled certain criteria. ment reasonable training and consultation processes and
An important task for the instructor candidates is to hold a resources to help ensure good program fidelity.
2-day training with key individuals from each participating Emphasis has been placed on building local capacity to
school. The instructor candidates are also involved in the implement the program. To this end, training-of-trainer
administration of the Olweus Bully ⁄ Victim Questionnaire and (TOT) courses have been held at national, state, and local
in interpreting and communicating the results to the individual levels, and more than 500 trainers from 42 states (plus the
school based on a 20-page report of the students’ responses split District of Columbia and Puerto Rico) have been certified to
by grade and gender. The Questionnaire is an important vehicle provide training in the model. The TOT involves participa-
for creating awareness and involvement among staff, students, tion in 5 days of intensive training over the course of 1 year
and parents. In addition, the key personnel receive continuing and 24 months of monthly telephone consultation with an
supervision and assistance from their instructor. experienced trainer. In addition, trainers submit online pro-
Establishment of staff discussion groups at each participating gress reports of their schools’ activities and evaluations of
school is an important tool for effective dissemination and trainings conducted. As is the case among Norwegian train-
implementation of the program. Each staff member in the ers, recertification is required every 2 years in order to help
school is a member of a staff discussion group. These groups ensure that trainers keep abreast of current research and
(with up to 15 participants) meet regularly for approximately practices.
90 min every other week under the leadership of the specially OBPP trainers are certified to provide training and monthly
trained key persons. The meetings are typically organized consultation (for at least one school year) to members of a
around important components or themes of the program as school’s Bullying Prevention Coordinating Committee, the
described in Olweus’ Core Program Against Bullying: A Teacher school team that is responsible for coordinating the program at
Handbook (in Norwegian; Olweus, 2001b) and the Norwegian a given school. Consultation involves either in-person or tele-
version of the book Bullying at School: What We Know and phone meetings to help ensure fidelity to the model and to prob-
What We Can Do (Olweus, 1992, 1993a). The recurrent staff lem solve about challenges.
meetings around the program serve to stimulate organizational In at least 12 states where there has been particular interest in
development of the school. the OBPP, state leaders have been identified. The positions of
In the period from 2001 to 2008, the program has been imple- these individuals vary—from state-level positions in depart-
mented in approximately 500 Norwegian schools, and more ments of education to employees in relevant nonprofit organiza-
than 125 OBPP instructors have been trained in use of the pro- tions—as do their roles with the OBPP. Typically, these
gram. Although the schools or communities pay a limited individuals provide a variety of supports for trainers in their
amount for materials and use of the questionnaire, most of the state, such as holding state-level meetings of trainers and acting
costs associated with the training of instructors have been reim- as a referral point for schools interested in the training.
bursed by the Norwegian government.
Using the same four-level train-the-trainer model, the OBPP Early (and ongoing) Challenges in Program Dissem-
has also been implemented in a considerable number of schools ination. Our experiences in the dissemination of the OBPP
in other European countries, including Iceland, Sweden, and have identified a number of challenges—some that are somewhat
Lithuania. unique to the American experience and others that likely are not.
These challenges generally relate to schools’ readiness to imple-
ment the program and (once a decision has been made to move
Dissemination of the OBPP in the United States
ahead with the program) their ability to do so with fidelity.
One of the biggest challenges to the successful adoption of
Initial Implementation. Based on the success of the the OBPP—and very likely, other bullying prevention pro-
OBPP in Norway and the initial promising findings from the grams—is resistance on the part of some school staff and par-
evaluation of the OBPP in South Carolina, the OBPP was iden- ents. Early in the dissemination of the OBPP, it was common to
tified in 1998 as one of 10 (and ultimately 11) Blueprints for Vio- find a sizable number of staff (and parents) at schools who
lence Prevention by the Center for the Study and Prevention of believed that bullying was not a concern—either because they
Violence (Olweus et al., 1999). Interest in the OBPP exploded felt it did not exist (or was rare) or because they viewed the
after this designation and others (e.g., designation of the pro- experience of bullying as a rite of passage or even a positive
gram as a model by the federal Substance Abuse and Mental learning experience for children.
Health Services Administration). As a result, a dissemination Many adults have underestimated the significant social, emo-
strategy was developed to meet the demand for training and tional, and academic costs of bullying and overestimated the
related materials that were tailored to the American educational ability of victimized children to stop bullying without assis-
context. tance from adults. It is common to find a handful of nay-say-
ers at any given school. Although the attitudes of some of
Training Model. To support implementation of the these adults may be swayed with time and education, efforts to
OBPP in the United States, faculty and staff affiliated with introduce and sustain a comprehensive bullying prevention pro-
Clemson University’s Institute on Family and Neighborhood gram may be doomed if a majority of school staff do not
Life (in consultation with the team in Norway) have worked to believe that bullying is a serious issue. The attitudes of the
achieve wide dissemination of the model to interested schools in school principal about bullying prevention are particularly
BULLYING IN SCHOOL 131

important to the success of a school-wide program. Results many to designate time to train nonteaching staff, such as bus
from the student questionnaire survey often act as an ‘‘eye drivers, custodial staff, and cafeteria staff, as these individuals
opener’’ and help the school make a more realistic assessment typically work different hours and frequently work under differ-
of the actual situation. ent contractual requirements. Administrators also have
As educators and members of the public have increasingly expressed challenges in ensuring sufficient time throughout the
recognized the need and benefits of focusing on prevention of school year for staff to engage in ongoing staff development
bullying, many have, understandably, sought simple or short- through their staff discussion groups. Nevertheless, many crea-
term solutions to bullying in their schools. Often school admin- tive administrators, who have recognized the importance of suf-
istrators and staff wish to adopt a piecemeal approach. Bullying ficient training and ongoing support for all adults in a school
may be the topic of a staff in-service training, a PTA meeting, a building, have identified the necessary procedures, time, and
school-wide assembly, or lessons taught by individual teachers. resources.
Although such efforts may represent important initial steps in
raising awareness about the problem or in the adoption of a
Conclusions
comprehensive bullying prevention strategy, they cannot be
expected to reduce bullying problems on their own (Limber, The OBPP is built on the belief that bullying need not and
2004). What is required to reduce bullying is nothing less than a should not be a commonplace experience for children and youth
change in the school ‘‘culture’’ and in the norms for behavior. (Olweus & Limber, 2010). Indeed, more than two decades of
This message continues to be hard for many to hear. research has shown that bullying can be decreased substantially
Another challenge has to do with schools’ use of strategies to through school-wide efforts designed to reduce opportunities
address bullying that are fundamentally at odds with the philos- and rewards for bullying and to build a feeling of community
ophy of the OBPP (Limber, 2004), such as zero-tolerance poli- among students and adults.
cies (see APA Zero Tolerance Task Force, 2008, for a review of Efforts required to make this culture shift are considerable on
research on the effects of these policies in school settings), peer the part of administrators and school staff, but the benefits are
mediation or conflict resolution strategies, or group treatment likely to be great. We (Olweus & Limber, 2010) have estimated,
for students who bully. As public awareness about effective and based on the results from six large-scale studies in Norway, that
ineffective practice grows, we have anecdotally experienced the OBPP helped more than 2,000 Norwegian students escape
fewer such conflicting approaches. being regularly bullied. Not only do these figures represent an
A final challenge experienced in the dissemination of the important ‘‘person’’ savings, but they also very likely signify a
OBPP (as well as numerous other programs) in the United substantial economic savings for society. As noted earlier, there
States is the tendency of school personnel to ‘‘cherry-pick’’ pro- is considerable evidence that many victims of bullying experi-
gram elements that are perceived as easier to implement, while ence mental health and health problems, such as depression,
failing to implement elements that require greater effort. In the anxiety, poor self-esteem, headaches, stomach aches, and sui-
American school context, those program elements that have cidal ideation.
posed the biggest challenge include holding weekly class meet- A recent Norwegian thesis provides some perspective on the
ings with students and holding regular staff discussion group possible magnitude of the problem. Fosse (2006) discovered that
meetings. With increasing time pressures on educators to cover among 160 young adults who had sought psychiatric treatment
required academic material and to prepare students for yearly for the first time, 50% had been bullied during their school
standardized tests, many administrators and teachers have been years, and the more severe bullying that they had experienced,
reluctant to set aside time for class meetings, despite evidence the greater their psychiatric symptoms as adults.
that they are important to the success of the program (Olweus Although no research has yet assessed the direct effects of the
& Kallestad, in press). OBPP (or any other bullying prevention program) on academic
Experience in implementing the Olweus program in American achievement, it is very reasonable to assume that reductions in
settings suggests that consistent use of classroom meetings tends bullying would lead to improvements in achievement among
to be more challenging in a middle school or junior high school students, and particularly among children who are bullied.
environment, where children change classes and have multiple Research has documented that bullied children are more likely
teachers, than in an elementary school setting, where students than nonbullied peers to want to avoid school (Kochenderfer &
spend the vast majority of the school day with one teacher. Ladd, 1996; Rigby, 1996; Smith, Talamelli, Cowie, Naylor, &
Whereas American elementary school teachers frequently have Chauhan, 2004). They also receive lower grades than peers who
flexibility to arrange their own weekly schedules to accommo- are not bullied (Arseneault et al., 2006; Eisenberg, Neumark-
date classroom meetings, staff in middle or junior high schools Sztainer, & Perry, 2003). In a longitudinal study, early peer
typically must confer with fellow grade-level teachers and exclusion in kindergarten was linked to decreased classroom
administrators to designate an appropriate day and time each participation and lower academic achievement in later elemen-
week to hold such meetings. tary grades (Buhs, Ladd, & Herald, 2006). As noted previously,
Similarly, time constraints on staff have made it challenging in the First Bergen Project, the positive effects of the OBPP
for some schools to set aside enough time for training and ongo- included clear improvements in several dimensions of social cli-
ing staff development. Although most school administrators mate that are very likely related to academic achievement.
have not balked at the need for two days of training for Coordi- A substantial cost savings also may be realized by preventing
nating Committee members and one day of training for teachers youth who bully (or potential bullies) from engaging in antisocial
prior to program implementation, it has been more difficult for and criminal behavior. Former male school bullies are clearly
132 OLWEUS AND LIMBER

overrepresented in crime registers as young adults (Olweus, or require implementation of research-based bullying prevention
1993a; Sourander et al., 2007). Although we have not assessed and intervention practices).
whether implementation of the OBPP has led to a reduction in Finally, although comprehensive, research-based bullying pre-
adult criminality, two large-scale projects in Norway and the vention efforts such as the OBPP need not be very expensive,
United States (described previously) documented clear program they do require modest training, personnel, and material
effects on concurrent antisocial behavior of youth, including van- resources. Given societal savings that likely will result, such pro-
dalism, theft, and truancy. Thus, it is reasonable to assume that a grams are wise investments by local, state, and federal govern-
proportion of youth who stop bullying in school as a result of the ments. To the extent that bullying is viewed and addressed as an
OBPP may be diverted from an antisocial trajectory (Olweus & issue of public health (and not just an issue of education), we
Limber, 2010). In light of the major societal costs incurred by are hopeful there will be increased will and resources to support
individuals with conduct problems or conduct disorder (Cohen, such efforts.
1998; Scott, Knapp, Henderson, & Maughan, 2001), such a result
would represent a substantial savings to society, even if the num-
Keywords: bullying; schools; epidemiology; Norway; United
ber of diverted bullies was small.
States; cross-cultural research; children’s rights; Convention on
Despite the significant personal and societal costs of bullying
the Rights of the Child; victimization; diffusion of knowledge;
and the substantial savings that likely would result from wide-
prevention; training of trainers; public information campaigns;
spread implementation of effective bullying prevention efforts
legislation; school-wide prevention
such as the OBPP, we estimate that the majority of schools in
the United States and Norway (not to mention elsewhere
around the globe) are not implementing evidence-based bullying References
prevention initiatives in schools. For example, notwithstanding Anderson, M., Kaufman, J., Simon, T. R., Barrios, L., Paulozzi, L.,
efforts to disseminate the OBPP widely, the program is being Ryan, G., et al. (2001). School-associated violent deaths in the United
implemented in a relatively limited percentage of schools in States, 1994–1999. Journal of the American Medical Association, 286,
Norway (approximately 25%) and in a small percentage in the 2695–2702.
United States (approximately 4%). Within the U.S. context, APA Zero Tolerance Task Force. (2008). Are zero tolerance policies
state laws typically require the establishment of bullying preven- effective in the schools? An evidentiary review and recommendations.
tion policies, but few require research-based approaches to pre- American Psychologist, 63, 852–862.
vention and intervention. As a result, what exists in American Arseneault, L., Walsh, E., Trzesniewski, K., Newcombe, R., Caspi, A.,
schools is a hodgepodge of efforts to address bullying, many of & Moffitt, T. E. (2006). Bullying victimization uniquely contributes to
adjustment problems in young children: A nationally representative
which are short term and ⁄ or ‘‘quick fixes’’ that are unlikely to
cohort study. Pediatrics, 118, 130–138.
have significant effects on the culture of bullying within schools. Bauer, N., Lozano, P., & Rivara, F. P. (2007). The effectiveness of the
What might be required to ensure that a greater percentage of Olweus Bullying Prevention Program in public middle schools: A con-
schools implement evidence-based bullying prevention programs trolled trial. Journal of Adolescent Health, 40, 266–274.
and practices? In our experience, the often-missing ingredients Beelman, A., Pfingsten, V., & Lösel, F. (1994). Effects of training social
are (a) adequate knowledge about the phenomenon, its short- competence in children: A meta-analysis of recent evaluation studies.
and long-term consequences, and effective prevention and Journal of Clinical Child Psychology, 23, 260–271.
intervention practices; (b) sufficient motivation to implement Black, S. A., & Jackson, E. (2007). Using bullying incident density to
comprehensive school-based efforts; and (c) the resources to do evaluate the Olweus Bullying Prevention Programme. School Psychol-
so. ogy International, 28, 623–638.
Buhs, E. S., Ladd, G. W., & Herald, S. L. (2006). Peer exclusion and
Although public information efforts (e.g., the National Bully-
victimization: Processes that mediate the relation between peer group
ing Prevention Campaign of the federal Health Resources and rejection and children’s classroom engagement and achievement?
Services Administration) and attention by the popular press Journal of Educational Psychology, 98, 1–13.
have certainly raised awareness about bullying, many educators Cohen, M. A. (1998). The monetary value of saving a high-risk youth.
and other professionals lack sufficient understanding of the phe- Journal of Quantitative Criminology, 14, 5–33.
nomenon of bullying and of best practices in bullying preven- Convention on the Rights of the Child. (1989). G.A. Res. 44 ⁄ 25, U.N.
tion and intervention. It is critical to infuse this information GAOR Supp. 49 at 165, U.N. Doc. A ⁄ 44 736.
into university curricula for future teachers and administrators Craig, W., Harel-Fisch, Y., Fogel-Grinvald, H., Dastaler, S., Hetland,
(as well as those preparing to enter health, mental health, and J., Simons-Morten, B., et al. (2009). A cross-national profile of bully-
law enforcement professions) and into continuing education ing and victimization among adolescents in 40 countries. International
Journal of Public Health, 54, S216–S224.
courses for professionals in the field.
Eisenberg, M. E., Neumark-Sztainer, D., & Perry, C. (2003). Peer
In our experience, most educators are motivated to act in the harassment, school connectedness, and academic achievement. Jour-
best interests of students, but much could be done to increase nal of School Health, 73, 311–316.
incentives (and decrease disincentives) for school personnel to Eslea, M., & Smith, P. K. (1998). The long-term effectiveness of anti-
implement comprehensive bullying prevention efforts, which bullying work in primary schools. Educational Research, 40, 203–218.
may require considerable effort on the part of administrators Espelage, D. L., & Swearer, S. M. (Eds.). (2004). Bullying in American
and staff. Such incentives may range from those that are local schools. Mahwah, NJ: Erlbaum.
and ⁄ or personal (e.g., public recognition of distinguished build- Flay, B. R., Biglan, A., Gonzalez Castro, F., Gottfredson, D., Kellam, S.,
ing-level or class-level efforts to address bullying) to those that Moscicki, E. K., et al. (2005). Standards of evidence: Criteria for effi-
are more broad based (e.g., passage of state laws that encourage cacy, effectiveness and dissemination. Prevention Science, 6, 151–175.
BULLYING IN SCHOOL 133

Fosse, G. K.. (2006). Mental health of psychiatric outpatients bullied in Olweus, D. (2002). Mobbing i skolen: Nye data om omfang og forandring
childhood. Doctoral thesis, Department of Neuroscience, Faculty of overtid. Unpublished manuscript, Research Center for Health Promo-
Medicine, Norwegian University of Science and Technology, Trond- tion, Universiteit i Bergen.
heim. Olweus, D. (2005). A useful evaluation design and effects of the Olweus
Hanewinkel, R. (2004). Prevention of bullying in German schools: Bullying Prevention Program. Psychology, Crime & Law, 11, 389–402.
An evaluation of an anti-bullying approach. In P. K. Smith, D. Olweus, D. (2007). The Olweus Bullying Questionnaire. Center City,
Pepler, & K. Rigby (Eds.), Bullying in schools: How successful can MN: Hazelden.
interventions be? (pp. 81–97). Cambridge, UK: Cambridge Univer- Olweus, D. (2010). Understanding and researching bullying: Some criti-
sity Press. cal issues. In S. R. Jimerson, S. M. Swearer, & D. L. Espelage (Eds.),
Hawker, D. S. J., & Boulton, M. J. (2000). Twenty years’ research on The handbook of school bullying: An international perspective (pp. 9–
peer victimization and psychosocial maladjustment: A meta-analytic 33). New York: Routledge.
review of cross-sectional studies. Journal of Child Psychology and Psy- Olweus, D., & Alsaker, F. D. (1991). Assessing change in a cohort longi-
chiatry and Allied Disciplines, 41, 441–455. tudinal study with hierarchical data. In D. Magnusson, L. R. Berg-
Juvonen, J., & Graham, S. (Eds.). (2001). Peer harassment in school. man, G. Rudinger, & B. Torestad (Eds.), Problems and methods in
New York: Guilford. longitudinal research (pp. 107–132). New York: Cambridge University
Kochenderfer, B. J., & Ladd, G. W. (1996). Peer victimization: Cause or Press.
consequence for school maladjustment? Child Development, 67, 1305– Olweus, D., & Kallestad, J. H. (in press). Olweus Bullying Prevention
1317. Program: Effects of classroom components at different grade levels.
Limber, S. P. (2004). Implementation of the Olweus Bullying Prevention In K. Osterman (Ed.), Indirect and direct aggression. New York: Peter
Program in American schools: Lessons learned in the field. In D. L. Lang.
Espelage & S. M. Swearer (Eds.), Bullying in American schools: A Olweus, D., & Limber, S. P. (2007). Olweus Bullying Prevention Pro-
social-ecological perspective on prevention and intervention (pp. 351– gram: Teacher guide. Center City, MN: Hazelden.
363). Mahwah, NJ: Erlbaum. Olweus, D., & Limber, S. P. (2010). The Olweus Bullying Prevention
Limber, S. P., Nation, M., Tracy, A. J., Melton, G. B., & Flerx, V. Program: Implementation and evaluation over two decades. In S. R.
(2004). Implementation of the Oweus Bullying Prevention Program in Jimerson, S. M. Swearer, & D. L. Espelage (Eds.), The handbook of
the Southeastern United States. In P. K. Smith, D. Pepler, & K. Rig- school bullying: An international perspective (pp. 377–402). New York:
by (Eds.), Bullying in schools: How successful can interventions be? Routledge.
(pp. 55–79). Cambridge, UK: Cambridge University Press. Olweus, D., Limber, S. P., Flerx, V., Mullin, N., Riese, J., & Snyder, M.
Melton, G. B., Limber, S. P., Cunningham, P., Osgood, D. W., Cham- (2007). Olweus Bullying Prevention Program: Schoolwide guide. Center
bers, J., Flerx, V., et al. (1998). Violence among rural youth. Final City, MN: Hazelden.
report. Washington, DC: U.S. Department of Justice, Office of Justice Olweus, D., Limber, S., & Mihalic, S. (1999). Blueprints for violence pre-
Programs, Office of Juvenile Justice and Delinquency Prevention. vention: Vol. 9. The Bullying Prevention Program. Boulder: Institute
Olweus, D. (1973). Hackkycklingar och översittare: Forskning om skol- of Behavioral Science, University of Colorado.
mobbning. Stockholm: Almqvist & Wiksell. Pagliocca, P. M., Limber, S. P., & Hashima, P. (2007). Evaluation report
Olweus, D. (1977). Aggression and peer acceptance in adolescent boys: for the Chula Vista Olweus Bullying Prevention Program. Final report
Two short-term longitudinal studies of ratings. Child Development, prepared for the Chula Vista, CA, Police Department.
48, 1301–1313. Pepler, D. J., Craig, W. M., O’Connell, P., Atlas, R., & Charach, A.
Olweus, D. (1978). Aggression in the schools: Bullies and whipping boys. (2004). Making a difference in bullying: Evaluation of a systemic
Washington, DC: Hemisphere. school-based programme in Canada. In P. K. Smith, D. Pepler, & K.
Olweus, D. (1986). Mobbning—vad vi vet och vad vi kan göra. Stock- Rigby (Eds.), Bullying in schools: How successful can interventions be?
holm: Liber. (pp. 125–139). Cambridge, UK: Cambridge University Press.
Olweus, D. (1991). Bully ⁄ victim problems among schoolchildren: Basic Pepler, D. J., Craig, W., Ziegler, S., & Charach, A. (1994). An evalua-
facts and effects of a school based intervention program. In D. J. Pe- tion of an anti-bullying intervention in Toronto schools. Canadian
pler & K. H. Rubin (Eds.), The development and treatment of child- Journal of Community Mental Health, 13, 95–110.
hood aggression (pp. 411–448). Hillsdale, NJ: Erlbaum. Rigby, K. (1996). Bullying in schools: And what to do about it. Brison,
Olweus, D. (1992). Mobbing i skolen: Hva vi vet ogh hva vi kan gjøre. PA: Jessica Kingsley.
Oslo, Norway: Universitetsforlaget ⁄ Gyldendals Akademiske. Schreier, A., Wolke, D., Thomas, K., Horwood, J., Hollis, C., Gunnell,
Olweus, D. (1993a). Bullying at school: What we know and what we can D., et al. (2009). Prospective study of peer victimization in childhood
do. Oxford, UK: Blackwell. and psychotic symptoms in a nonclinical population at age 12 years.
Olweus, D. (1993b). Victimization by peers: Antecedents and long-term Archives of General Psychiatry, 66, 527–536.
outcomes. In K. H. Rubin & J. H. Asendorf (Eds.), Social withdrawal, Scott, S., Knapp, M., Henderson, J., & Maughan, B. (2001). Financial
inhibition, and shyness (pp. 315–341). Hillsdale, NJ: Erlbaum. cost of social exclusion: Follow up study of antisocial children in
Olweus, D. (1996). The Revised Olweus Bully ⁄ Victim Questionnaire. Ber- adulthood. British Medical Journal, 323, 191–194.
gen, Norway: Research Center for Health Promotion, University of Smith, P. K., & Brain, P. (2000). Bullying in schools: Lessons from two
Bergen. decades of research. Aggressive Behavior, 26, 1–9.
Olweus, D. (1997). Bully ⁄ victim problems in school: Facts and interven- Smith, P. K., Morita, Y., Junger-Tas, J., Olweus, D., Catalano, R., &
tion. European Journal of Psychology of Education, 12, 495–510. Slee, P. (Eds.). (1999). The nature of school bullying: A cross-national
Olweus, D. (2001a). Peer harassment: A critical analysis and some perspective. London: Routledge.
important issues. In J. Juvonen & S. Graham (Eds.), Peer harassment Smith, P. K., Pepler, D., & Rigby, K. (Eds.). (2004a). Bullying in
in school (pp. 3–20). New York: Guilford. schools: How successful can interventions be? Cambridge, UK: Cam-
Olweus, D. (2001b). Olweus’ core program against bullying and antisocial bridge University Press.
behavior: A teacher handbook. Bergen, Norway: Research Center for Smith, P. K., & Sharp, S. (Eds.). (1994). School bullying: Insights and
Health Promotion (HEMIL Center), University of Bergen. perspectives. London: Routledge.
134 OLWEUS AND LIMBER

Smith, P. K., Sharp, S., Eslea, M., & Thompson, D. (2004). England: Stevens, V., Van Oost, P., & de Bourdeaudhuij, I. (2004). Interventions
The Sheffield project. In P. K. Smith, D. Pepler, & K. Rigby (Eds.), against bullying in Flemish schools: Programme development and
Bullying in schools: How successful can interventions be? (pp. 99–123). evaluation. In P. K. Smith, D. Pepler, & K. Rigby (Eds.), Bullying in
Cambridge, UK: Cambridge University Press. schools: How successful can interventions be? (pp. 141–165). New
Smith, P. K., Talamelli, L., Cowie, H., Naylor, P., & Chauhan, P. York: Cambridge University Press.
(2004). Profiles of non-victims, escaped victims, continuing victims Ttofi, M. M., & Farrington, D. P. (2009). What works in preventing
and new victims of school bullying. British Journal of Educational bullying: Effective elements of anti-bullying programmes. Journal of
Psychology, 74, 565–581. Aggression, Conflict and Peace Research, 1, 13–24.
Solberg, M., & Olweus, D. (2003). Prevalence estimation of school bul- Ttofi, M. M., Farrington, D. P., & Baldry, A. C. (2008). Effectiveness of
lying with the Olweus Bully ⁄ Victim Questionnaire. Aggressive Behav- programmes to reduce bullying. Stockholm: Swedish National Council
ior, 29, 239–268. for Crime Prevention.
Sourander, A., Jensen, P., Rönning, J. A., Elonheimo, H., Niemela, S., Universal Declaration of Human Rights. (1948). G. A. Res. 217A, U.N.
Helenius, H., et al. (2007). Childhood bullies and victims and their Doc. A ⁄ 810 at 71.
risk of criminality in late adolescence. Archives of Pediatrics and Ado- Vossekuil, B., Fein, R. A., Reddy, M., & Modzeleski, W. (2002). The
lescent Medicine, 161, 546–552. final report and findings of the Safe School Initiative: Implications for
Stassen Berger, K. (2007). Update on bullying at school: Science forgot- the prevention of school attacks in the U.S. Retrieved March 2, 2010,
ten? Developmental Review, 27, 90–126. from http://www.secretservice.gov/ntac/ssi_final_report.pdf.
Stevens, V., de Bourdeaudhuij, I., & Van Oost, P. (2000). Bullying in Whitney, I., Rivers, I., Smith, P., & Sharp, S. (1994). The Sheffield project:
Flemish schools: An evaluation of anti-bullying intervention in pri- Methodology and findings. In P. Smith & S. Sharp (Eds.), School bully-
mary and secondary schools. British Journal of Educational Psychol- ing: Insights and perspectives (pp. 20–56). London: Routledge.
ogy, 70, 195–210. j

You might also like