You are on page 1of 10

Learning and Individual Differences 61 (2018) 11–20

Contents lists available at ScienceDirect

Learning and Individual Differences


journal homepage: www.elsevier.com/locate/lindif

Reciprocal effects between self-concept of ability and performance: A T


longitudinal study of children with learning disabilities in inclusive versus
exclusive elementary education☆

Julia Gorgesa, , Phillip Neumannb, Elke Wilda, Daniela Stranghönera, &Birgit Lütje-Kloseb
a
Department of Psychology, Educational Psychology, Bielefeld University, Germany
b
Faculty of Educational Science, Inclusive Education, Bielefeld University, Germany

A R T I C L E I N F O A B S T R A C T

Keywords: Ample empirical research from regular school settings documents reciprocal effects between academic perfor-
Special educational needs mance and academic self-concept of ability (ASC), supporting what is known as a reciprocal effects model
Learning disability (REM). The present article investigates a REM in the domain of reading performance in a sample of elementary
Academic selfconcept of ability students with special educational needs in learning (SEN-L) who received special educational support in ex-
Reciprocal effects model
clusive versus inclusive settings (N = 446). In exclusive settings, SEN-L students attend special schools and are
Inclusive education
completely separated from regular students. By contrast, SEN-L students in inclusive settings attend regular
schools and are educated in classes with regular students. In both settings, SEN-L students are not graded and
taught based on individual learning goals, which may affect reciprocal effects between ASC and reading per-
formance. In addition, given that special education for SEN-L students relies heavily on individual reference
standards to evaluate performance, we tested individual performance growth of SEN-L students as a predictor of
ASC. Analyses of a longitudinal dataset across 3rd and 4th grade revealed some cross-lagged effects and an effect
of performance growth on ASC in exclusive settings in particular. The discussion focuses on the role of in-
dividualized instruction, grades, peer groups, and individual versus social reference standards for reciprocal
effects between ASC and performance as well as practical implications.

1. Introduction effect predicts a negative effect of peer-group performance—i.e., the


school or class average achievement—on his or her self-concept of
In educational psychology, students' academic self-concept (i.e., ability (Marsh, 1987; Marsh & Hau, 2003). Second, the internal/ex-
subjective perceptions) of ability is among the most researched theo- ternal-frame-of-reference model predicts that domain-specific achieve-
retical constructs (cf. Marsh, 2007). Due to the undeniable importance ment positively affects within domain self-concept but negatively af-
of academic self-concept of ability as a key predictor of academic per- fects cross-domain self-concepts (Marsh, 1986; Möller, Pohlmann,
formance (Wigfield, Eccles, Schiefele, Roeser, & Davis-Kean, 2007), a Köller, & Marsh, 2009). Third, the reciprocal effects model of causal
bulk of literature addresses self-concept development in general and the ordering (REM) predicts that performance affects subsequent self-con-
role of academic performance for self-concept development in parti- cept and vice versa within domains over time (cf., Marsh & Martin,
cular. The present study aims at contributing to this literature by pro- 2011).
viding empirical analyses of self-concept development in a hitherto Support for the REM of academic self-concept and performance
neglected group of students, that is, students with special educational comes from research on various cultures, age groups and educational
needs. systems (Marsh & Martin, 2011; Valentine, DuBois, & Cooper, 2004).
Three models of self-concept development stand out due to their Although the REM focuses on intra-individual processes, self-concept
extensive coverage by empirical studies. First, postulating social com- theory suggests that performance needs be evaluated against a social,
parison processes with a generalized other, the big-fish-little-pond temporal, or criterial standard to become informative (Marsh, 1986,


The present study was funded by a grant to Elke Wild, Birgit Lütje-Klose, and Malte Schwinger from the German Federal Ministry of Education and Research (support code:
01JC1101, support line: Equity of opportunities and participation [Chancengerechtigkeit und Teilhabe]). The sole responsibility for the article's contents lies with the authors. Parts of the
manuscript have been presented at the 5th conference of the Society for Empirical Educational Research [Gesellschaft für empirische Bildungsforschung] in Heidelberg, 15 March, 2017.

Corresponding author at: Department of Psychology, Educational Psychology, Bielefeld University, PO Box 100131, 33501 Bielefeld, Germany.
E-mail address: julia.gorges@uni-bielefeld.de (J. Gorges).

https://doi.org/10.1016/j.lindif.2017.11.005
Received 12 December 2016; Received in revised form 25 September 2017; Accepted 3 November 2017
1041-6080/ © 2017 Elsevier Inc. All rights reserved.
J. Gorges et al. Learning and Individual Differences 61 (2018) 11–20

1987). Hence, contextual factors relevant for comparison processes enhancement model primarily relies on intrapersonal processes,
such as available comparison targets within classrooms may affect whereas the skill-development model takes contextual characteristics of
intra-individual reciprocal effects between self-concept and perfor- students' school experiences into account (Valentine et al., 2004).
mance. When students in elementary school start to take standardized tests
This assumption has led us to investigate the REM within a specific as a class, receive grades on the same scale, and have a peer-group with
student population whose schooling systematically differs from their roughly the same level of ability to use as a social frame of reference
peers, and which has rarely been studied: students with special edu- (e.g., same-aged peers with a similar educational biography) they can
cational needs in learning (SEN-L). Because academic performance of easily compare their own performance to the performance of other
SEN-L students is substantially lower than the performance of their non- students. Such social comparisons are an important source of in-
SEN-L peers (Fuchs, Fuchs, Mathes, Lipsey, & Roberts, 2001; Kocaj, formation to develop their self-concepts (Marsh, 2007) and, therefore,
Kuhl, Kroth, Pant, & Stanat, 2014), special educational support is pro- domain-specific performance and self-concepts of ability become more
vided for these students in various forms. In Germany, SEN-L students closely related starting in primary school (cf., Dweck, 2002; Wigfield
can attend exclusive special or inclusive regular schools. The exclusive et al., 2007; see Rosenholtz & Simpson, 1984, for a detailed account of
setting means they attend schools in which teachers have specialized how classroom organization affects the formation of ability concep-
skills to support students' special educational needs and the whole tions).
student population consists of students with SEN-L. In inclusive set- Beyond social comparisons, students' self-concepts may be based on
tings, by contrast, SEN-L students are members of a regular classroom at temporal or intra-individual comparison processes (i.e., comparing
a regular school and receive part time special educational support one's current performance to one's previous performance), criterion
through special education teachers mostly during regular classes or in comparison processes (i.e., comparing one's performance to a given
small group settings; although the exact format differs between federal standard of excellence), or by drawing inferences from feedback given
states or even schools (cf., Werning & Lütje-Klose, 2016). Unlike regular by significant others (Möller & Trautwein, 2015). Supporting the re-
students, SEN-L students in elementary schools participating in this levance of such alternative frames of reference, parents' evaluations
study—in exclusive and inclusive settings alike—do not receive formal affect elementary students' SCAs beyond grades (Entwisle, Alexander,
grades but individualized reports on their development and are taught Pallas, & Cadigan, 1987; Gniewosz, 2010). Regarding intra-individual
according to individual learning goals. reference standards, Lüdtke et al.’s (2005) analyses of a large cross-
Using the case of Germany, the present study addresses three re- sectional dataset show that an individualized teacher frame-of-refer-
search questions. Our first question is whether empirical support for a ence—that is, teachers evaluating students' performance based on the
REM may be found among SEN-L students. Second, given the distinc- student's performance growth rather than social comparison-
tion between inclusive and exclusive settings, Germany's school system s—promotes a close association of a student's self-concept and perfor-
provides a suitable setting to examine the role of educational setting for mance within a specific domain.
processes underlying a REM. Hence, our second question is whether an Overall, various processes underlying the skill-development model
inclusive versus exclusive setting moderates reciprocal effects between and the self-enhancement model are spelled out in the literature. At
self-concept and performance. Finally, because of their individualized face value these two models specify that there are reciprocal causal
learning goals, SEN-L students may draw on an individual frame-of- effects between self-concept and performance over time. Factors af-
reference (i.e., their own performance growth) to evaluate their per- fecting the skill-development model in particular draw on contextual
formances (Lüdtke, Köller, Marsh, & Trautwein, 2005). Therefore, our features of students' schooling. Given distinctive features of SEN-L
third question is whether performance growth over time differentially students' school and educational contexts in Germany, our next step is
predicts self-concept of SEN-L students. Naturally, the former two to review and evaluate to what extent a REM may be conferrable to
questions lead to the idea that educational setting might also moderate inclusive and exclusive settings.
the predictive validity of performance growth.
1.2. Characteristics of SEN-L students and provision of special education
1.1. The reciprocal effects model in regular classrooms support

Ample research documents the close relation between academic Students with SEN-L represent the majority of students with special
self-concept of ability (SCA) and academic performance (for elementary educational needs in Germany (Bildungsberichterstattung,
education e.g., Guay, Marsh, & Boivin, 2003; Helmke & van Aken, Autorengruppe, 2014). However, SEN-L is not uniformly defined in
1995; Weidinger, Spinath, & Steinmayr, 2015; for secondary education Germany (Moser, 2012; see Fuchs et al., 2001, for a similar discussion
e.g., Marsh, Trautwein, Lüdtke, Köller, & Baumert, 2005; Marsh & in the US) and hardly comparable to the US-American definition (Löser
O'Mara, 2008; Retelsdorf, Köller, & Möller, 2014; for overviews see & Werning, 2011). International consensus is that the term SEN-L ty-
Marsh & Martin, 2011; Valentine et al., 2004). A meta-analysis by pically refers to students whose academic performance—particularly in
Valentine et al. (2004) reveals that REMs find strong support when the basic skills such as reading, writing and arithmetic—is one to two years
respective academic self-concept and academic performance refer to the behind those of their same-aged peers (Löser & Werning, 2011; Werning
same skills (i.e., a particular school subject), the performance measure & Lütje-Klose, 2016). Although some authors consider SEN-L to be a
has some relevance for the students (i.e., grades that determine edu- mild intellectual disability, a below average cognitive ability is no
cational progress), and students are informed about their performance constitutive element of diagnosing SEN-L. Other individual and con-
(i.e., grades or feedback communicated by teachers). textual risk factors leading to low academic performance are taken into
The self-concept-performance REM is a product of two models in- account when diagnosing SEN-L (Werning & Lütje-Klose, 2016). Iso-
itially developed and tested separately. On the one hand, the self-en- lated specific learning difficulties such as dyslexia or dyscalculia are not
hancement model posits that positive self-concepts promote students' recognized as SEN-L per se, but often accompany it.
motivation to engage in effortful behavior and experience themselves as The German school system provides two prototypical forms of
self-efficacious, which, in turn, leads to higher academic performance special educational support. Exclusive education via special schools for
(Green et al., 2012; Marsh, Byrne, & Yeung, 1999). On the other hand, SEN-L students only is available from first grade until the end of com-
the skill-development model posits that academic performance informs pulsory education. The basic idea of this type of school is that “students
students' self-concepts (Chapman & Tunmer, 1997; Liem, McInerney, & with similar special needs are taught in small groups by special edu-
Yeung, 2015; Poloczek, Karst, Praetorius, & Lipowsky, 2011; Retelsdorf cation teachers” (Löser & Werning, 2011, p. 91). Special education
et al., 2014; Skaalvik & Valås, 1999; Weidinger et al., 2015). The self- teachers are trained to use individual frame-of-reference to support

12
J. Gorges et al. Learning and Individual Differences 61 (2018) 11–20

students' performance growth. Hence, exclusive education is supposed SEN-L. Thus, SEN-L students may draw primarily on intra-individual
to offer better support and a protected environment for students with comparisons and use themselves as a benchmark to inform their aca-
SEN-L. Alternatively, inclusive education for SEN-L students as part of a demic self-concept (Rheinberg & Krug, 1999). Accordingly, students'
regular classroom at a regular school, in which teachers may emphasize individual performance growth should predict their self-concept rather
social comparisons underlying educational credentials (Carson, 2007; than a (specific) previous performance.
Fend, 2006), is available from grade 1 to grade 10. In inclusive settings, While SEN-L students in exclusive settings are taught exclusively by
SEN-L students are supposed to be better integrated with their peers special education teachers who are trained to use primarily individual
and to reach a higher performance level due to a more stimulating and frames-of-reference, those in inclusive settings tend to spend their time
demanding environment (Werning & Lütje-Klose, 2016). On average, in class with regular teachers who are supported by special education
three SEN-L students get integrated in classes of about 18 regular stu- teachers part time. Hence, students in inclusive settings may face—at
dents (FORSA, 2015). Typically, they share all classes with regular least vicarious—performance evaluations based on social reference
students but may have an additional special education teacher during norms. Therefore, they may be less inclined to rely on individual de-
scheduled classes and/or additional classes. Recent empirical studies velopments to evaluate their performance. Using social comparison,
suggest that low-achieving SEN-L students self-select in exclusive set- however, will likely result in consistently lower self-concept of students'
ting, whereas SEN-L students with higher competencies tend to attend in inclusive settings, even if their performance improves (e.g., Sauer,
inclusive schools (Kocaj et al., 2014; Wild et al., 2015). Ide, & Borchert, 2007; Tracey, Marsh, & Craven, 2003; see Lindsay,
In both inclusive and exclusive settings, SEN-L students are mostly 2007, for a review). Following this line of reasoning, the educational
taught and evaluated based on individual learning goals that are in- setting may moderate the effect of individual performance growth on
dependent of the general curriculum. Teachers are supposed to use an self-concept in exclusive settings in particular.
individual frame-of-reference when evaluating SEN-L students, re-
fraining from grading them unless they or their parents explicitly ask 1.4. The present study
for grades; and this is only possible from fourth grade onward.
To date, reciprocal effects between self-concepts and performance of
1.3. Factors that may affect reciprocal relations between self-concept and SEN-L students have scarcely been investigated, and the role of in-
performance clusive versus exclusive setting has not been addressed specifically.
Focusing on elementary school students, the present study addressed
Contextual factors of special educational support provision for SEN- reciprocal effects between self-concept and performance in the domain
L students in Germany may affect reciprocal effects between SEN-L of reading, which is the most basic skill for education and social par-
students' self-concept and performance. Without formal grades of their ticipation (OECD, 2010). The goal of the present study was threefold.
performance in elementary school it may be more difficult for SEN-L First, we investigated whether reciprocal effects between self-concept
students to engage in social comparisons. However, empirical studies and performance can be found in a sample of SEN-L students. We hy-
addressing the role of grades as opposed to verbal teacher feedback in pothesized that self-concept (performance) will predict subsequent
regular classrooms do not suggest systematic differences due to grading performance (self-concept). Second, we tested the potential moderating
practices (Lipowsky, Kastens, Lotz, & Faust, 2011; Wagner & Valtin, effect of the educational setting, that is, whether special educational
2003). Hence, self-concept and performance should reciprocally affect support was provided in an inclusive versus an exclusive setting. As self-
each other regardless of grading practices in the classroom. concept should affect performance due to intrapersonal processes (e.g.,
SEN-L students are taught based on their individual learning goals. striving to enhance one's self-image or affecting motivational media-
This may make evaluating one's performance more difficult because tors; Valentine et al., 2004), self-concept was hypothesized to predict
social comparison processes rely on the assumption of equalized subsequent performance in both settings. By contrast, assuming that
learning goals that are attained by students to varying extents. Hence, SEN-L students will find more appropriate comparison targets to eval-
individualized instruction—i.e., learning goals and lessons that are uate their reading performance and, thus, align their self-concept to
different between students—means that performance feedback may not their performance based on social comparisons with–in terms of per-
be comparable due to differences in task difficulty. To place their per- formance–similar peers in exclusive rather than in inclusive settings, we
formance in their peer group, students would have to assess whether hypothesized stronger effects of performance on students' self-concept
the learning goals that had to be attained were comparable prior to in exclusive than in inclusive settings. Third, assuming that contextual
comparing their performance. Consequently, students should engage in characteristics of special educational support bring intra-individual
social comparison processes only if tasks with comparable levels of comparisons to the fore, we examined the effect of individual perfor-
difficulty were assigned to several students. mance growth on students' self-concept at the end of primary school. An
It is not quite clear whether and how SEN-L students engage in increase in performance across the three measurement points was ex-
social comparison given individualized instruction. SEN-L students may pected to positively predict self-concept at the final measurement point
rely on teacher feedback, which could underlie a reciprocal causal or- (while controlling for previous self-concept). Educational setting was
dering (Wagner & Valtin, 2003), or their self-concept development may again tested as a potential moderator and we expected stronger effects
be separated from their performance. Assuming that teachers may try to in exclusive than in inclusive settings due to individual reference
boost SEN-L students' self-concepts by giving overly positive feedback, standards emphasized by special education teachers. Analyses were
teacher feedback may contribute to such separate developmental pro- based on a longitudinal dataset with three measurement points and
cesses. If students still engage in social comparison, the educational subject-specific assessments of self-concept and performance.
setting may act as a moderator because students may dispose of a
greater number of relevant social comparison targets, that is, compar- 2. Method
able peers, in exclusive educational settings (Möller, Streblow, &
Pohlmann, 2009). 2.1. Sample & Procedure
Without standardized evaluation criteria, SEN-L students may use
their individual performance growth to inform their self-concept. Data stems from a third-party funded research project that aimed at
Focusing on an individual frame-of-reference may help students to in- comparing SEN-L students' psychosocial and performance develop-
terpret their behavior and performance in a positive way. For example, ments in inclusive versus exclusive educational settings (Wild, Lütje-
Tabassam and Grainger (2003) found that an intervention of attribu- Klose, Schwinger, Gorges, & Neumann, 2017). The study was carried
tional retraining successfully increased self-concept for students with out in accordance with the recommendations of the German

13
J. Gorges et al. Learning and Individual Differences 61 (2018) 11–20

Psychological Association's guidelines for conducting research with Table 1


human subjects. Because the students participating in the study were Internal consistency and zero-order correlations of academic self-concept and perfor-
mance measures.
underage, written consent for their participation in the study had been
obtained from all parents prior to the time of data collection. Recruit- M SD α (2) (3) (4) (5) (6)
ment was based on a list of 3779 schools attended by children with
special educational needs in Germany's federal state of North-Rhine (1) SCA t1 3.17 0.89 0.87 0.55 0.47 0.36 0.34 0.31
(2) SCA t2 3.16 0.88 0.89 – 0.71 0.30 0.41 0.43
Westphalia. At t1, the researchers contacted 441 schools that had re-
(3) SCA t3 3.26 0.80 0.87 – 0.27 0.34 0.38
ported particularly high numbers of SEN-L student. For lack of na- (4) PERF t1 26.88 17.94 – – 0.90 0.86
tionwide standards the assessment, determination and labeling of stu- (5) PERF t2 38.13 21.47 – – 0.94
dents with SEN-L differs between federal states, administrative districts (6) PERF t3 48.43 23.00 – –
or even schools. Therefore, students in this study have been identified
Note. M = mean, SD = standard deviation, SCA = reading self-concept of ability,
based on the provision of SEN-L support as reported by the schools.
PERF = reading performance, significant correlation coefficients are printed in bold
At the time of the study, SEN-L could have been officially re- (p < 0.05).
cognized based on a non-standardized diagnostic procedure leading to
eligibility of additional resources from the ‘Land’ (i.e., the federal state), time period. Hence, the test captures students' literacy based on both
or it could have been recognized within a school leading to resource speed and power. The ELFE test has been validated using a sample of
allocation from the school's budget. A total of 271 schools actually had regular students and students with SEN with high internal consistency
SEN-L students in third grade in the school year 2012/13. Of these (0.92 < α < 0.97) across subtests. In our sample, the test-retest re-
schools, 45% agreed to participate in the research project. Next, the liability ranged between rtt = 0.74 und rtt = 0.92, which corresponds
parents of the respective children (N = 740) were contacted and in- to the test-retest reliability reported by Lenhard and Schneider (2006).
vited to participate in the study. The procedure to ask SEN-L students ELFE test scores correlate substantially with teachers' evaluations of
and their parents in our target schools to participate was repeated at t2 students reading performance (r > 0.71¸ Lenhard & Schneider, 2006).
and t3 to include students that were subsequently new to the school. Analyses were based on the sum of subtest raw scores at each mea-
Every family who participated at least in one measurement wave re- surement point.
ceived a 20-Euro voucher after the third measurement wave.
On three occasions from the beginning through middle of third
2.3. Statistical analyses
grade (t1: Oct. 2012 – March 2013) and fourth grade (t2: Sep. 2013 –
Jan. 2014) as well as at the end of fourth grade (t3: March 2014 – June
2.3.1. Handling of missing data
2014), participating students (N = 461) filled in a self-report ques-
The proportion of missing values on variables used in our analyses
tionnaire in a one-on-one session with the assistance of a trained in-
ranged between 13.4% at t1 and 7.6% at t2 for reading performance
vestigator and participated in a standardized reading test administered
and between 11% at t1 and 6.3% at t3 for reading SCA. We used
to groups of not more than four children. To take school into account as
multiple imputation (Schafer & Graham, 2002) based on the mice
a clustering variable, only children who did not change schools between
package (van Buuren & Groothuis-Oudshoorn, 2011) with m = 5 to
t1 and t2 (n = 13) or t2 and t3 (n = 2) remained in the final sample
impute missing values and pool imputed datasets.
(N = 446; 45% girls; age: M = 8.74; SD = 0.66; Min = 8, Max = 11 at
the beginning) The average interval between measurements was
M = 45.51 (SD = 6.39) weeks between t1 and t2, and M = 26.28 2.3.2. Measurement models and tests of measurement invariance
(SD = 4.25) weeks between t2 and t3. The questionnaire and the tests Following the recommendation by Marsh et al. (1999) we first es-
usually took place on two consecutive days, beginning with the ques- tablished measurement models for SCA. Using confirmatory factor
tionnaire on the first day. analyses (CFA), we specified multiple-group models with a latent
Of the participating children, 199 attended exclusive schools and variable indicating SCA at each measurement point. We accounted for
247 children attended inclusive, regular elementary schools. From the correlated uniqueness (Marsh et al., 1999) by specifying residual error
total of 49 exclusive schools, the sample contained between 1 and 14 correlations of parallel items across measurement points. We inspected
children from the same school (mode = 3). From a total of 110 in- the fit of our measurement models and whether factor loadings for all
clusive schools, the sample contained between 1 and 8 children from items were above 0.40 and significant (p < 0.05).
the same school (mode = 1). The exclusive subgroup had more boys To make certain that the measures to assess SCA are equivalent
than the inclusive subgroup (61.8% boys in exclusive settings and across groups and across measurement points we next tested weak
50.2% in inclusive settings). Students' cognitive ability was within the measurement invariance required for comparisons of variable inter-
average range (Stranghöner et al., 2017). There was no indication of relations (Meredith, 1993; Steenkamp & Baumgartner, 1998): Building
systematic dropout. on the baseline model, we specified a model that had factor loadings for
parallel items constrained to be equal across measurement points and
2.2. Measures compared model fit of these models. Weak measurement invariance
may be assumed as long as model fit does not decrease significantly due
Academic self-concept of ability in the domain of reading (SCA) was to imposing these equality restrictions. Measurement invariance across
assessed using three items developed by Schöne, Dickhäuser, Spinath, groups was tested as first step of the multiple-group structural equation
and Stiensmeier-Pelster (2002), which were adapted to be used for this modeling by constraining item loadings to be equal across groups (see
particular sample based on two pilot studies (e.g., “I think reading is below).
easy.”; Schwinger et al., 2015). Responses were coded using a 4-point
Likert-type scale (1 = “applies not at all”, 2 = “hardly applies”, 2.3.3. Reciprocal effects models for SEN-L students
3 = “applies somewhat”, 4 = “applies completely”). SCA measures Next, we turned to investigating the proposed REM. According to
showed good internal consistency (see Table 1). recommendations by Marsh et al. (1999), a good way to investigate
Reading performance was assessed using standardized test results reciprocal effects between performance and SCAs is to specify a full-
from the widely-used ELFE test for reading comprehension in grade 1 to forward model. In this model, performance and SCA predict all fol-
6 (Lenhard & Schneider, 2006). The ELFE comprises three subtests re- lowing assessments of performance and SCA, respectively (stability
presenting increasing literacy levels: Students taking the ELFE test have coefficients), as well as the respective other constructs (see Fig. 1). The
to identify written words, sentences, and paragraphs within a specific model accounted for correlated uniqueness of the SCA items and

14
J. Gorges et al. Learning and Individual Differences 61 (2018) 11–20

Fig. 1. Full-forward REM based on the full


sample of students with SEN-L.
Note. SCA = reading self-concept of ability,
PERF = reading performance, significant coeffi-
cients (p < 0.05) are printed in bold.

correlations between performance and SCA for each measurement while controlling for SCA at t1. After fitting the data from the full
point. We then fitted the data from the full sample to the full-forward sample, the moderating effect of the educational setting was tested
REM. Because variances of performance measures were considerably using multiple-group modeling as described above.
larger than for SCA measures due to scaling differences, we used z-
standardized performance scores. 2.3.6. Goodness of fit
All models were fit to the data using the robust Maximum
2.3.4. Reciprocal effects models with educational setting as moderator Likelihood Estimator (MLR) implemented in the lavaan package
To include educational setting as a dichotomous moderator, we 0.5–19.848 (Rosseel, 2012) in R 3.3.0 (R Core Team, 2015). To account
specified an unconstrained multiple-group SEM with inclusive versus for the complex data structure, we adjusted standard errors using la-
exclusive education as the grouping variable (Model A). We established vaan.survey (Oberski, 2014) with school specified as clustering vari-
weak measurement invariance (Meredith, 1993; Steenkamp & able. We used several indicators to assess goodness of fit for the models
Baumgartner, 1998) by constraining factor loadings (Model B), and tested in this study: The comparative fit index (CFI), the root-mean-
then determined whether the groups significantly differ by additionally square error of approximation (RMSEA), and the standardized root
constraining regression paths to be equal across groups (Model C). At mean square residual (SRMR) (Hu & Bentler, 1999; Schermelleh-Engel,
each step, we compared model fit to detect significant changes. A sig- Moosbrugger, & Müller, 2003). The CFI ranges between 0 and 1 with
nificant change in model fit of Model B compared to Model C would values > 0.95 indicating good and > 0.90 indicating acceptable model
support the hypothesized moderation by educational setting. fit, respectively. Similar to the CFI, values > 0.95 indicate good fit and
values > 0.90 indicate acceptable fit. Regarding the RMSEA, va-
2.3.5. Latent growth curve modeling with educational setting as moderator lues < 0.08 indicate acceptable fit and values < 0.05 indicate good fit.
Latent growth curve modeling is a specific application of SEM to The SRMR ranges between 0 and 1 with values < 0.08 indicating a
evaluate developmental trends over time (for an overview see Preacher, good fit. To identify significant differences in model fit we relied cutoff
Wichmann, MacCallum, & Briggs, 2008). This method is based on a criteria suggested by Chen (2007) and Cheung and Rensvold (2002):
regression-type curve for each participant across all measurement time Model fit can be considered equally fitting when the change in CFI
points that is described by two latent factors indicating the intercept is < 0.01 and the change in RMSEA is < 0.015.
(i.e., the starting point of the curve) and the slope (i.e., the increase or
decrease over time). The factor loadings of the intercepts are fixed to 1 3. Results
at each measurement point. Factor loadings of the latent slope factor
are set to 0 at t1, to 1 at t2 (10 months after t1), and to 1.7 at t3 3.1. Descriptive statistics and correlations
(7 months after t2). Thus, factor loadings were set to represent ap-
proximately linear changes. To investigate whether changes in perfor- Descriptive statistics and zero-order correlations for the full sample
mance—as opposed to the status quo of performance or the latest are shown in Table 1. As expected, SCA and performance showed sig-
available performance—affect SCA we used latent growth curve mod- nificant concurrent correlations on each measurement occasion. Table 2
eling to evaluate increase or decrease in student performance from t1 to depicts means and standard deviations for SEN-L students in each set-
t3 and then used this information (i.e., the slope) to predict SCA at t3 ting. Apparently, SEN-L students in both setting improved their reading

15
J. Gorges et al. Learning and Individual Differences 61 (2018) 11–20

Table 2
Descriptive statistics and bivariate correlations for SEN-L students in exclusive versus inclusive settings.

Exclusive setting Inclusive setting

M SD (2) (3) (4) (5) (6) M SD (2) (3) (4) (5) (6)

(1) SCA t1 3.07 0.96 0.539 0.482 0.324 0.320 0.329 3.25 0.84 0.571 0.450 0.393 0.364 0.330
(2) SCA t2 3.14 0.97 0.713 0.342 0.534 0.556 3.18 0.80 0.711 0.339 0.434 0.399
(3) SCA t3 3.24 0.90 0.316 0.458 0.509 3.28 0.72 0.265 0.315 0.341
(4) PERF t1 16.17 14.06 0.826 0.771 34.22 16.48 0.879 0.846
(5) PERF t2 24.88 17.17 0.930 48.10 18.86 0.918
(6) PERF t3 36.19 20.10 57.93 20.42

Note. SCA = reading self-concept of ability, PERF = reading performance, M = Mean, SD = Standard Deviation.

performance over time, whereas the SCA seemed to be rather stable (see p < 0.05), and path coefficients were consistently larger in the ex-
Stranghöner et al., 2017, for a detailed analyses of performance dif- clusive setting. Some other path coefficients also ranged around
ferences across time and educational setting). As may be expected based β = 0.10 or more but did not reach significance. Overall, however,
on previous studies, reading performance of students with SEN-L in these findings did not establish significant differences of the structural
exclusive settings appeared to be lower. model across groups, which can be seen from comparing the model with
factor loadings constrained to be equal across groups to the model with
3.2. Measurement models and measurement invariance factor loadings and regression paths constrained to be equal across
groups (Model B and Model C in Table 3).
The multiple-group CFA for self-concept showed significant factor
loadings (all loadings > 0.60) for each item (p < 0.05). Factor-corre- 3.5. Latent growth curve analyses and educational setting as moderator
lations of all models were significant (p < 0.05) and ranged between
r = 0.52 and r = 0.79. Based on the full sample of SEN-L students, a latent growth curve
Model fit for the three-factor model accounting for correlated un- model fitted the data well (χ2(28) = 38.066; p = 0.10; CFI = 0.997;
iqueness was good (χ2 = 23.826; df = 15; p = 0.068; CFI = 0.995; RMSEA = 0.030 [90%-CI: 0.000–0.052]; SRMR = 0.047). SCA at t3
RMSEA = 0.042 [90%-CI: 0.000–0.068]; SRMR = 0.017). Correlated was significantly predicted by SCA at t1 (β = 0.546, p < 0.05) and
uniqueness coefficients were positive and significant for item 1 between performance growth from t1 to t3 (β = 0.343, p < 0.05). Results from
t1 and t3, and item 2 and item 3 between t2 and t3. The remaining multiple-group latent growth curve modeling showed good model fit
correlated uniqueness coefficients were both positive and negative, but and no significant change in model fit with weak measurement in-
non-significant. Model fit did not change significantly when factor variance imposed (see Table 3). Students' past performance growth—-
loadings were fixed across measurement points (χ2 = 27.929; df = 19; that is, the slope of reading performance across the three measurement
p = 0.085; CFI = 0.995; ΔCFI = 0.000; RMSEA = 0.037 [90%-CI: points—significantly predicted their SCA at t3 in exclusive settings
0.000–0.064]; ΔRMSEA = 0.005; SRMR = 0.024) supporting the as- (β = 0.546, p < 0.05) but not in inclusive setting (β = 0.316,
sumption of weak measurement invariance. p = 0.065) beyond SCA at t1 (exclusive: β = 0.511, p < 0.05; in-
clusive: β = 0.576, p < 0.05). Again, constraining regressions to be
3.3. Reciprocal effects model (REM) equal did not result in a significant change of model fit (see Table 3,
Model 2 versus Model 3).
The first goal of the present study was to test reciprocal effects
between SCA and performance over time for students with SEN-L. 4. Discussion
Fitting the full-forward REM to the full sample of students with SEN-L
yielded good model fit (χ2(33) = 44.552, p = 0.086; CFI = 0.997; In the present study, reciprocal effects between academic self-con-
RMSEA = 0.28 [90%-CI: 0.000–0.051]; SRMR = 0.020). Path coeffi- cept of ability and performance in the domain of reading were in-
cients and correlations between SCA and performance for each mea- vestigated in a sample of SEN-L elementary students; including tests for
surement point are shown in Fig. 1. Stability coefficients for both SCA a moderating impact of an inclusive versus exclusive educational set-
and performance were high and significant (SCA: β > 0.561; perfor- ting and of individual performance growth as a predictor of self-concept
mance: β > 0.845); correlations between SCA and performance on of ability. Results documented cross-lagged effects in terms of perfor-
each measurement occasion were moderate and significant mance in third grade predicting self-concept of ability in early fourth
(0.221 < r < 0.388). Regarding the cross-lagged paths that are at the grade, and for reading self-concept of ability in early fourth grade
heart of the REM, performance at t1 predicted SCA at t2 (β = 0.102), predicting performance at the end of fourth grade. Testing educational
and SCA at t2 predicted performance at t3 (β = 0.062). setting as a moderator did not reveal differential effects of exclusive
versus inclusive school setting but suggested that the abovementioned
3.4. Reciprocal effects model with educational setting as moderator cross-lagged effects have been driven primarily by students in exclusive
settings. Results from latent growth curve models showed that in-
Considering exclusive versus inclusive educational setting as a dividual performance growth (i.e., the slope of the curve) significantly
moderator, we first compared an unconstrained model with a model predicted self-concept of ability in the full sample, which again seemed
that had factor loadings constrained to be equal across groups (i.e., to be driven by students in exclusive educational settings although the
inclusive versus exclusive setting) to test the assumption of weak structural model have been invariant.
measurement invariance. As can be seen from the results presented in
Table 4, weak measurement invariance may be assumed. Again, only 4.1. The role of individualized instruction and (no) grading
few significant cross-lagged effects reached significance (see Fig. 2).
Nevertheless, in line with our hypothesis, significant cross-lagged ef- Despite empirical evidence of a REM for regular students from first
fects showed in the exclusive setting: t1 performance predicted t2 SCA grade onwards even without grades (Helmke & van Aken, 1995;
(β = 0.172; p < 0.05), t2 SCA predicted t3 performance (β = 0.092; Wagner & Valtin, 2003), our results indicate that a REM may not

16
J. Gorges et al. Learning and Individual Differences 61 (2018) 11–20

Fig. 2. Full-forward REM, coefficients for both


settings (exclusive/inclusive) with weak mea-
surement invariance imposed.
Note. SCA = reading self-concept of ability,
PERF = reading performance, significant coeffi-
cients (p < 0.05) are printed in bold.

Table 3
Model fit for multiple-group structural equation models and latent growth curve models.

χ2 df p CFI ΔCFI RMSEA [90%-CI] ΔRMSEA SRMR

Structural equation models


Model A 74.084 66 0.231 0.998 0.025 [0.000–0.050] 0.022
Model B 81.108 72 0.216 0.997 − 0.001 0.025 [0.000–0.049] + 0.000 0.028
Model C 90.919 84 0.284 0.998 + 0.000 0.020 [0.000–0.045] − 0.005 0.036

Latent growth curve models


Model 1 68.487 56 0.122 0.996 0.033 [0.000–0.057] 0.044
Model 2 73.365 60 0.115 0.995 − 0.001 0.033 [0.000–0.056] + 0.000 0.045
Model 3 73.673 62 0.147 0.996 + 0.001 0.030 [0.000–0.054] − 0.003 0.045

Note. Model A: full-forward model with correlated uniqueness, unconstrained across groups; Model B: Model A with factor loadings of academic self-concept measures constrained to be
equal across groups; Model C: Model B with all regression paths constrained to be equal across groups; Model 1: latent growth curve model with previous self-concept and performance
growth predicting self-concept at t3, unconstrained across groups; Model 2: Model 1 with factor loadings of academic self-concept measures constrained to be equal across groups; Model
3: Model 1 with both regression paths constrained to be equal across groups; for further description see text.

generalize to students with SEN-L in inclusive settings in particular. exclusive versus inclusive) may not. Consequently, future studies need
Given that we did find cross-lagged effects for SEN-L students in ex- to assess how teachers teach in the classroom to take these differential
clusive setting, alignment of self-concept and performance appears to procedural variables into account when investigating student develop-
rely more on teacher feedback and on peers than on grading practices ment.
or individualized learning goals, which are probably consistent in both With individual learning goals, teachers' abilities to adequately
inclusive and exclusive setting. evaluate individual learning progress—of low-achieving students in
In addition, using individual learning goals as a framework for particular—appears to be an important factor for students' self-concept
teaching is specific to special education in both inclusive and exclusive development. Teachers' abilities to set individual learning goals in
settings. To date, it is unclear how this teaching approach may affect student's zones of proximal development (Hedegaard, 2005) and to
students' self-concept development. In fact, little is known about how raise students' awareness with respect to their performance growth
teachers implement individual learning goals in their classrooms. With might be the most important form of support in their learning progress
respect to self-concept development, for example, setting an individual and self-concept development. Given that special education teachers
learning goal for each and every students as opposed to setting the same are specifically trained for such tasks, further research on regular tea-
individual learning goal for pairs or small groups of students with si- chers' abilities to use information on student performance for feedback
milar performance may have differential effects because sharing a and support seems desirable. However, given that we did not find
learning goal probably facilitates social comparison processes. Hence, systematic differences between exclusive and inclusive educational
how teachers set learning goals for students may act as a moderator in settings, the intensity of special education support (performed by spe-
self-concept development, whereas the educational setting (i.e., cial education teachers) may not be as relevant as one may think.

17
J. Gorges et al. Learning and Individual Differences 61 (2018) 11–20

On the one hand, decoupling self-concept of performance may be mostly used full-forward structural equation models as REMs, the im-
beneficial by protecting SEN-L students from negative perceptions of portance of individual performance growth may not be limited to stu-
their own ability. On the other hand, however, decoupling self-concept dents with SEN-L (see Weidinger et al., 2015). Thus, future studies
of performance precludes an at least approximately realistic self-eva- applying latent growth curve modeling to regular student samples are
luation, which is important for future achievement-related choices necessary to learn about the role of individual performance growth for
(Wigfield & Eccles, 2000). Perhaps SEN-L students in inclusive settings self-concept development across different student groups, older stu-
will show reciprocal effects only later in their educational biography, or dents and students without disabilities in particular.
reciprocal effects depend on some other attribute of teaching and/or
performance feedback such as its frequency, quality or wording to take 4.4. Practical implications
effect. Overall, key questions to address in further research comprise
the role of grading, verbal teacher feedback and other potential influ- According to the ability formation theory put forward by Rosenholtz
encing factors in inclusive classes for students' self-concepts and per- and Simpson (1984), contextual factors in school are key determinants
formance developments. of the development of ability conceptions. More specifically, a uni-
dimensional classroom organization in which all students work on the
4.2. The role of social comparison targets same tasks, are evaluated publically on the same standard, and grouped
according to ability should foster the development of highly differ-
Although our results do not support concluding systematic differ- entiated patterns of ability conceptions (i.e., distinctions into low-,
ences of the REM as a function of educational setting, evidence from medium- and high-achieving students). By contrast, classroom organi-
regular classrooms (Huguet et al., 2009) suggest that having seemingly zations that enable selective social comparisons (e.g., comparing effort
similar students in a class—who, in our case, may be fellow SEN-L rather than test performance) and are based on grouping students in-
students—is relevant for whether or not social comparison processes dependent of their abilities leads to more students with moderately
take place. Hence, the availability of reasonable comparison targets positive ability conceptions and less differentiation. The principle of
may depend on the educational setting after all. In addition, sharing individual learning goals focuses on establishing such a multi-
individual learning goals may enable social comparison, or students dimensional context in which every student may excel at something,
may use teacher feedback—that is, compare teacher feedback so- and this should be beneficial for SEN-L (and all other) students in any
cially—regardless of the performance underlying the teacher's evalua- type of education.
tion. Future studies addressing performance and self-concept of full Teacher feedback is presumably an important source of information
classrooms (i.e., collecting data from all the children in a class) could for SEN-L students to develop their self-concepts of ability. However,
help answer these questions. In addition, assessing comparison pro- when regular teachers meet new SEN-L students, they may have little
cesses closer to the moment they actually occur appears to be an in- experience with performance levels common to SEN-L students as well
teresting avenue for future research on how students (in any setting) as no individual reference for these students. Hence, they likely face
choose comparison targets. difficulty giving adequate feedback to these students. In such cases, it
Drawing on effect sizes rather than statistical significance, results may be helpful to receive information on the students' previous per-
reveal path coefficients that may well be significant when using a larger formances (e.g., in their former classes or schools) or to get advice from
sample for SEN-L students in exclusive settings in particular. Hence, SEN-L teachers. This would be in line with the strong evidence of the
SEN-L students in exclusive settings may align their self-concept and importance of interdisciplinary collaboration between special educators
performance after all, thus supporting the hypothesis regarding the and regular teachers in inclusive settings (Friend, Cook, Hurley-
relevance of social comparison targets. In light of our findings, in- Chamberlain, & Shamberger, 2010). The downside of this information
vestigations of SEN-L students' self-concept development using larger transfer is, however, that potentially unfounded or biased negative
samples from exclusive and inclusive settings alike are needed to shed evaluations may be transferred as well.
light onto the relevance of reciprocal effects between self-concept and
performance. 4.5. Limitations and outlook

4.3. The role of individual reference standards for developing ability Our study was based on the assessment of SCA and performance on
conceptions three occasions. Thus, it meets requirements to apply a REM as outlined
by Marsh et al. (1999). Measures to assess academic self-concepts of
Individual reference standards in evaluating one's own performance ability have been adapted and pretested twice. Data collection was
(Lüdtke et al., 2005) appear to be used in exclusive settings in parti- conducted by student assistants on a one-to-one basis to ensure valid
cular, which is in line with our assumption regarding special education data. Despite these efforts to generate informative REM tests some
teacher training. Because using an individual reference standard is not limitations exist. In our study, the period between measurement waves
standardized, this strategy offers room for substantial variation. For was longer between t1 and t2 (10 months) than between t2 and t3
example, the time period considered for judging improvement may be (7 months). Furthermore, the transition from third grade to fourth
chosen by the individual or the teacher or in this case, the researchers. grade was between t1 and t2 introducing a potential confounding
Similarly, teachers may help to evaluate whether a particular perfor- context effect; however, teachers and peers typically do not change
mance gain meets general expectations or whether it is above or below between third and fourth grade, and these are the key components of
what can typically be expected of a student with similar prerequisites. context.
Such variation may also be exploited to give SEN-L students the most Our sample of SEN-L students in exclusive and inclusive education
positive feedback possible to boost their self-concepts. At this point, although broad, was not representative of all of Germany and not as
there is too little empirical evidence on the interrelation of individual, large as in some previous research on the REM (e.g., Guay et al., 2003;
social and criterion comparisons provided by teachers and used by Marsh et al., 2005). It was, however, quite large compared to previous
students. Hence, future studies should take the reference standard used studies focusing on SEN-L students. Given the prevalence of SEN-L
by students and teachers into account to estimate their differential in- students, which is about 2.64% of the student population in Germany,
fluence on self-concept of ability. of which one third attends inclusive schools (Klemm, 2015), recruiting
In light of the present findings, individual performance growth of a sample comparable in size to sample sizes of regular student REM
SEN-L students appears to be an important source of information for studies is quite challenging. In previous studies, only Möller et al.
their self-concept development. Further, given that previous research (2009) report results based on a sizable sample of 270 SEN-L students,

18
J. Gorges et al. Learning and Individual Differences 61 (2018) 11–20

which were recruited from exclusive schools only. Hence, although our develop separately in inclusive setting across the 3rd and 4th year in
study may have failed to detect significant differences due to limitations elementary school. These findings may be explained by students pur-
in sample size, it nevertheless adds to the scarce literature on SEN-L suing individualized learning goals, teachers using individual reference
students' self-concept development based on a sufficient sample size to standards to evaluate student performance, and differences in class-
use sophisticated methodology. room composition. In the light of the current modification of segregated
Results may be biased by the substantial difference in the perfor- school systems into inclusive school systems, more research is needed to
mance levels of children in inclusive versus exclusive settings (also see address motivational and competence development under less-stan-
Stranghöner et al., 2017). However, tests of measurement invariance dardized conditions.
indicate that children in both settings interpret the items used to assess
self-concept in a comparable way. Similarly, a recent study by Heine References
et al. (subm.) has demonstrated comparability of a standardized test
assessing cognitive ability in both settings. In addition, potential effects Bildungsberichterstattung, Autorengruppe (2014). Nationaler Bildungsbericht 2014.
[National educational report 2014.]. Bielefeld: Bertelsmann.
of the weaker reading performance of SEN-L students in exclusive set-
van Buuren, S., & Groothuis-Oudshoorn, K. (2011). Mice: Multivariate imputation by
tings would primarily be associated with weaker reciprocal effects be- chained equations. R. Journal of Statistical Software, 45(3), 1–67. Retrieved from
tween self-concept and performance due to a lack of self-reflection. Our http://www.jstatsoft.org/v45/i03/.
Carson, J. (2007). The measure of merit: Talents, intelligence, and inequality in the French and
results show that reciprocal effects are stronger rather than weaker in American republics, 1750–1940. Princeton, NJ: Princeton University Press.
exclusive settings. Therefore, we conclude that the performance dif- Chapman, J. W., & Tunmer, W. E. (1997). A longitudinal study of beginning reading
ference between SEN-L students from both settings does not affect re- performance and reading self-concept. British Journal of Educational Psychology, 67(3),
279–291. http://dx.doi.org/10.1111/j.2044-8279.1997.tb01244.x.
ciprocal effects between self-concept and performance. Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement in-
Self-concept development has mainly been conceptualized as a variance. Structural Equation Modeling, 14(3), 464–504. http://dx.doi.org/10.1080/
10705510701301834.
function of in-class (or in-school) processes (Marsh, 2007). Thus, an Cheung, G. W., & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing
objective in-survey test may not be sensitive to detect in-class measurement invariance. Structural Equation Modeling, 9(2), 233–255. http://dx.doi.
achievement processes that undergird self-concept development. Ac- org/10.1207/S15328007SEM0902_5.
Dweck, C. S. (2002). The development of ability conceptions. In A. Wigfield, & J. Eccles
cordingly, standardized tests associate with weaker reciprocal effects (Eds.). Development of achievement motivation (pp. 57–88). San Diego, CA: Academic
compared to teacher ratings or grades, which are more relevant to and Press.
transparent for students (Valentine et al., 2004). Because the students in Entwisle, D. R., Alexander, K. L., Pallas, A. M., & Cadigan, D. (1987). The emergent
academic self-image of first graders: Its response to social structure. Child
our sample did not receive grades, however, grades were not available Development, 58(5), 1190–1206. http://dx.doi.org/10.2307/1130614.
as indicators of performance. In addition, as we tested a basic skill, test Fend, H. (2006). Neue Theorie der Schule. Einführung in das Verstehen von Bildungssystemen
[New theory of school. An introduction to understanding educational systems].
scores should be reasonably related to individual learning goals and Wiesbaden: VS.
performance feedback from teachers (Lenhard & Schneider, 2006). FORSA (2015). Inklusion an Schulen aus Sicht der Lehrerinnen und Lehrer – Meinungen,
Young children typically show weaker reciprocal effects (Valentine Einstellungen und Erfahrungen Ergebnisse einer repräsentativen Lehrerbefragung.
[Inclusive education from the perspective of teachers – opinions, attitudes and ex-
et al., 2004). Students in our sample were relatively young and—con- perience. Results from a representative survey.]. Retrieved from http://www.vbe-
sidering their SEN-L—may not reflect about their performance as much berlin.de/files/Inklusion%20Ergebnisse%20-%20Bund.pdf.
Friend, M., Cook, L., Hurley-Chamberlain, D., & Shamberger, C. (2010). Co-teaching: An
as regular students. Hence, one could argue that their self-concepts of
illustration of the complexity of collaboration in special education. Journal of
ability are less aligned to their performance because these students Educational and Psychological Consultation, 20(1), 9–27. http://dx.doi.org/10.1080/
focus less on evaluating their performance against one reference stan- 10474410903535380.
Fuchs, D., Fuchs, L. S., Mathes, P. G., Lipsey, M. W., & Roberts, P. H. (2001). Is "learning
dard or the other. However, other researchers document reciprocal disabilities" just a fancy term for low achievement? A meta-analysis of reading dif-
effects between self-concepts and performance for students as early as ferences between low achievers with and without the label. Paper presented at the
first grade, which suggests that even children with a competence de- Learning Disabilities Summit: Building a Foundation for the Future (Washington, DC,
August 27–28, 2001). Retrieved from http://files.eric.ed.gov/fulltext/ED459544.pdf.
velopment lower than that of our target third grade children (due to the Gniewosz, B. (2010). Die Konstruktion des akademischen Selbstkonzeptes. Eltern und
age difference) are able to draw inferences from their performance to Zensuren als Informationsquellen [the construction of academic self-concept. Parents
and grades as sources of information]. Zeitschrift für Entwicklungspsychologie und
shape their SCAs. Pädagogische Psychologie, 42(3), 133–142. http://dx.doi.org/10.1026/0049-8637/
Although the goal of our study was to shed light on the role of social a000014.
comparison processes, these were not directly measured or observed. Green, J., Liem, G. A. D., Martin, A. J., Colmar, S., Marsh, H. W., & McInerney, D. (2012).
Academic motivation, self-concept, engagement, and performance in high school:
Study designs that are close to the core processes under investigation, Key processes from a longitudinal perspective. Journal of Adolescence, 35(5),
for example, by using observations, face-to-face interviews or the day 1111–1122. http://dx.doi.org/10.1016/j.adolescence.2012.02.016.
reconstruction method (Kahneman, Krueger, Schkade, Schwarz, & Guay, F., Marsh, H. W., & Boivin, M. (2003). Academic self-concept and academic per-
formance: Developmental perspectives on their causal ordering. Journal of
Stone, 2004), may give a more detailed account of what happens in Educational Psychology, 95(1), 124–136. http://dx.doi.org/10.1037/0022-0663.95.1.
exclusive and inclusive classrooms with respect to academic self-con- 124.
Hedegaard, M. (2005). The zone of proximal development as basis for instruction. In H.
cept development. Daniels (Ed.). An introduction to Vygotsky (pp. 227–252). London: Routeledge.
Finally, our study was limited to SEN-L students of a specific age Heine, J.-H., Gebhardt, M., Schwab, S., Neumann, P., Gorges, J., & Wild, E. (subm.).
range and to reading performance. Future studies should address stu- Testing Psychometric Properties of the CFT 1‑R for Students with Special Educational
Needs. Manuscript submitted for publication.
dents with other disabilities in various educational settings, at various Helmke, A., & van Aken, M. A. (1995). The causal ordering of academic achievement and
ages and with respect to mathematical performance as well to examine self-concept of ability during elementary school: A longitudinal study. Journal of
Educational Psychology, 87(4), 624–637. http://dx.doi.org/10.1037/0022-0663.87.4.
the generalizability of the results presented here. Particular attention
624.
should be paid to analyzing the effect of contextual factors and the Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure
mechanisms potentially underlying or replacing the skill-development analysis: Conventional criteria versus new alternatives. Structural Equation Modeling,
6(1), 1–55. http://dx.doi.org/10.1080/10705519909540118.
and the self-enhancement model in inclusive settings. Huguet, P., Dumas, F., Marsh, H., Régner, I., Wheeler, L., Suls, J., ... Nezlek, J. (2009).
Clarifying the role of social comparison in the big-fish-little-pond effect (BFLPE): An
4.6. Conclusion integrative study. Journal of Personality and Social Psychology, 97(1), 156–170. http://
dx.doi.org/10.1037/a0015558.
Kahneman, D., Krueger, A. B., Schkade, D. A., Schwarz, N., & Stone, A. A. (2004). A
The present study is among the first comprehensive investigations of survey method for characterizing daily life experience: The day reconstruction
method. Science, 306(5702), 1776–1780. http://dx.doi.org/10.1126/science.
self-concept development in children with SEN-L using a longitudinal 1103572.
dataset comparing prototypes of special education support. Results Klemm, K. (2015). Inklusion in Deutschland. Daten und Fakten [Inclusive education in
suggest that self-concept development follows theoretical assumptions Germany. Facts and figures]. Gütersloh: Bertelsmann Stiftung.
Kocaj, A., Kuhl, P., Kroth, A. J., Pant, H. A., & Stanat, P. (2014). Wo lernen Kinder mit
in exclusive settings, whereas self-concept and performance appear to

19
J. Gorges et al. Learning and Individual Differences 61 (2018) 11–20

sonderpädagogischem Förderbedarf besser? Ein Vergleich schulischer Kompetenzen concept–testing the reciprocal effects model. Learning and Instruction, 29, 21–30.
zwischen Regel- und Förderschulen in der Primarstufe [Where do students with http://dx.doi.org/10.1016/j.learninstruc.2013.07.004.
special educational needs learn better? A comparison of achievement between reg- Rheinberg, F., & Krug, S. (1999). Motivationsförderung im Schulalltag [Supporting motivation
ular primary schools and special schools]. Kölner Zeitschrift für Soziologie und at school] (2., überarbeitete und erweiterte Auflage). Göttingen [u.a.]: Hogrefe.
Sozialpsychologie, 66, 165–191. http://dx.doi.org/10.1007/s11577-014-0253-x. Rosenholtz, S. J., & Simpson, C. (1984). The formation of ability conceptions:
Lenhard, W., & Schneider, W. (2006). Leseverständnistest für Erst-Sechstklässler (ELFE 1–6). Developmental trend or social construction? Review of Educational Research, 54(1),
Göttingen: Hogrefe. 31–63. http://dx.doi.org/10.3102/00346543054001031.
Liem, G. A. D., McInerney, D. M., & Yeung, A. S. (2015). Academic self-concepts in ability Rosseel, Y. (2012). Lavaan: An R package for structural equation modeling. Journal of
streams: Considering domain specificity and same-stream peers. The Journal of Statistical Software, 48(2), 1–36. Retrieved from http://www.jstatsoft.org/v48/i02/.
Experimental Education, 83(1), 83–109. http://dx.doi.org/10.1080/00220973.2013. Sauer, S., Ide, S., & Borchert, J. (2007). Zum Selbstkonzept von Schülerinnen und
876227. Schülern an Förderschulen und in integrativer Beschulung: Eine
Lindsay, G. (2007). Educational psychology and the effectiveness of inclusive education/ Vergleichsuntersuchung [on the self-concept of students at special schools versus in
mainstreaming. British Journal of Educational Psychology, 77(1), 1–24. http://dx.doi. integrative schools: A comparative analysis]. Heilpädagogische Forschung, 33(3),
org/10.1348/000709906X156881. 135–142. Retrieved from http://www.pedocs.de/frontdoor.php?source_opus=8786.
Lipowsky, F., Kastens, C., Lotz, M., & Faust, G. (2011). Aufgabenbezogene Differenzierung Schafer, J. L., & Graham, J. W. (2002). Missing data: Our view of the state of the art.
und Entwicklung des verbalen Selbstkonzepts im Anfangsunterricht [task-related Psychological Methods, 7(2), 147. http://dx.doi.org/10.1037/1082-989X.7.2.147.
differentiation and the development of verbal self-concepts in early school instruc- Schermelleh-Engel, K., Moosbrugger, H., & Müller, H. (2003). Evaluating the fit of
tion]. Zeitschrift für Pädagogik, 57(6), 868–884. structural equation models: Test of significance and descriptive goodness-of-fit
Löser, J. M., & Werning, R. (2011). Does equity exist for immigrant students in German measures. Methods of Psychological Research - Online, 8(2), 23–74.
schools? In A. J. Artiles, E. B. Kozleski, & F. R. Waitoller (Eds.). Inclusive education Schöne, C., Dickhäuser, O., Spinath, B., & Stiensmeier-Pelster, J. (2002). Skalen zur
(pp. 89–100). Cambridge: Harvard Education Press. Erfassung des schulischen Selbstkonzepts [scales to measure school-based self-concept]
Lüdtke, O., Köller, O., Marsh, H. W., & Trautwein, U. (2005). Teacher frame of reference (SESSKO). Göttingen: Hogrefe.
and the big-fish-little-pond effect. Contemporary Educational Psychology, 30(3), Schwinger, M., Wild, E., Lütje-Klose, B., Grunschel, C., Stranghöner, D., Yotyodying, S., ...
263–285. http://dx.doi.org/10.1016/j.cedpsych.2004.10.002. Stelling, S. (2015). Wie können motivationale und affektive Merkmale bei Kindern
Marsh, H. W. (1986). Verbal and math self-concepts: An internal/external frame of re- mit sonderpädagogischem Förderbedarf valide erfasst werden? Erste Befunde der
ference model. American Educational Research Journal, 23(1), 129–149. http://dx.doi. Bielefelder Längsschnittstudie BiLieF [How to assess motivational and affective
org/10.3102/00028312023001129. characteristics in children with SEN-L: First results from the Bielefeld longitudinal
Marsh, H. W. (1987). The big-fish-little-pond effect on academic self-concept. Journal of Study BiLieF]. In P. Kuhl, P. Stanat, B. Lütje-Klose, C. Gresch, H. A. Pant, & M. Prenzel
Educational Psychology, 79(3), 280–295. http://dx.doi.org/10.1037/0022-0663.79.3. (Eds.). Inklusion von Schülerinnen und Schülern mit sonderpädagogischem Förderbedarf in
280. Schulleistungserhebungen (S. 273-300). Wiesbaden: Springer VS.
Marsh, H. W. (2007). Self-concept theory, measurement and research into practice: The role of Skaalvik, E. M., & Valås, H. (1999). Relations among performance, self-concept, and
self-concept in educational psychology. Vernon-Wall Lecture: British Psychological motivation in mathematics and language arts: A longitudinal study. The Journal of
Society. Experimental Education, 67(2), 135–149. http://dx.doi.org/10.1080/
Marsh, H. W., Byrne, B. M., & Yeung, A. S. (1999). Causal ordering of academic self- 00220979909598349.
concept and performance: Reanalysis of a pioneering study and revised re- Stranghöner, D., Hollmann, J., Otterpohl, N., Wild, E., Lütje-Klose, B., & Schwinger, M.
commendations. Educational Psychologist, 34(3), 155–167. http://dx.doi.org/10. (2017). Inklusion versus Exklusion: Schulsetting und Lese-Rechtschreibentwicklung
1207/s15326985ep3403_2. von Kindern mit Förderschwerpunkt Lernen [Inclusion vs. Exclusion: School Setting
Marsh, H. W., & Hau, K. T. (2003). Big-fish-little-pond effect on academic self-concept: A and the Development of Reading and Writing Skills in Students with Mild Learning
cross-cultural (26-country) test of the negative effects of academically selective Difficulties]. Zeitschrift für Pädagogische Psychologie, 31, 125–136. http://dx.doi.org/
schools. American Psychologist, 58(5), 364–376. http://dx.doi.org/10.1037/0003- 10.1024/1010-0652/a000202.
066X.58.5.364. Steenkamp, J. B. E. M., & Baumgartner, H. (1998). Assessing measurement invariance in
Marsh, H. W., & Martin, A. J. (2011). Academic self-concept and academic performance: cross-national consumer research. Journal of Consumer Research, 25(1), 78–107.
Relations and causal ordering. British Journal of Educational Psychology, 81(1), 59–77. http://dx.doi.org/10.1086/209528.
http://dx.doi.org/10.1348/000709910X503501. Tabassam, W., & Grainger, J. (2003). Self-concept enhancement for students with
Marsh, H. W., & O'Mara, A. (2008). Reciprocal effects between academic self-concept, learning difficulties with and without attention deficit hyperactivity disorder. In H.
self-esteem, performance, and attainment over seven adolescent years: W. Marsh, R. G. Craven, & McInerney (Eds.). International advances in self research.
Unidimensional and multidimensional perspectives of self-concept. Personality and Greenwich: DM Information Age Publishing.
Social Psychology Bulletin, 34(4), 542–552. http://dx.doi.org/10.1177/ Tracey, D. K., Marsh, H. W., & Craven, R. G. (2003). Self-concepts of preadolescent stu-
014616720731231. dents with mild intellectual disabilities: Issues of measurement and educational
Marsh, H. W., Trautwein, U., Lüdtke, O., Köller, O., & Baumert, J. (2005). Academic self- placement. In H. W. Marsh, R. G. Craven, & McInerney (Eds.). International advances
concept, interest, grades, and standardized test scores: Reciprocal effects models of in self research (pp. 203–230). Connecticut: DM Information Age Publishing.
causal ordering. Child Development, 76(2), 397–416. http://dx.doi.org/10.1111/j. Valentine, J. C., DuBois, D. L., & Cooper, H. (2004). The relation between self-beliefs and
1467-8624.2005.00853.x. academic achievement: A meta-analytic review. Educational Psychologist, 39(2),
Meredith, W. (1993). Measurement invariance, factor analysis and factorial invariance. 111–133. http://dx.doi.org/10.1207/s15326985ep3902_3.
Psychometrika, 58(4), 525–543. http://dx.doi.org/10.1007/BF02294825. Wagner, C., & Valtin, R. (2003). Noten oder Verbalbeurteilungen? Die Wirkung un-
Möller, J., Pohlmann, B., Köller, O., & Marsh, H. W. (2009). A meta-analytic path analysis terschiedlicher Bewertungsformen auf die schulische Entwicklung von
of the internal/external frame of reference model of academic achievement and Grundschulkindern [Marks or verbal reports? The effect of different assessment forms
academic self-concept. Review of Educational Research, 79(3), 1129–1167. http://dx. on school development of elementary school children]. Zeitschrift für
doi.org/10.3102/0034654309337522. Entwicklungspsychologie und Pädagogische Psychologie, 35(1), 27–36. http://dx.doi.
Möller, J., Streblow, L., & Pohlmann, B. (2009). Performance and self-concept of students org/10.1026//0049-8637.35.1.27.
with learning disabilities. Social Psychology of Education, 12(1), 113–122. http://dx. Weidinger, A. F., Spinath, B., & Steinmayr, R. (2015). Zur Bedeutung von
doi.org/10.1007/s11218-008-9065-z. Grundschulnoten für die Veränderung von Intrinsischer Motivation und
Möller, J., & Trautwein, U. (2015). Selbstkonzept [Self-concept]. In E. Wild, & J. Möller Fähigkeitsselbstkonzept in Deutsch [The role of grades for changes in intrinsic mo-
(Eds.). Pädagogische Psychologie (2. Auflage) (pp. 177–199). Berlin [u.a.]: Springer. tivation and ability self-concept in German]. Zeitschrift für Pädagogische Psychologie,
Moser, V. (2012). Braucht die Inklusionspädagogik einen Behinderungsbegriff? [Does 29(3–4), 193–204 doi:https://doi.org/10.1024/1010-0652/a000160.
inclusive education need a new understanding of disability?]. Zeitschrift für Inklusion. Werning, R., & Lütje-Klose, B. (2016). Einführung in die Pädagogik bei
3. Retrieved from http://www.inklusion-online.net/index.php/inklusion-online/ Lernbeeinträchtigungen [Introduction to the education of students with special educational
article/view/40/40. needs in learning] (4., überarbeitete Auflage). München [u.a.]: Reinhardt.
Oberski, D. L. (2014). Lavaan.survey: An R package for complex survey analysis of Wigfield, A., & Eccles, J. S. (2000). Expectancy–value theory of achievement motivation.
structural equation models. Journal of Statistical Software, 57(1), 1–27. Retrieved from Contemporary Educational Psychology, 25(1), 68–81. http://dx.doi.org/10.1006/ceps.
http://www.jstatsoft.org/v57/i01/. 1999.1015.
Organization for Economic Cooperation and Development [OECD] (2010). PISA 2009 Wigfield, A., Eccles, J. S., Schiefele, U., Roeser, R. W., & Davis-Kean, P. E. (2007).
Assessment Framework: Key competencies in reading, mathematics and science. Paris: Development of achievement motivation. In W. Damon, R. M. Lerner, & N. Eisenberg
OECD Publishinghttp://dx.doi.org/10.1787/9789264062658-en. (Eds.). Handbook of child psychology. Volume three: social, emotional, and personality
Poloczek, S., Karst, K., Praetorius, A. K., & Lipowsky, F. (2011). Generalisten oder development (pp. 933–1002). Wiley.
Spezialisten? Bereichsspezifität und leistungsbezogene Zusammenhänge des schu- Wild, E., Schwinger, M., Lütje-Klose, B., Yotyodying, S., Gorges, J., Stranghöner, D., ...
lischen Selbstkonzepts von Schulanfängern [Generalists or specialists? Domain spe- Kurnitzki, S. (2015). Schülerinnen und Schüler mit dem Förderschwerpunkt Lernen
cificity and relationships to achievement data of the academic self-concept of school in inklusiven und exklusiven Förderarrangements: Erste Befunde des BiLieF-Projektes
starters]. Zeitschrift für Pädagogische Psychologie, 25(3), 173–183 doi:https://doi.org/ zu Leistung, sozialer Integration, Motivation und Wohlbefinden [Students with
10.1024/1010-0652/a000045. Learning Disabilities in Inclusive and Exclusive School Settings. First Results from the
Preacher, K. J., Wichmann, A. L., MacCallum, R. C., & Briggs, N. E. (2008). Latent growth BiLieF Project on Achievement, Social Integration, Motivation, and Well-being.].
curve modeling. London: Sage. Unterrichtswissenschaft, 43(1), 7–21.
R Core Team (2015). R: A language and environment for statistical computing. Retrieved Wild, E., Lütje-Klose, B., Schwinger, M., Gorges, J., & Neumann, P. (2017). BiLieF -
from R Foundation for Statistical Computing, Vienna, Austria: http://www.R-project. Bielefelder Längsschnittstudie zum Lernen in inklusiven und exklusiven
org/. Förderarrangements. Version: 1. IQB. Datensatz: Institut zur Qualitätsentwicklung im
Retelsdorf, J., Köller, O., & Möller, J. (2014). Reading achievement and reading self- Bildungswesenhttp://dx.doi.org/10.5159/IQB_BiLieF_v1.

20

You might also like