Professional Documents
Culture Documents
net/publication/233315290
CITATIONS READS
41 130
2 authors, including:
Ilker Kalender
Bilkent University
34 PUBLICATIONS 261 CITATIONS
SEE PROFILE
Some of the authors of this publication are also working on these related projects:
All content following this page was uploaded by Ilker Kalender on 22 June 2015.
To cite this article: Ilker Kalender & Giray Berberoglu (2009) An Assessment of Factors Related
to Science Achievement of Turkish Students, International Journal of Science Education, 31:10,
1379-1394, DOI: 10.1080/09500690801992888
Taylor & Francis makes every effort to ensure the accuracy of all the information (the
“Content”) contained in the publications on our platform. However, Taylor & Francis,
our agents, and our licensors make no representations or warranties whatsoever as to
the accuracy, completeness, or suitability for any purpose of the Content. Any opinions
and views expressed in this publication are the opinions and views of the authors,
and are not the views of or endorsed by Taylor & Francis. The accuracy of the Content
should not be relied upon and should be independently verified with primary sources
of information. Taylor and Francis shall not be liable for any losses, actions, claims,
proceedings, demands, costs, expenses, damages, and other liabilities whatsoever
or howsoever caused arising directly or indirectly in connection with, in relation to or
arising out of the use of the Content.
This article may be used for research, teaching, and private study purposes. Any
substantial or systematic reproduction, redistribution, reselling, loan, sub-licensing,
systematic supply, or distribution in any form to anyone is expressly forbidden. Terms &
Conditions of access and use can be found at http://www.tandfonline.com/page/terms-
and-conditions
International Journal of Science Education
Vol. 31, No. 10, 1 July 2009, pp. 1379–1394
RESEARCH REPORT
In this study, a hypothesised model with latent variables such as socio-economic status, students’
perception of success and interest in different subject matter areas, out-of-school activities, and
classroom teaching learning activities in relation to science achievement of the students was tested
via linear structural modelling. The data come from the Student Assessment Program—2002
conducted by the Ministry of National Education in Turkey. The results obtained in a sample of
29,911 students indicated that there were positive relationships between the socio-economic status
of the students and teacher-centred activities in the classroom with science achievement. On the
other hand, student-centred activities did not contribute to explain achievement measures
positively. There is a need to scrutinise the quality of student-centred activities in Turkey.
Introduction
In today’s world, one of the key indicators of educational performance as an end
product is students’ achievement level in various subject matter areas. Among them,
science achievement is given a special emphasis by education policy-makers, since it
deals with the concepts and principles that are required for a technologically
equipped and developed society. Science curriculum of a country deals not only with
knowledge acquisition, but also process skills such as inquiry, critical-thinking,
problem-solving, and decision-making (Ministry of National Education of Turkey
[MONE], 2005). Thus, demand for assessing scientific knowledge and skills of the
students has increased tremendously within the past decade as evidenced by the
international studies such as the Third International Mathematics and Science
Study and the Program for International Student Assessment. The data obtained
*Corresponding author. Orta Dogu Teknik Universitesi, Egitim Fakultesi, Ortaogretim Fen ve
Matematik Alanlari Egitimi Bolumu, Ankara 06531, Turkey. Email: giray@metu.edu.tr
from these large-scale assessment programmes provide information for the partici-
pating countries in comparison with international criteria. Besides the international
studies, country-specific assessment programmes at different grade levels and
subject matter areas are also conducted at the national level on larger samples with
special emphasis given to curriculum-specific learning outcomes. The MONE in
Turkey conducted a large-scale study named the Student Assessment Program—
2002 (SAP-2002) in collaboration with the Directorate of Educational Research and
Development Division, for the purpose of benchmarking students learning at
primary education level across different grade levels and subject matter areas
(MONE, 2002). Among the other subject matter areas, science draws the attention
of educators, since in general a very low achievement level in this particular area has
already been known by the stakeholders in education sector for many years. In this
assessment programme, a student questionnaire was also used to collect information
Downloaded by [Bilkent University] at 23:41 23 April 2015
Method
Sample
The sample in SAP-2002 consisted of 10,285 students in the sixth-grade level, 9,969
in the seventh-grade level, and 9,657 students in the eighth-grade level. In the total
sample, 16,777 students are male and 13,134 students are female. In the survey, a
total of 29,911 students answered all the questionnaire and test items administered.
The sampling of the assessment programme was carried out by the MONE. In the
sampling process, students were selected in a stratified sample design from seven
geographical regions. Schools were randomly selected from each region considering
the total number of students and their weights in the total population. For each
school, the classrooms were randomly selected at the three grade levels. The
students in the selected classrooms responded to both the achievement tests and the
Downloaded by [Bilkent University] at 23:41 23 April 2015
student questionnaire. Schools included in the sample are state primary schools,
primary regional boarding schools, and private primary school. In the whole sample,
85.4% of the students are from state primary schools. The rest are from regional
boarding and private schools with ratios of 7.9% and 6.6%, respectively. The sample
represents the distribution ratios of the school types in the whole Turkish population
in the respective grade levels.
Instruments
In the SAP-2002 an achievement test with different test batteries and a student
questionnaire were used. These instruments were developed by the MONE experts.
The average response rates were 98.53% for the science test and 99.1% for the
student questionnaire.
The achievement test consisted of four batteries such as Turkish, social sciences,
mathematics, and natural sciences. In the present study only the natural sciences test
was used. In this particular test there are 20 questions at each grade level. Thus, for
the three grade levels a total of 60 questions was used to assess science achievement
of the students. The questions are all in multiple-choice format with four alterna-
tives. These questions were selected as a result of a pilot study conducted by the
MONE. In general, the natural science subtest measures conceptual understandings
of the students in line with the national curriculum. Across the grade levels, tests
have similar content with different test items. Across the grade levels, the natural
sciences subtest measures ability to identify relationships among science concepts, to
transform information from one format into another, to infer about a scientific
observation, to predict based on a scientific observation, and to solve simple
algorithmic routine science problems. Table 1 presents the sample items used across
different grade levels with the answer key, item difficulty index (p), and biserial
correlation coefficient (rbis).
The student questionnaire consisted of 58 items about student demographic char-
acteristics, interests, school-related learning activities, and out-of-school activities.
Among them, 26 items were selected for the path analytic model to be tested in the
1382 I. Kalender and G. Berberoglu
A student observes cheek epithelial cells and onion membrane in a microscope. Which one of the
followings cannot be learned as a result of this observation?
(A) properties of a plant cell
(B) properties of an animal cell
(C) the differences between a plant and an animal cells
(D) the amount of oxygen consumed by the cells in a unit time
(Correct answer: D)
p = 0.52, rbis = 0.34
Infer about a scientific observation (Grade level 6)
Downloaded by [Bilkent University] at 23:41 23 April 2015
Potential energy is related to the height of an object with reference to the earth.
In which cabin of the ferris wheel potential energy of a child is the lowest?
(A) 1
(B) 2
(C) 3
(D) 4
(Correct answer: D)
p = 0.52, rbis = 0.44
Infer about a scientific observation (Grade level 7)
Table 1. (Continued)
Downloaded by [Bilkent University] at 23:41 23 April 2015
(Correct answer: A)
p = 0.52, rbis = 0.49
Predict based on a scientific observation (Grade level 8)
present study by the authors of this paper. The item selection process for the student
questionnaire is explained in the following section.
science?’, ‘How successful are you in mathematics?’, ‘How interested are you in
science?’, and ‘How interested are you in mathematics?’ were the four questions
included for this particular latent variable. Considering the strong relationships
reported between self-concept and motivation variables from the literature (Skaalvik
& Rankin, 1995) and the correlations of 0.56 and 0.51 found in the data of the
present study between interest and perception of success items in the mathematics
and science areas, respectively, these four items were defined under the same latent
variable. These items were also rated on a four-point scale where for the interest
questions 1 = not interested and 4 = very interested, and for the perception of success
questions 1 = very unsuccessful and 4 = very successful.
For the purpose of validating the conceptually constituted latent variables above,
confirmatory factor analysis was carried out via LISREL (Jöreskog & Sörbom, 1999).
This analysis was actualised for each grade level separately. The goodness of fit index
Downloaded by [Bilkent University] at 23:41 23 April 2015
(GFI), the adjusted goodness of fit index (AGFI), the root mean square error of
approximation (RMSEA), and the standardised root mean square residual (S-RMR)
were used to evaluate the fit of the models (Browne & Cudeck, 1993; Gerbing &
Anderson, 1993; Jöreskog & Sörbom, 1993; Kelloway, 1998; Schumacker & Lomax,
1996). Criteria for a good fit were defined as values above 0.90 for the GFI and AGFI
and values below 0.05 for the RMSEA and S-RMR.
Table 2 presents the fit indexes obtained by confirmatory factor analyses
conducted at each grade level separately.
The indexes obtained for the confirmatory factor analysis indicated that the
conceptual framework proposed for the latent variable model is defensible.
The Cronbach alpha reliabilities of the latent variables are 0.750, 0.679, 0.631,
0.575, and 0.616 for the sixth-grade level, 0.753, 0.692, 0.710, 0.572, and 0.617 for
the seventh-grade level, and 0.754, 0.680, 0.694, 0.538, and 0.607 for the eight-grade
level in the Socio-economic Status, Out-of-school Activities, Interest and Perception of
Success towards Science and Mathematics, Teacher-centred Activities, and Student-centred
Activities dimensions, respectively.
In the present study, the science achievement latent variable was defined by using
all the items in the science achievement tests as observed variables for each grade level.
The principle component analysis of the items indicated that the science achieve-
ment tests measure a unidimensional trait at each grade level. The first two eigenval-
ues provided the strongest evidence for the unidimensionality of the scale, since a
very sharp drop was observed between the eigenvalues of the first and second
Table 2. Goodness-of-fit indices for the confirmatory factor analyses
factors. The first two eigenvalues are 2.931 and 1.159 in Grade 6, 2.940 and 1.194
in Grade 7, and 3.363, and 1.123 in Grade 8. The confirmatory factor analysis also
indicated that the science tests fit a one-dimensional model as evidenced by the
reasonable fit indexes obtained in LISREL across the grade levels. Fit indices
obtained are GFI = 0.96, AGFI = 0.95, SRMR = 0.039, RMSEA = 0.043 for
the sixth grade, GFI = 0.96, AGFI = 0.95, SRMR = 0.040, RMSEA = 0.044 for the
seventh grade, and GFI = 0.94, AGFI = 0.93, SRMR = 0.048, RMSEA = 0.051 for
the eighth grade. The achievement tests used in this study have the reliabilities of
0.67, 0.68 and 0.73 for Grade 6, Grade 7, and Grade 8, respectively.
The Model
In the model, the impacts of Socio-economic Status, Student-centred Activities, Teacher-
Downloaded by [Bilkent University] at 23:41 23 April 2015
Results
Path coefficients obtained across the grade levels are presented on the same path
diagram in Figure 1. The coefficients given on the diagram are in the order of the
sixth-, seventh- and eighth-grade levels, respectively. Deleted paths due to non-signif-
icant values are indicated by a minus sign. The t value of each coefficient is also
provided in parentheses in Figure 1.
The majority of the coefficients in the models were found significant. The path
Figure 1. Structural model of science achievement for grade levels. Note: SES, Socio-economic Status; STUD_CEN, Student-centred Activities; TEAC_CEN, Teacher-centred Activities; OUT_SCH, Out-of-school Activities; INT_SUCC, Interest and Perception of Success towards Science and Mathematics .
Figure 1. Structural model of science achievement for grade levels showing path coefficients.
Note: SES, Socio-economic Status; STUD_CEN, Student-centred Activities; TEAC_CEN, Teacher-
centred Activities; OUT_SCH, Out-of-school Activities; INT_SUCC, Interest and Perception of Success
towards Science and Mathematics. Each set of path coefficients is listed in order from grades 6–8;
t values are shown in parentheses.
In Grades 6 and 7, even though out-of-school activities does not indicate a significant
direct effect on science achievement, its indirect effect over interest and perception of
success is significant. For Grade 8, its indirect effect over interest and perception of
success is 0.16, which is higher than its direct effect on science achievement.
Goodness-of-fit indexes and total variance explained for each grade level are
presented in Table 3.
In general, across the grade levels there are similar patterns obtained in line with
the magnitudes of the path coefficients. All of the exogenous variables except out-of-
school activities are related with the achievement latent variable. On the other hand,
1388 I. Kalender and G. Berberoglu
Table 3. Goodness-of-fit indices and total variance explained for the path analytic model
Table 4 indicates the LISREL estimates, standard errors, and t values obtained for
each grade level.
Discussion
In this study, some selected student-related factors were considered in order to
explain the science achievement of the students across different grade levels within
the framework of linear structural modelling. In general, a similar structure was
obtained in the path analysis with latent variables models across all grade levels.
Among the selected variables, socio-economic status indicated a strong relation-
ship with the science achievement across all grade levels as expected. When the
observed variables are considered for this particular latent variable, it is seen that this
effect basically comes from parental education level and the facilities at home. The
effect of socio-economic status on achievement measure has frequently been
reported in the related literature (Caldas & Bankston, 1997, 2001; Rumberger &
Willms as cited in Caldas & Bankston, 2001). In general these studies indicated that
families from higher socio-economic status tend to be more interested in their
children’s homework, courses, grades, school, and/or peer problems, and so on. As a
result, a higher achievement in the school subjects is obtained (Muller & Kerbow as
cited in Schiller, Khmelkov, & Wang, 2002). In addition, those families may have
better opportunities for their children such as private tutoring, computers, and
educational materials, and a higher education level that may cause to transmit their
experiences to their children (Baker & Stevenson, 1986).
The important finding of the present study is about the classroom activities that
are used in Turkish schools. As was explained above, classroom activities were
grouped under two latent variables in the model tested. When the observed variables
of teacher-centred activities are closely evaluated, it is clearly seen that the question-
naire items are implying an interactive teacher model in the classroom who strives
for teaching through lecturing, problem-solving activities, science experiments, and
with daily life examples of the science concepts. This interactive teacher model
seems successful in enhancing students’ achievement level as evidenced by the
Downloaded by [Bilkent University] at 23:41 23 April 2015
Table 4. LISREL estimates, t values, and standard errors (SE) for science achievement model across grade levels
Latent variable
Observed variable Lambda t value SE Lambda t value SE Lambda t value SE
Table 4. (Continued)
Latent variable
Observed variable Lambda t value SE Lambda t value SE Lambda t value SE
How interested are you in science? 0.52 26.12 0.02 0.56 30.12 0.02 034 28.70 0.02
How successful do you in math? 0.58 44.04 0.01 0.77 58.51 0.01 0.52 58.39 0.01
How successful do you in science? 0.61 28.01 0.02 0.63 33.43 0.02 0.67 31.46 0.02
Factors Related to Science Achievement of Turkish Students 1391
significant path coefficients across all grade levels although its contribution to
achievement slightly drops as the grade level increases. When the total effect of this
latent variable is considered in the models, the greatest contribution on achievement
is observed with the 0.50 path coefficient at the sixth-grade level.
On the contrary, student-centred classroom activities, such as student presenta-
tions, discussions, and group work, among the students seem ineffective in improv-
ing learning in science as evidenced by negative path coefficients obtained across all
grade levels. This finding seems unusual when the teaching methodologies were
considered in this particular variable, but it is not completely unexpected when the
findings of similar studies are considered. The negative relations were reported
between achievement and student-centred activities in the literature (House, 2001;
Leung, 2002; Lokan et al., 2001; Pelgrum & Plomp, 2002; Yayan & Berberoğlu, gb
ev[]r
2004). The negative impact of this particular variable is greatest at Grade 6. As the
Downloaded by [Bilkent University] at 23:41 23 April 2015
grade level increases, the path coefficients slightly drop. These activities do not have
negative impact only on science achievement but on the interest and perception of
success dimension as well at Grades 6 and 8. As the classroom becomes more
student centred, students not only underachieve the science concepts but also lose
their interest about the subject matter and feel academically unsuccessful. The
negative relation implies an unstructured and vague classroom environment in
which, without teacher support in relation to learning, students may lose their atten-
tion on the subject matter and become less confident. When the relationship of
teacher-centred activities with the interest and perception of success latent variable
is considered, it is observed that especially for younger students (sixth-grade level)
the teacher is an important factor to enhance interest and self-confidence. When a
teacher becomes more reverted, as implied in the student-centred activities, students
might lose their interest and self-confidence.
In general, discussion and independent group work are the two basic strategies
implied in the student-centred activities latent variable. Teachers who are accus-
tomed to traditional teaching methodologies might find the student-centred activi-
ties more elaborate to conduct. Discussions without a meaningful and stimulating
question or group work and science experiments without a structured guidance and
active participation of all the group members might not help develop conceptual
understanding in students. Moreover, these activities require different and demand-
ing teacher qualifications. If the classroom environment is structured for the teach-
ers, they become more efficient in developing conceptual understanding in students.
If the classroom environment is basically oriented towards unstructured discussions
and student-centred experiments, teachers might not be able to manage the learning
environment to foster students’ understanding. Two typical items with similar
content from different latent variables imply a non-structured nature of student-
centred classroom activities in Turkish schools. These items are ‘Teacher conducts
experiments’ in the teacher-centred activities dimension and ‘Students conduct
experiments’ in the student-centred activities dimension. As was explained before,
the former indicated a positive relation with the achievement via the latent variable
to which it belongs, whereas the latter had a negative impact. As teachers let
1392 I. Kalender and G. Berberoglu
coefficient between this particular variable and the teacher-centred activities across
all grade levels.
Another finding of the study is related to the indirect effect of out-of-school activ-
ities on science achievement. The questions in this particular latent variable imply a
dedicated and independent student who reads and studies school subjects outside
the school. As a consequence, their science scores are higher than those of the
students who do not pay much attention on school-related activities outside
the school. Students who devote more time on outside school activities have a high
level of interest and positive perceptions about their academic success as evidenced
by the positive path coefficients of this particular variable with the interest and
perception of success latent variable. However, the relation of this latent variable
with the interest and perception of success dimension increases slightly as the grade
level increases. It could be said that activities considered in this latent variable is
more effective for the older students.
Apart from socio-economic status, this study indicated that what teachers do in
the classroom is one of the most important factors at schools to enhance learning in
science. This is consistent across all the grade levels.
More specifically, the following conclusions could be drawn from the results of the
present study.
(1) Teacher-centred activities imply an active teacher model who tries to foster
learning in the classroom with experiments, daily life examples, exercises, and so
forth. This model is successful not only to enhance learning, but also to improve
students’ interest and perception of success positively.
(2) Spending time on school-related activities outside the school has small but
positive indirect impact on science achievement.
(3) Student-centred activities have no positive relation with both achievement and
students’ interest and perception of success.
As a result, the policy-makers in the Turkish educational system should consider
teaching methodologies carried out in the classrooms across the country. As
evidenced by the findings of the present study, there is a need to pervade an active
Factors Related to Science Achievement of Turkish Students 1393
teacher model in the Turkish schools. On the other hand, there is a need to analyse
classroom environment in terms of effective student-centred classroom activities.
The results should not be interpreted as giving up the student-centred activities in
the classroom; rather, there is a need to initiate more in-depth analyses of these
activities as they are being used in schools in a way to enhance the quality of them
via improving teachers’ qualifications and classroom management skills.
References
Baker, D. P., & Stevenson, D. L. (1986). Mothers’ strategies for children’s school achievement:
Managing the transition to high school. Sociology of Education, 59, 156–166.
Browne, M. W., & Cudeck, R. (1993). Alternative ways of assessing model fit. In K. A. Bollen
& J. S. Long (Eds.), Testing structural equation models (pp. 136–162). Newbury Park, CA:
Sage.
Downloaded by [Bilkent University] at 23:41 23 April 2015
Caldas, S. J., & Bankston, C. L. (1997). The effect of school population socioeconomic status on
individual student academic achievement. Journal of Educational Research, 90(5), 269–277.
Caldas, S. J., & Bankston, C. L. (2001). Baton Rouge, desegregation, and white flight. Research in
the Schools, 8(2), 21–32.
Caldas, S. J., & Bankston, C. L. (2003). An evaluation of the consequences of school desegrega-
tion in Lafayette, Louisiana. Research in the Schools, 10(1), 41–52.
Fouad, N. A., & Smith, P. L. (1996). A test of a social cognitive model for middle school students:
Math and science. Journal of Counseling Psychology, 43(3), 338–346.
Gerbing, D. W., & Anderson, J. C. (1993). Monte Carlo evaluations of the goodness-of-tit indices
for structural equation models. In K. A. Bollen & J. S. Long (Eds.), Testing structural equation
models (pp. 40–65). Newbury Park, CA: Sage.
Guzel, C. I., & Berberoglu, G. (2005). An analysis of the programme for international student
assessment 2000 (PISA 2000) mathematical literacy Data for Brazilian, Japanese and Norwe-
gian students. Studies in Educational Evaluation, 31, 283–314.
Hayes, B. (1998). An experiment using teacher-centered instruction versus student-centered instruction as
a means of teaching American government to high school seniors. Retrieved June 28, 2004, from
http://www.secondaryenglish.com/approaches.html.
House, J. D. (2000). Relationships between instructional activities and science achievement of
adolescent students in Hong Kong: Findings from the Third International Mathematics and
Science Study (TIMSS). International Journal of Instructional Media, 27(3), 275–288.
House, J. D. (2001). Relationships between instructional activities and mathematics achievement
of adolescent students in Japan: Findings from the Third International Mathematics and
Science Study (TIMSS). International Journal of Instructional Media, 28(1), 93–106.
Huffman, D., & Lawrenz, F. (2001). TIMSS and relationships between instruction and achieve-
ment in Minnesota science and mathematics classes. Proceeding in National Science Council,
11(3), 103–113.
Jinks, J. L., & Morgan, V. L. (1999). Children’s perceived academic self-efficacy: An inventory
scale. The Clearing House, 72(4), 224–230.
Jöreskog, K. G., & Sörbom, D. (1993). LISREL 8: Structural equation modeling with the SIMPLIS
command language 3.0. Hillsdale, NJ: Erlbaum.
Jöreskog, K. G., & Sörbom, D. (1999). LISREL 8.30. Chicago: Scientific Software International.
Kelloway, E. K. (1998). Using LISREL for structural equation modeling. London & New Delhi:
Sage.
Kline, R. B. (1998). Principles and practice of structural equation modeling. New York: Guilford Press.
Lokan, J., Greenwood, L., & Cresswell, J. (2001). How literate are Australia’s students? Melbourne,
Australia: Australian Council for Educational Research.
1394 I. Kalender and G. Berberoglu
Leung, F. K. (2002). Behind the high achievement of East Asian students. Educational Research
and Evaluation, 8, 87–108.
Ministry of National Education of Turkey. (2002). Report on student assessment at the basic education
level (in Turkish). Ankara, Turkey: Education Research and Development Directorate.
Ministry of National Education of Turkey. (2005). Science and technology curriculum of elementary
schools (6th–8th grades) [in Turkish]. Board of Education.
Onwumere, E. A. (2003). The relationship between urban middle school students’ interest in science,
perceptions of science teachers, and achievement in science. Unpublished dissertation, Texas
Southern University, USA.
Paolucci, J. J. (2001). Gender roles and science beliefs and their relationship to science interest. Unpub-
lished dissertation, University of Rhode Island, USA.
Papanastasiou, E., & Zemyblas, M. (2004). Differential effects of science attitudes and science
achievement in Australia, Cyprus, and the USA. International Journal of Science Education,
26(3), 259–280.
Pelgrum, W. J., & Plomp, T. (2002). Indicators of ICT in mathematics: Status and covariation
with achievement measures. In D. F. Robitaille & A. E. Beaton (Eds.), Secondary analysis of
Downloaded by [Bilkent University] at 23:41 23 April 2015