Professional Documents
Culture Documents
ARTICLES
JEFFREY P. DORMAN
Australian Catholic University^
Catholic Education: A Journal of Inquiry and Practice. Vol. 3, No. 2, December 1999, 141-157
©1999 Catholic Education: A Journal of Inquiry and Practice
142 Catholic EducationA)eccmber 1999
1997b) conventional class form of the CSCEQ (in which students report their
perceptions of the class as a whole) to a personal form (in which a student
reports perceptions of his or her role in the classroom). Discussion in this
article is arranged in five major sections: Australian Catholic schooling, the
field of learning environment research, the need for a personal form of the
CSCEQ, the evolution and validation of the personal form of the CSCEQ,
and the use of this instrument in Catholic high school religion classes.
Table 1
Descriptive Information for Ciass and Personai Forms of the CathoUc
Schooi Ciassroom Environment Questionnaire
Sample Items
Scale Name Scale Description Moos's Class Form Personal Form
Schema*
Student Extent to which stu- R All students I know other
Affiliation dents know, help, and know each other students very
are friendly towards very well. (-I-) well. (+)
each other.
Interactions Extent to which R Students get on I get on well
teacher-student interac- well with the with my teacher,
tions emphasize a con- teacher. (+) (+)
cern for the personal
welfare and social
growth of the student.
Cooperation Extent to which stu- Most students I am willing to
dents cooperate rather are willing to help students
than compete with each help students who are having
other. who are having trouble with
trouble with their work. (+)
their work. (+)
Task Orientation Extent to which it is Almost all class Almost all my
important to complete time is spent class time is
activities planned and doing work. (+) spent doing
to stay on the subject work. (+)
matter.
Order & Emphasis on students Students fool I fool around in
Organization behaving in an orderly, around in this this class. (-)
quiet, and polite man- class. (-)
ner and on the overall
organization of class-
room activities.
Individualization Extent to which stu- Students are I am allowed to
dents are allowed to allowed to choose the
make decisions and are choose activities activities I do in
treated differently in the classroom. the classroom.
according to ability,
interest, and rate of
working.
Teacher Control The number of rules, Students don't I don't have to
how strictly rules are have to stick to stick to the rules
enforced, and how the rules in this in this class. (-)
severely infractions are class. (-)
punished.
'R: Relationship, P: Personal Growth, S: System Maintenance and System Change
Jeffrey P Dorman/CATHOLIC SCHOOL ENVIRONMENT QUESTIONNAIRE 147
SAMPLE
A random sample of 20 Catholic high schools from one Catholic diocese in
New South Wales, Australia, was invited to participate in the study. These
schools were identified using information provided by the diocesan Catholic
Education Office which has overall administrative responsibility for schools
in the diocese. Of these schools, 17 elected to participate in the study. The
sample consisted of four boys', five girls' and eight coeducational schools,
reflecting the diversity in the school population of the diocese. Where possi-
ble, two classes of grade 9 religious education and grade 12 religious educa-
tion were surveyed in each school. The total sample consisted of 1317 stu-
dents whose ages ranged from 13 to 18 years of age. In New South Wales,
students are usually 14 or 15 years of age in grade 9 and 17 or 18 years of
age in grade 12. Table 2 provides descriptive information for this sample.
Although school personnel (usually the religious education coordinator)
selected these classes, it is important to note that students in a particular
grade are almost always assigned to religious education classes in Catholic
schools on a random basis. Accordingly, the ability of the school to select a
biased sample was quite low. Because analyses used the class mean as the
unit of analysis, validation data for both the individual and class means as
units of analysis are reported below as recommended by Sirotnik (1980).
Table 2
Description of Sample by School T^pe and Year Level
Sample Size
Year Level School Type
Boys' Girls' Coeducational Total
Year 9 8(205) 10(262) 14(381) 32(848)
Year 12 2(38) 6(155) 12 (276) 20 (469)
Total 10(243) 16(417) 26(657) 52(1317)
Note: The number of students is given in parentheses.
VALIDATION DATA
Internal consistency reliability
Estimates of the intemal consistency reliability of the seven scales of the
CSCEQ were calculated for the above sample using Cronbach's coefficient
alpha. Table 3 shows the coefficient alpha for each scale of the CSCEQ using
the individual student and class means as units of statistical analysis. As
expected, alpha coefficients based on class means are somewhat larger than
those obtained with the individual as the unit of analysis. These values sug-
gest that, apart from the Individualization scale, each scale has acceptable
intemal consistency for both the individual and the class means as the unit of
analysis. For both units of analysis, the Individualization scale does not have
148 Catholic EducationA^ecembtT 1999
Table 3
Internal Consistency (Alpha Reliahility), Discriminant Validity (Mean
Correlation with Other Scales), and ANOVA Results for the CSCEQ
(Personal Form) for Two Units of Analysis
(N = 1317 students in 52 classes)
satisfactory reliability due to low scale variances. Removal of any one item
did not improve scale reliability and the results of subsequent analyses
involving this scale need to be interpreted with caution.
Discriminant validity
An important characteristic of a scale is that it assesses a relatively distinct
construct. Significant scale overlap contravenes parsimony and confounds
the interpretation of findings. Table 3 reports discriminant validity data using
the mean correlation of a scale with the remaining six scales as a convenient
index. These data indicate that the scales do overlap but not to the extent that
would violate the psychometric structure of the instrument. Additionally, the
data compare favorably with discriminant validity data of well-established
classroom environment instruments (see Fraser, 1998a).
Because religion classes were the primary sampling unit, the unit of
analysis used in all comparisons was the class rather than the individual.
Using the individual as the unit of analysis with a sample of 1317 students
would employ a very small estimate of the sampling error and subsequent
analyses could be statistically significant but not practically significant.
Accordingly, scale scores for each student were used to calculate class means
with the final data set consisting of 52 class means for each of the seven
scales of the CSCEQ. The third research question required gender compar-
isons and involved the use of gender class means, the calculation of which is
explained later in this section.
oo ON
ON
o
z
C.2
c cd u
le 8
(55 < U
ON
c
vd
S
O o cd
7,18
7,18
oo
-a
c O
I
CO
a 4.^
O
Wilks'
<U
27
53
<n
a ON
' ^
CO
O C
o 2
X u. Q.
de
0)
de
2 g
CM
O o OO <U CO
Cd
*
*— ro* *oo *
"^ in O o CO - C C
vO ^E ^
-^ — cs
o I S^ ^
z O
N « ^ B CO
09
S § § 13 ^ s t>
3 4.^
^ ^ ^ •-
Scale
Cd
o
o
ill
£E^U
T3
5 C UJU (U
o .2P^ ^
*
87**
(/) ON <s
pi
"to T3 ^
o o
80
oo 'fc^ C >
5 Cd >
•§ CO <u 1 )
• S Cd cd
o > 00 bO
ks'
29
ON CO __
13 ^
(U CO 1 3 "3 V
pe
cd *
O ^ CO CO
»n
School
U O
q
ti O 1^ V
Jeffrey P. Dorman/CATHOLIC SCHOOL ENVIRONMENT QUESTIONNAIRE 151
ed for each significant comparison using the difference between group means
as a fraction of the full sample standard deviation as a convenient index
(Cohen, 1977). In general, these effect sizes were very large and ranged from
0.85 for the comparison of Cooperation in boys' and coeducational schools
to 1.75 for Cooperation in boys' and girls' schools. An effect size of 1.75 is
extremely large for this research tradition and it confirms the sensitivity of
the CSCEQ to different school settings. Figure 1 shows the results for the
seven scales of the CSCEQ.
Figure 1
Mean Scores for Three Types of Catholic Schools
for Seven Scales of the CSCEQ
(N = 52 class means)
30 T
Catholic Boys'
Catholic Girls'
Catholic Coeducational
, * - - - — \
26 4-
24-4-
Mean
Scores
22-1-
20--
18--
16 I I I I I I I
Student Interactions Cooperation Task Order & Individualization Teacher
Affiliation Orientation Organization Control
These results are the first to be collected with the new personal form of
the CSCEQ. Accordingly, there are no previous studies with which direct
comparisons can be drawn. In the United States, Trickett et al. (1982) used
the Classroom Environment Scale (Moos & Trickett, 1987) to compare the
classroom environment in single-sex and coeducational schools. Results
showed that, compared to classes in coeducational schools, students in sin-
gle-sex schools perceived greater Student Affiliation, Involvement, Task
Orientation, Order and Organization, and Teacher Control in their class-
rooms. However, a major problem with the Trickett et al. study is that data
from boys' and girls' schools were pooled to form a data set for single-sex
schools. Employing the class form of the CSCEQ introduced earlier in this
article, Dorman et al. (1997) revealed that, in general, classes in Catholic
152 Catholic Education/DQccmbQT 1999
girls' schools had more positive environments than classes in Catholic boys'
and coeducational schools. The results of the present study are in broad
agreement with these earlier studies. For example, Student Affiliation,
Cooperation, Order and Organization, and Individualization were higher in
girls' school classes compared to boys' school classes. Differences between
girls' and boys' school classes for the remaining three scales were small. For
all scales, scores for coeducational school classes were below scale scores for
at least one of the remaining school types.
Figure 2
Mean Scores for Grade 9 and Grade 12 Classes
for Seven Scales of the CSCEQ
(N = 52 class means)
30 J
Grade 9
Grade 12
28--
26--
24 +
Mean
Scores
22-1-
20--
18--
16 I I I I
Student Interactions Cooperation Task Order & Individualization Teacher
Affiliation Orientation Organization Control
Jeffrey P. Dorman/CATHOLIC SCHOOL ENVIRONMENT QUESTIONNAIRE 153
These results are consistent with three previous studies on the effect of
grade on classroom environment (Dorman, Fraser, & McRobbie, 1994;
Randhawa & Michayluk, 1975; Welch, 1979). Overall, these studies showed
that as grade increased Cooperation increased but Task Orientation and
Teacher Control decreased. In the present study, Individualization was found
to be greater in grade 12 classes compared to grade 9 classes. This finding is
in agreement with Dorman et al.'s study which was conducted in religion and
science classes in Catholic high schools.
Figure 3
Mean Scores for Boys and Girls in Coeducational Classes
for Seven Scales of the CSCEQ
(N = 26 pairs of gender class means)
30-1-
28-
26- -
24
Mean
Scores
22
20- -
18- -
16
Student Interactions Cooperation Task Order & Individualization Teacher
Affiliation Orientation Organization Control
(1985) in Sydney and Minnesota, and Wong and Fraser (1996) in Singapore.
For example, the latter study revealed that in Singapore high schools, female
students held more favorable perceptions of chemistry classes than male stu-
dents.
CONCLUSION
The purpose of this paper has been to describe the evolution, validation, and
use of a personal form of the Catholic School Classroom Environment
Questionnaire (CSCEQ). By assessing the individual's perceptions of his or
her role in the classroom, this instrument reflects the latest trends in leaming
environment research. The CSCEQ assesses seven distinct dimensions of
classroom environment in Catholic high schools: Student Affiliation,
Interactions, Cooperation, Task Orientation, Order and Organization,
Individualization, and Teacher Control. Noteworthy design features of this
instrument include its consistency with Catholic school literature, its salience
to teachers and students, and coverage of Moos's (1979) three general cate-
gories of human environments. Given these characteristics, teachers and
administrators should feel confident in using the CSCEQ in classrooms.
Additionally, the CSCEQ is highly economical in that it takes approximate-
ly 15 minutes to administer its 49 items and can be scored efficiently by hand
or computer.
The application of the CSCEQ in 52 Catholic high school classes illus-
trates its usefulness as a research tool. As the atmosphere of Catholic school
classes is crucial to the maintenance of a Catholic ethos, it is hoped that this
latest form of the CSCEQ will encourage researchers, school administrators,
and teachers to investigate psychosocial environments in Catholic schools.
REFERENCES
Abbott, W. M. (1966). The documents of Vatican //. London: Geoffrey Chapman.
Bathersby, J. (1992). The Catholic school: Creating the future together: Pastoral letter for
Catholic education Sunday. Brisbane, Australia: Archdiocese of Brisbane.
Bartelheim, F. J. (1998, April). Preservice teachers' evolving perceptions of the classroom
environment. Paper presented at the meeting of the American Educational Research
Association, San Diego.
Buetow, H. A. (1988). The Catholic school: Its roots, identity, and future. New York:
Crossroad Publishing Co.
Cohen, J. (1977). Statistical power analysis for the behavioral sciences (Rev. ed.). New York:
Academic.
Cohen, J., & Cohen, P. (1975). Applied multiple regression/correlation analysis for the behav
ioral sciences. Hillsdale, NJ: Lawrence Erlbaum.
Congregation for Catholic Education. (1988). The religious dimension of education in a
Catholic school. Homebush, Australia: St. Paul Publications.
Dorman, J. P. (1997a). Psychosocial environment in religious education classes in Australian
Catholic secondary schools. British Journal of Religious Education, /9(2), 104-113.
156 Catholic Education/DQCcmbQT 1999
Randhawa, B. S., & Michayluk, J. O. (1975). Leaming environment in rural and urban class-
rooms. American Educational Research Journal, 12, 265-285.
Sacred Congregation for Catholic Education. (1977). The Catholic school. Homebush,
Australia: St. Paul Publications.
Sirotnik, K. A. (1980). Psychometric implications of the unit-of-analysis problem (with exam-
ples from the measurement of organizational climate). Journal of Educational
Measurement, 17, 245-282.
Stem, G. G., Stein, M. J., & Bloom, B. S. (1956). Methods in personality assessment. Glencoe,
IL: Free Press.
Trickett, E. J. (1978). Toward a social-ecological conception of adolescent socialization:
Normative data on contrasting types of public school classrooms. Child Development, 49,
408-414.
Trickett, E. J., Trickett, P K.. Castro, J. J., & Schaffner, P (1982). The independent school
experience: Aspects of normative environments of single-sex and coed secondary
schools. Journal of Educational Psychology, 74, 374-381.
von Glasersfeld, E. (1989). Cognition, construction of knowledge, and teaching. Synthese, 80,
122-140.
Welch, W. W. (1979). Curricular and longitudinal effects on leaming environments. In H. J.
Walberg (Ed.), Educational environments and effects: Evaluation, policy and productiv
ity (pp. 167-179). Berkeley, CA: McCutchan.
Wong, A. F. L., & Fraser, B. J. (1996). Environment-attitude associations in the chemistry lab-
oratory classroom. Research in Science and Technological Education, 14, 91-102.
Jeffrey P. Dorman is senior lecturer in the School of Education, Australian Catholic Universiry. Brisbane
Australia. Correspondence concerning this paper should be addressed to Jeffrey P. Dorman, School of
Education, Australian Catholic University, PO Bo.x 247, Everton Park 4053, Australia.