Professional Documents
Culture Documents
Values
Values
568–593
My Class Activities
Instrument as Used in
Saturday Enrichment
Program Evaluation
nielsen Pereira
Purdue University
Scott J. Peters
University of Wisconsin±W hitewater
Marcia Gentry
i
Purdue University
568
Copyright © 2010 Prufrock Press, P.O. Box 8813, Waco, TX 76714
program was used. Four different MCA models were evaluated: (a)
summary
ment and interest; (c) a three-factor model containing a combination
of interest and enjoyment, challenge, and choice; and (d) the original
MCA model after two items were removed. Results indicated that the
original MCA four-factor structure provided a better fit when used with
the Saturday enrichment sample than did the second-order and the three
first-order factor models. However, the best solution regarding model fit
was found using the original model, but with the removal of two poorly
it was originally normed. With two items deleted from the challenge
Pereira, N., Peters, S. J., & Gentry, M. (2010). My Class Activities instrument as used in
Saturday enrichment program evaluation. Journal of Advanced Academics, 21, 568–593.
My CLASS ACTIVITIES
Literature Review
My Class Activities
Development of MCA
Pilot Study. Gentry, Maxfield, and Gable (1998) assessed the con-
struct validity of the MCA to determine if students perceived
their regular classroom activities and their enrichment clusters
(Renzulli, 1994) differently. Two different instruments, one that
assessed students’ perceptions of their regular classroom activi-
ties and the other of the enrichment clusters, were created. Both
instruments had 40 items that varied only in the use of either
classroom or enrichment cluster in the item stems. Content judges
provided evidence of content validity for the five hypothesized
factors (i.e., interest, enjoyment, challenge, choice, meaningful-
ness). However, exploratory factor analysis (EFA) revealed differ-
ent factors for general classrooms (i.e., interest, challenge, choice,
enjoyment) and for enrichment clusters (i.e., interest/enjoyment,
choice, meaningfulness, challenge). MCA was then developed for
use in general classrooms based on the EFA results from this pilot
study (Gentry & Gable, 2001a) using the following operational
definitions of the four scales:
• Interest: Reflects positive feelings/preference for certain
topics, subject areas, or activities.
• Challenge: Engages the student and requires extra effort.
• Choice: Gives the student the right or power to select
educational options and direct his or her own learning.
• Enjoyment: Provides the student with pleasure and sat-
isfaction (Gentry & Gable, 2001a, p. 4).
Saturday Enrichment
Methods
Participants
Data Collection
Table 1
Respondents for Each Semester of Super Saturday
Semester Respondents Missing % Missing Total Used
Spring 2005 223 57 25% 166
Fall 2005 157 39 25% 118
Spring 2006 162 39 24% 123
Spring 2007 67 13 19% 54
Fall 2007 84 18 21% 66
Spring 2008 179 31 17% 148
Fall 2008 193 42 22% 151
Total 1065 239 22% 826
Data Analysis
Results
Table 2 includes means, standard deviations, skewness values,
and kurtosis values for the 31 MCA items. Descriptive values indicate
that the variables were moderately non-normal with skewness values
of two or less and all kurtosis values smaller than seven (Finney &
DiStefano, 2006). Means for the MCA normative sample ranged
from 3.05 (choice) to 3.64 (enjoyment) and means for our sample
ranged from 3.41 (choice) to 4.46 (enjoyment), which indicated that
students in this Saturday enrichment sample had higher means than
those from the normative sample for all MCA dimensions.
Alpha internal consistency estimates for the four subscales
ranged from .77 to .88. Correlations between the four factors
are shown in Table 3. The large correlations between some of the
factors for the Saturday enrichment sample may suggest that an
alternative model may fit the data better than the original model.
Model Fit
Gentry and Gable (2001) Model. In order to answer the first research
question, we evaluated how the original four-factor model (Gentry
Table 2
Descriptive Statistics for the MCA Items
Item Mean SD Skewness Kurtosis
1. What I do in my class fits my interests. 4.31 .751 -.807 .101
2. I have an opportunity to work on things in my 4.26 .823 -.972 .553
class that interest me.
3. What I do in my class gives me interesting and 4.15 .918 -.935 .434
new ideas.
4. I study interesting topics in my class. 4.22 .921 -1.086 .689
5. The teacher involves me in interesting learning 4.39 .803 -1.291 1.367
activities.
6. What I learn in my class is interesting to 4.38 .806 -1.290 1.460
me.
7. What I do in my class is interesting to me. 4.41 .800 -1.418 1.887
8. My class helped me explore my interests. 4.13 .996 -1.174 1.056
9. The activities I do in my class are challenging. 3.45 1.170 -.368 -.588
10. I have to think to solve problems in my 3.84 1.086 -.744 -.065
class.
11. I use challenging materials and books in my class. 2.90 1.297 .002 -1.043
12. I challenge myself by trying new things. 3.96 1.020 -.895 .406
13. My work can make a difference. 3.86 1.047 -.754 .032
14. I find the work in this class demanding. 2.88 1.308 .066 -1.072
15. I am challenged to do my best in class. 4.11 1.066 -1.119 .544
16. What we do in class fits my abilities. 4.18 .912 -1.056 .854
17. This class is difficult. 2.66 1.222 .271 -.791
18. I can choose to work in a group. 3.35 1.369 -.349 -1.048
19. I can choose to work alone. 3.44 1.382 -.445 -1.012
20. When we work together, I can choose my 3.41 1.459 -.407 -1.180
own partners.
21. I can choose my own projects. 3.49 1.469 -.502 -1.144
22. When there are many jobs, I can choose 3.65 1.316 -.683 -.668
the ones that suit me.
23. I can choose materials to work with in the 3.54 1.300 -.486 -.848
class.
24. I can choose an audience for my product. 2.98 1.404 .035 -1.214
25. I look forward to my class. 4.44 .872 -1.546 1.829
26. I have fun in my class. 4.58 .777 -2.006 4.582
27. The teacher makes learning fun. 4.5 .820 -1.728 2.614
28. I like what I do in my class. 4.46 .828 -1.585 2.239
29. I like working in my class. 4.43 .823 -1.437 1.712
30. The activities I do in my class are enjoyable. 4.46 .801 -1.572 2.421
31. I like the projects I work on in my class. 4.39 .896 -1.481 1.709
Table 3
Correlations Among MCA Dimensions (n = 826)
Interest Challenge Choice Enjoyment
Interest 1.00
Challenge .72 1.00
Choice .59 .66 1.00
Enjoyment .88 .62 .51 1.00
Note. All correlations significant at the p < 0.01 level.
& Gable, 2001a) fit the Super Saturday sample data. The original
MCA model yielded fit indices similar to those found in previous
studies (Gentry & Gable, 2001b; Gentry et al., 2001). We did not
generate separate fit indices for elementary and middle grades, but
rather analyzed the sample as a whole because the enrichment pro-
gram we studied included students at both levels and some classes
have students in elementary and middle school grades. Table 4
shows the goodness of fit indices for the Saturday enrichment
sample for the MCA original model we tested.
The MCA original model fit the Saturday enrichment sample
with a GFI value of .86, CFI value of .89, and RMSEA value of
.06. Comparing these values to the fit statistics obtained with the
normative sample, we noted that the model did not fit the Saturday
enrichment sample as well as it did the normative sample, which
had goodness of fit indices of .95 (elementary) and .88 (middle
school) and RMSEA of .04 (elementary) and .09 (middle school;
Gentry & Gable, 2001a). To test the second research question
concerning how alternative models affect overall model fit, we ana-
lyzed two alternative models and present the results below.
Table 4
Comparison of Fit Indices for the Different MCA Models
Model x² (df) GFI RMSEA RMSEA 90% CI CFI
MCA Original 1726.70 0.86 0.06 (0.0577, 0.0636) 0.89
Model (428)
Second-Order 2145.51 0.85 0.07 (0.0665, 0.0724) 0.89
Model (429)
Three-Factor 2089.63 0.83 0.07 (0.0654, 0.0712) 0.86
Model (431)
Revised MCA 1269.09 0.91 0.05 (0.0472, 0.0541) 0.92
(379)
Other fit indices also showed worse fit for this model with lower
GFI (.85) and CFI (.89) values and a higher RMSEA value (.07).
We expected that including a second-order term would have
significantly improved model fit due to fewer parameters being
estimated, but that was not the case for the Saturday enrichment
program sample.
Discussion
In this study we evaluated MCA for use with students in
out-of-school enrichment programs. We found the same factors
existed for this sample of Super Saturday participants as for the
general normative instrument sample (i.e., interest, challenge,
choice, enjoyment). However, by eliminating two items from the
Challenge scale, we strengthened the fit indices, reduced error
statistics, and obtained acceptable internal consistency estimates.
The decision to eliminate Items 16 and 17 was made because
they functioned poorly with the Saturday enrichment sample and
because these items appeared to be confusing or related to other
constructs. Thus, based on these results with our data, we propose
that MCA is a useful tool for evaluating or studying students’
perceptions of their out-of-school enrichment programs regard-
ing interest, challenge, choice, and enjoyment. Including MCA
or a similar instrument as a component of out-of-school pro-
gram evaluation responds to calls from VanTassel-Baska (2004)
to include multiple perspectives on program evaluation in order
to create a complete picture. Validating the use of this instru-
Conclusion
We conclude that removing two items from the MCA created
an appropriate tool to use in evaluating our Saturday enrich-
ment program. This change demonstrates that when using an
instrument in a different context, research must be conducted
in order to determine if valid information can still be obtained
(Joint Committee on Testing Practices, 2005). Yet, the original
MCA investigation and this study had similar results, possibly
due to the fact, that in its original development, gifted students
were oversampled with 24% of the elementary and 44% of the
middle school samples identified as gifted. Other out-of-school
programs and in-school enrichment programs may want to con-
sider using the MCA to learn how their student participants view
their programs. We suggest investigating how the MCA, modi-
fied as suggested in this project, works with students from dif-
ferent programs.
References
Alexander, J. M., & Schnick, A. K. (2008). Motivation. In J. A.
Plucker & C. M. Callahan (Eds.), Critical issues and practices in
gifted education (pp. 423± 447). Waco, TX: Prufrock Press.
Bangel, N. J., Enersen, D., Capobianco, B., & Moon, S. M. (2006).
Professional development of preservice teachers: Teaching in the
Super Saturday program. Journal for the Education of the Gifted,
29, 339± 363.
Bloom, B. S. (Ed.). (1985). Developing talent in young people. New York,
NY: Ballantine.
Brown, T. A. (2006). Confirmatory factor analysis for applied research.
New York, NY: The Guilford Press.
Callahan, C. M. (2001). Fourth down and inches. Journal of Secondary
Gifted Education, 12, 148± 156.
Center for Talent Development. (2008). Saturday enrichment program.
Retrieved from http://www.ctd.northwestern.edu/sep
Csikszentmihalyi, M. (1990). Literacy and intrinsic motivation.
Daedalus, 119, 115± 140.
Davis, G. A., & Rimm, S. B. (2004). Education of the gifted and talented
(5th ed.). New York, NY: Pearson.
Dewey, J. (1913). Interest and effort in education. New York, NY:
Houghton Mifflin.
Duke University Talent Identification Program. (2008). Scholar
Weekends at Duke University. Retrieved from http://www.tip.duke.
edu/academic_year_programs/scholar_weekends