Professional Documents
Culture Documents
This study estimated separately the unique effects (g) respecting diverse talents and ways of
of three dimensions of good practice and the global learning. The influence of Chickering and
effects of a composite measure of good practices Gamson’s seven principles on the field of
on the cognitive development, orientations to higher education has been extensive. In
learning, and educational aspirations of students addition to the broad dissemination of the
during their first year of college. Analyses of principles to colleges and universities in the
longitudinal data from a representative sample U.S. and Canada (Chikering & Ehrmann,
of colleges and universities were conducted, and 1996; Chickering & Gamson, 1999; Gamson,
net of a battery of confounding influences, 1991), there has been widespread assessment
measures of good practices were positively related of these good practices for policy-making and
to a number of first-year outcomes. The magni- research. In 1989, Chickering, Gamson, and
tude of the effects of these good practices differed Barsi, with support from the Johnson Founda-
by the pre-college characteristics of the students tion, constructed the “Inventories of Good
and by the type of institution attended. Practice in Undergraduate Education” as a
means for faculty and administrators to assess
In a project sponsored by the American the extent to which individual practices and
Association for Higher Education, the Edu- campus policies align with the seven principles
cation Commission of the States, and the (Gamson, 1991). These good practices also
Johnson Foundation, Chickering and Gamson have been assessed using indicators from
(1987) synthesized the existing evidence on previously existing surveys such as the College
the impact of college on students and cate- Student Experiences Questionnaire (Kuh,
gorized it into seven broad principles for good Pace, & Vesper, 1997; Kuh & Vesper, 1997).
practice in undergraduate education. These More recently, surveys such as the National
seven principles are: (a) encouraging student– Survey of Student Engagement (NSSE) and
faculty contact, (b) encouraging cooperation the Faculty Survey of Student Engagement
among students, (c) encouraging active (FSSE) have measured the extent to which
learning, (d) giving prompt feedback to students are engaged in these good practices
students, (e) emphasizing time on task, and the extent to which faculty expect students
(f ) communicating high expectations, and to be engaged in these good practices (Kuh,
Ty M. Cruce is a research analyst at the Center for Postsecondary Research at Indiana University; Gregory C.
Wolniak is a senior research and policy analyst at the Human Capital Research Corporation in Evanston, IL;,
Tricia A. Seifert is a doctoral research assistant in the Student Affairs Administration and Research Program at the
University of Iowa; and Ernest T. Pascarella is the Mary Louise Petersen Chair in Higher Education and Co-
director of the Center for Research on Undergraduate Education at the University of Iowa. This investigation was
conducted as part of the National Study of Student Learning (NSSL), which was supported by Grant No.
R117G10037 from the U.S. Department of Education to the National Center on Postsecondary Teaching, Learning,
and Assessment.
2001; National Survey of Student Engage- predictive validity of Chickering and Gamson’s
ment, 2003). (1987) principles for good practice in under-
A large body of evidence exists to support graduate education, there are several limita-
the predictive validity of Chickering and tions to this body of research. First, the effects
Gamson’s (1987) principles for good practice of a single good practice (e.g., student–faculty
in undergraduate education. Even in the interaction) are often studied in isolation, thus
presence of controls for important con- potentially biasing the estimates of the effects
founding influences, various measures of these upward by not accounting for the con-
principles for good practice are significantly founding influence of other good practices.
and positively linked to desired aspects of Second, studies of the effects of these good
cognitive and non-cognitive growth during practices are often limited to students within
college, and career and personal benefits after a single institution or within a small sample
college (Astin, 1993; Chickering & Reisser, of institutions. Consequently, the generaliz-
1993; Kuh, Schuh, Whitt, & Associates, 1991; ability of the results of these studies is limited
Pascarella & Terenzini, 1991, 2005; Sorcenelli, to students at similar institution types. Finally,
1991). Recent examples of individual studies studies of the effects of good practices
supporting the predictive validity of indicators sometimes rely on self-reported gains and do
of specific good practices in undergraduate not provide stringent statistical controls for the
education include the following: student– pre-college background and development of
faculty contact (Anaya, 1999; Frost, 1991; the students. Cautions against the use of
Kuh & Hu, 1999; Terenzini, Springer, Yaeger, self-reported gains in place of pre- and
Pascarella, & Nora, 1994); cooperation among post-measures have been noted elsewhere
students (Cabrera, Crissman, Bernal, Nora, (Pascarella, 2001). Pre-college measures allow
Terenzini et al., 2002; Johnson, Johnson, & for statistical adjustment for self-selection into
Smith, 1998a, 1998b; Qin, Johnson, & college and present a baseline from which to
Johnson, 1995; Whitt, Edison, Pascarella, measure gains. Without pre-college measures,
Nora, & Terenzini, 1999); active learning one cannot adequately differentiate the
(Grayson, 1999; Hake, 1998; Kuh, Pace, & effects of an institution’s good practices
Vesper, 1997; Lang, 1996; Murray & Lang, from the effects of the students’ pre-college
1997); academic effort/time on task (Astin; development.
Ethington, 1998; Hagedorn, Siadat, Nora, & Given these limitations of the current
Pascarella, 1997; Johnstone, Ashbaugh, & body of research, the purpose of this study is
Warfield, 2002; Watson & Kuh, 1996); to expand the understanding of the relation-
prompt feedback to students (d’Apollonia & ship between Chickering and Gamson’s (1987)
Abrami, 1997; Feldman, 1997); high expecta- principles for good practice and a number of
tions (Arnold, Kuh, Vesper, & Schuh, 1993; cognitive and non-cognitive student outcomes
Astin, 1993; Bray, Pascarella, & Pierson, 2004; by analyzing longitudinal data from a diverse
Whitmire & Lawrence, 1996); and diversity sample of institutions that participated in the
experiences (Kitchener, Wood, & Jensen, National Study of Student Learning (NSSL).
2000; Pascarella, Palmer, Moye, & Pierson, Two research questions guided the study. First,
2001; Terenzini et al.; Umbach & Kuh, 2003). what are the unique (or net) effects of these
Although collectively these and other good practices on students’ cognitive develop-
studies provide evidence supporting the ment, orientations to learning, and graduate
degree plans during the first year of college? 2004). At the same time, the conceptual
Second, are the net effects of good practices framework permits a greater generalizability
general or conditional? That is, are the effects with respect to a comprehensive understanding
similar in magnitude across student pre-college of the developmental impact of good practices.
characteristics or institutional type (general In operationalizing good practices, we
effects) or do they vary in magnitude for were guided by the research on the predictive
different kinds of students, or in different validity of different dimensions of good
institutional contexts (conditional effects)? practices reviewed above. Indeed, many of the
operational definitions of good practices
Conceptual Framework employed in this investigation were either
In estimating the effects of good practices in adapted or taken directly from the studies
undergraduate education, we were guided by previously cited (e.g., Bray et al., 2004;
a number of conceptual models of college Cabrera et al., 2002; Feldman, 1997; Hage-
impact (e.g., Astin, 1993; Chickering & dorn et al., 1997; Pascarella, Edison, Nora,
Reisser, 1993; Pascarella, 1985; Weidman, Hagedorn, & Braxton, 1996; Terenzini et al.,
1989). These models posit that the impact of 1994; Whitt et al., 1999). Additional contri-
college on nearly any student outcome is the butions of this particular study to the field are
result of multiple influences. At a minimum, the introduction of statistical controls for an
these multiple influences include: (a) student extensive battery of student pre-college
demographic and pre-college characteristics, characteristics and other confounding influ-
(b) organizational or structural characteristics ences during the first year of college, and the
of the institution attended, (c) students’ use of parallel pre- and post-measures to assess
academic experiences, and (d) students’ non- student gains in both cognitive and non-
academic experiences. We estimated the net cognitive areas.
effects of each of our dimensions of good
practices within the context of such a generic METHOD
conceptual model. Thus, in estimating the net
influences of good practice dimensions on any Institution Sample
dependent measure, we took into account not The institutional sample comprised 18 four-
only student demographic and pre-college year colleges and universities and 5 two-year
characteristics (e.g., race, socioeconomic colleges that are located in 16 states through-
background, pre-college scores on each out the country. Institutions were chosen from
dependent measure), but also institutional the National Center for Education Statistics
characteristics (e.g., institutional type), other Integrated Postsecondary Education Data
college academic experiences (e.g., full- or System to represent differences in colleges and
part-time enrollment, coursework taken), and universities nationwide on such characteristics
other college non-academic experiences (e.g., as institutional type and control (e.g., private
work responsibilities, place of residence). and public research universities, private liberal
Because it takes into account an extensive set arts colleges, comprehensive universities,
of potential influences on the outcomes historically Black colleges, and community
considered, such an approach is likely to lead colleges), size, location, commuter versus
to a conservative estimate of the net impacts residential character, and ethnic distribution
of good practice dimensions (e.g., Bray et al., of the undergraduate study body. This
somewhat lower levels of pre-college cognitive Fuller detailed operational definitions can be
test scores (as measured by fall 1992 scores on found in Pascarella, Wolniak, Seifert, Cruce,
the CAAP reading comprehension, mathe- and Blaich (2005); Pierson, Wolniak, Pasca-
matics, and critical thinking modules), rella, and Flowers (2003); Wolniak, Pierson,
socioeconomic background, and academic and Pascarella (2001); and Whitt, Edison,
motivation than their counterparts who Pascarella, Terenzini, and Nora (2001).
persisted in the study. Yet students who Students’ educational aspirations were coded:
remained in the study and those who dropped 1 = Master’s degree or higher, 0 = Bachelor’s
out of the study but persisted at the institution degree or lower.
differed in only small, chance ways with
respect to pre-college cognitive test scores, Independent Variables
age, race, and socioeconomic background In selecting and creating the independent
(Pascarella, Edison, Nora, Hagedorn, & variables, we were guided by Chickering and
Terenzini, 1998). Gamson’s (1987) principles for good practice
in undergraduate education and by research
Dependent Variables on effective teaching and influential peer
The dependent variables for this study were interactions in college (Pascarella & Terenzini,
three standardized measures of the students’ 1991, 2005; Whitt et al., 1999). From the data
cognitive development (i.e., reading compre- available on the end-of-first-year CSEQ and
hension, mathematics knowledge, and critical NSSL follow-up questionnaires, we created 19
thinking skills), five measures of the students’ individual measures or scales of good practices
orientations to learning (i.e., openness to that may be grouped by the seven principles:
diversity and challenge, learning for self- 1. Student–faculty contact: faculty interest
understanding, internal locus of attribution for in teaching and student development,
academic success, preference for higher-order quality of non-classroom interactions with
cognitive tasks, and positive attitude toward faculty;
literacy), and a measure of the students’
2. Cooperation among students: instruc-
educational aspirations (i.e., graduate degree
tional emphasis on cooperative learning,
plans). The three cognitive development
course-related interaction with peers,
measures were each 40-minute, multiple
quality of interactions with students, non-
choice tests taken from the CAAP. The CAAP
course-related interactions with peers;
was developed by ACT to measure general
education skills and competencies acquired 3. Active learning/time on task: academic
during the first two years of college. Reli- effort/involvement, instructor use of high-
abilities of the tests range from .76 to .87 order questioning techniques, emphasis on
(American College Testing Program, 1990). high-order examination questions, essay
Fuller operational definitions of the three exams in courses, computer use;
cognitive measures can be found in Pascarella 4. Prompt feedback: instructor feedback to
et al. (1996) and Whitt et al. (1999). The five students;
measures of students’ orientations to learning
5. Time on task: instructional clarity,
have been employed as dependent measures
instructional organization/preparation;
in several other studies of college impact. Their
average reliabilities range from .65 to .83. 6. High expectations: course challenge/
TABLE 1.
Estimated Effects of Good Practice Dimensions on First-Year Outcomes
Beta Beta
Dependent Variable b (Odds Ratio) b (Odds Ratio)
TABLE 1. continued
a
Equations also include measures of the following pre-college characteristics: age; sex; race; parents’ education;
parents’ income; secondary school grades; high school involvement in studying, socializing with friends, talking
with teachers outside of class, exercising or playing sports, studying with friends, volunteer work, and
extracurricular activities; academic motivation; college choice; a parallel pre-college measure of each first-
year outcome; measures of institutional type; and all other good practice dimensions.
b
Equations include all variables shown in superscript “a” plus measures of full-time/part-time status; on- or off-
campus residence; hours worked per week off-campus; and number of first-year courses taken in five areas
(i.e., arts and humanities, social sciences, mathematics, natural sciences, and technical/pre-professional).
c
Odds ratios were recalculated to represent the change in odds of success given a one-standard deviation
change in the independent variable [i.e., exp(βx*SDx)].
*p < .01. **p < .001.
TABLE 2.
Estimated Effects of Composite Good Practices in Undergraduate Education
on First-Year Outcomes
Beta Beta
Dependent Variable b (Odds Ratio) b (Odds Ratio)
Cognitive Development
Reading Comprehension .005* .054 .004* .035
Mathematics Knowledge .003* .032 .002
Critical Thinking Skills .006* .059 .005* .046
Orientations to Learning
Openness to Diversity and Challenge .083** .202 .089** .215
Learning for Self-Understanding .022** .119 .024** .129
** **
Internal Locus of Attribution for Academic Success .021 .094 .023 .103
Preference for Higher-Order Cognitive Tasks .013* .085 .014** .090
Positive Attitude Toward Literacy .042** .157 .041** .154
Educational Aspirations
Plans for a Graduate Degree .015** (1.190) c .010** (1.123) c
a
Equations also include measures of the following pre-college characteristics: age; sex; race; parents’ education;
parents’ income; secondary school grades; high school involvement in studying, socializing with friends, talking
with teachers outside of class, exercising or playing sports, studying with friends, volunteer work, and
extracurricular activities; academic motivation; college choice; a parallel pre-college measure of each first-
year outcome; and measures of institutional type.
b
Equations include all variables shown in superscript “a” plus measures of full-time/part-time status; on- or off-
campus residence; hours worked per week off-campus; and number of first-year courses taken in five areas
(i.e., arts and humanities, social sciences, mathematics, natural sciences, and technical/pre-professional).
c
Odds ratios were recalculated to represent the change in odds of success given a one-standard deviation
change in the independent variable [i.e., exp(βx*SDx)].
*p < .01. **p < .001.
the model, the effect of Challenge/High variance among the three dimensions, a
Expectations on graduate degree plans became composite of the 19 good practice measures
statistically non-significant. was introduced into the total and direct effects
Collectively, the results in Table 1 suggest models in place of the three good practice
that, after taking into account other important dimensions. Table 2 provides a summary of
confounding influences on the students’ the results of these models.
cognitive development, learning orientations,
and graduate degree plans, many of the unique Composite Good Practices
effects of the good practice dimensions on As Table 2 illustrates, the composite good
student gains in these areas are statistically practice measure had a significant total and
significant, but relatively small. With the direct effect on reading comprehension and
exception of the students’ openness to diversity critical thinking skills, and had a significant
and challenge, there is very little overlap in total effect on mathematics knowledge during
the unique effects of the good practice the first year of college. After statistically
dimensions on the student outcomes studied. controlling for other academic and non-
This finding suggests that each good practice academic experiences during the first year,
dimension is not equally important in foster- however, the effect of the composite good
ing student success within different cognitive practices on mathematics knowledge became
and psychosocial areas. Yet, the fact that many statistically non-significant. The composite
of these effects persist in the presence of the good practice measure also had a significant
other good practice dimensions provides us total and direct effect on all of the measures
with clearer evidence that each good practice of the students’ orientations to learning and
dimension does offer a unique contribution, on the students’ plans to obtain a graduate
even if this contribution is neither consistent degree.
across student outcomes nor sizable in Overall, the global effects of the composite
magnitude. measure were somewhat larger than the net
Given our inclusion of the parallel pre- effects of the three good practice dimensions,
college measures of our outcome variables and suggesting some shared variance among the
the large number of pre-college and first year three dimensions on the student outcomes.
controls into the model, we anticipated that The global effects of the composite good
the estimates of the effects of the good practice practices measure, however, were still relatively
dimensions would be conservative. An addi- small in magnitude. Again, these conservative
tional explanation for the number of statisti- estimates are most likely due to our inclusion
cally non-significant effects and for the into the model of the parallel pre-college
relatively small magnitudes of statistically measures of our outcome variables and a large
significant effects is the moderately strong number of pre-college and first year controls.
correlations among the three good practice Consistent with the findings of the net effects
dimensions (r = .40–.48). The three good of the three good practice dimensions, the
practice dimensions were entered into the magnitudes of the effects of the composite
models simultaneously, and thus the shared good practices on the measures of the students’
impact of these dimensions on the outcomes orientations to learning were somewhat larger
was not represented by the model coefficients. than the magnitudes of the effects on the mea-
To account for both the unique and shared sures of the students’ cognitive development.
376
Estimated Conditional Effects of Good Practices in Undergraduate Education on First-Year Outcomesa
Cognitive Development
Reading Comprehension
Men .007
Women .019** .096
Above Mean of Pre-College Reading Comprehension .004
Below Mean of Pre-College Reading Comprehension .025** .163
Mathematics Knowledge
Men –.012* –.058 .021* .068
Women .081* .042 .002
Above Mean of Pre-College Mathematics Knowledge –.003
Below Mean of Pre-College Mathematics Knowledge .085** .125
Community College .034* .134
Historically Black College –.021
Liberal Arts College –.012
Regional Institution .003
Research University .005
Critical Thinking Skills
Above Mean of Pre-College Critical Thinking Skills –.001
Below Mean of Pre-College Critical Thinking Skills .019* .089
Orientations to Learning
Learning for Self-understanding
Above Mean of Pre-College Learning
for Self-Understanding .034** .115
Below Mean of Pre-College Learning
for Self-Understanding –.012
table continues
TABLE 3. continued
Estimated Conditional Effects of Good Practices in Undergraduate Education on First-Year Outcomesa
◆ VOL
Beta Beta Beta Beta
Dependent Variable b (Odds Ratio) b (Odds Ratio) b (Odds Ratio) b (Odds Ratio)
47 NO 4
Good Practices During the First Year
Orientations to Learning
Positive Attitude Toward Literacy
Men –.021 .177** .244
Women .036* .070 .042
Student of Color .060* .113 .057** .204
White Student –.032 .026* .099
Community College .165** .269 .049** .210
Historically Black College .256** .278 .099** .313
Liberal Arts College .055 .008
Regional Institution .084* .114 .052** .188
Research University .121* .151 .047* .157
Educational Aspirations
Plans for a Graduate Degree
Community College –.027
Historically Black College –.108
Liberal Arts College .005
Regional Institution .016
Research University .054* (1.284)b
a
Equations include controls for all “main-effects” variables indicated in footnote “b” of Tables 2 and 3.
b
Odds ratios were recalculated to represent the change in odds of success given a one-standard deviation change in the independent variable [i.e.,
exp(âx*SDx)].
*p < .01. **p < .001.
377
Cruce, Wolniak, Seifert, & Pascarella
institution types but liberal arts colleges. undergraduate education on the cognitive
Finally, the effects of the good practice development, orientations to learning, and
dimensions and the composite good practices educational aspirations of students during
measure differed by the students’ gender and their first year of college. Analyses of longi-
ethnicity. Although Effective Teaching and tudinal data from 23 institutions located in
Interaction with Faculty had a significant effect 16 states from around the country were
on the first-year reading comprehension, conducted. The longitudinal data permitted
mathematics knowledge, and positive attitude us to introduce statistical controls for an
toward literacy of females, the effects of this extensive battery of student pre-college char-
good practice dimension on the reading acteristics and other confounding influences
comprehension and positive attitude toward during the first year of college. The results of
literacy of males were non-significant, and, in our analyses suggest several conclusions.
the case of mathematics knowledge, the effect First, our study presents consistent
of this good practice dimension was significant evidence that these principles for good
and negative. That the effect of this good practices in undergraduate education have a
practice dimension on the mathematics significant positive impact on the cognitive
knowledge of students was statistically development, learning orientations, and
significant and in the opposite direction for educational aspirations of students, at least
females and males may also explain why its during the first year of college. Gains during
general effect was statistically non-significant the first year in these three areas were not
(see Table 2). Interaction with Peers had a merely a function of such characteristics of the
significant effect on the first-year reading students as academic ability, academic moti-
comprehension of males, whereas the Chal- vation, secondary school achievement, or
lenge/High Expectations of faculty had a family background, nor were they merely a
significant effect on the first-year positive function of the type of institution attended
attitude toward literacy of males. For both or of other confounding college experiences
student outcomes, the effects of these good such as the number of credit hours taken, on-
practices were statistically non-significant for or off-campus residence, or the number of
females. With regard to ethnicity, Effective hours worked off-campus. Though relatively
Teaching and Interaction with Faculty and the small in magnitude, the statistically significant
good practices composite both had a signi- positive effects of the three good practice
ficant positive effect on the positive attitude dimensions and of the good practices com-
toward literacy of students of color. The effect posite almost always persisted in the presence
of Effective Teaching and Interaction with of controls for these other influences.
Faculty on the positive attitude toward literacy Second, our study provided evidence that
of White students was non-significant, whereas the ties are stronger between these principles
the effect of the good practices composite was for good practice and the students’ orientations
positive and significant but roughly half the to learning than between the principles for
size of the effect for students of color. good practice and the students’ cognitive gains.
Although the betas for the direct effects of the
DISCUSSION three good practice dimensions on the
The primary purpose of this study was to measures of cognitive development ranged
estimate the effects of good practices in between .034 and .073, the betas for direct
tor feedback to students are competencies and learning may be an important supplement to
behaviors that faculty can learn. Similarly, such other programmatic interventions (e.g., bridge
aspects of Challenge/High Expectations as use programs, first-year seminars, or support
of essay exams and high-order exam questions, services) that focus on the academic success
and number of reading and writing assign- and retention of students who enter college
ments are all aspects of an institution’s with less preparation. A greater emphasis on
academic culture that are subject to the the implementation of these good practices
influence of faculty decision—provided, of within remedial programs could increase the
course, that the faculty are willing to accept effectiveness of these programs toward the
the increased work load potentially involved academic adjustment of entering students.
with such approaches. The time and effort A final policy implication derives from the
expended by faculty members to enhance their fact that the estimated positive effects of the
teaching competence comes at the expense of good practices composite were generally larger
time and effort used in other, potentially more and more extensive than any of the three
institutionally rewarded, areas, such as subscales of good practices (i.e., Effective
research. In order for faculty members to Teaching and Interaction with Faculty,
choose to increase their effectiveness in the Interaction with Peers, Challenge/High
classroom and interact more frequently with Expectations). This suggests that what may
students, promotion and tenure may need to really matter in terms of the quality of
better reflect these good practices as insti- undergraduate education is an institutional
tutional values. ethos or culture that implements good
Second, the finding that the unique practices, not as isolated programs or experi-
contributions of the good practice dimensions ences, but rather in a broad-based and
were inconsistent across student outcomes and integrated manner. In this way such practices
varied by student background presents further as experienced by students may be mutually
evidence of the need for multiple approaches reinforcing in their impact on growth during
to teaching and learning both inside and college. Thus, good practices in undergraduate
outside of the classroom. A synthesis of the education serve as a foundational component
research on the impacts of college conducted in creating the supportive social psychological
during the decade of the 1990s found that the environment, which has long been found to
implementation of a variety of instructional enhance student growth (Astin, 1993; Pasca-
and learning approaches enhances the develop- rella & Terenzini, 1991, 2005). Institutions
ment of students well beyond traditional that are committed to improving under-
approaches alone (Pascarella & Terenzini, graduate education should consider the role
2005). Indeed, our findings suggest that that the integration of these good practices
multiple approaches to teaching and learning plays when creating such an environment.
will broaden the impact of these good practices
with regard to both the groups of students who LIMITATIONS
benefit from them and the cognitive and
psychosocial areas in which the students Clearly the results of this investigation are
develop. Moreover, given evidence of the limited by the nature of the sample. The NSSL
compensatory effects of these good practices, chose to study the effects of a wide range of
applying multiple approaches to teaching and student experiences, in substantial depth, over
time. This meant a limit on the number of longitudinal study that the possible changing
institutions studied. Consequently, the nature of the impacts of good practices on stu-
findings may not be generalized to all insti- dent development can be better understood.
tutions in the country. The findings of the
study are limited also by our operational CONCLUSION
definitions of good practices in undergraduate
education. Although we were guided by To our knowledge, this study provides the first
existing evidence on empirically vetted test of both the unique and global effects of
indicators of good practice dimensions, our measures of the seven principles for good
operational definitions of variables were educational practice on the cognitive develop-
limited by the data we analyzed. Certainly ment, orientations to learning, and graduate
there are other equally valid measures of good degree plans of a sample of students that
practices that might have yielded somewhat approximates the national population of
different results than the present investigation. college students, while providing stringent
Third, the findings are limited by attrition statistical controls for the students’ pre-college
from the sample during the first year of the cognitive development, learning orientations,
study. Despite our weighting of the sample to graduate degree plans, and a number of other
make it more representative of the population pre-college and college confounding influ-
at the end of the first year, the potential for ences. Two major conclusions can be derived
some selection bias is a clear limitation of the from this study. First, overall good practices
study. have a positive influence on the students’
Finally, the study is limited by the fact that cognitive growth and orientations to learning,
the data were collected in the 1990s. Weighed net of the students’ pre-college development,
against this, however, are the longitudinal learning orientations, and educational aspira-
nature of the NSSL data and the richness of tions; the type of college that they attended;
the variables measured. We know of no other and their other academic and nonacademic
existing longitudinal data that permits one to experiences during the first year of college.
introduce extensive controls for important Second, the effects of these good practices are
confounding influences while at the same time more complex than our first conclusion
provides such an extensive array of reliable and suggests. Specific dimensions of good practices
valid measures of good practices in under- have differential effects on the developmental
graduate education. It is worth mentioning, outcomes studied, and the magnitude of these
however, that the National Study of Liberal effects also differs by the students’ background
Arts Education, a large-scale longitudinal characteristics and pre-college development,
study funded by the Wabash College Center and by the institution attended.
of Inquiry in the Liberal Arts will begin in the
fall of 2006. This new study will address many Correspondence concerning this article should be
addressed to Ty M. Cruce, National Survey of Student
of the impacts of good practices estimated in
Engagement, Center for Postsecondary Research, Indiana
the present investigation (Wabash College University Bloomington, 1900 East Tenth Street,
Center of Inquiry in the Liberal Arts, 2005), Eigenmann Hall Suite 419, Bloomington, IN 47406-
and it is with the findings of this new 7512; tcruce@indiana.edu
REFERENCES
American College Testing Program (ACT). (1990). Report on Chickering and Z. F. Gamson (Eds), Applying the seven
the technical characteristics of CAAP; Pilot year 1: 1988–89. principles for good practice in undergraduate education. New
Iowa City, IA: Author. Directions for Teaching and Learning, No. 47 (pp. 5-12).
Anaya, G. (1999, April). Within-college, curricular and co- San Francisco: Jossey-Bass
curricular correlates of performance on the MCAT. Paper Grayson, J. (1999). The impact of university experiences on
presented at the annual meeting of the American Educa- self-assessed skills. Journal of College Student Development,
tional Research Association, Montreal, Canada. 40, 687–699.
Arnold, J., Kuh, G., Vesper, N., & Schuh, J. (1993). Student Hagedorn, L., Siadat, M., Nora, A., & Pascarella, E. (1997).
age and enrollment status as determinants of learning and Factors leading to gains in mathematics during the first year
personal development at metropolitan institutions. Journal of college. Journal of Women and Minorities in Science and
of College Student Development, 34, 11–16. Engineering, 3(3), 185–202.
Astin, A. (1993). What matters in college? San Francisco: Jossey- Hake, R. (1998). Interactive-engagement versus traditional
Bass. methods: A six-thousand-student survey of mechanics test
Baxter Magolda, M. (1992). Knowing and reasoning in college: data for introductory physics courses. American Journal of
Gender related patterns in students’ intellectual development. Physics, 66(1), 64–74.
San Francisco: Jossey-Bass. Johnson, D., Johnson, R., & Smith, K. (1998a). Active
Bray, G., Pascarella, E., & Pierson, C. (2004). Postsecondary learning: Cooperation in the college classroom (2nd ed.).
education and some dimensions of literacy development: Edina, MN: Interaction Book.
An exploration of longitudinal evidence. Reading Research Johnson, D., Johnson, R., & Smith, K. (1998b). Cooperative
Quarterly, 39, 306–330. learning returns to college. Change, 30(4), 26–35.
Cabrera, A., Crissman, J., Bernal, E., Nora, A., Terenzini, P., Johnstone, K., Ashbaugh, H., & Warfield, T. (2002). Effects
& Pascarella, E. (2002). Collaborative learning: Its impact of repeated practice and contextual-writing experiences on
on college students’ development and diversity. Journal of college students’ writing skills. Journal of Educational
College Student Development, 43(1), 20–34. Psychology, 94(2), 305–315.
Chickering, A., & Ehrmann, S. (1996). Implementing the King, P., & Kitchner, K. (1994). Developing reflective judgment.
seven principles: Technology as a lever. AAHE Bulletin, San Francisco: Jossey-Bass.
49(2), 3–6. Kitchener, K., Wood, P., & Jensen, L. (2000, August).
Chickering, A., & Gamson, Z. (1987). Seven principles for Promoting epistemic cognition and complex judgment in college
good practice in undergraduate education. AAHE Bulletin, students. Paper presented at the annual meeting of the
39(7), 3–7. American Psychological Association, Washington, DC.
Chickering, A., & Gamson, Z. (1999). Development and Kuh, G. (2001). Assessing what really matters to student
adaptations of the seven principles for good practice in learning: Inside the National Survey of Student Engage-
undergraduate education. New Directions for Teaching and ment. Change, 33(3), 10–17, 66.
Learning, 80, 75–81. Kuh, G., & Hu, S. (1999, November). Is more better? Student-
Chickering, A., Gamson, Z., & Barsi, L. (1989). Inventories faculty interaction revisited. Paper presented at the annual
of good practice in undergraduate education. Winona, MN: meeting of the Association for the Study of Higher
Seven Principles Resource Center, Winona State University. Education, San Antonio, TX.
Chickering, A., & Reisser, L. (1993). Education and identity Kuh, G., Pace, C., & Vesper, N. (1997). The development of
(2nd ed.). San Francisco: Jossey-Bass. process indicators to estimate student gains associated with
d’Apollonia, S., & Abrami, P. (1997). Navigating student good practices in undergraduate education. Research in
ratings of instruction. American Psychologist, 52, 1198–1208. Higher Education, 38, 435–454.
Ethington, C. (1998, November). Influences of the normative Kuh, G., & Vesper, N. (1997). A comparison of student
environment of peer groups on community college students’ experiences with good practices in undergraduate education
perceptions of growth and development. Paper presented at between 1990 and 1994. Review of Higher Education, 21,
the annual meeting of the Association for the Study of 43–61.
Higher Education, Miami, FL. Kuh, G., Schuh, J., Whitt, E., & Associates. (1991). Involving
Facione, P., Sanchez, C., Facione, N., & Gainen, J. (1995). colleges. San Francisco: Jossey-Bass.
The disposition toward critical thinking. Journal of General Lang, M. (1996). Effects of class participation on student
Education, 44, 1–25. achievements and motivation. Unpublished honors thesis,
Feldman, K. (1997). Identifying exemplary teachers and University of Western Ontario, London, Ontario.
teaching: Evidence from student ratings. In R. Perry & J. Murray, H., & Lang, M. (1997). Does classroom participation
Smart (Eds.), Effective teaching in higher education: Research improve student learning? Teaching and Learning in Higher
and practice (pp. 368–395). Edison, NJ: Agathon Press. Education, 20(Feb.), 7–9.
Frost, S. (1991). Fostering the critical thinking of college National Survey of Student Engagement. (2003). Converting
women through academic advising and faculty contact. data into action: Expanding the boundaries of institutional
Journal of College Student Development, 32, 359–366. improvement. Bloomington, IN: Indiana University Center
Gamson, Z. (1991). A brief history of the seven principles for Postsecondary Research.
for good practice in undergraduate education. In A. W.
Pace, C. (1990). College Student Experiences Questionnaire (3rd Pierson, C., Wolniak, G., Pascarella, E., & Flowers, L. (2003).
ed.). Los Angeles: University of California, Center for the Impacts of 2-year and 4-year college attendance on learning
Study of Evaluation, Graduate School of Education. orientations. Review of Higher Education, 26, 299–321.
Pascarella, E. (1985). College environmental influences on Qin, Z., Johnson, D., & Johnson, R. (1995). Cooperative
learning and cognitive development: A critical review and versus competitive efforts and problem solving. Review of
synthesis. In J. Smart (Ed.), Higher education: Handbook Educational Research, 65, 129–143.
of theory and research (Vol. 1). New York: Agathon. Sorcenelli, M. (1991). Research findings on the seven
Pascarella, E. (2001). Using student self-reported gains to principles. New Directions for Teaching and Learning, 47,
estimate college impact: A cautionary tale. Journal of College 13–25.
Student Development, 42(5), 488–492. Terenzini, P., Springer, L., Yaeger, P., Pascarella, E., & Nora,
Pascarella, E., Cruce, T., Umbach, P., Wolniak, G., Kuh, G., A. (1994). The multiple influences on students’ critical
Carini, R., Hayek, J., Gonyea, R., & Zhao, C. (2006). thinking skills. Paper presented at the annual meeting of
Institutional selectivity and good practices in undergraduate the Association for the Study of Higher Education,
education: How strong is the link? The Journal of Higher Orlando, FL.
Education, 77, 251-285. Umbach, P., & Kuh, G. (2003, May). Student experiences with
Pascarella, E., Edison, M., Nora, A., Hagedorn, L., & Braxton, diversity at liberal arts colleges: Another claim for distinction.
J. (1996). Effects of teacher organization/preparation and Paper presented at the annual meeting of the Association
teacher skill/clarity on general cognitive skills in college. for Institutional Research, Tampa, FL.
Journal of College Student Development, 37, 7–19. Wabash College Center of Inquiry in the Liberal Arts. (2005).
Pascarella, E., Edison, M., Nora, A., Hagedorn, L., & National Study of Liberal Arts Education, Retrieved
Terenzini, P. (1998). Does work inhibit cognitive develop- February 15, 2005, from http://liberalarts.wabash.edu/
ment during college? Educational Evaluation and Policy nationalstudy
Analysis, 20(2), 75–93. Watson, L., & Kuh, G. (1996). The influence of dominant
Pascarella, E., Palmer, B., Moye, M., & Pierson, C. (2001). race environments on students’ involvement, perceptions,
Do diversity experiences influence the development of and educational gains: A look at historically Black and
critical thinking? Journal of College Student Development, predominantly white liberal arts institutions. Journal of
42(3), 257–271. College Student Development, 37, 415–424.
Pascarella, E., & Terenzini, P. (1991). How college affects Weidman, J. (1989). Undergraduate socialization: A con-
students. San Francisco: Jossey-Bass. ceptual approach. In J. Smart (Ed.), Higher education:
Pascarella, E. & Terenzini, P. (1998). Studying college students Handbook of theory and research (Vol. 5, pp. 289–322). New
in the 21st century: Meeting new challenges. Review of York: Agathon.
Higher Education, 21, 151–165. Whitmire, E., & Lawrence, J. (1996, November). Under-
Pascarella, E., & Terenzini, P. (2005). How college affects graduate students’ development of critical thinking skills: An
students (Vol. 2): A third decade of research. San Francisco: institutional and disciplinary analysis and comparison with
Jossey-Bass. academic library use and other measures. Paper presented at
Pascarella, E., Wolniak, G., Cruce, T., & Blaich, C. (2004). the annual meeting of the Association for the Study of
Do liberal arts colleges really foster good practices in Higher Education, Memphis, TN.
undergraduate education? Journal of College Student Whitt, E., Edison, M., Pascarella, E., Nora, A., & Terenzini,
Development, 45, 57–74. P. (1999). Interactions with peers and objective and self-
Pascarella, E., Wolniak, G., Seifert, T., Cruce, T., & Blaich, reported cognitive outcomes across three years of college.
C. (2005). Liberal arts colleges and liberal arts education: Journal of College Student Development, 40, 61–78.
New evidence on impacts. San Francisco: Jossey-Bass/ASHE. Whitt, E., Edison, M., Pascarella, E., Terenzini, P., & Nora,
Perry, W. (1970). Forms of intellectual and ethical development A. (2001). Influences on students’ openness to diversity in
in the college years. New York: Holt, Rinehart, & Winston. the second and third years of college. Journal of Higher
Perry, W. (1981). Cognitive growth and ethical growth: The Education, 72, 172–204.
making of meaning. In A. Chicerking (Ed.), The modern Wolniak, G., Pierson, C., & Pascarella, E. (2001). Effects of
American college (pp.76–116). San Francisco: Jossey-Bass. intercollegiate athletic participation on male orientations
toward learning. Journal of College Student Development, 42,
604–624.