You are on page 1of 9

QUANTITATIVE METHODS IN PSYCHOLOGY

Correlation and the Coefficient of Determination


Daniel J. Ozer
Boston University

It is common practice in psychological statistics to use the square of the correlation


as a coefficient of determination or a percentage measure of variance accounted
for. This use of the correlation coefficient requires the adoption of a particular
model and attendant assumptions. In a variety of circumstances where the square
of the correlation coefficient is used, the required assumptions are not tenable.
An alternative, less well-known interpretation of the correlation coefficient is
described. In this model, the absolute value of the correlation provides a coefficient
of determination. Similarities and differences between these two models are
described, and conditions for the appropriate use of each model are discussed.
The correlation coefficient and not the correlation squared is recommended for
use as an effect size indicator, because evaluating effect size in terms of variance
accounted for may lead to interpretations that grossly underestimate the magnitude
of a relation.

Pearson coefficients of correlation and other of effect size, their interpretation is at times
derivative statistics (e.g., phi, point-biserial difficult. O'Grady (1982) described several
correlations) are used with considerable fre- problems associated with measures of ex-
quency in the analysis of psychological data. plained variance, noting that measurement
One reason for computing these statistics is error, features of the research design, and the
to determine the size or magnitude of the multiplicity of behavioral causes may limit
relation between two variables. When used the magnitude of such statistics. Sechrest and
for this purpose, it is common to use the Yeaton (1981, 1982) provided a detailed ex-
square of the correlation coefficient as an amination of effect size estimation issues.
index of the size of the relation. This index, They reviewed several methods of estimating
referred to by Guilford (1936) as the coeffi- the amount of explained variance and dem-
cient of determination, is interpreted as the onstrated how these procedures yield esti-
percentage of variance in one variable that is mates that are unlikely to be generalizable to
predicted or explained by the other. Amount situations that differ from the initial research
of explained variance is one way of expressing design and measurement context.
the degree to which some relation or phe- One may also question whether the amount
nomenon is present—what Cohen (1969) re- of variance accounted for is always an appro-
fers to as effect size. Effect size estimation is priate metric for assessing effect size. D'An-
an important concern, providing a basis for
evaluating the effectiveness of an experimental drade and Dart (1983) criticized the routine
treatment or perhaps even the success of a and common use of r2 as a measure of degree
basic research program. of association. Their arguments were based
Although measures of explained variance in part upon a rejection of the variance as
appear to be intuitively meaningful measures an appropriate measure of variation in a set
of scores. Instead of variance, which is based
upon the sum of squared deviations from the
The author thanks David Ems, Ralph D'Agostino, mean, D'Andrade and Dart suggested that
Kevin Lanning, Howard Terry, and two anonymous the sum of absolute deviations from the mean
reviewers for their comments on the manuscript. is a better measure of variation. They then
Requests for reprints should be sent to Daniel J. Ozer,
Department of Psychology, Boston University, 64 Cum- demonstrated that r, not r2, provides a close
mington Street, Boston, Massachusetts 02215. fit to the proportion of variation accounted
Psychological Bulletin, 1985, Vol. 97, No, 2, 307-315
Copyright 1985 by the American Psychological Association, toe, 0033-2909/85/$00,75

307
308 DANIEL J. OZER

for. D'Andrade and Dart concluded that r is


the more appropriate measure of association.
In this article, I demonstrate that D'An-
drade and Dart's conclusion does not require
rejecting the variance as a measure of varia-
tion. I describe instead a second model for
interpreting correlation. The purpose of this
article is to provide a simple presentation of
two models for interpreting the correlation
coefficient in terms of degree of determination
of one variable by another. In one, r2 provides
Figure 1. Standard interpretation of r^ = .50.
a coefficient of determination; in the other,
the absolute value of r provides a coefficient
of determination. Appropriate applications A very few sources (Cattell, 1957; Tryon,
of each of these models are discussed. 1929; Wiggins, 1973) have presented a com-
Certain inappropriate applications of r2 as parable yet different interpretation, as de-
a coefficient of determination are already picted in Figure 2. In this alternative inter-
recognized in some specialized contexts. For pretation, Txy = .5 has three possible meanings:
example, neither reliability coefficients (e.g., x is a part of y such that x comprises 25%
correlations between parallel tests) nor genetic of y (as in View A); y is a part of x such that
correlations (e.g., correlations between iden- y comprises 25% of x (as in View B); or that
tical twins reared apart) are squared prior to some portion of both x and y is common to
interpreting their size. In these two instances, both x and y, and this portion comprises
a different model, with different assumptions, 50% of both x and y (as in View C).
is being used. Although virtually no assump- Inspection of Figure 1 and View C of
tions need to be satisfied to compute a cor- Figure 2 suggests a fundamental incompati-
relation coefficient (Binder, 1959), particular bility between the standard and alternative
interpretations of the correlation require par- interpretations of correlation. Is the region of
ticular assumptions. For example, a correla- intersection or amount of determination of y
tion coefficient permits the prediction of a by x 25% or 50%? At issue here is not
score on one standardized variable from an- whether the equality r2 = ffy2/ay2 is always
other, but this prediction will be meaningful true. This equality is a definitional necessity.
only if the relation between the two variables The question is whether or not this equality
is approximately linear. What is not generally always permits an interpretation of r2 as a
recognized is that interpreting r2 as a coeffi- coefficient of determination or as defining
cient of determination also requires certain the region of intersection.
assumptions and the acceptance of a partic-
ular model. Correlation and Common Elements
The issues pertaining to whether r or r2
Models for Interpreting Correlation provides a coefficient of determination are
Coefficients most simply viewed through the common
One common way of describing a correla- elements interpretation of correlation (Guil-
tion between two variables, x and y, is to ford, 1936, pp. 364-366). The actual appli-
suggest an analogy with the concept of inter- cation of the common elements interpretation
section in set theory. This analogy leads to is appropriate only in circumstances rare in
the production of a Venn diagram as shown psychology: Each variable must be viewed as
in Figure I. 1 The region of intersection is an unweighted sum of elements that are
identified as r2, because of the identity: r2 = either present or absent. In such a circum-
<ry2/ffy2. This standard interpretation of cor-
relation is developed in this manner in a 1
This Venn diagram and others to follow are used for
number of widely respected texts (e.g., Cohen their heuristic value for representing correlation—they
& Cohen, 1975; Kerlinger, 1973). do not provide a literal model.
CORRELATION AND DETERMINATION 309

Figure 2. Alternative interpretation of r^ = .50.

stance, the correlation coefficient may be determination of variable y by variable x is


expressed as the ratio of number of elements common to
x and y to the total number of elements in
(1) y. nc/(nc + ny). Likewise, the percent deter-
mination of x by y is nc/(nc + nx).
where nx is the number of elements present If ny = 0, so that all the elements in y are
included in x, then
in variable x but absent in variable y, ny is
the number of elements present in variable y
but absent in variable x; and nc is the number (2)
of elements present in both variables x and
y (the common elements). which reduces to r^2 = nc/(nx + nc). When
One example where this formula may be x includes all the elements of y, r2 provides
properly invoked is in evaluating the corre- the percent determination of x by y. However,
lation between two scales containing one or in this instance, the determination of y by
more identical items scored in the same x is «c/(0 + «c) = 1. At least under the
direction. In this instance, the expected cor- common elements interpretation of correla-
relation between the scales will not be zero. tion, the use of r2 as a coeffiient of determi-
The common elements formula allows one nation of y by x implies that the degree of
to determine the correlation between the determination of x by y is unity.
scales that can be expected due to item The situation is different if nx = ny:
overlap.
The common elements interpretation pro- (3)
vides a simple formalization of correlation: nc
the ratio of the number of common elements and
in variables x and y to the geometric mean
of the total number of elements in jc and y.
The common elements nomenclature also (4)
allows a simple formalization of the coefficient
of determination as a percentage. The percent If nx = ny, r and not r 2 is the percent of
310 DANIEL J. OZER

determination of either variable through their


shared elements. Jensen (1971) used the com-
mon elements algebra in this way to demon-
strate why correlations between relatives pro-
vide direct estimates of the proportion of
common variance.2
Application of the common elements in-
terpretation leads to several observations
about the coefficient of determination, denned
as the ratio of common to total elements:
1. r2 is the percent of determination of y Figure 3. Tryon's (1929) partitioning of two variables.
by x if and only if all elements of x are
included in y. into two independent portions: a part com-
2. r is the percent of determination of y mon to both x and y (namely c) and residual
by x if and only if x and y have an equal portions a and b. Tryon first provided a proof
number of elements. that rby + rcy2 and r^2 + r are both equal
3. Algebraic manipulation of Equation 1 to 1. He then noted that rcy = rxy.a, where
reveals that r is equal to the geometric mean Txy.a is the partial correlation between x and
of the two coefficients of determination (y y with a removed, so rxy.a2 + rby 2 =
by x and x by y): Expanding the partial correlation term,

The result expressed in Point 2 is only and because ray = 0,


rarely mentioned in discussions of the prop-
erties of coefficients of correlation. It is at 2 _
(7)
odds with standard definitions of the coeffi-
cient of determination as the ratio of predicted
variance to total variance. Because the com- 'xy
mon elements interpretation is rarely appro- (8)
priate in most contexts where the correlation
coefficient is applied, it may be useful to Because r^2 + rcx2 = 1, r^ = 1 —
discover if the conclusions about the coeffi- Equation 8, by substitution, becomes
cient of determination previously derived can j. » 2 _ i
be generated without reference to the common (9)
elements interpretation of correlation. That is, r^lra is the percent of y determined
by x through c, and rby2 is the percent of y
Determination and Suppression determined by residual factors. Thus, r^,2
will be the percent determination of y by x
Tryon (1929) provided an interpretation of if and only if rc2 = 1, when c is x, as in
the correlation coefficient entirely consistent Figure 2, View A (i.e., when the residual area
with the conclusions noted previously. It is of x, namely a, is null).
of some historical interest to note that the Because 1 - r^2 = r^2, Equation 9 becomes
basis of Tryon's derivations lies in the logic
of suppression as it is conceived of in regres-
sion analysis. Although the first elucidation
of suppression is generally credited to Horst's 2
Jensen's additional assertion that the proportion of
(1941) contribution, Tryon's work clearly in- common variance in identical twins reared apart provides
dicates an earlier anticipation of the phenom- a heritability coefficient has been criticized by Miller and
enon. Levine (1973). These authors noted that this claim for
equivalence requires several additional assumptions, such
Tryon considered a situation depicted in as no genotype-environment covariance and uncorrelated
Figure 3. Variables x and y are each divided environments among twin pairs.
CORRELATION AND DETERMINATION 311

interpretation leads to a definition of the


(10)
coefficient of determination as r2, due to the
'ex
equality r = ay2/a2. The logic of an alter-
2

(the determination of y by x through c), so native interpretation has been elaborated us-
fxv2 = T^rJ- and ing the common elements interpretation of
correlation and Tryon's anticipation of the
concept of suppression. In View A and View
This last result is revealing; it parallels B of Figure 2, both the standard and alter-
results obtained in the common elements native accounts agree that r2 provides the
interpretation. The correlation between two coefficient of determination. But what of the
variables is the geometric mean of the two situation depicted in Figure 1, Figure 2 (View
coefficients of determination, as shown in C), and Figure 3? Is the region of overlap of
Equations 5 and 1 1 . If Regions A and B in x and y equal to r or r2? This area of overlap,
Figure 3 are equal (i.e., if the variances of x Region C in Figure 3, is the covariance of x
and y are equal), then r^ = rcy2 = rxy. As in' and y. Regions A, B, and C each have been
the common elements interpretation, if x and defined as independent of one another, so
y are the same size, then r and not r 2 provides
the coefficient of determination. This is ap- and a2 = aa +
parent from Equation 1 1 : If r^2 - rcy2, then

In Tryon's treatment of determination, if The covariance of x and y is then


one is interested in the determination of y
by x, the portion of x unrelated to y (Region (12)
A in Figure 3) is treated as a suppressor ff
Oxy ~ ab (13)
variable. The magnitude of this residual area
of x clearly affects the magnitude of rxy, but and because aab = = 0,
does not affect the coefficient of determination = (14)
of y by x. From Equation 1 1 one can see
that Txy = rcjcy. This result is basic to factor The variance of Region C in Figure 3 is the
analysis, where the correlation between two covariance of x and y. If scores are standard-
variables is the sum of the products of cor- ized, then the area of Region C must be equal
responding factor pattern coefficients, which to r and not r2. If the variances of x and y
are the correlations between the variables and are equal, then r is the percent of determi-
the factors. In the two-variable case, there is nation of y by x. But even if the x and y
but one common factor, so the correlation variances are unequal, there is still a simple
between x and y is the product previously percentage interpretation for r. The absolute
shown. value of the correlation coefficient expresses
This same logic provides the reason for the percent of the maximum possible covari-
not squaring reliability coefficients. In classical ance that is actually obtained. Because
test theory, if x and y are parallel tests, then „ __ // \ / I C\

the correlation between true scores and tests


x and y must be equal (rxt = ry,\ and the it is clear that when a correlation is unity the
covariance is equal to the product of standard
product of these correlations is equal to the
correlation between x and y: rxy = rxtryt. deviations. The correlation is then the ratio
of the obtained to maximum possible covari-
Because rxt = r^, then r^ = rxt2. The corre-
ance.
lation between parallel tests is the percent of
true score variance. Jensen (1980, Note 6, pp. 252-256) pro-
vided an alternative proof of this result. His
Determination: Predicted Variance method clarified the percentage interpreta-
or Covariance? tions of both r and r2. The percent of variance
in one variable that can be predicted from a
Two interpretations of correlation were second variable is r2. The percent of variance
presented in Figures 1 and 2. The standard common to two variables is r.
312 DANIEL J. OZER

On Using r and r2 A frequent application of the correlation


coefficient is to evaluate the relation between
The preceding discussion suggested that two measures. In this kind of task, the use
without a theoretical or conceptual basis for of r2 as a coefficient of determination has
specifying a relation between x and y, nothing historically been common. This type of usage
can be asserted about the degree of determi- is incorrect, because the underlying model
nation. It is often reasonable to assume some- fails to conform to the conditions noted
thing about this relation. Tryon (1929) offered previously.
as an example the relation between speed Mischel's (1968) characterization of Hart-
and accuracy on a task. One might specify shorne and May's research provides a well-
that the total time is the sum of time spent known case. In this data, cheating by copying
making incorrect choices plus the time spent from an answer key correlated with cheating
making correct choices. In this instance, a by adding on scores on a speed test at .292
measure of accuracy provides an estimate of (Mischel, 1968, p. 24). Mischel viewed this
time spent making correct choices and may coefficient as a typical cross-situational con-
be viewed as a portion of what is measured sistency coefficient obtained in personality
by speed. The appropriate estimate of the research. In Mischel's description, such a
percent determination of speed by accuracy coefficient "accounts for less than 10% of the
through their common variance is r2. When- relevant variance" (1968, p. 38). The preced-
ever variance decomposition of the dependent ing discussion should make it clear that Mis-
variable is the goal of the analysis, r2 provides chel misspecified the trait model. A trait
the coefficient of determination, with one model does not suggest that copying is a part
statistical caveat: The predictor variable of (or a cause of) adding on scores, nor does
should first be corrected for attenuation. This it assert the reverse. Most trait models suggest
is required by the model, which assumes that that some latent variable underlies scores on
all of the variance in the predictor variable both measures; and that the latent variable
is included in the criterion variable. By defi- is responsible for the covariance between the
nition, the error variance in the predictor is measured variables. In this model, the cor-
not so included. Whenever r2 is used as the relation coefficient itself provides the appro-
coefficient of determination, failure to correct priate coefficient of determination: 29.2% of
the predictor variable for attenuation due to the variance in both copying and adding on
unreliability is ipso facto a misspecification scores is held in common. If other sources of
of the model. No such imperative applies on covariation such as method variance can be
the criterion side—the model is neutral such ruled out, one may conclude that a latent
that one may choose to partition either total variable—cheating—accounts for nearly 30%
variance of the criterion (and correct the of the variance in these two measured vari-
correlation for attenuation on only the pre- ables. This is not determination of one vari-
dictor side) or only the reliable criterion able by another, but determination of mea-
variance (by correcting for attenuation on sured variables by a latent variable.
both sides). This interpretation requires that one be
Variance decomposition conforms to the indifferent to the relative variances of the two
standard model described earlier where r2 is measures. One assumes that the variances
the coefficient of determination. Variance either are in fact equal, or that no information
partitioning as described here requires one to of interest is carried by the differences in
invoke a model that identifies the predictor variance. Whenever one uses a correlational
or independent variable as a fully contained statistic a tacit indifference to variance has
part of a larger, more inclusive, dependent or already become influential. Correlation coef-
criterion variable. But this model is not always ficients are insensitive to the relative sizes of
appropriate. There are a variety of other uses the variances of the measures being correlated.
of correlation, and in many the absolute Use of a correlation coefficient generally im-
value of r should be interpreted as the coef- plies that differences in the variances of the
ficient of determination. Two other uses of variables are of little concern. If this view is
correlation are considered. unwarranted, then the correlation coefficient
CORRELATION AND DETERMINATION 313

is virtually uninformative to begin with, and Table 1


regression coefficients, which are sensitive to Distribution of Cases in Hypothetical
differences in variance, should be used (see Treatment Outcome Study
Pedhazur, 1982, p. 42, for a more detailed
Treatment outcome
treatment of this issue).
Many applications of correlation coeffi- Condition Survival Death
cients fit either the variance decomposition
or common variance models, where r2 and r, Treatment 65 35
No treatment 35 65
respectively, furnish appropriate coefficients
of determination. Correlational statistics are
also used as measures of magnitude of exper- able is continuous. For the two-variable large
imental effect. Here one wishes to determine and equal sample case, Levy (1967) showed
the extent to which the dependent variable is that the percent misclassified by the point-
a function of some independent variable. biserial correlation (rpb) is equal to the one-
This type of problem is not a good fit with tail probability value of z, where
either the variance partitioning or common
variance approaches. The independent vari-
able is generally not viewed as a portion of
the dependent variable, nor are both depen- The probability value associated with z is the
dent and independent variables typically con- percent misclassified, P(m). The correspon-
ceived of as some function of a third unmea- dence between (1 — rpb)/2 and P(m) can be
sured variable. seen in Table 2. For both dichotomous and
Rosenthal and Rubin (1979, 1982) offered continuous variables, the correlation (phi,
convincing examples demonstrating the ad- point-biserial), and not the correlation
vantage of using the correlation metric as a squared, provides a meaningful effect size
gauge of effect size in this situation. They indicator, being directly related to the percent
offered examples such as that shown in Table misclassified. There is no such simple inter-
1. In the data shown in Table 1, the phi pretable linkage between r2 and P(m), so that
coefficient is .30. This figure corresponds to assessing effect size through the ratio of pre-
the difference in survival rate as a result of dicted to total variance offers little in com-
treatment. This relation between phi and parison.
survival rate improvement will obtain exactly
whenever the marginal distributions and en- Conclusion
tries of the 2 X 2 table are symmetric and The size of a relation between two variables
equal (as in Table 1), and is moderately is often a pertinent concern, but this is just
robust with respect to minor disturbances in one aspect of the larger issue of the impor-
this symmetry. As Rosenthal and Rubin tance of a relation. O'Grady (1982) indicated
pointed out, thinking of this effect as an that a magnitude of an effect must be evalu-
example of accounting for 9% of the variance ated in a theoretical context. One must com-
may lead to a gross underestimation of treat- pare the magnitude of an obtained relation
ment effectiveness. The correlation coefficient to what may be expected, taking into account
(phi in this case) provides a directly inter- relevant theory, the methods used, and the
pretable reflection of treatment effect: There measurement operations. But it is not only
is an increase of 30% in the survival rate. the interpretation of an effect size that is
Another way to view correlation in the partially theory-dependent; the actual esti-
context of 2 X 2 contingency tables parallels mation of a coefficient of determination re-
Levy's (1967) conception of percent of mis- quires theory as well. In this article, two
classified cases. In a symmetric 2 X 2 contin- simple theoretical models for the two variable
gency table, the percent misclassified is (1 - case have been considered.3
r^/2 (e.g., in Table 1, 70 of 200 cases or 35%
are misclassified and (1 — r^J/2 = .35). This
formula provides a close estimate of percent 3
In cases where the assumptions of both of these
misclassified even when the dependent vari- models are unacceptable, other methods of estimating a
314 DANIEL J. OZER

Table 2 literature and found that the effect sizes,


Comparison of Two Misclassification Indexes assessed correlationally, were about .40. They
for Selected r^ Values too suggested aggregation as a means of im-
fob P(m) (1 - proving predictive power. Perhaps a more
sanguine view can be defended. One of the
.00 .50 .50 studies Funder and Ozer considered was by
.10 .46 .45 Darley and Latane (1968), which examined
.20 .42 .40 bystander intervention as a function of num-
.30 .38 .35
.40 .33 .30 ber of onlookers. The point-biserial correla-
.50 .28 .25 tion between helping and number of onlookers
.60 .23 .20 was —.38. Should one be distressed because
.70 .16 .15 only about 15% of the variance in helping is
.80 .09 .10
.90 .02 .05 explained or impressed that a simple principle
1.00 .00 .00 concerning diffusion of responsibility correctly
classifies the behavior of about 70% of the
persons?

The basic results described here have been


readily available since Tryon's (1929) expo- References
sition, but there is little acknowledgement of Binder, A. (1959). Consideration of the place of assump-
this interpretation of correlation in either tions in correlational analysis. American Psychologist,
current psychological statistics textbooks or 14, 504-510.
the research literature. Despite widespread Cattell, R. B. (1957). Personality and motivation structure
and measurement. Yonkers-on-Hudson, NY: World
practice, squaring the correlation coefficient Book.
to yield a percent of variance accounted for Cohen, J. (1969). Statistical power analysis for the be-
statistic is often unjustified by an underlying havioral sciences. New \brk: Academic Press.
model. When this kind of coefficient of de- Cohen, J., & Cohen, P. (1975). Applied multiple regres-
sion/correlation analysis for the behavioral sciences.
termination is informally interpreted as a Hillsdale, NJ: Erlbaum.
percentage measure of effect size, it is poten- D'Andrade, R. G., & Dart, J. (1983). The interpretation
tially misleading. Although r2 does have utility ofr versus r2. Unpublished manuscript.
in variance partitioning, other applications Darley, J. M., & Latane, B. (1968). Bystander intervention
are usually inappropriate. By contrast, the in emergencies: Diffusion of responsibility. Journal of
Personality and Social Psychology, 8, 377-383.
correlation coefficient is a directly interpret- Epstein, S. (1979). The stability of behavior. I: On
able effect size indicator and may in circum- predicting most of the people much of the time.
scribed conditions be used as a coefficient of Journal of Personality and Social Psychology, 37, 1097-
determination. 1126.
There appears to be a growing dissatisfac- Funder, D. C., & Ozer, D. J. (1983). Behavior as a
function of the situation. Journal of Personality and
tion with the magnitude of effects obtained Social Psychology, 44, 107-112.
in various domains of psychological investi- Guilford, J. P. (1936). Psychometric methods. New York:
gation. This has led some to advocate a McGraw-Hill.
strategy of aggregation (e.g., Epstein, 1979; Horst, P. (1941). The prediction of personal adjustment.
New York: Social Science Research Council.
Rushton, Brainerd, & Pressley, 1983). Even Jensen, A. R. (1971). Note on why genetic correlations
some important effects are not large when are not squared. Psychological Bulletin, 75, 223-224.
evaluated by traditional standards. Funder Jensen, A. R. (1980). Bias in mental testing. New \brk:
and Ozer (1983) selected several undoubtedly Free Press.
important results from the social psychology Kerlinger, F. N. (1973). Foundations of behavioral research
(2nd ed.). New York: Holt, Rinehart & Winston.
Levy, P. (1967). Substantive significance of significant
differences between two groups. Psychological Bulletin,
coefficient of determination are required. In such cases, 67, 37-40.
the value of the coefficient of determination will always Miller, J. K., & Levine, D. (1973). Correlation between
be between r2 and r (see Tryon, 1929, for the applicable genetically matched groups versus reliability theory: A
proof), but more precise estimation requires the use of reply to Jensen. Psychological Bulletin, 79, 142-144.
either causal modeling procedures or the method of Mischel, W. (1968). Personality and assessment. New
triads as Tryon proposed. York: Wiley.
CORRELATION AND DETERMINATION 315

O'Grady, K. E. (1982). Measures of explained variance: Sechrest, L., & Yeaton, W. J. (1981). Estimating magni-
Cautions and limitations. Psychological Bulletin, 92, tudes of experimental effects. JSAS Catalog of Selected
766-777. Documents in Psychology, 11. (Ms. No. 2355)
Pedhazur, E. J. (1982). Multiple regression in behavioral Sechrest, L., & Yeaton, W. J. (1982). Magnitudes of
research (2nd ed.). New York: Holt, Rinehart & Win- experimental effects in social science research. Evalu-
ston. ation Review, 6, 579-600.
Rosenthal, R., & Rubin, 0. B. (1979). A note on percent
variance explained as a measure of the importance of Tryon, R. C. (1929). The interpretation of the correlation
effects. Journal of Applied Social Psychology, 9, 395- coefficient. Psychological Review, 36, 419-445.
396. Wiggins, J. S. (1973). Personality and prediction: Principles
Rosenthal, R., & Rubin, D. B. (1982). A simple, general of personality assessment. Reading, MA: Addison-
purpose display of magnitude of experimental effect. Wesley.
Journal of Educational Psychology, 74, 166-169.
Rushton, J. P., Brainerd, C. J., & Pressley, M. (1983).
Behavioral development and construct validity: The
principle of aggregation. Psychological Bulletin, 94, Received October 11, 1983
18-38. Revision received June 7, 1984

Editorial Consultants for This Issue:


Quantitative Methods in Psychology

James J. Algina Bradley Efron Keith E. Muller


Duane F. Alwin Donald L. Fisher Gottfried E. Noether
James C. Anderson John Gaito Keven E. O'Grady
Mark L. Appelbaum Donald Guthrie Gordon F. Pitz
Douglas G. Bonnett Ronald K. Hambleton Robert Rosenthal
Michael J. Burke Richard J. Harris Donald B. Rubin
James E. Carlson James Jaccard Patrick E. Shrout
James Carlson Arthur R. Jensen Linda S. Siegel
Timothy F. Champney Leonard Katz John H. Skillings
James T. Chen Gary D. Koch Kikumi Tatsuoka
James Chumbley James Alan Kulik Robert Tibshirani
Albert T. Corbett James E. Laughlin Neil H. Timm
Lee J. Cronbach Richard G. Lomax Rand Roger Wilcox
William R. Dillon Robert Lorch, Jr. Alex C. Wilkinson
Ronald G. Downey Brian MacPherson Rebecca Zwick
Stephen L. Edgell George B. Macready
Donald G. Edwards Robert L. Mason

You might also like