You are on page 1of 168

LISTENING COMPREHENSION

A FACTORIAL

ANALYSIS

DONALD SPEARRITT

AUSTRALIAN COUNCIL FOR EDUCATIONAL RESEARCH

2234
APR 20 1376
:0v 1 3 197S
..j

g 4 1977
1977

DEC 7

68-22021* 152 ST^L Spearritt Listening comprehfinsion-A factorial analysis .

. .LISTENING COMPREHENSION A FACTORIAL ANALYSIS .J .

.

M. 76 LISTENING COMPREHENSION- A FACTORIAL ANALYSIS by DONALD SPEARRITT fey-' 'i M. Senior Lecturer in Education.D.C. University of Sydney A. E. Ed. R. Research Series No..R.E. 1962 . C.A.A.Ed.

Registered in Australia for transmission by post as a book PRINTED BY 0. MELBOURNE . GREEN & SONS PTY. LTD. W..

It adds a good deal to the evidence (as distinct from unsupported opinion) available on the relation between listening comprehension and reading comprehension. For the general reader likely to be unacquainted with those techniques. It is a technical study.E.. It is hoped that they will simplify the reading of the more technical sections of the book. by far the greater part of the immense amount of work involved was done in his own private time. However. of skill. 7. and in the libraries of Harvard University and the United States Office of Education. Spearritt. a simple explanation of factor analysis and a glossary of technical terms have been added to the text as Appendices E and F. of knowledge and of intelligent interpretation that the A study has required.C.. and many others. THE Although the inquiry was supported by the A. and points out the need for teachers to deal with listening as a skill requiring separate treatment from readjp^ Dr. but Ms own method of inquiry has not only made a notable contribution in its own right. it is thought that the amount of data available in this printed version of the study is sufficient for both the general reader and the majority of those whose interests may be roused by the techniques used. of planning. 5 6822021 (MO.) W .R. Director. KANSAS CITY PUBLIC LIBRARY . C . helped by all of this work is revealed in this printed version of the from which some of the more technical data have been excluded.C. but has pointed out many further studies likely to bring useful results. Those who wish to consult the original text and discuss Not study. in ways acknowledged by Dr. carefully devised and efficiently conducted.E.PREFACE study reported in the following pages is the first of its kind to be published in Australia. copy of the original text is also available at the A. the procedures used should refer their enquiries to the author at the University of Sydney. Spearritt would be the first to acknowledge that there is still much to find out about this skill and how best to develop it. into the factors associated with a skill we all need in varying degrees the skill of understanding what we hear.R. and make clearer to the reader not sophisticated in statistical matters the amount of patience.

.

preparing and administering the test battery. for their comments and suggestions on the plan of investigation. In addition to his guidance in developing the plan of this investigation. very kindly made available the services of Mr. my major adviser in the preparation of this thesis. Mr. C. Valerie. for his recommendations on suitable types of equipment. Carroll. John Morgan. John E. Dr. Principal of the Royal Melbourne Institute of Technology.ACKNOWLEDGMENTS I WISH to express my appreciation to a number of people and organizations from whom I have received advice* assistance and co-operation in carrying out this investigation. the Council permitted me grant of to use its typing and duplicating facilities for the trial tests and the final test booklets and allowed me to free myself from other duties in order to spend approximately three months in schools. Radford. R. Wynette. Robert H. Burton for the time and interest he devoted to this phase of the investigation. John B. and Dr. My My Miss Margaret Home and my schoolgirl acquaintances. Karlin. I must also thank the other members of my committee. W. F. officer in charge of school broadcast systems in Victoria. he has given me valuable advice and encouragement in correspondence extending over a period of four years. special thanks are due to Dr. Anderson. Mr. Mackay. Burton. The investigation would not have been possible without the generous support and assistance of the Australian Council for Educational Research and its director. Rulon and Dr. Phillip 3. for technical supervision in sincere thanks are due to the preparation of the recordings. and for his suggestions on methods of developing an audiometric test for group screening purposes. Marilyn and Ann. I have had to call on the services of several people. and has helped me greatly by arranging for a large part of the processing of my data to be done by the Littauer Statistical Laboratory at Harvard University. I am most grateful for this assistance. Dr. R. Dr. of the Bell Televii . which have been used extensively in the analysis of the data. I should also thank the speakers who made the tape recordings Mr. Rulon in particular for introducing me to electronic computers. In addition to sponsoring the investigation and making available a 100 for necessary expenses. In preparing the tape recordings used in the study.

W.) phone Laboratories. Educational Testing Service (Co-operative Test Division).C. G. New Jersey. for permission to seek the co-operation of teachers in Melbourne schools. Educational Test Bureau. the Littauer Statistical Laboratory at Harvard University and the MXT. and Science Research Associates. . which provided tapes and a Byer tape recorder at very reasonable rates.to the staffs of the Silliac Laboratory at the University of Sydney.VHI ACKNOWLEDGMENTS Hill. Murray to make Pty. was kind enough of four tests used in his earlier study of tape recordings auditory function. who have been of assistance in small ways. Director of Education in Victoria at the time. I am indebted to the following test publishers for permission to adapt tests for the purpose of the investigation: Australian Council for Educational Research. and to send these to me in Australia. Computation Center for advice and assistance in processing my data on electronic computers.E.R.. and to a number of staff members of the A. The assistance of the Australian Broadcasting Commission in providing me with several broadcast scripts as a basis for preparing a test of listening comprehension My is gratefully acknowledged. My wife has also been of great assistance in helping me score test papers and check tabulations. Mention should also be made of the co-operation of the Rola Co. Ltd. (Aust. and to the Psychology Branch of the Education Department for advice on the selection of schools. and of technical advice received from Mr. Special thanks are due to the head teachers and class teachers in the ten schools which participated in the main study for their interest and co-operation throughout the testing programme. and also to the 470 children in these schools for the effort and enthusiasm they displayed in taking the lengthy series of tests. I also wish to express my thanks . thanks are extended to Major-General Sir Alan Ramsay. Parr of Sydney Teachers' College on terminology in the measurement of sound and hearing.

. 19 Preparation of Test Battery and Description of Tests A. 9 16 . 52 D. Development of Hypotheses 2. . Auditory Resistance Tests E.56 . 57 58 60 60 .. Computation of Principal Factor Loadings ix .... Evaluation of Research F. . Experimental Tests of Listening Comprehension G. . 36 38 F. D. . . 6 Psychometric Variables E...47 .. .. School Achievement Variables 40 . Administration of Tests . ... The Problem and Its A. Background . .51 51 . .. Selection of Schools . . Definition of Listening C. Arrangement of Tests and Testing Schedule C. Introduction . B. Reasoning Tests . Coding of Test Scores G. ..... Memory Tests . .48 H. Scoring of Tests E. . . Data Collection and Analysis A.54 . . .TABLE OF CONTENTS Preface v vii Acknowledgments CHAPTER 1... 4 5 5 D. The Composition of the Final Samples F. . Computation of Correlation Co-efficients H.. . 23 28 31 33 B. Review of Research on Listening Comprehension (i) (ii) The Effect of Training in Listening Conditions affecting Listening (iii) Comprehension Relationships between Listening Comprehension and other . The Problem to be Investigated 3 . Verbal Comprehension Tests C. . Audiometric Screen Test 3. Attention Tests . . 1 1 B.

Analysis of Higher Order Factors K.. . Computation of Reliability Co-efficients 4. Estimation of Factor Loadings for Achievement Variables J.. Rotation of Axes . 6. Bibliography . . Reliability Co-efficients .61 . L. . Glossary of Technical Terms . 104 106 113 131 .. APPENDIX APPENDIX APPENDIX APPENDIX APPENDIX APPENDIX .. Correlation and Factor Matrices D. .63 64 .144 . Second Order Factors Summary. E.136 . 67 84 89 . . . Interpretation of First Interpretation of Order Factors .. ..130 . Sample Items from Tests C. 63 School . Order of Administration of Tests B..I. Conclusions and Implications A. ... The Technique of Factor Analysis F. 5. ..

They must be able to pass on knowledge and ideas to others. The process of verbal communication Is carried on mainly by means of speaking. and to some extent training in listening has been virtually nonexistent. any listening skills that pupils have acquired have come incidentally in the course of studying other subjects. INTRODUCTION in civilized societies have the fundamental task of help- ing children proficient in the use of their own language. the communication between their members becomes more necessary. children must be taught how to communicate effectively become with other members of their society. elementary schools have been traditionally concerned with providing training in teadirig aftd writing (as well as the third of "the three rY') in speaking. Listening and reading. who found that only fourteen scientific studies related to listening 1 . The dis- Formal proportion in the time and interest devoted to the assimilative skills of reading and listening has been strikingly illustrated by Nichols. and_ absorb^ knowledge and ideas from all others. As modern need for the effective societies grow in size and complexity. are regarded as leosgtflx&jQT assimiSchool learning itself. Speaking and writing are often described as expressive skills. Since the establishment of compulsory elementary education in many countries in the nineteenth century. To participate fully as adults in the everyday affairs of such societies. reading and writing. as well as the future rieedFof fotjjgJjjglljL society. listening. Although reading and writing are the more recently developed of the communication skills in human societies.CHAPTER 1 THE PROBLEM AND SCHOOLS ITS BACKGROUND A. they seem to have been more readily accepted as legitimate subjects of school instruction than have the older skills of listening and speaking. requires that children develop increasing competence in these four communication skills as they progress through the school. a person with an idea to express usually talks about it or writes about it. on the other hand.

listening opportunities have been extended spectacularly in the present century with the development of such mass media as radio.employed. on the average. the median daily time being 158 minutes (Wilt.visual aids are used increasingly to supplement formal lessons and lectures. 1950). must continue to play a large part in the early education of children before they are able to read and write. 25% in speaking. 1950. listening is the most important skill In a study of 68 Rankin found that 45% of the total time they devoted to adults.951 such studies in reading (Nichols. listening does not seem to have large. it is obvious that listening is a significant medium It of learning at all stages of education as well as in post-school life. its Despite obvious importance. of course. College students have been found to comprehend. 1955). Various studies have indicated that. only half (Brown. It has been found that about 50% of adults comprehend and retain very little of what they hear in an become. and 18% in writing (Bird. 30% in speaking. listening undoubtedly plays an important part in the proof communication. out A by Wilt on 530 elementary school children from Grades 1 through 6 in nineteen classrooms showed that children were expected to listen Sl\% of the time they spent in the classroom. Rankin. 1950). 15% in reading. a particularly efficient means of assimilating information. which cannot be properly evaluated without some assessment of the relative importance of the content that is communicated. and in high school and college. communication was spent in listening. But quite apart from evidence of this kind. in contrast to 1. in terms of the amount of time the four communication skills are Yet cess . on the cfifeculty levels of the questions used to assess . for the community at ordinary informational talk (Vernon. And the need for effective listening in the higher grades of the elementary school. television and sound film. study carried.2 LISTENING COMPREHENSION A FACTORIAL ANALYSIS comprehension had been published in the United States and England by 1939. 1930). reading and 9% in writing (Rankin. Estimates of this kind depend. At the adult level. 1926. 1953). 1953) of what they hear in lectures. Nichols. A similar study by Bird with female college students revealed that 42% of their time was spent in listening. 1949). 16% in. 1949) or less than half (Irvin. is likely to become more pronounced as audio. while similar results have been obtained with tenth grade students (Cartier.

1957). ITS BACKGROUND 3 comprehension.THE PROBLEM AND improvement listening. 1958.S. Summaries of research on listening have also begun to appear at regular intervals in the "Review of Educational Research" (Caffrey. E. 1955b.S.T. Dow. "listening" is often taken to include th^ . 1958). 1956. high school (Brown and Carlsen.A.. writing and speaking. Caffrey. suggests that listening was neglected in schools and colleges because of a widespread assumption that efficient listening required little more than intelligence and practice (Nichols. but listening invojygolict^ soundETv^etheflhey be spoken words. however.S. B. but there seems little doubt that there is room for in the comprehension of information gained through in listening? have schools paid so little attention in the past to training The most likely explanation would seem to be that teachers did not perceive listening as a skill to be taught formally. mechanical or dtEer noises. have been prepared within that period for students at elementary school ^Educational Testing Service. Freshman courses in English have been superseded in many colleges by courses in "Communication Skills" (Nichols and Stevens. which include formal training in listening as well as in reading. When considered in the context of verbal communication. College mushroomed since 1946 (Nichols and 1955a. There have been many signs. that listening is becoming an accepted area of school instruction in the U. DEFINITION OF LISTENING / oli^mere Listening J considerably broader in^connotatioa thaa Jieacpg? physiological reception "of sounds constitutes hearing. Tests of listening comprehension. Lewis. it seems pertinent to investigate the nature of this skill. courses in listening have Stevens. however. college level (Blewett. 1949).. Nichols. 1949). 1951. Wright. 1956. and to determine how it can best be measured. 1956) and Carlsen. 1957). 1953. first Most grade pupils could they first listen standing when came to school. musical sounds. and that this kind of training would be sufficient to provide them with efficient listening habits in adult life. 1953. Why with some degree of underit would be easy to assume that their skill in listening would develop as a result of the incidental training they received in the normal school programme.T. In view of this greatly increased interest in the subject of listening. 1957). Mckofc. Brown and E. in the last ten to fifteen years.

1957). Moreover. that is." Actually. in the cotiSpfSESSSSSST^dt in listening conapreji^sis^." (Brown D.^ difficulties in terminology are removed when "listening" is in operationally defined-Jn^the. There has been some confusion in the literature as fo'wleffiei" the term "listening" can properly be ap- plied to the process of getting whether meaning from the spoken word. and one with a low ' most of the listening occurring in colleges relates to informative or expository speech. ajpmonjvithjt high score^ on a listening comprehension testjs jregardfid a^ a^goo4 fisfeSS. 1956) havejjroposed that "auding" should be used as a more comprehensive!*^ it not "only hearing and listening to spoken languagerFut"*fec*ognizing well "IS this sense." Verbal communication is carried on chiefly so that others may comprehend the information transmitted. matenaTsucti as spoken passages or short talks.. In this study. but there appelar to be no practical advantages to be gained by employing the term "auding. or should be restricted to the process of directing attention to spoken sounds (Furness. skill listing is almost TSwiably assessed by de&mining the extent evaluated in practice by assessijog performance on tests of listening com^eherision. field of ^e^J^coirmunication.to the spoken words. looking at. Critical listening to persuasive speech and appreciative listening to language or non- language sounds have been excluded from consideration. which has been described as "the gross process of seeing. The study sets out The aim . Brown and Caffrey (Caffrey.4 LISTENING COMPREHENSION A FACTORIAL ANALYSIS active process involved in attaching meanings to the sounds. "listening" thus becomes synonymous with "auding. In an effort to refine the terminology. 1950) This proposed distinction between "listening" and "auding" be a useful semantic distinction. there seems little need to look beyond the term "listening comprehension" for an accurate description of the task involved. recognizing and interpreting written symbols. C THE PROBLEM TO BE INVESTIGATED 4 of the present study is to examine what is involved that is. comprehension of the material heard. and in this content may ^Ustenmg^MmpJes. be analogous to reading. the investigation has been limited to an examination of listening comprehension in situations of this kind.

THE PROBLEM AND

ITS

BACKGROUND

5

from the basic observation that some people comprehend more of what they hear than other people, or In other words, some people listen more effectively than others. To what can this be attributed? Writers in the field of listening have tended to discuss this variation
terms of individual differences along a dimension loosely referred to as "listening ability" (Anderson, 1952; Blewett, 1951; Brown, 1949; Goyer, 1954; Nichols, 1949; Pratt, 1956; Rankin, 1926). But although research studies over the last half century
in

have shown clearly that people vary appreciably in their performance on tasks involving reasoning, verbal relationships, memory, and a host of other mental processes (French, 1951; Vernon, 1951), the relationship between listening comprehension and these tasks has received little attention. It seems imperative, then, to determine whether the variation in the performance of persons on listening comprehension tests can be adequately described in terms of already known sources of variation or whether it is necessary to
postulate

a further "listening factor" or "listening ability" to account for this variation.

Before re-stating the problem in a form which will enable a precise research study to be undertaken, it is necessary to review

what

is

already

known about

listening comprehension. This should

provide useful material for the development of hypotheses, and should also indicate with which groups and under what conditions
the hypotheses could most profitably be investigated,
i

D. REVIEW OF RESEARCH ON LISTENING COMPREHENSION
Existing research on listening comprehension has been mostly effect of training in listening, conditions affecton listening comprehension tests* aflcHfee-mlationing performance

concerned with the

ships between performance on listening comprehension tests on qth$r attdiometric and psychometric tests.
(i)

and

The Effect of Training

in Listening

_
^ courses in ^ listening^kad to improvement in been derownSfatwl" for widely different age levels mlchool and college, although most of the experimental studies
"

relate to college students. Experimental groups crfcollege^fr^hmpn

^^a^f^fS^^^^^^^^^^S^ scores on listening comwho hawtfot received sich
prehension
tests

^ojgvejeceive^ sj^ftapatic ^i^fflgjajtf^^^
than controlljroups

6

LISTENING COMPREHENSION

A FACTORIAL ANALYSIS

training (Bird, 1953; Brown, 1954; Erickson, 1954; Irvin, 1953; Nichols, 1949). The training has generally comprised some instruction on how to listen, and practice exercises in listening, extending

over periods of from 7 to 12 weeks. Thejmproment4fr listening compi^ension^is appreciable for^belaw^^verage listener^butjriot marked for those found to be above average listeners aFthe initial testing (Bird, 1953; Erickson, 1954; Irvin, 1954).
Similar improvement has been noted with groups of high school and elementary students. In a study based on high school students, the experimental group received training in listening over a period of seven months (Lewis, 1956). In another study with sixth grade students, the training consisted of five lessons on listening given at

weekly intervals, the lessons being designed to provide training in observing details, using contextual clues, following oral directions, noting the relation between main ideas and supporting ideas, and
further experiment drawing justifiable inferences (Pratt, 1956). at the fifth grade level provided listening training in the form of daily twenty-minute listening lessons for six weeks (Hollow, 1955).

^

^ot

only did the experimental group show significantly greater improvement in listening comprehension than the control group in these studies of fifth and sixth grade children, but the training
v>

^as found
*

to be equally effective for different levels of intelligence./

(ii)

Conditions affecting Listening Comprehension

Performance on listening comprehension tests has been found to vary with certain characteristics of the groups to which they are administered and with certain characteristics of the tests
themselves.

which affect performance on these most important appear to be the educational level of a group and its sex composition. Gradual improvement in listening comprehension occurs as pupils proceed through the school, even when no explicit provision, is made for formal training in listening. Improved performance in listening comprehension has been noted from Grade 2 to Grade 4 (Wright, 1957), from Grade 4 to Grade 6 (Hampleman, 1955), from Grade 9 through to Grade 12 (Brown and Carlsen, 1953; Caffrey, 1955a), among college freshmen (Erickson, 1954) and at each grade level from Grade 4 through to
the group characteristics
tests,

Of

the

.

college
effective

level

(E.T.S.,

among

1956). adults with a

4^gPag^JM^

is more good educational background than

attainments (Carver, 1935).

THE PROBLEM AND
^
In

ITS

BACKGROUND
listening

performance on

comprehensionjests

-4a. studies "af_ aft";^eJIwe!s.CMa|g& QffisljQa, .these tests than slighfljL higher mean females, though the difference between means is not always large enough to be statistically significant (Dow, 1953; Hampleman,

have

appear^jccmsistently

Male superiority has been noted at Grade 4 (Hampleman, 1955), Grade 5 (Hollow, 1955), Grade 6 (Hampleman, 1955; King, 1959), Grades 9 to 12 (Caffrey, 1955a), and at
1955; Hollow, 1955).
college freshman level (Dow, 1953; Irvin, 1954; Nichols, 1948). This pattern was not confirmed in Haberland's study of college freshmen, but the number of cases available for comparison in this study was relatively small (Haberland, 1959). Caffrey demonstrated that the male superiority among his high school student could

groups not be attributed to differences in chronological age, mental age Dr sex bias in item content (Caffrey, 1955a).

.Tfic effect of differences in chronological age on performance Dn listening comprehension tests is reflected in the grade differences noted above. Within the high-school group, chronological age seems to have little effect on listening performance (Caffrey 1955a).

stigatorjias j^ortedjbat-4he performance of ffitibjgade children on^tKeseTtests j^earsLJLJ^^

of^Jimajieyeted--^^
the type of

viewing but has
1955).

little

relationship to

programme chosen (Hollow,

There
listening
istics

is

comprehension

also evidence to indicate that level of performance on tests is influenced by certain character-

of the tests themselves. These relate mainly to the nature of the material used in the tests and the way in which this material
is

presented.
It

might well be expected that the amount of material comprehended in a listening test would depend on the content of the passages used in the test. This has been found to be true in a recent experiment with sixth grade children in Britain; as a result it was suggested that a number of short passages on a variety of topics would provide a more valid assessment of listening comprehension than would one longer passage (King, i959). It is conceivable, however, that variation due to passage content could be largely a function of the difficulty level and interest level of the material for the groups to whom it is presented. As would be
expected, easy material is more readily comprehended than difficult material by both children and adults (Beighley, 1952; Carver, 1935; Hampleman, 1955). But contrary to expectations, the interest

1955a. 1954). when they are unaware that they will be questioned about the subject-matter of a talk. the effect of differential interest in the material presented is likely to be reduced or eliminated. however. Variation in length of passage between 100 words and 700 words has been found to have no effect on the relative standing of fourth and of sixth grade children on listening comprehension tests (Hampleman. to the way in which measures of if adequate motivalistening comprehension are usually obtained.8 LISTENING COMPREHENSION A FACTORIAL ANALYSIS appears to bear little level of the material for the subjects relation- ship to the amount comprehended 1955). Comprehension has also been (Goyer. relationships between interest and comprehension tend to be higher (Brown. 1959). than when reported to be greater when students see film. 1955). Listening comprehension is more effective with organized material (Vernon. Such material can be pre- Several sented either by a speaker in person.(Nelson. 1945). did indicate that differences in scores mean cpmprehension tests were significant when different speakers were used (Stodola and Coffman. and the third listening only to the sound from this differences in listejiingxQmpi^hension scores administration (Stodola and Coffman. 1952. 1953). The latter study. that know they are to be subjects retain more material when they tested (Knower et al. 1937). they listen to the sound track without seeing the On the other hand. 1955b. Comparisons of the various types sentation suggest that speakers in person are more effective than speaker a sound film. and that comprehension as judged by immediate retention tests is greater when the heard over a loudspeaker is present than when his voice is 1954. It has been found. 1955). Stodola and Coffman with college students showed no significant recordings presented by tape (Caffrey. This result may be due (Caffrey. for instance. This on listening . 1955a). fpfou^t^^ between three random second administration on closed circuit and listemnglol^ watching television. but does not appear to be seriously imare not presented in the correct paired when paragraphs of a script order (Beighley. Loder. tion among the subjects is secured in the testing situation. a recent well-designed experiment by 1953). 1959). to determine] investigations have been undertaken / Whether scores on listening comprehension tests are affected by the' Way in which the material is presented. or by means of a loud of prespeaker or a recording. Cartier.

and auditory memory span. 1957). 1955a). loudness.THE PROBLEM AND ITS BACKGROUND 9 finding Is at variance with results obtained by Caffrey with high school students (Caffrey. Knower et ai. 1954. 1952). Nichols. the level of comprehension is greatest when material is presented at the average rate of speech. 1955b). The amount of material comprehended is also likely to be influenced by the perceived prestige of the speaker (Coyne. it aids comprehension with some. 1945) and who make use of gestures (Goyer. 1952. prehension and audiometric between performance on listening comand performance on other types of psychometric Although low tests levels of performance on listening comprehension would obviously be expected among subjects with severe iegrees of hearing loss. College students with high and low scores on listening comprehension tests iave also been reported as showing no significant differences on luditory characteristics. 1954). 1955). but receives support from other investigations (Beighley. such as pitch. (iii) Relationships between Listening Comprehension Psychometric Variables and other Several research studies have been concerned with investigating possible relationships tests tests. or by the use of various types of note-taking practices during the tests (McClendon. it appears that children with moderate hearing loss do at least as well on listening comprehension tests is those with no hearing disabilities (Caffrey. 1957). Greater comprehension is achieved with speakers who are vocally skilled (Beighley. rhythm. There is some evidence which indicates that the value of note- taking varies for different students. Paulson. 1955. 1955a). about 150 words per minute (Goodman- Malamuth. 1954).affects per- While it has ~beeademonstrated HaTnBie^ra^of^F^n'tatioEr can be increased by mechanical means to about 300 words per minute without sigiislentef^colii*pre^ension~fests. among others . 1956. Harwood. but impedes it with others (Brown. e^at which spoken material is presented . speech>ound discrimination. Results obtained by college stuctents do not appear to be affected either by the time of day at which the tests tare administered (Irvin. nificant loss in on comprehension (Fairbanks et ai. Other conditions likely to influence listening comprehension have also received attention. 1952. 1957. Knower et al 1945).

but occasionally falling as low as . 1954). and correlations of . and the rather obvious dependence of language comprehension on the quality of a person's thinking. . 1953). Thus. 1956) and . in a variety of extent is To what related to performance situations. and in some degree reflected each author's views of the type of passage and question appropriate for such a test. At the high school level. correlations and . Most cursory examination of the experimental evidence reveals a wide range of correlations between listening comprehension and intelligence tests. the listening test used in each of the above studies was specially constructed for the particular study. of . 1926). but to differences in the type of test used in the various investigations. listening comprehension does not seem to be dependent on degree of hearing acuity among groups of students who are able to hear the speech samples reasonably well.66 for Grade 6 children (Pratt. These relationships have naturally proved to be of most interest to investigators.58 . reading and listening. because of the similarity of the endproduct of both the reading and the listening processes.2. Correlations of . The varying levels of correlation reported are likely to be due not only to different degrees of selection in the groups concerned.56 for children in A Grades 3 to 8 (Rankin.74 for children in Grades 10 and 11 respectively have been reported between the Brown-Carlsen Listening Comprehension Test and the Terman McNemar Test of Mental Ability (Brown and Carlsen.4 and . The second approach has involved comparisons of the relative effectiveness of the two assimilative language skills. 1955b).8.59 have been obtained with children in Grades 9 to 12 (Caffrey.4 and .10 LISTENING COMPREHENSION A FACTORIAL ANALYSIS (Ainsworth and High. performance on listening comprehension tests on other psychometric variables? Research on this question has proceeded in two main directions. With the exception of the Brown-Carlsen test. Caffrey.70 and . usually varying between . 1955a). 1955. or between listening comprehension tests and measures of intelligence.48 have been reported for Grade 5 children (Hollow. One approach has consisted in determining the correlations between listening comprehension and other variables deemed likely to be related to listening comprehension. of the correlational studies have examined the relationbetween listening comprehension tests and reading comprehenship sion tests.

65 . The 1954. others the Detroit It is perhaps significant that the three intelligence tests mentioned differ in the relative emphasis given to verbal and nonverbal types of item.73 as against . with differences of a similar order in a third (Haberland. listening comprehension tests have been found to correlate more highly with L scores than with Q scores on the American Council on Education Psychological Examinations. (Biggs. be reasonably conjectured that the size of the correlations obtained between listening comprehension and intelligence would be associated with the relative amount of verbal and non-verbal content in the intelligence test. but Some only . Rankin.43 in another (Kramar. at least for those for which this information is reported. Dow. Jftjcould. Hollow. 1955b. correlations 1955. But when listening comprehension scores are correlated with total scores on these and other Erickson.7.22 with the performance IQ (BrownCarlsen. In one study the Brown-Carlsen Listening Comprehension Test was found to have a correlation of . 1951).THE PROBLEM AND ITS BACKGROUND 1 1 The intelligence test employed also differed from one study to another.55 with the verbal IQ obtained from the Wechsler-Bellevue Adult Intelligence test but only . Caffrey obtained correlations of . Within-grade correlations of . was used as the measure of intelligence (Pratt.5 to . one form of the Pintner General Abilities Test. intelligence tests . 1926). In a sample of children drawn from Grades 9 to 12. 1955). 1948) the obtained cor- relations generally fall between . 1956).54 between the Brown-Carlsen test and the Wechsler verbal IQ.36 in one study (Blewett. in fact. 1956. In one case. 1953). . another study resulted in a correlation of .37 with the performance IQ (Kramar. 1959). Pratt. Verbal Series. Somewhat higher correlations have been reported at the high school level. .68 between the California Auding Test and the totabreading score from Form X of the Iowa Tests of General Educational Development (Caffrey. 1953. 1955a). In the upper grades of the elementary school. typical withingrade correlations between tests of listening and reading comprehension range from about . 1956. 1955b). in Alpha Intelligence Test (Rankin. Nichols.4 and reported between listening comprehension and reading comprehension tests are of about the same magnitude a$ those found between listening comprehension and intelligence tests.72 and .52 as against .6 (Caffrey. Similarly. 1955). evidence for this has appeared in several studies undertaken with college freshmen. 1926) and the California Test of Mental Maturity (Caffrey.

It could be readily imagined.C. Haberland.52 between her listening comprehension test and the Survey Section of the Diagnostic Reading Test was reduced to -. A correlation of . with the exception of Caffrey and Biggs. Caffrey noted that the above-quoted correlations of . 1956.45 respectively when mental age was partialled out He also found that his obtained correlation of . this result must depend largely on the type of 1951). Blewett. 1953). 1954. that some of the relationship between listening comprehension and reading comprehension could be attributed to a common dependence on measures of intelligence. Knower et ai.5 to .51 and . More and obtained at the college level.12 LISTENING COMPREHENSION A FACTORIAL ANALYSIS . Correlations are generally higher when the listening and reading comforms of an existing prehension measures are based on equivalent A reading comprehension test than when the measures are obtained from independently constructed tests (Larsen and Feder. and measures of part is intelligence. Erickson. Dow. 1951. 1959. 1959. 1948). Haberland.72 and . Nichols.66 between a test of reading vocabulary and a test of hearing or listening vocabulary was reduced to . and others fall between .6 (Biggs. some rise almost to .68 between listening and reading comprehension tests fell to . This possibility has received little consideration from investigators. question asked in the reading comprehension As a result of accumulated experimental evidence.8 (King. Dow. Biggs' results with college freshmen were still more striking. the exist'ence of a substantial relationship between reading comprehension "factual details'* sections of listening comprehension tests (Blewett. then. 1953. Larsen and Feder.25 and (Blewett. particularly verbal measures. 1945). Correlations with reading comprehension tests have also been sections than for the reported to be higher for the "inferential" though test. . Psychological Examination were held constant (Biggs. 1956).66 for Grades 10 and 11 have also been reported between the Brown-Carlsen Listening Comprehension Test and the paraTest graph comprehension sub-test of the Kelley-Greene Reading variable results have been (Brown and Carisen. The variation is probably again largely due to differences in the approach and content of the tests. 1940. although most correlations between measures of listening and reading comprehension among college freshmen are around .44 when mental age was held constant (Caffrey. now generally accepted. 1953. 1940). 1959).05 when scores on the A.E. 1951. 1955a).

37 with first semester marks among college freshmen girls (Blewett. The mechanics of language.5 or . such as capitalization.71 with scholastic success (letter-grade averages) among high school children (Still. 1951). sentence structure and punctuation have been shown to have correlations of about . and . line of inquiry into relationships between comprehension and other psychometric variables has listening centred on the relative effectiveness of listening comprehension and reading comprehension as a means of acquiring information.6 with study skills such as the use of dictionaries and indexes (Brown and Carlsen. and that it is likely to 33|ry with the type of passage used for comprehension (King. 1955). but the correlation between spelling and listening comprehension at Grade 5 level was found to be only . Research .62 to . 1957). Listening comprehension tests seem to be about as closely related To school marks as are reading comprehension tests (Blewett. Performance on listening comprehension tests has also been shown to have within-grade correlations from . 1959). 1955). Do The second main people understand verbal material better when they hear it or when they read it? Which mode of presentation is most effective in terms of immediate recall and delayed recall? Comprehension in the early grades of the elementary school is clearly studies suggest that this initial advantage is retained by listening until about the sixth or seventh grade (Beery. 1951. though a recent study indicates that this trend may be more characteristic of boys than of girls. 1953). Hampleman.56 with Arithmetic Reasoning. Students rated as good speakers have been found to score more highly on the Brown-Carlsen test than those rated as poor speakers (Stark. correlations between listening comprehension tests and grade point averages ranged from . 1959). Brown and Carlsen. spelling. 1954. At the fifth grade level.6 with the Brown-Carlsen Listening Comprehension Test among Grade 10 and Grade 11 students (Brown and Carisen.33 (Hollow. more dependent on listening than on reading.5 or .62 (Haberland. 1955).48 with Arithmetic fundamentals (Hollow. In other college freshmen groups.24 to . 1953). 1955).THE PROBLEM AND ITS BACKGROUND 13 Some correlations have been obtained between listening comprehension tests and other psychometric variables. and a correlation of . The Brown-Carlsen test also correlates to the extent of . 1953). Hollow found that her listening comprehension test correlated to the extent of .

There is some evidence that students with lower academic attainments or aptitude do relatively better on listening comprehension than on reading comprehension tests. Surprisingly enough. and by Caffrey and Smith. the advantage of reading over listening often disappears over a short period of time (Corey. 1958). comprehension tends to be achieved more through reading than through listening (Carver. Corey. And although the weight of experimental evidence at high school and college level suggests that reading produces more effective comprehension at the time the test is taken (Beighley. Factor studies designed to investigate the factorial structure of listening comprehension tests as well as other variables have been confined to two minor studies correlation undertaken by Caffrey. It is probably a fair generalization that the lower the reading perform- ance of the subjects. Cafirey selected nine variables for a centroid three measures of reading comprehension. Studies at the college level genreading and reading being equally erally show that reading leads to greater comprehension (Beighley. From a large matrix of thirty-two variables obtained with high school children. 1952. 1955a. Westover. 1943). 1940. and even then. 1940). occurred in another high school study only with "fairly difficult" and "difficult" material. however. Larsen and Feder. the most effective means of analysing relationships between listening comprehension and other psychometric variables has been employed in only a few instances. as compared with average and above average effectively Harwood. Larsen and Feder. 1934. though one of the studies on which this conclusion is based has not made the necessary allowance for the effect of regression (Anderson and Fairbanks. This superiority of reading over listening. 1940. 1935. 1937). listening effective with passages at other levels of ease (Harwood. As the material becomes more difficult. 1940) or that reading and listening are about equally effective as means of acquiring infor- mation (Larsen and Feder. Larsen and Feder. 1951). 1952. In addition to a reading factor and . 1940). students (Larsen and Feder. Corey. Odom and Miles. the greater is the advantage of listening (Beery. Rulon. At the senior use of printed materials has been found to lead to greater immediate comprehension than the use of phonograph recordings based on the same materials (Rulon. 1934. the A FACTORIAL ANALYSIS Beyond have been more variable. and two measures of selfrated interest in the latter test. 1955a). only on a limited scale. 1954). 1943). 1934. four sub-test analysis totals from the California Auding Test.14 LISTENING COMPREHENSION this level. findings level.

This study disclosed an auditory resistance factor in certain orally presented tests. His rotated factor matrix was not available to the author. On the basis of ratings made by college freshmen of the importance of various "factors" in listening. but the verbal facility factor. however. span memory factor was also found to be A common to tests involving the memorization of nonsense syllables. Two other studies have been concerned with the "factors" involved in listening comprehension. 1956). namely . size of listener's vocabulary. Two major factor studies have been made in areas which might be expected to have some bearing on listening comprehension. 1956). reading comprehension. he obtained what appeared to be a separate factor. indicating the extent to which subjects were able to resist distortion of words resulting from variations in the rate of presentation and the degree of intelligibility. but the "factors" discussed are not "factors" in the statistical sense. Nichols has listed the 'factors" involved in listening comprehension as intelligence. 1942). 1955a). In a factorial study of variables related to speech perception. recognition of correct English usage. and of the correlations he obtained between his listening comprehension test and other psychometric tests. The first of these is Karlin's study of auditory function among Mgh school students (Karlin. his results can be regarded as suggestive only. Stronger Indications of an auding factor were obtained in Caffrey and Smith's study of the factors involved in the Davis-Eells games. did not appear to be related to measures of speech perception in her sample of college students (Hanley. this factor. although the reading tests also had high loadings this factor in his unrotated factor matrix (Caffrey.THE PROBLEM AND an on auding ITS BACKGROUND 15 "interest" factor. The same factor. but in any case.67 with the Davis-Eells problem-solving factor (Caffrey and Smith. Hanley identified factors of verbal facility. voice memory. auditory resistance and auditory synthesis among others. which was defined by a vocabulary test of Thurstone's presented in an interrupted and uninterrupted form. regardless of whether the visual or auditory mode of presentation was employed. ability to make inferences and to sense . was found to be rather highly correlated with each of the other identified factors. accounted for most of the variance among the orally-administered Gates Reading Tests. because of the limited variety of tests included in the analysis and the absence of intelligence measures.53 with visual-verbal achievement and . described as an auditoryverbal factor.

E. and comprehend listening test instructions. In the analogous case of reading.16 LISTENING COMPREHENSION A FACTORIAL ANALYSIS the organization of spoken material. 1956). main and supporting ideas. There has been little progress in this direction in the past few years. that there She claimed partial confirmation of the hypothesis an independent listening trait on the grounds that when intelligence test scores were held constant. 1954). gested by Biggs would appear. audibility of the speaker and physical fatigue of the listener (Nichols. from the nature of her test battery. rather than listening comprehension as such. interest in and emotional attitude towards the topic. 1948). The auding Caffrey and by Caffrey and Smith rests be regarded as more than suggestive. Nor can a listening factor be affirmed on the basis of the evidence that listening comprehension can be improved through training. differentiate meaning. her listening test is still correlated to the extent of -50 with instructors' estimates of ability. EVALUATION OF RESEARCH What does the research evidence reveal about the nature of the task involved in listening comprehension tests? Are the differences in the performance of persons on these tests independent of or associated with the differences in their performance on other tests? Research studies have been too limited in number and scope to support the notion of a separate listening factor with any certainty. retain content. to reflect differences in verbal comprehension generally. Biggs developed a which required subjects to grasp ideas. understand words. recogrecognize nize correct word usage. it is worth noting that it has not been found necessary to postulate a reading factor despite the fact that there is factor reported by on too slender evidence to and the listening trait sug- ample evidence in school programmes to indicate that reading comprehension can be improved through the provision of training in reading. such improvement could well result from improved verbal comprehension. It was stated in 1954 that "considerable difficulty has been experienced in isolating listening ability from other personal characteristics" (Goyer. . rather than from the fact that it was achieved through listening. To test hypotheses about the factors constituting the listening process. listening but was virtually uncorrelated with a test of reading comprehension (Biggs.

1948) can be readily subsumed under reasoning factors and a verbal comprehension factor. and on tests involving language comprehension on the other. 1940). these facts suggest that individual differences in performance on listening comprehension tests may largely reflect differences in the performance of these persons on intelligence or reasoning type tests on the one hand. In the Fifth Mental Measurements Yearbook (Euros. but it occurred with both types of test (Larsen and Feder. Apart from motivational aspects such as interest in and emotional attitude towards the topic. 1959) Lindquist draws attention to the . and to note the reasonably high correlations between listening comprehension tests and other language and verbal type scholastic tests. The studies by Karlin (Karlin. especially tests of reading comprehension and intelligence. There is little in the research evidence to indicate what other forms of mental activity might be involved in listening comprehension tasks. Nichols' "factors" (Nichols. Taken in conjunction. It is also of some importance to find that correlations between tests of listening comprehension and intelligence are generally considerably higher for verbal than for non-verbal measures of intelligence. Despite the number of studies in which both reading and listening comprehension tests have been employed. Correlations between listening comprehension and reading comprehension tests are relatively high. the extent to which the two types of test are measuring the same skills and different skills is still not known.THE PROBLEM AND ITS BACKGROUND 17 The most significant point emerging from the available research concerns the relationship between tests of listening comprehension and other psychometric tests. regardless of the type of test used to assess listening comprehension. but. The size of the correlations between listening comprehension and reading comprehension tests can be partly attributed to a common association between these variables and measures of intelligence. except in one study. Inability to concentrate is mentioned in Larsen and Feder's study as a frequent cause of large differences between listening and reading comprehension scores. but the effect of such distortion on performance on listening comprehension tests has not been explored. 1942) and Hanley (Hanley. 1956) show that persons differ in their ability to resist distortion of speech due to variation in intelligibility or time intervals. the two types of comprehension test are is still substantially related when the effect of intelligence removed.

1951). Is it preferable. it is difficult to determine in what ways it can best be improved. reading comprehension and other language skills has already been thoroughly investigated in the context of this framework. and that testing time and effort are not being duplicated unnecessarily when both types of test are used in the same battery. Evidence of this kind is needed to ensure that there is some difference in what is being measured by the two types of test. Procedures have also been developed for extending this picture systematically so that newly identified factors can be incorporated easily into the existing framework (French. The appropriate experimental technique for studying relations between mental tests is factor analysis. there would appear to be an advantage in using groups at the upper elementary or early secondary school levels. It is also difficult to decide what types of item should be included in a listening comprehension test. The employment of factor analytic techniques in the past twenty to thirty years has enabled the more prominent types of mental activity to be identified experimentally. Without knowing what is involved in listening comprehension. by which stage reasonable proficiency in both . to test specific skills as the Browndoes. it is desirable that tests of listening comprehension be examined in the same way. but while there have been full-scale factor analytic studies of numerous types of mental activity. Research studies on the conditions affecting listening comprehension have given rather clear indications of the precautions that should be observed in selecting groups and specifying suitable conditions for factorial studies of listening comprehension. none of these studies has included listening comprehension tests. or to obtain a more general assessment of comprehension as is given by the STEP Listening Comprehension Tests? One failure to of the most serious gaps in research in this area is the examine the place of listening comprehension in the general scheme of what are referred to as mental abilities. Carlsen listening test for instance. In an exploratory investigation of this area. and a comprehensive picture of the various types of mental activity has emerged from these studies.18 LISTENING COMPREHENSION A FACTORIAL ANALYSIS fact that either the no satisfactory evidence has been produced to show that Brown-Carlsen Listening Comprehension Test or the STEP Listening Comprehension Tests measure anything not already measured by a silent reading test. As the place of tests of intelligence.

task of comprehending all but the simplest material would generally be regarded as demanding some reasoning on the part of a subject. As various types of be in- reasoning factors have been identified. Children in the lower elementary grades would generally not have attained the necessary proficiency in reading. . 1959). The main task in setting up the factor study consisted in determining what factors were likely to be involved in listening comprehension. The existence of a substantial relationship between reading comprehension tests and reasoning or intelligence tests is well accepted.THE PROBLEM AND listening ITS BACKGROUND 19 and reading could be expected. There are strong theoretical and empirical grounds for having the spoken tests presented by one person only (Lindquist. the inclusion of reference tests to measure the main sub-factors in the reasoning area might be expected to yield a clearer definition of the place of reasoning in listening comprehension tests. were then chosen. It is apparent from the research evidence that a similar relationship The and reasoning or listening comprehension tests intelligence tests. K The DEVELOPMENT OF HYPOTHESES present study was designed to investigate the factorial content of tests which measure the degree to which spoken passages or short talks are properly understood. while students in the final years of high school and at college or university would tend to be among the better readers of their age evidence of sex groups. and the extent of similarity in the factorial content of reading comprehension and listen- ing comprehension tests. The most appropriate rate for presenting the tests would appear from the evidence to be about 150 words per minute. This evidence is sufficient to is found between indicate that tests designed to measure reasoning should cluded in a study of this kind. such as reasoning and verbal comprehension. or reference tests. The sex. Appropriate measures of these factors. 1959. Stodola and Coffman. and preferably by means of recordings for an investigation of the kind envisaged. persistent differences in listening comprehension tests points to the desirability of separate factorial studies for each and the inclusion of test variables with differential appeal for the two sexes. The study aims to show the extent to which the variance of listening comprehension tests of this type can be accounted for by established factors.

in the com1951). Wittenborn. and because of the interest factorial structure of reading and listening comprehension. as the not available for further study once the words have been spoken. 1940. Experimental confirmation of this is evident in the relatively high correlations obtained between listening comprehension and reading comprehenand in the fact that in most cases there is still a subsion tests. is also likely to be influenced by individual differences in language or verbal competence. suggests that variations in auditory acuity do not affect listening comprehension. Empirical evidence with students not suffering from a serious hearing defect. relevance of reasoning and verbal factors to listening evidcomprehension has been strongly indicated by experimental indications of other relevant ence. however. or concentration could be expected to be of some- listening situation. parative tests in the batit was decided to include reading comprehension forms of these tests as listening and to present equivalent comprehension tests. whether it be in printed or spoken form. 1954). while reading comprehension tests do not. and that there is little loss in intelligibility . Verbal comprehension stantial relationship between held constant. There are minor experimental The such factors must rest more heavily on a consideration of the differences between the processes of listening and reading. Because of this. The fact that listening comprehension tests depend on apprehension of the spoken word. to be characteristic of both listening to the referents rather than to the Such attention what more importance in the material is mere symbols) appears and reading comprehension. Although there are minor indications that this may not be true (Larsen and Feder. ledge is also involved in reading comprehension tests (French.20 LISTENING COMPREHENSION A FACTORIAL ANALYSIS The comprehension of verbal material. 1943) the relevance of attention in both types of comprehension test justified the inclusion of measures of attention in the factor study. tery. but the choice of The need for close attention to the material to be understood (that is. factors. these tests when the effect of Differences in verbal competence intelligence is so it was appear most clearly in vocabulary tests (French. suggests that some measures of auditory performance should be included in a factorial study of listening comprehension. considered appropriate to include tests of reading and listening or verbal knowvocabulary in the study.

The relatively high correlations between listening comprehension tests and tests of intelligence and reading comprehension suggest that the factorial content of listening comprehension. since listening comprehension tests often require the recall of details mentioned in the spoken passage. this may not be true. comprehensive study of ability by Kelley has demonstrated that there are at least talk.THE PROBLEM AND essential that ITS BACKGROUND 21 with some types of speech distortion. Nevertheless. Comprehension could well be impaired among pupils with low auditory resistance to variations in speech stimuli. It was considered advantageous to include both auditorily-presented and visually-presented tests to represent each of the memory factors. it would seem some auditory tests be included in an experimental battery. And while it is commonly assumed that the intelligibility of speech samples in listening comprehension tests is of a sufficiently high level to avoid giving rise to differences in comprehension. 1954). particularly as such pupils are also likely to have developed consequent habits of inattention. such as Karlin's tests for the auditory resistance factor. verbal comprehension. because of a possible parallel between the two forms of presentation and the two memory factor. the listener cannot progress at his own speed or regulate the grouping of words and phrases as he wishes (Carver. the factors of rote memory and span memory could also be quite relevant. 1935). were obviously appropriate. types of comprehension being considered. The variance of listening comprehension tests can be accounted for by reasoning. This can be formally stated as the first hypothesis to be examined in the investigation: Hypothesis 1. it is likely that A memory may three types of memory factor (Kelley. tests may be rather similar to that of other comprehension tests and that the effect of an auditory or listening factor is likely to be small. atten- . In contrast with the reader. Since the degree to which a passage or talk has been comprehended is usually determined by questions administered at the completion of the part in memory play some listening comprehension. The meaningful which represents "the ability to remember meanmaterial" in both visual and auditory presentations is the ingful most relevant to the present investigation. It is obvious from the above discussion that the hypothesized factors are not all considered to be of equal importance in listening comprehension. Tests which would enable the effect of distortion in intelligibility or time patterns to be assessed. However.

. The study A therefore be examined in this study. the factors identified were found to be unrelated to the third hypothesis can mode of presentation of the test material. Listening comprehension tests have significant on the meaningful memory factor. The second hypothesis to be examined can be stated as follows: Hypothesis 2. but higher loadings on attention and memory factors. Visually-presented memory tests and auditorilypresented memory tests do not differ significantly in their correlation with either reading comprehension tests or listening comprehension tests. The second major hypothesis arises out of the difference in the mode of presentation of listening comprehension and reading comprehension tests. born. to a fifth hypothesis: The tests differ factorial content of listening comprehension with variations in the interest level of the topics presented. is The indications that the interest of the material for subjects of minor importance in a well-motivated listening situation leads Hypothesis does not 5. fourth hypothesis arises out of expected differences in the relationship of the different types of memory factors to listening A comprehension : loadings Hypothesis 4. Listening comprehension tests have similar loadings to reading comprehension tests on reasoning and verbal comprehension factors. the subject is able to re-read the passage or part of the passage if he so wishes. Hypothesis 3. but non-significant loadings on rote memory and span memory factors. Differences in the content of listening and reading comprehension tests would therefore be expected to occur mainly in the attention and memory factors.22 LISTENING COMPREHENSION A FACTORIAL ANALYSIS listening factor tion and memory factors. In the usual reading comprehension test. will also allow certain subsidiary hypotheses to be In Wittenbom's study of the attention factor (Witteninvestigated. This opportunity is not available in listening comprehension tests as passages are spoken once only and the subject is not factorial provided with a script of the spoken material. 1943) and in Kelley's study of the memory factor (Kelley. 1954). and no separate need be postulated.

Refertests for memory factors were selected from both those listed in the E. a battery of tests to measure the performance of individuals on the of task indicated. 1954).. P. These were designed to sample various types of situation in which listening occurs. 1951) as reference tests for test the was assembled ence the factors of general reasoning and verbal comprehension. explaining how something works. kit had been prepared (Keiley. tests by the Australian Council for Educational Research were substituted for similar tests listed in the E. Tests with high loadings on the Attention and Auditory Resistance Factors listed in French's monograph were selected as reference tests for these factors. This was an adaptation of the Co-operative tional Progress Series (E. New tests based on three short talks were prepared for the battery. as one of the more common listening experiences involves the comprehension of material presented orally in short expository talks.S. As the test battery was to be applied to Australian children. who had chosen passages which would provide natural listening motivation and which were typical of common oral situations. 1954). Nine tests of listening comprehension were prepared or adapted for inclusion in the battery. telling a story. kit and those identified in the more comprehensive study of memory ability carried out by H. One of these talks was of general interest to both sexes. and the like.CHAPTER 2 PREPARATION OF TEST BATTERY AND DESCRIPTION OF TESTS To hypotheses advanced in Chapter 1.S. such as giving directions. The other 23 .T. Kelley after the E. fully Listening Comprehension Tests in the Sequential Tests of Educa1956). Standard tests were available for a number types of the hypothesized factors. Reference tests for the Inductive Reasoning and Deductive Reasoning factors were selected from the "Kit of Selected Tests for Reference Aptitude and Achievement Factors" published by the Educational Testing Service (French. kit or in French's monograph (French.T. Only one of these tests contained material from a published listening comprehension test.T.S.T. and to reflect some of the different purposes for which people listen. this series had been care- prepared by a competent committee.S.

A. 1951). By presenting passages test as a reading test and the other form as a a comparison of the factorial structure of reading listening test. The remaining four tests of listening comprehension were reading comprehension tests. further test was prepared to represent another common situation A in which listening occurs.S. and listening comprehension could be made for passages of similar content and style. in addition to vocabulary tests. namely. It was therefore necessary to ensure that all existing tests were suitable for Grade investigation. Most of the reference tests had been originally designed for still U. as previous research had distinguished between the two types of listening (Blewett. this series included tests designed to assess understanding of different aspects of the the main ideas. selections suitable for listening comprehension may weU differ in content and style from those suitable for reading comprehension tests. listening for detail. For an adequate comparison of listening and reading comprehension. would be in specialized types of and as there would be many organizational difficulties in scheduling a lengthy testing programme for such children. There were already in existence two equivalent forms of reading comprehension tests prepared by the A. children above the Grade 8 level or for older groups. they were included to assess whether the factorial structure of listening comprehension tests girls. Children in 6 children. however. it appeared desirable to include some listening tests similar in type to the reading comprehension tests to be used in the study. It is sometimes questioned whether reading comprehension test passages should be presented as "listening" tests (Goyer.C.24 two LISTENING COMPREHENSION talks A FACTORIAL ANALYSIS were respectively designed to appeal to boys but not to and to girls but not to boys. and to prepare new instructions and practice examples where required. the highest grade level of the elementary school. .R.E. As children of these age levels secondary schools in Victoria. listening to everyday conversation or spontaneous discussion among two or more persons. differed with the degree of interest in the material presented. younger children were used for this Grade 6. details and implications. 1954). It was useful also to have separate measures of one form of each and listening for inference. for Australian children. were chosen for the purpose. presented in "listening" form.

Time limits for new and adapted tests were determined experimentally and were set so that almost all of the children could attempt all items in the time allowed. In selecting items for tests and in setting time limits and rates of presentation. tests were pre-tested on any one class of children. In one case. except in the case of speeded tests where the original time limits had to be retained to preserve the factor content of the tests. This was necessarily an unspeeded test. original intention of using the existing equivalent forms A.E. The of the . The usual measures of reading comprehension take account of rate of reading as well as accuracy of understanding. as the children were allowed sufficient time in which to choose an answer after each question had been presented orally. Item analyses were undertaken for most tests.R. and were used as a basis for retaining items in existing tests and selecting items in newly prepared tests. most of the early items in the tests could be correctly answered by most Grade 6 children. Reading Comprehension Tests (Reading for General Significance. The question then arose as to whether the corresponding reading comprehension test should be speeded or unspeeded. In both "reading" and "listening" form. In listening. The existing tests were therefore used as pools of items for the preparation of shorter tests. Reading for Inference) had to be abandoned. that time limits were appropriate and that rates of presentation of orallypresented tests were satisfactory. The purpose of the pre-testing was to ensure that existing or new instructions and practice examples could be understood by Grade 6 children. Reading to Note Details. this required five revisions of a test on five different classes of classes of Generally between two and six children. that existing or new items were of appropriate difficulty level and discriminating power. it was aimed to achieve something like a normal distribution of raw scores for each test. involved 18 different Grade 6 between 40 and 60 children in 10 different schools. however. which was spread over a period of a year. Sufficient items were selected in each case to construct a listening test which would require about 10 minutes* testing time.PREPARATION OF TEST BATTERY AND DESCRIPTION OF TESTS 25 All of the tests were therefore pre-tested on Grade 6 children before being included in the final battery. The pre-testing. The retention of such items would not have made effective use of the available testing time.C. Pre-test results indicated that the tests were functioning as speed of reading tests when given to Grade 6 children with the set time limits.

and the length of pauses between test items and test passages. While it was considered preferable that the instructions for each test should be introduced in "live" form and that the earliest practice examples . and the listening comprehension score depends only on the accuracy of understanding of the material presented. and not to the relative amount understood when each of these processes is employed for the same fixed possible. and would perhaps result in lower scores on such tests than might have been achieved with a visibly present speaker. and to allow the reading comprehension tests to become power tests by setting time limits which would permit the majority of the children to complete the tests. in an experimental investigation of this type. It was still sion tests that might be related to rate of reading.26 LISTENING COMPREHENSION A FACTORIAL ANALYSIS the rate of presentation is constant for all children. the rate of delivery of the material in the orally-presented tests. The use of tape recordings for listening comprehension tests would remove some of the realism of the ordinary listening situation in schools. it seemed important to control all sources of variation other than those being examined. so that they would be presented in exactly the same way to all classes participating in the experiment. When items had been selected on the basis of indices of difficulty level and discriminating power to provide a suitable test for Grade 6 children. It was therefore decided to eliminate the influence of rate of reading from the reading com- prehension score. or when rates of presentation or the amount of material to be memorized had been adjusted to secure a near normal distribution of raw scores. So the corresponding measures of listening and reading comprehension used in this study refer to the relative amount understood when material is presented in two different ways. to detect any difference in the factor structure of reading and listening comprehen- interval of time. Twenty of the tests selected for the final battery had to be presented orally. The use of tape recordings appeared to be the most effective means of standardizing the manner in which passages for listening comprehension were presented to each class. in "live" Tests which were to be orally presented were first pre-tested form by the author. It was decided to present these tests by means of tape recordings. as a separate speed of reading test was also included in the battery. Nevertheless. the test passages and questions were then put on tape. It could also be argued that tape recorded listening comprehension tests might not be as practicable for use in schools as "teacher-administered" tests. however.

Accordingly. it was thought desirable to re-make the test with a female rather than a male voice.T.PREPARATION OF TEST BATTERY AND DESCRIPTION OF TESTS 27 should be explained in detail by the author.P. The quality of the tape recordings for the Singing and Listening to Spontaneous Speech tests was not test of Singing had originally as good as for the other recordings. A tape recording of such a discussion by a group of four school girls was made in a private home. a three two-hour sessions were required high quality tape recorder (a Byer 66 machine) being used for this purpose. series of listening comprehension tests (Educational Testing Service. Several of the tests Triplet Numbers. teresting presentation Two of the tests were recorded by other persons.E. to ensure that the final form of each test was suitable for Grade 6 children. Listening to Spontaneous Speech. but the level of intelligibility achieved in these two recordings was considered to be quite adequate for use in school classrooms. to One three-hour and make the recordings. and the four tests of auditory resistance were further pre-tested in tape recorded form. designed to assess comprehension of poorly organized spontaneous speech. As Karlin's been presented by a soprano. required an unprepared and unrehearsed discussion of a topic by a group of children. The recordings were made in studios at the Royal Melbourne Technical College in the presence of the author and under the technical supervision of the officer responsible for school broadcast systems in government schools in Victoria. Listening to Short Talk. Another test. The procedures adopted in the preparation of the listening comprehension tests generally followed the recommendations of the committee responsible for preparing the S. A male speaker. was engaged to make the tape recordings for all but two of the orally-presented tests. 1955). so that the children would become accustomed to the tape presentation of material in each test. Options for each question in these tests were printed on the test . the test was re-made under the conditions described above by a young female soprano. with considerable experience in giving radio talks in the Schools' Broadcast sessions of the Australian Broadcasting Commission. part of the instructioBS and some of the later practice examples and explanations were also recorded on tape. who listened carefully to the original American test before making its Australian counterpart. Excellent clarity and inof material were achieved in the recordings.

The decision that had been followed in other studies in which that the practice test had been used. the score being taken as the correct. It was selected . kit of reference The task is tests. As with essentially two-choice items. options was used in Although the multiple-choice form of question for guessing was not generally a number of tests. changes have been made to the original what A.T. 2. a correction in the case of each individual test rested on applied. The steps involved in adapting the tests for use with Grade 6 A children are described in some detail to indicate clearly reference tests.S. for Letter List. and only for Triplet Numbers. Letter Series This test. to find the rule which relates three of the sets to fit each other and original test was Grade 8 and above. The instructions for the test were amplified slightly. The said to be suitable for children in minutes to allow the younger children to attempt a reasonable number of items in the test. Additional did not prove to be easy items prepared for Grade 6 children but the time limit was extended from three to four required. Each of the tests included in the battery is described in the factor loadings obtained in this investigation in the readily compared with those reported a result. so that children were not required as well as the material in the passage or talk itself. a correction for guessing was applied B. Letter Grouping test. is given in Appendix sample item from each test following pages. forms the "Reasoning" sub-test of the Primary Mental Abilities for ages 11-17. Inductive Reasoning 1. The number test contained thirty items. REASONING TESTS I. to mark the set which does not the rule. which was developed by Thurstone. which contained three-choice items. is named as a reference test for the Induction factor in the E. could then be more previous studies. Each item consists of four sets of four letters. published by Science Research Associates. This which was developed by Thurstone.28 LISTENING COMPREHENSION A FACTORIAL ANALYSIS to remember the booklets.

and the subject is required to choose from six or eight alternatives the figure that involve the comwould best complete the pattern. The sets can be administered with either an overall time limit or with fixed time limits for each set. Items in Set pletion of simple patterns. kit of reference tests. 1941).PREPARATION OF TEST BATTERY AND DESCRIPTION OF TESTS 29 as a reference test for the Induction factor because of Its loading this factor In an earlier study (Thurstone and Thurstone. which was developed by J. is named as a reference test for the induction factor In the E. C. each item is a 2 x 2 matrix. as the test had been children with time limits of two minutes for Set A. with the lower right corner of each matrix missing. correct. 3. giving a possible total score of 60. C.T. of the items in the Progressive Matrices test presents a geometrical pattern or matrix which is either symmetrical in form Each or involves directions. but did not prove to be required. The figure in the upper left hand corner is de- 3x3 veloped in and/or vertical directions. four minutes for Set C. Some easier items were prepared. an analogous relationship which exists both horizontally and vertically among the four corners enables the form of the missing part to be determined. The score on the test consisted of the among Grade 6 number of Items Raven's Progressive Matrices This test. two-way development in such characteristics as size and number of component elements has to be determined. The latter D procedure was chosen In Australian standardized for five this study. but was made available to teachers whose classes participated in the experiment. this was not used as an experimental variable.S. It consists of five sets (A. and E) of twelve items each. minutes for Set D and six minutes for Set E. In Set B. Experimental trials indicated that the first twenty-five items of the Science Research Associates* test with a six minute on time limit would provide adequate discrimination children. A A with the fourth corner missing. Items in Sets D and E are also presented in the form serial fashion in horizontal and the overall effect of this . three minutes for Set B. B. The score on the test was taken as the number of items correct on all five sub-tests. An IQ (intelligence quotient) based on the overall score was determined for each child. Items in Set C are matrices. Raven. a serial progression in horizontal and/or vertical part of the pattern is omitted.

In each item in Set D.S. two (or three) of the four words are missing. This which was developed by Thurstone. is named as a reference test for the Deduction factor in the E.30 of 3 LISTENING COMPREHENSION A FACTORIAL ANALYSIS x 3 matrices.S. the test proved to be correct. Part A of the original test consists of verbal matrices containing two rows of two words each. In the Set E matrices. three figures (or groups of figures) occur in cyclical order. Deductive Reasoning 4. the first figures are II. The missing figure is found by applying the correct processes to the first and second figures in the third row or column. often with simultaneous background development from row to row or column to column or in cyclical order also. score limit.S. the third figure in each row or column is obtained by combining figure The and second figures in the corresponding row or column. 1952).T. It consists A greater than B. but the item analysis data were used to modify the original test so that the easiest children would appear earliest in the this three items for test. The missing is the one which completes the third cycle simultaneously for both types of development. When Grade 6 administered in suitable for form with a five minute time Grade 6 children. tests. Part of the B of the original test involved type. kit of reference tests. and B A Experimental trials of the test indicated that additional easy items were not required. kit of refer- ence is of thirty formal syllogisms of this type: is greater than C. and have to be selected from five alternatives so that the two words in each row will be related in the same way. however. Reasoning test. The test is named as a reference test for the Deduction factor in the E. combined by the processes of addition and/or cancellation of the various elements.T. The instructions for the test were amplified for use with Grade 6 children. with the lower right corner missing. The 5. however. therefore is ? than C. The subject is required to write in the correct word. on the test is the number of items Word Squares This test was based on a test originally prepared by Adkins and Lyerly for application to enlisted men in the U. Army (Adkins and Lyerly. 3x3 be too and 4x4 matrices same and was considered to difficult for Grade .

VERBAL COMPREHENSION TESTS 7. general vocabulary test of this kind is considered to be a suitable reference test foi A (French. Reading Vocabulary This test was adapted from Form A of the A. Arithmetical Reasoning This test was adapted from Form B of the A. 1954). A The contained fifteen items eight from the A.R. Word Knowledge test. The experimental data indicated that a time limit of .E.C.E.R. Junior B test and seven from the Adkins and Lyerly test to be administered with a time limit of seven minutes. The instruction page was expanded and simplified. using all of the items in Part A. final test The III.R. score on the test is the number of items correct* General Reasoning 6.S. Problem Arithmetic test. trial test was prepared.E.PREPARATION OF TEST BATTERY AND DESCRIPTION OF TESTS 31 6 children. kit of reference tests.E. and preceding them by the verbal analogies sub-test of the A. The subject is required to select from five words the one which is most nearly the same in meaning as the test word printed at the beginning of each question.C. Junior B intelligence test. Thirty of the original one hundred items were selected for the revised test on the basis of item analysis data obtained for a group of Grade 6 children. arranged in "word squares" form.C. Seventeen of the original twenty-six items were selected on the basis of an item analysis of the results of a class of Grade 6 children. and the trial test was administered to three groups of Grade 6 children with appropriate modifications after each administration.R. test is the number of items correct. The number of items selected was governed by the number that could be administered in ten minutes in a test listening the verbal factor vocabulary based on a parallel form (Form B) of the A. consist of arithmetical problems which require little numerical computation for their solution.R.E. This type of test is named as a reference test for The items the general reasoning factor in the E.T.C. The score on the B. Word Knowledge test. The time limit for the revised test was determined experimentally and set at eight minutes so that almost all Grade 6 children would have sufficient time to attempt all the items.C.

Item analysis data obtained in the preliminary trials were used to prepare a shorter form of each test which was appropriate for children of this grade level. trial of the test with Grade 6 children indicated that the liminary time limit of 2i minutes was satisfactory for Australian children. The to level of the material is well within the grasp of Grade 6 children. would allow almost . tests with Grade 6 classes showed that the original tests required too much testing time and contained too many easy items for Grade 6 children. The subject required to cross out in each paragraph the word which should not be there. 11.C.E.E. which was prepared by Chapman and Cook.C. It consists of thirty 8. is published by the Educational Test Bureau.R. reading tests. Data obtained in the preliminary trials were used to set a time limit for each reading test which all Grade 6 children to complete the test. and to check as many paragraphs as he can in 21 minutes. Some minor modifications in wording were prenecessary adapt the test for Australian conditions. Reading for General Significance Reading to 10. score on the test was taken as the number of items Speed of Reading test.32 LISTENING COMPREHENSION A FACTORIAL ANALYSIS almost all 6 minutes would be to attempt all sufficient to allow Grade 6 children the items. The number of items used in each of the revised reading tests was determined by the number that could be administered in about 10 minutes in the corresponding listening test. Note Details Reading for Inference These three tests were adapted from Form A of the corresponding A. Items selected for the shorter tests were matched in difficulty level and discriminating power with corresponding items in the tests of Listening for General Significance. This one word which is short paragraphs. in the second half of each paragraph. score on the test is the number of wrong words correctly identified.R. there is spoils the meaning of the paragraph. Listening to Note Details and Listening for Inference respectively. preliminary trials of the A. A The 9. In each case. The correct.

For each of the three reading tests. B. ATTENTION TESTS The three tests in this group were originally used by Wittenborn in a factorial study of attention tests (Wittenborn." ranging between 40 and 90 words in length. A The score on the C. Matching Words test This was prepared by J.PREPARATION OF TEST BATTERY AND DESCRIPTION OF TESTS 33 The revised test of Reading for General Significance contains fourteen short passages which are to be read silently. test is the number of items correctly answered. The subject is required to read each story silently and then select which one of four to alternative sentences tells what is most happen next. The functions are limited to the use of verbs and adjectives and to the use of a noun or pronoun as subject or object of a sentence. The test comprises nineteen questions based on five passages. the score was taken as the of items correct. A time limit of 9 minutes was set for the test. and has a time limit of 12 minutes. Reading to Note Details. likely number 12. Minor modifications in wording were required to make the test suitable for Australian to recognize the function that children. 1943). test of In the revised required to read a passage silently The revised form of the test of Reading for Inference contains twelve "stories. The subject is required to answer a question about each passage by selecting one of five words which best describes the sense of the passage. The time limit for the test was set at 10 minutes. the subject is and then answer from three to five questions about details mentioned in the passage. Carroll is The subject is required performed by a given word in a particular sentence. The correct answer to each question has to be chosen from five suggested answers. They were prepared for use with men ranging in age from 18 to 30 entering an Air Corps Technical School in Illinois. . preliminary trial with Grade 6 children indicated that the original time limit of 8 minutes would be sufficient to allow most children to attempt all thirty items in the test. and then to select the word that performs a similar function in a second sentence.

Letter List This test was developed from a description of the original test given by Wittenborn. no response was to be made. he was to respond to . "live" form trials of the test with the digits presented at 2 second." the constant being added to avoid negative 14. If neither of these fulfilled. The scores. The instructions for the test were expanded considerably. and ample practice examples were provided so that the children would be familiar with the task to be performed. set was the largest conditions was then tively H second. Triplet A FACTORIAL ANALYSIS Numbers test was developed from a description of the original given by Wittenborn. In the original test. and a minus for a consonant following a vowel. and to make a cross otherwise. Wittenborn's procedure was adapted slightly. digits were therefore presented at the rate of approximately 90 beats a minute. The final form of the test consisted of twenty-five sets of three digits. a series of letters was presented on phonograph records. Sets of three digits were presented to Wittenbom's subjects by means of phonograph records. In the tape recorded form of the test. However. Subsequent trials indicated that there skewed would be too many high scores if the break between sets was longer than one beat. then 1 second intervals resulted in highly nega- distributions of scores. When a vowel followed a vowel or a consonant followed a consonant. Wittenborn had presented the digits in each set at the rate of 96 beats per minute. with a pause of six beats between Sets 12 and 13 and an interval of one beat between every other set. score on the Wrongs) -f~ test was obtained by the formula "(Rights 25. but it was expected that a slower rate of delivery would be required for Grade 6 children. The subject was to respond by marking a plus for a vowel following a consonant. The children were required to make a tick if either of the conditions was fulfilled. The subject had to write a plus if the first number of the set was the largest and the second the smallest.34 LISTENING COMPREHENSION 13. As it was considered that Grade 6 children might not give an independent response if they were able to observe when others in the class were making a written response. Pre-test results indicated that simplification of the rules was unnecessary for Grade 6 children. or if the third number of the This test and the first the smallest.

PREPARATION OF TEST BATTERY AND DESCRIPTION OF TESTS 35
the next letter with a plus no matter what It was. The task was simplified for Grade 6 children by requiring them to mark a plus for a vowel following a consonant, a minus for a consonant fol-

lowing a vowel and a tick for a vowel following a vowel or a consonant following a consonant. Simplified Instructions were prepared for the test, with ample practice exercises. It was considered
that the rate of delivery of the letters used by Wittenbora would be too rapid for Grade 6 children, but successive trials of the test in "live" form at slower delivery rates indicated that the original rate of delivery in which letters were called on alternate beats of a metronome set at 66 beats a minute, would be suitable for Grade 6 children. When the tape recorded form of the test was prepared, a stop watch was used to time delivery rates. The practice exercises were applied with 3 second intervals between letters. Letters in the three lists in the real test were called at the rate of one every two seconds. An interval of eight seconds was allowed between the lists, and the next list was announced during this
interval.

Each of

the three

lists

in the real test consisted of ten letters,

but as no response was to be

made

for the

first letter

of each

set,

the total possible score was 27. The score on the test was obtained I Wrongs) -f 15," the constant being by the formula "(Rights

added

to avoid negative scores.

15. Five Letters

This test was developed from a description of the original test given by Wittenborn. The sequence of letters, A, B, C, D, E, was presented orally to the subject at the beginning of each question but he was not allowed to write the sequence down. The task required the subject to interchange mentally two of the letters and then place one of the five letters between two of the others before writing his answer. Fifteen questions of this kind were selected from a larger number pre-tested in "live" form with two groups of Grade 6 children; these questions were arranged in order of in tape recorded form. difficulty, and the final test was presented
Extensive instructions were prepared for the
presented partly in "live"
test,

and these were
of sequences

form and partly by

tape.

The

score

on the

test consisted of the

number

completely correct.

36

LISTENING COMPREHENSION

A FACTORIAL ANALYSIS

D. AUDITORY RESISTANCE TESTS

The
a

four tests in this group were originally used by Karlin in

factorial study of auditory function (Karlin, 1942). They were distortion of meandesigned to tap the ability of subjects to resist the temporal sequence of sounds, and due to disturbance of

ing

were

was based on originally presented on records. Karlin's study the test performance of two hundred high school students at Whiting High School, Indiana.
16.

Rapid Spelling
subject
is

familiar words which required to write down Karlin's description of the have been spelled out very rapidly. a basis for preparing such a test, using original test was used as the official spelling lists prepared by the Victorian words from

The

Education Department for Grades 2, 3, 4 and 5. A test of twentyone such words was pre-tested in "live" form with two classes of Grade 6 children, and the results were used to prepare a test of
ten words of suitable
difficulty level for

Grade 6

children.

recording of the original test made available by that most of the six words he used would be unfamiliar to Grade 6 children in Australia, but one of the words "multiplication" ten word test to help ensure that the was added to the
existing

tape Karlin indicated

A

obtained score distribution would be symmetrical and that the test would discriminate sufficiently among children at this grade level. The eleven item test was then recorded on tape by the Australian
to write down speaker, ample time being allowed for the children each word. As satisfactory results were obtained when the tape

recorded

test

was

tried with

another class of Grade 6 children,
test battery.

it

was accepted

in this

form for inclusion in the
test
is

The

score on the

the

number

of words

correctly

understood.
17. Singing

subject is required to write down the words of a short vocal selection sung by a female voice. Each selection is played twice, and is preceded by a piano chord, played either simultaneously or in arpeggio form. Karlin's test could not be used in

The

its

original

form because of the

differences in accent

and inton-

ation of American and Australian speech.

A

new

tape was pre-

PREPARATION OF TEST BATTERY AND DESCRIPTION OF TESTS 3?
pared by an Australian soprano, using the original four selections. Pre-tests of this tape with two classes of Grade 6 children indicated
that the difficulty levels of the
first

three selections were suitable

for this group. The fourth selection was not used in the test battery as it was too easy for the group. One six-word and two seven-word
selections

were used in the

test.

The

score

on the

test is

the

number of words
18.

correctly understood.

Haphazard Speech

subject is required to write down the words of a short sentence spoken with unusual inflection and pitch changes. The five sentences used in Karlin's original test were pre-tested in "live"

The

form with a

class of

Grade 6 children and proved

to

be of suitable

difficulty level.

A new tape was prepared by the Australian speaker,

attempted to reproduce the Inflections and pitch changes in Karlin's original test as faithfully as possible. This tape was administered to a further group of Grade 6 children, and the results
indicated that each of the five sentences should be retained in the
test.

who

The

score

There are

thirty-five

on the test is the number of words understood. words altogether.
Grouping

19. Illogical

The subject is required to write down the words of a short sentence spoken with a grouping arrangement contrary to the sense of the passage. Karlin's original test was administered in "live"
a class of Grade 6 children, be of suitable difficulty level for this group. The modifications were designed to ensure that only words which were familiar to Grade 6 children would be used in the sentences. The Australian speaker who prepared the new tape made a careful

form with two and was found

slight modifications to

to

attempt to reproduce the sentences in exactly the same way as they were spoken in the original test. As a result of a further trial

with the

new

tape, only the first six of the seven sentences

were

used in the battery. The last sentence was too easy for the group and was omitted in order to reduce testing time. The six sentences

used in the
of

test

contained fifty-one words.

The

score

is

the

number

words understood.

the first sentence in each pair states a condition and the second sentence of the pair states a consequence of that condition. the correctly reproduce in his own words the conof that condition. The children were allowed to study the sentences for 4 minutes. The test proved to be suitable in form and with these timing arrangements. The initial reading of the pairs of sentences and the subsequent reading of the first sentence of each pair were then recorded for presentation on tape. the subject does not know which word will be omitted. dissertation. so additional items were added to make a final test of twenty pairs of sentences which proved to be suitable for Grade 6 children. Kelley's subjects comprised 480 U. Air Force group.38 LISTENING COMPREHENSION E. A new test of this kind was prepared. This test was administered to a class of Grade 6 children according to the plan originally adopted by Kelley for his 40 sentence test with the U. When the first sentence of each pair is heard again. The subject hears several pairs of sentences read aloud. 21. Meaningful! Memory 20.D. all of the tests were originally prepared by H. The score on the test was the number of words correct. When studying the sentence. dissertation. The subject is required to learn a group of unrelated sentences so that when he is presented with a sentence with one word omitted he can reproduce the missing word. and were then required to take another unrelated test occupying about 10 minutes before being asked to complete the sentences studied originally. set of fifteen pairs of sentences sequence pre-tested in "live" form with a Grade 6 class did not have suf- subject must A ficient ceiling. incorporating 25 sentences appropriate for Grade 6 children. Consequences this The type of task involved in this test is illustrated in the "directions" page for Consequences Test II (Verbal) in Kelley's Ph. Air Force pilot cadets entering basic pilot training at Lackland Air Force Base. 1. San Antonio. Approximately half a minute . A FACTORIAL ANALYSIS MEMORY TESTS in this section With the exception of the Word-Number test. Sentence Completion This test was based on Kelley's original test. 1954). Texas.S.D. Paul Kelley for a factor study of memory ability (Kelley.S. as described in the "directions" page for the test included in Kelley's Ph.

Then the first word of each pair is read again in a different order. "car" was accepted in lieu of "calf. The score on the test consisted of the number of words for which the correct response was supplied. Rote Memory 22. .. is named as a reference test for the Associative Memory or Rote Memory factor in the E. he has to write the appropriate number beside each word. The pairs are read aloud twice at the rate of approximately 2 seconds per pair. kit of reference tests. with ten pairs in each part. Memory for Words This test was developed from Kelley's description of the Memory for Words Test I (Unrelated words) used in Ms factor study of memory ability. Alternative responses were allowed in cases where the final consonant had not been sufficiently distinct. when the words are presented to him in a different order.T. In this test the subject is required to learn pairs of unrelated one-syllable nouns so that when he is presented with the first word of a pair he can reproduce the second word. for which a period of five minutes is allowed. and the test was finally applied with a nine minute study period and a five minute recall period. The effect of extending the time limits was therefore assessed with two other Grade 6 classes. for the subjects to write each of the consequent The II. administered consecutively. which was developed by Thurstone.S." "land" in lieu of "lamb. The 23." and so on. for example. The read- A ing of the paired words and the subsequent reading of the stimulus word were then recorded for tape presentation in the final battery. score on the test was the number of Ideas correct. Later. the order of the pairs being altered for the second reading. The test consists of two parts. The subject is required to study This fifteen word-number pairs for a period of six minutes. and ample time is allowed test comprising twenty for the subject to record his response.PREPARATION OF TEST BATTERY AND DESCRIPTION OF TESTS 39 was allowed sentences. Word-Number Recall test. The test proved to be too difficult for a Grade 6 class when these study and recall periods were applied. pairs of four letter words was prepared and proved to be suitable for Grade 6 children when administered in "live" form. score on the test was the number of words correctly numbered.

After hearing a sequence of letters. Listening Vocabulary This test B of the A. of sequences completely correct constituted the test. Kelley's procedure of using two sequences of each length from 3 to 11 letters was modified to provide a nineteen item test including three sequences at each length from 3 to 7 letters. is The subject original form. The score on the test consisted of the number of sequences completely correct. The actual test items and part of the instructions were subsequently recorded for presentation in tape form in the final battery. F.E. The results indicated that the two nine-letter sequences were too difficult for this grade level.40 III. two sequences of 8 letters. EXPERIMENTAL TESTS OF LISTENING COMPREHENSION was adapted from Form which. and two sequences of each length were presented one letter at a time by flash cards on a display stand. the subject is required to reproduce the sequence. required to select the one which most nearly the same in was a reading from five words meaning as the test word . two sequences of 8 letters and two sequences of 9 letters was prepared and administered by flash cards (8 in. test. Letter Span II (Auditory) This II test was based on Kelley's description of the Letter Span (Auditory) test used in his factor study of memory ability.) to a Grade 6 class. In Kelley's test. LISTENING COMPREHENSION A FACTORIAL ANALYSIS Span Memory 24. Word Knowledge vocabulary test. the sequences ranged in length from three to eleven letters. The test was administered in "live" form to a Grade 6 class at the rate of 1 second per letter reading time and was found to be suitable in this form. x 7i in. Each was exhibited for 2 seconds. the subject is required to reproduce the sequence. After seeing a sequence of letters.R. A test involving three sequences of each length from 3 to 7 letters.C. in its is 26. and two sequences of 9 letters. Letter Span I (Visual) This test was based on Kelley's description of the Letter Span Test I (Visual) used in his factor study of memory ability. so the final test comprised seventeen sequences ranging in length from 3 to 8 letter letters. The number score on the 25.

which was administered as a reading vocabulary test. Each of these reading comprehension tests was first presented to various groups of Grade 6 children as a listening test. The criterion used for determining the number of items to be included in each listening test (and consequently in each reading test) was the number that could be ing test administered in 10 minutes of testing time. 11. Listening for General Significance 28. Shorter forms of each test were therefore prepared for use as listening tests. items.PREPARATION OF TEST BATTERY AND DESCRIPTION OF TESTS 41 read aloud by the speaker. The Items included in the were selected so that the distribution of item difficulty levels for these classes was the same for this test as for the modified version of Form A of the test (Test 7). questions and alterna- These three tests of tive answers being read aloud by the author. using the item analysis data obtained in the preliminary trials. Each of these short listening tests was designed to give a raw score distribution similar to that given by the cor- responding short reading test. as this test The length of the test was set at 30 proved to be an appropriate number of Items for a 10 minute test of listening vocabulary. the passages. Listening for Inference tests were adapted from Form B of the A. The score on the test was the number of items correct. Listening to Note Details 29. These preliminary trials indicated that far too much time would be required to present the complete tests in listening form. (See Tests 9.C. The test word Is not printed on the speaker. Reading to Note Details and Reading for Inference respectively.) This was achieved by constructing the listening test and its associated read- from items which were roughly matched in difficulty level and discriminating power. but the five alternatives are printed test booklet as well as being read aloud by the on the ministered in "live" form. Reading for General Significance. 10. 27. Thirty of the 100 items In the original test were selected for Inclusion In the listening test on the basis of item analyses of the results obtained by children In two Grade 6 classes to whom the test was ad- subject's test booklet. . contained many items that were too easy for and that each test Grade 6 children.E.R. but only the alternative answers being printed on the child's test booklet.

The talk briefly traced the development of mosaics from the earliest known examples. the subject is required to select which one of five alternative answers best describes the general sense of the passage. In the test of Listening to Note Details. The correct answer to each question has to be chosen from one of five alternatives. a talk on mosaics was chosen as being most suitable for Grade 6 children. The score on each of these tests was taken as the number of items correct. Listening to Short Talk was designed to represent the type of listening situby Grade 6 children both in the classroom and in schools' radio broadcast sessions. The subject required to listen to each story. showing how the idea spread to various and eventually to Australia." is test of Inference consists of thirteen each containing between 30 and 70 words. From a number of broadcast scripts made available by the Commission. and concluded with a description of some important mosaic work being carried out in Australia at the present time. This talk had not been broadcast to countries schools in Melbourne. The test was based on a talk that had actually been presented in a schools broadcast by This test ation often encountered the Australian Broadcasting Commission. Listening for The "stories. and then to select which one of is four alternative sentences states what next in the story. There are five passages in the test. except for the last practice example in each test.42 LISTENING COMPREHENSION A FACTORIAL ANALYSIS The test of Listening for General Significance comprises fourteen short passages on various topics. After listening to a passage. and eighteen questions based on these passages. but the alternative answers were also printed on the test booklets for the instructions listening tests The subjects to follow as they listened to the tape recording. and then to answer three or four questions relating to various details given in the passage. questions and alternative answers in the actual tests were presented from the tape recorder. 30. . which was presented from the tape recorder. All of the passages. the subject is required to listen to a short passage. most likely to happen and practice examples for each of the three were presented by the author.

most of whom would be between 11 and 12 years. The author therefore enlisted the aid of four schoolgirls of his acquaintance. the talk 71 minutes. discussion of a topic by a group of children. . and the implications of the material presented. testing comprehension of main ideas and details.PREPARATION OF TEST BATTERY AND DESCRIPTION OF TESTS 43 Twenty four-choice questions were prepared on this talk. one 12 and one 9. The talk and the questions were then recorded on tape by the speaker. spontaneous speech of this kind be marked by the introduction of ideas in an un- organized fashion and by lack of continuity in the discussion. 31. the subject being discussed is usually not as well organized as when it is presented in a formal lesson or talk. itself occupies about When answering the questions on the test. it would be difficult to obtain such a speech sample which was of interest outside the group and which was long enough to provide material for a test of about fifteen questions. and this tape recorded form of the test was found to be quite satisfactory when applied to another Grade deleting 6 class. is With likely to children. two of whom were aged 14 years. and was found The results of this pre-testing to require 12 minutes* reading time. The most practicable procedure appeared to consist in asking a number of children to discuss a given topic. when a person is expected to pick up the thread of a conversation or discussion among a group of people. were used to shorten the talk by some sections. Listening to Spontaneous Speech This test was designed to represent one of the more common types of listening situations. The score on the test is the number of correct answers. People experienced in school broadcast work indicated that it would be difficult to obtain even a reasonably coherent discussion of an unprepared topic by a class of Grade 6 children. It was hoped they would be able to discuss a topic at a level suitable for Grade 6 children. In such a situation. the subject is able to follow the printed options on his booklet as they are being presented by the tape recorder. particularly. The talk was read to a Grade 6 class by the author. and to select fifteen questions suitable for Grade 6 children. as the children would be unlikely to talk freely. In the ordinary course of events. In the tape recorded version. It was considered that the best means of obtaining a sample of poorly organized spontaneous speech for use in the battery would be to record an ad lib.

Two differed for this purpose. and provided a very satisfactory The recording was administered to a class of Grade 6 children. The boys* talk was designed to appeal to boys but not to girls. These two boys was prepared on the subject of how aeroplanes become indicating in simple terms how and why aeroplanes air- . while the girls' talk was designed to appeal to girls but not to boys. it was thought necessary to let the girls know just prior to their discus- be considered. and the functions of the main controls. While it seemed undesirable to structure the topic too greatly. The options for each The score on the test is question are printed in the test booklet. where and how it should go. Listening to Girls Talk tests are described together. The girls were asked to imagine that they were members of a club discusswas ing where they would go for their annual picnic. such as when the club should go on the picnic. The aim in including these talks in the test closely structure of listening battery was to assess whether the factorial 3 These two was according as the material presented for listening was talks were prepared intrinsically interesting or uninteresting. followed by 29 four-choice questions in "live" form relating to details of the discussion and inferences that could be drawn from the discussion. This topic considered to have sufficient general interest for Grade 6 children. as their development linked. sample of poorly with some irrelevant organized spontaneous speech. 32. topics were chosen which ential appeal for boys and girls. Listening to Boys' Talk 33. The discussion was sion the sort of things that could recorded. borne. interest Two A were considered to have differsix minute talk designed to fly. seventeen questions were retained for inclusion in final test. and what the children could do at the picnic. the number of correct answers.44 LISTENING COMPREHENSION A FACTORIAL ANALYSIS The topic for discussion was chosen by the author. complete material introduced by the youngest of the four speakers. A magazine article on applique work with plastic material was re-written to provide another six-minute talk which was designed to be interesting to talks were given in girls in Grade 6 but not to boys. and to provide sufficient scope for a ten minute discussion. On the basis of a complete analysis of the disthe tractors. These questions were recorded on tape by the speaker.

while the girls attained an average score of 7. In contrast.4. Item analyses of the questions were used to determine which questions should be retained in the two tests. Although the hypothesis that there was no relationship between sex and the type of talk preferred could be rejected on these figures at the . The mean score obtained by the girls and the boys on the aeroplane talk was almost identical (7. it was considered that there was still too much "drift" on the part of the girls towards the "boys' talk. On the garage talk.e.. A talk was therefore prepared on a boys but not to craft activity likely to appeal to girls." i. the talk on aeroplanes being administered first. and inferences that could be drawn from the material presented. aeroplanes. immediately on completion of both talks. it was decided to prepare another boys' talk which would more closely parallel the nature and the content of the girls' talk on plastic decorations. level by the chi-square test.5 on the plastic decorations talk.3 and the girls a mean score of 9. together with the talk on plastic decorations. and all of was taken boys and the 20 girls preferred the talk on plastic decorations. the boys obtained a mean score of 11.1 per cent. . This evidence to indicate that the two talks had differential appeal for girls in the directions desired.PREPARATION OF TEST BATTERY AND DESCRIPTION OF TESTS 45 "live" form to a class of 45 Grade 6 children. Immediately after both talks and their associated questions had been administered. The talks and questions were then recorded on tape by the speaker. for which 17 questions had been prepared. but 6 of the 18 girls also preferred this talk. This talk was administered in "live" form to another Grade 6 class of 39 children.3 and the boys an average of 7. Seventeen of the 19 boys preferred the talk on garages. the mean score for the girls make a on the plastic decorations talk was 11. It which was was based on an article in a boys' hobby book and consisted of a description of how to scale-model garage. Each talk was followed by 15 four-choice questions relating to the main ideas and details presented. the children were asked to write down which of the two talks they had thought to be the more interesting.3). As it was also thought that some of the questions on the boys' talk might possibly depend on mechanical aptitude. so that girls would not be at any disadvantage with regard to the content of the talk. Twenty-four of the 27 boys preferred the aeroplanes talk.0. The children were again required to state which talk they thought was the more interesting. but was couched in general terms.3 and for the boys 9.1 as against 7.

total administration time for these occupied just over 30 minutes. In each test. Limitations in available testing time did not allow more than 6 passages to be used in the present modified version.P. which was adapted from Forms 3A and 4A of the Listening Tests in the Co-operative Sequential Tests of Educational Progress. the score is the number of correct answers. Preliminary trials of the other passages in "live" form indicated that many of the passages and questions were too easy for Australian Grade 6 children. The alternative answers for each question are printed on the child's test booklet. Certain passages could not be used because either the content or the style of talk was unfamiliar to Australian children. and 14 questions on the girls' talk. There are 15 questions on the boys' talk.E. It was therefore necessary to supplement the suitable passages with other passages from the next higher level. Questions on the passages relate to the main ideas put forward. the passages and questions in the mainder in a . as well as being presented on the tape recording. 34. 2 minutes 30 seconds to be read aloud by a speaker. but preliminary instructions and practice items required an additional 10 minutes. Listening Test used in this battery comprises three passages from Form 4A and three from Form 3A. the made and speaker's attitudes. The version of the S. and the relater period of similar duration. the first The 6 passages are given in a 40 or 45 minute period. of from the present version of the test differs in some important ways original Co-operative Listening tests.).E. In order to standardize testing conditions.46 LISTENING COMPREHENSION A FACTORIAL ANALYSIS The "boys' talk" on model garages occupies 6 minutes 10 seconds. while the "girls' talk" on plastic decorations takes 5 minutes 45 seconds.T.P. but this did not prove to be so.A.A. the more a short poem and important statements details. the implications the adequacy of the presentation. The latter consist of 12 or 13 passages to be read aloud by the teacher. Listening Test This test. Form 3 (Grades 7 to 9 in U. was the only standard listening comprehension test included in the battery. would be suitable for Grade 6 children in Australia. It was hoped that Form 4A for Grades 4 to 6 in U.S. S. which A had been pre-tested on another class of Grade 6 children and found to be suitable for children at this grade level. They include a recipe.S.T. as well as narrative and expository and the passages require from 30 seconds to prose passages.

PREPARATION OF TEST BATTERY AND DESCRIPTION OF TESTS 47
present version were recorded on tape by the speaker. Even the pauses between questions were included in the tape recording; observations made during the "live" form trials of the passages were

used to determine the length of these pauses. The preliminary instructions for the test were introduced by the author. The practice example was first presented by the author, and was then presented a second time by tape recording.

As

the alternative answers

in the other listening tests, the children are able to read on their test booklets while these answers

are being presented to them from the tape recording. The modified version of the test contains thirty-eight questions. The score on the test is the number of correct answers.

G. SCHOOL

ACHIEVEMENT VARIABLES

35. School Arithmetic
36. School

Reading

37. School Composition
It seemed useful to make some assessment of the extent to which children's levels of achievement in their school work were

related

to their performance on listening comprehension tests. This could have been done most effectively by including scholastic achievement tests in various subject areas in the test battery. But as the time required to administer the battery was already extensive, it was considered that the marks awarded by teachers in the ordinary school examinations could be used for the purpose.

A copy of the marks gained by each child in each subject in one or more of the regular school examinations was therefore obtained for each class participating in the experiment. For most schools, the marks were based on one examination only. In other schools, however, the mark for each child in each subject was an average obtained over two or more monthly examinations. The range of subjects for which marks were available differed from school to school, so the "aggregate marks" in different schools could not be regarded as measures of the same variable. The only subjects for which marks were available in all ten schools were Arithmetic, Reading, Written Composition and Spelling/Dictation. As the ability to spell words that had already been learned did not appear to be relevant to listening comprehension, only the first three of these subjects were selected for study. Although these

48

LISTENING COMPREHENSION

A FACTORIAL ANALYSIS

subjects had identical names in the various schools, they were not all identical in content. Arithmetic generally consisted of a mix-

of problems and mechanical processes, almost certainly weighted differently from school to school. Reading marks were awarded entirely on the basis of oral reading performance in some
ture
schools; in others they were awarded entirely on the basis of comprehension of material read, or on the basis of both oral performance and comprehension of subject matter. Written Composition marks were generally awarded for a short composition of a page or two on a particular theme, and are likely to be measuring the

same type of performance in different schools. The marks assigned to children on these

three achievement

variables were generally out of a total of 10, but sometimes out of a total of 20, 50 or 100.

H. AUDIOMETRIC SCREEN TEST
38. Modified

Spondee Test

required for detecting children whose hearing loss was pronounced enough to affect their performance on the tape recorded tests. Very few of the children had ever undergone an audiometric test. While it would have been desirable to apply

Some method was

a pure-tone threshold test or at least a pure-tone sweep test to each child with an audiometer (Scottish Council for Research in
Education, 1956), the additional class time required for this procedure made it impracticable. It was considered, however, that a quick screening test, such as a gramophone audiometric test,

would be quite
atories of

suitable for the purpose.

records developed by the Psycho-Acoustic LaborHarvard University and recorded by Amplivox Ltd. were modified for the purpose. These consist of four equivalent forms of 70 two-syllable words, spoken in such a manner that the

The Spondee

each word is the same pure tone of 1000 cycles per second at the same intensity level is added to each record for calibrating pur-

peak

intensity level of each syllable of

within about 2 db.

A

poses. During the playing of this calibrating tone, the volume control on the record player is adjusted so that the decibel meter on the audiometer reads at the db mark. The record is then

played at increasing intensity levels until 50% of the words are heard and repeated correctly by the person being tested. The level at which this occurs for a person is taken as his hearing loss,

PREPARATION OF TEST BATTERY AND DESCRIPTION OF TESTS 49
which
hearing

read directly from the decibel meter. Thus, a person of words correctly at 80 db would have a hearing loss for speech of 80 db.
is

50%

As these records were designed to test the hearing loss of individual persons, the above procedures had to be modified for group testing. By playing the records at different intensity levels
(10 words at 50 db, 10 at 60 db, and so on), and allowing suftime between words for the children to write down what they had heard, an estimate could have been obtained of the db level of hearing loss for each child. The purpose of using the test, however, was not to establish the level of hearing loss, but to distinguish between those children who could hear the tape recordings satisfactorily and those who could not. This objective could be achieved by playing the records at a sound pressure level slightly lower than the level at which the tape recorded tests were played. Children who could pass the Spondee test, when played at a weak speech level of 55 to 60 db, for instance, could be assumed to have satisfactorily heard tape recordings played at this sound pressure level and certainly to have had no difficulty in hearing tape recordings played at the normal classroom speech level, which in Victorian classrooms is about 70 db sound pressure level.
ficient

The records could not be used in their existing form on account of the accent of the speaker, the difficulty of some of the words for Grade 6 children, and the short interval between the modified test was therefore prepared, using thirty-five of words. the words which would be familiar to Grade 6 children. This was considered to be a sufficient number for the purpose, and with 15 second intervals between words, the test would require about 10

A

minutes for administration.
selected

A

tape recording of the thirty-five

words was prepared by the Australian speaker, who listened to the Amplivox records and attempted to reproduce the spoken words as accurately as possible. The meter on the tape recorder was used to check that the peak sound pressure level of the two syllables of each word was the same. (Allowance was made which did not meet this conlater for one word "headlight" tone of 1000 cycles per second was subsequently dition.) pure added to the tape recording at the same meter reading for classroom

A

calibration purposes.

The modified
calibrating tone

test was applied in the following manner. The was played first, and the volume control on the

note was A made of the "setting" of the volume control. It should also be pointed out that the modified test gives a conservative estimate of the number of children who could hear the tape recordings satisfactorily. children but whose spelling was so poor that the words they wrote did not even bear a phonetic resemblance to the correct words. which was found to be much the same in all classrooms. The test was scored according to the number of words correctly spelt.0002 dynes/cm2 Children who could write 75% or more of the 34 words (Le. 64 db above the zero reference level for sound pressure of 0. were excluded from the groups used for the final analysis of results. or spelt in such a way that it was clear that the child who could hear satisfactorily had understood the word.50 LISTENING COMPREHENSION A FACTORIAL ANALYSIS tape recorder was adjusted so that the signal was just comfortably audible to children at the back of the classroom.. Thus. it was possible to use a sound level meter at a later stage to determine the level of sound pressure at which the words themselves had been presented. 26 words or more) correctly at this level were regarded as being able to hear satisfactorily under classroom conditions. calibrating tone and the test This level was found to be . . By playing the calibrating tone at this setting.

It was therefore decided that the battery should be administered in six separate sessions over six days. who were mostly 11 or 12 years of age. The headmasters of each of the ten schools approached agreed to co-operate in the experiment. a short list of sixteen schools was selected in consultation with officers of the Psychology Branch of the Victorian Education Department. From a preliminary list of about forty government schools drawing pupils from a wide variety of living areas. Testing sessions of this duration were considered reasonable for Grade 6 children. it was proposed to administer the complete battery of tests to approximately ten Grade 6 classes in Melbourne. To obtain a sample of 200 boys and 200 girls. Permission to approach ten of the sixteen schools. The selected 51 . as lack of familiarity with the English language would not only affect the performance of these children on the various tests. Pre-test trials with the various tests had indicated that it would take 9 hours to administer the battery. but would perhaps affect their listening comprehension and reading comprehension results differentially. A. Schools were eliminated from consider- A other experimental work was already proceeding. Two independent analyses could also be expected to aid in the identification of factors. if their classes had already been given attainment or intelligence tests in the current year or if these classes contained a considerable number of children who had recently arrived in Australia from ation if Grade 6 non-English-speaking countries. each session requiring 90 minutes. was sought from and granted by the Director of Education in Victoria. and more if necessary. SELECTION OF SCHOOLS sample of Grade 6 children was selected which was considered to be broadly representative of children at this grade level in government schools in Melbourne. The latter provision was particularly important. so that the effect of sex differences on the factorial structure of listening comprehension tests could be examined.CHAPTER 3 DATA COLLECTION AND ANALYSIS THE investigation was designed to provide for separate analyses of the results for boys and girls.

P.52 LISTENING COMPREHENSION A FACTORIAL ANALYSIS schools were variously located in old established and newly established suburbs. ARRANGEMENT OF TESTS AND TESTING SCHEDULE The length of the test battery. It was also considered that motivation and interest in the tests would be better maintained with a weekly interval between sessions. The schedule was there- them on . The modified form of the Co-operative Test Division's S. and the resultant possibility of boredom and fatigue on the part of the children. it was decided to devote the first half of each session (approximately 45 minutes) to tape recorded tests. Because of the novelty of the tape recorder. and it contained a wide variety of interesting test material. while a paper-and-pencil session might include a reasoning test. B. made it necessary to give careful consideration to the order of presentation of the tests. The hearing screen test was applied at the sixth testing session after all other tape recorded tests had been administered. it provided good introductory explanations and examples. and an auditory memory test. Possible ways of scheduling the six sessions were discussed with the headmasters of the earliest schools contacted.T. so that children excluded from the sample because of hearing loss would include any whose hearing might have been deteriorating during the course of the testing programme. and in predominantly middle class and predominantly working class areas. a tape recorded session might consist of a listening comprehension test. Listening Comprehension Test was selected as the opening test in the battery on the grounds that it was a standard listening com- prehension test. A detailed plan of the order of administration of the tests and their approximate administration times is given in Appendix A. an attention test.E. Each of the experimental tests of listening comprehension developed for the investigation was placed at the beginning of a testing session. in residential and industrial areas. Thus. a memory test and a reading test. The proposal to conduct the sessions at weekly intervals over a period of six weeks was considered to be more practicable than conducting six successive days. The six weekly sessions would avoid prolonged interruption to the school programme at any one time. and would be less likely to arouse adverse parental comment than a six-consecutive-morning programme. An attempt was made to maintain the interest of the children by providing several different types of tests on any one day.

9. 29 30 46 48 52 13. 17. 23. September October 7. Details of the testing schedule are given in Table 1. 46 November December 3. 13. 17. 17. 44 49 J October 31 . 34 37 52 8 G Tuesday October 28 49 H I November 11. 49 21 September October 1. 15. 10.30 September 19. 20 16. 8.30 and 10. 27 Thursday December 4. 45 43 48 . 10. commencing on September 15 and ending on December 16. 25 December 9. 1958. Total 442 470 . 24 . 18. 15. after a 15 minute break between 10. 26 December 3.23.45 5 with the administration of two or three paper-and-pencil tests s ending usually between 11. 22. 12 (Friday) Wednesday November 5. 45 28 November 7..m. it was necessary to allow a two week interval between some sessions in two schools. The programme commenced each morning between 9.DATA COLLECTION AND ANALYSIS fore arranged 53 on this basis* but because of special holidays annual sports days.45 a. TABLE 1 Testing Schedule Number tested at Day School First of testing Dates of sessions (1958) at first session any session A Round Monday September October 6. 1 1 Friday .30 and 11. 20. The complete testing programme occupied a period of weeks. 19. 10 November 6. 26 October 3. 14.45 with the administration of the tape recorded tests. 21. 12. 16. 1. and continued. December 5 14. 24 .30 and 9. 24 22 44 45 43 46 47 September 18 October2.

The use of tape recordings ensured that there was no vari- ation in rate of presentation of test items. at the end of the sixth session in schools in the second round of the testing programme. children often made audible answers to questions put by the recorded voice in the same way as they did to questions asked by the author. Also. ADMINISTRATION OF TESTS In order that conditions of presenting the test battery to the various groups might be as uniform as possible. split-half reliability co-efficients would have been C. Pauses of longer duration were timed by the author with a stop watch. a Byer 66 machine (Serial No. and partly from the recording itself. enclosed in a baffle box especially designed by the . Generally the author introduced the description of the task and explained one or two practice examples. which in some cases also followed with the explanation of these examples. for which Kuder- Richardson or inappropriate. six of whom had missed the third session at one school. The change from one speaker to another did not seem to have any disturbing effect. of the equipment used to present the tape recorded tests followed the recommendations of the officer in selection The charge of the installation and testing of school broadcast systems high quality tape recorder. and pauses of up to 20 seconds between test items were also built into the tape recorded tests. Instructions for the tape recorded tests were delivered partly by the author. 070) with press-button start and stop control was hired for the course of the investigation. subsequent practice examples were then given from the tape recording. Each test was for administered strictly in accordance with the instructions prepared it. the actual instructions for administration are reproduced in Appendix C of the author's original thesis.54 LISTENING COMPREHENSION A FACTORIAL ANALYSIS Two additional sessions were conducted with two small groups of children. a test which had been administered earlier in the programme was re-applied. each of the 62 testing sessions was conducted by the author. A output of the tape recorder was fed into a 9 inch portable school vented speaker. This provided data for the computation of test-retest reliability co-efficients on six speeded tests. The in Victorian government schools. and seven who had missed the sixth session at another school as a result of having to attend their prospective secondary schools for preliminary interviews.

When these various levels were subsequently measured by a sound level meter. It could thus be assumed that any child who had heard 75% of the words correctly at the sound pressure level of 64 db would have little difficulty in hearing tape recorded tests played at 65 to 72 db and at 73 to 80 db. the author explained the purpose of the investigation in simple terms. The sound pressure level at which the tapes were presented was determined for each school at the first testing session by playing over an introductory passage. and attempted to motivate the children to do as well as they could in each of the testing sessions. control setting at which this passage was found to be comfortably audible for all children in the room was noted.000 cycles per second) under consideration. In the introductory remarks at the commencement of the first testing session. and except for two tests. the difference between sound pressure levels measured in decibels and sound levels measured in phons would not exceed 4db. the portable speaker was set at a level about 3 feet above the children's heads and directed towards them from a central position at the front of the classroom.* level of The children generally maintained a high level of interest in the various sessions of the testing programme. a lower setting was determined for each class at the level at which a 1. the Spondee test. Factors which could be regarded as contributing to good motivation were the novelty of the tape * Measurements have been given in terms of decibels of sound pressure level. higher setting was required for Listening to Spontaneous Speech. For the range of sound pressure levels (64 to 80db) and frequencies (approximately 300 to 4. For the screen test of hearing. The test described as Listening to The volume A Spontaneous Speech had been played at an average sound pressure 73 db with a maximum of 80 db. the remainder of the tapes were presented at this setting. not in terms of phons. it was found that the calibrating tone had been played at a sound pressure level of 64 db. and that the majority of the tapes had been presented at the average level for conversational speech.000 cycle per second pure tone signal was just comfortably audible to children at the back of the room. . The general attitude of the children at the various testing sessions suggested that most of them were putting forth their best efforts.DATA COLLECTION AND ANALYSIS Royal Melbourne 55 Institute of Technology to achieve optimum broadcast reproduction in Victorian school classrooms. For each testing session. ranging between sound pressure levels of 65 and 72 db. as the recorded conversation among the four girls was not as clear as the recordings made by the regular speaker.

Social Studies and Heritage of tected. it was the best that could be realised in the schools. the author inquired from the class teacher and head teacher in each school whether the Grade 6 class had received any special training in listening. English. A complete re-marking of all test papers was carried out for the four tests in which the majority of one point discrepancies occurred. While the testing programme was in progress. some cases of cheating were de- The results of these children were excluded from the sample used for analysis. were all scored by the author. The children were seated two to a desk. This appeared to be the only formal training received in listening. Although the children were constantly reminded of the need for independent work. the clarity of the recordings. The scoring of tests arranged in multiple choice form was undertaken by the author. While this was not an ideal seating arrangement. and close supervision was maintained by the author. D. re-checking of the thirty-four tests and the Spondee A of 50 boys and 50 girls revealed very few discrepancies in scores. and the amount of training could consequently be expected to be similar for each class. The class teachers remained in the room as interested observers in most schools. It was found that all classes listened to school broadcast sessions on such topics as Health. Tests requiring some interpretation.56 LISTENING COMPREHENSION A FACTORIAL ANALYSIS recorder and the recorded presentation of tests (the atmosphere was almost one of excitement when the equipment was being set up at the first testing session). While teachers were well aware of the importance of reading comprehension. test for a random sample . but limited their participation to assistance in distributing test booklets. the pleasant voice and interesting manner of the speaker who had made different character of the tests the recordings. where accommodation was generally fully taxed. they had not previously been acquainted with the concept of listening comprehension. such as those in which the score consisted of the number of words understood. the wide variety of tests and the rather from the usual routine school work. and that it was the general practice for children to make notes during or after the broadcast. with the assistance of a second marker. SCORING OF TESTS All tests were hand-scored with the aid of stencils or strip keys in accordance with the scoring formulas given in Chapter 2.

cheating.DATA COLLECTION AND ANALYSIS E. were also excluded. were excluded from the final sample OH the grounds that they could not be assumed to have heard the A tape recordings clearly. it Table 2 gives details of the number of children excluded from the sample.. 4 1 13 (d) (e) Number Number with scores of less than 26 on test Spondee hearing for 2 1 3 whom school examination 3 results not available 4 142 Total number excluded 76 161 66 139 Number available for final samples 300 . If such a child had been living in Australia for at least five years. such as missing out a page of questions. 7 4 9 (c) Number of non-English-speaking migrants . 205 442 excluded: Number sessions absent from second and/or later 61 50 111 11 (b) Number etc with test irregularities. it was to be expected that absences of children from one or more testing sessions would reduce the number of cases availin able for analysis. few children who had completed all tests but who failed to reach the required level of 26 words on the hearing screen (Spondee) test. and that initial language handicaps were likely to have been largely or completely overcome. The children present at the first testing session each school constituted the pool from which the final sample could be selected. with less than 5 years* residence . Migrant children from non-English-speaking countries ("New Australians") were excluded from the final sample if they had been in Australia for less than five years. 57 THE COMPOSITION OF THE FINAL SAMPLES Owing to the extension of the testing programme over six weeks. and the reasons for their exclusion: TABLE 2 Exclusion of children from experimental samples Boys 237 Girls Total Number Number (a) present at first testing sessions . . or whose test papers showed evidence of irregularities. but children who had been found to be cheating. Absence from one or more sessions proved to be the main reason for eliminating cases. could be assumed that he had passed right through the elementary school in Australia.

12. F. Because complete results were available for these children. 7 and 4 respectively. they were included in the samples. The final sample of 161 boys included 9 New Australian boys of 5 years' residence or more. Inspection of the raw score distributions obtained with the final samples of boys and girls suggested that this goal had been achieved in most cases. 20.D. 1951). (c) or (d). All raw score distributions for each of the final samples were therefore before normalized correlation co-efficients were * computed. .58 LISTENING COMPREHENSION A FACTORIAL ANALYSIS also Among the children included in category there were a number who could (a) in Table 2. 17. and 5 girls from one school who took the third series of tests a few days after completing the sixth on all tests series. CODING OF TEST SCORES As was indicated in Chapter 2. and for i S. interval about the mean. the advantages of including the additional 22 cases were considered to outweigh the possible effects of slight variation in testing order and differences in performance of these New Australian children. however. This was found to be 10 points or less in more than two-thirds of the tests. have been included in categories (b). The final sample of 139 girls included 8 New Australian girls of 5 years' residence or more. in which variables are assigned the values 1 through 9. as disparate distributions of test scores can affect the magnitude of product-moment correlation co-efficients and thus the factorial structure (Carroll and Schweiker. probably because of differences in the characteristics of the particular classes used for pre-testing and the final samples of Grade 6 children. A suitable scale for the purpose was the stanine scale. units ranging upwards from -f~ i S. with relative frequencies in 100 cases of 4. all tests were designed to give approximately normal distributions of raw scores for Grade 6 children. 12.D. 7.D. a normalized scale with this number of steps was therefore appropriate. The choice of a normalized scale to which raw scores could be transformed was determined chiefly by the range of raw scores in the various tests. It was essential that the variables to be used in the study should be normally distributed. 17. These correspond to the areas under the normal curve for the i S. Some distributions were skewed. and others tended to be platykurtic.

When the hypothesis that the distribution of stanine was normal could be rejected at the 5% level by the chi-square test. viz. were rounded to avoid increasing unduly the amount of work required to prepare the data for processing by an electronic computer. and following the corresponding procedure with the lowest marks. and that distribution which gave the closest fit (as determined by the chi-square test) to the model distribution was selected. 31. 9.D. There appeared to be no satisfactory method of allowing for differences in the general level of performance in these subjects among the Grade 6 classes in the different schools. 1 to 4 in Appendix D The process of normalizing scores for the three school achievement variables. The coarser marking scales used for Reading and Composition precluded the use of stanine scores (and even a 5 point scale) for these variables. approaching a rectangular on a 4 point scale in some instances.DATA COLLECTION AND ANALYSIS and downwards from . the corresponding frequencies were 6. and for all but seven variables in the boys' sample. distributions of stanine scores which did not differ significantly from the normal model were achieved for the Arithmetic test. as the limits of the raw score intervals and the coded score intervals did not necessarily coincide. 59 i S. 28.. the relevant raw score distributions were normalized by means of percentiles to T scores with a mean of 50 and an S. 19. The desired frequencies for coded scores could not always be attained. Data relating to the score distributions and to the nor- one digit scores to mality of the stanine score distributions are summarized in Tables of the author's original thesis. was somewhat more difficult. in the The T scores obtained for the one non-normal distribution girls' results. a 4 point normalized scale analogous to a stanine scale was developed. 17. 28. Alternative frequency distributions were prepared in those cases where a raw score could be assigned to either of two coded scores. etc. 27. Raw score distributions were converted to stanines for al but one of the experi- mental and reference test variables in the girls* sample. Reading and Composition. 19. Reading for Inference. 11. scores of 10. 24. with a base unit distribution . For the boys' sample. the desired frequencies for each value from 1 to 9 were 7. for the girls' sample. 24. 11 and 7.. a score of 8 to the next highest. Instead. 9 and 6. By assigning a stanine score of 9 to the highest mark in each school. Arithmetic. The distribution of marks for these subjects differed markedly between schools. 17.D.

three factors were extracted for the boys' matrix and four factors for the girls' matrix. of boys and Reading and Composition marks 4. Silliac H. The IBM cards were forwarded to the Littauer Statistical Laboratory at Harvard University. The correlations with the school achievement measures (variables 35.. Diagonal unities were replaced by estimated communalities.D. low each case. as near as practicable the highest girls in 101% 3.4 in residual correlations were mostly very in Table 3. where the principal factors for the boys' matrix and for the girls' matrix were extracted on an IBM 650. the in each school assigned a score of next 39i% a score of were and so on.60 LISTENING COMPREHENSION A FACTORIAL ANALYSIS of It S. the highest correlation in each column. as these variables did not form part of the main study. COMPUTATION OF CORRELATION CO-EFFICIENTS The thirty-seven normalized scores for each boy and each girl in the final samples were punched on paper tapes by the author at the Silliac laboratory at the University of Sydney. With the aid of an existing library programme. Accordingly. the eigenvalue corresponding to the last factor extracted had fallen below . and on this occasion. 36 and 37) were not included in the matrices to be factored. the product-moment correlation co-efficients among the thirty-seven variables were obtained by the high-speed computer for both the boys' sample and the girls' sample. the relatively high values of some of the residual correlations and the results of preliminary rotations with the obtained factors indicated that a greater number of factors should be extracted. namely. and the in value. as indicated . However. nine factors were extracted for the boys' matrix and ten factors for the girls' matrix. The correlation co-efficients for each sample are shown in Table 1 in Appendix C. the principal axes factor programme was again applied to the two correlation matrices. COMPUTATION OF PRINCIPAL FACTOR LOADINGS The correlation co-efficients between the thirty-four experimental and reference variables for each of the two samples were rounded to four decimal places and punched on IBM cards in Melbourne in a format suitable for computing principal axes factor loadings. By this stage. G. Initially. the extraction process being halted when the size of the eigenvalues fell below unity.

as recently recommended by Kaiser (Kaiser. the former using an analytic method of rotation. Cj p = (v j p v^p).D . The residual correlations for the two samples are given in Table 4 of Appendix E in the author's original thesis.0774 to . which has very similar to those obtained in graphical solutions. This method. The was left whether Following on his earlier approaches to an analytic solution for the oblique factor case (Carroll.0003 -. suggests that it may not always be appropriate to limit the extraction of factors to those corresponding to eigenvalues greater than unity. and it to the configuration of test vector termini to determine factors would be orthogonal or oblique.0003 Mean S. where vjp is the general element of the rotated factor matrix 2 V.m).0257 The subsequent analysis of the obtained factors. 1956).0839 . 1960). and where j represents the test variables = 1.0256 . 1957). Carroll developed the "biquartimin" method (Carroll. which he has pro- grammed for the IBM 704 results been found to yield computer.DATA COLLECTION AND ANALYSIS 6! TABLE 3 Distribution Statistics for Residual Correlations BOYS Range (9 factors) GIRLS (10 factors) -. the latter using graphical methods. .q = IJI . the criterion of simple structure was used as a basis for making rotations.0938 to . JiX and p the rotated factors (p.2. L ROTATION OF AXES principal axes factors for each of the two matrices were rotated independently by Professor John B. 1953. compared with the preliminary analysis attempted with the smaller number of factors. Carroll and by the author. The restriction of orthogonality among the factors was not made in either case. The unrotated orthogonal factor matrices for boys and girls are presented in Tables 2 and 3 respectively in Appendix C.071! . requires that the expression m 2 / p<q\j = n 2 v 2 jpv2 jq l -f j = n S \ c jpc jq l / be a minimum.

8. presented the author were made by Graphical rotations undertaken by of two-dimensional plots of the columns of factor loadinspection and girls. Quite high correlations were obtained between some of the factors. satisfactory approximation programme A was obtained for all four solutions. he began To the with eight factors in each case. . The transformation matrix A for matrix of factor the two more acceptable solutions and the V are given in Tables 4.62 LISTENING COMPREHENSION A FACTORIAL ANALYSIS and girls.* Cosines between the reference 7. involving about 190 changes in the position of individual axes. 1947). but oblique simple structure solution for boys and the nine-factor solution for the eight-factor more acceptable psychological interpretation than girls provided a the alternative solutions. 13 and 14 in Appendix vectors and correlations between the primary factors for the two in Tables 9 and 16 in solutions are more acceptable Appendix C. Carroll applied this method to the F matrix for boys avoid the possibility of rotating too many factors. which V was also used to find the inverse of A ' correlations between the primary factors A and to compute the from the relation C present the oblique obtained for boys and RM = DCA'A^D. 6. only eight the boys' matrix. The chief criterion used ings in the F matrices for boys in locating the position of reference vectors was to maximize the number of test vectors with zero projections on the new axes also given to the groupings (Thurstone. Satisfactory approximations to oblique simple structure were reached in each case after seven rotations of the orthogonal reference frame. and subsequently repeated to with nine factors. the closeness of the test points to the origin in all plots involving the ninth factor from the boys' matrix indicated that this was a residual factor. Consideration was of tests which had been included to represent established factors. 12 and 15 in Appendix transformation matrices and the V matrices *Corresponding tables for the nine-factor solution for boys and the eightfactor solution for girls are given in the author's original thesis. The matrix matrix after each multiplications required to compute the new successive round of rotations were performed on Silliac. and factors were restricted to the positive manifold as far as possible. loadings for each of the four solutions C. Tables 5. 11. Although all ten factors were used in rotating axes for the factors were used in making rotations for girls' matrix.

rotations in the second and higher order domains could not be considered compelling. it was considered desirable to avoid increasing the . but are available in the author's original thesis. ANALYSIS OF HIGHER ORDER FACTORS by Second order analyses were undertaken for the two graphical solutions and for the more psychologically acceptable biquartimin solutions. for an analysis of second order factors was indicated the presence of high correlations among the primary factors. The principal axis factor matrices and the associated trans- formation and rotated factor matrices for each of the four second order solutions are not presented in this volume. The need The diagonal unities in each of the four M matrices were replaced by estimated communalities (the highest correlation in the column).DATA COLLECTION AND ANALYSIS girls 63 by application of the graphical methods. An extension of the 8 factor biquartimin solution for boys to third and fourth order factors in accordance with the procedure described by Schmid and Leiman (Schmid and Leiman. ESTIMATION OF FACTOR LOADINGS FOR SCHOOL ACHIEVEMENT VARIABLES As the relationship between listening comprehension and elementary school subjects was only a subsidiary aspect of the investigation. 1957) failed to give results which could be considered meaningful. though there are more cases of negatively correlated factors than in the corresponding biquartimin solutions. K. and appear to give a clearer definition of factors in instances. namely. There is evidence in Tables 10 and 17 in Appendix C show number of high correlations among the primary factors in these solutions also. and the principal axes factors for each of the resulting matrices were computed on SiMac. The V substantial agreement with those obtained by the biquartimin method. In general. There was considerably less agreement among the four rotated matrices than had been found in the first order domain. Because of the difficulty in arriving at a clear interpretation of the second order factors from the various solutions. loadings of the original tests on the second order factors were not computed. of a J. the 8 factor solution for boys and the 9 factor solutions for girls.14 were then rotated to a position which approximated an oblique simple structure in each case. Factors cor- R responding to positive eigenvalues above an arbitrary level of about .

and consequent misplaceof responses in the attention tests could have been serious enough to make it doubtful whether these tests were giving any function at all. certain of the orally presented appeared likely to be susceptible to momentary fluctuations in attention ment on the part of the subject. the loadings of the original tests on the (F^jF'jm) represents the diagonal matrix of the eigenvalues corresponding to the unrotated factors. 1938) of Dwyer's extension (Dwyer. Kelley. they were subsequently found to be very consistent with the factor interpretations made in the main study. But it was considered advisable to compute reliability co-efficients for tests tests used in the present battery. This consists in solving the variables in the matrix equation V tp == / R'tjF*j m (Fm jF j 1 m)~ A mp . This equation was solved for each of the graphical solutions and for two biquartimin solutions (8 factors for boys. and A mp represents the transformation matrix which converts the original unrotated F jm matrix to the rotated factor matrix jp V . 1952. where V tp represents the loadings of the new tests on the rotated tests factors. French. 36 and 37) on the factors obtained in the main study are presented in the last three rows of Tables 6. COMPUTATION OF RELIABILITY CO-EFFICIENTS tests Reliability co-efficients are not generally computed for the employed in factor studies. consistent measures of . 1951. 8. and 9 factors for girls) by using the matrix multiplication programme on Silliac. Loadings of school achievement variables on the factors identified in the main study were therefore estimated by means of Mosier's generalisation (Mosier. 1937).64 LISTENING COMPREHENSION A FACTORIAL ANALYSIS rank of the factor matrices by Including the school achievement main analyses. The estimated loadings of the three school achievement measures (variables 35. Although these loadings were determined quite independently of the main study. R'ti represents the correlations between the original tests. most investigators being content to regard the final computed communality estimate for each test as a lower-bound estimate of the reliability co-efficient for that test (Adkins and Lyerly. 14 and 15 in Appendix C. L. 1954). new and the F'jm represents unrotated factors.

and applying the Spearman-Brown formula (for a test twice as long) to these correlations. which are less dependent on test length than are the co-efficients of internal consistency. tests of appropriate for the Ringing. The retest data were obtained for one of the classes participating in the second round of the testing programme. examinees. interval between test and re-test ranged The reliability co-efficients for each of the 34 experimental and reference tests are given In Appendix D. Singing . Reliability co-efficients for the six speeded tests were computed by the test-retest method. estimates were obtained from a sample of 50 boys and 50 girls. The test-retest co-efficients. except in the case of Triplet Numbers and Letter List. The from one to five weeks. Reliability co-efficients for these tests were therefore computed by correlating the total number of words correctly identified in the odd-numbered sentences with the The Kuder-Richardson formula was not total number correctly identified in the even-numbered sentences. which suggests that these tests are not providing very consistent measures of the attention factor. Of the tests for which Kuder-Richardson or split-half co-efficients are available. drawn at random from the final groups of 161 boys and 139 girls respectively. It will be seen that most of the reliability co-efficients are lower than the accepted To keep the total testing time within reasonable limits. it is necessary to use much shorter tests than those used in the diagnosis of individual levels for individual diagnosis. Haphazard Speech and Illogical Grouping. The necessary estimates of item variance and raw score variance for each test were computed for this sample of 100 cases. are generally satisfactory. and to use the time available to the best effect for studying the factorial structure of tests.DATA COLLECTION AND ANALYSIS tests 65 Reliability coefficients for all of the listening comprehension and for most of the other tests in which the time were sufficient to alow 90% of the children to were attempt all computed by means of Kuder-Richardson Formula 20. The correct identification of individual words in these tests was likely to be associated with the correct identification of adjacent words or of the sentence as a whole. the reliability co-efficients are generally of a satisfactory level and are sufficiently high for purposes of factor analysis (Kelley. Considering the small number of items in most tests. 1954).

Listening to Boys' Talk. suggests that tests involving a considerable amount of auditory synthesis may tend to be less reliable than those in which the speech sample is clearly presented. suggests that tests of listening less comprehension are tests slightly reliable than corresponding of reading comprehension. coupled with the fact that the reliability co-efficient for Haphazard Speech is also low. 27. Comparison of Tests 7.66 LISTENING COMPREHENSION A FACTORIAL ANALYSIS and Listening to Spontaneous Speech are the least reliable. namely. This could be due to the poorer quality of the tape recordings for these two tests. 28 and 29 respectively. . and Listening for General Significance. But the fact that relatively low reliabilities have also been obtained with some high quality recordings. 10 and 11 with Tests 26. 9. Listening to Short Talk.

two and girls.27* . As an aid in the interpretation of factors.28* .34* .24 . 5.44* 0>) . Matching Words Word Squares 48* 35* 67 .27 6.25 and above in the V analytic) for boys obtained in each of the three solutions matrices for girls.48* 12. 1. Tests with significant loadings on the corresponding factors in each solution have been listed for each of the factors considered.CHAPTER 4 INTERPRETATION OF FIRST ORDER FACTORS THE results of the factor analyses of the Intercorrelation matrices for boys and girls are discussed in this chapter. Factor loadings which exceed three times the standard error of a correlation co-efficient of zero for 161 cases and 139 cases respectively have been regarded as significant. factor loadings have been marked with an asterisk when they represent the highest factor loading for the test concerned. with the reference-test factors. Arithmetic Reasoning Five Letters Letter Series . are discussed in the following pages.30* . tests with significant factor loadings in only one of the three solutions for boys and for girls have been separated from those with significant loadings in more than one solution. the lists of tests include only those tests with loadings of . 3. and of . Progressive Matrices Letter Grouping 42* 41* 37* 33* . consideration has been given to the factor loadings (one graphical.24 and above in the V matrices for boys.28* . The fact that there was a high degree of correspondence between the rotated factors obtained for both boys and girls and for both types of solution made it possible to group the information from all solutions in discussing particular factors. In identifying the various factors. In the list of tests for commencing each factor.48* Biquartimin (8) . The various factors FACTOR A' BOYS Loadings Test Graphical (8) . 15. accordingly. 2.

included to represent a deductive reasoning factor) and the attention tests (Triplet Numbers. Factor E in Table CIS and Factor B in Table C14. ..27 5.45* . . The reference tests included to represent the induction factor Letter Grouping..44* .) BOYS Test 35. where the factor in question does not appear to admit of a very clear interpretation. and Reasoning and Word Squares..27* 35.. Factor B in Table CIS. Reasoning 21. (contd..35* .) Loadings Graphical . (School Arithmetic) Arithmetic Reasoning Letter Grouping . 4. GIRLS (10) 2. Consequences 32.....68 LISTENING COMPREHENSION FACTOR A' A FACTORIAL ANALYSIS (contd.30* . 14. .25 Reasoning Reading Vocabulary . . Factor G in Tables C6 and C7. 1. 3..38* . 4. Letter List . .25 (8) Biquartimin (9) 33... 6. . . . Word Squares .27* .30 . The two graphical solutions and the 9-factor reasoning the factor biquartimin solution for girls indicate that the other reasoning (Arithmetic Reasoning. (8) . This factor corresponds to Factor C in Table C8.56* . . .45* . Letter List and Five Letters) also have sigtests .35* .46* . .33* . 44* . 1954). Letter Series and Progressive Matrices have their highest loadings on this factor in all solutions except the 8-f actor biquartimin solution for girls.35* . 1951.. 15.44* . *Highest loading for the Factor A': Induction. (8) Letter Series Triplet Numbers Five Letters . .33* . . 8. . There would be some justification for advancing the view that may be a general reasoning rather than an inductive factor. .36* . (School Arithmetic) Letter List Listening to Girls' Talk . included to represent a general reasoning factor.47* .35* 14. Progressive Matrices .29 Listening to Boys* Talk Speed of Reading .43* . .. . 7.42* 13.29 test. ..27* (9) . The factor seems to be best interpreted as the inductive reasoning or induction factor described by French (French.29* -. .

.. 31. 13. Reasoning Triplet Numbers Listening to Boys' Talk . The estimated loadings of School Arithmetic on this factor are consistent with the factor interpretation. . But the more widely accepted induction factor (French. Word Squares and Matching Words. 1951. and had to be re-formulated by the pupils in the course loadings of the of answering the test items.33* . reasoning of the inductive type could have been involved.43* 4. the task of discovering a or principle is certainly involved in Arithmetic Reasoning. Biquartimm (8) . Reasoning Triplet Numbers Listening to Spontaneous Speech 13.. -.28 GIRLS Graphical (10) . To the extent that the rales had not been thoroughly learned. Listening for Inference Listening Vocabulary Listening to Girls* Talk Memory for Words . 1954) appears adequate to describe the pattern of test loadings. 33. 26. -. The sistent with Word Squares test on this factor are quite conAdkins and Lyerly's study. It is more difficult to account for the loadings of the attention tests on this factor. even if not so clearly as in Letter to Grouping.. . 3. ^Highest loading for the . 23. 29.. Letter Series and Progressive Matrices. School arithmetic at the sixth grade level requires pupils not only to demonstrate speed and accuracy in computation. FACTOR B' BOYS Test 4. as they would generally seem to call for application of rules rather than discovery of rules.33* Progressive Matrices . . which have higher loadings than most other tests on the factor. but also to find answers to problems presented in verbal form. 1952)..INTERPRETATION OF FIRST ORDER FACTORS 69 nificant loadings on this factor.28 . 32.30* (9) . where the test was found to have a loading on an inductive as well as oa a deductive factor (Adkins and Lyerly.32 test.

this factor in is the only other test in the battery requiring the subject to make three "greater elements. than" and "less than" comparisons between the test This factor has been tentatively interpreted as Deduction. This factor corresponds to Factor E Table C8. Neither the Progressive Matrices test nor Listening to Boys' Talk. It is most strongly represented in ThurFactor 1 in Table stone's test of Reasoning. Factor F In Table C13 C14. had no loadings on the factor. solution relationships. would be expected to involve the type of logical reasoning which the factor appears to indicate. significant in the Word Squares test offers little scope for making comparisons of relative magnitude. 1952) It is possible that syllogistic tests involving "greater than" and "less than" comparisons may be represented by a distinct sub-factor in a wider domain of deductive reasoning. The suggested interpretation of the factor is not affected by the nature of the other tests which have significant loadings on it. as is a reference test for the Deduction factor (French. Factor D (reflected) in Table and C7. verbal and inductive factors than had higher loadings on spatial. the other reference test for this factor. At the eighth grade level. labelled Syllogisms. 1941). 1952). In the boys* solutions and in the graphical is also represented in Triplet Numbers. with University students a similar test. (Adkins & Lyerly. on the deductive factor. but the test had a significant loading on a number factor (Thurstone. The test was not included in Adkins and Lyerly's battery . no Deduction factor was isolated. most of which occurred in only one of the six solutions. 1938). . Factor D in Table C6. as in the present study. and with these subjects at least. More as positive identification of the factor is difficult. the Reasoning test has had a rather varied pattern of ings in Thurstone's studies. This for girls. In the Adkins and Lyerly study (Adkins & Lyerly. In any case. it does not seem that much importance should be attached to these loadings. appears to call for discovery of rules as in Induction rather than application factor load- of rules.70 LISTENING COMPREHENSION f A FACTORIAL ANALYSIS Factor B : Deduction. both of which have significant negative loadings on the factor. The verbal analogy type of item . 1954) Word Squares. Progressive Matrices had significant positive loadings on inductive reasoning factors only. in which the subject is required to solve or less than" logical problems involving "greater than. though its loading on the latter factor was still significant (Thurstone. Factor I (reflected) in Table CIS. equal to.

Factor Factor C: Span Memory.47* . and that the absence of significant loadings for two of these tests on the span memory factor in the biquartimin solutions can be attributed to the fact that the span memory and auditory resistance factors are much more highly correlated in the biquartimin than in the graphical solutions. and is Span Memory Letter Span. best represented in the reference tests for the namely Auditory Letter Span and Visual tests Memory factor in Kelley's The other four tests study of have the highest loadings on the Span memory factors (Kelley.. Singing . 18.28 test.50* . 18. . C13 and C14. These two factor.39* . 19. 16. Some of these tests also define an Auditory Resistance factor in the present study. Listening to Short Talk -. Letter Span I (Visual) 16. 30. Singing Haphazard Speech GIRLS 25.26* (9) Grouping 25. 1942).28 BOYS Test Biquartimin (8) .35* . Letter Span II (Auditory) Letter Span I (Visual) Rapid Spelling 17.57* .28 .32* 17. It is one of the most clearly defined factors in A the battery. 24. This factor corresponds to Factor B C in Table CIS. . and Factor in Tables C6 C7. 1954) with loadings on this factor were all . Letter Span II (Auditory) 24. included as reference tests for Karlin's factor of Auditory Resistance (Karlin..INTERPRETATION OF FIRST ORDER FACTORS FACTOR 71 C L&adlngs Graphical (8) . Rapid Spelling Illogical 19. It appears likely that all four of the auditory resistance tests involve span memory.46* .34* . Haphazard Speech Illogical Grouping .30 *Highest loading for the in Table C8.53* .38* 59* . -.

for it is represented also in the tests of Singing. the Visual Letter modality Span test. is At first glance. all of which require the pupil to memorize a sequence of related words included in a sentence. as the factor is well represented in the one visually-presented test (Visual visually-presented Letter Span) as well as in the five auditorily-presented tests. it would seem more correct to infer that the factor was an auditory span memory factor than that it transcended the of presentation. it was clear that many if not most of the children were vocalizing the letters and thus effectively converting the task to one of auditory memory. 1942). Significant loadings for the Rapid Spelling and visual memory span tests were obtained on Singing. and that visual span memory would be better tested by extremely short tachistoscopic presentations of groups of letters than by sequential presentations of one letter at a time. Haphazard Speech and Illogical Grouping. the tests of Rapid Spelling. and also in the Rapid Spelling test. Even after they were cautioned against saying the letters audibly. But the present factor seems wider than this. however. Kelley's claim that this factor common to and auditorily-presented span tests (Kelley. It is seems likely that this approach to tests of visual memory not confined to well-motivated children. another factor. However.72 LISTENING COMPREHENSION A FACTORIAL ANALYSIS Kelley has described the span memory factor as "the ability to recall perfectly for immediate reproduction a series of unrelated items after only one presentation of the series" (Kelley. From observations made by the author during the course of the experiment. 1954). significant loadings factor. it was strongly suspected that they were performing the task by sub-vocalizing the letters. Although Test 24. it is quite conceivable that many pupils would obtain correct answers in the latter test by merely memorizing the sequence of letters without necessarily synthesizing them into a recognized word. memory span factor ("General Span") which was represented in auditory and visual span tests similar to those used in the present study. 1954) would seem to be supported by the present study. was presented visually. but Karlin interpreted this as a speed of closure The other three tests had significant loadings on the auditory . This adequately describes the task involved in the Auditory and Visual Letter Span tests. Karlin identified a Haphazard Speech and Illogical Grouping did not have on this factor. In his factorial study of auditory function (Karlin.

23. Word Number Memory for Words Sentence Completion 20. 33. 21. (10) . FACTOR D' BOYS Loadings Test Graphical Biquartimin 22. Loadings Test Graphical Biquartimin 23. Arithmetical Reasoning 22. Karlin's general factor is also represented in two masking tests. 15.26 GIRLS Graphical 21.51* . . 5. Word Squares -.43* . 20. Word Number Letter List Five Letters . 6. Memory for Words Sentence Completion Consequences Listening to Short Talk 22.26 test. Word Number Listening to Girls* Talk Listening to Boys' Talk 32. Listening to Boys* Talk . *Highest loading for the . 30. which do not to involve the type of task required in the Auditory and Visual Letter Span tests in the present battery. (9) .. Biquartimin (8) Consequences 20. The fact that these tests appear in a span memory factor in this study and not in Karlin's study is probably best attributed to a difference in the nature of the two span memory factors.INTERPRETATION OF FIRST ORDER FACTORS 73 resistance factor as they have in the present study. 14. Sentence Completion 32.

These clearly into factors are presented the reference tests and Factor E' (Meaningful and discussed together. for Words. Factor F in Tables C6 and C7. The difficulty in the other case is a result of the decision to identify the particular factor in the graphical solution for boys as a meaningful memory . most noticeable in the solutions in which only one of the two factors was identified. This provided matching corresponding factors from the various solutions. the significant loadings of the Sentence Completion test on the rote memory factor pose no great problem. This can be largely accounted for by variations in the size of the correlations drift some between the two factors in the various solutions. The was. as this was a completion recall test and not a free recall test like Consequences. require the subject to memorize material presented in a meaningful context. 21. and factor E' as meaningful memory. and Tests 20 and 21 for the meaningful memory factor. Factor D' corresponds to Factor E in Tables C6 and C7 ? to Factor F in Table CIS. KeUey. 1951. difficulties in Factor D' has been interpreted as rote memory. Factor B' corresponds to Factor G in Table C8. to Factor E in Table C15. By contrast. namely. Such tests have been shown to be the best measures of the associative or rote memory factor (French. 22 and 23) did not separate Memory) some two memory factors in all solutions. to Factor C in Tables C13 and C14. Tests 20 and 21. Sentence Completion and Consequences. Word Number and Memory tests. These interpretations have been based mainly on the loadings of the reference tests for these factors. A two for clear separation of the factors girls. it could be readily conceded that rote memorization might play some part in the task (Kelley. and fails to appear in Tables CIS and C14. two pairs of reference tests into the was achieved only in the case of the graphical solution In most of the other solutions there was a tendency for reference test loadings to drift to the other memory factor.74 LISTENING COMPREHENSION Factor A FACTORIAL ANALYSIS D' (Rote Memory). and does not appear in Table C8. Both of these tests had high loadings on the meaningful memory factor in Kelley's study (Kdley. as (Tests 20. As presented in the above table. Tests 22 and 23 for the rote memory factor. of course. 1954). are both paired associate with no apparent meaningful relationship between the separate elements of each pair. In the case of the biquartimin solutions for the girls. 1954). Tests 22 and 23. 1954).

19. The listening tests based on Number test.31 .27* 18. Biquartimin (8) .48* .INTERPRETATION OF FIRST ORDER FACTORS 75 rather than a rote memory factor. Whereas all three tests require the subject to memorize meaningless symbols.40* . thus injecting some meaning into a supposedly meaningless relationship.37* . only Arithmetic Reasoning appears to be inconsistent with the interpretation offered. the need for responding quickly to a series of directions does not occur at all in the Word tests with significant loadings on either of the two factors.44* .52* . Of the remaining the three short talks could weE be expected to have significant loadings on a meaningful memory factor.36* . 12. . FACTOR F Loadings Graphical (8) . Singing .39* (9) 17. it is quite conceivable that some of the children adopted this approach. . Consideration of the nature of the task in these two tests and in Word Number appears to favour the existing interpretation.28* .33* BOYS Test Biquartimin (8) . Haphazard Speech Word Squares GIRLS Graphical (10) 18.36* . 5. This interpretation preferred not only because it allowed of closer matching with the biquartimin solutions for boys.26 .36* . 16. As this person indicated that he had simplified the task of remembering unrelated words like shoe and tree by mentally picturing a shoe hanging on a tree.27 (9) Haphazard Speech Illogical Grouping Rapid Spelling Matching Words .33 *Highest loading for the test. but also because of comments about the Memory for Words test by an observer at one of the testing sessions. particularly as Letter List and Five Letters were reference tests for the latter factor. Some justification is required for interpreting Factor D" in the biquartimin solutions for boys as a rote memory rather than an attention factor.

.40* . and to Factor Factor of the factor is quite Tables C13 and CI4. is represented only the reference tests included to measure this factor. In KarHn's study. . the 9-factor biquartimin solution for boys and the 8-factor biquartimin solution for girls are less acceptable psychologically than the alternative biquartimin solutions.32* . Listening Vocabulary Listening for General Significance . C8 and CIS. 5. (School Composition) 8.43* . had significant loadings for both FACTOR G' BOYS Test Graphical (8) Loadings Biquartimin (8) . The Singing test. their loadings on this factor in two of the and provide evidence that biquartimin solutions are incongruous.. The present results suggest that the factor may be affected by the sex of the speaker in relation to that of the respondents.49* Speed of Reading 36. Reading Vocabulary 9.47* . Matching Words 37. Haphazard Speech. This factor corresponds to ra in Tables C6.42* .36* . . Reading for General Significance 12. Haphazard Speech and Illogical Grouping. Reading for Inference 7. It is the H G auditory in (KarBn.76 LISTENING COMPREHENSION A FACTORIAL ANALYSIS Factor F: Auditory Resistance. (School Reading) 10.35* . in which voice was employed. 1942).46* . The interpretation resistance factor identified by Karlin clear. the test involving a female the greatest sexes. the factor was best represented in the tests of Singing. . The exceptions are the Word Squares test and the Matching Words test.54* (9) .32* . 38* ..34* 26. evidently involved considerably less distortion for the girls than it did for the boys.29* .26* Word Squares 25 .. 52* . Being non-auditory tests.34* . amount of distortion.31* 34 33* 33* .. 27. C7. Karlin's that pupils with the highest interpretation of the factor implies tests would be those best able to resist the effects scores on these of distortion in speech brought about by temporal disarrangement of words and inflectional disturbances. Reading to Note Details 11.42* 44* 41* 41* .46* . Illogical Groupand became for them more ing offered less distortion for the boys. and with two exceptions. Similarly. a measure of span memory.

27.36* . . Reading Vocabulary .34* . variously described as verbal comprehension (French. Each of these reference highest loading on this factor in all six solutions. (School Reading) .41* . Thurstone.36* . CIS. It is clearly the well-established verbal fac- tor. 1938). C14 and CIS. In all solutions there are some listening . 8. 1951.47* . ^Highest loading for the test.27 .08 in the graphical solution for girls to . .40* Listening for Inference Listening to Note Details . 10.43* . 29. The five reference tests for this factor (Tests 7. .43* . 1952. . 26.35* .39* Listening Vocabulary .32* . and which is described in the next section as a listening comprehension factor. In most solutions the factor is quite closely related to another factor which is represented mainly in the listening tests.55* (9) .27* .47* .34* .28 Listening to Spontaneous Speech . Loadings Biquarlimin (8) .65* .28 . 8. 31.25* . 1941). as the former test requires understanding of verbal relations and the had its significant latter demands appreciation of the functions of words in sentences.27* .47* .24* 34.43* 9. 1954) and verbal (Adkins and Lyerly.77 in the graphical solution for boys. 10 and 11) require the subject to demonstrate his understanding of the meaning and relations relations of tests words or verbal concepts. 28.33* . The loadings obtained for Word Squares and Matching Words in certain of the boys* solutions are not unexpected.39* .62* .41* Reading for Inference Reading to Note Details Speed of Reading Reading for General Significance . .INTERPRETATION OF FIRST ORDER FACTORS 77 GIRLS Graphical (10) 11.49* . The correlation between the two factors ranges from . STEP Listening . . verbal knowledge (French. Factor Factor G': Verbal Comprehension. 36. Thurstone. The most interesting aspect of this factor for the present invesits tigation is relationship to the experimental tests of listening comprehension.54* . .. Listening for General Significance . 9.. 7.24 . This factor corresponds to B in Tables C6 and C7. and to Factor D In Tables C8.

In the Listening Vocabulary test. The estimated loadings of School Reading on the factor are consistent with the factor interpretation. the argument could be advanced that reading speed contributed to the factor. Listening Significance. It would appear in the latter case that some of the listening test variance which has been attributed to the timin solutions for verbal factor could well have been transferred by means of further rotations to a "listening" factor. giving a pattern of results similar to those obtained in both graphical solutions and in the biquartimin solutions for boys.78 tests LISTENING COMPREHENSION A FACTORIAL ANALYSIS with significant loadings on this verbal factor. the words are presented out of context. It is not surprising that School Composition has a significant loading on the factor. as writing as well as reading requires an understanding of the meaning of words and of the relations between words* . in the biquargirls. the fact that Speed of Reading. these tests are found to depend mostly on knowledge of the meanings of particular words. In the boys' sistently solutions. listening tests. which all require comprehension of detail and inference in selected passages. This finding suggests that understanding of the meaning of words may be more central to the verbal comprehension factor than comprehension of the relations between words. this possibility seems unlikely as ample time limits were allowed for all of the other reading tests. Upon examination. appear conin the lists of tests for this verbal factor. above separate grouping of the reading and listening tests in the draws attention to the fact that the loadings of the listening tests are mostly considerably lower than those of the The list However. the subject has to choose from five words the one most appropriate to describe a given context. there are significant loadings for the two tests on this 95 factor. and no time limits were involved in the listening tests. most of the listening tests have significant loadings on the factor. whereas in Listening for General Significance. two of the and Listening for General Vocabulary reading tests. but not on the "listening factor. in contrast to the other listening tests. Because of the high loadings for the Speed of Reading test. Reading to Note Details and Reading for Inference have higher loadings than Reading Vocabulary and Reading for General Significance indicate that comprehension of verbal relations is also important. On the other hand.

definition of the present factor in the 9-factor biquargirls probably also results from assigning most of the variance of the listening tests to the verbal comprehension The present factor is clearly both confined to and common to the experimental tests of listening comprehension.29 Listening to Boys* Talk Listening to Note Details Listening to Short Talk .52* . all of the listening comprehension tests have .26 .44* 29. The rather weak timin solution for factor.29* . 32.. Listening to Girls* Talk Listening to Boys' Talk STEP Listening Listening to Short Talk Listening for Inference .41* . * Highest loading for the Factor H': Listening Comprehension.39* . 8.36* .43* . -.INTERPRETATION OF FIRST ORDER FACTORS FACTOR H' 79 BOYS Test Graphical (8) .26 (9) 33. .36 GIRLS Graphical (10) 32. 26. 30. . 21. -. . 34. -. . 29.28* .48* .50* . Biquartlmin (8) (9) . Memory for Words . Listening to Note Details . 27.30* .28 .46 Speed of Reading . Consequences Listening to Girls' Talk Listening for Inference STEP Listening Listening Vocabulary Listening for General Significance .27* test. .56* . In the graphical solution for girls. Loadings Blqmrtlmin (8) . . 28. (Comprehension of verbal material presented in spoken form. . 33.32* . Reasons Factor A C E for its non-appearance in the latter table have already been advanced in the discussion on the verbal comprehension factor.30* .43* .36 . Factor in Tables C8 and C15 y Factor in Table C14 and does not appear in Table C13.34* .46 .37* .23 23. 30.29* .) This factor corresponds to in Tables C6 and C7..32* .39* .25* .24 31. Reading to Note Details Listening to Spontaneous Speech > . 28. 34. 10.34* . . .

this factor could . nor is it represented tests. of the latter 9. *In the case of the 9-factor biquartimin solution for also have been interpreted as meaningful memory. is certainly received by the subject in the in the tests range from matters of detail to inferences The questions and implications based on the material presented.21. Because of tests. despite was included as although Consequences and not as an experimental test of its for level with requisite significance low communality. except (and their highest) loadings on which almost attained the Spontaneous Speech. Considering the nature of the tests. as closely they appear to be related to reading comprehension tests. girls.43 on a factor which was Girls' Talk had its highest loading to not interpreted (Factor F). listening reading comprehension the experimental listening tests does call for the understanding of words and the comprehension of verbal relations. Listening of . the only listening are Listening Vocabulary and Listening for General the above list the emphasis on word meanings in these Significance. And a test of meaningful memory task of reproducing the listening comprehension." except that it seems to extend in this study to certain types of verbal test presented in spoken form. Although as or more closely than to listening comprehension have a significant loading on the Listening to Note Details did not factor in the boys* graphical solution." or more simply but less accurately or auditory comprehension. the usual prehension verbal comprehension factor might be better described as "com- the nature of the present factor? It is not represented in in the other auditory tests in the battery. In view of the lower loadings of the reading and listening vocabulary tests (numbers 7. Yet the task involved in all of the What is prehension of verbal material presented in printed (or written) form. but which seemed to be confined tests based on long rather than short selections. the task would appear to be adequately described as "comprehension of verbal material presented in as listening comspoken form. By contrast.* In the boys solutions. the a series of meaningful consequents in relation to given orallyantecedents is virtually a form of listening comprehen- substance of presented 1 tests missing from sion. and the material form of auditory stimuli.20 approached to the necessary significance level In the same solution. its very loading of . 26 and 27) on Factors G' and HP and the loadings it might be more satisfactory to two tests on the verbal factor.80 LISTENING COMPREHENSION A FACTORIAL ANALYSIS this significant Listening to factor. its loading of .

1955a) that latter). 1941).43* . UNIDENTIFIED FACTORS Graphical solutions BOYS Factor GIRLS F Talk Talk .56 in the This accords generally with the level of correlation between the verbal and listening factors in the present study. 1956). . 1956) drew a distinction between a visual-verbal achievement factor as found in tests of reading comprehension and an auditory-verbal factor involving comprehension of spoken language." This third vocabulary-type factor would appear to be similar in some ways to Carroll's a C* factor 'the richness of the individual's stock of linguistic responses" (Carroll.." while Caffrey and Smith (Caffrey and Smith.30 No significant loadings. 1955a) and Caffrey and Smith (Caffrey and Smith. Interestingly enough. "the" verbal factor might be "further reducible according to input channel type. Five Letters . .. Listening to Girls' 32. Caffrey suggested in his article (Caffrey." "comprehension of ful verbal passages presented in printed form" and "'knowledge of word meanings. Matching Words 2. Singing . Letter List H 33* 32* .. -..41* 26* Factor 14.79 in the former study. Eight-factor biquartimin solutions Factor B . 13. Word Number . Listening to Boys' 22. Factor .30 Factor J No significant loadings . the reading or visual-verbal factor and the auding factor were highly correlated (.INTERPRETATION OF FIRST FACTORS 8! postulate three factors "comprehension of passages presented in spoken form. of course. The present study confirms the finding of a separate auding factor in the smaller factor studies of Caffrey (Caffrey. 12. Triplet Numbers 15. need to be substantiated by further research. In both of these studies. This suggested division of the verbal domain would. G 33. .27 .26* -. Letter Series 17.

(School Arithmetic) . . the only unidentified factor is Factor from the graphical solution. does not justify any attempt at a definite interpretation. Spontaneous . Its failure to appear in other solutions.29 Factor 14. tests however. in the 9-factor biquartimin solution for girls is represented only in Listening to Spontaneous Speech. Letter List . As these three tests were the only based on expository talks of about six or seven minutes* duration. .25* ^Highest loading for the test. 1. . -. (School Arithmetic) Letter Grouping .. Although the factor is best represented in Letter List and Matching Words.36* ..36* . In the graphical solutions.82 LISTENING COMPREHENSION' A FACTORIAL ANALYSIS Nine-factor biquartimin solutions Factor 1 Factor 31. the hypothesis that the factor represents a form of . the highest loadings for Letter List and Matching Words it that may be were obtained on reasoning Factor factors. The suggests basically a reasoning factor.26 . Only F Listening to Girls* Talk and Listening to Boys' Talk had significant loadings on the factor. apart from the F estimated significant loading for School Arithmetic. while Matching Words demands understanding of the function of words in basis for interpreting the significant loadings of Letter Series and Arithmetic Reasoning on the factor in the respective solutions. sentences. the factor could possibly represent a particular form of listening comprehension. There seems to be it no sound factor as stands. these two tests do not seem to have anything in common. . Listening to F 37* . which appears in both biquartimin solutions for girls.. . . coupled with the estimated loading for School Arithmetic. Arithmetic Reasoning 37. but the loading of Listening to Short Talk (. No significant loadings. Some comment is required on Factor H. As Listening to Spontaneous Speech was the only listening test of its kind in the battery.. Letter List requires the subject to distinguish quickly between consonants and vowels.23) was almost significant. Unidentified Factors: Among the boys* solutions. 35. H .30 Speech 35. Matching Words . (School Composition) 6.28 12.

it failed to emerge with any clarity. tests. The in the present case. were included in the battery to identify the Attention factor. and even in it these studies there are indications that the factor in reasoning tests. It is based chiefly on Wittenborn's studies (Wittenbom. 1944). it is conceivable that the factor could be better defined among older subjects. obtained for two of these tests. verbal com5 prehension reflection and listening comprehension factors) of the low reliability of the test.INTERPRETATION OF FIRST ORDER FACTORS listening 83 comprehension peculiar to poorly organized speech cannot be verified. ticipating 1943) may explain the absence of a well-defined Attention factor factors. or that it is difficult to measure reliably with 11 and 12 year old children. In the present study. Factor B in the 8-factor biquartimin solution for girls could be identified as the Attention factor. On the other cannot really be claimed that the Attention factor is a well-established factor. 1943. The rather varied pattern of factor loadings obtained for this test in the various solutions (including loadings on deductive reasoning meaningful memory. Wittenbom and Larsen. is also represented . the highest loadings for the three tests of attention have mostly appeared on the inductive or deductive reasoning difference between the age levels of the subjects parin this study and in Wittenborn's study (Wittenbom. as is suggested by the reliability co-efficients hand. Factor E in the biquartimin solutions for boys could also be identified as the Attention factor. but in the discussion relating to Factor D'. Although there were some indications of such a factor in the results. arguments have been advanced for naming this factor rote memory rather than attention. may be a Three reference namely Triplet Numbers. Letter List and Five Letters.

that is. While this could possibly indicate a fundamental difference in the manner achieved even in R which boys and this kind are hardly of results approach a particular task. inferences of absence of any clear pattern among the second order factors. as in the biquartimin solutions for boys and girls. however.CHAPTER 5 INTERPRETATION OF SECOND ORDER FACTORS As indicated in Chapter 3. The extraction of further axis factors the relevant F principal is also unlikely to result in greater clarity in and between solutions. Although the first order domain had been characterized by a high degree of correspondence between factors from the various solutions. where the first factor had as many significant negative as positive loadings. girls justified in the It is possible that greater clarity could be achieved in the second order domain by further rotations or revised rotations of matrices. Negative intercorrelations in the M matrices are more numerous in the graphical solutions. When differences of this land occur in the second order F matrices. The plotted points representing the primary factors. there was little correspondence between the second order factors obtained in the four solutions. But correspondence between factors was still not when there was less difference among the pq matrices. lack is of agreement between the subsequent rotated factor (V) matrices not surprising. the 8-factor solution for the boys and the 9-factor solution for the girls. This lack of correspondence stems largely from differences in the pattern of intercorrelations among the primary factors. These differences led R to rather different patterns of principal axis factor loadings. particularly in the graphical solution for boys. are so few in number and so widely scattered that it seems difficult to avoid rather arbitrary placements of reference vectors. and include a number of relatively high correlations in the graphical solution for boys. second order factors were computed only for the two graphical solutions and for the more psychologically acceptable biquartimin solutions. In only two instances was it possible to match a factor from one solution with a factor from another solution with any degree of assurance. 84 .

.. Induction .25 and above on the second order factors in each of the four solutions. The table below lists the primary factors which have loadings of . Examination of the primary factor loadings on the second order factors.87 . After the individual second order factors have been presented.. It is also worth that a clear noting of results in the first order domain does not similar clarity in the second order domain (Thurstone..25 Girls' Graphical Solution Factor At .53 .51 Factor DM . Boys* Graphical Solution Factor At Listening Comprehension .90 .86 ..... Span Memory 26 . 1947) and three of the have carried to this stage. * * Deduction Listening Comprehension ~ Factor Ct Rote Memory Verbal Comprehension Span Memory 72 . attempts to interpret these factors individually would not seem to be justified....40 -.INTERPRETATION OF SECOND In any case.73 . only four factors can be ables FACTORS with 85 vari- (Tfaurstone. .. 1947). revealed a possible division of second order factors according to two broad groupings of primary factors.35 .. ... a tentative interpretation of the second order domain will be suggested.47 Auditory Resistance Verbal Comprehension . Induction 31 . Verbal Comprehension Factor B% .77 Meaningful Unidentified Memory Span Memory Unidentified .57 Auditory Resistance Verbal Comprehension Unidentified .54 Factor C* Induction Listening Comprehension Auditory Resistance 58 .40 Deduction -.42 Deduction Unidentified .. Because of the differences between the second-order factors obtained in the four solutions. Meaningful Memory . however.81 77 *.. .. .51 .87 Factor Listening Comprehension . 62 .. ..51 .

50 . Listening Comprehension Auditory Resistance Span Memory Verbal Comprehension .89 Solution Factor An Listening Comprehension Unidentified Unidentified Factor Ct Unidentified ...42 ..51 9-faclor Eiqmmtimm .* while the remaining earlier factors (except for Factor A2 in the girls' biquartimin solution) do not. A FACTORIAL ANALYSIS Solution Factor C* Induction .32 Meaningful Memory Auditory Resistance Girls 9 . factor listed under Factor 2 in the boys' graphical solution included both meaningful memory and rote memory D .. .27 Rote Memory Factor Dt .. Verbal Comprehension Span Memory Listening Comprehension Unidentified ... Span Memory Induction 61 Rote Memory Factor Bt Unidentified 55 36 Factor E% Rote Memory 59 39 . ...51 73 67 . of the span memory or rote memory fac- closer examination..59 . The two corresponding pairs are In the second marked by the presence tors. This distinction affords a basis for discussing second-order factors in terms of two broad groupings of primary factors. pair of second-order factors. it will be noted that the later second order factors listed in each solution involve the primary factors of Upon rote memory or span memory or both..64 Factor D$.71 Rote Memory . Deduction . and between Factors D and 2 in the third and fourth solutions the lists of primary factors do not agree for any other respectively..50 Apart from the obvious correspondence between Factor 62 and Factor D in the fourth solution above.86 LISTENING COMPREHENSION Boys* 8-factor Factor At 6! . .43 ..56 ..43 .43 ..36 Verbal Comprehension Factor Bs .. .46 Deduction Auditory Resistance -.44 . *The "meaningful memory" tests.

Meaningful Memory and Auditory Resistance. In each biquartimin solution. Factors Bs and C2 in the girls' graphical solution.INTERPRETATION OF SECOND ORDER FACTORS in the 87 tie earlier Despite the lack of correspondence second order solutions. Factor D 2 in the boys' graphical solution. are proficient at remembering meaningless material might well be expected because of this to obtain higher scores on tests involving meaningful content. Essentially. It is quite reasonable to expect order factor is Children who scores on listening comprehension tests to be partially determined in this way. when considered in combination. "Bz and regard these second order factors and the primary factors subsumed under them as a group displaying some evidence of homogeneity. The second group consists of the remaining second order factors. Induction and Deduction factors (as listed under Factors 62 and 2 in . IE the girls' graphical solution. and is not called upon to place any meaningful interpretation upon the material. and it is certainly not inconceivable that scores on some of the tests representing the Verbal Comprehension. these tests call for the "memorization of meaningless material. The distinctive feature of the second group is found in the types of test used to define the primary factors of span memory and rote memory. they divide into Factors It is possible therefore to 2. All of these factors are characterized by significant loadings for the primary factors of span memory or rote memory. whereas with one exception referred to earlier. they appear. Listening Comprehension. namely. This does not imply that the second limited to tests employing meaningless material. these primary factors are al included under the one second order factor (Factor As). Induction." presented in either paired associate form or longer sequences of letters or words. Verbal Comprehension. tors first group of second- A factors tentative interpretation of the two groups of second-order can be made on the basis of the differences in the type of task involved in the associated primary factors. Deduction. these primary fac- do not have significant loadings on the order factors. with one exception they are all included in Factors A2 and 62. and Factors Dj> and Es in the girls' biquartimin solution. The subject is merely required to reproduce given material in the form in which it was originally presented. A2. to encompass the same list of primary factors. in the boys' graphical solution. Factors 2 and D2 in the boys' biquartimin solution.

The first resistance tests part would be represented by the loadings of the auditory on the span memory factor. Tests of listening comprehension obviously depend on verbal interpretation. Likewise.88 the LISTENING COMPREHENSION girls' A FACTORIAL ANALYSIS 2 in the boys' graphical solution. Listening Comprehension. The above tentative interpretation of the second order factors also provides a reasonable explanation of the variance of scores on the tests of auditory resistance. verbal comprehension tests. group of second order factors (i. As the process of interpretation would involve the manipulation of verbal symbols in all of the relevant tests. Verbal Comprehension. In other words. The second part. and it has already been indicated how such tests are also likely to be associated with the second order group of memory factors. he must first make an active search for meaning in the material presented before he can answer the questions based on the material. Meaningful Memory and Auditory Resistance) all appear to be represented In tests which require the subject to interpret the material in his own way rather than merely reproduce it. which in turn is represented only in the group of second order factors which has been labelled "verbal interpretation.e. the task might be more fully described as "verbal interpretation. Deduction. involving questions of both detail and inference. could be expected to be associated with both groups of second order factors." because of the established connotation of the latter term in the domain of primary factors. Part of this variance can be attributed to the fact that some children can remember longer sequences of letters and words than others. with the possible exception of Progressive Matrices. would be represented by the loadings of the tests on the primary factor of auditory resistance. The task that is common to this group of second order factors can therefore best be described as comprehension or interpretation.." This is to be preferred to "verbal com- prehension. part can also be attributed to differences in the extent to which children can make sense from distorted speech samples. and thus on the second order group of memory factors. and under Factor solution) could be similarly influenced. the primary factors appearing in the The by subject. Induction. which involves the actual interpretation of the verbal messages." . Mquartimifl task involved in the second group of second order factors thus appears mainly to call for passive reproduction of material the By contrast.

as described by French (French. and three tests based on short talks of about six or seven 89 . span memory and rote memory. and by considering the differences between the processes of listening and reading. there is very little experimental evidence to justify this assumption.T. meaningful memory. A survey of the literature has revealed that although it has been commonly assumed that individual differences in performance on listening comprehension tests can be explained in terms of a separate "listening ability** or listening factor. The battery comprised nine experimental tests A of listening comprehension. the high correlations typically found between these tests and tests of reading comprehension and reasoning suggested that differences in the performance of subjects on listening comprehension tests might be almost completely accounted for by their differences in performance on reading comprehension and reasoning tests. a test designed to measure comprehension of the poorly organized spontaneous speech which is characteristic of many conversational situations. a modified version of the S. 1951. 1954). attention. all of which were either specially constructed or modified for the investigation. The problem was investigated in terms of the framework established for identifying the main types of mental activity involved in aptitude and achievement tests. auditory resistance.P. Indeed. The following established factors were judged to be relevant to the investigation: verbal comprehension* reasoning (induction and deduction).E. Since World War II an increasing amount of attention has been devoted to forma! training in listening comprehension and to the assessment of listening comprehension. Five specific hypotheses about listening comprehension tests were also advanced. Listeiipaig Comprehension test. Hypotheses concerning factors likely to be involved in listening comprehension were developed by examining the correlations between listening comprehension tests and other tests.CHAPTER 6 SUMMARY. battery of 34 tests was prepared and assembled to test the various hypotheses. They included a number of reading comprehension tests presented in listening form. CONCLUSIONS AND IMPLICATIONS THIS study was undertaken to investigate the factorial structure of listening comprehension tests.

supplemented by function and memory comprehensive studies of attention. attention and auditory resistance. ment schools . and also three of the memory tests. kit of the information available in the more The remaining tests in 1954). Karlin One form (Karlin. the battery were reference tests for the The selection of reference tests hypothesized factors listed above. The tests were applied by the author to over 400 Grade 6 children in ten schools in Melbourne. the tests presentation of the parallel series as listening comprehension allowed for more precise comparisons between the factorial structure of the two types of test. so as appeal to boys but not to girls. and to girls to assess the effect of differential interest in material presented on the factorial structure of listening comprehension tests. high quality tape recorder and a portable speaker specially designed for class- A rooms were used to present the recordings. the recommendations in French's monograph was based mainly on reference tests (French. were presented by means of tape recordings to ensure that there would be no differ- The tests of listening ences in the manner of presentation or the rate of delivery in different schools. 1951) and the E. 1943). One of these talks was of general interest to both sexes. the sample being chosen so as to be broadly representative of sixth grade children in govern- in that city. and reading comprehension tests prepared of a series of vocabulary by the Australian Council for Educational Research was modified to serve as reference tests for the verbal comprehension factor. comprehension. The test battery was administered to each of the ten classes in six testing sessions of approximately ninety minutes* duration and spaced at weekly intervals. 1954) respectively. Children who were unable to hear the recordings satisfactorily were detected by applying a modified version of the Harvard Spondee test as an audiometric group screen test. 1942) and Kelley (Kelley. All but two of the recordings were made under technical supervision by a male speaker with considerable experi- ence in making broadcasts to schools. the complete testing programme occupying a period of three months. the others were made by a female soprano and by a small group of schoolgirls. The other two talks were respectively designed to but not to boys.T. auditory which had been made by Wittenborn (Wittenbora. (French.90 LISTENING COMPREHENSION A FACTORIAL ANALYSIS minutes* duration.S.

Auditory Resistance. were not included in the used for analysis. The reference tests included in the battery clearly identified the factors of Induction. where the loadings of the tests on the principal axes were computed on an IBM 650 and subsequently rotated analytically by Carrol's "biquartimin" method on an IBM 704 computer. and an appropriate reliability co-efficient was computed for each of the 34 tests. reading the two samples. the first order factors were easily interpretable. Factor loadings of the three school achievement variables on the primary factors were estimated by means of Mosier's generalization (Mosier. the Satisfactory approximations to oblique simple structure among first order factors were obtained in the graphical solutions and also in the two biquartimin solutions (one based on eight factors. but the factor of Attention failed to emerge. Meaningful Memory and Rote Memory. and children from non-English-speaking countries who had in Australia for less than five years. the final samples consisted of 161 boys and 139 girls. the 9-factor biquartimin solution for boys and the 8-factor biquartimin solution for girls were less acceptable on psychological grounds than the other solutions. 1937). Verbal Comprehension. CONCLUSIONS AND IMPLICATIONS Children test 9! who had not been present at all testing or papers showed evidence of poor hearing or Irregularities. Span Memory. 34 tests and on school examinations in and composition were normalized for each of arithmetic. There was a high degree of correspondence in the pattern of factor loadings obtained from each of the six solutions. Nevertheless. for whom results on all tests were available. These intercorrelations were punched on IBM cards and forwarded to the Littauer Statistical Laboratory at Harvard University.SUMMARY. but because of some incon- gruous loadings for certain tests on some factors. Deduction. the other on nine factors) for both boys and girls. . possibly because of the low reliabilities of the Attention test or their closer association with reasoning tests among younger age groups. and the intercorrelations of the 37 variables for each sample were computed on Silliac at the University of Sydney. who also computed second order factors correlations between the primary factors obtained in the graphical and two of the biquartimin solutions. 1938) of Dwyer's extension (Dwyer. Independent graphical rotations of the principal factor loadings on eight factors for the boys' sample and ten factors for the girls' sample were scores on the Raw from the undertaken by the author.

" This comprehension" factor. For both boys and girls.92 LISTENING COMPREHENSION greatest Interest A FACTORIAL ANALYSIS Of was the Identification of a separate "listening more exact terms as "comprehension of verbal material presented in spoken form. In marshalling the necessary evid-. which had not been included in the main analysis. verbal comprehension. as interpretations were less certain in these instances because of lack of clarity in certain aspects of the analyses. The first order factor interpretations tended to be confirmed by the pattern of estimated loadings of the school achievement variables. and no separate listening factor need be postulated. School Arithmetic had significant loadings on the induction factor and School Reading and School Composition had significant loadings on the verbal comprehension factor. suggesting that performance on listening comprehension tests depended both on how well a subject could interpret the material and on how well he could remember it.' The These general conclusions about the nature of listening comprehension can be supplemented by the answers to the five specific hypotheses set out at the end of the first chapter. factor. as the second order factors seemed to fall into two groups. the subject 5 material. it tentatively suggested that the primary factors might be divided into those requiring active "verbal interpretation" on the part of was and those requiring him "to memorize meaningless listening comprehension factor had significant loadings in both groups. described in which was common to most tests of listening comprehension and generally confined to these tests. However. attention and memory factors. Second order analyses for the two graphical and for two biquartimin solutions showed little correspondence from one solution to another. is discussed more fully below. and a definite interpretation of the second order factors was not attempted. and of the second order analyses. Each of these hypotheses is discussed below. according to whether they were or were not represented in the rote memory and span memory factors. The variance of listening comprehension tests can be accounted for by reasoning. This hypothesis must be rejected. ence to examine each hypothesis. the experimental group of listening comprehension . as a definite listening comprehension factor was identified in the first order domain. Hypothesis 1. little cognizance has been taken of the less acceptable 9-factor biquartimin solution for boys and 8-factor biquartimin solution for girls.

first order domain necessary in examining this hypothesis to consider not only the relative size of the loadings of the listening comprehension and reading comprehension tests on the factors indicated. Thus. however. appeared to be more closely to the verbal comprehension than to the listening comprehension were found to depend more on the of a subject's vocabulary than on his grasp of the content of spoken passages. Listening comprehension tests have similar loadings to reading comprehension tests on reasoning and verbal comprehension factors. The hypothesis has therefore been examined by comparing the loadings of Tests 7 to . of the listening comprehension tests had their loadings on this factor. Hypothesis 2. as a result. The correlations between this factor and other factors indicate that performance on listening comprehension tests is most closely associated with performance on verbal comprehension tests. it was considered that an examination of trends in these comparisons would be a sufficient test of the hypothesis. while the hypothesis must be rejected in the form in which it is stated. These tests types of memory tests. there is some evidence that performance on listening comprehension tests is related to performance on inductive reasoning. listening comprehension and verbal comprehension various solutions approximated oblique simple structure fairly closely. comparisons between the tests of and the The listening comprehension and reading comprehension have to be based mainly on non-significant loadings* Because of this. CONCLUSIONS AND IMPLICATIONS tests 93 tended to occupy a position in the common tests for factor differentiated them from the reference other factors. But although this separate listening comprehension factor was identified. and very few of them had significant ings on any other factor. and fairly closely associated with performance on span memory and inductive reasoning tests. it was found to be associated with certain of the other primary factors. There is also a moderate degree of association between performance on listeniag comprehension tests and performance on tests of rote memory and auditory resistance. verbal comprehension and certain factor. but also the magnitude of the correlations between these it is Since fee obtained factor structure in the factors factors.SUMMARY. but higher loadings on attention and memory factors. Listening Vocabulary and Listening for General Significance. was oblique.

94 LISTENING COMPREHENSION A FACTORIAL ANALYSIS 1 1 with those of Tests 26 to 34 on each of six factors for each of four solutions. The predicted similarity of loadings on the verbal comprehension factor. inspection of the correlations between the two comprehension factors and the memory factors suggests that the hypothesis can be rejected in relation to the meaningful memory and rote memory factors only. On the other hand. This afforded an opportunity of confirming Kelley's finding (Kelley. The loadings of Listening Vocabulary and Listening for General Significance on the verbal comprehension factor suggest that the may not have been rejected if vocabulary tests had been used to define the verbal comprehension factor. In the three pairs of tests defining the three memory factors. one test in each pair was presented by visual means and the other from a tape recording. The idea that listening comprehension tests would make more demands than reading comprehension tests on attention and memory is mostly discounted by the evidence. Reading comprehension tests had much higher loadings than listening comprehension tests on the verbal comprehension factor. Deduction. The hypothesized attention factor was not identified at all. of course. be a direct result of the fact that the verbal comprehension factor was The evidence it reveals that the insofar as affects the inductive defined in this study largely by reading comprehension tests. and the three memory factors. Hypothesis 5. was not attained. nor in the correlations of the factors with the listening comprehension and verbal comprehension factors. and by comparing the correlations of the listening comprehension and verbal comprehension factors with Induction. hypothesis can be accepted and deductive reasoning factors. the span memory factor is much related to the listening comprehension factor than more it is closely to the ~~" verbal comprehension factor. In three of hypothesis the four solutions. The form . Visually-presented memory tests and auditorilypresented memory tests do not differ significantly in their correlation with either reading comprehension tests or listening comprehension tests. This may. 1954) that the memory factors were not related to the mode of presentation of the test material. however. and the loadings of the two groups of tests on the three memory factors show no trace of any difference in the hypothesized direction. There are no consistent differences in the loadings of the two groups of tests on these factors.

05 was required to reject the hypothesis that the two sets of correlations were from the same population. and between each of the three pairs of tests and Tests 26 to 34. this corresponded to the maximum possible discrimination between the two sets of correlations when was equal to 5. the less powerful sign test for correlated samples was employed in the latter case* (Ferguson 1959). 20 and Tests 7 to II were compared with those between Test 21 and Tests 7 to 11 for both boys and girls. but as the number of reading comprehension tests fell below the tabled values for the Wilcoxon test.06. and for girls in the rote memory tests. The hypothesis is also untenable in For both auditory test relation to the meaningful memory tests for both sexes. Similar comparisons were Tests 22 and 23 and Tests 7 to 11. Application of the non-parametric tests revealed that the hywas supported for both boys and girls in the span memory pothesis tests. it The rejection of the hypothesis as memory tests and to the rote memory *In the Wilcoxon applies to the meaningful tests for boys does not pro- tests a probability level below . both the reading comprehension and listening comprehension tests had significantly higher correlations with the visual rote memory test (Word Number) than with the auditory rote memory test (Memory be sustained for Words). however. As the main interest lay in determining whether the visual and auditory correlations within each set of comtherefore The correlations between Test reading prehension or listening comprehension tests could arise by random sampling from the same population. The Wilcoxon matched-pairs signed-ranks test was used for comparisons within each set of listening comprehension tests. Tests 24 and 25 and Tests 7 to 11. CONCLUSIONS AND IMPLICATIONS in 95 of in which this third hypothesis is stated requires a the correlations of the visual and auditory memory pair with the reading comprehension tests and the com- prehension tests. it was considered appropriate to employ non-parametric tests to examine the hypothesis. In the sign tests the hypothesis was rejected when the probability level was . comthe prehension have significantly higher correlations with memory test (Consequences) than with the visual memory (Sentence Completion). indicating that the hypothesis cannot in this instance. Among the boys.SUMMARY. the reading comprehension and tests boys and listening girls. N .

fact that one test was Hypothesis 4. In the solutions in which the meaningful memory factor was clearly identified. there was no further support for the hypothesis in either the matrices of factor loadings or in the correlational evidence. indicating that scores on listening comprehension tests are related to individual differences in the types of task represented in these memory factors.35 and . Listening comprehension tests have significant loadings on the meaningful memory factor. and of .43 with the rote memory factor. were not orthogonal or near-orthogonal hypothesis to consider the correlations necessary in assessing the validity of this between the listening com- prehension factor and memory factors as well as the loadings of the nine listening comprehension tests (Tests 26 to 34) on the memory tests factors specified. Although Listening to Short Talk. The factorial content of listening comprehension tests does not differ with variations in the interest level of the topics presented. Examination of the loadings of the listening comprehension on the three memory factors shows that the hypothesis cannot be sustained. but non-significant loadings on rote memory and span memory factors.96 LISTENING COMPREHENSION A FACTORIAL ANALYSIS vide grounds for concluding that these memory factors are related to the mode of presentation of the material.49. the auditory meaningful memory test (Consequences) has higher correlations with reading comprehension as well as with listening comprehension tests. . It will be noted that the visual rote memory test (Word Number) has higher correlations not only with the visually-presented reading comprehension tests but also with the auditorily-presented listening comprehension Similarly.27. Listening to Boys' Talk and Listening to Girls' Talk had significant loadings on the meaningful memory and not on the rote memory and span memory factors in one or two of the solutions. . It appears therefore that the significantly higher correlations associated with the visual test in the one comparison and the auditory test in the other tests. factors it is in As the primary many instances. comparison cannot be attributed to the presented visually and the other auditorily. its correlation with the listen- ing comprehension factor was very close to zero.57 with the span memory factor.55 and . Hypothesis 5. By comparison. . the listening comprehension factor had correlations of .

though they were significant only for the Boys' TalLf To what extent can the above conclusions be generalized beyond the group for which the data was obtained? As factor structure has been shown to change with increase in age in at least some of the relevant investigations (e.01 not significant List. . but the trend is not consistent enough in the various comparisons to be accepted as a basis for rejecting the hypothesis.1% level. Both tests tend to have significant on the same factors (generally Listening Comprehension and Meaningful Memory) in the two graphical and the two blquartimin solutions. 8. Listening to Boys* Talk and Listening to Girls' Talk..D. Richards.11 . .47 .43 2.g. Relchard. . as the increasing amount of reading and independent study demanded of the secondary *In the main factor study..D. corbetween listening comprehension tests and reading comprehension tests are likely to be lower. as the mechanics of reading may not have been fully mastered by many children.40 . 1941). CONCLUSIONS AND IMPLICATIONS 97 The test of this hypothesis rests on a of the loadings of the two tests designed to appeal differentially lo and girls. Although the two tests. of course.42 2. preclude the existence of differences in mean score.. There is some evidence of a tendency for the Boys' Talk to have higher loadings than the Girls* Talk on these factors in the girls* solutions. f was rejected Boys List. On these figures the hypothesis of independence of sex and preference for the talks by the chi-square test at the . Girls Difference . 2.43 8. the would exhibit of fail to any differences in factorial structure.8.SUMMARY. were found to have this appeal.99 Significance level Boys' Talk.51 p <. and differences in the expected direction were found in the main study. mean S. .61 . At younger age levels..92 2. the present findings should probably be limited to children aged about 10 to 12 years. 1944. mean S. The confirm this prediction. 9.. 145 of 161 boys (90% ) preferred the boys* tall. The absence of a difference in factorial content does not. while 118 of 139 girls (85%) preferred the girls* talk.* it was predicted that with a well-motivated children who know they wiH be questioned. Factor patrelations terns at older age levels may differ also. and for the Girls' Talk to have higher loadings in the boys' solutions. . Girls' Talk. .

to consider how widely the findings can be generalized beyond children in government schools in Melbourne. 1956) suggests that the factorial content of listening comprehension tests among American school children may be similar to that found in the present study. 1951). the basic similarity among the States in curricula and pattern of instruction and in their incidental approach to listening comprehension would suggest that the results could be safely generalized to Australian children in the age groups concerned. and to America in particular.S..R. Not only is the teaching and testing of listening comprehension in the U. and less to speaking and listening. 1. There have been no comparative studies of listening comprehension in the different Australian States or in government and non-government schools. But the fact that the reference factors identified in this study were mostly established on American students in the first place. Although the norms for reading comprehension tests differ in the various States (A. IMPLICATIONS implications of the findings of this study can veniently considered under three headings. Caffrey and Smith. On the other hand. Generalization to children in other English-speaking countries.98 LISTENING COMPREHENSION A FACTORIAL ANALYSIS school pupil might affect Ms performance on reading comprehension and listening comprehension tests differentially.. It is pertinent. with Australian schools devoting more attention to reading and writing.E.C. too. Implications for Testing Practice The be con- The identification of a separate listening comprehension factor indicates that listening comprehension tests do measure something tests. and the listening comprehension factor could we! follow the same pattern. not already measured by reading comprehension and reasoning thus providing an answer to Lindquist's criticism of listening comprehension tests in the Fifth Mental Measurements Yearbook.A. Although there is a substantial positive correlation between the . 1950). the verbal comprehension factor has been identified over a wide range of age levels (French. 1955. coupled with the evidence of an auding factor with American high school and fifth grade groups (Caffrey. may be less justified. Australian observers tend to difference in emphasis in the two countries more widespread remark on a basic on the teaching of language at the elementary school level.

with its sub-tests of immediate recall. the latter test gives measures of span memory and reasoning. the task of comprehending spoken material is performed in the same way for passages differing widely But variations in interest level can still be reflected between the mean scores of various groups. It would also seem desirable to use several short passages rather than one long passage in order to sample a wider range of topics. the study gave no indications that comprehension of the three short talks was different in character to comprehension based on a number of short passages. following directions. provide a satisfactory measure of listening comprehension. For a measure of general achievein this area. unless recent information about children's hearing is available from school records or other sources. the study shows that questions based on short talks. In developing listening comprehension tests. a test like the Brown-Carlsen Listening Comprehension test. It would seem. What should be measured in tests To answer this question. the results of the study that listenof ing comprehension cannot be adequately measured by reading comprehension. even though the passages do not differ in factorial content. verbal comprehension. The results show that the two listening tests based . Listening Com- ment prehension Test. for instance. except for an unidentified factor in one solution. or on short selections as in the S. which are shown in the present and study to be correlated with listening comprehension.SUMMARY. The question of whether much is to be gained by measuring listening vocabulary in addition to reading vocabulary is also raised by the study. or alternatively to provide separate norms for boys and girls. For diagnostic purposes.P. In addition to providing a direct measure of listening. The application of such tests is not an unnecessary duplication of testing time and effort. memory and auditory resistof listenance.E. in differences against the other. reasoning. lecture comprehension. might be more useful. advisable also to use a hearing screen test in conjunction with listening comprehension tests. for well-motivated children who know they are to be tested. it would therefore be advisable to select passages which did not. The study has revealed that. the purpose is of listening comprehension? for which the measurement required should be known. CONCLUSIONS AND IMPLICATIONS 99 listening comprehension factor and certain other factors. recognizing transitions and word meanings. favour one sex as in interest level.T. and that it needs to be measured specifically by ing comprehension.

. 2. where the correlation between Reading Vocabulary and Listening Vocabulary was the highest obtained (. would be required to establish this point. more definitive study of vocabulary and comprehension tests. There would thus seem to be less need for two separate measures of vocabulary than for two separate measures of comprehension. in most American schools. Probably the larger part of adult learning. takes place in this form. Not only does much of the learning in kindergartens and elementary schools take Is place in this form.68) in the 9 A girls matrix. and television. Implications for School Programmes The development of comprehension of spoken passages has been treated as an incidental matter in Australian schools. until quite recently. Useful indications of children who could profit from remedial instruction in either area were obtained even in the present study. the discussion method and the lecture method are in wide use in secondary schools and universities. however. Pending such a study. it would not follow that schools should provide formal instruction in mirror writing. through contact with other people.100 LISTENING COMPREHENSION A FACTORIAL ANALYSIS on knowledge of word meanings (Listening Vocabulary and Listening for General Significance) are more closely related to the verbal comprehension than to the listening comprehension factor. If pupils were found to exhibit considerable differences in mirror writing. several studies have demonstrated that members of the community could become much more efficient at comprehending spoken material than they are at present. radio. for instance. and also. The establishment of a separate listening comprehension factor not necessarily an indication that the school should do anything about it. both formal and informal. it desirable that children and adults should be able to comprehend spoken passages effectively? Is this an important educational objective? It seems rather obvious that it is. Although this type of learning is so common in the com- munity. The case for formal teaching of listening comprehension must be decided on its is own merits. The present investigation draws attention to the fact that pupils differ markedly in the extent to which they comprehend spoken material.73) in the boys' matrix and the second highest (. it would probably be desirable to continue to test both reading vocabulary and listening vocabulary.

CONCLUSIONS AND IMPLICATIONS listening 101 Teachers have tended to assume that Increasing in comprehension comes incidentaiy la the school proIt is true that children obtain higher scores on comprehension tests as they become older. however. and those who are poor at reading and good at listening should be identified so that they could be studied in A greater detail and appropriate remedial measures instituted.64. even they no formal instruction in listening comprehension. In the meantime. the fact that school arithmetic. and drawing inferences. would also be effective. the median correlation being . such as exercises in observing details* making use of contextual clues. question of how listening comprehension may be best has not been a major concern of this investigation. as improvement is generally greater for poorer listeners than for good listeners. listening comprehension factor. distinguishing between main and supporting ideas. further question of considerable importance for school prois raised by the demonstration that tests of reading comprehension and listening comprehension differ in factorial A grammes content.52. and that the latter objective needs attended to explicitly. There is ample evidence in other studies that listening comprehension is trainable. . reading and composition do not have significant loadings on the factor indicates that development in the ordinary school subjects does not guarantee develop- separate shown ment to be in listening comprehension. this study has suggested that increments in score resulting from training are not entirely due to increased comprehension of verbal material generally. Evidence from other studies suggests that the provision of formal instruction in listening comprehension would tend to Increase these correlations. this investigation has that this type of comprehension can be developed specifically. Correlations between the equivalent tests presented as reading and listening comprehension tests (excluding the vocabulary tests) ranged from . but are due in part to increased comprehension of verbal material presented in spoken form. In establishing a gramme. appears that specific training in span memory Examination of the types of items in the listening comprehension tests suggests that the types of training employed in other studies.SUMMARY. this taught would need to be determined by further studies employing appropriate experimental designs for this purpose. the correlations are low enough to suggest that children who are good at reading and poor at listening. From the evidence The obtained.33 to . tasks it would be useful.

The finding that listening tests based mainly on vocabulary knowledge have greater affinity with the verbal comprehension than with the listening comprehension factor suggests knowledge of word meanings might be a sub-factor of the domain which transcends the modality of presentation. Apart from the fact that only one such test was included in the study. Comparison of performance on the two types of test also raises the issue involved in determining whether a pupil is performing up to expectation in a given area. and that "comprehension of verbal passages presented in spoken form" (listening comprehension) and "comprehension of verbal passages that presented in printed form" (reading comprehension) might be other sub-factors. more legitimate 3. It has been customary in educational and psychological practice to use a score on an intelligence or reasoning test as the criterion of what might be expected of a pupil. The factorial structure of tests of poorly organized spontaneous speech has not been sufficiently established in this investigation. Implications for Further Research The findings in this study give rise to a number of suggestions which could be profitably explored in further factor studies. it would appear that his score on a listening comprehension test might be a criterion than his score on an intelligence test. This notion would be worth investigating with a test battery which included several tests of reading vocabulary and listening vocabulary as well as a variety of reading comprehension and listening comprehension tests. Those who were good at listening but poor at reading would probably show a record of failure in their reading experiences. Although . each correlated with the vocabulary sub-factor. Foremost among these is one relating to the domain of comprehension of verbal material.102 LISTENING COMPREHENSION A FACTORIAL ANALYSIS study of the reasons for the difference In their performance on the two types of comprehension test should be profitable. in deciding what might be expected of a pupil in the field of reading comprehension. however. Why others were good at reading but poor at listening could only be conjectured. such possibilities as lack of security in face-to-face contacts and the development of habits of inattention as a result of prolonged exposure to radio and television would need to be investigated. its its pattern of factor loadings failed to indicate clearly relationship with the listening comprehension factor.

of applying similar tests to older age groups and to groups in other English-speaking countries. such as registering answers. Finally. there remains the wider question of whether the factors obtained in the present investigation would appear in the same or in modified form if the test battery were to be applied in "live" listening situations and to other populations. This may explaia why the same memory factors have previously been found in both visually-presented and auditorily-presented test material. In one solution. If a visually-presented memory task can be vocalized or sub-vocalized* is it really a test of visual memory? There would seem to be considerable scope for developing tests of visual memory which could not be vocalized by subjects. its loadings on the comprehension factor generally approached the level required for a significance. its factor pattern of such tests should obviously in a battery which included several reliable tests of this kind. In the course of conducting this study. indicates that it would also be desirable to crossvalidate Wittenbonfs attention factor at older age levels in a test battery which included several types of reasoning tests. CONCLUSIONS AND IMPLICATIONS 103 Its loadings were mostly non-significant:. of accompanying the tests by demonstrations of what is being discussed in the passages.SUMMARY. Research is also required into the nature of visual memory and the methods of testing it. The strong association found between these tests and reasoning tests. can only be ascertained by further research studies of the present kind. it is possible an attention factor would be obtained at the Grade 6 level. It seems essential then to determine testretest reliability co-efficients for these tests before employing them in a factor investigation. and assessing both the factorial content of these tests and their relevance to learning. Tests of attention or concentration are affected far more than other types of tests by mechanical features of the task. Its weak factor pattern in this study is separate factor. The effect of having study could be modified to that the tests administered listening comprehension by classroom teachers. If the attention tests used in the present make them more reliable. . it was observed that so-called tests of visual memory were probably measuring auditory memory to a large extent. however. which ia turn can be attributed to the rather poorer quality of the tape recording for Further research into the nature of the Attention factor is required. It appeared to be examined more thoroughly probably due to this test. The extremely low reliability. however.

E. 18 Rapid Spelling Singing Haphazard Speech Illogical Grouping Listening for Inference 4i 5i 5i 7 17 29 Break 4 20 9 Reasoning Sentence Completion . . 20 20 30 13 Second Day Listening to Short Talk (ST) Triplet 19 . 4 5 22 Word Number . 5 ... .. . Listening 45 Break Letter Grouping . 30 22 Fourth Day 32 16 17 18 19 Listening to Boys' Talk (BT) .. . 24 (Visual) ... 14 104 ....APPENDIX A Time Total ORDER OF ADMINISTRATION OF TESTS Test No. 13 18 8i 10 . Numbers . 31 Listening to Poorly Organised Spontaneous Speech 14 Letter List . Reading for General Significance . I0i 18 21 Consequences Letter Series Break 2 12 6 . 18 Matching Words Third 8 20 Day .) first Day ..P.. . .) Time (mins. 34 1 S. Test Title Limit (mins. 20 12 17 28 3 Listening to Note Details Break Raven's Progressive Matrices (1938) Letter Span I 20 .T.

. Break . 27 25 26 Listening for General Significance Letter Span II (Auditory) . Tes? Title (mins. . Day (GT) . .12 . 16 12 IS 10 11 6 8 Arithmetic Reasoning . Listening Vocabulary Spondee Test . . 7i I4i 10 Reading to Note Details .. .. 16 22 10 13 23 5 11 Memory Word for Words Break ..7 9 6 Reading for Inference Reading Vocabulary Sixth .10 24 Chapman-Cook Speed Form A of Reading.. Squares .... . .) No. .) 33 15 Listening to Girls' Talk Five Letters . .APPENDIX A 105 APPENDIX Test A (Continued) Time Total (mins. 12 7 9i Day ..

bites D. and write the letters for these words in the blank spaces. and Ted has twice as much as John and Will put together. tests are marked with an asterisk) Letter Grouping line the Three of the groups of one that is different. dog 6. Letter Scries ABCD MNOP EFGH should be. X in the box of answers. older than N. Reasoning M 5. Progressive 1938 Diagrammatic material. man E. 4. a c d e g 3.. smiles B. How much money have the three boys between them? 106 . letters are alike in some way. Will has Is.APPENDIX B SAMPLE ITEMS FROM TESTS (Tape recorded 1. Under- XURM 2. barks C.. Word Squares Find the words that are missing from the square. 4d. A. and Decide what the next it letter in this series mark f with an cadaeafa Matrices. Arithmetic Reasoning John has 9d. therefore K is K is than M. is younger than N.

. in the second part of each paragraph.. boat 3. choose the sentence what is most likely to happen next....... and write its number its in the brackets. Slowly but surely the keen-edged axe ate of the forest giant. way into the heart As the great tree began to creak and sway the axeman leaped to safety.. (1) awful (2) sweet (3) quiet (4) foolish (5) loud 11. or its in L jump 2. 1........ put a pipe in his mouth and a hat on his head. They built a snowman. (1) crows (2) laughs . ship 8... There was a fire last the ground... and five houses were burned to happened because someone was careless.. They laughed merrily when Tom knocked the hat off with a snowball.. the brackets. and threw a nail into the waste-paper basket.. Reading to Note Details is it In the Australian bush there ing jackass. Its laughter is (3) brays ) (4) dances (5) swims ... the one word which spoils the meaning.. 107 Reading Vocabulary Find the word or phrase which has the the same meaning as the underlined word.. Every morning living in the country. .APPENDIX B 1.... wakens with a strange bird called the laughits loud laughter people The jackass .. tree 4. Reading for General Significance The children had a fine time in the snow. ..... 9.. It all night.. The children were (1) cold (2) very happy (3) hungry (4) naughty (5) sad 10.... sail ( ) Speed of Reading Cross out.. stick 5... Reading for Inference From which tells the sentences following this story.. ( 2......

.... Triplet Numbers Listen to the following sets of three numbers. make a tick. 7 Set B... or when the third number of a set is the largest fit and the first number is the smallest.... The The The tree 2.. E.. Five Letters* Start with the letters A........ T L O 2 .. 3. or a consonant comes after a consonant. B 3 ... letters. When a consonant comes after a vowel.o Write down the words that have been sung. When the numbers do not either of these rules. Rapid Spelling* As soon word as the speaker has finished spelling a word. 8 14... My puppy eats biscuits.. a17.. grew taller the next year.. LISTENING COMPREHENSION A FACTORIAL ANALYSIS Many woodmen were killed........ A 4 ..... Set C. Write down the new order E...... Letter List* When a vowel comes after a consonant.... . ... write a minus.. 3-6-8.. 4. U 5 . When a vowel comes after a vowel. 13. cross. 15... Place a tick in the space on your answer sheet when the first number of a set is the largest and the second number the smallest. 2. birds protested against the felling of the tree.108 1 ... Singing* 1 - s.... Bloom the sweetest flower in the field........ tree fell with a mighty crash.... A D of the 16... C......... write a plus............. D...4 5 5.. SUSAN hurt her finger.... make a Set A..... Now change over and then put in between B and C. D 6 ..... 12.. write that in the space provided. Matching Words sentence as Mark the word that does the same job in the second the Key Word (capitals) does in the first sentence.. B.

lamp .APPENDIX B 18. or as near to it as you can. write out exactly speaker said. The sentences below are the ones you studied just a few minutes ago. or as near to it as you can. Illogical following short sentences are spoken in another unusual way. like violent storm unroofed several houses. saw him. Consequences* causes the trees to grow. Sentence Completion Study the following sentences: George's house is green. the / fourteen of / us. 109 Haphazard Speech* the The following short sentences are spoken in an After each sentence is completed. After each sentence is completed. 19. when again. 20. Many people had to Later. write out exactly what the speaker said. is This this pair: is a test to see how sentences. word which The George's house 21. the speaker reads out the first sentence in each pair have to write down the second sentence which com- 22. / not under the Grouping* table lay / a / cat. On. Fill in the blank space in each sentence with the was in it before. The speaker The will well you can remember pairs of read out 20 pairs of sentences. you pletes the pair. The sun causes the trees to grow. 1. 1. stay with friends. Word Number Study these pairs of words and numbers: box chair fan 66 21 92 77. The We.

. Remain means most 1. .. choose the right answer from the five words printed on your test paper. he in you are to write down the which they were called out... After each set of letters. you have to write down the word which was paired with it in the list.. come ) 4. . 1. lamp box fan 23... Memory This is for Words* you can remember pairs of words which have heard. question make 27. nail mule . Letter Span II (Auditory)* In this test. the speaker will call out a series of letters.. nearly the same as 5. 2..gold . Listening for General Significance* ." 26. . like this: you a test to see if First reading..seal . After letters in the exact order "Series L H R L. ..110 LISTENING COMPREHENSION Later: Write the chair .. .wren mule . when the speaker reads out the first word of each pair. The speaker will read out a list of pairs. stay ( 2. follow 3. Letter Span I (Visual) In this test you will be shown some cards with letters on them. finishes.. of each of the objects: . H R L G K P 25. When you are asked what a certain word means. . ..gold lark nail Then. Listening Vocabulary* This is a test to see how many words you know when you hear them spoken. write down the letters in the exact order in which they were shown to you. 24.wren lark - seal Second reading: .. A FACTORIAL ANALYSIS number .

will When the talk over. 3. you be asked to answer some questions about it. The questions were also presented on tape. early in autumn.APPENDIX B 28. To tell us about the mosaics they took them. in autumn. Listening to Spontaneous Speech* This is a test to see how much you understand when you hear a group of people or children talking together. summer. You will hear a recording of a conversation in which a number of children were talking about going somewhere. in the spring. You wUl hear is a short talk about making toy models. late in 4. Sample item The their children decided that the best time of the year to have day out was L 2. and when the talk is over. Talk* . did the speaker mention that the Spaniards sailed the seas to America? 2. you will be asked to answer some questions about it. 10 and 11 respectively. Listening for Inference* 111 These tests were composed of passages similar to those in Tests 9. . but the options were printed in the test booklets. Listening to Note Details* 29. To show us how they got to America. to America with 4. 30. . 3. This is talks you Sample item Why 1. Listening to Short Talk* a test to see how well you can understand the kinds of are likely to hear on the radio or in school. us how the idea of mosaics reached parts of 31. 32. When the recording is finished. You wil hear a short talk about designs or patterns. The passages were presented on tape. Listening to Boys' . you will be asked to answer some questions to see if you understand this conversation or discussion. To tell us where they settled in America. To show America.

. . the weight of the iron." how to spell a word. support the roof of the garage.112 LISTENING COMPREHENSION A FACTORIAL ANALYSIS Sample The frame 1. 4. All you have to do is to write down the words that the For example." you would write down "good-bye. Listening to Girls' Talk* . You will hear is when about the talk it. Arithmetic School Marks 36. he could only stand there rubbing his eyes in.T. 3. 33. speaker says. Listening Test* Sample passage of in The old man hurried back to his house. angry . hold the side walls in position. and wondering whose house he was Sample item When the old man saw how did he feel? 1. 4. Modified Spondee Test* . ( ) 35. the yellow cat in his best armchair. .E. the lightness of plastic material. 2. and his mind was full many things. a short talk about plastic decorations. and over. . surprised sad 4. 3. . described in the talk was to 2.P. . Reading School Marks 37. you will be asked to answer some questions Sample item The decoration becomes part of the article because of 1 the heat of the iron. just write it down the way you think it is spelt. if the speaker said "goodIf you are not sure bye. the smoothness of plastic material. . 3. pleased 2. support the base of the garage. strengthen the openings around the doors." so you would write down "note-book". yellow cat sitting Ms best armchair. When he suddenly saw a fat. the speaker might say "note-book. Composition School Marks 38. S. 34.

APPENDIX C CORRELATION AND FACTOR MATRICES TABLE CI Intercorrelations of 37 variables for 161 boys (Below Diagonal) and for 139 girls (Above Diagonal) (Decimal points omitted) 113 .

Rdglafer . 25. 26. ...1 14 LISTENING COMPREHENSION- A FACTORIAL ANALYSIS TABLE Cl (Continued) Intercorrelatlons of 37 variables for 161 boys (Below Diagonal) and for 139 girls (Above Diagonal).... ... . 13.. ListDetails 29... SchArith . ListSponSp ListBoysT .. 19. (Decimal points omitted) Test 9 2801 ... 4752 5036 3834 4273 5304 3568 3367 2909 5745 5557 5500 3793 4483 3148 4526 4755 4899 4383 5287 4274 1205 4148 1745 3216 1520 4351 2511 2586 4170 2785 2423 2643 0470 -0054 3832 2177 2953 3316 6022 2456 4908 2471 5156 2012 3865 2051 3762 1410 3401 0649 4421 1629 4203 1578 5101 2287 5665 3235 5173 3469 5165 3631 2192 1906 2394 1806 2475 3252 0095 3456 1750 2615 2538 3428 2398 2492 2112 2719 2643 3767 2856 2128 1331 3296 4074 2800 3903 3143 3023 2905 3842 3540 4013 3793 3145 1952 . ListGenSig 28. ... 37... 18... 33.. RapidSpell Singing .. 15.. 20. 9.. ListShTalk . . 3436 3599 1204 4233 4136 2956 2302 1395 4098 3802 1315 4.. 35. 17. 4038 3695 2852 4392 4591 5290 3878 5797 2950 0926 4788 4586 6648 5151 2825 3979 3057 5150 2670 4593 1529 0455 3551 3798 5432 2922 3614 3009 2359 3995 3645 4455 3337 4825 2441 0732 2923 3401 4621 1527 1482 2239 1188 4275 1274 2123 0904 1982 2000 3655 3154 4427 2983 3589 1043 2435 3188 3547 2753 2507 2942 2242 2143 2016 2025 2864 2617 1896 1468 1419 1736 6458 27. 10 II 12 13 14 15 16 L LetterGroup 2. 32. 4728 7044 5976 4662 5829 5775 4727 4890 6723 5353 5804 5336 0733 1298 2834 4749 3436 2310 3311 4575 4662 3442 3360 3155 2537 1296 2984 2452 0746 1525 2247 3682 2951 3003 1336 2751 .. . RdgVocab Sp.. ListGirlsT 34.ofRdg RdgGenSIg RdgDetalis . AudLetSpan ListVocab ... MatchWds TripletNos FiveLett ... 3. . ..... 2917 2771 2390 3587 2370 3704 5143 4475 1866 2171 6. .. . 31.. .... .. 16.... 24... 4430 4516 4021 3533 0136 0858 1162 2155 2161 10. 6878 6714 6215 5187 2806 2749 3291 3159 2779 3818 2381 2585 2520 2107 3375 1809 2398 3712 2437 1538 3199 1948 0833 3371 12.. 2794 3433 3068 3204 4391 1551 3265 1611 3137 2159 2513 LetterSer 3717 Raven'sPM Reasoning ...... 22. 6439 4542 5537 3758 5677 4940 6241 5905 6113 4560 5542 3466 5468 4503 5491 STEP List . 23. LetterList . 11. 5..... 36. AritfaReas 7. .. 21.. 8. SchRdg SchComp . HapSpeech HiGroup SentComp Conseq . Listlnfer 30. MemWds VisLetSpan . WdNumber . 6145 2791 14. WdSquares .

(Decimal points omitted) .APPENDIX C TABLE CI (Continued) Intercorrelations of 37 variables for 161 boys (Below Diagonal) 115 and for 139 girls (Above Diagonal).

(Decimal points omitted) .116 LISTENING COMPREHENSION A FACTORIAL ANALYSIS TABLE Cl (Continued) Intercorrelations of 37 variables for 161 boys (Below Diagonal) and for 139 girls (Above Diagonal).

26. . 8. ListGirlsT 34.. LetterList .. . 3330 4647 1484 2056 2433 2352 4920 5422 4508 4441 4419 3406 4869 3463 3775 1929 1360 0775 0398 0837 0380 3016 3116 1905 4388 2534 4402 1502 1253 2917 3403 5444 5398 5611 33. Listlnfer 30......... ListShTalk 31.. Five Lett RapidSpell Singing .APPENDIX C TABLE Cl (Continued) Intercorrelations of 37 variables for 16! boys (Below Diagonal) 139 girls (Above Diagonal).. .. 2522 3763 0907 1304 1082 0421 0561 .. 2939 3696 5693 3194 4295 6300 4925 5942 4703 5290 3740 1249 1794 7. 20. 4673 3034 4771 2660 2913 2728 3320 3593 1733 3292 4934 4357 4553 4542 2937 Rdglnfer ...... 14. 13.. 9. .... 27.. 37.. . 0292 2336 2712 3361 0179 2767 2049 2299 1007 2188 15.. .. . 4.. SentComp Conseq .. 1430 ... ListDetails ... ListSponSp ListBoysT .of Rdg RdgGenSig RdgDetails . . 4848 4309 4199 4846 5109 4001 3844 3122 1540 2531 2935 1508 2387 STEP List . SchComp ^ 5820 3658 3526 3010 2606 5313 5476 2482 0792 0486 3526 2897 4107 4283 3144 2998 2793 2674 2584 3252 3822 4805 4978 2500 0839 0886 1828 2066 3550 3333 2170 1535 1419 1427 1569 2014 3496 4567 5415 . 11... 3.. 19. .. RdgVocab Sp. . 2246 2903 3373 2390 2542 3287 2881 4536 5156 1579 5078 4934 3951 2325 4312 1342 2871 Raven'sPM Reasoning . 2545 3481 4260 2602 3279 4873 5784 4520 2730 1574 2213 3964 3743 3952 3411 WdSquares ArithReas .... 28.. .... 18.. 17. 16. WdNumbers 23... 32. 6. 36. 4424 2808 3004 -0258 4173 1833 HapSpeech IllGroup ... AudLetSpan ListVocab ListGenSig . MatchWds TripletNos . 5. 3543 2333 3261 0449 0303 1000 0592 3756 3256 .. 21. . 10. SchRdg . 33 34 35 1945 36 37 LetterGroup LetterSer . MemWds VisLetSpan . 35.. 29... SchArith . 24. 117 and for (Decimal points omitted) Test 1. 22. 2.. 25.. 12.

(Decimal points omitted) Factor .118 LISTENING COMPREHENSION A FACTORIAL ANALYSIS TABLE C2 Principal Axis Factor Matrix (F) for 161 Boys.

. 475 688 847 634 767 626 711 11.. .. 3. 703-207-030-135-229 -306 -104 -222 -328 -198 -204 007 -001 -076 -155 037 -279 -061 003 029 -087 229 -188 -019 190 -116 -017 -025 -021 . WdSquar ArithRe 6... 14.. 17.. Lis MemWds . 12. HapSpch IllGrp . 16.No. . 222 512 498 762 717 606 569 549 545 645 721 248 -116 541 -183 428 -236 016 -206 148 -310 356 -182 -081 024 -060 036 -144 057 -058 -158 -115 -125 177 -083 313 -247 302 -179 269 -239 154 444 -024 228 135 354 205 364 -220 061 -203 -045 -219 -165 -221 -060 297 480 216 553 -194 102 -190 -003 034 19S 138 024 -012 036 098 -120 -135 132 190 048 068 -253 -159 -140 012 -114 -107 080 -069 -360 193 234 -179 139-111 -292 144 069 -168 -060 089 -125 050 081 058 -063 142 078 146 061 326 041 -073 253 -095 283 077 -174 -132 168 -271 182 044 027 049 362 316 -152 163 126 -161 224 273 257 416 109 160 003 142 -205 -021 092 -050 -126 -017 038 -121 -036 001 -210 118 154 -210 -053 -035 074 -004 -175 049 -116 028 282 069 300 -053 099 024 -172 054 -001 -076 -099 120 -066 042 -042 149 040 140 088 068 092 030 112 025 -151 -016 -085 -076 -010 258 -217 005 109 -223 -032 -101 081 197 123 140 061 -186 -077 058 150 062 041 -O54 Oil 141 -049 025 105 211 -003 -091 160 -150 027 029 082 -217 067 095 025 -126 -053 015 -206 -105 218 061 453 678 671 367 480 6% 769 662 698 567 688 496 285 414 449 628 368 490 536 500 566 354 348 668 646 671 ... LisGenS 28.APPENDIX C TABLE C3 Principal Axis Factor Matrix (F) for 139 Girls.. . 7.. 18. 5 55 IV V VI VII VIII IX X fa^ LetGroup LetSer ... 23.... LisS Sp 32. 9. . 5... SenCom Conseq .. 33.. Lislnf 30... 24.. (Decimal points omitted) 119 Factor I !.. BT .. 22. LetList ... 20.. 439 583 303 2. -002 -010 -243 014 -105 037 -141 055 -151 041 000 -022 -046 121 -097 -089 015 -178 -083 -043 154 -064 -081 -133 045-107-153 113 059 046 014 036 063 317 202 -129 -126 086 -220 -161 277 021 -124 -150 -073 -191 033 049 -064 -048 -016 055 071 -009 -072 059 167 113 -018 618 662 575 567 4% 549 516 612 .. AudSpan 26. Lis 34.. 15... 13. STEP Lis GT . MatWds TripNos FiveL RapSpl Singing . Lis ST 31. Raven'sPM 585 Reasoning 4. . 600 134 460 419 481 445 403 538 418 591 169 Wd.. 21. 8.. . . LisDet 29. 10. VisSpan 25.... . LisVoc 27. 19. RdgVoc SpRdg RdgGenS RdgDet Rdglnf ..

120 LISTENING COMPREHENSION' A FACTORIAL ANALYSIS TABLE C4 Oblique Transformation Matrix (Decimal points omitted) A for 8 factor biquartlmin solution for boys. (Decimal points omitted) . TABLE C5 Oblique Transformation Matrix A for graphical solution for boys.

.

(Decimal points omitted) V .122 LISTENING COMPREHENSION- A FACTORIAL ANALYSIS TABLE C7 Rotated Oblique Factor Matrix for 9 factor biquartirain solution for boys.

.

(Diagonal and above) Cosines of Angles between Reference Vectors: Matrix A'A (Diagonal and below) Correlations between Primary Factors: Matrix Rw (Decimal points omitted) Factor . (Diagonal and above) Cosines of Angles between Reference Vectors: Matrix A*A (Diagonal and below) Correlations between Primary Factors: Matrix RINJ (Decimal points omitted) Factor TABLE CIO Graphical solution for Boys.124 LISTENING COMPREHENSION A FACTORIAL ANALYSIS TABLE C9 S Factor Biquartimln solution for Boys.

.

126 LISTENING COMPREHENSION A FACTORIAL ANALYSIS TABLE C13 Rotated Oblique Factor Matrix V for 8 factor biquaitimin solution for girls. (Decimal points omitted) .

(Decimal points omitted) Factor 127 V .APPENDIX C TABLE C14 Rotated Oblique Factor Matrix for 9 factor biquartimin solution for girls.

128 LISTENING COMPREHENSION' A FACTORIAL ANALYSIS TABLE CIS Rotated Oblique Factor Matrix V for graphical solution for girls. (Decimal points omitted) Factor .

(Diagonal and above) Cosines of Angles between Reference Vectors: Matrix A'A (Diagonal and below) Correlations between Primary Factors: Matrix Rp (Decimal points omitted) Factor . (Diagonal and above) Cosines of Angles between Reference Vectors (A' A) (Diagonal and below) Correlations between Primary Factors: Matrix R M (Decimal points omitted) Factor . TABLE C17 Graphical solution for Girls.APPENDIX C TABLE C16 129 9 Factor Biquartimln solution for Girls.

130 LISTENING COMPREHENSION A FACTORIAL ANALYSIS APPENDIX D RELIABILITY COEFFICIENTS .

factor analysis is of great assistance in the development of test batteries. division. when the number of tests is large. Common observation indicates that people differ greatly in their performance tasks. each person's performance could be adequately described by a number score and a verbal score. and has been used extensively in studying relationships between different kinds of mental tasks. it attempts to explain the correlations between a number of variables in terms of a smaller number of variables or dimensions or explanatory constructs. If this were so. that the correlations between six tests. some can spell better than on such others. vocabulary and reading comprehension can be accounted for by two basic variables or constructs. some have a much better memory than others. and thus for describing the ways in which people differ in their mental behaviour. It might demonstrate. it is relatively easy to interpret the relationships (usually expressed in the form of correlation co-efficients) between tiie various tests or groups of tests. subtraction. multiplication. Such performances. instead of the original six scores. which might be taken to represent computational ability and verbal ability. some know many more words than others. easily grasped It is the aim of factor analysis to describe the relationships between variables in as economical or parsimonious a manner as possible. for instance. When only three or four tests developing appropriate are involved. It shows how a wide range of mental abilities can be tested economically by a few relatively "pure" tests of those abilities. By indicating whether tests are measuring much the same ability or different abilities. it is virtually impossible to interpret the mass of inter- relationships as presented in a table or matrix of correlation coefficients. and how duplication of measurement and thus of testing time and effort can be avoided. can be measured by tests. and many others. and the relationships between these can be established by correlating the results of perperformances sons on the various pairs of tests.APPENDIX E THE TECHNIQUE OF FACTOR ANALYSIS FACTOR analysis Is a technique for studying the interrelationships between variables. such as addition. 131 . Factor analysis seeks to establish a simpler and more framework for expressing the complex of interrelationships among such tests.

where the aim has been to identify and describe the fundamental variables underlying mental behaviour. which are used as bases for investigating newly hypothesized factors. In the 1930*$. and the correlations between the tests were analysed to determine whether they could be adequately accounted for by a smaller number of underlying variables. From the results of numerous factor studies. ability in numerical tasks. material presented in auditory or visual form. for example. factor analysis has been employed in more detailed investigations of these broad areas of behaviour. and so on. the need for the new factor and its place in the overall pattern of mental abilities can be systematically investigated by applying tests designed to measure this factor along with tests selected to measure standard "reference factors. When a new factor is proposed to account for a particular kind of mental task. izing pairs meaningful material. a comprehensive picture of the main types of mental activity has been developed. Within the field of memory. When the broad outlines of a field have been established in this way." and factor analysing the resulting table of inter-correlations. for example. where little is known about the basic variables or the structure of their relationships. for example. hypotheses have been developed about the different types of memorizing that people are called upon to undertake memorof unrelated words. Tests have been constructed to measure these hypothesized abilities. It Is a useful technique for exploratory studies of a new field. such as ability to comprehend verbal relations. It was found that most of the variation among the tests could be described in terms of a few broad variables. or whether they needed further refinement. large batteries of tests of quite different mental tasks were assembled and applied to large groups of students. It migjit be asked. sequences of letters or digits. Well established factors (known as "reference factors") have been incorporated into systematic frameworks.132 LISTENING COMPREHENSION A FACTORIAL ANALYSIS Factor analysis has been most fruitfully employed as an experimental technique la the psychological investigation of individual differences in abilities and personality. ability to think spatially. ticular and the correlations between the tests for a parof persons have been factor analyzed to determine group whether the hypotheses could be confirmed. whether the variation in the performance of people on tests of listening comprehension could be adequately described in terms of known . memory ability and so on. in an attempt to identify the basic types of thinking or behaving which occur in these fields.

Thurstone and his . the original cor- n tests can be represented by the angular n test vectors emanating from an origin into m-dimensional space. In conformity with their theories about the nature of mental activity. Various procedures are used to determine or "extract" the which will account for a given correlation (or covariance) matrix. In all of these methods. which is that portion of its self-correlation which is associated with other tests in the battery. and are actually only one of many possible sets of factors which will account for the original correlations. it is necessary to estimate the "communality" of each test. British psychologists have tended to follow methods which involve.APPENDIX E sources of variation reference factors 133 or whether It was neces- sary to postulate a listening factor or listening ability to account for this variation. From a geometrical point of view. the ultimate aim being to determine a new set of factors which will successively account for as much of the variation in test scores as possible. In this way. The factors extracted by any of the above methods are un- related to or independent of each other. where m is the minimum number of dimenrelations among the separations between sions required to account for the original correlations. developed largely by Thurstone. However. the factors represent one of many possible sets of reference axes against which these vectors can be interpreted. and as the addition of new tests to the battery is likely to alter their position appreciably. This is achieved with the aid of mathematical techniques such as centroid analysis. The projections of the test vectors on each of the new axes give the "loadings" of each test on the new factors. makes no initial assumption about the need for a general factor but seeks to determine the minimum number of factors indicated by the correlations. new factors can be verified and abilities incorporated into the existing framework. the extraction of a general factor in which all tests in a battery are represented. as a first step. as the new axes merely provide an arbitrary frame of reference. and which will together account almost completely for the original correlations except for minor discrepancies or small "residual" amounts. multiple-group analysis or principal axes factor analysis. The American approach to factor analysis. and then the identification of factors group factors corresponding to sub-groupings of similar tests. and the picture of mental extended. which are used to "factorize" the correlation matrix.

however. as they consider that explanatory constructs like height and weight. whereby certain functions of the factor loadings are maximized or minimized to yield a precise solution. for instance. the factors themselves are correlated. This requires that axes be placed through clusters of test points so that each test will have significant loadings on only factors. Such factors are described as "orthogonal. Although still commonly employed." as they are represented by axes which are at right angles with each other. and some success has been achieved in recent years with "analytic" methods of rotation. Thurstone's criterion of "simple structure. But regardless of the method used to locate the new axes. and allows the pattern of test points to determine whether the final factors are orthogonal or oblique. this approach has the dis- The may advantage of requiring decisions of a subjective nature." which was developed from the assumption that in every intellectual task there are some mental functions that are not involved. and the correlations among these primary factors can be analyzed to yield more comprehensive second-order factors. do not insist on independent factors.134 LISTENING COMPREHENSION' A FACTORIAL ANALYSIS factors followers claim that they must be rotated to a position which yields which are "psychologically meaningful. and noting which tests cluster together. do not have to be completely independent of each other to be useful concepts. they therefore allow for the possibility of correlated or "oblique" factors. has proved to be a useful guide in rotating axes to positions which have psychological meaning. and some investigators prefer that the rotated factors to which they give a psychological interpretation should also be unrelated or independent. It has been customary to determine new positions for the axes by inspecting plots of the pattern of test points for each pair of axes. The end result of the process of factorizing a and rotating the obtained factors is correlation matrix to provide a table which shows . If they are oblique. and so that each factor will include a good number of tests with near zero loadings. Other factor analysts." rotation of axes in this search for psychological meaning take several forms. an important question about the relationship between the finally accepted factors has to be faced. represented by axes which are not at right angles to each other. The factors are unrelated before rotation. The application of this principle shows whether a psychologically acceptable solution one or two of this form can be attained.

Among the better known of the established factors are (verbal comprehension). I (induc- (verbal educational) comprising both v (verbal) abilities. but mathematical constructs which describe and classify types of mental behaviour. a practical spatial mechanical factor. the extent to which represented in each of the factors identified. v:ed M Vz (spatial visualization). They are thus ing or schooling.. The psychological interpretation of each factor is undertaken by noting which tests have high loadings on the factor and which have zero or negligible loadings. and n (number) and k:m. the main factors (memory) and isolated in British studies have been g (general ability).APPENDIX E the loading of each test test is 135 on each factor. (word fluency). . influenced by and susceptible to the effects of trainThe absence of a spelling factor in a primitive community would cause no concern.e. W N D (deduction). i. tion). (facility in manipulating each V numbers). The tive factors identified in factor analytic studies are not distinc- mental faculties or entities in the mind. the presence of such a factor among teachers' college students in a civilized community would call for individual differences remedial instruction in spelling to reduce the range of and thus the effect of the factor.

A F = 4. : R 3. Terms 1.APPENDIX F GLOSSARY OF TECHNICAL TERMS A.g. For example: . Matrix Multiplication Under certain conditions. two matrices may be multiplied to give a product matrix. usually represented in matrix notation by a single letter. Correlation Matrix is A correlation matrix a square symmetric matrix in which the cell entries consist of the correlation co-efficients between the various pairs of tests. 2. thus: A A = 5 3 8 6 7 1 A matrix has no specific arithmetical value. Factor Matrix factor matrix is usually a rectangular matrix consisting of the loadings of each test in a battery on each of the factors extracted. associated with matrices and matrix notation Matrix matrix is a rectangular or square arrangement of numbers in a table. e.

The transpose of matrix above is denoted as A'. and summing the products. Matrix Equation This is matrices. Inverse inverse of a matrix is a second matrix. = 1.4 Transpose The transpose of a matrix is formed by writing the rows of the matrix as columns of the new matrix. etc.. gives a matrix with unities in the diagonal cells and zeros elsewhere. A matrix has to be square and non-singular (i. which when mulby the original matrix. (5 x 2) (4 x 2) (4 x 4) + = + = 26. 5. Thus: tiplied The This relationship is analogous to the reciprocal relationship in ordinary algebra.B B A. a x a. = + Diagonal Matrix A and zeros elsewhere matrix with non-zero entries in the principal diagonal is called a diagonal matrix. (5 x 3) 23. A' A 795 538 469 6 7 1 8.g. with a determinant not equal to zero) in order to have an inverse.e. such as 6.APPENDIX F 137 The elements tiplying in turn in the product matrix C are obtained by muleach element of each row of matrix by each A element of each column of matrix B. cells D 7. A ~f. an equation which expresses a relationship between AB C. = | 3 1 . . etc.. For example. e.

. Thus the br) can be represented as expression (as A sum A determinant differs from a matrix in that it is always a square arrangement of numbers with a definite numerical value. the matrix has only one-third order determinant. For example. of rows and columns of the matrix. Elimination of the third row and third column of the third order determinant . and one of the problems in factor analysis is to determine this rank. 234 432 333 234 432 333 which has a value of zero and thus vanishes. Order The order of a matrix or of a determinant indicates the number matrix consisting of three rows and two columns of numbers would be of order 3x2. elimination of the first and third first the one-rowed or 12. 11.138 9. LISTENING COMPREHENSION A FACTORIAL ANALYSIS Determinant determinant Is a special form of notation used to denote a of product terms. | | Rank of a Matrix The rank of a matrix is the order of the highest non-vanishing minor or determinant. 10. namely. rows and the first and second columns gives order minor y . A Minor Minors of a determinant are obtained by eliminating various rows and columns of the determinant. with alternating algebraic signs.

Often the highest correlation obtained between each test and other tests in the battery is used as a first approximation. The communality of a test can be computed from an orthogonal factor matrix by squaring the loading of the test on each factor and summing these 2. The first or * Methods of evaluating determinants are described in Thurstone's (Thurstone. The true rank of a correlation matrix based on experimental data is usually equal to the number of variables. of the two-rowed or second-order minors vanish. this determinant Is 139 expressed as 2x3x3 None 2x3x2 + 4x3x4 4x3x3 3x3x2 3x3x4 = 0). Terms associated with the factorization of matrices Communaltties The communality of a test is that part of its variance which it has in common with other tests in a test battery. Principal squares. is and the rank of the matrix thus 2. 1. Axes Reference axes located through a scattergram or swarm of points in a multivariate score distribution or through a pattern of test vectors so as to maximize the sum of the squared score or test projections on these axes are known as principal axes. the numerical value of the communality is unknown and has to be estimated for each test. . is 2 4 4 2 = -12. can be accounted for in terms of two independent variables. and which is described as its common factor variance..* 3 3 + e. It is usually represented 2 by the symbol h The remaining portion of a test's variance. text . and represents abilities and errors of test only (specific variance) measurement (error variance). 1947). this taken to indicate that the inter-relationships among the numbers in the matrix (usually correlation co-efficients). 2 4 t= -6. is that unique to the particular test. In experimental problems. B.APPENDIX F (In expanded form. (1 involved in h 2 ).g. but factor analysis seeks to determine some smaller rank which will account for the correlations to a very close approximation. In factor analysis.

246 . They are determined algebraically by setting up a specific equation (known as the characteristic equation) for the particular matrix and finding the set of values which satisfy this equation. .906 . 4.729. are orthogonal (at right angles) to each other. The direction cosines of the first principal axis in the above example (represented by the eigenvalue of 1.072 .809 and .379.729 -.638. They represent the variance of the original test standard scores (when considered as points in a space of as many dimensions as there are tests) along the principal axes.259. and each subsequent principal axis maximizes the sum of squares of that part of the score or test configuration not accounted for by the principal axes already located.650 are 1.140 LISTENING COMPREHENSION A FACTORIAL ANALYSIS major principal axis maximizes the sum of squares of these projections for the original data. or the amount of common factor variance (or total test variance in some cases) which can be attributed to each principal axis.309 . Eigenvalues The latent roots or characteristic roots. .379) to the original test vectors are . which enables the angles between the principal axis and each of the original test vectors to be determined.438 . and the factors which they represent. Eigenvectors The specified direction of a principal axis identified by an eigenvalue is by a corresponding eigenvector (or latent or characteristic vector) of the direction cosines for that axis. roots of a characteristic equation are called eigenvalues.379 .259 When the test sum of the eigenvalues communalities are inserted in correlation matrices. the first eigenvector is thus .309 .438 .891 -.246 respectively. and -.072 -. 3.809 .638 . The principal axes. The eigenvalues of the matrix . is equal to the total common factor variance. or in matrix form 1.

The projections of test vectors on these reference axes (in other words. Orthogonal rotation rotation of the arbitrary orthogonal reference axes to a new position which does not involve any alteration in the angular separation of these axes is known as an orthogonal rotation or trans- A formation. In the above example. Residual Correlation Matrix This matrix indicates the amount of correlation between tests which has not been accounted for by the factors that have been extracted. The extraction of factors is usually continued until the residual correlations are zero or near-zero. Terms associated with the rotation of factors Unrotated orthogonal reference frame The unrotated orthogonal reference frame refers to the arbitrary set of reference axes resulting from the application of a centroid or principal axis or other type of analysis to the original correlation matrix. Principal 141 Axis Factor Loadings Principal axis factor loadings are the projections of the test vectors on the principal axes. (or the correlations between the test vectors and the principal axes). 2. These reference axes are at right angles to each other. 6. or uncorrelated. Oblique rotation A rotation of the position in arbitrary orthogonal reference axes to a new angles is which the reference axes are not necessarily at right known as an oblique rotation or transformation of the . Reference axes (and thus factors) are orthogonal in both the original and the new axis system.856 and -. after the latter have been adjusted to take account of their different variances.APPENDIX F 5. These factor loadings are determined by multiplying the direction cosines in each eigenvector by the square root of the corresponding eigenvalue. and thus the corresponding factors are orthogonal. 3. all of C 1. the factor loadings of the three tests on the first principal axis are .750. . independent. 1379. the factor loadings of the tests) form what is often referred to as the unrotated orthogonal factor matrix (usually designated as F). viz. The sum of squares of these factor loadings is equivalent to the first eigenvalue.289.

Graphical methods of rotation In graphical methods of rotation. or negligibly negative. or it may not be possible to 6. Post-multiplication of an unrotated arbitrary orthogonal factor matrix^ (F) by a transformation matrix (A) gives a rotated factor matrix (V) of factor loadings or test projections A on the new axes. there be tests with zero loadings in one column ings in both columns. and only a small number of tests with appreciable loadings in both columns. The criteria for simple structure In a factor matrix are that there be at least one zero (or near-zero) column should contain as loading for each test. an oblique factor matrix. several but not in the other. the correlations between the may be non-zero. the new positions of the axes are located by inspection of the configuration of test points when these are plotted in relation to the arbitrary orthogonal co-ordinate reference axes. all mental functions are inis developed from the idea that not volved in every intellectual task. Simple Structure This concept was introduced by Thurstone as a guide in rotatframe to a unique position ing the arbitrary orthogonal reference It In which factors would have acceptable psychological meaning. These methods usually employ two-dimensional configurations. Positive attain simple structure at all. 1. Transformation matrix transformation matrix (usually designated as A) is a matrix of direction cosines indicating the direction of each axis in the new system in relation to each axis in the old system. Such a solution is often achieved in the field of mental abilities as these are mostly positively correlated. it may prove possible to rotate the matrix to axes are still at orthogonal simple structure (in which the new to each other) or to oblique simple structure (in which right angles the new axes are not at right angles to each other). 5.142 LISTENING COMPREHENSION A FACTORIAL ANALYSIS axes. manifold This refers to a particular form of simple structure solution in which all factor loadings are positive or zero. that each factor of many zero loadings as there are factors. In factors 4. . For a given unrotated orthogonal factor matrix. and that in every pair a good proportion of tests with zero loadfactor columns.

Biquartimin method of rotation This analytic method of rotation to oblique simple structure minimizes over all factors both the sum of the cross-products and the sum of the covariances of the squared factor loadings. Second-order factors the vectors representing primary factors are not to each other. while the normal varimax method maximizes the same function after the factor loadings have been adjusted to take account of differences in test communalities 9. These procedures are designed to fulfil the conditions set up for a desired type of rotated factor matrix. Each second-order factor would usually subsume a number of primary factors.APPENDIX F 8. The aim of the biquartimin method is to maximize both the number of zero or near-zero entries in the rotated factor matrix and the number of significant factor loadings which occur in only one row and one column of the factor matrix." The quartimax method. for instance. the primary factors are themselves cororthogonal related. usually one which meets the criteria for "simple structure. maximizes the variance of all squared loadings of a factor matrix. the new positions of the axes are determined by objective mathematical procedures. 10. . 143 Analytic methods of rotation In analytic methods of rotation. If the second-order factors were correlated. and the process could be When then be continued to give successively higher-order factors. Psychological interpretations are usually based 11. The matrix of correlations between the primary factors can itself analyzed to determine whether these correlations can be adequately accounted for in terms of one or more second-order factors. the raw varimax method maximizes the within-factor variance of the squared factor loadings for a given factor matrix. third-order factors could be extracted. on these factors. . The normalized biquartimin method minimizes the same function after the factor loadings have been adjusted to take account of differences in test communalities. Primary factors The factors identified in the rotated factor matrix (V) are known as primary or first-order factors.

Listening?" Educational 6. Factor Analysis of Reasoning Tests. "How Teachable Research Bulletin. (1955). "Teaching Aural English. (1953)." School 71. (1953). North Carolina Press. and Fairbanks." Speech Mono- graphs. H. A. (1949). 9-13. J. 215-224. K. "Needed Research in Listening. "Evaluating Student Performance in Listening. 3. 3. Australian 5. Yonkers. A. "An Experimental Study of the Effect of Four Speech Variables on Listener Comprehension. (1952). J." Journal of Educational Research. 3. 0. "An Experiment in the Measurement of Listening at the College Level. 23. 139446.C. I. Grades 9-13. I. J. P. 249-258. Blewett. Ainsworth. 19. 575-585. J. Anderson. Univ. T. C. Chapel Hill. 164-172. 31. Anderson. 127-130. 1. 8." Journal of Communication. Melbourne: A. 18. 316-322. 4. D. I. (1956).: World Book Co. 33. K. R. S." Journal of Experimental Education. N. B. (1952)." English Journal. I. D." Journal of Communication. N. "The Construction of a Diagnostic Test of Listening Comprehension.Y." Speech Monographs. (1951). is and Society." Elementary English. Diagnostic Test of Listening Effectiveness. Reading 6. "Construction. Brown. 128-136. 2. (1954). (1954). Brown. I." Journal of Educational Research. D. and Lyerly. 44. S.. 4. 144 . E. 85-93. (1937). T. 75. C. 9.E. 5. Brown. Beighley. "Teaching Listening Comprehension. 317-324. Biggs. (1950). Council for Educational Research (1950). 7. 30. G. and High. "Interrelationships between Listening and Other Language Arts Areas. 39. C. (1950). 7. Validation and Evaluation of a Beighley. Bird. 29. (1954). 69-71. 49 84-86. Brown. H. J." Education. Brown. Evaluation and Adjustment Series. C. (1952).BIBLIOGRAPHY L 2. 248-253." Speech Monographs. and Carlsen. (1954). Form C. Beery. "Common and Differential Factors in Reading Vocabulary and Hearing Vocabulary. Brown. Brown-Carlsen Listening Comprehension Test." Elementary English. Adkins. 21. 'The Measurement of Listening Ability.C. I. Manual for Tests. B.R. "An Experimental Study of the Effect of Three Speech Variables on Listener Comprehension. G. "Auditory Functions and Abilities in Good and Poor Listeners.

1956. 6. Memorandum from Communications Section. W. B. 25. Caffrey.J. M. Further Notes on Analytic Simple Structure (Mimeographed. (!955a). N. and Schweiker. Test Development Department for members of the Workshop (Roneo'd. "Auding. Carroll." Roneo'd statement subAnalysis mitted to Conference of American Psychological Association. K. 4. (1955). 24. Princeton. Carroll. 23-38." Journal of Educational Psychology 25. (1955b). "Audiog Education. Dwyer. Educational Testing Service (Co-operative Test Division) (1956). (1953). B. 10-12." Review of Educational Research. 1952: Dissertation Abstracts. 279-308. Cartier. "Prestige Suggestion Influences in Communication Analysis. W. 32. 173-179. 22. (1934). 16.* Speech 28. 53-57. J." 23. and Smith.'* Psychometrika. J. "The Development of Listening Comprehension Tests for Michigan State College Freshmen.) (1959). Learning from Readings.J. C.** Psychometrika. 18. 145 Euros. (1935). 26. 35. A. 0. Coyne. 13-14. L B." Review of Educational Research. of Verbal Abilities." Science. "An Analytic Solution for Approximating Simple Structure in Factor Analysis. P. Erickson. "The Determination of the Factor Loadings of a Given Test from the Known Factor Loadings of Other Tests. A. Caffrey. 75. Human 5 Interest. 21.) 25. Ability at the Secondary Level" 20. Carroll. G. 27.) 34. (Ed. Caffrey. "Can listening Efficiency be Improved?" Journal of Communication. 128-133. in 21. 19." Abstract of doctor's thesis presented to Stanford University.) The Psychology of Radio. (1956). J. H953). on Co-operative Listening Comprehension Tests. New York: Harper. W. M. Corey. Carver. 459-470. . (1941). J. Carroll. "Factor Analysis Research. Dissertation Abstracts. G. (1954). (1937). T. 1955. J. J. (1956). (1956). "Learning from Lectures vs. Solutions. R. 2. J. Chapter IX in (Editors. Sequential Tests of Educational Progress: Listening. B. Grades 4-6. 31. (1951).: The Gryphon Press. 303-310. Fifth Mental Measurements Yearbook.BIBLIOGRAPHY 18. 30. Some 22. F. 1114-1115. Educational Testing Service (1955). "A Factor Psychometrika. 29. (1957). Highland Park. 121-138. 126. "Biquartimin Criterion for Rotation to Oblique Simple Structure in Factor Analysis. 13. E. "Preliminary Identification of Factors in the Davis-Eells Games. Educational 368-388. S. and Allport. N. Cantril. Dow. F. 33. F. Carroll. M.: Educational Testing Service. 268-269. "Listenability and Monographs. H. B." Abstract of doctor's thesis presented to Michigan State College. 7-9. I.

61. 44. 7. Harwood. "An Experimental Study of the Rate upon Listenabillty. ton. 2. N. "A Factorial Study of Auditory Function. . Kelley. "Listenability and Rate of Presentation. 56. Princeton. 22. 477-482. (1954). Irvin. K.. 50. C. (1955b). K." Audio-Visual Communication Review." The School Review. A." Elementary School Journal. (1956). W. "The Description of Aptitude and Achievement Terms of Rotated Factors. E. Manual for Kit of Selected Tests for Reference Aptitude and Achievement Factors. Effects of Speaking 24. H. E. H. S. (1955). (1957). NX: "A Factor Analysis of Memory Ability. 20. 141-151. (1954). Goodman-Malamuth." Psychometric Monographs. 1955. 2.* Journal of Speech and Hearing Disorders. J. 15. W." Journal of Educational Psychology. "Comparison of Listening and Reading Comprehension Ability of Fourth and Sixth Grade Pupils. 22. (1959)." PrinceEducational Testing Service Research Bulletin 54-7. G. 22. No. 52. A. K." Educational and Psychological Measurement. Case of Terminological Furness. "Listening Comprehension at the Intermediate Grade Level. "Factorial Analysis of Speech Perception." Journal of Speech and Hearing Disorders. 299-302. (1954). "An Analysis of Certain Aspects of a Listening Training Program Among College Freshmen at Michigan State College. J. LISTENING COMPREHENSION A FACTORIAL ANALYSIS Fairbanks. A. 89-90. L." Journal of Communication. J. Tests in (1951). 48. 1757." Journal of Educational Research. G.J. R. (1953). Hanley. (1960). E. "Listenability and Readability. Karlin. 51. E. 49. French. 46. II (1957). N. Monographs. F. 76-87. No. 25-29. 40. P. Kaiser. C." Speech 47. 5. A. 39. and Mlroit. 43. 37. Goyer. "A Comparison of Listening Tests with Standardized Tests. Irvin. A Con- 41. Guttman. Psychology and 38. M. "Effects of 1 Time Compression upon the Comprehension of Connected Speech. (1942). I. No. N. French. 10-19. (1959). 21. Harwood. 52. New York: McGraw Hill Book Co. 251-279. C.) (1954). 53. "The Application of Electronic Computers to Factor Analysis. Haberland. (1955a).: Educational Testing Service. "Oral Communication: Studies in Listening. "Listening: fusion." Speech Monographs. Dissertation Abstracts." Speech Monographs. 45. 4. S. 57-59." Abstract of doctor's thesis presented to Indiana University. (1957). 48. Hampleman.." Psychometrika. Hollow. (1955). (Ed. S.146 36. R. 158-161. M. 4. Ferguson. 42. Statistical Analysts in Education. "Evaluating a Training Program in Listening for College Freshmen. L. 49-53.

BIBLIOGRAPHY
54.

147

King, W. H. (1959). "An Experimental Investigation into the Relative Merits of Listening and Reading Comprehension for Boys and Girls of Primary School Age." British Journal of Educational
Psychology, 29, 42-49.

55.

Knower, F. H.,

Phillips, D. and Koeppel, F. (1945). ''Studies in Listening to Informative Speaking,'" Journal of Abnormal and Social Psychology, 40, 82-88.

56.

Kramar, E. J. J. (1955). "The Relationships of the Wechsler-Bellewe and A.C.E. Intelligence Tests with Performance Scores in Speaking and the Brown-Carlsen Listening Comprehension Test." Abstract
of doctor's thesis presented to Florida State University, Dissertation Abstracts, 15, 2599.
1955;

57.

Larsen, R. P, and Feder, D. D. (1940). "Common and Differential Factors in Reading and Hearing Comprehension." Journal of Educational Psychology, 31, 241-252.

58.
59.

Lewis, N. B. (1956). "Listen, Please!" Clearing House, 30, 535-536. Lewis, T. R. (1958). "Listening." Review of Educational Research,
28, 89-95.

60.

lindquist, E. F.

(1959). Reviews of Brown-Carlsen Listening Comprehension Test and STEP Listening Comprehension Test in Fifth Mental Measurements Yearbook (Ed, Buros). Highland Park, N.J.: The Gryphon Press.

61.

62.

Loder, J. E. (1937). "A Study of Aural Learning With or Without the Speaker Present." Journal of Experimental Education, 6, 47-60. McClendon, P. I. (1957). "An Experimental Study of the Relationship

between the Note-Taking Practices and Listening Comprehension of College Freshmen During Expository Lectures." Speech Monographs, 24, 95-96. 63. Mosier, C. I. (1938). "A Note on Dwyer: The Determination of the Factor Loadings of a Given Test." Psychometrika, 3, 297-299.
64.

Nelson, H. E. (1953). "Pictorial and Verbal Elements of Educational Films." Journal of Communication, 3, 43-47.
Nichols, R. G. (1948), "Factors in Listening Comprehension." Speech Monographs, 15, 154-163. Nichols, R. G. (1949). "Teaching of Listening." Journal, 30, 273-278.

65.

66.

Chicago Schools

67.

Nichols, R. G. (1955). "Ten Components of Effective listening." Education, 75, 292-303.
Nichols, R. G. and Stevens, L. A. (1957).

68.

Are You Listening?

New

York:
69.

McGraw

Hill

Book Co.

Odom,

C. L. and Miles, R. W. (1951). "Oral versus Visual Presentation of True-False Achievement Tests in the First Course of

Psychology." Educational and Psychological Measurement, 470-477.
70.
Pratt,

11,

E. (1956).

Improvement
315-320.

"Experimental Evaluation of a Program for the of Listening." Elementary School Journal, 56,

148
71.

LISTENING COMPREHENSION

A FACTORIAL ANALYSIS

Paulson, S. F. (1952). "Experimental Study of Spoken Communications: The Effects of Prestige of the Speaker and Acknowledgment of Opposing Arguments on Audience Retention and Shift of Opinion." Abstract of doctor's thesis presented to University of Minnesota, 1952: Dissertation Abstracts, 13, 27Q-27L

72.

Rankin, P. T. (1926). "The Measurement of the Ability to Understand Spoken Language." Abstract of doctor's thesis presented to University of Michigan, 1926: Dissertation Abstracts, 12, 847-848. 73. Rankin, P. T. (1930). "listening Ability: Its Importance, Measurement and Development." Chicago Schools Journal, 12, 177-179.
74.

Relchard, S. (1944). "Mental Organization and of Psychology, No. 295.

Age

Level." Archives

75.

Richards, T. W. (1941). "Genetic Emergence of Factor Specificity." Psychometrika, 6 37-42.

76.

Rulon, P. J. et al. (1943). "A Comparison of Phonographic Recordings with Printed Material in Terms of Knowledge Gained through Their Use Alone." Harvard Educational Review, 13, 63-76.

77.

Schmid,

J.

and Leiman,

J.

M.

(1957). 'The Development of Hier-

archical Factor Solutions." Psychometrika, 22, 53-61.

78.

Scottish Council for Research in Education (1956). Hearing Defects of School Children. London: University of London Press.
Stark,

79.

J. (1957). "An Investigation of the Relationship of the Vocal and Communicative Aspects of Speech Competency with Listening Comprehension." Speech Monographs, 24, 98-99. 80. Still, D. S. (1955). 'The Relationship Between Listening Ability and High School Grades." Abstract of doctor's thesis presented to

University 1761-1762.
81.

of

Pittsburgh,

1955:

Dissertation

Abstracts,

15,

Stodola, Q. and Coffman, W. E. (1959). 'The Effect of Conditions of Administration on Listening Comprehension Test Scores." Personal communication from W. E. Coffman, October 2, 1959.

82.

(1938). "Primary Mental Abilities." Psychometric Monographs, No. 1. 83. Thurstone, L. L. and Thurstone, T. G. (1941). "Factorial Studies of Intelligence." Psychometric Monographs, No. 2. 84. Thurstone, L. L. (1947). Multiple Factor Analysis. Chicago: University of Chicago Press.

Thurstone, L. L.

85.

Vernon, P. E. (1950). Investigations of the

Intelligibility of Educational Broadcasts. British Association for the Advancement of Science, 1950. As quoted by F. A. Cartier in "Listenability and Human Interest." Speech Monographs, 22, 53-57.

86.

Vernon, P. E. (1950). The Structure of Methuen.

Human

Abilities.

London:

87.

Vernon, M. D. (1953). "Perception and Understanding of Instructional Television Programmes." British Journal of Psychology, 44,
116-126.

BIBLIOGRAPHY
$8.

149

Westover, F. L. (1958). "A Comparison of Listening and Reading as a Means of Testing." Journal of Educational Research, 52,

No.
89.
Wilt,

1.

M.

E. (1950).
in

a Factor
90.

"A Study of Teacher Awareness of Listening as Elementary Education." Journal of Educational

Research, 43, 626-636.

Wittenbom,

91.

J. R. (1943), "Factorial Equations for Tests of Attention.** Psychometrika, 8, 19-35. Wittenborn, J. R. and Larsen, R. P. (1944). "A Factorial Study of Achievement in College German." Journal of Educational

92.

Psychology, 35, 39-48. Wright, E. L. (1957). 'The Construction of a Test of Listening Comprehension for the Second, Third, and Fourth Grades." Abstract of doctor's thesis presented to Washington University, 1957; Dissertation Abstracts, 17, 2226-2227.