Professional Documents
Culture Documents
PDF Assessing English Language Proficiency in U S K 12 Schools 1St Edition Mikyung Kim Wolf Ebook Full Chapter
PDF Assessing English Language Proficiency in U S K 12 Schools 1St Edition Mikyung Kim Wolf Ebook Full Chapter
https://textbookfull.com/product/english-language-proficiency-
assessments-for-young-learners-1st-edition-mikyung-kim-wolf/
https://textbookfull.com/product/assessing-english-language-
learners-bridges-to-educational-equity-connecting-academic-
language-proficiency-to-student-achievement-margo-gottlieb/
https://textbookfull.com/product/foreign-language-proficiency-in-
higher-education-paula-winke/
https://textbookfull.com/product/ict-in-education-in-global-
context-the-best-practices-in-k-12-schools-1st-edition-jinbao-
zhang/
Handbook on Digital Learning for K 12 Schools 1st
Edition Ann Marcus-Quinn
https://textbookfull.com/product/handbook-on-digital-learning-
for-k-12-schools-1st-edition-ann-marcus-quinn/
https://textbookfull.com/product/english-the-american-way-a-fun-
esl-guide-to-language-culture-in-the-u-s-w-audio-cd-mp3-sheila-
mackechnie-murtha-m-a/
https://textbookfull.com/product/corporal-punishment-in-u-s-
public-schools-legal-precedents-current-practices-and-future-
policy-1st-edition-elizabeth-t-gershoff/
https://textbookfull.com/product/bilingualism-across-the-
lifespan-factors-moderating-language-proficiency-elena-nicoladis/
https://textbookfull.com/product/assessing-english-for-
professional-purposes-1st-edition-ute-knoch-susy-macqueen/
ASSESSING ENGLISH LANGUAGE
PROFICIENCY IN U.S. K–12
SCHOOLS
Mikyung Kim Wolf is Senior Research Scientist at the Center for English
Language Learning and Assessment Research at Educational Testing Service.
Innovations in Language Learning and Assessment at ETS
Series Editors: John M. Norris, Sara Cushing, Steven John Ross, and Xiaoming Xi
The goal of the Innovations in Language Learning and Assessment at ETS series is to
publish books that document the development and validation of language assess-
ments and that explore broader innovations related to language teaching and
learning. Compiled by leading researchers, then reviewed by the series editorial
board, volumes in the series provide cutting-edge research and development
related to language learning and assessment in a format that is easily accessible to
language teachers and applied linguists as well as testing professionals and measure-
ment specialists.
Typeset in Bembo
by Integra Software Services Pvt. Ltd.
CONTENTS
Introduction 1
SECTION I
Contexts and Fundamental Considerations in the
Development of K–12 ELP Assessments 17
SECTION II
Empirical Research and Practical Considerations on
the Development of K–12 ELP Assessments 93
SECTION III
Some Future Considerations in K–12 ELP Assessment 205
that accurately identify English learners, track their progress, and help determine
when they are likely to be able to succeed in mainstream English-medium class-
rooms. Chapters emphasize diverse theoretical and practical issues, including
construct definition, validity claims, task design, learners’ test-taking processes,
accessibility issues, score reporting, and collaboration with stakeholders such as
policymakers, educators, teachers, and others, to determine best practices in test-
score-based interpretations. The book concludes with a forward-looking section
on the emerging uses of technology in ELP assessments—including the very
intriguing yet challenging use of automated scoring of learners’ spoken and writ-
ten English production—and important considerations in attempting to connect
large-scale assessments with teachers’ and learners’ classroom practices. The final
chapter of the book then calls for a system-wide validation effort with special
attention to consequences for accountability testing.
This volume is uniquely authoritative, drawing both on ETS expertise and
leading K–12 education scholars to clearly define major issues in the contempor-
ary landscape of large-scale ELP assessment. Collectively, the chapters paint
a complex picture of the many factors that shape assessment design and that
must be addressed by test providers if they seek to maintain professional stand-
ards and deliver trustworthy tests. The book also delivers the key message that
the consequences of such assessments for K–12 English learners are potentially
dramatic—even life-changing—hence the critical importance of investigating,
understanding, and improving on the design and use of these powerful tests.
Series editors
John M. Norris, Sara T. Cushing, Steven J. Ross, Xiaoming Xi
ACKNOWLEDGMENTS
Edynn Sato, CEO & Chief Research Scientist, Sato Education Consulting LLC
Figures
4.1 ACCESS for ELLs sample technology-enhance item (hot spot). 60
4.2 ELPA21 sample technology-enhanced item (drag and drop). 60
4.3a ACCESS for ELLs Grade 1 sample speaking task prompt. 62
4.3b ACCESS for ELLs Grade 1 sample speaking task with
scaffolding. 63
4.4 ELPAC Grades 3–5 sample writing item with scaffolding. 64
4.5 ELPAC Grades 9–10 sample reading item with accessibility
features. 66
6.1 Overview of classroom educator involvement in the ELPAC. 99
7.1 Percentage of students in each rating category across grade level/
grade spans. 121
7.2 A sample “Reading for Detail” type item. 123
7.3 Examples of students’ responses in Grades 2–3 on the computer
vs. on paper. 125
8.1 Reporting hierarchy of summative ELPAC, Kindergarten
through Grade 12. 138
8.2 Example of a Summative ELPAC Student Score Report. 139
8.3a Correlated four-factor model (listening, speaking, reading,
writing). 144
8.3b Correlated two-factor model (oral and written). 145
8.3c Correlated two-factor model (receptive and productive). 146
8.3d Unidimensional model (ELP: English language proficiency). 147
8.4 Percentage metric TCCs of oral language proficiency scores. 157
8.5 Percentage metric TCCs of written language proficiency scores. 157
Illustrations xv
Tables
4.1 Summary of Three ELP Assessments. 57
4.2 Summary of Main Embedded Universal Tools. 65
7.1 The Number of Participants by Grade and ELP Levels. 116
7.2 Item Types Selected for the Study, Grades K–3. 118
7.3 Item Types Selected for the Study, Grades 6–8. 119
8.1 Summative ELPAC Integrated Task Types and Skill Mapping. 137
xvi Illustrations
including the reauthorized Elementary and Secondary Education Act, the term “EL”
reinforces the legal rights of this subgroup of students. Irrespective of the termin-
ology used to refer to these students, it is important to note the current prevailing
asset-based view of EL students, which recognizes their linguistic and cultural
diversity as a valuable resource for U.S. schools and society (e.g., Hakuta, 2011;
NASEM, 2017; Valdés, Kibler, & Walqui, 2014).
Keen attention has been paid to EL students in recent years, due not only to the
rapid growth of this population but also to the persistent and substantial achievement
gap they experience relative to their non-EL peers. For example, in the 2019
National Assessment of Education Progress (NAEP) Grade 8 reading assessment,
72% of EL students scored below the “Basic” level, as compared to 24% of non-EL
students (the NAEP proficiency levels include “Basic,” “Proficient,” and
“Advanced.”). Even though EL students are by definition those identified as need-
ing English language support to perform academic tasks, the proportion of them
scoring below the Basic level is disconcerting. The results of the 2019 NAEP Grade
8 mathematics assessment raise similar concerns in that 72% of EL students scored
below “Basic,” as compared to 28% of non-EL students (U.S. Department of
Education, n.d.; results available at www.nationsreportcard.gov/).
Research suggests that a number of factors account for this achievement gap,
including the challenge of learning academic content and academic English simul-
taneously, having unequal opportunities to learn in school, low socioeconomic
status, and lack of teacher training in educating EL students (Abedi & Herman,
2010; Callahan & Shifrer, 2016; Estrada, 2014; Samson & Lesaux, 2015;
Umansky, 2016). Helping EL students improve their ELP is of utmost importance
in efforts to close the achievement gap and foster EL students’ academic and
vocational success.
The 2002 reauthorization of the Elementary and Secondary Educational Act, also
known as No Child Left Behind, highlighted the importance of EL students’ ELP
development. This education law requires that, once students are identified as
ELs, a school must assess their ELP annually to monitor their progress toward
proficiency. The act holds schools, local educational agencies (LEAs), and state
educational agencies (SEAs) accountable for ensuring EL students’ appropriate
ELP attainment.
This mandate has led to the creation of large-scale, standards-based ELP
assessments across the United States, with high-stakes uses at both the student
and school levels (Boals et al., 2015). At the individual student level, ELP
assessments are used to make decisions about the types of instructional services
and accommodations an EL student will receive. The results are also used to
determine whether a student can exit EL services and be relieved of the
required annual ELP assessment. At the school level, ELP assessment results are
used for accountability purposes, including program evaluation and funding
allocation. They also influence schools’ decisions about resource allotment and
curriculum planning for their EL students. Considering the significant uses of
Introduction 5
ELP assessments and their impact on various stakeholders, the quality of state-
wide large-scale ELP assessments is crucial. The development of appropriate
ELP assessments must be guided by a rigorous process that is informed by
empirical investigations and supported by robust theoretical bases.
This edited volume is intended to inform the fields of language testing and
K–12 education about key considerations in the development and use of large-
scale, standards-based ELP assessments for EL students. As mentioned above,
the No Child Left Behind Act spawned the first generation of large-scale,
standards-based K–12 ELP assessments across states. Since the act was passed in
2002, the field has made considerable strides in conceptualizing the kinds of
academic language proficiency to be assessed in ELP assessments (Bailey, 2007;
DiCerbo, Anstrom, Baker, & Rivera, 2014; Schleppegrell, 2012; Snow &
Uccelli, 2009), and in systematically measuring students’ language skills in listen-
ing, reading, speaking, and writing from kindergarten through high school.
Abedi (2007) documents this major undertaking and the characteristics of the
first-generation standards-based ELP assessments in the United States. In a way,
the present volume provides a collective account of the second (or current)
generation of standards-based ELP assessments, which has resulted from the
substantial reform of academic content standards and the subsequent changes
in ELP standards across many states.
This volume contains a collection of conceptual and empirical articles
describing the historical landscape of K–12 ELP assessments including various
endeavors in the development of the current generation of ELP assessments.
Readers will, I hope, gain a better understanding of the contexts of large-scale
K–12 ELP assessments and the variety of empirical research and advancements
that underlie them. The chapters in this volume are designed to stimulate
discussion and future research that will contribute to the next generation of
ELP assessments and improve policy-making and practices that are facilitated
by such assessments. Thus, the intended audience of this volume is wide,
encompassing researchers, graduate students, test developers, educators, and
policymakers. Although the volume focuses on U.S. K–12 education, informa-
tion presented in this volume should be useful and applicable in other contexts
and countries dealing with ELP assessment for students learning English as
an additional language. Note that this volume is concerned with statewide,
summative ELP assessments that are used largely for accountability purposes.
While equally important, other types of ELP assessments and native language
assessments for diagnostic and formative purposes, for example, are beyond the
scope of this volume.
In this introductory chapter, I provide a brief overview of EL students, the role
of large-scale standards-based ELP assessments, and policies that have engendered
such ELP assessments. I also highlight major issues to consider in the development
and use of K–12 ELP assessments and describe how these issues are covered across
chapters.
6 Mikyung Kim Wolf
It is also worth noting that most EL students are in the primary grades. This
is because EL identification usually takes place when students first enroll in
a U.S. public school, often in kindergarten. As it takes time to develop suffi-
cient English proficiency to exit EL status, there is a higher proportion of EL
students in the primary grades than in the upper grades. Given that learners
from kindergarten to Grade 2 have relatively little familiarity with standardized
testing, an evidence-based design of appropriate assessments is critical (Bailey,
Heritage, & Butler, 2014; Wolf & Butler, 2017).
Research also points to the socioeconomically disadvantaged characteristics of
the EL population, which impact students’ opportunities to learn and their
academic performance (Menken, 2010; Samson & Lesaux, 2015). Demographic
data indicate that EL students disproportionally reside in high-poverty areas and
attend schools with limited resources. Examining the Early Childhood Longitu-
dinal Study-Kindergarten (ECLS-K) dataset, Samson and Lesaux (2015) found
that linguistic minority students constitute a disproportionately high percentage of
those in the low socioeconomic status quintiles (more than 70%, compared
to 37% of their counterparts). As current large-scale ELP testing is increasingly
technology-based, EL students’ degree of familiarity with technology (which may
be less for socioeconomically disadvantaged students) should be an important
consideration in the development and use of ELP assessments.
We peel de meat,
Dey gib us de skin;
And dat’s de way
Dey take us in;
We skim de pot,
Dey give us de liquor,
And say dat’s good enough for nigger.
I AM now at the beginning of the year 1836, when the mind naturally
occupies itself with the mysteries of life in all its phases—the ideal,
the real, and the actual. Sober people look both ways at the
beginning of a new year, surveying the errors of the past, and
providing against the possible errors of the future. I, too, was thus
exercised. I had little pleasure in retrospect, and the future prospect
was not brilliant. “Notwithstanding,” thought I, “the many resolutions
and prayers I have made in behalf of freedom, I am, this first day of
the year 1836, still a slave, still wandering in the depths of a
miserable bondage. My faculties and powers of body and soul are
not my own, but are the property of a fellow-mortal in no sense
superior to me, except that he has the physical power to compel me
to be owned and controlled by him. By the combined physical force
of the community I am his slave—a slave for life.” With thoughts like
these I was chafed and perplexed, and they rendered me gloomy
and disconsolate. The anguish of my mind cannot be written.
At the close of the year, Mr. Freeland renewed the purchase of
my services of Mr. Auld for the coming year. His promptness in doing
so would have been flattering to my vanity had I been ambitious to
win the reputation of being a valuable slave. Even as it was, I felt a
slight degree of complacency at the circumstance. It showed him to
be as well pleased with me as a slave as I with him as a master. But
the kindness of the slave-master only gilded the chain, it detracted
nothing from its weight or strength. The thought that men are made
for other and better uses than slavery throve best under the gentle
treatment of a kind master. Its grim visage could assume no smiles
able to fascinate the partially enlightened slave into a forgetfulness
of his bondage, or of the desirableness of liberty.
I was not through the first month of my second year with the kind
and gentlemanly Mr. Freeland before I was earnestly considering
and devising plans for gaining that freedom which, when I was but a
mere child, I had ascertained to be the natural and inborn right of
every member of the human family. The desire for this freedom had
been benumbed while I was under the brutalizing dominion of Covey,
and it had been postponed and rendered inoperative by my truly
pleasant Sunday-school engagements with my friends during the
year at Mr. Freeland’s. It had, however, never entirely subsided. I
hated slavery always, and my desire for freedom needed only a
favorable breeze to fan it to a blaze at any moment. The thought of
being only a creature of the present and the past troubled me, and I
longed to have a future—a future with hope in it. To be shut up
entirely to the past and present is to the soul whose life and
happiness is unceasing progress—what the prison is to the body—a
blight and mildew, a hell of horrors. The dawning of this, another
year, awakened me from my temporary slumber, and roused into life
my latent but long-cherished aspirations for freedom. I became not
only ashamed to be contented in slavery, but ashamed to seem to be
contented, and in my present favorable condition under the mild rule
of Mr. Freeland, I am not sure that some kind reader will not
condemn me for being over-ambitious, and greatly wanting in
humility, when I say the truth, that I now drove from me all thoughts
of making the best of my lot, and welcomed only such thoughts as
led me away from the house of bondage. The intensity of my desire
to be free, quickened by my present favorable circumstances,
brought me to the determination to act as well as to think and speak.
Accordingly, at the beginning of this year 1836, I took upon me a
solemn vow, that the year which had just now dawned upon me
should not close without witnessing an earnest attempt, on my part,
to gain my liberty. This vow only bound me to make good my own
individual escape, but my friendship for my brother-slaves was so
affectionate and confiding that I felt it my duty, as well as my
pleasure, to give them an opportunity to share in my determination.
Toward Henry and John Harris I felt a friendship as strong as one
man can feel for another, for I could have died with and for them. To
them, therefore, with suitable caution, I began to disclose my
sentiments and plans, sounding them the while on the subject of
running away, provided a good chance should offer. I need not say
that I did my very best to imbue the minds of my dear friends with my
own views and feelings. Thoroughly awakened now, and with a
definite vow upon me, all my little reading which had any bearing on
the subject of human rights was rendered available in my
communications with my friends. That gem of a book, the Columbian
Orator, with its eloquent orations and spicy dialogues denouncing
oppression and slavery—telling what had been dared, done, and
suffered by men, to obtain the inestimable boon of liberty, was still
fresh in my memory, and whirled into the ranks of my speech with
the aptitude of well-trained soldiers going through the drill. I here
began my public speaking. I canvassed with Henry and John the
subject of slavery, and dashed against it the condemning brand of
God’s eternal justice. My fellow-servants were neither indifferent,
dull, nor inapt. Our feelings were more alike than our opinions. All,
however, were ready to act when a feasible plan should be
proposed. “Show us how the thing is to be done,” said they, “and all
else is clear.”
We were all, except Sandy, quite clear from slaveholding
priestcraft. It was in vain that we had been taught from the pulpit at
St. Michaels the duty of obedience to our masters; to recognize God
as the author of our enslavement; to regard running away an
offense, alike against God and man; to deem our enslavement a
merciful and beneficial arrangement; to esteem our condition in this
country a paradise to that from which we had been snatched in
Africa; to consider our hard hands and dark color as God’s
displeasure, and as pointing us out as the proper subjects of slavery;
that the relation of master and slave was one of reciprocal benefits;
that our work was not more serviceable to our masters than our
master’s thinking was to us. I say it was in vain that the pulpit of St.
Michaels had constantly inculcated these plausible doctrines. Nature
laughed them to scorn. For my part, I had become altogether too big
for my chains. Father Lawson’s solemn words of what I ought to be,
and what I might be in the providence of God, had not fallen dead on
my soul. I was fast verging toward manhood, and the prophesies of
my childhood were still unfulfilled. The thought that year after year
had passed away, and my best resolutions to run away had failed
and faded, that I was still a slave, with chances for gaining my
freedom diminished and still diminishing—was not a matter to be
slept over easily. But here came a trouble. Such thoughts and
purposes as I now cherished could not agitate the mind long without
making themselves manifest to scrutinizing and unfriendly observers.
I had reason to fear that my sable face might prove altogether too
transparent for the safe concealment of my hazardous enterprise.
Plans of great moment have leaked through stone walls, and
revealed their projectors. But here was no stone wall to hide my
purpose. I would have given my poor tell-tale face for the immovable
countenance of an Indian, for it was far from proof against the daily
searching glances of those whom I met.
It was the interest and business of slaveholders to study human
nature, and the slave nature in particular, with a view to practical
results; and many of them attained astonishing proficiency in this
direction. They had to deal not with earth, wood, and stone, but with
men; and by every regard they had for their safety and prosperity
they had need to know the material on which they were to work. So
much intellect as the slaveholder had round him required watching.
Their safety depended on their vigilance. Conscious of the injustice
and wrong they were every hour perpetrating, and knowing what
they themselves would do if they were victims of such wrongs, they
were constantly looking out for the first signs of the dread retribution.
They watched, therefore, with skilled and practiced eyes, and
learned to read, with great accuracy, the state of mind and heart of
the slave through his sable face. Unusual sobriety, apparent
abstraction, sullenness, and indifference,—indeed, any mood out of
the common way,—afforded ground for suspicion and inquiry.
Relying on their superior position and wisdom, they “would often
hector the slave into a confession by affecting to know the truth of
their accusations. “You have got the devil in you, and we’ll whip him
out of you,” they would say. I have often been put thus to the torture
on bare suspicion. This system had its disadvantages as well as its
opposite—the slave being sometimes whipped into the confession of
offenses which he never committed. It will be seen that the good old
rule, “A man is to be held innocent until proved to be guilty,” did not
hold good on the slave plantation. Suspicion and torture were the
approved methods of getting at the truth there. It was necessary,
therefore, for me to keep a watch over my deportment, lest the
enemy should get the better of me. But with all our caution and
studied reserve, I am not sure that Mr. Freeland did not suspect that
all was not right with us. It did seem that he watched us more
narrowly after the plan of escape had been conceived and discussed
amongst us. Men seldom see themselves as others see them; and
while to ourselves everything connected with our contemplated
escape appeared concealed, Mr. Freeland may, with the peculiar
prescience of a slaveholder, have mastered the huge thought which
was disturbing our peace. As I now look back, I am the more inclined
to think he suspected us, because, prudent as we were, I can see
that we did many silly things very well calculated to awaken
suspicion. We were at times remarkably buoyant, singing hymns,
and making joyous exclamations, almost as triumphant in their tone
as if we had reached a land of freedom and safety. A keen observer
might have detected in our repeated singing of
was a favorite air, and had a double meaning. In the lips of some it
meant the expectation of a speedy summons to a world of spirits; but
in the lips of our company, it simply meant a speedy pilgrimage to a
free State, and deliverance from all the evils and dangers of slavery.
I had succeeded in winning to my scheme a company of five
young men, the very flower of the neighborhood, each one of whom
would have commanded one thousand dollars in the home market.
At New Orleans they would have brought fifteen hundred dollars
apiece, and perhaps more. Their names were as follows: Henry
Harris, John Harris, Sandy Jenkins, Charles Roberts, and Henry
Bailey. I was the youngest but one of the party. I had, however, the
advantage of them all in experience, and in a knowledge of letters.
This gave me a great influence over them. Perhaps not one of them,
left to himself, would have dreamed of escape as a possible thing.
They all wanted to be free, but the serious thought of running away
had not entered into their minds until I won them to the undertaking.
They all were tolerably well off—for slaves—and had dim hopes of
being set free some day by their masters. If any one is to blame for
disturbing the quiet of the slaves and slave-masters of the
neighborhood of St. Michaels, I am the man. I claim to be the
instigator of the high crime (as the slaveholders regarded it), and I
kept life in it till life could be kept in it no longer.
Pending the time of our contemplated departure out of our
Egypt, we met often by night, and on every Sunday. At these
meetings we talked the matter over, told our hopes and fears, and
the difficulties discovered or imagined; and, like men of sense, we
counted the cost of the enterprise to which we were committing
ourselves. These meetings must have resembled, on a small scale,
the meetings of the revolutionary conspirators in their primary
condition. We were plotting against our (so-called) lawful rulers, with
this difference—we sought our own good, and not the harm of our
enemies. We did not seek to overthrow them, but to escape from
them. As for Mr. Freeland, we all liked him, and would gladly have
remained with him as free men. Liberty was our aim, and we had
now come to think that we had a right to it against every obstacle,
even against the lives of our enslavers.
We had several words, expressive of things important to us,
which we understood, but which, even if distinctly heard by an
outsider, would have conveyed no certain meaning. I hated this
secresy, but where slavery was powerful, and liberty weak, the latter
was driven to concealment or destruction.
The prospect was not always bright. At times we were almost
tempted to abandon the enterprise, and to try to get back to that
comparative peace of mind which even a man under the gallows
might feel when all hope of escape had vanished. We were
confident, bold, and determined, at times, and again doubting, timid,
and wavering, whistling, like the boy in the grave-yard, to keep away
the spirits.
To look at the map and observe the proximity of Eastern shore,
Maryland, to Delaware and Pennsylvania, it may seem to the reader
quite absurd to regard the proposed escape as a formidable
undertaking. But to understand, some one has said, a man must
stand under. The real distance was great enough, but the imagined
distance was, to our ignorance, much greater. Slaveholders sought
to impress their slaves with a belief in the boundlessness of slave
territory, and of their own limitless power. Our notions of the
geography of the country were very vague and indistinct. The
distance, however, was not the chief trouble, for the nearer the lines
of a slave state to the borders of a free state the greater was the
trouble. Hired kidnappers infested the borders. Then, too, we knew
that merely reaching a free state did not free us, that wherever
caught we could be returned to slavery. We knew of no spot this side
the ocean where we could be safe. We had heard of Canada, then