© 2003 Northwest Evaluation Association, Portland, Oregon
Table of Contents
Foreword.............................................................................................................1Acknowledgments...............................................................................................2Introduction.........................................................................................................3
Other Resources......................................................................................................................................3Organization of This Manual..................................................................................................................4Cova
l
ent Assessments.............................................................................................................................5
Educational Assessment ......................................................................................6
The Principles That Guide NWEA Assessments...................................................................................6MAP and ALT in a Comprehensive Assessment Plan..........................................................................9
Testing for a Purpose: NWEA Assessment Design ..............................................9
Test Structure ..........................................................................................................................................9Achievement Level Tests (ALT).....................................................................................................10Measures of Academic Progress (MAP).........................................................................................12Testing Modality...................................................................................................................................15
The Item Banks and Measurement Scales..........................................................17
The Measurement Model......................................................................................................................17Scale Development and Item Calibration.............................................................................................19Phase I: Developing the Measurement Scales...............................................................................19Phase II: Maintaining the Measurement Scales.............................................................................20Item Development.................................................................................................................................21Item Writing and Editing.................................................................................................................21Item Bias Review.............................................................................................................................22Content Category Assignment.........................................................................................................23Field Testing.....................................................................................................................................23Item Analyses and Calibration.........................................................................................................24Periodic Review of Item Performance.................................................................................................27
The Assessment Process....................................................................................28
Test Development.................................................................................................................................29Test Design.......................................................................................................................................29ALT Test Specifications.............................................................................................................29MAP Test Specifications............................................................................................................31Content Definition............................................................................................................................32Item Selection...................................................................................................................................34Test Construction.............................................................................................................................35Test Administration...............................................................................................................................36