Practice: Get quality data into your evaluator’s hands
Key Action: Use technique to ensure valid and reliable data
TOOL: Judging the Validity and Reliability of a Survey
: Surveys are commonly used to measure programoutcomes. However, to yield accurate information,surveys must be both reliable and valid. The followingnarrative and checklist can help you determine whether surveys proposed for use in your evaluation have beentested for reliability and validity.Note: Reliability and validity are sometimes termed“psychometric properties.” Conducting the statisticaltests required to establish survey reliability and validitycan be labor intensive. Individual magnet schoolevaluations generally do not have the time or financialresources to do thorough psychometric testing of aninstrument. The most efficient alternative is to useexisting evaluation instruments that provide appropriatedata documenting their reliability and validity.
1.Read the brief definitions and examples of “validity”and “reliability.”2.Review the checklist with your evaluator as a wayto begin a discussion about the validity and reliabilityof survey instruments being used in your evaluation.