Professional Documents
Culture Documents
To Be a Good Test
Sensitivity
The ability to detect a true difference.
Sensitivity
• A measurement device or tool…..
– Used to apply a number or value - scale
– Indicates and separates differences – scale
– You can only be sure of your measurement
when it fits the scale
– Potential for error is high when sensitivity is
poor.
– Examples
What Happens When Sensitivity
is Poor?
• Too High?
– Detect everything
– Unable to discriminate between what you’re searching
for and everything else you find
– Example: Signal vs. signal
• To Low?
– Can’t detect enough
– Unable to discriminate between what you’re looking
for and nothing
– Example: Signal vs. noise or signal vs. silence
• Either case, the result is an incorrect result.
True State
True False
• Comparison against…
– Individuals
• Best example?
– Tabled Values
• Match the group?
Types of Reliability
• Stability
• Juggler please….
Judges’ scores………
Factors Affecting Objectivity
• The clarity of the scoring system
– Examples:
• Tennis serve for accuracy
versus
• 40 yd. run for time/speed in football or baseball
Types of Validity
• Construct Validity - validity for an instrument
that measures a variable or factor that is not
directly observable
– Examples:
• Attitudes, feelings, motivation
• Learning new skills
Factors Affecting Validity
• Student characteristics
– Examples: sex, age, experience
• Administrative procedures
– Examples: unclear directions, poor weather
• Reliability
– Example: same results after repeated test
When a A Test is Not Valid…..
To Be a Good Test
Now to the testing process….
Tests and Their Administration
• Test Characteristics
• Administrative Concerns
• Participant Concerns
• Pre Test Procedures
• Administering the Test
• Post Test Procedures
• Individuals with Disabilities
Tests and Their Administration
Test Characteristics
• Validity, Reliability, Objectivity
• Content Related Attributes
– Important Attributes – a sample, not everything
– Discrimination – best from better from good
– Resemblance to the Activity - similarity
– Specificity – single attribute vs. multiple attributes,
ID’s limitations
– Unrelated Measures – battery - different aspects –
“independence”
Test Administration
Administrative Concerns
• Mass Testability
• Minimal Practice
• Minimal Equipment
• Minimal Personnel
• Ease of Preparation
• Adequate Directions
• Norms / Criterion
• Useful Scores
Test Administration
Participant Concerns
• Appropriateness to Participants
• Individual Scores
• Enjoyable
• Safety
• Confidentiality and Privacy
• Motivation
Test Administration
Pretest Procedures
Posttest Procedures
• Analyze Test Scores
• “Share” Information – highs vs. lows
Test Administration
• Disabilities Include: