Professional Documents
Culture Documents
Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session five
Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session five
Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session five
validity
Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session five
Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session five
reliability
Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session five
Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session five
Are these definitions clear enough to guide you in general understanding? Can you find something off about these definitions?
Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session three
refreshed definitions
Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session five
validity
Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session five
validity
Validity is the interpretation of the information that the test generates. It refers to the accuracy of the interpretation.
Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session five
validity
For example, a driving test must include a competency-based assessment which requires the candidates to drive a vehicle in a real setting.
Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session five
QUESTION
Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session five
validity of assessment
Validity of any assessment is dependent upon the purpose of the assessment and the way in which evidence is interpreted and used by the key stakeholders.
Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session five
validity
Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session five
inference
Refers to the conclusions drawn on the synthesis and interpretation of evidence and subsequently, requires judgment on the basis of the evidence gathered and prior beliefs/expectations.
Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session five
validity types
face validity
content validity
construct validity consequential validity
criterion validity
Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session five
face validity
At surface level, the assessment translates sufficiently the content and construct being assessed.
Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session five
content validity
How well the content of the test samples the class situations or subject matter about which conclusions are to be drawn.
Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session five
Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session five
construct validity
It refers to the degree to which the inferences can legitimately be made. Applicable when there is no obvious body of content or when there are no existing criteria.
Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session five
construct validity
The extent a variable is abstract rather than concrete, we speak of it as being a construct. Such a variable is literally a construct in that it is something put together from their own imaginations.
Numally, J.C. (1978) Psychometric Theory
Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session five
consequential validity
Refers to the consequences of the assessment.
Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session five
criterion validity
two types of criterion validity:
predictive validity concurrent validity
Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session five
criterion validity
predictive
The extent to which the assessment is able to predict something that it should theoretically be able to predict.
Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session five
criterion validity
concurrent
Occurs when the criterion measures are obtained at the same time as the test scores.
The ability of a measure to indicate an individuals present standing on the criterion variable.
Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session five
reliability
Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session five
reliability
Reliability is the ability to control background noise.
Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session five
reliability types
inter-rater (across assessors)
Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session five
inter-rater reliability
Consistency of judgment across different assessors using the same assessment task and procedure.
Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session five
intra-rater reliability
Consistency of assessment outcomes across time and location, and using the same assessment task administered by the same assessor.
Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session five
Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session five
Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session five
The way in which the assessor uses and interprets the evidence collected will impact on validity.
Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session five
validity or reliability?
Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session five
validity or reliability?
Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session five
validity or reliability?
Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session five
Practicality
Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session five
In addition to validity and reliability, considerations must also be given to the aspect of practicality.
Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session five
practicality
Considerations given to the operationalization of an assessment (i.e. cost, stake, worth) which may also affect decisions on validity and reliability.
Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session five