Validity Reliability Validity implies the extent to which the Reliability refers to the degree to which research instrument measures, what it assessment tool produces consistent is intended to measure. results, when repeated measurements are made. It refers to the ability of the It refers to the reproducibility of the results instrument/test to measure what it is when repeated measurements are done. supposed to measure. It relates to the correct applicability of It relates to the extent to which an the instrument/test/procedure in a experiment, test or any procedure gives the needed situation. same result on repeated trials. Can relate to question of ‘Does it Can relate to question, ‘How representative measure what it is supposed to is the measurement’? measure’? Answers, ‘Is it the right instrument/test Answers, ‘Can the results obtained be for what I need to measure?’ replicated if the test is repeated?’ Differences between Validity and Reliability Validity Reliability Validity looks at accuracy. Reliability looks at repeatability/consistency. Validity mainly focuses on the outcome. Reliability mainly focuses on maintaining consistent result. Influencing factors for validity are: Influencing factors for reliability are: process, purpose, theory matters, logical test length, test score variability, implications, etc. heterogenicity, etc. Validity has more analysis and is harder Reliability is comparatively easier and to achieve. yields faster results. There cannot be validity without There can be reliability without validity. reliability. Even if validity of an instrument is poor When reliability/repeatability is poor, (for certain test), it can have high validity may also be poor. Thus, reliability (for other tests) usefulness of a test/experiments are negligible. Differences between Validity and Reliability Validity Reliability If the results are not valid, the test is of no If the results cannot be replicated, the test is use at all. of little use. Examples of different types of validity are: Examples of different types of reliability are:
Face validity Test-retest reliability
Construct validity Parallel forms reliability Content validity Intra rater reliability Criterion validity Internal reliability Concurrent validity External reliability Convergent validity etc. External validity Internal validity etc.
Face validity is when the tool appears to be Test-retest reliability is a measure of
measuring what it is supposed to measure reliability obtained by administering the same with the content of test matching test twice over a period of time to a group of instructional objectives. individuals. Differences between Validity and Reliability Validity Reliability Construct validity seeks the implications Parallel forms reliability is a measure of between a theoretical concept and a specific reliability obtained by administering different measuring device. versions of an assessment tool (both versions It includes constructs like concepts, ideas, must contain items that probe the same theories, etc. construct, skill, knowledge base, etc.) to the same group of individuals. Content validity is qualitative measure where Intra rater reliability is a measure in which the the actual content matches the measurement same assessment is completed by the same which is a logical method of measurement. rater on two or more occasions. Criterion validity is the measure where there Internal consistency reliability is a measure is correlation with the standards and the of reliability used to evaluate the degree to assessment tool and yields a standard which different test items that probe the same outcome. construct produce similar results.