You are on page 1of 32

Qualities of a Good Test

1. Reliability
“Reliability refers to the consistency of scores obtained by
the same persons when they are reexamined with the same
test on different occasions, or with different sets of
equivalent items, or under other variable examining
conditions.”
A good test should be highly reliable. This means that the
test should give similar results even though different testers
administrate it, different peoples' scores in different forms of
the test are given and the same person takes that test at two
or more different times. Reliability is usually checked by
comparing different sets of scores.
Continue
According to Ebel and Frisbie (1991) “the term reliability
means the consistency with which a set of test scores measure
whatever they do measure.”
In actual practice, psychological tests are never perfectly
reliable. One reason is that changes do occur in individuals
over time; for example, a person who scores lower in her group
at an initial testing may develop new skills that raise her to a
higher position in the group at the time of the second testing.
Reliability Answers to the following Questions
Gronlund and Linn (1995)
1. How similar the test scores are if the test is administered
twice?
2. How similar the test scores are if two equivalent forms of
tests are administered?
3. To what extent the scores of any essay test. Differ when it is
scored by different teachers?
Measurement Errors
It is not always possible to obtain perfectly consistent results.
Because there are several factors like physical health, memory,
guessing, fatigue, forgetting etc. this may affect the results
from one measurement to other. These extraneous variables
may introduce some error to our test scores. This error is called
as measurement errors.
Activity
Give your opinion which General Considerations a
teacher should determine in Determining
Reliability.
Different Types of Consistency
1. Consistency over a period of time.
2. Consistency over different forms of instrument.
3. Consistency within the instrument itself.
Methods of Determining Reliability
1. Test-Retest method.
2. Equivalent forms/Parallel forms method.
3. Split-half method.
1. Test re Test Reliability
In test- retest reliability method the same test is given to the
same group of people at two different times.
The scores thus obtained are then correlated and compared.
The reliability coefficient in this case is simply the correlation
(r) between the scores obtained by the same sample on the two
administration of the test.
This approach supposes that there is no firm change in the
concept being measured between the two occasions. The amount
of time allowed between measures is extremely important.
The shorter the time gap, the higher the correlation; the longer
the time gap, the lower the correlation.
Continue
It is used to assess the consistency of a measure from one time
to another.
Time gap of retest score should not be more than six months.
This correlation coefficient is also referred as a correlation of
stability.
2. Split Half Reliability
In this method the test is divided into two equal halves
and the scores of half the items are correlated with the
scores of the other half.
The items of the test can be divided into two set in a
variety of ways.
3. Parallel- Form Reliability
In this process two parallel forms of tests are administered to
the same group of pupils in short interval of time, then the
scores of both the tests are co-related.
This correlation provides the index of equivalence.
In this method a large set of questions are divided into
two sets. Thus the estimate of reliability is obtained by
correlating the two parallel forms is the estimate of
reliability.
2. Validity
A valid test means it must measure, what it purports to
measure.
Validity refers to how well a tool measures what it intends to
measure in a test.
It can also be referred as the truthfulness of the test. It means to
what extent the test measures that, what the test maker intends
to measure.
According to Freeman (2006) “An index of validity shows the
degree to which a test measures what it wants to measure,
when compared with accepted criteria”.
Continue
“The term validity, when applied to a set of test scores, refers
to the consistency (accuracy) with which the scores measure a
particular cognitive ability of interest.”
Ebel and Frisbie
“Validity is the “extent to which a test or other measuring
instru­ment fulfills the purpose for which it is used.”
C.V. Good
Types of Validity
1. Operational validity
2. Predictive validity
3. Content validity
4. Construct validity
5. Criterion related validity
6. Face Validity
Continue
1. Operational Validity
A test will have operational validity if the tasks required by the
test are sufficient to evaluate the definite activities or qualities.
2. Predictive Validity
A test has predictive validity if scores on it predict future
performance.
3. Content Validity
If the items in the test constitute a representative sample of the
total course content to be tested, the test can be said to have
content validity. It is the process of matching the test items with
the instructional objectives.
Continue
4. Construct Validity
Construct validity involves explaining the test scores
psychologically. A test is interpreted in terms of numerous
research findings.
Continue
5. Criterion-related validity
In criterion-related validity, the individual’s performance
may be compared and judged against some criterion.
Continue
For example:
A job applicant takes a performance test during the interview
process. If this test accurately predicts how well the employee will
perform on the job, the test is said to have criterion validity.
A graduate student takes the GRE. The GRE has been shown as an
effective tool (i.e. it has criterion validity) for predicting how well a
student will perform in graduate studies.
The first measure (in the above examples, the job performance test
and the GRE) is sometimes called the predictor variable or
the estimator. The second measure is called the criterion variable as
long as the measure is known to be a valid tool for predicting
outcomes.
Continue
6. Face Validity
Face validity means that the given test appears or seems to
measure what it is to measure.
If the test content appears irrelevant or inappropriate, the result
will be poor regardless of the actual validity of the test.
To check the content validity of the test a careful and critical
examination of the test items in relation to the objectives
should be made.
3. Objectivity
Objectivity means that if the test is marked by different people,
the score will be the same . In other words, marking process
should not be affected by the marking person's personality.
A test is said to be objective if it is free from personal
biaseness. 
Objectivity of a test can be increased by using more objective
type test items and the answers are scored according to model
answers provided.
Aspects of Objectivity
There are two aspects of objectivity which should be kept in
mind while constructing a test.
1. Objectivity in scoring.
2. Objectivity in interpretation of test items by the testee.
1. Objectivity in scoring
Objectivity of scoring means same person or different persons
scoring the test at any time arrives at the same result without
may chance error.
A test to be objective must necessarily so worded that only
correct answer can be given to it.
In other words the personal judgment of the individual who
score the answer script should not be a factor affecting the test
scores.
2. Objectivity of Test Items
By item objectivity we mean that the item must call for a
definite single answer.
Test items should be free from ambiguity.
A given test item should mean the same thing to all the
students that the test maker intends to ask.
Dual meaning sentences, items having more than one correct
answer should not be included in the test.
4. Usability
The test must have practical value from time, economy, and
administration point of view. This may be termed as usability.
Aspects of Usability
1. Ease of Administration
It means the test should be easy to administer so that the
general class-room teachers can use it.
Simple and clear directions should be given.
The timing of the test should not be too difficult.
Continue
2. Time required for administration
Appropriate time limit to take the test should be provided.
If in order to provide ample time to take the test we shall make
the test shorter than the reliability of the test will be reduced.
Continue
3. Ease of Interpretation and Application
Another im­portant aspect of test scores are interpretation of
test scores and application of test results.
If the results are misinterpreted, it is harmful on the other hand
if it is not applied, then it is useless.
Continue
4. Cost of Testing
A test should be economical from preparation, administration
and scoring point of view.
Summary
1. Validity
A test is considered as valid when it measures what it is supposed to
measure.
2. Reliability
A test is considered reliable if it is taken again by the same students
under the same circumstances and the score average is almost the
constant , taking into consideration that the time between the test and
the retest is of reasonable length.
3. Objectivity
Objectivity means that if the test is marked by different people, the
score will be the same . In other words, marking process should not be
affected by the marking person's personality.
Continue
4. Comprehensiveness
A good test should include items from different areas of material
assigned for the test. e.g (dialogue, composition, comprehension,
grammar, vocabulary, orthography, dictation and handwriting).
5. Simplicity
Simplicity means that the test should be written in a clear , correct
and simple language , it is important to keep the method of testing
as simple as possible while still testing the skill you intend to test.
(Avoid ambiguous questions and ambiguous instructions).
References
https://
www.yourarticlelibrary.com/education/test/top-4-characteristic
s-of-a-good-test/64804
https://
www.psychologydiscussion.net/intelligence/4-main-characteris
tics-of-a-good-test/2040
https://
sites.google.com/site/rgfarra220141500/exams/qualities-of-goo
d-test
http
://wiki.answers.com/Q/What_are_the_characteristics_of_a_goo
d_test#ixzz1z6Ur1PwA

You might also like