Professional Documents
Culture Documents
Definitions:
The role of achievement tests in education has become much more pronounced since
the passage of the 2001 No Child Left Behind Act. This legislation focused on standard-
based education which was used to measure educational goals and outcomes. While this law
was later replaced by the 2015 Every Student Succeeds Act, achievement testing remains a
key element in measuring educational success and plays a role in determining school funding.
But achievement tests are not just important during the years of K-12 education and college.
They can be used to assess skills when people are trying to learn a new sport. If you were
learning dance, martial arts, or some other specialized athletic skill, an achievement test can
be important for determining your current level of ability and possible need for further
training.
They keep a fair record of student achievement and help to ensure that teachers and
the school itself are accountable to the taxpaying public who are funding their salaries and
equipment. To ensure that schools are running effectively and that students are being taught
what it is agreed that they should know, standardized tests are a useful tool.
State and local officials can look at standardized as an unbiased look at student
achievement. If all students from all districts take the same tests, state and local officials can
measure their achievement by comparing their scores. This is a superior method, it is argued,
to evaluating learning based on grades from teachers who have a personal interest in
presenting good scores and favorable reflections on their teaching. Standardized tests are
used to make sure that all students are learning the appropriate material for their grade level
and class.
They can also help assess which students in which subject areas are being most
challenged, and use that to inform individual plans for students who may need extra
assistance or to be taught in another way.
Athletes often time their runs, for instance, to see if they are getting faster or slower
with their training. Weightlifters often measure the amount they have lifted and test their
strength on various weights before they find the one most likely to help them strengthen and
move on. A demonstration of skills in an ice skating class or a ballet class is also a kind of
achievement test.
Achievement tests are used just as often for evaluation of an instructor as they are for
the evaluation of a student. Many students get nervous when it is time to take a standardized
test, but the fact of the matter is that the test is simply designed to see how effective the
teacher is at doing his or her job. Students who are taking a skills test in a martial arts class,
an equestrian qualification or in a tap dancing class are very likely being evaluated to see if
they have the skills necessary to move to the next round.
Achievement tests have their pros and cons. On the pro side, achievement tests allow
for data to be collected about student achievement and learning that helps to inform
educators, curriculum planners and the state officials who can help to determine the budget
for a school.
Standardized testing also helps to pinpoint instructional leaders who are falling short
of their duties and whose students are performing below standards. Very often, the data
gained from standardized tests have helped to improve and ameliorate failing education
systems, remove instructors who are no longer effective in the classroom, and reshape
curriculums that may have been less than effective. In these ways, having a measure or metric
of student achievement is important and useful, particularly when instructors are teaching a
large volume of students every day, and have few opportunities to do large assessments.
Research has also shown that standardized testing has a high effect on student
achievement. This could be because teachers begin to tailor their curriculum specifically so
that students perform well on achievement tests as opposed to coming away from their
learning with a real sense of the subject matter, but regardless, the test results do point to an
understanding of the presented subject matter in a way that demonstrates effective classroom
instruction.
Another argument in favor of standardized testing is that the tests are non-
discriminatory because the content evaluated on the tests has been presented to all students.
This ensures that all content given to all students is the same, and that there are not different
tests given to disabled or minority children, which helps create educational equity in our
schools.
Worldwide educational research has shown that students in nations, like China, who
have long histories of standardized testing routinely perform better in reading, math and
science than students from other nations.
For as many positive merits of standardized achievement tests as there are, there are
possibly more criticisms of the tests that critics have used for years to make the case to
abolish the system entirely and find alternative means for evaluating student achievement.
There are arguments that the tests, in fact, do not help student achievement in any
meaningful way, and the increases in positive scores that are seen on the test is merely a
reflection of curriculum that is designed to help students score highly on these standardized
tests specifically while allowing the more important but perhaps less quantifiable learning
that should be taking place in the classroom fall by the wayside.
The argument is that the tests teach students to simply regurgitate knowledge for a
high mark rather than internalize consider, apply and adapt what they have learned. The tests
also come under fire for teaching students a lack of critical thinking skills and for being
focused mode predominantly on rote memorization.
There is also academic evidence to suggest that only a certain kind of student fares
well in the sort of educational atmosphere that leads to strong standardized tests scores, and
that performance on standardized tests is not indicative of strong instructional leadership in
the classroom nor an academically rigorous curriculum.
Many critics of standardized tests have pointed to the challenges that such tests pose
for children with learning disabilities, special needs or emotional issues, whom the stress of
the test or the structure of the questions may affect negatively.
These critics argue that the tests are discriminatory, setting up for failure the many
students who have cognitive issues with the material, or simply struggle with multiple choice
questions in a timed environment. This is also the case for students who are English language
learners, and those who may find the structure of the questions and the language used in the
test may be confusing or isolating.
While some tests like New York State's Regent exams, California's California
Achievement Tests (CATs) and Iowa's Basic Skills Test (IBST) are regional, there are many
standardized tests that operate on a national level. Tests like the ERBs measure elementary
school student’s aptitude with certain skills and knowledge.
Anyone who has applied to college remembers the SATs, and some even took a
PSAT during secondary school. Postgraduate admissions are often heavily reliant on
standardized test results. Students hoping to attend medical school must take the MCATs.
Students applying to law school take the LSAT. Students applying to business school must
take the GMATs, and students in more traditionally liberal arts-related graduate programs
will take the GRE.
Test Designing:
The first step in constructing an effective achievement test is to identify what you
want students to learn from a unit of instruction. Consider the relative importance of the
objectives and include more questions about the most important learning objectives. If,
however, the test focuses on a few objectives to the exclusion of others, students will not
have the opportunity to demonstrate their understanding of other aspects of the material and
you may not be able to make an accurate assessment of each student's knowledge.
The learning objectives that you want to emphasize will determine not only what
material to include on the test, but also the specific form the test will take. For example, if it
is important that students be able to do long division problems rapidly, consider giving a
speeded test. The types of questions to be used will also depend on the learning objectives. If
it is important for students to understand how historical events affected one another, then
short answer or essay questions might be appropriate. If it is important that students
remember dates, then multiple-choice or fill-in-the-blank questions might be appropriate.
Childs, Ruth Axman, 1989
Tryout:
At this stage the initial format of the test is administered on a small representative
sample. After that the process of item analysis is used to calculate difficulty level and
discriminative value. There are a variety of techniques for performing an item analysis, which
is often used, for example, to determine which items will be kept for the final version of a
test. Item analysis is used to help “build” reliability and validity is “into” the test from the
start. Item analysis can be both qualitative and quantitative. The former focuses on issues
related to the content of the test, e.g. Content validity. The latter primarily includes
measurement of item difficulty and item discrimination.
Item analysis
In this stage test constructer examining the responses of respondents in the sample to
each test item. It can also be define as it is a statistical procedure by which the appropriate
items are selected for the final draft and poor items are rejected. Item analysis is an analysis
of responses made to ‘teacher made tests’ by the pupil in the class. Suresh, 2012
The test will provide useful information about the students’ knowledge of the learning
objectives. Considering the questions relating to the various learning objectives as separate
subtests, the evaluator can develop a profile of each student’s knowledge of or skill in the
objectives.
The final test is constructed after the above analysis for this a suitable format is prepared and
norms are specified. Also, instructions for examinees be prepared.
The test constructed in accordance to the above referred procedure will definitely assumes a
purpose or an idea of what is good or desirable from the stand point of individual or society
or both.
The item difficulty index is one of the most useful, and most frequently reported, item
analysis statistics. It is a measure of the proportion of examinees who answered the item
correctly; for this reason it is frequently called the p-value. As the proportion of examinees
who got the item right, the p-value might more properly be called the item easiness index,
rather than the item difficulty. It can range between 0.0 and 1.0, with a higher value
indicating that a greater proportion of examinees responded to the item correctly, and it was
thus an easier item. For criterion-referenced tests (CRTs), with their emphasis on mastery-
testing, many items on an exam form will have p-values of .9 or above. Norm-referenced
tests (NRTs), on the other hand, are designed to be harder overall and to spread out the
examinees' scores. Thus, many of the items on an NRT will have difficulty indexes between
.4 and .6.
The item discrimination index is a measure of how well an item is able to distinguish
between examinees who are knowledgeable and those who are not, or between masters and
non-masters. There are actually several ways to compute item discrimination, but one of the
most common is the point-biserial correlation. This statistic looks at the relationship between
an examinee's performance on the given item (correct or incorrect) and the examinee's score
on the overall test. For an item that is highly discriminating, in general the examinees who
responded to the item correctly also did well on the test, while in general the examinees who
responded to the item incorrectly also tended to do poorly on the overall test.
The possible range of the discrimination index is -1.0 to 1.0; however, if an item has
discrimination below 0.0, it suggests a problem. When an item is discriminating negatively,
overall the most knowledgeable examinees are getting the item wrong and the least
knowledgeable examinees are getting the item right. A negative discrimination index may
indicate that the item is measuring something other than what the rest of the test is measuring.
More often, it is a sign that the item has been miss-keyed.
Evaluating: Make judgments about Key Words: appraises, compares, concludes, contrasts,
the value of ideas or materials. criticizes, critiques, defends, describes, discriminates,
evaluates, explains, interprets, justifies, relates,
summarizes, supports
Creating: Builds a structure or pattern problem. Revises and process to improve the outcome.
Method
Instrument:
A self-made achievement test of 30 multiple choice items was prepared for the subject
of General Science. The items were prepared on the basis of following cognitive domains:
1. Knowledge
2. Comprehension
3. Evaluation
Participants:
For the pilot study, 50 students of 8th class from Govt. Girls Higher Secondary School
no. 1 Bagh Sardaran, Rawalpindi were selected. However, for the final study 25 students
participated.
Procedure:
Items were prepared from the subject General Science. The test was given to the 25
students from Govt. Girls Higher Secondary School, Rawalpindi. The students were asked to
provide demographic information. After that, they were asked to mark the best possible
answer according to them. They were also narrated verbally so that the students could
understand them properly. The time limit for the test was 30 minutes. After that, responses
were checked and scored and item analysis was done. Items with insufficient difficulty and
discrimination level were excluded from the test.
Specifications Chart
Total students:
Pilot study=25
Main study=25
Class: 8th
Total items=30
Item analysis
Item 1:
a b c
Upper group 0 0 7
Lower group 0 2 5
Correct response: c
P= Up+Lp/U+L
P=7+5/7+7
P=12/14
P=0.85
2. Item discrimination
D= Up-Lp/U
D=7-5/7=2/7
D=0.28
Item 2:
a B c
Upper group 7 0 0
Lower group 5 1 1
Correct response: a
P= Up+Lp/U+L
P=7+5/7+7
P=12/14
P=0.85
2. Item discrimination
D= Up-Lp/U
D=7-5/7=2/7
D=0.28
Item 3:
a b c
Upper group 0 0 7
Lower group 0 2 5
Correct response: c
P= Up+Lp/U+L
P=7+4/7+7
P=11/14
P=0.78
2. Item discrimination
D= Up-Lp/U
D=7-4/7
D=3/7
D=0.42
Item 4:
a b c
Upper group 0 1 6
Lower group 4 3 0
Correct response: b
P=6+3/7+7
P=9/14
P=0.64
2. Item discrimination
D= Up-Lp/U
D=6-3/7
D=3/7
D=0.42
Item 5:
A b c
Upper group 1 0 6
Lower group 1 0 6
Correct response: c
P= Up+Lp/U+L
P=6+6/7+7
P=12/14
P=0.85
2. Item discrimination
D= Up-Lp/U
D=6-6/7
D=0/7
D=0
Item 6:
A b c
Upper group 7 0 0
Lower group 4 0 3
Correct response: a
P= Up+Lp/U+L
P=7+5/7+7
P=12/14
P=0.78
2. Item discrimination
D= Up-Lp/U
D=7-5/7
D=2/7
D=0.28
Item 7:
a b c
Upper group 0 0 7
Lower group 4 0 3
Correct response: c
P= Up+Lp/U+L
P=7+3/7+7
P=10+14
P=0.71
2. Item discrimination
D= Up-Lp/U
D=7-3/7
D=4/7
D=0.57
Item 8:
a b c
Upper group 2 0 5
Lower group 5 1 1
Correct response: c
P= Up+Lp/U+L
P=5+1/7+7
P=6/14
P=0.42
2. Item discrimination
D= Up-Lp/U
D=5-1/7
D=4/7
D=0.57
The item will remain in the test.
Item 9:
a b c
Upper group 4 1 2
Lower group 0 2 5
Correct response: a
P= Up+Lp/U+L
P=4+0/7+7
P=4/14
P=0.28
2. Item discrimination
D= Up-Lp/U
D=4-0/7
D=4/7
D=0.57
Item 10:
a b c
Upper group 0 2 5
Lower group 0 4 3
Correct response: b
P= Up+Lp/U+L
P=2+4/7+7
P=6/14
P=0.42
2. Item discrimination
D= Up-Lp/U
D=2-4/7
D=-2/7
D=-0.28
Item 11:
a b c
Upper group 0 2 5
Lower group 5 2 0
Correct response: c
P= Up+Lp/U+L
P=5+0/7+7
P=5/14
P=0.35
2. Item discrimination
D= Up-Lp/U
D=5-0/7
D=5/7
D=0.71
a b c
Upper group 1 0 6
Lower group 2 0 5
Correct response: c
P= Up+Lp/U+L
P=6+5/7+7
P=11/14
P=0.78
2. Item discrimination
D= Up-Lp/U
D=6-5/7
D=1/7
D=0.14
Item 13:
a b c
Upper group 1 6 0
Lower group 1 6 0
Correct response: b
P= Up+Lp/U+L
P=6+6/7+7
P=12/14
P=0.85
2. Item discrimination
D= Up-Lp/U
D=6-6/7
D=0/7
D=0
Item 14:
a b c
Upper group 1 3 3
Lower group 3 3 1
Correct response: c
P= Up+Lp/U+L
P=3+1/7+7
P=4/7
P=0.28
2. Item discrimination
D= Up-Lp/U
D=3-1/7
D=2/7
D=0.29
Item 15:
a b c
Upper group 1 2 4
Lower group 5 1 1
Correct response: b
P= Up+Lp/U+L
P=2+1/7+7
P=3/14
P=0.21
2. Item discrimination
D= Up-Lp/U
D=2-1/7
D=1/7
D=0.14
Item 16:
a b c
Upper group 6 1 0
Lower group 6 1 0
Correct response: a
P= Up+Lp/U+L
P=6+6/7+7
P=12/14
P=0.85
2. Item discrimination
D= Up-Lp/U
D=6-6/7
D=0/7
D=0
Item 17:
a b c
Upper group 3 2 2
Lower group 6 1 0
Correct response: a
P= Up+Lp/U+L
P=3+6/7+7
P=9/14
P=0.64
2. Item discrimination
D= Up-Lp/U
D=3-6/7
D=-3/7
D=-0.42
Item 18:
a b c
Upper group 6 1 0
Lower group 7 0 0
Correct response: a
P= Up+Lp/U+L
P=6+7/7+7
P=13/14
P=0.85
2. Item discrimination
D= Up-Lp/U
D=6-7/7
D=-1/7
D=-0.14
Item 19:
a b c
Upper group 6 0 1
Lower group 1 3 3
Correct response: a
P= Up+Lp/U+L
P=6+1/7+7
P=7/14
P=0.50
2. Item discrimination
D= Up-Lp/U
D=6-1/7
D=5/7
D=0
Item 20:
a b c
Upper group 1 6 0
Lower group 4 3 0
Correct response: b
P= Up+Lp/U+L
P=6+3/7+7
P=9/14
P=0.64
2. Item discrimination
D= Up-Lp/U
D=6-3/7
D=3/7
D=0.42
Item 21:
a b c
Upper group 0 7 0
Lower group 0 7 0
Correct response: b
P= Up+Lp/U+L
P=7+7/7+7
P=14/14
P=1
2. Item discrimination
D= Up-Lp/U
D=7-7/7
D=0/7
D=0
Item 22:
a b c
Upper group 3 4 0
Lower group 2 5 0
Correct response: b
P= Up+Lp/U+L
P=4+5/7+7
P=9/14
P=0.64
2. Item discrimination
D= Up-Lp/U
D=4-5/7
D=-1/7
D=-0.14
Item 23:
a b c
Upper group 0 4 3
Lower group 0 5 2
Correct response: c
P= Up+Lp/U+L
P=3+2/7+7
P=5/14
P=0.38
2. Item discrimination
D= Up-Lp/U
D=3-2/7
D=1/7
D=0.14
Item 24:
a b c
Upper group 0 4 3
Lower group 6 0 1
Correct response: b
P= Up+Lp/U+L
P=4+0/7+7
P=4/14
P=0.28
2. Item discrimination
D= Up-Lp/U
D=4-0/7
D=4/7
D=0.57
Item 25:
a b c
Upper group 6 1 0
Lower group 2 2 3
Correct response: a
P= Up+Lp/U+L
P=6+2/7+7
P=8/14
P=0.57
2. Item discrimination
D= Up-Lp/U
D=6-2/7
D=4/7
D=0.57
Item 26:
a b c
Upper group 1 1 5
Lower group 0 5 2
Correct response: c
P= Up+Lp/U+L
P=5+2/7+7
P=7/14
P=0.50
2. Item discrimination
D= Up-Lp/U
D=5-2/7
D=3/7
D=0.42
Item 27:
a b c
Upper group 0 2 5
Lower group 0 6 1
Correct response: c
P= Up+Lp/U+L
P=5+1/7+7
P=6/14
P=0.42
2. Item discrimination
D= Up-Lp/U
D=5-1/7
D=4/7
D=0.57
Item 28:
a b c
Upper group 4 3 0
Lower group 2 5 0
Correct response: b
P= Up+Lp/U+L
P=3+5/7+7
P=8/14
P=0.57
2. Item discrimination
D= Up-Lp/U
D=3-5/7
D=-2/7
D=-0.28
Item 29:
a b c
Upper group 2 0 5
Lower group 4 0 3
Correct response: c
P= Up+Lp/U+L
P=5+3/7+7
P=8/14
P=0.57
2. Item discrimination
D= Up-Lp/U
D=5-3/7
D=2/7
D=0.28
Item 30:
a b C
Upper group 1 1 5
Lower group 3 0 4
Correct response: c
P= Up+Lp/U+L
P=5+4/7+7
P=9/14
P=0.64
2. Item discrimination
D= Up-Lp/U
D=5-3/7
D=2/7
D=0.14
Report
Total number of items was 30. On the basis of item analysis, 13 items were retained whereas
17 items were discarded. The score of the reliability calculated on SPSS was 0.80.
Achievement Test
https://www.verywellmind.com/what-is-an-achievement-test-2794805
https://www.alleydog.com/glossary/definition.php?term=Achievement+test
https://www.theclassroom.com/advantages-disadvantages-achievement-tests-3513.html
https://www.encyclopedia.com/social-sciences/applied-and-social-sciences-
magazines/achievement-testing
http://cachescan.bcub.ro/e-book/E1/580683/149-201.pdf
http://www.vkmaheshwari.com/WP/?p=181
https://proftesting.com/test_topics/steps_9.php