Subjective Answers Evaluation

Team Members:
Guide: 1. Hemanth Kumar
Mr. V Rama Krishna (19H61A0569)
Assistant Professor 2. K.Jahnavi Reddy
(19H61A0583)
3. Arun Kumar Reddy
(19H61A0597)
 ABSTRACT
Subjective paper evaluation is a tricky and tiresome task to do by manual labor.
Insufficient understanding and acceptance of data are crucial challenges while
analyzing subjective papers. This process can be time-consuming and subjective,
requiring the evaluation of various factors such as relevance, coherence, and
language proficiency. However, most of the work uses specific words to achieve this
task. It would enable educational institutes to perform tests, quiz by using different
technologies. It asks admin to create his/her set of questions. This project would be
helpful for creating practice tests, for educational institutes.
 PROBLEM STATEMENT

Subjective answer evaluation is the process of assessing the quality of a written response to a prompt, question or
task that does not have a unique or objective correct answer. The problem definition for subjective answer evaluation
involves developing a methodology for evaluating such responses in a consistent and fair manner. The evaluation of
subjective answers is often challenging as it requires the consideration of multiple factors, including the relevance of
the response, the coherence and clarity of the argument, the use of evidence and examples, the level of analysis and
critical thinking, and the overall writing quality.

TITLE
Assessment of subjective questions
online.
Short descriptive answers
A pair-wise Similarity
Similarity and paraphrasing
identification
LITERATURE SURVEY
TECHNOLOGY USED
Latent Semantic Indexing
approach ,Segmentation Technique
lexico-semantic pattern (LSP)
PDSM (pair-wise document similarity Less accuracy
measure)
clustering algorithm
LIMITATIONS
Difference of 5% in the results
As a result, the system performed
better than the existing system by
0.137
As a result, pre-trained embedding
with labeled data from experts
provided better recall and precision
of 0.87 and 0.782 for K-means.
 EXISTING SYSTEM
The first problem is that there are loads of hard copied documents being generated.
This brings us to the age-old discussion of keeping information in the form databases
versus keeping the same on sheets of paper. Keeping the information in the form of
hard-copied documents leads to the following problems:
I. Lack of space
II. Filing poses a problem
III. Filtering is not easy
IV. Reviewing becomes time-consuming
V. Result Processing is slow
 PROPOSED SYSTEM
To solve these problems they required a computerized system to handle all the works. They required a web based
application that will provide a working environment that will be flexible and will provide ease of work and will reduce the
time for report generation and other paper works.
Advantages:
Administrator has the highest authority to add exam and delete users
Students can only view their test records
 They should be able to login with their id, name.
 They should be able to give the exam as per the details entered by respective admin.
 Also they should be able to view their score after test finishes.
 If already given the test then they should just be able to view their scores.
 The questions should be selected randomly from the database.
The test is time limited so the candidates appearing will have limited time to answer the best.
 HARDWARE & SOFTWARE REQUIREMENTS
HARDWARE AND SOFTWARE SPECIFICATION:
Software Requirement:
1. Language-python
2. OS-Windows 7 32bit
3. MySQL Server
4. NetBeans IDE 7.1.2
Hardware Requirement:
1. 1 GB RAM
2. 80 GB Hard Disk
3. Above 2GHz Processor
4. Data Card
ARCHITECTURE
UML DIAGRAMS:
Use Case Diagram
Activity Diagram:
Sequence Diagram
Class Diagram
RESULTS
 CONCLUSION
The techniques discussed and implemented in this project should have a high agreement (up to 90 percent) with
Human Performance. The project works with the same factors which an actual human being considers while
evaluation such as length of the answer, presence of keywords, and context of key-words. Use of Natural
Language Processing coupled with robust classification techniques, checks for not only keywords but also the
question specific things. Students will have certain degree of freedom while writing the answer as the system
checks for the presence of keywords, synonyms, right word context and coverage of all concepts. It is concluded
that using ML techniques will give satisfactory results due to holistic evaluation. The accuracy of the evaluation
can be increased by feeding it a huge and accurate training dataset. As the technicality of the subject matter
changes different classifiers can be employed. Further improvement by taking feedback from all the stakeholders
such as students and teachers can improve the system meticulously.
 REFERENCES

[1] Hu and Xia proposed a Latent Semantic Indexing approach for the assessment of subjective questions online.
[2] Kushner et al. presented a novel concept of using Word Mover’s Distance (WMD) to find the dissimilarity between
two texts.
[3] Kim et al. proposed a method to grade short descriptive answers

[4] Oghbaie and Zanjireh proposed a pair-wise Similarity

[5] Orkphol and Yang used the word2vec approach

[6] Xia et al. combined the word2vec approach with the legal document corpus
[7] Wagh and Anand proposed a multi-criteria decision-making perspective to find the Similarity between legal
documents.
THANK YOU