PAMANTASAN NG LUNGSOD NG MUNTINLUPA

DEVELOPMENT OF AN AUTOMATED EXAM CHECKER SYSTEM WITH

DATA VISUALIZATION FOR SUCAT ELEMENTARY SCHOOL

A Capstone Project Presented to the Faculty of the

College of Information Technology and Computer Studies
Pamantasan ng Lungsod ng Muntinlupa
City of Muntinlupa

In Partial fulfillment of the requirements for the Degree

Bachelor of Science in Information Technology

LIMPUASAN, ARDEN JOY G.

DELA CRUZ, ANGELU T.
PANELO, SHIENA MAY P.
 PAMANTASAN NG LUNGSOD NG MUNTINLUPA

ACKNOWLEDGEMENT

We would like to express our sincere gratitude to our thesis adviser Mr. Ricky
Dimaapi for the continuous help, support, and always open whenever we ran into a
trouble spot or had a question about our thesis research, Development of an
Automated Exam Checker System with Data Visualization for Sucat Elementary
School. For his patience, motivation and knowledge. His guidance helped us in
writing and finishing our thesis research. This thesis research wouldn’t be this better if
we don’t also have a better adviser and mentor. He consistently allowed this paper to
be our work, but steered us in the right direction whenever he thought we needed it.

Furthermore, we would also like to thank our three panelist Mr. Christian
Bana, Mr. Alni Casacop and Ms. Vicky Solatorio for the encouragement, questions
and all the recommendation that are given to the proponents that made this research
better.

We would also like to extend our sincere gratitude to Sucat Elementary School
for giving us an idea and opportunity to help their community and our sincere thanks
to Pamantansan ng Lungsod ng Muntinlupa for molding us to our best and helping us
to step close to our dreams. This is just the beginning of our journey.

Lastly, we would like to thanks our parents for their love, guidance and
unfailing support and continuous encouragement throughout the years of our study
and through the process of researching and writing this thesis. This accomplishment
would not have been possible without them and we would also like to thank God
Almighty for giving us the strength, knowledge, ability and opportunity to undertake
this research study and to persevere and complete it satisfactorily. Without His
blessing, this achievement would not have been possible.
 PAMANTASAN NG LUNGSOD NG MUNTINLUPA

EXECUTIVE SUMMARY

In 1912, Sucat Elementary School was established and it is situated in the

middle part of the community that located at Purok 4, Manuel L. Quezon Street,
Sucat, Muntinlupa City. At first, the community has a low count of population and as
the years goes by, the population of the students are numerously increasing.

Furthermore, Sucat Elementary School was conducting manual checking and

manual getting of item analysis that took one week to gather. It consumed days and
time before classes resume. For this reason, faculty members are having trouble with
the students’ record, there are times when teachers are confused in recording the
student exam and because of every teacher confusion, mistakes cannot be avoided
when recording each student examination results, some student unintended to get a
low grade in their total average especially that the exam has a big percentage in the
grading system.

The proponent came up with this system that could lessen the time being
consumed by the teachers and student. A fastest and accurate way of getting the
student results and item analysis that used by the teachers for student lesson recap or
reviewer. This system need to input student number to put the result directly to its
specific student record. After inputting the student number, the papers are ready for
scanning and automatically save the result to the right student.

In additional, the F.O.E or frequency of error and also known as item analysis
are also automatically tally and gathered upon checking each student examination
papers. With this, the teachers have a lot of time to prepare for the lessons recap the
next day.
PAMANTASAN NG LUNGSOD NG MUNTINLUPA

TABLE OF CONTENT

PRELIMINARIES

CHAPTERS

1: INTRODUCTION

Project Context 3

Purpose and Description 5

Objectives of the Study 6

Scope and Limitations

2: REVIEW OF THE RELATED LITERATURES AND STUDIES

Technical Background 9

Related Literature 10

Related Literature 14

Definition of Terms 17

3: METHODOLOGIES

Requirement Analysis 20

Requirement Documentation 23

Design of Software, System, Product and/or Process 25

Development and Testing 28

Development Procedure 29

Evaluation Instrument 33

Testing Procedure 34
PAMANTASAN NG LUNGSOD NG MUNTINLUPA
Implementation Plan 35

LIST OF FIGURES

FIGURES

1 Existing System of S.E.S 21

2 Context Data Flow Diagram 22

3 Functional Decomposition Diagram 23

4 Conceptual Framework Diagram 25

5 System Architecture 27

6 Waterfall Model System Development

Life Cycle 29

7 HIPO Diagram

8 Main Scene

9 Login Form

10 Control Menu/Main Menu

11 Examination Form

12 Adding Examination Form

13 Exam Title Added Form

14 Process of Creating Examination F

15 Editing Correction Keys Form

16 Scanning Paper Form

17 List of Student Form

18 Adding New Student Form

PAMANTASAN NG LUNGSOD NG MUNTINLUPA
19 Classes Form

LIST OF TABLES

TABLES

1 Testing Procedures Conducted 34

2 Likert Scale Measurement 35

3 Implementation Plan 36

4 Testing Results Conducted

5 Evaluation from Actual User

6 Evaluation from IT Expert

REFERENCES 38
PAMANTASAN NG LUNGSOD NG MUNTINLUPA

APPENDICES

EVALUATION TOOL SAMPLE

APPROVED TITLE

LETTER OF IMPLEMENTATION

USER’S MANUAL

REQUEST LETTER
Adviser
Panelist
Language Editor

ENDORSEMENT

RELEVANT SOURCE CODE

RESEARCHERS PROFILE
 PAMANTASAN NG LUNGSOD NG MUNTINLUPA

CHAPTER 1

INTRODUCTION

Project Context

In present generation, manual system took too much time to community and

this can be seen as the reason why people choose to find an easiest way to lessen the

time being consumed. Technology is one of the best solution for this problem. It has

been innovated in different kinds of purposes, as for business, school works,

marketing and even household chores.

In 1912, Sucat Elementary School was established and it is situated in the

middle part of the community that located at Purok 4, Manuel L. Quezon Street,

Sucat, Muntinlupa City. The school has shown improvement with the construction of

the first semi-permanent two-storey building composed of six rooms. Thus, more

buildings and school rooms were constructed because of tremendous increase of

population.

Presently, the school now has a numerous number of students, ten sections

with more than forty students per room from first to sixth grade. For instance, there is

still a chance that more students may be added per room as more than as what

expected.
 PAMANTASAN NG LUNGSOD NG MUNTINLUPA
The student population growth cannot be prevented. For this reason, faculty

member having trouble with the students’ record, there are times when teachers are

confused in recording the student exam and because of the professor/teachers

confusion, mistakes cannot be avoided when recording each student examination

results, some student unintended to get a low grade in their total average especially

that the exam has a big percentage in the grading system. In addition, teachers also

looking for the class F.O.E or Frequency of Error where most of the class has a

mistake. To know what the class does not really understand. This is one of the basis

where teachers should more focus on teaching the students. It also serves as the mini-

reviewer for the students.

Therefore, students do not comply with it. Student might change their answer

while checking of the paper just to get a high grade. While when looking for

Frequency of Error, some student does not take it seriously. Sometimes student is

mistaken to raise their hands in some items that are wrong and some student

forgetting or too lazy to raise their hand in other number of item. Which lead to the

professor/teachers to wrong recording of data.

The proponents aim to develop this system for the Sucat Elementary School to

help the school to have an easy way of getting the better result of examination that

will automatically tally each number of item and to lessen the time of recording the

student examination papers.

Purpose and Description

 PAMANTASAN NG LUNGSOD NG MUNTINLUPA
The Exam checker has three primary purposes; First is to recognize individual

student ID number/name of student, to save or input information of the examination

paper to the right student; Second is automatically recorded the result of the checked

exam paper directly to the student information, after the process of scanning the

papers the result will automatically uploaded to the system; Lastly, tally the frequency

of error per items, to easily know what item have the most wrong answers of student;

It sort the data file of all the student properly and alphabetically. Automated exam

checker system will detect the examination paper and then recognize the name of the

student to sort the information that will be save. This project has data visualization

that will give more efficient, clear and better examination result of the student.

The automated exam checker system has the following features: To

automatically detect the answers of the exam by scanning the papers of each student.

To distinguish the error of each items for easily getting the Frequency of Error. To

count the correct and wrong answer each items that will provide the result of the

examination. Capable of saving information of each student to prevent losing of data.

Able to view the result of the examination of the student to prevent shouting of score

of each student also to lessen the time consumed.

The proponents aimed to develop Automated Exam Checker System for Sucat

Elementary School to help the Staff, Teacher, Faculties for easy way of getting better

result that will lessen the time of checking and recording the examination paper of

each students, to maximize the resources that the school have and also to have a fair
 PAMANTASAN NG LUNGSOD NG MUNTINLUPA
checking of examinations. The system is designed in such manner that can operate

easily by the users. It doesn’t need internet connection to run the program. It is built to

run the system offline to avoid consuming of data/internet that can cause hassle to the

users.

Objectives of the Study

The main objective of the project is to develop an automated exam checker for

Sucat Elementary School with data visualization, to help the faculty and staff of the

school for reliable, efficient and accurate result that will lessen the time of checking

and recording the examination paper of each student and to prevent the losses of

important data or information.

The specific objectives are the following:

1. To design an automated exam checker system with the following features:

a. Able to recognize ID number/name of the student;

b. Capable of automated checking;

c. Capable of sorting/arranging names of student with their score;

d. Capable of counting the correct and wrong answer.

e. Able to generate Data Visualization;

f. Able to generate frequency of Error;

2. To construct the proposed system as design;

3. To test and improve the proposed project using Alpha and Beta test;
 PAMANTASAN NG LUNGSOD NG MUNTINLUPA
4. To evaluate the performance of the proposed project using the ISO

25010:2011.

Scope and Limitations

This system can help Sucat Elementary School for an easy way of checking,

recording and arranging the names of each student. The proponents aim to build a

system that automatically recognize the examination paper, name of student, record

the result of checked paper, and sort the information alphabetically. Automated Exam

Checker System is capable of creating and editing examination key. Automated Exam

Checker System with Data Visualization is capable of recognizing Bubble Sheet using

Optical Mark Recognition (OMR) and save automatically to the system to prevent any

losses of data. Then, the detected examination of the student will be matching to the

answer key system. The result of the examination will be presented with designed

data visualization.

System can scan paper before uploading and will be compared to the

examination key for automatically checking. The system can only run in Computer-

based. The examination paper of the student can be scanned using camera with the

help OpenCV (Open Source Computer Vision) a library of programming function

used for image processing. It helps to process the examination paper before it will be

uploaded to the system. This system has limited access user it can only manage by
 PAMANTASAN NG LUNGSOD NG MUNTINLUPA
teacher, faculties and staff. Student are not allowed to access the system just only to

view the result of their examination. The project cannot be run in android based

system, proponents build this system to handle and access other application programs.

The system able to process one by one paper to be scan and recognize each

examination papers. The project can’t do multiple recognition of the examination

papers.

CHAPTER 2

REVIEW OF THE RELATED LITERATURES AND STUDIES

Technical Background

Upon reading and doing researches about the articles and other related topics

that talks about the proponents’ capstone. Automated Exam Checker System with

Data Visualization will be develop using Microsoft Visual Studio, an integrated

development environment (IDE) from Microsoft. Visual Studio uses Microsoft

software development platforms such as Windows API, Windows Form, Windows

Presentation Foundation, Windows Store and Microsoft Silverlight, that used to

develop computer programs, as well as websites, web apps, web services and mobile

apps. It can produce both native code and managed code. Automated Exam Checker

also build by Opencv that will manage the device camera to detect an object. Opencv

(Open Source Computer Vision) is a library of programming functions mainly aimed

at real-time computer vision. Originally developed by Intel, it was later supported by

 PAMANTASAN NG LUNGSOD NG MUNTINLUPA
Willow Garage. The library is cross-platform and free for use under the open-source

BSD (Berkeley Software Distribution) license.

Development of Automated Exam Checker with Data Visualization can only

be run in computer based. Using Opencv examination paper will be

detected/recognized the name, student ID/number, and the answer in each item of

examination paper. The answered paper will be compared to the answer key of the

examination. After processing, the computer will show the result of each student

examination paper. The system will automatically tally the number of error in each

items to provide fast and easy way of taking the Frequency of Error (FOE). Using the

Data Visualization, the proponent’s want to help the student and teacher to understand

all the information clearly and efficiently. Data visualization is viewed by many

disciplines as a modern equivalent of visual communication. And also makes complex

data more accessible, understandable and usable.

Related Literature

“This is the capability of a single answer sheet being scored by optical and

electronic scanning techniques. If it is desired to change the answer key, i.e., change

the sequence of some or all of the correct choices for a series of test questions, then a

new answer/score sheet combination must be printed so that the correct answers to

each group of questions will be defined on the bottom sheet for proper grading by the

test scorer.” [1]

 PAMANTASAN NG LUNGSOD NG MUNTINLUPA
“The proposed system is designed in such a manner that it is easy to use; no

special training is required to operate the system and is the most cost effective method

when the number of answer sheets to be evaluated is very large and the need is

regular. Exams are conducted using OMR answer sheet checking system because by

using this technology the conduction of exam is getting much easier, powerful, and

cheap.” [2]

“New generation reader/authenticator/validator (RAV) technology can assist

in the ID screening process for the wide variety of existing identity documents such as

passports and drivers’ licenses. Such devices can read the information on the ID,

authenticate the ID, and provide a security risk analysis.” [3]

“The system was built using the Common Lisp HrFP Server from MIT and its

functionality to generate HTML on the fly, which offers the appropriate level of

interactivity and flexibility needed to design such systems. It allows instructors to

create exams and to manage them on-line, and it includes automatic grading and

immediate feedback to students. Also, the system allows for automated scores

bookkeeping: students may check their grades at any time and so may do their

instructor.” [4]

“The test answer sheets may also include handwritten answers such as essay or

short answer questions. Systems for scanning and scoring the bubbles on such answer

sheets are known in the art. Increased difficulties are encountered, however, when

such answer sheets either include other types of answers, such as handwritten
 PAMANTASAN NG LUNGSOD NG MUNTINLUPA
answers, or cannot be machine graded. These test answer sheets are typically scored

by test resolvers either by manually scoring the physical test answer sheet or scoring

an electronic representation of the test answer sheet on a computer.” [5]

“The system receives a plurality of answer to test questions. The answers each

comprise an electronic representation of at least a portion of a test answer sheet. The

system divides the answers according to predefined categories and then organizes the

divided answers into separate groupings. Finally, the System reports the answers in

the groupings.” [6]

“The focus of this book is on validity evidence based on response processes

with the goal highlighting the importance of the rarely used form of validity evidence,

while also providing guidance to measurement researchers and practitioners in the

creating and using such evidence as a regular part of the assessment validation

process.” [7]

“The assumption that the exam will be the main focal point of the image, and

this be larger than the other objects in the image. This assumption allows to “filter”

contours, simply by investigating their area and knowing that the contour that

corresponds to the exam should be near the front of the list.” [8]

“MultiQuest is our classic multiple choice exam software-written specifically

to run on individual PCs and work with paper making sheet and OMR Scanners.” [9]
 PAMANTASAN NG LUNGSOD NG MUNTINLUPA

“Eye-grade, a system for automatic grading of multiple choice exams is

presented. Eye-grade has been designed to provide a more efficient and error-free data

collection procedure. The tool has been validated with a set of experiments that show

ease of use (both setup and operation), the reduction in grading time and an increase

in the reliability of the results when compared with conventional, more expensive

systems.” [10]

Related Literature

“The study is an online, computer aided tool that was designed primarily for

the conduct of online examination. The system was created using PHP, a web based

scripting language, and MySQL as the database software. The system focuses on the

automation of students' examinations; preparation, scheduling, checking and grading.

A database is provided for the storage of exam questions, answers to questions and

students' records. The system allows instructors to create an exam by entering

questions with its corresponding answers into the database. Instructors are provided

with three options on the type of exam; these include, True or False, Multiple Choice

and Fill in the Blanks.” [11]

“An important part of the exam is the evaluation of the students' program

codes. An automatic testing environment for evaluation of exam solutions has been
 PAMANTASAN NG LUNGSOD NG MUNTINLUPA
developed. The environment was adjusted to be applied also for manual evaluation of

program constructs and programming style. In this paper we present a study of

programs designed by the students during the maturity exam in the spring of 2010.”

[12]

“The program is written in such a way that it can be tolerate rotating the paper

in the scanning operation using the process of image registration, any kind of pencil

could be used to make the correct answer no matter its color. The program can detect

question with multiple choices and eliminate them from calculations.” [13]

“The answer key sheet is to be scanned first and to be stored in the memory

where the rest of the sheets to be scanned are being compared with. The shaded area

of the scanned sheets as well as the results of the scanned answer sheets such as the

name, ID numbers and Scores are displayed in the monitor and can be manipulated

through the software, programmed in Turbo C++.” [14]

“Methodological advances have also been made within individual procedures,

such as protocol analysis, to ensure the validity of the information obtained about

students’ cognitive processing.” [15]

“The software is user-friendly. Compatible with Windows-based software. It

has features that determine the number of items discrimination, desirability of each
 PAMANTASAN NG LUNGSOD NG MUNTINLUPA
option, item characteristics and item response theory leading to formulation of

standardized examination.” [16]

“This software application is the built to check subjective answer in an online

examination and allocate marks to the user after verifying the answer. The system

requires to store the original answer for the system.” [17]

“An automating the task of scoring subjective answer is considered. The goal

is to assign score which are comparable to those of human score by coupling AI

technologies. In this process involves many image level operation i.e. removal of pre-

printed matter, extraction and segmentation of words. Scoring is based on machine

learning of parameter and natural language processing. System checks answer and

score as good as human being.” [18]

“An automatic answer checker application that checks and marks written

answers similar to a human being. This software application is built to check

subjective answers in an online examination and allocate marks to the user after

verifying the answer. The system requires you to store the original answer for the

system. This facility is provided to the admin. The admin may insert questions and

respective subjective answers in the system. These answers are stored as notepad files.

When a user takes the test he is provided with questions and area to type his answers.

Once the user enters his/her answers the system then compares this answer to original

answer written in database and allocates marks accordingly.” [19]

 PAMANTASAN NG LUNGSOD NG MUNTINLUPA

“SikuliX uses opencv–an open source image recognition library–to detect

images on the screeen, tesseract for optical character recognition and Java Robot to

automate operating system actions like clicks and typing. This means the automated

test isn’t just able to drive a browser but instead anything the end users could interact

and see on the screen.” [20]

Definition of Terms

 OMR (Optical Mark Recognition)

- Is the process of automatically analyzing human-marked documents and

interpreting the result.

 IDE (Integrated Development Environment)

- Is a software application that provides comprehensive facilities to computer

programmers for software development. An IDE normally consists of a source

code editor, build automation tools, and a debugger. Most modern IDEs have

intelligent code completion.

 API (Application Programming Interface)

- Is a set of routines, protocols, and tools for building software applications.

Basically, an API specifies how software components should interact.

 OpenCV (Open Source Computer Vision)

 PAMANTASAN NG LUNGSOD NG MUNTINLUPA
- Is a library of programming functions mainly aimed at real-time computer

vision. In simple language it is library used for Image Processing. It is mainly

used to do all the operation related to Images.

 BSD (Berkeley Software Distribution)

- Was a Unix-based operating system developed and distributed by

the Computer Systems Research Group (CSRG).

 Lisp HrFP

- Is a family of computer programming languages with a long history and a

distinctive, fully parenthesized prefix notation. Lisp is the second-oldest

high-level programming language in widespread use today. Only Fortran is

older, by one year. Lisp has changed since its early days, and

many dialects have existed over its history. Today, the best known general-

purpose Lisp dialects are Common Lisp and Scheme.

 HTML (Hyper Text Mark-Up Language)

- Is the standard markup language for creating web pages and web

applications. With Cascading Style Sheets (CSS) and JavaScript, it forms a

triad of cornerstone technologies for the World Wide Web.

 CSS (Cascading Style Sheets)

 PAMANTASAN NG LUNGSOD NG MUNTINLUPA
- is a style sheet language used for describing the presentation of a document

written in a markup language like HTML. CSS is a cornerstone technology of

the World Wide Web, alongside HTML and JavaScript.

 PHP (Hypertext Preprocessor)

- is a server-side scripting language designed for Web development, but also

used as a general-purpose programming language.

 MySQL (My Structured Query Language)

- is an Oracle-backed open source relational database management system

(RDBMS) based on Structured Query Language (SQL). MySQL runs on

virtually all platforms, including Linux, UNIX and Windows. Although it can

be used in a wide range of applications, MySQL is most often associated with

web applications and online publishing.

 RDBMS (Relational Database Management System)

- is a collection of programs and capabilities that enable IT teams and others to

create, update, administer and otherwise interact with a relational database.

Most commercial RDBMS use Structured Query Language (SQL) to access

the database, although SQL was invented after the initial development of the

relational model and is not necessary for its use.

 PAMANTASAN NG LUNGSOD NG MUNTINLUPA

CHAPTER 3

METHODOLOGIES

Requirement Analysis

The Proponents analyze the requirements of the organization in terms of

System Information and Functionalities. The Sucat Elementary School has no current

existing system for easily checking an examination paper. Sucat Elementary School

(S.E.S) are using the traditional checking which is manually check by the students.

The teacher writes the answer in the blackboard and the student will check the items

one by one of the examination paper. After checking the examination paper the

student will count the number of correct. And then the student will be getting the

Frequency of Error (F.O.E) by raising hand in each number of wrong items. The
 PAMANTASAN NG LUNGSOD NG MUNTINLUPA
organization takes so much time in checking and arranging examination papers. The

Automated Exam Checker System with Data Visualization has some relevance with

the Giving Answers Key Checking of Papers concept

of the

Teachers proposed project. After

Students

Recording Result Submitting Result

analyzing all the data

gathered problems encountered by the Teachers, Student, and other Staff of the

School, the proponents come out to propose the system. The proponents scheduled

meetings with the School Staff to present the proposed system and to ask for their

comments, feedbacks, and other idea regarding the prototype. The proponents will

enhance the developed system according to the additional idea, feedbacks, and

comments of the users. The Use Case diagram of “Automated Exam Checker with

Data Visualization” is illustrated below:

Step by step process of manual checking

Manual

Checking
 PAMANTASAN NG LUNGSOD NG MUNTINLUPA
Figure 1. Diagram for Existing system of Sucat Elementary School

Figure 1 shows the existing system of Sucat Elementary School (S.E.S).

Tradition checking of exam are manually check by the student in each number of

items. After checking the examination paper, student will count manually the scores

of exams. After getting the result the teacher will record all the scores in each

student manually with the class record notebook. The teacher will ask student to get

the Frequency of Error (F.O.E) in each number of wrong items. The student will get

the Frequency of Error (F.O.E) by raising hand in each wrong items and count

manually how many students are wrong in that item.

The Context Diagram shows the main process of the entire proposed system

operation, assembles the process in details into segment for quick review of the

system. Figure 2 will show how the system run,manipulate and process the automated

checking of the examination.

PAMANTASAN NG LUNGSOD NG MUNTINLUPA
 PAMANTASAN NG LUNGSOD NG MUNTINLUPA
Figure 2. Context Data Flow Diagram

Figure 2 shows the main purpose of the proposed system which are

automatically check by the system. Creating Examination key is one of the main

purpose of the system is allow create and edit the correction key of the examination.

The faculty, Teacher, ad Staff are the one who can manipulate the entire system. The

system will automatically scan, check, count the scores, and save the result of the

examination. Student can only view the records of the examination paper. Students

are not allowed to handle the propose system to prevent cheating, student might edit

the records to have high scores in exam.

Requirement Documentation

The proponent will make system that can help the Sucat Elementary School

more efficient and convenient in Checking Examination papers of the Student. Having

an Automated Exam Checker System with Data Visualization allows the School to
 PAMANTASAN NG LUNGSOD NG MUNTINLUPA
save time and increase productivity since the checking of examination papers will

easily check. Teacher, Faculty, and other Staff of the school will have time to rest and

can be start new lesson in advance. The structure of the Automated Exam Checker

System with Data Visualization is based on the needs and preferences of the user. The

diagram below shows the structure of the system in relation with user

Figure 3. Functional Decomposition Diagram for Automated Exam Checker System

with Data Visualization

Figure 3 shows the incremental process of the proposed system. It shows how

each entity are distributed and grouped by its function. Based on the given diagram

above, the Automated Exam Checker System with Data Visualization can only be run

using a Computer Based.

Each section is described as follows: Examination, provide creating new

Examination papers, Editing Key, Scanning Papers, Reviewing papers. Editing key is

creating an answer key for the selected answer sheet. Scanning Papers will scan the

examination paper of the student. Reviewing Papers will provide reports of the

scanned papers. Students Menu, this module Add New Student in the list. See result

of the test in each student. Classes, creating a Class or Section with the list of student.

And also a subject that will be having an examination.

Design of Software, System, Product and/or Process

 PAMANTASAN NG LUNGSOD NG MUNTINLUPA
The Automated Exam Checker System with Data Visualization, as

stated above, is a Computer-based system. The proponents discussed what software

application must be used, what hardware components must be obtained, what type of

approach that would map out the actions required in building a System and what

output the proponents desired to achieve. Figure 4 Below is the illustration diagram

that showed the Input, Process and Output model of Automated Exam Checker with

Data Visualization:

Input Process Output

Knowledge
Requirements
Requirement Phase
- System Development Gathered data and
- Programming initiated the project
- Data Visualization AUTOMATED
- Hardware/ Software User Design Phase EXAM CHECHEK
Integration Interface and logical WITH DATA
- Checking Examination design of the system VISUALIZATION:
Procedure
System development A COMPUTER-
Software Requirements Actual BASED EXAM
coding/Programming CHECKER FOR
- Windows 7 to 10 SUCAT
- Microsoft Visual Studio Testing Phase ELEMENTARY
- OpenCV System testing and SCHOOL
- MySQL implementation
- Adobe Photoshop CS6

Hardware
Requirements

- PC Unit/Laptop
- Camera (for scanning)
EVALUATION
 PAMANTASAN NG LUNGSOD NG MUNTINLUPA

Figure 4. Conceptual Framework Diagram for Automated Exam Checker System

with Data Visualization

Figure 4 shows the conceptual model of Automated Exam Checker System

with Data Visualization. It illustrates the Input-Process-Output (IPO) of the

Computer-based system and how the system itself will be created. The input has three

main categories: Knowledge, Software, and Hardware requirements in which these

requirements are stated above.

This project is technically a Computer-based Automated Exam Checker

System

with Data Visualization. The project we use different programming language such as

C++ for the system structure, Microsoft visual studio for the design, EmguCV for

camera scanning and MYSQL for the database. In creating this project, the

proponents conducted several interviews to different programmers which the system

they are creating is related to the system that the proponents created.

The process states the strategies and techniques in completing the plan with

the

use

of
 PAMANTASAN NG LUNGSOD NG MUNTINLUPA
Waterfall Model System Development Life Cycle (WMSDLC) methodology for this

study. This methodology is composed of six phases such as Requirements Analysis,

System Design, Implementation, Integration and Testing, Deployment of System, and

Maintenance. It emphasizes how the system will be developed. Lastly, the output

which is the product of this study will undergo an alpha and beta testing.

Figure 5. System Architecture for Automated Exam Checker with Data

Visualization

Figure 5 illustrates the structure of the proposed system. It represents the

relationships of the entities to each other. Examination Answer sheet will be scanned

and process to upload the file to the system and review the file then the file will be

process for checking. The result will show the scores, and wrong items of the

examination papers. The result will undergo to the system and save to the database.

Result can be access and viewed in the system. The diagram shows how the user will

manipulate the system in creating, scanning, processing, and giving the result of the

examination paper of the student. Diagram illustrate the procedure of the how to use

the Automated Exam Checker System with Data Visualization it shows the main

purpose of the system.

Development and Testing

 PAMANTASAN NG LUNGSOD NG MUNTINLUPA
In this phase the system will be tests to determine if the proposed project

designed will meets the initial set of objectives. Proponent will be performing the trial

and error case for what will be the structure of the system in Development and

Testing. The proponent will check the system if it is connected to the database and if

the system does not have errors. Programming and debugging will be next step. This

process is being done to test if the hardware and program are working in accordance

to its design and specification. During debugging, all data are being collected will be

used to produce correlation data ensuring that the readings are all within specification.

Development Procedure

The Waterfall Model System Development Life Cycle(WMSDLC) was used

in developing the system. This part of the study will unfold and discuss the different

phases the project will go through, how the system will be conducted, regulated and

developed.
 PAMANTASAN NG LUNGSOD NG MUNTINLUPA

Figure 6. Waterfall Model System Development Life Cycle(WMSDLC) for

Automated Exam Checker System with Data Visualization

Figure 6 shows the System Development Life Cycle of the proposed system,

where the proponents will use to conduct the study. This methodology is composed of

eight phases such Requirements Analysis, System Design, Implementation,

Integration and Testing, Deployment of System, and Maintenance. It lets the users to

be involved from Requirements Analysis to the development of the Automated Exam

 PAMANTASAN NG LUNGSOD NG MUNTINLUPA
Checker System with Data Visualization for Sucat Elementary School. The

WMSDLC help the proponents to development process as the users help in providing

feedbacks, comments, and questions regarding to the system being develop, in order

to know if the requirements of the users are considered.

WMSDLC consists of four (6) stages which begin by requirements wherein it

includes system planning and system analysis to determine the expectations for the

system. Right after the planning is designing – wherein it will describe how the

project will look like and function. Implementation phase will come after a complete

understanding of system requirements and specifications. Testing will be done to

ensure the satisfaction of the user. The last phase, Operation and Maintenance, will be

carried out to maintain, introduce and to test the functionality of the completed

system.

Before the proponents start, Initiation & Feasibility must be conducted. This is

where the proponents would go and look at client current system to see how the

proponent could improve if possible. The reasons proponents would do this is because

there could be a number of problems like it being too slow. Once you have found out

the all the problems and boundaries proponents will report back to the client.

Proponents will do a feasibility study on the current system to see if making a

new system is feasible: financially and worthwhile making. This study is made to

determine if the project should be given a go, if it is not given the go then team cannot
 PAMANTASAN NG LUNGSOD NG MUNTINLUPA
do the project and the client will have to find another team. By the end of the study

you should have a project plan for the future stages of the cycle.

Requirement Analysis

In this phase, the proponents decide exactly what project is to be done. All

possible requirements will be established, which will start from planning until the

project is initiated. Building a plan is the most vital step to have a successful output.

Determining all the possible problems that might occur while developing the system,

as well as the resources is done in this phase. Also, the proponents study on how the

project would be different from the existing project that is closely related to the

proposed one; distinction of the project is well-planned. This phase focuses on the

requirements of the project. All the requirements needed for the project is defined and

listed seemly -- the users of the system, how would be the flow of the project and the

expectations of the end-users. Also, requirement specification document is created

which serves as the guideline for the next phase.

User Design Phase

This phase comes after a good understanding of system requirements.

Designing the system includes defining its elements, interfaces, type of data to use.

The

proponents study the flow of checking in Sucat Elementary School to have a clear

vision on how the activity will be include in the system. Therefore, the content of the

project is based on the manual checking of school so that the system would be more
 PAMANTASAN NG LUNGSOD NG MUNTINLUPA
reliable for the teachers, faculties and staff to use. The created layout will help the

proponents to identify what software to download to program the system and what

hardware specifically to use that could carry the entire project’s data. Developers are

very careful upon filtering and sorting data that has been researched.

Implementation

With inputs from the system design, the system is first developed in small

programs called units, which are integrated in the next phase. Each unit is developed

and tested for its functionality, which is referred to as Unit Testing.

Integration and Testing 

All the units developed in the implementation phase are integrated into a

system after testing of each unit. Post integration the entire system is tested for any

faults and failures. Right after the code is developed the unit testing, application

testing and integration testing, will be done to make sure if the project actually solves

the needs addressed and gathered during the requirements phase and to validate if the

system meets the satisfaction of the end-user.

Deployment of System 

Once the functional and non-functional testing is done, the product is

deployed to the end-users, specifically Teachers.
 PAMANTASAN NG LUNGSOD NG MUNTINLUPA
Maintenance 

Maintenance will be done only if any failures occur while testing the

computer application or there are some issues which come up in the client

environment. To fix those issues, patches are released. Also to enhance the product

some better versions are released. Maintenance is done to deliver these changes in the

customer environment.

Testing Procedure

Testing is one of the most important phases of a system’s development. It

takes the form of testing the functionality of each component and then testing the

complete integrated system.

The testing procedure consists of Alpha and Beta testing. Alpha testing was

performed by the project team in order to find bugs that might be found. It involved

simulating a real user environment by carrying out tasks and operations. Beta testing

was the second phase of the system’s testing. It is also known as field testing because

it takes place at the user’s site.

Table 1.

Component Test to Conduct

Installation of System Double Tap the icon to run the System

 PAMANTASAN NG LUNGSOD NG MUNTINLUPA

Create or Login User Input and save users name

Installation of Application in other Install the system to Computer with

devices different resolutions and Computer-
based

Tutorial display of images and texts Tap the button to show tutorial texts and
images

Testing Procedures to be Conducted for Automated Exam Checker System with Data
Visualization

Table 1 show the Testing procedures of Automated Exam Checker System

with Data Visualization. Once the system is done the proponents must check or test if

the system is compatible to other computer-based in different resolution. By installing

the system to other computer it can be test if it is properly running and all the

components are functioning.

Evaluation Instrument

The evaluation instrument was based on the characteristics and sub-

characteristics provided by ISO/IEC 25010:2011.

Respondents of the study will be the individual users of the system such as

the ten (10) Information Technology (IT) experts, twenty (20) actual users such as

Teacher, and Staff and ten (10) Faculty. Purposive sampling will be used to select the

number of respondents. Purposive sampling is a non-probability sampling technique;

 PAMANTASAN NG LUNGSOD NG MUNTINLUPA
it is a form of sampling in which the selection of the sample is based on the judgment

of the researchers as to which subjects.

Table 2.
Likert Scale Measurement for Evaluation Result Interpretation

Scale Range Interpretation

T h e s t a t i s t i c
5 4.51-5.00 Excellent

4 3.51-4.50 Very Good

3 2.51-3.50 Good

2 1.51-2.50 Fair

1 1.00-1.50 Poor

arithmetic mean as shown in Table 2. Arithmetic mean is used to determine the

average responses of the five options in each item, namely 5(excellent), 4(very good),

3(good), 2(fair) and 1(poor). The arithmetic means for each software characteristics

were computed. These were used to derive the evaluation mean.

Implementation Plan

The developed system will be used for Sucat Elementary School as part of the

implementation plan of the project. All the proponent will give the developed system

as agreed by all proponents. If the system will be implemented properly, there will be

an update and maintenance on the proponent’s end.

Table 3.
Implementation Plan for Automated Exam Checker System with Data Visualization
 PAMANTASAN NG LUNGSOD NG MUNTINLUPA

Table 3 shows the implementation plan the proponents will do once the system

development is completed. The proponents must seek the approval of the panels and

adviser to upload and publish the system. Once the approval is done, the proponent

must send the system to the beneficiaries which is Sucat Elementary School right

away after the approval and revision to present it once more to the Teacher, Faculty,

and Staff of the Sucat Elementary School. If the beneficiaries want to adopt the

developed system, the proponents must hand over the system together with its

documentation. It will serve as a guide to the users who will using the system. There

would be a letter of endorsement that the system will be hand over to the beneficiaries

freely.

CHAPTER 4
 PAMANTASAN NG LUNGSOD NG MUNTINLUPA
RESULTS AND DISCUSSION

Project Description

The Automated Exam Checker System aimed to help the Staff,

Teacher, Faculties for reliable, efficient and accurate result that will lessen the time of

checking and recording the examination paper of each students, to maximize the

resources that the school have and also to have a fair checking of examinations. To

help the school to have an easy way of getting the better result of examination that

will automatically tally each number of item and to lessen the time of recording the

student examination papers. The system able to process one by one paper to be scan

and recognize each examination papers. The system is designed in such manner that

can operate easily by the users.

Project Structure

Figure 7. HIPO Diagram

 PAMANTASAN NG LUNGSOD NG MUNTINLUPA

Figure 8. Main Scene for Automated Exam Checker System

Figure 8 shows the Main Scene for Automated Exam Checker System. The

main scene will always show every time the user runs the program. The main scene is

just a quick preview that take 5 seconds before it changes to Log-in Forms.

The program has three (3) major sections that are categorized by its functions

and capabilities. The first is the Examination Section that houses the creating or

adding of exam, editing keys, scanning papers, and the result. The second one is

Student Section that consists of adding student and records of all student. The last one

is the Class Section where all the student arranged by each section.
 PAMANTASAN NG LUNGSOD NG MUNTINLUPA

Figure 9. Login Form

The figure 9 show a Login in the system, in this form identify and filtered out

the users who using the system. Input your username and password and system verify

your account. If your account is correct the system will verify and then you may

proceed to the main menu. Else if not there will be a warning message that the

account you entered is not authorized to access the program.

 PAMANTASAN NG LUNGSOD NG MUNTINLUPA
Figure 10. Control Menu / Main Menu

The figure 10 show Main Menu of the system, in this form, user can choose

where in the system want to go. As we can see in figure 10 there are three (3) major

sections that are categories by its functions. The Examination where the users can add

or create exam, editing keys, and scanning papers. The other one is Student that

handles all the records and information of all student, and also handles the registration

of new student. Last one, the Class where all the student arranged by each section. All

of this three major section handles different forms of the system but connected to one

another.

Examination Adding
Button Search Examination
Button
 PAMANTASAN NG LUNGSOD NG MUNTINLUPA
Figure 11. Examination Form

The figure 11 show the Examination Form, if we click the Examination at the

left side in the Main Menu figure 11 will show the examination form where you can

start adding exam, checking exam, viewing result, editing keys and scanning papers.

Figure 12. Adding Examination Form

The figure 12 will show Adding Examination Form after clicking the Add

button in the examination form at the Main Menu, the user was created Title for the

student examination. To recognize what Examination should be process or should be

done. After clicking the Save button or simple saving the examination title, it will be
 PAMANTASAN NG LUNGSOD NG MUNTINLUPA
listed in the examination menu. Figure 13 will show where the saved title will proceed

after saving it.

Figure 13. Exam Title Added Examination

Title Added

The figure 13 show the Exam Title Added that were created in the Adding

Examination Form. The created title or saved title will be showed in the Examination

form if the user will be going to click the created title it will proceed to another form

where the Edit keys, scanning of papers and result are located. The user can start

making or editing keys, and scanning the papers of each student. The result will be

done after scanning all the papers of each students. Each scanned paper will record in

the corresponding student.

 PAMANTASAN NG LUNGSOD NG MUNTINLUPA

Figure 14. Process of Creating Examination

The figure 14 show the Process of creating examination, the editing of correct

keys, scanning of papers and viewing the result of examination. It will appear when

the Exam Title Added are selected or clicked by the users.

Figure 15. Editing Correct Keys

 PAMANTASAN NG LUNGSOD NG MUNTINLUPA

Figure 15 show the Editing of correct keys for the checking of examination

papers, it allows the user to set or create correction key for the specific examination.

Figure 16. Scanning Papers

The Figure 16 show Scanning of Papers, it counts the number of papers that

are already scanned and save the information by clicking the save button. And also

give the score of each scanned papers.

Adding Button
For New
Student
 PAMANTASAN NG LUNGSOD NG MUNTINLUPA
Figure 17. List of Students

Figure 17 show the List of Students, when the user clicked the Student Button

at the left side of the program student list will show and all the records and the result

of examination. If the users want to find the specific student, users can use the search

bar to find specific student same as deleting record, users need to put the ID Number

of student before clicking the delete button.

Figure 18. Adding of New Student

The figure 18 show the Adding of New Student, entering the specific

information of the student that will be added. After inputting information of student,

the data or information will save at the SQL databases.

 PAMANTASAN NG LUNGSOD NG MUNTINLUPA

Figure 19. Classes

The Figure 19 show the Classes; it will sort or arranged all the student

according to their class or sections. Also can view all the result of the examination of

all the student that are already taken the exam or done of checking the examination

papers.

Project Capabilities and Limitations

The following are the capabilities and limitations of Automated Exam Checker

System with Data Visualization: A Computer-Based program for the Sucat

Elementary School.
 PAMANTASAN NG LUNGSOD NG MUNTINLUPA

Capabilities

1. The programs allow the user to login before accessing the system.

2. The program is capable of creating or adding new examination.

3. The program is capable of creating correction keys.

4. Capable of scanning examination papers.

5. The program also capable to save the scanned paper of examination to the

corresponding student.

6. It can also show the result of all examination in each student.

7. Registration of new student is also one of the capabilities of the program.

8. Program also capable of sorting student in each section.

9. The program can remove student in list or records.

10. The program can be run in without the internet connection.

Limitations

1. The program is intended only for Sucat Elementary School.

2. Student are not allowed to access the system.

3. Student can only view the result with the help of the teacher and faculties

who can only access the system.

4. The scanning of papers can only scan one by one.

5. The program can only be installed and run using a computer or laptop.
 PAMANTASAN NG LUNGSOD NG MUNTINLUPA

The main components and objectives of the program have been attained as to

what the result shows in table 4. The functions needed were achieved as they were

proposed and required by the program.

Table 4.
Testing Results Conducted for Automated Exam Checker System with Data
Visualization
Test Conducted Result
Create or Edit correct keys Successfully create and edit
correction keys as the users want.

Scanning of papers Successfully Scanned Examination

Adding New Student
Save in SQL and update data
papers. Detect corresponding circles.
Successfully registered new student
and save to the SQL database.
It’s successfully save and add Student
Records

Teacher and Faculties Can access all the buttons in the

program.

The testing result table as shown in table 4 was a test conducted by twenty

(20) evaluators which are actual users and IT Experts. Ten (10) were actual users that

consists of five (5) Teachers and five (5) Faculty member, while ten (10) were IT

Experts. Automated Exam Checker System with Data Visualization was tested

successful and was properly executed by the system. The system also checked by their

own computers and printers to test how the system will run.
 PAMANTASAN NG LUNGSOD NG MUNTINLUPA

Project Evaluation

To evaluate the project capabilities, the proponents conducted an actual testing

and evaluation process for the application. The evaluation instrument was based on

the characteristics and sub-characteristics provided by ISO/IEC 25010:2011

Evaluation Instrument. The evaluation instrument provides numerical rating to scale

the criteria for the prototype and software materials, where five (5) is the highest and

one (1) is the lowest. It suggests a software metrics (Excellent, Very Good, Good, Fair

and Poor).

Table 5.
Summary of Overall Mean Score Evaluation from Actual Users
Indicators Mean Descriptive Meaning
A. Functionality 4.46 Very Good
B. Content 4.54 Very Good
C. Reliability 4.15 Very Good
D. Availability 4.62 Very Good
Overall Mean 4.44 Very Good

The summary of the overall mean score evaluation by the actual users as

shown in Table 5 was 4.44 and was rated “Very Good”. The following areas of

evaluation were the Functionality which was scored 4.46 and was rated “Very Good”

because the application provided functions that met stated and implied needs when

used under specified conditions, the area of Content which was scored 4.54 and was

rated “Very Good” because the accuracy, updated and presentation were met against

preset standard of accuracy in terms of content, the area of Reliability which was

scored 4.15 and was rated “Very Good” because the application showed consistency
 PAMANTASAN NG LUNGSOD NG MUNTINLUPA
in result and performance, and lastly, the area of Availability which was scored 4.62

and was rated “Very Good” because the program performs according to specifications

under specified conditions and provided requirements for completeness.

Table 6.
Summary of Overall Mean Score Evaluation from IT Experts
Indicators Mean Descriptive Meaning
A. Functional Suitability 4.36 Very Good
B. Performance Efficiency 4.10 Very Good
C. Compatibility 4.20 Very Good
D. Usability 4.36 Very Good
E. Reliability 4.50 Very Good
F. Portability 4.05 Very Good
Overall Mean 4.26 Very Good

The summary of the overall mean score evaluation by the IT Experts as

shown in Table 6 was 4.35 and was rated “Very Good”. The following areas of

evaluation were the Functional Suitability which was scored 4.36 and was rated “Very

Good” because the application’s completeness, correctness and appropriateness were

met, the area of Performance Efficiency which was scored 4.10 and was rated “Very

Good” because the resources used were utilized and met the requirements, the area of

Compatibility which was scored 4.20 and was also rated “Very Good” because the

application performed the required functions efficiently in a common environment,

the area of Usability which was scored 4.36 and was rated “Very Good” because sub-

characteristics such as learnability, operability, user interface aesthetics were met and

satisfied along with other sub-characteristics, the area of Reliability which was scored

4.50 and was rated “Very Good” because the application performed its intended or

required function on demand and without failure, and last is the area of Portability
 PAMANTASAN NG LUNGSOD NG MUNTINLUPA
which was scored 4.05 and was rated “Very Good” because the program ran and

worked only in computer-based.

CHAPTER 5

SUMMARY OF FINDINGS, CONCLUSION AND RECOMMENDATION

This chapter present the summary of findings, conclusion and

recommendation based from the result of evaluations, comments and suggestions.

Summary of Findings

On the basis of test and evaluation conducted on the performance of the

propose system project and system. The following are findings of the study:

For Actual User

1. Functional Suitability: the respondents rated the system project and system to

be very good because the functions required for the system is implemented;

2. Content: the respondents rated the project very good because of the good

presentation content, updated and accuracy of the project;

3. Reliability: the respondents rated the system project very good because of the

conformance of the desired result and being correct precise performance of the

system
 PAMANTASAN NG LUNGSOD NG MUNTINLUPA
4. Availability: the respondents rated the project very good because of the

difference or contrast between similarity of the project in terms of

specification and completeness of the system.

For IT Expert

1. Functional Suitability: the respondents rated the system project and system to

be very good because the functions required for the system is implemented it

to replace the Existing Manual System of Sucat Elementary School.

2. Performance Efficiency: the respondents rated proposed project and system to

be very good because it expressed as the actual output present compared with

the expected output desire.

3. Compatibility: the respondents rated the system project and system to

be very good because they notice that some part is able to exist or occur a little

conflict.

4. Usability: the respondents rated the system project and system to

be very good because the system has a degree to fit the existing manual

system.

5. Reliability: the respondents rated the proposed project and system to

be very good because the quality of being trustworthy are perform well.

6. Security: the respondents rated the computer-based project and system to

 PAMANTASAN NG LUNGSOD NG MUNTINLUPA
be very good because the state of being free but secured from any violence

issue and threat.

7. Maintainability: the respondents rated the system project and system to

be very good because the system is enable to access and operate with the user.

8. Portability: the respondents rated the system project and system to

be very good because the system has the ability to be easily carried and

operate by the user.

Conclusions

1. Based on findings, the researchers can conclude that the system was design

with features that can give the fastest way of processing the checking of

examination papers of Sucat Elementary School. Capable of sorting/arranging

the names of the student with their score, capable of counting correct answers

and able to generate Data Visualization. The researchers conclude that the

proposed system was tested.

2. They found out that the system was able to provide eases way of Checking the

Examination papers of the student and saving the result or the information of

the student properly. That the Automated Exam Checker System was

constructed as not necessary designed by the user desire.

3. That the system had been successfully tested for functional Suitability,

Performance Efficiency, Compatibility, Usability, Reliability, Security,

 PAMANTASAN NG LUNGSOD NG MUNTINLUPA
Maintainability, Portability by IT experts and tested by the actual users on the

area of functionality, content, reliability and availability.

4. That the system where evaluated by the IT experts with an overall mean score

of 4.26 and was rated “Very Good” and evaluated by the actual users with an

overall mean score of 4.44 and was rated “Very Good” based from the

evaluation, prepared and adopted from the Automated Exam Checker System

with Data Visualization.

Recommendation

1. Based on the finding and the evaluation of the study, a modification of the

developed system is recommended to further more enhance more in different

aspects such as compatibility of interface, maintainability, functionality and

usability.

2. Processing of scanning of papers may improve using scanner to easily adjust

the light and to focus only on the shaded part of the answers sheet of the

examination.

3. System design can enhance using one to three colors that are close to one

another or might use a material design or metro framework by downloading it

in the visual studio.

4. Make all fonts will be readability by the users. So, that any users can easily

read and understand what will be the use of each button in the system.
PAMANTASAN NG LUNGSOD NG MUNTINLUPA

REFERENCES

[01] Wikipedia, “Microsoft Visual Studio”, en.wikipedia.org[Online]

://en.wikipedia.org/wiki/Microsoft_Visual_Studio[Accessed:October 12,2018]

[02] google, “Image Processing Based OMR Sheet Scanning”,

ijarece.org.2015 [Online] Available:
http://ijarece.org/wp-content/uploads/2015/03/IJARECE-VOL-4-ISSUE-3-
519-522.pdf [Accessed: October 12, 2018]

[03] Wikipedia, “Opencv”, en.wikipedia.org [Online]

https://en.wikipedia.org/wiki/opencv [Accessed: October 12, 2018]

[04] Google, “Automated Authentication of Current Identity Documents”,

finance.senate.gov.2002[Online]https://www.finance.senate.gov/imo/media/
doc/080206bb.pdf [Accessed: October 12,2018]

[05] Google, “Automatic Exams and Course Administration on the Web”,

files.eric.ed.gov.1998 [Online] https://files.eric.ed.gov/fulltext/ED427743.pdf
[Accessed: October 12,2018]
PAMANTASAN NG LUNGSOD NG MUNTINLUPA
[06] Patents, “Multiple Test Scoring System”, patent.google.com.1993
[Online] https://patents.google.com/patent/US5321611/un [Accessed: October
12,2018]

[07] Categorized Test Item Reporting System

[08] Routledge, “Validation of Score Meaning Using Examinee Response

Processes for the Next Generation of Assessment”, routledge.com[online]
https://www.routledge.com/Validation-of-Score-Meaning-for-the-Next-
Generation-of-Assessments-The/Ercikan-Pellegrino/p/book/9781138898370
[Accessed: October 12,2018]

[09] Pyimage, “Bubble Sheet Multiple Choice Scanner and Test Grader Using
OMR, Python and OpenCV”, pyimage.com [online]
https://www.pyimagesearch.com/2016/10/03/bubble-sheet-multiple-choice-
scanner-and-test-grader-using-omr-python-and-opencv/ [Accessed: October
12,2018]

[10] Speedwell, “Exam Software to Manage Paper Assessment”, [online]

https://www.speedwellsoftware.com [Accessed: October 12,2018]

[11] Wikipedia, “Grading Multiple Choice Exam with Low Cost and Portable
Computer-Vision Techniques”, science.gov [online]
https://www.science.gov/topicpages/m/multiple+grade+levels.html [Accessed:
October 12, 2018]

[12] Academia, “Design and Development of an Online Exam Maker and

Checker”, Academia.edu [online]
https://www.academia.edu/5024517/DESIGN_AND_DEVELOPMENT_OF_
AN_ONLINE_EXAM_MAKER_AND_CHECKER [Accessed: October 12,
2018]
PAMANTASAN NG LUNGSOD NG MUNTINLUPA

[13] Researchgate, “Observation Semi-Automatic Testing of Program Codes

in the High School Student Maturity Exam” Researchgate.net [online]
https://www.researchgate.net/publication/247928066_Observations_from_sem
i-
automatic_testing_of_program_codes_in_the_high_school_student_maturity_
exam [Accessed: October 12, 2018]

[14] iasj, “Automatic System to Grade Multiple Choice Question Paper Based
Exam” iasj.net [online] https://www.iasj.net/iasj?func=fulltext&aId=15510
[Accessed: October 12, 2018]
[15] ijesrt, ”Design of Based Eletronic Checker for Standardized Entrance
Examination” ijesrt,.com [online] http://www.ijesrt.com/issues%20pdf
%20file/Archive-2016/July-2016/126.pdf [Accessed: October 12, 2018]

[16] taylorfrancis, “the Reats to Score Meaning in Automated Scoring”

taylorfrancis.com [online]
https://www.taylorfrancis.com/books/e/9781317483342/chapters/10.4324%2F
9781315708591-7 [Accessed: October 12, 2018]

[17] ftp.recsam, “Test Checker and Item Analyzer with Statistic”

ftp.recsam.edu [online]
http://ftp.recsam.edu.my/cosmed/cosmed09/AbstractsFullPapers2009/Abstract
/Workshop%20PDF/TEST%20CHECKER%20AND%20ITEM
%20ANALYZER%20WITH%20STATISTICS.pdf [Accessed: October 12,
2018]

[18] Wikipidia, “Automatic Answer Checker from Novenprojects.com”

Wikipidia [online] http://nevonprojects.com/automatic-answer-checker/
[Accessed: October 12, 2018]
PAMANTASAN NG LUNGSOD NG MUNTINLUPA
[19] ijaes.co, “Automatic Answer Sheet Checker” ijaes.co.in [online]
http://ijaes.co.in/wp-content/uploads/2017/06/6.Automatic-Answer-Sheet-
Checker.pdf [Accessed: October 12, 2018]