Professional Documents
Culture Documents
A Thesis Presented to
In Partial Fulfillment
By:
Jugarap, Fernando A.
Matias, Joshua G.
Vargas, Jhustine D.
May 2023
PAGE \* MERGEFORMAT 2
UNIVERSITY OF CALOOCAN CITY
Computer Studies Department
Information Technology, has been examined and is hereby recommended for oral
defense.
PAGE \* MERGEFORMAT 2
UNIVERSITY OF CALOOCAN CITY
Computer Studies Department
APPROVAL SHEET
been approved by the Committee on Oral Examination with a grade of _____% on May
__, 2023.
Accepted and approved in partial fulfillment of the requirements for the degree of
PAGE \* MERGEFORMAT 2
PROF. RAUL
UNIVERSITY OF CALOOCAN CITY GUTIERREZ
Coordinator,
Computer Studies Department BSIT
CERTIFICATE OF ORIGINALITY
paper is a product of our original research investigation. To the best of our knowledge, it
was created by our group's collaborative effort. It does not contain any material that has
contain any work that has been accepted for an award or any other degree or credential
Researchers:
Attested by:
ENECITA FRANCISCO ARLOS.
PAGE \* MERGEFORMAT 2
MAED/ English, Ph.D.
Units & LPT UNIVERSITY OF CALOOCAN CITY
Computer Studies Department
Research Project
Adviser
Date: May, 2023
CERTIFICATE OF GRAMMARIAN
This is to certify that the undersigned has reviewed and went through all the pages
of the research paper study entitled USING CHATGPT BOT AS A TOOL FOR
set of structural guidelines that regulate the construction of English sentences, phrases,
and words.
Signed: Grammarian
PAGE \* MERGEFORMAT 2
UNIVERSITY OF CALOOCAN CITY
May 2023 Computer Studies Department
ACKNOWLEDGEMENT
This study is a product of hard work and collaborative efforts of the researchers
and some special persons. The researchers would like to express their sincere gratitude
and appreciation to those who in one way or another helped bring this work to
completion.
First and foremost, we would like to praise and thank God, the Almighty, who has
granted countless blessings, knowledge, and opportunity to the writers, so that we have
been finally able to accomplish this research. Without his blessing, this achievement
would not have been possible. We would also like to thank the following persons, first;
extremely thankful to him for sharing expertise, and sincere and valuable guidance and
encouragement.
Dr. Enecita F. Arlos, Ph.D. Units MAED, MAT ENG., the researchers’ adviser,
a mentor, and Chairperson of the panel of examiners, for her Technical, brilliant
comments and suggestions that made our study more informative and reliable. And also,
for her critical evaluation of the study for his insights and recommendations which
PAGE \* MERGEFORMAT 2
contributed to the refinement of
UNIVERSITY OF CALOOCAN CITY
this work, and Computer Studies Department for patience and
us even when we wanted to give up, and thank you for being a great professor and
mentor.
To respondents, for answering the questions of the researchers, this study may
not be complete without their participation because they are the subject for this.
Last but not the least we would like to express gratitude to our family and friends
have been able to complete this research. Thank you for your cooperation, support, and
patience with one another. This thesis is only a beginning of the researcher’s journey.
ABSTRACT
PAGE \* MERGEFORMAT 2
STUDENT
UNIVERSITY OF CALOOCAN CITY
Computer Studies Department FROM
ACADEMIC PURPOSES
JUGARAP, FERNANDO A.
MATIAS, JOSHUA G.
VARGAS, JHUSTINE D.
TECHNOLOGY
Year: : 2022-2023
educational activities. In particular, ChatGPT, a large language model based on the GPT-
3.5 architecture, has emerged as a promising tool for assisting students with academic
queries. However, its effectiveness and usefulness for specific academic purposes, such
thoroughly examined.
PAGE \* MERGEFORMAT 2
This study aimed to
UNIVERSITY OF CALOOCAN CITY
investigate the Computer Studies Department effectiveness of
sought to determine the most common academic reasons for using ChatGPT, identify the
problems encountered by CSD students when using ChatGPT, and evaluate students'
satisfaction with the bot's user-friendliness and the importance of verifying the
questionnaire to collect data from 52 CSD students. The questionnaire consisted of four
sections that assessed the demographic profile of the respondents, their reasons for using
ChatGPT, the problems encountered when using the bot, and their satisfaction with its
The study found that homework and assignments were the most common
academic reasons for CSD students to use ChatGPT, followed by general IT knowledge.
Students also reported encountering problems with ChatGPT's ability to understand their
academic queries. However, overall, students were satisfied with the bot's user-
friendliness and found it easy to navigate. Students also recognized the importance of
verifying the credentials and expertise of the bot before trusting its answers.
Based on the findings, it can be concluded that ChatGPT has the potential to be an
effective tool for supporting CSD students with their academic activities. However,
improvements are needed to address the problems encountered with its understanding of
academic queries.
PAGE \* MERGEFORMAT 2
The study suggests the
UNIVERSITY OF CALOOCAN CITY
need for Computer Studies Department further research to
also recommends the inclusion of features to support homework and assignments and to
expand the bot's capabilities for general IT knowledge. Developers should prioritize the
accountability, incorporating quality control measures, and seeking out user feedback.
Overall, the study underscores the importance of staying responsive to user feedback and
continually improving the bot's capabilities to ensure it remains a valuable resource for
Table of Contents
Chapter Page
Certificate of Originality……………………………………………………… iv
Certificate of Grammarian…………………………………………………… v
Acknowledgement…………………………………………………………… vi
PAGE \* MERGEFORMAT 2
List of Tables
UNIVERSITY OF CALOOCAN CITY
Computer Studies Department
…………………………………………………………………. xiii
Introduction 1
Related Literature 9
Synthesis of the Reviewed Studies 14
Theoretical Framework 15
Conceptual Framework 17
Definition of Terms 19
Research Design 21
Respondents of the Study 22
Sampling Technique 22
Research Instruments 23
Data Gathering Procedure 24
Statistical Treatment of Data 25
PAGE \* MERGEFORMAT 2
IV.
UNIVERSITY OF CALOOCAN CITY
Computer Studies Department
PRESENTATION, ANALYSIS AND 28
INTERPRETATION OF DATA
BIBLIOGRAPHY 44
APPENDIX A 46
Survey Questionnaire
APPENDIX B 49
Letter
CURRICULUM VITAE 50
LIST OF TABLES
Table Page
PAGE \* MERGEFORMAT 2
LIST OF FIGURES
UNIVERSITY OF CALOOCAN CITY
Computer Studies Department
Figures
Pages
1 Theoretical Framework 15
2 Conceptual Framework 17
Chapter 1
of the problem, scope and delimitation of the study and significance of the study.
Introduction
The advancement of technology has paved the way for new educational
tools and resources that have made learning more efficient and convenient. One
such tool is ChatGPT bot, an artificial intelligence-based chatbot that can answer
increasingly using ChatGPT bot as a tool to aid them in their academic pursuits,
support students' learning and academic pursuits. Among the chatbots available,
still in its infancy, and there is limited research on its usage, challenges, and
the aim of this research is to explore the most common academic purposes for
which college students are using ChatGPT bot, the challenges they face while
using it, their satisfaction with the overall performance and usability of ChatGPT
bot, and their assurance of the accuracy and reliability of the bot in providing
academic performance. It will provide insights into the challenges that students
face when using the bot, which could inform the development of more effective
educational chatbots in the future. Furthermore, the research will highlight the
PAGE \* MERGEFORMAT 2
bot, which will aid in the
UNIVERSITY OF CALOOCAN CITY
improvement Computer Studies Department of the bot's
provide valuable insights into the usage, challenges, satisfaction, and assurance
of college students towards ChatGPT bot as a tool for their academic purposes.
service, healthcare, and education. In the education sector, chatbots are gaining
conversation and provides assistance to users. It has the potential to offer timely
This study aims to fill this gap by investigating the usage, challenges,
PAGE \* MERGEFORMAT 2
exploring the academic
UNIVERSITY OF CALOOCAN CITY
purposes for Computer Studies Department which college
students are using ChatGPT bot, this study seeks to identify the typical academic
reasons that college students use ChatGPT bot for. Additionally, by investigating
the challenges that students face when using the bot, this study aims to identify
the areas for improvement in the bot's design and functionality. Furthermore, this
study aims to investigate how satisfied college students are with the overall
performance and usability of ChatGPT bot as a tool for their academic purposes.
in providing answers to their academic queries, this study seeks to identify the
performance. It provides insights into the challenges that students face when
using the bot, which could inform the development of more effective educational
chatbots in the future. Furthermore, the study will highlight the assurance of
college students towards the accuracy and reliability of ChatGPT bot, which will
academic needs.
and assurance of college students towards ChatGPT bot as a tool for their
PAGE \* MERGEFORMAT 2
academic purposes.
UNIVERSITY OF CALOOCAN CITY
Specifically, Computer Studies Department this study aims to
1.1. Age
1.2. Gender
2. What are the most common academic purposes for which college
3. What are the most common challenges that college students face
4. How satisfied are college students with the overall performance and
Assumption
In conducting this study, it was assumed that the college students had
access to ChatGPT bot and are familiar with its basic features and functionalities.
They used ChatGPT bot as a tool for their academic purposes. They were willing
to share their experiences and perceptions regarding the usage of ChatGPT bot
for their academic pursuits. The data collected through surveys and interviews
PAGE \* MERGEFORMAT 2
and reliable responses to the
UNIVERSITY OF CALOOCAN CITY
academic Computer Studies Department queries of college
students.
purposes of college students from CSD in University of Caloocan City only which
respondents were selects based on who have used ChatGPT bot for their
academic pursuits. The study focused on exploring the academic purposes for
which college students are using ChatGPT bot, the challenges they face when
using the bot, their satisfaction with the overall performance and usability of the
bot, and their assurance of the accuracy and reliability of the bot in providing
The study delimits the potential bias in self-reported data and the limited
generalizability of the findings due to the study's specific focus on ChatGPT bot
and the sample size. Additionally, the study will not examine the technical
aspects of ChatGPT bot, such as its algorithms and programming, but will focus
on the user experience and assurance of college students towards the bot as a
PAGE \* MERGEFORMAT 2
UNIVERSITY OF CALOOCAN CITY
Computer Studies Department
Significance of the Study
academic purposes. The following groups may benefit from this study:
College students. The findings of this study can help college students to
better understand how to use ChatGPT bot as a tool for their academic pursuits
and can provide insights into the most effective ways to use the bot to enhance
classroom to enhance student learning outcomes. The study can provide insights
into the most common academic purposes for which college students are using
ChatGPT bot and can help educators to identify the most useful features and
ChatGPT bot Developers. The findings of this study can help ChatGPT
bot developers to improve the design and functionality of the bot to better meet
the needs of users. The study can identify the most common challenges faced by
college students when using the bot and can provide insights into the features
PAGE \* MERGEFORMAT 2
Higher Education
UNIVERSITY OF CALOOCAN CITY
Institutions. Computer Studies Department The findings of
this study can help higher education institutions to better understand how
outcomes and can provide insights into the most effective ways to integrate
Future Research. The findings of this study can serve as a basis for further
education, specifically in higher education. The study can provide insights into
ChatGPT bot as a tool for their academic pursuits, and can guide future research
PAGE \* MERGEFORMAT 2
Chapter 2
UNIVERSITY OF CALOOCAN CITY
Computer Studies Department
REVIEW OF RELATED
This chapter consist of the related literature and studies reviewed by the
programs that use natural language processing and machine learning algorithms
to simulate human conversation, and they can be used for a wide range of
delivery (Mansour & Abdel-Aty, 2021). One prominent example of a chatbot that
among college students in the Philippines. The study aimed to investigate the
college students. The results of the study showed that the students perceived
PAGE \* MERGEFORMAT 2
KUMU as helpful in
UNIVERSITY OF CALOOCAN CITY
providing Computer Studies Department quick and
accurate answers to their academic inquiries. Additionally, the study found that
the students' satisfaction with KUMU was influenced by their assurance of its
ease of use, usefulness, and reliability. The researchers suggested that the
improve their effectiveness and promote their use among college students.
academic purposes has been increasing in recent years. In their study, they
support to college students in the Philippines. The results of the study showed
that the students perceived KAI as helpful and user-friendly in providing answers
to their academic inquiries. However, the study also identified some limitations of
KAI, such as its inability to answer complex questions and its reliance on pre-
chatbots for academic purposes should address these limitations and incorporate
Based on the study conducted by Cabico et al. (2020), the use of chatbots
as a tool for academic support has become increasingly popular among college
students in the Philippines. The study aimed to investigate the factors that affect
the adoption and use of chatbots for academic purposes. The results of the study
showed that the perceived usefulness, ease of use, and social influence were
PAGE \* MERGEFORMAT 2
purposes. Additionally, the
UNIVERSITY OF CALOOCAN CITY
study found Computer Studies Department that the students'
use the tool. The researchers suggested that chatbots should be designed to
provide accurate and reliable information to increase the students' trust in the tool
J. Reyes et al. (2020) states that the use of chatbots as a tool for
showed that the students perceived Mr. Roboto as useful and reliable in
providing answers to their academic inquiries. The study also found that the
students' satisfaction with Mr. Roboto was influenced by their assurance of its
ease of use, usefulness, and accuracy. However, the study identified some
capabilities to improve their effectiveness and promote their use among college
students.
According to Liu et al. (2019), their study showed that using chatbots in
with the learning experience. The study found that students were able to quickly
PAGE \* MERGEFORMAT 2
and easily access
UNIVERSITY OF CALOOCAN CITY
information Computer Studies Department through the
chatbot, which reduced their workload and increased their engagement with the
satisfaction among students. However, the study also noted the importance of
ensuring that chatbots are designed with appropriate content and functionality to
learning experience. The study found that students were able to quickly and
outcomes and higher levels of engagement with the material. The chatbot was
study also noted the importance of addressing potential issues such as technical
chatbots have the potential to revolutionize the way students learn and interact
Hossain et al. (2021) state that the use of chatbots in higher education has
PAGE \* MERGEFORMAT 2
learning experience. The
UNIVERSITY OF CALOOCAN CITY
study found Computer Studies Department that students who
used a chatbot as a learning tool reported higher levels of satisfaction with their
learning experience and felt that the chatbot was a helpful resource for
answering their questions and providing feedback on their work. However, the
study also identified several challenges associated with the use of chatbots in
education, such as technical limitations and the need for proper training and
Despite these challenges, Hossain et al. (2021) concluded that the use of
learning experience for students and improve the overall quality of education.
higher education, and there is a need for further research to explore their
investigate the most effective ways of using ChatGPT and other chatbots to
face when using these tools. This information can help educators and developers
to design and develop effective strategies for integrating chatbots into the
tools.
PAGE \* MERGEFORMAT 2
Based on the synthesis
UNIVERSITY OF CALOOCAN CITY
of the Computer Studies Department reviewed studies,
Several studies have reported that ChatGPT can help students with
generating summaries. For example, Palattao et al. (2020) found that ChatGPT
scientific articles. Reyes et al. (2020) reported that ChatGPT helped students in
al. (2020) found that students perceived ChatGPT as a useful tool for getting
immediate feedback and support. Similarly, Vizcaino et al. (2020) found that
students were satisfied with the responses provided by ChatGPT and perceived
Overall, the reviewed studies suggest that ChatGPT has the potential to
The findings provide valuable insights for educators and designers in developing
PAGE \* MERGEFORMAT 2
effective chatbots that can
UNIVERSITY OF CALOOCAN CITY
provide Computer Studies Department personalized and
investigate the factors that influence the effectiveness and adoption of chatbots
among students.
Theoretical Frameworks
PAGE \* MERGEFORMAT 2
perceived ease of use.
UNIVERSITY OF CALOOCAN CITY
Perceived Computer Studies Department usefulness refers
to the extent to which an individual believes that using a particular technology will
enhance their performance, while perceived ease of use refers to the degree to
uncomplicated.
students may be more or less likely to use a chatbot for academic purposes. If
college students perceive that the chatbot is useful for their academic goals and
that it is easy to use, they may be more likely to adopt it as a tool. Conversely, if
college students do not perceive the chatbot as useful or find it difficult to use,
hypotheses about the factors that influence college students' intention to use
chatbots for academic purposes. For example, the researchers may hypothesize
that students who perceive the chatbot as more useful will have a greater
intention to use it than students who do not find it useful. Additionally, the
researchers may hypothesize that students who perceive the chatbot as easier to
use will have a greater intention to use it than students who find it difficult to use.
Overall, TAM provides a useful framework for understanding the factors that
Conceptual Framework
OUTPUT
· Most common academic purposes for using ChatGPT
bot.
· Most common challenges faced by college students
while using ChatGPT bot
· Satisfaction with the overall performance and usability
of ChatGPT bot
· Assurance of accuracy and reliability of ChatGPT bot
· Recommendations that can help to enhance the
performance and usability of ChatGPT bot as a tool
for academic purposes, and ultimately provide
greater value and benefit to college students in
their academic pursuits.
output of the study on the use of ChatGPT bot as a tool for college students to
gender, and year level. The most common academic purposes for which college
students are using ChatGPT bot are identified, as well as the most common
challenges they face while using it. The satisfaction of college students with the
PAGE \* MERGEFORMAT 2
perception of its accuracy and
UNIVERSITY OF CALOOCAN CITY
reliability, are Computer Studies Department also examined.
The data will be gathered through Google Forms and analyzed for presentation
and interpretation.
Finally, the Output section presents the findings of the study, which
includes identifying the most common academic purposes for using ChatGPT
bot, the most common challenges faced by college students while using it, and
their satisfaction with its performance and usability. The study also aims to
assure the accuracy and reliability of ChatGPT bot and recommends ways to
enhance its performance and usability as an academic tool. Ultimately, the study
aims to provide greater value and benefit to college students in their academic
pursuits.
Definition of Terms
For clarification, the following important terms used in the study have been
operationally defined.
educational goals, which can include tutoring, advising, and other forms of
guidance.
that can perform tasks that typically require human intelligence, such as learning,
PAGE \* MERGEFORMAT 2
problem- solving, decision-
UNIVERSITY OF CALOOCAN CITY
making, and Computer Studies Department language
understanding.
data.
PAGE \* MERGEFORMAT 2
UNIVERSITY OF CALOOCAN CITY
Computer Studies Department
Chapter 3
This chapter describes in detail the strategy that was used by the
respondents of the study, instrument used for data collection, validation of the
Research Design
ways in which college students from CSD in University of Caloocan City are
using ChatGPT bot for their academic purposes. Descriptive research is a type of
this study, the focus is on describing how college students are using ChatGPT
bot, what challenges they face while using it, their overall satisfaction with the
bot's performance and usability, and their assurance of the accuracy and
PAGE \* MERGEFORMAT 2
reliability of ChatGPT bot in
UNIVERSITY OF CALOOCAN CITY
providing Computer Studies Department answers to their
academic queries.
The target population of this study were the Computer Studies Department
students from first to fourth year level enrolled at University of Caloocan City with
a total of fifty-two (52) respondents who have used or are currently using
ChatGPT bot for their academic purposes. Hence, not all college students who
have used ChatGPT bot may have been included in the sample. Nonetheless,
the researchers made efforts to ensure that the sample was diverse and
findings.
Sampling Technique
technique that involves selecting participants based on specific criteria that are
relevant to the research question. In this study, the criterion were college
students from CSD who have used or are currently using ChatGPT bot for
academic purposes. The researchers have also used snowball sampling, where
participants were asked to refer other college students who have used ChatGPT
Research Instrument
PAGE \* MERGEFORMAT 2
The researchers used
UNIVERSITY OF CALOOCAN CITY
a survey Computer Studies Department questionnaire,
which was designed to gather data on CSD students’ use of ChatGPT bot for
their academic purposes, the challenges they faced while using it, their overall
satisfaction with the bot's performance and usability, and their assurance of the
accuracy and reliability of the bot in providing answers to their academic queries.
ended questions have included Likert scale items, where participants were asked
Part II: This part asked about the typical academic reasons why they use
the ChatGPT bot. The respondents chose the corresponding rate of their
Part III: This part asked about the challenges that they encountered while
using ChatGPT bot for their academic purposes. The respondents chose the
corresponding rate of their answers, the descriptive equivalent using the scale: (4
PAGE \* MERGEFORMAT 2
Part IV: This part
UNIVERSITY OF CALOOCAN CITY
asked about Computer Studies Department the satisfaction of
the CSD students with the overall performance and usability of ChatGPT bot as a
tool for your academic purposes. The respondents chose the corresponding rate
of their answers, the descriptive equivalent using the scale: (4 – Strongly Agree,
Part V: This part asked about how they ensure the accuracy and reliability
chose the corresponding rate of their answers, the descriptive equivalent using
Disagree).
questionnaire to the respondents right away after having the authority to use it.
respondents who took the face-to-face class for them to answer. The survey
questionnaire was also distributed through Google Forms for CSD students who
have used or are currently using ChatGPT bot for their academic purposes.
Participants may have been provided with a link to the survey and instructed to
approximately 10-15 minutes to complete. The researchers may have also used
PAGE \* MERGEFORMAT 2
to refer other college students
UNIVERSITY OF CALOOCAN CITY
who have Computer Studies Department used ChatGPT
The data gathered from the survey questionnaire may have been in the
form of quantitative data, which can be analyzed using statistical techniques. The
the data and generate descriptive statistics, such as means, frequencies, and
percentages.
purposes for which college students use ChatGPT bot, the most common
challenges faced by the students while using the bot, the level of satisfaction with
the bot's overall performance and usability, and the students' assurance of the
accuracy and reliability of the bot in providing answers to their academic queries.
To interpret the data effectively, the researchers will employ the following
statistical treatment:
identify the most common academic purposes for which college students use
ChatGPT bot, the challenges they face while using the bot, and their overall
PAGE \* MERGEFORMAT 2
Formula:
UNIVERSITY OF CALOOCAN CITY
f
%= x 100,
Computer Studies Department
n
score of responses to Likert scale questions. Likert scale questions are a type of
Formula: x=
∑f x ,
N
x =Weighted Mean; ∑fx = Summation of the product of the value and the
and a series of response five options that range from "strongly agree" to "strongly
choosing the response option that best reflects their opinion or attitude. The
responses are then scored and analyzed to determine the participants' overall
attitudes or opinions.
PAGE \* MERGEFORMAT 2
UNIVERSITY OF CALOOCAN CITY
Computer Studies Department
Adjective
Weighted mean scale Verbal interpretation rating
4 - 3.50-4.49 Agree A
3 - 2.50-3.49 Neutral N
2 - 1.50-2.49 Disagree D
Chapter 4
PAGE \* MERGEFORMAT 2
PRESENTATION,
UNIVERSITY OF CALOOCAN CITY
ANALYSIS Computer Studies Department AND
INTERPRETATION OF DATA
This chapter presents the analysis of the data gathered from the selected
data is presented in tabular and textual form with the aid of statistical treatment
for analysis and interpretation. The study assessed the use of ChatGPT by CSD
students from the University of Caloocan City, North Congress Campus for
1.1. Age
1.2. Gender
2. What are the most common academic purposes for which college students
3. What are the most common challenges that college students face while using
4. How satisfied are college students with the overall performance and usability
5. How does college students ensure the accuracy and reliability of ChatGPT
PAGE \* MERGEFORMAT 2
Table 1. Frequency and
UNIVERSITY OF CALOOCAN CITY
Percentage Computer Studies Department Distribution of
PROFILE FREQUENCY PECENTAGE
the
Gender Male 37 71.15%
Female 15 28.85%
TOTAL 52 100%
Age Range 20 - 24 52 100%
25 - 29 0 0%
30 - 34 0 0%
35 - 39 0 0%
40 - 44 0 0%
45 – asbove yrs. old 0 0%
TOTAL 52 100%
Year Level First Year 0 0%
Second Year 0 0%
Third Year 30 57.69%
Fourth Year 22 42.31%
TOTAL 52 100%
Profile of Respondents in terms of Age, Gender, and Year Level
the respondents as to gender, age range, and year level. The table above shows
the demographic profile of the respondents where most of them are male with a
respondents are twenty-eight point eighty-five percent (28.85%) only with a total
percentage of 100.
PAGE \* MERGEFORMAT 2
On the age range,
UNIVERSITY OF CALOOCAN CITY
majority of Computer Studies Department the respondents
have an age ranging from 20-24 years of age that sums up to one hundred
percent (100%).
On the year level, majority of the respondents is third year with a fifty-
seven and sixty-nine percent (57.69%) and the respondents from fourth year has
level.
Table 2. Most common academic reasons that CSD students use ChatGPT
bot for.
Table 2 shows the most common academic reason that CSD students use
ChatGPT bot for. The first indicator is "Research Assistance" with a weighted
mean of 3.46, indicating a neutral response from the students. The second
PAGE \* MERGEFORMAT 2
mean of 3.52, indicating
UNIVERSITY OF CALOOCAN CITY
that students Computer Studies Department generally agree
that the ChatGPT bot is helpful in this area. The third indicator is "Technical
compared to the other categories. The fifth and final indicator is "General IT
neutral response from the students. The overall weighted mean for all categories
is 3.45, which again suggests a neutral response from the students in terms of
PAGE \* MERGEFORMAT 2
UNIVERSITY OF CALOOCAN CITY
Computer Studies Department
misunderstands my
academic queries.
Overall Weighted Mean 2.92 Neutral
Table 3 shows the five indicators of most common challenges that CSD
students encountered while using ChatGPT bot for their academic purposes. The
response from the students. The second indicator is "It sometimes provides too
much information that is not helpful for my academic queries," which has a lowest
weighted mean of 2.78, also indicating a neutral response. The third indicator is
weighted mean of 2.84, indicating a neutral response from the students. The
slightly higher level of challenge compared to the other categories. The overall
weighted mean for all categories is 2.92, which again suggests a neutral
response from the students in terms of the overall challenges encountered while
PAGE \* MERGEFORMAT 2
The
UNIVERSITY OF CALOOCAN CITY
overall Computer Studies Department
performance and usability of Descriptive
Weighted
ChatGPT bot as a Rating
Mean
tool for their academic
purposes.
1. Responsiveness of
ChatGPT to my questions 3.54 Agree
or requests.
2. Easy to navigate and use Agree
3.76
for academic purposes.
3. ChatGPT bot has helped
me find answers to Agree
3.62
questions that I couldn't find
elsewhere.
4. Saves my time in
researching and finding Agree
3.68
information for my
academic work.
5. I can use it wherever I go
because it is a convenient 3.56 Agree
and efficient tool.
Overall Weighted Mean 3.63 Agree
Table 4 shows the five indicators of satisfaction of CSD students with the
overall performance and usability of ChatGPT bot as a tool for their academic
requests," with a lowest weighted mean of 3.54, indicating that students generally
agree that the ChatGPT bot is responsive to their queries. The second indicator
is "Easy to navigate and use for academic purposes," which has a highest
weighted mean of 3.76, indicating that students find the ChatGPT bot user-
friendly and easy to navigate. The third indicator is "ChatGPT bot has helped me
find answers to questions that I couldn't find elsewhere," with a weighted mean of
PAGE \* MERGEFORMAT 2
3.62, indicating that
UNIVERSITY OF CALOOCAN CITY
students find Computer Studies Department the ChatGPT bot
time in researching and finding information for my academic work," with a slightly
higher weighted mean of 3.68, indicating that students find the ChatGPT bot
helpful in saving time while researching and finding information. The fifth and
efficient tool," with a slightly lower weighted mean of 3.56, indicating that
students find the ChatGPT bot convenient and efficient to use. The overall
weighted mean for all categories is 3.63, which indicates that students generally
agree with the overall performance and usability of the ChatGPT bot as a tool for
Table 5. The technique used by the CSD students to ensure the accuracy
queries.
PAGE \* MERGEFORMAT 2
1. I
UNIVERSITY OF CALOOCAN CITY
Computer Studies Department
Neutral
cross-check the answers 3.38
provided by ChatGPT bot
with other sources.
2. I only use ChatGPT bot for
academic queries that I am Neutral
3.22
already knowledgeable
about to gauge its reliability.
3. I rely on ChatGPT bot's
high accuracy and reliability Neutral
3.20
ratings from other users
and academic sources.
4. I use fact-checking tools. 3.30 Neutral
5. I verify the credentials and
expertise of ChatGPT bot 3.50 Agree
before trusting its answers.
Overall Weighted Mean 3.32 Neutral
Table 5 shows the five indicators of technique that can be used by the
CSD students to ensure the accuracy and reliability of ChatGPT bot in providing
answers to your academic queries. The first indicator is "I cross-check the
answers provided by ChatGPT bot with other sources," with a slightly higher
weighted mean of 3.38, indicating that students are neutral in their approach to
checking the answers provided by the ChatGPT bot. The second indicator is "I
only use ChatGPT bot for academic queries that I am already knowledgeable
about to gauge its reliability," with a slightly lower weighted mean of 3.22,
indicating that students use their own knowledge to test the reliability of the
ChatGPT bot. The third indicator is "I rely on ChatGPT bot's high accuracy and
reliability ratings from other users and academic sources," with a lowest weighted
mean of 3.20, indicating that students take into consideration the reliability
PAGE \* MERGEFORMAT 2
ratings of the ChatGPT bot from
UNIVERSITY OF CALOOCAN CITY
other Computer Studies Department sources. The
fourth indicator is "I use fact-checking tools," with a weighted mean of 3.30,
indicating that some students use fact-checking tools to ensure the accuracy and
reliability of the ChatGPT bot. The fifth and final indicator is "I verify the
credentials and expertise of ChatGPT bot before trusting its answers," with a
highest weighted mean of 3.50, indicating that students tend to agree that
verifying the credentials and expertise of the ChatGPT bot is an important step in
ensuring its reliability. The overall weighted mean for all categories is 3.32, which
indicates that students are generally neutral in their approach to ensuring the
Chapter 5
and recommendation based on the data analyzed in the previous chapter about
the use of ChatGPT bot of the CSD students from University of Caloocan City –
PAGE \* MERGEFORMAT 2
North Congress
UNIVERSITY OF CALOOCAN CITY
Campus for Computer Studies Department academic
purposes.
Based on the gathered data, the researchers came up with the following
findings:
1.1. Age
All respondents fall within the age range of 20-24 years old, making up
1.2. Gender
and the respondents from fourth year has forty-two and thirty-one percent
2. What are the most common academic purposes for which college
PAGE \* MERGEFORMAT 2
The second indicator
UNIVERSITY OF CALOOCAN CITY
"Homework Computer Studies Department and Assignment
Help" was found to be the most useful indicator, with a weighted mean of 3.52,
Support" both received a neutral response from the students, with weighted
of 3.32, while "General IT Knowledge" had a slightly higher rating of 3.48, both
indicating a neutral response. The overall weighted mean for all categories is
3.45, indicating a neutral response from the students about the overall
3. What are the most common challenges that college students face while
queries" has the highest weighted mean of 3.06, indicating a slightly higher level
too much information, limited ability to answer complex questions, and difficulty
ranging from 2.78 to 2.98, also indicating a neutral response from the students.
The overall weighted mean for all categories is 2.92, indicates that students
4. How satisfied are college students with the overall performance and
PAGE \* MERGEFORMAT 2
The second indicator
UNIVERSITY OF CALOOCAN CITY
is "Easy to Computer Studies Department navigate and use
for academic purposes," has the highest weighted mean of 3.06, indicating a
all have weighted means ranging from 3.54 to 3.68, also indicating an
agreement response from the students. The overall weighted mean for all
categories is 3.63, which indicates that students generally agree with the overall
performance and usability of the ChatGPT bot as a tool for their academic
purposes.
The fifth indicator is “I verify the credentials and expertise of ChatGPT bot
before trusting its answers.” has the highest weighted mean of 3.50, indicating
agreement from the students. The students showed a neutral response towards
the indicators, including cross-checking answers, using the bot for familiar
topics, considering its reliability ratings, and use fact-checking tool, all have
weighted means ranging from 3.20 to 3.38. The overall weighted mean for all
Conclusion
PAGE \* MERGEFORMAT 2
Based from the findings
UNIVERSITY OF CALOOCAN CITY
of the study, Computer Studies Department the following
1. On the demographic profile of the respondents, they are all 20-24 years old,
predominantly male, and only 3rd and 4th year level was actively participated.
2. According to the survey's findings, the researchers found out that homework
and assignment were the most academic reason why CSD students using the
ChatGPT bot is for which received the highest weighted mean of 3.52 among
all categories. The neutral response for "General IT Knowledge" indicates that
academic activities.
the researchers found out that students encounter ChatGPT bot sometimes
mean of 3.06 among all categories. This indicates a potential area for
4. Based on the survey's findings, the researchers concluded that CSD students
satisfy for the user-friendliness of the ChatGPT which received the highest
weighted mean of 3.68, indicating that students found the ChatGPT bot to be
researchers found out that students generally agree with the importance of
verifying the credentials and expertise of the ChatGPT bot before trusting its
PAGE \* MERGEFORMAT 2
answers, with a highest
UNIVERSITY OF CALOOCAN CITY
weighted Computer Studies Department mean of 3.50.
Recommendation
suggested:
the findings.
supporting homework and assignments for CSD students. This could include
further research to explore how the bot can be useful for supporting students'
what specific topics or areas they would like the bot to cover, and then
PAGE \* MERGEFORMAT 2
could involve
UNIVERSITY OF CALOOCAN CITY
Computer Studies Department incorporating
their queries, in order to help them refine and clarify their questions.
4. One potential area for improvement is the bot's accessibility. Developers may
or voice commands to make the bot more usable for students with disabilities
5. ChatGPT developers should prioritize the accuracy and reliability of the bot's
sources, incorporating quality control measures, and actively seeking out user
feedback. By doing so, they can help build trust and confidence in the bot
feedback and continually improve the bot's capabilities in order to provide the
most effective and helpful support for academic activities. By addressing issues
with accuracy and exploring new ways to leverage the bot's capabilities,
developers can ensure that it remains a valuable resource for CSD students and
other users.
PAGE \* MERGEFORMAT 2
UNIVERSITY OF CALOOCAN CITY
Computer Studies Department
BIBLIOGRAPHY
Avendaño, N., Ramos, M., & Rarangol, R. (2020). A Study on the Use of
PAGE \* MERGEFORMAT 2
Hossain, M. S.,
UNIVERSITY OF CALOOCAN CITY
Hasan, M. Computer Studies Department A., & Ahmed, T.
101176-101186. https://doi.org/10.1109/ACCESS.2021.3106900
Liu, Y., Chen, H., Wu, D., Liu, B., & Zhang, H. (2019). A chatbot system
for customer service in the hospitality industry. Journal of Hospitality and Tourism
https://doi.org/10.1109/TLT.2019.2927076
PAGE \* MERGEFORMAT 2
UNIVERSITY OF CALOOCAN CITY
Computer Studies Department
APPENDIX A
SURVEY QUESTIONNAIRE
Kindly fill out the following information being asked. All of the answer
Age:
( ) 20 - 24 years old Gender:
( ) 25 - 29 years old ( ) Male
( ) 30 - 34 years old ( ) Female
( ) 35 - 39 years old
( ) 40 - 44 years old Year Level:
( ) 45 years old and above ( ) 1st year
( ) 2nd year
PAGE \* MERGEFORMAT 2
( ) 3rd year ( ) 4th year
UNIVERSITY OF CALOOCAN CITY
Computer Studies Department
Direction: Kindly use the scale below to answer the questions 1 to 3. Put a
check
Agree
3 – Neutral 1 – Strongly Disagree
2. What are the typical academic reasons that you use ChatGPT bot for?
Indicator 1 2 3 4 5
Research Assistance
Technical Support
Programming Assistance
General IT Knowledge
3. What are the challenges that you encountered while using ChatGPT bot for
your academic purposes?
PAGE \* MERGEFORMAT 2
UNIVERSITY OF CALOOCAN
Indicator 1 CITY
2 3 4 5
I encounter technical Computer
issues suchStudies
as Department
slow response times, downtime, or
errors.
It sometimes provides too much
information that is not helpful for my
academic queries.
Limited ability of ChatGPT to
answer complex questions.
Difficulty in Indicator
understanding the 1 2 3 4 5
responses provided
Responsiveness of by ChatGPT.
ChatGPT to my
ChatGPT bot
questions or requests. sometimes
misunderstands
Easy to navigatemyand academic
use for
queries.
academic purposes.
ChatGPT bot has helped me find
answers to questions that I couldn't
find elsewhere.
Saves my time in researching and
finding information for my academic
work.
It is a convenient and efficient tool;
you can use it wherever you go.
4. How satisfy are you with the overall performance and usability of ChatGPT
bot as a tool for your academic purposes?
Indicator 1 2 3 4 5
PAGE \* MERGEFORMAT 2
by ChatGPT bot
with other sources. UNIVERSITY OF CALOOCAN CITY
I only use Computer Studies Department
ChatGPT bot for
academic queries that I am already
knowledgeable about to gauge its
reliability.
I rely on ChatGPT bot's high
accuracy and reliability ratings from
other users and academic sources.
I use ChatGPT bot's sources and
references.
I verify the credentials and expertise
of ChatGPT bot before trusting its
answers.
5. How does college students ensure the accuracy and reliability of ChatGPT
APPENDIX B
VALIDATION LETTER
April 3, 2023
PAGE \* MERGEFORMAT 2
Congressional Rd Ext, Barangay
UNIVERSITY OF CALOOCAN CITY
171, Caloocan, Metro
Computer Studies Department
Manila
Rest assured that the result of the survey will be treated with high confidentiality.
Truly Yours,
CURRICULUM VITAE
PAGE \* MERGEFORMAT 2
EDUCATIONAL
UNIVERSITY OF CALOOCAN CITY
BACKGROUND
Computer Studies Department
Level School Year
Skills
Knowledgeable with MS Office applications (Word, PowerPoint, Excel).
Basic programming (Python, Java, Visual Basic, Oracle Database).
Knowledgeable with Video Editing, Photo Editing.
Ability to fix hardware and electronics.
Goal in Life:
CURRICULUM VITAE
FERNANDO A. JUGARAP
Blk45, Lot Excess, Ph7c, Pkg7
Bagong Silang, Caloocan City
hiferjugarap@gmail.com
09050795511
EDUCATIONAL BACKGROUND
PAGE \* MERGEFORMAT 2
Level
UNIVERSITY OF CALOOCAN CITY
School
Computer Studies Department
Year
Skills
Good knowledge about computer programs.
Detail Oriented.
Adaptability and Flexibility.
Goal in Life:
To be a successful developer/programmer.
Fernando A. Jugarap
CURRICULUM VITAE
JOSHUA G. MATIAS
Blk45, Lot Excess, Ph7c, Pkg7
Bagong Silang, Caloocan City
joshmatias030108@gmail.com
099485775206
EDUCATIONAL BACKGROUND
PAGE \* MERGEFORMAT 2
Level
UNIVERSITY OF CALOOCAN CITY
School
Computer Studies Department
Year
Skills
Having knowledge about computer programming, Packet Tracer, Android
Studio, MySQL, Html & CSS and Formatting Windows PC/Laptop.
Capable of creating and editing video, files, presentation using different
Microsoft Windows Application.
Goal in Life:
Joshua G. Matias
CURRICULUM VITAE
EDUCATIONAL BACKGROUND
PAGE \* MERGEFORMAT 2
Level
UNIVERSITY OF CALOOCAN CITY
School
Computer Studies Department
Year
Skills
Knowledgeable with MS Office applications (Word, PowerPoint, Excel)
Knowledgeable with Video Editing, Photo Editing
Good in Communication
Goal in Life:
CURRICULUM VITAE
EDUCATIONAL BACKGROUND
PAGE \* MERGEFORMAT 2
Level
UNIVERSITY OF CALOOCAN CITY
School
Computer Studies Department
Year
Skills
Programming
Technical Support
Web Development
Good in Communication
Goal in Life:
CURRICULUM VITAE
JHUSTINE D. VARGAS
#5881 San Isidro Purok 2 Brgy. 178 Area D.
Camarin Caloocan City
jhustinedv18@gmail.com
09918000710
EDUCATIONAL BACKGROUND
PAGE \* MERGEFORMAT 2
Level
UNIVERSITY OF CALOOCAN CITY
School
Computer Studies Department
Year
Skills
Knowledgeable with MS Office applications (Word, PowerPoint, Excel).
Basic programming (Python, Java, Visual Basic, Oracle Database)
Knowledgeable with Video Editing, Photo Editing
Ability to fix Hard-wares and Electronics
Goal in Life:
Jhustine D. Vargas
PAGE \* MERGEFORMAT 2