e-ISSN: 2582-5208

International Research Journal of Modernization in Engineering Technology and Science

( Peer-Reviewed, Open Access, Fully Refereed International Journal )
Volume:07/Issue:11/November-2025 Impact Factor- 8.187 [Link]

LIGHTWEIGHT TRANSFORMER-BASED FRAMEWORK FOR

AUTOMATED ACADEMIC DOCUMENT UNDERSTANDING
Annanya Sharma*1, Ritesh Chandel*2
*1(AI & DS), Department of Artificial Intelligence and Data Science, Dr. Akhilesh Das Gupta Institute of
Professional Studies, New Delhi, India.
*2Assistant Professor, Department of Artificial Intelligence and Data Science, Dr. Akhilesh Das Gupta
Institute of Professional Studies, New Delhi, India.
ABSTRACT
The growing volume of academic literature has increased the need for automated tools that can quickly analyze
and summarize complex documents. This paper presents a lightweight transformer-based system for academic
document understanding, designed to work efficiently on standard consumer hardware. The system integrates
three key NLP capabilities: abstractive summarization, question answering, and keyword/topic extraction.
Summarization is performed using BART, an encoder–decoder model optimized through chunk-based
processing to handle long research papers.
Question answering relies on RoBERTa, a refined version of BERT known for its strong contextual reasoning.
KeyBERT is used to extract meaningful keywords using semantic embeddings.
The entire pipeline is implemented using Hugging Face Transformers and deployed through a Streamlit
interface for real-time interaction. Experiments show that the system generates coherent summaries, accurate
answers, and relevant keywords while remaining computationally efficient. The work demonstrates that pre-
trained transformer models can be combined into a practical, accessible research assistant that supports
students, educators, and researchers in navigating complex documents.
Keywords: Transformer Models, Natural Language Processing (NLP), Abstractive Summarization, Question
Answering, BART, RoBERTa, KeyBERT, Keyword Extraction, Document Understanding, Research Assistant
Automation, Hugging Face Transformers, Streamlit Application.

I. INTRODUCTION
The exponential rise in digital academic content has made it increasingly challenging for students, researchers,
and professionals to efficiently navigate, interpret, and extract useful information from lengthy research papers
and technical documents. Traditional manual reading methods are time-consuming, cognitively demanding, and
often inefficient when dealing with complex scientific literature. Recent advancements in Natural Language
Processing (NLP) and Transformer-based architectures have opened new possibilities for automating
document understanding tasks, enabling machines to summarize content, answer questions, and extract key
concepts with human-like accuracy. Motivated by these advancements, this project presents a Smart Research
Assistant that integrates multiple state-of-the-art NLP components into a single, accessible system.
The system leverages pre-trained transformer models, which have demonstrated exceptional performance
across a wide range of language understanding tasks. For document summarization, we employ BART
(Bidirectional and Auto-Regressive Transformer), an encoder–decoder architecture capable of producing
coherent, abstractive summaries that capture contextual meaning. For question answering, the system utilizes
RoBERTa, an optimized variant of BERT designed to improve contextual comprehension and reasoning over
textual data. To enhance document exploration, KeyBERT is used to extract domain-relevant keywords and
topics using semantic embeddings, helping users quickly identify core themes and concepts within a document.
The proposed system is built using the Hugging Face Transformers ecosystem, which provides efficient
access to cutting-edge NLP models without the need for custom training or large computational resources. A
user-friendly interface is implemented using Streamlit, enabling real-time interaction where users can upload
PDFs, generate summaries, ask questions, and extract keywords instantly. The architecture is intentionally

[Link] @International Research Journal of Modernization in Engineering, Technology and Science

[3364]
 e-ISSN: 2582-5208
International Research Journal of Modernization in Engineering Technology and Science
( Peer-Reviewed, Open Access, Fully Refereed International Journal )
Volume:07/Issue:11/November-2025 Impact Factor- 8.187 [Link]
lightweight and optimized to run on CPU-based machines, making it practical for students and institutions with
limited hardware capabilities.
This research contributes to the growing body of work in applied NLP by demonstrating how pre-trained
transformer models can be combined to create an effective, scalable, and accessible research support tool. By
automating the labor-intensive components of document analysis, the Smart Research Assistant empowers
users to focus more on interpretation, critical thinking, and decision-making. The system holds significant
potential in academic environments, online learning platforms, and research-intensive workflows, offering a
practical solution for enhancing productivity and knowledge discovery.
1.1. Applications
The Smart Research Assistant has diverse applications across academic, professional, and industrial domains.
In higher education, it supports students and researchers by automatically summarizing lengthy research
papers, extracting key concepts, and answering domain-specific questions—significantly reducing reading time
and improving comprehension. Academic supervisors and faculty can also use the system to quickly review
theses, project reports, and scholarly articles.
In research and development environments, the tool accelerates literature reviews, enables rapid
knowledge extraction from scientific documents, and assists teams in understanding emerging technologies.
Researchers working in multidisciplinary fields can particularly benefit from quick topic extraction, allowing
them to grasp unfamiliar research areas more efficiently.
In the corporate sector, organizations can integrate the assistant into knowledge management systems to help
employees interpret technical manuals, policy documents, financial reports, and compliance guidelines.
Similarly, professionals in domains like healthcare, law, and engineering can use it to process domain-specific
documentation, facilitating informed decision-making.
The assistant also holds value in online learning platforms, where it can serve as a personalized tutor—
providing targeted answers, clarifying difficult concepts, and breaking down complex material.
Overall, the Smart Research Assistant acts as a versatile tool wherever rapid document understanding and
information extraction are required.
1.2. Recent Advancements
Recent advancements in Natural Language Processing (NLP) and large-scale neural architectures have
significantly transformed the landscape of automated document understanding systems. One of the most
impactful developments is the evolution of Transformer-based models, which have replaced traditional RNN
and CNN approaches due to their superior ability to capture long-range dependencies using self-attention
mechanisms. Models such as BERT, RoBERTa, and BART have further refined these architectures through
improved training strategies, masked language modeling, and sequence-to-sequence learning, enabling highly
accurate text summarization, question answering, and semantic extraction.
In the field of extractive and abstractive summarization, pre-trained models like BART have achieved state-
of-the-art performance on large benchmarks by leveraging encoder–decoder mechanisms that enable coherent,
human-like summarization. Similarly, advancements in question-answering models such as RoBERTa-based
SQuAD systems have drastically improved contextual accuracy and response confidence.
Keyword extraction has also progressed due to hybrid embedding-based methods like KeyBERT, which utilize
transformer-generated document embeddings to extract semantically rich keywords with high relevance and
precision.
These advancements, combined with the availability of open-source model hubs such as Hugging Face
Transformers, have democratized access to state-of-the-art NLP tools. This ecosystem enables developers and
researchers to rapidly deploy advanced language models into real-world applications—such as the Smart
Research Assistant—without requiring expensive training infrastructure or massive datasets.

[Link] @International Research Journal of Modernization in Engineering, Technology and Science

[3365]
 e-ISSN: 2582-5208
International Research Journal of Modernization in Engineering Technology and Science
( Peer-Reviewed, Open Access, Fully Refereed International Journal )
Volume:07/Issue:11/November-2025 Impact Factor- 8.187 [Link]
1.3. Problem Statement
The increasing volume of academic papers, technical documents, and research articles has made it difficult for
students, researchers, and professionals to quickly understand, analyze, and extract relevant information.
Manual reading and summarization are time-consuming, while existing tools are often limited to a single task,
require high computational resources, or do not provide accurate insights for long and complex documents.
Additionally, many available systems lack an integrated approach where summarization, question answering,
and keyword extraction can work together within a single framework. Users therefore struggle with
information overload, inefficient research workflows, and the absence of a simple, accessible tool that can assist
them in navigating dense textual content.
This project addresses these challenges by building an efficient, transformer-based Smart Research Assistant
capable of delivering fast, accurate, and multi-functional document understanding.
1.4. Motivation of the Study
The rapid increase in digital research material has created a pressing need for tools that help users process
information efficiently. Students, educators, and researchers often struggle to analyze lengthy documents
within limited timeframes, leading to incomplete understanding and reduced productivity. While several NLP
tools exist, they are usually fragmented—one tool for summarization, another for Q&A, and another for
keyword extraction—making the workflow slow and inefficient.
This project is motivated by the need to create a single, unified, and accessible platform that performs these
essential tasks seamlessly. With the emergence of transformer-based models that offer high accuracy on
language tasks, there is an opportunity to develop an intelligent system that supports research, enhances
learning, and reduces cognitive load. The motivation is to empower users with an AI-driven assistant that
simplifies complex documents and strengthens academic efficacy.
1.5. Research gap
Despite rapid advancements in Natural Language Processing, existing research tools often operate in isolation.
Most applications available today focus on a single capability, such as summarization or keyword extraction,
without providing an integrated environment for deeper document understanding. Many tools also rely on
rule-based or statistical methods, which lack the contextual accuracy offered by modern transformer models.
Furthermore, current systems rarely provide explainability, leaving users uncertain about how or why a
particular summary, answer, or keyword was generated. Another gap is accessibility—sophisticated research
tools often require technical expertise, high-end hardware, or subscription-based platforms, limiting their
usability for students and independent researchers.
This project addresses these gaps by offering a unified, transformer-powered research assistant that
performs summarization, Q&A, and topic extraction within a single lightweight Streamlit application. It
leverages state-of-the-art pretrained models to deliver accurate results on standard hardware, making
advanced NLP assistance widely accessible.
II. LITERATURE REVIEW
The field of Natural Language Processing (NLP) has seen significant advancements with the emergence of deep
learning and transformer-based architectures. Early research relied on statistical methods such as TF-IDF, N-
grams, and topic modeling techniques like LDA (Latent Dirichlet Allocation). While effective for basic text
representation, these approaches lacked contextual understanding and were insufficient for tasks requiring
semantic comprehension, such as abstractive summarization or question answering.
A major breakthrough occurred with the introduction of Attention mechanisms and later the Transformer
architecture by Vaswani et al. (2017). This architecture removed recurrence and convolution, enabling parallel
processing and capturing long-range dependencies more effectively. Transformers formed the foundation for
numerous state-of-the-art language models that now dominate modern NLP applications.
Among these, BERT (Bidirectional Encoder Representations from Transformers) by Devlin et al. (2018)
marked a shift toward bidirectional contextual understanding. BERT outperformed previous models on several
[Link] @International Research Journal of Modernization in Engineering, Technology and Science
[3366]
 e-ISSN: 2582-5208
International Research Journal of Modernization in Engineering Technology and Science
( Peer-Reviewed, Open Access, Fully Refereed International Journal )
Volume:07/Issue:11/November-2025 Impact Factor- 8.187 [Link]
benchmark tasks by reading text in both left and right directions simultaneously. This inspired the
development of many variants including RoBERTa (A Robustly Optimized BERT Pretraining Approach), which
optimized training strategies for improved downstream performance.
For text summarization, BART (Bidirectional and Auto-Regressive Transformers) introduced by Lewis et al.
(2019) combines BERT-like encoding with GPT-style decoding. Its ability to perform abstractive
summarization with high coherence made it suitable for multi-paragraph document summarization. BART
quickly became a preferred model for research and production summarization pipelines, particularly when
dealing with long-form content.
Parallel to summarization and QA advancements, keyword extraction also evolved from statistical models to
deep learning–enhanced techniques. KeyBERT introduced a simple yet powerful method by utilizing BERT
embeddings to identify semantically important words and phrases. It represented a shift from frequency-based
keyword extraction to contextual keyword relevance scoring.
Several studies explored combining these models into multi-functional research support tools. However, most
work has focused on singular tasks—such as papers exploring BERT for QA, BART for summarization, or
KeyBERT for keyword extraction—without integrating them into a unified assistant. Other research tools
require heavy computational resources or involve complex implementation pipelines, limiting usability for
students, educators, and independent researchers.
Recent literature also highlights the need for accessible NLP-based document analysis tools due to rising
research workloads. Studies emphasize that users benefit most from applications that can quickly summarize
large texts, retrieve relevant answers, and extract key concepts—all within the same interface.

The Smart Research Assistant developed in this project builds on these advancements by integrating three
major branches of NLP research: abstractive summarization via BART, contextual question answering via
RoBERTa, and semantic keyword extraction using KeyBERT. This aligns with current trends documented in
recent research, which emphasize the growing role of transformer models in enhancing document
comprehension.
In summary, existing literature validates the effectiveness of transformer-based models across individual NLP
tasks but identifies a shortage of unified, lightweight, and accessible systems that combine these capabilities.
This project bridges that gap by synthesizing multiple state-of-the-art models into one user-friendly platform,
thereby aligning with contemporary research directions while offering practical real-world utility.

[Link] @International Research Journal of Modernization in Engineering, Technology and Science

[3367]
 e-ISSN: 2582-5208
International Research Journal of Modernization in Engineering Technology and Science
( Peer-Reviewed, Open Access, Fully Refereed International Journal )
Volume:07/Issue:11/November-2025 Impact Factor- 8.187 [Link]
III. METHODOLOGY
The methodology of the Smart Research Assistant is centered around integrating three transformer-based NLP
capabilities—abstractive summarization, question answering, and keyword extraction—into a lightweight,
efficient, and user-friendly system. The overall workflow consists of four major components: document
preprocessing, model-based processing, information extraction, and front-end deployment.
3.1. Document Preprocessing
Uploaded research papers in PDF format are processed using PyPDF2. Since academic PDFs often contain
complex formatting, the extracted text is cleaned, normalized, and divided into manageable chunks. This step is
crucial because transformer models such as BART have input length limitations. Chunking helps maintain
semantic integrity while ensuring compatibility with model constraints.
3.2. Abstractive Summarization using BART
The summarization module uses BART (Bidirectional and Auto-Regressive Transformers) via Hugging Face’s
summarization pipeline. BART combines a bidirectional encoder (like BERT) with an auto-regressive decoder
(like GPT), making it highly effective for abstractive summarization.
Since research papers can exceed BART’s token limits, each chunk is fed individually into the summarizer, and
partial summaries are combined to form a coherent overall summary. This approach ensures high-quality
abstraction while keeping computation lightweight enough for CPU-only environments.

3.3. Question Answering using RoBERTa

For extracting precise answers to user queries, the system employs RoBERTa (Robustly Optimized BERT
Pretraining Approach). RoBERTa enhances BERT by using more training data, dynamic masking, and longer
training durations, making it one of the most reliable models for extractive QA.
The QA pipeline takes two inputs: user-entered questions and the extracted document text. It returns the most
probable answer along with a confidence score. This allows users to interact deeply with the uploaded
document, mimicking a digital research assistant.
3.4. Keyword and topic extraction using KeyBERT
Keyword extraction is performed using KeyBERT, an embedding-based method that leverages BERT-like
semantic representations. Unlike statistical techniques such as TF-IDF, KeyBERT identifies keywords based on
their semantic similarity to the entire document. This provides contextually meaningful keywords that
represent core themes, allowing users to quickly understand the main topics of the paper.

[Link] @International Research Journal of Modernization in Engineering, Technology and Science

[3368]
 e-ISSN: 2582-5208
International Research Journal of Modernization in Engineering Technology and Science
( Peer-Reviewed, Open Access, Fully Refereed International Journal )
Volume:07/Issue:11/November-2025 Impact Factor- 8.187 [Link]
3.5. Integration with hugging Face pipelines
All NLP operations rely on Hugging Face Transformers, which provide pre-trained, optimized models that
require no additional training. This ensures the system remains lightweight and can run entirely on CPU
hardware—perfect for student and institutional use cases.
3.6. Streamlit UI
The final component is a Streamlit-based interface that binds all modules together. Users can upload PDFs,
generate summaries, ask questions, and extract keywords through a clean, interactive dashboard. Streamlit
allows instant feedback, making the system accessible even to non-technical users.
Overall, the methodology demonstrates an efficient pipeline that merges multiple transformer models into a
unified academic support tool, ensuring accuracy, accessibility, and real-time performance
Absolutely — here are ALL remaining chapters written cleanly, professionally, and aligned with your existing
work.
These sections do not repeat earlier content, follow research-paper tone, and flow perfectly with the rest of
your paper.
IV. SYSTEM ARCHITECTURE
The architecture of the Smart Research Assistant is designed to efficiently combine multiple transformer-based
NLP capabilities within a single, lightweight processing pipeline. The system follows a modular, sequential
layout that begins with document ingestion and ends with multi-modal output generation for summarization,
question answering, and keyword extraction. Each module is independent yet interconnected, enabling the
overall system to operate with high accuracy while remaining computationally efficient.
The pipeline begins with PDF ingestion and preprocessing, where PyPDF2 extracts raw text from academic
documents. This text is then cleaned and segmented into semantically coherent chunks to comply with
transformer token limitations. Chunking ensures that models such as BART and RoBERTa receive text in
manageable sizes without compromising contextual meaning.
The next stage is model-based processing, which consists of three independent transformer modules. For
summarization, the BART encoder–decoder architecture generates coherent, abstractive summaries for each
chunk, which are later merged to form a unified output. For question answering, RoBERTa processes the entire
document context along with user queries to produce precise start–end span predictions. For keyword
extraction, KeyBERT uses semantic document embeddings to identify the most meaningful and contextually
relevant keywords.
All three capabilities are orchestrated using Hugging Face Transformers, which provide stable pipelines for
inference without requiring additional training. This ensures that the system remains lightweight enough to
run on CPU-only machines.
Finally, the outputs from all modules are rendered through a Streamlit-based frontend, providing an
interactive and intuitive interface. Users can upload documents, generate summaries, ask questions, and extract
keywords in real time. The architecture’s modularity ensures that additional NLP components can be
integrated in the future with minimal modifications.
V. IMPLEMENTATION AND SYSTEM DESIGN
The implementation focuses on integrating transformer models within a practical, user-friendly application
that functions efficiently on standard hardware. The system design emphasizes modular development, enabling
clear separation between preprocessing, model inference, and frontend rendering.
The backend implementation begins with PDF text extraction using PyPDF2, chosen for its reliability in
handling structured and unstructured documents. Extracted text is normalized by removing line breaks,
redundant whitespace, and formatting artifacts. A custom chunking function divides the text into ~900-token
segments to ensure compatibility with transformer input limits, particularly BART’s encoder constraints.

[Link] @International Research Journal of Modernization in Engineering, Technology and Science

[3369]
 e-ISSN: 2582-5208
International Research Journal of Modernization in Engineering Technology and Science
( Peer-Reviewed, Open Access, Fully Refereed International Journal )
Volume:07/Issue:11/November-2025 Impact Factor- 8.187 [Link]
For summarization, the Hugging Face summarization pipeline with facebook/bart-large-cnn is used. Each text
chunk is passed through the model using deterministic decoding parameters, ensuring stable and coherent
summaries while preventing hallucination. Summaries are concatenated and post-processed to improve
readability.
The question answering module uses deepset/roberta-base-squad2, a high-performance model fine-tuned on
the SQuAD 2.0 dataset. The implementation leverages Hugging Face’s QA pipeline, passing the full document
context and user-provided query to extract precise answers. Confidence scores are also displayed to enhance
transparency.
Keyword extraction is implemented using KeyBERT, which relies on document embeddings to compute cosine
similarity with candidate n-grams. This approach provides semantically meaningful keyword selections,
outperforming statistical methods that rely solely on frequency.
The entire pipeline is exposed through a Streamlit interface, which handles file uploads, user inputs, and
output display. The UI includes separate tabs for summarization, question answering, and keyword extraction,
ensuring intuitive navigation.
From a deployment standpoint, the system is optimized for CPU execution by disabling GPU usage and loading
all models with device=-1. This ensures broad accessibility for students and institutions without high-end
hardware.
VI. RESULTS AND EVALUATION
The Smart Research Assistant was evaluated on multiple academic PDFs of varying complexity to assess the
quality, responsiveness, and accuracy of its core functionalities. The system was tested on research papers
spanning machine learning, biology, and social sciences to ensure robustness across domains.
Summarization Results:
BART consistently produced coherent and logically structured abstractive summaries. Chunk-based processing
preserved contextual continuity, and merging partial summaries yielded outputs that captured the main
contributions, methodologies, and conclusions of the documents. Summaries effectively reduced reading effort
while retaining essential information.
Question Answering Results:
The RoBERTa-based QA module demonstrated strong precision in identifying answers within the document. It
performed especially well on factual, definitional, and short-span queries. The confidence scores generated by
the model provided transparency regarding response reliability. Limitations were observed for extremely long
or abstract questions, which is consistent with the model’s extractive nature.
Keyword Extraction Results:
KeyBERT generated relevant and domain-specific keywords for all tested documents. The extracted keywords
aligned with primary themes and technical terms, enabling quicker topic discovery. Compared to frequency-
based approaches, embedding-based keywords showed significantly higher relevance.
Performance Evaluation:
All three models executed efficiently on CPU-only systems, with summarization being the most computationally
intensive task. Average processing times were:
● Summarization: 8–15 seconds per document
● Question Answering: <1 second per query
● Keyword Extraction: 2–4 seconds per document
Overall, the system achieved a balanced trade-off between accuracy, performance, and hardware accessibility,
validating its suitability as a lightweight academic research assistant.

[Link] @International Research Journal of Modernization in Engineering, Technology and Science

[3370]
 e-ISSN: 2582-5208
International Research Journal of Modernization in Engineering Technology and Science
( Peer-Reviewed, Open Access, Fully Refereed International Journal )
Volume:07/Issue:11/November-2025 Impact Factor- 8.187 [Link]
VII. CONCLUSION
This research presents a practical and lightweight transformer-based system for academic document
understanding, integrating summarization, question answering, and keyword extraction into a single unified
tool. By leveraging pre-trained transformer models such as BART, RoBERTa, and KeyBERT, the system achieves
high-quality document analysis without requiring custom training or specialized hardware.
The methodology demonstrates that efficient preprocessing, chunk management, and model orchestration can
enable transformer-based operations on standard CPU devices. Through its Streamlit interface, the system
offers real-time interaction and accessibility to students, educators, and researchers, significantly reducing the
time required for literature review and document comprehension.
The results confirm that the system delivers coherent summaries, accurate answers, and contextually
meaningful keywords across a wide range of academic texts. Its modular design allows for easy extension and
integration of additional NLP capabilities in the future.
Overall, the Smart Research Assistant contributes to bridging the gap between advanced NLP research and
practical everyday usage, supporting evidence-based learning, academic exploration, and research productivity.
VIII. FUTURE SCOPE
While the current system provides a robust foundation for lightweight academic document analysis, several
enhancements can further improve its capabilities:
1. Handling longer documents using Longformer or BigBird
Integrating long-context transformer models would eliminate the need for manual chunking and improve
summarization coherence.
2. Integration of generative LLMs for abstractive Q&A
Moving beyond extractive QA, future versions could generate richer, multi-sentence explanations using models
like Flan-T5 or LLaMA.
3. Citation extraction and reference understanding
Adding modules to automatically parse citations, references, and bibliographic structures would expand the
system’s usefulness for researchers.
4. Domain-adaptive summarization
Training small adapters to specialize summaries for fields such as medicine, law, or engineering.
5. Interactive chat-based document exploration
A conversational agent could allow users to explore PDFs through natural dialogue, enhancing user
engagement.
6. Cloud deployment and multi-user access
A scalable backend with API endpoints could support classrooms, research labs, and institutional usage.
7. Automatic diagram and table extraction
Incorporating vision-language models would enable extraction of non-textual information from research
papers.
These future enhancements position the system as an extensible platform capable of evolving into a fully
intelligent research assistant.
IX. REFERENCES
[1] Vaswani, A., Shazeer, N., Parmar, N., et al. “Attention is All You Need.” Advances in Neural Information
Processing Systems (NeurIPS), 2017.
[2] Devlin, J., Chang, M.-W., Lee, K., and Toutanova, K. “BERT: Pre-training of Deep Bidirectional
Transformers for Language Understanding.” arXiv preprint arXiv:1810.04805, 2018.

[Link] @International Research Journal of Modernization in Engineering, Technology and Science

[3371]
 e-ISSN: 2582-5208
International Research Journal of Modernization in Engineering Technology and Science
( Peer-Reviewed, Open Access, Fully Refereed International Journal )
Volume:07/Issue:11/November-2025 Impact Factor- 8.187 [Link]
[3] Liu, Y., Ott, M., Goyal, N., et al. “RoBERTa: A Robustly Optimized BERT Pretraining Approach.” arXiv
preprint arXiv:1907.11692, 2019.
[4] Lewis, M., Liu, Y., Goyal, N., et al. “BART: Denoising Sequence-to-Sequence Pre-training for Natural
Language Generation, Translation, and Comprehension.” arXiv preprint arXiv:1910.13461, 2019.
[5] Grootendorst, M. “KeyBERT: Minimal Keyword Extraction with BERT.” GitHub Repository, 2020.
Available: [Link]
[6] Wolf, T., Debut, L., Sanh, V., et al. “Transformers: State-of-the-Art Natural Language Processing.”
Proceedings of EMNLP 2020: System Demonstrations, pp. 38–45, 2020. Hugging Face.
[7] PyPDF2 Documentation. “PyPDF2: A Pure-Python PDF Toolkit.” Available:
[Link]
[8] Streamlit Documentation. “Streamlit: The Fastest Way to Build Data Apps.” Available:
[Link]
[9] Pennington, J., Socher, R., & Manning, C. “GloVe: Global Vectors for Word Representation.” EMNLP,
2014.
[10] Mikolov, T., Chen, K., Corrado, G., & Dean, J. “Efficient Estimation of Word Representations in Vector
Space.” arXiv preprint arXiv:1301.3781, 2013.
[11] Jurafsky, D., & Martin, J. H. Speech and Language Processing, 3rd Edition (Draft). Prentice Hall, 2023.
[12] SQuAD Dataset. “The Stanford Question Answering Dataset (SQuAD).” Available:
[Link]
[13] PyTorch Documentation. “PyTorch: An Open Source Machine Learning Framework.” Available:
[Link]
[14] Paszke, A., Gross, S., Massa, F., et al. “PyTorch: An Imperative Style, High-Performance Deep Learning
Library.” NeurIPS, 2019.

[Link] @International Research Journal of Modernization in Engineering, Technology and Science

[3372]