LITERATURE REVIEW: CURRENT ISSUE LEARNING MANAGEMENT
SYSTEM AS A VIRTUAL ONLINE LEARNING MEDIA
Tony ardy (20190804009)
ABSTRAK
This paper is the result of a Systematic Literature Review (SLR)
on the topic of virtual-based learning as a prelude to further
studies on designing an Intelligent Learning Management
System (LMS) for online-based virtual learning. A learning
management system (LMS) is a software application for
administration, documentation, tracking, reporting, and
delivery of educational courses, training programs, or learning
and development programs. [1] The learning management
system is designed to identify training and learning gaps,
utilizing analytical data and reporting. The LMS focuses on
sending online learning but supports a variety of uses, acting as
a platform for online content, including courses, both
asynchronous and synchronous based. LMS can offer classroom
management for instructor-led training or inverted classes,
which are used in higher education, but not in company spaces.
As the basis for a broader study of LMS, this research focuses
on analyzing the leading study reports of virtual based online
learning in particular. The SLR method analyzes papers
published in the 2017-2019 range. From 112 research papers
analyzing 25 in-depth papers. The research findings confirm
that most LMS studies still focus on e-commerce, film, tourists,
and many more which are the most popular collaborative and
content-based screening. Some studies at LMS for online
education mostly focus on scheduling, recommendations for
courses, books, prospective students and others. The results of
this study found that there are still many opportunities to
develop methods and approaches for LMS in online learning.
The findings of this study provide the basis for our future
research to develop contextual awareness models using LMS
based learning for online virtual learning.
KEYWORDS : Learning Management Systems, online
learning, virtual learning, Virtual Online.
I. INTRODUCTION
Online learning (also known as distance learning or e-learning)
is a term that refers to training provided through computers or
other digital devices [2]. In the last ten years, online learning in
higher education has been widely accepted in many countries
as an alternative mode of learning from conventional learning
or face to face. This learning mode is expected to reduce
geographical barriers (eg students can learn from anywhere)
and time constraints (eg students can learn comfortably at any
time). In contrast to conventional learning methods,
communication between students and lectures in e-learning is
not face-to-face but is facilitated by software called Learning
Management Systems (LMS). In general, LMS is a web-based
platform that is used to automate and centralize the
administration of online learning activities such as registration,
delivery of learning materials, tracking, and reporting of
1
learning progress. LMS also provides functionalities such as:
user management, course organization, course delivery, online
assessment, question handling, reporting, communication and
collaboration services. An effective LMS must provide a
learning environment for students, so administrators can use it
to manage users easily and manage other online learning
services [2].
One problem is how to design an effective LMS that provides
convenient functionality for online learning students but a
reliable back-end system for online learning management. On
the other hand, although widely used, to our knowledge, most
LMSs are designed and operated only as learning storage areas.
LMS users are required to access various functions to store or
access information needed because monitoring learning
becomes inefficient. This condition has created a problem: how
to design an LMS with automatic analytic functionality using
text / voice documents available in the LMS repository as input
so that the LMS is not only able to respond to any questions but
some information can be pushed automatically to the recipient.
Although a lot of research has been done on LMS especially
virtual learning, but as far as the author's knowledge, most
researchers focus on accuracy in predicting recommendations
rather than the knowledge obtained by students [1].
Conversely, not much research is done on the design and
measurement of learning systems that are inherent in design.
As part of overcoming this problem, this paper presents a
preliminary study for a broader research objective that designs
an LMS that adopts the emergence of Natural Language
Processing (NLP) technology. As a first step to overcoming this
broad problem, this paper presents the results of analyzing
previous studies and related to virtual-based online learning
problems
II. RESEARCH METHODOLOGY
To conduct a comprehensive literature review of studies on the
use of LMS in online learning, the main method of this research
is the systematic literature review methodology (SLR) [3]. The
main focus of this review is: keyword patterns for the paper
search process, initiating inclusion and exclusion criteria, data
mining, and analysis of findings to answer research questions.
Systematic Literature Review (SLR) is a prominent method that
can be loosely defined as a systematic method for literature
assessment. Research by Mulrow was published in 1994 [4] and
Davis et al. in 1995 [5] [6] were among the evidence that SLR
has become a common method in the health care research
domain. Kitchenham et al. [7] defines SLR as a secondary study
method for analyzing previous research that focuses on finding,
evaluating critically and gathering a number of important
previous research papers and relevant to an interesting
research topic or question. Apart from the different definitions,
the general aim of this methodology is to ensure that the 13 Virtual Networks IEEE/ACM 9
review is unbiased, rigorous and auditable. Although previously 14 Virtual Campus IEEE/ACM 4
15 Virtual Hands-on Lab Platform IEEE/ACM 3
practiced in the field of evidence-based medicine, in recent
16 Virtual Experiment Teaching IEEE/ACM 2
years, this method has been widely adopted in various research 17 Virtual Radio Access Network IEEE/ACM 1
domains including computer science, economics, psychology, Virtual School System
18 IEEE/ACM 3
social science and health care. Implementation
The advantages of this method, among other things, are to 19 Virtual Small Cells IEEE/ACM 2
facilitate rational decision making, choose a large amount of 20 Virtual Small IEEE/ACM 2
information, and follow the development of evidence collected Virtual Network
21 IEEE/ACM 2
Implementation
in the field and to practice evidence-based medicine. In this 22 Virtual Network IEEE/ACM 3
study, SLR specifically aims to investigate the extent of virtual 23 Virtual learning IEEE/ACM 9
use in online learning education and what methods are most 24 virtual collaboration IEEE/ACM 4
often and appropriate to be used. The current trend, the high virtual bank for evaluating
25 IEEE/ACM 2
interest of writers to continue to explore virtual online learning security
can identify various models, methods and approaches used. 26 Virtual Environments IEEE/ACM 2
Amount 112
Based on this, this research will be identified as a new model in
the use of Virtual for online learning. Following et al., [3], the Search results process that the type of data or type of journal
SLR method used in this study carries out automatic searches in obtained through the search process most talked about is virtual
internet-based digital sources and indexing services including: reality.
1. IEEE Xplore Digital Library (http: /ieeexplore.ieee.org) 1. Results of Selection Inclusion and Exclusion Criteria
2. ACM Digital Library (dl.acm.org) The results of the search process will be selected based on
The search string used for all sources consists of the following the Inclusion and Exclusion Criteria. This process leaves 25
strings: journals. Then we do the data scanning. From the results of
1. (Learning Management System AND LMS) AND (Online the scanning table above, quality assessment will be given
Learning OR OL) AND (Learning management System OR to see the data that will be used (whether the data is used
e-Virtual) or not in this study).
2. (E-learning Virtual OR Virtual school) AND (Online 2. Quality Assesment
Learning OR learning style) The selection results of the Inclusion and Exclusion Criteria
3. (Electronic learning AND Virtual Online) will be assessed the quality (Quality Assessment) of each
data.
Search exclusion criteria in this study are: Quality Assessment. In SLR research, the data found will be
1. This paper is based on their publication date between evaluated based on Quality assessment criteria questions
2015-2019 as follows:
2. Complete paper structure, which means all identities QA1. Was the journal paper released in 2015– 2019?
(journals / conferences) Mentioned on paper. QA2. Does the journal paper write Learning Management
3. Duplicate papers from the same study will not be System?
included and deleted from SLR Data Extraction. QA3. Does the journal paper write Virtual Learning?
Quality Assessment Results Table
III. RESEARCH RESULT N Penulis Judul Tahun QA1 QA2 QA3 Hasil
Search process results o
1 SeungWon Park and Boosting learning-by- Y Y Y 
2015
The results of the search process will be grouped by type of 2
ChanMin Kim. teaching in virtual tutorin
Revisiting the Flynn Y Y Y 
journal to make it easier to see the type of data or type of David Passig.
Effect through 3D
Immersive Virtual Reality
2015

journal obtained through the search process shown in the 3

(IVR)
Towards a virtual bank Y Y Y x
S. Kiljan, M. van
table below. Eekelen and H.
for evaluating security
aspects with focus on
2016
Vranken,
No Type Jurnal/paper source Amount user behavior,
4 Meng-Tzu Cheng, Y Y Y 
1 Virtual Environments IEEE/ACM 6 Yu-Wen Lin, and
Learning through playing
2016
Virtual Age
Hsiao-Ching She
Virtual System 
2 IEEE/ACM 10 5 The crossroads of English Y Y Y
Implementation Julian ChengChiang
language learners, task-
based instruction, and 2016
3 Virtual Reality IEEE/ACM 25 Chen
3D multi-user virtual
learning in Second Life
4 Virtual Machine IEEE/ACM 9 6 Ana González- Y Y Y 
5 Virtual Hands-on Lab Platform IEEE/ACM 1 Marcos, Fernando Student evaluation of a
Alba-Elías, Fermín virtual experience for
2016
6 virtual mentor IEEE/ACM 2 Navaridas-Nalda, project management
and Joaquín learning
7 Virtual Agents IEEE/ACM 6 Ordieres-Meré.
7 Ruben Heradio, Luis Y Y Y 
8 Virtual Heritage Environment IEEE/ACM 1 de la Torre, Daniel
9 virtual experiences IEEE/ACM 1 Galan, Francisco
Virtual and remote labs
Javier Cabrerizo, 2016
in education
10 Virtual Avatars IEEE/ACM 1 Enrique Herrera-
Viedma, and
11 Virtual Body Resizing IEEE/ACM 1 Sebastian Dormido.
12 Virtual Disability IEEE/ACM 1 8 Nicole C. Krämer, Closing the gender gap in Y Y Y x
Bilge Karacora, Gale STEM with friendly male 2016
Lucas, Morteza instructors? On the

2
 Dehghani, Gina effects of rapport
Rüther, and behavior and gender of a 3. Data Analysis
Jonathan Gratch. virtual agent in an
instructional interaction At this stage, it will answer the questions from the Research
9 Veljko Potkonjak, Y Y Y 
Michael Gardner, Question (RQ) and discuss the results of the dominant
Victor Callaghan, Virtual laboratories for
Pasi Mattila, education in science, methods and approaches that emerge from 20 15-2019.
2016
Christian Guetl, technology, and
Vladimir M. engineering 1. Discussion of Results
Petrović, and Kosta
Jovanović. This section will explain / answer the Research Question
1
0
G. Csapó
Sprego
collaboration space
virtual
2017
Y Y Y x
(RQ)

1
1
Cognitive adaptability to
optimize online behavior
Y Y Y
a. RQ1. What problems have arisen in LMS and Virtual
C. Meinel and S.
Chujfi,
personalizing digital
workspaces with virtual
2017
Learning (2015-2019)?
1
reality
Learn-as-You-Go with Y Y Y 
In total there are 112 journals through the search
D. Basu, X. Wang, Y.
2
Hong, H. Chen and
Megh: Efficient Live
Migration of Virtual
2017 process. After the data is selected based on inclusion
S. Bressan
1
Machines
How are e-leadership Y Y Y 
and exclusion criteria, using the keywords "Learning
3
Yan Piaw Chua and
practices
implementing a school
in Management System and Virtual Learning" there are 25
2017
Yee Pei Chua virtual learning
environment enhanced?
journals, which are then given a quality assessment
1 Juan A. Muoz-
A grounded model study
Y Y Y 
(Quality Assessment) from the results of quality
Using virtual learning
4 Cristbal,
Gallego-Lema,
Vanesa
environments in assessment (QA) there are 18 relevant journals. Where
bricolage mode for
Higinio F. Arribas-
Cubero, Alejandra
orchestrating learning
2017 the data is grouped based on issues (problems) and
situations across physical
Martnez-Mons, and
Juan I. Asensio-Prez
and virtual spaces approaches used to answer research questions.
1
Jeanette
Designing curriculum to Y Y Y  Grouping issues / problems in virtual learning
5 shape professional social
Novakovich, Sophia
media skills and identity 2017
Miah, and Steven
in virtual communities of
Shaw.
practice No Isu/ Masalah Jumlah
1 Project-based learning in Y Y Y 
Dana Ruggiero and
6
Jeffrey D. Boehm.
a virtual internship
programme
2017 1 Distance and Flexible Education 2
1
7
Y. Deng, D. Lu, C.
Learn-as-you-go
Megh: Efficient Live
with Y Y Y  2 Language Learning Practice 2
Chung, D. Huang 2018
and Z. Zeng
Migration of Virtual
Machines
3 Simulations and Role-Playing 1
1
8 D. A. Temesgene,
Dynamic Functional Split
Selection in Energy
Y Y Y x 4 Multimedia and Games Design 2
M. Miozzo and P.
Dini
Harvesting Virtual Small
Cells Using Temporal
2018 5 Human Sensory Limitations 2
1
Difference Learning
Online Virtual Y Y Y 
6 Historical Recreations 1
9
L. Li, Y. Chen, Z. Li, D.
Experiment Teaching
Platform for Database 2018
7 Presentations and Discussions 1
Li, F. Li and H. Huang
Technology
Application
and
8 Social Impact Virtual Reality 6
2
0
A Framework on the
Critical Success Factors
Y Y Y x
9 Direct micro/macroscopic Effect 1
B. M. Almutairi and of Virtual School System
2018
M. A. Albraithen, Implementation: A
Systematic Literature
Review From the table above shows that the dominant issue
2
1 W. Feng, H. Zhao
Research on Application
of Novel Virtual Reality
Y Y Y x
(problem) that arises as in virtual learning is Social Impact
2018
and G. Li, Technology in Medical
Teaching
Virtual Reality.

2
2
Virtual learning
environment for children
Y Y Y
b. RQ2. What is the dominant method in virtual learning
K. Calle-Urgiléz, M.
F. Mena-Salcedo, Y.
with
proposal
disabilities:
based
A
on
(2015-2019)?
Robles-Bykbaev, V. 2018
Robles-Bykbaev and
MOODLE and content
management with Over
In RQ2 displays the dominant method in Virtual
H. T. Carpio,
The
technology
Top (OTT)
Learning based on the data shown in Table 4. The
2
3
An Identification
Decision Tree Learning
Y Y Y x results of RQ2 are presented in below.
S. Zou, Y. Tang, Y.
Sun and K. Su,
Model for
Management in Virtual
Self-
2018 Grouping Approaches (Methods)
Radio Access Network:
IDTLM
No Pendekatan Jumlah

2
4 Y. Gu, Y. Hu, Y. Ding,
Elastic Virtual Network
Function Orchestration
Y Y Y
1 Feature Modeling 2
2019
J. Lu and J. Xie Policy Based
Workload Prediction
on
2 Component-based techniques 4

2
5
D. Basu, X. Wang, Y.
Learn-as-you-go
Megh: Efficient Live
with Y Y Y
3 Techniques for transforming 4
Hong, H. Chen and 2019
S. Bressan
Migration of Virtual
Machines
Models into a program
Symbol Description: 4 Case-based reasoning 8
a. Y: For the Journal or data used in the study, the data
was chosen because it has enough problems, Based on table 4 the dominant approach in Virtual
approaches and information for data selection. learning (2015-2019) is Case-based reasoning.
b. X: For journals or data not used in research. Because 2. Case-based reasoning.
the data is a guest editor that tells about the Case-based reasoning (CBR) solves problems by
experience of researchers, problems, approaches or remembering similar problems in the past [8] which are
inadequate information for data selection. assumed to have the same solution. Many past cases are
needed to adapt their solutions or methods to new
problems. CBR recognizes that problems are more easily

3
solved by repeated attempts, adding to learning. This
involves four steps [9] (Fig. 1):
a. take the most relevant last case from the database;
b. use cases taken to produce solutions to new
problems;
c. revise the proposed solution with a simulation or
test implementation; and
d. maintain solutions for future use after successful
adaptation.
Picture. 1. The four-step CBR process (adapted from
[9]).
Retrieval recognizes syntactic similarity (grammatical
structure) or semantics (meaning) with new cases. Syntax
similarity tends to be shallow but easy to apply. Semantic
matching according to context is used by advanced CBR
[9]. The main taking method is the nearest neighbor,
inductive and guided by knowledge.
Retrieval of nearest neighbors finds cases that share most
of the features with new ones and weigh them in
importance. Determining weight is the biggest difficulty.
This method ignores the fact that each important feature,
influenced by other features, is case specific. Retrieval
time increases linearly with database size, according to
this method
time consuming [11]. The inductive method decides which
features distinguish the best cases [11]. The case is
arranged in a decision tree according to these features,
reducing retrieval time. However, this method demands a
database case of reasonable size and quality. Taking the
knowledge guide applies existing knowledge to identify
important features in each case, assessing all cases
4
independently. It is expensive for large databases and is
therefore often used with others.
After retrieval, CBR adjusts past solutions to new
problems. Adaptation is structural or derivative [11].
Structural adaptation creates solutions to new problems
by modifying solutions from past cases; Derivational
adaptations apply the algorithm, method, or rule used in
the previous case to a new case. The proposed solution is
then evaluated and revised if necessary. After
confirmation, the solution is stored in a database.
Redundant cases can be deleted and existing cases
combined [11].
IV. CONCLUSIONS
Based on the results of research that has been done,
several conclusions can be drawn as follows:
a. Referring to the SLR results that the author did in
Journal & Magazine published from 2015-2019. The
dominant problem discussed in this SLR research is
Social impact virtual reality
b. Based on the results of SLR conducted in the
publication of Journal & Magazine, from 2015-2019
the dominant method that emerged was Case-based
reasoning (CBR).
c. The SLR method can be used to identify the issues and
approaches contained in virtual learning (2015-2019).
V. SUGGESTIONS
Based on the conclusions from the results of the study, the
authors suggest the following:
SLR can be used to identify issues and approaches that exist
in certain fields or domains, such as: Project Management,
Artificial Intelligent (artificial intelligence), and so forth.
REFERENSI
[1] Bersin, Josh; Howard, Chris; O'Leonard, Karen; Mallon, David (2009),
Learning Management Systems 2009, Bersin & Associates
[2] Simonson, M., Smaldino, S., Albright, M.,& Zvacek, S. (2006). Teaching and
learning at a distance: Foundations of distance education (3rd ed.).
Upper Saddle River, NJ: Pearson
[3] Sabharwal, Renu & Hossain, Rahat & Chugh, Ritesh & Wells, Marilyn.
(2018). Learning Management Systems in the Workplace: A Literature
Review. 387-393. 10.1109/TALE.2018.8615158.
[4] C. D. Mulrow, “Systematic Reviews: Rationale for systematic reviews,” Bmj,
vol. 309, no. 6954, p. 597, 1994.
[5] Systematic Review of the Effect of Continuing Medical Education
Strategies,” Jama, vol. 274, no. 9, pp. 700–705, 1995.
[6] A. D. Oxman, M. A. Thomson, D. A. Davis, and B. Haynes, “No magic bullets:
a systematic review of 102 trials of interventions to improve professional
practice,” Cmaj, vol. 153, no. 10, pp. 1423–1431, 1995.
[7] B. Kitchenham, O. Pearl Brereton, D. Budgen, M. Turner, J. Bailey, and S.
Linkman, “Systematic literature reviews in software engineering -A
systematic literature review,” Inf. Softw. Technol., vol. 51, no. 1, pp. 7–
15, 2009.
[8] F. Fdez-Riverola, J.M. Corchado, Improved CBR system for biological
forecasting, EOAI, Workshop 23, Binding Environmental Sciences and
Artificial Intelligence, Valencia, Spain, 2004.
[9] A. Aamodt, E. Plaza, Case-based reasoning: foundational issues,
methodological variations, and system approaches, AI Commun. 7
(1994) 35–59.
[10]Hamilton, Serena & Jakeman, A.J. & Norton, John. (2008). Artificial
Intelligence techniques: An introduction to their use for modelling
environmental systems. Mathematics and Computers in Simulation. 78.
379–400. 10.1016/j.matcom.2008.01.028.
[11] I. Watson, F. Marir, Case-Based, Reasoning: a review, Kno wl. Eng. Rev. 9
(1994) 327–354.
5