Professional Documents
Culture Documents
Abstract— the objective of this research is to implement a data and improve student performance [6]. As an emerging field; it
panel or personalized Dashboard so that teachers can observe and has been shown that it contributes to the prevention of dropout,
analyze the data of each student and make timely and relevant as well as the optimization of teaching-learning.
decisions to improve the teaching-learning processes. The
methodology used to implement the Dashboard consisted of Given the problems caused by the health crisis generated by
analyzing 9257 data from the interaction of students in the the COVID-19 pandemic [7] [8], there is a need for the correct
Learning Management System (LMS) of the Faculty of use of virtual learning environments by teachers. It is necessary
Educational Sciences of the Universidad Nacional de San Agustín, to design a detailed report viewer that allows showing student
the data analysis was developed in the data mining platform performance data that allows timely decision-making. As
KNIME, where a model was implemented in the following phases: mentioned [9], there is a permanent need to train educational
Requirements definition, design and modeling, development, actors in the Moodle platform, because there are shortcomings
implementation and evaluation of results. The results of the model identified in the training of the pedagogical application of the
implemented in the KNIME platform are taken as tools. Its main use is usually as a job manager [10]. In
recommendations to implement the Dashboard proposal. The conclusion, there is evidence of the lack of training of teachers
results allow us to implement a proposal for a personalized regarding the proper use of the platform, as well as problems in
Dashboard so that teachers can identify observable patterns of the methodology, in content management and evaluation.
student behavior in a way that allows them to make timely and
Therefore, it is necessary to find a way to support the solution
relevant decisions to improve the teaching-learning processes. In
of this problem. It is essential to carry out this type of research
conclusion, a personalized Dashboard is implemented according
to the recommendations of the model implemented in the KNIME
in conditions where, for the first time, full use of teaching is
platform to be used by teachers. made through the Moodle platform.
LMS are implemented in order to improve educational
Keywords — Dashboard; personalized; teaching; learning; quality, but the analysis of the impact on learning is still a
KNIME subject of recent research [11] [4]. Moodle is a platform that
has become very popular [12]; but problems have also arisen in
I. INTRODUCTION the lack of knowledge of all its tools and in the correct use of
The use of technology in the remote work of teachers and these [1], for example, one of the reasons is that some of its
the use of better tools that facilitate the teaching-learning functionalities are poorly known [13]. The use of Virtual
process and the evaluation of students in real time has increased Learning Environments has become a constant need, therefore,
in recent years, education has evolved through immersion it must be part of the skills of the 21st century teacher.
Information and Communication Technologies (ICT) in
teaching and learning processes. By becoming more ubiquitous Another problem in distance education is related to the
and active [1]. The transition to online learning has been interaction and communication between teacher and student,
difficult, yet it is expanding rapidly [2]. Given this situation, since observing the behavior of students, regarding their
there is a predominance of Virtual Learning Environments, due learning is more complex, where it has been identified that in
to the increase in distance learning in recent years, there has the monitoring of the activities that are performed by means of
also been a proportional increase in educational Big data due to the Moodle report registry presents the difficulty in use [14].
the large amount of data generated by the interaction that Therefore, the behavior is partially observable, but with data
platforms allow [3] [4]. analysis techniques, significant information can be extracted to
serve as data for a more complete and detailed observation.
There is a need to monitor the current status of the academic
performance of students by teachers, in distance teaching- As [15] also mentions, it is necessary to design
learning in Virtual Learning Environments. Distance learning, complements to optimize the different aspects of monitoring to
in the sense that generally the learning activities of a study implement them in the Learning Management System (LMS),
program do not require the physical presence of the student [3]. because they have a monitoring system that calculates simple
Given this trend of distance education and the need to analyze metrics. The data generated by the interaction is difficult to
through data generated by the interaction of educational actors, analyze to predict performance from Moodle [16]. Moodle has
this process is called Learning Analytics. These analytics are limitations due to the lack of tools to monitor students in real
intuitive graphical representations about the activity and time, because personalized data processing is more expensive,
performance of the students, in order to optimize it [5]. Whose but that can be complemented with plugins or systems that
main objective is to provide processed information on the real demonstrate a solution in the efficiency of processing
situation, through data collection, in such a way to anticipate personalized queries [17]. It also has a very complex and
1 | Page
www.thesai.org
(Abbreviation) Journal Name
Vol. XXX, No. XXX, 2021
inflexible internal structure, which makes it difficult to modify, process. Proposing a future study on the evaluation of
an alternative is to use it to collect data for the purpose of further efficiency. Similarly [5] mentions that the SOLAR application
analysis in another system [18]. Similarly, our Moodle-based provides learning analysis on the development of capacities
LMS has a very simple and non-interactive monitoring with different social perspectives parallel to the social plane.
reporting function for the visualization of relevant data that For the support to the follow-up, he received high satisfaction.
contributes to timely decision-making in teaching. Some 80% of the teachers were able to identify patterns of failure.
Virtual Learning Environments provide reports and logs so that SOLAR can help teachers to raise awareness, stimulate
teachers can track student performance but they have a reflection, understand the behavior of students on a social level.
deficiency in facilitating learning analysis, and are not intuitive While EMODA, [23], is an emotional board that displays
[19] or are inappropriate to use [31]. According to [20] in emotional data on a videoconferencing platform and focuses on
distributed teaching it is more difficult to monitor, control and synchronous interactions through the application of both
adjust the learning process. The data generated is crucial to dimensional and discrete emotional models, we demonstrate
analyze and generate knowledge for decision making. For this that the emotions of different students can be detected during
reason, the early identification of students who need support is these environments. In the initial study of the EMODA board
possible through data captured by a system [21]. In this sense, to obtain the perception of the usability of the board, the tutors
various external tools have emerged such as control panels, or confirmed that the board is easy to use. This suggests that a
dashboards, which serve to facilitate the visualization and simplified display would be easier to understand. Also
monitoring of activities. Providing information in real time by LEARNATO [24] is a Dashboard that provides teachers with
connecting an API [22]. progress information in real time. Participants reported using
the board time efficiently. Only the information extraction
According to [19], The Learning Analytics Risk Report process was a slow task, but in general they indicated that they
plugins, uses data visualization techniques to show cognitive, feel supported by the information they obtain on the board for
social and behavioral indicators of learning. In such a way that a differentiated instruction.
it provides mechanisms that promote the improvement of
student performance; mainly from those at risk of dropping out, The Dashboards integrated in LMS that had good results
based on access, interactions (in the forum) and performance mostly indicate that they arose due to the difficulties it has.
indicators (less than 50%); as it is a qualitative research, as a Similarly, SLAR, described by [25], is integrated into the Soft
result the plugins allow the teacher to intervene and rescue Learn platform to complement the information provided by its
students who have never accessed the platform and those who graphical visualization tools with the textual reports of the data
have low performance; as well as some limitations in the export displayed. Helping teachers understand student behavior during
and filter of reports. the course. Furthermore, SLAR's performance in terms of
content veracity meets expectations to a high degree.
Also [15] in the proposal of an eOrientation plugins
designed, developed and implemented on the Moodle platform, The aforementioned research shows us that the Dashboards
that graphically analyzes the record of interactions of students focus on some indicators for a better visualization and help the
and teachers, such as the frequency of access and participation, work of teachers in the distance teaching-learning process; On
through an information extraction process. In addition, its the other hand, our proposal includes optimal indicators
effectiveness was proven, facilitating the monitoring of obtained by a rigorous process of cataloging the appropriate
students and the detection of academic dropouts using indicators so that they can be visualized in the Dashboard
predictive machine learning techniques. It was studied whether design and that they have a better impact on the context. In fact,
the type of grade variable predicted the students' learning the current architecture should be modified to offer real-time
behaviors and it was found that the variable with the highest visualization to teachers in order to optimize monitoring and
predictive value between the two groups of grade students was make it more enjoyable. In addition, these tools need to be
the frequency of access to exams. The grouping technique was based on standards that the educator must have as indicated by
also applied, and three groupings were found for the the International Society for Technology in Education (ISTE)
distribution of the frequency of student access to the platform's [33]. The standards are:
resources. In addition, Data visualization tools based on Orange
• Apprentice: Teachers follow a constant process of learning
software were used, specifically, prediction and classification
from their practice exploring successful practices that use
aspects were shown. Similarly [14] develops a Data
Visualization Dashboard as a support tool for teachers and for technology to improve student teaching-learning
• Leader: Teachers seek opportunities to actively promote
monitoring learning, which guides the teacher, which adjusts to
the needs that can be improved after obtaining the information. student learning and their own teaching.
• Citizen: Teachers encourage students to make positive
Of the students, principles such as visualization are also contributions to the digital world and participate
applied, which would be the attributes of creativity and visual responsibly.
perception for the organization of the visual components in the • Collaborative: Teachers spend their time collaborating with
Dashboard. Where in the qualitative evaluation its usefulness their colleagues and students to improve their practice.
of the prototype was satisfactory. In turn [20] indicates that • Designer: Teachers design authentic, student-oriented
Imoodle is a system integrated by Moodle, which presents a learning activities and their variability.
dashboard, in an integrated system, in order to collect from the • Facilitator: Teachers use technology to promote learning
database extract meaningful information where teachers can and support student achievement.
track their students, in order to control the online learning
2 | Page
www.thesai.org
(Abbreviation) Journal Name
Vol. XXX, No. XXX, 2021
• Analyst: Teachers understand data to improve teaching and Data records were extracted from the LMS using the
promote student learning. IntelliBoard tool, data that are related to the objectives for the
analysis to be performed through the model implemented in the
The research question that we posed was: To what extent KNIME platform, with these data the dimensions and indicators
will the design of a Dashboard based on a personalized model to be modeled in the KNIME platform were proposed.
help an efficient visualization for the best timely decision-
making of teachers in the Virtual Learning Environments? TABLE I. INDICATORS AND DIMENSIONS OF ACADEMIC
PERFORMANCE
II. METHODOLOGY
A. Objectives to be analyzed on the KNIME platforms Dimensions Indicators
• Identify observable behavior patterns through the Access Visits to courses Clicks
relationship between the time spent in the courses and the
time dedicated to the development of activities. Qualification Average rate
• Identify indicators of academic performance towards the Grade by course
achievement of success and low performance, through the
Weather Time for each course
relationship between the activities completed and their Total time in courses
qualification. Total time in activities
• Identify the effectiveness of the activities, through the
relationship between activities completed, tasks performed courses Enrolled courses
and the average obtained in the course.
• Establish improvement actions for teaching-learning based Activities Activities seen
on the proposal of a personalized Dashboard according to Homework
Completed activities
the educational context where the student operates.
• Track student activities and interactions through the
relationship between time spent on a course and the average
grade received. Phase 2: Design and Modeling
• Compare the development of the activities with the other Data preparation was performed using the reports extracted
students through the relationship between the time from the LMS in table format in spreadsheets, files such as
dedicated to the courses and the time dedicated to the summary of activities on the site by user, site access statistics,
activities demographic data, summary of activities performed, student
B. Description of the context and the participants progress in the course, etc.
For the implementation of the Dashboard proposal, the We proceed to implement the nodes in the KNIME platform
LMS data is analyzed through a model implemented in the data to process the data and achieve as a result a single table
mining platform KNIME [26]. Online behavior indicators were containing all the academic performance indicators.
extracted such as: access, rating and time on the website and As shown in Figure 2, the model was separated into two
valid information from the LMS of the Faculty of Education of groups. In the first group, the data obtained from the reports
the Universidad Nacional de San Agustín. extracted from IntelliBoard were processed. The second group
C. Instruments and Procedures of statistics corresponds to the modeling results according to the
The data from the sample used of 9250 records are objectives requiring data visualization.
extracted, through a simple random sampling of a total
population of 100000 records of the faculty LMS, using the
IntelliBoard tool, with this data set the model is implemented in
the KNIME platform whose recommendations of the analysis
performed allow implementing the proposed customized
Dashboard. The methodology for Dashboard design [31],
consists of five phases: Requirements definition, design,
development, implementation and evaluation of the results.
Phase 1: Definition of Requirements
3 | Page
www.thesai.org
(Abbreviation) Journal Name
Vol. XXX, No. XXX, 2021
Fig. 3. Access, grading, joining and student identification meta-node Fig. 6. Time conversion Methanode
Figure 4 shows the Metanodo that performs the Figure 7 shows the process of converting the time in the
identification and separation of the 9252 student records, for courses, which were in text format, to a numerical format, in
which the demographic data report and summary of activities seconds and hours. By means of the String Manipulation, String
on the site are used. to number, Math Formula and Column filter nodes. The
extraction of each number is performed due to the format of the
time variable in the courses, since it is in the format hh:mm:ss.
This, through the string manipulation node, simplifies the task
of individual extraction of the format, due to its search and
extraction properties, resulting in the fields of hours, minutes
4 | Page
www.thesai.org
(Abbreviation) Journal Name
Vol. XXX, No. XXX, 2021
5 | Page
www.thesai.org
(Abbreviation) Journal Name
Vol. XXX, No. XXX, 2021
6 | Page
www.thesai.org
(Abbreviation) Journal Name
Vol. XXX, No. XXX, 2021
Fig. 15. Relationship between time in courses and time in activities Fig. 17. Relationship between completed activities, completed tasks and the
grade
Figure 16 shows that the behavior patterns identified
indicate that the longer the time spent in the courses, the greater Figure 18 shows that the greater the number of activities
the time spent in the development of the activities. completed, the higher the grade obtained. The number of
assignments does not have much influence on the grade
The indicators of academic performance towards the according to the data shown.
achievement of success and low performance are also observed,
by means of the relationship between the activities completed Likewise, the monitoring of student activities and
and their grade. interactions through the relationship between the times spent in
a course and the average grade received.
Fig. 16. Relationship between completed activities and the average grade
7 | Page
www.thesai.org
(Abbreviation) Journal Name
Vol. XXX, No. XXX, 2021
Fig. 19. Ratio between time spent in courses and time spent in activities by
specialty
Phase 4: Implementation
Figures 20, 21 and 22 show the results of the proposed
implementation of a personalized Dashboard according to the
personal characteristics of each student where the visualizer
will show all the proposed implementation objectives, whose
visualized data will help the teacher to make timely decisions
in order to improve the teaching-learning processes while
monitoring the performance of students in order to identify
possible risks in academic performance.
8 | Page
www.thesai.org
(Abbreviation) Journal Name
Vol. XXX, No. XXX, 2021
9 | Page
www.thesai.org
(Abbreviation) Journal Name
Vol. XXX, No. XXX, 2021
[18] M. Campo, A. Amandi, and JC Biset, “A software architecture [26] R. Kresimir, BG Marijana, and M. Vlado, “Development of the intelligent
perspective about Moodle flexibility for supporting empirical research of system for the use of university information system,” Procedia Eng., Vol.
teaching theories,” Educ. Inf. Technol., 2020, doi: 10.1007 / s10639-020- 69, pp. 402–409, 2014, doi: 10.1016 / j.proeng.2014.03.005.
10291-4. [27] S. Jaggia, A. Kelly, K. Lertwachara, and L. Chen, “Applying the CRISP-
[19] M. Brito, F. Medeiros, and EP Bezerra, “An infographics-based tool for DM Framework for Teaching Business Analytics,” Decis. Sci. J. Innov.
monitoring dropout risk on distance learning in higher education,” 2019, Educ., Vol. 18, no. 4, pp. 612–634, 2020, doi: 10.1111 / dsji.12222.
doi: 10.1109 / ITHET46829.2019.8937361. [28] JS Rengifo Collazos, “Data analytics applied to the university context.
[20] A. Tlili, F. Essalmi, M. Jemni, M. Chang, and Kinshuk, “iMoodle: An Case Study: Saber Pro tests, ”2020.
intelligent moodle based on learning analytics,” Lect. Notes Comput. Sci. [29] H. Wiemer, “Applied Aciences Data Mining Methodology for
(Including Subser. Lect. Notes Artif. Intell. Lect. Notes Bioinformatics), Engineering Applications (DMME). A Holistic Extension,”Appl. Sci.,
vol. 10858 LNCS, no. August, pp. 476–479, 2018, doi: 10.1007 / 978-3- 2019.
319-91464-0.
[30] PC Ncr et al., "Crisp-Dm," SPSS inc, vol. 78, pp. 1–78, 2000, [Online].
[21] D. Liu, D. Richards, C. Froissard, and A. Atif, “Validating the Available: http://www.crisp-dm.org/CRISPWP-0800.pdf.
effectiveness of the moodle engagement analytics plugin to predict
[31] S. Michaeli, D. Kroparo, and A. Hershkovitz, “Teachers' Use of
student academic performance,” 2015 Am. Conf. Inf. Syst. AMCIS 2015,
no. December, 2015. Education Dashboards and Professional Growth,” Int. Rev. Res. Open
Distance Learn., Vol. 21, no. 4, pp. 61–78, 2020, doi: 10.19173 /
[22] C. Zimmerman, MK Stein, D. Hardt, C. Danielsen, and R. Vatrapu, IRRODL.V21I4.4663.
"EmotionVis: Designing an emotion text inference tool for visual
[32] AD Robalino, "Methodology for the design of Dashboards oriented
analytics," Lect. Notes Comput. Sci. (Including Subser. Lect. Notes Artif.
towards the recording of evidence in the institutional evaluation process,"
Intell. Lect. Notes Bioinformatics), vol. 9661 LNCS, no. May, pp. 238–
244, 2016, doi: 10.1007 / 978-3-319-39294-3_22. p. 88, 2017, [Online]. Available:
https://reunir.unir.net/handle/123456789/6171
[23] R. Doumbouya, MS Benlamine, A. Dufresne, F. Garza, and D. De,
[33] UNESCO International Institute for Higher Education in Latin America
"Prediction of dominant emotion," no. August, pp. 54–65, 2018, doi:
10.1007 / 978-3-319-91464-0. and the Caribbean, “Higher education and COVID-19 in Latin America
and the Caribbean: Financing for students”. Pp. 9, 2021,
[24] E. Van Alphen, “Lernanto: Using an Ambient Screen During https://unesdoc.unesco.org/ark:/48223/pf0000378257/PDF/378257spa.p
Differentiated Instruction,” pp. 2334–2340, 2016. df.multi
[25] A. Ramos-Soto, "Towards the preparation of textual reports in the
analysis of learning Dashboards," pp. 260-264, 2015.
10 | Page
www.thesai.org