Professional Documents
Culture Documents
Abstract—Smart learning environments (SLEs) have gained article presents a comprehensive characterization to describe SLEs
considerable momentum in the last 20 years. The term SLE has through their affordances, the technologies used, and pedagogical
emerged to encompass a set of recent trends in the field of approaches considered in the selected papers. As a result, specific
educational technology, heavily influenced by the growing core functions of SLEs are identified and explained. This work aims
impact of technologies, such as cloud services, mobile devices, at ensuring a relevant knowledge base and reference toward the
and interconnected objects. However, the term SLE has been implementation of future SLEs.
used inconsistently by the technology-enhanced learning (TEL) Index Terms—Smart learning environments (SLEs), system-
community since different research works employ the adjective atic literature review (SLR), technology-enhanced learning
“smart” to refer to different aspects of novel learning (TEL).
environments. Previous surveys on SLEs are narrowly focused
on specific technologies or remain at a theoretical level that does
not discuss practical implications found in empirical studies. To
address this inconsistency and also to contribute to a common I. INTRODUCTION
understanding of the SLE concept, this article presents a systematic
literature review of papers published between 2000 and 2019
discussing SLEs in empirical studies. Sixty-eight papers out of an
initial list of 1341 papers were analyzed to identify the following:
I N recent years, educational technology has evolved in
response to new educational needs with affordances that
offer new opportunities for teaching and learning. The techno-
1) what affordances make a learning environment smart; 2) which logical changes unleashed since the universalization of the
technologies are used in SLEs; and 3) in what pedagogical contexts
are SLEs used. Considering the limitations of previous surveys, and Internet and the later popularization of smartphones have
the inconsistent use of the SLE concept in the TEL community, this facilitated ubiquitous access to multiple formal, informal, and
nonformal learning options. Learning and teaching have
evolved enormously thanks to the adoption of software tools
Manuscript received July 30, 2020; revised March 1, 2021; accepted March for improved collaboration between people (e.g., open source
18, 2021. Date of publication March 23, 2021; date of current version June 4, software, video-conferencing tools, chats, MOOC platforms,
2021. This work was supported in part by the European Regional Develop-
ment Fund as well as by the National Research Agency of the Spanish Minis- etc.) or information technologies (IT) that are helping to
try of Science, Innovations, and Universities through the SmartLet project understand what happens in our environment (e.g., cloud serv-
under Grant TIN2017-85179-C3-1-R and Grant TIN2017-85179-C3-2-R, in ices, sensors, artificial intelligence (AI), data algorithms, etc.).
part by the Madrid Regional Government through the e-Madrid-CM Project
under Grant S2018/TCS-4307, a project which is cofunded by the European In addition, new modalities of educational environments have
Structural Funds (FSE and FEDER), in part by the European Regional Devel- emerged, in face-to-face, online (e-learning), and mobile envi-
opment Fund, as well as the Regional Council of Education of Castile, and ronments where learning occurs anytime and anywhere
Leon through CasualLearn project under Grant VA257P18, in part by the
European Commission through Erasmus+ Capacity Building in the Field of (m-learning). The recent pandemic and its effect on teaching
Higher Education projects LALA (586120-EPP-1-2017-1-ES-EPPKA2- and learning provides an illustrative example of the new
CBHE-JP), InnovaT (5898758-EPP-1-2018-1-AT-EPPKA2-CBHE-JP), and opportunities and challenges of recent advances in educational
PROF-XXI (609767-EPP-1-2019-1-ES-EPPKA2-CBHE-JP), through the
Erasmus+ Knowledge Alliances project ColMOOC (588438-EPP-1-2017-1- technology.
EL-EPPKA2-KA), and through the Erasmus+ Strategic Partnerships for higher Additionally, the combination of mobility with improved
education project TEASPILS (2020-1-ES01-KA203-082258). (Corresponding connectivity and cloud computing have facilitated the creation
author: Bernardo Tabuenca.)
Bernardo Tabuenca is with the Information Systems Department, Universi- of environments where multiple physical and virtual objects,
dad Politecnica de Madrid, 28031 Madrid, Spain (e-mail: bernardo. as well as people, are interconnected to support the so-called
tabuenca@upm.es). ubiquitous learning situations [1], [2]. The combination of
Sergio Serrano-Iglesias, Cristina Villa-Torrano, Yannis Dimitriadis, Juan
I. Asensio-Perez, Eduardo Gomez-Sanchez, Miguel L. Bote-Lorenzo, and ubiquitous learning with recent trends in social learning and
Alejandra Martınez-Mones are with the Cooperative and Intelligent learning analytics (LAs) has led the focus of this article: smart
Systems Group, Universidad de Valladolid, 47002 Valladolid, Spain (e- learning [3]. Broadly speaking, smart learning can be regarded
mail: sergio@gsic.uva.es; cristina@gsic.uva.es; yannis@tel.uva.es; juaase@tel.
uva.es; edugom@tel.uva.es; migbot@tel.uva.es; amartine@infor.uva.es). as learning in interactive, intelligent, and tailored environ-
Adrian Carruana Martın, Carlos Alario-Hoyos, and Carlos Delgado Kloos ments, supported by advanced digital technologies and serv-
are with the Telematic Engineering Department, Universidad Carlos III de ices [4]. In the context of these learning environments,
Madrid, 28903 Madrid, Spain (e-mail: acarruan@inf.uc3m.es; calario@it.
uc3m.es; cdk@it.uc3m.es). students may adopt different learning patterns depending on
Digital Object Identifier 10.1109/TLT.2021.3067946 their daily activity, the device in their hands, their
1939-1382 ß 2021 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission.
See https://www.ieee.org/publications/rights/index.html for more information.
Authorized licensed use limited to: Edith Cowan University. Downloaded on June 14,2022 at 03:34:16 UTC from IEEE Xplore. Restrictions apply.
130 IEEE TRANSACTIONS ON LEARNING TECHNOLOGIES, VOL. 14, NO. 2, APRIL 2021
connectivity, time availability, location, and needs for interac- as in empirical studies. Additionally, despite the relevant role
tion with objects or colleagues [5]. Students can benefit from that technology plays in SLEs, it has not been considered a core
learning environments like these, which may efficiently fit topic in any of those previous literature reviews. Empirical
into their daily routine and seamlessly integrate formal and results from case studies help to analyze the consistency and the
informal learning [5]. evolution of a research area over time. Therefore, a review of
In recent years, new associations like the International empirical research on SLEs could help to better understand the
Association for Smart Learning Environments (IASLE), con- specific features of existing SLEs as well as the particular tech-
ferences like the International Conference on Smart Learning nologies they use and the educational contexts in which they
Environments (ICSLE) or the International Conference on have been tested. By understanding those three ingredients,
Smart Learning Ecosystems and Regional Developments which are much harder to grasp from theoretical proposals, it is
(ICSLERD), and journals like the Smart Learning Environ- more likely to obtain a clearer delimitation of the SLE concept.
ments Journal (SLE Journal) or Interactive Technology and Based on the understanding of those ingredients, this article
Smart Education Journal (ITSE) have clustered research investigates a convergent vision of SLE that aims at providing
efforts attempting to define, assimilate, and integrate emerging consistency of the term SLE in further research.
technologies in educational environments aimed at improving In this article, a systematic literature review (SLR) is carried
learning performance, the so-called smart learning environ- out to characterize SLEs in three dimensions:
ments (SLEs). All this swarm of research activities suggests 1) what affordances make a learning environment “smart”;
that SLEs are progressively becoming the focus of a distinct 2) which technologies are used in SLEs; and
subcommunity within the wider technology-enhanced learning 3) in what pedagogical contexts are SLEs used. Based on
(TEL) research field. However, the initial development of this this characterization, we propose a definition of SLE,
community, as usual [6], leaves many questions that need fur- discuss the results of the literature review, and suggest
ther investigation. research opportunities in the field of SLEs.
Within this new evolving landscape, several relevant pro- The rest of this article is organized as follows. Section II
posals have been made with the aim to delimitate the definition, presents and compares existing literature reviews related with
features, and scope of SLEs. Kinshuk [7] defined SLEs as eco- SLEs. Section III describes the methodology applied to perform
systems that enable the fusion of technology and pedagogy to the literature review. Next, Section IV describes the results of
provide real-time and ongoing evidence of changes in knowl- the analysis of relevant publications presenting the evolution of
edge and skills, which are seamlessly assimilated by learners as the topic within the last two decades and identifying the key
they move from one learning context to another. Spector [8] authors and publications. SLEs are characterized in Section V.
identified ten affordances that are necessary (effective, efficient, Then, in Section VI, gaps for further research in the field of
and scalable), highly desirable (engaging, flexible, adaptive, and SLEs are discussed. Finally, Section VII concludes this article.
personalized), and likely (conversational, reflective, and innova-
tive) “to develop thoughtful, productive, and responsible mem-
II. RELATED WORK
bers of society using SLEs.” Spector’s general claim is that the
extent to which these affordances are present determines The scientific literature includes relevant reviews in which
whether and to what extent a particular learning environment publications on SLEs are explored. Papamitsiou and Econo-
should be considered “smart.” Alternatively, Hwang [9] summa- mides [3] performed a meta-analysis quantifying empirical
rized the potential of SLEs into three key capabilities. findings for publications between 2009 and 2015 in the inter-
1) SLEs are aware of learners’ situation or their context, section of two research areas: SLEs and LAs. The results of
meaning that the system is able to provide learning sup- their analysis suggested that the main pedagogical objectives
port based on the learners’ status. consisted in predicting learning performance, modeling stu-
2) SLEs are able to offer instant and adaptive support to dent behavior, improving assessment, and anticipating drop-
learners by analyzing their individual needs and consid- outs. However, this review targeted the potential of LAs,
ering different perspectives (e.g., learning performance, rather than a better understanding of the affordances of an
learning behaviors, profiles, personal factors, etc.). SLE. Moreover, it covered a period in which research on
3) SLEs are able to adapt the user interface and the subject SLEs was still incipient. A more recent work by Putro et al.
contents to meet the personal characteristics (e.g., learn- [11] reviews the scientific literature to explore alternative
ing styles and preferences) and learning status (e.g., options for group formation in SLEs. Although the authors
learning progress, learning performance, etc.) of indi- considered Hwang’s definition to contextualize their work
vidual learners [9]. Last but not least, Koper [10] within group organization issues towards learning, the review
focused on the efficiency to describe SLEs as improved is narrowly focused on one specific feature (learning in
environments to promote “better and faster” learning. groups), which is, in fact, not always supported or even needed
As shown above, multiple definitions of SLEs and their scope in many SLEs that only support individual learning. More-
have been proposed, while no single definition has been widely over, the characteristics of SLEs, as defined by Hwang, were
accepted and used in the literature. Moreover, existing literature not discussed in the presentation of the results. Heinemann
reviews are either very narrowly focused or are limited to theo- and Uskov [12] also presented a literature review to explore
retical primary studies that do not discuss practical implications key concepts with regard to the implementation of smart
Authorized licensed use limited to: Edith Cowan University. Downloaded on June 14,2022 at 03:34:16 UTC from IEEE Xplore. Restrictions apply.
TABUENCA et al.: AFFORDANCES AND CORE FUNCTIONS OF SMART LEARNING ENVIRONMENTS: A SYSTEMATIC LITERATURE REVIEW 131
A. Research Questions
The following research questions guided the study. B. Review Methodology
1) Research Question 1 (RQ1). What Affordances Make a The literature review was accomplished following
Learning Environment “smart”?: Existing models provide Kitchenham’s [13] guidelines for SLRs. Nine researchers par-
multiple working definitions for SLEs using specific affordan- ticipated in the review. An overview of the process is graphi-
ces of adaptability, efficiency, effectiveness, sustainability, or cally depicted in Fig. 1, where search, selection of studies, and
intelligence [7]–[10]. It is worth studying how these defini- data extraction processes are described. The full dataset
tions and affordances have been used in real settings in order including the results of the complete process is shared in open
to converge toward a more consistent characterization. Here, access.
we focus our exploration on previous works that have evalu- 1) Search: The search phase spanned from September
ated the impact of SLEs in real learning settings. We believe 2019 to November 2019. As illustrated in Fig. 1, the search
that research findings based on empirical evidence, instead of was performed using three different sources to identify rele-
analyses that are theoretical in nature, can better explain the vant articles.
impact of the SLEs main features in real situations in which 1) Digital libraries: An automatic search of the query
different pedagogical approaches, technological tools, and string “smart learning environment” was carried out
roles (teachers, students, institutions, etc.) are involved. in digital libraries within the fields (title or abstract or
2) Research Question 2 (RQ2). Which Technologies are keywords or body). The search was performed using
Used in SLEs?: SLEs are used in face-to-face (e.g., physical the databases considered most relevant to cover the
classrooms), online [e.g., learning management systems scope of this research: ACM Digital Library, IEEE
(LMSs)], or hybrid [16] (e.g., physical and digital artifacts, Xplore Digital Library, Web of Science, Scopus,
physical spaces with augmented reality (AR), web-based with SpringerLink, and ScienceDirect.
3-D worlds, etc.) learning contexts. From a different perspec- 2) Journals with a specific focus on SLEs: A manual
tive, SLEs are employed in classroom and out-classroom search for journals referencing SLEs in their journal
learning situations. With respect to time, SLEs involve syn- name, scope, or issue name was done. Two specific
chronous or asynchronous interactions. Technology plays a journals were identified: 1) the SLE journal, released
key role in assisting stakeholders across these learning con- in 2014, which has published approximately 30 articles
texts, situations, and interactions. This study investigates how per year in open access; and 2) the ITSE journal,
Authorized licensed use limited to: Edith Cowan University. Downloaded on June 14,2022 at 03:34:16 UTC from IEEE Xplore. Restrictions apply.
132 IEEE TRANSACTIONS ON LEARNING TECHNOLOGIES, VOL. 14, NO. 2, APRIL 2021
Authorized licensed use limited to: Edith Cowan University. Downloaded on June 14,2022 at 03:34:16 UTC from IEEE Xplore. Restrictions apply.
TABUENCA et al.: AFFORDANCES AND CORE FUNCTIONS OF SMART LEARNING ENVIRONMENTS: A SYSTEMATIC LITERATURE REVIEW 133
Authorized licensed use limited to: Edith Cowan University. Downloaded on June 14,2022 at 03:34:16 UTC from IEEE Xplore. Restrictions apply.
134 IEEE TRANSACTIONS ON LEARNING TECHNOLOGIES, VOL. 14, NO. 2, APRIL 2021
Authorized licensed use limited to: Edith Cowan University. Downloaded on June 14,2022 at 03:34:16 UTC from IEEE Xplore. Restrictions apply.
TABUENCA et al.: AFFORDANCES AND CORE FUNCTIONS OF SMART LEARNING ENVIRONMENTS: A SYSTEMATIC LITERATURE REVIEW 135
Feedback and recommendations (recommendation Here, technologies are classified and listed considering these
onwards) refers to information provided by the SLE based on core functions.
stakeholders’ actions performing learning activities. The 1) Collecting Contextual Information. Sense: SLEs collect
results show that the recommendation affordance was recog- specific information about stakeholders’ context in order to
nized by 29% of the publications. In the context of tutoring prepare personalized adaptations. Likewise, SLEs might col-
systems, Lalingkar et al. [60] developed a system that pro- lect multiple samples along the learning activity to trace stake-
vided corrective feedback clues just after answering the ques- holders’ actions and reactions. Technology plays a key role in
tion. The difficulty level of the questions could be configured SLEs collecting contextual information, which could refer to
by the teacher. the following [85]:
SLEs usually analyze the collected data and identify pat- 1) identification of the stakeholder (e.g., through face recog-
terns related to stakeholders’ behavior and their context when nition, person identification, etc.) or an object [e.g., near-field
carrying out learning activities. The results of the analysis communication (NFC)];
show that patterns, activity, and behavior identification affor- 2) timestamp when learning activities are performed, to
dances (pattern recognition onwards) were identified in 23% record the time where the learning activity is performed;
of the publications. In the context of presentation training, 3) who collaborates with the stakeholder within the SLE;
Burghardt et al. [20] proposed a system that recorded a 4) the conditions in which the learning activity is carried out
speaker making a presentation in public, recognized the pre- (e.g., environmental, physical, or biometric conditions).
senter’s behaviors, and provided suitable guidance to improve Table IV lists technologies found in the review that are used
it. Similarly, Denden et al. [61] developed a role-playing to sense information in SLEs.
game to teach the subject of computer architecture. Their sys- The most frequently used technologies on SLEs were
tem used data analysis techniques to identify behaviors within smartphones, handheld devices, and tablets. These devices
the game. Consequently, the system sketched out the personal- usually comprised multiple sensors and interfaces that facili-
ity of the students considering these patterns. tated retrieving data from them. For example, the work of
SLEs offer appropriate adaptations based on stakeholders’ Bacca et al. [38] shows an architecture for customizing the
profile to personalize their learning activities and, conse- way English is learnt as a foreign language. This architecture
quently, to provide a more engaging learning experience. The included a mobile application, in which the student answered
analysis shows that the engaging affordance was recognized questions that were prompted considering the data collected
in 21% of the publications. In the context of video-based from his/her profile.
learning, Kleftodimos and Evangelidis[30] designed a tool for Desktop computers were used in 25% of the selected publi-
teachers to add interactive features to videos, such as question cations. For example, Hien et al. [78] presents a messenger
answering, extra information, jokes, etc. Thus, learning chatbot that collects frequently asked questions by students.
became more fun and attractive to students. The teacher progressively improves the chatbot including
Efficient in SLEs refers to how well education is performed answers to the questions.
with respect to the required effort. The results show that the LMSs were referenced in 20% of the selected publications.
efficiency affordance was identified by 21% of the publica- LMSs are commonly used in e-learning environments. The
tions. In the context of primary education, Smeda et al. [24] work from Koulocheri and Xenos[86] presents an LMS that
investigated the efficiency of digital storytelling in a physical collects information from students’ social activity in forums
classroom considering learning performance and students’ to provide customized assistance.
engagement. In recent years, cameras featuring new functionalities are
Effective learning in SLEs is considered when stakeholders showing a great potential for application in the educational
perform their learning activities successfully obtaining the field (e.g., GoPro cameras, 360-degree cameras, super slow
intended result. The results show that the effective affordance motion cameras, or cameras with facial/motion recognition).
was recognized by 16% of the publications. Choi and Suk [29] Cameras enable identification of stakeholders and track them
analyzed the impact of the light intensity in the effectiveness in the sense process. In the context of nursing education, Her-
of resolving arithmetic problems. The authors found a small ault et al. [65] used videos recorded with a 360-degrees cam-
increase in the academic performance when light had a higher era in real medical operations. Later on, these videos were
intensity. used to promote discussion among students in authentic
scenarios.
Nowadays, wearables sense data on sleeping patterns or
B. Technologies Involved in SLEs
biometrics. In the context of smart cities, Kadar [53] devel-
The analysis of the technologies identified in the review sug- oped an early warning system that collected biometric and
gests that technology is used in three well-differentiated pro- environmental conditions to monitor critical processes on a
cesses of the SLE: input data (sense onwards, such as computers, smart campus.
smartphones, microcontrollers, biometric sensors, etc.), process Overall, the results presented in this section help to under-
data (analyze onwards, such as machine learning (ML), ontolo- stand how technology can help to sense data in SLEs. In the
gies, process mining, etc.), and output data (react onwards, next section, alternative techniques for analyzing data using
such as smartphones, computers, data visualizations, etc.). technologies are described.
Authorized licensed use limited to: Edith Cowan University. Downloaded on June 14,2022 at 03:34:16 UTC from IEEE Xplore. Restrictions apply.
136 IEEE TRANSACTIONS ON LEARNING TECHNOLOGIES, VOL. 14, NO. 2, APRIL 2021
TABLE IV TABLE V
TECHNOLOGIES USED TO COLLECT CONTEXTUAL INFORMATION IN SLES TECHNOLOGIES USED TO INTERPRET THE CONTEXT WITH DATA PROCESSING
(SENSE) TECHNIQUES IN SLES (ANALYZE)
Authorized licensed use limited to: Edith Cowan University. Downloaded on June 14,2022 at 03:34:16 UTC from IEEE Xplore. Restrictions apply.
TABUENCA et al.: AFFORDANCES AND CORE FUNCTIONS OF SMART LEARNING ENVIRONMENTS: A SYSTEMATIC LITERATURE REVIEW 137
Authorized licensed use limited to: Edith Cowan University. Downloaded on June 14,2022 at 03:34:16 UTC from IEEE Xplore. Restrictions apply.
138 IEEE TRANSACTIONS ON LEARNING TECHNOLOGIES, VOL. 14, NO. 2, APRIL 2021
Such diversity suggests that SLEs do not intrinsically restrict Nevertheless, nonformal and informal learning studies attempt
the pedagogical approach to be used. to enable learning in unconventional settings that offer new
From the previous results, it can be observed that the sup- opportunities to learners, with a major concern on the actions
ported pedagogical approaches are mostly student-centered. that can be performed or the development of the learning
This focus on students is reflected on the stakeholders consid- resources. Preston et al. [46] encouraged students to learn lan-
ered throughout the different papers. From 68 papers guages while they are cooking, with the provision of embed-
reviewed, 39 focused exclusively on supporting learners, ded devices and interfaces among the kitchenware. Tortorella
whereas 3 papers supported exclusively teachers. This interest and Kinshuk [59] proposed a mobile learning system that pro-
in supporting learners is consistent with the affordances vides contextual information about potential pathogens pres-
reported in Section V-A, which are tightly related to the learn- ent in the current environment and suitable alternatives to deal
ing experience and sustain the student-centered perspective of with them. Leonidis et al. [56] presented an extensible soft-
SLEs. The support for teachers is mostly aimed at providing ware infrastructure that empowers teachers to design and pro-
reports and visualization of analytics with regard to learners’ gram purposeful and engaging learning activities for formal
activity [70], [84]. Imran et al. [70] introduced an analytical and informal learning environments, by combining and
and visualization tool (rule-based recommender system: orchestrating cloud-based, ambient and pervasive facilities,
VAT-RUBARS) to provide support for teachers in learner- and services. Still, some contributions attempt to combine
centered courses toward improved performance of their learn- these types of learning. Tabuenca et al. [58] presented an IoT
ers. On the other hand, Bechreu et al. [84] presented a tool system based on NFC tags and audio/visual feedback that
(StudentViz) to help teachers visualize and understand the col- learners could use to configure customized alerts, aimed at
laboration patterns among students. fostering self-awareness on the time devoted to learning across
Nonetheless, 23 papers attempted to support both learners contexts. Bravo-Torres et al. [62] presented a platform
and teachers simultaneously. In these contributions, there is a (OPPIA) which deploys sporadic learning networks among
special interest in the adoption of new technologies for students with similar learning needs to systematically encour-
enhanced learning practice: with the inclusion of sensors and age the interaction among them independently on where they
pervasive devices [29], [33], [44], [52], [53], [57], [79]; are located.
enabling the generation and deployment of new learning Regarding the learning spaces, the results of the analysis
resources such as documents [30], videos [19], enriching con- show that SLEs are implemented for virtual (43%), physical
tents with AR [43], or enabling access to resources from any- (32%), and blended spaces (25%). Through this analysis, it
where [56]; facilitating the learning process across was found that the objective of the SLEs depends on the sup-
spaces [20], [39], [47], [63]; or exploring its influence of its ported space. In the physical space, most proposals attempt to
adoption in practice [24], [82], [83]. Different publications enhance the facilities provided by the educational institution
presented systems that aimed at modeling students’ actions in classrooms [24], [29], [30], [33], [35], [41], [43], [45], [57],
and behavior [40], [50], [52], [61], [71], [76]. Likewise, Bdiwi [63], [65], [66] and laboratories [30], [31], [34], [35], [48],
et al. [34] monitored teacher’s interactions with the different [52], [68], [82]. In these cases, the major interest of the authors
groups of students in a classroom with an RFID-based location is to exploit the integration of technologies in these kinds of
system to analyze how those interactions affected students’ environments to provide new types of resources or ways of
performance. interaction. In the context of physical classrooms, Augello
Beyond the support in educational institutions, some of the et al. [45] presented the architecture of PICo, an intelligent
papers explored the support to learners in professional set- agent in the form of a storyteller robot that creates personal-
tings. Three articles aimed at supporting trainees in the indus- ized learning paths according to the student’s needs. Other
try where the main goal is to sharpen their professional skills. authors attempted to adapt the classroom to promote conve-
Seanosky et al. [21] relied on a system (SCALE) to evaluate nient conditions for learning. Choi and Suk [29] presented a
the skills of the workers in a company on emergency proce- dynamic lighting system to adapt the light of the classroom
dures. Barmada and Baghaei [87] presented an interactive and to investigate the effect of lighting color and temperature
training platform (Train-for-life) for workers in the area of on students’ performance. Chen et al. [33] developed Speech-
transport, logistics, security, and safety industry. This platform Driven PowerPoint to support the presentation of slides
helped the workers of the company to carry out their profes- through the detection of spoken keywords. In regard of physi-
sional training in MOOCs, reducing the number of dropouts. cal laboratories, some researchers explore the acquisition of
Pesare et al. [26] supported health professionals with the pro- data from the actions performed by learners in such environ-
vision of two serious games for sustaining engagement and ments [30], [31], [34], [52] through the usage of the tools and
motivation in medical contexts. systems involved (e.g., video-based learning [30]) or by means
One of the most prominent features of SLEs, according to of wearable biometric sensors to explore how students interact
seminal definitions, refers to the opportunity to bridge formal (e.g., collaborative learning [52]). Nevertheless, other contri-
and informal learning contexts [9], [92]. Most papers focused butions introduce SLEs to foster new interactions in the learn-
on formal learning (57 out of 68), nine focused on nonfor- ing situations. Martinez et al. [48] used a robotic platform to
mal [26], [28], [40], [54], [58], [59], [62], [68], [75], and six guide a problem-based learning approach. Overall, the main
focused on informal learning [46], [54], [56], [58], [62], [63]. focus was to provide alternative resources and strategies to
Authorized licensed use limited to: Edith Cowan University. Downloaded on June 14,2022 at 03:34:16 UTC from IEEE Xplore. Restrictions apply.
TABUENCA et al.: AFFORDANCES AND CORE FUNCTIONS OF SMART LEARNING ENVIRONMENTS: A SYSTEMATIC LITERATURE REVIEW 139
Authorized licensed use limited to: Edith Cowan University. Downloaded on June 14,2022 at 03:34:16 UTC from IEEE Xplore. Restrictions apply.
140 IEEE TRANSACTIONS ON LEARNING TECHNOLOGIES, VOL. 14, NO. 2, APRIL 2021
Authorized licensed use limited to: Edith Cowan University. Downloaded on June 14,2022 at 03:34:16 UTC from IEEE Xplore. Restrictions apply.
TABUENCA et al.: AFFORDANCES AND CORE FUNCTIONS OF SMART LEARNING ENVIRONMENTS: A SYSTEMATIC LITERATURE REVIEW 141
With RQ2, we aimed at investigating which technologies With RQ3, we aimed at investigating in which types of ped-
are used in SLEs. SLEs are equipped with technology to assist agogical contexts are SLEs used. Student-centered support is
students (or teachers) to perform learning (or teaching) activi- the core of SLEs. SLEs support a wide variety of pedagogical
ties. Considering the technologies reported in Section V-B, approaches that keep students in the main focus. Nevertheless,
here, we describe the SLE core functions performed by the teachers are still considered in these environments, both for
system as illustrated in Fig. 3. the provision of reports and analytics, and the enactment and
1) Sense: SLEs are capable of collecting information from provision of learning activities in these environments. We
the context in which they are introduced. For example, have not been able to deduce that SLEs are conditioned by a
SLEs can sense ambient conditions using environmental specific type of pedagogy or learning context. Indeed, it seems
sensors [41], [53], [59], [66], [67]. Likewise, SLEs are they are not necessarily associated with instructional technolo-
capable of collecting information from stakeholders gies. Therefore, SLEs put more emphasis on learning
when performing teaching and learning activities. For activities, revealing a certain tendency to student-centered
example, SLEs can sense students’ patterns both in approaches. SLEs are flexible enough to support a wide vari-
online classrooms using LMSs [21]–[23], [39], [50], ety of pedagogical approaches, learning domains and spaces,
[55], [62], [69]–[72], [79], [80], [86] and physical class- involving physical and virtual spaces. Some researchers have
rooms using cameras [35], [43], [44], [47], [49], [52], explored the connection between formal, nonformal, and
[63]. In addition, technology can sense specific profile informal learning. These studies not only attempted to extend
information on the stakeholder using sensors (e.g., via the learning situation to unconventional learning settings but
smartphone [28], [29], [35], [38], [39], [42]–[46], [49], also considered how the conditions of those settings can pro-
[50], [53], [58], [59], [62], [63], [87], [88]). In SLEs, mote different learning activities and interactions among stu-
the most frequently used technologies to sense data are dents. However, these papers are a minority compared to the
summarized in Section V-B1. ones focused on formal learning and should be covered in fur-
2) Analyze: SLEs are able to generate higher level indica- ther research.
tors from the data collected in the sense process using
data analysis techniques. The expansion of data gener-
VII. CONCLUSION
ated by increasingly integrated digital learning environ-
ments, together with emerging open standards for From this review, we can conclude that an SLE comprises a
learning data, offer new opportunities to assess, mea- space in which stakeholders (students or teachers) carry out
sure, and document learning [95]. The capacity to ana- their activities with the assistance of technology to face learn-
lyze digital learning data is a relatively new research ing barriers. The SLE performs three core functions that pro-
field. Therefore, teachers and students are not always vide smartness to the SLE: sensing, analyzing, and reacting.
sufficiently prepared or do not have suitable tools to There are works that place more emphasis on some functions
exploit this data toward improved learning perfor- than others, but this would be the common denominator. This
mance. SLEs assist stakeholders by including complex definition is not intended to be normative, but rather a way of
data analysis techniques that help understand how stu- synthesizing all the work done so far, and which will continue
dents learn and, consequently, facilitate intervention. in future research.
Indeed, data analysis techniques imply an essential tool The survey of papers reporting innovative contributions in
for SLEs to configure automatic interventions (per- the field of SLEs shows that most aspects that triggered the
formed by the system) that identify actionable insights interest of the community are still poorly developed. Due to
for both teachers and students. In SLEs, the most fre- the student-centered nature of SLEs, many researchers have
quently used techniques to analyze data are summarized explored how learners use these new environments in the
in Table V. classroom. However, teachers should not be left behind, and
3) React: SLEs are able to provide customized recommen- research should explore how to involve them in the design of
dations for stakeholders based on the data collected dur- SLEs. The demand for a higher involvement of learners and
ing the sense process and its interpretation performed teachers can be observed in related fields, such as learning
during the analysis process. In this review, various tech- analytics, that are progressively incorporating human-centered
nology actuators have been identified that present visual approaches in their design processes [96], [97]. In order to
(data visualizations, videos, displays, etc.), auditory exploit the possibilities offered by SLEs, further work has to
(chatbots), or tangible (3-D printers, wearables, interac- be done to support teachers in designing appropriate learning
tive posters, etc.) recommendations to stakeholders. situations that can take advantage of their main affordances,
Reactions (e.g., mobile notifications, contextual recom- specially on the assessment and motivation of learners, and
mendations in LMS, alerts, etc.) are usually configured the connection of formal and informal learning experiences.
to be triggered after identifying actionable insights in For example, SLEs can support learning situations in real-life
the analysis process (e.g., lack of activity within an settings that can motivate learners to further reflect on the con-
assignment, increase of dropouts, etc.). In SLEs, the cepts explored during the lessons. These affordances should be
most frequently used technologies are described in evaluated not only in controlled laboratory settings, but also
Section V-B3. during real-world experiments over longer periods of time in
Authorized licensed use limited to: Edith Cowan University. Downloaded on June 14,2022 at 03:34:16 UTC from IEEE Xplore. Restrictions apply.
142 IEEE TRANSACTIONS ON LEARNING TECHNOLOGIES, VOL. 14, NO. 2, APRIL 2021
order to evaluate the impact on stakeholders. Further research [7] Kinshuk, Designing Adaptive and Personalized Learning Environments.
Evanston, IL, USA: Routledge, 2016.
should investigate these issues implementing SLEs that con- [8] J. M. Spector, “Conceptualizing the emerging field of smart learning
sider the sense, analyze, and react functions. Finally, ethics environments,” Smart Learn. Environ., vol. 1, no. 1, pp. 1–10, 2014.
and privacy concerns should be taken into account, specially [9] G.-J. Hwang, “Definition, framework and research issues of smart learn-
ing environments—A context-aware ubiquitous learning perspective,”
with the sensitive information collected from learners. In this Smart Learn. Environ., vol. 1, no. 1, 2014, Art. no. 4.
regard, more work should be done to make analytics transpar- [10] R. Koper, “Conditions for effective smart learning environments,” Smart
ent and understandable for teachers and students, in line with Learn. Environ., vol. 1, no. 1, pp. 1–17, 2014.
[11] B. L. Putro et al., “Group formation in smart learning environment: A
global calls to provide trustworthy AI-based systems [98], literature review,” in Proc. Int. Conf. Inf. Technol. Syst. Innov., 2018,
with a focus on the educational domain [99]. pp. 381–385.
The affordances identified in this review were shortlisted [12] C. Heinemann and V. L. Uskov, Smart University: Literature Review
and Creative Analysis. Cham, Switzerland: Springer Int. Publ., 2018,
considering empirical articles. Future reviews might classify pp. 11–46.
SLEs not only examining the affordances specified in empiri- [13] B. Kitchenham et al., “Guidelines for performing systematic literature
cal articles as listed in Table III but also the affordances as reviews in software engineering version 2.3,” Engineering, vol. 45,
no. 4, 2007, Art. no. 1051.
identified in theoretical articles [7]–[10]. [14] L. Xia and B. Zhong, “A systematic review on teaching and learn-
The term SLE is usually coined in a vague way in articles ing robotics content knowledge in k-12,” Comput. Educ., vol. 127,
where “smart” might have alternative meanings and the smart- pp. 267–282, 2018.
[15] W. Matcha, N. A. Uzir, D. Gasevic, and A. Pardo, “A systematic review
ness of the tool is not specified. This is probably a sign of of empirical studies on learning analytics dashboards: A self-regulated
immaturity. The increase in the number of publications in learning perspective,” IEEE Trans. Learn. Technol., vol. 13, no. 2,
recent years and the creation of associations, conferences, and pp. 226–245, Apr./Jun. 2020.
[16] A. Cohen, R. T. Nørgard, and Y. Mor, “Hybrid learning spaces–design,
specialized journals on this topic might forecast a significant data, didactics,” Brit. J. Educ. Technol., vol. 51, no. 4, pp. 1039–1044,
growth in the near future. We expect this work will help to 2020.
better define the field toward extended research. [17] P. Brereton, B. A. Kitchenham, D. Budgen, M. Turner, and M. Khalil,
“Lessons from applying the systematic literature review process within
The increase in the number of computer networks (with the software engineering domain,” J. Syst. Softw., vol. 80, no. 4,
greater speed and broadband), the universalization in the use pp. 571–583, 2007.
of smartphones (which include information on the profile of [18] J. R. Landis and G. G. Koch, “The measurement of observer agreement
for categorical data,” Biometrics, vol. 33, pp. 159–174, 1977.
the stakeholder), and the increased availability of Internet [19] J. C. Burguillo and E. Vazquez, “X-Learn: An intelligent educational
services (e.g., cloud services, IoT platforms, etc.) might facili- system oriented towards the net,” in Proc. Conf. Technol. Transfer,
tate the growth in this research field in the coming years. vol. 3040, 2003, pp. 628–637.
[20] C. Burghardt, C. Reisse, T. Heider, M. Giersich, and T. Kirste,
This article is limited by the restrictions of the keyword “Implementing scenarios in a smart learning environment,” in Proc.
search. Therefore, it is possible that relevant articles in the 6th Annu. IEEE Int. Conf. Pervasive Comput. Commun., 2008,
field of SLE have not been considered in the review process. pp. 377–382.
[21] J. Seanosky, D. Boulanger, V. Kumar, and Kinshuk, “Unfolding learn-
Nonetheless, we believe that the conclusions obtained from a ing analytics for big data,” in Emerging Issues in Smart Learning.
systematic review in which 1341 papers were screened and 11 Berlin, Germany: Springer, 2015, pp. 377–384.
researchers were involved will contribute to advance the com- [22] V. Kumar et al., “An approach to measure coding competency
evolution,” in Smart Learning Environments. Berlin, Germany:
munity and draw attention to academic debates. Springer, 2015, pp. 27–43.
[23] K. Govindarajan et al., “Assessing learners’ progress in a smart learning
ACKNOWLEDGMENT environment using bio-inspired clustering mechanism,” in Innovations
in Smart Learning. Berlin, Germany: Springer, 2017, pp. 49–58.
This publication reflects the views only of the authors, and fun- [24] N. Smeda, E. Dakich, and N. Sharda, “The effectiveness of digital story-
telling in the classrooms: A comprehensive study,” Smart Learn. Envi-
ders cannot be held responsible for any use which may be made
ron., vol. 1, no. 6, pp. 1–21, 2014.
of the information contained therein. [25] G. Paquette, O. Mari~no, D. Rogozan, and M. Leonard, “Competency-
based personalization for massive online learning,” Smart Learn. Envi-
REFERENCES ron., vol. 2, no. 4, pp. 1–19, 2015.
[26] E. Pesare, T. Roselli, N. Corriero, and V. Rossano, “Game-based learn-
[1] J. A. Gonzalez-Martınez, M. L. Bote-Lorenzo, E. Goimez-Sanchez, and ing and gamification to promote engagement and motivation in medical
R. Cano-Parra, “Cloud computing and education: A state-of-the-art learning contexts,” Smart Learn. Environ., vol. 3, no. 5, pp. 1–21, 2016.
survey,” Comput. Educ., vol. 80, pp. 132–151, 2015. [27] G. Barata, S. Gama, J. Jorge, and D. Gonçalves, “Gamification for smar-
[2] B. Tabuenca, V. Garcıa-Alcantara, C. Gilarranz-Casado, and ter learning: Tales from the trenches,” Smart Learn. Environ., vol. 2,
S. Barrado-Aguirre, “Fostering environmental awareness with smart IoT no. 10, pp. 1–23, 2015.
planters in campuses,” Sensors, vol. 20, no. 8, 2020, Art. no. 2227. [28] K. Mouri and H. Ogata, “Ubiquitous learning analytics in the real-world
[3] Z. Papamitsiou and A. A. Economides, “Learning analytics for smart language learning,” Smart Learn. Environ., vol. 2, no. 15, pp. 1–18,
learning environments: A meta-analysis of empirical research results 2015.
from 2009 to 2015,” Learn., Des. Technol.: Int. Compendium Theory, [29] K. Choi and H.-J. Suk, “Dynamic lighting system for the learning envi-
Res., Pract. Policy, pp. 1–23, 2016. doi:10.1007/978-3-319-17727- ronment: Performance of elementary students,” Opt. Exp., vol. 24,
4_15-1. no. 10, pp. A 907–A916, 2016.
[4] J. Lee, H. Zo, and H. Lee, “Smart learning adoption in employees and [30] A. Kleftodimos and G. Evangelidis, “Using open source technologies
HRD managers,” Brit. J. Educ. Technol., vol. 45, no. 6, pp. 1082–1096, and open internet resources for building an interactive video based learn-
2014. ing environment that supports learning analytics,” Smart Learn. Envi-
[5] B. Tabuenca, S. Ternier, and M. Specht, “Supporting lifelong learners to ron., vol. 3, no. 9, pp. 1–23, 2016.
build personal learning ecologies in daily physical spaces,” Int. J. [31] E. Serral, J. De Weerdt, G. Sedrakyan, and M. Snoeck, “Automating
Mobile Learn. Organisation, vol. 7, no. 3-4, pp. 177–196, 2013. immediate and personalized feedback taking conceptual modelling edu-
[6] T. S. Kuhn, The Structure of Scientific Revolutions. Chicago, IL, USA: cation to a next level,” in Proc. IEEE 10th Int. Conf. Res. Challenges
Univ. Chicago Press, 2012. Inf. Sci., 2016, pp. 1–6.
Authorized licensed use limited to: Edith Cowan University. Downloaded on June 14,2022 at 03:34:16 UTC from IEEE Xplore. Restrictions apply.
TABUENCA et al.: AFFORDANCES AND CORE FUNCTIONS OF SMART LEARNING ENVIRONMENTS: A SYSTEMATIC LITERATURE REVIEW 143
[32] A. Taamallah and M. Khemaja, “Designing and experiencing smart [54] G. Yang, D. KinshukWen, and E.Sutinen, “A contextual query expansion
objects based learning scenarios: An approach combining IMS ID, based multi-document summarizer for smart learning,” in Proc. Int.
XAPI and IoT,” in Proc. 2nd Int. Conf. Technol. Ecosystems Enhancing Conf. Signal-Image Technol. Internet-Based Syst., 2013, pp. 1010–1016.
Multiculturality, 2014, pp. 373–379. [55] K. Simic, M. Despotovic-Zrakic, Z. Bojovic, B. Jovanic, and
[33] C.-L. D. Chen, Y.-H. Chang, Y.-T. Chien, C. Tijus, and C.-Y. Chang, D. Knezevic, “A platform for a smart learning environment,” Facta
“Incorporating a smart classroom 2.0 speech-driven powerpoint system Univ.-Series: Electron. Energetics, vol. 29, no. 3, pp. 407–417, 2016.
(SDPPT) into university teaching,” Smart Learn. Environ., vol. 2, no. 7, [56] A. Leonidis, M. Antona, and C. Stephanidis, “Enabling programmability
pp. 1–11, 2015. of smart learning environments by teachers,” in Distributed, Ambient,
[34] R. Bdiwi, C. de Runz, S. Faiz, and A. A. Cherif, “Smart learning envi- and Pervasive Interactions, N. Streitz and P. Markopoulos, Eds. Cham,
ronment: Teacher’s role in assessing classroom attention,” Res. Learn. Switzerland: Springer Int. Publ., 2015, pp. 62–73.
Technol., vol. 27, pp. 1–14, 2019. [57] A. Preston, S. Lazem, A. Kharrufa, B. Pursglove, and P. Olivier,
[35] L. J. Thomas, M. Parsons, and D. Whitcombe, “Assessment in smart “Supporting the smart teacher: An agenda for the use of embedded sens-
learning environments: Psychological factors affecting perceived ing in novel learning spaces,” Smart Learn. Environ., vol. 5, no. 1, 2018,
learning,” Comput. Hum. Behav., vol. 95, pp. 197–207, 2019. Art. no. 19.
[36] G. Akçapınar, M. N. Hasnine, R. Majumdar, B. Flanagan, and H. Ogata, [58] B. Tabuenca, D. B€orner, M. Kalz, and M. Specht, “User-modelled ambi-
“Developing an early-warning system for spotting at-risk students by ent feedback for self-regulated learning,” in Design for Teaching and
using ebook interaction logs,” Smart Learn. Environ., vol. 6, no. 4, Learning in a Networked World, G. Conole, T. Klobucar, C. Rensing,
pp. 1–15, 2019. J. Konert, and E. Lavoue, Eds. Cham, Switzerland: Springer Int. Publ.,
[37] R. Luckin, “The learner centric ecology of resources: A framework for 2015, pp. 535–539.
using technology to scaffold learning,” Comput. Educ., vol. 50, no. 2, [59] R. Tortorella and Kinshuk, “A mobile context-aware medical training
pp. 449–462, 2008. system for the reduction of pathogen transmission,” Smart Learn. Envi-
[38] J. Bacca, Kinshuk, and D.Segovia-Bedoya, “An architecture for mobile- ron., vol. 4, no. 1, pp. 1–13, 2017.
based assessment systems in smart learning environments,” in Proc. Int. [60] A. Lalingkar, C. Ramnathan, and S. Ramani, “Ontology-based smart
Conf. Smart Learn. Environ., 2019, pp. 25–34. learning environment for teaching word problems in mathematics,”
[39] X. Huang, “Wechat-based teaching for an immersion cultural exchange J. Comput. Educ., vol. 1, no. 4, pp. 313–334, 2014.
program—A case study in CFL,” Smart Learn. Environ., vol. 6, no. 7, [61] M. Denden, A. Tlili, F. Essalmi, and M. Jemni, “Implicit modeling of
pp. 1–21, 2019. learners’ personalities in a game-based learning environment using
[40] V. Rus and D. Ştefanescu, “Non-intrusive assessment of learners’ prior their gaming behaviors,” Smart Learn. Environ., vol. 5, no. 1, pp. 1–
knowledge in dialogue-based intelligent tutoring systems,” Smart Learn. 19, 2018.
Environ., vol. 3, no. 2, pp. 1–18, 2016. [62] J. F. Bravo-Torres, V. E. Robles-Bykbaev, M. L. Nores,
[41] I. Jormanainen, T. Toivonen, and V. Nivalainen, “A smart learning envi- E. F. Ordo~nez-Morales, Y. Blanco-Fernandez, and A. Gil-Solla, “Oppia:
ronment for environmental education,” in Proc. Int. Conf. Smart Learn. A context-aware ubiquitous learning platform to exploit short-lived stu-
Environ., 2018, pp. 13–16. dent networks for collaborative learning,” in Proc. 8th Int. Conf. Com-
[42] D. Kohen-Vacs, M. Milrad, M. Ronen, and M. Jansen, “Evaluation of put. Supported Education - Volume 1: CSEDU, INSTICC, 2016,
enhanced educational experiences using interactive videos and web pp. 494–498.
technologies: Pedagogical and architectural considerations,” Smart [63] S. Pal, P. K. D. Pramanik, and P. Choudhury, “A step towards smart
Learn. Environ., vol. 3, no. 6, pp. 1–19, 2016. learning: Designing an interactive video-based m-learning system for
[43] C. Lytridis and A. Tsinakos, “Evaluation of the artutor augmented real- educational institutes,” Int. J. Web-Based Learn. Teach. Technol.,
ity educational platform in tertiary education,” Smart Learn. Environ., vol. 14, no. 4, pp. 26–48, 2019.
vol. 5, no. 6, pp. 1–15, 2018. [64] M. Procter, F. Lin, and B. Heller, “Intelligent intervention by conversa-
[44] Z. Chaczko, W. Alenazy, and C. Y. Chan, “Middleware-based software tional agent through chatlog analysis,” Smart Learn. Environ., vol. 5,
architecture for interactions in the smart learning environment,” in Proc. no. 1, 2018, Art. no. 30.
26th Int. Bus. Inf. Manage. Assoc. Conf. Innov. Manage. Sustain. Econ. [65] R. C. Herault, A. Lincke, M. Milrad, E.-S. Forsg€arde, and C. Elmqvist,
Competitive Advantage: Regional Develop. Glob. Growth, 2015, “Using 360-degrees interactive videos in patient trauma treatment edu-
pp. 699–714. cation: Design, development and evaluation aspects,” Smart Learn.
[45] A. Augello et al., “A personal intelligent coach for smart embodied Environ., vol. 5, no. 1, 2018, Art. no. 26.
learning environments,” in Proc. 9th KES Int. Conf. Intell. Interactive [66] T. Savov, V. Terzieva, and K. Todorova, “Computer vision and internet
Multimedia Syst. Serv., 2016, pp. 629–636. of things: Attention system in educational context,” in Proc. 19th Int.
[46] A. Preston et al., “Can a kitchen teach languages? Linking theory and Conf. Comput. Syst. Technol (CompSysTech’18 Series), 2018, pp. 171–
practice in the design of context-aware language learning environ- 177.
ments,” Smart Learn. Environ., vol. 2, no. 9, pp. 1–19, 2015. [67] T. Toivonen, I. Jormanainen, C. S. Montero, and A. Alessandrini,
[47] Q. Tan, M. Denojean-Mairet, H. Wang, X. Zhang, F. C. Pivot, and “Innovative maker movement platform for k-12 education as a smart
R. Treu, “Toward a telepresence robot empowered smart lab,” Smart learning environment,” in Challenges and Solutions in Smart Learning,
Learn. Environ., vol. 6, no. 5, pp. 1–19, 2019. M. Chang, E. Popescu, Kinshuk, N.-S. Chen, M. Jemni, R. Huang, and
[48] F. Martınez, H. Montiel, and H. Valderrama, “Using embedded robotic J. M. Spector, Eds., Singapore: Springer Singapore, 2018, pp. 61–66.
platform and problem-based learning for engineering education,” in [68] E. A. Khousa, Y. Atif, and M. M. Masud, “A social learning analytics
Proc. 3rd Int. KES Conf. Smart Educ. e-Learn., 2016, pp. 435–445. approach to cognitive apprenticeship,” Smart Learn. Environ., vol. 2,
[49] I. L. Enegi, M. Hamada, and S. A. Adeshina, “Adaptive multimedia no. 1, pp. 1–23, 2015.
learning framework with facial recognition system,” in Proc. 13th Int. [69] Y. Li, Y. Zheng, J. Kang, and H. Bao, “Designing a learning recom-
Conf. Electron., Comput. Comput., 2017, pp. 1–6. mender system by incorporating resource association analysis and social
[50] M. M. El-Bishouty et al., “Analyzing learner characteristics and courses interaction computing,” in State-of-The-Art and Future Directions of
based on cognitive abilities, learning styles, and context,” in Proc. Smart Smart Learning, Y. Li, M. Chang, M. Kravcik, E. Popescu, R. Huang,
Learn. Environ., 2015, pp. 3–25. Kinshuk, and N.-S. Chen, Eds., Singapore: Springer Singapore, 2016,
[51] P. Temdee, “Smart learning environment for enhancing digital literacy pp. 137–143.
of thai youth: A case study of ethnic minority group,” Wirel. Pers. Com- [70] H. Imran, K. Ballance, J. M. C. Da Silva, Kinshuk, and S. Graf,
mun., pp. 1–12, 2019. “Vat-rubars: A visualization and analytical tool for a rule-based rec-
[52] G. Dafoulas, C. C. Maia, J. Samuels-Clarke, A. Ali, and J. C. Augusto, ommender system to support teachers in a learner-centered learning
“Investigating the role of biometrics in education-the use of sensor data approach,” in State-of-The-Art and Future Directions of Smart
in collaborative learning,” in Proc. IADIS Int. Conf. e-Learn. 2018, Learning., Y. Li, M. Chang, M. Kravcik, E. Popescu, R. Huang,
pp. 115–123. [Online]. Available: https://eprints.mdx.ac.uk/id/eprint/ Kinshuk, and N.-S. Chen, Eds., Singapore: Springer Singapore,
24621 2016, pp. 31–38.
[53] M. Kadar, “Smart learning environment for the development of smart [71] B. Vesin, K. Mangaroska, and M. Giannakos, “Learning in smart envi-
city applications,” in Proc. IEEE 8th Int. Conf. Intell. Syst., 2016, ronments: User-centered design and analytics of an adaptive learning
pp. 59–64. system,” Smart Learn. Environ., vol. 5, no. 1, 2018, Art. no. 24.
Authorized licensed use limited to: Edith Cowan University. Downloaded on June 14,2022 at 03:34:16 UTC from IEEE Xplore. Restrictions apply.
144 IEEE TRANSACTIONS ON LEARNING TECHNOLOGIES, VOL. 14, NO. 2, APRIL 2021
[72] H. Elhoseny, M. Elhoseny, S. Abdelrazek, and A. M. Riad, “Evaluating [97] S. B. Shum, R. Ferguson, and R. Martinez-Maldonado, “Human-centred
learners’ progress in smart learning environment,” in Proc. Int. Conf. learning analytics,” J. Learn. Analytics, vol. 6, no. 2, pp. 1–9, 2019.
Adv. Intell. Syst. Inform., A. E. Hassanien, K. Shaalan, T. Gaber, and M. [98] High-Level Expert Group on Artificial Intelligence (HLEG-AI), “Ethics
F. Tolba, Eds., Cham, Switzerland: Springer Int. Publ., 2018, pp. 734– guidelines for trustworthy AI: Requirements of trustworthy AI,” Eur.
744. Commission, Tech. Rep., Apr. 2019. Accessed: Feb. 24, 2021. [Online].
[73] M.-X. Fan, R. Kuo, M. Chang, and J.-S. Heh, Story-Based Virtual Experi- Available: https://ec.europa.eu/digital-single-market/en/news/ethics-
ment Environment. Berlin, Heidelberg: Springer 2015, pp. 175–198. guidelines-trustworthy-ai
[74] K. Aljuhani, M. Sonbul, M. Althabiti, and M. Meccawy, “Creating a vir- [99] S. Vincent-Lancrin and R. Van derVlies, “Trustworthy AI in education:
tual science lab (VSL): The adoption of virtual labs in Saudi schools,” Promises and challenges,” Organisation Econ. Co-operation Develop-
Smart Learn. Environ., vol. 5, no. 1, pp. 1–13, 2018. ment (OECD), Tech. Rep., Feb. 2020, Accessed: Feb. 24, 2021.
[75] S. Johnson and O. R. Zaiane, “Learning to analyze medical images: A [Online]. Available: http://www.oecd.org/education/trustworthy-artifi-
smart adaptive learning environment for an ill-defined domain,” in cial-intelligence-in-education.pdf
Proc. Bus. Process Manage. Workshops, 2018, pp. 56–68.
[76] S. Li and J. Zheng, “The effect of academic motivation on students’ Bernardo Tabuenca (Senior Member, IEEE)
English learning achievement in the eschoolbag-based learning environ- received the Ph.D. degree in ubiquitous technology
ment,” Smart Learn. Environ., vol. 4, no. 1, pp. 1–14, 2017. for lifelong learners from Open University of The
[77] G. Deeva and J. De Weerdt, “Understanding automated feedback in Netherlands, Heerlen, Netherlands, in 2015.
learning processes by mining local patterns,” in Proc. Int. Conf. Bus. He is currently an Assistant Professor with Univer-
Process. Manage., 2018, pp. 56–68. sidad Politecnica de Madrid, Madrid, Spain. He
[78] H. T. Hien, P.-N. Cuong, L. N. H. Nam, H. L. T. K. Nhung, and conducted his research with the Research Center for
L. D. Thang, “Intelligent assistants in higher-education environments: Learning, Teaching, and Technology, Open Univer-
The fit-ebot, a chatbot for administrative and learning support,” in Proc. sity of The Netherlands. His current areas of research
9th Int. Symp. Inf. Commun. Technol., 2018, pp. 69–76. include technology-enhanced learning, ubiquitous
[79] J. Burrows and V. Kumar, “The objective ear: Assessing the progress of technology, and smart learning environments.
a music task,” Smart Learn. Environ., vol. 5, no. 1, pp. 1–9, 2018.
[80] A. Tlili et al., “Automatic modeling learner’s personality using learn-
ing analytics approach in an intelligent moodle learning platform,”
Sergio Serrano-Iglesias received the B.Sc. and M.Sc.
Interactive Learn. Environ., pp. 1–15, 2019, doi:10.1080/
10494820.2019.1636084. degrees in telecommunications engineering from the
[81] Y. Li, Y. Zheng, H. Bao, and Y. Liu, “Towards better understanding of University of Valladolid, Spain, in 2016 and 2017,
hot topics in online learning communities,” Smart Learn. Environ., respectively. He is currently working toward the Ph.D.
vol. 2, no. 1, pp. 1–14, 2015. degree in information and telecommunication technol-
[82] T. L. Tyler-Wood, D. Cockerham, and K. R. Johnson, “Implementing ogies with the GSIC-EMIC Research Group, Univer-
sity of Valladolid.
new technologies in a middle school curriculum: A rural perspective,”
Smart Learn. Environ., vol. 5, no. 1, pp. 1–16, 2018. His main research interests include smart learning
[83] A. Amigud, J. Arnedo-Moreno, T. Daradoumis, and A. Guerrero-Roldan, environments and the application of cloud computing
“A robust and non-invasive strategy for preserving academic integrity in for the support of learning.
an open and distance learning environment,” in Proc. IEEE 17th
Int. Conf. Adv. Learn. Technol., 2017, pp. 530–532.
[84] A. Becheru, A. Calota, and E. Popescu, “Analyzing students’ collabora- Adrian Carruana Martın received the B.Sc. and
tion patterns in a social learning environment using studentviz M.Sc. degrees in computer science from the Univer-
platform,” Smart Learn. Environ., vol. 5, no. 1, pp. 1–18, 2018. sidad Carlos III de Madrid, Madrid, Spain, in 2015
[85] M. Specht, “RTST trend report: Lead theme contextualisation,” Open and 2017, respectively. He is currently a Ph.D. candi-
Univ. Netherlands, Heerlen, Netherlands, Tech. Rep., May 2012. date with the Department of Telematics Engineering,
Accessed: Feb. 24, 2021. [Online]. Available: https://telearn.archives- Universidad Carlos III de Madrid.
ouvertes.fr/hal-00722748 His main research interests include machine learning
[86] E. Koulocheri and M. Xenos, “Correlating formal assessment with social and smart learning environments.
network activity within a personal learning environment,” Int. J. Web-
Based Learn. Teach. Technol., vol. 14, no. 1, pp. 17–31, 2019.
[87] B. Barmada and N. Baghaei, “Train-for-life (t4l): An interactive learn-
ing platform for logistics, safety and security professionals,” Smart
Learn. Environ., vol. 5, no. 1, pp. 17–31, 2018.
[88] Q. Zhao, “An empirical study on cultivating learners’ creativity in Cristina Villa-Torrano received the B.Sc. and M.Sc.
smart learning environment,” in Proc. Int. Conf. Appl. Intell. Syst. degrees in computer science from the University of
Multi-Modal Inform. Analytics, 2019, pp. 596–603. Murcia, Murcia, Spain, in 2018 and 2019, respec-
[89] E. Alpaydin, Introduction to Machine Learning. Cambridge, MA, USA: tively. She is currently working toward the Ph.D.
MIT Press, 2020. degree in computer science with the GSIC-EMIC
[90] W. Greller and H. Drachsler, “Translating learning into numbers: A Research Group, University of Valladolid, Valladolid,
generic framework for learning analytics,” J. Educ. Technol. Soc., Spain.
vol. 15, no. 3, pp. 42–57, 2012. Her main research interests include learning ana-
[91] P. Long and G. Siemens, “Penetrating the fog: Analytics in learning and lytics and smart learning environments.
education,” Ital. J. Educ. Technol., vol. 22, no. 3, pp. 132–137, 2014.
[92] B. Gros, “The design of smart educational environments,” Smart Learn.
Environ., vol. 3, no. 1, pp. 1–11, 2016.
[93] B. Barron, “Learning ecologies for technological fluency: Gender and Yannis A. Dimitriadis received the Engineering
experience differences,” J. Educ. Comput. Res., vol. 31, no. 1, pp. 1–36, degree in electrical engineering from the Technical Uni-
2004. versity of Athens, Athens, Greece, in 1981, the M.Sc.
[94] R. Luckin, Re-Designing Learning Contexts: Technology-Rich, Learner- degree in electrical engineering from the University of
Centred Ecologies. Evanston, IL, USA: Routledge, 2010. Virginia, VA, USA, in 1983, and the Ph.D. degree in tel-
[95] B. Alexander et al., “EDUCAUSE horizon report: 2019 higher edu- ecommunications engineering from the University of
cation edition,” EDUCAUSE, Louisville, CO, USA, Tech. Rep., Valladolid, Valladolid, Spain, in 1992.
2019. Accessed: Feb. 24, 2021. [Online] Available: http://library. He is currently a Full Professor of Telematics Engi-
educause.edu/-/media/files/library/2019/4/2019horizonreport.pdf neering with the University of Valladolid.
[96] X. Ochoa and A. F. Wise, “Supporting the shift to digital with student-cen-
tered learning analytics,” Educ. Technol. Res. Develop., vol. 69, Nov. 2020,
pp. 1–9.
Authorized licensed use limited to: Edith Cowan University. Downloaded on June 14,2022 at 03:34:16 UTC from IEEE Xplore. Restrictions apply.
TABUENCA et al.: AFFORDANCES AND CORE FUNCTIONS OF SMART LEARNING ENVIRONMENTS: A SYSTEMATIC LITERATURE REVIEW 145
Juan I. Asensio-Perez received the Ph.D. degree in Miguel L. Bote-Lorenzo received the Ph.D. degree
telecommunications engineering from the University in telecommunications engineering from the Univer-
of Valladolid, Valladolid, Spain, in 2000. sity of Valladolid, Valladolid, Spain, in 2005.
He is currently a Full Professor of Telematics Engi- He is currently an Associate Professor of Telematics
neering with the University of Valladolid, and Mem- Engineering with the University of Valladolid, and
ber of the Multidisciplinary Research Group GSIC/ Member of the Multidisciplinary research group GSIC/
EMIC. His research interests include the development EMIC. His research interests include smart learning
of technological solutions for ubiquitous learning, environments, learning analytics, and gamification.
learning design support, and learning analytics.
Carlos Alario-Hoyos received the M.S. and Ph.D. Alejandra Martınez-Mones received the Ph.D.
degrees in information and communication technolo- degree in computer science from the University of
gies from the Universidad of Valladolid, Valladolid, Valladolid, Valladolid, Spain, in 2003.
Spain, in 2007 and 2012, respectively. She is currently an Associate Professor of Computer
He is currently a Visiting Associate Professor with Science and Human Computer Interaction with the
the Department of Telematics Engineering, Universi- University of Valladolid. Her main research interests
dad Carlos III de Madrid, Getafe, Spain. His skills include area of Technology Enhanced Learning include
and experience include research and development in the support to teachers in the design, enactment, and
MOOCs, social networks, collaborative learning, or evaluation of innovative learning activities using learn-
evaluation of learning experiences. ing analytics approaches.
Eduardo Gomez-Sanchez received the Ph.D. degree Carlos Delgado Kloos received the Ph.D. degree in
in telecommunications engineering from the Univer- computer science from the Technische Universitat
sity of Valladolid, Valladolid, Spain, in 2001. Munchen, Munich, Germany, in 1986, and in tele-
He is currently a Professor of Telematics Engineer- communications engineering from the Universidad
ing with the University of Valladolid, Valladolid, Politecnica de Madrid, Madrid, Spain.
Spain. His main research interests include the design He is currently a Full Professor of Telematics
and evaluation of software systems to support collab- Engineering with the Universidad Carlos III de
orative learning, both in formal and informal settings, Madrid, Getafe, Spain, where he is the Director of
and connecting them. the GAST Research Group, Director of the UNESCO
Chair on “Scalable Digital Education for All,” and
Vice President for Strategy and Digital Education.
He is also the Coordinator of the eMadrid research network on Educational
Technology in the Region of Madrid. He is the Spanish representative at IFIP
TC3 on Education.
Authorized licensed use limited to: Edith Cowan University. Downloaded on June 14,2022 at 03:34:16 UTC from IEEE Xplore. Restrictions apply.