You are on page 1of 17

IEEE TRANSACTIONS ON LEARNING TECHNOLOGIES, VOL. 14, NO.

2, APRIL 2021 129

Affordances and Core Functions of Smart Learning


Environments: A Systematic Literature Review
Bernardo Tabuenca , Senior Member, IEEE, Sergio Serrano-Iglesias, Adrian Carruana Martın,
Cristina Villa-Torrano, Yannis Dimitriadis , Juan I. Asensio-Perez , Carlos Alario-Hoyos ,
omez-Sanchez , Miguel L. Bote-Lorenzo , Alejandra Martınez-Mones , and Carlos Delgado Kloos
Eduardo G

Abstract—Smart learning environments (SLEs) have gained article presents a comprehensive characterization to describe SLEs
considerable momentum in the last 20 years. The term SLE has through their affordances, the technologies used, and pedagogical
emerged to encompass a set of recent trends in the field of approaches considered in the selected papers. As a result, specific
educational technology, heavily influenced by the growing core functions of SLEs are identified and explained. This work aims
impact of technologies, such as cloud services, mobile devices, at ensuring a relevant knowledge base and reference toward the
and interconnected objects. However, the term SLE has been implementation of future SLEs.
used inconsistently by the technology-enhanced learning (TEL) Index Terms—Smart learning environments (SLEs), system-
community since different research works employ the adjective atic literature review (SLR), technology-enhanced learning
“smart” to refer to different aspects of novel learning (TEL).
environments. Previous surveys on SLEs are narrowly focused
on specific technologies or remain at a theoretical level that does
not discuss practical implications found in empirical studies. To
address this inconsistency and also to contribute to a common I. INTRODUCTION
understanding of the SLE concept, this article presents a systematic
literature review of papers published between 2000 and 2019
discussing SLEs in empirical studies. Sixty-eight papers out of an
initial list of 1341 papers were analyzed to identify the following:
I N recent years, educational technology has evolved in
response to new educational needs with affordances that
offer new opportunities for teaching and learning. The techno-
1) what affordances make a learning environment smart; 2) which logical changes unleashed since the universalization of the
technologies are used in SLEs; and 3) in what pedagogical contexts
are SLEs used. Considering the limitations of previous surveys, and Internet and the later popularization of smartphones have
the inconsistent use of the SLE concept in the TEL community, this facilitated ubiquitous access to multiple formal, informal, and
nonformal learning options. Learning and teaching have
evolved enormously thanks to the adoption of software tools
Manuscript received July 30, 2020; revised March 1, 2021; accepted March for improved collaboration between people (e.g., open source
18, 2021. Date of publication March 23, 2021; date of current version June 4, software, video-conferencing tools, chats, MOOC platforms,
2021. This work was supported in part by the European Regional Develop-
ment Fund as well as by the National Research Agency of the Spanish Minis- etc.) or information technologies (IT) that are helping to
try of Science, Innovations, and Universities through the SmartLet project understand what happens in our environment (e.g., cloud serv-
under Grant TIN2017-85179-C3-1-R and Grant TIN2017-85179-C3-2-R, in ices, sensors, artificial intelligence (AI), data algorithms, etc.).
part by the Madrid Regional Government through the e-Madrid-CM Project
under Grant S2018/TCS-4307, a project which is cofunded by the European In addition, new modalities of educational environments have
Structural Funds (FSE and FEDER), in part by the European Regional Devel- emerged, in face-to-face, online (e-learning), and mobile envi-
opment Fund, as well as the Regional Council of Education of Castile, and ronments where learning occurs anytime and anywhere
Leon through CasualLearn project under Grant VA257P18, in part by the
European Commission through Erasmus+ Capacity Building in the Field of (m-learning). The recent pandemic and its effect on teaching
Higher Education projects LALA (586120-EPP-1-2017-1-ES-EPPKA2- and learning provides an illustrative example of the new
CBHE-JP), InnovaT (5898758-EPP-1-2018-1-AT-EPPKA2-CBHE-JP), and opportunities and challenges of recent advances in educational
PROF-XXI (609767-EPP-1-2019-1-ES-EPPKA2-CBHE-JP), through the
Erasmus+ Knowledge Alliances project ColMOOC (588438-EPP-1-2017-1- technology.
EL-EPPKA2-KA), and through the Erasmus+ Strategic Partnerships for higher Additionally, the combination of mobility with improved
education project TEASPILS (2020-1-ES01-KA203-082258). (Corresponding connectivity and cloud computing have facilitated the creation
author: Bernardo Tabuenca.)
Bernardo Tabuenca is with the Information Systems Department, Universi- of environments where multiple physical and virtual objects,
dad Politecnica de Madrid, 28031 Madrid, Spain (e-mail: bernardo. as well as people, are interconnected to support the so-called
tabuenca@upm.es). ubiquitous learning situations [1], [2]. The combination of
Sergio Serrano-Iglesias, Cristina Villa-Torrano, Yannis Dimitriadis, Juan
I. Asensio-Perez, Eduardo Gomez-Sanchez, Miguel L. Bote-Lorenzo, and ubiquitous learning with recent trends in social learning and
Alejandra Martınez-Mones are with the Cooperative and Intelligent learning analytics (LAs) has led the focus of this article: smart
Systems Group, Universidad de Valladolid, 47002 Valladolid, Spain (e- learning [3]. Broadly speaking, smart learning can be regarded
mail: sergio@gsic.uva.es; cristina@gsic.uva.es; yannis@tel.uva.es; juaase@tel.
uva.es; edugom@tel.uva.es; migbot@tel.uva.es; amartine@infor.uva.es). as learning in interactive, intelligent, and tailored environ-
Adrian Carruana Martın, Carlos Alario-Hoyos, and Carlos Delgado Kloos ments, supported by advanced digital technologies and serv-
are with the Telematic Engineering Department, Universidad Carlos III de ices [4]. In the context of these learning environments,
Madrid, 28903 Madrid, Spain (e-mail: acarruan@inf.uc3m.es; calario@it.
uc3m.es; cdk@it.uc3m.es). students may adopt different learning patterns depending on
Digital Object Identifier 10.1109/TLT.2021.3067946 their daily activity, the device in their hands, their
1939-1382 ß 2021 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission.
See https://www.ieee.org/publications/rights/index.html for more information.

Authorized licensed use limited to: Edith Cowan University. Downloaded on June 14,2022 at 03:34:16 UTC from IEEE Xplore. Restrictions apply.
130 IEEE TRANSACTIONS ON LEARNING TECHNOLOGIES, VOL. 14, NO. 2, APRIL 2021

connectivity, time availability, location, and needs for interac- as in empirical studies. Additionally, despite the relevant role
tion with objects or colleagues [5]. Students can benefit from that technology plays in SLEs, it has not been considered a core
learning environments like these, which may efficiently fit topic in any of those previous literature reviews. Empirical
into their daily routine and seamlessly integrate formal and results from case studies help to analyze the consistency and the
informal learning [5]. evolution of a research area over time. Therefore, a review of
In recent years, new associations like the International empirical research on SLEs could help to better understand the
Association for Smart Learning Environments (IASLE), con- specific features of existing SLEs as well as the particular tech-
ferences like the International Conference on Smart Learning nologies they use and the educational contexts in which they
Environments (ICSLE) or the International Conference on have been tested. By understanding those three ingredients,
Smart Learning Ecosystems and Regional Developments which are much harder to grasp from theoretical proposals, it is
(ICSLERD), and journals like the Smart Learning Environ- more likely to obtain a clearer delimitation of the SLE concept.
ments Journal (SLE Journal) or Interactive Technology and Based on the understanding of those ingredients, this article
Smart Education Journal (ITSE) have clustered research investigates a convergent vision of SLE that aims at providing
efforts attempting to define, assimilate, and integrate emerging consistency of the term SLE in further research.
technologies in educational environments aimed at improving In this article, a systematic literature review (SLR) is carried
learning performance, the so-called smart learning environ- out to characterize SLEs in three dimensions:
ments (SLEs). All this swarm of research activities suggests 1) what affordances make a learning environment “smart”;
that SLEs are progressively becoming the focus of a distinct 2) which technologies are used in SLEs; and
subcommunity within the wider technology-enhanced learning 3) in what pedagogical contexts are SLEs used. Based on
(TEL) research field. However, the initial development of this this characterization, we propose a definition of SLE,
community, as usual [6], leaves many questions that need fur- discuss the results of the literature review, and suggest
ther investigation. research opportunities in the field of SLEs.
Within this new evolving landscape, several relevant pro- The rest of this article is organized as follows. Section II
posals have been made with the aim to delimitate the definition, presents and compares existing literature reviews related with
features, and scope of SLEs. Kinshuk [7] defined SLEs as eco- SLEs. Section III describes the methodology applied to perform
systems that enable the fusion of technology and pedagogy to the literature review. Next, Section IV describes the results of
provide real-time and ongoing evidence of changes in knowl- the analysis of relevant publications presenting the evolution of
edge and skills, which are seamlessly assimilated by learners as the topic within the last two decades and identifying the key
they move from one learning context to another. Spector [8] authors and publications. SLEs are characterized in Section V.
identified ten affordances that are necessary (effective, efficient, Then, in Section VI, gaps for further research in the field of
and scalable), highly desirable (engaging, flexible, adaptive, and SLEs are discussed. Finally, Section VII concludes this article.
personalized), and likely (conversational, reflective, and innova-
tive) “to develop thoughtful, productive, and responsible mem-
II. RELATED WORK
bers of society using SLEs.” Spector’s general claim is that the
extent to which these affordances are present determines The scientific literature includes relevant reviews in which
whether and to what extent a particular learning environment publications on SLEs are explored. Papamitsiou and Econo-
should be considered “smart.” Alternatively, Hwang [9] summa- mides [3] performed a meta-analysis quantifying empirical
rized the potential of SLEs into three key capabilities. findings for publications between 2009 and 2015 in the inter-
1) SLEs are aware of learners’ situation or their context, section of two research areas: SLEs and LAs. The results of
meaning that the system is able to provide learning sup- their analysis suggested that the main pedagogical objectives
port based on the learners’ status. consisted in predicting learning performance, modeling stu-
2) SLEs are able to offer instant and adaptive support to dent behavior, improving assessment, and anticipating drop-
learners by analyzing their individual needs and consid- outs. However, this review targeted the potential of LAs,
ering different perspectives (e.g., learning performance, rather than a better understanding of the affordances of an
learning behaviors, profiles, personal factors, etc.). SLE. Moreover, it covered a period in which research on
3) SLEs are able to adapt the user interface and the subject SLEs was still incipient. A more recent work by Putro et al.
contents to meet the personal characteristics (e.g., learn- [11] reviews the scientific literature to explore alternative
ing styles and preferences) and learning status (e.g., options for group formation in SLEs. Although the authors
learning progress, learning performance, etc.) of indi- considered Hwang’s definition to contextualize their work
vidual learners [9]. Last but not least, Koper [10] within group organization issues towards learning, the review
focused on the efficiency to describe SLEs as improved is narrowly focused on one specific feature (learning in
environments to promote “better and faster” learning. groups), which is, in fact, not always supported or even needed
As shown above, multiple definitions of SLEs and their scope in many SLEs that only support individual learning. More-
have been proposed, while no single definition has been widely over, the characteristics of SLEs, as defined by Hwang, were
accepted and used in the literature. Moreover, existing literature not discussed in the presentation of the results. Heinemann
reviews are either very narrowly focused or are limited to theo- and Uskov [12] also presented a literature review to explore
retical primary studies that do not discuss practical implications key concepts with regard to the implementation of smart

Authorized licensed use limited to: Edith Cowan University. Downloaded on June 14,2022 at 03:34:16 UTC from IEEE Xplore. Restrictions apply.
TABUENCA et al.: AFFORDANCES AND CORE FUNCTIONS OF SMART LEARNING ENVIRONMENTS: A SYSTEMATIC LITERATURE REVIEW 131

universities and identified several key concepts, such as smart


campus, SLEs, smart teacher, smart classrooms, and smart
education. The authors of this last review identified four key
features of SLEs inspired by Hwang’s vision: 1) ubiquitous
computing; 2) context-aware systems; 3) adaptive teaching;
and 4) seamless learning. However, their findings are based
solely on theoretical proposals, rather than on analysis of
empirical studies involving SLEs.
All in all, previous literature surveys have focused on quite
specific issues (e.g., the role of LAs in SLEs or group forma-
tion in SLEs) or have paid attention to the affordances of
SLEs in specific educational contexts (e.g., higher education),
and they have not analyzed the empirical results of the use of
SLEs. From a conceptual perspective, it remains unclear what
the affordances of an SLE are that make it smart. From a prac- Fig. 1. Methodology used in this systematic literature review.
tical perspective, the implications of different technologies
have not been studied. Finally, with regard to the experience these enabling technologies are organized and what ecologies
of learning in SLEs, to the best of our knowledge, existing lit- are usually formed.
erature has not systematically analyzed the different pedagogi- 3) Research Question 3 (RQ3). In What Pedagogical Con-
cal approaches and educational settings in which SLEs have texts are SLEs Used?: The introduction of advanced func-
been used. tionalities in environments can be applied in various
pedagogical contexts (e.g., problem-based learning, immer-
III. METHOD sive education, inquiry-based learning, etc.), educational set-
This SLR has been carried out following the method speci- tings (formal learning, informal learning, or nonformal
fied by Kitchenham and Charters [13]. This method was ini- learning), educational levels (e.g., primary, secondary, higher
tially conceived for the field of software engineering. education, etc.), and domains (e.g., workplace, wellness,
However, its use has spread to multiple research areas, includ- health, and fitness). This SLR explores and systematizes the
ing TEL [1], [14], [15]. literature considering these contexts.

A. Research Questions
The following research questions guided the study. B. Review Methodology
1) Research Question 1 (RQ1). What Affordances Make a The literature review was accomplished following
Learning Environment “smart”?: Existing models provide Kitchenham’s [13] guidelines for SLRs. Nine researchers par-
multiple working definitions for SLEs using specific affordan- ticipated in the review. An overview of the process is graphi-
ces of adaptability, efficiency, effectiveness, sustainability, or cally depicted in Fig. 1, where search, selection of studies, and
intelligence [7]–[10]. It is worth studying how these defini- data extraction processes are described. The full dataset
tions and affordances have been used in real settings in order including the results of the complete process is shared in open
to converge toward a more consistent characterization. Here, access.
we focus our exploration on previous works that have evalu- 1) Search: The search phase spanned from September
ated the impact of SLEs in real learning settings. We believe 2019 to November 2019. As illustrated in Fig. 1, the search
that research findings based on empirical evidence, instead of was performed using three different sources to identify rele-
analyses that are theoretical in nature, can better explain the vant articles.
impact of the SLEs main features in real situations in which 1) Digital libraries: An automatic search of the query
different pedagogical approaches, technological tools, and string “smart learning environment” was carried out
roles (teachers, students, institutions, etc.) are involved. in digital libraries within the fields (title or abstract or
2) Research Question 2 (RQ2). Which Technologies are keywords or body). The search was performed using
Used in SLEs?: SLEs are used in face-to-face (e.g., physical the databases considered most relevant to cover the
classrooms), online [e.g., learning management systems scope of this research: ACM Digital Library, IEEE
(LMSs)], or hybrid [16] (e.g., physical and digital artifacts, Xplore Digital Library, Web of Science, Scopus,
physical spaces with augmented reality (AR), web-based with SpringerLink, and ScienceDirect.
3-D worlds, etc.) learning contexts. From a different perspec- 2) Journals with a specific focus on SLEs: A manual
tive, SLEs are employed in classroom and out-classroom search for journals referencing SLEs in their journal
learning situations. With respect to time, SLEs involve syn- name, scope, or issue name was done. Two specific
chronous or asynchronous interactions. Technology plays a journals were identified: 1) the SLE journal, released
key role in assisting stakeholders across these learning con- in 2014, which has published approximately 30 articles
texts, situations, and interactions. This study investigates how per year in open access; and 2) the ITSE journal,

Authorized licensed use limited to: Edith Cowan University. Downloaded on June 14,2022 at 03:34:16 UTC from IEEE Xplore. Restrictions apply.
132 IEEE TRANSACTIONS ON LEARNING TECHNOLOGIES, VOL. 14, NO. 2, APRIL 2021

TABLE I were considered outside the scope of this review. Surveys


INCLUSION AND EXCLUSION CRITERIA
were discarded. Technological proposals that were not
described within a pedagogical context were also discarded.
Papers where the term “smart” was only stated in the title,
keywords, or slightly in the text without justifying its
“smartness” were discarded. All these restrictions were formu-
lated as inclusion and exclusion criteria (IC/EC), as shown in
Table I.
The papers were independently reviewed by four research-
ers with respect to the IC and EC as suggested by Breton et al.
[17]. In all reviews, the disagreements were negotiated refin-
ing the IC/EC criteria or accordingly adapting the RQs. The
selection process was performed to filter out-of-scope publica-
tions in two steps.
1) Preprocessing: Two researchers reviewed the titles,
keywords, and publication scope of the studies found
in the search process, and irrelevant papers were dis-
carded according to the IC/EC. The set of primary
studies was reduced to 312 publications.
2) Processing: The same two researchers independently
reviewed titles, abstracts, and keywords against the IC/
released in 2004, which has published approximately EC in two iterations. In the first review, the set of primary
24 articles per year in Open Access. studies was reduced to 195 publications. Kitchenham
3) Conferences with a specific focus on SLEs: A manual and Charters [13] proposed using Cohen’s Kappa statis-
search for conferences including “SLE” in their tic to measure the agreement between two judges during
name, scope, or proceedings title was done. Two con- the study selection process. The value of Kappa in the
ferences were shortlisted. The first conference is the first review resulted (k = 0.58) in a moderate agreement
ICSLE, which was first organized in 2012 as the Inter- according to Landis and Koch [18]. The second review
national Symposium on Smart Learning Environ- was performed including two new researchers with the
ments. Its second edition (now as a conference) was aim of considering alternative points of view. The set of
held in 2015. Since then, it has been held annually primary studies was reduced to 104 publications in the
with the exception of 2017. The second conference is second review, whereas the value of Kappa resulted (k =
the ICSLERD, which was first organized in 2016. 0.93) in an almost perfect agreement [18].
Since then, it has been held every year. Moreover, 3) Data Extraction: In the third phase, nine researchers
conferences with a focus on educational technology reviewed the papers to extract data that will be further ana-
were manually scanned to identify special tracks lyzed with respect to the RQs. The researchers had to read the
including “SLE” in their title. Therefore, publications full text and then fill out a structured questionnaire.
from the SLE special track at the IEEE International Reviewers were requested to classify each article according
Conference on Advanced Learning Technologies to the type of publication, authors, number of citations, the
(ICALT) were included in the initial dataset. way authors had approached the concept of SLE, and the ped-
Duplicated papers or preliminary versions of publications agogical context in which the SLE was introduced.
were removed. This phase resulted in a set of 1341 articles. Reviewers extracted “smart” concepts (e.g., artifacts,
2) Selection of Studies: In order to let the formulated RQs spaces, or approaches) associated with the SLEs that were pre-
guide the literature selection, the search targeted publications sented in the articles. Hence, they could select these concepts
in which one or several technological tools were used in the from a given list (eight concepts shortlisted during the selec-
context of an SLE. As noted above, this review aims to fill a tion of studies) or even introduce concepts that had not been
research gap: explore publications in which SLEs are empiri- shortlisted. These concepts were extracted from the articles as
cally presented. Therefore, the description of technological literally stated by their authors. Hence, reviewers categorized
tools should include their specific components, and it should articles considering authors’ perspectives on what might be
be shown that such tools have achieved, at least, the level of qualified as “smart” in their own publication. The reviewers
functional prototype, capable of being used by real stakehold- did not make interpretations aggregating similar concepts nor
ers (teachers, students, etc.). Likewise, publications should separating disparate concepts because the “smartness” was not
provide enough evidence (e.g., evaluation, pictures, detailed always sufficiently justified in the texts.
architecture schemas, etc.) to corroborate that the SLE had Similarly, the identification of affordances was performed
indeed been used by real teachers and/or students (i.e., they in two steps: First, in the preprocessing, reviewers shortlisted
were not just yet-to-be-developed tools). Articles describing the most frequent affordances of SLEs; second, in the data
only ideas, theories, or models to be implemented in the future extraction process, reviewers classified SLEs considering

Authorized licensed use limited to: Edith Cowan University. Downloaded on June 14,2022 at 03:34:16 UTC from IEEE Xplore. Restrictions apply.
TABUENCA et al.: AFFORDANCES AND CORE FUNCTIONS OF SMART LEARNING ENVIRONMENTS: A SYSTEMATIC LITERATURE REVIEW 133

and 2016, respectively. The low peak in 2017 can be attributed


to the cancelation of the 2017 ICSLE and the subsequent lack
of publication (within the same year) of extended versions in
the partner journal Smart Learning Environments. It stands
out that prior to the peak in 2015, two articles presenting
SLEs were published [19], [20] in 2003 and 2008, respec-
tively. As specified in Section III-B1, it should be noted that
the search process did not include all publications in 2019 (the
search was performed in September 2019) justifying the slight
decrease in the last year.
Regarding the distribution of papers by publication type, the
fact that only rather mature papers with empirical articles are
considered justifies that most of the selected articles come
from journals: 59% (n = 40) were published in journals, 40%
(n = 27) were published in conference proceedings, and less
Fig. 2. Evolution in the number of empirical papers published between 2000 than 1% (n = 1) were published as book chapters. Considering
and 2019 (September).
the number of articles selected, the Smart Learning Environ-
ments journal (n = 31) and the International Journal of Web-
these affordances. Optionally, reviewers could suggest addi- Based Learning and Teaching Technologies (n = 2) were the
tional affordances that had not been shortlisted. most relevant journals, whereas the ICSLE (n = 8) was the
With respect to technologies, the review process included most relevant conference.
an item in which reviewers should identify technologies used The 68 publications extracted in the SLR were written by
in the SLEs that were used in the papers. As a result of the ini- 222 different authors. Only 20 authors have three or more pub-
tial review, 21 technologies were previously shortlisted. The lications. According to this classification, Kinshuk (n = 8),
questionnaire offered a choice of these technologies, allowing Kumar (n = 3), Boulanger (n = 3), and Seanosky (n = 3) are
for multiple selection. Likewise, reviewers had the option to the most relevant authors. Kinshuk, Boulanger, and Seanosky
propose additional technologies. [21]–[23] have coauthored three publications, whereas Kumar
With regard to the pedagogical contexts, an analysis of the [21], [22] has also coauthored two publications with them.
pedagogical approaches involved in the contributions from a Exploring the number of citations in Google Scholar (see right
TEL perspective was performed. Hence, reviewers had to clas- vertical axis in Fig. 2), the most highly cited publications
sify the publications considering the list of 13 topics included were [24] (n = 130 citations), [25]–[28] (30 < n < 40 cita-
in the scope of the European Conference on Technology- tions), and [29]–[33] (15 < n < 30 citations). The highest
Enhanced Learning 2019 (EC-TEL). The usage of these topics number of citations occurs between 2014 and 2016. Regarding
in the review process was considered due to the high relevance the number of citations per year, again [24] obtained the
of this conference in the area. The review process included 10 higher rate (n = 21), followed by [25]–[29], [34]–[36] (5 > n
questions to investigate the pedagogical context in SLEs. > 10 cites per paper). Smeda et al. [24] present a special soft-
Questions referring to pedagogical approaches and learning ware where students go through the complete lifecycle of digi-
strategies and learning domains presented a set of items tal storytelling under the guidance of teachers.
extracted from the previous phase. Reviewers were encour-
aged to identify the most suitable one for the reviewed paper.
Nevertheless, reviewers could add any additional category as
V. CHARACTERIZATION OF SLES
they see fit.
In addition, a question was included to filter articles that This section aims at characterizing the SLEs by means of
were not sufficiently detailed or that were outside the scope of investigating “smart” concepts that are associated with SLEs
educational technology. (what is smart in SLEs?), their affordances, the technologies
Finally, the set of primary studies was reduced to 68 publi- used, and the pedagogical contexts as they are described in the
cations in the third phase. The value of Kappa resulted (k = selected studies. The analysis and interpretation of the results
0.85) in an almost perfect agreement [18] against the IC/EC. are reported in the conclusions section. For the sake of read-
ability, tables presented in this section only illustrate the most
frequently used concepts to characterize SLEs.
IV. ANALYSIS OF PUBLICATIONS INCLUDED IN THE SLR
The results presented in Table II show that SLEs are usually
Fig. 2 shows the evolution in the number of papers pub- implemented considering smartphones within the environ-
lished per year, escalating notably in the last five years. The ment [37]. Smartphones play a key role in SLEs as they embed
rapid growth in the number of publications in recent years multiple sensors and actuators in just one device. For example,
coincides with the time when the Smart Learning Environ- smartphones are used as clickers to complete questionnaires
ments journal was first released (2014). Likewise, the ICSLE and assignments [26], [38]–[41]. Alternatively, smartphones
and the ICSLERD were organized for the first time in 2015 are used to visualize learning contents [32], [42], [43].

Authorized licensed use limited to: Edith Cowan University. Downloaded on June 14,2022 at 03:34:16 UTC from IEEE Xplore. Restrictions apply.
134 IEEE TRANSACTIONS ON LEARNING TECHNOLOGIES, VOL. 14, NO. 2, APRIL 2021

TABLE II TABLE III


CONCEPTS ASSOCIATED WITH THE TERM “SMART” AFFORDANCES ASSOCIATED WITH SLES

SLEs are usually implemented in smart classrooms that


combine the physical and virtual spaces. Burghardt et al. [20]
designed a smart meeting room equipped with multiple cam-
eras and projection surfaces for learning purposes. The teacher
speaks and moves along a room while a set of cameras capture
the most relevant view which is projected on screens. Simi-
larly, in the work of Bdiwi et al. [34], classrooms were
equipped with cameras, screens, tablets, and radio frequency
identification (RFID) tags to investigate the impact of the pres-
ence of the teacher in working groups. The results indicated
that the presence of the teacher increased learners’ motivation,
engagement, and effective learning. Finally, Chaczko et al.
[44] presented an architecture in the context of a smart class-
room featuring gesture recognition, haptic devices, speech rec-
ognition, and ambient sensors to enhance collaborative
learning.
Regarding the use of smart devices, Augello et al. [45] pre-
sented a system [Personal Intelligent Coach (PICo)] to manage
learning tasks and interactions within a complex SLE. This
system featured two alternative embodiments: 1) a humanoid
robot; and 2) an avatar running on a mobile application. This
system adapted the learning contents based on students’ needs considering stakeholders’ context. In the context of clinical
along the learning process. care, Pesare et al. [26] developed serious games for symptom
With respect to the concept of smart teacher, Preston et al. identification and therapeutic interventions. In these serious
[46] presented a kitchen equipped with cookware (smart games, students make decisions and are scored depending on
objects) and high resolution screens. An avatar guided the their performance. In addition, the game becomes more com-
user with audio messages to cook while learning the vocabu- plicated as the student progresses. Hence, the authors managed
lary in the selected foreign language. Tan et al. [47] presented to create an adaptive and personalized environment for each
a smart lab that supports students to perform assignments student. Similarly, Paquette et al. [25] presented a method for
remotely using robotics, Internet of Things (IoT) devices, computing the relationships between students’ competencies
LAs, cloud services, and virtual reality. to personalize their MOOC. Thus, the system adapted the
Finally, the concept of smart education is used in the con- learning environment considering the profile of each student.
text of electrical engineering education to train students sup- SLEs record data from stakeholders’ context throughout
ported by an autonomous robotic system [48]. The authors learning activities using sensors installed in the environ-
justified the smartness of the system considering adaptation, ment [58] or in embedded systems [34], [44], [52], [59], such
autonomy, and self-organization features. as smartphones and wearables. The results of the analysis
show that tracking and monitoring affordances (traceable
onwards) were identified in 31% of the publications. In the
A. Affordances of SLEs
context of language learning, Mouri and Ogata [28] designed
The results summarized in Table III show that many SLEs a methodology for learning Japanese as a foreign language.
adapt to stakeholders’ (i.e., learners and teachers) context to Similarly, Bdiwi et al. [34] defined a collaborative learning
support them to perform learning activities. Adaptation, cus- environment aimed at learning how to make a joystick using
tomization, and personalization (adaptable onwards) are the an Arduino microcontroller. Teachers could track and provide
most frequently referred (62%) affordances when defining support to different groups of students using sensors and
SLEs. Adaptable refers to adjusting the learning environment cameras.

Authorized licensed use limited to: Edith Cowan University. Downloaded on June 14,2022 at 03:34:16 UTC from IEEE Xplore. Restrictions apply.
TABUENCA et al.: AFFORDANCES AND CORE FUNCTIONS OF SMART LEARNING ENVIRONMENTS: A SYSTEMATIC LITERATURE REVIEW 135

Feedback and recommendations (recommendation Here, technologies are classified and listed considering these
onwards) refers to information provided by the SLE based on core functions.
stakeholders’ actions performing learning activities. The 1) Collecting Contextual Information. Sense: SLEs collect
results show that the recommendation affordance was recog- specific information about stakeholders’ context in order to
nized by 29% of the publications. In the context of tutoring prepare personalized adaptations. Likewise, SLEs might col-
systems, Lalingkar et al. [60] developed a system that pro- lect multiple samples along the learning activity to trace stake-
vided corrective feedback clues just after answering the ques- holders’ actions and reactions. Technology plays a key role in
tion. The difficulty level of the questions could be configured SLEs collecting contextual information, which could refer to
by the teacher. the following [85]:
SLEs usually analyze the collected data and identify pat- 1) identification of the stakeholder (e.g., through face recog-
terns related to stakeholders’ behavior and their context when nition, person identification, etc.) or an object [e.g., near-field
carrying out learning activities. The results of the analysis communication (NFC)];
show that patterns, activity, and behavior identification affor- 2) timestamp when learning activities are performed, to
dances (pattern recognition onwards) were identified in 23% record the time where the learning activity is performed;
of the publications. In the context of presentation training, 3) who collaborates with the stakeholder within the SLE;
Burghardt et al. [20] proposed a system that recorded a 4) the conditions in which the learning activity is carried out
speaker making a presentation in public, recognized the pre- (e.g., environmental, physical, or biometric conditions).
senter’s behaviors, and provided suitable guidance to improve Table IV lists technologies found in the review that are used
it. Similarly, Denden et al. [61] developed a role-playing to sense information in SLEs.
game to teach the subject of computer architecture. Their sys- The most frequently used technologies on SLEs were
tem used data analysis techniques to identify behaviors within smartphones, handheld devices, and tablets. These devices
the game. Consequently, the system sketched out the personal- usually comprised multiple sensors and interfaces that facili-
ity of the students considering these patterns. tated retrieving data from them. For example, the work of
SLEs offer appropriate adaptations based on stakeholders’ Bacca et al. [38] shows an architecture for customizing the
profile to personalize their learning activities and, conse- way English is learnt as a foreign language. This architecture
quently, to provide a more engaging learning experience. The included a mobile application, in which the student answered
analysis shows that the engaging affordance was recognized questions that were prompted considering the data collected
in 21% of the publications. In the context of video-based from his/her profile.
learning, Kleftodimos and Evangelidis[30] designed a tool for Desktop computers were used in 25% of the selected publi-
teachers to add interactive features to videos, such as question cations. For example, Hien et al. [78] presents a messenger
answering, extra information, jokes, etc. Thus, learning chatbot that collects frequently asked questions by students.
became more fun and attractive to students. The teacher progressively improves the chatbot including
Efficient in SLEs refers to how well education is performed answers to the questions.
with respect to the required effort. The results show that the LMSs were referenced in 20% of the selected publications.
efficiency affordance was identified by 21% of the publica- LMSs are commonly used in e-learning environments. The
tions. In the context of primary education, Smeda et al. [24] work from Koulocheri and Xenos[86] presents an LMS that
investigated the efficiency of digital storytelling in a physical collects information from students’ social activity in forums
classroom considering learning performance and students’ to provide customized assistance.
engagement. In recent years, cameras featuring new functionalities are
Effective learning in SLEs is considered when stakeholders showing a great potential for application in the educational
perform their learning activities successfully obtaining the field (e.g., GoPro cameras, 360-degree cameras, super slow
intended result. The results show that the effective affordance motion cameras, or cameras with facial/motion recognition).
was recognized by 16% of the publications. Choi and Suk [29] Cameras enable identification of stakeholders and track them
analyzed the impact of the light intensity in the effectiveness in the sense process. In the context of nursing education, Her-
of resolving arithmetic problems. The authors found a small ault et al. [65] used videos recorded with a 360-degrees cam-
increase in the academic performance when light had a higher era in real medical operations. Later on, these videos were
intensity. used to promote discussion among students in authentic
scenarios.
Nowadays, wearables sense data on sleeping patterns or
B. Technologies Involved in SLEs
biometrics. In the context of smart cities, Kadar [53] devel-
The analysis of the technologies identified in the review sug- oped an early warning system that collected biometric and
gests that technology is used in three well-differentiated pro- environmental conditions to monitor critical processes on a
cesses of the SLE: input data (sense onwards, such as computers, smart campus.
smartphones, microcontrollers, biometric sensors, etc.), process Overall, the results presented in this section help to under-
data (analyze onwards, such as machine learning (ML), ontolo- stand how technology can help to sense data in SLEs. In the
gies, process mining, etc.), and output data (react onwards, next section, alternative techniques for analyzing data using
such as smartphones, computers, data visualizations, etc.). technologies are described.

Authorized licensed use limited to: Edith Cowan University. Downloaded on June 14,2022 at 03:34:16 UTC from IEEE Xplore. Restrictions apply.
136 IEEE TRANSACTIONS ON LEARNING TECHNOLOGIES, VOL. 14, NO. 2, APRIL 2021

TABLE IV TABLE V
TECHNOLOGIES USED TO COLLECT CONTEXTUAL INFORMATION IN SLES TECHNOLOGIES USED TO INTERPRET THE CONTEXT WITH DATA PROCESSING
(SENSE) TECHNIQUES IN SLES (ANALYZE)

institutions. The work of Toivonen et al. [67] showed an SLE


for 3-D design in which data was collected from students’ dig-
ital trails. The system analyzed data from different learning
activities (brainstorming, design, 3-D printing, programming,
and sharing) and unified the results into a single dashboard.
Ontologies were referenced in 9% of the selected publica-
tions. Ontologies are frequently used in educational contexts
to formulate models of knowledge that can be understood by
2) Interpreting the Context Using Data Processing Techni- both humans and machines. For example, the work by Laling-
ques. Analyze: The proliferation of sensors, wireless net- kar et al. [60] showed a problem-solving system in which all
works, and cloud data systems (the so-called big data) has the interactions of the student were stored in the student model
favored the inclusion of data processing and analysis techni- ontology and displayed the student’s learning profile together
ques in SLEs (see Table V). The results of the analysis are pre- with a list of missing concepts and misconceptions. Addition-
sented considering that some of these data processing ally, the system analyzed the profile data to provide custom-
techniques might overlap in specific taxonomies. ized feedback via links to resources to study some concepts
The most frequently used technique to analyze data was ML in depth.
(26%). ML is a set of data processing techniques usually seen The results presented in this section showcase how technol-
as a subset of AI [89]. ML studies computer algorithms to ogy can help to improve the analysis of data generated in
improve them through experience. In Savov et al. [66], ML SLEs. The next step, tackled by the next section, is to under-
was used within a system that inferred students’ level of atten- stand how technology can also help to “react” and make use
tion analyzing their expressions toward improved engagement. of the results of those data analysis with the ultimate goal of
LA were referenced in 25% of the selected publications. improving the learning processes supported by SLEs.
LAs are driven by the collection and analysis of learners’ 3) Providing Customized Cues for Action. React: SLEs
traces while interacting with the learning environment [90]. In provide customized feedback and recommendation cues for
SLEs, LAs can help to understand and optimize the learning stakeholders based on the interpretation of the data analyzed
process and the environments in which this process during the analysis process. Table VI summarizes the technolo-
occurs [91]. For example, the work of Khousa et al. [68] pre- gies that are employed to facilitate reaction through suitable
sented an SLE career prediction system that analyzed the data recommendations to stakeholders in SLEs. These reactions can
collected from students in a questionnaire. Based on the be directly produced by the SLE based on the analysis of the
results of the analysis, the system aimed at building self-confi- data or indirectly produced by stakeholders based on the rec-
dence on the student within a specific field of employment. ommendations suggested by the SLE (actionable feedback).
Data mining was referenced in 13% of the selected publica- Smartphones, handheld devices, and tablets are equipped
tions. Data mining techniques in education are mostly used to with useful features to provide feedback or display informa-
extract and analyze information collected by educational tion: sending messages, displaying multimedia content, or

Authorized licensed use limited to: Edith Cowan University. Downloaded on June 14,2022 at 03:34:16 UTC from IEEE Xplore. Restrictions apply.
TABUENCA et al.: AFFORDANCES AND CORE FUNCTIONS OF SMART LEARNING ENVIRONMENTS: A SYSTEMATIC LITERATURE REVIEW 137

TABLE VI TABLE VII


TECHNOLOGIES USED TO PROVIDE CUSTOMIZED CUES FOR ACTION IN SLES PEDAGOGICAL APPROACHES AND LEARNING STRATEGIES IN SLES
(REACT)

extracting data from Internet services (e.g., repositories or


cloud services). For example, the work of Lytridis and Tsina-
kos [43] shows a mobile tool that responds to the identification
of a specific page in a book, presenting augmented 3-D objects
to enrich the description. and coherently use actuators to trigger an action to provide
Similarly, desktop computers can react by displaying cus- feedback. For example, the Feedback Cube [58] includes both
tomized information. Thomas et al. [35] presented a simula- visual and acoustic actuators. A ring of 16 LEDs can be pro-
tion tool in which students were posed a problem. Students grammed to respond displaying effects such as fading, blink-
had to deal with alternative choices, provided by the tool in ing, or color transitions. The mini speaker used can reproduce
reaction to their answers, to learn how to solve the problem. audio effects such as single tones, complex melodies, or
Data visualizations were referenced in 17% of the selected encoded audio files. The actuators of the system can be config-
publications. Data visualizations comprise charts, representa- ured by the student to provide customized alerts based on his/
tions, or dashboards whose interpretation can be translated her learning patterns.
into meaningful actionable recommendations to guide stake- Displays were referenced in 7% of all publications. Most
holders in their learning [15]. In the context of software engi- displays show information visually and acoustically. The pub-
neering [31], students worked individually in conceptual lications included in this cluster also include digital post-
design tasks (i.e., create class and interaction diagrams). The ers [44] and digital tables [57]. The work by Tortorella and
tool reacted providing customized visualizations for improved Kinshuk [59] presents a medical training system that uses dif-
design considering students’ traces. ferent displays to alert students about potential invisible risks
Videos were referenced in 10% of the selected publications. and pathogen contamination usually found in specific spaces
Videos are frequently used in online education as embedded (e.g., bathroom, sink, toilet, etc.). The system reacted display-
resources in LMSs or in social networks. In the context of ing recommendations on how students should behave onwards
SLEs, Herault et al. [65] present an interactive video-based to reduce the risks of contamination.
learning system for nursing education. The system reacts to
the decisions taken by the student prompting contextualized
C. Pedagogical Contexts in SLEs
questions in a simulated scenario.
Microcontrollers and actuators were used in 7% of the In this section, we explore RQ3, dealing with the educa-
selected publications. The results reported in this review show tional settings the SLEs were designed for. An analysis of the
different SLEs in which IoT systems use sensors (see Table conditions of the supported settings helped to understand the
VI: biometric, environmental) to collect data, use a microcon- rationale of the contributions. The results of this analysis are
troller to process the data (Arduino [34], [58], ARM Cortex presented in Table VII. These results show no predominant
A7 [48], Dragonboard [66], and Raspberry [47], [59], [67]), pedagogical approach or learning strategies tied to SLEs.

Authorized licensed use limited to: Edith Cowan University. Downloaded on June 14,2022 at 03:34:16 UTC from IEEE Xplore. Restrictions apply.
138 IEEE TRANSACTIONS ON LEARNING TECHNOLOGIES, VOL. 14, NO. 2, APRIL 2021

Such diversity suggests that SLEs do not intrinsically restrict Nevertheless, nonformal and informal learning studies attempt
the pedagogical approach to be used. to enable learning in unconventional settings that offer new
From the previous results, it can be observed that the sup- opportunities to learners, with a major concern on the actions
ported pedagogical approaches are mostly student-centered. that can be performed or the development of the learning
This focus on students is reflected on the stakeholders consid- resources. Preston et al. [46] encouraged students to learn lan-
ered throughout the different papers. From 68 papers guages while they are cooking, with the provision of embed-
reviewed, 39 focused exclusively on supporting learners, ded devices and interfaces among the kitchenware. Tortorella
whereas 3 papers supported exclusively teachers. This interest and Kinshuk [59] proposed a mobile learning system that pro-
in supporting learners is consistent with the affordances vides contextual information about potential pathogens pres-
reported in Section V-A, which are tightly related to the learn- ent in the current environment and suitable alternatives to deal
ing experience and sustain the student-centered perspective of with them. Leonidis et al. [56] presented an extensible soft-
SLEs. The support for teachers is mostly aimed at providing ware infrastructure that empowers teachers to design and pro-
reports and visualization of analytics with regard to learners’ gram purposeful and engaging learning activities for formal
activity [70], [84]. Imran et al. [70] introduced an analytical and informal learning environments, by combining and
and visualization tool (rule-based recommender system: orchestrating cloud-based, ambient and pervasive facilities,
VAT-RUBARS) to provide support for teachers in learner- and services. Still, some contributions attempt to combine
centered courses toward improved performance of their learn- these types of learning. Tabuenca et al. [58] presented an IoT
ers. On the other hand, Bechreu et al. [84] presented a tool system based on NFC tags and audio/visual feedback that
(StudentViz) to help teachers visualize and understand the col- learners could use to configure customized alerts, aimed at
laboration patterns among students. fostering self-awareness on the time devoted to learning across
Nonetheless, 23 papers attempted to support both learners contexts. Bravo-Torres et al. [62] presented a platform
and teachers simultaneously. In these contributions, there is a (OPPIA) which deploys sporadic learning networks among
special interest in the adoption of new technologies for students with similar learning needs to systematically encour-
enhanced learning practice: with the inclusion of sensors and age the interaction among them independently on where they
pervasive devices [29], [33], [44], [52], [53], [57], [79]; are located.
enabling the generation and deployment of new learning Regarding the learning spaces, the results of the analysis
resources such as documents [30], videos [19], enriching con- show that SLEs are implemented for virtual (43%), physical
tents with AR [43], or enabling access to resources from any- (32%), and blended spaces (25%). Through this analysis, it
where [56]; facilitating the learning process across was found that the objective of the SLEs depends on the sup-
spaces [20], [39], [47], [63]; or exploring its influence of its ported space. In the physical space, most proposals attempt to
adoption in practice [24], [82], [83]. Different publications enhance the facilities provided by the educational institution
presented systems that aimed at modeling students’ actions in classrooms [24], [29], [30], [33], [35], [41], [43], [45], [57],
and behavior [40], [50], [52], [61], [71], [76]. Likewise, Bdiwi [63], [65], [66] and laboratories [30], [31], [34], [35], [48],
et al. [34] monitored teacher’s interactions with the different [52], [68], [82]. In these cases, the major interest of the authors
groups of students in a classroom with an RFID-based location is to exploit the integration of technologies in these kinds of
system to analyze how those interactions affected students’ environments to provide new types of resources or ways of
performance. interaction. In the context of physical classrooms, Augello
Beyond the support in educational institutions, some of the et al. [45] presented the architecture of PICo, an intelligent
papers explored the support to learners in professional set- agent in the form of a storyteller robot that creates personal-
tings. Three articles aimed at supporting trainees in the indus- ized learning paths according to the student’s needs. Other
try where the main goal is to sharpen their professional skills. authors attempted to adapt the classroom to promote conve-
Seanosky et al. [21] relied on a system (SCALE) to evaluate nient conditions for learning. Choi and Suk [29] presented a
the skills of the workers in a company on emergency proce- dynamic lighting system to adapt the light of the classroom
dures. Barmada and Baghaei [87] presented an interactive and to investigate the effect of lighting color and temperature
training platform (Train-for-life) for workers in the area of on students’ performance. Chen et al. [33] developed Speech-
transport, logistics, security, and safety industry. This platform Driven PowerPoint to support the presentation of slides
helped the workers of the company to carry out their profes- through the detection of spoken keywords. In regard of physi-
sional training in MOOCs, reducing the number of dropouts. cal laboratories, some researchers explore the acquisition of
Pesare et al. [26] supported health professionals with the pro- data from the actions performed by learners in such environ-
vision of two serious games for sustaining engagement and ments [30], [31], [34], [52] through the usage of the tools and
motivation in medical contexts. systems involved (e.g., video-based learning [30]) or by means
One of the most prominent features of SLEs, according to of wearable biometric sensors to explore how students interact
seminal definitions, refers to the opportunity to bridge formal (e.g., collaborative learning [52]). Nevertheless, other contri-
and informal learning contexts [9], [92]. Most papers focused butions introduce SLEs to foster new interactions in the learn-
on formal learning (57 out of 68), nine focused on nonfor- ing situations. Martinez et al. [48] used a robotic platform to
mal [26], [28], [40], [54], [58], [59], [62], [68], [75], and six guide a problem-based learning approach. Overall, the main
focused on informal learning [46], [54], [56], [58], [62], [63]. focus was to provide alternative resources and strategies to

Authorized licensed use limited to: Edith Cowan University. Downloaded on June 14,2022 at 03:34:16 UTC from IEEE Xplore. Restrictions apply.
TABUENCA et al.: AFFORDANCES AND CORE FUNCTIONS OF SMART LEARNING ENVIRONMENTS: A SYSTEMATIC LITERATURE REVIEW 139

TABLE VIII interventions [40]). Additionally, some authors attempt to sup-


LEARNING DOMAINS IN SLES
port virtual laboratories by means of SLEs [20], [47], [53],
[73], [74]. Kuo et al. [73] presented a virtual laboratory for
students practicing science process skills in chemistry and
biology modules. Tan et al. [47] presented a telepresence
robot equipped with a camera that students could operate
remotely to physically perform activities in a real lab.
Finally, the educational levels covered through the different
papers were analyzed. In general, higher education has got
more attention (38) as compared to primary (6) and secondary
(12) education. This preference might be due to convenience
for the researchers for the enactment of the experiments as well
as for the availability of the appropriate infrastructure. This
reflection might also apply with respect to the support to learn-
ing domains. There seems to be a special interest in science,
technology, engineering, and mathematics (32), specially in
engineering (15) and technology (10) domains, compared to
social sciences (12), or health and medicine (7) as illustrated in
Table VIII. In the case of social sciences, the amount of papers
supporting foreign languages courses is relevant (6), where
SLEs facilitated papers related with foreign languages (6),
facilitating the interaction with other learners and applying the
vocabulary in real-life scenarios. Also, in the case of health and
medicine courses, the scenarios generally involved the prepara-
tion of learners toward the professional practice, with the provi-
interact using technology [24], [30], [35], [41], [43], [57], sion of new kinds of resources or keeping track of their actions
[63], [65], [66], [67], [82]. For example, Toivonen et al. [67] during simulations and games. As a final comment, it is worth
used a 3-D printer in the context of K-12 studies to promote noticing that the majority of the contributions were designed to
the adoption of the so-called maker movement. Following a be generally applicable in a broader set of scenarios. Only 20 of
similar approach, some publications explored the use of the 68 total papers offered an ad hoc proposal that could not be
mobile phones (and applications) to facilitate ubiquitous used in a different learning scenario.
access [43], [63] and to foster awareness of the individual
time devoted to learning [58]. Beyond the walls of the class-
VI. DISCUSSION
room, Preston et al. [46] considered SLEs at home by instal-
ling high-definition multimedia interface displays and tagging The results of this review show that the term SLE is used
cookware in the kitchen for language learning purposes while inconsistently in the TEL literature. The SLR reported in this arti-
cooking a recipe. cle aimed at better understanding the specific affordances of
In addition, the work done on SLEs in the virtual space ben- existing SLEs, including the particular technologies they use as
efits from the diversity of learning environments and systems well as the educational contexts in which they have been evalu-
available. Among these systems, we found SLEs that build on ated. In this article, 68 articles (out of 1341) were shortlisted and
intelligent tutoring systems [40], [71], personal learning envi- analyzed to shed some light on what affordances of an SLE make
ronments [58], [86], serious games [26], [61], blogs and it smart, what technologies are used in SLEs, and in which peda-
forums [76], and chat rooms supported with conversational gogical contexts SLEs are used. The results of this review suggest
agents [64]. Nevertheless, the most prominent environments that this research area is in an initial state (see Section IV).
in this set are LMSs. Most publications proposed SLEs The following aspects differentiate this article from previ-
deployed in LMSs for the support of online courses and the ous reviews.
activities of traditional courses performed in the virtual 1) We have conducted a review of the literature with a
space [19], [25], [51], [69], [70], [77], [80], [87]. In an online focus on empirical studies.
course on competency-based education, Paquette et al. [25] 2) We have followed a well-accepted methodology for
presented an LMS feature that dynamically configured the SLRs [13] considering the inter-rater reliability to facil-
contents provided to students based on their individual profile itate future iterations.
within the platform. Likewise, the adoption of mobile devices 3) In total of 11 researchers were involved in most phases of
plays a key role in the virtual space [39], [40], [49], [51]. Tem- the review to ensure the quality of the results. Lastly, an
dee [51] implemented a mobile application to enhance digital overall synthesized composition of an SLE is presented
literacy on ethnic minority groups in Thailand. LA is useful to specifying its core functions and affordances (Fig. 3).
understand how students learn by analyzing the logs collected Regarding the distinctive affordances of SLEs identified in
by mobile phones (e.g., facial recognition [49] or chat the literature review, seminal articles on SLEs pinpoint to

Authorized licensed use limited to: Edith Cowan University. Downloaded on June 14,2022 at 03:34:16 UTC from IEEE Xplore. Restrictions apply.
140 IEEE TRANSACTIONS ON LEARNING TECHNOLOGIES, VOL. 14, NO. 2, APRIL 2021

technology to remotely perform tasks that were usually per-


formed in person (e.g., remote labs). Smartphones are usually
presented in SLEs as devices that facilitate learners’ ubiqui-
tous access to learning resources or to track students’ learning
activities.
Nonetheless, there are many publications that label their
learning environment as “smart,” but their authors do not pro-
vide arguments to justify it. The results of this review suggest
that the adjective “smart” is sometimes used to characterize
learning environments when they feature a technology or put
into practice a pedagogical approach, which is not aligned
with the most traditional vision of learning environments.
All in all, SLEs can be characterized as stakeholder-cen-
Fig. 3. Overall synthesized composition of a smart learning environment. tered (student or teacher) learning ecologies [37], [93].
Luckin [37] proposed the ecology of resources model to con-
sider a broader spectrum of learning resources beyond the
features such as adaptive and personalized [7], [9], [10], effi- students’ usual learning environment. This model is used to
cient [8], [10], effective, scalable, engaging, flexible, conver- represent how existing tools in the students’ context can offer
sational, reflective, and innovative [8], or better and new ways of assistance [94]. Luckin distinguishes three
faster [10], to characterize SLEs. The results from the litera- resources in ecology: 1) knowledge; 2) environment; and
ture review suggest that SLEs merge trends of technological 3) technology. From our perspective, the results are aligned
innovations (e.g., widespread use of smartphones, learning with this model considering stakeholders in the center of the
analytics, or ubiquity) with pedagogical advances mostly ecology. To support learning, it is necessary to explore the
focused on the implications of learning in different contexts manner in which the interactions of a learner with resources
(being the so-called “seamless learning” one prominent exam- (knowledge, environment, and technology) might be con-
ple). SLEs seem also to provide a more interactive, intelligent, strained (filters or barriers) [37]. The smartness in SLEs is the
and tailored support using advanced digital technologies and quality of a system to provide forms of assistance for stake-
services, to learn across multiple physical, virtual, or hybrid holders considering their barriers for learning. SLEs are
spaces [4]. equipped with adaptable, traceable, or engaging features (see
The SLR has also provided some very interesting bibliomet- Table III). Reflecting on the results reported in Section V,
ric results. On the one hand, the surge of the number of publi- Fig. 3 illustrates our overall perspective of an SLE. The syn-
cations about SLEs happened around 2015, together with the thesized results suggest that SLEs are ecologies comprising
creation of key associations (IASLE), conferences (ICSLE four key components.
and ICSLERD), and journals (SLE and ITSE) about the topic. 1) Stakeholder: Students that generally perform learning
On the other hand, it looks like not many authors have stood activities or teachers that generally define learning
out among the rest regarding the number of publications about activities (learning designs).
SLEs, being Kinshuk the only exception we found. 2) Space: Physical or virtual environment where learning
With RQ1, we aimed at investigating what affordances occurs. The classroom, or the desktop where the stake-
make a learning environment “smart.” The classification pre- holder normally performs learning activities. Frequently
sented in Table III shows the most frequent affordances in cited environments in the literature are smart class-
empirical articles. Several correspondences were found with rooms [20], [33], [34], [44], [48], [52]–[55], smart
regard to previous SLE definitions in theoretical articles labs [20], [47], smart workspaces [20], [34], smart
[7]–[10]. Coherently with Kinshuk [7], Hwang [9], and homes [46], [58], or smart campuses [53].
Koper [10], Table III shows that adaptability (adaptation, cus- 3) System: SLE core functions that provide smartness to
tomization, and personalization) is the most commonly used the SLE. The system collects data from the learning
affordance to describe SLEs. Additionally, several articles were context (sense), decodes, processes the data collected
consistent with Spector’s vision [8] who used affordances such (analyze), and coherently suggests actions to ease learn-
as engaging, efficiency, and effectiveness to define SLEs. Track- ing constraints toward improved learning performance
ing and monitoring, feedback and recommendation, and pattern (react). These functions are usually performed with the
recognition affordances are also quite common in SLE. help of technology (see Section V-B).
The smartness of SLEs is usually justified arguing that the 4) Tools and Technology: Tools that are added to the usual
system includes a smart component. The results presented in environment to facilitate student learning. In SLEs,
Section V show that smart classrooms and smartphones are tools and technology are configured to assist stakehold-
frequently included in SLEs. Classrooms (physical or online) ers. Data processing techniques (e.g., machine learning
are characterized as smart when they are equipped with some and computer vision) techniques or IoT systems (e.g.,
technology that facilitates learning. For example, smart class- sensors, microprocessors, and actuators) are examples
rooms are usually presented as spaces equipped with of technologies included in SLEs to assist stakeholders.

Authorized licensed use limited to: Edith Cowan University. Downloaded on June 14,2022 at 03:34:16 UTC from IEEE Xplore. Restrictions apply.
TABUENCA et al.: AFFORDANCES AND CORE FUNCTIONS OF SMART LEARNING ENVIRONMENTS: A SYSTEMATIC LITERATURE REVIEW 141

With RQ2, we aimed at investigating which technologies With RQ3, we aimed at investigating in which types of ped-
are used in SLEs. SLEs are equipped with technology to assist agogical contexts are SLEs used. Student-centered support is
students (or teachers) to perform learning (or teaching) activi- the core of SLEs. SLEs support a wide variety of pedagogical
ties. Considering the technologies reported in Section V-B, approaches that keep students in the main focus. Nevertheless,
here, we describe the SLE core functions performed by the teachers are still considered in these environments, both for
system as illustrated in Fig. 3. the provision of reports and analytics, and the enactment and
1) Sense: SLEs are capable of collecting information from provision of learning activities in these environments. We
the context in which they are introduced. For example, have not been able to deduce that SLEs are conditioned by a
SLEs can sense ambient conditions using environmental specific type of pedagogy or learning context. Indeed, it seems
sensors [41], [53], [59], [66], [67]. Likewise, SLEs are they are not necessarily associated with instructional technolo-
capable of collecting information from stakeholders gies. Therefore, SLEs put more emphasis on learning
when performing teaching and learning activities. For activities, revealing a certain tendency to student-centered
example, SLEs can sense students’ patterns both in approaches. SLEs are flexible enough to support a wide vari-
online classrooms using LMSs [21]–[23], [39], [50], ety of pedagogical approaches, learning domains and spaces,
[55], [62], [69]–[72], [79], [80], [86] and physical class- involving physical and virtual spaces. Some researchers have
rooms using cameras [35], [43], [44], [47], [49], [52], explored the connection between formal, nonformal, and
[63]. In addition, technology can sense specific profile informal learning. These studies not only attempted to extend
information on the stakeholder using sensors (e.g., via the learning situation to unconventional learning settings but
smartphone [28], [29], [35], [38], [39], [42]–[46], [49], also considered how the conditions of those settings can pro-
[50], [53], [58], [59], [62], [63], [87], [88]). In SLEs, mote different learning activities and interactions among stu-
the most frequently used technologies to sense data are dents. However, these papers are a minority compared to the
summarized in Section V-B1. ones focused on formal learning and should be covered in fur-
2) Analyze: SLEs are able to generate higher level indica- ther research.
tors from the data collected in the sense process using
data analysis techniques. The expansion of data gener-
VII. CONCLUSION
ated by increasingly integrated digital learning environ-
ments, together with emerging open standards for From this review, we can conclude that an SLE comprises a
learning data, offer new opportunities to assess, mea- space in which stakeholders (students or teachers) carry out
sure, and document learning [95]. The capacity to ana- their activities with the assistance of technology to face learn-
lyze digital learning data is a relatively new research ing barriers. The SLE performs three core functions that pro-
field. Therefore, teachers and students are not always vide smartness to the SLE: sensing, analyzing, and reacting.
sufficiently prepared or do not have suitable tools to There are works that place more emphasis on some functions
exploit this data toward improved learning perfor- than others, but this would be the common denominator. This
mance. SLEs assist stakeholders by including complex definition is not intended to be normative, but rather a way of
data analysis techniques that help understand how stu- synthesizing all the work done so far, and which will continue
dents learn and, consequently, facilitate intervention. in future research.
Indeed, data analysis techniques imply an essential tool The survey of papers reporting innovative contributions in
for SLEs to configure automatic interventions (per- the field of SLEs shows that most aspects that triggered the
formed by the system) that identify actionable insights interest of the community are still poorly developed. Due to
for both teachers and students. In SLEs, the most fre- the student-centered nature of SLEs, many researchers have
quently used techniques to analyze data are summarized explored how learners use these new environments in the
in Table V. classroom. However, teachers should not be left behind, and
3) React: SLEs are able to provide customized recommen- research should explore how to involve them in the design of
dations for stakeholders based on the data collected dur- SLEs. The demand for a higher involvement of learners and
ing the sense process and its interpretation performed teachers can be observed in related fields, such as learning
during the analysis process. In this review, various tech- analytics, that are progressively incorporating human-centered
nology actuators have been identified that present visual approaches in their design processes [96], [97]. In order to
(data visualizations, videos, displays, etc.), auditory exploit the possibilities offered by SLEs, further work has to
(chatbots), or tangible (3-D printers, wearables, interac- be done to support teachers in designing appropriate learning
tive posters, etc.) recommendations to stakeholders. situations that can take advantage of their main affordances,
Reactions (e.g., mobile notifications, contextual recom- specially on the assessment and motivation of learners, and
mendations in LMS, alerts, etc.) are usually configured the connection of formal and informal learning experiences.
to be triggered after identifying actionable insights in For example, SLEs can support learning situations in real-life
the analysis process (e.g., lack of activity within an settings that can motivate learners to further reflect on the con-
assignment, increase of dropouts, etc.). In SLEs, the cepts explored during the lessons. These affordances should be
most frequently used technologies are described in evaluated not only in controlled laboratory settings, but also
Section V-B3. during real-world experiments over longer periods of time in

Authorized licensed use limited to: Edith Cowan University. Downloaded on June 14,2022 at 03:34:16 UTC from IEEE Xplore. Restrictions apply.
142 IEEE TRANSACTIONS ON LEARNING TECHNOLOGIES, VOL. 14, NO. 2, APRIL 2021

order to evaluate the impact on stakeholders. Further research [7] Kinshuk, Designing Adaptive and Personalized Learning Environments.
Evanston, IL, USA: Routledge, 2016.
should investigate these issues implementing SLEs that con- [8] J. M. Spector, “Conceptualizing the emerging field of smart learning
sider the sense, analyze, and react functions. Finally, ethics environments,” Smart Learn. Environ., vol. 1, no. 1, pp. 1–10, 2014.
and privacy concerns should be taken into account, specially [9] G.-J. Hwang, “Definition, framework and research issues of smart learn-
ing environments—A context-aware ubiquitous learning perspective,”
with the sensitive information collected from learners. In this Smart Learn. Environ., vol. 1, no. 1, 2014, Art. no. 4.
regard, more work should be done to make analytics transpar- [10] R. Koper, “Conditions for effective smart learning environments,” Smart
ent and understandable for teachers and students, in line with Learn. Environ., vol. 1, no. 1, pp. 1–17, 2014.
[11] B. L. Putro et al., “Group formation in smart learning environment: A
global calls to provide trustworthy AI-based systems [98], literature review,” in Proc. Int. Conf. Inf. Technol. Syst. Innov., 2018,
with a focus on the educational domain [99]. pp. 381–385.
The affordances identified in this review were shortlisted [12] C. Heinemann and V. L. Uskov, Smart University: Literature Review
and Creative Analysis. Cham, Switzerland: Springer Int. Publ., 2018,
considering empirical articles. Future reviews might classify pp. 11–46.
SLEs not only examining the affordances specified in empiri- [13] B. Kitchenham et al., “Guidelines for performing systematic literature
cal articles as listed in Table III but also the affordances as reviews in software engineering version 2.3,” Engineering, vol. 45,
no. 4, 2007, Art. no. 1051.
identified in theoretical articles [7]–[10]. [14] L. Xia and B. Zhong, “A systematic review on teaching and learn-
The term SLE is usually coined in a vague way in articles ing robotics content knowledge in k-12,” Comput. Educ., vol. 127,
where “smart” might have alternative meanings and the smart- pp. 267–282, 2018.
[15] W. Matcha, N. A. Uzir, D. Gasevic, and A. Pardo, “A systematic review
ness of the tool is not specified. This is probably a sign of of empirical studies on learning analytics dashboards: A self-regulated
immaturity. The increase in the number of publications in learning perspective,” IEEE Trans. Learn. Technol., vol. 13, no. 2,
recent years and the creation of associations, conferences, and pp. 226–245, Apr./Jun. 2020.

[16] A. Cohen, R. T. Nørgard, and Y. Mor, “Hybrid learning spaces–design,
specialized journals on this topic might forecast a significant data, didactics,” Brit. J. Educ. Technol., vol. 51, no. 4, pp. 1039–1044,
growth in the near future. We expect this work will help to 2020.
better define the field toward extended research. [17] P. Brereton, B. A. Kitchenham, D. Budgen, M. Turner, and M. Khalil,
“Lessons from applying the systematic literature review process within
The increase in the number of computer networks (with the software engineering domain,” J. Syst. Softw., vol. 80, no. 4,
greater speed and broadband), the universalization in the use pp. 571–583, 2007.
of smartphones (which include information on the profile of [18] J. R. Landis and G. G. Koch, “The measurement of observer agreement
for categorical data,” Biometrics, vol. 33, pp. 159–174, 1977.
the stakeholder), and the increased availability of Internet [19] J. C. Burguillo and E. Vazquez, “X-Learn: An intelligent educational
services (e.g., cloud services, IoT platforms, etc.) might facili- system oriented towards the net,” in Proc. Conf. Technol. Transfer,
tate the growth in this research field in the coming years. vol. 3040, 2003, pp. 628–637.
[20] C. Burghardt, C. Reisse, T. Heider, M. Giersich, and T. Kirste,
This article is limited by the restrictions of the keyword “Implementing scenarios in a smart learning environment,” in Proc.
search. Therefore, it is possible that relevant articles in the 6th Annu. IEEE Int. Conf. Pervasive Comput. Commun., 2008,
field of SLE have not been considered in the review process. pp. 377–382.
[21] J. Seanosky, D. Boulanger, V. Kumar, and Kinshuk, “Unfolding learn-
Nonetheless, we believe that the conclusions obtained from a ing analytics for big data,” in Emerging Issues in Smart Learning.
systematic review in which 1341 papers were screened and 11 Berlin, Germany: Springer, 2015, pp. 377–384.
researchers were involved will contribute to advance the com- [22] V. Kumar et al., “An approach to measure coding competency
evolution,” in Smart Learning Environments. Berlin, Germany:
munity and draw attention to academic debates. Springer, 2015, pp. 27–43.
[23] K. Govindarajan et al., “Assessing learners’ progress in a smart learning
ACKNOWLEDGMENT environment using bio-inspired clustering mechanism,” in Innovations
in Smart Learning. Berlin, Germany: Springer, 2017, pp. 49–58.
This publication reflects the views only of the authors, and fun- [24] N. Smeda, E. Dakich, and N. Sharda, “The effectiveness of digital story-
telling in the classrooms: A comprehensive study,” Smart Learn. Envi-
ders cannot be held responsible for any use which may be made
ron., vol. 1, no. 6, pp. 1–21, 2014.
of the information contained therein. [25] G. Paquette, O. Mari~no, D. Rogozan, and M. Leonard, “Competency-
based personalization for massive online learning,” Smart Learn. Envi-
REFERENCES ron., vol. 2, no. 4, pp. 1–19, 2015.
[26] E. Pesare, T. Roselli, N. Corriero, and V. Rossano, “Game-based learn-
[1] J. A. Gonzalez-Martınez, M. L. Bote-Lorenzo, E. Goimez-Sanchez, and ing and gamification to promote engagement and motivation in medical
R. Cano-Parra, “Cloud computing and education: A state-of-the-art learning contexts,” Smart Learn. Environ., vol. 3, no. 5, pp. 1–21, 2016.
survey,” Comput. Educ., vol. 80, pp. 132–151, 2015. [27] G. Barata, S. Gama, J. Jorge, and D. Gonçalves, “Gamification for smar-
[2] B. Tabuenca, V. Garcıa-Alcantara, C. Gilarranz-Casado, and ter learning: Tales from the trenches,” Smart Learn. Environ., vol. 2,
S. Barrado-Aguirre, “Fostering environmental awareness with smart IoT no. 10, pp. 1–23, 2015.
planters in campuses,” Sensors, vol. 20, no. 8, 2020, Art. no. 2227. [28] K. Mouri and H. Ogata, “Ubiquitous learning analytics in the real-world
[3] Z. Papamitsiou and A. A. Economides, “Learning analytics for smart language learning,” Smart Learn. Environ., vol. 2, no. 15, pp. 1–18,
learning environments: A meta-analysis of empirical research results 2015.
from 2009 to 2015,” Learn., Des. Technol.: Int. Compendium Theory, [29] K. Choi and H.-J. Suk, “Dynamic lighting system for the learning envi-
Res., Pract. Policy, pp. 1–23, 2016. doi:10.1007/978-3-319-17727- ronment: Performance of elementary students,” Opt. Exp., vol. 24,
4_15-1. no. 10, pp. A 907–A916, 2016.
[4] J. Lee, H. Zo, and H. Lee, “Smart learning adoption in employees and [30] A. Kleftodimos and G. Evangelidis, “Using open source technologies
HRD managers,” Brit. J. Educ. Technol., vol. 45, no. 6, pp. 1082–1096, and open internet resources for building an interactive video based learn-
2014. ing environment that supports learning analytics,” Smart Learn. Envi-
[5] B. Tabuenca, S. Ternier, and M. Specht, “Supporting lifelong learners to ron., vol. 3, no. 9, pp. 1–23, 2016.
build personal learning ecologies in daily physical spaces,” Int. J. [31] E. Serral, J. De Weerdt, G. Sedrakyan, and M. Snoeck, “Automating
Mobile Learn. Organisation, vol. 7, no. 3-4, pp. 177–196, 2013. immediate and personalized feedback taking conceptual modelling edu-
[6] T. S. Kuhn, The Structure of Scientific Revolutions. Chicago, IL, USA: cation to a next level,” in Proc. IEEE 10th Int. Conf. Res. Challenges
Univ. Chicago Press, 2012. Inf. Sci., 2016, pp. 1–6.

Authorized licensed use limited to: Edith Cowan University. Downloaded on June 14,2022 at 03:34:16 UTC from IEEE Xplore. Restrictions apply.
TABUENCA et al.: AFFORDANCES AND CORE FUNCTIONS OF SMART LEARNING ENVIRONMENTS: A SYSTEMATIC LITERATURE REVIEW 143

[32] A. Taamallah and M. Khemaja, “Designing and experiencing smart [54] G. Yang, D. KinshukWen, and E.Sutinen, “A contextual query expansion
objects based learning scenarios: An approach combining IMS ID, based multi-document summarizer for smart learning,” in Proc. Int.
XAPI and IoT,” in Proc. 2nd Int. Conf. Technol. Ecosystems Enhancing Conf. Signal-Image Technol. Internet-Based Syst., 2013, pp. 1010–1016.
Multiculturality, 2014, pp. 373–379. [55] K. Simic, M. Despotovic-Zrakic, Z.  Bojovic, B. Jovanic, and
[33] C.-L. D. Chen, Y.-H. Chang, Y.-T. Chien, C. Tijus, and C.-Y. Chang, D. Knezevic, “A platform for a smart learning environment,” Facta
“Incorporating a smart classroom 2.0 speech-driven powerpoint system Univ.-Series: Electron. Energetics, vol. 29, no. 3, pp. 407–417, 2016.
(SDPPT) into university teaching,” Smart Learn. Environ., vol. 2, no. 7, [56] A. Leonidis, M. Antona, and C. Stephanidis, “Enabling programmability
pp. 1–11, 2015. of smart learning environments by teachers,” in Distributed, Ambient,
[34] R. Bdiwi, C. de Runz, S. Faiz, and A. A. Cherif, “Smart learning envi- and Pervasive Interactions, N. Streitz and P. Markopoulos, Eds. Cham,
ronment: Teacher’s role in assessing classroom attention,” Res. Learn. Switzerland: Springer Int. Publ., 2015, pp. 62–73.
Technol., vol. 27, pp. 1–14, 2019. [57] A. Preston, S. Lazem, A. Kharrufa, B. Pursglove, and P. Olivier,
[35] L. J. Thomas, M. Parsons, and D. Whitcombe, “Assessment in smart “Supporting the smart teacher: An agenda for the use of embedded sens-
learning environments: Psychological factors affecting perceived ing in novel learning spaces,” Smart Learn. Environ., vol. 5, no. 1, 2018,
learning,” Comput. Hum. Behav., vol. 95, pp. 197–207, 2019. Art. no. 19.
[36] G. Akçapınar, M. N. Hasnine, R. Majumdar, B. Flanagan, and H. Ogata, [58] B. Tabuenca, D. B€orner, M. Kalz, and M. Specht, “User-modelled ambi-
“Developing an early-warning system for spotting at-risk students by ent feedback for self-regulated learning,” in Design for Teaching and
using ebook interaction logs,” Smart Learn. Environ., vol. 6, no. 4, Learning in a Networked World, G. Conole, T. Klobucar, C. Rensing,
pp. 1–15, 2019. J. Konert, and E. Lavoue, Eds. Cham, Switzerland: Springer Int. Publ.,
[37] R. Luckin, “The learner centric ecology of resources: A framework for 2015, pp. 535–539.
using technology to scaffold learning,” Comput. Educ., vol. 50, no. 2, [59] R. Tortorella and Kinshuk, “A mobile context-aware medical training
pp. 449–462, 2008. system for the reduction of pathogen transmission,” Smart Learn. Envi-
[38] J. Bacca, Kinshuk, and D.Segovia-Bedoya, “An architecture for mobile- ron., vol. 4, no. 1, pp. 1–13, 2017.
based assessment systems in smart learning environments,” in Proc. Int. [60] A. Lalingkar, C. Ramnathan, and S. Ramani, “Ontology-based smart
Conf. Smart Learn. Environ., 2019, pp. 25–34. learning environment for teaching word problems in mathematics,”
[39] X. Huang, “Wechat-based teaching for an immersion cultural exchange J. Comput. Educ., vol. 1, no. 4, pp. 313–334, 2014.
program—A case study in CFL,” Smart Learn. Environ., vol. 6, no. 7, [61] M. Denden, A. Tlili, F. Essalmi, and M. Jemni, “Implicit modeling of
pp. 1–21, 2019. learners’ personalities in a game-based learning environment using
[40] V. Rus and D. Ştefanescu, “Non-intrusive assessment of learners’ prior their gaming behaviors,” Smart Learn. Environ., vol. 5, no. 1, pp. 1–
knowledge in dialogue-based intelligent tutoring systems,” Smart Learn. 19, 2018.
Environ., vol. 3, no. 2, pp. 1–18, 2016. [62] J. F. Bravo-Torres, V. E. Robles-Bykbaev, M. L. Nores,
[41] I. Jormanainen, T. Toivonen, and V. Nivalainen, “A smart learning envi- E. F. Ordo~nez-Morales, Y. Blanco-Fernandez, and A. Gil-Solla, “Oppia:
ronment for environmental education,” in Proc. Int. Conf. Smart Learn. A context-aware ubiquitous learning platform to exploit short-lived stu-
Environ., 2018, pp. 13–16. dent networks for collaborative learning,” in Proc. 8th Int. Conf. Com-
[42] D. Kohen-Vacs, M. Milrad, M. Ronen, and M. Jansen, “Evaluation of put. Supported Education - Volume 1: CSEDU, INSTICC, 2016,
enhanced educational experiences using interactive videos and web pp. 494–498.
technologies: Pedagogical and architectural considerations,” Smart [63] S. Pal, P. K. D. Pramanik, and P. Choudhury, “A step towards smart
Learn. Environ., vol. 3, no. 6, pp. 1–19, 2016. learning: Designing an interactive video-based m-learning system for
[43] C. Lytridis and A. Tsinakos, “Evaluation of the artutor augmented real- educational institutes,” Int. J. Web-Based Learn. Teach. Technol.,
ity educational platform in tertiary education,” Smart Learn. Environ., vol. 14, no. 4, pp. 26–48, 2019.
vol. 5, no. 6, pp. 1–15, 2018. [64] M. Procter, F. Lin, and B. Heller, “Intelligent intervention by conversa-
[44] Z. Chaczko, W. Alenazy, and C. Y. Chan, “Middleware-based software tional agent through chatlog analysis,” Smart Learn. Environ., vol. 5,
architecture for interactions in the smart learning environment,” in Proc. no. 1, 2018, Art. no. 30.
26th Int. Bus. Inf. Manage. Assoc. Conf. Innov. Manage. Sustain. Econ. [65] R. C. Herault, A. Lincke, M. Milrad, E.-S. Forsg€arde, and C. Elmqvist,
Competitive Advantage: Regional Develop. Glob. Growth, 2015, “Using 360-degrees interactive videos in patient trauma treatment edu-
pp. 699–714. cation: Design, development and evaluation aspects,” Smart Learn.
[45] A. Augello et al., “A personal intelligent coach for smart embodied Environ., vol. 5, no. 1, 2018, Art. no. 26.
learning environments,” in Proc. 9th KES Int. Conf. Intell. Interactive [66] T. Savov, V. Terzieva, and K. Todorova, “Computer vision and internet
Multimedia Syst. Serv., 2016, pp. 629–636. of things: Attention system in educational context,” in Proc. 19th Int.
[46] A. Preston et al., “Can a kitchen teach languages? Linking theory and Conf. Comput. Syst. Technol (CompSysTech’18 Series), 2018, pp. 171–
practice in the design of context-aware language learning environ- 177.
ments,” Smart Learn. Environ., vol. 2, no. 9, pp. 1–19, 2015. [67] T. Toivonen, I. Jormanainen, C. S. Montero, and A. Alessandrini,
[47] Q. Tan, M. Denojean-Mairet, H. Wang, X. Zhang, F. C. Pivot, and “Innovative maker movement platform for k-12 education as a smart
R. Treu, “Toward a telepresence robot empowered smart lab,” Smart learning environment,” in Challenges and Solutions in Smart Learning,
Learn. Environ., vol. 6, no. 5, pp. 1–19, 2019. M. Chang, E. Popescu, Kinshuk, N.-S. Chen, M. Jemni, R. Huang, and
[48] F. Martınez, H. Montiel, and H. Valderrama, “Using embedded robotic J. M. Spector, Eds., Singapore: Springer Singapore, 2018, pp. 61–66.
platform and problem-based learning for engineering education,” in [68] E. A. Khousa, Y. Atif, and M. M. Masud, “A social learning analytics
Proc. 3rd Int. KES Conf. Smart Educ. e-Learn., 2016, pp. 435–445. approach to cognitive apprenticeship,” Smart Learn. Environ., vol. 2,
[49] I. L. Enegi, M. Hamada, and S. A. Adeshina, “Adaptive multimedia no. 1, pp. 1–23, 2015.
learning framework with facial recognition system,” in Proc. 13th Int. [69] Y. Li, Y. Zheng, J. Kang, and H. Bao, “Designing a learning recom-
Conf. Electron., Comput. Comput., 2017, pp. 1–6. mender system by incorporating resource association analysis and social
[50] M. M. El-Bishouty et al., “Analyzing learner characteristics and courses interaction computing,” in State-of-The-Art and Future Directions of
based on cognitive abilities, learning styles, and context,” in Proc. Smart Smart Learning, Y. Li, M. Chang, M. Kravcik, E. Popescu, R. Huang,
Learn. Environ., 2015, pp. 3–25. Kinshuk, and N.-S. Chen, Eds., Singapore: Springer Singapore, 2016,
[51] P. Temdee, “Smart learning environment for enhancing digital literacy pp. 137–143.
of thai youth: A case study of ethnic minority group,” Wirel. Pers. Com- [70] H. Imran, K. Ballance, J. M. C. Da Silva, Kinshuk, and S. Graf,
mun., pp. 1–12, 2019. “Vat-rubars: A visualization and analytical tool for a rule-based rec-
[52] G. Dafoulas, C. C. Maia, J. Samuels-Clarke, A. Ali, and J. C. Augusto, ommender system to support teachers in a learner-centered learning
“Investigating the role of biometrics in education-the use of sensor data approach,” in State-of-The-Art and Future Directions of Smart
in collaborative learning,” in Proc. IADIS Int. Conf. e-Learn. 2018, Learning., Y. Li, M. Chang, M. Kravcik, E. Popescu, R. Huang,
pp. 115–123. [Online]. Available: https://eprints.mdx.ac.uk/id/eprint/ Kinshuk, and N.-S. Chen, Eds., Singapore: Springer Singapore,
24621 2016, pp. 31–38.
[53] M. Kadar, “Smart learning environment for the development of smart [71] B. Vesin, K. Mangaroska, and M. Giannakos, “Learning in smart envi-
city applications,” in Proc. IEEE 8th Int. Conf. Intell. Syst., 2016, ronments: User-centered design and analytics of an adaptive learning
pp. 59–64. system,” Smart Learn. Environ., vol. 5, no. 1, 2018, Art. no. 24.

Authorized licensed use limited to: Edith Cowan University. Downloaded on June 14,2022 at 03:34:16 UTC from IEEE Xplore. Restrictions apply.
144 IEEE TRANSACTIONS ON LEARNING TECHNOLOGIES, VOL. 14, NO. 2, APRIL 2021

[72] H. Elhoseny, M. Elhoseny, S. Abdelrazek, and A. M. Riad, “Evaluating [97] S. B. Shum, R. Ferguson, and R. Martinez-Maldonado, “Human-centred
learners’ progress in smart learning environment,” in Proc. Int. Conf. learning analytics,” J. Learn. Analytics, vol. 6, no. 2, pp. 1–9, 2019.
Adv. Intell. Syst. Inform., A. E. Hassanien, K. Shaalan, T. Gaber, and M. [98] High-Level Expert Group on Artificial Intelligence (HLEG-AI), “Ethics
F. Tolba, Eds., Cham, Switzerland: Springer Int. Publ., 2018, pp. 734– guidelines for trustworthy AI: Requirements of trustworthy AI,” Eur.
744. Commission, Tech. Rep., Apr. 2019. Accessed: Feb. 24, 2021. [Online].
[73] M.-X. Fan, R. Kuo, M. Chang, and J.-S. Heh, Story-Based Virtual Experi- Available: https://ec.europa.eu/digital-single-market/en/news/ethics-
ment Environment. Berlin, Heidelberg: Springer 2015, pp. 175–198. guidelines-trustworthy-ai
[74] K. Aljuhani, M. Sonbul, M. Althabiti, and M. Meccawy, “Creating a vir- [99] S. Vincent-Lancrin and R. Van derVlies, “Trustworthy AI in education:
tual science lab (VSL): The adoption of virtual labs in Saudi schools,” Promises and challenges,” Organisation Econ. Co-operation Develop-
Smart Learn. Environ., vol. 5, no. 1, pp. 1–13, 2018. ment (OECD), Tech. Rep., Feb. 2020, Accessed: Feb. 24, 2021.
[75] S. Johnson and O. R. Zaiane, “Learning to analyze medical images: A [Online]. Available: http://www.oecd.org/education/trustworthy-artifi-
smart adaptive learning environment for an ill-defined domain,” in cial-intelligence-in-education.pdf
Proc. Bus. Process Manage. Workshops, 2018, pp. 56–68.
[76] S. Li and J. Zheng, “The effect of academic motivation on students’ Bernardo Tabuenca (Senior Member, IEEE)
English learning achievement in the eschoolbag-based learning environ- received the Ph.D. degree in ubiquitous technology
ment,” Smart Learn. Environ., vol. 4, no. 1, pp. 1–14, 2017. for lifelong learners from Open University of The
[77] G. Deeva and J. De Weerdt, “Understanding automated feedback in Netherlands, Heerlen, Netherlands, in 2015.
learning processes by mining local patterns,” in Proc. Int. Conf. Bus. He is currently an Assistant Professor with Univer-
Process. Manage., 2018, pp. 56–68. sidad Politecnica de Madrid, Madrid, Spain. He
[78] H. T. Hien, P.-N. Cuong, L. N. H. Nam, H. L. T. K. Nhung, and conducted his research with the Research Center for
L. D. Thang, “Intelligent assistants in higher-education environments: Learning, Teaching, and Technology, Open Univer-
The fit-ebot, a chatbot for administrative and learning support,” in Proc. sity of The Netherlands. His current areas of research
9th Int. Symp. Inf. Commun. Technol., 2018, pp. 69–76. include technology-enhanced learning, ubiquitous
[79] J. Burrows and V. Kumar, “The objective ear: Assessing the progress of technology, and smart learning environments.
a music task,” Smart Learn. Environ., vol. 5, no. 1, pp. 1–9, 2018.
[80] A. Tlili et al., “Automatic modeling learner’s personality using learn-
ing analytics approach in an intelligent moodle learning platform,”
Sergio Serrano-Iglesias received the B.Sc. and M.Sc.
Interactive Learn. Environ., pp. 1–15, 2019, doi:10.1080/
10494820.2019.1636084. degrees in telecommunications engineering from the
[81] Y. Li, Y. Zheng, H. Bao, and Y. Liu, “Towards better understanding of University of Valladolid, Spain, in 2016 and 2017,
hot topics in online learning communities,” Smart Learn. Environ., respectively. He is currently working toward the Ph.D.
vol. 2, no. 1, pp. 1–14, 2015. degree in information and telecommunication technol-
[82] T. L. Tyler-Wood, D. Cockerham, and K. R. Johnson, “Implementing ogies with the GSIC-EMIC Research Group, Univer-
sity of Valladolid.
new technologies in a middle school curriculum: A rural perspective,”
Smart Learn. Environ., vol. 5, no. 1, pp. 1–16, 2018. His main research interests include smart learning
[83] A. Amigud, J. Arnedo-Moreno, T. Daradoumis, and A. Guerrero-Roldan, environments and the application of cloud computing
“A robust and non-invasive strategy for preserving academic integrity in for the support of learning.
an open and distance learning environment,” in Proc. IEEE 17th
Int. Conf. Adv. Learn. Technol., 2017, pp. 530–532.
[84] A. Becheru, A. Calota, and E. Popescu, “Analyzing students’ collabora- Adrian Carruana Martın received the B.Sc. and
tion patterns in a social learning environment using studentviz M.Sc. degrees in computer science from the Univer-
platform,” Smart Learn. Environ., vol. 5, no. 1, pp. 1–18, 2018. sidad Carlos III de Madrid, Madrid, Spain, in 2015
[85] M. Specht, “RTST trend report: Lead theme contextualisation,” Open and 2017, respectively. He is currently a Ph.D. candi-
Univ. Netherlands, Heerlen, Netherlands, Tech. Rep., May 2012. date with the Department of Telematics Engineering,
Accessed: Feb. 24, 2021. [Online]. Available: https://telearn.archives- Universidad Carlos III de Madrid.
ouvertes.fr/hal-00722748 His main research interests include machine learning
[86] E. Koulocheri and M. Xenos, “Correlating formal assessment with social and smart learning environments.
network activity within a personal learning environment,” Int. J. Web-
Based Learn. Teach. Technol., vol. 14, no. 1, pp. 17–31, 2019.
[87] B. Barmada and N. Baghaei, “Train-for-life (t4l): An interactive learn-
ing platform for logistics, safety and security professionals,” Smart
Learn. Environ., vol. 5, no. 1, pp. 17–31, 2018.
[88] Q. Zhao, “An empirical study on cultivating learners’ creativity in Cristina Villa-Torrano received the B.Sc. and M.Sc.
smart learning environment,” in Proc. Int. Conf. Appl. Intell. Syst. degrees in computer science from the University of
Multi-Modal Inform. Analytics, 2019, pp. 596–603. Murcia, Murcia, Spain, in 2018 and 2019, respec-
[89] E. Alpaydin, Introduction to Machine Learning. Cambridge, MA, USA: tively. She is currently working toward the Ph.D.
MIT Press, 2020. degree in computer science with the GSIC-EMIC
[90] W. Greller and H. Drachsler, “Translating learning into numbers: A Research Group, University of Valladolid, Valladolid,
generic framework for learning analytics,” J. Educ. Technol. Soc., Spain.
vol. 15, no. 3, pp. 42–57, 2012. Her main research interests include learning ana-
[91] P. Long and G. Siemens, “Penetrating the fog: Analytics in learning and lytics and smart learning environments.
education,” Ital. J. Educ. Technol., vol. 22, no. 3, pp. 132–137, 2014.
[92] B. Gros, “The design of smart educational environments,” Smart Learn.
Environ., vol. 3, no. 1, pp. 1–11, 2016.
[93] B. Barron, “Learning ecologies for technological fluency: Gender and Yannis A. Dimitriadis received the Engineering
experience differences,” J. Educ. Comput. Res., vol. 31, no. 1, pp. 1–36, degree in electrical engineering from the Technical Uni-
2004. versity of Athens, Athens, Greece, in 1981, the M.Sc.
[94] R. Luckin, Re-Designing Learning Contexts: Technology-Rich, Learner- degree in electrical engineering from the University of
Centred Ecologies. Evanston, IL, USA: Routledge, 2010. Virginia, VA, USA, in 1983, and the Ph.D. degree in tel-
[95] B. Alexander et al., “EDUCAUSE horizon report: 2019 higher edu- ecommunications engineering from the University of
cation edition,” EDUCAUSE, Louisville, CO, USA, Tech. Rep., Valladolid, Valladolid, Spain, in 1992.
2019. Accessed: Feb. 24, 2021. [Online] Available: http://library. He is currently a Full Professor of Telematics Engi-
educause.edu/-/media/files/library/2019/4/2019horizonreport.pdf neering with the University of Valladolid.
[96] X. Ochoa and A. F. Wise, “Supporting the shift to digital with student-cen-
tered learning analytics,” Educ. Technol. Res. Develop., vol. 69, Nov. 2020,
pp. 1–9.

Authorized licensed use limited to: Edith Cowan University. Downloaded on June 14,2022 at 03:34:16 UTC from IEEE Xplore. Restrictions apply.
TABUENCA et al.: AFFORDANCES AND CORE FUNCTIONS OF SMART LEARNING ENVIRONMENTS: A SYSTEMATIC LITERATURE REVIEW 145

Juan I. Asensio-Perez received the Ph.D. degree in Miguel L. Bote-Lorenzo received the Ph.D. degree
telecommunications engineering from the University in telecommunications engineering from the Univer-
of Valladolid, Valladolid, Spain, in 2000. sity of Valladolid, Valladolid, Spain, in 2005.
He is currently a Full Professor of Telematics Engi- He is currently an Associate Professor of Telematics
neering with the University of Valladolid, and Mem- Engineering with the University of Valladolid, and
ber of the Multidisciplinary Research Group GSIC/ Member of the Multidisciplinary research group GSIC/
EMIC. His research interests include the development EMIC. His research interests include smart learning
of technological solutions for ubiquitous learning, environments, learning analytics, and gamification.
learning design support, and learning analytics.

Carlos Alario-Hoyos received the M.S. and Ph.D. Alejandra Martınez-Mones received the Ph.D.
degrees in information and communication technolo- degree in computer science from the University of
gies from the Universidad of Valladolid, Valladolid, Valladolid, Valladolid, Spain, in 2003.
Spain, in 2007 and 2012, respectively. She is currently an Associate Professor of Computer
He is currently a Visiting Associate Professor with Science and Human Computer Interaction with the
the Department of Telematics Engineering, Universi- University of Valladolid. Her main research interests
dad Carlos III de Madrid, Getafe, Spain. His skills include area of Technology Enhanced Learning include
and experience include research and development in the support to teachers in the design, enactment, and
MOOCs, social networks, collaborative learning, or evaluation of innovative learning activities using learn-
evaluation of learning experiences. ing analytics approaches.

Eduardo Gomez-Sanchez received the Ph.D. degree Carlos Delgado Kloos received the Ph.D. degree in
in telecommunications engineering from the Univer- computer science from the Technische Universitat
sity of Valladolid, Valladolid, Spain, in 2001. Munchen, Munich, Germany, in 1986, and in tele-
He is currently a Professor of Telematics Engineer- communications engineering from the Universidad
ing with the University of Valladolid, Valladolid, Politecnica de Madrid, Madrid, Spain.
Spain. His main research interests include the design He is currently a Full Professor of Telematics
and evaluation of software systems to support collab- Engineering with the Universidad Carlos III de
orative learning, both in formal and informal settings, Madrid, Getafe, Spain, where he is the Director of
and connecting them. the GAST Research Group, Director of the UNESCO
Chair on “Scalable Digital Education for All,” and
Vice President for Strategy and Digital Education.
He is also the Coordinator of the eMadrid research network on Educational
Technology in the Region of Madrid. He is the Spanish representative at IFIP
TC3 on Education.

Authorized licensed use limited to: Edith Cowan University. Downloaded on June 14,2022 at 03:34:16 UTC from IEEE Xplore. Restrictions apply.

You might also like