Professional Documents
Culture Documents
Full Chapter Special Topics in Artificial Intelligence and Augmented Reality The Case of Spatial Intelligence Enhancement Cognitive Technologies 1St Edition Christos Papakostas PDF
Full Chapter Special Topics in Artificial Intelligence and Augmented Reality The Case of Spatial Intelligence Enhancement Cognitive Technologies 1St Edition Christos Papakostas PDF
https://textbookfull.com/product/augmented-exploitation-
artificial-intelligence-automation-and-work-1st-edition-phoebe-v-
moore/
https://textbookfull.com/product/introduction-to-artificial-
intelligence-undergraduate-topics-in-computer-science-wolfgang-
ertel/
https://textbookfull.com/product/handbook-of-artificial-
intelligence-and-wearables-applications-and-case-studies-1st-
edition-hemachandran-k/
Distributed Computing and Artificial Intelligence,
Special Sessions II, 15th International Conference
Sigeru Omatu
https://textbookfull.com/product/distributed-computing-and-
artificial-intelligence-special-sessions-ii-15th-international-
conference-sigeru-omatu/
https://textbookfull.com/product/distributed-computing-and-
artificial-intelligence-special-sessions-17th-international-
conference-sara-rodriguez-gonzalez/
https://textbookfull.com/product/the-psychoanalysis-of-
artificial-intelligence-1st-edition-isabel-millar/
https://textbookfull.com/product/playing-smart-on-games-
intelligence-and-artificial-intelligence-1st-edition-julian-
togelius/
https://textbookfull.com/product/ai-meets-bi-artificial-
intelligence-and-business-intelligence-1st-edition-lakshman-
bulusu/
Cognitive Technologies
Christos Papakostas
Christos Troussas
Cleo Sgouropoulou
Special Topics
in Artificial
Intelligence and
Augmented
Reality
The Case of Spatial Intelligence
Enhancement
Cognitive Technologies
Editor-in-Chief
Daniel Sonntag, German Research Center for AI, DFKI,
Saarbrücken, Saarland, Germany
Titles in this series now included in the Thomson Reuters Book Citation Index
and Scopus!
The Cognitive Technologies (CT) series is committed to the timely publishing of
high-quality manuscripts that promote the development of cognitive technologies
and systems on the basis of artificial intelligence, image processing and
understanding, natural language processing, machine learning and human-computer
interaction.
It brings together the latest developments in all areas of this multidisciplinary topic,
ranging from theories and algorithms to various important applications. The
intended readership includes research students and researchers in computer science,
computer engineering, cognitive science, electrical engineering, data science and
related fields seeking a convenient way to track the latest findings on the foundations,
methodologies and key applications of cognitive technologies.
The series provides a publishing and communication platform for all cognitive
technologies topics, including but not limited to these most recent examples:
• Interactive machine learning, interactive deep learning, machine teaching
• Explainability (XAI), transparency, robustness of AI and trustworthy AI
• Knowledge representation, automated reasoning, multiagent systems
• Common sense modelling, context-based interpretation, hybrid cognitive
technologies
• Human-centered design, socio-technical systems, human-robot interaction, cog-
nitive robotics
• Learning with small datasets, never-ending learning, metacognition and
introspection
• Intelligent decision support systems, prediction systems and warning systems
• Special transfer topics such as CT for computational sustainability, CT in busi-
ness applications and CT in mobile robotic systems
The series includes monographs, introductory and advanced textbooks, state-of-the-
art collections, and handbooks. In addition, it supports publishing in Open
Access mode.
Christos Papakostas • Christos Troussas •
Cleo Sgouropoulou
© The Editor(s) (if applicable) and The Author(s), under exclusive license to Springer Nature
Switzerland AG 2024
This work is subject to copyright. All rights are solely and exclusively licensed by the Publisher, whether
the whole or part of the material is concerned, specifically the rights of translation, reprinting, reuse of
illustrations, recitation, broadcasting, reproduction on microfilms or in any other physical way, and
transmission or information storage and retrieval, electronic adaptation, computer software, or by similar
or dissimilar methodology now known or hereafter developed.
The use of general descriptive names, registered names, trademarks, service marks, etc. in this publication
does not imply, even in the absence of a specific statement, that such names are exempt from the relevant
protective laws and regulations and therefore free for general use.
The publisher, the authors, and the editors are safe to assume that the advice and information in this book
are believed to be true and accurate at the date of publication. Neither the publisher nor the authors or the
editors give a warranty, expressed or implied, with respect to the material contained herein or for any
errors or omissions that may have been made. The publisher remains neutral with regard to jurisdictional
claims in published maps and institutional affiliations.
This Springer imprint is published by the registered company Springer Nature Switzerland AG
The registered company address is: Gewerbestrasse 11, 6330 Cham, Switzerland
In the pages of this book, titled Special Topics in Artificial Intelligence and
Augmented Reality with the subtitle The Case of Spatial Intelligence Enhancement,
lies a comprehensive exploration of AI and AR at the intersection of spatial intelli-
gence. This book offers an in-depth examination of both theoretical and practical
aspects, guiding the way toward enhancing spatial intelligence in the era of techno-
logical convergence. Readers will find valuable insights, diverse case studies, and a
roadmap for navigating the evolving landscape of technologies that enhance human
cognition.
This work spans various critical subjects, including the foundations and applica-
tions of AI and AR, their symbiotic relationship, and their combined impact on the
development of spatial intelligence. The authors have undertaken a commendable
effort to bring together expertise from diverse domains, providing a comprehensive
view of this captivating field. By addressing both the theoretical underpinnings and
real-world applications, this book serves as a bridge, connecting scholarly discourse
to practical implementation, offering a clear and comprehensive understanding of
the subject matter.
One of the notable strengths of this work is its ability to illuminate the vast poten-
tial of AI and AR in enhancing human spatial intelligence. The authors have curated a
collection that not only sheds light on the transformative impact of these technologies
but also encourages interdisciplinary discourse. Scholars, educators, and profession-
als alike will benefit from the diverse perspectives presented, fostering a deeper under-
standing of the profound influence of AI and AR on spatial intelligence enhancement.
In conclusion, this book represents a valuable resource that underscores the criti-
cal juncture of AI, AR, and spatial intelligence. The authors’ collective expertise
and their commendable effort in bringing together various facets of this field make
this work an essential asset for anyone seeking a comprehensive and insightful
exploration of the subject. It is my hope that this book will inspire, inform, and
spark further research in this dynamic and ever-evolving domain.
v
Preface
vii
viii Preface
ix
x Contents
Abstract This chapter of this book serves as an introductory chapter, offering read-
ers a comprehensive overview of the research. It begins with an “Overview” section
that outlines the main sections to provide readers with a roadmap of what to expect
in the subsequent sections. The “Motivation” section explores the reasons behind
conducting this research, emphasizing the significance of spatial ability in human
intelligence and its connection to success in scientific and educational fields. It also
discusses the potential benefits of augmented reality in enhancing spatial ability and
the importance of adaptivity in training systems, which serves as a motivation for
the study. In the “Research Questions” section, specific research questions are intro-
duced, designed to address gaps in existing literature and examine the impact of a
proposed blended mobile system on fostering spatial ability. These questions pro-
vide a clear focus for the study and guide the subsequent chapters. It highlights the
iterative nature of the research and presents the overall structure of the book, help-
ing readers understand how the subsequent chapters build upon each other.
1.1 Overview
The first chapter introduces the purpose of the research presented in the current
book. More specifically, Sect. 1.2 argues the research motivation and outlines the
problem, Sect. 1.3 defines the research questions, and the final section defines the
approach and structure of the book.
1.2 Motivation
Einstein, Newton, Faraday, Maxwell, and Tesla are scientists who left their mark on
the history of physics and technology, and they all claimed that the development of
their ground-breaking theories involved the utilization of spatial visualization [1–5].
For instance, Albert Einstein gained notoriety for his utilization of creative think-
ing and his capacity to mentally comprehend challenging mathematical concepts. In
order to create his laws of motion and gravitation, Isaac Newton also possessed a
keen visual imagination and the ability to visually picture the motion of celestial
bodies. The inception of the principle of the electromagnetic field and Michael
Faraday’s research into electromagnetic induction are his two most notable accom-
plishments. Utilizing Faraday’s findings as a foundation, James Clerk Maxwell cre-
ated a series of formulas that clarify the operation of electric and magnetic fields.
These equations are known as Maxwell’s equations. The evolution of modern inno-
vations like radio and television was facilitated by these equations. His research on
alternating current (AC) electrical systems and his innovations linked to wireless
communication and electricity transmission are what made Nikola Tesla, a contem-
porary of Faraday and Maxwell, so widely recognized. Tesla was also renowned for
his prodigious visualization skills, which he allegedly used to plan and create a
number of his inventions.
Spatial visualization is the ability to mentally rotate, manipulate, and twist two-
and three-dimensional stimulus objects [6]. For scientists and engineers, spatial
visualization is a crucial ability since it may be utilized to develop new ideas, design
new technologies, and comprehend complex data. It is an ability that can be acquired
and refined with practice, and scientific and engineering education frequently
emphasizes it.
Psychologists and cognitive researchers have scrutinized and delineated the con-
cept of “spatial ability” through numerous perspectives across several decades.
Spatial ability, one of the most extensively studied human aptitudes, has undergone
various interpretations over time [6–16].
While definitions of spatial ability may vary, most researchers concur that it
entails the skill to manipulate visual and spatial data mentally. This encompasses
the ability to mentally rotate or manipulate objects, comprehend spatial connections
between objects, and navigate physical environments.
Extensive research has established a connection between spatial ability and aca-
demic performance [17, 18]. In the past decade, studies have underscored the sig-
nificant importance of spatial ability in achieving academic excellence, notably
within the realms of STEM disciplines (science, technology, engineering, and math-
ematics) [19–24]. Spatial cognition has also shown relevance across a spectrum of
vocations, encompassing STEM careers, as well as everyday tasks such as driving
and navigation.
While having better spatial skills as a child can predict a person’s future success
in STEM fields [25], a meta-analysis of the research on spatial ability by [1] revealed
that spatial skills can develop over time with the right kind of training [26].
1.2 Motivation 3
According to research, spatial ability may be developed via practice and instruction
and is not a set characteristic. Although there is some research that indicates that
spatial ability may have genetic roots, contextual elements including exposure to
spatially demanding activities and experiences can also have a significant impact on
how spatial ability develops.
There are several ways to train one’s own spatial skills, including playing spe-
cific video games, engaging in mental rotation and visualization exercises, and get-
ting specialized spatial instruction in school settings. For children’s spatial ability to
develop, early exposure to challenging spatial tasks and situations can be very
helpful.
The importance of spatial ability, in engineering education, has been highlighted
by several studies [26–30]. The visualization of abstract concepts, such as the geom-
etry of three-dimensional objects, has been of great interest in engineering educa-
tion [27]. Technical drawing design is considered to have a role in the training of
spatial skills [30, 31]. The development of multimedia software, for improving 3-D
spatial visualization skills, is based on the manipulation of physical models, provid-
ing kinaesthetic learners with a convenient way to absorb information [28].
Engineering education often involves the visualization and manipulation of com-
plex three-dimensional objects and structures, and the ability to think spatially is
critical for solving many engineering problems [32–34]. Technical drawing design
is one way in which spatial skills can be developed in engineering education.
Technical drawing involves the use of specialized software to create detailed draw-
ings and schematics of engineering designs and requires a high degree of spatial
visualization ability. By practicing technical drawing and other spatially challeng-
ing activities, engineering students can improve their spatial skills and better pre-
pare themselves for success in their future careers.
The advancement of multimedia software and other digital technologies in recent
years has provided new possibilities for enhancing spatial ability in engineering
education. These resources offer students the ability to engage with three-
dimensional models and representations on the display of their devices, making
learning more engaging and immersive. For kinesthetic learners, who learn best
through hands-on experience and physical manipulation of items, this can be
extremely helpful. Overall, the improvement of spatial ability through focused
training and instruction can have a positive impact on students’ future success in
their chosen field. Engineering education places a high value on this goal.
The challenge of student retention usually has an impact on engineering studies
too, particularly concerning first-year university students [35]. Sorby [36] argues
that students are more likely to lose motivation and abandon their engineering stud-
ies if they struggle with the course material right on. However, if they attend a
course with significant spatial abilities and maintain putting up the effort to improve
them as the course proceeds, there is a significantly lower chance that they would
drop out.
Students who struggle with the course material or lack confidence in their abili-
ties are more likely to drop out of engineering studies, particularly in the first year
of university. However, enhancing spatial skills might be crucial for increasing
4 1 Introduction and Overview of AI-Enhanced Augmented Reality in Education
is where personalized learning comes into play since it enables specialized training
that is catered to each student’s unique requirements and talents.
The creation of AR applications that take use of the portable qualities and quick
access to information that are gained with mobile devices has become popular over
the past few years due to the trend of mixing mobile technologies with AR [53]. The
convergence of mobile technology and augmented reality has ushered in fresh pros-
pects for education and training by granting users access to augmented reality
encounters and materials via their mobile devices. This has the potential to make
learning more adaptable, personalized, and engaging [54–60].
However, the combination of AR and its application in educational settings
remains an open area research. The elaboration of educational content based on
augmented reality approaches or methods for the design and construction of highly
interactive materials so that it can offer tailored learning in any location and at any
time are not subject to any predefined rules. The potential of augmented reality
(AR) in education has been the subject of some studies and trials, but there is still
much to learn and investigate in terms of setting standards and best practices for
creating efficient AR-based learning experiences. Additionally, there is a need for
deeper and thorough evaluation techniques to determine how AR affects learning
results. It is anticipated that new approaches and frameworks will emerge to direct
the development and application of augmented reality in education as the area con-
tinues to grow.
In light of the aforementioned, the major objective of this research is to utilize
the advantages of augmented reality and the technology of adaptive systems by fus-
ing them in a novel way to provide optimized and customized spatial ability train-
ing. By combining AR technology with adaptive systems, it may be possible to
create a highly interactive and engaging learning environment that can provide per-
sonalized training in spatial ability. This could have important implications for edu-
cation in fields such as engineering, where spatial ability is a key skill.
Given that the undergraduate students of the Departments of Electrical and
Electronic Engineering, Biomedical Engineering, Industrial Design and Production
Engineering, Informatics and Computer Engineering, Surveying and Geoinformatics
Engineering, Mechanical Engineering, Naval Architecture, and Civil Engineering
of the School of Engineering of the University of West Attica, are offered at their
curriculum, courses such as the technical drawing, which is highly correlated with
an advanced level of spatial ability, this research developed a mobile application for
spatial ability training. The mobile application, namely PARSAT (personalized spa-
tial ability training application), incorporates learning theories to support the peda-
gogical features of the system, and fuzzy expert system for personalization and
adaptivity. The incorporation of learning theories and a fuzzy expert system for
personalization and adaptivity can help optimize the training experience for each
individual student.
In particular, PARSAT incorporates the following:
• the use of the Structure of the Observed Learning Outcomes (SOLO) learning
theory, for the instructional design of learning content, providing a framework
6 1 Introduction and Overview of AI-Enhanced Augmented Reality in Education
for organizing and assessing student learning outcomes based on increasing lev-
els of complexity;
• the use of fuzzy logic in an AR system in engineering education, a mathematical
tool for dealing with uncertain and imprecise information, to personalize the
learning experience based on the student’s performance;
• the adaptive delivery of the learning activities taught to students in the AR sys-
tem, which adjusts the difficulty and type of activities based on the student’s
progress and needs.
Students can provide highly engaging content that is individualized to their charac-
teristics and requirements by integrating these applications into an adaptable and
accessible learning process. As a result, students are able to comprehend the con-
tents and correlate them to the actual world.
Each student can benefit from a customized learning experience that takes into
account their cognitive demands, skills, and preferences by integrating PARSAT
with an adaptable and accessible learning process. By allowing students to apply the
learning content to actual situations, this personalized learning experience can
increase student engagement, knowledge acquisition, and the practical applicability
of their learning. By incorporating AR technology, PARSAT can provide a more
immersive and engaging learning experience, which can enhance spatial ability
training in engineering education.
1.3 Research Questions
The current research has the purpose to design and develop a system for training
students’ spatial skills, in an innovative mobile environment, using augmented real-
ity technology, and adaptive tutoring techniques. The research objective is to
develop and evaluate a novel mobile system for spatial ability training using aug-
mented reality technology.
Hence, the research questions are formulated as follows:
1. What is the current state of research on spatial ability training through aug-
mented reality technology? (RQ1);
2. How can the use of mobile devices enhance the effectiveness of the system for
training spatial skills? (RQ2);
3. What are the key components of an effective system for training spatial skills
using augmented reality technology and adaptive tutoring techniques? (RQ3);
4. What are the most effective instructional strategies and techniques for training
spatial skills in a mobile augmented reality environment? (RQ4);
5. How effective is the developed AR-based spatial ability training system in
improving participants’ spatial abilities? (RQ5);
6. How does the developed AR-based spatial ability training system compared to
traditional spatial ability training methods in terms of effectiveness and effi-
ciency? (RQ6);
1.4 Approach and Structure 7
7. What is the impact of the system on students’ academic achievement and moti-
vation to train spatial skills? (RQ7);
8. What are the participants’ perceptions of the usability and effectiveness of the
developed AR-based spatial ability training system? (RQ8).
In essence, the aim of this research is to enhance the realm of spatial ability training
by investigating the capabilities of augmented reality (AR) technology in creating a
mobile training system that is both effective and efficient while also capturing the
user’s engagement. The research will encompass the following activities:
• a comprehensive literature review
• a design phase
• an implementation phase
• an evaluation phase
to answer the research questions and achieve the research objective.
The structure of this book is well-organized and follows a logical progression.
Following is a brief synopsis of each chapter:
• Chapter 2 “Review of the Literature on AI-enhanced Augmented Reality in
Education”: This chapter provides an in-depth analysis of the related literature
on the topic of the book. It attempts to highlight the research’s current deficien-
cies and offer an extensive overview of the research setting. The chapter will also
discuss the state of the art at the point in time and offer a critical assessment of
earlier research.
• Chapter 3 “AI-driven and SOLO-based Domain Knowledge Modeling in
PARSAT AR Software”: This chapter describes the domain knowledge model
used in the book and the integration of the SOLO taxonomy. In-depth analysis of
the taxonomy and domain knowledge used, as well as their applicability to the
research question, will also be provided in this chapter.
• Chapter 4 “Fuzzy Logic for modeling the Knowledge of Users in PARSAT AR
Software”: This chapter describes the student model used in the book and the
integration of fuzzy logic. The student model and the fuzzy logic employed will
also be thoroughly examined in this chapter, along with their applicability to the
subject of the study.
• Chapter 5 “Artificial Intelligence-enhanced PARSAT AR Software: Architecture
and Implementation”: This chapter provides a detailed description of the archi-
tecture and implementation of the proposed system. It will also discuss the soft-
ware tools and technologies used, the design decisions made, and the
implementation challenges faced.
• Chapter 6 “Multi-Model Evaluation of the Artificial Intelligence-Enhanced
PARSAT AR Software”: This chapter evaluates the proposed system using a
8 1 Introduction and Overview of AI-Enhanced Augmented Reality in Education
References
18. C. L. Gohm, L. G. Humphreys, and G. Yao, “Underachievement among spatially gifted stu-
dents.,” Am Educ Res J, vol. 35, pp. 515–531, 1998, https://doi.org/10.2307/1163447.
19. C. Papakostas, C. Troussas, A. Krouska, and C. Sgouropoulou, “Exploring Users’ Behavioral
Intention to Adopt Mobile Augmented Reality in Education through an Extended Technology
Acceptance Model,” Int J Hum Comput Interact, vol. 39, no. 6, pp. 1294–1302, 2023, https://
doi.org/10.1080/10447318.2022.2062551.
20. C. Papakostas, C. Troussas, A. Krouska, and C. Sgouropoulou, “User acceptance of augmented
reality welding simulator in engineering training,” Educ Inf Technol (Dordr), vol. 27, no. 1,
pp. 791–817, Jan. 2022, https://doi.org/10.1007/s10639-020-10418-7.
21. A. Marougkas, C. Troussas, A. Krouska, and C. Sgouropoulou, “Virtual Reality in Education:
A Review of Learning Theories, Approaches and Methodologies for the Last Decade,”
Electronics (Basel), vol. 12, no. 13, 2023, https://doi.org/10.3390/electronics12132832.
22. A. Krouska, C. Troussas, K. Kabassi, and C. Sgouropoulou, “An Empirical Investigation of
User Acceptance of Personalized Mobile Software for Sustainability Education,” Int J Hum
Comput Interact, pp. 1–8, Aug. 2023, https://doi.org/10.1080/10447318.2023.2241614.
23. P. Strousopoulos, C. Troussas, C. Papakostas, A. Krouska, and C. Sgouropoulou,
“Revolutionizing Agricultural Education with Virtual Reality and Gamification: A Novel
Approach for Enhancing Knowledge Transfer and Skill Acquisition,” in Novel & Intelligent
Digital Systems: Proceedings of the 3rd International Conference (NiDS 2023), K. Kabassi,
P. Mylonas, and J. Caro, Eds., Cham: Springer Nature Switzerland, 2023, pp. 67–80.
24. M. Iakovidis, C. Papakostas, C. Troussas, and C. Sgouropoulou, “Empowering Responsible
Digital Citizenship Through an Augmented Reality Educational Game,” in Novel & Intelligent
Digital Systems: Proceedings of the 3rd International Conference (NiDS 2023), K. Kabassi,
P. Mylonas, and J. Caro, Eds., Cham: Springer Nature Switzerland, 2023, pp. 31–39.
25. J. Wai, D. Lubinski, and C. Benbow, “Spatial Ability for STEM Domains: Aligning Over 50
Years of Cumulative Psychological Knowledge Solidifies Its Importance,” J Educ Psychol,
Nov. 2009, https://doi.org/10.1037/a0016127.
26. S. Sorby, “Developing 3D spatial skills for engineering students,” Australasian Journal of
Engineering Education, vol. 13, pp. 1–11, Jan. 2007, https://doi.org/10.1080/22054952.200
7.11463998.
27. A. R. Arslan and S. Dazkir, “Technical Drafting and Mental Visualization in Interior
Architecture Education,” International Journal for the Scholarship of Teaching and Learning,
vol. 11, no. 2, 2017, https://doi.org/10.20429/ijsotl.2017.110215.
28. H. B. P. Gerson, S. A. Sorby, A. Wysocki, and B. J. Baartmans, “The development and
assessment of multimedia software for improving 3-D spatial visualization skills,” Computer
Applications in Engineering Education, vol. 9, no. 2, pp. 105–113, 2001.
29. J. L. Mohler, “Computer Graphics Education: Where and How Do We Develop Spatial
Ability?,” in Eurographics (Education Papers), 2006, pp. 79–86.
30. A. Šafhalter, S. Glodež, A. Šorgo, and M. Ploj Virtič, “Development of spatial thinking abili-
ties in engineering 3D modeling course aimed at lower secondary students,” Int J Technol Des
Educ, 2020, https://doi.org/10.1007/s10798-020-09597-8.
31. R. H. McKim, Experiences in visual thinking. Monterey, Calif.: Brooks/Cole Pub. Co., 1980.
32. Z. Kanetaki et al., “Acquiring, Analyzing and Interpreting Knowledge Data for Sustainable
Engineering Education: An Experimental Study Using YouTube,” Electronics (Basel), vol. 11,
no. 14, 2022, https://doi.org/10.3390/electronics11142210.
33. A. Krouska, C. Troussas, and C. Sgouropoulou, “Fuzzy Logic for Refining the Evaluation
of Learners’ Performance in Online Engineering Education,” European Journal of
Engineering Research and Science, vol. 4, pp. 50–56, Jun. 2019, https://doi.org/10.24018/
ejers.2019.4.6.1369.
34. C. Papakostas, C. Troussas, A. Krouska, and C. Sgouropoulou, “Exploration of Augmented
Reality in Spatial Abilities Training: A Systematic Literature Review for the Last Decade,”
Informatics in Education, vol. 20, no. 1, pp. 107–130, Mar. 2021, https://doi.org/10.15388/
infedu.2021.06.
10 1 Introduction and Overview of AI-Enhanced Augmented Reality in Education
35. S. Sheppard and R. Jennison, “Freshman engineering design experiences and organizational
framework,” International Journal of Engineering Education, vol. 13, pp. 190–197, 1997.
36. S. A. Sorby, “Assessment of a “new and improved” course for the development of 3-D spatial
skills,” The Engineering Design Graphics Journal, vol. 69, no. 3, 2005.
37. C. Papakostas, C. Troussas, P. Douros, M. Poli, and C. Sgouropoulou, “CoMoPAR: A
Comprehensive Conceptual Model for Designing Personalized Augmented Reality Systems
in Education,” in Novel & Intelligent Digital Systems: Proceedings of the 3rd International
Conference (NiDS 2023), K. Kabassi, P. Mylonas, and J. Caro, Eds., Cham: Springer Nature
Switzerland, 2023, pp. 67–79.
38. J. L. B. Acosta, S. M. B. Navarro, R. F. Gesa, and K. Kinshuk, “Framework for designing moti-
vational augmented reality applications in vocational education and training,” Australasian
Journal of Educational Technology, vol. 35, no. 3 SE-Articles, Jun. 2019, https://doi.
org/10.14742/ajet.4182.
39. S. Y. Chen and S. Y. Liu, “Using augmented reality to experiment with elements in a chemis-
try course,” Comput Human Behav, vol. 111, p. 106316, Apr. 2020, https://doi.org/10.1016/j.
chb.2020.106418.
40. J. Garzón, J. Pavón, and S. Baldiris, “Systematic review and meta-analysis of augmented
reality in educational settings,” Virtual Real, vol. 23, no. 4, pp. 447–459, 2019, https://doi.
org/10.1007/s10055-019-00379-9.
41. M. Thees, S. Kapp, M. P. Strzys, F. Beil, P. Lukowicz, and J. Kuhn, “Effects of augmented real-
ity on learning and cognitive load in university physics laboratory courses,” Comput Human
Behav, vol. 108, p. 106316, 2020, https://doi.org/10.1016/j.chb.2020.106316.
42. C. Papakostas, C. Troussas, A. Krouska, and C. Sgouropoulou, “Measuring User Experience,
Usability and Interactivity of a Personalized Mobile Augmented Reality Training System,”
Sensors, vol. 21, no. 11, p. 3888, Jun. 2021, https://doi.org/10.3390/s21113888.
43. S. Alimamy, K. R. Deans, and J. Gnoth, “The Role of Augmented Reality in the Interactivity
of Co-Creation: A Critical Review,” Int. J. Technol. Hum. Interact., vol. 14, no. 3, pp. 88–104,
2018, https://doi.org/10.4018/IJTHI.2018070106.
44. C. Papakostas, C. Troussas, A. Krouska, and C. Sgouropoulou, “PARSAT: Fuzzy logic for
adaptive spatial ability training in an augmented reality system,” Computer Science and
Information Systems.
45. C. Papakostas, C. Troussas, A. Krouska, and C. Sgouropoulou, “Personalization of the
Learning Path within an Augmented Reality Spatial Ability Training Application Based on
Fuzzy Weights,” Sensors, vol. 22, no. 18, 2022, https://doi.org/10.3390/s22187059.
46. C. Troussas, C. Papakostas, A. Krouska, P. Mylonas, and C. Sgouropoulou, “Personalized
Feedback Enhanced by Natural Language Processing in Intelligent Tutoring Systems,”
in Augmented Intelligence and Intelligent Tutoring Systems, C. Frasson, P. Mylonas, and
C. Troussas, Eds., Cham: Springer Nature Switzerland, 2023, pp. 667–677. https://doi.
org/10.1007/978-3-031-32883-1_58.
47. C. Papakostas, C. Troussas, A. Krouska, and C. Sgouropoulou, “On the development of a
personalized augmented reality spatial ability training mobile application,” in Frontiers in
Artificial Intelligence and Applications, IOS Press, 2021, pp. V–VI. https://doi.org/10.3233/
FAIA210078.
48. A. Marougkas, C. Troussas, A. Krouska, and C. Sgouropoulou, “How personalized and
effective is immersive virtual reality in education? A systematic literature review for the last
decade,” Multimed Tools Appl, 2023, https://doi.org/10.1007/s11042-023-15986-7.
49. A. Marougkas, C. Troussas, A. Krouska, and C. Sgouropoulou, “A Framework for Personalized
Fully Immersive Virtual Reality Learning Environments with Gamified Design in Education,”
2021. https://doi.org/10.3233/FAIA210080.
50. E. B. Hsu, Y. Li, J. D. Bayram, D. Levinson, S. Yang, and C. Monahan, “State of virtual reality
based disaster preparedness and response training,” PLoS Curr, vol. 5, 2013.
51. A. Soofi and M. Uddin, “A Systematic Review of Domains, Techniques, Delivery Modes
and Validation Methods for Intelligent Tutoring Systems,” International Journal of
References 11
Advanced Computer Science and Applications, vol. 10, Jan. 2019, https://doi.org/10.14569/
IJACSA.2019.0100312.
52. M. Holmes, A. Latham, K. A. Crockett, and J. D. O’Shea, “Near Real-Time Comprehension
Classification with Artificial Neural Networks: Decoding e-Learner Non-Verbal Behavior,”
IEEE Transactions on Learning Technologies, vol. 11, pp. 5–12, 2018.
53. G. Papagiannakis, G. Singh, and N. Thalmann, “A Survey of Mobile and Wireless Technologies
for Augmented Reality Systems (Preprint),” Comput Animat Virtual Worlds, vol. 19, pp. 3–22,
Feb. 2008, https://doi.org/10.1002/cav.221.
54. P. Strousopoulos, C. Papakostas, C. Troussas, A. Krouska, P. Mylonas, and C. Sgouropoulou,
“SculptMate: Personalizing Cultural Heritage Experience Using Fuzzy Weights,” in Adjunct
Proceedings of the 31st ACM Conference on User Modeling, Adaptation and Personalization,
in UMAP ’23 Adjunct. New York, NY, USA: Association for Computing Machinery, 2023,
pp. 397–407. https://doi.org/10.1145/3563359.3596667.
55. C. Papakostas, C. Troussas, A. Krouska, and C. Sgouropoulou, “Modeling the Knowledge of
Users in an Augmented Reality-Based Learning Environment Using Fuzzy Logic,” in Lecture
Notes in Networks and Systems, A. Krouska, C. Troussas, and J. Caro, Eds., Cham: Springer
International Publishing, 2023, pp. 113–123. https://doi.org/10.1007/978-3-031-17601-2_12.
56. C. Troussas, A. Krouska, and C. Sgouropoulou, “Enriching Mobile Learning Software with
Interactive Activities and Motivational Feedback for Advancing Users’ High-Level Cognitive
Skills,” Computers, vol. 11, no. 2, 2022, https://doi.org/10.3390/computers11020018.
57. F. Giannakas, C. Troussas, A. Krouska, C. Sgouropoulou, and I. Voyiatzis, “XGBoost and
Deep Neural Network Comparison: The Case of Teams’ Performance,” in Intelligent Tutoring
Systems, A. I. Cristea and C. Troussas, Eds., Cham: Springer International Publishing, 2021,
pp. 343–349.
58. C. Troussas, A. Krouska, and C. Sgouropoulou, “Towards a Reference Model to Ensure the
Quality of Massive Open Online Courses and E-Learning,” in Brain Function Assessment
in Learning, C. Frasson, P. Bamidis, and P. Vlamos, Eds., Cham: Springer International
Publishing, 2020, pp. 169–175.
59. C. Troussas, A. Krouska, and C. Sgouropoulou, “Dynamic Detection of Learning Modalities
Using Fuzzy Logic in Students’ Interaction Activities,” in Intelligent Tutoring Systems,
V. Kumar and C. Troussas, Eds., Cham: Springer International Publishing, 2020, pp. 205–213.
60. A. Krouska, C. Troussas, and C. Sgouropoulou, “A novel group recommender system for
domain-independent decision support customizing a grouping genetic algorithm,” User Model
User-adapt Interact, 2023, https://doi.org/10.1007/s11257-023-09360-3.
Chapter 2
Review of the Literature on AI-Enhanced
Augmented Reality in Education
2.1 Overview
This chapter presents an overview of the relevant literature and is organized into five
sections. More specifically, the first section of this chapter introduces the term “spa-
tial ability”, its multiple definitions, and its components. The second section of the
chapter emphasizes in the importance of spatial ability in various fields, more spe-
cifically in engineering training. The third section evaluates the use of augmented
reality technology to improve spatial skills. The fourth section presents a systematic
literature review (SLR) on the exploration of relevant training, based on augmented
reality technology, that has been used to improve spatial ability. The last section
summarizes the review of the literature.
Spatial ability, as a factor of human intelligence, was initially recognized and stud-
ied by [1]. Thorndike levelled criticism against the formulation of two-factor theory
of intelligence [2], whose theory was based on the existence of a general intelli-
gence factor. Thorndike’s proposed model consisted of three mutually independent
abilities, namely abstract (maintained from Spearman’s theory), mechanical and
social intelligence, while mechanical ability was defined as the ability to visualize
the objects’ relations and understanding of the physical world. Thorndike’s theory
served as the early-stage research for later studies on spatial ability and highlighted
the importance of designing measuring tools for it.
In [3] the author also acknowledged spatial ability as a separate independent fac-
tor, opposed to Spearman’s [2] theory. Koussy researched spatial intelligence and
contributed to the creation of tools for assessing it. Koussy identified the term factor
“K”, as the ability to acquire and use visual spatial images. The manipulation of
spatial relations was introduced as an additional separate component of spatial
ability.
In [4] the author also came to a different conclusion about the nature of intelli-
gence than [2]. Thurstone suggested that the intelligence consists of seven interre-
lated primary mental abilities, rather than a single general one. These primary
mental abilities include a) associative memory; b) numerical ability; c) perceptual
speed; d) reasoning; e) spatial visualization; f) verbal comprehension; and g) word
fluency, while spatial visualization was defined as the factor involved in visualizing
and manipulating objects. Thurstone’s theory of multiple factors [4] was the basis
for creating each factor’s measuring tests.
Thurstone [5] defined three core components of spatial ability, namely mental
rotation, spatial visualization, and spatial perception. Mental rotation refers to the
capacity to identify an object as it undergoes various orientations or angles of move-
ment; spatial visualization entails the capability to discern the components of an
object when it is shifted or relocated from its initial position; and spatial perception
2.2 Spatial Ability: Review of Theories 15
involves the ability to utilize one’s own bodily orientation to engage with the sur-
rounding environment, thereby influencing spatial awareness [6].
In [7] the author put forth the theory of multiple intelligences, which challenges
the idea of intelligence as a singular, overarching capability. Instead, he suggested
the existence of eight distinct intelligences, each rooted in specific skills and apti-
tudes. Gardner’s argument stated that there is a wide range of cognitive abilities, not
necessarily correlated between them, namely musical, visual-spatial, linguistic-
verbal, logical-mathematical, bodily-kinesthetic, interpersonal, intrapersonal, and
naturalistic. Visual-spatial intelligence is defined as the ability to accurately inter-
pret the visual environment, to alter and modify one’s first perception, and to recre-
ate some aspects of one’s visual experience, even in the lack of appropriate
physical input.
In [8] the author extensively studied the factor structure of spatial ability, defin-
ing two main factors, namely a) spatial visualization; and b) spatial orientation.
Spatial visualization is the ability to mentally rotate, manipulate, and twist two- and
three-dimensional stimulus objects [8], while spatial orientation is the comprehen-
sion of the agreement of elements within a visual stimulus pattern and the aptitude
to remain unconfused by the changing orientation in which a spatial configuration
may be presented [9].
Linn and Petersen[10] researched the gender differences in the aspects of spatial
ability and labeled the spatial ability factors as: a) spatial perception; b) mental rota-
tion; and c) spatial visualization, separating mental rotation from spatial visualiza-
tion. In [11] the author also proposed three factors for spatial ability, giving them the
slightly different names: a) spatial visualization; b) spatial orientation; and c)
speeded rotation.
Many recent theories proposed additional factors or cognitive processes, in their
effort to better understand spatial ability [12, 13]. Each research has added signifi-
cantly to the definition of spatial ability, as a form of intelligence, where a person
demonstrates the capacity to mentally generate, transform, and rotate a visual image
and thus, understand and recall spatial relationships between real and imagined
objects. Table 2.1 summarizes the definitions of spatial ability and its structure
factors.
In [14] the author reported a list of 84 different occupations that require top-level
spatial ability, and that engineering, and graphics-related occupations were well-
represented on this list. 26 out of 84 occupations were related to engineering, while
14 of them were related to graphics (Table 2.2). There is a significant correlation
between spatial ability and many scientific fields, such as geometry, physics and
technical drawing [15, 16].
Spatial ability stands as a pivotal cognitive prowess significantly applicable
across numerous scientific and technical domains such as engineering, graphics,
16 2 Review of the Literature on AI-Enhanced Augmented Reality in Education
physics, and geometry [17, 18]. Those possessing robust spatial abilities are inclined
toward triumph in these areas, and fostering spatial competence becomes a para-
mount objective for educational initiatives focused on equipping students for STEM
careers.
Beyond its significance in achieving success within the realm of engineering,
spatial ability also plays a vital role in advancing innovative technologies. Engineers
possessing robust spatial skills are more adept at conceptualizing and crafting novel
2.2 Spatial Ability: Review of Theories 17