You are on page 1of 18

Behaviour & Information Technology

ISSN: (Print) (Online) Journal homepage: https://www.tandfonline.com/loi/tbit20

Toward better intelligent learning (iLearning)


performance: what makes iLearning work for
students in a university setting?

Hung-Yi Wu, Hung-Shu Wu, I.-Shuo Chen & Yu-Pei Su

To cite this article: Hung-Yi Wu, Hung-Shu Wu, I.-Shuo Chen & Yu-Pei Su (2023) Toward
better intelligent learning (iLearning) performance: what makes iLearning work for
students in a university setting?, Behaviour & Information Technology, 42:1, 60-76, DOI:
10.1080/0144929X.2021.2014967

To link to this article: https://doi.org/10.1080/0144929X.2021.2014967

© 2022 The Author(s). Published by Informa


UK Limited, trading as Taylor & Francis
Group

Published online: 31 Jan 2022.

Submit your article to this journal

Article views: 1113

View related articles

View Crossmark data

Full Terms & Conditions of access and use can be found at


https://www.tandfonline.com/action/journalInformation?journalCode=tbit20
BEHAVIOUR & INFORMATION TECHNOLOGY
2023, VOL. 42, NO. 1, 60–76
https://doi.org/10.1080/0144929X.2021.2014967

Toward better intelligent learning (iLearning) performance: what makes


iLearning work for students in a university setting?
Hung-Yi Wua, Hung-Shu Wub, I.-Shuo Chenc and Yu-Pei Sua
a
Department of Business Administration, National Chiayi University, Taiwan (R.O.C); bDepartment of Smart Living Technology, Huafan
University, Taiwan (R.O.C); cSchool of Management, Anglia Ruskin University, Cambridge, UK

ABSTRACT ARTICLE HISTORY


We explored the critical factors associated with iLearning that impact students’ learning Received 9 November 2020
performance and identified the factors with a notable influence to help managers in higher Accepted 1 December 2021
education institutions increase the effectiveness of iLearning for students. We initially synthesised
KEYWORDS
4 main dimensions (including 26 criteria): performance expectancy, lecturers’ influence, quality of Intelligent learning
service, and personal innovativeness. Subsequently, we conducted surveys in two stages. First, by (iLearning); higher
studying a group of students with experience using iLearning at Taiwanese universities, we education; university; factor
extracted 5 critical dimensions (including 18 criteria) through a factor analysis. Second, by analysis (FA); analytic
studying a group of senior educators and practitioners in Taiwan, we prioritised the dimensions hierarchy process (AHP)
and criteria through the analytic hierarchy process (AHP). We found that performance expectancy
is the top critical dimension, and the top five critical criteria pertain to enhancing the learning
performance, increasing the learning participation, altering learning habits, ensuring access at all
times, and enabling prompt use of learning resources. Moreover, we recommend several
suggestions for the relevant managers to enhance the students’ iLearning performance.

1. Introduction additionally, systems to monitor the learning processes


Technological advancement has significantly changed and performance in real time are lacking (e.g. Corbeil
the way in which students learn and has challenged tra- and Valdes-Corbeil 2007). Therefore, intelligent learn-
ditional pedagogy in higher education (Rossing et al. ing (iLearning) has emerged as another mainstream
2012; Thongsri, Shen, and Bao 2019). To learn, students way to enable learning and teaching in higher education
in the past had to attend face-to-face classes or read frameworks because it addresses many of the existing
books (Summers, Waigandt, and Whittaker 2005). drawbacks of mLearning and provides additional
However, in recent years, an increasing number of benefits for learning and teaching.
different ways to learn have emerged, for example iLearning refers to a smart campus that enables intel-
using Facebook, iTunes, and podcasts, or registering ligent learning and teaching; related applications, such
for courses provided by online course venders such as as interactive learning systems, smart classrooms, syn-
Coursera and Udemy. In other words, students can chronous distance teaching and learning, virtual learn-
learn using portable devices such as mobile phones ing communities, and gaming competitions; and
and laptops (i.e. mLearning; e.g. Al-Emran, Arpaci, collaborative learning across classrooms (e.g. Aini,
and Salloum 2020; Irwin et al. 2012; McGarr 2009; Rahardja, and Hariguna 2019; Aini, Dhaniarti, and
McKinney, Dyck, and Luber 2009). Many studies have Khoirunisa 2019; Abbasy and Quesada 2017; Araya
found that at universities, mLearning is a key way to et al. 2016; AjazMoharkan et al. 2017; Marquez et al.
learn and teach, and this mode contributes to the stu- 2016; Muhamad et al. 2017). In the iLearning environ-
dents’ learning motivation and performance (e.g. ment, instructors/lecturers and students are involved
Crompton, Burke, and Gregory 2017; Major, Haßler, in the learning processes in a real-time manner.
and Hennessy 2017; Miller and Cuevas 2017). However, Although recent studies have indicated that iLearning
mLearning has been criticised in terms of several may contribute to the students’ learning performance
aspects. For example, mLearning creates a sense of iso- (e.g. Nik-Mohammadi and Barekat 2015; Yarmatov, &
lation for students and a sense of being out of the loop Ahmedova, 2020), the factors associated with iLearning
for both teachers and students (e.g. Rahman 2020); platforms that influence the students’ learning

CONTACT I-Shuo Chen i-shuo.chen@aru.ac.uk School of Management, Anglia Ruskin University, Cambridge, UK
This article has been republished with minor changes. These changes do not impact the academic content of the article.
© 2022 The Author(s). Published by Informa UK Limited, trading as Taylor & Francis Group
This is an Open Access article distributed under the terms of the Creative Commons Attribution-NonCommercial-NoDerivatives License (http://creativecommons.org/licenses/by-nc-nd/4.0/),
which permits non-commercial re-use, distribution, and reproduction in any medium, provided the original work is properly cited, and is not altered, transformed, or built upon in any way.
BEHAVIOUR & INFORMATION TECHNOLOGY 61

performance and the relevant factors that must be con- collaborators (2003) introduced four dimensions that
sidered by university managers to enhance the effective- may influence individuals’ use of new technology: per-
ness of iLearning for students remain unclear. formance expectancy, effort expectancy, social influ-
Addressing these gaps in the literature is crucial for uni- ences, and facilitating conditions. These dimensions
versities to effectively improve the overall quality of have been tested in existing studies (e.g. Wang et al.
education and, in turn, their competitive advantages 2020; Wang, Wu, and Wang 2009), and several
in the long run. The reason is that the resources in researchers have demonstrated that the performance
any organisation may be limited; hence, it is important expectancy should be particularly emphasised com-
for universities to invest their limited resources in pared to effort expectancy (e.g. Oh, Lehto, and Park
addressing the factors that may have a greater impact 2009). Additionally, the use of new technology may be
on the students’ learning performance by adopting impacted by not only how effectively and efficiently
iLearning. individuals receive support but also the overall experi-
Considering these aspects, we aimed to explore the ence of service that the technology delivers (Choi et al.
critical factors associated with iLearning platforms 2020). Moreover, recent studies have highlighted that
that may influence the students’ learning performance individual differences such as personal innovativeness
and identify the factors with the most notable influence. may influence the effective use of new technology (e.g.
First, we extracted the factors pertaining to iLearning Patil et al. 2020). Considering these aspects, we adopted
platforms that have been found to influence the stu- performance expectancy, lecturers’ influence, quality of
dents’ learning performance based on an extensive lit- service, and personal innovativeness as the measure-
erature review. Using these factors, we conducted a ment dimensions in our research. Notably, due to the
student survey to identify the key factors for iLearning nature of our study, rather than focusing on social influ-
and prioritise these factors based on an expert survey ence in general, we particularly focused on the lecturers’
of other stakeholders (academic staff and practitioners influence since lecturers frequently interact with stu-
from different industries and the government) to ident- dents during the iLearning journey and are therefore
ify the factors that significantly influence the students’ more likely to influence students through teacher – stu-
learning performance. We contribute to the literature dent interactions.
in the following way: we present novel insights regard- ‘Performance expectancy’ concerns the degree to
ing iLearning by specifying the elements derived from which individuals believe that adopting an information
iLearning platforms that affect the students’ learning platform/system will facilitate them in functioning
performance, thereby also contributing to the literature effectively in a given environment or in achieving a
related to higher education by demonstrating an given outcome (Venkatesh et al. 2003). When individ-
efficient technique to increase the effectiveness of uals perceive that the use of a specific information plat-
iLearning for students. Specifically, although iLearning form/system will help them achieve the desired
has gained importance in recent years, few studies outcome, they may be more likely to use it (Do Nam
have attempted to explore the critical elements (e.g. Hung, Azam, and Khatibi 2019). Empirical studies
dimensions and criteria) that may influence students’ have supported this observation by demonstrating that
iLearning performance. We believe that by focusing enhancing the individuals’ performance expectancy
on enhancing the key elements, managers of higher edu- may significantly alter their attitude toward a given
cation institutions can effectively optimise the students’ information platform/system as well as their behav-
iLearning performance in an efficient and effective ioural intent (e.g. Lowenthal, 2010; Purwanto and
manner. Loisa 2020). Similar findings have been obtained in
learning-related studies. In an iLearning context, the
performance expectancy may be viewed as the students’
2. Key factors derived from ilearning
perception of whether the use of a specific learning plat-
platforms that influence iLearning for
form/system (e.g. an iLearning platform) will benefit
students
their learning performance. Wang, Wu, and Wang
Learning is a personal act, and learning performance (2009) and Chaka and Govender (2017) found that as
may be affected by the conditions of the learning part of learning in a digital and intelligent manner, per-
environment (Milošević et al. 2015). Technological formance expectancy was a strong determinant that
advancements alone may not ensure a student’s learning motivated students to adopt this mode of learning.
performance because specific strategies, tools, and Recent studies have indicated that intelligent and digital
resources are necessary to support different types of learning may enrich students’ learning performance by
learning (Milošević et al. 2015). Venkatesh and providing new learning experiences, increasing learning
62 H.-Y. WU ET AL.

participation (e.g. Chen 2011; Yarmatov & Ahmedova, real-time discussions between instructors and their stu-
2020), and facilitating collaborative learning (e.g. Hirsch dents via the platform (e.g. Abu-Al-Aish and Love 2013;
and Ng 2011; Abbasy and Quesada 2017) in an inte- Badwelan, Drew, and Bahaddad 2016; Chen 2011; Milo-
grated environment. Additionally, iLearning may help šević et al. 2015; Iqbal and Qureshi 2012; Sabah 2016;
students strengthen their learning efficiency, enhance Vrana 2018). Specifically, iLearning platforms allow a
their learning performance (e.g. Abu-Al-Aish and teacher to teach in real time, and the students have
Love 2013; Wang, Wu, and Wang 2009), and further opportunities to have face-to-face interactions and dis-
extend their learning effect across different domains cussions with the teacher (e.g. Kose and Deperlioglu
(e.g. Karimi 2016). Therefore, it is conceivable that 2012). Such frameworks also allow the teacher to
these elements may help enhance the students’ iLearn- teach students to use the platform to learn more
ing performance expectancy. promptly and effectively. Therefore, these elements
‘Lecturers’ influence’ originates from social influence may enhance the lecturers’ influence on the students’
(Abu-Al-Aish and Love 2013). Social influence concerns iLearning.
the degree to which individuals perceive others’ expec- The ‘quality of service’ in the information system and
tations regarding the use of an information platform/sys- human–computer interaction fields is not the same as
tem (Sung et al. 2015; Venkatesh et al. 2003). In other that in service industry management (Ameen et al.
words, if individuals strongly perceive that other indi- 2019; Kuan, Bock, and Vathanophas 2008). The former
viduals expect them to use a specific information plat- type concerns individuals’ assessment of the reliability
form/system, the individuals are more likely to be and response, content quality, and security of an infor-
motivated to use it (Alshurideh et al. 2020; Liu and Li mation platform/system, and the latter type refers to
2010; Lu and Viehland 2008; Nassuora 2012; Venkatesh the expectation and satisfaction of customers with
and Morris 2000). Existing studies have revealed that regard to the services being provided (Abu-Al-Aish
social influence, similar to performance expectancy, is and Love 2013; Celesti et al. 2019; Rai, Lang, and Welker
a key element that can significantly influence the indi- 2002; Venkatesh et al. 2003). Existing studies have
viduals’ behavioural intent to adopt new technology found that when a service is provided in a satisfactory
(e.g. Alshurideh et al. 2020; Venkatesh & Davis, 2000; manner, individuals are more likely to adopt new tech-
Venkatesh, Morris, and Ackerman 2000). The concept nology (Abu-Al-Aish and Love 2013); however, a low
of social influence has been widely extended to the edu- quality of service (e.g. inferior facilitating conditions)
cation and learning literature (e.g. Chen 2011; Fagan may impede the adoption of new technology (Lim and
2019; Iqbal and Qureshi 2012; Sabah 2016; Vrana 2018). Khine 2006). In a learning context, Lee showed that stu-
In a learning context, the ‘lecturers’ influence’ is dents’ perception of the quality of service of a digital
defined as the degree to which instructors/lecturers learning platform may significantly affect their willing-
encourage, support, and motivate students to adopt a ness to use the platform for learning. Similarly, Abu-
specific learning platform/system for learning (Abu-Al- Al-Aish and Love (2013) indicated that in a digital
Aish and Love 2013). Existing studies have reported learning environment, the quality of service plays a cru-
findings that support this aspect (e.g. Badwelan, Drew, cial role in predicting the students’ acceptance and
and Bahaddad 2016; Izkair, Lakulu, and Mussa 2020; adoption of the learning platform in the environment.
Milošević et al. 2015). For example, in their study To enhance the quality of service of iLearning plat-
based on a Chinese university, Hao, Dennen, and Mei forms, recent studies have suggested that instructors
(2017) discovered that the lecturers’ influence may should provide ample learning resources (Shukla 2021;
motivate the students in using a new learning platform Swanson 2020), enhance their teaching quality (Zakar-
for digital learning. Similarly, Nassuora (2012) indicated iaa, Maatb, and Khalidc 2019), promote a pleasant intel-
that lecturers’ positive word of mouth may enhance the ligent campus experience (Lin and Su 2020; Wu, Wu,
students’ willingness to learn through a digital learning and Su 2019), and improve traditional learning methods
platform. Other studies have claimed that to effectively for students (Ehsanpur and Razavi 2020). Moreover,
motivate and support students in adopting a digital researchers have suggested that learning platform provi-
learning platform (e.g. an iLearning platform), instruc- ders should not only ensure the students’ privacy and
tors/lecturers may alter their teaching methods from a safety but also assist them in using learning resources
traditionally physical method to a method that is both efficiently and in logging onto the platform at any
intelligent and digital, thereby providing students with time. Additionally, it has been noted that encouraging
a higher learning quality through the digital learning students to learn via cloud computing technology,
platform, enabling them to experience mobile learning increasing the efficiency with which messages are trans-
in which they can learn at any location, and increasing ferred between instructors/lecturers and students,
BEHAVIOUR & INFORMATION TECHNOLOGY 63

enhancing the operational stability of the learning plat- suggestions may be elements that can enhance the stu-
form, increasing the number of campus receivers, and dents’ personal innovativeness with regard to iLearning.
making the platform simple and easy to use are critical In conclusion, through a literature analysis sum-
to advance the quality of service of the learning platform marising the most referenced and commonly used fac-
(e.g. Abu-Al-Aish and Love 2013; Badwelan, Drew, and tors in the relevant studies, we propose four
Bahaddad 2016; Hassanzadeh, Kanaani, and Elahi 2012; dimensions with 26 criteria (i.e. elements that may
Kim and Ong 2005; Kim et al. 2012; Lee 2006; Liu, Han, help enhance the dimensions) for iLearning. Table 1
and Li 2010; Milošević et al. 2015; Ng et al. 2010; summarises the proposed dimensions and sources of
Mohammadi 2015; Salloum et al. 2019). These findings the proposed criteria.
may be viewed as elements that may enhance the quality
of service of iLearning for students.
‘Personal innovativeness’ concerns the degree to 3. Research methods
which individuals are willing to try and use a new infor-
3.1. Research procedure and strategy
mation platform/system (Agarwal and Prasad 1998;
Rogers 2003). Compared to their counterparts, individ- The research procedure of this study is presented in
uals with a high degree of personal innovativeness are Figure 1. We aimed to explore the critical factors that
more likely to adopt and deal with the uncertainty may affect students’ iLearning on campus at a university
associated with a new information platform/system and identify the factors that have a more notable influ-
(Abu-Al-Aish and Love 2013; Lu, Yao, and Yu 2005). ence by calculating the relative importance of the critical
Existing studies have reported supportive evidence dimensions and criteria (i.e. factors). To develop an
that indicates that personal innovativeness can motivate iLearning research framework, we used keywords such
an individual to use new technology (e.g. Agarwal and as mLearning, eLearning, iLearning, acceptance and
Prasad 1998; Agarwal and Karahanna 2000; Fang, use of new technology, and teaching and learning in a
Shao, and Lan 2009; Hung and Chang 2005; Lassar, high education context to seek the articles necessary
Manolis, and Lassar 2005; Lewis, Agarwal, and Samba- for an extensive literature review. The reviewed and
murthy 2003; Lu, Yao, and Yu 2005; Lian and Lin considered studies are summarised in Table 1. Based
2008; Matute-Vallejo and Melero-Polo 2019; Yi et al. on the extensive literature review, we developed an
2006). Although personal innovativeness has been iLearning research framework that encompasses four
widely investigated in different fields, such as online critical dimensions with 26 critical criteria. These
shopping and blogs (e.g. Bhagat and Sambargi 2019; dimensions and criteria were used to develop a ques-
Bigne-Alcaniz et al. 2008; Wang, Chou, and Chang tionnaire. The study was performed in two stages. In
2010), it is particularly crucial in a digital and intelligent the first stage, questionnaire surveys were distributed,
learning context (Abu-Al-Aish and Love 2013; Agarwal through convenience sampling, to respondents (i.e. stu-
and Prasad 1998; Badwelan, Drew, and Bahaddad 2016; dents who have used iLearning on campus at a univer-
Handoko 2019; Joo, Lee, and Ham 2014; Fagan, Kilmon, sity) physically by the researchers. The survey required
and Pandey 2012; Liu, Li, and Carlsson 2010; Milošević approximately one month to complete. Subsequently,
et al. 2015; Shorfuzzaman et al. 2019; Salloum et al. we performed factor analysis (FA) to extract the critical
2019). factors, which were employed to construct the hierarch-
For example, Fagan, Kilmon, and Pandey (2012) dis- ical evaluation structure of the second-stage question-
covered that students with a high level of personal inno- naire. In the second stage, the analytic hierarchy
vativeness are more willing to learn by adopting virtual process (AHP) was adopted to obtain a consensus
reality simulations. Abu-Al-Aish and Love (2013) and based on domain expert opinions. Using the judgment
Karimi (2016) indicated that personal innovativeness sampling method, the researchers consulted the experts
is crucial in any learning environment involving infor- personally across three different sectors (e.g. industry,
mation technology. To effectively support students’ per- government, and academia). Next, we analyzed the rela-
sonal innovativeness, existing studies have highlighted tive importance of and prioritised each critical dimen-
the importance of altering students’ learning habits sion and criterion. Based on the analysis results, we
and strengthening their courage to try and enhance formulated managerial and educational recommen-
their self-efficacy in learning with a new learning plat- dations, with this study’s findings serving as a valuable
form (e.g. Abu-Al-Aish and Love 2013; Badwelan, reference for university managers to enhance the effec-
Drew, and Bahaddad 2016; Joo, Lee, and Ham 2014; tiveness of iLearning for students. In the following sec-
Karimi 2016; Milošević et al. 2015; Shorfuzzaman tions, we briefly introduce the relevant data analysis
et al. 2019; Salloum et al. 2019). Notably, these methods (including FA and AHP) used in this study.
64 H.-Y. WU ET AL.

Table 1. Dimensions and criteria that influence iLearning of students.


Dimension References Criteria References
Performance Abbasy and Quesada (2017); Abu-Al-Aish and Love Providing new learning Bai (2019); Darmaji et al. (2019); Kumar and
Expectancy (A) (2013); Almahri, Bell, and Merhi (2020); Aini, Rahardja, experiences* (A1) Chand (2019)
and Hariguna (2019); Badwelan, Drew, and Bahaddad Increasing the learning Chen (2011); Johnson et al. (2015)
(2016); Chen (2011); Fagan (2019); Hirsch and Ng participation (A2)
(2011); Kumar and Bervell (2019); Karimi (2016); Latip Extending the learning effect Karimi (2016)
et al. (2020); Milošević et al. (2015); Shukla (2021); (A3)
Wang et al (2009) Increasing the learning Abu-Al-Aish and Love (2013); Wang, Wu,
efficiency (A4) and Wang (2009)
Enhancing the learning Nik-Mohammadi and Barekat (2015)
performance (A5)
Facilitating collaborative Aini, Rahardja, and Hariguna (2019); Aini,
learning* (A6) Dhaniarti, and Khoirunisa (2019); Abbasy
and Quesada (2017)
Lecturers’ Abu-Al-Aish and Love (2013); Almahri, Bell, and Merhi Altering teaching methods Sabah (2016); Vrana (2018)
Influence (B) (2020); Aini, Dhaniarti, and Khoirunisa (2019); (B1)
Badwelan, Drew, and Bahaddad (2016); Chen (2011); Teachers’ encouragement Kacetl and Klímová (2019)
Kumar and Bervell (2019); Iqbal and Qureshi (2012); (B2)
Latip et al. (2020); Milošević et al. (2015); Sabah (2016); Higher learning quality (B3) Almaiah and Alismaiel (2019)
Shukla (2021); Vrana (2018); Wang, Wu, and Wang Enabling mobile teaching Aremu (2019); Wu, Wu, and Su (2019)
(2009) (B4)
Fostering discussions Kose and Deperlioglu (2012)
between teachers and
students (B5)
Quality of Service Abu-Al-Aish and Love (2013); Almaiah and Alismaiel Additional learning resources Shukla (2021); Swanson (2020)
(C) (2019); Almaiah and Al Mulhem (2019); Alshurideh et al. (C1)
(2019); Badwelan, Drew, and Bahaddad (2016); Privacy and safety (C2) Palalas and Wark (2020); Thomas and
Hassanzadeh, Kanaani, and Elahi (2012); Kim and Ong Hajiyev (2020)
(2005); Kim et al. (2012); Lee (2006); Liu et al (2010); Learning through cloud Okai-Ugbaje et al. (2020); Sekaran et al.
Milošević et al. (2015); Ng et al. (2010); Mohammadi computing technology* (2019)
(2015); Salloum et al. (2019) (C3)
Transferring messages Gonzalez, Gonzalez, and Huidobro (2019);
promptly* (C4) Nyembe and Howard (2019)
Higher teaching quality Zakariaa, Maatb, and Khalidc (2019)
(without the limitation of
space) (C5)
Numerous campus receivers+ Ichaba, Musau, and Mwendia (2020)
(C6)
Creating a pleasant campus Lin and Su (2020); Wu, Wu, and Su (2019)
experience (C7)
Improving traditional Ehsanpur and Razavi (2020)
learning methods (C8)
Access at all times (C9) Alshurideh et al. (2020); Cavus (2020)
Prompt usage of learning Nielit and Thanuskodi (2020); Okai-Ugbaje
resources (C10) et al. (2020)
Easy to use* (C11) Alam and Aljohani (2020); Malik et al.
(2020)
Operational stability* (C12) Seralidou, Douligeris, and Gralista (2019);
Wu, Wu, and Su (2019)
Personal Abu-Al-Aish and Love (2013); Badwelan, Drew, and Altering learning habits (D1) Wu, Wu, and Su (2019)
Innovativeness Bahaddad (2016); Joo, Lee, and Ham (2014); Karimi Promotion of self-efficacy* Buabeng-Andoh (2021); Senaratne,
(D) (2016); Li (2020); Liu et al. (2010); Milošević et al. (2015); (D2) Samarasinghe, and Jayewardenepura
Patil et al. (2020); Shorfuzzaman et al. (2019); Salloum (2019)
et al. (2019); Sidik and Syafar (2020) Having the courage to try Joseph et al. (2019); Wu, Wu, and Su (2019)
(D3)
Notes: 1. +: C6 was deleted after the pretest analysis; 2. *: A1, A6, C3, C4, C11, C12, and D2 were deleted after factor analysis.

3.2. FA
controversial. The interpretations of the results may
FA is a multivariate technique applied to address the be debatable since different interpretations may be
problem of interdependence between variables. Factor derived from the same factors. Therefore, naming or
loadings can be used to extract the main factors based renaming factors would require researchers to have
on the explained maximum variance for all variables. specialised knowledge (Navlani 2019). This study used
The main purpose/advantage of FA is to reduce the principal component analysis with varimax rotation
number of variables without losing the representative- for factor extraction in the first stage to confirm that
ness of the original data by identifying the hidden no correlations existed among the factors and to satisfy
dimensions that may/may not be directly apparent the requirement of independence among the elements
from the analyses. However, FA results may be of the hierarchical structure in the second-stage AHP
BEHAVIOUR & INFORMATION TECHNOLOGY 65

Figure 1. Research procedure and strategy.

analysis. Based on these results, we examined the claimed that the AHP enables group decision-making
reliability of the extracted dimensions based on the rel- via group consensus. Millet and Wedley (2002) indi-
evant criteria. cated that the AHP is beneficial in situations that are
uncertain or risky because it allows researchers or prac-
titioners to develop scales in cases in which ordinary
3.3. AHP
evaluations cannot be applied. Another advantage of
The AHP, which was first proposed by Saaty in 1971, is a using the AHP is that a large sample size is not required
systematic and hierarchical analysis tool that combines to achieve statistically robust results, and in several
qualitative and quantitative methods (Saaty 1980). cases, the results derived from even a single qualified
This approach can practically and effectively solve com- expert may be sufficiently representative since the
plex decision-making problems by dividing the complex AHP is based on judgments of field/specialised experts
decision-making situations into small components. (e.g. Darko et al. 2019; Tavares, Tavares, and Parry-
These small components are organised in a tree-like Jones 2008). The sample size used in many AHP studies
hierarchy, and expert opinions are collected to evaluate normally ranges from 4–9 (e.g. Pan, Dainty, and Gibb
the relative importance of each component (i.e. dimen- 2012; Akadiri, Olomolaiye, and Chinyio 2013; Chou,
sion/criterion) on a scale ranging from 1 to 9. Specifi- Pham, and Wang 2013), although a few studies have
cally, pairwise comparisons are performed between the been known to adopt a sample size larger than 30 (e.g.
evaluation factors; next, comparison matrixes are estab- Ali and Al Nsairat 2009; El-Sayegh 2009). In other
lished to reflect the decision makers’ subjective prefer- words, sample selection is more important than the
ences. The eigenvectors and eigenvalues are calculated, sample size for an AHP study. This common practice
and the eigenvectors determine the relative weights also justifies the appropriateness of the sample size of
between the criteria, representing the priority of each this study. One of the most criticised aspects of the
component (i.e. dimension/criterion) at each level, AHP, however, is that it does not consider the inter-
which can provide decision makers with sufficient relationship between the dimensions and criteria. In
decision information, help define the relevant criteria this study, the AHP was used as an analytical framework
and selected weights, and reduce the risk of decision for establishing an evaluation model to determine the
errors. order of importance of the critical factors derived
In summary, the AHP helps simplify complex pro- from iLearning platforms that may influence students’
blems into hierarchies, thereby facilitating the compari- iLearning at a university.
son of factors in a pairwise manner, and it represents a Consistency analysis is the main approach that has
useful tool for addressing the ambiguity and complexity been used to test the reliability of the experts’ judgments
in decision problems (Ramanathan 2001). Existing obtained in AHP studies (e.g. Saaty 1980; Saaty and Var-
studies have highlighted several advantages of the gas 2013). This approach has also been used to support
AHP. For example, Macharis and collaborators (2004) the fact that although the data collected are subjective
proposed that the AHP allows a decision problem to judgments, the AHP can reduce bias and ensure that
be decomposed into constitutive parts that allow the the judgments are reliable (Abudayyeh et al. 2007; Hsu,
development of hierarchies of the dimensions and cri- Wu, and Li 2008). In this research, based on the results
teria, thereby clarifying the level of importance pertain- of the AHP, we further adopted consistency analysis
ing to each dimension and criterion. Zahir (1999) with the threshold of consistency (value <1) suggested
66 H.-Y. WU ET AL.

by Saaty (1980) on the studied dimensions and the overall in fields related to iLearning. A total of 17 valid responses
research framework to test their reliability. were obtained from experts, including 5, 5, and 7 experts
from the industry, government, and academia, respect-
ively. Table 3 details the backgrounds of the responding
4. Data analysis and results experts. Approximately half of the experts had 10 or
4.1. Respondents’ demographics more years of relevant work experience.

The study adopted questionnaire surveys that were


administered in two stages. In the first stage, FA was 4.2. Critical factors extracted using FA
performed to analyze the data collected by convenience
During the first stage, the questionnaire (4 dimensions
sampling from university students with experience
and 26 criteria) was designed based on the related impor-
using iLearning. For both the pretest (50 valid responses
tant factors that may affect students’ iLearning with refer-
received) and actual study (355 valid responses
ence to the criteria shown in Table 1. The participants
received), the participants’ characteristics are summar-
were asked to make their evaluations through a 5-point
ised in Table 2.
Likert scale ranging from ‘strongly agree’ (5) to ‘strongly
In the second stage, the AHP was employed to deter-
disagree’ (1). After the pretest, one item (numerous cam-
mine the priorities of the dimensions and criteria based
pus receivers [C6]) was deleted. In the actual survey,
on expert consensus. Judgment sampling was used to
using principal component analysis (PCA) with iter-
solicit feedback from experts who had work experience
ations and varimax rotation, the factors (5 dimensions
and 18 criteria) were extracted after eliminating all cri-
Table 2. Profiles of the respondents in the first-stage surveys. teria with factor loadings less than 0.5. The five dimen-
Characteristic Category
Pilot Study
Frequency (%)
Actual Study
Frequency (%)
sions were renamed ‘performance expectancy’ (PE) (4
Gender Male 22 (44) 140 (39)
criteria), ‘quality of service’ (QS) (4 criteria), ‘personal
Female 28 (56) 215 (61) innovativeness’ (PI) (3 criteria), ‘convenience of use’
College Engineering 7 (14) 28 (8) (CU) (3 criteria), and ‘lecturers’ influence’ (LI) (4 cri-
Literature 9 (18) 54 (15)
Medicine 3 (6) 43 (12) teria), which accounted for 64.65% of the total variance.
Agriculture 2 (4) 35 (10) The data regarding the factor loadings of each criterion,
Business & 23 (46) 148 (42)
Management Cronbach’s α values and variance explained by the factors
Education 3 (6) 6 (2) (dimensions), are summarised in Table 4. The extracted
Law - 32 (9)
Science - 9 (2) critical factors (5 dimensions and 18 criteria) were used
Other 3 (6) - to construct a hierarchical structure (Figure 2).
Frequency of using Less than 1 h 25 (50) 155 (44)
iLearning on 1–5 h 15 (30) 161 (45)
campus per week 5–15 h 4 (8) 29 (8)
More than 15 h 6 (12) 10 (3) 4.3. Relative weights of the critical factors
Frequency of using Less than 1 h 25 (50) 98 (28) examined in the AHP
the Internet to 1–5 h 15 (30) 170 (48)
study per week 5–15 h 4 (8) 65 (18) In the second stage, as shown in Figure 2, the AHP was
More than 15 h 6 (12) 22 (6)
employed to prioritise the factors, i.e. the dimensions

Table 3. Profiles of the responding experts in the second-stage AHP survey.


Sector Position Institution Tenure (Relevant experience)
Industry (5 experts) Executive assistant High-technology company ⩽3y
Instructor Computer company 5–10 y
Engineer International company ⩽3y
Sales representative International company 5–10 y
Sales representative International company ⩽3y
Government (5 experts) President Department of Education (Secondment from elementary school) 10–15 y
Division chief Department of Education 10–15 y
Officer Department of Education 3–5 y
Officer Department of Education 10–15 y
Division chief Department of Education (Secondment from junior high school) 10–15 y
Academia (7 experts) Professor Public university 15–20 y
Assistant professor Public university 10–15 y
Professor Public university ⩾ 20 y
Assistant professor Public science and technology university 5–10 y
Assistant professor Private college ⩾ 20 y
Associate professor Private science and technology university 15–20 y
Assistant professor Private university 10–15 y
BEHAVIOUR & INFORMATION TECHNOLOGY 67

Table 4. Results of the extracted critical dimensions and criteria of iLearning.


Factor Corrected Item- Cronbach’s Variance Cumulative
Dimensions Criteria Loading Communality Total Correlation α (%) (%)
Performance Enhancing the learning .782 .748 .719 .823 38.183 38.183
expectancy (PE) performance (PE1)
Increasing the learning .713 .652 .626
participation (PE2)
Increasing the learning efficiency .707 .645 .634
(PE3)
Extending the learning effect (PE4) .694 .656 .611
Quality of service Creating a pleasant campus .731 .661 .633 .791 7.606 45.789
(QS) experience (QS1)
Improving traditional learning .643 .668 .558
methods (QS2)
Higher teaching quality (without .622 .567 .591
the limitation of space) (QS3)
Higher learning quality (QS4) .513 .653 .618
Personal Altering learning habits (PI1) .729 .693 .559 .700 7.103 52.892
innovativeness (PI) Having the courage to try (PI2) .691 .643 .571
Teachers’ encouragement (PI3) .642 .630 .432
Convenience of use Access at all times (CU1) .799 .712 .547 .659 6.174 59.066
(CU) Prompt usage of learning resources .654 .684 .510
(CU2)
Enabling mobile teaching (CU3) .573 .631 .364
Lecturers’ influence Privacy and safety (LI1) .733 .615 .460 .699 5.583 64.649
(LI) Fostering discussions between .641 .543 .485
teachers and students (LI2)
Additional learning resources (LI3) .547 .609 .512
Altering teaching methods (LI4) .502 .626 .483

and criteria. Pairwise comparisons among the factors students. First, through an extensive literature review,
were performed by experts with work experience and we synthesised four critical dimensions (e.g. perform-
knowledge regarding iLearning. The opinions (assess- ance expectancy, lecturers’ influence, quality of service,
ments) of the 17 experts were averaged to obtain expert and personal innovativeness) and 26 critical criteria.
consensus. The consistency ratio (C.R.) values of the 5 Subsequently, we extracted five critical dimensions
dimensions, i.e. PE, QS, PI, CU, and LI, were 0.000, (prompt usage of learning resources is a new dimension
0.076, 0.080, 0.091, and 0.059, respectively, which were extracted based on the FA result) with 18 critical criteria
less than 0.1 and thus satisfied the threshold of consist- by studying a group of students from universities in Tai-
ency suggested by Saaty (1980). The C.R. for the whole wan. We further prioritised these criteria by surveying a
hierarchy (0.062) was also less than 0.1. Therefore, the group of senior educators and practitioners in Taiwan.
experts’ opinions were considered consistent. In other Our results indicated that enhancing the learning per-
words, the AHP analysis results were reliable. Table 5 formance, increasing the learning participation, altering
presents the relative weights (importance) and rankings learning habits, ensuring access at all times, and
of the dimensions and criteria. The most critical enabling prompt usage of learning resources are the
dimension that affected students’ iLearning was PE criteria that university managers must emphasise to
(weight=0.349), followed by CU (0.185), PI (0.169), enhance the effectiveness of iLearning for students.
QS (0.168), and LI (0.130). Additionally, the top five In terms of the dimensions, our results indicated that
critical criteria were enhancing the learning performance PE is the most crucial dimension that may motivate stu-
(PE1) (0.140), increasing the learning participation (PE2) dents to adopt iLearning, which aligns with existing
(0.110), altering learning habits (PI1) (0.092), ensuring related findings (e.g. Chaka and Govender 2017; Low-
access at all times (CU1) (0.075), and enabling prompt enthal 2010; Wang, Wu, and Wang 2009). In other
usage of learning resources (CU2) (0.067). words, to successfully implement iLearning in a univer-
sity, it is crucial for the managers of the university to
place emphasis on helping students perceive that they
5. Discussion
can make progress in their learning performance through
This study was aimed at exploring the critical factors iLearning, which in turn may stimulate the students to be
associated with iLearning platforms that may impact more willing to learn by adopting iLearning. In addition,
students’ learning performance and identifying the cri- our results indicated that enhancing the learning per-
teria with a more notable impact to enable university formance and increasing learning participation are two
managers to enhance the effectiveness of iLearning for key factors that strengthen the students’ iLearning PE,
68 H.-Y. WU ET AL.

Figure 2. Hierarchical structure of the critical factors for iLearning.

which is in line with the findings of many existing studies Furthermore, this finding indicates that it may be
(e.g. Abu-Al-Aish and Love 2013; Chen 2011; Wang, Wu, necessary to focus on designing iLearning that can effec-
and Wang 2009). This finding implies that to effectively tively stimulate students to proactively participate
help students perceive that they can enhance their learn- during their learning journey to strengthen the cogni-
ing performance with iLearning, the design of iLearning tive connection between the use of iLearning and sub-
may need to be goal oriented. For example, a clear yet sequent learning performance. Empirical studies have
challenging learning goal may be needed to ensure that shown that when students are engaged in learning,
the extent to which the students’ learning performance they are more likely to perceive an improved learning
is enhanced can be measured by instructors/lecturers outcome (e.g. Blasco-Arcas et al. 2013; McLaughlin
and perceived by the students. et al. 2013). However, the learning participation and
BEHAVIOUR & INFORMATION TECHNOLOGY 69

Table 5. Results of the prioritised critical factors for iLearning.


Dimensions Weight Criteria Local Weight Global Weight
Performance expectancy (PE) C.R. = 0.00<0.1 0.349 (1) Enhancing the learning performance (PE1) 0.402 0.140 (1)
Increasing the learning participation (PE2) 0.316 0.110 (2)
Increasing the learning efficiency (PE3) 0.154 0.054 (6)
Extending the learning effect (PE4) 0.127 0.044 (10)
Quality of service (QS) C.R. = 0.076<0.1 0.168 (4) Creating a pleasant campus experience (QS1) 0.303 0.051 (7)
Improving traditional learning methods (QS2) 0.263 0.044 (11)
Higher teaching quality (without the limitation of space) (QS3) 0.259 0.044 (12)
Higher learning quality (QS4) 0.175 0.029 (15)
Personal innovativeness (PI) C.R. = 0.080<0.1 0.169 (3) Altering learning habits (PI1) 0.547 0.092 (3)
Having the courage to try (PI2) 0.298 0.050 (8)
Teachers’ encouragement (PI3) 0.155 0.026 (17)
Convenience of use (CU) C.R. = 0.091<0.1 0.185 (2) Access at all times (CU1) 0.405 0.075 (4)
Prompt usage of learning resources (CU2) 0.362 0.067 (5)
Enabling mobile teaching (CU3) 0.233 0.043 (13)
Lecturers’ influence (LI) C.R. = 0.059<0.1 0.130 (5) Privacy and safety (LI1) 0.349 0.045 (9)
Fostering discussions between teachers and students (LI2) 0.299 0.039 (14)
Additional learning resources (LI3) 0.206 0.027 (16)
Altering teaching methods (LI4) 0.146 0.019 (18)
Notes: 1. C.R.H. = 0.062 < 0.1; 2. (): Ranking of dimensions/criteria.

learning performance may not always be proportional. Other studies based on the iLearning platform infra-
Therefore, with respect to managerial implications, the structure have suggested investing in smart campuses
relevant units of iLearning management should not (e.g. Hirsch and Ng 2011), ensuring seamless connec-
only focus on the students’ learning performance but tivity, and supporting integrated learning across various
also consider whether the students’ involvement and devices (laptops, tablets and smartphones) for ubiqui-
inputs in learning can be enhanced through iLearning. tous learning (e.g. Atif, Mathew, and Lakas 2015).
Existing studies have indicated that if students find Additionally, our findings reflect the need for
that their inputs are polished or advanced, they are instructors/lecturers to upload learning resources in a
more likely to perceive better learning outcomes (e.g. timely manner and to ensure the fit and consistency
Chemosit 2012). Among the relevant factors, enhancing between teaching contents and learning resources to
the learning performance and increasing the learning ensure that students can use the learning resources
participation represent the most crucial factors that efficiently when needed. Supporting this point, existing
must be considered the main goals while implementing studies have highlighted the importance of the timely
iLearning in a university settings. provision of learning resources and usefulness of learn-
According to our results, CU is the second most ing from/with these resources, especially in a digital and
important dimension, which is in line with existing intelligent learning environment (e.g. Ma et al. 2010;
findings regarding the importance of the efficiency of Otieno 2010; Ross and Grinder 2002). Certain studies
using an information platform/system in a digital and also emphasised the need to ensure that iLearning plat-
intelligent learning context (e.g. Abu-Al-Aish and forms allow students to use learning resources from any
Love 2013; Badwelan, Drew, and Bahaddad 2016; Has- device (e.g. Atif, Mathew, and Lakas 2015; Hirsch and
sanzadeh, Kanaani, and Elahi 2012; Kim and Ong Ng 2011). Notably, ensuring access at all times and
2005; Kim et al. 2012; Lee 2006; Liu et al., 2010; Miloše- enabling prompt usage of learning resources should be
vić et al. 2015; Ng et al. 2010; Mohammadi 2015; Sal- considered the main goals to be fulfilled while perform-
loum et al. 2019). This finding implies that the ease of ing iLearning in a university setting, and these aspects
use of iLearning can enhance the students’ willingness represent two of the top five factors.
to use and continue to use iLearning. Our results also PI is ranked as one of the top three dimensions in this
indicate that ensuring access at all times and enabling study, echoing existing studies that highlight its impor-
the prompt use of learning resources are critical to tance in a digital and intelligent learning environment
increase the students’ efficiency in using iLearning plat- (Abu-Al-Aish and Love 2013; Agarwal and Prasad
forms. This finding reflects that it may be crucial for 1998; Badwelan, Drew, and Bahaddad 2016; Joo, Lee,
university managers to allow students to learn at their and Ham 2014; Fagan, Kilmon, and Pandey 2012; Liu
own pace. Different students have a different pace of et al., 2010; Milošević et al. 2015; Shorfuzzaman et al.
learning, and thus, students may be more likely to 2019; Salloum et al. 2019). This finding implies that to
learn effectively and successfully when learning at effectively implement iLearning, university managers
their own pace (Chou and Liu 2005; Vermunt 2005). may need to develop students’ interest in trying and
70 H.-Y. WU ET AL.

adopting iLearning. Our results further indicate that instructors/lecturers can successfully alter students’
altering the learning habits of students is crucial in learning habits, which is the third most important
assisting managers with this task. Recent studies have criterion.
suggested that iLearning must be designed to provide
opportunities for students to frequently interact with
6. Research Limitations and future
learning since an interactive design and application in
recommendations
a digital and intelligent learning environment is ben-
eficial in changing students’ behaviour in specific ways Although this study strived to be sufficiently rigorous,
(e.g. Ibrahim, Halim, and Ibrahim 2012). it involves certain limitations. The recommendations
In general, among the 18 criteria, the accumulated for future follow-up research are as follows. First,
importance weight (0.538) of the top six criteria, i.e. because iLearning is still under development despite
enhancing the learning performance, increasing the its increased global application and technological
learning participation, altering learning habits, ensuring advancement, more dimensions and criteria may be
access at all times, enabling prompt usage of learning explored or developed in research and practice in the
resources, and increasing the learning efficiency, accounts immediate future. Therefore, we suggest that future
for more than half of the overall importance weight. research should expand our framework by integrating
These results indicate that except for the criterion of more relevant dimensions and criteria into the frame-
altering learning habits, which ranks third, all five of work for assessment. Through this aspect, the research
the remaining criteria belong to the PE and CU dimen- results can be rendered more practical and applicable.
sions. This result is consistent with the finding of Milo- Second, future research may be aimed at having stu-
šević et al. (2015), who have showed that, especially for dent respondents prioritise the dimensions and criteria
higher-level education, iLearning should be an integral and compare the results with those obtained in this
mode way of learning that provides prompt access to study. It is likely that the viewpoints of senior educa-
learning resources to enhance the learning performance. tors and practitioners and those of students are not
In higher education institutions, investments regarding identical. Since the primary users of iLearning plat-
technologies and specialists in iLearning to enhance the forms are students, implementing iLearning in univer-
learning performance are a notable concern. The impor- sities may be more effective and efficient if the critical
tance of iLearning design in changing students’ learning factors were identified by incorporating the opinions of
habits and increasing learning participation should be students.
emphasised. The implication may be that university stu- Third, while prioritising the dimensions and criteria
dents are no longer satisfied with traditional ways of for iLearning, we did not consider the interrelationships
learning. between the dimensions and criteria in our framework.
Interestingly, the LI dimension has a relatively low A change in one factor may influence other factors. In
impact on students’ iLearning. This result may be this regard, we suggest that future research should
explained by the fact that most students are older than adopt the analytic network process (ANP) for prioritisa-
18 and have their own thoughts and opinions. The stu- tion. The ANP can more effectively address multicriteria
dents likely adopt iLearning because they perceive that decision-making issues, such as those investigated in
their learning performance is enhanced by iLearning this study, in which the dimensions and/or criteria
in addition to lectures. Notably, however, although may be interdependent (Liao et al. 2018). Fourth, the
this dimension is the least important compared to the generalizability of this study may be enhanced. In this
others and corresponds to the lowest ranking criterion, study, due to limited resources and time, we focused
altering teaching methods, in practical applications, the only on students and experts in Taiwan. Hence, future
teaching methods of instructors/lecturers still influence research may diversify the respondents by studying stu-
the students to a certain extent since students may not dents and experts from different countries to enhance
proactively adopt this mode of learning without the the generalizability of our results. Fifth, the dimensions
cooperation of instructors/lecturers. Therefore, instruc- and criteria used in this study may be consolidated by
tors/lecturers should be encouraged to adopt new teach- using other techniques to determine the significance
ing methods related to iLearning-related application among the dimensions and criteria, which may be
systems to facilitate the students’ use of iLearning. another avenue for future research before our study fra-
Implementing this aspect through the CU dimension, mework is retested. Finally, subsequent research may be
which ranks second and consists of both the fourth supplemented by case studies, interviews, and other
and fifth highest ranking criteria (i.e. access at all qualitative analyses to more clearly understand and
times and prompt usage of learning resources), implement iLearning on campus.
BEHAVIOUR & INFORMATION TECHNOLOGY 71

7. Conclusion Continuance Intention and Student Participate Adoption


of ILearning.” Procedia Computer Science 161: 242–249.
Technology has significantly changed our way of life, doi:10.1016/j.procs.2019.11.120.
including the way in which individuals gain knowledge. AjazMoharkan, Z., T. Choudhury, S. C. Gupta, and G. Raj.
In recent years, students at many universities have 2017, February. “Internet of Things and its Applications
ceased relying on conventional ways of learning. in E-Learning.” In 2017 3rd International Conference on
computational intelligence & Communication
Instead, students have increasingly adopted iLearning Technology (CICT) (pp. 1-5). IEEE. doi:10.1109/CIACT.
on campus. While the importance of iLearning has 2017.7977333.
been highlighted in research and practice, little is Akadiri, P. O., P. O. Olomolaiye, and E. A. Chinyio. 2013.
known regarding the influence of factors derived from “Multi-criteria Evaluation Model for the Selection of
iLearning on the students’ learning performance at a Sustainable Materials for Building Projects.” Automation
In Construction 30: 113–125. doi:10.1016/j.autcon.2012.
university and the factors that must be focused on by
10.004.
relevant management to enhance the effectiveness of Al-Emran, M., I. Arpaci, and S. A. Salloum. 2020. “An
iLearning for students. Considering these aspects, we Empirical Examination of Continuous Intention to use
initially proposed a framework encompassing four criti- m-Learning: An Integrated Model.” Education and
cal dimensions with 26 critical criteria based on an Information Technologies 25 (4): 2899–2918. doi:10.1007/
extensive literature review. Moreover, by conducting s10639-019-10094-2.
Alam, T., and M. Aljohani. 2020. “M-Learning: Positioning
questionnaire surveys in two stages, we advanced the the Academics to the Smart Devices in the Connected
framework and prioritised the critical dimensions and Future.” International Journal on Informatics
criteria for iLearning. The research results may provide Visualization 4 (2): 76–79. doi:10.30630/joiv.4.2.347.
university managers with valuable reference to not only Ali, H. H., and S. F. Al Nsairat. 2009. “Developing a Green
promote the use of iLearning on campus but also Building Assessment Tool for Developing Countries–Case
of Jordan.” Building and Environment 44 (5): 1053–1064.
enhance the effectiveness of iLearning for students.
doi:10.1016/j.buildenv.2008.07.015.
Almahri, F. A. J., D. Bell, and M. Merhi. 2020. “Understanding
Student Acceptance and Use of Chatbots in the United
Disclosure statement Kingdom Universities: A Structural Equation Modelling
No potential conflict of interest was reported by the author(s). Approach.” In 2020 6th International Conference on
Information Management (ICIM) (pp. 284-288). IEEE.
doi:10.1109/ICIM49319.2020.244712.
Almaiah, M. A., and A. Al Mulhem. 2019. “Analysis of the
References
Essential Factors Affecting of Intention to use of Mobile
Abbasy, M. B., and E. V. Quesada. 2017. “Predictable Learning Applications: A Comparison Between
Influence of IoT (Internet of Things) in the Higher Universities Adopters and non-Adopters.” Education and
Education.” International Journal of Information and Information Technologies 24 (2): 1433–1468. doi:10.1007/
Education Technology 7 (12): 914–920. s10639-018-9840-1.
Abu-Al-Aish, A., and S. Love. 2013. “Factors Influencing Almaiah, M. A., and O. A. Alismaiel. 2019. “Examination of
Students’ Acceptance of m-Learning: An Investigation in Factors Influencing the use of Mobile Learning System: An
Higher Education.” The International Review of Research Empirical Study.” Education and Information Technologies
in Open and Distance Learning 14 (5): 86–111. doi:10. 24 (1): 885–909. doi:10.1007/s10639-018-9810-7.
19173/irrodl.v14i5.1631. Alshurideh, M., B. Al Kurdi, S. A. Salloum, I. Arpaci, and M.
Abudayyeh, O., S. J. Zidan, S. Yehia, and D. Randolph. 2007. Al-Emran. 2020. “Predicting the Actual use of m-Learning
“Hybrid Prequalification-Based, Innovative Contracting Systems: a Comparative Approach Using PLS-SEM and
Model Using AHP.” Journal of Management in Machine Learning Algorithms.” Interactive Learning
Engineering 23 (2): 88–96. doi:10.1061/(ASCE)0742-597X Environments, 1–15. doi:10.1080/10494820.2020.1826982.
(2007)23:2(88). Alshurideh, M., S. A. Salloum, B. Al Kurdi, A. A. Monem, and
Agarwal, R., and E. Karahanna. 2000. “Time Flies When K. Shaalan. 2019. “Understanding the Quality Determinants
You’re Having fun: Cognitive Absorption and Beliefs That Influence the Intention to use the Mobile Learning
About Information Technology Usage.” MIS Quarterly, Platforms: A Practical Study.” International Journal of
665–694. doi:10.2307/3250951. Interactive Mobile Technologies 13 (11): 157–183.
Agarwal, R., and J. Prasad. 1998. “A Conceptual and Ameen, A., K. Alfalasi, N. A. Gazem, and O. Isaac. 2019,
Operational Definition of Personal Innovativeness in the December. “Impact of System Quality, Information
Domain of Information Technology.” Information Quality, and Service Quality on Actual Usage of Smart
Systems Research 9 (2): 204–215. doi:10.1287/isre.9.2.204. Government.” In 2019 first International Conference of
Aini, Q., I. Dhaniarti, and A. Khoirunisa. 2019. “Effects of intelligent Computing and Engineering (ICOICE) (pp. 1-
ILearning Media on Student Learning Motivation.” Aptisi 6). IEEE. doi:10.1109/ICOICE48418.2019.9035144.
Transactions on Managemen 3 (1): 1–12. Araya, R., C. Aguirre, M. Bahamondez, P. Calfucura, and P.
Aini, Q., U. Rahardja, and T. Hariguna. 2019. “The Jaure. 2016, September. “Social Facilitation due to Online
Antecedent of Perceived Value to Determine of Student Inter-Classrooms Tournaments.” In European Conference
72 H.-Y. WU ET AL.

on Technology Enhanced learning (pp. 16-29). Springer, Chou, S. W., and C. H. Liu. 2005. “Learning Effectiveness in a
Cham. doi:10.1007/978-3-319-45153-4_2. Web-Based Virtual Learning Environment: a Learner
Aremu, B. V. 2019. “Availability and Utilization of M- Control Perspective.” Journal of Computer Assisted
Learning Devices for Mathematics at the Universities in Learning 21 (1): 65–76. doi:10.1111/j.1365-2729.2005.
Southwest, Nigeria.” FUOYE Journal of Education 2 (2). 00114.x.
Atif, Y., S. S. Mathew, and A. Lakas. 2015. “Building a Smart Chou, J. S., A. D. Pham, and H. Wang. 2013. “Bidding Strategy
Campus to Support Ubiquitous Learning.” Journal of to Support Decision-Making by Integrating Fuzzy AHP
Ambient Intelligence and Humanized Computing 6 (2): and Regression-Based Simulation.” Automation in
223–238. doi:10.1007/s12652-014-0226-y. Construction 35: 517–527. doi:10.1016/j.autcon.2013.06.
Badwelan, A., S. Drew, and A. A. Bahaddad. 2016. “Towards 007.
Acceptance m-Learning Approach in Higher Education Corbeil, J. R., and M. E. Valdes-Corbeil. 2007. “Are you Ready
in Saudi Arabia.” International Journal of Business and for Mobile Learning?” Educause Quarterly 30 (2): 51.
Management 11 (8): 12–30. doi:10.5539/ijbm.v11n8p12. Crompton, H., D. Burke, and K. H. Gregory. 2017. “The use of
Bai, H. 2019. “Pedagogical Practices of Mobile Learning in K- Mobile Learning in PK-12 Education: A Systematic
12 and Higher Education Settings.” TechTrends 63 (5): Review.” Computers & Education 110: 51–63. doi:10.
611–620. doi:10.1007/s11528-019-00419-w. 1016/j.compedu.2017.03.013.
Bhagat, R., and S. Sambargi. 2019. “Evaluation of Personal Darko, A., A. P. C. Chan, E. E. Ameyaw, E. K. Owusu, E. Pärn,
Innovativeness and Perceived Expertise on Digital and D. J. Edwards. 2019. “Review of Application of Analytic
Marketing Adoption by Women Entrepreneurs of Micro Hierarchy Process (AHP) in Construction.” International
and Small Enterprises.” International Journal of Research Journal of Construction Management 19 (5): 436–452.
and Analytical Reviews 6 (1): 338–351. doi:10.1080/15623599.2018.1452098.
Bigne-Alcaniz, E., C. Ruiz-Mafé, J. Aldás-Manzano, and S. Darmaji, D., D. Kurniawan, A. Astalini, A. Lumbantoruan,
Sanz-Blas. 2008. “Influence of Online Shopping and S. Samosir. 2019. “Mobile learning in higher education
Information Dependency and Innovativeness on Internet for the industrial revolution 4.0: Perception and response of
Shopping Adoption.” Online Information Review 32 (5): physics practicum.” International Association of Online
648–667. doi:10.1108/14684520810914025. Engineering. Retrieved March 14, 2021 from https://www.
Blasco-Arcas, L., I. Buil, B. Hernández-Ortega, and F. J. Sese. learntechlib.org/p/216574/.
2013. “Using Clickers in Class. The Role of Interactivity, Do Nam Hung, J. T., S. F. Azam, and A. A. Khatibi. 2019. “An
Active Collaborative Learning and Engagement in Empirical Analysis of Perceived Transaction Convenience,
Learning Performance.” Computers & Education 62: 102– Performance Expectancy, Effort Expectancy and Behavior
110. doi:10.1016/j.compedu.2012.10.019. Intention to Mobile Payment of Cambodian Users.”
Buabeng-Andoh, C. 2021. “Exploring University Students’ International Journal of Marketing Studies 11 (4): 77–90.
Intention to use Mobile Learning: A Research Model doi:10.5539/ijms.v11n4p77.
Approach.” Education and Information Technologies 26 Ehsanpur, S., and M. R. Razavi. 2020. “A Comparative
(1): 241–256. doi:10.1007/s10639-020-10267-4. Analysis of Learning, Retention, Learning and Study
Cavus, N. 2020. “Evaluation of MobLrN m-Learning System: Strategies in the Traditional and M-Learning Systems.”
Participants’ Attitudes and Opinions.” World Journal on European Review of Applied Psychology 70 (6): 100605.
Educational Technology: Current Issues 12 (3): 150–164. doi:10.1016/j.erap.2020.100605.
Celesti, A., D. Mulfari, A. Galletta, M. Fazio, L. Carnevale, and El-Sayegh, S. M. 2009. “Multi-Criteria Decision Support
M. Villari. 2019. “A Study on Container Virtualization for Model for Selecting the Appropriate Construction
Guarantee Quality of Service in Cloud-of-Things.” Future Management at Risk Firm.” Construction Management
Generation Computer Systems 99: 356–364. doi:10.1016/j. and Economics 27 (4): 385–398.
future.2019.03.055. Fagan, M. H. 2019. “Factors Influencing Student Acceptance
Chaka, J. G., and I. Govender. 2017. “Students’ Perceptions of Mobile Learning in Higher Education.” Computers in
and Readiness Towards Mobile Learning in Colleges of the Schools 36 (2): 105–121. doi:10.1080/07380569.2019.
Education: A Nigerian Perspective.” South African 1603051.
Journal of Education 37 (1): 1–12. doi:10.15700/saje. Fagan, M., C. Kilmon, and V. Pandey. 2012. “Exploring the
v37n1a1282. Adoption of a Virtual Reality Simulation: The Role of
Chemosit, C. C. 2012. College Experiences and Student Inputs: Perceived Ease of use, Perceived Usefulness and
Factors That Promote the Development of Skills and Personal Innovativeness.” Campus-Wide Information
Attributes That Enhance Learning among College Systems 29 (2): 117–127. doi:10.1108/
Students. Ann Arbor: Illinois State University. 10650741211212368.
Chen, J. L. 2011. “The Effects of Education Compatibility and Fang, J., P. Shao, and G. Lan. 2009. “Effects of Innovativeness
Technological Expectancy on e-Learning Acceptance.” and Trust on web Survey Participation.” Computers in
Computers & Education 57 (2): 1501–1511. doi:10.1016/j. Human Behavior 25 (1): 144–152. doi:10.1016/j.chb.2008.
compedu.2011.02.009. 08.002.
Choi, Y., M. Choi, M. Oh, and S. Kim. 2020. “Service Robots Gonzalez, D. C. B., C. L. B. Gonzalez, and C. B. Huidobro.
in Hotels: Understanding the Service Quality Perceptions 2019. “Intelligent Learning Ecosystem in M-Learning
of Human-Robot Interaction.” Journal of Hospitality Systems.” In International Congress of telematics and com-
Marketing & Management 29 (6): 613–635. doi:10.1080/ puting (pp. 213-229). Springer, Cham. doi:10.1007/978-3-
19368623.2020.1703871. 030-33229-7_19.
BEHAVIOUR & INFORMATION TECHNOLOGY 73

Handoko, B. L. 2019. “Technology Acceptance Model in for Foreign Language Education.” Education Sciences 9
Higher Education Online Business.” Journal of (3): 179. doi:10.3390/educsci9030179.
Entrepreneurship Education 22 (5): 1–9. Karimi, S. 2016. “Do Learners’ Characteristics Matter? An
Hao, S., V. P. Dennen, and L. Mei. 2017. “Influential Factors Exploration of Mobile-Learning Adoption in Self-
for Mobile Learning Acceptance among Chinese Users.” Directed Learning.” Computers in Human Behavior 63:
Educational Technology Research and Development 65 (1): 769–776. doi:10.1016/j.chb.2016.06.014.
101–123. doi:10.1007/s11423-016-9465-2. Kim, G. M., and S. M. Ong. 2005. “An Exploratory Study of
Hassanzadeh, A., F. Kanaani, and S. Elahi. 2012. “A Model for Factors Influencing m-Learning Success.” Journal of
Measuring e-Learning Systems Success in Universities.” Computer Information Systems 46 (1): 92–97.
Expert Systems with Applications 39 (12): 10959–10966. Kim, K., S. Trimi, H. Park, and S. Rhee. 2012. “The Impact of
doi:10.1016/j.eswa.2012.03.028. CMS Quality on the Outcomes of e-Learning Systems in
Hirsch, B., and J. W. P. Ng. 2011. “Education Beyond the Higher Education: An Empirical Study.” Decision Sciences
Cloud: Anytime-Anywhere Learning in a Smart Campus Journal of Innovative Education 10 (4): 575–587. doi:10.
Environment.” International Conference for Internet 1111/j.1540-4609.2012.00360.x.
Technology and secured transactions, Abu Dhabi, United Kose, U., and O. Deperlioglu. 2012. Intelligent learning
Arab Emirates, 718-723. environments within blended learning for ensuring effec-
Hsu, P. F., C. R. Wu, and Z. R. Li. 2008. “Optimizing tive C programming course. arXiv preprint
Resource-Based Allocation for Senior Citizen Housing to arXiv:1205.2670. doi:10.5121/ijaia.2012.3109.
Ensure a Competitive Advantage Using the Analytic Kuan, H. H., G. W. Bock, and V. Vathanophas. 2008.
Hierarchy Process.” Building and Environment 43 (1): 90– “Comparing the Effects of Website Quality on Customer
97. doi:10.1016/j.buildenv.2006.11.028. Initial Purchase and Continued Purchase at e-Commerce
Hung, S. Y., and C. M. Chang. 2005. “User Acceptance of wap Websites.” Behaviour & Information Technology 27 (1):
Services: Test of Competing Theories.” Computer 3–16. doi:10.1080/01449290600801959.
Standards & Interfaces 28: 359–370. doi:10.1016/j.csi. Kumar, J. A., and B. Bervell. 2019. “Google Classroom for
2004.10.004. Mobile Learning in Higher Education: Modelling the
Ibrahim, N., S. A. Halim, and N. Ibrahim. 2012. “The Design Initial Perceptions of Students.” Education and
of Persuasive Learning Pills for m-Learning Application to Information Technologies 24 (2): 1793–1817. doi:10.1007/
Induce Enthusiastic Learning Habits among Learners.” In s10639-018-09858-z.
2012 4th International Congress on Engineering education Kumar, B. A., and S. S. Chand. 2019. “Mobile Learning
(pp. 1-5). IEEE. Adoption: A Systematic Review.” Education and
Ichaba, M., F. Musau, and S. Mwendia. 2020. “An Empirical Information Technologies 24 (1): 471–487. doi:10.1007/
Approach to Mobile Learning on Mobile Ad Hoc s10639-018-9783-6.
Networks (MANETs).” In 2020 IST-Africa Conference Lassar, W. M., C. Manolis, and S. S. Lassar. 2005. “The
(IST-Africa) (pp. 1-14). IEEE. Relationship Between Consumer Innovativeness, Personal
Iqbal, S., and I. A. Qureshi. 2012. “M-learning Adoption: Characteristics, and Online Banking Adoption.”
A Perspective from a Developing Country.” The International Journal of Bank Marketing 23 (2): 176–199.
International Review of Research in Open and Distributed doi:10.1108/02652320510584403.
Learning 13 (3): 147–164. doi:10.19173/irrodl.v13i3.1152. Latip, M. S. A., I. Noh, M. Tamrin, and S. N. N. A. Latip. 2020.
Irwin, C., L. Ball, B. Desbrow, and M. Leveritt. 2012. “Students’ “Students’ Acceptance for e-Learning and the Effects of
Perceptions of Using Facebook as an Interactive Learning Self-Efficacy in Malaysia.” International Journal of
Resource at University.” Australasian Journal of Educational Academic Research in Business and Social Sciences 10 (5):
Technology 28: 7. doi:10.14742/ajet.798. 658–674. doi:10.6007/IJARBSS/v10-i5/7239.
Izkair, A. S., M. M. Lakulu, and I. H. Mussa. 2020. “Intention Lee, Y. C. 2006. “An Empirical Investigation Into Factors
to Use Mobile Learning in Higher Education Institutions.” Influencing the Adoption of an e-Learning System.”
International Journal of Education, Science, Technology, Online Information Review 30 (5): 517–541. doi:10.1108/
and Engineering 3 (2): 78–84. 14684520610706406.
Johnson, L., Becker, S. A., Estrada, V., & Freeman, A. (2015). Lewis, W., R. Agarwal, and V. Sambamurthy. 2003. “Sources
NMC Horizon Report: 2015 Library Edition (pp. 1-54). of Influence on Beliefs About Information Technology
Austin, Texas: The New Media Consortium. use: an Empirical Study of Knowledge Workers.” MIS
Joo, Y. J., H. W. Lee, and Y. Ham. 2014. “Integrating User Quarterly 27: 657–678. doi:10.2307/30036552.
Interface and Personal Innovativeness Into the TAM for Li, X. 2020. “Students’ Acceptance of Mobile Learning: An
Mobile Learning in Cyber University.” Journal of Empirical Study Based on Blackboard Mobile Learn.” In
Computing in Higher Education 26 (2): 143–158. doi:10. Mobile Devices in Education: Breakthroughs in Research
1007/s12528-014-9081-2. and Practice, 354–373. IGI Global. doi:10.4018/978-1-
Joseph, A. F., O. S. Sunday, S. Jarkko, and T. Markku. 2019. 7998-1757-4.ch022.
“Smart Learning Environment for Computing Education: Lian, J., and T. Lin. 2008. “Effects of Consumer
Readiness for Implementation in Nigeria.” In EdMedia+ Characteristics on Their Acceptance of Online
Innovate Learning, edited by J. Theo Bastiaens, 1382– Shopping: Comparisons among Different Product
1391. Amsterdam: Association for the Advancement of Types.” Computers in Human Behavior 24 (1): 48–65.
Computing in Education (AACE). doi:10.1016/j.chb.2007.01.002.
Kacetl, J., and B. Klímová. 2019. “Use of Smartphone Liao, H., X. Mi, Z. Xu, J. Xu, and F. Herrera. 2018.
Applications in English Language Learning—A Challenge “Intuitionistic Fuzzy Analytic Network Process.” IEEE
74 H.-Y. WU ET AL.

Transactions on Fuzzy Systems 26 (5): 2578–2590. doi:10. Matute-Vallejo, J., and I. Melero-Polo. 2019. “Understanding
1109/TFUZZ.2017.2788881. Online Business Simulation Games: The Role of Flow
Lim, C. P., and M. Khine. 2006. “Managing Teachers’ Barriers Experience, Perceived Enjoyment and Personal
to ICT Integration in Singapore Schools.” Journal of Innovativeness.” Australasian Journal of Educational
Technology and Teacher Education 14 (1): 97–125. Technology 35 (3): 71–85. doi:10.14742/ajet.3862.
Lin, X., and S. Su. 2020. “Chinese College Students’ Attitude McGarr, O. 2009. “A Review of Podcasting in Higher
and Intention of Adopting Mobile Learning.” International Education: Its Influence on the Traditional Lecture.”
Journal of Education and Development Using Information Australasian Journal of Educational Technology 25 (3),
and Communication Technology 16 (2): 6–21. doi:10.14742/ajet.1136.
Liu, Y., S. Han, and H. Li. 2010. “Understanding the Factors McKinney, D., J. L. Dyck, and E. S. Luber. 2009. “iTunes
Driving m-Learning Adoption: A Literature Review.” University and the Classroom: Can Podcasts Replace
Campus-Wide Information Systems 27 (4): 210–226. Professors?” Computers & Education 52 (3): 617–623.
doi:10.1108/10650741011073761. doi:10.1016/j.compedu.2008.11.004.
Liu, Y., and H. Li. 2010. “Mobile Internet Diffusion in China: An McLaughlin, J. E., L. M. Griffin, D. A. Esserman, C. A.
Empirical Study.” Industrial Management & Data Systems Davidson, D. M. Glatt, M. T. Roth, N. Gharkholonarehe,
110 (3): 309–324. doi:10.1108/02635571011030006. and R. J. Mumper. 2013. “Pharmacy Student Engagement,
Liu, Y., H. Li, and C. Carlsson. 2010. “Factors Driving the Performance, and Perception in a Flipped Satellite
Adoption of m-Learning: An Empirical Study.” Classroom.” American Journal of Pharmaceutical
Computers & Education 55 (3): 1211–1219. doi:10.1016 /j. Education 77 (9): 196. doi:10.5688/ajpe779196.
compedu.2010.05.018. Miller, H. B., and J. A. Cuevas. 2017. “Mobile Learning and its
Lowenthal, J. 2010. “Using Mobile Learning: Determinates Effects on Academic Achievement and Student Motivation
Impacting Behavioral Intention.” The American Journal of in Middle Grades Students.” International Journal for the
Distance Education 24 (4): 195–206. doi:10.1080/ Scholarship of Technology Enhanced Learning 1 (2): 91–110.
08923647.2010.519947. Millet, I., and W. C. Wedley. 2002. “Modelling Risk and
Lowenthal, P. R. 2010. “The Evolution and Influence of Social Uncertainty with the Analytic Hierarchy Process.” Journal
Presence Theory on Online Learning.” In Social computing: of Multi−Criteria Decision Analysis 11: 97–107.
Concepts, Methodologies, Tools, and Applications, 113–128. Milošević, I., D. Živković, D. Manasijević, and D. Nikolić.
IGI Global. 2015. “The Effects of the Intended Behavior of Students
Lu, X., and D. Viehland. 2008. “Factors influencing the adop- in the use of M-Learning.” Computers in Human
tion of mobile learning.” ACIS 2008 proceedings, 56. Behavior 51: 207–215. doi:10.1016/j.chb.2015.04.041.
Lu, J., J. E. Yao, and C. S. Yu. 2005. “Personal Innovativeness, Mohammadi, H. 2015. “Investigating Users’ Perspectives on
Social Influences and Adoption of Wireless Internet e-Learning: An Integration of TAM and IS Success
Services via Mobile Technology.” Journal of Strategic Model.” Computers in Human Behavior 45: 359–374.
Information Systems 14 (3): 245–268. doi:10.1016/j.jsis. doi:10.1016/j.chb.2014.07.044.
2005.07.003. Muhamad, W., N. B. Kurniawan, S. Suhardi, and S. Yazid.
Ma, H., Z. Zheng, F. Ye, and S. Tong. 2010, November. “The 2017. “Smart Campus Features, Technologies, and
Applied Research of Cloud Computing in the Construction Applications: A Systematic Literature Review.” 2017
of Collaborative Learning Platform Under e-Learning International Conference on Information Technology
Environment.” In 2010 International Conference on Systems and Innovation (ICITSI), 384-391. doi:10.1109/
System science, Engineering design and manufacturing ICITSI.2017.8267975.
informatization Vol. 1, (pp. 190-192). IEEE. doi:10.1109/ Nassuora, A. B. 2012. “Students Acceptance of Mobile
ICSEM.2010.58. Learning for Higher Education in Saudi Arabia.”
Macharis, C., J. Springael, K. De Brucker, and A. Verbeke. 2004. American Academic & Scholarly Research Journal 4 (2):
“Promethee and AHP: The Design of Operational Synergies 24–30.
in Multicriteria Analysis. Strengthening Promethee with Navlani, A. 2019. Introduction to Factor Analysis in Python.
Ideas of AHP.” European Journal of Operational Research Accessed in March 2021 at https://www.google.com/url?
153: 307–317. doi:10.1016/S0377-2217(03)00153-X. sa=t&rct=j&q=&esrc=s&source=web&cd=&cad=rja&uact=
Major, L., B. Haßler, and S. Hennessy. 2017. “Tablet use in 8&ved=2ahUKEwigg8W_pJ_vAhXBoFwKHXiXAtcQFjAA
Schools: Impact, Affordances and Considerations.” In egQIAxAD&url=https%3A%2F%2Fwww.datacamp.com%
Handbook on Digital Learning for K-12 Schools, 115–128. 2Fcommunity%2Ftutorials%2Fintroduction-factor-analysis
Springer, Cham. doi:10.1007/978-3-319-33808-8_8. &usg=AOvVaw3BHduLbDErkH1EWARHRqyE.
Malik, S., M. Al-Emran, R. Mathew, R. Tawafak, and G. Ng, J. W., N. Azarmi, M. Leida, F. Saffre, A. Afzal, and P. D.
AlFarsi. 2020. “Comparison of E-Learning, M-Learning Yoo. 2010. “The Intelligent Campus (ICampus): End-to-
and Game-Based Learning in Programming Education–A end Learning Lifecycle of a Knowledge Ecosystem.” In
Gendered Analysis.” International Journal of Emerging 2010 sixth International Conference on intelligent environ-
Technologies in Learning 15 (15): 133–146. ments (pp. 332-337). IEEE. doi:10.1109/IE.2010.68.
Marquez, J., J. Villanueva, Z. Solarte, and A. Garcia. 2016. Nielit, S. G., and S. Thanuskodi. 2020. “E-discovery
“IoT in Education: Integration of Objects with Virtual Components of E-Teaching and M-Learning: An
Academic Communities.” In New Advances in Overview.” Mobile Devices in education: Breakthroughs
Information Systems and Technologies, 201–212. Springer, in research and practice, 928-936. doi:10.4018/978-1-
Cham. doi:10.1007/978-3-319-31232-3_19. 7998-1757-4.ch053.
BEHAVIOUR & INFORMATION TECHNOLOGY 75

Nik-Mohammadi, F., and Q. H. Barekat. 2015. “Evaluating the Learning Resources for the web.” In Software
Effect of Creating Smart Schools with Educational Visualization, edited by S. Diehl, 269–283. Berlin,
Performance of Teachers at Elementary Schools in Dezful Heidelberg: Springer.
City.” International Journal on New Trends in Education Rossing, J. P., W. M. Miller, A. K. Cecil, and S. E. Stamper.
and Literature 7 (1): 37–50. 2012. “iLearning: The Future of Higher Education?
Nyembe, B. Z. M., and G. R. Howard. 2019, August. “The Student Perceptions on Learning with Mobile Tablets.”
Utilities of Prominent Learning Theories for Mobile Journal of the Scholarship of Teaching and Learning 12
Collaborative Learning (MCL) with Reference to (2): 1–26.
WhatsApp and m-Learning.” In 2019 International Saaty, T. L. 1980. The Analytical Hierarchy Process. New York:
Conference on Advances in Big data, Computing and McGraw-Hill.
data Communication Systems (icABCD) (pp. 1-6). IEEE. Saaty, T. L., and L. G. Vargas. 2013. The Logic of Priorities:
doi:10.1109/ICABCD.2019.8851042. Applications of Business, Energy, Health and
Oh, S., X. Y. Lehto, and J. Park. 2009. “Travelers’ Intent to use Transportation. New York: Springer Science & Business
Mobile Technologies as a Function of Effort and Media.
Performance Expectancy.” Journal of Hospitality Sabah, N. M. 2016. “Exploring Students’ Awareness and
Marketing & Management 18 (8): 765–781. doi:10.1080/ Perceptions: Influencing Factors and Individual Differences
19368620903235795. Driving m-Learning Adoption.” Computers in Human
Okai-Ugbaje, S., K. Ardzejewska, A. Imran, A. Yakubu, and Behavior 65: 522–533. doi:10.1016/j.chb.2016.09.009.
M. Yakubu. 2020. “Cloud-Based M-Learning: A Salloum, S. A., M. Al-Emran, K. Shaalan, and A. Tarhini.
Pedagogical Tool to Manage Infrastructural Limitations 2019. “Factors Affecting the E-Learning Acceptance: A
and Enhance Learning.” International Journal of Case Study from UAE.” Education and Information
Education and Development Using Information and Technologies 24 (1): 509–530. doi:10.1007/s10639-018-
Communication Technology 16 (2): 48–67. 9786-3.
Otieno, K. O. 2010. “Teaching/Learning Resources and Sekaran, K., M. S. Khan, R. Patan, A. H. Gandomi, P. V.
Academic Performance in Mathematics in Secondary Krishna, and S. Kallam. 2019. “Improving the Response
Schools in Bondo District of Kenya.” Asian Social Science Time of m-Learning and Cloud Computing Environments
6 (12): 126. Using a Dominant Firefly Approach.” IEEE Access 7:
Palalas, A., and N. Wark. 2020. “The Relationship Between 30203–30212. doi:10.1109/ACCESS.2019.2896253.
Mobile Learning and Self-Regulated Learning: A Senaratne, S. I., S. M. Samarasinghe, and G. Jayewardenepura.
Systematic Review.” Australasian Journal of Educational 2019. “Factors Affecting the Intention to Adopt m-
Technology 36 (4): 151–172. doi:10.14742/ajet.5650. Learning.” International Business Research 12 (2): 150–
Pan, W., A. R. Dainty, and A. G. Gibb. 2012. “Establishing and 164. doi:10.5539/ibr.v12n2p150.
Weighting Decision Criteria for Building System Selection Seralidou, E., C. Douligeris, and C. Gralista. 2019. “EduApp: A
in Housing Construction.” Journal of Construction Collaborative Application for Mobile Devices to Support
Engineering and Management 138 (11): 1239–1250. the Educational Process in Greek Secondary Education.”
doi:10.1061/(ASCE)CO.1943-7862.0000543. In 2019 IEEE Global Engineering Education Conference
Patil, P., K. Tamilmani, N. P. Rana, and V. Raghavan. 2020. (EDUCON) (pp. 189-198). IEEE. doi:10.1109/EDUCON.
“Understanding Consumer Adoption of Mobile Payment 2019.8725175.
in India: Extending Meta-UTAUT Model with Personal Shorfuzzaman, M., M. S. Hossain, A. Nazir, G. Muhammad,
Innovativeness, Anxiety, Trust, and Grievance Redressal.” and A. Alamri. 2019. “Harnessing the Power of big Data
International Journal of Information Management 54: Analytics in the Cloud to Support Learning Analytics in
102144. doi:10.1016/j.ijinfomgt.2020.102144. Mobile Learning Environment.” Computers in Human
Purwanto, E., and J. Loisa. 2020. “The Intention and use Behavior 92: 578–588. doi:10.1016/j.chb.2018.07.002.
Behaviour of the Mobile Banking System in Indonesia: Shukla, S. 2021. “M-learning Adoption of Management
UTAUT Model.” Technology Reports of Kansai University Students’: A Case of India.” Education and Information
62 (06): 2757–2767. Technologies 26 (1): 279–310.
Rahman, M. M. 2020. “EFL Learners’ Perceptions About the Sidik, D., and F. Syafar. 2020. “Exploring the Factors
Use of Mobile Learning During COVID-19.” Journal of Influencing Student’s Intention to use Mobile Learning in
Southwest Jiaotong University 55 (5): 1–7. doi:10.35741/ Indonesia Higher Education.” Education and Information
issn.0258-2724.55.5.10. Technologies 25 (6): 4781–4796. doi:10.1007/s10639-020-
Rai, A., S. S. Lang, and R. B. Welker. 2002. “Assessing the 10271-8.
Validity of IS Success Models: An Empirical Test and Summers, J. J., A. Waigandt, and T. A. Whittaker. 2005. “A
Theoretical Analysis.” Information Systems Research 13 Comparison of Student Achievement and Satisfaction in
(1): 50–69. doi:10.1287/isre.13.1.50.96. an Online Versus a Traditional Face-to-Face Statistics
Ramanathan, R. 2001. “A Note on the use of the Analytic Class.” Innovative Higher Education 29 (3): 233–250.
Hierarchy Process for Environmental Impact doi:10.1007/s10755-005-1938-x.
Assessment.” Journal of Environmental Management 63: Sung, H., D. Jeong, Y. S. Jeong, and J. I. Shin. 2015. “The
27–35. doi:10.1006/jema.2001.0455. Relationship among Self-Efficacy, Social Influence,
Rogers, E. M. 2003. Diffusion of Innovations. New York: The Performance Expectancy, Effort Expectancy, and
Free Press. Behavioral Intention in Mobile Learning Service.”
Ross, R. J., and M. T. Grinder. 2002. “Hypertextbooks: International Journal of u-and e-Service, Science and
Animated, Active Learning, Comprehensive Teaching and Technology 8 (9): 197–206. doi:10.14257/ijunesst.2015.8.9.21.
76 H.-Y. WU ET AL.

Swanson, J. A. 2020. “Assessing the Effectiveness of the use of Vrana, R. 2018. “Acceptance of Mobile Technologies and m-
Mobile Technology in a Collegiate Course: A Case Study in Learning in Higher Education Learning: An Explorative
M-Learning.” Technology, Knowledge and Learning 25 (2): Study at the Faculty of Humanities and Social Science. at
389–408. doi:10.1007/s10758-018-9372-1. the University of Zagreb.” 2018 41st International conven-
Tavares, R. M., J. L. Tavares, and S. L. Parry-Jones. 2008. “The tion on Information and Communication Technology,
use of a Mathematical Multicriteria Decision-Making electronics and microelectronics (MIPRO), 738-743.
Model for Selecting the Fire Origin Room.” Building and doi:10.23919/MIPRO.2018.8400137.
Environment 43 (12): 2090–2100. doi:10.1016/j.buildenv. Wang, C. Y., S. C. T. Chou, and H. C. Chang. 2010. Exploring
2007.12.010. an Individual’s intention to use blogs: The roles of social,
Thomas, B. J., and J. Hajiyev. 2020. “The Direct and Indirect motivational and individual factors. In PACIS (p. 161).
Effects of Personality on Data Breach in Education Wang, H., D. Tao, N. Yu, and X. Qu. 2020. “Understanding
Through the Task-Related Compulsive Technology use: Consumer Acceptance of Healthcare Wearable Devices:
M-Learning Perspective.” International Journal of An Integrated Model of UTAUT and TTF.” International
Computing and Digital Systems 9 (03): 459–469. doi:10. Journal of Medical Informatics 139: 104156. doi:10.1016/j.
12785/ijcds/090310. ijmedinf.2020.104156.
Thongsri, N., L. Shen, and Y. Bao. 2019. “Investigating Factors Wang, Y., M. Wu, and H. Wang. 2009. “Investigating the
Affecting Learner’s Perception Toward Online Learning: Determinants and age and Gender Differences in the
Evidence from ClassStart Application in Thailand.” Acceptance of Mobile Learning.” British Journal of
Behaviour & Information Technology 38 (12): 1243–1258. Educational Technology 40 (1): 92–118. doi:10.1111/j.
doi:10.1080/0144929X.2019.1581259. 1467-8535.2007.00809.x.
Venkatesh, V., and F. D. Davis. 2000. “A Theoretical Wu, H. Y., H. S. Wu, and Y. P. Su. 2019, June. “Exploring the
Extension of the Technology Acceptance Model: Four Critical Factors Affecting College Students’ Intelligent
Longitudinal Field Studies.” Management Science 46 (2): Learning.” In EdMedia+ Innovate Learning, edited by J.
186–204. Theo Bastiaens, 806–817. Amsterdam, Netherlands:
Venkatesh, V., and M. G. Morris. 2000. “Why Don’t men Ever Association for the Advancement of Computing in
Stop to ask for Directions? Gender, Social Influences, and Education (AACE).
Their Role in Technology Acceptance and Usage Yarmatov, R., and M. Ahmedova. 2020. “The Formation of
Behavior.” MIS Quarterly 24 (1): 115–139. doi:10.2307/ Positive Motivation through Intellectual Games in
3250981. Teaching English in Continuous Education.” Архив
Venkatesh, V., M. G. Morris, and P. L. Ackerman. 2000. “A Научных Публикаций JSPI, 1-7.
Longitudinal Field Investigation of Gender Differences in Yi, M. Y., J. D. Jackson, J. S. Park, and J. C. Probst. 2006.
Individual Technology Adoption Decision Making “Understanding Information Technology Acceptance by
Processes.” Organizational Behavior and Human Decision Individual Professionals: Toward an Integrative View.”
Processes 83 (1): 33–60. doi:10.1006/obhd.2000.2896. Information & Management 43 (3): 350–363. doi:10.1016/
Venkatesh, V., M. G. Morris, G. B. Davis, and F. D. Davis. j.im.2005.08.006.
2003. “User Acceptance of Information Technology: Zahir, S. 1999. “Clusters in Group: Decision Making in the
Toward a Unified View.” MIS Quarterly 27 (3): 425–478. Vector Space Formulation of the Analytic Hierarchy
doi:10.2307/30036540. Process.” European Journal of Operational Research 112:
Vermunt, J. D. 2005. “Relations Between Student Learning 620–634. doi:10.1016/S0377-2217(98)00021-6.
Patterns and Personal and Contextual Factors and Zakariaa, M. I., S. M. Maatb, and F. Khalidc. 2019. “A
Academic Performance.” Higher Education 49 (3): 205– Systematic Review of M-Learning in Formal Education.”
234. doi:10.1007/s10734-004-6664-2. People 7 (11): 1–24.

You might also like