Professional Documents
Culture Documents
To cite this article: Hung-Yi Wu, Hung-Shu Wu, I.-Shuo Chen & Yu-Pei Su (2023) Toward
better intelligent learning (iLearning) performance: what makes iLearning work for
students in a university setting?, Behaviour & Information Technology, 42:1, 60-76, DOI:
10.1080/0144929X.2021.2014967
CONTACT I-Shuo Chen i-shuo.chen@aru.ac.uk School of Management, Anglia Ruskin University, Cambridge, UK
This article has been republished with minor changes. These changes do not impact the academic content of the article.
© 2022 The Author(s). Published by Informa UK Limited, trading as Taylor & Francis Group
This is an Open Access article distributed under the terms of the Creative Commons Attribution-NonCommercial-NoDerivatives License (http://creativecommons.org/licenses/by-nc-nd/4.0/),
which permits non-commercial re-use, distribution, and reproduction in any medium, provided the original work is properly cited, and is not altered, transformed, or built upon in any way.
BEHAVIOUR & INFORMATION TECHNOLOGY 61
performance and the relevant factors that must be con- collaborators (2003) introduced four dimensions that
sidered by university managers to enhance the effective- may influence individuals’ use of new technology: per-
ness of iLearning for students remain unclear. formance expectancy, effort expectancy, social influ-
Addressing these gaps in the literature is crucial for uni- ences, and facilitating conditions. These dimensions
versities to effectively improve the overall quality of have been tested in existing studies (e.g. Wang et al.
education and, in turn, their competitive advantages 2020; Wang, Wu, and Wang 2009), and several
in the long run. The reason is that the resources in researchers have demonstrated that the performance
any organisation may be limited; hence, it is important expectancy should be particularly emphasised com-
for universities to invest their limited resources in pared to effort expectancy (e.g. Oh, Lehto, and Park
addressing the factors that may have a greater impact 2009). Additionally, the use of new technology may be
on the students’ learning performance by adopting impacted by not only how effectively and efficiently
iLearning. individuals receive support but also the overall experi-
Considering these aspects, we aimed to explore the ence of service that the technology delivers (Choi et al.
critical factors associated with iLearning platforms 2020). Moreover, recent studies have highlighted that
that may influence the students’ learning performance individual differences such as personal innovativeness
and identify the factors with the most notable influence. may influence the effective use of new technology (e.g.
First, we extracted the factors pertaining to iLearning Patil et al. 2020). Considering these aspects, we adopted
platforms that have been found to influence the stu- performance expectancy, lecturers’ influence, quality of
dents’ learning performance based on an extensive lit- service, and personal innovativeness as the measure-
erature review. Using these factors, we conducted a ment dimensions in our research. Notably, due to the
student survey to identify the key factors for iLearning nature of our study, rather than focusing on social influ-
and prioritise these factors based on an expert survey ence in general, we particularly focused on the lecturers’
of other stakeholders (academic staff and practitioners influence since lecturers frequently interact with stu-
from different industries and the government) to ident- dents during the iLearning journey and are therefore
ify the factors that significantly influence the students’ more likely to influence students through teacher – stu-
learning performance. We contribute to the literature dent interactions.
in the following way: we present novel insights regard- ‘Performance expectancy’ concerns the degree to
ing iLearning by specifying the elements derived from which individuals believe that adopting an information
iLearning platforms that affect the students’ learning platform/system will facilitate them in functioning
performance, thereby also contributing to the literature effectively in a given environment or in achieving a
related to higher education by demonstrating an given outcome (Venkatesh et al. 2003). When individ-
efficient technique to increase the effectiveness of uals perceive that the use of a specific information plat-
iLearning for students. Specifically, although iLearning form/system will help them achieve the desired
has gained importance in recent years, few studies outcome, they may be more likely to use it (Do Nam
have attempted to explore the critical elements (e.g. Hung, Azam, and Khatibi 2019). Empirical studies
dimensions and criteria) that may influence students’ have supported this observation by demonstrating that
iLearning performance. We believe that by focusing enhancing the individuals’ performance expectancy
on enhancing the key elements, managers of higher edu- may significantly alter their attitude toward a given
cation institutions can effectively optimise the students’ information platform/system as well as their behav-
iLearning performance in an efficient and effective ioural intent (e.g. Lowenthal, 2010; Purwanto and
manner. Loisa 2020). Similar findings have been obtained in
learning-related studies. In an iLearning context, the
performance expectancy may be viewed as the students’
2. Key factors derived from ilearning
perception of whether the use of a specific learning plat-
platforms that influence iLearning for
form/system (e.g. an iLearning platform) will benefit
students
their learning performance. Wang, Wu, and Wang
Learning is a personal act, and learning performance (2009) and Chaka and Govender (2017) found that as
may be affected by the conditions of the learning part of learning in a digital and intelligent manner, per-
environment (Milošević et al. 2015). Technological formance expectancy was a strong determinant that
advancements alone may not ensure a student’s learning motivated students to adopt this mode of learning.
performance because specific strategies, tools, and Recent studies have indicated that intelligent and digital
resources are necessary to support different types of learning may enrich students’ learning performance by
learning (Milošević et al. 2015). Venkatesh and providing new learning experiences, increasing learning
62 H.-Y. WU ET AL.
participation (e.g. Chen 2011; Yarmatov & Ahmedova, real-time discussions between instructors and their stu-
2020), and facilitating collaborative learning (e.g. Hirsch dents via the platform (e.g. Abu-Al-Aish and Love 2013;
and Ng 2011; Abbasy and Quesada 2017) in an inte- Badwelan, Drew, and Bahaddad 2016; Chen 2011; Milo-
grated environment. Additionally, iLearning may help šević et al. 2015; Iqbal and Qureshi 2012; Sabah 2016;
students strengthen their learning efficiency, enhance Vrana 2018). Specifically, iLearning platforms allow a
their learning performance (e.g. Abu-Al-Aish and teacher to teach in real time, and the students have
Love 2013; Wang, Wu, and Wang 2009), and further opportunities to have face-to-face interactions and dis-
extend their learning effect across different domains cussions with the teacher (e.g. Kose and Deperlioglu
(e.g. Karimi 2016). Therefore, it is conceivable that 2012). Such frameworks also allow the teacher to
these elements may help enhance the students’ iLearn- teach students to use the platform to learn more
ing performance expectancy. promptly and effectively. Therefore, these elements
‘Lecturers’ influence’ originates from social influence may enhance the lecturers’ influence on the students’
(Abu-Al-Aish and Love 2013). Social influence concerns iLearning.
the degree to which individuals perceive others’ expec- The ‘quality of service’ in the information system and
tations regarding the use of an information platform/sys- human–computer interaction fields is not the same as
tem (Sung et al. 2015; Venkatesh et al. 2003). In other that in service industry management (Ameen et al.
words, if individuals strongly perceive that other indi- 2019; Kuan, Bock, and Vathanophas 2008). The former
viduals expect them to use a specific information plat- type concerns individuals’ assessment of the reliability
form/system, the individuals are more likely to be and response, content quality, and security of an infor-
motivated to use it (Alshurideh et al. 2020; Liu and Li mation platform/system, and the latter type refers to
2010; Lu and Viehland 2008; Nassuora 2012; Venkatesh the expectation and satisfaction of customers with
and Morris 2000). Existing studies have revealed that regard to the services being provided (Abu-Al-Aish
social influence, similar to performance expectancy, is and Love 2013; Celesti et al. 2019; Rai, Lang, and Welker
a key element that can significantly influence the indi- 2002; Venkatesh et al. 2003). Existing studies have
viduals’ behavioural intent to adopt new technology found that when a service is provided in a satisfactory
(e.g. Alshurideh et al. 2020; Venkatesh & Davis, 2000; manner, individuals are more likely to adopt new tech-
Venkatesh, Morris, and Ackerman 2000). The concept nology (Abu-Al-Aish and Love 2013); however, a low
of social influence has been widely extended to the edu- quality of service (e.g. inferior facilitating conditions)
cation and learning literature (e.g. Chen 2011; Fagan may impede the adoption of new technology (Lim and
2019; Iqbal and Qureshi 2012; Sabah 2016; Vrana 2018). Khine 2006). In a learning context, Lee showed that stu-
In a learning context, the ‘lecturers’ influence’ is dents’ perception of the quality of service of a digital
defined as the degree to which instructors/lecturers learning platform may significantly affect their willing-
encourage, support, and motivate students to adopt a ness to use the platform for learning. Similarly, Abu-
specific learning platform/system for learning (Abu-Al- Al-Aish and Love (2013) indicated that in a digital
Aish and Love 2013). Existing studies have reported learning environment, the quality of service plays a cru-
findings that support this aspect (e.g. Badwelan, Drew, cial role in predicting the students’ acceptance and
and Bahaddad 2016; Izkair, Lakulu, and Mussa 2020; adoption of the learning platform in the environment.
Milošević et al. 2015). For example, in their study To enhance the quality of service of iLearning plat-
based on a Chinese university, Hao, Dennen, and Mei forms, recent studies have suggested that instructors
(2017) discovered that the lecturers’ influence may should provide ample learning resources (Shukla 2021;
motivate the students in using a new learning platform Swanson 2020), enhance their teaching quality (Zakar-
for digital learning. Similarly, Nassuora (2012) indicated iaa, Maatb, and Khalidc 2019), promote a pleasant intel-
that lecturers’ positive word of mouth may enhance the ligent campus experience (Lin and Su 2020; Wu, Wu,
students’ willingness to learn through a digital learning and Su 2019), and improve traditional learning methods
platform. Other studies have claimed that to effectively for students (Ehsanpur and Razavi 2020). Moreover,
motivate and support students in adopting a digital researchers have suggested that learning platform provi-
learning platform (e.g. an iLearning platform), instruc- ders should not only ensure the students’ privacy and
tors/lecturers may alter their teaching methods from a safety but also assist them in using learning resources
traditionally physical method to a method that is both efficiently and in logging onto the platform at any
intelligent and digital, thereby providing students with time. Additionally, it has been noted that encouraging
a higher learning quality through the digital learning students to learn via cloud computing technology,
platform, enabling them to experience mobile learning increasing the efficiency with which messages are trans-
in which they can learn at any location, and increasing ferred between instructors/lecturers and students,
BEHAVIOUR & INFORMATION TECHNOLOGY 63
enhancing the operational stability of the learning plat- suggestions may be elements that can enhance the stu-
form, increasing the number of campus receivers, and dents’ personal innovativeness with regard to iLearning.
making the platform simple and easy to use are critical In conclusion, through a literature analysis sum-
to advance the quality of service of the learning platform marising the most referenced and commonly used fac-
(e.g. Abu-Al-Aish and Love 2013; Badwelan, Drew, and tors in the relevant studies, we propose four
Bahaddad 2016; Hassanzadeh, Kanaani, and Elahi 2012; dimensions with 26 criteria (i.e. elements that may
Kim and Ong 2005; Kim et al. 2012; Lee 2006; Liu, Han, help enhance the dimensions) for iLearning. Table 1
and Li 2010; Milošević et al. 2015; Ng et al. 2010; summarises the proposed dimensions and sources of
Mohammadi 2015; Salloum et al. 2019). These findings the proposed criteria.
may be viewed as elements that may enhance the quality
of service of iLearning for students.
‘Personal innovativeness’ concerns the degree to 3. Research methods
which individuals are willing to try and use a new infor-
3.1. Research procedure and strategy
mation platform/system (Agarwal and Prasad 1998;
Rogers 2003). Compared to their counterparts, individ- The research procedure of this study is presented in
uals with a high degree of personal innovativeness are Figure 1. We aimed to explore the critical factors that
more likely to adopt and deal with the uncertainty may affect students’ iLearning on campus at a university
associated with a new information platform/system and identify the factors that have a more notable influ-
(Abu-Al-Aish and Love 2013; Lu, Yao, and Yu 2005). ence by calculating the relative importance of the critical
Existing studies have reported supportive evidence dimensions and criteria (i.e. factors). To develop an
that indicates that personal innovativeness can motivate iLearning research framework, we used keywords such
an individual to use new technology (e.g. Agarwal and as mLearning, eLearning, iLearning, acceptance and
Prasad 1998; Agarwal and Karahanna 2000; Fang, use of new technology, and teaching and learning in a
Shao, and Lan 2009; Hung and Chang 2005; Lassar, high education context to seek the articles necessary
Manolis, and Lassar 2005; Lewis, Agarwal, and Samba- for an extensive literature review. The reviewed and
murthy 2003; Lu, Yao, and Yu 2005; Lian and Lin considered studies are summarised in Table 1. Based
2008; Matute-Vallejo and Melero-Polo 2019; Yi et al. on the extensive literature review, we developed an
2006). Although personal innovativeness has been iLearning research framework that encompasses four
widely investigated in different fields, such as online critical dimensions with 26 critical criteria. These
shopping and blogs (e.g. Bhagat and Sambargi 2019; dimensions and criteria were used to develop a ques-
Bigne-Alcaniz et al. 2008; Wang, Chou, and Chang tionnaire. The study was performed in two stages. In
2010), it is particularly crucial in a digital and intelligent the first stage, questionnaire surveys were distributed,
learning context (Abu-Al-Aish and Love 2013; Agarwal through convenience sampling, to respondents (i.e. stu-
and Prasad 1998; Badwelan, Drew, and Bahaddad 2016; dents who have used iLearning on campus at a univer-
Handoko 2019; Joo, Lee, and Ham 2014; Fagan, Kilmon, sity) physically by the researchers. The survey required
and Pandey 2012; Liu, Li, and Carlsson 2010; Milošević approximately one month to complete. Subsequently,
et al. 2015; Shorfuzzaman et al. 2019; Salloum et al. we performed factor analysis (FA) to extract the critical
2019). factors, which were employed to construct the hierarch-
For example, Fagan, Kilmon, and Pandey (2012) dis- ical evaluation structure of the second-stage question-
covered that students with a high level of personal inno- naire. In the second stage, the analytic hierarchy
vativeness are more willing to learn by adopting virtual process (AHP) was adopted to obtain a consensus
reality simulations. Abu-Al-Aish and Love (2013) and based on domain expert opinions. Using the judgment
Karimi (2016) indicated that personal innovativeness sampling method, the researchers consulted the experts
is crucial in any learning environment involving infor- personally across three different sectors (e.g. industry,
mation technology. To effectively support students’ per- government, and academia). Next, we analyzed the rela-
sonal innovativeness, existing studies have highlighted tive importance of and prioritised each critical dimen-
the importance of altering students’ learning habits sion and criterion. Based on the analysis results, we
and strengthening their courage to try and enhance formulated managerial and educational recommen-
their self-efficacy in learning with a new learning plat- dations, with this study’s findings serving as a valuable
form (e.g. Abu-Al-Aish and Love 2013; Badwelan, reference for university managers to enhance the effec-
Drew, and Bahaddad 2016; Joo, Lee, and Ham 2014; tiveness of iLearning for students. In the following sec-
Karimi 2016; Milošević et al. 2015; Shorfuzzaman tions, we briefly introduce the relevant data analysis
et al. 2019; Salloum et al. 2019). Notably, these methods (including FA and AHP) used in this study.
64 H.-Y. WU ET AL.
3.2. FA
controversial. The interpretations of the results may
FA is a multivariate technique applied to address the be debatable since different interpretations may be
problem of interdependence between variables. Factor derived from the same factors. Therefore, naming or
loadings can be used to extract the main factors based renaming factors would require researchers to have
on the explained maximum variance for all variables. specialised knowledge (Navlani 2019). This study used
The main purpose/advantage of FA is to reduce the principal component analysis with varimax rotation
number of variables without losing the representative- for factor extraction in the first stage to confirm that
ness of the original data by identifying the hidden no correlations existed among the factors and to satisfy
dimensions that may/may not be directly apparent the requirement of independence among the elements
from the analyses. However, FA results may be of the hierarchical structure in the second-stage AHP
BEHAVIOUR & INFORMATION TECHNOLOGY 65
analysis. Based on these results, we examined the claimed that the AHP enables group decision-making
reliability of the extracted dimensions based on the rel- via group consensus. Millet and Wedley (2002) indi-
evant criteria. cated that the AHP is beneficial in situations that are
uncertain or risky because it allows researchers or prac-
titioners to develop scales in cases in which ordinary
3.3. AHP
evaluations cannot be applied. Another advantage of
The AHP, which was first proposed by Saaty in 1971, is a using the AHP is that a large sample size is not required
systematic and hierarchical analysis tool that combines to achieve statistically robust results, and in several
qualitative and quantitative methods (Saaty 1980). cases, the results derived from even a single qualified
This approach can practically and effectively solve com- expert may be sufficiently representative since the
plex decision-making problems by dividing the complex AHP is based on judgments of field/specialised experts
decision-making situations into small components. (e.g. Darko et al. 2019; Tavares, Tavares, and Parry-
These small components are organised in a tree-like Jones 2008). The sample size used in many AHP studies
hierarchy, and expert opinions are collected to evaluate normally ranges from 4–9 (e.g. Pan, Dainty, and Gibb
the relative importance of each component (i.e. dimen- 2012; Akadiri, Olomolaiye, and Chinyio 2013; Chou,
sion/criterion) on a scale ranging from 1 to 9. Specifi- Pham, and Wang 2013), although a few studies have
cally, pairwise comparisons are performed between the been known to adopt a sample size larger than 30 (e.g.
evaluation factors; next, comparison matrixes are estab- Ali and Al Nsairat 2009; El-Sayegh 2009). In other
lished to reflect the decision makers’ subjective prefer- words, sample selection is more important than the
ences. The eigenvectors and eigenvalues are calculated, sample size for an AHP study. This common practice
and the eigenvectors determine the relative weights also justifies the appropriateness of the sample size of
between the criteria, representing the priority of each this study. One of the most criticised aspects of the
component (i.e. dimension/criterion) at each level, AHP, however, is that it does not consider the inter-
which can provide decision makers with sufficient relationship between the dimensions and criteria. In
decision information, help define the relevant criteria this study, the AHP was used as an analytical framework
and selected weights, and reduce the risk of decision for establishing an evaluation model to determine the
errors. order of importance of the critical factors derived
In summary, the AHP helps simplify complex pro- from iLearning platforms that may influence students’
blems into hierarchies, thereby facilitating the compari- iLearning at a university.
son of factors in a pairwise manner, and it represents a Consistency analysis is the main approach that has
useful tool for addressing the ambiguity and complexity been used to test the reliability of the experts’ judgments
in decision problems (Ramanathan 2001). Existing obtained in AHP studies (e.g. Saaty 1980; Saaty and Var-
studies have highlighted several advantages of the gas 2013). This approach has also been used to support
AHP. For example, Macharis and collaborators (2004) the fact that although the data collected are subjective
proposed that the AHP allows a decision problem to judgments, the AHP can reduce bias and ensure that
be decomposed into constitutive parts that allow the the judgments are reliable (Abudayyeh et al. 2007; Hsu,
development of hierarchies of the dimensions and cri- Wu, and Li 2008). In this research, based on the results
teria, thereby clarifying the level of importance pertain- of the AHP, we further adopted consistency analysis
ing to each dimension and criterion. Zahir (1999) with the threshold of consistency (value <1) suggested
66 H.-Y. WU ET AL.
by Saaty (1980) on the studied dimensions and the overall in fields related to iLearning. A total of 17 valid responses
research framework to test their reliability. were obtained from experts, including 5, 5, and 7 experts
from the industry, government, and academia, respect-
ively. Table 3 details the backgrounds of the responding
4. Data analysis and results experts. Approximately half of the experts had 10 or
4.1. Respondents’ demographics more years of relevant work experience.
and criteria. Pairwise comparisons among the factors students. First, through an extensive literature review,
were performed by experts with work experience and we synthesised four critical dimensions (e.g. perform-
knowledge regarding iLearning. The opinions (assess- ance expectancy, lecturers’ influence, quality of service,
ments) of the 17 experts were averaged to obtain expert and personal innovativeness) and 26 critical criteria.
consensus. The consistency ratio (C.R.) values of the 5 Subsequently, we extracted five critical dimensions
dimensions, i.e. PE, QS, PI, CU, and LI, were 0.000, (prompt usage of learning resources is a new dimension
0.076, 0.080, 0.091, and 0.059, respectively, which were extracted based on the FA result) with 18 critical criteria
less than 0.1 and thus satisfied the threshold of consist- by studying a group of students from universities in Tai-
ency suggested by Saaty (1980). The C.R. for the whole wan. We further prioritised these criteria by surveying a
hierarchy (0.062) was also less than 0.1. Therefore, the group of senior educators and practitioners in Taiwan.
experts’ opinions were considered consistent. In other Our results indicated that enhancing the learning per-
words, the AHP analysis results were reliable. Table 5 formance, increasing the learning participation, altering
presents the relative weights (importance) and rankings learning habits, ensuring access at all times, and
of the dimensions and criteria. The most critical enabling prompt usage of learning resources are the
dimension that affected students’ iLearning was PE criteria that university managers must emphasise to
(weight=0.349), followed by CU (0.185), PI (0.169), enhance the effectiveness of iLearning for students.
QS (0.168), and LI (0.130). Additionally, the top five In terms of the dimensions, our results indicated that
critical criteria were enhancing the learning performance PE is the most crucial dimension that may motivate stu-
(PE1) (0.140), increasing the learning participation (PE2) dents to adopt iLearning, which aligns with existing
(0.110), altering learning habits (PI1) (0.092), ensuring related findings (e.g. Chaka and Govender 2017; Low-
access at all times (CU1) (0.075), and enabling prompt enthal 2010; Wang, Wu, and Wang 2009). In other
usage of learning resources (CU2) (0.067). words, to successfully implement iLearning in a univer-
sity, it is crucial for the managers of the university to
place emphasis on helping students perceive that they
5. Discussion
can make progress in their learning performance through
This study was aimed at exploring the critical factors iLearning, which in turn may stimulate the students to be
associated with iLearning platforms that may impact more willing to learn by adopting iLearning. In addition,
students’ learning performance and identifying the cri- our results indicated that enhancing the learning per-
teria with a more notable impact to enable university formance and increasing learning participation are two
managers to enhance the effectiveness of iLearning for key factors that strengthen the students’ iLearning PE,
68 H.-Y. WU ET AL.
which is in line with the findings of many existing studies Furthermore, this finding indicates that it may be
(e.g. Abu-Al-Aish and Love 2013; Chen 2011; Wang, Wu, necessary to focus on designing iLearning that can effec-
and Wang 2009). This finding implies that to effectively tively stimulate students to proactively participate
help students perceive that they can enhance their learn- during their learning journey to strengthen the cogni-
ing performance with iLearning, the design of iLearning tive connection between the use of iLearning and sub-
may need to be goal oriented. For example, a clear yet sequent learning performance. Empirical studies have
challenging learning goal may be needed to ensure that shown that when students are engaged in learning,
the extent to which the students’ learning performance they are more likely to perceive an improved learning
is enhanced can be measured by instructors/lecturers outcome (e.g. Blasco-Arcas et al. 2013; McLaughlin
and perceived by the students. et al. 2013). However, the learning participation and
BEHAVIOUR & INFORMATION TECHNOLOGY 69
learning performance may not always be proportional. Other studies based on the iLearning platform infra-
Therefore, with respect to managerial implications, the structure have suggested investing in smart campuses
relevant units of iLearning management should not (e.g. Hirsch and Ng 2011), ensuring seamless connec-
only focus on the students’ learning performance but tivity, and supporting integrated learning across various
also consider whether the students’ involvement and devices (laptops, tablets and smartphones) for ubiqui-
inputs in learning can be enhanced through iLearning. tous learning (e.g. Atif, Mathew, and Lakas 2015).
Existing studies have indicated that if students find Additionally, our findings reflect the need for
that their inputs are polished or advanced, they are instructors/lecturers to upload learning resources in a
more likely to perceive better learning outcomes (e.g. timely manner and to ensure the fit and consistency
Chemosit 2012). Among the relevant factors, enhancing between teaching contents and learning resources to
the learning performance and increasing the learning ensure that students can use the learning resources
participation represent the most crucial factors that efficiently when needed. Supporting this point, existing
must be considered the main goals while implementing studies have highlighted the importance of the timely
iLearning in a university settings. provision of learning resources and usefulness of learn-
According to our results, CU is the second most ing from/with these resources, especially in a digital and
important dimension, which is in line with existing intelligent learning environment (e.g. Ma et al. 2010;
findings regarding the importance of the efficiency of Otieno 2010; Ross and Grinder 2002). Certain studies
using an information platform/system in a digital and also emphasised the need to ensure that iLearning plat-
intelligent learning context (e.g. Abu-Al-Aish and forms allow students to use learning resources from any
Love 2013; Badwelan, Drew, and Bahaddad 2016; Has- device (e.g. Atif, Mathew, and Lakas 2015; Hirsch and
sanzadeh, Kanaani, and Elahi 2012; Kim and Ong Ng 2011). Notably, ensuring access at all times and
2005; Kim et al. 2012; Lee 2006; Liu et al., 2010; Miloše- enabling prompt usage of learning resources should be
vić et al. 2015; Ng et al. 2010; Mohammadi 2015; Sal- considered the main goals to be fulfilled while perform-
loum et al. 2019). This finding implies that the ease of ing iLearning in a university setting, and these aspects
use of iLearning can enhance the students’ willingness represent two of the top five factors.
to use and continue to use iLearning. Our results also PI is ranked as one of the top three dimensions in this
indicate that ensuring access at all times and enabling study, echoing existing studies that highlight its impor-
the prompt use of learning resources are critical to tance in a digital and intelligent learning environment
increase the students’ efficiency in using iLearning plat- (Abu-Al-Aish and Love 2013; Agarwal and Prasad
forms. This finding reflects that it may be crucial for 1998; Badwelan, Drew, and Bahaddad 2016; Joo, Lee,
university managers to allow students to learn at their and Ham 2014; Fagan, Kilmon, and Pandey 2012; Liu
own pace. Different students have a different pace of et al., 2010; Milošević et al. 2015; Shorfuzzaman et al.
learning, and thus, students may be more likely to 2019; Salloum et al. 2019). This finding implies that to
learn effectively and successfully when learning at effectively implement iLearning, university managers
their own pace (Chou and Liu 2005; Vermunt 2005). may need to develop students’ interest in trying and
70 H.-Y. WU ET AL.
adopting iLearning. Our results further indicate that instructors/lecturers can successfully alter students’
altering the learning habits of students is crucial in learning habits, which is the third most important
assisting managers with this task. Recent studies have criterion.
suggested that iLearning must be designed to provide
opportunities for students to frequently interact with
6. Research Limitations and future
learning since an interactive design and application in
recommendations
a digital and intelligent learning environment is ben-
eficial in changing students’ behaviour in specific ways Although this study strived to be sufficiently rigorous,
(e.g. Ibrahim, Halim, and Ibrahim 2012). it involves certain limitations. The recommendations
In general, among the 18 criteria, the accumulated for future follow-up research are as follows. First,
importance weight (0.538) of the top six criteria, i.e. because iLearning is still under development despite
enhancing the learning performance, increasing the its increased global application and technological
learning participation, altering learning habits, ensuring advancement, more dimensions and criteria may be
access at all times, enabling prompt usage of learning explored or developed in research and practice in the
resources, and increasing the learning efficiency, accounts immediate future. Therefore, we suggest that future
for more than half of the overall importance weight. research should expand our framework by integrating
These results indicate that except for the criterion of more relevant dimensions and criteria into the frame-
altering learning habits, which ranks third, all five of work for assessment. Through this aspect, the research
the remaining criteria belong to the PE and CU dimen- results can be rendered more practical and applicable.
sions. This result is consistent with the finding of Milo- Second, future research may be aimed at having stu-
šević et al. (2015), who have showed that, especially for dent respondents prioritise the dimensions and criteria
higher-level education, iLearning should be an integral and compare the results with those obtained in this
mode way of learning that provides prompt access to study. It is likely that the viewpoints of senior educa-
learning resources to enhance the learning performance. tors and practitioners and those of students are not
In higher education institutions, investments regarding identical. Since the primary users of iLearning plat-
technologies and specialists in iLearning to enhance the forms are students, implementing iLearning in univer-
learning performance are a notable concern. The impor- sities may be more effective and efficient if the critical
tance of iLearning design in changing students’ learning factors were identified by incorporating the opinions of
habits and increasing learning participation should be students.
emphasised. The implication may be that university stu- Third, while prioritising the dimensions and criteria
dents are no longer satisfied with traditional ways of for iLearning, we did not consider the interrelationships
learning. between the dimensions and criteria in our framework.
Interestingly, the LI dimension has a relatively low A change in one factor may influence other factors. In
impact on students’ iLearning. This result may be this regard, we suggest that future research should
explained by the fact that most students are older than adopt the analytic network process (ANP) for prioritisa-
18 and have their own thoughts and opinions. The stu- tion. The ANP can more effectively address multicriteria
dents likely adopt iLearning because they perceive that decision-making issues, such as those investigated in
their learning performance is enhanced by iLearning this study, in which the dimensions and/or criteria
in addition to lectures. Notably, however, although may be interdependent (Liao et al. 2018). Fourth, the
this dimension is the least important compared to the generalizability of this study may be enhanced. In this
others and corresponds to the lowest ranking criterion, study, due to limited resources and time, we focused
altering teaching methods, in practical applications, the only on students and experts in Taiwan. Hence, future
teaching methods of instructors/lecturers still influence research may diversify the respondents by studying stu-
the students to a certain extent since students may not dents and experts from different countries to enhance
proactively adopt this mode of learning without the the generalizability of our results. Fifth, the dimensions
cooperation of instructors/lecturers. Therefore, instruc- and criteria used in this study may be consolidated by
tors/lecturers should be encouraged to adopt new teach- using other techniques to determine the significance
ing methods related to iLearning-related application among the dimensions and criteria, which may be
systems to facilitate the students’ use of iLearning. another avenue for future research before our study fra-
Implementing this aspect through the CU dimension, mework is retested. Finally, subsequent research may be
which ranks second and consists of both the fourth supplemented by case studies, interviews, and other
and fifth highest ranking criteria (i.e. access at all qualitative analyses to more clearly understand and
times and prompt usage of learning resources), implement iLearning on campus.
BEHAVIOUR & INFORMATION TECHNOLOGY 71
on Technology Enhanced learning (pp. 16-29). Springer, Chou, S. W., and C. H. Liu. 2005. “Learning Effectiveness in a
Cham. doi:10.1007/978-3-319-45153-4_2. Web-Based Virtual Learning Environment: a Learner
Aremu, B. V. 2019. “Availability and Utilization of M- Control Perspective.” Journal of Computer Assisted
Learning Devices for Mathematics at the Universities in Learning 21 (1): 65–76. doi:10.1111/j.1365-2729.2005.
Southwest, Nigeria.” FUOYE Journal of Education 2 (2). 00114.x.
Atif, Y., S. S. Mathew, and A. Lakas. 2015. “Building a Smart Chou, J. S., A. D. Pham, and H. Wang. 2013. “Bidding Strategy
Campus to Support Ubiquitous Learning.” Journal of to Support Decision-Making by Integrating Fuzzy AHP
Ambient Intelligence and Humanized Computing 6 (2): and Regression-Based Simulation.” Automation in
223–238. doi:10.1007/s12652-014-0226-y. Construction 35: 517–527. doi:10.1016/j.autcon.2013.06.
Badwelan, A., S. Drew, and A. A. Bahaddad. 2016. “Towards 007.
Acceptance m-Learning Approach in Higher Education Corbeil, J. R., and M. E. Valdes-Corbeil. 2007. “Are you Ready
in Saudi Arabia.” International Journal of Business and for Mobile Learning?” Educause Quarterly 30 (2): 51.
Management 11 (8): 12–30. doi:10.5539/ijbm.v11n8p12. Crompton, H., D. Burke, and K. H. Gregory. 2017. “The use of
Bai, H. 2019. “Pedagogical Practices of Mobile Learning in K- Mobile Learning in PK-12 Education: A Systematic
12 and Higher Education Settings.” TechTrends 63 (5): Review.” Computers & Education 110: 51–63. doi:10.
611–620. doi:10.1007/s11528-019-00419-w. 1016/j.compedu.2017.03.013.
Bhagat, R., and S. Sambargi. 2019. “Evaluation of Personal Darko, A., A. P. C. Chan, E. E. Ameyaw, E. K. Owusu, E. Pärn,
Innovativeness and Perceived Expertise on Digital and D. J. Edwards. 2019. “Review of Application of Analytic
Marketing Adoption by Women Entrepreneurs of Micro Hierarchy Process (AHP) in Construction.” International
and Small Enterprises.” International Journal of Research Journal of Construction Management 19 (5): 436–452.
and Analytical Reviews 6 (1): 338–351. doi:10.1080/15623599.2018.1452098.
Bigne-Alcaniz, E., C. Ruiz-Mafé, J. Aldás-Manzano, and S. Darmaji, D., D. Kurniawan, A. Astalini, A. Lumbantoruan,
Sanz-Blas. 2008. “Influence of Online Shopping and S. Samosir. 2019. “Mobile learning in higher education
Information Dependency and Innovativeness on Internet for the industrial revolution 4.0: Perception and response of
Shopping Adoption.” Online Information Review 32 (5): physics practicum.” International Association of Online
648–667. doi:10.1108/14684520810914025. Engineering. Retrieved March 14, 2021 from https://www.
Blasco-Arcas, L., I. Buil, B. Hernández-Ortega, and F. J. Sese. learntechlib.org/p/216574/.
2013. “Using Clickers in Class. The Role of Interactivity, Do Nam Hung, J. T., S. F. Azam, and A. A. Khatibi. 2019. “An
Active Collaborative Learning and Engagement in Empirical Analysis of Perceived Transaction Convenience,
Learning Performance.” Computers & Education 62: 102– Performance Expectancy, Effort Expectancy and Behavior
110. doi:10.1016/j.compedu.2012.10.019. Intention to Mobile Payment of Cambodian Users.”
Buabeng-Andoh, C. 2021. “Exploring University Students’ International Journal of Marketing Studies 11 (4): 77–90.
Intention to use Mobile Learning: A Research Model doi:10.5539/ijms.v11n4p77.
Approach.” Education and Information Technologies 26 Ehsanpur, S., and M. R. Razavi. 2020. “A Comparative
(1): 241–256. doi:10.1007/s10639-020-10267-4. Analysis of Learning, Retention, Learning and Study
Cavus, N. 2020. “Evaluation of MobLrN m-Learning System: Strategies in the Traditional and M-Learning Systems.”
Participants’ Attitudes and Opinions.” World Journal on European Review of Applied Psychology 70 (6): 100605.
Educational Technology: Current Issues 12 (3): 150–164. doi:10.1016/j.erap.2020.100605.
Celesti, A., D. Mulfari, A. Galletta, M. Fazio, L. Carnevale, and El-Sayegh, S. M. 2009. “Multi-Criteria Decision Support
M. Villari. 2019. “A Study on Container Virtualization for Model for Selecting the Appropriate Construction
Guarantee Quality of Service in Cloud-of-Things.” Future Management at Risk Firm.” Construction Management
Generation Computer Systems 99: 356–364. doi:10.1016/j. and Economics 27 (4): 385–398.
future.2019.03.055. Fagan, M. H. 2019. “Factors Influencing Student Acceptance
Chaka, J. G., and I. Govender. 2017. “Students’ Perceptions of Mobile Learning in Higher Education.” Computers in
and Readiness Towards Mobile Learning in Colleges of the Schools 36 (2): 105–121. doi:10.1080/07380569.2019.
Education: A Nigerian Perspective.” South African 1603051.
Journal of Education 37 (1): 1–12. doi:10.15700/saje. Fagan, M., C. Kilmon, and V. Pandey. 2012. “Exploring the
v37n1a1282. Adoption of a Virtual Reality Simulation: The Role of
Chemosit, C. C. 2012. College Experiences and Student Inputs: Perceived Ease of use, Perceived Usefulness and
Factors That Promote the Development of Skills and Personal Innovativeness.” Campus-Wide Information
Attributes That Enhance Learning among College Systems 29 (2): 117–127. doi:10.1108/
Students. Ann Arbor: Illinois State University. 10650741211212368.
Chen, J. L. 2011. “The Effects of Education Compatibility and Fang, J., P. Shao, and G. Lan. 2009. “Effects of Innovativeness
Technological Expectancy on e-Learning Acceptance.” and Trust on web Survey Participation.” Computers in
Computers & Education 57 (2): 1501–1511. doi:10.1016/j. Human Behavior 25 (1): 144–152. doi:10.1016/j.chb.2008.
compedu.2011.02.009. 08.002.
Choi, Y., M. Choi, M. Oh, and S. Kim. 2020. “Service Robots Gonzalez, D. C. B., C. L. B. Gonzalez, and C. B. Huidobro.
in Hotels: Understanding the Service Quality Perceptions 2019. “Intelligent Learning Ecosystem in M-Learning
of Human-Robot Interaction.” Journal of Hospitality Systems.” In International Congress of telematics and com-
Marketing & Management 29 (6): 613–635. doi:10.1080/ puting (pp. 213-229). Springer, Cham. doi:10.1007/978-3-
19368623.2020.1703871. 030-33229-7_19.
BEHAVIOUR & INFORMATION TECHNOLOGY 73
Handoko, B. L. 2019. “Technology Acceptance Model in for Foreign Language Education.” Education Sciences 9
Higher Education Online Business.” Journal of (3): 179. doi:10.3390/educsci9030179.
Entrepreneurship Education 22 (5): 1–9. Karimi, S. 2016. “Do Learners’ Characteristics Matter? An
Hao, S., V. P. Dennen, and L. Mei. 2017. “Influential Factors Exploration of Mobile-Learning Adoption in Self-
for Mobile Learning Acceptance among Chinese Users.” Directed Learning.” Computers in Human Behavior 63:
Educational Technology Research and Development 65 (1): 769–776. doi:10.1016/j.chb.2016.06.014.
101–123. doi:10.1007/s11423-016-9465-2. Kim, G. M., and S. M. Ong. 2005. “An Exploratory Study of
Hassanzadeh, A., F. Kanaani, and S. Elahi. 2012. “A Model for Factors Influencing m-Learning Success.” Journal of
Measuring e-Learning Systems Success in Universities.” Computer Information Systems 46 (1): 92–97.
Expert Systems with Applications 39 (12): 10959–10966. Kim, K., S. Trimi, H. Park, and S. Rhee. 2012. “The Impact of
doi:10.1016/j.eswa.2012.03.028. CMS Quality on the Outcomes of e-Learning Systems in
Hirsch, B., and J. W. P. Ng. 2011. “Education Beyond the Higher Education: An Empirical Study.” Decision Sciences
Cloud: Anytime-Anywhere Learning in a Smart Campus Journal of Innovative Education 10 (4): 575–587. doi:10.
Environment.” International Conference for Internet 1111/j.1540-4609.2012.00360.x.
Technology and secured transactions, Abu Dhabi, United Kose, U., and O. Deperlioglu. 2012. Intelligent learning
Arab Emirates, 718-723. environments within blended learning for ensuring effec-
Hsu, P. F., C. R. Wu, and Z. R. Li. 2008. “Optimizing tive C programming course. arXiv preprint
Resource-Based Allocation for Senior Citizen Housing to arXiv:1205.2670. doi:10.5121/ijaia.2012.3109.
Ensure a Competitive Advantage Using the Analytic Kuan, H. H., G. W. Bock, and V. Vathanophas. 2008.
Hierarchy Process.” Building and Environment 43 (1): 90– “Comparing the Effects of Website Quality on Customer
97. doi:10.1016/j.buildenv.2006.11.028. Initial Purchase and Continued Purchase at e-Commerce
Hung, S. Y., and C. M. Chang. 2005. “User Acceptance of wap Websites.” Behaviour & Information Technology 27 (1):
Services: Test of Competing Theories.” Computer 3–16. doi:10.1080/01449290600801959.
Standards & Interfaces 28: 359–370. doi:10.1016/j.csi. Kumar, J. A., and B. Bervell. 2019. “Google Classroom for
2004.10.004. Mobile Learning in Higher Education: Modelling the
Ibrahim, N., S. A. Halim, and N. Ibrahim. 2012. “The Design Initial Perceptions of Students.” Education and
of Persuasive Learning Pills for m-Learning Application to Information Technologies 24 (2): 1793–1817. doi:10.1007/
Induce Enthusiastic Learning Habits among Learners.” In s10639-018-09858-z.
2012 4th International Congress on Engineering education Kumar, B. A., and S. S. Chand. 2019. “Mobile Learning
(pp. 1-5). IEEE. Adoption: A Systematic Review.” Education and
Ichaba, M., F. Musau, and S. Mwendia. 2020. “An Empirical Information Technologies 24 (1): 471–487. doi:10.1007/
Approach to Mobile Learning on Mobile Ad Hoc s10639-018-9783-6.
Networks (MANETs).” In 2020 IST-Africa Conference Lassar, W. M., C. Manolis, and S. S. Lassar. 2005. “The
(IST-Africa) (pp. 1-14). IEEE. Relationship Between Consumer Innovativeness, Personal
Iqbal, S., and I. A. Qureshi. 2012. “M-learning Adoption: Characteristics, and Online Banking Adoption.”
A Perspective from a Developing Country.” The International Journal of Bank Marketing 23 (2): 176–199.
International Review of Research in Open and Distributed doi:10.1108/02652320510584403.
Learning 13 (3): 147–164. doi:10.19173/irrodl.v13i3.1152. Latip, M. S. A., I. Noh, M. Tamrin, and S. N. N. A. Latip. 2020.
Irwin, C., L. Ball, B. Desbrow, and M. Leveritt. 2012. “Students’ “Students’ Acceptance for e-Learning and the Effects of
Perceptions of Using Facebook as an Interactive Learning Self-Efficacy in Malaysia.” International Journal of
Resource at University.” Australasian Journal of Educational Academic Research in Business and Social Sciences 10 (5):
Technology 28: 7. doi:10.14742/ajet.798. 658–674. doi:10.6007/IJARBSS/v10-i5/7239.
Izkair, A. S., M. M. Lakulu, and I. H. Mussa. 2020. “Intention Lee, Y. C. 2006. “An Empirical Investigation Into Factors
to Use Mobile Learning in Higher Education Institutions.” Influencing the Adoption of an e-Learning System.”
International Journal of Education, Science, Technology, Online Information Review 30 (5): 517–541. doi:10.1108/
and Engineering 3 (2): 78–84. 14684520610706406.
Johnson, L., Becker, S. A., Estrada, V., & Freeman, A. (2015). Lewis, W., R. Agarwal, and V. Sambamurthy. 2003. “Sources
NMC Horizon Report: 2015 Library Edition (pp. 1-54). of Influence on Beliefs About Information Technology
Austin, Texas: The New Media Consortium. use: an Empirical Study of Knowledge Workers.” MIS
Joo, Y. J., H. W. Lee, and Y. Ham. 2014. “Integrating User Quarterly 27: 657–678. doi:10.2307/30036552.
Interface and Personal Innovativeness Into the TAM for Li, X. 2020. “Students’ Acceptance of Mobile Learning: An
Mobile Learning in Cyber University.” Journal of Empirical Study Based on Blackboard Mobile Learn.” In
Computing in Higher Education 26 (2): 143–158. doi:10. Mobile Devices in Education: Breakthroughs in Research
1007/s12528-014-9081-2. and Practice, 354–373. IGI Global. doi:10.4018/978-1-
Joseph, A. F., O. S. Sunday, S. Jarkko, and T. Markku. 2019. 7998-1757-4.ch022.
“Smart Learning Environment for Computing Education: Lian, J., and T. Lin. 2008. “Effects of Consumer
Readiness for Implementation in Nigeria.” In EdMedia+ Characteristics on Their Acceptance of Online
Innovate Learning, edited by J. Theo Bastiaens, 1382– Shopping: Comparisons among Different Product
1391. Amsterdam: Association for the Advancement of Types.” Computers in Human Behavior 24 (1): 48–65.
Computing in Education (AACE). doi:10.1016/j.chb.2007.01.002.
Kacetl, J., and B. Klímová. 2019. “Use of Smartphone Liao, H., X. Mi, Z. Xu, J. Xu, and F. Herrera. 2018.
Applications in English Language Learning—A Challenge “Intuitionistic Fuzzy Analytic Network Process.” IEEE
74 H.-Y. WU ET AL.
Transactions on Fuzzy Systems 26 (5): 2578–2590. doi:10. Matute-Vallejo, J., and I. Melero-Polo. 2019. “Understanding
1109/TFUZZ.2017.2788881. Online Business Simulation Games: The Role of Flow
Lim, C. P., and M. Khine. 2006. “Managing Teachers’ Barriers Experience, Perceived Enjoyment and Personal
to ICT Integration in Singapore Schools.” Journal of Innovativeness.” Australasian Journal of Educational
Technology and Teacher Education 14 (1): 97–125. Technology 35 (3): 71–85. doi:10.14742/ajet.3862.
Lin, X., and S. Su. 2020. “Chinese College Students’ Attitude McGarr, O. 2009. “A Review of Podcasting in Higher
and Intention of Adopting Mobile Learning.” International Education: Its Influence on the Traditional Lecture.”
Journal of Education and Development Using Information Australasian Journal of Educational Technology 25 (3),
and Communication Technology 16 (2): 6–21. doi:10.14742/ajet.1136.
Liu, Y., S. Han, and H. Li. 2010. “Understanding the Factors McKinney, D., J. L. Dyck, and E. S. Luber. 2009. “iTunes
Driving m-Learning Adoption: A Literature Review.” University and the Classroom: Can Podcasts Replace
Campus-Wide Information Systems 27 (4): 210–226. Professors?” Computers & Education 52 (3): 617–623.
doi:10.1108/10650741011073761. doi:10.1016/j.compedu.2008.11.004.
Liu, Y., and H. Li. 2010. “Mobile Internet Diffusion in China: An McLaughlin, J. E., L. M. Griffin, D. A. Esserman, C. A.
Empirical Study.” Industrial Management & Data Systems Davidson, D. M. Glatt, M. T. Roth, N. Gharkholonarehe,
110 (3): 309–324. doi:10.1108/02635571011030006. and R. J. Mumper. 2013. “Pharmacy Student Engagement,
Liu, Y., H. Li, and C. Carlsson. 2010. “Factors Driving the Performance, and Perception in a Flipped Satellite
Adoption of m-Learning: An Empirical Study.” Classroom.” American Journal of Pharmaceutical
Computers & Education 55 (3): 1211–1219. doi:10.1016 /j. Education 77 (9): 196. doi:10.5688/ajpe779196.
compedu.2010.05.018. Miller, H. B., and J. A. Cuevas. 2017. “Mobile Learning and its
Lowenthal, J. 2010. “Using Mobile Learning: Determinates Effects on Academic Achievement and Student Motivation
Impacting Behavioral Intention.” The American Journal of in Middle Grades Students.” International Journal for the
Distance Education 24 (4): 195–206. doi:10.1080/ Scholarship of Technology Enhanced Learning 1 (2): 91–110.
08923647.2010.519947. Millet, I., and W. C. Wedley. 2002. “Modelling Risk and
Lowenthal, P. R. 2010. “The Evolution and Influence of Social Uncertainty with the Analytic Hierarchy Process.” Journal
Presence Theory on Online Learning.” In Social computing: of Multi−Criteria Decision Analysis 11: 97–107.
Concepts, Methodologies, Tools, and Applications, 113–128. Milošević, I., D. Živković, D. Manasijević, and D. Nikolić.
IGI Global. 2015. “The Effects of the Intended Behavior of Students
Lu, X., and D. Viehland. 2008. “Factors influencing the adop- in the use of M-Learning.” Computers in Human
tion of mobile learning.” ACIS 2008 proceedings, 56. Behavior 51: 207–215. doi:10.1016/j.chb.2015.04.041.
Lu, J., J. E. Yao, and C. S. Yu. 2005. “Personal Innovativeness, Mohammadi, H. 2015. “Investigating Users’ Perspectives on
Social Influences and Adoption of Wireless Internet e-Learning: An Integration of TAM and IS Success
Services via Mobile Technology.” Journal of Strategic Model.” Computers in Human Behavior 45: 359–374.
Information Systems 14 (3): 245–268. doi:10.1016/j.jsis. doi:10.1016/j.chb.2014.07.044.
2005.07.003. Muhamad, W., N. B. Kurniawan, S. Suhardi, and S. Yazid.
Ma, H., Z. Zheng, F. Ye, and S. Tong. 2010, November. “The 2017. “Smart Campus Features, Technologies, and
Applied Research of Cloud Computing in the Construction Applications: A Systematic Literature Review.” 2017
of Collaborative Learning Platform Under e-Learning International Conference on Information Technology
Environment.” In 2010 International Conference on Systems and Innovation (ICITSI), 384-391. doi:10.1109/
System science, Engineering design and manufacturing ICITSI.2017.8267975.
informatization Vol. 1, (pp. 190-192). IEEE. doi:10.1109/ Nassuora, A. B. 2012. “Students Acceptance of Mobile
ICSEM.2010.58. Learning for Higher Education in Saudi Arabia.”
Macharis, C., J. Springael, K. De Brucker, and A. Verbeke. 2004. American Academic & Scholarly Research Journal 4 (2):
“Promethee and AHP: The Design of Operational Synergies 24–30.
in Multicriteria Analysis. Strengthening Promethee with Navlani, A. 2019. Introduction to Factor Analysis in Python.
Ideas of AHP.” European Journal of Operational Research Accessed in March 2021 at https://www.google.com/url?
153: 307–317. doi:10.1016/S0377-2217(03)00153-X. sa=t&rct=j&q=&esrc=s&source=web&cd=&cad=rja&uact=
Major, L., B. Haßler, and S. Hennessy. 2017. “Tablet use in 8&ved=2ahUKEwigg8W_pJ_vAhXBoFwKHXiXAtcQFjAA
Schools: Impact, Affordances and Considerations.” In egQIAxAD&url=https%3A%2F%2Fwww.datacamp.com%
Handbook on Digital Learning for K-12 Schools, 115–128. 2Fcommunity%2Ftutorials%2Fintroduction-factor-analysis
Springer, Cham. doi:10.1007/978-3-319-33808-8_8. &usg=AOvVaw3BHduLbDErkH1EWARHRqyE.
Malik, S., M. Al-Emran, R. Mathew, R. Tawafak, and G. Ng, J. W., N. Azarmi, M. Leida, F. Saffre, A. Afzal, and P. D.
AlFarsi. 2020. “Comparison of E-Learning, M-Learning Yoo. 2010. “The Intelligent Campus (ICampus): End-to-
and Game-Based Learning in Programming Education–A end Learning Lifecycle of a Knowledge Ecosystem.” In
Gendered Analysis.” International Journal of Emerging 2010 sixth International Conference on intelligent environ-
Technologies in Learning 15 (15): 133–146. ments (pp. 332-337). IEEE. doi:10.1109/IE.2010.68.
Marquez, J., J. Villanueva, Z. Solarte, and A. Garcia. 2016. Nielit, S. G., and S. Thanuskodi. 2020. “E-discovery
“IoT in Education: Integration of Objects with Virtual Components of E-Teaching and M-Learning: An
Academic Communities.” In New Advances in Overview.” Mobile Devices in education: Breakthroughs
Information Systems and Technologies, 201–212. Springer, in research and practice, 928-936. doi:10.4018/978-1-
Cham. doi:10.1007/978-3-319-31232-3_19. 7998-1757-4.ch053.
BEHAVIOUR & INFORMATION TECHNOLOGY 75
Nik-Mohammadi, F., and Q. H. Barekat. 2015. “Evaluating the Learning Resources for the web.” In Software
Effect of Creating Smart Schools with Educational Visualization, edited by S. Diehl, 269–283. Berlin,
Performance of Teachers at Elementary Schools in Dezful Heidelberg: Springer.
City.” International Journal on New Trends in Education Rossing, J. P., W. M. Miller, A. K. Cecil, and S. E. Stamper.
and Literature 7 (1): 37–50. 2012. “iLearning: The Future of Higher Education?
Nyembe, B. Z. M., and G. R. Howard. 2019, August. “The Student Perceptions on Learning with Mobile Tablets.”
Utilities of Prominent Learning Theories for Mobile Journal of the Scholarship of Teaching and Learning 12
Collaborative Learning (MCL) with Reference to (2): 1–26.
WhatsApp and m-Learning.” In 2019 International Saaty, T. L. 1980. The Analytical Hierarchy Process. New York:
Conference on Advances in Big data, Computing and McGraw-Hill.
data Communication Systems (icABCD) (pp. 1-6). IEEE. Saaty, T. L., and L. G. Vargas. 2013. The Logic of Priorities:
doi:10.1109/ICABCD.2019.8851042. Applications of Business, Energy, Health and
Oh, S., X. Y. Lehto, and J. Park. 2009. “Travelers’ Intent to use Transportation. New York: Springer Science & Business
Mobile Technologies as a Function of Effort and Media.
Performance Expectancy.” Journal of Hospitality Sabah, N. M. 2016. “Exploring Students’ Awareness and
Marketing & Management 18 (8): 765–781. doi:10.1080/ Perceptions: Influencing Factors and Individual Differences
19368620903235795. Driving m-Learning Adoption.” Computers in Human
Okai-Ugbaje, S., K. Ardzejewska, A. Imran, A. Yakubu, and Behavior 65: 522–533. doi:10.1016/j.chb.2016.09.009.
M. Yakubu. 2020. “Cloud-Based M-Learning: A Salloum, S. A., M. Al-Emran, K. Shaalan, and A. Tarhini.
Pedagogical Tool to Manage Infrastructural Limitations 2019. “Factors Affecting the E-Learning Acceptance: A
and Enhance Learning.” International Journal of Case Study from UAE.” Education and Information
Education and Development Using Information and Technologies 24 (1): 509–530. doi:10.1007/s10639-018-
Communication Technology 16 (2): 48–67. 9786-3.
Otieno, K. O. 2010. “Teaching/Learning Resources and Sekaran, K., M. S. Khan, R. Patan, A. H. Gandomi, P. V.
Academic Performance in Mathematics in Secondary Krishna, and S. Kallam. 2019. “Improving the Response
Schools in Bondo District of Kenya.” Asian Social Science Time of m-Learning and Cloud Computing Environments
6 (12): 126. Using a Dominant Firefly Approach.” IEEE Access 7:
Palalas, A., and N. Wark. 2020. “The Relationship Between 30203–30212. doi:10.1109/ACCESS.2019.2896253.
Mobile Learning and Self-Regulated Learning: A Senaratne, S. I., S. M. Samarasinghe, and G. Jayewardenepura.
Systematic Review.” Australasian Journal of Educational 2019. “Factors Affecting the Intention to Adopt m-
Technology 36 (4): 151–172. doi:10.14742/ajet.5650. Learning.” International Business Research 12 (2): 150–
Pan, W., A. R. Dainty, and A. G. Gibb. 2012. “Establishing and 164. doi:10.5539/ibr.v12n2p150.
Weighting Decision Criteria for Building System Selection Seralidou, E., C. Douligeris, and C. Gralista. 2019. “EduApp: A
in Housing Construction.” Journal of Construction Collaborative Application for Mobile Devices to Support
Engineering and Management 138 (11): 1239–1250. the Educational Process in Greek Secondary Education.”
doi:10.1061/(ASCE)CO.1943-7862.0000543. In 2019 IEEE Global Engineering Education Conference
Patil, P., K. Tamilmani, N. P. Rana, and V. Raghavan. 2020. (EDUCON) (pp. 189-198). IEEE. doi:10.1109/EDUCON.
“Understanding Consumer Adoption of Mobile Payment 2019.8725175.
in India: Extending Meta-UTAUT Model with Personal Shorfuzzaman, M., M. S. Hossain, A. Nazir, G. Muhammad,
Innovativeness, Anxiety, Trust, and Grievance Redressal.” and A. Alamri. 2019. “Harnessing the Power of big Data
International Journal of Information Management 54: Analytics in the Cloud to Support Learning Analytics in
102144. doi:10.1016/j.ijinfomgt.2020.102144. Mobile Learning Environment.” Computers in Human
Purwanto, E., and J. Loisa. 2020. “The Intention and use Behavior 92: 578–588. doi:10.1016/j.chb.2018.07.002.
Behaviour of the Mobile Banking System in Indonesia: Shukla, S. 2021. “M-learning Adoption of Management
UTAUT Model.” Technology Reports of Kansai University Students’: A Case of India.” Education and Information
62 (06): 2757–2767. Technologies 26 (1): 279–310.
Rahman, M. M. 2020. “EFL Learners’ Perceptions About the Sidik, D., and F. Syafar. 2020. “Exploring the Factors
Use of Mobile Learning During COVID-19.” Journal of Influencing Student’s Intention to use Mobile Learning in
Southwest Jiaotong University 55 (5): 1–7. doi:10.35741/ Indonesia Higher Education.” Education and Information
issn.0258-2724.55.5.10. Technologies 25 (6): 4781–4796. doi:10.1007/s10639-020-
Rai, A., S. S. Lang, and R. B. Welker. 2002. “Assessing the 10271-8.
Validity of IS Success Models: An Empirical Test and Summers, J. J., A. Waigandt, and T. A. Whittaker. 2005. “A
Theoretical Analysis.” Information Systems Research 13 Comparison of Student Achievement and Satisfaction in
(1): 50–69. doi:10.1287/isre.13.1.50.96. an Online Versus a Traditional Face-to-Face Statistics
Ramanathan, R. 2001. “A Note on the use of the Analytic Class.” Innovative Higher Education 29 (3): 233–250.
Hierarchy Process for Environmental Impact doi:10.1007/s10755-005-1938-x.
Assessment.” Journal of Environmental Management 63: Sung, H., D. Jeong, Y. S. Jeong, and J. I. Shin. 2015. “The
27–35. doi:10.1006/jema.2001.0455. Relationship among Self-Efficacy, Social Influence,
Rogers, E. M. 2003. Diffusion of Innovations. New York: The Performance Expectancy, Effort Expectancy, and
Free Press. Behavioral Intention in Mobile Learning Service.”
Ross, R. J., and M. T. Grinder. 2002. “Hypertextbooks: International Journal of u-and e-Service, Science and
Animated, Active Learning, Comprehensive Teaching and Technology 8 (9): 197–206. doi:10.14257/ijunesst.2015.8.9.21.
76 H.-Y. WU ET AL.
Swanson, J. A. 2020. “Assessing the Effectiveness of the use of Vrana, R. 2018. “Acceptance of Mobile Technologies and m-
Mobile Technology in a Collegiate Course: A Case Study in Learning in Higher Education Learning: An Explorative
M-Learning.” Technology, Knowledge and Learning 25 (2): Study at the Faculty of Humanities and Social Science. at
389–408. doi:10.1007/s10758-018-9372-1. the University of Zagreb.” 2018 41st International conven-
Tavares, R. M., J. L. Tavares, and S. L. Parry-Jones. 2008. “The tion on Information and Communication Technology,
use of a Mathematical Multicriteria Decision-Making electronics and microelectronics (MIPRO), 738-743.
Model for Selecting the Fire Origin Room.” Building and doi:10.23919/MIPRO.2018.8400137.
Environment 43 (12): 2090–2100. doi:10.1016/j.buildenv. Wang, C. Y., S. C. T. Chou, and H. C. Chang. 2010. Exploring
2007.12.010. an Individual’s intention to use blogs: The roles of social,
Thomas, B. J., and J. Hajiyev. 2020. “The Direct and Indirect motivational and individual factors. In PACIS (p. 161).
Effects of Personality on Data Breach in Education Wang, H., D. Tao, N. Yu, and X. Qu. 2020. “Understanding
Through the Task-Related Compulsive Technology use: Consumer Acceptance of Healthcare Wearable Devices:
M-Learning Perspective.” International Journal of An Integrated Model of UTAUT and TTF.” International
Computing and Digital Systems 9 (03): 459–469. doi:10. Journal of Medical Informatics 139: 104156. doi:10.1016/j.
12785/ijcds/090310. ijmedinf.2020.104156.
Thongsri, N., L. Shen, and Y. Bao. 2019. “Investigating Factors Wang, Y., M. Wu, and H. Wang. 2009. “Investigating the
Affecting Learner’s Perception Toward Online Learning: Determinants and age and Gender Differences in the
Evidence from ClassStart Application in Thailand.” Acceptance of Mobile Learning.” British Journal of
Behaviour & Information Technology 38 (12): 1243–1258. Educational Technology 40 (1): 92–118. doi:10.1111/j.
doi:10.1080/0144929X.2019.1581259. 1467-8535.2007.00809.x.
Venkatesh, V., and F. D. Davis. 2000. “A Theoretical Wu, H. Y., H. S. Wu, and Y. P. Su. 2019, June. “Exploring the
Extension of the Technology Acceptance Model: Four Critical Factors Affecting College Students’ Intelligent
Longitudinal Field Studies.” Management Science 46 (2): Learning.” In EdMedia+ Innovate Learning, edited by J.
186–204. Theo Bastiaens, 806–817. Amsterdam, Netherlands:
Venkatesh, V., and M. G. Morris. 2000. “Why Don’t men Ever Association for the Advancement of Computing in
Stop to ask for Directions? Gender, Social Influences, and Education (AACE).
Their Role in Technology Acceptance and Usage Yarmatov, R., and M. Ahmedova. 2020. “The Formation of
Behavior.” MIS Quarterly 24 (1): 115–139. doi:10.2307/ Positive Motivation through Intellectual Games in
3250981. Teaching English in Continuous Education.” Архив
Venkatesh, V., M. G. Morris, and P. L. Ackerman. 2000. “A Научных Публикаций JSPI, 1-7.
Longitudinal Field Investigation of Gender Differences in Yi, M. Y., J. D. Jackson, J. S. Park, and J. C. Probst. 2006.
Individual Technology Adoption Decision Making “Understanding Information Technology Acceptance by
Processes.” Organizational Behavior and Human Decision Individual Professionals: Toward an Integrative View.”
Processes 83 (1): 33–60. doi:10.1006/obhd.2000.2896. Information & Management 43 (3): 350–363. doi:10.1016/
Venkatesh, V., M. G. Morris, G. B. Davis, and F. D. Davis. j.im.2005.08.006.
2003. “User Acceptance of Information Technology: Zahir, S. 1999. “Clusters in Group: Decision Making in the
Toward a Unified View.” MIS Quarterly 27 (3): 425–478. Vector Space Formulation of the Analytic Hierarchy
doi:10.2307/30036540. Process.” European Journal of Operational Research 112:
Vermunt, J. D. 2005. “Relations Between Student Learning 620–634. doi:10.1016/S0377-2217(98)00021-6.
Patterns and Personal and Contextual Factors and Zakariaa, M. I., S. M. Maatb, and F. Khalidc. 2019. “A
Academic Performance.” Higher Education 49 (3): 205– Systematic Review of M-Learning in Formal Education.”
234. doi:10.1007/s10734-004-6664-2. People 7 (11): 1–24.