Analysis Using the Technology Acceptance Model
(TAM) and DeLone & McLean Information System
(D&M IS) Success Model of AIS Mobile User
Acceptance
1st Nur Aeni Hidayah 2nd Nida’ul Hasanati 3rd Ranti Novela Putri
Faculty of Science and Technology Faculty of Science and Technology Faculty of Science and Technology
UIN Syarif Hidayatullah Jakarta UIN Syarif Hidayatullah Jakarta UIN Syarif Hidayatullah Jakarta
Jakarta, Indonesia Jakarta, Indonesia Jakarta, Indonesia
[Link]@[Link] [Link]@[Link] ranti.novela15@[Link]
4th Kamal Fiqry Musa 5th Zahrotun Nihayah 6th Abdul Muin
Faculty of Sharia and Law Faculty of Psychology Faculty of Tarbiyah and Teacher Training
UIN Syarif Hidayatullah Jakarta UIN Syarif Hidayatullah Jakarta UIN Syarif Hidayatullah Jakarta
Jakarta, Indonesia Jakarta, Indonesia Jakarta, Indonesia
kamalfiqry@[Link] [Link]@[Link] [Link]@[Link]
Abstract—Universitas Islam Negeri (UIN) Syarif processes and operations, supporting decision making by
Hidayatullah has now launched an android -based application employees and managers, and supporting strategies for
for Academic Information System (AIS). This application is competitive advantage (O'Brien & Marakas, 2007). This is
intended to facilitate students in accessing AIS via mobile. supported by the statement of Suzanto & Sidharta which states
However, there are still many weaknesses of the application felt that the use of information systems and information
by the user such as errors when logging in or filling the study technology in presenting information needs that are fast,
plan card (KRS), as well as values that often do not appear in reliable, and accurate is needed (Suzanto & Sidharta, 2015).
the application, so research on user acceptance of this
application is needed. The purpose of this study is to find out the Likewise with universities, in order to provide services to
status of user acceptance of the Mobile AIS application. This is students, the role of academic information systems also
done because user acceptance is one of the important factors becomes very important in improving academic quality and
influencing the successful implementation of the application. academic service systems (Suzanto & Sidharta, 2015). UIN
This research uses quantitative methods and uses the Syarif Hidayatullah is one of the colleges that use information
Technology Acceptance Model (TAM) model which is combined technology.
with the DeLone & McLean Information System (D&M IS)
Success Model. The population of this research is UIN student One of the uses of this technology is the existence of the
Syarif Hidayatullah who is a user of the AIS Mobile application. AIS UIN Syarif Hidayatullah. AIS UIN Syarif Hidayatullah is
Sampling is done by purposive sampling. There were 237 an integrated information system that includes lecture
respondents from that population who were used as samples for activities. The development of AIS UIN Syarif Hidayatullah
this study. Data processing using the Partial Least Square- is with an android-based application with the application name
Structural Equation Modelling (PLS-SEM) method with the "Mobile AIS for Student". This application is developed by
help of SmartPLS application version 3.0. The results of this PUSTIPANDA UIN Syarif Hidayatullah. This application
study are information quality, system quality, service quality, makes it easy for students to access AIS UIN Syarif
perceived usefulness, and perceived ease of use affect the Hidayatullah through their smartphone.
acceptance of application users. Of the 8 hypotheses proposed,
there is one hypothesis that is rejected, namely the relationship Based on the results of observations made, was found to
of service quality with perceived ease of use because it gets a t- some errors contained in this Mobile AIS application that
test value of 1,844. This research produces recommendations to make users uncomfortable. Examples of errors contained in
the department information technology and database center this application are the information contained in the
(PUSTIPANDA) as the developer to focus more on the services application is still not integrated with the information
provided to application users to make it easier for users to use available on the AIS website. Many users have complained
the application. about this asynchronization such as the value of courses that
already exist on the AIS website does not appear on this
Keywords—User Acceptance, AIS Mobile Application,
Mobile AIS, filling KRS that is still incomplete, language
Technology Acceptance Model (TAM), D&M IS Success Model,
scores that do not appear on some accounts, and other errors.
PLS-SEM, SmartPLS
Therefore the evaluation of this application is needed in
I. INTRODUCTION terms of user acceptance in order to know the factors that
The development of technology at this time has been influence user acceptance and then serve as a basis for making
increasingly rapid and sophisticated. The development of this decisions for application developers later yes it is
technology also increasingly plays an important role in PUSTIPANDA. Based on the above matters, the researcher is
various fields. interested in conducting a study entitled "Analysis Using The
Technology Acceptance Model (TAM) and DeLone &
Information Systems or Information Technology has an
important role in an organization, namely supporting business
Authorized licensed use limited to: Auckland University of Technology. Downloaded on December 20,2020 at [Link] UTC from IEEE Xplore. Restrictions apply.
The 8th International Conference on Cyber and IT Service Management (CITSM 2020)
On Virtual, October 23-24, 2020
McLean Information System (D&M IS) Success Model of So it can be concluded that the academic information
AIS Mobile User Acceptance". system mobile application is a program that is specifically
used mobile to process academic data into useful information
II. LITERATURE REVIEW for the wearer namely students and lecturers.
A. User Acceptance III. RESEARCH METHODOLOGY
User acceptance is the user’s desire to use information
technology designed to help work and is seen as an internal A. Research Approach
factor that determines the success or failure of using This research uses a quantitative approach so that data
information technology (Nasir, 2013). User acceptance also a collection and data analysis methods are needed. Data
user’s willingness to employ technology for task it is designed collection conducted in this study is to use a questionnaire. In
to support (Teo, 2011). addition, researchers also made direct observations of the
Mobile AIS application, the results of these observations are
B. Technology Acceptance Model (TAM) intended as additional data in the discussion of this study.
Technology Acceptance Model (TAM) is an adaptation of Whereas the data analysis was performed statistically using a
Theory of Reasoned Action Model (TRA). This model was statistical processing application. The software used in this
developed by Fred D. Davis in 1986. TAM is a theory that study is Microsoft Word 2016 for report writing, Microsoft
describes the behavior of technology users in accepting and Excel 2016 for processing demographic data, and SmartPLS
using new technology. 3 to process data from respondents collected through
TAM has two main variables that are used to predict the questionnaires.
acceptance of use is perceived usefulness and perceived ease B. Research Model
of use that will affect the attitude towards using, behavioral The model in this study was adopted from the Technology
intention to use and finally shows the real use of the system Acceptance Model (TAM) by Davis (1989) which was
(actual system use) (Davis, 1989). modified by Oktavianti (2007) and the D&M IS Success
C. D&M IS Succes Model Model by DeLone and McLean (2003) as seen in Figure 2
D&M IS Success Model is a model developed by DeLone below. This research model consists of 8 variables, namely
and McLean in 1992. Model is an information system consists information quality, system quality, service quality taken from
of e named variable in which the system quality, information the D&M IS Success Model. While perceived usefulness,
quality, use, user satisfaction, individual impact, and perceived ease of use and acceptance of IT are taken from
organizational impact. After ten years since the D&M IS TAM.
Success Model was introduced, the information system has
changed. So DeLone and McLean make improvements to the
model's success has been updated model is then referred to
updated D & M IS Success Model.
Fig. 2. Research Model
C. Population and Sample
This study uses purposive sampling for sampling, where
the researcher determines the sample only for students of the
Islamic State University of Syarif Hidayatullah Jakarta who
Fig. 1. D&M IS Success Model (DeLone & McLean, 2003) have used the Mobile AIS application. The population
recorded on March 12, 2019, is already 11,501 active users of
D. Academic Information System (AIS) the AIS Mobile application.
Academic information system is a collection of sub- Researchers also use the Slovin formula in determining the
systems that are interconnected with each other and work minimum number of samples using a standard error of 7%.
together harmoniously to achieve the goal, that is to organize From the calculation of the Slovin formula with a population
data into information needed by users of information in of 11,501, the minimum number of samples is 201 samples.
connection with academic activities (Sutabri, 2012).
IV. RESULT
Academic information system is a collection of elements
both physical and non-physical and procedures that are A. Demographic Analysis
interconnected with one another into one unit and work The respondents collected for this study were 237
together to process academic data in an educational institution respondents. This amount has met the value of the minimum
into useful information for the wearer (Mutia, 2014). immune response that must be met.
Authorized licensed use limited to: Auckland University of Technology. Downloaded on December 20,2020 at [Link] UTC from IEEE Xplore. Restrictions apply.
The 8th International Conference on Cyber and IT Service Management (CITSM 2020)
On Virtual, October 23-24, 2020
Demographic analysis in this research contains some Variable Code
Outer
AVE CR
demographic groups are the type of gender, origin student Loading
faculty, and acceptance status of the application Mobile AIS. SQ6 0.767
SEQ1 0.765
TABLE I. DEMOGRAPHIC ANALYSIS RESULT
SEQ2 0.862
Demographic Service
Information Total
Group Quality SEQ3 0.800 0.656 0.851
Female 170 (SEQ)
Gender SEQ4 0.568
Male 67
SEQ5 0.530
Dirasat Islamiyah 6
PU1 0.812
Ilmu Tarbiyah & Keguruan 56 Perceived
Usefulness PU2 0.894 0.728 0.889
Syariah & Hukum 17 (PU)
PU3 0.852
Adab & Humaniora 14
PEU1 0.745
Ilmu Sosial & Ilmu Poltik 6
PEU2 0.777
Kedokteran 1 Perceived
Faculty Ease Of Use PEU3 0.727 0.564 0.866
Ilmu Kesehatan 22 (PEU)
PEU4 0.712
Ushuluddin 9
PEU5 0.793
Dakwah & Ilmu Komunikasi 32
AI1 0.797
Ekonomi & Bisnis 10 Acceptance
AI2 0.875 0.707 0.878
of IT (AI)
Sains & Teknologi 63
AI3 0.848
Psikologi 1
Receive 169
After analyzing the outer model, it is known that the model
Status of used in this study already has statistically good characteristics
Do Not Accept 9
Acceptance
if three indicators are removed, namely IQ5, SEQ4, and
Neutral / Don’t Know 59
SEQ5. After removing the three indicators, this model is in
accordance with the conditions that exist at each stage of the
B. Outer Model Analysis outer model analysis (individual item reliability, internal
accuracy reliability, average variance extracted, and
Outer Model analysis was performed with four stages of discriminant validity). So it can be concluded that this model
testing, namely individual item reliability, internal can be continued for further analysis, namely the analysis of
consistency reliability, Average Variance Extracted (AVE), the inner model.
and discriminant validity. This analysis is seen through the
value of outer loading for each indicator, also AVE value, and C. Inner Model Analysis
composite reliability (CR) value for each variable of this. Inner Model analysis is carried out with six stages of
testing namely path coefficient, coefficient of determination,
TABLE II. OUTER MODEL ANALYSIS RESULT t-test, effect size, predictive relevance dan relative impact.
Outer
Variable Code AVE CR TABLE III. INNER MODEL ANALYSIS RESULT PART 1
Loading
IQ1 0.760 Analysis
Path
Path T-test Path
IQ2 0.704 Coefficient t-test
Coefficient
IQ3 0.776 IQ PU 0.192 2.404 Significant Accepted
Information
IQ4 0.710 0.536 0.874 IQ PEU 0.202 2.342 Significant Accepted
Quality (IQ)
IQ5 0.531 SQ PU 0.265 3.240 Significant Accepted
IQ6 0.722 SQ PEU 0.373 4.642 Significant Accepted
IQ7 0.720 SEQ PU 0.280 3.069 Significant Accepted
SQ1 0.617 SEQ PEU 0.173 1.844 Significant Rejected
SQ2 0.729 PU AI 0.554 10.171 Significant Accepted
System
SQ3 0.634 0.502 0.857 PEU AI 0.238 4.432 Significant Accepted
Quality (SQ)
SQ4 0.808
SQ5 0.678
Authorized licensed use limited to: Auckland University of Technology. Downloaded on December 20,2020 at [Link] UTC from IEEE Xplore. Restrictions apply.
The 8th International Conference on Cyber and IT Service Management (CITSM 2020)
On Virtual, October 23-24, 2020
TABLE IV. INNER MODEL ANALYSIS RESULT PART 2 SEQ5. This is because the outer loading value for
Effect Relative these three indicator items is below the threshold
Path Predictive Relevance value of 0.7.
Size Impact
IQ PU Predictive Relevance Small Small
• From 8 hypotheses proposed, there is 1 hypothesis
IQ PEU Predictive Relevance Small Small that is rejected, namely SEQ PEU because of value
t-test for this hypothesis is less than the standard
SQ PU Predictive Relevance Small Small
value of t-test that can be accepted. These results are
SQ PEU Predictive Relevance Small Small also consistent with previous research which states
that service quality has no influence on perceived
SEQ PU Predictive Relevance Small Small
ease of use.
SEQ PEU Predictive Relevance Small Small
• There are 7 hypotheses that are accepted and
PU AI Predictive Relevance Big Intermediate considered to have an influence, namely IQPU, IQ
PEU AI Predictive Relevance Small Small
PEU, SQ PU, SQ PEU, SEQ PU, SEQ
PEU, PU AI, and PEU AI. From the results
of the analysis, factors that influence the acceptance
The results of t-test testing in the analysis of the inner status of Mobile AIS application users at UIN Syarif
model show that the sixth hypothesis (H6) is rejected because Hidayatullah are:
the t-test value is below 1.96 which is equal to 1.844. This o IQ (Information Quality) and SQ (System
means that service quality (SEQ) has no influence on Quality) indirectly affect AI (Acceptance of
perceived ease of use (PEU). However, if you look at the IT).
results of the path coefficient test which is 0.173, SQ has
significance to the PEU. This is consistent with research o PU (Perceived Usefulness) and PEU
(Groho et al., 2014) which also states that service quality has (Perceived Ease of Use) affect AI
no influence on the ease felt by end users. (Acceptance of IT) directly.
End users of the Mobile AIS application feel that the • From 7 accepted hypotheses, there is only 1
services provided by the development team have no effect on hypothesis which is PU AI has the effect size that
user convenience when using this Mobile AIS application. has a big effect. Whereas the other 6 hypotheses have
The services provided are deemed unsatisfactory for users. An a small effect size effect.
example is that some users find it easy to use the Mobile AIS
application, but users feel that this convenience is obtained REFERENCES
without interference from the services provided by the [1] Davis, F. D. (1989). Perceived Usefulness, Perceived Ease of Use, and
application development team. User Acceptance of Information Technology. MIS Quarterly.
[2] DeLone, W. H., & McLean, E. R. (2016). Information System Success
V. CONCLUSION Measurement. Foundations and Trends in Information System vol.2,
no.1.
Based on the research results of the User Acceptance [3] DeLone, W., & McLean, E. (2003). The DeLone and McLean Model
Analysis of the Mobile AIS Application, the following of Information System Success : A Ten-Year Update. Journal of
conclusions can be drawn : Management Information System.
[4] Groho, T. C., Winarno, W. W., & Permanasari, A. E. (2014). Evaluasi
• From the results of data processing conducted by Kesuksesan Implementasi Aplikasi Pengelolaan Tugas Belajar di BPK.
researchers, of 237 respondents who are students of Seminar Nasional Informatika (semnasIF).
UIN Syarif Hidayatullah Jakarta who have used the [5] Mutia, I. (2014). Perancangan Sistem Informasi Akademik dengan
AIS Mobile application, it is known that as many as Teknologi Short Message Service (SMS) pada XYZ. Faktor Exacta.
169 respondents (71.3%) stated that they can accept [6] Nasir, M (2013). Evaluasi Penerimaan Teknologi Informasi
this application and only 9 respondents (3.8%) which Mahasiswa di Palembang Mengggunakan Model UTAUT. Seminar
states do not accept the existence of this application. Nasional Aplikasi Teknologi Informasi (SNATI).
Meanwhile, as many as 59 respondents (24.9%) [7] O'Brien, J., & Marakas, G. (2007). Management Information Systems.
New York: McGraw-Hill Education.
stated they did not know or were neutral about the
[8] Oktavianti, B. (2007). Evaluasi Penerimaan Sistem Teknologi
status of acceptance of this Mobile AIS application. Informasi dengan menggunakan Variabel Perceived Usefulness,
The majority of respondents stated that they can Perceived Ease of Use, dan Perceived Enjoyment. Universitas Gadjah
accept this Mobile AIS application so it can be Mada: Tesis.
concluded that application users feel the benefits of [9] Sutabri, T. (2012). Konsep Sistem Informasi. Yogyakarta: Andi Offset.
the Mobile AIS application for students of UIN [10] Suzanto, B., & Sidharta, I. (2015). Pengukuran End-User Computing
Syarif Hidayatullah Jakarta and have accepted this Satisfaction Atas Penggunaan Sistem Informasi Akademik. Jurnal
application as an alternative to access Academic Ekonomi, Bisnis & Entrepreneurship.
Information System (AIS) UIN Syarif Hidayatullah [11] Teo, T. (2011). Technology Acceptance in Education. Netherlands:
Jakarta. Sense Publishers.
• Based on the data processing that has been done,
three indices are deleted, namely IQ5, SEQ4, and
Authorized licensed use limited to: Auckland University of Technology. Downloaded on December 20,2020 at [Link] UTC from IEEE Xplore. Restrictions apply.
