You are on page 1of 5

The DeLone and McLean Model of Information Systems

Success – Original and Updated Models


Satu-Maria Hellstén Maiju Markova
satu.hellsten@tut.fi maiju.markova@tut.fi
ABSTRACT and therefore, different studies and systems are not
In this paper we introduce the original as well as updated comparable [1].
DeLone and McLean Model of Information Systems
Success. The original model has six interrelated dimensions The aim of this paper is to introduce the first attempt to
of success: System Quality, Information Quality, Use, User capture all different aspects of IS success into a one
Satisfaction, Individual Impact, and Organizational Impact. comprehensive model – IS success model – as well as its
The dimensions of Service Quality and Intention to Use updated version. Based on the literature, this study also
were added into the updated model and the original describes how this model has been used in several studies
dimensions of Individual and Organizational Impact were and how it could help the development of human-centered
combined into one new dimension, Net Benefits. We also technology.
present five examples of applying or testing the model This paper is organized as follows. First, the original and
together with concrete success measures of IS. We believe updated DeLone and McLean model of IS success are
that IS success model provides a good framework for introduced with their dimensions and examples of success
identifying and developing different measures. IS success measures. After that the utilization of the model in different
model might provide a practical way to evaluate, for studies is discussed and concrete ways to measure various
example, user satisfaction and impacts of that satisfaction dimensions of success are presented. Finally conclusions
on the use of information systems. are drawn.

Author Keywords THE DELONE AND MCLEAN MODEL OF IS SUCCESS


information systems success, evaluation of IS In order to organize diverse research and to present more
integrated view of the concept of IS success, DeLone and
ACM Classification Keywords McLean introduced a comprehensive, multidimensional
H1 Information Systems: Models and Principles: Human model of IS success [1]. The purpose of this model is to be
factors, K4.3 Computers an Society: Organizational a framework for measuring different dependent variables in
Impacts IS research. Based on the communications research of
Shannon and Weaver from 1949 and the information
INTRODUCTION “influence theory” of Mason from 1978, as well an
Effective measurement of information system (IS) success empirical management information systems (MIS) research
is an important issue for both practitioners and researchers. studies from 1981-1987, they categorized IS success into
The measurement of success is critical in order to six major dimensions:
understand the value of IS management actions and IS
investments [1, 2]. However, IS success is a multi- 1) System Quality,
dimensional concept that can be assessed at various levels. 2) Information Quality,
In addition, various stakeholders may have different 3) Use,
opinions of the success of the same information system, for 4) User Satisfaction,
example, product developers may value technical success, 5) Individual Impact, and
end-users easiness of use, and managers increased revenues 6) Organizational Impact.
gained through the use of IS. In the literature, there are In their study, they reviewed all those empirical studies that
nearly as many IS success measures as there are studies, have attempted to measure some aspects of MIS success in
seven publications (Management Science, MIS Quarterly,
Communications of the ACM, Decision Sciences,
Information & Management, Journal of MIS, and ICIS
Proceedings). Additionally, some other articles were
included to contribute to theoretical or conceptual issues.
Altogether 180 articles were referenced in the paper.
Figure 1 presents these six interrelated dimensions of
success: System Quality and Information Quality singularly

1
System Use
Quality

Individual Organizational
Impact Impact

Information User
Quality Satisfaction

Figure 1 IS Success Model [1, p. 87].

and jointly affect both Use and User Satisfaction. In


Table 2 Examples of Success Measures – Use and User
addition, the amount of Use can have a positive or negative Satisfaction
effect on the degree of User Satisfaction and vice versa.
Use and User Satisfaction are direct antecedents of Information Use User Satisfaction
Individual Impact, and this impact should eventually have
Amount/duration of use Satisfaction with specifics
some Organizational Impact. [1]
Actual vs. reported use Overall satisfaction
In DeLone and McLean IS success model, these six
dimensions are examined at three different levels: technical Nature of use: use for Information satisfaction:
level, semantic level, and effectiveness or influence level. intended purpose, Difference between
appropriate use, type of information needed and
First dimension of the model, Systems Quality, studies the information used received
success at technical level. It focuses on the desired
characteristics of the information system itself which Motivation to use Enjoyment
produces the information. Second dimension, Information
Quality, focuses on the information product instead, and In addition, the influences which the information product
characteristics at the semantic level, i.e. “the success of the has on management decision (Individual Impact) and on
information in conveying the intended meaning”. Some organizational performance (Organizational Impact) are
examples of success measures of Systems and Information measured at the influence level. Some examples of success
Quality are listed in Table 1. measures are presented in Table 3.
Table 1 Examples of Success Measures – Systems Quality and Table 3 Examples of Success Measures – Individual Impact
Information Quality and Organizational Impact
System Quality Information Quality Individual Impact Organizational Impact
Ease of use Importance Learning Operating cost reductions
Ease of learning Relevance Decision effectiveness: Staff reductions
Convenience of access Usefulness Decision quality, Improved
decision analysis,
Realization of user Timeliness
Correctness, time to make
requirements
decision
Usefulness of system Readability
Improved individual Overall productivity gains
features and functions
productivity
Data and system accuracy Content
Task performance Increased revenues, sales,
market share, profits
At the influence level, Use and User Satisfaction are Problem identification Increased work volume
measured in order to analyze the interaction of the
information product with its recipients. Some examples of Willingness to pay for Service effectiveness
success measures of Use and User Satisfaction are listed in information
Table 2.
This model already helps IS researchers in understanding
different aspects of IS success, but as DeLone and McLean

2
argues “this success model clearly needs further that e-commerce studies should include net benefits
development and validation before it could serve as a basis measures (e.g., incremental sales, market valuation) and not
for the selection of appropriate IS measures” [1, p. 88]. be content to collect only surrogate measures, such as Web
site hits (Use). On the other hand, to understand these net
Updated D&M IS Success Model benefit results, they argue that the quality of the user’s
As the original IS success model needed further validation, experience and the customer’s usage of, and satisfaction
DeLone and McLean proposed an updated model in 2003, with, the system should be measured. [3]
again based on a literature review [2]. They added Service
Quality (e.g., IS support) as one important dimension. In Rai et al. [4] did an empirical test in quasi-voluntary IS use
addition, they added Intention to Use as an alternative context regarding a Student Information System (SIS). The
measure because an attitude is worthwhile to measure in SIS provides online access to a database of students’
some context. Finally, they combined Individual and personal and academic information. The use of SIS was not
Organizational Impact to one dimension, named Net mandatory. The findings support DeLone and McLean’s
Benefits; to broaden the impacts of IS also to groups, observation that IS success models must be carefully
industries and nations, depending on the context. specified in a given context. They also suggest that future
research should examine how “IS success models perform
in different context, including settings that range from
Information strictly voluntary to strictly involuntary use, and
Quality recommend refinements as appropriate”.
Intention Use Iivari [5] tested the IS success model by using field study of
to use a mandatory information system. The test was conducted
System Net with Oulu City Council. The council was working on the
Quality Benefits adoption of a new information system and trying to
accomplish its organizational acceptance. Iivari collected
User Satisfaction data with questionnaires which were given to new
information system’s primary users. The questionnaire was
Service based on standard measures. System Quality was measured
Quality with six scales: flexibility of the system, integration of the
system, response/turnaround time, error recovery,
convenience of access, and language. Information Quality
Figure 2 Updated D&M IS Success Model [2] was also measured with six scales: completeness, precision,
In 2002 Rai et al. [4] tested empirically and theoretically accuracy, reliability, currency, and format of output. The
DeLone and McLean’s model and Seddon’s model. Both results showed that perceived system quality and perceived
models deal with IS success, but Seddon’s model treats IS information quality were significant predictors of user
Use as a behavior, not as a process leading to individual or satisfaction with the system, but they did not matter to
organizational impact as in the original model of DeLone system use. User satisfaction was a strong predictor of
and McLean. Seddon’s model focuses on the causal aspects individual impact.
of the interrelationships among the taxonomic categories. Bryd et al. [6] contributed to IS success research through
According to Rai et al, the principal difference between the development and empirical testing of a process-oriented
these two models is in the definition and placement of IS model of IS success that was based on the model of DeLone
use. Seddon says that the use must precede impacts and and McLean. They examined the influence of lower-level
benefits, but it does not cause them. He considers IS use to intangible IS and information technology (IT) benefits on
be a resulting behavior that reflects an expectations of net higher-level financial measures. They also introduced IS
benefits from using an information system. More plan quality as an antecedent to the model’s input variables.
information about the empirical test conducted by Rai et al. The results supported a process-oriented view of the
is discussed later. benefits from IS and showed how the effects of IS along a
Next, various studies where these previously presented path can lead to better organizational performance, in their
models have been used are presented. case, lower overall costs. Concrete measures are introduced
in the appendix of their study. In their study, they used 7-
UTILIZATION OF THE SUCCESS MODEL point Likert scale anchored by “Strongly Disagree” to
DeLone and McLean [3] applied their updated model to “Strongly Agree” or scale from “Not Much” to
organize the e-commerce success metrics identified in the “Extensively”.
literature and demonstrated how the model can be used Wu and Wang [7] proposed and empirically assessed a
through two case examples. In both cases, usability was knowledge management systems (KMS) success model.
seen as an important measure of System Quality leading to Based on an analysis of current practice of knowledge
increased number of visits in web sites (Use) and repeat management as well as the DeLone and McLean’s model,
purchases (User Satisfaction). In addition, they suggested

3
they used five dependent variables (system quality, knowledge that I need
knowledge or information quality, perceived KMS benefits, PKB3. KMS enable me to accomplish tasks more
user satisfaction, and system use) in evaluating KMS efficiently
success. The definitions and success measures are presented PKB4. My performance on the job is enhanced by KMS
in Table 4. PKB5. KMS improves the quality of my work life

Table 4 Construct definition and success measures [7] System use: The extent of the KMS being used

System quality: How good the KMS is in terms of its SU1. I use KMS to help me make decisions
operational characteristics SU2. I use KMS to help me record my knowledge
SU3. I use KMS to communicate knowledge and
Q1. KMS is easy to use information with colleagues
Q2. KMS is user friendly SU4. I use KMS to share my general knowledge
Q3. KMS is stable SU5. I use KMS to share my specific knowledge
Q4. The response time of KMS is acceptable
Knowledge or information quality: How good the KMS
is in terms of its output Lai et al. [8] attempted to extend the DeLone-McLean
model by adding a new concept, dependability. To test their
1) Content quality new concept, they did a questionnaire survey in
KQ1. KMS makes it easy for me to create knowledge internationalized companies in Taiwan. In their study, Lai
documents et al. had questions that were related to Information Quality
KQ2. The words and phrases in contents provided by KMS (IQ), System Quality (SQ), Dependability (DEP), Perceived
are consistent Usefulness (PU), User Satisfaction (US) and Intention to
KQ3. The content representation provided by KMS is Use (IU). They found out that SQ had the largest total effect
logical and fit on DEP, PU and IU. Their finding imply that when dealing
KQ4. The knowledge or information provided by KMS is with enterprise applications, System Quality can help to
available at a time suitable for its use build users’ beliefs regarding dependability, satisfaction,
KQ5. The knowledge or information provided by KMS is and intention to use. Because 1) employees need to have the
important and helpful for my work right information from the right place at the right time, 2)
KQ6. The knowledge or information provided by KMS is employees’ efforts must be maximized and 3) enterprise
meaningful, understandable, and practicable applications must provide integrated service to help
KQ7. The knowledge classification or index in KMS is employees to complete their daily tasks despite different
clear and unambiguous systems, dependability is a significant factor for the success
of enterprise applications. Lai et al. feel that researchers
2) Context and linkage quality need to understand the importance of dependability. System
KQ8. KMS provide contextual knowledge or information Quality and Information Quality affect Intention to Use and
so that I can truly understand what is being accessed and User Satisfaction through dependability.
easily apply it to work
KQ9. KMS provide complete knowledge portal so that I Linking IS success model with TAM
can link to knowledge or information sources for more An interesting link between IS success model and
detail inquire Technology Acceptance Model (TAM) was also pointed
KQ10. KMS provide accurate expert directory (link, out in the literature. The TAM model is developed by Davis
yellow pages) [9] and it is an adaptation of the Theory of Reasoned
KQ11. KMS provide helpful expert directory (link, yellow Action, and the Theory of Planned Behavior, which are two
pages) for my work of the most popular models used to explain IS behavior.
User satisfaction: The sum of one’s feelings of pleasure or According to TAM, Perceived Usefulness and Perceived
displeasure regarding KMS Ease of Use affect users’ behavioral intentions. In addition,
this effect impacts on IS Use. [4]
US1. I am satisfied that KMS meet my knowledge or
information processing needs
CONCLUSION
US2. I am satisfied with KMS efficiency DeLone and McLean’s IS success model seems to provide a
US3. I am satisfied with KMS effectiveness good framework to identify and develop different measures
US4. Overall, I am satisfied with KMS for several important dimensions. Therefore, it could be
Perceived KMS benefits: The valuation of the benefits of used also in the field of human-centered technology and
the KMS by users usability studies to understand different aspects of IS
success. For example, it could provide a practical way to
PKB1. KMS helps me acquire new knowledge and evaluate why user satisfaction is not good and what
innovative ideas
PKB2. KMS helps me effectively manage and store

4
problems does the usability of the system create to users 4. Rai, A., Lang, S. S., and Welker, R. B. Assessing the
and organization. Validity of IS Success Models: An Empirical Test and
Theoretical Analysis, Information Systems Research,
Both the original and updated models are based on
(2002), Vol. 13, No. 1, March 2002, 50-69
literature reviews and other researchers have tried to
validate, use and develop these models further. Instead of 5. Iivari, J. An empirical Test of the DeLone-McLean
having ready-to-use measures, there is a lot of work to be Model of Information System Success. Database for
done when modifying the model for own purposes. Advances in Information Systems (1), April 2005, 8-27
However, the model and empirical studies offer great 6. Bryd, T.R., Thrasher, E.H., Lang, T., and Davidson,
advices and concrete measures for future work for N.W. A process-oriented perspective if IS success:
evaluating information systems in different contexts. Examining the impact of IS on operational cost. Omega,
34, (2006), 448-460.
REFERENCES
1. DeLone, W.H., and McLean, E.R. Information systems 7. Wu, J-H., and Wang, Y-M. Measuring KMS success: A
success: The quest for the dependent variable. respecification of the DeLone and McLean´s model.
Information Systems Research, 3, 1 (1992), 60-95. Information & Management, 43 (2006), 728-739.

2. DeLone, W.H., and McLean, E.R. The DeLone and 8. Lai, J-Y., Yang, C-C., and Tang, W-S. Exploring the
McLean Model of Information Systems Success: A Ten- Effects of Dependability on Enterprise Applications
Year Update. Journal of Management Information Success in e-Business. SIGMIS-CPR’06, April 13-15,
Systems, 19, 4, (2003), 9-30. 2006, Claremont, California, USA.

3. DeLone, W.H., and McLean, E.R. Measuring e- 9. Davis, F.D. Perceived usefulness, perceived ease of use,
Commerce Success: Applying the DeLone & McLean and user acceptance of information technology. MIS
Information Systems Success Model. International Quarterly, September (1989), 318-340.
Journal of Electronic Commerce, 9, 1, (2004), 31-47.

You might also like