INFORMATION SYSTEMS

MANAGEMENT (MSIT 7103)

Course Instructor: Habtamu Fanta, PhD
WSU, School of Informatics
Department of Computer Science
Shanghai Jiao Tong University
Department of Computer Science and Engineering
E-mail: habtamu_fanta@yahoo.com
habtamu_fanta@sjtu.edu.cn
Information Systems Evaluation
• ISE is defined as evaluation of performances in
hardware, software, networks, data and people.
• The main purpose of ISE is upgrading and improving
quality of IS.
• ISE assesses how successfully IS fulfills its objectives.
• The evaluation process gathers information about the
functionality of the evaluated IS or its components.
Information Systems Evaluation
Strategies for IS evaluation
• Goal-based evaluation
• Goal-free evaluation
• Criteria-based evaluation
Information Systems Evaluation
Strategies for IS evaluation
• Goal-based evaluation
 IS evaluation is driven by explicit goals from
organizational context
 These goals measure the IT-system
 Measures if predefined goals are achieved or not
Information Systems Evaluation
Strategies for IS evaluation
• Goal-free evaluation
 No explicit goals are used for IS evaluation
 Inductive and situationally driven strategy
 The aim of this strategy is:
• To avoid narrowly studying programme objectives thereby
missing unexpected outcomes
• Eliminate biases introduced in evaluation process by “knowing
the goals”
Information Systems Evaluation
Strategies for IS evaluation
• Criteria-based evaluation
 Explicit general criteria are used as evaluation
measurement
 These criteria are adapted from some perspectives or
theories
 Unlike goal-based, the criteria are general, not restricted
to an organization’s particular context
Information Systems Evaluation
• The following are crucial factors that affect success of
Information Systems:
1. Functionality/performance of IS
2. Data quality
3. Usefulness of IS
4. Usage simplicity of IS
5. Self-efficiency of IS user
6. Influence of IS on users
7. IS user’s satisfaction
Information Systems Evaluation
• IS user satisfaction is used to assess performance of IS
functionality.
 it depends on the interaction between user and IS
• User satisfaction is measured with the following instruments:
 Relation b/n user and IT professionals
 Provision of current and prompt information
 User’s level of training to use IS
 Quality of output information and documentation
 User’s level of dependence on IS
Information Systems Evaluation
• The most important factors for functionality/performance of
IS can be seen in different four groups of interest.
Organization’s management
• Output accuracy
• Output promptness
• Understanding of users’ needs
• Users’ trust in IS
Information Systems Evaluation
Users
• Output accuracy
• Competency of top managers
• Users’ trust in IS
• Output promptness
Information Systems Evaluation
IT professionals
• Competency of top managers
• Users’ trust in IS
• Output accuracy
• Output promptness
• System and procedures documentation
Information Systems Evaluation
IS management
• Users’ expectation from computer support
• Users’ participation
• Business effects of computer support
• Understanding of users’ needs
• Communication between users and IT professionals
Information Systems Evaluation
Project 3
Evaluate the information system performance and
practices of the organization you visited previously in
accordance with the factors discussed in this chapter
(max. of 6 pages).