Topic 11 Purpose of Evaluation

1. Purpose of Evaluation

 The success of any interactive information system depends on its functionality,

performance, reliability and user interface.
 Each one of these factors is important and inefficiency in any one of them can
cause a problem in the system as a whole.
 A systems analyst needs to consider each factor when evaluating a user interface.

2. Evaluation of a User Interface

2.1 Usability Goals

 Free from error
 Efficient
 easy to learn
 easy to recall
 easy to use

2.2 User Experience Goals

 Aesthetically satisfying
 Enjoyable to use
 Motivating
 Engaging
 Reliable

3. Heuristic Evaluation Business Systems Problem

3.1 Objectives of Heuristic Evaluation

 It can be used to identify usability problems.
 It is not undertaken by users of the system being evaluated
 It is undertaken by an impartial evaluator.
 An observer answers an evaluator’s questions about the interface.
 An observer provides advice on using an interface.
 The evaluator states what they don’t like about the interface and their reasons why.

3.2 Aspects of an interface assessed using a heuristic evaluation.

 Simple language and directions
 Easily recalled
 Consistency
 Feedback
 Clearly marked exits
Information Systems Analysis Topic -11 Page 1
 KMD Institute
 Shortcuts
 Clear and relevant error messages
 Lack of errors
 Help features

3.3 Disadvantages of using Heuristic Evaluation

 Although usability problems are identified, there is not always explanation/adequate
explanation of how they should be improved or corrected.
 Evaluators are not end users of the interfaces and therefore might not identify all
problems or potential problems with usability.
 An observer answers an evaluator’s questions about the interface or gives advice
on using it

3.4 Cognitive walkthrough

 It is an evaluation method that is used to inspect the usability of a system
 Its aim is to measure how easy users find it to complete tasks and subtasks.

3.5 Informal Evaluation methods

 Predictive modelling
 Guidelines review
 Consistency inspection
 Critical event analysis
 Dialogue error analysis
 Usability testing
 Expert reviews

Information Systems Analysis Topic- 11 Page 2

 KMD Institute
REVIEW QUESTIONS
June 2014
 Identify THREE (3) usability goals that are required to be included in a test of the
usability of an interface. (3)

September 2014
 Evaluate Heuristic Evaluation as an interface evaluation technique. (2)
 Identify TWO (2) disadvantages associated with heuristic evaluation of a human
computer interface.2
 Describe THREE (3) user experience goals that should be included in usability test of the
user interface. (2)
 List THREE (3) benefits of an efficient interface. (3)

December 2014
 What is the purpose of a Heuristic evaluation and how can it be implemented? (4)
 Identify THREE (3) usability goals that are required to be included in a test of the
usability of an interface. (3)
 Describe THREE (3) user experience goals that should be included in usability test of the
user interface. (2)
 Identify TWO (2) ways that efficient interface design can help an organization. (3)

December 2015 Sample

 Suggest THREE (3) types of user experience goals used to evaluate user interface
design. (3)
 Briefly discuss the objectives of Heuristic evaluation. (3)

March 2016
 Outline FOUR (4) characteristics of heuristic evaluation. (4)
 Briefly explain what is meant by the term cognitive walkthrough. (2)
 State FOUR (4) informal evaluation methods (not including heuristic evaluation
and cognitive walkthroughs) that can be used to evaluate an information system’s
interface. (4)

Information Systems Analysis Topic- 11 Page 3