ITECH3001

Assignment 2: Evaluating a System (25%)

Due date: Monday, Week 11
Word limit: 3,000 – 5,000 words

Assignment objectives
• Investigate the techniques for evaluating systems as described in the literature
• Design and conduct usability evaluation for a chosen system
• Analyse and interpret the data and results from the evaluation
• Report on the results and recommend for improvement of the evaluated system

Details of written components

Assignment

You will select one of the websites provided (the list is available on Moodle). You must notify your
tutor which website you have selected as each website can be evaluated by only one person. The
assignment involves conducting a usability test on that website, interpreting the results and writing
recommendations in the form of a report on any changes needed. A copy of your report will be ready
to be submitted to the charity.

Each of the charities listed have requested a usability evaluation of their website. The written
component of the assignment must be based on your ACTUAL usability test on REAL users and
should contain the following:

• A discussion, based on the literature, of the different approaches for assessing or testing
usability with more detail on the use of usability testing for evaluating systems or websites.

• A brief description of the website selected for the usability evaluation. This should include the
purpose of the website, the audience and the objectives of the organisation with respect to their
website as determined by the charity.

• For the usability test you must:

o Describe how the usability testing was conducted, and rationale for the approach. You
may use the usability instrument provided on Moodle or a modified version (but
improved version). The description should include a justification of the number of

1
 users, selection of users, the instrument you used for your test (that is the questions), the
task you set the users, the scenario etc.

• A critical discussion of the method (good or useful aspects, difficult or poor aspects).

• A page summarizing your recommendations for changes to the website with supporting
evidence. Think about what you think key personnel in the charity will want to know about
how well their website is performing.

It should be noted that this is not an exclusive list but suggestions of how you might approach the
assignment. Your presentation must be brief and no more than 10 A4 pages with 12pt font. Use
dot or numbered lists, tables and numbered headings to organize your ideas and info as
demonstrated in this document. To support your arguments, use screenshots, graphs and actual
data from your test and cite references across your document.

Presentation to the charity

• You are required to do a presentation for the charity. This is an assessable component of your
assignment.

• Your presentation will be a summary version of the full assignment and should contain
recommendations regarding changes to the website.

• The presentation will not contain all the information you have in your written assignment.
Consider carefully what you think the charity will want to know that will be useful to them.

• It would be helpful if you imagine you are reporting your evaluation results to your boss who
has only about 10 minutes for you, and your career or promotion depends on your success on
this reporting.

• Start with key points (must haves), followed by blurbs (additional info) and then with
elaborations on each of the key points (nice to have).

Please use the attached marking guide as a guide to the work and content required for this
assignment.

2
 Marking guide for the assignment written component
The written component of your assignment will be marked out of 50, is worth 20% of your final mark. Use the
following guide to structure the written component of the assignment. The criteria used to mark your work will
be as follows:
Criteria Comments

Understanding the purpose of the website (as described by the /4

charity)
• Described the organisation’s purpose adequately
• Described the purpose (objectives) the organisation has for their web
site adequately
• Identified the audience the charity is trying to reach
Background literature on evaluating and testing for usability /10
• Overview of approaches to usability testing and evaluation was included
• Discussion was provided on the different approaches and use of
usability
• testing
• Critical assessment of the use of usability testing was included
Implementation of the usability testing /16
• Details were provided on the choice of users with justification
• Detailed description was provided of how the usability test was
implemented (including the, instrument used with justification, test
environment, scenario and tasks performed).
• Critical discussion provided reflecting on your use of and experience
with usability testing
• Summary of findings provided and include evidence from the testing to
support the findings

Recommendations /12
• Recommendations were sufficiently detailed.
• Recommendations were appropriate
• Recommendations were well justified based on the outcomes of the
• evaluation
• Recommendations were presented appropriately
Literature /4
• The literature used was appropriate
• Sufficient literature was used
Submission /4
• Written presentation was professional
• References cited correctly using Harvard style or similar correctly presented in
• text and in reference section and all details provided
• Assignment Submitted on time
• No evidence of plagiarism

Total Marks /50

Mark out of /20

3
 Assignment Presentation Marking Guide
You are required to present the results in a short presentation of no longer than 10 minutes. The presentation
should be based on the report to be provided to the charity, it should focus on the key findings from your testing
and the recommendations. Your presentation should consist of no more than 10 slides. Please use the attached
marking guide as a guide to the content for your presentation.

Presentation Content Rating

• Relevancy of the content for the organisation /4
• Appropriateness as a report for an organisation

• Recommendations with justification provided

• Ability to address issues/questions raised /3

• All relevant issues addressed and all information the organisation

would need was provided
• Appropriate breadth vs depth /5
• Contained interesting, informative and useful information

• Sufficient reflective thinking

• Analysis of results described appropriately /3

Presentation Style /5
• Ability to incite interest, interaction and/or discussion
• Clear, concise, and professional delivery, flow of
information and presentation
• Quality of powerpoint slides
• Ability to adhere to time constraints and number of slides
• marks will be deducted for over time and/or more than 6 slides

Total Marks /20

Mark out of /5