Professional Documents
Culture Documents
recently conducted usability test. This test compared the websites of two
companies that sell performance parts for diesel vehicles. Both of these
companies have items for smaller diesel cars, but the target market of both
companies focuses on diesel pickups, in particular those equipped with
Powerstroke, Duramax, and Cummins diesel engines.
The two websites that were compared were Thoroughbred Diesel, and
Extreme Diesel Performance (Referred to from here forward as XDP, a
common abbreviation of their name). The sites are both intended to be
straightforward to use, obviously. Both sites are designed in such a way that
all that a person really needs to know to purchase parts is the engine that
they are seeking to upgrade (Or the vehicle it comes in, as the case may be
with engine swaps).
MethodsTo determine which of the two sites is simpler and easier to use, a test was
designed. The test involved tasks like "Find a set of stage II injectors for a
1994-1997 7.3 liter Powerstroke Turbo Diesel engine". These tasks had three
criteria to determine ease of use. Each of the tasks was timed, and had the
number of "clicks" of the mouse it took to complete recorded. These
statistics were taken starting at the homepage of each website, unless a task
was directly connected to the task before it. In addition to this, a Likert
Scale (With a range of one to ten) was used to describe the ease of
completing the task. In these examples, one was easy, and ten was hard.
The test for Thoroughbred Diesel occurred first on Monday, November 16th.
It occurred around noon. The test was done in my apartment on a laptop
computer using Internet Explorer. The XDP test occurred on Friday,
November 20th, also around noon. Given that my schedule for both days is
nearly the same, I felt that it would be the best way to eliminate bias caused
by different levels of stress. Both tests occurred with music playing on a
stereo in the background. The same three songs were played during the
second test, to help eliminate any possible biases that could have caused.
The songs were "Wrecked" and "The Bird Hunters" both by Turnpike
Troubadours, followed by "The Gift" from Seether, for any individual
wondering.
The testsThe test for each site was divided into eight tasks. Both sites did the same
tasks in the same order, starting from their homepage for each separate
task, unless otherwise stated.
Task One- Find a set of stage II injectors for a '94-'97 Powerstroke.
XDP was the victor of this task, but in my opinion only won by chance. I
started the task on Thoroughbred Diesel, and was immediately able to see
where I needed to go. The site has an easy "drop down" menu of engines
that makes it easy to find yours by just selecting the vehicle that the engine
is in. Selecting the option for your engine will send you to a list of
categories. On Thoroughbred Diesel, fuel injectors have their own category.
This made the process very simple. The hitch came later in the form of an
uninformed misstep. Their injectors are also found via a drop down menu of
brands. My first selection was "Alliant Diesel Injection", which as it turns out
did not have any injectors labeled as stage II. I went back a step, and then
selected Industrial Injection, from there, I found a set of 160cc injectors
(equivalent to stage II) which completed my task.
XDP divided their site into categories in a banner. You could select things like
"Dodge Cummins" or "Ford Powerstroke". Selecting "Ford Powerstroke" took
me to a similar list of categories. In this case, I clicked "Fuel System" as fuel
injectors did not have their own category. I selected their "Baby Swamps"
injectors, and found the size I needed. This took additional clicks compared
to Thoroughbred given that to order these injectors I had to select a size for
the nozzles, select a year for my vehicle, select a transmission option, and
give details regarding other modifications. Most of this information was
useless, which presented a minor irritation to me.
As was stated earlier, XDP won this round. XDP- one. Thoroughbred- Zero.
Task one
time
clicks
likert score
Thoroughbred
XDP Diesel.
0:5
8
1:36
10
8
2
2
Task Two- Find the cost to ship the injectors to Zip Code 83843.
Thoroughbred Diesel won this contest by a landslide. Their site has a quick,
simple, and easy "Estimate shipping costs" window on the same page that
you are on to see the product. This took me less than ten seconds (rounded
up in the stats for simplicity- the actual total was 9.83)
On XDP, one has to begin to checkout, and advance through multiple pages
before the option to estimate shipping costs becomes available. Their
process is still very simple, but was not nearly as streamlined as the one on
Thoroughbred Diesel.
Victor- Thoroughbred Diesel. XDP- One. Thoroughbred- One.
Task two
time
clicks
likert score
Thoroughbred
XDP
Diesel
0:49
0:10
7
5
1
1
Task three
time
clicks
likert score
XDP
0:4
3
12
3
Thoroughbred
Diesel
0:10
2
1
Thoroughbred
XDP
Diesel
0:41
0:30
3
3
1
1
XD Thoroughbre
P
d Diesel
5:0
0
0:15
37
1
Likert Score