White Paper

Usability Test
Comparing Computer Modeling Programs
SEPTEMBER 15TH, 2019 ROBERT CARNE

UNIVERSITY OF IDAHO
Table of Contents
Introduction .................................................................................................................................................. 3
Methodology................................................................................................................................................. 3
Equipment and Environment .................................................................................................................... 3
Tasks.......................................................................................................................................................... 3
Testing Metrics.......................................................................................................................................... 3
Evaluation ..................................................................................................................................................... 4
Table 1 ................................................................................................................................................... 4
Results ........................................................................................................................................................... 5
Task 1: Create a Sketch ............................................................................................................................. 5
Task 2: Trim Feature of Sketch .................................................................................................................. 6
Task 3: Extrude Sketch into Solid Part ...................................................................................................... 7
Task 4: Change View (Rotate, Zoom, Pan) ................................................................................................ 8
Task 5: Create an Additional Feature on an Existing Part ......................................................................... 9
Task 6: Revolve Sketch into Solid Part .................................................................................................... 10
Task 7: Assemble Created Parts .............................................................................................................. 11
Task 8: Apply Surfaces/Material to Parts ................................................................................................ 12
Task 9: Render Photo of Assembly.......................................................................................................... 13
Task 10: Animation of Assembly ............................................................................................................. 14
Conclusion and Recommendations ............................................................................................................ 15
References .................................................................................................................................................. 15
Appendix ..................................................................................................................................................... 17
2
Introduction
Two of the best know modeling software’s SolidWorks and CATIA V5 where used in usability test. This
white paper presents the results from ten specific performance tests for first time users with an interest
in engineering and know what computer simulated modeling is.
Methodology
Equipment and Environment
The information collected in this test of usability of SolidWorks and CATIA V5 where conducted in a
controlled environment with zero distractions. The tests where completed on the same computer using
Windows 10 education. The versions of SolidWorks and CATIA V5 where 2018 and 2013 respectively.
These where the most up to date versions available to use at University of Idaho’s senior design lab.
Tasks
1. Create a Sketch
2. Trim feature of Sketch
3. Extrude Sketch into Solid Part
4. Change View (Rotate, Zoom, Pan)
5: Create an Additional Feature on an Existing Part
6. Revolve Sketch into Solid Part
7. Assemble Created Parts
8. Apply Surfaces/Materials to Parts
9. Render Photo of Assembly
10. Animation of Assembly
Testing Metrics
The following criteria was used to evaluate each task:
Effective: I was able to complete this task.
Efficient: I was able to perform this task in a timely manner.
Engaging: The software aided in the completion of the task.
Error Tolerant: The software pointed out any errors and offered resolution techniques.
Easy to Learn: Software utilities used in this task were easy to learn.
3
Evaluation
Each testing metric was evaluated using a Likert scale like the one showed below.
Strongly Slightly Slightly Strongly

Disagree Agree
Disagree Disagree Agree Agree
1 2 3 4 5 6
Table 1
4
Results
Task 1: Create a Sketch
Open the designated modeling program and create a shape using the line tool. This is the first step to be
able to create a 3D model. Four separate lines where created in each program to create a shape in CATIA
V5 and SolidWorks, see Figure 1 and Figure 2 respectfully.
Figure 1 Figure 2
SolidWorks was found to be much easier for new users to discover on their own how to create a sketch
using the different shape tools.
Image 1
5
Task 2: Trim Feature of Sketch
Use the “Trim” tool to modify the sketch and create a closed continuous sketch. The two extended lines
where trimmed down to create a square.
Figure 3 Figure 4
SolidWorks was found to have a better layout much more organized and labled clearly to be able to
select the right tool without having to look up help.
Image 2
6
Task 3: Extrude Sketch into Solid Part
Use the “Pad” tool in CATIA V5 (Figure 5) to create a 3D object from the previous sketch. Us the “Extrude”
tool in SolidWorks (Figure 6) to create a similar part. Although the same action was named differently
between the two programs both where easy to find and use.
Figure 5 Figure 6
It was found that both programs where relatively easy to create a 3D part, but SolidWorks was more
engaging to the user as to how to create the actual part.
Image 3
7
Task 4: Change View (Rotate, Zoom, Pan)
Use the mouse and keyboard controls to change the view of the created part. By exploring the options,
it was found that SolidWorks rotate, zoom, and pan options where much easier to discover based on the
general layout of the program.
Figure 7 Figure 8
CATIA V5 was found to be more difficult to find the correct combinations of keys to be able to exicute the
disired action. If a wrong command was exicuted the view would change no matter what the user intended
to enter.
Image 4
8
Task 5: Create an Additional Feature on an Existing Part
A cylinder was added to the top of the extruded part by selecting the face desired to create the circular
sketch. Once the sketch was created on the top surface of the block, the extrude feature was used and
the cylinder was created.
Figure 9 Figure 10
It was found that both programs allowed users to easily add features to exsistion parts.
Image 5
9
Task 6: Revolve Sketch into Solid Part
A sketch was created using the line tool as in task 1 (see figure 1) and revolved around an axis to create a
hallow cylinder. Both programs had the same command tool name of revolve.
Figure 11 Figure 12
SolidWorks was found to have a higher overall usability for creating a revolved part.
Image 6
10
Task 7: Assemble Created Parts
The assembly workbench for each program was opened and the separate parts where added. It took a
greater amount of time to create the CATIA V5 assembly then the SolidWorks assembly. SolidWorks
navigation bar is far better at labeling different features within the program. A “coincidence” mate was
placed on both assemblies to align the inner cirlce of the revolved part and the outside diameter of the
cylinder of part one.
Figure 13 Figure 14
CATIA V5 was very challenging to get into the correct workbench to create an assembly while
SolidWorks was very user friendly.
Image 7
11
Task 8: Apply Surfaces/Material to Parts
Add surfaces/materials to individual parts. The same materials where added in each program. Copper
was applied to the revolved part, and steal was added to block and cylinder in part 1. CATIA V5 (figure
15) has a much darker and less realistic finishing without adjusting any lights then the SolidWorks
finishing (figure 16).
Figure 15 Figure 16
SolidWorks has a very clearly labled materials tap in the design tree, making it very easy to navigate and
select the desired material unlike CATIA V5.
Image 8
12
Task 9: Render Photo of Assembly
Create a high quality rendered photo of the created assembly with the applied materials. Both programs
took a long time to find the desired workbench without having to search for help.
Figure 16 Figure 17
Both programs where not user friendly when making a rendering. It wasn’t clear what needed to be
done in order to get a rendering from either program.
Image 9
13
Task 10: Animation of Assembly
Create a simple animation of the revolved part sliding over the cylinder. The help menu as well as a
YouTube video where needed to complete the animation in both programs.
Figure 18
Figure 19 Figure 20
14
SolidWorks was much more intuitive and error resistant then CATIA V5, although not by much. A
YouTube video was needed to find the correct workbench and steps needed to create an animation in
SolidWorks. This is only because I am currently taking a CATIA V5 class at University of Idaho.
Image 10
Conclusion and Recommendations
Overall, I found SolidWorks to be more first-time user friendly even though I had to use an
outside source to figure out how to create animation. SolidWorks has everything labeled very well as
well as a small picture with it while CATIA only has little icons you must float over for a few seconds
before they tell you what command it is. I also felt it was much easier to learn all the feature in
SolidWorks compared to CATIA. I feel CATIA is used for larger assemblies and for users that already have
a slight understanding of computer modeling programs.
I would recommend CATIA to expand their icon space so users can find the feature they wish to
use much faster and not waste time hovering over things. CATIA also is very unclear on what
workbenches do what without having to ask for help or look it up online.
References
https://www.youtube.com/watch?v=wTEhxA1PZ_I
15
This Page was Intentionally Left Blank
16
Appendix
Product CATIA V5 SolidWorks
Task # 1 Create a Sketch Create a Sketch

Efficient
Strongly Slightly Slightly Strongly Strongly Slightly Slightly Strongly
Disagree Agree Disagree Agree
Disagree Disagree Agree Agree Disagree Disagree Agree Agree
1 2 3 4 5 6 1 2 3 4 5 6
Effective
1 2 3 4 5 6 1 2 3 4 5 6
Engaging
1 2 3 4 5 6 1 2 3 4 5 6
Error Tolerant
1 2 3 4 5 6 1 2 3 4 5 6
Easy to Learn
1 2 3 4 5 6 1 2 3 4 5 6
My Notes
17
Product
CATIA V5 SolidWorks
Task # 2 Trim feature of Sketch Trim feature of Sketch
Efficient
1 2 3 4 5 6 1 2 3 4 5 6
Effective
1 2 3 4 5 6 1 2 3 4 5 6
Engaging
1 2 3 4 5 6 1 2 3 4 5 6
Error Tolerant
1 2 3 4 5 6 1 2 3 4 5 6
Easy to Learn
1 2 3 4 5 6 1 2 3 4 5 6
My Notes
18
Task # 3 Extrude Sketch into Solid Part Extrude Sketch into Solid Part
Efficient
1 2 3 4 5 6 1 2 3 4 5 6
Effective
1 2 3 4 5 6 1 2 3 4 5 6
Engaging
1 2 3 4 5 6 1 2 3 4 5 6
Error Tolerant
1 2 3 4 5 6 1 2 3 4 5 6
Easy to Learn
1 2 3 4 5 6 1 2 3 4 5 6
My Notes
19
Task # 4 Change View (Rotate, Zoom, Pan) Change View (Rotate, Zoom, Pan)
Efficient
1 2 3 4 5 6 1 2 3 4 5 6
Effective
1 2 3 4 5 6 1 2 3 4 5 6
Engaging
1 2 3 4 5 6 1 2 3 4 5 6
Error Tolerant
1 2 3 4 5 6 1 2 3 4 5 6
Easy to Learn
1 2 3 4 5 6 1 2 3 4 5 6
My Notes
20
Task # 5 Create an Additional Feature on an Existing Part Create an Additional Feature on an Existing Part
Efficient
1 2 3 4 5 6 1 2 3 4 5 6
Effective
1 2 3 4 5 6 1 2 3 4 5 6
Engaging
1 2 3 4 5 6 1 2 3 4 5 6
Error Tolerant
1 2 3 4 5 6 1 2 3 4 5 6
Easy to Learn
1 2 3 4 5 6 1 2 3 4 5 6
My Notes
21
Task # 6 Revolve Sketch into Solid Part Revolve Sketch into Solid Part
Efficient
1 2 3 4 5 6 1 2 3 4 5 6
Effective
1 2 3 4 5 6 1 2 3 4 5 6
Engaging
1 2 3 4 5 6 1 2 3 4 5 6
Error Tolerant
1 2 3 4 5 6 1 2 3 4 5 6
Easy to Learn
1 2 3 4 5 6 1 2 3 4 5 6
My Notes
22
Task # 7 Assemble Created Parts Assemble Created Parts

Efficient
1 2 3 4 5 6 1 2 3 4 5 6
Effective
1 2 3 4 5 6 1 2 3 4 5 6
Engaging
1 2 3 4 5 6 1 2 3 4 5 6
Error Tolerant
1 2 3 4 5 6 1 2 3 4 5 6
Easy to Learn
1 2 3 4 5 6 1 2 3 4 5 6
My Notes
23
Task # 8 Apply Surfaces/Materials to Parts Apply Surfaces/Materials to Parts

Efficient
1 2 3 4 5 6 1 2 3 4 5 6
Effective
1 2 3 4 5 6 1 2 3 4 5 6
Engaging
1 2 3 4 5 6 1 2 3 4 5 6
Error Tolerant
1 2 3 4 5 6 1 2 3 4 5 6
Easy to Learn
1 2 3 4 5 6 1 2 3 4 5 6
My Notes
24
Task # 9 Render Photo of Assembly Render Photo of Assembly

Efficient
1 2 3 4 5 6 1 2 3 4 5 6
Effective
1 2 3 4 5 6 1 2 3 4 5 6
Engaging
1 2 3 4 5 6 1 2 3 4 5 6
Error Tolerant
1 2 3 4 5 6 1 2 3 4 5 6
Easy to Learn
1 2 3 4 5 6 1 2 3 4 5 6
My Notes
25
Product
CATIA V5 SolidWorks
Task # 10 Animation of Assembly Animation of Assembly
Efficient
1 2 3 4 5 6 1 2 3 4 5 6
Effective
1 2 3 4 5 6 1 2 3 4 5 6
Engaging
1 2 3 4 5 6 1 2 3 4 5 6
Error Tolerant
1 2 3 4 5 6 1 2 3 4 5 6
Easy to Learn
1 2 3 4 5 6 1 2 3 4 5 6
My Notes
26

White Paper

Uploaded by

Document Information

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

White Paper

Uploaded by

Copyright:

Available Formats

Usability Test

Comparing Computer Modeling Programs

SEPTEMBER 15TH, 2019 ROBERT CARNE

2. Trim feature of Sketch

3. Extrude Sketch into Solid Part

4. Change View (Rotate, Zoom, Pan)

5: Create an Additional Feature on an Existing Part

6. Revolve Sketch into Solid Part

7. Assemble Created Parts

8. Apply Surfaces/Materials to Parts

9. Render Photo of Assembly

10. Animation of Assembly

The following criteria was used to evaluate each task:

Effective: I was able to complete this task.

Efficient: I was able to perform this task in a timely manner.

Engaging: The software aided in the completion of the task.

Strongly Slightly Slightly Strongly

Conclusion and Recommendations

Task # 1 Create a Sketch Create a Sketch

Task # 7 Assemble Created Parts Assemble Created Parts

Task # 8 Apply Surfaces/Materials to Parts Apply Surfaces/Materials to Parts

Task # 9 Render Photo of Assembly Render Photo of Assembly

You might also like