Test and Evaluate the Prototype

Introduction
What is the purpose of the test? Is it to validate your predictions or is it to answer a question?
How do you know that a test is successful? These are only a few of the questions that
designers answer when testing a prototype or system and evaluating their test results.
A design solution may solve the technical problem at hand, but what if the test isn’t accurate
or repeatable? Does the engineer immediately revisit the design process? No, the engineer
would seek input from other experts to troubleshoot the testing results. This is exactly what
your team is going to do . . . run a test, collect data, and seek the advice of experts on the
evaluation of the testing results.
Procedure
For this project, your team will test your prototype, collect data, and evaluate the results.

Part I
Perform the testing procedure(s) at least three times and collect data for each test on the
forms that you created in Part H. Take pictures throughout the test procedure. Document
your test administration, insert copies of your data, and reflect on the test results in your
engineering notebook.

If your test results reflect your predictions for the testing procedure, answer the following
questions with your team:
 Are your test results accurate?
 The test results for both tests are accurate points of data that can be used to
evaluate the prototype. The data for the effectiveness test is comprised of five
separate times and their average time for each of the three times the test was
repeated. The data for the weight test is accurate because the initial weight was
measured on a scale, and it was increased by 20 pounds for each of the other
two trials. This is why the test data are accurate points of data that can be used
to evaluate the prototype.
 Is your testing procedure repeatable?
The test procedure is repeatable because the tests are relatively simple and use materials
that everyone's has access to. For the effectiveness test all that is required is for it to be worn
and the tester tracks how long it takes them to walk 20ft compared to a normal shoe. The
tester then just needs to compare the average times between the two. This test is repeatable
by collecting more times for the normal shoe and prototype to compare. As for the weight
test, the user simply must stand on the prototype and put their weight on it. This test can
simply be repeated by doing it again and changing the amount of weight.

If you answered no to either of the questions above, proceed with your team to Part II. If you
answered yes to both questions, then your team is ready to send your data to experts and/or
stakeholders. Create a summary of the testing procedure. Submit the data tables and
summary to the experts for their input.

After receiving feedback from the experts and/or stakeholders, determine with your team
whether your design solution was a success, failure, or somewhere in between. As a team
discuss the test results and write a summary of proposed corrections or modifications to the
following:
 Prototype’s design
 Testing procedures
 Data collected

I. Test Procedure: Include the information you documented in Part H. Include images of
your tests to illustrate the procedure.

Weight test Effectiveness test

Image of the shoe after weight test Image of 20ft long area for testing

II. Results: Include the data that you collected as well as graphs and/or charts that are
appropriate to display your data for easy consumption.

The weight test results show that all three times this test was attempted were all
successful. This is because the test's success criteria were that it didn't suffer any
damage or deformities from the weight it bore. The first test was a weight of 141.4
pounds with no signs of damage. For the next two tries of the test, 20 pounds were
added with no signs of deformation. So, this is why the weight test is considered a
success.

The effectiveness test results also show that the test was also a success for all three
attempts. The criteria for this test success were that the average time of the prototype
was close to that of the normal shoe and had to within a second of its time. So the data
for these tests is provided below and it shows that all three attempts fell within that
criterion for success.
 III. Reflection: Explain the results of your test. Discuss the quality of the test data. Why do
you believe it is accurate and repeatable? Did the limitations of the test affect the
results? What implications does the data have on the product design? Did the design
solution perform successfully?

These tests, being a success, show that the prototype works just as well as a
normal shoe and is strong enough to bear the weight of the user. Also, the data
used for these tests was acquired using proper equipment and software, so it is
accurate. As for if it was repeatable, the tests are made to be simple and use
simple equipment to measure the date so that it can be repeated as many times
as the tester wants. Additionally, the test helps get rid of any limitations that
affect test data. This is because for the weight test any amount of weight can be
placed on the prototype, and with the effectiveness test the distance for the test
can be changed for what the tester desires. Finally, the data for the tests show
that the prototype was a success in working effectively. Overall, the prototype
was a success as it was able to perform the task it was designed to do which
allows it to help solve the issue of shoe waste.
IV. Expert Feedback: Summarize the feedback that you received from experts regarding
your test results and the implications of the test data.

David Fehrle was our advisor who helped us get feedback and brainstorm ideas
for our project. When we met with him, we discussed what to focus on when
building our prototype. The aspects that we focused on were ensuring the
strength of the prototype and ensuring that it could function just as well as a
normal shoe that could be bought. So, when looking at what we were going to
test we chose to test the strength and effectiveness of the shoe. This advice from
our advisor is what allowed us to decide what to focus on when designing or
prototype.
V. Recommendations: Based on the test results, what recommendations would you
make for improving the design of the product, the testing procedures, or the type or
method of data collection?
Since the data for the prototype shows that it was a success and functions properly, the next
step is to try and improve the design. The improvements would be focused on making the
shoe easier and better to use. The design would be made lighter by making it not as thick in
the sole of the shoe. The other change would be improving the system that connects the two
parts of the shoe to make sure that it is stronger. As for the testing procedures and the
methods used for collecting data, there isn't anything that needs to be changed. These are
the recommendations for improving the designs, testing procedures, and methods used.
Part II
Answer the following questions. You may choose to consult with your experts prior to
answering:
 Do the results reflect a problem with the testing procedure? No
 Do the results reflect a problem with the testing criteria? No
 Do the results reflect a problem with the materials used for the prototype? No
 Do the results reflect a problem with the quality of the building process of the prototype?
No
 Do the results reflect a problem with the design of the prototype? No
If your team answered yes to any question above, revisit the document that you created in
Part H. Revise your test procedure.

I. Test Procedure: Include the information you documented in Pr

N/A
II. Results: Include the data that you collected. Then discuss the results of your test.
Explain why the data is not accurate or not repeatable.
N/A

III. Expert Feedback (if applicable): Summarize the feedback that you received from
experts regarding your test results and the implications of the test data. Be sure to
document your correspondence with experts and stakeholders and indicate specific
questions, concerns, and opinions regarding the testing procedure and data analysis.
N/A

IV. Recommendations: Based on the test results, what recommendations would you make
for improving the design of the product or prototype, changing the testing criteria (which
may require a change in the design specifications), and/or revising the testing
procedures.
Implement your recommended changes and create new documents (design
specifications, technical drawings, prototype build procedure, and/or test procedure) as
necessary. Be sure to document refinements in your engineering notebook. Retest your
prototype using the instructions in Part I of this document. Be sure to document the
second round of testing as required. If time does not allow you to incorporate the
necessary refinements to your design solution, meet with your instructor to discuss
options. You may only be able to create a summary of proposed improvements and
receive expert feedback on your recommendations.

N/A