22 DOE Exercise

QOSC Flyer
1. Graphical DOE Analysis
(Recommended for Greenbelt Class)

2. Main and Interaction Calculation

3. Bonferroni Analysis
A10 1
 DOE exercise

1.Graphical DOE Analysis

(Recommended for Greenbelt Class)

2. Main and Interaction Calculation

3.Bonferroni Analysis
A10 2
 The Experiment
Objective: Produce QOSC Flyers with Long Drop Times
1. Obtain QOSC Flyer templates and manufacturing instructions.
2. As a team, choose two factors with which to experiment. Do NOT use wing length
as a factor.
• Use your physics knowledge of “How the helicopter is supposed to work”, and,
your flow chart for the dropping process, and your C&E Diagram.
3. Is your measuring system ready and OK?
4. Make 4 flyers.
• One Flyers per treatment combination.
• Each flyer will be dropped four times.
(Optional: Make 16 flyers and drop them once each (16 data points). Includes
build variation and makes it more difficult to show statistical significance.)
• Each drop will have two stop watch times that will be averaged.
• See data collection sheets #1-#2 for guidance.
5. Choose a data collection sheet and execute experiment.
• Randomize (Sheet #1 is in a random order as an example)
6. Draw the Main Effects and Interaction Graphs.
• Hint: This is easiest using data collection sheet #2.
• Make visual and intuitive assessment of significance.
7. Make analytical assessment of significance.
8. Prepare for download to class and team-to-team
A10 competition. 3
 How is the Gravity Helicopter Supposed to Work?

 Consider a Gravity Helicopter rotating to the ground:

– The KPOV is the time-to-ground.
 The physics of how it works:
– The helicopter rotates as it drops due to
offset wings and the action of air drag.
– This exposes a virtual disc to the air for
drag to slow it down to less than free fall.
– The bigger the disk of air, the faster the rotation the
more air molecules that will hit the virtual disk slowing
it down.
– Area is set by rotation and length of the wings.

Varies
– Helicopter goes into free fall until rotation starts. 47.5 mm
– Instability that tilts the helicopter sideways
also puts the helicopter into free fall. Powertrain Flyer

– (Wing length is a KPIV but we want you to

choose other ones.)
105 mm
32.5 mm
A10 4
 Flyer DOE Data Collection Sheet #1
Experimental Array - Randomized
Yates Run
Code A B Stop Watch 1 Stop Watch 2 Average
Order Order
12 1 ab +1 +1
4 2 ab +1 +1
15 3 b -1 +1
14 4 a +1 -1
13 5 (1) -1 -1
16 6 ab +1 +1
1 7 (1) -1 -1
11 8 b -1 +1
2 9 a +1 -1
6 10 a +1 -1
10 11 a +1 -1
3 12 b -1 +1
5 13 (1) -1 -1
8 14 ab +1 +1
9 15 (1) -1 -1
7 16 b -1 +1 A10 5
 DOE Data Collection Sheet #2
(Each of the 16 drops is an average from two stop watches)

A
-1 +1
B
𝑥1 ____ 𝑥5 ____
-1 𝑥2 ____ 𝑥𝐴−𝐵− 𝑥6 ____ 𝑥𝐴+𝐵−
𝑥3 ____ _____ 𝑥7 ____ _____
𝑥4 ____ 𝑥8 ____

𝑥9 ____ 𝑥13 ____

+1 𝑥10 ____ 𝑥𝐴−𝐵+ 𝑥14 ____ 𝑥𝐴+𝐵+
𝑥11 ____ _____ 𝑥15 ____ _____
𝑥12 ____ 𝑥16 ____

A10 6
1. Graphical DOE Analysis
Main Effect A Main Effect B

A- A+ B- B+
Data
Average
A10 7
1. Graphical DOE Analysis
AB Interaction

B+
B-

A- A+

Average A10 Data 8

1. Graphical DOE Analysis
Main Effect A
3Tukey end count = 1
Example
3 Main Effect B
Fail to reject the null
Wing length has no effect Tukey end count = 11
Reject the null
Significant improvement
With no paper clip
2.5 2.5

2 2

1.5 Not 1.5

Significant Significant

A- A+ B- B+
Short Wings Long Wings Data 1 paper clip No paper clip
Average
A10 9
Make sure to add factor labels!
1. Graphical DOE Analysis
20 AB Interaction Example
B+: Tukey end count = 0
Fail to reject the null
When there is NO paper
15 B-: Tukey end count = 1 clip the length of the wings
does NOT matter
Fail to reject the null
When there is a paper clip
the length of the wings
does NOT matter A+ Long Wings

10 A- Short Wings

5 Not
Significant

B- B+
1 paper clip No paper clip

Average Data
A10 10
Make sure to add factor labels!
Main and Interaction Calculations

A10 11
2. Main and Interaction Calculation
Main Effects

A
-1 +1
B
𝑥𝐴−𝐵− 𝑥𝐴+𝐵−
𝑥ҧ𝐵− -1 _______ _______
Effect of B:
(𝑥ҧ𝐵+ ) - (𝑥ҧ𝐵− ) = ________
𝑥ҧ𝐵+ 𝑥𝐴−𝐵+ 𝑥𝐴+𝐵+
+1 _______ _______

𝑥𝐴−
ҧ 𝑥𝐴+
ҧ
Effect of A: (𝑥𝐴+
ҧ ) − 𝑥𝐴−
ҧ = _________

A10 12
2. Main and Interaction Calculation
Interaction Effect
A
-1 +1
B
Average Average
-1 _______ _______

Average Average
+1 _______ _______

𝑥𝐴𝐵−
ҧ 𝑥𝐴𝐵+
ҧ

Effect of AB: (𝑥𝐴𝐵+

ҧ ) – (𝑥𝐴𝐵−
ҧ ) = _________

A10 13
Bonferroni Analysis

A10 14
 Calculating the Main Effect Standard Deviations
A (𝑆𝐵− )2 + (𝑆𝐵+ )2
𝑃𝑜𝑜𝑙𝑒𝑑 𝑆𝐵 =
-1 +1 2
B
𝑥1 ____ 𝑥5 ____
-1 𝑥2 ____ 𝑥6 ____ σ(𝑥𝑛 −𝑥ҧ𝐵− )2
𝑥3 ____ 𝑥7 ____ 𝑆𝐵− =
7
𝑥4 ____ 𝑥8 ____

𝑥9 ____ 𝑥13 ____

𝑥10 ____ 𝑥14 ____ σ(𝑥𝑛 −𝑥ҧ𝐵+ )2
+1 𝑥11 ____ 𝑥15 ____ 𝑆𝐵+ =
7
𝑥12 ____ 𝑥16 ____

(𝑆𝐴− )2 + (𝑆𝐴+ )2
𝑆𝐴− = 𝑆𝐴+ = 𝑃𝑜𝑜𝑙𝑒𝑑 𝑆𝐴 =
2
ҧ )2
σ(𝑥𝑛 −𝑥𝐴− ҧ )2
σ(𝑥𝑛 −𝑥𝐴+
7 7
A10 15
3. Bonferroni Analysis
 Calculating the Main Effect Standard Deviations

𝑆𝐵− : ෍(𝑥𝑛 −𝑥𝐵− )2 = (𝑥1 −𝑥𝐵− )2 + (𝑥2 −𝑥𝐵− )2 + (𝑥3 −𝑥𝐵− )2 + (𝑥4 − 𝑥𝐵− )2 +
+(𝑥5 −𝑥𝐵− )2 + (𝑥6 −𝑥𝐵− )2 + (𝑥7 −𝑥𝐵− )2 + (𝑥8 −𝑥𝐵− )2

𝑆𝐵+ : ෍(𝑥𝑛 −𝑥𝐵+ )2 = (𝑥9 −𝑥𝐵+ )2 + (𝑥10 −𝑥𝐵+ )2 + (𝑥11 −𝑥𝐵+ )2 +

+(𝑥12 − 𝑥𝐵+ )2 + (𝑥13 −𝑥𝐵+ )2 + (𝑥14 −𝑥𝐵+ )2 + (𝑥15 −𝑥𝐵+ )2 + (𝑥16 −𝑥𝐵+ )2

𝑆𝐴− : ෍(𝑥𝑛 −𝑥𝐴− )2 = (𝑥1 −𝑥𝐴− )2 + (𝑥2 −𝑥𝐴− )2 + (𝑥3 −𝑥𝐴− )2 + (𝑥4 − 𝑥𝐴− )2 +
+(𝑥9 −𝑥𝐴− )2 + (𝑥10 −𝑥𝐴− )2 + (𝑥11 −𝑥𝐴− )2 + (𝑥12 −𝑥𝐴− )2

𝑆𝐴+ : ෍(𝑥𝑛 −𝑥𝐴+ )2 = (𝑥5 −𝑥𝐴+ )2 + (𝑥6 −𝑥𝐴+ )2 + (𝑥7 −𝑥𝐴+ )2 +

+(𝑥8 − 𝑥𝐴+ )2 + (𝑥13 −𝑥𝐴+ )2 + (𝑥14 −𝑥𝐴+ )2 + (𝑥15 −𝑥𝐴+ )2 + (𝑥16 −𝑥𝐴+ )2

σ(𝑥𝑛 −𝑥ҧ𝐵− )2
Example: Solve the equation 𝑆𝐵− =
7
A10 16
3. Bonferroni Analysis
 Interaction Analysis Standard Deviations
A
-1 +1
B
𝑥1 ____ 𝑥5 ____
-1 𝑥2 ____ 𝑆𝐴−𝐵− 𝑥6 ____ 𝑆𝐴+𝐵−
𝑥3 ____ ____ 𝑥7 ____ ____
𝑥4 ____ 𝑥8 ____

𝑥9 ____ 𝑥13 ____

+1 𝑥10 ____ 𝑆𝐴−𝐵+ 𝑥14 ____ 𝑆𝐴+𝐵+
𝑥11 ____ ____ 𝑥15 ____ ____
𝑥12 ____ 𝑥16 ____

Example:
(𝑥1 −𝑥𝐴−𝐵−
ҧ )2 + (𝑥2 −𝑥𝐴−𝐵−
ҧ )2 + (𝑥3 −𝑥𝐴−𝐵−
ҧ )2 + (𝑥4 −𝑥𝐴−𝐵−
ҧ )2
𝑆𝐴−𝐵− =
3
A10 17
3. Bonferroni Analysis
 Analysis of Main Effects

Factor A Factor B
A- A+ B- B+
𝑥𝐴 𝑜𝑟 𝐵
Delta
𝑆𝐴 𝑜𝑟 𝐵
𝑆𝑃
Delta
𝑆𝑃

𝑥𝐴 𝑜𝑟 𝐵 = Average of a specific factor level.

Delta = Difference between 𝑥𝐴 𝑜𝑟 𝐵 factor levels.
𝑆𝐴 𝑜𝑟 𝐵 = Standard Deviation of a specific factor level.
𝑆𝑃 = Pooled Standard Deviation by factor.

A10 18
3. Bonferroni Analysis
 Analysis of Interaction Effects

A- A+
A-B- A-B+ A+B- A+B+
𝑥𝐴𝐵
Delta
𝑆𝐴𝐵
𝑆𝑃
Delta
𝑆𝑃

𝑥𝐴𝐵 = Average of a specific factor combination level.

Delta = Difference between 𝑥𝐴𝐵 at specific factor combinations at a
Main effect level
𝑆𝐴𝐵 = Standard Deviation of a specific factor combination level.
𝑆𝑃 = Pooled Standard Deviation by factor.

A10 19
3. Bonferroni Analysis
 Significance Via Delta/Standard Deviation
Critical Risk for 95% Confidence with Multiple Contrasts
0.08 Variable
Assumes 2k full factorial, n=16, and,
Main Effect Risk
0.07
equal variance between treatments Interaction Risk

0.06
Risk Probability

0.05 0.05 1 contrast

0.04

0.03

0.02
0.017 3 contrasts
0.01
0.007 7 contrasts
0.003 15 contrasts
0.00

1 2 3 4 5 6
Delta/Standard Deviation

A10 20
3. Bonferroni Analysis