Professional Documents
Culture Documents
Experiments & Design of Experiments (Doe)
Experiments & Design of Experiments (Doe)
• Introduction
• Timelines in history of DoE
• Terminologies in DoE
• Principles of DoE
• Stages of DoE
• Scope of DoE
• Planning and implementation of DoE
• Importance of DoE
• Application of DoE techniques
Design of experiments (DoE)
• Engineering experiments need to be designed carefully as time and
resource/ budgets are limited
• Used in production and quality control activities
• All experiments are designed experiments, but some are poorly
designed and some are well-designed
Experimental units(EU’s)
The entities that receive an independent application of one of the experiment’s
treatments
Subjects/things we apply treatments
Treatments or runs(levels)
The set of conditions under study
Treatments are applied to EU’s and responses are measured
4.Non-manufacturing/non-product
development activities
– Marketing
– Market research
– Transactional and service operations
– General business operations
Strategy of Experimentation
• Experimental design
– Important tool in the scientific and engineering world
– Helps to improve the product realization process
– Critical components are new manufacturing process design
and development, and process management
Applications of DoE
• Broad application in many disciplines
• Generate data from the process, and then use the
information or data to establish new inferences, which lead
to new experiments
• Application of DoE techniques early in process
development can result in:
– Improved process yields
requirements
Robustness
• Under what conditions do the response variables of interest
seriously degrade?
or
• What conditions would lead to unacceptable variability in the
response variables?
Empirical Models
Principles of DOE---Randomization
Box plot
High values of F-ratio indicates at least one of the treatment means differ
from others
Testing: The two sample t-test
• For the two sample t-test both samples are assumed to come from
Normal populations with (possibly different) means μi and
variances σ2
• Chi-squared distribution
• t-distribution
Useful sampling distributions
• F-distribution
Chi-squared table
Mortar data
Basic statistical concepts
Sampling and Sampling Distributions
• Random Samples
• Sample Mean
• Sample Variance
Inferences about differences in mean
• Hypothesis testing
In the mortar example, we assume that
and are coming from two independent
normal population
Inferences about differences in mean
Inferences about differences in mean
Two sample t-test
Two sample t-test
Example of t-test
Testing hypothesis
Paired comparison designs
Diet medicine example
Hardness testing example
Advantages of paired comparison design
Blocking
• Important design technique in industrial experimentation
• Systematically eliminates the effect of nuisance factors of variability on
the statistical comparisons among treatments
• The source of variability is known and controllable
Blocking factors
– Units of test equipment or machinery
– Batches of raw material, people, and time
Types of Designs-RCBD
• The RCBD is a generalization of the paired t-test concept
• The RCBD is one of the most widely used experimental designs
• Noise reduction design technique
• Increases the signal-to-noise ratio in the data
• Improves the precision with which treatment means are compared
Statistical Analysis of the RCBD
• The statistical model for the RCBD can be written in
several ways.
• The traditional model is an effects model:
• Each letter occurs once and only once in each row and column
Latin square designs
ANOVA for Latin Square Designs---without replications
Latin square designs--Example
Latin square designs—Example with coded data
Latin square designs---ANOVA
Exercises--LSD
• An industrial engineer is investigating the effect of four
assembly methods (A, B, C, D) on the assembly time for a
color television component.
• Four operators are selected for the study.
• Furthermore, the engineer knows that each assembly
method produces such fatigue that the time required for the
last assembly may be greater than the time required for the
first, regardless of the method.
• That is, a trend develops in the required assembly time.
• To account for this source of variability, the engineer uses
Exercises---LSD
Exercises---LSD
Latin square designs with missing value
Replication of Latin squares
Replication of Latin squares
• A Latin square may be replicated in several ways:
ANOVA for LSD with replications
ANOVA for Latin square designs---with replications
Graeco-Latin square design
There are Graeco-Latin square designs for any
size n except for n=1,2 & 6
Graeco-Latin square design
Graeco-Latin square design
Graeco-Latin square design
Graeco-Latin square-Example
• Testing three different types of gasoline:
– Three drivers
– Three vehicles
– Three gasoline types(treatments)—Latin Letters
– The test need to be performed each day---Greek letters
• The test/experiment is too complicated to be performed in one day
hence need to be performed over three days
• In this case, using drivers and vehicles over three separate days
could result in systematic errors
• To eliminate these errors we construct a Graeco-Latin square
experimental design
• In this case, each type of gasoline (treatment) will be tested:
o just once with each driver
o once with each vehicle
o once each day
Graeco-Latin square design---ANOVA
• In this Graeco-Latin square design, the different types of
gasoline are represented by the Latin letters A, B & C and
the different days by α, β & γ
• After eliminating the effects of the lines or rows (vehicles),
the columns (drivers),the greek letters (days), ANOVA
helps to know whether there is a significant difference b/n
the types of gasoline or not.
Graeco-Latin square design--Example
Balanced incomplete block design(BIBD)
Balanced incomplete block design(BIBD)
BIBD---Example
BIBD--ANOVA
BIBD--ANOVA
Completely randomized design (CRD)
One-factor-at-a-time experiments (OFAT)
• a dominant, but potentially disastrous type of experimentation
• Commonly used by many engineers and scientists in both
industry and academia
• Tests conducted by systematically changing the levels of one
factor holding the levels of all other factors fixed
• The “optimal” level of the first factor is then selected
• Subsequently, each factor in turn is varied and its “optimal” level
selected while the other factors are held fixed
• It can not detect the unique effects of combinations of factors
(interaction)
One-factor-at-a-time experiments (OFAT)
• OFAT experiments are:
o Easier to implement
o More easily understood
o Better than trial and error
o Believed to provide the optimum combinations of the factor
levels
o Unfortunately, each of these beliefs can be false except
under very special circumstances
– It is only conducted under very special circumstances;
– Because it does not provide:
o adequate information on interactions
o efficient estimates of the effects
Factorial design--Basic definition and principles
• Many experiments involve the study of the effects of two
or more factors
• In this case, all of the possible combinations of factors’
level are investigated
• When factors are arranged in factorial design, they are
said to be crossed
• For example, if there are a levels of factor A and b levels of
factor B, each replicate contains all ab treatment
combinations
Factorial design--Basic definition and principles
• Effect of a factor:
o the change in response due to a change in the level of the factor
Since the effect of A depends on the level chosen for factor B, we see
that there is interaction between A and B
Two-level factorial design-all factors at two levels
Factorial design
• A tool that experiment many factors simultaneously
• Simplest factorial design is two factors each at two levels
• These designs are excellent in screening many factors to
identify the vital few
• They reveal interactions which is never be found using
OFAT method
OFAT vs factorial design
In Factorial designs;
Factorial OFAT
Factorial OFAT
High High
Factor B Factor B
Low Low
Fig. Scores from the golf experiment in the previous figure and
calculation of the factor effects
Factorial designs with several factors
Fig. A four-factor factorial experiment; type of driver, type of ball, type of beverage & mode of
travel
Generalization to two Factor FD
Testing Hypothesis
Example 2^2
Example 2^2
Example 2^2
Sum of Squares
Blocking a Replicated 2^k Factorial Design
2 Factor FD Examples
Example
Interaction--Example
Interaction--Example
General Factorial Design
General Factorial Design without interaction
effect
Model with significant interaction effect
Relative efficiency of FD over OFAT
Factorial Experiment--Example
Factorial Experiment--Example
FD with and with out Blocking
Example--- ull Factorial Designs
Example---ull Factorial Designs
Example--- full factorial
Example--- full factorial designs
Example--- full factorial designs
Example--- full factorial designs
Example---full factorial designs
Example--- full factorial
Example--- full factorial
Example---full factorial
Example--- full factorial
Example--- full factorial
Example--- full factorial
Example--- full factorial
Main and interaction effects
Chopping terms in the model
Analyzing in Minitab
Analyzing in Minitab
Analyzing in Minitab
Analyzing in Minitab
Using the model
FFEs
• Fractional factorials manly used in screening experiments
• Screening experiments are used when many factors are considered and the
objective is to identify those factors with large effects
• Usually performed in the early stages of a project when many of the factors
initially considered likely have little or no effect on the response
• The important factors are then investigated more thoroughly in subsequent
Experiments
The successful use of fractional factorial designs(FFDs) is based on three key
ideas:
– The sparsity of effects principle: When there are several variables, the
system or process is likely to be driven primarily by some of the main
effects and low-order interactions
– The projection property: FFDs can be projected into stronger (larger)
designs in the subset of significant factors
– Sequential experimentation: it is possible to combine the runs of two (or
more) fractional factorials to construct sequentially a larger design to
estimate the factor effects and interactions of interest
Sound Strategy of Experimentation
Three stages
• Screening the vital few factors (20%) from the trivial
many(80%)
• Characterizing main effects and interactions
• Optimizing (typically via response surface methods)
• AC=BD
• AD=BC
• The main effects are aliased with the 3-way interactions
effect for X3
Run X1 X2 X3
1 -1 -1 -1
2 +1 -1 +1
3 -1 +1 +1
4 +1 +1 -1
A Notation and Method for Generating Confounding
or Aliasing
• A short way of writing 'X3 = X1*X2' ( '3 = 12') or X3 = -X1*X2 (3 = -
12)
• Any column multiplied by itself gives the identity column of all
1's.
• (3=12)* 3 ---33=123, or I=123 since 33=I (or a column of all
1's)
• 2I=2123, or 2=2123, or 2=1223, or 2=13; since 2I=2, 22=I, and
1I3=13 Run
X1 X2 X3
• 1=23 because I=123
1 -1 -1 +1
2 +1 -1 -1
3 -1 +1 -1
4 +1 +1 +1
A Notation and Method for Generating Confounding or Aliasing
• Main effect estimates from fractional factorial not as good as full
factorial
• I=123 is a design generator or a generating relation for 23-1design
(the dark-shaded corners)
• I=-123 is a design generator or a generating relation for 23-1design
(the light-shaded corners)
• I=123 the defining relation for the 23-1 design that can generate (by
"multiplication") the complete confounding pattern for the design
• From I=123, we can generate the set of {1=23, 2=13, 3=12,
I=123}, which is the complete set of aliases or all columns for 23-
1
fractional factorial design
A Notation and Method for Generating Confounding or Aliasing
• The confounding pattern described by 1=23, 2=13, and 3=12 tells
the main effects of the 2^3-1 design are confounded with two-factor
interactions
(limitations of 2^3-1 Fractional factorial design)
• Typically used when the number of factors and levels are small
• When all possible interaction information is required
• Hence the most commonly used factorial designs are 2k full
factorials
Type of Designs
• Screening designs are among the most popular designs for
industrial experimentation
• Typically used in initial stages of experimentation to narrow down
the long list of potentially important factors and interactions to
only a few important effects
• Usually requires fewer experimental runs than other designs
• The experiments are small and efficient, involving many factors
• Some classical screening designs include fractional factorial
designs, Plackett-Burman, Cotter and mixed-level designs
y=f(x1,x2)+E
E refers to noise or error observed in the
response y
E(y)=f(x1,x2) is called a response surface
Contour plot of the RSM
• In most RSM problems, the form of the relationship between the
response and the independent variables is unknown
• The first step in RSM is to find a suitable approximation for the
true functional relationship between y and the set of independent
variables.
• Usually, a low-order polynomial in some region of the
independent variables is employed
• If the response is well modelled by a linear function of the
independent variables, then the approximating function is the
first-order model
• If there is curvature in the system, then a polynomial of higher
degree must be used, such as the second-order model
Contour plot of the RSM
• Once the region of the optimum has been found, a more elaborate
model, such as the second-order model, may be employed, and
an analysis may be performed to locate the optimum
Sequential procedure of RSM
• E.g. Study on extraction of plant material in high yield and quality and
determine optimum conditions for this extraction process
• Noise factors are process or design parameters that are difficult or expensive
to control during manufacturing.
• Examples:
– Ambient temperature
– Humidity
• Consider a cake mixture manufacturer who wants to optimize cake flavor under
various conditions
• The manufacturer wants to determine:
– Control factors (which are in the manufacturer's control--cake mixture ingredients)
that reduce the effect of noise factors on cake flavor
– Noise factors (which are out of the manufacturer's control--air temperature and
humidity) while the consumer is making the cake
Features of Taguchi DOE
Strength
• It requires very few runs to get excellent insight into process
control
weakness
• It requires expert process knowledge to select the correct factors
• Analysis for the process at one location may be totally inadequate
for another location if they have different equipment or
management approach
• It uses its own unique terminology with different meaning as with
other DOE methodologies
• There are three terms in particular that are unique in their usage
within Taguchi DOE
• Control factors are the factors controlled by the operator
Features of Taguchi DOE
• There may be other factors that control the process, but if the
operator does not have access to them, they are not Taguchi
Control Factors
• Noise factors are all factors being analyzed that are not control
factors
• Controlled by other factors that are part of the system, and factors
in the environment
• They may have a significant effect, but they are “noise” from the
operator stand point
• Taguchi labels a process optimization as robust if the operator is
able to control it
• The process may actually be very fragile, but if it is fully
controlled by the operator, Taguchi calls it robust
Application of Taguchi DOE
• Only use this approach with process improvement projects
• A process expert is required as an advisor when setting up a
Taguchi DOE; otherwise picking the control and noise factors is
difficult
• Be very careful with the terminology – Taguchi terms do not carry
the normal meaning of the terms
• Taguchi arrays do not use the plus 1 and minus 1 settings for high
and low; they use one and two
• However, the Taguchi arrays are still balanced and orthogonal
• The use of the different numbers should not matter once values
for high, low and midpoints are recorded
Robust parameter design
• One of the classical approaches used to achieve robustness is to:
– Redesign the product using stronger components or
components with tighter tolerances
– Use different materials
– However, this may lead to problems with overdesign
– Overdesign leads to more expensive product, more difficult to
manufacture, or suffers a weight and subsequent performance
penalty
– Sometimes different design methods or incorporation of new
technology into the design can be exploited
Robust Design Problem
• Robust design problem mainly focus on one or more of the
following:
– Designing systems that are insensitive to environmental
factors that can affect performance once the system is
deployed in the field
(e.g. development of an exterior paint that should exhibit long
life when exposed to a variety of weather conditions)
– Designing products so that they are insensitive to
variability transmitted by the components of the system
(e.g. designing an electronic amplifier so that the output voltage
is as close as possible to the desired target regardless of the
variability in the electrical parameters of the transistors, resistors,
and power supplies that are the components of the system)
Robust Design Problem
– Designing processes so that the manufactured product will
be as close as possible to the desired target specifications,
even though some process variables (such as temperature) or
raw material properties are impossible to control precisely
• The design for the single noise factor is a 2^1 design, and it is
called the outer array design
• Notice how each run in the outer array is performed for all eight
treatment combinations in the inner array, producing the crossed
array structure
• In the leaf spring experiment, each of the 16 distinct design
points was replicated three times, resulting in 48 observations on
free height
Example of Crossed array design
The role of the control Vs noise interaction in RD
Example of Crossed array design
Example of Crossed array design
• Examination of the crossed array design in Table 12.2 reveals
a major problem with the Taguchi design strategy; namely, the
crossed array approach can lead to a very large experiment
• In our example, there are only seven factors, yet the design has
72 runs. Furthermore, the inner array design is a 3^(4-2)
resolution III design
• In spite of the large number of runs, we cannot obtain any
information about interactions among the controllable
variables
• Indeed, even information about the main effects is potentially
tainted because the main effects are heavily aliased with the
two-factor interactions
Analysis of the Crossed Array Design
• In Taguchi method, data are summarized from a crossed array
experiment with two statistics:
– the average of each observation in the inner array across all runs in the outer
array
– a summary statistic that attempted to combine information about the mean and
variance, called the signal-to-noise ratio.
• Signal-to-noise ratios are supposedly defined so that a maximum value
of the ratio minimizes variability transmitted from the noise variables
• Variance model
Batch 1 from supplier 1 has no connection with batch 1 from any other supplier, batch 2
from supplier 1 has no connection with batch 2 from any other supplier, and so forth
To emphasize the fact that the batches from each supplier are different batches, we may
renumber the batches as 1, 2, 3, and 4 from supplier 1; 5, 6, 7, and 8 from supplier 2; and
9, 10, 11, and 12 from supplier 3
Statistical analysis
• The linear statistical model for the two-stage nested design is:
• That is, the A treatment effects sum to zero, and the B treatment effects sum to
zero within each level of A
• Mixed models with A fixed and B random are also widely encountered
Statistical analysis
Example---a two-stage nested design
• Consider a company that buys raw material in batches from
three different suppliers
• The purity of this raw material varies considerably, which
causes problems in manufacturing the finished product
• We wish to determine whether the variability in purity is
attributable to differences between the suppliers
• Four batches of raw material are selected at random from each
supplier, and three determinations of purity are made on each
batch
Example---a two-stage nested design
Practical implications of SP designs
• The practical implications of this experiment and the analysis are
very important
• The objective of the experimenter is to find the source of the
variability in raw material purity
• If it results from differences among suppliers, we may be able to
solve the problem by selecting the “best” supplier
• However, that solution is not applicable here because the major
source of variability is the batch-to-batch purity variation within
suppliers
• Therefore, we must attack the problem by working with the
suppliers to reduce their batch-to-batch variability
• This may involve modifications to the suppliers’ production
processes or their internal quality assurance system
A three-stage staggered nested design
Sources of variation in the 3-stage nested design example
ANOVA for 3-stage nested design
Designs with Both Nested and Factorial Factors
Because there are only three fixtures and two layouts, but
the operators are chosen at random, this is a mixed model
Expected Mean Square
Type of Designs
• Split plot designs are typically used when an experiment involves hard-to-change
variables
• E.g. temperature of an industrial oven or the location of a cornfield
• Traditional randomized experiments require factors to be tested for each run, which
is impractical in this case
• Split plot design is a blocked experiment, having the blocks serve as experimental
units for a subset of factors
• In split plot experiments, a treatment is applied to more than one experimental unit
because a factor(s) is associated with batch processing, or it is hard or costly to
change
• As a result, split plot experiments are more practical to be carried out in the industrial
world
• Examples split-split plot design (nested relationship) & strip plot design (cross
relationship)
Goal: Enable experiments to be carried out even with presence of hard-to-change variables.
Split plot designs
• A split-plot design is an experimental design in which
researchers are interested in studying two factors in which:
– One of the factors is “easy” to change or vary.
– One of the factors is “hard” to change or vary.
• This type of design was developed in 1925 by mathematician
Ronald Fisher for use in agricultural experiments.
• To illustrate the idea of the split-plot design, consider an
example in which researchers want to study the effects of two
irrigation methods (Factor A) and two fertilizers (Factor B) on
crop yield.
Split plot---Example
• When the center points are set at the usual operating recipe in a factorial
experiment, the observed responses at these center points provide a rough
check of whether anything “unusual” occurred during the experiment
• The center point responses can be plotted directly on the control chart as a
check of the manner in which the process was operating during the
experiment
Center Points
• Center points are used with quantitative factors
• Sometimes with majority quantitative and few qualitative
factors
• To illustrate, consider an experiment with two quantitative
factors, time and temperature, each at two levels, and one
qualitative factor, catalyst type, also with two levels (organic
and nonorganic)
CCD
• Two parameters in the CCD design
– the distance of the axial runs from the design center =alpha
– the number of center points nC
• Rotatablity: it is important for the second-order model to provide
good predictions throughout the region of interest
• Variance is the same at all points x that are at the same distance
from the design center
• The variance of predicted response is constant on spheres
• With proper choice of nc the CCD can be made orthogonal or it can be made
uniform precision design
• It means that the variance of response at origin is equal to the variance of
response at a unit distance from the origin
• Considering uniform precision, for three-factor experimentation, eight (23)
factorial points, six axial points (2 × 3) and six centre runs, a total of 20
experimental runs may be considered and the value of α is (8)1/4 = 1.682
Face-centred CCD with 3 factors
Different CCD designs
CCD Type Descriptions
• CCC designs are the original form of the central composite design
• The star points are at some distance from the center based on the
properties desired for the design and the number of factors in the
Circumscribe design
• The star points establish new extremes for the low and high
d settings for all factors
(CCC) • These designs have circular, spherical, or hyper spherical
symmetry and require 5 levels for each factor
• Augmenting an existing factorial or resolution V fractional
factorial design with star points can produce this design
• The limits specified for factor settings are truly limits,
• CCI design uses the factor settings as the star points and creates a
Inscribed factorial or fractional factorial design within those limits
• A CCI design is a scaled down CCC design with each factor level
(CCI)
of the CCC design divided by α to generate the CCI design)
• Requires 5 levels of each factor
• In this design the star points are at the center of each face
of the factorial space, so α = ± 1
Face • Requires 3 levels of each factor
Centered(CCF)
• Augmenting an existing factorial or resolution V design
with appropriate star points can also produce this design
Types of CCD
• The CCC explores the largest process space and the CCI explores
the smallest process space
• Both the CCC and CCI are rotatable designs
• The CCF is not rotatable design
• In the CCC design, the design points describe a
circle circumscribed about the factorial square
• For three factors, the CCC design points describe a sphere around
the factorial cube
• The value of α is chosen to maintain rotatability
• To maintain rotatability, the value of α depends on the number of
experimental runs in the factorial portion of the CCD:
α=[number of factorial runs]1/4
• If the factorial is a full factorial, then α=[2k]1/4
• However, the factorial portion can also be a fractional factorial
design of resolution V.
Determining α for Rotatability
Number of Factorial Scaled Value for α
Factors Portion Relative to ±1
2 22 22/4 = 1.414
3 23 23/4 = 1.682
4 24 24/4 = 2.000
5 25 25/4 = 2.378
6 26 26/4 = 2.828
Orthogonal blocking
• The value of α also depends on whether or not the design is orthogonally
blocked
• The design is divided into blocks such that the block effects do not affect
the estimates of the coefficients in the second order model
• Under some circumstances, the value of α allows simultaneous rotatability
and orthogonality
BLOCK X X
• One such example for k = 2 is shown in the 1 2
1 -1 -1
table: 1 1 -1
1 -1 1
1 1 1
1 0 0
1 0 0
2 -1.414 0
2 1.414 0
2 0 -1.414
2 0 1.414
2 0 0
2 0 0
Structural Comparisons of CCC (CCI), CCF, and Box-Behnken
Designs for 3 Factors
CCC (CCI) CCF Box-Behnken
Rep X1 X2 X3 Rep X1 X2 X3 Rep X1 X2 X3
1 -1 -1 -1 1 -1 -1 -1 1 -1 -1 0
1 +1 -1 -1 1 +1 -1 -1 1 +1 -1 0
1 -1 +1 -1 1 -1 +1 -1 1 -1 +1 0
1 +1 +1 -1 1 +1 +1 -1 1 +1 +1 0
1 -1 -1 +1 1 -1 -1 +1 1 -1 0 -1
1 +1 -1 +1 1 +1 -1 +1 1 +1 0 -1
1 -1 +1 +1 1 -1 +1 +1 1 -1 0 +1
1 +1 +1 +1 1 +1 +1 +1 1 +1 0 +1
1 -1.682 0 0 1 -1 0 0 1 0 -1 -1
1 1.682 0 0 1 +1 0 0 1 0 +1 -1
1 0 -1.682 0 1 0 -1 0 1 0 -1 +1
1 0 1.682 0 1 0 +1 0 1 0 +1 +1
1 0 0 -1.682 1 0 0 -1 3 0 0 0
1 0 0 1.682 1 0 0 +1
6 0 0 0 6 0 0 0
Total Runs = 20 Total Runs = 20 Total Runs = 15
Factor Settings for CCC and CCI Designs for 3Factors
Central Composite Central Composite
Circumscribed CCC Inscribed CCI
SN X1 X2 X3 SN X1 X2 X3
1 10 10 10 1 12 12 12
2 20 10 10 2 18 12 12
3 10 20 10 3 12 18 12
4 20 20 10 4 18 18 12 Factorial
5 10 10 20 5 12 12 18 points in
the design
6 20 10 20 6 18 12 18
7 10 20 20 7 12 12 18
8 20 20 20 8 18 18 18
9 6.6 15 15 * 9 10 15 15
10 23.4 15 15 * 10 20 15 15
11 15 6.6 15 * 11 15 10 15
Star
12 15 23.4 15 * 12 15 20 15
points
13 15 15 6.6 * 13 15 15 10
14 15 15 23.4 * 14 15 15 20
15 15 15 15 15 15 15 15
16 15 15 15 16 15 15 15
17 15 15 15 17 15 15 15 System
18 15 15 15 18 15 15 15 recomm
19 15 15 15 19 15 15 15 ended
20 15 15 15 20 15 15 15 center
points
CCC vs CCI
• In the CCC design how the low and high values of each factor
have been extended to create the star points
• In the CCI design, the specified low and high values become the
star points
• The system computes appropriate settings for the factorial part of
the design inside those boundaries
Factor Settings for CCF & Box-Behnken Designs for 3 Factors
CCF Box-Behnken
SN X1 X2 X3 SN X1 X2 X3
1 10 10 10 1 10 10 15
2 20 10 10 2 20 10 15
3 10 20 10 3 10 20 15
4 20 20 10 4 20 20 15
5 10 10 20 5 10 15 10
6 20 10 20 6 20 15 10
7 10 20 20 7 10 15 20
8 20 20 20 8 20 15 20
9 10 15 15 * 9 15 10 10
10 20 15 15 * 10 15 20 10
11 15 10 15 * 11 15 10 20
12 15 20 15 * 12 15 20 20
13 15 15 10 * 13 15 15 15
14 15 15 20 * 14 15 15 15
15 15 15 15 15 15 15 15
16 15 15 15
17 15 15 15
18 15 15 15
19 15 15 15
20 15 15 15
Summary of Properties of Classical RSDs
Design Type Comment
• CCC designs provide high quality predictions over the entire design space, but
require factor settings outside the range of the factors in the factorial part
• Note: When the possibility of running a CCC design is recognized before starting a
CCC
factorial experiment, factor spacings can be reduced to ensure that ± for each
coded factor corresponds to feasible (reasonable) levels
• Requires 5 levels for each factor
• CCI designs use only points within the factor ranges originally specified, but do not
CCI provide the same high quality prediction over the entire space compared to the CCC
• Requires 5 levels of each factor
• CCF designs provide relatively high quality predictions over the entire design space
and do not require using points outside the original factor range.
CCF • However, they give poor precision for estimating pure quadratic coefficients.
• Requires 3 levels for each factor
• These designs require fewer treatment combinations than a central composite design
in cases of 3 or 4 factors
• The Box-Behnken design is rotatable (or nearly so) but it contains regions of poor
prediction quality like the CCI
Box-Behnken
• Its "missing corners" may be useful when the experimenter should avoid combined
factor extremes
• This property prevents a potential loss of data in those cases
• Requires 3 levels for each factor
Number of Runs Required by CC and Box-Behnken Designs
5 33 (fractional factorial) or 46
52 (full factorial)
6 54 (fractional factorial) or 54
91 (full factorial)
Desirable Features for Response Surface
Designs
• Satisfactory distribution of information across the experimental region
– rotatability
• Fitted values are as close as possible to observed values
– minimize residuals or error of prediction
• Good lack of fit detection
• Internal estimate of error
• Constant variance check
• Transformations can be estimated
• Suitability for blocking
• Sequential construction of higher order designs from simpler designs
• Minimum number of treatment combinations
• Good graphical analysis through simple data patterns
• Good behavior when errors in settings of input variables occur
Prediction variances of 2-factor R, O&RO CC designs
Parameters of R,O,RO CC designs
irrelevant
• But for a screening study, the risk of missing critical effects will be
less
matrix