METTU UNIVERSITY

College of Engineering and Technology

Chemical Engineering Department
RESEARCH METHODS AND PROJECT PROPOSAL

Lecture
on
Design and Analysis of Experiments

Aim
Contents  to describe and explain the variation of
 Introduction information under conditions that are
 Defining research problem hypothesized to reflect the variation
 Selection of the Responses
 Statistical Analysis
Design of Experiment is a problem-solving tool
 Introduction to Design of Experiment (DOE)
Research design is a set of advance decisions that make up the master plan
specifying the methods and procedures for collecting and analyzing the needed
information.
a. Sampling Design: deals with the method of selecting items to be observed for
the given study.
b. observational design: relates to the conditions under which the observations
are to be made.
c. Statistical Design: concerns with the question of how many items are to be
observed and how the information and data gathered are to be analyzed.
d. Operational Design: deals with the techniques by w/c the procedures specified
in the sampling, statistical and observational designs can be carried out.

Design of Experiment is a problem-solving tool 1

 Experiment

• An experiment is defined as manipulating an IV to see how it affects a DV

while also controlling the effects of additional extraneous variables.
• Experiments are used widely in the engineering world
 Process characterization & optimization
 Evaluation of material properties
 Product design & development
 Component & system tolerance determination
 An experiment is a test or a series of tests
Why is designing an experiment important?
To ensure that the right type of data and a sufficient sample size and power are
available to answer the research questions of interest as clearly and efficiently as
possible.
Design of Experiment is a problem-solving tool 3
 Engineering Experiments

• Reduce time to design/develop new

products & processes
• Improve performance of existing
processes
• Improve reliability and performance of
products
• Achieve product & process robustness
• Evaluation of materials, design
alternatives, setting component &
system tolerances, etc.

Design of Experiment is a problem-solving tool 4

 What is Design of Experiment?
• Design of Experiment (DOE) is the logical
planning of an experiment.
• Reliable process for stating and solving problems
in the natural world.
• Done to obtain certain relevant observations
regarding the hypothesis under study.
• The design includes:
i. planning of the experiment,
ii. obtaining observations from it
iii. making a statistical analysis of these
observations.
iv. Reach on conclusion

DOE is a body of knowledge and techniques that assist the experimenter to:
 conduct experiment economically,
from the analysis and the original
 analyze the data, and
objectives of the investigation.
 make connections between the conclusions

Design of Experiment is a problem-solving tool 5

 Terminology used in DOE
Terminology Definition
Response variable (RV) The outcome of an experiment
Factor Each variable that affects the RV and has several alternatives

Level of factors The values that a factor can assume

Primary factor The factors whose effects need to be quantified

Secondary factor Factors that impact the performance but whose impact we are not
interested in quantifying

Experiment unit Any entity that is used for the experiment

Interaction Two factors A and B interact if the effect of one depends upon the level
of the other

Replication Repetition of all or some experiments

Treatment One set of levels of all factors employed in a given experimental trial

Effect Effect of a factor is the change in RV due to change in the level of IV

Design of Experiment is a problem-solving tool 6

 Basic Principles of DOE
• Randomization
– The use of statistical methods requires randomization in any experiment
– Running the trials in an experiment in random order
– Notion of balancing out effects of “lurking” variables
– Avoid bias and Control the role of chance
• Replication
 involves the repetition of the experiment
 obtain the magnitude of experimental error
 improving precision of effect estimation
• Blocking
– Design technique used to improve the precision of the experiment
– A portion of the experimental material that should be more homogeneous than
the entire set of material
– Also a restriction on complete randomization
– Reduce or eliminate the effect of nuisance factors or noise factors

Design of Experiment is a problem-solving tool 7

 What are the steps to follow?
1. Observe (a visible or provable
2.
fact)
1. 2. Formulate a Question (Problem
3. Statement)
3. Selection factors, level & ranges
4. Choice of experiment design
(sequentially)
5 and 6. 4. 5. Conducting experiment and
record data
6. Analyze the Results
7. Draw a Conclusion and
communicate the results
7.

Design of Experiment is a problem-solving tool 8

 Ask a Series of Questions
 DOE is a multistep process that each experiment gives us answers that generate
more questions
Question Experiment(E) Q E Q E Q E
(Q)

Answer A A A
Careful observations lead to questions that
• From where ???????
arise…
– Curiosity
Screen: Which are the biggest – Information Gaps
factors?
– Controversy
Characterize: What is the relationship between – Replication
responses and factors?
– Literature Review
Optimize: What is the best setting of – Other People
the factors? – ...???
Verify: Are the results repeatable?

Design of Experiment is a problem-solving tool 9

 Selection of Research Problem
• A Problem Statement is a question that
compares two variables.

A Variable is anything that changes.

Independent variable: • variable we manipulate, or

change
Dependent variable:  changes as a result of the IV
 Variable that measured and recorded.
*Remember,
The dependent variable depends on the independent variable!!
– Example: Does the change in the length of daylight
affect the leaf color of deciduous trees?

Design of Experiment is a problem-solving tool 10

 Selection of Research Problem

There are two factors in the selection of topic:

 External criteria
 involves how the topic is important for the field, availability of both data and
data collection methods and the administration is cooperative or not.
Personal Criteria
 means researcher own interest, time and cost.

If a researcher has personal interest in the topic, he/she

• Personal Inclination would select that problem for his/her research work

• Resources Availability money, time, accommodation and transport are available

to the selection place, etc..

• Relative Importance If the problem is relatively important, then the researcher

tends towards the selection of the problem

Design of Experiment is a problem-solving tool 11

 Some characteristics for Selection of Research Problem
• Researcher knowledge: The wisdom and experience of an investigator is required for
well collection of the research data. He/ She can bitterly select a
problem
• Practicality:  The practical usefulness of the problem is the main motivation
for a researcher to attend it

• Time-lines of the Problem:  some problems take little time for its solution while others
take more time. So, it depends on the time in which we have
to complete his research work
• Data Availability:  If the desired data is available to the researcher, then the
problem would be selected
• Urgency: Urgent problem must be given priority because the immediate solution
  can benefit the people
• Feasibility:
The researcher qualification, training and experience should match
• Area Culture: the problem
The culture of the area for which a researcher conducts his research is
also responsible for the selection of research problem
www.studylecturenotes.com

Design of Experiment is a problem-solving tool 12

 Difference between a constant and a control
A CONSTANT
• variable that does not change through the entire experiment
• a value that remains the same.

VS.

• The CONTROL is the group or condition that is used as the basis for
comparison for the results of the changes in the independent variable

• A Controlled Experiment means that only ONE independent Variable is being

tested at a time!!!
• This allows the scientists to evaluate the results of the one thing being tested!!!

Design of Experiment is a problem-solving tool 13

 Process, Responses, and Factors
Best practices for selecting response variables

 Measurable: The response of interest can be observed and recorded at a

reasonable cost and without affecting the test outcome.
 Valid: Measures should directly address the test objectives and be
carried out with some degree of precision and consistency.
Factors Responses

Silver laydown, Film Speed,

Finish time … Building Contrast

Time, Chemical Yield,

Catalyst… Process Purity

Transport speed, Digital Image resolution,

Capture lens... Imaging Banding
Design of Experiment is a problem-solving tool 14
 Hypothesis Statement

• A hypothesis is the stated outcome predicted to the problem statement

that will be evaluated by the experiment
• This is your expected results or your “educated guess” to the problem at
hand.

Example: If a superball is dropped from increasing heights, then the

bounce height will also increase because....

Design of Experiment is a problem-solving tool 15

 Formatting your Hypothesis
1. If blah blah blah, then blah blah blah because…

OR

2. As a statement (3rd person always!!!)

Example: The bounce height of the superball will increase

in direct proportion (this means the graph of the results
will be a straight line with a constant slope) with the
increase in drop height.

Design of Experiment is a problem-solving tool 16

 Writing a Great Procedure!
1. Written in outline or list form (step #1 is
never ‘gather all materials’!!!)
2. Always be written in the third person…
(no personal pronouns!)
3. It must be repeatable! A clear, concise
list of each step to follow
includes
• tools used,
• measurements taken,
• location,
• anything necessary to exactly replicate
your procedure….etc
4. Directions to follow for making and taking
observations over time!

Design of Experiment is a problem-solving tool 17

 Collecting DATA

QUANTITATIVE
• This is a NUMBER or “quantity”
• an objective measure or
observation
• measured numerically
Examples: Distance, mass,
QUALITATIVE volume, density
• This is a WORD or “quality”
• a subjective measure other than an
number
• categorical in nature
Examples: An odor, color, texture,
taste, etc.

Design of Experiment is a problem-solving tool 18

Data Tables

1. TITLE that identifies both the IV and DV

4. Calculations are
generally to the right
3. Y Axis – DV columns - after stated
data

2. X Axis – IV

Design of Experiment is a problem-solving tool 19

 Graphs
• Graphs help to communicate and visualize quantitative
(numeric) data.
• The most common forms we will use include:
1. LINE GRAPH
2. BAR GRAPH
3. PIE CHART (rare)

Design of Experiment is a problem-solving tool 20

 All Graphs will include:
1. TITLE: The Effect of the (IV) on the (DV)
notice that all words in the title are capitalized except for prepositions.

4. KEY for data

2. Y-Axis = DV
series
that will include:
• Labels
• Unit Measures
• Appropriate
scale to fit the
data 3. X-Axis = IV that will include:
• Labels
• Consistent • Unit Measures
increments • Appropriate scale to fit the data
• Consistent increments

Design of Experiment is a problem-solving tool 21

 This compares a
number to a number!

Design of Experiment is a problem-solving tool 22

Design of Experiment is a problem-solving tool 23
Design of Experiment is a problem-solving tool 24
Interpreting the Results

Design of Experiment is a problem-solving tool 25

 Conclusion
The concluding paragraph (5-8 sentences)
should include the following:
1. Restate the problem statement.
2. Restate the hypothesis.
3. Accept or reject the hypothesis using the analysis of your data. Be
specific, proving your point with specific data points and trends.
4. Include a discussion of the validity of your results.
5. How might this experiment be improved or modified to further test
the problem statement.
6. Summarize or restate you conclusion to finish up!

***This must be written in the third person!***

Design of Experiment is a problem-solving tool 26

 Communication
 Sharing of information is essential to scientific process

Theory Scientific Law

• Supported by considerable
evidence-never yet disproven
• Ties together related hypotheses
• A Statement of fact that concisely explains an
action or group of actions
e.g. Law of Gravity
• Accepted to be true
• Universal

Design of Experiment is a problem-solving tool 27

 Main Objectives of a Good Experimental Design

1. The design should be accurate or unbiased.

2. It should give a valid measure of the experimental error, by making a
sufficient control over undesirable influences.
3. The design should be sufficiently sensitive.
4. The design should give unbiased estimates of the treatment effects.
5. The design should have a wide scope of its application.

Design of Experiment is a problem-solving tool 28

 Steps in Designing an Experiment:
1. Statement of the problem or the object.
2. Formulation of Hypothesis.
3. Study of the experimental sight
4. Choice of an experimental technique.
5. Performance of the experiment.
6. Collection of the results and their statistical
analysis.
7. Decision about the results obtained.

Some elementary designs are:

 Completely Randomized Design (CRD),
 Randomized Block Design (RBD) and
 Latin Square Design (LSD) etc.

Design of Experiment is a problem-solving tool 29

 Summary
Characteristics of good experiments:

• Unbiased
– Randomization • Wide range of applicability
– Blinding – Deliberate variation
• High precision – Factorial designs
– Uniform material • Able to estimate uncertainty
– Replication – Replication
– Stratification – Randomization
• Simple
– Protect against
mistakes
30
 Thank you

01/20/2022 31
 Quiz (10%) TA: 15 minutes
1. Explain the project proposal with its content, mention basic elements of
introduction sequentially.
2. Describe the need of literature review and enumerate the sources of
literature review.
3. What is the goal and outcomes of this course?
4. Why the experiment is important in engineering?
5. What are the basic principles of the design of experiments?

Design of Experiment is a problem-solving tool 32