Experimental design
Design of experiment
Research design / blueprint
Data Collection Process
Experiment
• The systematic procedure carried out under
controlled conditions in order to discover an
unknown effect, to test or establish a hypothesis, or
to illustrate a known effect
• Conceptual structure within which research is to be
conducted
Purpose
• Minimize costs
• Reduce setup time
• Avoid late design changes
• Reduce labor and material complexity
• To make sure moving in the correct direction
• To stay within available / limited skills
• Accuracy and reliability
Contents
• Clear statement of research problem
• Data / information necessary for research
• Strategy for data collection
• Experimental and control groups
• Plan for data analysis
• Time and cost budget for data collection and
analysis
Data
• Factors (cause-effect)
- controllable variables
- uncontrollable variables
- extraneous variables / Noise
• Levels
Settings of each factor
• Structure & layout of experimental runs
- Capable measurement system
(Measurable variables / Assessable attributes)
- Stable process
Be careful
• Measurement error (not mistake)
• Unexplained variation
• Settings to reduce effect of noise factors
• Combined effects or interaction of factors
• Causation and correlation
Exploratory / Formulative study
• Broadly defined problem transforms into meaningful
problem
• Flexible design to provide opportunity to consider
different aspects
• Methods:
• Survey of literature
• Experience survey
• Analysis of insight simulating examples
Descriptive / Diagnostic study
• Rigid design
• Protection against bias
• Maximize reliability
• Clear definition of population
• Sample design
• Methods:
• Observation
• Questionnaires
• Interviews
• Examination of records
Experimental study
• Principle of replication
• Principle of randomization
• Principle of local control
• Designs
• Informal (before and after without control, after only with control,
before and after with control)
• Formal (completely randomized, randomized block, latin square,
factorial)