Professional Documents
Culture Documents
Problem Statement and Problem Analysis-Merged
Problem Statement and Problem Analysis-Merged
Problem Analysis
BMI 3213 Research Methodology
Identification of key
Identification of over- concepts & terms,
Identification of what
Clarity and precision arching question and key articulation of study’s
would be studied
factors / variables boundaries, some extent
of generalizability,
Conveyance of more
Conveyance of study’s No use of unnecessary than mere gathering of
importance (…’so what?’) jargon data providing a
snapshot
Should include:
• A clear statement that the problem
exists
• Evidence that supports the existence
of the problem
Clinically
Interesting Feasible
significant
Meaningful
Background and Justification
Introduction of
• The evidence and relevance from
literature and published / archival data
Problem Statement
showing the problem exists (at least 2
references).
• Should also include theoretical basis for
the study
in a
Deficiencies in the Evidence
• Include a brief discussion that details
Research Proposal the area of need (in relation to the
problem) and the deficiency or lack of
evidence in the literature
Audience
• Discuss who is affected and who benefits
Definition of Terms
• Provide complete scientific definitions and appropriate references if
necessary. Include as many terms / variables as needed.
Deficiencies in the
Research Problem
• Subject area • Evidence from the Evidence • How will addressing
literature the problem help
• Concern / issue • Evidence from • What is missing in researchers,
• Something that practical experience the evidence? educators, policy
needs solution • What do we need to makers and others?
know more about?
Relating the
Justification of
Topic Discussion to the
Research Problem
Audiences
Introduced in the first paragraphs that includes general
subject matter
Why is the
Research
To create reader interest
Problem
Important?
To focus reader’s attention on
how the study will add to the
literature
Stating the Research Problem
Common pitfall:
Refer the problem
defining the problem
using the literature
based on the solution
How is the Problem different from other parts?
Based on,
• What other researchers have found
• Personal or workplace experiences
• Experiences that others have had in their workplaces
Locating the Research Problem
Look for …
1. Lack or insufficient studies on a particular topic / area
• Geographical, population, etc.
2. Lack of understanding / knowledge in a field (i. e. controversies)
• Conflicting theories, disagreement between researchers on the effect /
approach / solution to a problem, etc.
3. Problems / limitations in previous studies
• Things that could be improved – methodology, data collection method,
data analytical method, etc.
Assessing the Research Problem:
Will the study replicate a past study but examine a different participants and
employ a different research site?
Will the study extend past research / examine the topic more thoroughly?
Will the study give voice to people not heard / silenced / rejected by the society?
A process of systematic,
methodical & ethical inquiry
and investigation to (possibly)
solve practical problems &
increase knowledge.
Purpose? To understand,
describe, predict, or control a
phenomenon.
BMI3213 Research Methodology
Could arise from
Problem Gaps in professional knowledge
Statement /
Uncertainty in practices
Research
Question Need of warrant in change of practice
Government initiatives
Why is it essential?
• Helps to focus in research
• Determines the specificity of a
well-developed research
• Focused
‘How does frequency of pure
tones affect the intensity of brain
activation?’
RQ e.g.
• Complexity
• Too simple
‘How are doctors addressing diabetes in
Malaysia?’
• Appropriately complex
‘What are the common traits of diabetic patients in
Malaysia and how can it be used to aid the medical
community in the disease prevention?’
?? Potential of publication ??
BMI3213 Research Methodology
BMI3213 Research Methodology
The primary RQ
forms the basis of (preferably, 1 RQ
research objectives for 1 study)
& hypotheses.
BMI3213 Research Methodology
Research Hypothesis
Research Variables
Measurable characteristic that varies.
1. Dependent variable shows the effect of
manipulating/introducing the independent variables
2. Independent variable is those that researcher has control
over.
3. Intervening variable refers to abstract processes that is
not directly observable
BMI3213 Research Methodology
Instrumen
t
Problem Research
Sampling developm
statement hypothesis
ent & pilot
tests
Ordinal
Literature review
Differences? Major role in suggesting RQ to Minor role in suggesting RQ
be asked to be asked
Data collection
Ethnography
• Studies cultural patterns & perspectives of participants in
their natural settings
Case Study
• Examines characteristics of a particular entity / person /
phenomenon
Ethology
• Compares origins, characteristics & culture of different
societies
Ethnomethodology
• Studies how people make sense of their everyday activities
to behave in socially accepted ways
Grounded Theory
• Investigates how inductively-derived theory about
phenomenon is grounded in the data of a particular setting
Phenomenology
• Considers how the experience of particular participants
exhibits a unique perspective
Symbolic Interaction
• Investigates how people construct meaning & shared
perspectives by interacting with others
Action Research
• Teacher-initiated, school-based research, used to improve
the practitioner’s practice by doing / changing something
Generally…
• Uses a long time in the field (fieldwork)
• Researchers - as main instrument of data collection
• Data analysis → from interpretative lenses
• Uses expressive language & voice in explanations
• Seeks depths of perspective through ongoing analysis (i.e.
waves of data)
• Judged in terms of believability, trustworthiness, coherence
& logics underlying researcher’s interpretation
Qualitative Research
General characteristics
• Data sources – real-world situations
• Data – descriptive
• Emphasises a holistic approach (processes & outcomes)
• Data analysis – inductive
• Describes meaning of research findings from perspective
of research participants
• Uses inductive reasoning:
• Develop generalisations from a limited number of specific
observations / experiences
• Highly dependent on the number & representativeness of
specific observations to make generalisation
Qualitative Research Issues
1. Gaining entry?
• Access depends on researcher’s personal characteristics
& how others perceive the researcher
• May require ~negotiation & compromise with a
gatekeeper
• Trust → EARNED. Not given.
2. Contacting participants
• To gain access
• To deal with gatekeeper
• Issues of building trust & ensuring confidentiality &
anonymity
3. Selecting participants
• Goal → to get deepest possible understanding of setting
being studied
• To identify participants who can provide info about the
topic & setting being studied
• Fraught with difficulties in identifying & selecting an
appropriate N (that can provide useful info)
• Utilises purposive sampling
• Number of participants → sufficient, when
• selected participants represent range of potential participants in
the setting &
• point at which data gathered begins to be redundant
• Threats to validity?
• Observer bias
• Observer effects
4. Strategies to enhance validity & to reduce bias
• Time extension for observation
• More participants to make study more representative
• Focus upon building participant trust to access > detailed &
honest data
• Identify biases & preferences, seek by asking others
• Compare field notes & impressions from independent
observations with other researchers
• After completed observations, participants can be offered
opportunity to validate accuracy of verbatims
• Journalise one’s own reflections, concerns & uncertainties
during the study
• Carefully examine unusual / contradictory results for
explanations
5. Leaving the field
• ?when bond is formed with participants, how to leave the
setting
• Time constraints
• When is amount of data is sufficient?
Qualitative Research Methods
Interviews
• Informal – researcher to recollect discussion
• Unstructured – at respondent’s pace & subjects to vary
by interviewee to an extent (e.g. ethnography)
• Semi-structured – uses interview guide
• Structured – uses identical stimuli & adheres to schedule
Qualitative Research Methods
Semi-structured interviews (focus group method)
• Recruited to discuss
• One focus group = one (1) unit of analysis
• Complement surveys: 1st step in tapping critical
questions to be used in a survey
• Identify why people feel certain way & elucidate steps in
their decision making process
• Ideal size: 6 to 12 persons & one moderator / note-taker
• !Series of groups for validity
• Often segmented to expected meaningful differences
(e.g. disease status, gender, etc.)
• !fine line between leading too much and not getting
people to contribute
• No right / wrong answers
• Tapes → usually transcribed verbatim
• Text → sorted into themes by >2 researchers (to ensure
validity)
• Themes are compared with field notes taken by other
researchers
• Thematic coding factors: frequency, specificity, emotion,
extensiveness
Qualitative Research Methods
Structured interviews
Questionnaire
1. Face-to-face interviews
2. Self-administered questionnaires
3. Telephone interviews
Face-to-face interviews
Advantages Disadvantages
• Can be used with bedridden, • Intrusive & reactive
illiterate patients, etc.
• Cost time & money
• Can elicit more in-depth response /
fill-in info if participants does not • Difficult to locate respondents
understand the qs for callbacks
Outcome /
Independent
variable Influences Dependent
variable
e.g. How does cocktail noise influence the
cognitive distraction?
Properties Manipulation
• Refers to conscious control of independent
variable by the researcher (through treatment /
intervention) to observe its effect on the
dependent variable
• The researcher varies the independent variable &
observes the effect of its manipulation on the
dependent variable of interest
• Example?
Properties Control
• Refers to use of control group & controlling the
effects of extraneous variables on the dependent
variable of interest
• Subjects in control & experimental groups are the
same in number & characteristics, but the
controls do not receive any treatment /
intervention at all.
• Comparison is being made on the effect of
treatment / intervention
Properties Control (cont’d)
Group
Outcome
Sample 1
population Group
Outcome
2
New treatment
Features of a well-designed RCT
• Samples are appropriate to the hypothesis being
tested, so results are appropriately generalisable.
Sufficient N to have high probability of
detecting a clinical difference (if it truly exists).
• Effective (concealed) randomisation of
subjects, to eliminate selection bias & minimise
confounding variables)
• Both groups treated identically, except for
intervention of interest. Blinded assignment of
groups to the participants by researcher.
• Patients are analysed within the group to which
they were located, irrespective of outcomes
• Analysis focuses on testing the RQ (hypothesis),
rather than ‘trawling’ to find a difference.
‘Randomised’ controlled trial
• Random assignment of subjects to either group
→minimise confounding variables
• Concealed randomisation from researchers
• Stratified randomisation ensures a potential
baseline confounding variable to be equally
distributed within two groups
Quasi-experimental Research
• Involves manipulation of independent variable to
observe the effect on dependant variable.
• BUT. Lacks randomisation and/or control group
• Generally used to establish the causality, where
researchers are not able to randomly assign the
subjects to groups OR have no control group for the
experimental study.
• Independent variable is not manipulated in complete-
controller situations
Two common types
Non-randomised
Time-series design
control group design
Non-randomised control
group design
• = non-equivalent control group design
• No randomisation in selecting both groups
• Dependent variables are observed in experimental
AND control groups before the intervention
• Later, experimental group receives treatment, but not
control group. Post-test observation of dependent
variables is done for both groups to assess the effect
of treatment on experimental group
Non-randomised control group design
Experimental
Pre-test Intervention Post-test
group
Control
Pre-test Post-test
group
Time-series design
• Aims to measure effects of a treatment over a
long period of time
• Measurement are done multiple times after each
administration of intervention, throughout the
course of experiment
• Generally, it is a single-subject research, due to
small number of samples needed
Pre-test observation
Experimental
O1 O2 O3
group
O3 O2 O1 Intervention
Post-test observation
Example
• Pain level assessment of patients with LBP. 3
weeks of pre-intervention pain assessment,
followed by intervention (special exercise) to
reduce the pain level. 3 weeks of post-
intervention pain assessment was done again.
Advantages Disadvantages
More practical and feasible, due No control over extraneous
to absence of large N, variables influencing the
randomisation & control group dependent variable
Suitable to real-world/ Results are less reliable & weak
environmental natural setting for establishment of causal
relationship between variables
Conclusion
Sample of
Sample of Malay non-
smokers population smokers
Prevalence of CAD?
Reasons to use cross-sectional studies
• Assessing prevalence of a disease
• Seeking info on general attitudes towards a number of things
in society (drinking / smoking)
• Exploring links between variables (poor diet & overweight)
Longitudinal / prospective / cohort studies
• Involves data collection from same group at different points in
time
• Also explores relationships / differences
• Referred to as repeated measure studies
• Multiple time measurement periods allowed researchers to
study functional changes over a time period.
Study design – cohort study
Condition
develops
Variable
present
Condition does
not develop
Population Sample
Condition
develops
Variable absent
Condition does
not develop
• E.g.
To see the effects of jering consumption
on diabetes in a population
Present Future
Jering-free Diabetic
diet
Non-diabetic
Diabetic
Jering diet
Non-diabetic
Advantages
• Separate follow-up of each subjects, thus serves as his / her
own control
• Increased depth of responses
• Early trends in data can be analysed
• Assessment of changes over time
• Differences & relationships can be explored
Disadvantages
• Long duration of data collection
• High cost
• Internal validity threats (testing & mortality – present &
unavoidable)
• Lost subjects to follow-up (death / attrition) → sample bias →
affects internal & external validity, OR generalisability
Longitudinal studies begin in the present and end in
the future; Cross-sectional studies look at a
broader perspective of a cross section of the
population at a specific point in time
Retrospective / Ex post facto / case control studies
• The dependent variable already has been affected by
the independent variable, x
• Researchers? Aim to link present events to past
events
• Or causal-comparative / comparative studies
• Researchers hypothesize ..
– **x is related to & a determinant of y
– But x (the presumed cause) is not manipulated, &
subjects are not randomly assigned to groups
Past Present
High jering consumption Diabetic
group
Low jering consumption
2
RESEARCH
• Systematic collection, analysis and interpretation of
data to answer certain questions to solve problems
• It is crucial to follow cascading scientific steps when
conducting research
RESEARCH FLOW
Some idea of a problem situation for study
Determine methods
Write proposal
Commence study
Data collection
Data analysis
Write up
Presentation / publication
Own observation
RESEARCH FLOW
Suggestion from others
News item Some idea of a problem situation for study
Own records
Other studies Conduct search for past studies
Determine methods
Write proposal
Commence study
Data collection
Data analysis
Write up
Presentation / publication
RESEARCH FLOW
Literature
Some idea of a problem situation for study
search
Conduct search for past studies
Literature
search
Research questions and formulate hypothesis
Determine methods
Write proposal
Commence study
Data collection
Data analysis
Write up
Presentation / publication
Topic
• Choose an interesting topic that:
– Up to what level of knowledge
– Gap of knowledge
7
PHASE I
THE
CONCEPTUAL
PHASE
8
Brink et al. (2006)
• Conceptualization…..
9
Brink et al. (2006)
• Early steps in a quantitative study typically have a strong
conceptual or intellectual element. These activities includes
reading ,conceptualising, theorising and reviewing ideas with
colleagues or supervisors
10
st
1 phase of original research
• Divided into 4 steps:
11
1. Formulation of research question
• According to the definition, the problem is something that you like to
know more about or a question you like to answer
• Researchers begin with identifying an interesting significant research
problem and formulating research questions
• In developing the research questions, researchers must attend to
substantive issues, clinical issues, methodological issues and ethical
issues
• Formulation of research question is frequently recognized as the
most difficult and the most important part of research project
12
Formulation of research question cont….
• To identify a scientific problem, discover the sources
that relate to the topic and seek for the problems that are
raised in the search
13
Formulation of research question cont….
• The challenge in developing an appropriate research question is;
– in determining which clinical uncertainties could or should be studied
– also rationalizing the need for the investigation
14
Good research question: FINER
• FINER criteria outline the important aspects of the question in general
15
Tool : Research Question
16
2. Literature review
• A process of searching information
• About certain issue / topic / question
• What has already known
• And what questions not yet answered
• A vital process before starting a study / research
• A good literature review depends on how good the literature search is
17
Why literature review?
• The aims of literature review are to get an insight and a view of the
works of others
• In the literature review, researchers might be able to find a study that is
quite similar. It helps to find and select appropriate measurement
instruments and also to anticipate common problems in research
• Look at the theories, arguments, conclusions, similarities and the
differences which closely related to the work. Therefore, researchers can
decide which ideas or information that are important to emphasis on
• Compare also different authors views on an issue and at the same time
put those with similar conclusions in groups, note the
disagreement areas and conclude by summarizing what the
literature says
18
3. Development of the theoretical
framework of the research
• The theoretical framework in a study works as a map for the research. It is
presented in the early section of a dissertation and provides the rationale
for conducting the research and to investigate a particular research
problem
• Consider the theoretical framework as a conceptual model that establishes
a sense of structure that guides the research
• It provides the background that supports researchers investigation and
offers the reader a justification for the study of a particular research problem
• It includes the variables that the researchers intend to measure and the
relationships that were seek to understand. Essentially, this is where the
researchers describe a “theory” and build the case for investigating that
theory
19
Cancer patients with
Conceptual implantable venous access
port (IVAP)
Framework Surgical reports:
Socio-demographic
Insertion site,
characteristics:
insertion side,
Age, weight, sex, race Ward of care
Prognostic factors of (IVAP)
Clinical reports:
Co-morbidity: removal due to
complications Types of cancer, division of
Diabetes mellitus, cancer types, main cancer site,
hypertension, respiratory cancer stage, cancer metastases,
system disease, liver disease, cancer relapsed, chemotherapy
kidney disease treatment, surgery, radiotherapy
Event Censored
Removal of IVAP due to Death
complications Patient loss to follow-up
On-going chemotherapy
20
Figure 3: Conceptual frameworks of prognostic factors of IVAP removal due to complications.
4. Formulation of hypothesis &
objectives
• It a statement of researcher’s expectations and predictions about
relationships among study variables
• The research questions identifies the study concepts and asks how
the concepts might be related, a hypothesis is predicted answer
• Hypotheses are more specific predictions about the nature and
direction of the relationship between two variables
• In general, research objectives describe what we expect to achieve
by a project
21
Main Objectives
• Aim or purpose of the chosen area of research
• Broad general statement
• Overall aim of the study
• Eg: To determine the prevalence of cleft palate babies
and its factors associated with cleft palate babies among
pregnant women
22
Specific objectives
• More specific objectives
• Break down of general objective into some specific objectives
– Eg To determine the prevalence of cleft palate babies in
Kelantan
– To determine the socio-demographic characteristics
associated with cleft palate babies among pregnant mothers in
Kelantan
– To determine the association between clinical characteristics
of pregnant mothers with cleft palate babies in Kelantan
23
Specific objectives
• SMART
– S Specific
– M Measurable
– A Achievable,
– R Reliable, Relevant
– T Time Related, time bound
• Eg To determine the prevalence of cleft palate babies in Kelantan
• To determine the socio-demographic characteristics associated
with cleft palate babies among pregnant mothers in Kelantan
• To determine the association between clinical characteristics of
pregnant mothers with cleft palate babies in Kelantan
24
Hypothesis
• Each specific objective is matched with a hypothesis
• More specific prediction about the nature and direction of the relationship
between two variables ;
– dependent vs independent variable
– It is developed in order to provide basis for statistical analysis
– H0
– HA
• Eg H0 : There is no significant association between cleft palate babies and
the socio-demographic characteristics among pregnant mothers in Kelantan
• Eg HA : There is a significant association between cleft palate babies and
the socio-demographic characteristics among pregnant mothers in Kelantan
25
PHASE II
26
Phil Ender, 1998
• The aim of this phase of research is to prepare general
plan of real research
27
The design & planning phase
• The design & planning should be involved following steps:
1. Selecting a research design
2. Developing protocol for intervention
3. Identifying the population to be studied
4. Designing the sampling plan
5. Specifying methods to measure the research variables
6. Developing methods to safeguard human and animal’s right
7. Reviewing and finalizing the research plan
28
1. Selecting the research design
• It is a overall plan for obtaining the research questions. Many
experimental or non experimental research designs are available
• Researchers select a specific design and identify strategy to
minimize the bias
• Research design indicates how often the data will be collected,
what type of comparisons will be made and where the study will
take place
29
2. Developing protocol for
intervention
• In experimental research ,researchers actively intervene, which
means that participants are exposed to different treatment
conditions
• An intervention protocol for the study must be developed,
specifying exactly what the bio feedback treatment would entail
and what alternative condition would be.
• The goal of well articulated protocol is to have all people in each
group treated in the same way.(in non- experimental research,
this step is not necessary)
30
3. Identifying the population to be
studied
• A population is all the individuals or objects ,with common or
defined characteristics
• Quantitative researchers must specify the population to be
studied
31
4. Designing the sampling plan
• In a quantitative study, samples adequacy is assessed by its size
and representativeness
• The sampling plan identifies how the sample will be selected and
recruited and how many subjects will be there
32
5. Specifying methods to measure
research variables
• Quantitative researchers must develop the methods to measure
the research variables accurately
• Sources of data may include people, literature, documents, and
findings (for example, from sources such as laboratory data or
measurements of vital signs)
• Data also may be collected from interviews, questionnaires, direct
measurement, or examinations (such as physical or
psychological tests)
33
6. Developing methods to safeguard
human & animal’s right
• The study should be adhered to ethical principles
• Each aspect of the study needs to be scrutinized to determine
whether the right of the participants have been adequately
protected
• A formal presentation to an ethics committee is often required
34
7. Reviewing & finalizing the
research plan
• Before collecting the data, researchers often take steps to that
plans will work smoothly
• Researchers also have their research plan critiqued by peers,
supervisors, consultants or other reviewers before implementing
it
• Researchers taking financial support submit proposal to funding
source, and reviewers usually suggest improvement
35
PHASE III
THE EMPIRICAL
PHASE
36
The empirical phase
• In many studies empirical phase is the most time consuming
part of the investigation. Data collection requires many weeks
or months. Nonetheless, the amount of time spent, however,
varies from study to study.
• Empirical phase includes the following steps:
1. Collecting the data
2. Preparing the data for analysis
37
1. Collecting the data
• This step proceeds according to established plan
• The plan specifies when and where the data will be
collected, procedure for describing the study to
participants and methods for recording information
38
2. Preparing the data for analysis
• Data collected in a quantitative study are rarely amenable to
direct analysis (preliminary steps are needed)
• One such step is coding (translating the verbal data into the
numeric data)
• Another preliminary steps involves entering the data into
computer files @ software for analysis
39
PHASE IV
THE ANALYTICAL
PHASE
40
The analytical phase
• It includes analysis and interpretation, which is the fourth
major phase of a project
• Statistical procedures are used to analyse the data and provide
answers to the research question
• This phase include the following steps:
1. Analysing the data
2. Interpreting the results
41
1. Analysing the data
• Quantitative researchers analyse their data through
statistical analysis, which includes simple as well as
complex procedures
• Use of computers @ software has made easy the use of
statistical data
42
2. Interpreting the results
• It involves making the sense of study results and
examining their implications
• Researchers attempt to explain the findings in light of
prior evidence theory, their own clinical experience and in
the light of adequacy of methods, they used in the study
43
PHASE V
THE
DISSEMINATION
PHASE
44
The dissemination phase
• Researchers responsibilities are not completed until the study
results are disseminated
• This phase include the following steps:
1. Communicating the findings
2. Utilizing the findings in the practice
45
1. Communicating the findings
• It includes the preparation of research report that summarizes the
findings
• Through publications and presentations, the researcher explains the
results of the study and links them to the existing body of knowledge in
the literature
• Research report can take various forms-
– Dissertation
– Journal articles
– Conference presentation
46
2. Utilizing the findings in the
practice
• The concluding step of a high quality study is to plan for the
use of evidence in practice setting
• The researchers must include in their research report, how
the research report can be utilized in the clinical settings
• The researcher also describes the implications of the study
and suggests directions for further research
47
48
ETHICAL ISSUES IN HEALTH
SCIENCE RESEARCH
Norhayati Mohd Zain
BSc Diagnostic Imaging
& Radiotherapy (Hons), UKM
MHSc Diagnostic Imaging, UKM
Nuremberg War Crimes Trial
a. Nuremberg Principles
b. Helsinki Declaration
Nuremberg Courtroom
Nuremberg Code
Study case
Approach
Results
7
Abstract
Advantages
People can be contacted faster.
Can obtain complete answer compared to
mail survey.
Disadvantages
Limited calling time (window 6-9 pm).
People are reluctant to answer phone
survey.
Mail Survey
Advantages
Least expensive.
Allow respondent to answer at leisure
time.
Disadvantages
Waiting time can take weeks or months.
Response can be low due to illiteracy.
E-mail Survey
Advantages
Speed.
Not much cost involved.
Disadvantages
Have to purchase e-mail addresses.
Cannot generalize findings to whole
population.
5 STEPS TO DESIGNING
QUESTIONNAIRES
• 1. Defining the objectives of the survey.
• 2. Determining the sampling group.
• 3. Writing the questionnaire.
• 4. Administering the questionnaire.
• 5. Interpretation of the results.
QUIESTIONNAIRE DESIGN
- general consideration
• Most problems are due to not well defined goals.
• Questionnaires is developed to directly address
goals (objectives) of the survey.
• Goals are developed depending on what you
intend to do with the information to be obtained.
KISS
1. Personal Characteristics
age
sex
salary per year
education
Knowledge
• Multiple choice
• Numeric open end
• Text open end
• Rating scales
• Agreement scales
MULTIPLE CHOICE
English _____
Pathology _____
Anatomy _____
Applied Biostatistics _____
Agreement Scale (Close end)
IBM PC □
Apple □
…or
IBM PC □
Apple □
Do not own a computer □
Other brands (state your brand)
_________
FOLLOW COMFORTABLY FROM
PREVIOUS QUESTIONS
Face
Content
Criterion
Concurrent
Predictive
Construct
Face Validity
• It looks OK
• Looks to measure what
it is supposed to
measure
• Look at items for
appropriateness
– Client
– Sample respondents
• Least scientific validity
measure
Looks Good To Me
Content-Related Validity
• Organized review of
format and content of
Balance instrument
– Comprehensiveness
– Adequate number of
questions per objective
– No voids in content
Definition Sample Content Format • By subject matter
experts
Criterion-Related Validity
Test-Retest
Equivalent Forms
Internal Consistency
Split-Half Approach
Kuder-Richardson Approach
Cronbach Alpha Approach
Test-Retest Reliability
TIME
Equivalent Forms Reliability