Professional Documents
Culture Documents
The Newcastle-Ottawa Scale (NOS) For Assessing The Quality of Nonrandomized Studies in Meta-Analysis
The Newcastle-Ottawa Scale (NOS) For Assessing The Quality of Nonrandomized Studies in Meta-Analysis
Applications
Current Developments
Development: Item Selection
• Case-Control studies
• Selection of case and controls
• Comparability of cases and controls
• Ascertainment of exposure
Development: Identifying Items
• Identify ‘high’ quality choices with a
‘star’
• A maximum of one ‘star’ for each h
item within the ‘Selection’ and
‘Exposure/Outcome’ categories;
maximum of two ‘stars’ for
‘Comparability’
N EWCAS TL E - O TTAW A Q UAL IT Y ASS ESS MENT SCA L E
CO HOR T S T UD IES
Note: A study ca n be awarded a ma ximum of one star for each numbered item within the Selection and
Ou tcome categories. A ma xi mum of two stars can be given for Comparability
Selection
1) Representativeness of the exposed cohort
a) truly representa tive of the average __________ _____ (describe) in the community
b ) so mewhat representative of the average ___ ___________ in the community
c) selected group of users eg nurses, volunteers
d) no description of the derivation of the cohort
2) Selection of the non exposed cohort
a) drawn from the same co mmunity as the exposed cohort
b ) drawn from a different source
c) no description of the deriva tion of the non exposed cohort
3) Ascertainment of exposure
a) secure record (eg surgical records)
b ) structured interview
c) written self report
d) no description
4) Demonstration that outco me of interest was not present at start of study
a) yes
b ) no
Compara bility
1) Comparability of cohorts on the basis of the design or analysis
a) study controls for ___________ __ (select the most important factor)
b ) study controls for any additional factor (This criteria could be modified to indicate specific
control for a second i mportant factor.)
Outcome
1) Assessment of outco me
a) independent blind assessment
b ) record linkage
c) self report
d) no description
2) Was follow-up long enough for outcomes to occur
a) yes (select an adequate follow up period for outcome of interest)
b ) no
3) Adequacy of follow up of cohorts
a) co mplete follow up - all subjects accounted for
b ) sub jects lost to follow up unlikely to introduce bias - sma ll number lost - > ____ % (select an
adequate %) follow up, or description provided of those lost)
c) follow up rate < ____% (select an adequate %) and no description of those lost
d) no sta tement
N EWCAS TL E - O TTAW A Q UALITY ASS ESS MENT SCA L E
CAS E CON TRO L S TUD IES
Note: A study can be awarded a ma ximum of one star for each numbered item within the Selection and
Exposure categories. A maximum of two stars can be given for Comparability.
Selection
1) Is the case definition adequate?
a) yes, with independent validation
b) yes, eg record linkage or based on self reports
c) no description
4) Definition of Controls
a) no history of disease (endpoint)
b) no description of source
Compara bility
1) Comparability of cases and controls on the basis of the design or analysis
a) study controls for _________ ______ (Select the most important factor.)
b) study controls for any additional factor (This criteria could be modified to indicate specific
control for a second important factor.)
Exposure
1) Ascertainment of exposure
a) secure record (eg surgical records)
b) stru ctured interview where blind to case/control status
c) interview not blinded to case/control status
d) written self report or medical record only
e) no description
• Selection (4)
• Comparability (1)
• Exposure (3)
– A study can be awarded a maximum of one star for each numbered item within the
Selection and Exposure categories. A maximum of two stars can be given for
Comparability
Selection
1. Is the case definition adequate?
a) yes, with independent validation
b) yes, eg record linkage or based on self reports
c) no description
3. Selection of Controls
a) community controls
b) hospital controls
e.g. ICD codes in database
c) no description >1 person/record/time/process
or self-report with no
to extract information, or
4. Definition of Controls reference to primary record
a) no history of disease (endpoint)
reference to primary record
or no description
b) no description of source source such as x-rays or
medical/hospital records
Comparability
1. Comparability of cases and controls on the basis of the design or analysis
b) study controls for any additional factor (This criteria could be modified to indicate specific control for a second important factor.)
Exposure
1. Ascertainment of exposure
a) secure record (eg surgical records)
b) structured interview where blind to case/control status
c) interview not blinded to case/control status
d) written self report or medical record only
e) no description
3. Non-Response Rate
a) same rate for both groups
b) non respondents described
c) rate different and no designation
Newcastle-Ottawa Quality Assessment Scale:
Cohort Studies
• Selection (4)
• Comparability (1)
• Outcome (3)
– A study can be awarded a maximum of one star for each numbered item within the
Selection and outcome categories. A maximum of two stars can be given for
Comparability
Selection
1. Representativeness of the exposed cohort
a) truly representative of the average ___________ (describe) in the community
b) somewhat representative of the average ___________ in the community
c) selected group of users eg nurses, volunteers
d) no description of the derivation of the cohort
b) study controls for any additional factor (This criteria could be modified to indicate specific control for a second important factor.)
Outcome
1. Assessment of outcome
a) independent blind assessment
b) record linkage
c) self report
d) no description
• Types of studies
– case-control, cohort or cross-sectional studies
• Population
– postmenopausal women
• Intervention
– women exposed to hormone replacement therapy (estrogen or
estrogen + progesterone)
– ever, current, past
• Outcomes
– coronary heart disease (events)
– fatal, non-fatal, both
Steps of a Cochrane Systematic
Review
• 16 case-control or cross-sectional
• 14 cohort
Quantification of Effects
• Exposure (ever, current, past)
• Outcome (fatal, non-fatal, both)
• Effect estimates (EE)
• Relative Risk (RR)
• Odds Ratio (OR)
• Adjusted effect estimates
• Effects vs population, follow-up periods,
etc. (homogeneity)
Steps of a Cochrane Systematic
Review
Folsom / 95
Grodstein / 96
Henderson / 91
Lafferty / 94
Lauritzen / 83
Petitti / 87
Sourander / 98
Wilson / 85
Wolf / 96
Case-Control Star Template
Selection Comparability Exposure
Adam / 81
Beard / 89
Croft / 89
Grodstein / 97
Heckbert / 97
LaVecchia / 87
Mann / 94
Pfeffer / 78
Rosenberg / 76
Rosenberg / 80
Rosenberg / 93
Ross / 81
Sidney / 97
Szklo / 84
Talbott / 77
Thompson / 89
Adjusted Effect Estimates for Coronary Heart Disease
(All Events) (HRT: Estrogen Current Use)
Case-Control Studies
Selection Comparability Exposure
Rosenberg / 76
Talbott / 77
Pfeffer / 78
Rosenberg / 80
Heckbert / 87
LaVecchia / 87
Rosenberg / 93
Mann / 94
Grodstein / 97
Sidney / 97
0.01 0.1 1 10
Adjusted Effect Estimates for Coronary Heart Disease
(All Events) (HRT: Estrogen Past Use)
Case-Control Studies
Rosenberg / 80
Heckbert / 87
LaVecchia / 87
Grodstein / 97
Sidney / 97
0.1 1 10
Adjusted Effect Estimates for Coronary Heart Disease
(All Events) (HRT: Estrogen Ever Use)
Case-Control Studies
Heckbert / 87
Thompson / 89
Rosenberg / 93
0.1 1 10
Adjusted Effect Estimates for Coronary Heart Disease
(All Events) (HRT: Estrogen Current Use)
Cohort Studies
Bush / 87
Avila / 90
Folsom / 95
Grodstein / 96
Cauley / 97
Criqui / 98
Sourander / 98
0.01 0.1 1 10
Adjusted Effect Estimates for Coronary Heart Disease
(All Events) (HRT: Estrogen Ever Use)
Cohort Studies
Selection Comparability Outcome
Lauritzen / 83
Wilson / 85
Petitti / 87
Henderson / 91
Lafferty / 94
Folsom / 95
Ettinger / 96
Wolf / 96
0.01 0.1 1 10
Current Development: Validity
• Face/content validity
• Criterion validity
• compare to more comprehensive scales
• compare to expert judgement
• Construct validity
• external criteria
– ‘convergent validity’
– ‘divergent validity’
• internal structure
– ‘factorial validity’
Current Development: Reliability
• Inter-rater reliability
• Intra-rater reliability
Future Development: Scoring