Professional Documents
Culture Documents
STUDY
Patarawan Woratanarat, MD, PhD
Research question
◦ Uncertainty about diagnostic test
◦ New test
◦ Cheaper, simple test
◦ Differentiate, classify severity
◦ Diagnostic threshold
◦ Treatment threshold
◦ Compare with a gold standard
Study design
◦ Cross-sectional study
◦ Cross-sectional study with randomization for test
◦ In case of sequence matter e.g. Arthroscope vs MRI
◦ Setting, location, dates
Population
◦ Reference population
◦ Study population
◦ Uncertainty of diagnosis e.g. groin pain with fever (septic hip vs.
transient synovitis of the hip)
◦ Only one population included whole spectrum of the disease
◦ Avoid patients vs normal control
moderate
Patient who were suspected to have disease
Test
Gold standard
Test
◦ Explain details
◦ Procedure: sufficient detail to allow replication
◦ Test performance
◦ Interpreter (if presents)
◦ Definition and rationale for positive, and negative results
◦ e.g. ESR > 40 mm/hr
◦ Emphasize
◦ No reader/interpreter of test known the results of gold standard (blind
comparison, independent reader)
Stard-statement.org, 2015
Question
CRP
ESR
Gold standard
Gold standard
◦ Rationale for selection, acceptable?
◦ Explain details
◦ Procedure: sufficient detail to allow replication
◦ Gold standard performance
◦ Interpreter (if presents)
◦ Definition and rationale for positive, and negative results
◦ e.g. rim enhancement in MRI
◦ Emphasize
◦ No reader/interpreter of test known the results of the test (blind
comparison)
◦ Test should not be parts of gold standard
◦ Perform gold standard in all participants unless it is highly invasive, then
use silver standard
Verification bias
Gold
Positive
standard
Test
Negative
Example
◦ The diagnosis of primary bone tumor
◦ Test = MRI known results
◦ Goal standard
◦ Bone biopsy & pathology
◦ If no biopsy, use silver standard (x-ray) with clinical follow-up
Data collection
◦ Participant recruitment
◦ Specimen collection
◦ Logistic method for test and gold standard
◦ Data record form
Statistical analysis
◦ Sensitivity
◦ Specificity
◦ Positive predictive value
◦ Negative predictive value
◦ Accuracy
◦ Likelihood ratio of positive test
◦ Likelihood ratio of negative test
◦ Odds ratio with 95% confidence interval
◦ Area under receiver operating characteristic (ROC) curve
Exercises
Test results Septic arthritis Aseptic arthritis Total
Positive 7 (100) 5 (35.7) 12
Negative 0 (0) 9 (64.3) 9
Total 7 14 21
Sensitivity =
Specificity =
Positive predictive value =
Negative predictive value =
Accuracy =
Likelihood ratio of positive test =
Likelihood ratio of negative test =
◦ Odds(post) = Odds(pre) x LR
= (0.5/(1-0.5) x 18.3
= 18.3
◦ Posttest prob = odds(post)/(odds post+1)
= 18.3/(18.3+1)
= 94.8
SARS-CoV-2 Antigen Self Test Nasal Test characteristics (ROCHE)
Assay format Lateral flow test / immunochromatographic
Sensitivity 91.1% (Ct value ≤ 30)
Specificity 99.6%
◦ The power of the study 0.8 Estimated sample size for a one-sample proportion test
Score z test
◦ Sensitivity Ho: p = p0 versus Ha: p != p0
Study parameters:
◦ Accuracy
alpha = 0.0500
power = 0.8000
◦ ROC curve 0.8 delta = -0.1000
p0 = 0.8000
pa = 0.7000
N= 147
Excluded =
Results
Disease ROC
Sensitivity Specificity PPV NPV Accuracy LR+ LR- OR
Test area
Yes No (95%CI) (95%CI) (95%CI) (95%CI) (95%CI) (95%CI) (95%CI) (95%CI)
(95%CI)
(N = ) (N = )