Professional Documents
Culture Documents
Background and Purpose—The Graeb score is a visual rating scale of intraventricular hemorrhage (IVH) on noncontrast
head CT. Little data exist in the hyperacute (<6 hour) period for reliability and predictive value of the modified Graeb
Score (mGS) or the original Graeb Score (oGS) for clinical outcomes or their correlation with quantitative IVH volumes.
Methods—A retrospective analysis of multicenter prospective intracranial hemorrhage study was performed. oGS and mGS
inter-observer agreement and IVH volume correlation on the baseline noncontrast head CT were calculated by intraclass
correlation coefficient and Pearson coefficient respectively. Predictors of poor outcome (modified Rankin Scale scores
≥4) at 3 months were identified using a backward stepwise selection multivariable analysis. oGS and mGS performance
for modified Rankin Scale scores ≥4 was determined by receiver operating characteristic analysis.
Results—One hundred forty-one patients (65±12 years) with median (interquartile range) time to CT of 82.5 (70.3–157.5)
minutes were included. IVH was observed in 43 (30%) patients. Inter-observer agreement was excellent for both oGS
(intraclass correlation coefficient, 0.90 [95% CI, 0.80–0.95]) and mGS (intraclass correlation coefficient, 0.97 [95% CI,
0.84–0.99]). mGS (R=0.79; P<0.01) correlated better than oGS (R=0.71; P<0.01) with IVH volumes (P=0.02). Models
of thresholded oGS and mGS were not different from a model of planimetric baseline intracranial hemorrhage and IVH
volume for poor outcome prediction. Area under the curves were 0.70, 0.73, and 0.72, respectively.
Conclusions—Excellent correlation for oGS and mGS with IVH volume was seen. Thresholded oGS and mGS are reasonable
Downloaded from http://ahajournals.org by on May 11, 2020
surrogates for planimetric IVH volume for hyperacute intracranial hemorrhage studies. (Stroke. 2020;51:00-00. DOI:
10.1161/STROKEAHA.120.029040.)
Key Words: cerebral intraventricular hemorrhage ◼ hematoma ◼ intracranial hemorrhage ◼ scoring methods
Received January 12, 2020; final revision received March 10, 2020; accepted April 7, 2020.
From the Division of Neuroradiology, Department of Medical Imaging (D.-A.B., A.S.S., L.Z.) and Division of Neurology, Department of Medicine
(D.G.), Sunnybrook Health Sciences centre, and University of Toronto, Canada; Department of Neurology (M.L.F., J.P.B) and Department of Radiology
(J.C.), University of Cincinnati Academic Health Center, OH; Department of Medicine (Neurology) (D.D.) and Division of Neuroradiology, Department of
Radiology (R.I.A.), University of Ottawa, Ottawa Hospital Research Institute, Canada; and Calgary Stroke Program, Department of Clinical Neurosciences,
Department of Radiology, Hotchkiss Brain Institute, University of Calgary, Canada (M.D.H., A.D.).
*A list of all STOP-IT and SPOTLIGHT investigators is given in the Appendix.
Guest Editor for this article was Harold P. Adams, MD.
Correspondence to Richard I. Aviv, MBChB, Department of Radiology, University of Ottawa, 501 Smyth Rd, Room L2121, Ottawa, ON, Canada K1H
8L6. Email raviv@toh.ca
© 2020 American Heart Association, Inc.
Stroke is available at https://www.ahajournals.org/journal/str DOI: 10.1161/STROKEAHA.120.029040
1
2 Stroke June 2020
Score (mGS)7,8 were developed as surrogates of IVH volume. point for each region demonstrating expansion totaling 32 (Figure 1A
The mGS is an extension of oGS including more ventricular and 1B).4,8 Ninety-day modified Rankin Scale scores (mRS) were
obtained by telephone interview (STOP-IT) and in person or by tele-
locations and accounting for ventricular expansion.
phone interview (SPOTLIGHT).
While mGS has shown excellent inter-observer correla-
tion, and correlated more strongly than oGS with quantitative
IVH estimation9 there is a lack of consensus whether mGS has
Statistical Analysis
Demographic data was compared using Wilcoxon rank-sum nonpara-
additional predictive value over the oGS. Whereas Morgan et metric test or Fisher exact test for continuous or categorical variables.
al8 reported greater mGS correlation with IVH volume and Inter-observer agreement for oGS and mGS was quantified using
outcome, Czorlich et al9–11 found that mGS was no better than intraclass correlation coefficient. Agreement between the averaged
the oGS and unnecessarily complicated IVH assessment. oGS and mGS and between oGS/mGS and IVH volumes was cal-
The assessment, selection, and treatment of patients in the culated for the 2 readers using the Pearson’s product–moment cor-
relation coefficient. A score difference of ≤3 points was considered
hyperacute phase is increasingly important as new hyperacute agreement as previously published.10 ROC analysis was performed to
trials for ICH treatment emerge using minimally invasive explore an optimal dichotomous oGS and mGS threshold associated
techniques earlier than the traditional stability periods. Scant with clinical outcome. Quantitative IVH volume was dichotomized
data exist on oGS inter-observer agreement and on oGS and by quartiles and outcome using mRS was compared between the
fourth and lower quartiles. To search for significant predictive factors
mGS score correlation with IVH in the hyperacute period (<6
of poor functional outcome (mRS ≥4), univariate logistic regression
hours). Existing studies evaluate performance up to 7 days9,10 analysis was conducted. In addition to study average oGS and mGS
or do not indicate the time to assessment.12,13 values and specific thresholds calculated in this study, a thresholded
The purpose of this study was to address these knowledge oGS was studied based on prior literature (oGS5; thresholded as oGS
gaps by evaluating the inter-observer reliability of oGS and ≤5 and >5) in univariate analysis.16 Natural log-transformation was
applied where appropriate to normalize distribution. All variables
mGS, determine their correlation with IVH volume and assess P<0.10 in the univariate analysis were advanced to a backward step-
prediction of clinical outcome using data from 2 prospective wise selection multivariable analysis. To avoid codependence of oGS,
hyperacute multicenter ICH studies. mGS, and IVH volume (Spearman correlation, r=0.948 and r=0.981,
respectively; P<0.0001), 4 models were tested, and R2 calculated to
determine the best model fit. Two-sided P<0.05 was considered sta-
Methods tistically significant.
Study Participants, Scan Protocol
and Patient Follow-Up Results
Study participants are derived from the STOP-IT (Spot Sign for
Demographics
Downloaded from http://ahajournals.org by on May 11, 2020
3 points in 35 (80%) cases; corresponding to a high inter- excellent correlation (R=0.92; P<0.01) between averaged
observer agreement (intraclass correlation coefficient, 0.97 oGS and mGS scores (Figure 2A).
for absolute agreement [95% CI, 0.84–0.99]). There was Both oGS (R=0.71; P<0.01) and mGS (R=0.79; P<0.01)
correlated with IVH volumes (Figure 2B and 2C), with higher
Table 1. Demographics of Patients With and Without IVH Determined at correlation for mGS compared with oGS (P=0.02). Patients
Baseline CT Scan with Graeb scores within the lower three quartiles for both
IVH Present IVH Absent P Value oGS (R=0.56; P=0.0005) and mGS (R=0.67; P<0.0001)
showed correlation with IVH volumes; higher for mGS versus
Age, y 64.3±14.1 64.7±11.7 0.847
oGS (P=0.036).
Sex, male 20 (45.5%) 58 (59.8%) 0.113
Race 0.114 Effect of IVH Severity on Outcome and
Downloaded from http://ahajournals.org by on May 11, 2020
Figure 2. The upper panel demonstrates correlation between average original Graeb score and modified Graeb score from 2 readers. Correlation between
planimetric intraventricular hemorrhage (IVH) volume and average original Graeb score is demonstrated in the lower left panel. Correlation between plani-
metric IVH volume and average modified Graeb score at baseline CT is demonstrated in the lower right panel.
Table 2. Univariate Predictors of Poor Functional Outcome (mRS Score ≥4) 0.74 for mGS compared with oGS for prediction of poor out-
Predictive Factors P Value OR (95% CI) come.10 Hwang demonstrated similar performance of oGS for
clinical outcome prediction to Morgan.19 Czorlich showed that
Male sex 0.0814 0.53 (0.26–1.08)
mGS underperformed for Glasgow outcome scale determina-
Age, y 0.0330 1.03 (1.00–1.07) tion relative to oGS (0.767 versus 0.780).13 In another study,
IVH presence 0.2835 1.52 (0.71–3.26) the addition of mGS to a predictive clinical model previously
oGS (continuous) 0.0765 1.51 (0.96–2.40) failed to significantly improve outcome prediction,12 and oGS
tertiles were not significantly associated with either 30 day
oGS >5 vs ≤5 0.0993 2.39 (0.86–7.03)
mortality or 6 month good outcome.16 Three prior publica-
oGS >4 vs ≤4 0.0547 2.60 (0.99–7.13) tions have demonstrated that an OGS cutoff of 5 predicted the
mGS (continuous) 0.1316 1.28 (0.93–1.77) rate of functional outcome, consistent with our findings.12,13,16
mGS ≤12 vs >12 0.0332 3.44 (1.14–11.67) No prior study has calculated an optimal mGS threshold as-
sociated with worse clinical outcome. The finding that oGS4,
ICH volume at baseline (log) 0.0007 2.11 (1.39–3.34)
oGS5, and mGS12 added to a model of baseline ICH demon-
IVH volume at baseline (log) 0.0306 1.45 (1.04–2.05) strated similar prediction for poor outcome compared with a
Total ICH volume (log) <0.0001 2.58 (1.64–4.26) model of planimetric IVH confirms the utility of each of these
Deep ICH 0.8515 1.08 (0.48–2.52) scores as a surrogate of quantitative IVH.
The very small median IVH volume of 7cc in our pa-
Hypertension 0.0816 2.10 (0.93–5.02)
tient cohort (IVH volumes between 2 and 15cc in 50%) could
Diabetes mellitus 0.8024 1.12 (0.46–2.66) explain the disparity between outcome prediction of IVH
Angina 0.8203 0.75 (0.03–8.08) volume, thresholded oGS and mGS and IVH presence as a
Myocardial infarction 0.8081 0.74 (0.03–7.92) binary variable. Worse functional outcomes are expected with
greater IVH severity but the role of smaller IVH volumes
Atrial fibrillation 0.1811 4.77 (0.59–98.01)
is less well understood. Whereas some reports suggest any
Hypercholesterolemia 0.8925 1.06 (0.48–2.29) IVH is associated with increased risk6,20 others demonstrate
Transient ischemic attack 0.5601 1.53 (0.35–6.75) that small IVH volumes are not associated with worse out-
Smoking 0.0368 2.30 (1.07–5.13) come.12,13 Trifan and Nishikawa et al showed that low volumes
ICH indicates intracranial hemorrhage; IVH, intraventricular hemorrhage;
of IVH (defined as oGS <5) had similar outcomes to patients
mGS, modified Graeb score; mRS, modified Rankin Scale; oGS, original Graeb with ICH without IVH19 and were not associated with poor
Downloaded from http://ahajournals.org by on May 11, 2020
score; and OR, odds ratio. functional outcome.12,15 Consistent with this understanding,
the association between IVH volume and outcome in this se-
surgical intervention is planned mGS may be superior due to a ries was driven by the patients within the highest quartile for
lower number of false positives. Contradictory data exist as to IVH volume. Comparative studies assessing IVH prediction
the utility of oGS and mGS. Morgan reported a higher AUC of on stability scans, imaged at variable but generally extended
Table 3. Four Predictive Models for Poor Outcome Prediction Derived From a Backward Stepwise Selection Process
Appendix
Kevin E. Thorpe, Mmath, Dalla Lana School of Public Health,
University of Toronto; Jane C. Khoury, PhD, Applied Health
Research Centre; Heidi J. Sucharew, PhD, University of Cincinnati;
Fahad Al-Ajlan, MD, King Faisal Specialist Hospital and Research
Center, Riyadh, Saudi Arabia; Ken Butcher, MD, PhD, University of
New South Wales, Sydney, Australia; Gord Gubitz, MD, Dalhousie
University, Halifax, Nova Scotia, Canada; Stephanie DeMasi, BSc,
MSc, Applied Health Research Centre, Li Ka Shing Knowledge
Institute of St Michael’s Hospital; Judith Hall, MSc, Applied Health
Research Centre, Li Ka Shing Knowledge Institute of St Michael’s
Hospital; David Gregg, MD, Medical University of South Carolina,
Figure 3. Receiver operating curves (ROC) for 4 models including model
Charleston; Muhammad Mamdani, PharmD, Applied Health Research
A and B (original Graeb score [oGS >5 and >3.5] and intracranial hemor-
rhage), model C (modified Graeb score [mGS] >11.5 and ICH), and model
Centre, Li Ka Shing Knowledge Institute of St Michael’s Hospital;
D (planimetric baseline intraventricular hemorrhage volume, and plani-
Michel Shamy, MD, University of Ottawa; Richard H. Swartz, MD,
metric baseline intracranial hemorrhage volume) for poor (modified Rankin PhD, Division of Neurology, Department of Medicine, University
Scale score ≥4) 90-day functional outcome. of Toronto; C. Martin del Campo, MD, Division of Neurology,
Department of Medicine, University of Toronto; Brett Cucchiara,
MD, University of Pennsylvania, Philadelphia; Peter Panagos, MD,
time points <24 hour, <72 hours, and up to 7 days.8–13,18 In Washington University in St Louis, St Louis, Missouri; Joshua N.
Downloaded from http://ahajournals.org by on May 11, 2020
contrast, the present study had a short median time to scan of Goldstein, MD, Massachusetts General Hospital, Boston; Edward
82.5 minutes which may account for why IVH presence and C. Jauch, MD, Mission Research Institute, Mission Health System,
average (nondichotomized) oGS and mGS scores were insen- Asheville, North Carolina; Joseph P. Broderick, MD, University of
Cincinnati Academic Health Center, Cincinnati.
sitive to final outcome because smaller IVH volumes and less
IVH expansion are expected hyperacutely.
Sources of Funding
Limitations of the study include the relatively small The SPOTLIGHT (Spot Sign Selection of Intracerebral Hemorrhage
sample size. Small sample sizes in published IVH studies to Guide Hemostatic Therapy) trial was funded by peer-reviewed
are due to the relative infrequency of both primary ICH as operating grants from the Canadian Institutes of Health Research,
a stroke subtype and the additional infrequency of super- the Ontario Stroke Network, and the Ontario Ministry of Research
and Innovation. The STOP-IT (Spot Sign for Predicting and
imposed IVH. Prior data sources include a single cohort Treating ICH Growth) trial was funded by a peer-reviewed oper-
study of aneurysmal subarachnoid hemorrhage patients ating grant from the National Institute of Neurological Disorders
with IVH (n=150),11 prospective registry10 (n=71), retro- and Stroke. Recombinant activated coagulation factor VII was pur-
chased with grant funds for the SPOTLIGHT sites from Canadian
spective single center studies (n=35 oGS only),12 (n=112; Blood Services and Hema-Quebec and was supplied by Novo
oGS only),13 (n=153; oGS only18), and post hoc analysis of Nordisk for the STOP-IT sites. Dr Gladstone is supported by a Mid-
CLEAR B (Clot Lysis Evaluating Accelerated Resolution Career Award from the Heart and Stroke Foundation of Canada, the
of Intraventricular Hemorrhage Clinical Trial) (n=36 Eaton Scholar Award from the University of Toronto Department
of Medicine, Bastable-Potts Chair in Stroke Research, the Tory
patients, 360 scans) and VISTA (Virtual International Family, and the Department of Medicine at Sunnybrook Health
Stroke Trials Archive) (n=399).8,9 Despite, small sample Sciences Centre. Drs Broderick and Flaherty were supported by
size, the prospective multicenter study design and hyper- grant P50 NS044283 from the National Institute of Neurological
Disorders and Stroke. R.I. Aviv was funded by a project grant from
acute time period of the study are strengths rarely seen in
Canadian Institutes of Health Research.
prior publications. A proportion of patients in this study
received recombinant factor VIIa which could theoreti-
Disclosures
cally have contributed to the lack of IVH growth and lack Dr Gladstone has received grants from the Canadian Institutes of
of association of IVH presence with outcome. However, Health Research, Ontario Ministry of Research and Innovation, and
recombinant factor VIIa was not shown to alter size of ei- Ontario Stroke Network. Dr Demchuk has received personal fees
ther ICH or IVH compared with controls in SPOTLIGHT from Medtronic and NovoNordisk Canada. Dr Dowlatshahi has re-
ceived grants from the Heart and Stroke Foundation of Canada and
and STOP-IT studies14; and therefore, this factor is un- has a patent issued for automated dynamic spot sign detection soft-
likely to have influenced the predictive findings. ware. J. Carrozzella received a grant from University of Cincinnati.
Bisson et al Graeb Correlation With IVH Volume and Outcome 7
Dr Flaherty has received nonfinancial support for the STOP-IT trial 10. Hansen BM, Morgan TC, Betz JF, Sundgren PC, Norrving B, Hanley DF,
from Novo Nordisk and personal fees from CSL Behring, Janssen et al. Intraventricular extension of supratentorial intracerebral hemorrhage:
Pharmaceuticals, and Portola Pharmaceuticals and has a patent issued the modified graeb scale improves outcome prediction in lund stroke reg-
and licensed to Sense Diagnostics for a noninvasive cerebral nervous ister. Neuroepidemiology. 2016;46:43–50. doi: 10.1159/000442575
system sensor that can monitor intracranial bleeding. The other 11. Czorlich P, Mende KC, Vettorazzi E, Regelsberger J, Westphal M,
authors report no conflicts. Schmidt NO. Validation of the modified graeb score in aneurysmal sub-
arachnoid hemorrhage. Acta Neurochir (Wien). 2015;157:1867–1872;
discussion 1872. doi:10.1007/s00701-015-2583-5
References 12. Nishikawa T, Ueba T, Kajiwara M, Miyamatsu N, Yamashita K. A
1. Staykov D, Bardutzky J, Huttner HB, Schwab S. Intraventricular fibrinol- priority treatment of the intraventricular hemorrhage (IVH) should
ysis for intracerebral hemorrhage with severe ventricular involvement. be performed in the patients suffering intracerebral hemorrhage
Neurocrit Care. 2011;15:194–209. doi: 10.1007/s12028-010-9390-x with large IVH. Clin Neurol Neurosurg. 2009;111:450–453. doi:
2. Gaberel T, Magheru C, Parienti JJ, Huttner HB, Vivien D, Emery E. 10.1016/j.clineuro.2009.01.005
Intraventricular fibrinolysis versus external ventricular drainage alone 13. Trifan G, Arshi B, Testai FD. Intraventricular hemorrhage severity as
in intraventricular hemorrhage: a meta-analysis. Stroke. 2011;42:2776– a predictor of outcome in intracerebral hemorrhage. Front Neurol.
2781. doi: 10.1161/STROKEAHA.111.615724 2019;10:217. doi: 10.3389/fneur.2019.00217
3. Hanley DF. Intraventricular hemorrhage: severity factor and treatment 14. Gladstone DJ, Aviv RI, Demchuk AM, Hill MD, Thorpe KE, Khoury JC,
target in spontaneous intracerebral hemorrhage. Stroke. 2009;40:1533– et al. Effect of recombinant activated coagulation factor vii on hemor-
1538. doi: 10.1161/STROKEAHA.108.535419 rhage expansion among patients with spot sign–positive acute intrace-
4. Hinson HE, Hanley DF, Ziai WC. Management of intraventricu- rebral hemorrhage: the spotlight and stop-it randomized clinical trials.
lar hemorrhage. Curr Neurol Neurosci Rep. 2010;10:73–82. doi: JAMA Neurol. 2019;76:1493–1501. doi: 10.1001/jamaneurol.2019.2636
10.1007/s11910-010-0086-6 15. Kosior JC, Idris S, Dowlatshahi D, Alzawahmah M, Eesa M, Sharma P,
5. Hanley DF, Lane K, McBee N, Ziai W, Tuhrim S, Lees KR, et al; CLEAR et al; PREDICT/Sunnybrook CTA ICH Study Investigators. Quantomo:
III Investigators. Thrombolytic removal of intraventricular haemorrhage validation of a computer-assisted methodology for the volumetric anal-
in treatment of severe stroke: results of the randomised, multicentre, ysis of intracerebral haemorrhage. Int J Stroke. 2011;6:302–305. doi:
multiregion, placebo-controlled CLEAR III trial. Lancet. 2017;389:603– 10.1111/j.1747-4949.2010.00579.x
611. doi: 10.1016/S0140-6736(16)32410-2 16. Godoy DA, Piñero G, Di Napoli M. Predicting mortality in spon-
6. Steiner T, Diringer MN, Schneider D, Mayer SA, Begtrup K, taneous intracerebral hemorrhage: can modification to original
Broderick J, et al. Dynamics of intraventricular hemorrhage in patients score improve the prediction? Stroke. 2006;37:1038–1044. doi:
with spontaneous intracerebral hemorrhage: risk factors, clinical im- 10.1161/01.STR.0000206441.79646.49
pact, and effect of hemostatic therapy with recombinant activated fac- 17. Eagles ME, Jaja BNR, Macdonald RL. Incorporating a modified graeb
tor vii. Neurosurgery. 2006;59:767–773; discussion 773-764. doi: score to the modified fisher scale for improved risk prediction of delayed
10.1227/01.NEU.0000232837.34992.32 cerebral ischemia following aneurysmal subarachnoid hemorrhage.
7. Graeb DA, Robertson WD, Lapointe JS, Nugent RA, Neurosurgery. 2018;82:299–305. doi: 10.1093/neuros/nyx165
Harrison PB. Computed tomographic diagnosis of intraventricular 18. Ibrahim GM, Weidauer S, Macdonald RL. Interobserver variability
hemorrhage. Etiology and prognosis. Radiology. 1982;143:91–96. doi: in the interpretation of computed tomography following aneurysmal
10.1148/radiology.143.1.6977795 subarachnoid hemorrhage. J Neurosurg. 2011;115:1191–1196. doi:
Downloaded from http://ahajournals.org by on May 11, 2020
8. Morgan TC, Dawson J, Spengler D, Lees KR, Aldrich C, Mishra NK, 10.3171/2011.7.JNS11725
et al; CLEAR and VISTA Investigators. The Modified Graeb Score: 19. Hwang BY, Bruce SS, Appelboom G, Piazza MA, Carpenter AM,
an enhanced tool for intraventricular hemorrhage measurement and Gigante PR, et al. Evaluation of intraventricular hemorrhage assessment
prediction of functional outcome. Stroke. 2013;44:635–641. doi: methods for predicting outcome following intracerebral hemorrhage. J
10.1161/STROKEAHA.112.670653 Neurosurg. 2012;116:185–192. doi: 10.3171/2011.9.JNS10850
9. Krishnan K, Mukhtar SF, Lingard J, Houlton A, Walker E, Jones T, et 20. Yogendrakumar V, Ramsay T, Fergusson D, Demchuk AM, Aviv RI,
al. Performance characteristics of methods for quantifying spontaneous Rodriguez-Luna D, et al; the PREDICT/Sunnybrook CTA Study Group.
intracerebral haemorrhage: data from the efficacy of nitric oxide in New and expanding ventricular hemorrhage predicts poor outcome in
stroke (enos) trial. J Neurol Neurosurg Psychiatry. 2015;86:1258–1266. acute intracerebral hemorrhage. Neurology. 2019;93:e879–e888. doi:
doi: 10.1136/jnnp-2014-309845 10.1212/WNL.0000000000008007