You are on page 1of 11

Intensive Care Med (2018) 44:1284–1294

https://doi.org/10.1007/s00134-018-5305-7

SYSTEMATIC REVIEW

Optic nerve sheath diameter measured


sonographically as non‑invasive estimator
of intracranial pressure: a systematic review
and meta‑analysis
Chiara Robba1,2* , Gregorio Santori3 , Marek Czosnyka4,5, Francesco Corradi6, Nicola Bragazzi7,
Llewellyn Padayachy8, Fabio Silvio Taccone9 and Giuseppe Citerio10

© 2018 Springer-Verlag GmbH Germany, part of Springer Nature and ESICM

Summary
Purpose: Although invasive intracranial devices (IIDs) are the gold standard for intracranial pressure (ICP) measure-
ment, ultrasonography of the optic nerve sheath diameter (ONSD) has been suggested as a potential non-invasive ICP
estimator. We performed a meta-analysis to evaluate the diagnostic accuracy of sonographic ONSD measurement for
assessment of intracranial hypertension (IH) in adult patients.
Methods: We searched on electronic databases (MEDLINE/PubMed®, ­Scopus®, Web of ­Science®, ­ScienceDirect®,
Cochrane ­Library®) until 31 May 2018 for comparative studies that evaluated the efficacy of sonographic ONSD vs. ICP
measurement with IID. Data were extracted independently by two authors. We used the QUADAS-2 tool for assessing
the risk of bias (RB) of each study. A diagnostic meta-analysis following the bivariate approach and random-effects
model was performed.
Results: Seven prospective studies (320 patients) were evaluated for IH detection (assumed with ICP > 20 mmHg
or > 25 ­cmH2O). The accuracy of included studies ranged from 0.811 (95% CI 0.678‒0.847) to 0.954 (95% CI
0.853‒0.983). Three studies were at high RB. No significant heterogeneity was found for the diagnostic odds ratio
(DOR), positive likelihood ratio (PLR) and negative likelihood ratio (NLR), with I2 < 50% for each parameter. The pooled
DOR, PLR and NLR were 67.5 (95% CI 29‒135), 5.35 (95% CI 3.76‒7.53) and 0.088 (95% CI 0.046‒0.152), respectively.
The area under the hierarchical summary receiver-operating characteristic curve (AUHSROC) was 0.938. In the subset
of five studies (275 patients) with IH defined for ICP > 20 mmHg, the pooled DOR, PLR and NLR were 68.10 (95% CI
26.8‒144), 5.18 (95% CI 3.59‒7.37) and 0.087 (95% CI 0.041‒0.158), respectively, while the AUHSROC was 0.932.
Conclusions: Although the wide 95% CI in our pooled DOR suggests caution, ultrasonographic ONSD may be a
potentially useful approach for assessing IH when IIDs are not indicated or available (CRD42018089137, PROSPERO).
Keywords: Intracranial pressure, Invasive intracranial devices, Optic nerve sheath diameter, Ultrasonography, Adult
patients, Meta-analysis

*Correspondence: kiarobba@gmail.com
2
Neurosciences Critical Care Unit, Addenbrooke’s Hospital, University
of Cambridge, Box 1, Hills Road, CB2 0QQ Cambridge, UK
Full author information is available at the end of the article
Chiara Robba and Gregorio Santori contributed equally as first authors
1285

Introduction
Increased intracranial pressure (ICP) is an important Take home message
cause of secondary brain injury, and its association with Optic nerve sheath diameter (ONSD) is gaining popularity as an easy,
poor outcome has been extensively demonstrated [1]. bedside, non-invasive ICP estimator
Therefore, monitoring and treatment of ICP are invalua- The available evidence, summarised in this systematic review and
ble in the management of neurosurgical and neurological meta-analysis, suggests its potential utility for estimating increased
intracranial pressure non-invasively in critically ill patients
critically ill patients. The gold standard for ICP measure-
ment is invasive techniques (i.e., ventriculostomy and
intraparenchymal microtransducers), associated with several authors extended the use of this technique [9, 12].
risks, such as infection and haemorrhage [2, 3]. Thus, However, with an updated approach, diagnostic meta-
an accurate non-invasive method to measure elevated analyses concerning ONSD as a potential ICP estimator
ICP would be most appropriate in the management of can be improved in many ways (study selection criteria,
critically ill patients. Several non-invasive techniques for evaluation of cut-off values for defining IH, effect size,
the evaluation of ICP have been developed [4], includ- statistical methods) adding new elements at the previ-
ing brain imaging techniques based on morphological ous one. Therefore, we performed a systematic review
changes associated with ICP increases [such as magnetic and meta-analysis following more stringent criteria for
resonance imaging (MRI), computed tomography (CT)] the selection of studies and management of the cut-off
and indirectly transmitted ICP (fundoscopy, tympanic values assumed for IH in adult patients, with the aim to
membrane displacement). provide an updated and reliable synthesis of the available
Although some non-invasive methods have been evidence.
shown to be promising, none of them has come to
replace the invasive methods [4]. Among non-invasive Methods
methods, the measurement of optic nerve sheath diam- We adhered to the Preferred Reporting Items for System-
eter (ONSD) has gained particular interest. The sheath atic Reviews and Meta-Analysis of Diagnostic Test Accu-
enveloping the optic nerve is in continuity with the dura racy (PRISMA-DTA) [Electronic Supplementary Material
mater of the brain and the subarachnoidal interspace (ESM) Table 1A, B] [13]. We registered our protocol with
filled with cerebrospinal fluid (CSF), accounting for a the International Prospective Register of Systematic
direct connection between the two compartments. As Reviews (PROSPERO) on 22 February 2018 (registration
the ONS is distensible, CSF pressure variations influ- number: CRD42018089137).1
ence the volume of ONSD with fluctuations in the ante-
rior retrobulbar compartment, about 3 mm behind the Data sources and search strategy
globe [5]. ONSD measurement for ICP detection based A systematic literature search was performed for the
on CT, MRI and ultrasound was previously studied [6, 7]. period 1 January 1980–31 December 2017 and further
Ultrasonography has the potential advantage of being a
MEDLINE/PubMed®, ­Scopus®, Science Citation I­ndex®
updated until 31 May 2018 in the following databases:
repeatable, bedside safe and low-cost tool, with no risks
of radiations and side effects. Sonographic ONSD meas- Science®, ­ScienceDirect® and
®
Expanded from Web of ­
urement is performed using a linear probe, which is care- Cochrane ­Library . The search was primarily set by
fully placed on the closed upper eyelid without exerting including only original studies published in English in
pressure on the eye, with patient in the supine position. peer-review journals. A control search without language
In the two-dimensional mode, ONSD is then measured limitations was also performed. More details regarding
3 mm behind the globe using an electronic calliper. the search strategy, terms and queries are presented in
According to some authors, there is a linear relation- ESM Table 2.
ship between perioptic CSF pressure and ICP [6, 8],
and ONSD changes almost directly with ICP showing Study screening and selection
good sensitivity and specificity [9]. Nevertheless, some The studies were independently screened by two authors
authors reported poor correlation with low sensitiv- (CR, GS) looking at study titles and abstracts for potential
ity and specificity [10], while there is a substantial het- eligibility. Screening questions were answered and pilot
erogeneity regarding the cut-off (ICP > 20 mmHg, > 25 tested with a subset of records before implementation.
or > 20 cmH2O) for defining intracranial hypertension
(IH). To date, the clinical validity/reliability of using 1
The protocol of this study was prospectively developed with the differ-
ONSD as a non-invasive ICP estimator has not been fully ent steps started on 1 December 2017 (as pointed out in the PROSPERO
established, although in 2011 Dubourg et al. published “Anticipated or actual start date” section) and was submitted with some
delay to the PROSPERO staff, which, after revision, did not find any flaw or
the first meta-analysis on this topic [11], and since then methodological incoherence. Available at: https​://bit.ly/2ISbI​bp.
1286

Disagreement was assessed using κ statistics and was table, while they returned the ROC curve (plot of sensi-
resolved through discussion; a third reviewer (FC) was tivity vs. 1-specificity) to establish the optimal cut-off to
involved if necessary. We included only studies where ICP optimise ONSD sensitivity and specificity. A χ2 test was
assessment with ultrasonographic ONSD was compared carried out to assess equality of sensitivities and specifi-
with invasive (intraparenchymal, intraventricular or lum- cities; 95% confidence intervals (CIs) for sensitivities and
bar puncture) measurement. The invasive ICP measure- specificities were calculated with the Wilson method and
ment (IICPM) was assumed as the standard reference. placed in forest plots. The heterogeneity of DOR, PLR
Studies conducted in healthy volunteers or in animal mod- and NLR was estimated by the Cochran’s Q statistic. The
els were excluded, as were any other publications lack- I2 was calculated to assess variability due to heterogeneity
ing abstract and/or quantitative details. When multiple rather than chance, assuming heterogeneity with I2 > 50%.
publications of the same research group/center described Since sensitivities and false-positive rates are interre-
potentially overlapping case series, we used the more lated, bivariate approaches to the meta-analysis of diag-
recent publication, if eligible. We excluded any contact nostic accuracy [16] and their hierarchical summary
with the authors of the original studies to obtain essential receiver-operating characteristics (HSROC) have become
information not available in the published format. More the gold standard for diagnostic meta-analysis (DMA)
details about extracted data are reported in ESM Table 3. [17]. The bivariate approach implies a binomial model
We established further inclusion criteria to re-eval- conditional on primary studies’ true sensitivity and false-
uate the first pool of studies preliminarily selected for positive rates, with a bivariate normal model for the logit-
the quantitative synthesis: (1) the diagnostic accuracy of transformed pairs of sensitivities and false-positive rates.
ONSD ultrasonography should be compared with IICPM The final model is a linear mixed model with known vari-
in adult patients (> 18 years old); (2) the IH should be set ances of the random effects, similar to the computational
with ICP > 20 mmHg or > 25 cmH2O; (3) sonographic approach by Reitsma et al. [16], with variance compo-
ONSD and IICPM should be simultaneously performed nents estimated by restricted maximum likelihood. The
in the same patients or with a time window formally/ outputs of the bivariate diagnostic random-effects model
technically < 1 h; (4) the sample size should be ≥ 15 (pooled DOR, PLR, NLR) were calculated according to
patients; (5) enough information should be reported to Zwinderman and Bossuyt [18]. For the HSROC curve, we
construct a 2 × 2 table; (6) the correlation coefficient (r) calculated the area under the curve (AUC), partial AUC
between mean ONSD and IICPM should be reported. (FPR-restricted and normalised), an average operating
Only studies that met all the above criteria were enrolled point central to the observed data (θ) and curve asymme-
for quantitative synthesis. try (β). The HSROC curve was not extrapolated beyond
the range of the original data. Meta-regression analysis
Appraisal of study quality was performed to evaluate the potential impact of pre-
The overall quality of evidence at the outcome level was defined covariates on the Sens and FPR of the bivariate
assessed according to the Grading of Recommendations, diagnostic random-effects model [19].
Assessment, Development and Evaluations (GRADE) The presence of publication bias (PB) was evaluated by
system [14]. Risk of bias (RB) of each included study combining trim and fill with ln DOR [20]. The trim and
was assessed using the Quality Assessment of Diagnostic fill method (TFM) estimates the number of missing stud-
Accuracy Studies (QUADAS)-2 tool [15]. Two reviewers ies from a meta-analysis because of the suppression of the
were contents experts (CR, FC), and one reviewer (GS) most extreme results on one side of the funnel plot. Then,
was an experienced biostatistician/epidemiologist. The this method augments the observed data and recomputes
contents experts only assessed potential publications the summary estimate based on the complete data. The
with respect to the appropriateness of the research ques- trim and fill outputs were obtained with 100 iterations.
tions tested. The biostatistician only evaluated the appro- The same studies enrolled for DMA were further evalu-
priateness of methods employed. Disagreement was ated by assuming r as effect size. The DerSimonian-Laird
resolved by consensus. random-effects model [21] was applied to the Fisher’s
r-to-z transformed correlation coefficients. PB was esti-
Statistical analysis mated by extensive funnel plots.
Diagnostic accuracy of each included study was calcu- Statistical significance was assumed for p < 0.05. Sta-
lated from a 2 × 2 table for sensitivity (Sens), specificity, tistical analysis was carried out using the R software/
false-positive rate (FPR), diagnostic odds ratio (DOR) environment (version 3.4.2. R Foundation for Statistical
and positive and negative likelihood ratio (PLR; NLR). Computing). The numerical and graphical outputs were
The DOR was assumed as the main indicator of the whole obtained by using mada [22], metafor [23] and metamisc
diagnostic performance. No study presented a full 2 × 2 [24] R packages.
1287

Fig. 1 PRISMA flow diagram of the search results for original studies published in English and selection of eligible studies

Results screening records, 65 studies written in English were


Study selection assessed for eligibility (Fig. 1). Of these, 57 did not fit the
The initial database searching returned 883 records eligibility criteria (ESM Table 4). In the group of eight
written in English. A control search without language studies including 352 adult patients initially considered as
limitations found 20 other studies, none of which met potential candidates for quantitative synthesis, one [25]
the enrolment criteria. After removing duplicates and did not report either r or a correlation plot to indirectly
1288

estimate this coefficient. Thus, we finally selected seven

0.60
0.76
0.50
0.76
0.69
0.59
0.68
ICP intracranial pressure, IH intracranial hypertension, ONSD optic nerve sheath diameter, PO prospective observational, D diagnostic phase I-II validity study, O observational, PBO prospective blinded observational, EVD
studies including 320 adult patients for the quantitative

external ventricular drainage, LP lumbar puncture, IP intraparenchymal, M miscellaneous, ICH intracerebral haemorrhage, SAH subarachnoid haemorrhage, TBI traumatic brain injury, Sim simultaneously, r correlation
analysis.

Threshold (mm)
Study characteristics
The main characteristics of the selected studies are sum-

5.60
5.85
6.30
4.80
5.20
5.00
5.86
marised in Table 1. All studies used a prospective design
and enrolled consecutive adult patients with suspicion
of IH. The ICP control was made through external ven-

ICP-ONSD window
tricular drainage, lumbar puncture and/or intraparen-
chymal probes. The cut-off values for IH were placed
with ICP > 20 mmHg in five studies [12, 26–29] and

Not Sim

Not Sim

Not Sim
ICP > 25 cmH2O (18.3 mmHg) in the remaining two [30,

Sim

Sim
Sim
Sim
31]. The ONSD threshold values that optimised sensitivi-
ties and specificities evaluated by the ROC curves ranged

Pathology

ICH + SAH
from 4.80 to 6.30 mm. The procedures, probes and skills

TBI + ICH
for ONSD sonographic measurement are reported in

TBI
M
M
M
M
Table 2. The diagnostic accuracy parameters for each
included study are reported in ESM Table 5.

Male (%)
Quality of evidence and risk of bias

32
77
13
40
57
67
68
Following the GRADE system, the overall quality of evi-
dence for the included studies was assessed as very low
Agea

55.9

36.5
53

53
52
60
38
(ESM Table 6). The RB evaluated with the QUADAS-2
tool was low in three studies [12, 26, 27], unclear in one
Patients (n)

study [30] and high in three studies [28, 29, 31] (ESM
Table 7).
62
64
30
65
53
15
31
Publication bias and heterogeneity of the included studies
Table 1 Characteristics of the studies included in the quantitative synthesis

The TFM returned two simulated missing studies on the


25 ­cmH2O

25 ­cmH2O
IH cut-off

20 mmHg
20 mmHg

20 mmHg
20 mmHg

left side and no missing studies on the right side of the 20 mmHg
funnel plot, with all included studies within the pseudo-
confidence region (Fig. 2). For each study, the sensitiv-
coefficient between the means of sonographic ONSD and invasive ICP measurements
ICP control

ity and specificity of sonographic ONSD measurement


IP or EVD

IP or EVD
IP or EVD

compared with ICP by invasive devices are shown in


Fig. 3. The χ2 test for equality did not reach statistical
EVD
EVD

LP

IP

significance for sensitivities (p = 0.972) and specificities


(p = 0.375). No significant heterogeneity was found for
Design

DOR (Q = 3.507, p = 0.743; I2 = 0.00%), PLR (Q = 5.154,


PBO
PO
PO

PO
PO
PO
D

p = 0.524; I2 = 0.00%) and NLR (Q = 1.486, p = 0.966;


I2 = 0.00%).
United Kingdom
South Korea

Diagnostic meta‑analysis for the included studies


Country

France

The pooled DOR returned by the bivariate diagnostic


Spain

USA
USA
Italy

random-effects model was 67.5 (95% CI 29‒135), the


pooled PLR was 5.35 (95% CI 3.76‒7.53), and the pooled
Reported as mean or median
del Saz-Saucedo et al. 2016

NLR was 0.088 (95% CI 0.046‒0.152). The area under the


HSROC curve was 0.938 (θ = 2.346; β =1.476), whereas
Moretti and Pizzi 2009

Geeraerts et al. 2007


Kimberly et al. 2008

the partial AUC was 0.916 (Fig. 4). To evaluate the poten-
Rajajee et al. 2011
Robba et al. 2017

tial impact of predefined covariates on Sens and FPR of


Jeon et al. 2017

the bivariate diagnostic random-effects model, we per-


formed an extensive meta-regression analysis. No sta-
Study

tistical significance was found for the patient age (Sens


a
1289

Table 2 Procedures, probes and skills described for sonographic measurement of the optic nerve sheath diameter in the
studies included in the quantitative synthesis
Study Description of US for ONSD Probe Skills described

Jeon et al. 2017 Temporal part of the closed ProSound Alpha 6, Hitachi Two investigators with more than 17
upper eyelid, with coupling gel, two Medical Corp., Tokyo, Japan examinations
measurements on each eye in trans- 13 MHz US probe
verse plane
Robba et al. 2017 3 mm behind the retina in both eyes 11L4, Xario 200; Toshiba; Zoetermeer, Three experienced operators
patients in supine position The Netherlands
The final ONSD value was calculated by 7.5-MHz linear probe
averaging four measured values
del Saz-Saucedo et al. 2016 3 mm behind the lamina cribrosa, Toshiba AplioXG US system One single operator with 10 years of
patient in supine position, three meas- 4.8–11-MHz linear probe experience
urements on each eye
Rajajee et al. 2011 3 mm behind the retina, three meas- Sonosite™ M-Turbo One operator with 3 years of
urements on each eye (SonoSite Inc., Bothell, WA, USA) experience, and one operator with
6–13-MHz linear probe 2 months of experience
Moretti and Pizzi 2009 3 mm behind the globe, patients in Hitachi EUB 405, Hitachi Two experienced operators
supine position, two measurements Medical Corp., Tokyo, Japan
on each eye 7.5-MHz linear probe
Kimberly et al. 2008 3 mm posterior to the orbit, patients in Sonosite™ Micromax Two experienced operators
supine position, three measurements (Sonosite Inc., Bothell, WA, USA)
on each eye 5–10-MHz linear probe
Geeraerts et al. 2007 3 mm behind the globe, supine posi- HP Sonos 5550, Hewlett Two investigators trained in ocular
tion, two measurements for each eye Packard, Les Ulis, France pathology
(sagittal and transverse planes) 7.5-MHz linear probe
US ultrasonography, ONSD optic nerve sheath diameter

p = 0.656; FPR p = 0.933), pathology (Sens p = 0.809; bivariate diagnostic random-effects model was 68.10
FPR p = 0.091), ICP-ONSD window (Sens p = 0.690; FPR (95% CI 26.8‒144), the pooled PLR was 5.18 (95% CI
p = 0.495), cut-off value assumed for IH (Sens p = 0.811; 3.59‒7.37), and the pooled NLR was 0.087 (95% CI
FPR p = 0.475), ONSD threshold (Sens p = 0.857; FPR 0.041‒0.158). The area under the HSROC curve was
p = 0.829), r (Sens p = 0.889; FPR p = 0.687) and RB (Sens 0.932 (θ = 3.682; β = 2.188), whereas the partial AUC was
p = 0.813; FPR p = 0.470). 0.921 (ESM Fig. 3).
By evaluating the potential impact of predefined
Publication bias and heterogeneity in a subset of included covariates on the bivariate diagnostic random-effects
studies model for the subset of included studies, we did not find
We repeated the analysis described above on the sub- any statistical significance in meta-regression analysis
set of five studies (275 patients) that assumed IH for for patient age (Sens p = 0.952; FPR p = 0.636), pathol-
ICP > 20 mmHg (Table 1). The TFM returned no simu- ogy (Sens p = 0.779; FPR p = 0.113), ICP-ONSD win-
lated missing study on either side of the funnel plot, with dow (Sens p = 0.876; FPR p = 0.607), ONSD threshold
all included studies within the pseudo-confidence region (Sens p = 0.510; FPR p = 0.649), r (Sens p = 0.807; FPR
(ESM Fig. 1). For each study of the subset, the sensitivity p = 0.851) and RB (Sens p = 0.876; FPR p = 0.607).
and specificity of sonographic ONSD measurement com-
pared with ICP by invasive devices are shown in ESM Additional analyses
Fig. 2. The χ2 test for equality did not reach statistical Further analyses concerning the r between the means of
significance for sensitivities (p = 0.937) and specificities sonographic ONSD and IICPM were reported in the sup-
(p = 0.212). No significant heterogeneity was found for plementary material (ESM Sect. 1, Figs. 4, 5).
DOR (Q = 3.013, p = 0.556; I2 = 0.00%), PLR (Q = 4.121,
p = 0.390; I2 = 2.928%) and NLR (Q = 0.983, p = 0.912; Discussion
I2 = 0.00%). Raised ICP can occur in multiple clinical settings and is
a common life-threatening condition. The invasiveness of
Diagnostic meta‑analysis for a subset of included studies the ‘gold standard’ devices for detecting raised ICP and
In the subset of included studies that assumed IH for the risk for severe complications (infection, haemorrhage,
ICP > 20 mmHg, the pooled DOR returned by the malfunction) preclude their use in several situations [32].
1290

Fig. 2 Funnel plot for the trim and fill method, with original studies as solid circles and simulated studies as open circles

The measurement of ONSD for ICP detection was exten- diagnostic accuracy for ONSD measured sonographically
sively studied using MRI, CT or ultrasound [4]. Sono- in the detection of ICP. Moreover, the area under the
graphic ONSD has gained interest in the last years as a HSROC curve strengthened the reliability of sonographic
promising bedside tool for the non-invasive detection of ONSD measurement for ICP detection (Fig. 4). The same
raised ICP in a binary mode, with several authors dem- order of magnitude for the pooled DOR and area under
onstrating that this technique provides good diagnostic the HSROC curve was confirmed in the subset of five
accuracy [12, 27], although these studies suffered from studies that assumed IH for ICP > 20 mmHg. However, in
several methodological flaws to provide definitive results. the whole set of included studies the forest plot for sen-
A critical point of studies regarding ICP evaluation is sitivity and specificity showed for this latter a relatively
represented by the unit of measurement and the cut-off lower performance (Fig. 3). The studies included in our
value assumed for IH. Although IH is frequently defined analysis were quite heterogeneous regarding patients’
as ICP ≥ 20 mmHg [33], a non-negligible part of studies pathology (Table 1), and this covariate was the closest to
assumes as reference value ICP ≥ 25 cmH2O, and some- approaching significance for the potential impact on FPR
times even ≥ 20 cmH2O [9] or 30 cmH2O [35]. However, in the meta-regression analysis. On the other hand, in the
the ICP cut-offs expressed as mmHg or ­cmH2O are not subset of studies that established IH for ICP > 20 mmHg,
equivalent [34, 35], thus introducing a further element of we found no significance by entering patients’ pathology
heterogeneity. in the meta-regression for FPR. Notably, no significant
In this study we found high pooled DOR, PLR and NLR heterogeneity was found for DOR, PLR and NLR, with
returned by the bivariate approach, suggesting a good I2 systematically lower to 5% in both all included studies
1291

Fig. 3 Sensitivity (a) and specificity (b) of sonographic ONSD compared with invasive ICP measurement for diagnosis of intracranial hypertension in
each included study

found no heterogeneity by limiting the same model to the


five studies that assumed IH for ICP > 20 mmHg, suggest-
ing that the evaluation of r as effect size could be a prom-
ising additional output, especially when this ICP cut-off
value was assumed for IH.
Our results substantially confirmed the previous find-
ings of Dubourg et al. [11], although with several meth-
odological differences. Our enrolment criteria were
more protective towards the potential overlapping of the
same patients from different included studies. Moreover,
by applying the QUADAS-2 tool we assign a low [27],
unclear [30] and high [28] RB for the three shared stud-
ies with Dubourg et al., whereas these same studies were
originally assumed of high quality [11]. We entered the
RB as covariate in the meta-regression analysis, without
finding any significance. We also evaluated the over-
all quality of evidence of the included studies with the
GRADE system [14] by assigning a whole judgment of
Fig. 4 HSROC curve of sonographic ONSD compared with invasive “very low”. This finding should be reasonably extensible
ICP measurement for diagnosis of intracranial hypertension. The to each sample of ONSD studies, considering their recur-
HSROC curve was not extrapolated beyond the range of the original rent weaknesses (small sample sizes, no evaluation of
data
statistical power, different ICP cut-off values, clinical het-
erogeneity and wide 95% CI).
A critical point for any meta-analysis is the PB for
and in the subset with ICP > 20 mmHg. In the analysis many potential reasons (delayed publication, selective
performed assuming r as effect size, we found a slightly reporting of positive results, more impact on studies with
increased heterogeneity (ESM Sect. 1). Conversely, we small sample size) [36]. For the whole set of included
1292

studies, we found that each study fell within the pseudo- Strengths and limitations
confidence region, although two simulated missing stud- Our meta-analysis has several strengths and limitations.
ies were returned on the left side (Fig. 2). In the subset of Differently from the previous meta-analysis of Dubourg
studies with ICP > 20 mmHg, the funnel plot for the TFM et al. [11], we used pooled DOR instead of pooled sensi-
showed no simulated missing study, with all studies of the tivity and specificity to evaluate the diagnostic accuracy
subset within the pseudo-confidence region (ESM Fig. 1). of sonographic ONSD measurement for IH detection,
Also, in the funnel plot related to the TFM, we observed this latter approach being potentially misleading [50],
that all selected studies fell within the pseudo-confidence especially when different threshold values occur between
region. Moreover, the small studies (< 50 patients) did not studies. Moreover, in both the meta-analysis of Dubourg
have better sensitivity and specificity than larger studies et al. [11] and the recent protocol of Koziarz et al. [51],
(Fig. 3), thus reinforcing that PB can be excluded. no specifications were provided regarding the methods
Since 2011, PROSPERO has become the reference used for calculation of the pooled DOR, PLR and NLR.
open-access facility to prospectively register non- We calculated these parameters as outputs of the bivari-
Cochrane reviews [37]. While a previous study found ate diagnostic random-effects model using the method
no evidence that review/protocol registration reduced of Zwinderman and Bossuyt [18]. Furthermore, in our
outcome reporting bias [38], the PROSPERO registra- meta-analysis we evaluated the PB by using the TFM
tion is recommended for all non-Cochrane reviews [39]. with ln DOR, which a previous simulation study rec-
We registered our protocol/review in PROSPERO with ommended as the more reliable approach for evaluating
a delay from start date. Although this asynchronism is performance of the PB tests in DMA [52]. In addition,
clearly not desirable, no discrepancy occurred between neither the previous meta-analysis of Dubourg et al. [11]
this review and the declared primary outcome, an even- nor the protocol of Koziarz et al. [51] provided a formal
tuality demonstrated in about a third of the systematic distinction between the criteria used for assessing IH
reviews registered in PROSPERO [39]. (ICP > 20 mmHg or ICP > 25 ­cmH2O). We treated the
Our results seem to support the use of ONSD as a cut-off assumed for IH as a predefined covariate for the
non-invasive tool for the assessment of IH in a binary meta-regression analysis, and we replicated the DMA
mode. Measuring ONSD with a duplex Doppler machine for the subset of included studies that assumed IH with
is quick, safe and inexpensive; it does not require probe ICP > 20 mmHg. Finally, we also evaluated the r between
fixation or specific dedicated hardware, and ultrasonog- the means of sonographic ONSD and IICPM, both as a
raphy devices are available in most emergency depart- predefined covariate for the meta-regression analysis and
ments and intensive care units. However, this method as effect size in a random-effects model. Notably, we used
presents several limitations. Differently from invasive an open source environment for all statistical analyses,
ICP monitoring, ONSD is not able to return continuous making our study potentially reproducible [53].
measurements. The inter-/intra-observer variability may The main limit of our study is the low power, although
be high [11]. Although the learning curve for experienced we included more studies (seven) and patients (320)
sonologists may just include from 17 to 25 scans [40, 41], than the meta-analysis of Dubourg et al. (six studies
pitfalls and detection of artefacts are common during the for 231 patients [11]). Our patient number was slightly
examination. Also, ONSD use was questioned in patients higher (275) than in Dubourg et al. also in the subset of
with subarachnoid haemorrhage [42]. Therefore, ONSD five studies that established IH with ICP > 20 mmHg.
should not be used to substitute invasive devices in neu- The wide 95% CI calculated for the pooled DOR and the
rocritical care patients when indications are met. How- increased risk of false positives in the subgroup analy-
ever, current guidelines on TBI management are unclear sis suggest caution in our estimates. Moreover, the low
about ICP indications [43], and although all the authors number of studies included in our meta-analysis clearly
agree about the importance of assessing and managing affects the reliability of the meta-regression models. We
ICP [44, 45], there is a huge variability among different excluded studies that did not report/allow obtaining all
centres concerning the indications [46]. Therefore, whilst the required data, without contacting the corresponding
the superiority of invasive ICP monitoring is still advo- authors; this strategy may have increased the study selec-
cated, the sonographic ONSD measurement may be of tion bias. The delayed PROSPERO registration represents
potential benefit in several scenarios where IICPM is not an additional limitation of this review. The PB evalua-
immediately available or indicated (general ICU patients, tion is elusive in DMA, especially when fewer than ten
coagulopathy, liver failure, metabolic coma) as well as studies are included. The TFM seems to suggest that PB
in the intraoperative settings [47, 48] and emergency can be excluded, especially for the subset of studies that
departments [49]. assumed IH with ICP > 20 mmHg. A further limitation of
1293

our study is represented by the heterogeneity of patients’ 2. Holloway KL, Barnes T, Choi S et al (1996) Ventriculostomy infections: the
effect of monitoring duration and catheter exchange in 584 patients. J
pathology, considering that the ONSD thresholds for Neurosurg 85:419–424. https​://doi.org/10.3171/jns.1996.85.3.0419
subarachnoid haemorrhage, intracerebral haemorrhage 3. Hoefnagel D, Dammers R, Ter Laak-Poort MP, Avezaat CJJ (2008) Risk fac-
and stroke were not as well defined as for traumatic brain tors for infections related to external ventricular drainage. Acta Neurochir
150:209–214. https​://doi.org/10.1007/s0070​1-007-1458-9
injury. Thus, the aim to obtain a resolutive cut-off value 4. Robba C, Bacigaluppi S, Cardim D, Donnelly J, Bertuccio A, Czosnyka M
for sonographic ONSD overcomes the possibilities of this (2016) Non-invasive assessment of intracranial pressure. Acta Neurol
review because of the extreme heterogeneity of thresh- Scand 134:4–21. https​://doi.org/10.1111/ane.12527​
5. Moretti R, Pizzi B (2011) Ultrasonography of the optic nerve in neurocriti-
olds in the included studies. However, our study suggests cally ill patients. Acta Anaesthesiol Scand 55:644–652. https​://doi.org/10.1
that a more rigorous approach to establish IH should be 111/j.1399-6576.2011.02432​.x
used and that the ICP > 20 mmHg seems to be associated 6. Sekhon MS, Griesdale DE, Robba C et al (2014) Optic nerve sheath
diameter on computed tomography is correlated with simultaneously
with more reliable results. measured intracranial pressure in patients with severe traumatic brain
injury. Intensive Care Med 40:1267–1274. https​://doi.org/10.1007/s0013​
Conclusions 4-014-3392-7
7. Geeraerts T, Newcombe VFJ, Coles JP et al (2008) Use of T2-weighted
Sonographic measurement of ONSD may be a potentially magnetic resonance imaging of the optic nerve sheath to detect raised
useful technique for assessing IH in a binary mode (pre- intracranial pressure. Crit Care 12:R114. https​://doi.org/10.1186/cc700​6
sent/absent) when invasive/monitoring methods are not 8. Geeraerts T, Merceron S, Benhamou D, Vigué B, Duranteau J (2008) Non-
invasive assessment of intracranial pressure using ocular sonography in
desirable or available. However, because of the limited neurocritical care patients. Intensive Care Med 34:2062–2067. https​://doi.
number of patients and the low quality of the included org/10.1007/s0013​4-008-1149-x
studies in our meta-analysis, larger high quality studies 9. Amini A, Kariman H, Arhami Dolatabadi A et al (2013) Use of the sono-
graphic diameter of optic nerve sheath to estimate intracranial pressure.
are needed to establish the appropriate cut-off value for Am J Emerg Med 31:236–239. https​://doi.org/10.1016/j.ajem.2012.06.025
IH and the applicability of this technique in specific clini- 10. Strumwasser A, Kwan RO, Yeung L et al (2011) Sonographic optic nerve
cal conditions. sheath diameter as an estimate of intracranial pressure in adult trauma. J
Surg Res 170:265–271. https​://doi.org/10.1016/j.jss.2011.03.009
Electronic supplementary material 11. Dubourg J, Javouhey E, Geeraerts T, Messerer M, Kassai B (2011)
The online version of this article (https​://doi.org/10.1007/s0013​4-018-5305-7) Ultrasonography of optic nerve sheath diameter for detection of raised
contains supplementary material, which is available to authorized users. intracranial pressure: a systematic review and meta-analysis. Intensive
Care Med 37:1059–1068. https​://doi.org/10.1007/s0013​4-011-2224-2
Author details 12. Robba C, Cardim D, Tajsic T et al (2017) Ultrasound non-invasive meas-
1
Anaesthesia and Intensive Care, San Martino Policlinico Hospital, IRCCS urement of intracranial pressure in neurointensive care: a prospective
for Oncology, Genoa, Italy. 2 Neurosciences Critical Care Unit, Addenbrooke’s observational study. PLoS Med 14:e1002356. https​://doi.org/10.1371/
Hospital, University of Cambridge, Box 1, Hills Road, CB2 0QQ Cambridge, UK. journ​al.pmed.10023​56
3
Department of Surgical Sciences and Integrated Diagnostics (DISC), Univer- 13. McInnes MDF, Moher D, Thombs BD et al (2018) Preferred reporting items
sity of Genoa, Genoa, Italy. 4 Department of Clinical Neurosciences, Division for a systematic review and meta-analysis of diagnostic test accuracy
of Neurosurgery, Brain Physics Laboratory, Cambridge Biomedical Campus, studies: the PRISMA-DTA statement. JAMA 319:388–396. https​://doi.
Addenbrooke’s Hospital, University of Cambridge, Cambridge, UK. 5 Institute org/10.1001/jama.2017.19163​
of Electronic Systems, Warsaw University of Technology, Warsaw, Poland. 14. Guyatt GH, Oxman AD, Vist GE et al (2008) GRADE: an emerging consen-
6
Anaesthesia and Intensive Care Unit, E.O. Ospedali Galliera, Genoa, Italy. sus on rating quality of evidence and strength of recommendations. BMJ
7
Department of Health Sciences (DISSAL), University of Genoa, Genoa, Italy. 336:924–926. https​://doi.org/10.1136/bmj.39489​.47034​7
8
Paediatric Neurosurgery Unit, Division of Neurosurgery, Faculty of Health 15. Whiting PF, Rutjes AWS, Westwood ME et al (2011) QUADAS-2: a revised
Sciences, Red Cross War Memorial Children’s Hospital, University of Cape Town, tool for the quality assessment of diagnostic accuracy studies. Ann Int
Cape Town, South Africa. 9 Department of Intensive Care, Clinique Universitaire Med 155:529–536. https​://doi.org/10.7326/0003-4819-155-8-20111​
de Bruxelles (CUB) Erasme, Brussels, Belgium. 10 School of Medicine and Sur- 0180-00009​
gery, University of Milan-Bicocca, Milan, Italy. 16. Reitsma JB, Glas AS, Rutjes AWS, Scholten RJPM, Bossuyt PM, Zwinder-
man AH (2005) Bivariate analysis of sensitivity and specificity produces
Compliance with ethical standards informative summary measures in diagnostic reviews. J Clin Epidemiol
58:982–990. https​://doi.org/10.1016/j.jclin​epi.2005.02.022
Conflicts of interest 17. Liu Z, Yao Z, Li C, Liu X, Chen H, Gao C (2013) A step-by-step guide to
None of the authors have any potential conflict of interest associated with this the systematic review and meta-analysis of diagnostic and prognos-
study. tic test accuracy evaluations. Br J Cancer 108:2299–2303. https​://doi.
org/10.1038/bjc.2013.185
Ethics and dissemination 18. Zwinderman AH, Bossuyt PM (2008) We should not pool diagnostic
Formal ethical approval was not required as primary data were not collected. likelihood ratios in systematic reviews. Stat Med 27:687–697. https​://doi.
org/10.1002/sim.2992
19. Doebler P, Holling H, Böhning D (2012) A mixed model approach to
Received: 25 April 2018 Accepted: 4 July 2018 meta-analysis of diagnostic studies with binary test outcome. Psychol
Published online: 17 July 2018 Methods 17:418–436. https​://doi.org/10.1037/a0028​091
20. Duval S, Tweedie R (2000) Trim and fill: a simple funnel-plot-based
method of testing and adjusting for publication bias in meta-analysis.
Biometrics 56:455–463. https​://doi.org/10.1111/j.0006-341X.2000.00455​.x
21. DerSimonian R, Laird N (1986) Meta-analysis in clinical trials. Control Clin
References Trials 7:177–188. https​://doi.org/10.1016/0197-2456(86)90046​-2
1. Marmarou A, Anderson RL, Ward JD et al (1991) Impact of ICP instability 22. Doebler P (2017) mada: meta-analysis of diagnostic accuracy. R package
and hypotension on outcome in patients with severe head trauma. J version 0.5.8. https​://cran.r-proje​ct.org/web/packa​ges/mada/index​.html.
Neurosurg 75(Suppl 1):S59–S66 Accessed 19 June 2018
1294

23. Viechtbauer W (2010) Conducting meta-analyses in R with the metafor 38. Tsujimoto Y, Tsujimoto H, Kataoka Y et al (2016) Majority of systematic
package. J Stat Softw 36:1–48. https​://doi.org/10.18637​/jss.v036.i03 reviews published in high-impact journals neglected to register the
24. Debray T, de Jong V (2017) metamisc: diagnostic and prognostic meta- protocols: a meta-epidemiological study. J Clin Epidemiol 84:54–60. https​
analysis. R package version 0.1.7. https​://cran.r-proje​ct.org/web/packa​ ://doi.org/10.1016/j.jclin​epi.2017.02.008
ges/metam​isc/index​.html. Accessed 19 June 2018 39. Tricco AC, Cogo E, Page MJ et al (2016) A third of systematic reviews
25. Mehrpour M, Oliaee Torshizi F, Esmaeeli S, Taghipour S, Abdollahi S changed or did not specify the primary outcome: a PROSPERO reg-
(2015) Optic nerve sonography in the diagnostic evaluation of pseu- ister study. J Clin Epidemiol 79:46–54. https​://doi.org/10.1016/j.jclin​
dopapilledema and raised intracranial pressure: a cross-sectional study. epi.2016.03.025
Neurol Res Int 2015:146059. https​://doi.org/10.1155/2015/14605​9 40. Ballantyne SA, O’Neill G, Hamilton R, Hollman AS (2002) Observer vari-
26. Rajajee V, Vanaman M, Fletcher JJ, Jacobs TL (2011) Optic nerve ultra- ation in the sonographic measurement of optic nerve sheath diameter
sound for the detection of raised intracranial pressure. Neurocrit Care in normal adults. Eur J Ultrasound 15:145–149. https​://doi.org/10.1016/
15:506–515. https​://doi.org/10.1007/s1202​8-011-9606-8 S0929​-8266(02)00036​-8
27. Moretti R, Pizzi B (2009) Optic nerve ultrasound for detection of intrac- 41. Tayal VS, Neulander M, Norton HJ, Foster T, Saunders T, Blaivas M (2007)
ranial hypertension in intracranial hemorrhage patients confirmation of Emergency department sonographic measurement of optic nerve
previous findings in a different patient population. J Neurosurg Anesthe- sheath diameter to detect findings of increased intracranial pressure
siol 21:16–20. https​://doi.org/10.1097/ANA.0b013​e3181​85996​a in adult head injury patients. Ann Emerg Med 49:508–514. https​://doi.
28. Geeraerts T, Launey Y, Martin L et al (2007) Ultrasonography of the optic org/10.1016/j.annem​ergme​d.2006.06.040
nerve sheath may be useful for detecting raised intracranial pressure 42. Bäuerle J, Niesen WD, Egger K, Buttler KJ, Reinhard M (2016) Enlarged
after severe brain injury. Intensive Care Med 33:1704–1711. https​://doi. optic nerve sheath in aneurysmal subarachnoid hemorrhage despite
org/10.1007/s0013​4-007-0797-6 normal intracranial pressure. J Neuroimaging 26:194–196. https​://doi.
29. Jeon JP, Lee SU, Kim SE et al (2017) Correlation of optic nerve sheath org/10.1111/jon.12287​
diameter with directly measured intracranial pressure in Korean adults 43. Bratton SL, Chestnut RM, Ghajar J et al (2007) Guidelines for the manage-
using bedside ultrasonography. PLoS One 12:e0183170. https​://doi. ment of severe traumatic brain injury. VI. Indications for intracranial
org/10.1371/journ​al.pone.01831​70 pressure monitoring. J Neurotrauma 24(Suppl 1):S37–S44. https​://doi.
30. Kimberly HH, Shah S, Marill K, Noble V (2008) Correlation of optic nerve org/10.1089/neu.2007.9990
sheath diameter with direct measurement of intracranial pressure. Acad 44. Robba C, Citerio G (2017) Focus on brain injury. Intensive Care Med
Emerg Med 15:201–204. https​://doi.org/10.1111/j.1553-2712.2007.00031​ 43:1418–1420. https​://doi.org/10.1007/s0013​4-017-4869-y
.x 45. Asehnoune K, Balogh Z, Citerio G et al (2017) The research agenda
31. del Saz-Saucedo P, Redondo-González O, Mateu-Mateu Á, Huertas-Arroyo for trauma critical care. Intensive Care Med 43:1340–1351. https​://doi.
R, García-Ruiz R, Botia-Paniagua E (2016) Sonographic assessment of the org/10.1007/s0013​4-017-4895-9
optic nerve sheath diameter in the diagnosis of idiopathic intracranial 46. Cnossen MC, Huijben JA, Van Der Jagt M et al (2017) Variation in monitor-
hypertension. J Neurol Sci 361:122–127. https​://doi.org/10.1016/j. ing and treatment policies for intracranial hypertension in traumatic brain
jns.2015.12.032 injury: a survey in 66 neurotrauma centers participating in the CENTER-
32. Anderson RC, Kan P, Klimo P, Brockmeyer DL, Walker ML, Kestle JR (2004) TBI study. Crit Care 21:233. https​://doi.org/10.1186/s1305​4-017-1816-9
Complications of intracranial pressure monitoring in children with 47. Robba C, Cardim D, Donnelly J et al (2016) Effects of pneumoperitoneum
head trauma. J Neurosurg 101(Suppl 1):53–58. https​://doi.org/10.3171/ and Trendelenburg position on intracranial pressure assessed using
ped.2004.101.2.0053 different non-invasive methods. Br J Anaesth 117:783–791. https​://doi.
33. Dubourg J, Messerer M, Karakitsos D et al (2013) Individual patient org/10.1093/bja/aew35​6
data systematic review and meta-analysis of optic nerve sheath 48. Robba C, Bragazzi NL, Bertuccio A et al (2017) Effects of prone position
diameter ultrasonography for detecting raised intracranial pres- and positive end-expiratory pressure on noninvasive estimators of ICP: a
sure: protocol of the ONSD research group. Syst Rev 2:62. https​://doi. pilot study. J Neurosurg Anesthesiol 29:243–250. https​://doi.org/10.1097/
org/10.1186/2046-4053-2-62 ANA.00000​00000​00029​5
34. Nabeta HW, Bahr NC, Rhein J et al (2014) Accuracy of noninvasive 49. Blaivas M, Theodoro D, Sierzenski PR (2003) Elevated intracranial
intraocular pressure or optic nerve sheath diameter measurements for pressure detected by bedside emergency ultrasonography of
predicting elevated intracranial pressure in cryptococcal meningitis. the optic nerve sheath. Acad Emerg Med 10:376–381. https​://doi.
Open Forum Infect Dis 1:ofu093. https​://doi.org/10.1093/ofid/ofu09​3 org/10.1111/j.1553-2712.2003.tb013​52.x
35. Wang LJ, Chen LM, Chen Y, Bao LY, Zheng NN, Wang YZ, Xing YQ (2018) 50. Gatsonis C, Paliwal P (2006) Meta-analysis of diagnostic and screening
Ultrasonography assessments of optic nerve sheath diameter as a test accuracy evaluations: methodologic primer. AJR Am J Roentgenol
noninvasive and dynamic method of detecting changes in intracranial 187:271–281. https​://doi.org/10.2214/AJR.06.0226
pressure. JAMA Ophthalmol 136:250–256. https​://doi.org/10.1001/jamao​ 51. Koziarz A, Sne N, Kegel F et al (2017) Optic nerve sheath diameter sonog-
phtha​lmol.2017.6560 raphy for the diagnosis of increased intracranial pressure: a systematic
36. Sterne JAC, Gavaghan D, Egger M (2000) Publication and related bias in review and meta-analysis protocol. BMJ Open 7:e016194. https​://doi.
meta-analysis: power of statistical tests and prevalence in the litera- org/10.1136/bmjop​en-2017-01619​4
ture. J Clin Epidemiol 53:1119–1129. https​://doi.org/10.1016/S0895​ 52. Bürkner PC, Doebler P (2014) Testing for publication bias in diagnostic
-4356(00)00242​-0 meta-analysis: a simulation study. Stat Med 33:3061–3077. https​://doi.
37. PROSPERO. York, England: Centre for reviews and dissemination, Univer- org/10.1002/sim.6177
sity of York. http://www.crd.york.ac.uk/PROSP​ERO/. Accessed 19 June 53. Santori G (2016) Research papers: journals should drive data reproduc-
2018 ibility. Nature 535:355. https​://doi.org/10.1038/53535​5b

You might also like