Professional Documents
Culture Documents
Clinical science
Table 3 The three approaches for model development and their performance
Approaches Variables (n) Variables C-statistics (95% CI) Calibration slope (95% CI)
Model A: clinical 9 No pre-admission ULT,* ULT adjustment,*† diuretic adjustment,*† pre- 0.82 (0.77 to 0.86) 0.93 (0.33 to 1.52)
knowledge-driven admission urate>0.36 mmol/L,* tophus, no pre-admission prophylaxis,
prophylaxis started/increased,† AKI, surgery, IV fluid≥2 L within 48 hours,‡
dialysis,‡ alcohol drinking (yes/no)‡
Model B: statistics- 15 No pre-admission ULT,* ULT adjustment,*† diuretic adjustment,*† pre- 0.81 (0.76 to 0.86) 2.11 (1.66 to 2.56)
driven admission urate>0.36 mmol/L,* tophus, no pre-admission prophylaxis,
prophylaxis started/increased,† AKI, IV fluid≥2 L within 48 hours, disease of the
nervous system (primary diagnosis), stroke (comorbidity), warfarin adjustment,
blood product, CRP>100 mg/L† or CRP not tested, platelet>450×109/L†
Model C: decision tree 5 No pre-admission ULT,* ULT adjustment,*† diuretic adjustment,*† pre- 0.76 (0.71 to 0.82) NA
admission urate>0.36 mmol/L,* IV fluid≥2 L within 48 hours
*Selected by all three approaches.
†Occurs during admission and prior to flare.
‡Removed from the multivariate regression model due to p-value greater than 0.05.
AKI, acute kidney injury;CRP, C-reactive protein; IV, intravenous; NA, not applicable; ULT, urate-lowering therapy.
Table 4 Variables in the final model using multivariable regression with shrinkage
Variable OR (95% CI) P value Regression coefficients Regression coefficients with shrinkage*
Intercept – – −6.060 −5.393
No pre-admission ULT 4.40 (2.50 to 7.87) <0.001 1.481 1.318
ULT adjustment† 3.04 (1.31 to 7.03) 0.009 1.111 0.989
Diuretics adjustment† 2.91 (1.58 to 5.39) 0.001 1.070 0.952
Pre-admission urate>0.36 mmol/L 3.36 (1.31 to 8.61) 0.012 1.212 1.079
Tophus 4.32 (1.39 to 13.40) 0.011 1.462 1.301
No pre-admission gout prophylaxis 8.44 (2.26 to 31.57) 0.002 2.133 1.898
Gout prophylaxis started or increased† 17.36 (2.76 to 109.24) 0.002 2.854 2.540
Acute kidney injury 2.33 (1.23 to 4.43) 0.01 0.845 0.752
Surgery 1.84 (1.01 to 3.38) 0.049 0.610 0.543
*Shrinkage factor=0.89.
†Occurs during admission and prior to flare.
ULT, urate-lowering agent.
discrimination but slightly lower calibration when tested in 1000 ‘validation’ subgroups, as data splitting could undermine the
hypothetical data sets. power of regression analysis and might be prone to fortuitous
splitting. For a data set with relatively small event number, boot-
Discussion strap validation is a preferable option for internal validation.20
We found that nine variables from the clinical knowledge- Furthermore, our decision to take three different approaches
driven model were associated with the risk of inpatient gout of model development allowed us to see patterns of variables
flare among patients with comorbid gout. These variables were emerging from different methods. For the nine-item final model,
consistent with existing knowledge. In theory, an acute illness four variables were also selected by the other two approaches.
could prime macrophages for an inflammatory response to This apparent agreement between different methods is relatively
deposited monosodium urate crystals.21 In addition, a change reassuring in terms of the reliability of the models.
in serum urate concentration could also promote partial disso- The final model was derived from a clinical knowledge-driven
lution of crystal deposits and crystal release.7 In our study, the variable selection. This approach is generally preferable to selec-
association between gout flare and ULT adjustment, diuretic tion based on p value alone (univariate and stepwise selection),
adjustment, surgery and AKI may be explained by these mecha- which is prone to selecting spurious predictors and overfitting.16
nisms, as these factors were likely associated with the patients’ In this regard, the clinical knowledge-driven model could be
acute illness and alteration of serum urate level. The effect of considered as more robust than the statistics-driven model. This
ULT adjustment on gout flare is further supported by trials that assumption is supported by model A’s superior performance.
found an increase of gout flare rate after initiation of ULT.22 23 Another advantage of the clinical knowledge-driven approach is
The remaining five predictors (no pre-admission ULT or gout that it ensures that all variables are intuitive to clinicians and that
prophylaxis, gout prophylaxis started/increased during admis- they are feasible in routine hospital setting.
sion, tophus and urate>0.36 mmol/L) generally reflect subop- There are a number of limitations to our study. It must be
timal gout treatment. Prophylaxis started/increased during emphasised that a predictive model cannot capture all existing
admission, in particular, likely reflects poorly controlled gout predictors. The retrospective nature of this study meant that
(ie, frequent flare) that prompted the doctors to take preven- data were limited to those documented in hospital record. Some
tive action. In the context of multivariable model, the presence variables, such as tophus and alcohol history, might be underes-
of ‘prophylaxis started/increased’ further emphasises the signif- timated or otherwise inaccurate especially in the non-flare group
icance of the other eight predictors because they remain predic- where gout was not the focus during admission. There was a
tive of flare despite some people receiving new or higher dose small possibility that people with conditions which often mimic
of prophylaxis. Urate concentration of <0.36 mmol/L is recom- the natural course of gout flare (eg, calcium pyrophosphate
mended as a therapeutic target of gout management.24 25 Our crystal arthritis) could have been mistakenly included as having a
study strengthens the importance of this treat-to-target strategy. gout flare episode. However, this could be considered a strength.
This study took many steps to minimise potential bias. We If the cohort were confounded by non-gout episodes, the associ-
identified patients using word search and ICD-10 coding for ation of the selected covariates should have been weaker because
comorbidity. Patient identification using discharge ICD coding our covariates are highly specific to gout. In our opinion, the
alone could carry bias towards flare group, as gout is more likely strong association found in our models despite this limitation
to be coded if it was active during inpatient stay. Previous studies is compelling. Regarding sample size, our cohort was relatively
relying on ICD coding alone reported much higher prevalence small for prediction model development. Despite our effort to
of inpatient flare among people with comorbid gout, compared make the model as robust as possible, there remains a proba-
with our cohort (34%–35% vs 14%).12 26 We also excluded bility that the model will not perform as well as expected in a
repeated admissions to ensure that all cases in the final cohort different population. The number of gout flare episodes were
were independent from each other. Finally, all comorbid gout also lower than originally expected, which could limit the power
and flare episodes were confirmed by manual hospital record of the regression analysis. An external validation is planned for
review in accordance to the predefined case definition. a future study.
To minimise over-optimism, we applied shrinkage techniques Our study provides some evidence supporting the role of
to correct for potential over-optimism in models A and B. We several variables long suspected to increase the risk of inpa-
refrained from splitting our cohort into ‘development’ and tient gout flare. The proposed predictors are practical and
Jatuworapruk K, et al. Ann Rheum Dis 2019;0:1–6. doi:10.1136/annrheumdis-2019-216277 5
Crystal arthropathies
non-invasive, as they are readily available in typical hospital 6 Saseen JJ, Agashivala N, Allen RR, et al. Comparison of patient characteristics and
care setting. The model may help clinicians identify hospitalised gout-related health-care resource utilization and costs in patients with frequent
versus infrequent gouty arthritis attacks. Rheumatology 2012;51:2004–12.
patients with comorbid gout who are at risk of developing flare. 7 Fisher MC, Pillinger MH, Keenan RT. Inpatient gout: a review. Curr Rheumatol Rep
It must be emphasised that the target group for these predic- 2014;16:458.
tors is hospitalised people with comorbid gout rather than the 8 Kang EH, Lee EY, Lee YJ, et al. Clinical features and risk factors of postsurgical gout.
general inpatient population. Consequently, identification of Ann Rheum Dis 2008;67:1271–5.
9 Zleik N, Elfishawi MM, Kvrgic Z, et al. Hospitalization increases the risk of acute
patients with comorbid gout at the time of admission is essential arthritic flares in gout: a population-based study over 2 decades. J Rheumatol
before any risk evaluation could begin. 2018;45:1188–91.
Acknowledgements We would like to thank Gordon Purdie and James Stanley, 10 Neogi T, Jansen TLTA, Dalbeth N, et al. 2015 gout classification criteria: an American
College of Rheumatology/European League against rheumatism collaborative
Biostatistical Services, University of Otago, Wellington, for their statistical advices.
initiative. Arthritis Rheumatol 2015;67:2557–68.
Contributors KJ and WT designed the study. KJ collected the data. KJ, RG, ND and 11 Vittinghoff E, McCulloch CE. Relaxing the rule of ten events per variable in logistic
WT were involved in the data analysis, data interpretation and model development. and COX regression. Am J Epidemiol 2007;165:710–8.
All authors were involved in manuscript preparation and have approved the 12 Petersel D, Schlesinger N. Treatment of acute gout in hospitalized patients. J
submitted version of the manuscript. Rheumatol 2007;34:1566–8.
13 Groll DL, To T, Bombardier C, et al. The development of a comorbidity index with
Funding The authors have not declared a specific grant for this research from any
physical function as the outcome. J Clin Epidemiol 2005;58:595–602.
funding agency in the public, commercial or not-for-profit sectors.
14 Taylor WJ, Fransen J, Jansen TL, et al. Study for updated gout classification criteria
Competing interests RG reports grants and personal fees from AbbVie, (sugar): identification of features to classify gout. Arthritis Care Res 2016;68:1894–8.
personal fees from Janssen and personal fees from Pfizer, outside submitted 15 Van Houwelingen JC, Le Cessie S. Predictive value of statistical models. Stat Med
work. ND reports grants and personal fees from AstraZeneca, grants from Amgen, 1990;9:1303–25.
personal fees from Dyve, personal fees from Hengrui, personal fees from Horizon, 16 Steyerberg EW, Eijkemans MJ, Harrell FE, et al. Prognostic modelling with logistic
personal fees from Kowa, personal fees from Abbvie, personal fees from Pfizer, regression analysis: a comparison of selection and estimation methods in small data
personal fees from Janssen, outside the submitted work. KJ and WT have nothing sets. Stat Med 2000;19:1059–79.
to disclose. 17 Steyerberg EW, Eijkemans MJC, Habbema JDF. Application of shrinkage techniques in
logistic regression analysis: a case study. Stat Neerl 2001;55:76–88.
Patient consent for publication Not required. 18 Geurts P, Irrthum A, Wehenkel L. Supervised learning with decision tree-based
Ethics approval The Human Research Ethics Committee, University of Otago, methods in computational and systems biology. Mol Biosyst 2009;5:1593–605.
reviewed and approved the study protocol (reference number H18/012). 19 Song Y-Y, Lu Y. Decision tree methods: applications for classification and prediction.
Shanghai Arch Psychiatry 2015;27:130–5.
Provenance and peer review Not commissioned; externally peer reviewed. 20 Moons KGM, Kengne AP, Woodward M, et al. Risk prediction models: I. Development,
Data availability statement All data relevant to the study are included in the internal validation, and assessing the incremental value of a new (bio)marker. Heart
article or uploaded as supplementary information. 2012;98:683–90.
21 So AK, Martinon F. Inflammation in gout: mechanisms and therapeutic targets. Nat
ORCID iD Rev Rheumatol 2017;13:639–47.
Kanon Jatuworapruk http://orcid.org/0000-0002-9301-8941 22 Schumacher HR, Becker MA, Wortmann RL, et al. Effects of febuxostat versus
allopurinol and placebo in reducing serum urate in subjects with hyperuricemia and
gout: a 28-week, phase III, randomized, double-blind, parallel-group trial. Arthritis
References Rheum 2008;59:1540–8.
1 Kuo C-F, Grainge MJ, Zhang W, et al. Global epidemiology of gout: prevalence, 23 Becker MA, Schumacher HR, Espinoza LR, et al. The urate-lowering efficacy and
incidence and risk factors. Nat Rev Rheumatol 2015;11:649–62. safety of febuxostat in the treatment of the hyperuricemia of gout: the confirms trial.
2 Winnard D, Wright C, Taylor WJ, et al. National prevalence of gout derived from Arthritis Res Ther 2010;12.
administrative health data in Aotearoa New Zealand. Rheumatology 2012;51:901–9. 24 Khanna D, Fitzgerald JD, Khanna PP, et al. 2012 American College of rheumatology
3 Singh JA, Strand V. Gout is associated with more comorbidities, poorer health-related guidelines for management of gout. Part 1: systematic nonpharmacologic and
quality of life and higher healthcare utilisation in US veterans. Ann Rheum Dis pharmacologic therapeutic approaches to hyperuricemia. Arthritis Care Res
2008;67:1310–6. 2012;64:1431–46.
4 Lin Y-H, Hsu H-L, Huang Y-C, et al. Gouty arthritis in acute cerebrovascular disease. 25 Richette P, Doherty M, Pascual E, et al. 2016 updated EULAR evidence-based
Cerebrovasc Dis 2009;28:391–6. recommendations for the management of gout. Ann Rheum Dis 2017;76:29–42.
5 Lee G, Roberts L. Healthcare burden of in-hospital gout. Intern Med J 26 Gnanenthiran SR, Hassett GM, Gibson KA, et al. Acute gout management during
2012;42:1261–3. hospitalization: a need for a protocol. Intern Med J 2011;41:610–7.