Professional Documents
Culture Documents
Antimicrobial resistance is impacting treatment decisions for, and patient outcomes from, bacterial infections Lancet Infect Dis 2021;
worldwide, with particular threats from infections with carbapenem-resistant Enterobacteriaceae, Acinetobacter baumanii, 21: e175–81
or Pseudomonas aeruginosa. Numerous areas of clinical uncertainty surround the treatment of these highly resistant Published Online
April 21, 2021
infections, yet substantial obstacles exist to the design and conduct of treatment trials for carbapenem-resistant bacterial
https://doi.org/10.1016/
infections. These include the lack of a widely acceptable optimised standard of care and control regimens, varying S1473-3099(20)30791-X
antimicrobial susceptibilities and clinical contraindications making specific intervention regimens infeasible, and *Contributed equally
diagnostic and recruitment challenges. The current single comparator trials are not designed to answer the urgent MRC Clinical Trials Unit at
public health question, identified as a high priority by WHO, of what are the best regimens out of the available options University College
that will significantly reduce morbidity, costs, and mortality. This scenario has an analogy in network meta-analysis, London, London, UK
which compares multiple treatments in an evidence synthesis to rank the best of a set of available treatments. To (Prof A S Walker FMedSci,
Prof I R White PhD,
address these obstacles, we propose extending the network meta-analysis approach to individual randomisation of R M Turner PhD); Centre for
patients. We refer to this approach as a Personalised RAndomised Controlled Trial (PRACTical) design that compares Tropical Medicine and Global
multiple treatments in an evidence synthesis, to identify, overall, which is the best treatment out of a set of available Health, Nuffield Department of
Medicine, University of Oxford,
treatments to recommend, or how these different treatments rank against each other. In this Personal View, we
Oxford, UK (Prof A S Walker,
summarise the design principles of personalised randomised controlled trial designs. Specifically, of a network of Prof N J White FRS,
different potential regimens for life-threatening carbapenem-resistant infections, each patient would be randomly Prof G E Thwaites FMedSci);
assigned only to regimens considered clinically reasonable for that patient at that time, incorporating antimicrobial National University of
Singapore, Saw Swee Hock
susceptibility, toxicity profile, pharmacometric properties, availability, and physician assessment. Analysis can use both
School of Public Health,
direct and indirect comparisons across the network, analogous to network meta-analysis. This new trial design will Singapore (L Y Hsu MD);
maximise the relevance of the findings to each individual patient, and enable the top-ranked regimens from any Lee Kong Chian School of
personalised randomisation list to be identified, in terms of both efficacy and safety. Medicine, Nanyang
Technological University,
Singapore (T W Yeo MD);
Introduction for combi nation therapies. Outstanding questions, Mahidol-Oxford Research
Broad-spectrum multidrug resis tance is impacting highlighted in recent reviews,7–11 include whether high- Unit, Faculty of Tropical
treat
ment decisions for, and patient outcomes from, dose carbapenems might overcome low-level resistance, Medicine, Mahidol
University, Bangkok,
bacterial infections worldwide, particularly in Asia whether old, potentially toxic drugs, (such as colistin)
Thailand (Prof N J White);
and southern Europe. Infections with carbapenem- are more effective in combination with other drugs, St George’s University of
resistant Enterobacteriaceae, Acinetobacter baumanii, or and whether alternative drugs synergistically increase London, London, UK
Pseudomonas aeruginosa are the clearest threat, with antimicrobial potency (for example, polymyxin B plus (Prof M Sharland MD); and
Oxford University Clinical
multiple documented mechanisms of carbapenem resis zidovudine).12 Research Unit, Ho Chi Minh
tance.1 Many of these mechanisms co-occur with Randomised controlled trials provide the most robust City, Vietnam
resistance to multiple antibiotic classes and are spread by evidence regarding the relative effectiveness of different (Prof G E Thwaites)
mobile genetic elements, including plasmids, which therapeutic options.13 However, despite the plethora of Correspondence to:
facilitate their spread. This mechanism leads to mosaic questions, there are few randomised trials in carbapenem- Prof Guy Thwaites ,
Oxford University Clinical
patterns of resistance, requiring personalisation of anti resistant infections to provide clear answers. Clinical
Research Unit, 764 Vo Van Kiet,
biotic therapy guided by antimicrobial susceptibility practice is currently guided by retrospective observational Ho Chi Minh city, Vietnam
testing. cohort studies, such as the INCREMENT study, where gthwaites@oucru.org
Numerous areas of clinical uncertainty surround the combination therapy was associated with improved
treatment of these highly resistant infections, particularly clinical outcomes in patients at high risk of infection.14
because in-vitro data (eg, from hollow-fibre models) The challenges of doing randomised controlled trials are
suggest that antibiotic combinations might be synergistic2 illustrated by the US Food and Drug Administration’s
or antagonistic.3 The situation is made more complex by a (FDA) approval in 2018 of plazomicin on the basis of the
lack of standardisation of in-vitro pharmacokinetic and CARE trial, which screened 2000 adults and randomly
pharmacodynamic (PK–PD) models and dose-optimisation assigned only 39 over 2 years.15 Of note, the parallel trial of
methods for single-antibiotic drug development pro plazomicin versus meropenem (EPIC), for complicated
grammes,4 recently highlighted by the National Institute urinary tract infection recruited 609 adults but had
of Allergy and Infectious Diseases (North Bethesda, 0·2% mortality overall,16 compromising extrapolation
MD, USA).5,6 There is further lack of clarity on the to more serious infections. One of the largest trials
relationship between in-vitro data and clinical outcomes in carbapenem-resistant infections to date randomised
such a trial is shown in the table with a flow diagram in into a personal randomisation list based on physician
figure 1. preference or local availability. Although there would
We propose that the eligible population would be probably be some clinician or site-specific preferences for
patients with bloodstream infections and hospital- certain regimens, given combination therapy choices in
associated or ventilator-associated pneumonia (as defined studies to date,26 these preferences are very likely to vary
by the FDA24 or European Medicines Agency25), highly substantially between sites, and even between clinicians
likely or proven to be caused by a carbapenem-resistant within sites. In practice, sufficient numbers of participating
organism (carbapenem-resistant Enterobacteriaceae, sites and previous assessment of site and physician
A baumanii, or P aeruginosa). These infections are still preferences would ensure variation in the personal
relatively uncommon in high-income settings but are randomisation lists and overcome potential risks of
now common in Asia,26 where such trials should be done. restricted prescribing. A single protocol would harmonise
Patients would be randomly assigned when the clinician delivery of each regimen and management. The number
decides to initiate therapy to treat a life-threatening of different regimens and complexity of dosing would
proven or highly likely carbapenem-resistant infection. preclude masking, but standard two-arm trials in this area
Generally, this decision requires the results of culture of research have been open label for similar reasons.
and antimicrobial susceptibility testing, but might be The trial endpoints should be objective (reducing the
affected by known previous carbapenem-resistant effect of lack of blinding) with direct relevance to patients
organism colonisation or other epidemiological risk and physicians. Both bloodstream infections and hospital-
factors. associated or ventilator-associated pneumonia are life-
The physician would consider the treatment options threatening infections. Therefore, we consider that phase 3
for each individual patient from the full regimen trials, which aim to provide practice-changing evidence,
list based upon their assessment of the nature and should be large and definitive with mortality as their
antimicrobial susceptibility of the infecting organisms, primary endpoint.27 Syndrome-specific outcomes have
clinical presentation, PK–PD properties of the drugs been defined by regulators assessing licensing trials and
available, and the patient’s characteristics (table). This these could also be included as endpoints.
could be conceptualised as a list of predefined inclusion
and exclusion criteria that the physician would use to Statistical considerations
determine the initial randomisation possibilities for Extrapolating from network meta-analysis, initial simu
each patient, which could then be further individualised lations show that two-analysis methods give appropriate
inference about differences between regimens. The The potential for variation by age raises the question as
network method corresponds to a common-effect to whether such a trial should recruit adults or
network meta-analysis, combining direct and indirect adolescents only, infants or children only, or both, given
evidence by assuming consistency (ie, that relative the threat that carbapenem-resistant organism infections
treatment effects are the same for each patient type).23 pose across the age groups. Assuming appropriate dose
Failure of consistency would be shown by interactions adjustment for maturity, patient’s weight, and kidney
between treatment and personalised randomisation. function (thus overcoming major age-driven differences
In the pairwise method, all data for each pairwise in pharma cokinetics), the antimicrobial action of
comparison of any two regimens (a pairwise trial) are different drugs and combinations is unlikely to vary
stacked and analysed using robust variance adjustments. substantially by age. There is a recognised ethical
Both network and pairwise methods ensure that direct obligation to ensure that children benefit from research
comparisons between any pair of regimens are informed to identify the best treatments for them as for adults.28
only by patients who are eligible for both regimens and We can identify no current trials on carbapenem-resistant
are, therefore, comparable. Uncertainty will be expressed organisms in children. A review of the global literature
via confidence intervals around relative treatment noted a mortality of 36% from a total of 23 children and
effects, but our aim is not to show statistical significance 38 neonates.29 Therefore, we strongly advocate for
and so there is no need to allow for multiple testing. including all ages in the trial. A single independent data
Instead, across a network of regimens, the goal is monitoring committee would monitor safety and efficacy
essentially to rank the options and provide some degree (eg, by use of single-group Bayesian stopping rules) to
of assurance that the top-ranked regimen that is relevant halt randomisation to regimens with unacceptable
for any individual patient is one of the best regimens toxicity,30 overall and by age group.
for that patient. For example, from the table, a new The primary analysis would be intention to treat.
patient could take any of these regimens: plazomicin, Postrandomisation changes to antimicrobial therapy are
ceftazidime plus avibactam, high-dose meropenem, permissable and probable, but can be assumed to
high-dose meropenem plus ertapenem, high-dose mero represent what would happen outside the trial context,
penem plus polymyxin B with or without zidovudine, or where the trial regimens would be used in clinical
high-dose meropenem plus high-dose tigecycline. The practice. Therefore, the initial randomised comparison
goal of a personalised randomised trial is to ensure that will more closely reflect real-world effectiveness. Changes
there is a high probability that the top-ranked regimen from randomised treatment could also be adjusted for
from this list based on the trial’s results provides using inverse probability weighting methods.31 If cure
an expected improvement in the primary outcome was the primary efficacy endpoint, and change of regimen
compared with any randomly chosen regimen from this was counted as a failure, then a further possibility would
list. be to re-randomise patients who need to change treatment
One important challenge for all trials is variation in for lack of response, clinical deterioration, or treatment-
differences between regimens by, for example, hetero emergent toxicity to a new personalised list of acceptable
geneous types and severity of comorbidity or underlying regimens.32 Our proposal differs from a Sequential
disease (ie, subgroup effects or interactions), which even Multiple Assignment, Randomized Trial (SMART) design
traditional trial designs are rarely powered to detect. that aims to optimise sequences of treatments.
However, the fact that our new design uses both indirect
and direct evidence in any regimen comparison requires Sample size
specific consideration and checking of consistency in the Standard methods for determining sample size (eg, to
analysis. In all trials, not just this new proposed design, detect a clinically relevant improvement in outcome
the main approach to deal with heterogeneity in regimen from an intervention vs a comparator regimen) do not
comparisons is to restrict eligibility criteria to a more apply to a network of regimens. We did a simulation
homogeneous group and try to answer the questions analysis assuming that ten regimens in a network
within this group. The challenge is then to generalise have overall 30-day mortality uniformly distri buted
such results. The alternative is to enrol a broad and between 10–30%; if, hypothetically, we could choose the
generalisable group of patients and accept that power to true top-ranked regimen for each patient, then we would
detect all but the strongest interactions will be low. We reduce mortality by 5·5% on average across simulations
favour the latter approach, because, given the underlying compared with choosing a random regimen for each
mechanism of action (bacterial killing), it is plausible that patient from the personalised randomisation list. A
only qualitative (effect vs no effect) interactions are likely 5·5% reduction is, therefore, the maximum possible
to be clinically important. The ranking analysis method, average reduction in mortality if perfect information on
however, could be applied within specific subgroups to the true mortality under each regimen was available.
investigate, for example, whether the top three regimen Randomising 1000 patients provides an expected
choices from any personalised randomisation list varied mortality reduction of 4·6% from choosing the
substantially across different patient subgroups. top-ranked regimen based on the trial’s results versus
trial designs
or cost
H Advantages
Individual trade-offs
for a new patient F • No requirement for predefined standard of care control group, facilitating wide
recruitment across ages, centres, and countries.
cost ranking
Toxicity or
B
D • No requirement that both control and all interventions can be taken by all randomly
assigned patients, enhancing recruitment
• Pretrial engagement with physicians in construction of full randomisation list
A
increasing trial buy-in and subsequent recruitment
high toxicity
I
• Pragmatic eligibility criteria enhancing recruitment
Low rank,
or cost
Suboptimal Probably • Provides outcomes that can inform individual countries’ public health decisions
preferable
• Faster recruitment and multiple randomised groups result in quicker results on more
Low rank, High rank, relevant regimens
high mortality low mortality
Mortality
• Personalised randomisation list enhances potential benefit to patients from joining
the trial, because the regimens that they can be randomised to are more individually
Figure 2: Hypothetical ranking of regimens from a personalised relevant
randomisation list for a future individual patient after the trial • Trial mirrors normal clinical practice, easing on-the-ground delivery
Efficacy ranking based on predicted probability of primary outcome for the • Trial produces an easy to understand ranking of multiple patient-focused (eg, oral
personalised randomisation subset (table). I=high-dose meropenem plus high-
administration, few side-effects) and physician-focused outcomes (eg, drug
dose tigecycline. D=high-dose meropenem. H=high-dose meropenem plus
polymyxin B with or without zidovudine. F=high-dose meropenem plus susceptibility profile, renal function)
ertapenem. B=ceftazidime plus avibactam. A=plazomicin. • Results might lead to electronic clinical decision support systems that provide better
targeted therapy for individual patients
personalised randomisation list for some patients. There MC_UU_12023/29). ASW is also supported by the Oxford NIHR
will be competition for similar patients from innovator Biomedical Research Centre; and is an NIHR senior investigator.
GET and NJW are supported by the Wellcome Trust (UK). LYH is
companies doing carbapenem-resistant organism supported by the Singapore National Medical Research Council’s
studies, which will provide high per-patient fees. Many Collaborative Centre Grant (NMRC/CGAug16C005). The views
patients are not eligible for such standard two-arm expressed are those of the authors and not necessarily those of the UK
licencing trials, but could enter the proposed personalised National Health Service, the NIHR, the UK Department of Health, or
Public Health England.
randomisation trial. Whether and how data from this
novel design could support licensing applications would References
1 Bush K. Past and present perspectives on β-Lactamases.
need discussion with the FDA and European Medicines Antimicrob Agents Chemother 2018; 62: e01076-18.
Agency. Clinicians might potentially only wish to 2 Drusano GL, Neely MN, Yamada WM, et al. The combination of
randomise between their top two choices for an fosfomycin plus meropenem is synergistic for Pseudomonas
aeruginosa PAO1 in a hollow-fiber infection model.
individual patient, reducing power across the network of Antimicrob Agents Chemother 2018; 62: e01682-18.
regimens: clear criteria for inclusion and exclusion of 3 Pryjma M, Burian J, Kuchinski K, Thompson CJ. Antagonism
specific regimens and mini mising the number of between front-line antibiotics clarithromycin and amikacin in
the treatment of Mycobacterium abscessus infections is mediated
regimens that can be rejected for physician preference by the whiB7 gene. Antimicrob Agents Chemother 2017;
could mitigate this issue and increase generalisability. 61: e01353-17.
Recommending doses in patients likely to have renal 4 McAleenan A, Ambrose PG, Bhavnani SM, et al. Methodological
features of clinical pharmacokinetic-pharmacodynamic studies of
insufficiency, which might then improve during antibacterials and antifungals: a systematic review.
treatment, is challenging, particularly where access to J Antimicrob Chemother 2020; 75: 1374–89.
therapeutic drug monitoring is limited and as most of 5 Bulitta JB, Hope WW, Eakin AE, et al. Generating robust and
informative nonclinical in vitro and in vivo bacterial infection
the drugs under consideration do not have adequate model efficacy data to support translation to humans.
pharmacokinetic data in individuals with severe Antimicrob Agents Chemother 2019; 63: e02307-18 .
infections. 6 Rizk ML, Bhavnani SM, Drusano G, et al. Considerations for dose
selection and clinical pharmacokinetics/pharmacodynamics for
the development of antibacterial agents.
Conclusions Antimicrob Agents Chemother 2019; 63: e02309-18.
The major challenge to obtaining robust evidence on the 7 Carrara E, Bragantini D, Tacconelli E. Combination versus
most effective regimens for life-threatening carbapenem- monotherapy for the treatment of infections due to carbapenem-
resistant Enterobacteriaceae. Curr Opin Infect Dis 2018;
resistant infections is that a large number of the potential 31: 594–99.
treatment options in routine clinical care might not 8 Sheu CC, Chang YT, Lin SY, Chen YH, Hsueh PR. Infections
be relevant for any individual patient, preventing success caused by carbapenem-resistant enterobacteriaceae: an update on
therapeutic options. Front Microbiol 2019; 10: 80.
ful conduct of a traditional two-arm or even multiarm 9 Piperaki ET, Tzouvelekis LS, Miriagou V, Daikos GL.
randomised controlled trials. The current, largely Carbapenem-resistant Acinetobacter baumannii: in pursuit of an
innovator company-led, single comparator trials are not effective treatment. Clin Microbiol Infect 2019; 25: 951–57.
10 Durante-Mangoni E, Andini R, Zampino R. Management of
designed to answer the urgent public health question, carbapenem-resistant Enterobacteriaceae infections.
identified as a high priority by WHO, particularly for Clin Microbiol Infect 2019; 25: 943–50.
antibiotics in the reserve group of the Essential Medicines 11 Gutierrez-Gutierrez B, Rodriguez-Bano J. Current options for the
treatment of infections due to extended-spectrum beta-lactamase-
list, of what are the best regimens out of the available producing Enterobacteriaceae in different groups of patients.
options that will significantly reduce morbidity, costs, Clin Microbiol Infect 2019; 25: 932–42.
and mortality. We propose a novel trial design, building 12 Lin YW, Abdul Rahim N, Zhao J, et al. Novel polymyxin
on network meta-analysis methods, to maximise the combination with the antiretroviral zidovudine exerts synergistic
killing against NDM-producing multidrug-resistant
relevance to each individual patient, and enable the safest Klebsiella pneumoniae. Antimicrob Agents Chemother 2019;
and most efficacious regimens from any personalised 63: e02176-18.
randomisation list to be identified. 13 Barton S. Which clinical studies provide the best evidence?
The best RCT still trumps the best observational study. BMJ 2000;
Contributors 321: 255–56.
The concept of this Personal View was developed by ASW, IRW, RMT, 14 Gutierrez-Gutierrez B, Salamanca E, de Cueto M, et al. Effect of
MS, and GET, with input from HLY, YTW, and NJW. The manuscript appropriate combination therapy on mortality of patients with
was drafted by ASW, IRW, MS, and GET, and critically reviewed by all bloodstream infections due to carbapenemase-producing
authors. Enterobacteriaceae (INCREMENT): a retrospective cohort study.
Lancet Infect Dis 2017; 17: 726–34.
Declaration of interests 15 McKinnell JA, Dwyer JP, Talbot GH, et al. Plazomicin for
ASW reports grants from the UK Medical Research Council (MRC) infections caused by carbapenem-resistant enterobacteriaceae.
and from the UK National Institutes of Health Research (NIHR), N Engl J Med 2019; 380: 791–93.
during the conduct of the study. MS is the Chair of the Antibiotic 16 Wagenlehner FME, Cloutier DJ, Komirenko AS, et al. Once-daily
Working Group of the WHO Expert Committee on the Selection and plazomicin for complicated urinary tract infections. N Engl J Med
Use of Essential Medicines. The remaining authors declare no 2019; 380: 729–40.
competing interests. 17 Paul M, Daikos GL, Durante-Mangoni E, et al. Colistin alone
versus colistin plus meropenem for treatment of severe infections
Acknowledgments
caused by carbapenem-resistant Gram-negative bacteria:
ASW, IRW, and RMT are supported by core support from the MRC to an open-label, randomised controlled trial. Lancet Infect Dis 2018;
the MRC Clinical Trials Unit (MC_UU_12023/22 through a 18: 391–400.
concordat with the Department for International Development,
18 WHO. Antibacterial agents in clinical development: an analysis of 26 Stewardson AJ, Marimuthu K, Sengupta S, et al. Effect of
the antibacterial clinical development pipeline, including carbapenem resistance on outcomes of bloodstream infection
tuberculosis. Geneva, Switzerland: World Health Organization, caused by Enterobacteriaceae in low-income and middle-income
2017. https://www.who.int/medicines/areas/rational_use/ countries (PANORAMA): a multinational prospective cohort study.
antibacterial_agents_clinical_development/en/ (accessed Lancet Infect Dis 2019; 19: 601–10.
April 30, 2020). 27 Harris PNA, McNamara JF, Lye DC, et al. Proposed primary
19 Parmar MK, Sydes MR, Cafferty FH, et al. Testing many endpoints for use in clinical trials that compare treatment options
treatments within a single protocol over 10 years at MRC Clinical for bloodstream infection in adults: a consensus definition.
Trials Unit at UCL: multi-arm, multi-stage platform, umbrella and Clin Microbiol Infect 2017; 23: 533–41.
basket protocols. Clin Trials 2017; 14: 451–61. 28 Burman WJ, Cotton MF, Gibb DM, Walker AS, Vernon AA,
20 Lanini S, Ioannidis JPA, Vairo F, et al. Non-inferiority versus Donald PR. Ensuring the involvement of children in the evaluation
superiority trial design for new antibiotics in an era of high of new tuberculosis treatment regimens. PLoS Med 2008; 5: e176.
antimicrobial resistance: the case for post-marketing, adaptive 29 Dona D, Sharland M, Heath PT, Folgori L. Strategic trials to define
randomised controlled trials. Lancet Infect Dis 2019; 19: e444–51. the best available treatment for neonatal and pediatric sepsis caused
21 Rouse B, Chaimani A, Li T. Network meta-analysis: an introduction by carbapenem-resistant organisms. Pediatr Infect Dis J 2019;
for clinicians. Intern Emerg Med 2017; 12: 103–11. 38: 825–27.
22 Riley RD, Jackson D, Salanti G, et al. Multivariate and network 30 Zohar S, Teramukai S, Zhou Y. Bayesian design and conduct of
meta-analysis of multiple outcomes and multiple treatments: phase II single-arm clinical trials with binary outcomes: a tutorial.
rationale, concepts, and examples. BMJ 2017; 358: j3932. Contemp Clin Trials 2008; 29: 608–16.
23 Salanti G, Higgins JP, Ades AE, Ioannidis JP. Evaluation of 31 Hernan MA, Robins JM. Per-protocol analyses of pragmatic trials.
networks of randomized trials. Stat Methods Med Res 2008; N Engl J Med 2017; 377: 1391–98.
17: 279–301. 32 Kahan BC, Forbes AB, Dore CJ, Morris TP. A re-randomisation
24 US Department of Health and Human Services, Food and Drug design for clinical trials. BMC Med Res Methodol 2015; 15: 96.
Administration, Center for Drug Evaluation and Research. Hospital- 33 Parmar MK, Carpenter J, Sydes MR. More multiarm randomised
acquired bacterial pneumonia and ventilator-associated bacterial trials of superiority are needed. Lancet 2014; 384: 283–84.
pneumonia: developing drugs for treatment. 2020. https://www.fda.
gov/downloads/drugs/guidances/ucm234907.pdf (accessed © 2021 Elsevier Ltd. All rights reserved.
April 30, 2020).
25 EMA. Addendum to the guideline on the evaluation of medicinal
products indicated for treatment of bacterial infections. London, UK:
European Medicines Agency, Oct 24, 2013. https://www.ema.europa.
eu/en/documents/scientific-guideline/addendum-guideline-
evaluation-medicinal-products-indicated-treatment-bacterial-
infections_en.pdf (accessed April 30, 2020).