You are on page 1of 8

Clinical Review & Education

JAMA | Users' Guides to the Medical Literature

How to Use and Interpret the Results of a Platform Trial


Users’ Guide to the Medical Literature
Jay J. H. Park, PhD; Michelle A. Detry, PhD; Srinivas Murthy, MD, CM, MHSc; Gordon Guyatt, MD, MSc; Edward J. Mills, PhD

Multimedia
Platform trials are a type of randomized clinical trial that allow simultaneous comparison of CME Quiz at
multiple intervention groups against a single control group that serves as a common control jamacmelookup.com
based on a prespecified interim analysis plan. The platform trial design enables introduction
of new interventions after the trial is initiated to evaluate multiple interventions in an ongoing
manner using a single overarching protocol called a master (or core) protocol. When multiple
treatment candidates are available, rapid scientific therapeutic discoveries may be made.
Platform trials have important potential advantages in creating an efficient trial infrastructure
that can help address critical clinical questions as the evidence evolves. Platform trials have
recently been used in investigations of evolving therapies for patients with COVID-19.
The purpose of this Users’ Guide to the Medical Literature is to describe fundamental
concepts of platform trials and master protocols and review issues in the conduct and Author Affiliations: Author
interpretation of these studies. This Users’ Guide is intended to help clinicians and readers affiliations are listed at the end of this
article.
understand articles reporting on interventions evaluated using platform trial designs.
Corresponding Author: Edward J.
Mills, PhD, 802-777 W Broadway,
JAMA. 2022;327(1):67-74. doi:10.1001/jama.2021.22507 Vancouver, BC V5Z 1J5, Canada
(millsej@mcmaster.ca).

structure wherein interventions can be added and discontinued at


Clinical Scenario different times after their clinical questions are answered through
comparisons against a control group, sometimes shared across
A hospitalist physician is evaluating a 60-year-old patient with interventions.3-5 The control group and the standard care provided
severe COVID-19 who was admitted to the intensive care unit (ICU) can be updated during platform trials as interventions are shown to
and is receiving high-flow oxygen via nasal cannula. A resident phy- be effective or ineffective over time.5
sician on the ICU team is considering administration of intravenous In the setting of multiple competing but unestablished treat-
hydrocortisone to the patient. The hospitalist physician is ments with new treatments on the horizon, as occurred during the
requested to assess the evidence regarding that decision. The phy- COVID-19 pandemic, platform trials have important potential
sician is aware of a platform trial, the Randomized, Embedded, advantages compared with traditional, fixed approaches to clinical
Multifactorial Adaptive Platform Trial for Community-Acquired trial research. In many conventional RCTs, data are analyzed when
Pneumonia (REMAP-CAP), that investigated hydrocortisone vs no the last participant has finished their trial follow-up. These RCTs
hydrocortisone for patients with severe COVID-19.1 REMAP-CAP is typically have a fixed sample size and a defined end and usually
an ongoing, international, multicenter platform trial that aims to address only 1 intervention vs a comparator (ie, 2-group RCTs). In
determine best treatment strategies for patients with severe pneu- contrast, platform trials are typically designed with the intention of
monia in pandemic and nonpandemic settings.2 This trial is investi- continuing for a longer duration to enable multiple interventions to
gating multiple interventions including corticosteroids. be evaluated at different times. Platform trials also include pre-
The article reporting the corticosteroid findings of the specified interim statistical analyses that allow for adaptive actions
REMAP-CAP trial presented results on organ support–free days, (eg, stopping an intervention early for futility or expected success).
in-hospital mortality, and other clinical outcomes of 2 hydrocorti- Although multigroup and factorial RCTs can evaluate multiple inter-
sone regimens vs no hydrocortisone.1 To assess this article, and in ventions with a broader scope than 2-group RCTs, these trials are
particular to determine what inferences can be drawn from plat- limited to the interventions determined at the beginning of the
form trials compared with conventional randomized clinical trials trial. With a focus on identifying treatments for a medical condition
(RCTs), the physician uses the framework in the Users’ Guide to instead of evaluating specific interventions, platform trials are able
Platform Trials (Box 1). to evaluate multiple interventions to determine if any reach desired
levels of efficacy compared with standard care, and they can
quickly add or discontinue an intervention according to emerging
internal or external evidence.6
Fundamental Principles of Platform Trials
Platform trials are becoming more common in medical
Platform trials are RCTs that allow for multiple interventions to be research, but their utility may be limited if clinicians and other read-
simultaneously evaluated and new interventions to be added after ers are unfamiliar with their underlying concepts and their
the trial is initiated (Figure).3-5 The platform provides a single infra- interpretation.1,7,8 The purpose of this Users’ Guide to the Medical

jama.com (Reprinted) JAMA January 4, 2022 Volume 327, Number 1 67

© 2022 American Medical Association. All rights reserved.

Downloaded From: https://jamanetwork.com/ by a Royal College of Physicians User on 01/14/2022


Clinical Review & Education Users' Guides to the Medical Literature How to Use and Interpret the Results of a Platform Trial

for the dissemination of trial results after an intervention in the trial


Box 1. Questions Addressing Risk of Bias in Platform Trials is completed and the responsibilities of a committee (eg, trial steer-
• Were prespecified plans for interim and statistical analyses
ing committee) that may hold the ultimate decision for approving
used in the trial? Were the prespecified plans applied equally to the reporting of results.
all interventions?a In platform trials, interventions, regardless of when they are
• Did the investigators include nonconcurrent randomized added to the trial, are evaluated using prespecified adaptive deci-
participants or limit statistical comparisons to concurrently sion rules outlined in the protocol documents.5 Once the master pro-
randomized patients?a
tocol is finalized, new interventions follow the master protocol pre-
• Did the investigators minimize risk of bias from information flow
specified plans for interim analyses and decision rules unless
within and outside the specific platform?
• Did the investigators follow reporting guidelines in published deviations from the master protocol are prespecified in the inter-
reports of the trials? vention-specific appendix. The goal is to have few deviations from
a
the master protocol, yet allow for flexibility, if required, due to an
Addresses risk of bias specifically for platform trials.
evolving clinical field during the ongoing platform trial.
When a new intervention is available, several scientific and
Literature is to provide guidance on how to interpret the results practical considerations may guide the decisions regarding its
from platform trials (Box 1) and to describe the fundamental con- inclusion in the trial, including a sound rationale, support by a
cepts of platform trials (see Box 2 for relevant definitions). robust biological hypothesis, positive evidence of potential effi-
cacy, adequate safety profile, ease of administration, and low
The Master Protocol cost.17,18 These scientific merits may be reviewed by an indepen-
A master protocol is a set of documents with standardized operat- dent working group that consists of members from industry, aca-
ing procedures compiled for the goal of increasing trial quality demia, patient advocacy groups, and others with technical exper-
and efficiency.3 Three types of clinical trials that may be conducted tise, clinical expertise, or both and who are not directly involved
under the master protocol framework include basket trials, in the platform trial. An independent working group can screen
umbrella trials, and platform trials.3,7,13 In basket trials, a targeted and prioritize candidate interventions to be added to the platform
therapy is evaluated for multiple diseases with a common risk trial in instances for which many interventions could be simulta-
factor, such as a molecular alteration, or risk factors that that may neously evaluated.
help predict whether patients will respond to the given therapy.
Umbrella trials evaluate multiple targeted therapies in a single dis- Shared Infrastructure and Control Groups
ease that is stratified into multiple substudies based on different for Ongoing Evaluation
molecular or other predictive risk factors.3,13,14 Both of these trial In many platform trials, a large trial network can be established across
types can be platform trials in nature if they are designed to have multiple trial centers using standardized operating procedures out-
a common control group and enable the addition of new inter- lined in the protocol.3,14 Coordinated screening mechanisms with
ventions during the trial. A key element of these trials is use of centralized trial systems are implemented to streamline and im-
a master protocol.5 prove the quality of many trial processes and logistics.3 The com-
In platform trials, the master protocol may be structured in a mon database(s) and randomization system across the shared in-
modular format with all common generic elements of the trial, frastructure may allow for more seamless integration of the new
including documented standardized operating procedures that are interventions being added into the trial. These features combined
implemented for clinical trial evaluation. A modular-structured with centralized analytics may improve standardization of clinical
master protocol may include intervention appendixes specific to evaluation and reporting of different interventions being evalu-
each intervention that outline protocol elements specific to the ated in the platform over time.
intervention and that differ from the master protocol as well as A platform trial can evaluate multiple different interventions
other nonintervention appendixes outlining design details (eg, an against standardized common control groups. To address each of
adaptive-design report including details on the prespecified adap- these interventions separately in an RCT would require multiple
tation and the simulated trial operating characteristics).5 The addi- separate teams creating separate protocols, recruiting participating
tion of new interventions can be expedited because the master centers, establishing a methods center, obtaining ethics approval,
protocol is not updated every time a new intervention is added or and addressing all the challenges that arise as the trial proceeds.
discontinued; instead, an intervention-specific appendix is added. Conducting multiple trials independently could result in inefficien-
Administrative requirements such as institutional ethical review cies. Within a platform trial, this entire process is done only once,
may be expedited as the trial design for the new intervention is creating a large trial network across multiple centers or sites using
typically identical to the design that was first approved, and new standardized operating procedures outlined in the master protocol,
interventions may be indicated in an amendment to the trial proto- with central coordination, for all interventions and the control
col rather than requiring a complete new review.15 group.3,14 In creating coordinated screening mechanisms with cen-
The master protocol will often include details regarding tralized randomization, study monitoring, and common database
mechanisms for adding new interventions. The master protocol (s), the platform trial achieves efficiency and may also enhance
and other documents of platform trials are often available as quality.3 For example, the REMAP-CAP platform trial has evaluated
supplementary materials of publications and on trial websites (see, multiple interventions within multiple therapeutic areas (referred
for example the protocol documents of the REMAP-CAP platform to as domains by the REMAP Investigators), including antiviral
trial16). The protocol may also prespecify the communication plans agents, corticosteroids, and immunoglobulins.2

68 JAMA January 4, 2022 Volume 327, Number 1 (Reprinted) jama.com

© 2022 American Medical Association. All rights reserved.

Downloaded From: https://jamanetwork.com/ by a Royal College of Physicians User on 01/14/2022


How to Use and Interpret the Results of a Platform Trial Users' Guides to the Medical Literature Clinical Review & Education

Figure. Illustrative Example of a Platform Trial Schema

Placebo (common control)

Treatment 1
S TA RT O F P L AT F O R M T R I A L

Treatment 2

Treatment 3
The platform initially starts as a
Treatment 4
3-group randomized clinical trial with
placebo as a common control, and
Treatment 5 new treatments are introduced into
the platform over time. Green circles
indicate start of random assignment
Treatment 6 of participants to a new intervention,
and red circles indicate stopping of
Treatment 7 assignment and/or testing of that
intervention.

Common Control Group onstrates little to no chance of demonstrating desired clinical ben-
Different platform trials vary in design and objectives, but they all efits even if more participants are randomized to that intervention
plan on patients being randomized to an intervention or a simi- group.22 With early stopping for greater efficacy, an intervention
larly defined control group against which each intervention can can be declared as effective before the maximum recruitment tar-
be evaluated. 7,14 When at a single point in time, patients are get is reached for that intervention. Similar to other clinical trials
randomized to more than 1 intervention or a common control that allow early stopping at a prespecified interim analysis, plat-
group, platform trials can improve efficiency by reducing the form trials require prespecification of interim analysis plans and
number of patients needed in the control group compared with characterization of operating characteristics such as the type I error
the numbers of participants that would be needed in multiple rate. Because the accuracy of treatment effect estimates in trials
independent RCTs.4,19 that are stopped early for efficacy can be a concern when the
Such sample size savings represent an efficiency that could al- sample size is small, efficacy and statistical superiority thresholds
low testing more interventions than in multiple, separate interven- for early stopping are generally chosen to be more conservative for
tion trials. The efficiencies could result in lower costs relative to mul- interim analyses than for the final analysis of trials that continue to
tiple individual trials that address the same questions, addressing completion.23,24 Simulations are generally used to plan for interim
more interventions with the same cost, or some combination.20 analyses in platform trials.25,26
When effective interventions are identified in a platform trial, the Response-adaptive randomization is a potential design feature
control and standard care can be updated in the platform, allowing in multi-intervention platform trials in which allocation ratios can
research to continue toward investigating additional improvement be adapted, based on prespecified rules, at each interim analyses
in the new standard care. over the course of the trial.27,28 The allocation ratio among the
In multifactorial platform trials such as REMAP-CAP, in which intervention groups is adapted to favor the interventions with
multiple interventions from multiple intervention groupings more favorable interim results, while keeping the allocation ratio to
within a common clinical mode were simultaneously evaluated, the control group fixed.27,28 In platform trials and other multigroup
there are instances for which patients may only be eligible for a sub- trials, response-adaptive randomization could minimize the num-
set of the intervention groups.1,2 In such case, it is important that ber of participants being treated with a less effective treatment
only control group patients who were also eligible for the same in- and allow effective treatments to more quickly complete the trial
terventions are used for statistical estimates of treatment effects to because they receive more patients and improve the probability of
obtain a valid estimate of the comparative effectiveness. In placebo- selecting the best treatment group given that allocation is
controlled platform trials, multiple placebos may be required in adequately maintained in the control group.29 The optimal alloca-
the control group.21 tion ratio of intervention to control groups should be determined
using simulations.29
Because each platform trial will have different goals and there-
fore design features, there are no default interim analyses plans
The Users’ Guides for Platform Trials
that are best for all platform trials, and the simulations should be
Were Prespecified Plans for Interim and Statistical Analyses conducted before starting the trial to determine the best design for
Used in the Trial? each platform trial.30 The process of simulating virtual patients in
Well-planned platform trials will use statistical analyses with pre- virtual trial designs are used to inform, revise, and determine the
specified adaptations (ie, modification of key trial characteristics final statistical design, including the interim analysis plans and deci-
such as sample size and allocation ratios) and decision rules. sion rules. Many of the design features, such as early stopping and
Interim analyses will generally be used to allow for early stopping response-adaptive randomization, can affect the performance
for futility or efficacy as prespecified adaptations. The decision for characteristics (eg, type I error rate, statistical power, expected
early stopping for futility may be made when the intervention dem- sample size) of a given platform trial. Therefore, it is important to

jama.com (Reprinted) JAMA January 4, 2022 Volume 327, Number 1 69

© 2022 American Medical Association. All rights reserved.

Downloaded From: https://jamanetwork.com/ by a Royal College of Physicians User on 01/14/2022


Clinical Review & Education Users' Guides to the Medical Literature How to Use and Interpret the Results of a Platform Trial

evaluate different design features during the planning stage.23,26


Box 2. Glossary of Terms Used in Platform Trials Given the long-term or ongoing nature of platform trials, it may also
Platform trial: A type of randomized clinical trial design in which
be beneficial to conduct additional simulations when more data
multiple interventions can be evaluated simultaneously against become available that may either validate or contradict the
a common control group with flexibilities of allowing new assumptions that were made during the planning stage.5
interventions to be added and the control group to be updated As the investigators reported, the REMAP-CAP platform trial had
throughout the trial.5 Platform trials use a master protocol (also a prespecified statistical analysis plan for the COVID-19 corticoste-
called a core protocol9) to streamline and improve the quality of roid interventions that was prepared by a blinded steering commit-
many of the trial processes and logistics.3 These trials typically
tee, posted online before data lock and conduct of the final analy-
compare multiple interventions against a common control group
using prespecified interim analysis plans for statistical efficiencies. ses, and included as a supplement with the published artricle.1 Use
of a bayesian adaptive design and final analyses were planned using
Master protocol: Generally refers to an overarching protocol
designed to evaluate multiple interventional hypotheses.3,7 The simulations. For their specific bayesian design, simulations showed
master protocol document often contains standardized operating an estimated power of 90% of determining whether either of 2 hy-
procedures that are supplemented with intervention-specific drocortisone groups would be statistically superior to the control of
appendixes, a statistical analysis plan (SAP) appendix, a simulation no corticosteroid with a sample size of 500 patients and an odds ra-
appendix, and other protocol-related appendixes in a modular tio of 1.75 compared with the control, or at a sample size of 1000
structured format.5 The details on the prespecified modifications
patients if the odds ratio was 1.50.1
and decision rules that will be applied to all interventions are
included in the SAP and simulation appendixes.
Platform trials like REMAP-CAP that are designed under the
framework of bayesian statistics may allow for more intuitive
Fixed sample trial design: Conventional clinical trial design in
which the clinical trial data are assessed for efficacy after the last
interpretations.31-33 Traditionally used frequentist statistical mea-
participants have finished clinical follow-up. Clinical trials with fixed sures such as 95% CIs are often misinterpreted as 95% chance of
sample trial designs are designed with a fixed maximum sample size, the study estimate intervals containing the true effect size.34 The
a fixed number of interventions, and a defined end to the trial.4 REMAP-CAP investigators used 95% credible intervals (CrIs), which
Adaptive trial design: In an adaptive trial design, key trial are bayesian equivalent measures for CIs.34 Bayesian statistical analy-
characteristics (eg, randomization proportions, sample size, sis also allows for estimation of probability of a certain intervention
treatment groups) evolve in response to information accruing being statistically superior to standard care, which also may be more
within the trial according to prespecified rules.10-12 Adaptive trial intuitive to understand and apply in clinical practice.31
designs use interim analyses according to prespecified schedules
that allow key trial characteristics to evolve over time.
Did the Investigators Include Nonconcurrent Randomized
Simulation study: Used to investigate behavior of methods when
Participants or Limit Statistical Comparisons
applied to synthetic data sets generated with known characteristics.
In clinical trial design planning, simulations can be used to investigate to Concurrently Randomized Patients?
operating characteristics of different trial designs. For instance, trial data In conventional RCTs, enrollment for all groups including the con-
generatedwithandwithoutatreatmenteffectcanbeusedtoassesshow trol group will start at the same time, with randomization used to
often a given trial design correctly or incorrectly rejects the null allocate patients into different groups, and statistical comparisons
hypothesis to estimate its statistical power and type I error rate. are made with data from the concurrently randomized control
Interim analysis: A randomized clinical trial statistical analysis of group.35 In platform trials, investigational groups enter and finish the
clinical efficacy data that occurs before the last participant has finished trial at different times. For new interventions that are added into the
clinicalfollow-up.Interimanalysesmayleadtoearlystoppingforstatistical
platform later, there will be a set of previously randomized partici-
superiority when there is a sufficiently robust effect that exceeds pre-
pants in the control group (ie, nonconcurrent control participants)
specified statistical thresholds. Interim analyses may also lead to early
stopping for futility when data analysis suggests there is little chance of (Box 2). Although the control group participants have not been ran-
achievingadesiredmagnitudeoftreatmenteffect.Thetermstrialupdate domized at the same time as each intervention group participant in
or adaptive analysis may also be used instead of interim analysis. the platform trial, they were enrolled under the same inclusion and
Response-adaptive randomization: A type of adaptive trial design exclusion criteria and had end-point information collected in a con-
in which allocation ratios are adapted based on interim results so sistent manner. Because diseases may change over time, as in
more patients are randomized to treatments with favorable COVID-19 waves, it is not possible to be as confident of prognostic
interim results than those with less favorable results. This design is balance—the goal of randomization—as when patients are random-
often included in platform trials.
ized concurrently to intervention and control groups.
Concurrent control group participants: A concurrent control In the REMAP-CAP platform trial, the primary outcome analy-
group includes participants who were randomized to the
sis was conducted for all randomized patients who met criteria for
control group during the same time period as the participants
in a particular intervention treatment group.
severe COVID-19 criteria as of June 17, 2020, not only those who were
randomized within the corticosteroid intervention group of the over-
Nonconcurrent control group participants: A nonconcurrent
control group includes participants who were enrolled and
all platform trial. Because REMAP-CAP is investigating multiple thera-
randomized to the control group before the period of time in peutic intervention groups with sites not necessarily participating
which participants in the intervention group(s) are enrolled into in all intervention groups, some patients were eligible but were not
the trial. There may be other types of nonconcurrent control randomized to receive a corticosteroid intervention.1 These pa-
groups whereby the patients in the control group are enrolled tients were included in the analysis that used a bayesian hierarchi-
after a given experimental group has finished clinical evaluation. cal model. The model included covariate terms for each patient’s eli-
gibility, resulting in the corticosteroid treatment effect being

70 JAMA January 4, 2022 Volume 327, Number 1 (Reprinted) jama.com

© 2022 American Medical Association. All rights reserved.

Downloaded From: https://jamanetwork.com/ by a Royal College of Physicians User on 01/14/2022


How to Use and Interpret the Results of a Platform Trial Users' Guides to the Medical Literature Clinical Review & Education

estimated using only the data from patients who were randomized reveal some information about the performance of the experimen-
concurrently to 1 of the corticosteroid regimen groups or the con- tal intervention. Knowledge of the trial adaptations, such as re-
trol group. The patients enrolled to other therapeutic areas (eg, an- sponse-adaptive randomization, that have occurred can reveal some
tiviral agents or immunoglobulins) contributed to estimate the prog- information regarding the observed treatment effect, so steps to
nostic factors (ie, location, age, sex, and time period) on the mitigate operational biases in adaptive clinical trials will likely in-
outcomes of interest.1 In a preplanned sensitivity analysis, the in- clude a strict communication and information flow structure from
vestigators repeated the analysis limited to patients randomized to individuals who will conduct the unblinded analyses and review the
the hydrocortisone and no-hydrocortisone groups, without includ- unblinded data (eg, DSMB and SAC members).42
ing patients randomized to other interventions.1 This second analy- The number of study personnel with access to unblinded data
sis evaluated the consistency of the adjusted results in the primary or knowledge of implemented adaptations should be limited, com-
analysis using all control group participants with results using only munication among such personnel and investigators and others
concurrently randomized patients. involved in the trial should be limited, and this information should
Sharing control information and using the nonconcurrent con- be reported in publications of trial results. The REMAP-CAP investi-
trol group data are qualitatively different than supplementing a trial gators reported that the trial was overseen by an international trial
with historical or observational control group data or external clini- steering committee that was blinded to treatment assignment and
cal trial data because the participants met the same trial enroll- outcomes and an unblinded DSMB, that the prespecified statistical
ment criteria and data were measured and collected in a consistent analysis plan was prepared by a blinded steering committee, and
environment.36 While temporal variability may exist in platform trials, that the prespecified statistical analyses were conducted by the
because patients are randomized and followed up with the same SAC, who communicated with the DSMB. They also reported that
standardized operating procedures outlined in the master proto- because the primary analysis included information about assign-
col, nonconcurrent control group data collected earlier in the plat- ment to other ongoing therapeutic areas, the unblinded SAC per-
form trial may have minimal temporal variability compared with con- formed the primary analysis and did not share treatment effect
current control group data. Using the nonconcurrent control group information for ongoing interventions.1
data can increase statistical power, and statistical adjustments for Given the ongoing nature of platform trials, the potential for in-
temporal variability and other confounders can minimize the ef- formation leakage needs to be minimized whenever possible. Sev-
fect of prognostic imbalance. However, incorporating the noncon- eral important considerations need to be made when reporting plat-
current control group data may not ensure prognostic balance in the form trial results that use data from ongoing interventions being
same way that randomization does.37 It is crucial that platform trial evaluated in the platform via conference presentations or peer re-
authors report their results differentiating comparisons based on view publications. For instance, it is not always clear how results from
concurrently randomized patients from comparisons based on those a platform trial should be reported for a given intervention if that
who are not.38 intervention is found to be more effective than the control for spe-
When assessing a report of a platform trial that used noncon- cific prespecified patient groups or parameters (such as defined by
current control group data, it is important to compare the results of a given biomarker subtype), when the same intervention is still being
the analysis incorporating nonconcurrent control group data with evaluated in other remaining groups. In some platform trials, scien-
the analysis limited to concurrent control group data for any incon- tific communication of results may be delayed until the interven-
sistency. It is also important to consider the statistical methods that tion is no longer active for clinical evaluation to preserve scientific
were applied to incorporate nonconcurrent and concurrent con- integrity. For example, the master protocol for REMAP-CAP indi-
trol group data. Nonconcurrent control group data may be ac- cates that all manuscripts and abstracts resulting from the data col-
counted for by modeling possible temporal variations in the con- lected during the trial are prepared by the relevant trial subcommit-
trol population.5,39 Statistical methods, such as dynamic borrowing tees (referred to as domain-specific working groups in REMAP) and
methods, use data-driven approaches to determine the amount of approved for dissemination by the international trial steering com-
information borrowing based on degree of consistency between the mittee. The central group determines the amount of information that
nonconcurrent and concurrent data.36,38,40,41 These methods bor- can be publicly shared while preserving the scientific integrity of the
row the nonconcurrent data the most when it is consistent with the platform. The publication of interim or definite results by indi-
concurrent data and borrow less when the data are inconsistent.40 vidual investigators without review and approval from the interna-
tional trial steering committee is not permitted.2
Did the Investigators Minimize Risk of Bias From Information
Flow Within and Outside the Specific Platform? Did the Investigators Follow Reporting Guidelines
During the conduct of clinical trials, some information about treat- in Published Reports of the Trials?
ment effects and other information about the trial (eg, baseline con- Reporting standard guidelines and risk-of-bias assessment tools
trol event rate) is known to the unblinded data and safety monitor- for conventional RCTs apply to platform trials. Important potential
ing board (DSMB) and the unblinded statistical analysis committee bias source categories such as randomization process, deviation
(SAC) who conduct the prespecified interim analyses. This informa- from intended interventions, missing outcome data, measure-
tion needs to be tightly controlled among the limited unblinded ment of outcomes, and selective reporting that are included in
groups because reduced generalizability and bias can occur when the Cochrane risk-of-bias assessment tool are important to con-
information from an ongoing trial causes changes to the partici- sider.43 A recently developed extension of the Consolidated Stan-
pant pool, investigator behavior, and other aspects of the trial.10 Simi- dards of Reporting Trials (CONSORT) for adaptive trials has out-
lar to other nonplatform adaptive clinical trials, interim analyses can lined several important reporting considerations that may be

jama.com (Reprinted) JAMA January 4, 2022 Volume 327, Number 1 71

© 2022 American Medical Association. All rights reserved.

Downloaded From: https://jamanetwork.com/ by a Royal College of Physicians User on 01/14/2022


Clinical Review & Education Users' Guides to the Medical Literature How to Use and Interpret the Results of a Platform Trial

helpful to the users and readers of platform trials.44,45 In cases of However, after stopping randomization to the intervention groups,
extenuating circumstances that lead to important modifications to when the prespecified corticosteroid group final analyses were per-
platform trials, readers can use the CONSORT and SPIRIT (Standard formed, the investigators observed that in comparison with the
Protocol Items: Recommendations for Interventional Trials) Exten- no-hydrocortisone group, fixed-dose hydrocortisone showed a
sion for RCTs Revised in Extenuating Circumstances (CONSERVE) 93% probability of being statistically superior, with an odds ratio of
2021 statement as a framework to evaluate the effect of modifica- 1.43 (95% CrI, 0.91-2.27) for the primary end point of organ
tions that the trial investigators have made.46 Similar to when read- support–free days, whereas the shock-dependent hydrocortisone
ing other clinical trial publications, readers of platform trial publica- regimen showed an 80% probability of being statistically superior
tions can also apply the existing Users’ Guides and risk-of-bias to no hydrocortisone, with an odds ratio of 1.22 (95% CrI,
assessment tools.43-45,47 0.76-1.94).1 All statistical comparisons were limited to concurrently
enrolled patients.1
What Are the Results? The findings of the REMAP-CAP trial1 were published simulta-
The relevant results of a platform trial focus on (1) the difference in neously in JAMA on September 2, 2021, with the World Health
the clinical effectiveness measured by the primary outcome be- Organization (WHO) Rapid Evidence Appraisal for COVID-19 Thera-
tween experimental treatment group and control group; (2) the harm pies (REACT) Working Group’s meta-analysis that explored the
outcomes that should favor the experimental intervention group association between systematic corticosteroids and mortality
over the control group; and (3) whether the new experimental among critically ill patients with COVID-19.8 This meta-analysis
therapy allocated to the intervention group provides clinically mean- included mortality data from 1703 patients in 7 RCTs including
ingful differential benefit over that provided to the control group. those in the REMAP-CAP trial.8 The WHO REACT meta-analysis
A given platform trial may have several publications, such as to out- found that lower 28-day mortality was associated with corticoste-
line the trial design and report results of experimental interven- roid treatment compared with usual care or placebo. The associa-
tions separately. Each publication may be specific to the compara- tion between corticosteroids and lower mortality was similar for
tive effectiveness of a single intervention vs the control, and hydrocortisone and dexamethasone, suggesting a possible class
comparisons between interventions may not directly be provided. effect that was not specific to any particular corticosteroid. The
If the publication is specific to a single intervention, there can be over- results provided moderate-quality evidence of a substantial mortal-
lap of control group patients appearing in different publications that ity reduction associated with corticosteroids in severely and criti-
report results of different interventions. In a single platform trial pub- cally ill patients with COVID-19, establishing the drug as a core
lication, the number of participants randomized to other trial inter- aspect of management of these patients.8
ventions or recruited before or after the given intervention was ac-
tive for recruitment should be provided in the CONSORT flow
diagram but provided in a general concealed nature if it is from in-
Clinical Scenario Resolution
terventions still actively participating in the platform.1,48-50
The corticosteroid therapeutic area of REMAP-CAP included For the 60-year-old patient with COVID-19 who was admitted to
403 adult patients with severe COVID-19 who were enrolled and the ICU and was receiving high-flow oxygen via nasal cannula, the
randomly assigned to a 7-day, fixed-dose intravenous course of 50 hospitalist physician considered the evidence from the REMAP-
mg or 100 mg of hydrocortisone every 6 hours (n = 143), a shock- CAP platform trial by applying the principles outlined in this article
dependent intravenous course of 50 mg of hydrocortisone every 6 while considering the totality of evidence from the WHO REACT
hours (n = 152), or no hydrocortisone (n = 108) between March 9 meta-analysis that examined steroid use across critically ill patients
and June 17, 2020. 1 The prespecified statistical analysis plan with COVID-19.1,8 Based on these findings, the care team decided
defined respiratory and cardiovascular organ support–free days up to administer corticosteroids because they understood there was
to day 21 as the primary outcome and included other secondary a high likelihood of benefit to reduce organ support and mortality
outcomes such as in-hospital mortality.1,16 The prespecified statisti- with fixed-dose hydrocortisone and dexamethasone.
cal thresholds in the analysis plan were not met for either of the 2
hydrocortisone regimens evaluated in REMAP-CAP, and the enroll-
ment to the hydrocortisone groups was halted on June 17, 2020,
Conclusions
following the announced results of mortality benefits of dexameth-
asone in patients with COVID-19 receiving either invasive mechani- Platform trials represent a potentially useful approach for medical
cal ventilation or supplemental oxygen in the RECOVERY trial.1,48 research. In addition to meeting conventional risk-of-bias criteria,
The REMAP-CAP investigators made the decision to halt the prespecification of statistical analysis plans, and adequate control
intervention groups due to external factors, not based on internal of information flow, the risk of bias in a given platform trial can be
trial results, because investigators or other study personnel did minimized. Platform trials, with their ongoing and intervention-
not have access to unblinded data at the time of their decision, agnostic nature, may contribute research findings more efficiently
highlighting adequate control of information within the trial.1 and potentially be more patient centered.

ARTICLE INFORMATION Author Affiliations: Division of Experimental of Pediatrics, Faculty of Medicine, University of
Accepted for Publication: November 30, 2021. Medicine, Department of Medicine, University of British Columbia, Vancouver, Canada (Murthy);
British Columbia, Vancouver, Canada (Park); Berry Department of Health Research Methods,
Consultants LLC, Austin, Texas (Detry); Department Evidence, and Impact, McMaster University,

72 JAMA January 4, 2022 Volume 327, Number 1 (Reprinted) jama.com

© 2022 American Medical Association. All rights reserved.

Downloaded From: https://jamanetwork.com/ by a Royal College of Physicians User on 01/14/2022


How to Use and Interpret the Results of a Platform Trial Users' Guides to the Medical Literature Clinical Review & Education

Hamilton, Ontario, Canada (Guyatt, Mills); Cytel Inc, 9. Dean NE, Gsell PS, Brookmeyer R, et al. Creating 23. Hummel J, Wang S, Kirkpatrick J. Using
Vancouver, British Columbia, Canada (Mills). a framework for conducting randomized clinical simulation to optimize adaptive trial designs:
Author Contributions: Dr Mills had full access to all trials during disease outbreaks. N Engl J Med. 2020; applications in learning and confirmatory phase
of the data in the study and takes responsibility for 382(14):1366-1369. doi:10.1056/NEJMsb1905390 trials. Clin Investig (Lond). 2015;5(4):401-413. doi:
the integrity of the data and the accuracy of the 10. Detry MA, Lewis RJ, Broglio KR, Connor JT, 10.4155/cli.15.14
data analysis. Berry SM, Berry DA. Standards for the Design, 24. Viele K, McGlothlin A, Broglio K. Interpretation
Concept and design: All authors. Conduct, and Evaluation of Adaptive Randomized of clinical trials that stopped early. JAMA. 2016;315
Drafting of the manuscript: Park, Mills. Clinical Trials. Patient-Centered Outcomes (15):1646-1647. doi:10.1001/jama.2016.2628
Critical revision of the manuscript for important Research Institute guidance report. Revised March 25. Mayer C, Perevozskaya I, Leonov S, et al.
intellectual content: All authors. 15, 2012. Accessed December 2, 2021. https://www. Simulation practices for adaptive trial designs in
Administrative, technical, or material support: Park. pcori.org/assets/Standards-for-the-Design- drug and device development. Stat Biopharm Res.
Supervision: Murthy, Mills. Conduct-and-Evaluation-of-Adaptive-Randomized- 2019;11(4):325-335. doi:10.1080/19466315.2018.
Conflict of Interest Disclosures: Dr Park reported Clinical-Trials.pdf 1560359
being a former employee of Cytel and receiving 11. Bauer P, Bretz F, Dragalin V, König F, Wassmer G. 26. Thorlund K, Haggstrom J, Park JJ, Mills EJ.
grants from the Bill and Melinda Gates Foundation Twenty-five years of confirmatory adaptive Key design considerations for adaptive clinical
for the TOGETHER trial. Dr Detry reported being an designs: opportunities and pitfalls. Stat Med. 2016; trials: a primer for clinicians. BMJ. 2018;360:k698.
employee of Berry Consultants LLC, a statistical 35(3):325-347. doi:10.1002/sim.6472 doi:10.1136/bmj.k698
consulting company that collaborates on numerous 12. Bhatt DL, Mehta C. Adaptive designs for clinical
platform trials (this work was independent of any of 27. Park JJ, Thorlund K, Mills EJ. Critical concepts in
trials. N Engl J Med. 2016;375(1):65-74. doi:10.1056/ adaptive clinical trials. Clin Epidemiol. 2018;10:343-
the consulting projects and received no funding). NEJMra1510061
Dr Murthy reported being an investigator for the 351. doi:10.2147/CLEP.S156708
REMAP-CAP trial, receiving grants from the 13. Park JJH, Hsu G, Siden EG, Thorlund K, Mills EJ. 28. Biswas A, Bhattacharya R. Response-adaptive
Canadian Institutes of Health Research, and An overview of precision oncology basket and designs for continuous treatment responses in
receiving salary support from the Health Research umbrella trials for clinicians. CA Cancer J Clin. 2020; phase III clinical trials: a review. Stat Methods Med Res.
Foundation and Innovative Medicines Canada. 70(2):125-137. doi:10.3322/caac.21600 2016;25(1):81-100. doi:10.1177/0962280212441424
Dr Mills reported being an employee of Cytel and 14. Siden EG, Park JJ, Zoratti MJ, et al. Reporting of 29. Viele K, Broglio K, McGlothlin A, Saville BR.
being co–principal investigator of the TOGETHER master protocols towards a standardized approach: Comparison of methods for control allocation in
trial. No other disclosures were reported. a systematic review. Contemp Clin Trials Commun. multiple arm studies using response adaptive
2019;15:100406. doi:10.1016/j.conctc.2019.100406 randomization. Clin Trials. 2020;17(1):52-60. doi:10.
REFERENCES 15. Schiavone F, Bathia R, Letchemanan K, et al; 1177/1740774519877836
1. Angus DC, Derde L, Al-Beidh F, et al; Writing Past and Present Members of the STAMPEDE and 30. US Food and Drug Administration. Adaptive
Committee for the REMAP-CAP Investigators. FOCUS4 Trial Management Group. This is a platform Designs for Clinical Trials of Drugs and Biologics
Effect of hydrocortisone on mortality and organ alteration: a trial management perspective on the Guidance for Industry. US Food and Drug
support in patients with severe COVID-19: the operational aspects of adaptive and platform and Administration; 2019.
REMAP-CAP COVID-19 corticosteroid domain umbrella protocols. Trials. 2019;20(1):264. doi:10.
randomized clinical trial. JAMA. 2020;324(13):1317- 1186/s13063-019-3216-8 31. Lewis RJ, Angus DC. Time for clinicians to
1329. doi:10.1001/jama.2020.17022 embrace their inner bayesian? reanalysis of results
16. REMAP-CAP. Current protocol documents. of a clinical trial of extracorporeal membrane
2. Angus DC, Berry S, Lewis RJ, et al. Accessed September 27, 2021. https://www. oxygenation. JAMA. 2018;320(21):2208-2210. doi:
The REMAP-CAP (Randomized Embedded remapcap.org/protocol-documents 10.1001/jama.2018.16916
Multifactorial Adaptive Platform for 17. Sydes MR, Parmar MKB, Mason MD, et al.
Community-Acquired Pneumonia) study: rationale 32. McGlothlin AE, Viele K. Bayesian hierarchical
Flexible trial design in practice—stopping arms for models. JAMA. 2018;320(22):2365-2366. doi:10.
and design. Ann Am Thorac Soc. 2020;17(7):879-891. lack-of-benefit and adding research arms mid-trial
doi:10.1513/AnnalsATS.202003-192SD 1001/jama.2018.17977
in STAMPEDE: a multi-arm multi-stage randomized
3. Woodcock J, LaVange LM. Master protocols to controlled trial. Trials. 2012;13:168. doi:10.1186/ 33. Quintana M, Viele K, Lewis RJ. Bayesian
study multiple therapies, multiple diseases, or both. 1745-6215-13-168 analysis: using prior information to interpret the
N Engl J Med. 2017;377(1):62-70. doi:10.1056/ results of clinical trials. JAMA. 2017;318(16):1605-
18. Barker AD, Sigman CC, Kelloff GJ, Hylton NM, 1606. doi:10.1001/jama.2017.15574
NEJMra1510062 Berry DA, Esserman LJ. I-SPY 2: an adaptive breast
4. Berry SM, Connor JT, Lewis RJ. The platform cancer trial design in the setting of neoadjuvant 34. Greenland S, Senn SJ, Rothman KJ, et al.
trial: an efficient strategy for evaluating multiple chemotherapy. Clin Pharmacol Ther. 2009;86(1): Statistical tests, P values, confidence intervals,
treatments. JAMA. 2015;313(16):1619-1620. doi:10. 97-100. doi:10.1038/clpt.2009.68 and power: a guide to misinterpretations. Eur J
1001/jama.2015.2316 Epidemiol. 2016;31(4):337-350. doi:10.1007/s10654-
19. Saville BR, Berry SM. Efficiencies of platform 016-0149-3
5. Angus DC, Alexander BM, Berry S, et al; Adaptive clinical trials: a vision of the future. Clin Trials. 2016;
Platform Trials Coalition. Adaptive platform trials: 13(3):358-366. doi:10.1177/1740774515626362 35. Committee for Proprietary Medicinal Products.
definition, design, conduct and reporting ICH Topic E 10: Choice of Control Group in Clinical
20. Parmar MK, Carpenter J, Sydes MR. More Trials. European Medicines Agency; 2001:30.
considerations. Nat Rev Drug Discov. 2019;18(10): multiarm randomised trials of superiority are
797-807. doi:10.1038/s41573-019-0034-3 needed. Lancet. 2014;384(9940):283-284. doi:10. 36. Thorlund K, Dron L, Park JJH, Mills EJ.
6. Park JJH, Harari O, Dron L, Lester RT, Thorlund 1016/S0140-6736(14)61122-3 Synthetic and external controls in clinical trials—
K, Mills EJ. An overview of platform trials with a primer for researchers. Clin Epidemiol. 2020;12:
21. Reis G, Moreira Silva EADS, Medeiros Silva DC, 457-467. doi:10.2147/CLEP.S242097
a checklist for clinical readers. J Clin Epidemiol. et al; TOGETHER Investigators. Effect of early
2020;125:1-8. doi:10.1016/j.jclinepi.2020.04.025 treatment with hydroxychloroquine or lopinavir 37. Lee KM, Wason J. Including non-concurrent
7. Park JJH, Siden E, Zoratti MJ, et al. Systematic and ritonavir on risk of hospitalization among control patients in the analysis of platform trials: is
review of basket trials, umbrella trials, and platform patients with COVID-19: the TOGETHER it worth it? BMC Med Res Methodol. 2020;20(1):165.
trials: a landscape analysis of master protocols. Trials. randomized clinical trial. JAMA Netw Open. 2021;4 doi:10.1186/s12874-020-01043-6
2019;20(1):572. doi:10.1186/s13063-019-3664-1 (4):e216468. doi:10.1001/jamanetworkopen.2021. 38. Yu LM, Bafadhel M, Dorward J, et al; PRINCIPLE
8. Sterne JAC, Murthy S, Diaz JV, et al; 6468 Trial Collaborative Group. Inhaled budesonide for
WHO REACT Working Group. Association between 22. Saville BR, Connor JT, Ayers GD, Alvarez J. COVID-19 in people at high risk of complications in
administration of systemic corticosteroids and The utility of bayesian predictive probabilities for the community in the UK (PRINCIPLE):
mortality among critically ill patients with interim monitoring of clinical trials. Clin Trials. 2014; a randomised, controlled, open-label, adaptive
COVID-19: a meta-analysis. JAMA. 2020;324(13): 11(4):485-493. doi:10.1177/1740774514531352 platform trial. Lancet. 2021;398(10303):843-855.
1330-1341. doi:10.1001/jama.2020.17023 doi:10.1016/S0140-6736(21)01744-X

jama.com (Reprinted) JAMA January 4, 2022 Volume 327, Number 1 73

© 2022 American Medical Association. All rights reserved.

Downloaded From: https://jamanetwork.com/ by a Royal College of Physicians User on 01/14/2022


Clinical Review & Education Users' Guides to the Medical Literature How to Use and Interpret the Results of a Platform Trial

39. Berry SM, Reese CS, Larkey PD. Bridging 44. Dimairo M, Pallmann P, Wason J, et al; ACE McGraw-Hill Education; 2015. https://
different eras in sports. J Am Stat Assoc. 1999;94 Consensus Group. The Adaptive Designs CONSORT jamaevidence.mhmedical.com/book.aspx?bookID=
(447):661-676. doi:10.1080/01621459.1999.10474163 Extension (ACE) statement: a checklist with 847
40. Viele K, Berry S, Neuenschwander B, et al. explanation and elaboration guideline for reporting 48. Horby P, Lim WS, Emberson JR, et al;
Use of historical control data for assessing randomised trials that use an adaptive design. BMJ. RECOVERY Collaborative Group. Dexamethasone in
treatment effects in clinical trials. Pharm Stat. 2014; 2020;369:m115. doi:10.1136/bmj.m115 hospitalized patients with Covid-19. N Engl J Med.
13(1):41-54. doi:10.1002/pst.1589 45. Dimairo M, Pallmann P, Wason J, et al; ACE 2021;384(8):693-704. doi:10.1056/NEJMoa2021436
41. Dron L, Golchi S, Hsu G, Thorlund K. Minimizing Consensus Group. The Adaptive Designs CONSORT 49. James ND, Spears MR, Clarke NW, et al;
control group allocation in randomized trials using Extension (ACE) statement: a checklist with STAMPEDE Investigators. Failure-free survival and
dynamic borrowing of external control data—an explanation and elaboration guideline for reporting radiotherapy in patients with newly diagnosed
application to second line therapy for non-small cell randomised trials that use an adaptive design. Trials. nonmetastatic prostate cancer: data from patients
lung cancer. Contemp Clin Trials Commun. 2019;16: 2020;21(1):528. doi:10.1186/s13063-020-04334-x in the control arm of the STAMPEDE trial. JAMA
100446. doi:10.1016/j.conctc.2019.100446 46. Orkin AM, Gill PJ, Ghersi D, et al; CONSERVE Oncol. 2016;2(3):348-357. doi:10.1001/jamaoncol.
42. He W, Kuznetsova OM, Harmer M, et al. Group. Guidelines for reporting trial protocols and 2015.4350
Practical considerations and strategies for completed trials modified due to the COVID-19 50. Sydes MR, Spears MR, Mason MD, et al;
executing adaptive clinical trials. Ther Innov Regul Sci. pandemic and other extenuating circumstances: STAMPEDE Investigators. Adding abiraterone or
2012;46(2):160-174. doi:10.1177/0092861512436580 the CONSERVE 2021 statement. JAMA. 2021;326 docetaxel to long-term hormone therapy for
(3):257-265. doi:10.1001/jama.2021.9941 prostate cancer: directly randomised data from the
43. Sterne JAC, Savović J, Page MJ, et al. RoB 2:
a revised tool for assessing risk of bias in 47. Guyatt G, Rennie D, Meade MO, Cook DJ. Users’ STAMPEDE multi-arm, multi-stage platform
randomised trials. BMJ. 2019;366:l4898. doi:10. Guides to the Medical Literature: A Manual for protocol. Ann Oncol. 2018;29(5):1235-1248. doi:10.
1136/bmj.l4898 Evidence-Based Clinical Practice. 3rd ed. 1093/annonc/mdy072

74 JAMA January 4, 2022 Volume 327, Number 1 (Reprinted) jama.com

© 2022 American Medical Association. All rights reserved.

Downloaded From: https://jamanetwork.com/ by a Royal College of Physicians User on 01/14/2022

You might also like