You are on page 1of 5

The Importance of Clinical Specificity: A Review of FDA Cleared

Fecal Calprotectin Tests


Bethany Bell, PhD†
Andrea Tarbet†

Abstract
Symptoms shared between inflammatory bowel disease are two distinct gastrointestinal tract disorders
(IBD) and irritable bowel syndrome (IBS) can make it that present with similar clinical symptoms.1,2,4,14,15
challenging for gastroenterologists (GIs) to quickly and Therefore, determining the correct diagnosis for
accurately determine the correct diagnosis for patients. 1,2,4
patients can be an ongoing challenge for GIs.1,2,4
A hallmark feature of IBD that is not present in IBS is
mucosal inflammation which can be identified through Because of this, many IBD patients experience a delay of
either an invasive colonoscopy, or by noninvasively greater than 1-2 years from onset of initial symptoms to a
measuring fecal calprotectin. 5-9
Measuring fecal correct and final diagnosis.1,2,4 The most common IBD patient
calprotectin assists GIs by efficiently and effectively self-reported reason for the delay in IBD diagnosis was an
differentiating IBD from IBS, thereby reducing the number inaccurate initial diagnosis by their clinician.2,4 Additionally,
of unnecessary colonoscopies for those patients with IBS.1,5-10 a prolonged delay in the accurate diagnosis has been
Until recently, clinical laboratories and their physician clients associated with poor overall outcomes in IBD patients.2,4
had seven FDA cleared fecal calprotectin tests available
to choose from; however, there are several known Although there are clinical symptoms of IBD and IBS that
shortcomings with many of these tests, including low overlap, there are distinct differences that exist between
clinical specificity.
1,9,11,12
A review of the clinical specificity IBD and IBS such as etiology, risk of developing related
of these fecal calprotectin tests demonstrates that complications, and treatment options. Therefore, it is
there is low clinical accuracy for excluding IBD as vital for GIs to have access to tools which allow them to
a diagnosis in IBS patients, therefore leading to quickly and accurately differentiate IBD from IBS.2,4
unnecessary colonoscopies, which are invasive and
costly procedures.11 As a result, a chemiluminescence Guidelines from professional medical associations such as
based calprotectin ELISA was recently developed to the American College of Gastroenterology (ACG) and the
provide clinical laboratories and gastroenterologists with National Institute for Health and Care Excellence (NICE-UK)
an FDA cleared fecal calprotectin test that can more recommend that patients suspected of having either IBD
accurately differentiate IBD from IBS and thus ensure or IBS are screened for fecal calprotectin levels.18,19 Levels
that patients enter the correct care pathway faster.13 above the recommended cut-off of 50 µg/g are indicative
of mucosal inflammation which is then confirmed through a
Background colonoscopy.5,9,20 Symptomatic patients that fall below 50 µg/g
IBD and IBS, which affect millions of patients globally, are more likely to have IBS.5,7,9,20

ALPCO, Salem, NH

2

FDA 510(k) Cleared Fecal Calprotectin Tests agency will grant marketing clearance to the applicant and
There are currently eight FDA cleared fecal calprotectin subsequently make available the FDA’s 510(k) Substantial
tests commercially available to clinical laboratories. Equivalence Determination Decision Summary and the
However, in many of these tests, there are several known 510(k) Summary. The 510(k) Summary provides a high-
problems including low clinical specificity, high false positive level review of the contents of the 510(k) submission
rates, and variable cut-off values.1,9,12 Consequently, a and results of any testing with enough detail to provide
significant percentage of patients screened for mucosal an understanding of the basis of the FDA’s substantial
inflammation with a fecal calprotectin test are still equivalence determination.21
referred for a colonoscopy when it is unnecessary.
Clinical Accuracy
Thus, it is essential for clinical laboratories and The clinical accuracy of a test is defined as its ability to
gastroenterologists to fully understand each clinical classify patients correctly as diseased or non-diseased in
characteristic of a fecal calprotectin test in order the context of clinical truth. With respect to the utility of
to choose the one that will allow them to accurately calprotectin when used to differentiate between IBD and
differentiate IBD from IBS, to exclude patients with IBS IBS, this speaks to the test’s ability to positively identify
from receiving a needless endoscopic procedure. anyone who has IBD (true positive), and accurately rule
out anyone who has IBS (true negative). Because no test
510(k) Submission Process for Calprotectin Tests
is perfect, clinical accuracy also considers anyone who has
During the premarket notification process, also known as been identified to have IBD who does not actually have
the 510(k) process, the FDA evaluates the subject device to the disease (false positive) as well as anyone who has been
ensure that it is substantially equivalent to a legally marketed identified as not having IBD who does have the disease
device with a similar intended use and similar technological (false negative).22
characteristics (predicate device). To make this determination
the FDA reviews the subject device’s performance
characteristics, which include both analytical and clinical Clinical Accuracy =
performance characteristics. 21 (True Positive + True Negative)
____________________________________________________________________
(True Positive + True Negative + False Positive + False Negative)
For fecal calprotectin assays, the clinical diagnostic
gold standard is endoscopy, and when being compared
to the clinical diagnosis there should be an association Clinical Sensitivity
between the analytical results obtained using the subject The clinical sensitivity of a test is defined as its ability to
device and the presence/absence of IBD versus other correctly identify patients with a given disease.22 With
gastrointestinal conditions. This is commonly referred to respect to the utility of calprotectin, this speaks to the
as clinical sensitivity and specificity. test’s ability to positively identify anyone who has IBD.8

Once the FDA has determined that the subject device is True Positive
Clinical Sensitivity = _________________________________
substantially equivalent to the predicate device, the (True Positive + False Negative)
3

Clinical Specificity is chosen, patients with IBS are spared unnecessary

The clinical specificity of a test is defined as its ability to colonoscopies, allowing those ultimately diagnosed with

correctly identify those patients without a given disease.22 IBD earlier access to the care they need. 8,20

With respect to the utility of calprotectin, this speaks to


A Review of all 510(k) Cleared Fecal Calprotectin Tests
the test’s ability to exclude anyone who does not have IBD,
A review of the 510(k) summaries for the eight FDA cleared
a subset of which may be IBS.8
calprotectin tests currently available demonstrates that
these tests all offer good clinical sensitivity (≥87.6%)
True Negative
Clinical Specificity = _________________________________ and can therefore correctly identify patients with IBD.
(True Negative + False Positive) However, there are notable performance shortfalls with
regard to clinical specificity and the overall clinical utility
Clinical Utility scores of many of these same assays.
Although a test may prove to be clinically accurate, accuracy
Comparing Clinical Specificity
does not always reflect how the test actually impacts the
The clinical specificities of the FDA 510(k) cleared fecal
clinical diagnosis or a resulting decision.22 A clinically useful
calprotectin tests vary greatly, ranging from 66.8%
test assists with improving healthcare efficiency, cost-
-95.1%.11 The fecal calprotectin tests with low clinical
effectiveness, and patient outcomes. 22-24 The higher the
specificity have high false positive rates.11 This leads to an
clinical utility, the more likely the test is to lead to actual
increased number of patients with IBS reported to have
changes that matter to patients.22-24 Therefore, the higher
levels of calprotectin indicative of IBD (false positives) and
the clinical utility, the better the test for clinicians and their
leading to unnecessary follow-up colonoscopies.1 Research
patients.23,24
in this field has suggested that the clinical specificity of
Many clinicians now seek out laboratory tests according to several of these calprotectin tests would be improved if the
their clinical utility which considers both clinical sensitivity positive cut-off values were to be increased.9,12 However,
and clinical specificity. When the sum of clinical sensitivity this would in turn sacrifice clinical sensitivity and increase
and clinical specificity is greater than or equal to 170, the the chance of false negative results in patients with IBD,
test is likely to prove clinically useful.24 thereby lowering the utility of a fecal calprotectin screen.9,12

Comparing Clinical Utility of Calprotectin Tests


Clinical Utility Score = Clinical Sensitivity + Clinical Specificity
The calculated clinical utility scores (Tables 1 & 2) from four
=170 = High Clinical Utility
of the eight FDA cleared calprotectin tests are lower than
the standard benchmark of 170, indicating that these tests
Clinical care is most effective when patients enter the
offer sub-optimal clinical utility to gastroenterologists and
correct treatment pathway.23 Therefore, the most clinically
their patients. These same calprotectin assays exhibit the
useful fecal calprotectin test would be able to accomplish
highest false positive rates. Therefore, clinical laboratories
both excluding patients with normal fecal calprotectin
running these calprotectin tests are are more likely to report
levels (clinical specificity) from the IBD care pathway,
results that may misguide decisions made by ordering
and accurately identifying patients with IBD (clinical
sensitivity). 8 When the correct fecal calprotectin test physicians.
4

False AMR from


Date of FDA 510(k) Clinical Clinical Clinical Clinical
Applicant Test Name Positive Primary
Clearance Number Accuracy Sensitivity Specificity Utility
Rate Dilution (µg/g)
Genova PhiCal™ Test 4/26/2006 K050007 15.6 – 250
®
Eurospital S.p.A. Calprest 1/16/2014 K130945 15.6 - 500
Information not available
Eurospital S.p.A. Calprest® NG 11/10/2016 K160447 27.1 - 3000
QUANTA Flash®
Inova Diagnostics, Inc. 12/22/2017 K170993 16.1 - 3500
Calprotectin
®
BÜHLMANN BÜHLMANN fCAL ELISA 6/4/2018 K181012 83.0% 93.3% 72.3% 164.6 27.7% 30 - 1800
DiaSorin, Inc. LIAISON® Calprotectin 12/26/2018 K182698 85.2% 98.0% 65.7% 163.7 34.3% 5 - 800

BÜHLMANN BÜHLMANN fCAL® turbo 6/25/2019 K190784 83.8% 91.1% 76.2% 167.3 23.8% 30 - 3000
ALPCO Calprotectin
ALPCO 10/25/2019 K191807 93.9% 92.1% 95.1% 187.2 4.9% 7.9 - 6000
Chemiluminescence ELISA

Table 1: Summary of clinical performance when assessing devices based on their ability to differentiate between IBD and IBS.

False AMR from


Date of FDA 510(k) Clinical Clinical Clinical Clinical
Applicant Test Name Positive Primary
Clearance Number Accuracy Sensitivity Specificity Utility
Rate Dilution (µg/g)
Genova PhiCal™ Test 4/26/2006 K050007 82.4% 87.6% 79.3% 166.9 20.7% 15.6 – 250
®
Eurospital S.p.A. Calprest 1/16/2014 K130945 93.5% 96.9% 85.0% 181.9 15.0% 15.6 - 500
®
Eurospital S.p.A. Calprest NG 11/10/2016 K160447 92.3% 94.6% 90.2% 184.8 9.8% 27.1 - 3000
QUANTA Flash®
Inova Diagnostics, Inc. 12/22/2017 K170993 81.8% 96.5% 74.1% 170.6 25.9% 16.1 - 3500
Calprotectin
®
BÜHLMANN BÜHLMANN fCAL ELISA 6/4/2018 K181012 79.5% 93.3% 70.3% 163.6 29.7% 30 - 1800
®
DiaSorin, Inc. LIAISON Calprotectin 12/26/2018 K182698 81.3% 98.0% 66.8% 164.8 33.2% 5 - 800
BÜHLMANN BÜHLMANN fCAL® turbo 6/25/2019 K190784 81.0% 91.1% 74.3% 165.4 25.7% 30 - 3000
ALPCO Calprotectin
ALPCO 10/25/2019 K191807 92.5% 92.1% 92.5% 184.6 7.5% 7.9 - 6000
Chemiluminescence ELISA

Table 2: Summary of clinical performance when assessing devices based on their ability to diagnose IBD.

Conclusion
A thorough review of the clinical performance intended use statement for all eight cleared devices, the
characteristics of all of the FDA cleared fecal calprotectin criteria for a good fecal calprotectin test are twofold. First and
tests currently available to clinicians and reference foremost, IBD patients must be positively identified at the
laboratories demonstrates that all assays have different same time that IBS patients are ruled out, so as to eliminate
levels of accuracy and utility when screening levels of unnecessary follow up endoscopic procedures. Secondarily,
calprotectin in patients suspected of having IBD (Tables IBD patients must also be positively identified, while non-IBD
1 & 2). When making the decision as to which test should patients are ruled out. When all of these requirements are
be implemented for assessing levels of fecal calprotectin, it met, this ensures that physicians are provided with the most
is important to understand all of the clinical characteristics of accurate information to assist them in making the correct
each assay and how they impact the patient. In line with the diagnosis for their patients.
5

References
1. D’Angelo, et al. Calprotectin in daily practice: where do 13. ALPCO. 510(k) summary: ALPCO Calprotectin
we stand in 2017? Digestion. 2017;95(4):293-301. PMID: Chemiluminescence ELISA. 2019.
28511188.
14. Kaplan. The global burden of IBD: from 2015 to
2. Gallinger, et al. Delayed diagnosis of Crohn’s disease 2025. Nat Rev Gastroenterol Hepatol. 2015
is common and associated with an increased risk of Dec;12(12):720-7. PMID: 26323879.
disease complications. Crohn’s and Colitis Congress 2019.
15. International Foundation for Gastrointestinal Disorders.
3. Presentation Number P030. Gastroenterology, Volume Facts about IBS. aboutibs.org. 2016.
156, Issue 3, S21. https://www.gastrojournal.org/article/
16. Ahluwalia, et al. Immunopathogenesis of inflammatory
S0016-5085(19)30144-1/pdf.
bowel disease and mechanisms of biological therapies.
4. Dotinga, R. Delays of 1-2 + years in IBD diagnosis are Scand J Gastroenterol. 2018 Apr;53(4):379-389. PMID:
common, patients say. Conference Coverage Crohn’s 29523023.
and Colitis Congress 2019. GI & Hepatology News.
17. Pathirana, et al. Faecal calprotectin. Clin Biochem
Publish date: February 19, 2019. mdedge.com.
Rev. 2018 Aug; 39(3): 77–90. PMID: 30828114.
5. Tibble, et al. A simple method for assessing intestinal 18. American College of Gastroenterology. ACG updates
inflammation in Crohn’s disease. Gut. 2000 Oct; 47(4): guideline on diagnosis, management of Crohn’s disease.
506–513. PMID: 10986210. ACP Gastroenterology Monthly. APRIL 27, 2018.
gastroenterology.acponline.org.
6. Tibble and Bjarnason. Fecal calprotectin as an index
of intestinal inflammation. Drugs Today (Barc). 19. National Institute for Health and Care Excellence. Faecal
2001 Feb;37(2):85-96. PMID: 12783101. calprotectin diagnostic tests for inflammatory diseases
of the bowel. Diagnostics guidance [DG11] Published
7. Gisbert and McNicholl. Questions and answers on
date: October 2013. Nice.uk.org.
the role of faecal calprotectin as a biological marker
in inflammatory bowel disease. Dig Liver Dis. 2009 20. Waugh, et al. Faecal calprotectin testing for differentiating
an;41(1):56-66. PMID: 18602356. amongst inflammatory and non-inflammatory bowel
diseases: systematic review and economic evaluation.
8. Van Rheenen, et al. Fecal calprotectin for screening
Health Technology Assessment, No. 17.55. Southampton
of patients with suspected inflammatory bowel disease;
(UK): NIHR Journals Library; 2013 Nov. PMID:
diagnostic meta-analysis. BMJ. 2010 Jul 15;341:c3369.
24286461.
PMID: 20634346.
21. US Food and Drug Administration. The 510(k) program:
9. Walsham and Sherwood. Fecal calprotectin in Evaluating substantial equivalence in premarket
inflammatory bowel disease. Clin Exp Gastroenterol. notifications [510(k)]: Guidance for industry and Food
2016; 9: 21–29. PMID: 26869808. and Drug Administration staff. Fda.gov. 2014.
10. Rokkas, et al. Fecal calprotectin in assessing inflammatory 22. Linnet, et al. Quantifying the accuracy of a diagnostic
bowel disease endoscopic activity: a diagnostic accuracy test or marker. Clin Chem. 2012 Sep;58(9):1292-301.
meta-analysis. J Gastrointestin Liver Dis. 2018 Sep; 27(3): PMID: 22829313.
299-306. PMID: 30240474.
23. Bossuyt, et al. Beyond diagnostic accuracy: The clinical
11. US Food and Drug Administration. 510(k) Premarket utility of diagnostic tests. Clin Chem. 2012 Dec;58(12):
Notification Database. Page last updated: 09/30/2019. 1636-43. PMID: 22730450.
accessdata.fda.gov.
24. Wians Jr, Frank. Clinical laboratory tests: Which,
12. Oyaert, et al. Analytical performance of diagnostic why, and what do the results mean? Laboratory
accuracy of six different faecal calprotectin assays in Medicine, Volume 40, Issue 2, February 2009, Pages
inflammatory bowel disease. Clin Chem Lab Med. 2017 105–113, doi.org/10.1309/LM4O4L0HHUTWWUDD.
Aug 28;55(10):1564-1573. PMID: 28222018.
Copyright © 2019 by ALPCO. All rights reserved. This material or any portion thereof may not be
reproduced or used in any manner whatsoever without the express written permission of ALPCO.

You might also like