types of cancer,
3-5
inflammatory bowel disease,
6,7
neurode-generative disease,
8,9
and many others.
10
Many companies are competing to create high-reliability, high-throughput assays for measuring thou-sandsofgenotypesandcellularphenotypesinordertocre-atetheinfrastructureformolecularmedicine.Inmanycases,comprehensive panels are being created that provide mea-surementsoflargenumbersofgenomicvariables.Thesepan-els raise the possibility that clinical use of genomics maynot be entirely focused on specific gene variants but mayalsoincludeanumberofrelatedvariants.Forexample,onepanelaccuratelymeasuresmorethan30polymorphismsin just 2 genes. These genes come from a group of more than200 that may be important for drug dosing, so future gen-erationsofthispanelmaytestfor200
15=3000polymor-phisms.Inthebestcase,thisinfrastructurewillprovidethebasisforgenome-informedmedicaldecisionmakingthatwillleadtodiagnosesandtherapiesthataremoretargeted,havereducedvariabilityinoutcome,maximizeefficacy,andmini-mize adverse effects.
Potential Implications of Genomic Testing
Thefollowing3-parthypotheticalscenarioillustratessomeof the implications of application of genomic testing:Thereexistsasinglegenomictestthathas99.9%sensitiv-ity (true-positive rate) and a false-positive rate of 0.1% (ie,specificity or a true-negative rate of 99.9%) for a rare treat-able disease, “X.” For comparison, cystic fibrosis tests havebeenreportedwith99%sensitivity
11
and
BRCA1
testingshowsasensitivityof81%whenthefalse-positiverateis42%.
12
Thehypotheticaltestinthiscasewasdevelopedinastudyoffami-lieswithdiseaseX,anditworkswellonthispopulation,whichhas a disease prevalence of 1 in 1000, much greater than inthegeneralpopulation.Specifically,if1000individualsfromthispopulationaretested,thentherewillbe1true-positive,1false-positive,and998true-negativeresults.Twoindividu-als(thosewiththetrue-positiveandfalse-positiveresults)aretested further at some expense; the one with the true-positiveresultisgivenadiagnosisandistreated.Thepersonwiththefalse-positiveresultistestedanddiseaseisruledout.TheconclusioninthiscaseisthatgenomemeasurementsareusefulfordiagnosingdiseaseX.Thisoccursbecausethepre-testprobabilityofdiseaseof0.001yieldsaposttestprobabil-ityof0.5ifthetestresultispositive,thesensitivityofthetestis0.999,andthefalse-positiverateofthetestis0.001,usingthe Bayes theorem.
13
However, if this same genomic test is applied to the gen-eral population (with no such occurrence of the disease intheirkinship),theoveralldiseaseprevalenceis1in100000,orapretestdiseaseprobabilityof0.00001.Ifageneralpopu-lation of 10000000 individuals is tested, 100 will have thedisease,10000peoplewilltestpositivewithnodisease,100people with disease will be missed, and 9989900 peoplewillhaveanegativetestandnodisease.Thus,10100peopletest positive and require follow-up. One hundred are accu-ratelyidentifiedashavingthedisease,butthecostofdoingsoisveryhighbecause10000haveaworkupandarefoundto not have the disorder. Thus, in this population a posi-tive test result raises the posttest probability that an indi-vidualhasdiseaseonlyfrom0.00001to0.0099,orlessthan1in1000.Now,theconclusionisthatthisisapoortestforscreening and leads to too many false-positive results. Thisproblemwillbereplayedwithindividualscomingfromdif-ferent ethnic and geographic backgrounds. As demon-stratedbytheHapMapproject,
14
thesepopulationscandif-fer in the frequencies of several genomic markers.The first example illustrates the use of a single genomictest. What if the general population is screened for severalgenetic variants at once? Suppose there is a panel of ge-nomic tests, each with superb testing performance: a sen-sitivity of 100% and a false-positive rate of 0.01%. That is,of100000individuals,eachtestwillonlyproduce10false-positive results. Assuming a disease prevalence of 1 in100000, in a population of 100000 the number of true-positive results will increase by 1 with each additional test.The increase in the number of false-positive results will be10 with each independent test, but some individuals willbe subject to multiple false-positive results; therefore, theincrease of the number of individuals with a false-positiveresultwillbeslightlylessthan10pertest.The
F
IGURE
showsthe increase in the proportion of individuals with a false-positivetestresultundertheseassumptions.Asillustrated,with 10000 independent tests, more than 60% of the en-tire population tested would have false test results.
Figure.
Percentage of Total Population With a False-Positive TestResult
7030605040201000 2000 4000 6000 8000 10
000
No. of Independent Tests
P e r c e n t a g e o f T o t a l P o p u l a t i o n w i t h a F a l s e - P o s i t i v e T e s t R e s u l t
Asthenumberoftestsincreasesto10000,thefractionofthepopulationthathasa false-positive test result increases to more than 60%. Any large-scale genomicpanel is therefore likely to routinely report false-positive results. The data for thisfigure were generated by running a simulation in which a population of 100000was tested with 1 through 10000 tests, each with a sensitivity of 100% and afalse-positive rate of 0.01%. That is, 10 individuals with false-positive tests wererandomly selected from the population for each test. Because some individualscould be selected more than once with a larger panel of tests, the increase in thenumber of individuals with false-positive test results is less than linear.
COMMENTARY
©2006 American Medical Association. All rights reserved.
(Reprinted) JAMA,
July 12, 2006—Vol 296, No. 2
213
at STANFORD Univ Med Center on May 2, 2008www.jama.comDownloaded from
Add a Comment