Professional Documents
Culture Documents
John Doe
Date
Outline
EBM movement
began in the early 1990s
Clinician preference, opinions
and experience and habits
opinion based model
EBM supported by enhanced
education, dissemination of
information
EBM endorsed by government
agencies, private sector
organizations and academic
institutions
Internet public drive for
information
Evidence-based
medicine is the
integration of the best
research with clinical
expertise and patient
values.
Context
Dr. David Sackett
Best
Evidence
Professional
Judgement
Systematic
Reviews
Experience
EBM
Clinical
Expertise
Patient
Values
Religious and Moral Beliefs
Preferences and Rights
Hierarchy of Evidence
Best Possible
Evidence
Choudhry NK,et al. Just a spoonful of medicine helps the sugar go down: Improving the management
of type 2 diabetes [Internet]. Boston (MA): Alosa Foundation; 2009.
Vinik A. Clin Ther. 2007; 29:1236-53.
Amori RE, et al. JAMA. 2007; 298: 194-206; Bolen S, et al. Ann of Int Med. 2007; 147: 386-99.
Choudhry NK,et al. Just a spoonful of medicine helps the sugar go down: Improving the
management of type 2 diabetes [Internet]. Boston (MA): Alosa Foundation; 2009.
Assessing Evidence:
The Science of Critiquing Papers
What is the study about?
Was the study design reasonable?
Was the comparator appropriate?
How was the outcome measured?
Were patients randomized?
Was the randomization concealed?
Were patients analyzed in the groups to which they were
randomized?
Was follow-up complete?
Basic Statistics
Control Event Rate
(CER)
(TER)
= TER / CER
= (1-RR) x 100%
= CER TER
= 1/ARR
An Example: Hypoglycemia
RCT of 20 patients comparing a new diabetes treatment
(drug A) vs. the control
Risk of experiencing hypoglycemia:
Drug A: 2 out of 10 pts
Risk = 2/10 = 0.2 or 20%
Control: 4 out of 10 pts
Risk = 4/10 = 0.4 or 40%
Relative Risk (RR) = risk in Drug A / risk in Control = 0.2/0.4 = 0.5
RRR
ARR
NNT
1% vs. 2%
50%
1%
100
50%
10%
10
50%
40%
2.5
RRR = relative risk reduction; ARR = absolute risk reduction; NNT = number needed to treat
Pioglitazone
Placebo
RRR(95%CI)
NNT(95%CI)
NotSignificant
PrimaryCompositeendpoint*
20%
22%
9.2%(0.9to18)
MainSecondaryCompositeEndpoint**
12%
14%
15%(1.9to26)
49(27to407)
Anyseriousadverseevent
46%
48%
4.6%(1.1to9.9)
NotSignificant
RRI(95%CI)
NNH(95%CI)
HeartFailure
11%
8%
40%(22to60)
23(16to38)
*Deathfromanycause,nonfatalmyocardialinfarction,stroke,acutecoronarysyndrome,legamputation,
coronaryrevascularisation,orrevascularisationoftheleg.
**Deathfromanycause,nonfatalmyocardialinfarction,orstroke.
RRR = relative risk reduction; NNT = number needed to treat; RRI = relative risk increase; NNH = number
needed to harm
Statistically significant
and clinically relevant
A1c
Confidence
interval
Fig 1: A point estimate
+0.7
Clinical relevance
Not statistically
significant
Statistical significance
Not statistically
significant
Statistical insignificance
(line = 0 for no absolute
differences, or line = 1 for no
relative differences)
Statistical significance
-0.7
Clinical relevance
Onset of
action
Peak
Duration
5-8 h
Up to 18 h
Human Insulin
Intermediate-acting
(NPH, N)
1-3 h
90 min
No peak
24 h
Detemir (Det)
(Levemir)
90 min
No peak
16-24 h
Onset of
action
Human Insulin
Peak
Duration
Short-acting
30-60 min
2-3 h
6.5 h
(Regular, Toronto)
Rapid-Acting Insulin Analogues (RAIA)
Lispro (Lis)
10-15 min
1-2 hours
3-5 h
(Humalog)
Aspart (Asp)
10-15 min
1-2 hours
3-5h
(NovoRapid)
Efficacy
Overall hypoglycemia
Nocturnal hypoglycemia
Severe hypoglycemia
Weight gain
Cost
Individual patient
Society
Quality of Life
A1C = hemoglobin A1C; FBG = fasting blood glucose; 2hPPG = 2-h postprandial glucose
Rate Ratio
Lispro
WMD(%
0.4
Aspart
0.2
0.06
0.03
0.12
0
0.2
0.04
0.09
0.21
0.4
0.6
0.8
Favors analog
HI = regular human insulin; IAsp = insulin aspart; ILis = insulin lispro; RAIA = rapid-acting insulin analogue
Singh SR, et al. CMAJ. 2009;180(4):385-97.
Glargine
Detemir
0.6
0.49
WMD(%
0.4
0.38
0.28
0.2
0
0.2
0.22
0.13
0.03
0.07
0.04
0.05
0.13
w/o orals
0.1
0.18
0.4
0.6
Favors analog
with orals
0.8
with bolus
IGlar vs. NPH (w/o OADs), 1 trial; 518 pts
IDet vs.NPH (w/IAsp), 1 trial; 505 pts
IDet = insulin detemir; IGlar = insulin galrgine; LAIA = long-acting insulin analogue; NPH = neutral protamine Hagedorn
IDet vs NPH
* statistically significant
HI = human insulin; IGlar = insulin glargine; IDet = insulin detemir; LAIA = long-acting insulin analogue;
NPH = Neutral Protamine Hagedorn
Hypoglycemia
Fear of Hypoglycemia
Blood Glucose < 4 mmol/L
Mild
-
Moderate
-
Severe
-
3.73
3.50
RiskRatio
3.00
2.50
Severe
Nocturnal
2.37
2.00
1.50
1.63
1.53
0.71
0.65
1.36
1.00
0.50
0.43
0.00
0.08
0.39
0.11
0.28
1.48
20.01
Severe
Nocturnal
RiskRatio
1.20
1.00
0.91
0.80
0.60
0.75
0.66
0.68
0.56
0.47
0.40
0.29
0.31
0.20
0.00
0.53
0.03
IDet = insulin detemir; IGlar = insulin glargine; NPH = neutral protamine Hagedorn; OAD = oral antidiabetes drug
Expanding Evidence
Evidence
Efficacy
Effectiveness
Economics
Efficiency
Ethics
Equity
AverageWholesalePrice($)permL
9.00
8.00
7.00
6.00
5.00
4.00
3.00
2.00
1.00
0.00
HumanInsulins
RapidActingInsulinAnalogues
LongActingInsulinAnalogues
PorkInsulins
McKessonCanada,MaximumWholesaleUnitPrice AverageofCanadianJurisdictions,March2008.
*Prices may vary locally and may change over time.
Costeffectiveness
(CEA)
Monetary
Cost-utility
(CUA)
Monetary
Costminimization
(CMA)
Cost-of-illness
Monetary
Monetary
Primary Concern
Maximal increment
in benefit for limited
resources
Clinical: life-year Least costly way to
gained, %
achieve objective;
patients
compare alternatives
reaching goal
within 1 therapeutic
category
Quality-adjusted Societal allocation;
life-year (QALY) compare alternatives
gained
across therapeutic
categories
Efficiency (e.g.,
Equal benefit
generic, therapeutic
ASSUMED
substitution)
Monetary
Total cost
identification
$20,000 - $16,000
2.6 QALYs - 2.0 QALYs
= $6,400 / QALY
Pharmacoeconomics
CLINICAL
Safety
ECONOMIC
Side
effects
Efficacy/
Effectiveness
HUMANISTIC
Satisfaction
Work
productivity
Resources
consumed
Direct Medical
Costs
Quality
of Life
Bothersomeness,
tolerability
Health-related
quality of life
(Weights)
Perfect
Health
Dead 0.0
2. With
Program
A
Qu
alit
y-
B
Adj
1. Without
Program
Intervention
Death 1
Duration (years)
ust
ed
Life
Yea
r
Death 2
Drummond MF, et al. Methods for the economic evaluation of health care programmes. 3rd
ed. Oxford: Oxford University Press; 2005.
Denominator
Healthy
Morbidity
Mortality
sG
ain
ed
Intervention A
Worse than status quo
Decrease in
total costs(-)
Consider
Costeffectiveness
Increase in
total costs (+)
Comparing Drugs
Intervention A
Better than status quo
Consider
Costeffectiveness
Reduced clinical benefit (-)
NW
NE
Straight line
from Origin
represents
ICUR
Difference in cost
SW
SE
Difference in
effectiveness
Difference in cost
NW
NE
SW
SE
Difference in
effectiveness
Difference in cost
NW
NE
If ICUR >
WTP then
should not
adopt
SW
SE
Difference in
effectiveness
NW
NE
SW
SE
NW
NE
SW
SE
NW
NE
WTP = Zero
SW
SE
NE
SW
SE
NE
SW
SE
NE
SW
SE
Interpretation
___________________________________________________________
Good value
Intermediate value
Cost prohibitive
_______________________________________________
Scatter Plot
Incremental cost-utility scatter plot of glargine vs. NPH in
patients with type 2 diabetes
ICER = incremental cost-effectiveness ratio; LE = life expectancy; NPH = neutral protamine Hagedorn; QALE = quality-adjusted life expectancy
0.14%
Self
Monitoring
0.17%
22%
28%
SelfTesting
Control
0.00%
0.00%
10%
10%
Differenceinmean
change(95%CI)
0.14%(0.35to0.07)
0.17%(0.37to0.03)
RRI(95%CI)
123%(28to292)
189%(70to396)
A1C = hemoglobin A1C; CI = confidence interval; NNH = number needed to harm; RRI = Relative Risk Increase
NNH(95%CI)
9(5to26)
6(4to10)
SMBG
Difference
Between SMBG
and No SMBG
7.298
7.322
0.02385
$27,997
$30,708
$2,711
$113,643
ICUR = incremental cost-utility ratio; QALY = quality-adjusted life-year; SMBG = self-monitoring of blood glucose.
*Discounted at 5% per year.
Cost in $C per incremental quality-adjusted life-year gained.
Sensitivity Analysis
ICUR (C$/QALY)
Reference Case
$113,643/QALY
Lower limit of 95% CI for WMD in A1C from 7 RCTs ( A1C = -0.39%)
$77,706/QALY
Upper limit of 95% CI for WMD in A1C from 7 RCTs ( A1C = -0.15%)
$189,376/QALY
$86,129/QALY
$58,615/QALY
$31,101/QALY
$89,656/QALY
$81,654/QALY
$122,416/QALY
$169,120/QALY
$213,503/QALY
Baseline A1C, 8.0 to 10.5% (WMD in A1C% = 0.30%, Baseline A1C = 8.7%)
$94,443/QALY
$91,724/QALY
$292,144/QALY
100%
90%
80%
70%
60%
50%
40%
30%
20%
10%
0%
$0
$25,000
$50,000
$75,000
$100,000
$125,000
$150,000
90%
Reference Case
<1 SMBG per day
80%
70%
60%
50%
40%
30%
20%
10%
0%
$0
$25,000
$50,000
$75,000
$100,000
$125,000
$150,000
Potential Impact
Opportunity Cost
The value of opportunity forgone, as a result of engaging resources in an activity
A reduction in utilization from 9 strips/week (current use in Ontario) to 1-2 strips/week
for patients not using insulin.
Potential cost savings of $150 million
Are there alternative uses for this $150 million?
* This estimate is based on 2006 data from eight publicly funded drug plans in Canada (BC, MB, NL, NIHB, NS,
ON, QC, SK) plus data from 67% of privately funded drug plans that submitted data to Brogan Inc. Some patients
in the dataset could not be classified by province or territory, therefore the estimate is understated.
Conclusions
References
Amori RE, Lau J, Pittas AG. Efficacy and safety of incretin therapy in type 2
diabetes: systematic review and meta-analysis. JAMA. 2007 Jul 11;298(2):194206.
Bolen S, Feldman L, Vassy J, Wilson L, Yeh HC, Marinopoulos S, et al. Systematic
review: comparative effectiveness and safety of oral medications for type 2
diabetes mellitus. Ann Intern Med. 2007 Jul 16;147(6):386-99. Available from:
http://www.annals.org/cgi/reprint/147/6/386.pdf
Cameron CG, Bennett HA. Cost-effectiveness of insulin analogues for diabetes
mellitus. CMAJ. 2009 Feb 17;180(4):400-7.
Canadian Agency for Drugs and Technologies in Health. An economic evaluation
of insulin analogues for the treatment of patients with type 1 and type 2
diabetes mellitus in Canada [Internet]. Ottawa: The Agency; 2008. (Optimal
therapy report; vol. 2 no. 4) [cited 2008 Apr 11]. Available from:
http://cadth.ca/media/compus/reports/compus_Economic_IA_Report.pdf
Canadian Agency for Drugs and Technologies in Health. Current utilization of
blood glucose test strips in Canada [Internet]. Ottawa: The Agency; 2009 Mar.
(Optimal therapy report; vol. 3 no. 4) [cited 2009 Mar 31]. Available from:
http://www.cadth.ca/media/pdf/compus_CU_Report-BGTS.pdf
References
Canadian Agency for Drugs and Technologies in Health. Long-acting insulin
analogues for the treatment of diabetes mellitus: meta-analyses of clinical
outcomes [Internet]. Ottawa: The Agency; 2008 Mar. (Optimal therapy report;
vol. 2 no. 1) [cited 2008 Apr 9]. Available from:
http://cadth.ca/media/compus/reports/compus_Long-Acting-Insulin-AnalogsReport_Clinical-Outcomes.pdf
References
Dormandy JA, Charbonnel B, Eckland DJ, Erdmann E, Massi-Benedetti M,
Moules IK, et al. Secondary prevention of macrovascular events in
patients with type 2 diabetes in the PROactive Study (PROspective
pioglitAzone Clinical Trial in macroVascular Events): a randomised
controlled trial. Lancet. 2005;366(9493):1279-89.
Drummond MF, Sculpher MJ, Torrance GW, O'Brien BJ, Stoddart GL.
Methods for the economic evaluation of health care programmes. 3rd
ed. Oxford: Oxford University Press; 2005.
Farmer A, Wade A, Goyder E, Yudkin P, French D, Craven A, et al. Impact
of self monitoring of blood glucose in the management of patients
with non-insulin treated diabetes: open parallel group randomised
trial. BMJ. 2007 Jul 21;335(7611):132.
Guyatt G, Rennie D, eds. Users' guides to the medical literature: a manual
for evidence-based clinical practice. Chicago: AMA Press; 2002.
Hirsch IB. Insulin analogues. N Engl J Med. 2005;352(2):174-83.
References
Isley WL. Pioglitazone did not reduce a composite endpoint of macrovascular
complications and increased risk for heart failure in type 2 diabetes with
macrovascular disease. ACP J Club. 2006 Mar;144(2):34.
Sackett DL, Rosenberg WM, Gray JA, Haynes RB, Richardson WS. Evidence based
medicine: what it is and what it isn't. BMJ. 1996 Jan 13;312(7023):71-2.
Singh SR, Ahmad F, Lal A, Yu C, Bai Z, Bennett H. Efficacy and safety of insulin
analogues for the management of diabetes mellitus: a meta-analysis. CMAJ.
2009 Feb 17;180(4):385-97.
Triplitt C. How to initiate, titrate, and intensify insulin treatment in type 2 diabetes.
US Pharm. 2007 [cited 2009 Feb 2];32(10):10-6. Available from:
http://www.uspharmacist.com/content/t/diabetes/c/10215/
Vinik A. Advancing therapy in type 2 diabetes mellitus with early, comprehensive
progression from oral agents to insulin therapy. Clin Ther. 2007;29 Spec
No:1236-53.
Waldron-Lynch F, Dinneen S. Self-monitoring of blood glucose did not improve
glycemic control in patients with type 2 diabetes not treated with insulin. ACP J
Club. 2008 Jan;148(1):1.