BMJ 2007;335:925 (3 November), doi:10.1136/bmj.39343.511389.BE (published 11 October 2007)
Simon K H Lam, MSc student1, Andrew Owen, consultant2
1 National Heart and Lung Institute, London SW3 6LY, 2 Department of Cardiology, Kent and Canterbury Hospital, Canterbury
Correspondence to: S K H Lam, Chi Lin Medical Centre, Kowloon, Hong Kong simon.lam{at}medsci.oxon.org
Design Bayesian network meta-analysis.
Data sources Medline, Embase, and Cochrane databases up to June 2006.
Review methods Two reviewers independently assessed trial eligibility and quality. Included trials compared cardiac resynchronisation therapy, implantable cardioverter defibrillator therapy, combined resynchronisation and implantable defibrillator therapy, and medical therapy alone, in patients with impaired left ventricular systolic function. Bayesian random effects network models were used to examine overall number of deaths.
Results 12 studies including 1636 events in 8307 patients were identified. Combined cardiac resynchronisation and implantable cardioverter defibrillator therapy reduced the number of deaths by one third compared with medical therapy alone (odds ratio 0.57, 95% credible interval 0.40 to 0.80) but did not further improve survival when compared with implantable defibrillator therapy (0.82, 0.57 to 1.18) or resynchronisation (0.85, 0.60 to 1.22) therapy alone.
Conclusion Evidence from randomised controlled trials is insufficient to show the superiority of combined cardiac resynchronisation and implantable cardioverter defibrillator therapy over cardiac resynchronisation therapy alone in patients with left ventricular impairment.
Current evidence based guidelines3 4 5 recommend an implantable cardioverter defibrillator for the primary prevention of sudden cardiac death in selected patients with impaired left ventricular function, and cardiac resynchronisation therapy for improvement of symptoms and survival in selected patients with abnormal ventricular conduction. Many patients may be eligible for both treatments but it does not necessarily follow that such patients would obtain additional benefit from the combined treatment over one treatment alone. There are, however, theoretical justifications for the combined treatment. Sudden cardiac deaths still account for about one third of all deaths in patients treated with resynchronisation therapy,w1w2 and adding implantable cardioverter defibrillator backup to resynchronisation therapy might further reduce mortality. Conversely, resynchronisation therapy alone reduces the risk of worsening deaths owing to heart failure as well as sudden cardiac deathsw2 suggesting that the addition of such therapy to implantable cardioverter defibrillation might further reduce the risk of death. It is therefore important to ascertain the efficacy of the combined treatment, which is more expensive than either treatment alone.
Several pairwise meta-analyses have compared the independent efficacies of resynchronisation therapy6 7 8 9 10 and of implantable cardioverter defibrillator therapy5 11 12 13 14 with medical therapy, whereas the effect of cardiac resynchronisation with an implantable defibrillator device was examined in exploratory meta-regression analyses.7 9 The overall evidence from randomised controlled trials for device therapy consists of pairwise comparisons between combined resynchronisation and implantable cardioverter defibrillator therapy, resynchronisation therapy, implantable cardioverter defibrillator therapy, and medical therapy. Most studies compared devices with medical therapy, with few directly comparing combined resynchronisation and implantable defibrillator therapy with either therapy alone.w1w3-w5 This network of evidence can be examined within a mixed treatment comparison framework without breaking randomisation, using either traditional or Bayesian models,15 16 to inform medical decision making by facilitating simultaneous comparison of all treatment options.17 18
The presence of three treatment groups (combined resynchronisation and implantable defibrillator therapy, resynchronisation alone, and control) in the medical therapy, pacing, and defibrillator in chronic heart failure trialw1 creates an additional level of complexity in evidence synthesis because multiple pairwise comparisons (compared with a common control) are correlated.15 19 Previous studies either excluded data7 (because of lack of a separate implantable cardioverter defibrillator treatment arm) from the combined resynchronisation and implantable defibrillator therapy group, or divided data9 from the control group to incorporate comparisons with combined resynchronisation and implantable defibrillator therapy and resynchronisation therapy in the same analysis. These approaches are not ideally suited15 to investigate the potential incremental benefits of combined therapy, particularly as this is the largest trial examining the efficacy of this type of therapy. It is important to include data from all three treatment groups of the medical therapy, pacing, and defibrillator in chronic heart failure trial to provide evidence of a higher methodological quality, and appropriate modelling of random effects in multigroup trials can be implemented using a fully Bayesian model.19 20
We systematically reviewed overall evidence from randomised controlled trials for combined cardiac resynchronisation and implantable cardioverter defibrillator therapy on survival compared with medical therapy, an implantable cardioverter defibrillator, and cardiac resynchronisation therapy in patients with left ventricular impairment, using Bayesian network meta-analysis.
We searched Medline (1966 to June 2006), Embase (1988 to 2006, week 26), and the Cochrane central register of controlled trials (2nd quarter 2006). In addition, we searched for studies in reports from the US Food and Drugs Administration and reference lists of identified studies and published meta-analyses. We applied no restrictions on types of cardiac resynchronisation therapy or implantable cardioverter defibrillator devices or on language.
Selection criteria
Studies were eligible if they were
randomised parallel controlled trials or randomised crossover trials;
included patients with impaired left ventricular systolic function
(ejection fraction <35%); compared cardiac resynchronisation or
combined resynchronisation and implantable cardioverter defibrillator
therapy with medical therapy or with medical therapy plus implantable
cardioverter defibrillator therapy (studies including patients with
pacing leads inserted through the transthoracic route were
eligible, whereas we excluded trials comparing different pacing
strategies in themselves), or were primary prevention trials
comparing implantable cardioverter defibrillator with usual medical
therapy or with oral antiarrhythmics (we excluded studies with a
mandatory requirement for inducible arrhythmias and secondary
prevention trials); and reported all cause mortality. We excluded
trials recruiting patients who had had a myocardial infarction or
undergone coronary revascularisation within the past month.
Consistent with previous systematic reviews,7 9
we excluded trials of less than two weeks' duration.
Methodological assessment
We assessed concealment of
treatment allocation, blinding (patient and investigator), and
analysis using intention to treat for internal validity and graded
these as yes, no, or unclear. We also noted studies where
randomisation occurred after implantation of the device.
Data abstraction and outcomes
Both authors independently
recorded trial design, recruitment criteria, baseline
characteristics, efficacy outcomes, and quality assessment; any
discrepancies were resolved by consensus. Primary outcomes were all
cause mortality for combined resynchronisation and implantable
cardioverter defibrillator therapy compared with medical therapy,
with resynchronisation alone, and with implantable cardioverter
defibrillator alone. For crossover trials we considered results from
the first period only. We abstracted the total number of events and
patients randomised to each treatment arm (intention to treat
principle). Subgroup analyses were planned for patients with New York
Heart Association class III or IV symptoms of heart failure at
baseline.
Statistical analysis
For direct pairwise comparison
meta-analysis we decided a priori to analyse trials using medical
therapy as the control group separately from those using implantable
cardioverter defibrillator therapy as the control because of prima
facie evidence of clinical heterogeneity in the control groups
(irrespective of estimated heterogeneity). To facilitate comparison
with Bayesian network meta-analysis we expressed mortality outcomes
from individual studies as odds ratios. We used random effects models
to estimate the mean and 95% confidence interval for the overall
treatment effect (if there were at least three
studies).22
We analysed the network of randomised controlled trials within a mixed treatment comparison framework15 16 17 using full Bayesian random effects models as described by Higgins and Whitehead19 and implemented by Caldwell et al.23 Specifically, we used binomial likelihood to model the probability of death within each treatment arm. In each trial we defined a study specific baseline effect using log odds of the control group mortality, and we modelled the effect of intervention (log odds ratio) for each treatment arm. For each treatment (device) we estimated the treatment specific effect (basic variable) from the mean intervention effect for each treatment compared with the medical therapy control. We derived comparisons between treatments (functional variables) from differences between basic variables. Mean and Bayesian 95% credible intervals for treatment effects were estimated and expressed as odds ratios for presentation.
The absolute benefit for each treatment (odds of death) was estimated by adding the treatment specific effect compared with medical therapy (basic variables) to the average effect of medical therapy (baseline odds). We used standard formulas to convert the absolute odds of death to overall mortality (for the purpose of reporting).24 In each simulation we ranked best the treatment option with the highest absolute odds. The probability that each treatment was best was derived from the percentage of best ranking across all simulations.
To ensure that overall effects were dominated by data from the trials and not influenced by choice of initial distribution we used low information (non-informative) prior distributions—that is, we used vague normal (mean 0, variance 10 000) and uniform (0-2) prior distributions for means and standard deviations, respectively. We examined the impact of different choices of prior distribution in sensitivity analyses.
The Bayesian models were implemented using WinBUGS version 1.4.1 (Imperial College and Medical Research Council, 2004). After convergence was achieved from an initial 5000 (burn-in) simulations, we constructed posterior distributions of the treatment effects from three chains of 50 000 simulations. MATLAB version 7.0 (MathWorks, Natick, MA, 2004) was used to carry out diagnostics and further data analyses.
We used funnel plots of log odds ratios against standard errors to
explore the possibility of publication or other biases.25 Heterogeneity was explored using the L'Abbé plot (in
logarithmic scale) of the odds of death in the treatment group
against that in the control group.24 We used
2 test of Cochran's Q statistics to examine the
hypothesis that all studies were evaluating the same study
effect,26 and we quantified the percentage of total
variation across studies owing to heterogeneity
(I2).27
The potential impact of study heterogeneity was examined in a
priori sensitivity analyses excluding trials with a crossover design,
less than one year's follow-up, fewer than 200 patients per group,
use of less than 50%
blocker, early termination of trial due to futility, and
requirement of previous myocardial infarction for inclusion.
Figure 2
shows the relation between the network of randomised
controlled trials. In total, 1636 events occurred in 8307 patients
randomised to cardiac resynchronisation therapy (245/1283),
implantable cardioverter defibrillator therapy (367/2429), combined
resynchronisation and implantable cardioverter defibrillator
therapy (132/1112), amiodarone (247/897), and control (645/2586).
Seven studies reported 1013 events in 4319 patients for subgroup
analysis of New York Heart Association class III or IV heart
failure, including five studies that recruited only patients
with class III or IV heart
failurew1w2w5w6w9 and two
studies that reported subgroup
outcomes.w9w11
Table 1
summarises the design, baseline characteristics, and
quality assessment of the included studies. All used the transvenous
approach to implantation, whereas one included 11% of patients
with leads implanted transthoracically.w4 Most studies
were analysed using the intention to treat principle, but
concealment of treatment allocation was unclear in most trials. In
several studiesw3w5w6w9
blinding of investigators or patients, or both, was possible as only
patients with successful device implantations were considered for
randomisation.
One study was presented in two publications reporting independent results from patients with New York Heart Association class IIw3 and class III or IVw5 heart failure at baseline. The number of deaths reported was identical to a FDA report38 but different from an earlier version39 cited in previous reviews.7 9 In this review published outcomes were abstracted as per two independent studies.w3w5 Mortality data were used from the extension phase of the cardiac resynchronisation heart failure trial.40w2
Four studies accounted for 73% of patients and 88% of observed events.w1w2w6w11 Baseline mortality was comparable in most studies except for five.w3-w6w9 In these five studies duration of follow-up was shorter and patients only with successfully implanted devices were randomised. No major asymmetry was seen in the funnel plots to suggest publication bias (not shown).
Quantitative analysis
Figures 3
and 4
summarise the all cause mortality data for Bayesian
network and pairwise comparisons of device therapies compared
with medical therapy. Combined resynchronisation and implantable
defibrillator therapy significantly reduced mortality compared
with medical therapy in one direct comparison studyw1
(odds ratio 0.64, 95% confidence interval 0.46 to 0.90), and in
Bayesian network meta-analysis of 12 studies (0.57, 95% credible
interval 0.40 to 0.80). Both resynchronisation (0.66, 95% credible
interval 0.50 to 0.89) and implantable defibrillator therapy (0.69,
0.55 to 0.87) reduced mortality compared with medical therapy.
Amiodarone did not have any apparent effect on mortality compared
with medical therapy (0.97, 0.68 to 1.35).
The overall mortality for combined resynchronisation and implantable
defibrillator therapy was 9.1% compared with 14.0% for medical
therapy, corresponding to a 35% relative risk reduction (table
2
). The probability determined from the Bayesian analysis
that combined resynchronisation and implantable defibrillator
therapy was the best option (compared with other devices and
optimal medical therapy) was 0.75 in all patients with impaired
left ventricular function and 0.62 in the subgroup of patients
with New York Heart Association class III or IV heart failure.
The corresponding probabilities for resynchronisation therapy
were 0.14 and 0.27 and for implantable defibrillator therapy
were 0.10 and 0.08.
Figure 5
shows the results of head to head comparisons of combined
resynchronisation and implantable defibrillator therapy with
either therapy alone. When combined therapy was compared with
implantable defibrillator therapy no evidence was found from
pairwise meta-analysis (three studies, odds ratio 0.81, 95%
confidence interval 0.48 to 1.37) and Bayesian network meta-analysis
(12 studies, odds ratio 0.82, 95% credible interval 0.57 to
1.18; seven studies, New York Heart Association class III or IV
subgroup, odds ratio 0.74, credible interval 0.39 to 1.57) to suggest
that combined therapy further improved survival (fig 4
). Similarly, when combined therapy was compared with
resynchronisation therapy no evidence was found from one direct
comparison study (odds ratio 0.79, 95% confidence interval 0.60 to
1.06) and Bayesian network meta-analysis (odds ratio 0.85, 95%
credible interval 0.60 to 1.22; New York Heart Association class
III or IV subgroup, odds ratio 0.89, 95% credible interval 0.45
to 1.76) for an incremental value of combined therapy.
Estimates of treatment effects were robust for study selection
criteria (including a priori and post hoc sensitivity analyses)
and for statistical assumption of prior distributions (not shown).
Limitations
Limitations of the primary trials and
potential confounders may affect the validity of the findings. Five
studies, two of resynchronisation therapyw6w9
and three of combined therapy compared with implantable cardioverter
defibrillator therapyw3-w5 only randomised patients after
successful implantation of the device. Although results of these
studies were analysed using intention to treat (from randomisation),
complications related to implantations were excluded. Event rates in
these studies were lower than in other studies included in the
review, but treatment effects were comparable. In addition, similar
to previous meta-analyses, the present study was subject to potential
publication bias,24 although funnel plots did not suggest
the presence of such bias and an extensive search strategy was used
to identify relevant trials.
Criteria for patient selection were different but overlapping in the primary trials examining implantable cardioverter defibrillator and cardiac resynchronisation therapy. Although both sets of trials recruited patients with impaired left ventricular function, prolonged QRS interval is a prerequisite only for patients undergoing resynchronisation. Thus interpretation of the results of the present meta-analysis is subject to this potential confounder. This situation is, however, no different from everyday clinical scenarios where the doctor needs to use clinical judgment informed by the same evidence base. The point of the present meta-analysis is to use all the available evidence to tackle the clinically relevant question of whether patients independently eligible for resynchronisation and for implantable defibrillator therapy would benefit from a combined device. The current evidence base is not ideal but it is the best available pending a definitive randomised controlled trial on this subject.
We excluded studies that compared resynchronisation therapy with univentricular pacing. This reduces the total number of cases available for analysis and potentially the overall statistical power. However, this strategy avoided the ambiguity in previous reviews, where patients treated with univentricular pacing were analysed in the same group (and hence assumed to have the same prognosis) as those receiving optimal medical therapy alone. It is possible to include patients from studies using right (or left) univentricular pacing as a sixth (or seventh) treatment group in the network analysis. This approach was not adopted in the present protocol because the a priori clinical question of interest was the value of resynchronisation therapy, and not univentricular pacing, in heart failure.
Trials included in this review were carried out over a period of
evolving medical management of heart failure;
blocker usage at baseline was less than 50% in several
trialsw4w7w9 and the underlying risk
of death in these studies might have been different had their usage
been higher. In addition, the follow-up period was no more than six
months for most trials of resynchronisation therapy (except the
studies of cardiac resynchronisation heart failurew2 and
comparison of medical therapy, pacing, and defibrillator in chronic
heart failurew1), potentially before the full benefits of
resynchronisation therapy were realised. Several trials were
underpowered to detect mortality benefits because recruitment
was discontinued (owing to futility) before achieving the intended
number of participants,w7w12 and some studies were
primarily designed to identify functional
changes.w3-w6w9 Furthermore, one trial required
a history of myocardial infarctionw11 for inclusion, and
patients with a more recent history may respond less favorably to
implantable cardioverter defibrillators.41 However,
multiple sensitivity analyses suggested that these potential
confounders did not affect the findings of this study.
The main efficacy outcome of interest in this study was mortality, but many primary trials did not report outcome in sufficient detail to permit abstraction of data on subgroups. Previous reviews7 9 provided good evidence that resynchronisation therapy improved functional outcomes and quality of life, but these outcomes were not reported in any primary trials of implantable cardioverter defibrillators included in the present review, and Bayesian network meta-analyses were not planned for these outcomes. Finally, data were limited for subgroup analysis of patients with New York Heart Association class III or IV heart failure (fewer patients in implantable cardioverter defibrillator trials had class III symptoms) leading to wide credibility intervals.
Relation to previous studies
In previous meta-analyses
that compared resynchronisation therapy with no such
therapy,6 7 8 9 10 trials
with different comparison groups (resynchronisation versus medical
therapy, resynchronisation versus univentricular pacing, and combined
resynchronisation and implantable defibrillator versus implantable
defibrillator) were combined making it impossible to determine the
efficacy of combined therapy itself. The efficacy of combined
therapy was inferred from exploratory metaregression analyses
implemented using likelihood estimation9 or full
Bayesian7 techniques, which found no significant
variability between trials comparing resynchronisation therapy with
medical therapy (or univentricular pacing) and trials comparing
combined therapy with implantable defibrillator therapy. Only two
trials compared combined therapy with implantable defibrillator
therapy,39w4 and data from 595 patients from the
comparison of medical therapy, pacing, and defibrillator in
chronic heart failure trialw1 treated with combined
therapy were not incorporated.7 Thus results of these
regression analyses may not be robust,27 and the efficacy
of combined resynchronisation and implantable defibrillator therapy
itself cannot be quantified in these studies.
One previous meta-analysis reported that adding implantable cardioverter defibrillator to cardiac resynchronisation therapy resulted in an apparent reduction in mortality.6 This claim was, however, based on the pooled estimates of data from the comparison of medical therapy, pacing, and defibrillator in chronic heart failure trialw1 and a non-randomised controlled trial.42 Although it is possible to include non-randomised studies within a general evidence synthesis framework43 it is not generally advised in systematic reviews of device therapy44 because of the possibility of introducing significant bias, especially when studies are few.45
The present Bayesian network meta-analysis permits simultaneous comparison of all treatment options, and conclusions on the efficacies of resynchronisation therapy and of implantable defibrillator therapy are similar to the results of previous meta-analyses. No evidence was found from the present network analysis, however, that combined cardiac resynchronisation and implantable defibrillator therapy is better than either resynchronisation or implantable defibrillator alone.
The full Bayesian network approach provided evidence of a higher methodological quality by taking into account the multivariate relation between intervention effects of multigroup trials. All available evidence, including data from all three treatment groups of the comparison of medical therapy, pacing, and defibrillator in chronic heart failure trial,w1 was incorporated without splitting or discarding groups,15 in contrast to previous exploratory metaregression analyses7 9 where this was not possible. Thus conclusions of the present study are based on all available current evidence from randomised controlled trials, and multiple sensitivity analyses suggest that these findings are robust for statistical assumptions and trial inclusion criteria.
Implications
Current guidelines from the American College
of Cardiology, American Heart Association, and European Society of
Cardiology for the management of patients with ventricular
arrhythmias and the prevention of sudden cardiac death46
give a IIa (weight of evidence in favour of efficacy), level of
evidence B (data derived from a single randomised trial or
non-randomised studies) recommendation for combined resynchronisation
and implantable defibrillator therapy in patients with New York Heart
Association class III or IV heart failure and a broad QRS complex. A
case exists for using combined therapy in patients who
simultaneously satisfy the criteria for both therapies, and the
present Bayesian analysis suggests that it is probable that combined
therapy is the best option. However, this practice is based on
extrapolated evidence from trials that showed efficacy of
resynchronisation therapy or implantable defibrillator therapy
compared with medical therapy. No direct evidence was found from
primary trials or from the present Bayesian network meta-analysis to
suggest that combined therapy is better than either therapies alone
in patients with left ventricular impairment. As clinical practice
guidelines are becoming prescriptive rather than offering guidance,
many clinicians may feel compelled (despite this lack of direct
evidence of superior efficacy) to implant a combined
resynchronisation and cardioverter defibrillator device if patients
fulfill criteria for both therapies.
It could be argued that cardiac resynchronisation should be added to an implantable cardioverter defibrillator in clinical practice to improve symptoms rather than survival itself, but resynchronisation therapy alone improves symptoms (as well as survival). The potential advantage of combined therapy over resynchronisation therapy alone is the theoretical incremental survival benefit (not proved in the present meta-analysis). The routine use of combined therapy in all patients eligible for both treatments, on the basis that it may prolong survival over cardiac resynchronisation therapy or implantable cardioverter defibrillator alone, would not seem to be appropriate. Trial evidence is usually required before a new treatment is used routinely.
The lack of definitive clinical evidence means that public funding bodies are unable to assess properly the comparative cost effectiveness of combined resynchronisation and implantable defibrillator therapy even if it does offer some advantage over either therapy alone. A simple pragmatic approach would be to use resynchronisation therapy, which may be more cost effective than combined therapy,47 48 to reduce symptoms and extend life in patients with New York Heart Association class III or IV heart failure, with the addition of an implantable cardioverter defibrillator left to clinical judgment on an individual basis when additional indications exist. When such an addition is contemplated the hypothesised incremental benefits in survival would need to be balanced by the possible increase in morbidity due to, for example, inappropriate shocks.49
Ongoing clinical trials50 51 are examining the potential value of combined therapy for patients suitable for implantable cardioverter defibrillators who are not currently eligible for cardiac resynchronisation. These studies will provide important data on the value of adding resynchronisation therapy to treat patients who currently only satisfy criteria for implantable cardioverter defibrillators, but do not inform whether combined therapy offers any survival benefits over resynchronisation therapy in patients who have heart failure with a prolonged QRS interval. In view of the additional cost of combined therapy and potential morbidity associated with inappropriate defibrillation shocks, the burden of proof (requiring a major new clinical trial of thousands of patients) should ideally be on combined therapy to show superiority over resynchronisation therapy, and further studies are needed to identify the population most likely to benefit.
|
Funding: None.
Competing interests: None declared.
Ethical approval: Not required.