Abstract
Background:
The reported cost effectiveness of cardiovascular disease management programs (CVD-MPs) is highly variable, potentially leading to different funding decisions. This systematic review evaluates published modeled analyses to compare study methods and quality.
Methods:
Articles were included if an incremental cost-effectiveness ratio (ICER) or cost-utility ratio (ICUR) was reported, it is a multi-component intervention designed to manage or prevent a cardiovascular disease condition, and it addressed all domains specified in the American Heart Association Taxonomy for Disease Management. Nine articles (reporting 10 clinical outcomes) were included.
Results:
Eight cost-utility and two cost-effectiveness analyses targeted hypertension (n=4), coronary heart disease (n=2), coronary heart disease plus stoke (n=1), heart failure (n=2) and hyperlipidemia (n=1). Study perspectives included the healthcare system (n=5), societal and fund holders (n=1), a third party payer (n=3), or was not explicitly stated (n=1). All analyses were modeled based on interventions of one to two years’ duration. Time horizon ranged from two years (n=1), 10 years (n=1) and lifetime (n=8). Model structures included Markov model (n=8), ‘decision analytic models’ (n=1), or was not explicitly stated (n=1). Considerable variation was observed in clinical and economic assumptions and reporting practices. Of all ICERs/ICURs reported, including those of subgroups (n=16), four were above a US$50,000 acceptability threshold, six were below and six were dominant.
Conclusion:
The majority of CVD-MPs was reported to have favorable economic outcomes, but 25% were at unacceptably high cost for the outcomes. Use of standardized reporting tools should increase transparency and inform what drives the cost-effectiveness of CVD-MPs.
Introduction
The concept of disease management started to spread in the US healthcare industry in the mid-1990s with growing expectations that a disease management intervention can be cost-saving when applied to chronic diseases. 1 Despite this expectation and the amount invested, the evidence on the ability of disease management to actually reduce or save healthcare costs without compromising the quality of care has been highly variable. The inconclusiveness is further compounded by considerable variation in economic evaluation methods, inadequate costing methods observed in economic evaluations in general,2,3 and by the lack of a widely-accepted definition of disease management. 4
Cardiovascular disease (CVD) is the largest contributor to the chronic disease cluster, 5 and accounts for a substantial share of national health expenditures in the USA, 6 the EU 7 and Australia. 8 Both CVD and its risk factors have often been the target of prevention and management efforts globally, and heart failure, coronary artery disease, hypertension and hyperlipidemia collectively accounted for 25% to 38% of the chronic conditions targeted by disease management interventions identified in systematic reviews9,10 and meta-analyses. 11
Despite substantial investment made in recent decades, the cost-effectiveness of cardiovascular disease management programs (CVD-MPs) is inconsistent. Understanding under what circumstances CVD-MP is or is not cost-effective is an important determinant of efficient resource allocation. However, considerable methodological or reporting variation has hindered the assessment of what could have impacted the reported cost-effectiveness, let alone the reliable estimate of the cost-effectiveness of CVD-MPs.
Given the paucity of data that could collectively inform policy decisions and urgency to standardize cost analyses of these widespread and commonly applied programs, our objectives are to: 1) identify model-based economic evaluation of CVD-MPs and compare study characteristics, the methods used and cost-effectiveness reported across identified studies; 2) assess the degree of transparency against established methodological or reporting principles.
Methods
The Preferred Reporting System for Systematic Reviews and Meta-Analysis (PRISMA) strategy was followed to ensure systematic selection of studies. 12 Electronic databases (Medline, CINAHL, the NHS Economic Evaluations Database (NHS-EED)) were searched from 1990 to May 2013. Studies published before 1990 were not considered, as it was not until 1995 that disease management appeared frequently in the medical literature. 13 We used MeSH headings and keywords to identify modeled analyses of CVD-MPs reporting incremental cost-effectiveness ratio (ICER) or cost-utility ratio (ICUR). The complete search strategies for Medline Ovid, CINAHL and the NHS-EED are provided in online in Supplementary Material Appendices 1–3.
The Taxonomy for Disease Management, 14 a system of classification developed by the American Heart Association (AHA) was used as the operational definition of a CVD-MP, which includes eight domains: patient population, recipient, intervention content, delivery personnel, method of communication, intensity and complexity, environment and outcome measures. Two reviewers independently screened the titles and abstracts of the identified citations according to exclusion and inclusion criteria (Table 1). Disagreements between reviewers were adjudicated by a third author. After the articles were excluded based on titles/abstracts, the full-texts of the remainder were reviewed using a screening algorithm (Table 2), namely, if an article met any of the conditions in Group A in the order listed, it was excluded. The remaining articles were further screened for the conditions in Groups B and C. The algorithm was used to ensure only one reason for exclusion was assigned per article.
Inclusion and exclusion criteria.
CVD: cardiovascular disease; ICER: incremental cost-effectiveness ratio; ICUR: incremental cost-utility ratio.
Screening algorithm.
CVD: cardiovascular disease; ICER: incremental cost-effectiveness ratio; ICUR: incremental cost-utility ratio.
Data extraction
A data collection table was developed a priori, pilot tested on three randomly-selected included articles and refined accordingly. Two reviewers extracted data on study characteristics, intervention characteristics and information relevant to economic evaluation.
Measures of cost-effectiveness (e.g. ICER, ICUR) were converted to 2013 US dollar values using a web-based tool 15 that enables the conversion of costs across currencies (using purchasing power parities conversion rates) and years (using GDP deflator index values). 16 Costs reported in international dollars were converted to the country’s purchasing power parity (PPP) exchange rate using the Penn World Table 17 and then converted to 2013 US dollars. US dollars were used as a standard currency in preference to euros. The PPP of a euro varies widely across European countries making conversion to euros using PPP highly variable. US dollars avoids this problem.
Study quality assessment
Two assessment tools were used, namely, the Grading System for the Quality of Cost-Effectiveness Studies (Chiou’s system) 18 and the Consolidated Health Economic Evaluation Reporting Standards (CHEERS checklist) 19 by the International Society for Pharmacoeconomics and Outcomes Research (ISPOR). The CHEERS checklist consolidated previous health economic evaluation guidelines into one reporting guideline. Chiou’s system is also used because a scoring tool does not assume that each criterion shares an equal level of importance as in a checklist, and this tool was previously used to assess economic evaluations of telehealth services 20 and drug-eluting stents for percutaneous coronary intervention. 21
Two reviewers independently assessed study quality using the two tools. Any discrepancies between reviewers were resolved by discussion with a third author. The CHEERS checklist consists of 24 items scored dichotomously as having met the criteria (in full) or not. Chiou’s system includes 16 weighted criteria with score values ranging from 0 (lowest quality) to 100 (highest quality). If a subgroup analysis was not undertaken (Chiou’s item 4), that item was not applicable and the weights were rescaled excluding that factor. The items deemed to have partially met the criteria were scored as ‘0’ (Chiou’s system) and ‘No’ (CHEERS checklist) to avoid introducing subjectivity associated with assigning part scores.
Results
Of 379 articles identified, nine articles (reporting 10 analyses and a total of 16 ICERs/ICURs including those of subgroup analyses) were included22-28 (Figure 1). Study characteristics of CVD-MPs are summarized in Supplementary Material Table 1. The targeted cardiovascular conditions were hypertension (n=4), coronary heart disease (n=2), coronary heart disease plus stoke (n=1), heart failure (n=2), and hyperlipidemia (n=1), with eight cost-utility and two cost-effectiveness analyses22,28 reported. The clinical trials that provided the key data inputs for the modeled analyses were carried out in Austria 29 (n=1), the USA22,27,30 (n=3), England 26 (n=1 article or 2 analyses), Ireland and Northern Ireland23,24 (n=2), Argentina 28 (n=1) and Pakistan 25 (n=1). (Supplementary Material Table 1.)

Flow chart of study selection process.
Although ‘usual care’ was used as the comparator in all analyses, it was not consistently defined. Of note, the usual care described in three articles included some level of active involvement such as the provision of two 30-minute surveys, 21 an action plan during a diabetes review with a diabetologist, 25 or a detailed disease management plan sent to the appropriate primary care physician, who was asked to implement it. 28 Hence, it is plausible that some elements of the CVD-MP in one study could match the level of the usual care in another. Supplementary Material Table 2 shows the key items assessed in the economic evaluation.
Choice of model
Markov models (n=8) and ‘decision analytic models’ (n=1) 22 were used. One article 25 did not describe how the observed clinical data were converted into CVD disability-adjusted life-years (DALYs), or what parameters were used in the DALY and therefore in the probabilistic sensitivity analysis. Only three articles23,28,29 justified the choice of model.
Economic perspective
Six analyses (five articles)22-24,26,27 stated that their analysis was performed from the healthcare system perspective including one 24 that implied it took this perspective, one article reported both societal and fund holders perspectives 25 and three articles used a third party payer perspective.28-30
Discount rates
Eight articles discounted both benefits and costs, and one article discounted costs only. 22 Four articles used 3%–3.5%, four articles used 5% in their base case and one analysis used different rates for each, that is, 3% for cost, 5% for benefit 30 (Supplementary Material Table 2). Although all articles reported discount rates, only two articles25,26 justified the choice of particular rates, that is, ‘reflecting common conventions’ 26 and ‘in accordance with the ISPOR guidelines’,25,31,32 respectively. Discount rates were varied in sensitivity analyses in all but one article. 22 In all but four CVD-MPs,25,26,29,30 results were shown to be sensitive to the choice of discount rate.
Time horizon
All analyses were modeled based on data from interventions of one to two years’ duration. The time horizon ranged from two years (n=1) 25 to 10 years (n=1) 30 and lifetime (n=8).
Six23-27,29 of the nine articles explicitly stated the assumed duration of intervention effect beyond the observed data.
Reporting of costs
The reported net difference in costs for CVD-MPs ranged from cost saving of $–9055 to $6015 in 2013 US$ (original: US$–8788 to US$4850) (Supplementary Material Table 2). The included costs appear to reflect the perspective taken except in one article, where perspective was not explicitly stated. 24 The description of ‘intervention cost’ was least comparable. One article 22 reported the cost of developing the educational modules as a one-time research ‘sunk’ cost that would not be incurred again if implemented for future patient care, and hence it was not included in their costing. It is unclear whether the same practice was followed elsewhere, for example, whether it was part of ‘intervention setup’ or whether similar costs were simply not incurred in the other studies. Demarcation of fixed or variable costs was also inconsistent. One article 27 assessed the impact of the allocation of intervention costs between fixed and variable components; the effect of this was to increase the ICER from $43,650 (base-case) to $129,738 per quality-adjusted life-year (QALY) gained when all intervention costs were assumed to be variable.
Reporting of effectiveness
The analyses of heart failure management programs27,29 referred to the mortality observed in a trial. The other seven articles mapped an intermediate outcome (CVD risk factor observed in a trial) to a definite health outcome such as to reflect mortality in life tables or the mortality rates from the Framingham Heart Study.22,33 Methods used for this mapping included use of the Framingham risk equation,23,24,26,28 and the United Kingdom Prospective Diabetes Study (UKPDS) Risk Engine. 30 Health outcomes were valued using SF-6D utility weights from the SF-36,23,24,27 preference weights converted from Minnesota Living with Heart Failure Questionnaire, 29 previously published health state values,26,30 assumptions due to ‘lack of evidence’, 30 and for the DALY conversion 25 no details were provided. Two articles did not use (dis)utility as they reported health outcomes in life-years (LYs) only.22,28 Reported net differences in QALYs ranged from 0.0051 to 0.84; LY ranged from 0.03 to 0.18. (Supplementary Material Table 2.)
Cost-effectiveness of CVD-MPs
All authors of the reviewed articles cautiously concluded their CVD-MPs to be a potentially cost-effective alternative to usual care. Stated acceptability constraints ranged from US$50,000/QALY,26,30 Canadian$50,000/QALY, 29 US$100,000/QALY, 27 €45,000/QALY, 23,24 US$50,000/LY, 22 three times GDP/LY 28 to three times GDP per capita per CVD DALY 25 (US$43,089 to US$122,694 in US$ 2013 values).
The ICERs/ICURs are shown both in 2013 US$ and original figures in parentheses as reported in articles (Supplementary Material Table 2). Of all ICERs/ICURs reported including those reported of subgroups (n=16), six ICERs/ICURs22,25,26,28,29 were below and four22,27 were above US$50,000/QALY or US$50,000/LY, which is most frequently cited as an acceptable threshold, and six ICURs were shown to be dominant (cost-saving) in the base-case23,29,30 as well as in subgroups 24 (compared in 2013 US$).
Study quality
All articles were of adequate quality: Chiou’s system (minimum 63, maximum 93; median 82); the CHEERS checklist (minimum 44%, maximum 87%; median 73%) although the CHEERS is not a formal scoring instrument.
Items 8, 9 and 13 of Chiou’s system were not satisfied most often across the studies. The requirement to justify the choice of discount rates (item 8) was met by only one article 26 out of nine (11%), and the choice of economic model (item 13) by three articles23, 28 , 29 (33%). Six articles22-24,28-30 (66%) reported resource quantities and unit costs separately (item 9). Chiou’s item 4 on subgroup analysis (pre-specification) was applicable in only two articles.22,24
The criteria met the least in the CHEERS checklist were items 7, 9, 15 and 17. The requirements to describe and to justify the comparator (item 7) were met by four articles23,24,28,30 out of nine (44%), the choice of a particular discount rate (item 9) by three25,26,28 articles (33%), and the choice of model (item 15) by three23,28,29 articles (33%). Analytic methods including approaches to validate the model and sensitivity analysis methods (item 17) were clearly described by five articles23,24,27-29 (56%). Valuation of preference-based outcomes (item 12) was not applicable in two articles that reported cost per LY.22,28
The results per study are provided in the Supplementary Material Table 3.
Discussion
In this review of published modeled economic analyses for CVD-MPs, of all ICERs/ICURs reported including those of subgroups (n=16), six ICURs23,24,29,30 were shown to be ‘dominant’ (more effective and less costly), six ICERs22,25,26,28,29 were below, and four22,27 were above a US$50,000 willingness to pay threshold (in 2013 US$). 28
The patient groups represented in the selected studies were community-based outpatients with one or two conditions to manage,22-28,30 except one article 29 with those recently discharged from hospital and at high risk for re-hospitalization and death. There were two heart failure programs applied to relatively low- 27 and high-risk 29 patient groups, respectively; however, the type and scope of the intervention also greatly differed in each case. This makes it difficult to infer the extent to which the ICURs may have been attributable to patient or intervention characteristics.
Whether CVD-MPs are cost-effective when all the costs for program development and implementation were considered 9 remains uncertain in our review. For future research, systematic reporting and standardization of intervention costs may be facilitated through the use of a tool to aid comprehensive cost estimates such as the Tools for Economic Analysis of Patient Management Interventions in Heart Failure. 34 Such effort will be complemented by an increased use of study quality assessment tools (e.g. the CHEERS) to further standardize reporting of economic evaluation methods, and thus to facilitate cost-effectiveness assessment of CVD-MPs.
While numerous factors affect cost-effectiveness, reporting practice is one area that can be standardized to improve the transparency of economic analyses regardless of other critical variables. Because a model could be framed to favor one intervention over another, or assumptions can be introduced without adequate justification, 35 use of a common reporting format and the justification for the choice made by a modeler, as emphasized in the study quality assessment tools, are crucial. If results were reported in a comparable and transparent manner, it would facilitate discerning the differences in cost-effectiveness ratios due to study methodology from those due to the characteristics of the intervention evaluated. 36
To clarify differences in the methods used across studies, we assessed how well they adhered to established methodological and reporting principles by using Chiou’s system and the CHEERS checklist. Although the quality of an analysis would ultimately hinge on whether clinical and modeling assumptions were reasonable, not simply whether authors adhered to procedural guidelines for reporting, 37 adherence to the guidelines is nevertheless the first step to increasing transparency. Our review revealed considerable variability in reporting itself, which hinders the assessment of methodological variation across studies and, ultimately, of value for money of CVD-MPs.
The variables to which the results reviewed appeared sensitive were intervention costs, 27 , 22 transition probabilities,27,29 utility weights for health states,27,30 the discount rate of health outcomes (utilities) 30 and time horizon. 30 Seven reviewed articles,22-24,26-29 used a long time horizon (i.e. lifetime). This is particularly relevant to CVD-MP studies as their benefits due to reduced resource utilization and/or health gain after the incremental intervention cost is taken into account may not become evident in a short timeframe. Some suggest that it takes at least three to five years to identify ‘true’ program effectiveness because of time lags in reaching full implementation, 38 while other evidence indicates that evaluations of a shorter duration (<1 year) can overestimate intervention effects of >1 year.39,40 This may be due to the difficulty in sustaining the intervention effects over time as risk factors can be ‘heavily influenced by an individual’s health behavior’. 41 As a lifetime horizon is preferable for chronic conditions and modeling is often needed for data extrapolation, model assumptions regarding unobserved long-term intervention effects as well as the cost of sustaining them should be made explicit as they could significantly impact its cost-effectiveness. In two heart failure management programs,27,29 the base case conservatively assumed mortality rates to be the same across groups post-trial. In a hypertension or lipid control program, 26 continuing provision of the intervention was assumed to be required to achieve its continued benefit. In the studies for coronary heart disease (CHD),23,24 the effect was assumed to persist for four years post-trial, and thereafter was assumed to be the same across groups. Whether each assumption made was reasonable can be further judged as long as such choice and rationale are clearly stated.
Apart from those assessed in the sensitivity analyses, clinical practice patterns or the availability of alternative treatments or healthcare resources 36 are also known to affect cost-effectiveness. For example, an intervention can be highly clinically and cost effective in one context but highly ineffective when transferred to another context in which accessibility and quality of current clinical practice are much higher. 42 This is of particular importance for a high-context intervention such as disease management, whose effectiveness depends on background clinical practice patterns (usual care) and how healthcare is delivered and financed in each locale. ‘Usual care’ could mask variation across jurisdictions and over time in the availability of new technologies or the level of substitution effects. Moreover, the content of ‘usual’ or ‘routine’ care is often not sufficiently described. 43 The same rigor should apply to the reporting of what constitutes usual care as well as CVD-MP, for ‘usual case’ could also be a multi-component ‘intervention’. Referencing to an instrument such as an instrument to measure the intensity and complexity of heart failure disease management program 44 would significantly improve comparability across reports.
We excluded articles if clinical effectiveness estimates were derived from meta-analysis or hypothetical CVD-MPs. That is, we only included modeled analyses whose source of effectiveness data was a single study for three reasons: i) using the AHA taxonomy as a guide for defining CVD-MP we were unable to fit hypothetical or meta-analyzed CVD-MPs into the taxonomy structure; ii) cost-effectiveness estimated from the summarized effect of CVD-MPs is difficult to interpret as each program widely differs in its intensity or intervention components; iii) our interest was in the assessment of CVD-MPs actually implemented. Some hypothetical programs appeared to assess the expected impacts of alternative interventions prior to actual development and implementation, and thus, rely more on synthesized assumptions and projections than those included in our review. Such studies were not considered as providing an empirical measure for technical efficiency and hence were excluded.
Our review has limitations. First, there is substantial heterogeneity across studies from three main sources: the range of CVD conditions studied, the components in the CVD-MP intervention and the approach to modeling (discussed above). Different target conditions were included because that enabled us to assess how modeling was used for both intermediate and definite outcomes; for example, in two secondary prevention programs of CVD23,24 and a prevention program of CVD in patients with diabetes, 30 the clinical outcomes observed in the clinical trials were CVD risk factors that were then transformed into LY outcomes (LY, QALY, DALY). Only two27,29 out of nine articles used mortality outcome actually observed in a trial. As for the intervention components, their scope or intensity was not described consistently or sufficiently. The only observable commonality was that all CVD-MPs incorporated patient education. Second, restricting to model-based analyses (by excluding trial-based analyses) inevitably reduces the number of eligible articles; hence no statistical analysis was involved and as a result our analyses are descriptive in nature. Although this was a trade-off between the increased comparability within modeled analyses and the diversity allowing different target conditions, such comparability enabled us to assess methodological and reporting variations independent of the variation of trial-based versus model-based approaches.
Finally, although publication bias may be present, its extent is hard to gauge, given the lack of study registration requirements for model-based analyses as would be required for clinical trials (no audit trail). Although a funnel plot is widely used as a test for publication bias, it has been suggested that asymmetry of the funnel plot does not accurately predict publication bias. 45 True heterogeneity among studies itself can cause asymmetry, 46 which is highly probable in CVD-MPs where patient and intervention characteristics substantially vary across studies.
Conclusion
Although CVD-MPs appear to be cost-effective based on published model-based analyses, it is not possible to estimate the extent of the influence by the reporting variation across studies, which itself may have masked the variation due to methodological approaches and modeling assumptions. Transparency should be increased through standardization tools to enable a more robust determination of what truly drives the long-term cost-effectiveness of CVD-MPs.
Footnotes
Acknowledgements
Ms Jodie Vickery is acknowledged for assisting study selection. Mr Shamesh Naidoo is acknowledged for his initial work on this topic. JAW was supported by a research fellowship from the Queensland Government Department of Employment, Economic Development and Innovation, Queensland Health and Griffith University.
Conflict of interest
None declared.
Funding
This work was supported by a National Health and Medical Research Council of Australia program grant (grant 519823).
Heterogeneity around the intervention and/or patient characteristics will remain obscured where substantial variations in reporting and methodological approaches affect cost-effectiveness. The use of practical standardization tools will increase transparency and third-party reproducibility. Any improved comparability across studies will subsequently inform what type of intervention works for which patient population, enabling targeted approaches in clinical practice and resource allocation.
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
