HHS Public Access Author manuscript Author Manuscript
JAMA Intern Med. Author manuscript; available in PMC 2017 August 01. Published in final edited form as: JAMA Intern Med. 2016 August 1; 176(8): 1167–1175. doi:10.1001/jamainternmed.2016.2827.
Association Between Medicare Accountable Care Organization Implementation and Spending Among Clinically Vulnerable Beneficiaries
Author Manuscript
Carrie H. Colla, PhD, Valerie A. Lewis, PhD, Lee-Sien Kao, BA, A. James O’Malley, PhD, Chiang-Hua Chang, PhD, MS, and Elliott S. Fisher, MD, MPH The Dartmouth Institute for Health Policy & Clinical Practice, Geisel School of Medicine at Dartmouth, Lebanon, New Hampshire (Colla, Lewis, Kao, Chang, Fisher); Norris Cotton Cancer Center, Manchester, New Hampshire (Colla); The Dartmouth Institute for Health Policy & Clinical Practice, Department of Biomedical Data Science, Geisel School of Medicine at Dartmouth, Lebanon, New Hampshire (O’Malley)
Abstract IMPORTANCE—Accountable care contracts hold physician groups financially responsible for the quality and cost of health care delivered to patients. Focusing on clinically vulnerable patients, those with serious conditions who are responsible for the greatest proportion of spending, may result in the largest effects on both patient outcomes and financial rewards for participating physician groups.
Author Manuscript
OBJECTIVE—To estimate the effect of Medicare accountable care organization (ACO) contracts on spending and high-cost institutional use for all Medicare beneficiaries and for clinically vulnerable beneficiaries. DESIGN, SETTING, AND PARTICIPANTS—For this cohort study, 2 study populations were defined: the overall Medicare population and the clinically vulnerable subgroup of Medicare beneficiaries. The overall Medicare population was based on a random 40% sample drawn from
Corresponding Author: Carrie H. Colla, PhD, The Dartmouth Institute for Health Policy & Clinical Practice, Geisel School of Medicine at Dartmouth, Level 5, WTRB, One Medical Center Dr, Lebanon, NH 03756, ([email protected]). Supplemental content at jamainternalmedicine.com
Author Manuscript
Author Contributions: Dr Colla had full access to all of the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis. Study concept and design: Colla, Lewis, Chang, Fisher. Acquisition, analysis, or interpretation of data: Colla, Lewis, Kao, O’Malley, Chang. Drafting of the manuscript: Colla, Kao, Fisher. Critical revision of the manuscript for important intellectual content: Colla, Lewis, O’Malley, Chang. Statistical analysis: Colla, Lewis, Kao, O’Malley, Chang. Obtained funding: Colla, Lewis. Administrative, technical, or material support: Colla. Study supervision: Colla, O’Malley, Chang, Fisher. Conflict of Interest Disclosures: None reported. Disclaimer: The content of the article is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health. Additional Contributions: The authors are grateful to Stephanie R. Raymond, BA, Senior Programmer/Analyst at The Dartmouth Institute, for superb programming assistance and Ellen R. Meara, PhD, a professor at The Dartmouth Institute, for her insight and expertise. Neither Ms Raymond nor Dr Meara received additional compensation for their contributions.
Colla et al.
Page 2
Author Manuscript
continuously enrolled fee-for-service beneficiaries with at least 1 evaluation and management visit in a calendar year. The clinically vulnerable study population included all Medicare beneficiaries 66 years or older who had at least 3 Hierarchical Condition Categories (HCCs). Beneficiaries entered the cohort during the quarter between January 2009 to December 2011 when they first had at least 3 HCCs and remained in the cohort until death. Cohort entry was restricted to the preperiod to account for potential changes in coding practices after ACO implementation. Difference-in-difference estimations were used to compare changes in health care outcomes for Medicare beneficiaries attributed to physicians in ACOs with those attributed to non-ACO physicians from January 2009 to December 2013. EXPOSURES—Medicare ACOs beginning contracts in January 2012, April 2012, July 2012, and January 2013 through the Pioneer and Medicare Shared Savings Programs.
Author Manuscript
MAIN OUTCOMES AND MEASURES—Total spending per beneficiary-quarter, spending categories, use of hospitals and emergency departments, ambulatory care sensitive admissions, and 30-day readmissions. RESULTS—Total spending decreased by $34 (95% CI, −$52 to −$15) per beneficiary-quarter after ACO contract implementation across the overall Medicare population (n = 15 592 600) and decreased $114 in clinically vulnerable patients (n = 8 673 823) (95% CI, −$178 to −$50). In the overall Medicare cohort, hospitalizations and emergency department visits decreased by 1.3 and 3.0 events per 1000 beneficiaries per quarter, respectively (95% CIs: −2.1 to −0.4 and −4.8 to −1.3), and hospitalizations and emergency department visits decreased in the clinically vulnerable cohort by 2.9 and 4.1 events per 1000 beneficiaries per quarter, respectively (95% CIs: −5.2 to −0.7 and −7.1 to −1.2). Changes in total spending associated with ACOs did not vary by clinical condition of beneficiaries.
Author Manuscript
CONCLUSIONS AND RELEVANCE—Medicare ACO programs are associated with modest reductions in spending and use of hospitals and emergency departments. Savings were realized through reductions in use of institutional settings in clinically vulnerable patients. Accountable care organizations (ACOs) are one of the largest payment and delivery reforms currently under way in the United States. Over 700 ACO contracts are now in place, covering 23 million Americans.1 Accountable care organizations are groups of health care providers collectively held responsible for the cost and quality of care for a defined patient population. Early evidence suggests that ACOs are improving quality and modestly affecting health care costs.2–5 These gains have led to further policy changes intended to accelerate adoption of these and other alternative payment models such as the Next Generation ACO model, Accountable Health Communities model, Comprehensive ESRD Care model, and Oncology Care model.6–9
Author Manuscript
Little is known, however, about how the ACO payment contracts implemented by Medicare may have influenced health care delivery. Accountable care organizations are hypothesized to improve care and lower costs in several ways, including better care coordination and more effective treatment of chronic illness; indeed, early evidence on quality of care improvements suggests that ACOs may be adopting this approach.10,11 Better care, in turn, should reduce the use of high-cost institutional settings through prevention, coordination, and outpatient management. A related mechanism could be that ACOs focus more directly
JAMA Intern Med. Author manuscript; available in PMC 2017 August 01.
Colla et al.
Page 3
Author Manuscript
on the care of patients with complex medical needs. Patients who are older and have multiple chronic conditions have historically received inefficient, inappropriate, and fragmented care.12–18 Studies of early ACO pilot programs found cost savings primarily among high-cost beneficiaries.2,19 However, the effect of Medicare’s current ACO programs on spending and high-cost institutional use for beneficiaries—and especially for clinically vulnerable beneficiaries—remains unknown. In this study, we focus on the question of whether the implementation of Medicare ACOs has had an effect on spending and usage for both overall and for clinically vulnerable Medicare beneficiaries, focusing in particular on the use of high-cost institutional settings including hospital stays, emergency department visits, and postacute care.
Methods Author Manuscript Author Manuscript
We used 5 years (January 2009–December 2013) of Medicare fee-for-service administrative claims data encompassing all Part A and B charges to compare changes in spending and usage for beneficiaries cared for by physicians in ACOs and those cared for by non-ACO physicians. Beneficiaries were annually assigned to an ACO or non-ACO physician group if the sum of charges for a subset of evaluation and management visits to the primary care physicians within the group exceeded the sum of charges for such visits to any other physician group. Following the Centers for Medicare and Medicaid Services (CMS) Medicare Shared Savings Program (MSSP) methodology to attribute patients, we used a set of outpatient codes defining evaluation and management visits to physicians, nurse practitioners, or physician assistants.20 We used a difference-in-difference design to account for time-invariant differences between ACOs and non-ACOs, and differences between the preintervention and postintervention periods. Detailed methodological notes are available in eAppendix in the Supplement. The Dartmouth institutional review board approved this study. Study Populations
Author Manuscript
We defined 2 study populations, one representing the overall Medicare population and a second representing a clinically vulnerable subgroup of Medicare beneficiaries. The overall Medicare population is based on a random 40% sample we drew of continuously enrolled fee-for-service beneficiaries with at least 1 evaluation and management visit in a calendar year. The clinically vulnerable study population includes all Medicare beneficiaries age 66 or older who had at least 3 Hierarchical Condition Categories (HCCs).21 Patients in this cohort are required to have either 1 inpatient diagnosis or 2 outpatient diagnoses in the prior year to be assigned a condition category. Beneficiaries enter the cohort during the quarter from January 2009 to December 2011 when they first have at least 3 HCCs and remain in the cohort until death. We restricted participant entry to the period before ACO contract implementation to account for potential changes in coding practices after ACO implementation.
JAMA Intern Med. Author manuscript; available in PMC 2017 August 01.
Colla et al.
Page 4
Identifying ACOs
Author Manuscript
The health care provider groups in our study joined Medicare ACO programs in January 2012 (32 ACOs); April 2012 (27 ACOs); July 2012 (87 ACOs); and January 2013 (106 ACOs). To compare physician group performance over time and to preserve the relationship between physicians and ACOs, we assigned physicians to a preperiod organization (corresponding to an ACO) if the physicians were associated with that organization in the ACO period. Outcome Variables
Author Manuscript
Our main outcome measures were total spending per quarter and a number of spending categories: acute care, durable medical equipment, facility, tests, long-term care, hospice, imaging, home health, procedures, evaluation and management visits, and skilled nursing facility. We also studied quarterly counts of hospitalizations, emergency department visits, and observation stays.22 Other outcome measures included ambulatory care sensitive admissions23 and 30-day all-cause read-missions in the quarter. Quarterly measurements of outcomes allowed precise representation of an organization’s ACO status, increasing the precision of our analyses compared with yearly measurements. In 2013, Medicare excluded from research files any claims associated with substance abuse. To measure changes in outcomes over time, we applied Medicare’s approach to remove such claims from files for prior years (January 2009–December 2012). Control Variables
Author Manuscript
We grouped beneficiaries by 5-year age categories to allow for nonlinear effects of age. We created indicators for disability as original reason for entitlement; sex; nursing home residence; dual enrollment in Medicare and Medicaid; black, Hispanic, and other race or ethnicity groups24; hospital referral region (HRR) of residence; and 10 of the most prevalent chronic conditions, including end-stage renal disease, coronary artery disease, chronic obstructive pulmonary disease, cancer, diabetes, congestive heart failure, renal failure, polyneuropathy, cardio-respiratory failure and shock, and vascular disease. As all HCCs indicate increased risk status, we considered any beneficiary diagnosed with a condition to have that condition for the remainder of the study period. We measured the proportion in poverty in the patients’ zip code using the 2010 Census. Statistical Analysis
Author Manuscript
To estimate changes in spending and high-cost institutional use associated with ACO contracts, we compared changes in outcome variables over the ACO implementation period for the beneficiary-quarter observations attributed to ACO and non-ACO (control group) care. Our main specification was a difference-in-difference beneficiary-quarter level linear model with time and HRR indicators, with the control group made up of beneficiaries attributed to non-ACO physicians. This design controlled for fixed differences between ACO and non-ACO care, as well as biases from comparisons over time that could reflect broader trends in health care or Medicare beneficiary population health. Because individuals contribute multiple observations across the study period (up to 20 across the 5-year period), we use robust standard errors accounting for the fact that errors were likely clustered by
JAMA Intern Med. Author manuscript; available in PMC 2017 August 01.
Colla et al.
Page 5
Author Manuscript
beneficiary and by HRR, an indicator for the local health care market. Using the subscripts i, j, t, and k for individual, practice group, quarter, and HRR, respectively, the statistical models had the following linear form:
Author Manuscript
The coefficient of primary interest, represented by β1, measures the effect of a patient receiving care from an ACO after the ACO contract begins (indicated by ACOPost). We estimated a single ACO effect for all outcomes, and additionally we estimated total spending effects separately for each ACO wave by program start date and individual ACO. In the latter 2 cases, ACOPost is the interaction of a postperiod indicator with a vector of indicators for each wave of ACOs or for individual ACOs, respectively. The variable ACO can be nonzero at any time to indicate physician groups who later became ACOs, whereas ACOPost can only be nonzero after ACOs have begun Medicare contracts. Because we suspected anticipatory effects of ACO implementation, we defined EarlyPost to indicate the 2 quarters prior to ACO implementation, when the ACO had applied for and then been accepted for participation. The EarlyPost coefficient, β2, quantifies the effect of anticipation compared with earlier preperiod quarters and removes this period of time from the evaluation of the ACOPost coefficient β1. The SocioDem vector captures Medicaid status, disability, nursing home residency, age group, sex, race/ethnicity, and percent poverty in census tract. The Clinical vector includes chronic condition indicators and for the full cohort the beneficiary’s total number of HCCs. The variables γt and ωk denote time adjustment (quarterly indicators, year indicators, and season indicators) and the HRR that the group practices in, respectively. The error term captures idiosyncratic variation in Y. All covariates with continuous or ordinal scales were centered.
Author Manuscript
We chose a linear model because (1) there were few occurrences of zeros owing to the requirement of at least 1 evaluation and management visit and the focus on clinically vulnerable patients who have intense health care usage; (2) distributions were largely symmetrical; (3) if linear models do not fit the data well, our standard errors are biased against finding a significant effect and are therefore conservative; and (4) for ease of interpretation it was desirable for the estimated coefficients to represent a dollar amount or rate. We designed our approach for the clinically vulnerable cohort and used the same models for the full cohort to maintain easy comparability.
Author Manuscript
To determine whether changes in spending and high-cost institutional use in ACOs with earlier start dates were due to a longer follow-up period, we performed a sensitivity analysis limited to the first 6 months and 1 year of post-ACO implementation for each wave. We also performed a sensitivity analysis estimating the association of ACO contracts with changes in spending for 9 clinical cohorts. Additional sensitivity analyses are described further in eAppendix in the Supplement.
JAMA Intern Med. Author manuscript; available in PMC 2017 August 01.
Colla et al.
Page 6
Author Manuscript
Results Descriptive Characteristics
Author Manuscript
On average, spending on the clinically vulnerable cohort was 114% more than on Medicare beneficiaries overall ($22 235 annually in the clinically vulnerable attributed to ACOs vs $10 378 overall), and spending in the clinically vulnerable cohort made up 82% of overall spending in the first quarter of 2009. The clinically vulnerable cohort includes 22% of attributed Medicare beneficiaries. The top 10 conditions identified in the clinically vulnerable cohort were congestive heart failure (37%), specified heart arrhythmias (37%), chronic obstructive pulmonary disease (31%), renal failure (29%), vascular disease (26%), diabetes without complication (24%), cardiorespiratory failure and shock (17%), cancer (12%), polyneuropathy (10%), and stroke (10%). The largest component of total spending for the clinically vulnerable was acute care (36%), followed by skilled nursing facility (11%), evaluation and management visits (10%), and procedures (10%). Spending in the preperiod was slightly greater in beneficiaries attributed to ACOs than for the control group. Demographic and clinical characteristics of beneficiary-quarters attributed to ACO and nonACO care were similar in the preperiod overall and in the clinically vulnerable cohort. Because patients remain in the study cohort after first observation of 3 conditions, we see that the cohort has aged in the postperiod, with associated effects such as decreases in chronic conditions and spending due to mortality in the sickest patients (Table 1). Regression Results
Author Manuscript Author Manuscript
Despite differences in the level of spending between ACOs and control populations, spending over time shows similar trends during the pre-ACO period (Figure 1). We find small significant decreases in spending associated with the Pioneer program and MSSP ACOs. Across all ACOs, average total spending decreased by $34 or 1.3% per beneficiaryquarter (95% CI, −$52 to −$15) (Table 2) and by $114 or 2.0% per beneficiary-quarter (95% CI, −$178 to −$50) in the clinically vulnerable cohort. We found a statistically significant anticipatory decrease in spending in the 6 months leading up to implementation: $17 in the full cohort (95% CI, −$30 to −$3) and −$68 in the clinically vulnerable (95% CI, −$111 to − $26). In the clinically vulnerable cohort, total spending per beneficiary-quarter decreased by $132 or 2.2% (95% CI, −$225 to −$40) for the Pioneer program; $148 (95% CI, −$289 to − $7) for April 2012 MSSPs; $119 (95% CI, −$198 to −$39) for July 2012 MSSPs; and $41 (95% CI, −$105 to $22) for January 2013 MSSPs. A Wald test on the coefficients showed that the total savings achieved by each ACO wave were not statistically different from each other. Estimated changes in spending ranged from savings of $89 (25th percentile) to increased spending of $79 (75th percentile) in the full cohort and savings of $211 (25th percentile) to increased spending of $222 (75th percentile)in the clinically vulnerable (Figure 2). When effects were estimated separately for each of the top condition categories, there were statistically significant decreases in total spending per beneficiary-quarter for all conditions, and decreases across conditions did not differ significantly in magnitude (Figure 3). Adjusting for ACOs that dropped out of the Pioneer program before the end of our study period did not significantly change results.
JAMA Intern Med. Author manuscript; available in PMC 2017 August 01.
Colla et al.
Page 7
Author Manuscript
Reductions in total spending per beneficiary-quarter by ACOs in the postperiod can be explained in part by decreases in acute care spending and high-cost institutional use across all waves. Acute care spending decreased by $12 or 1.4% (95% CI, −$21 to −$4, Table 2) overall and $48 or 2.3% (95% CI, −$79 to −$17) for the clinically vulnerable cohort. Skilled nursing facility spending decreased by $10 or 5.0% (95% CI, −$16 to −$4) overall and $30 or 5.0% (95% CI, −$46 to −$13) for the clinically vulnerable cohort. In the full Medicare cohort, spending decreased slightly for long-term care and had negligible changes for evaluation and management visits. In the clinically vulnerable cohort, spending decreased slightly for both long-term care and evaluation and management visits. Changes in spending were negligible or statistically insignificant for durable medical equipment, facility, test, hospice, imaging, home health, and procedure spending for both the full Medicare and the clinically vulnerable cohorts.
Author Manuscript
In the full Medicare cohort, ACOs were associated with a reduction in emergency department visits of 3.0 events or 1.9% per 1000 beneficiary-quarters (95% CI, −4.8 to −1.3) and a decrease in hospitalizations of 1.3 events or 1.4% (95% CI, −2.1 to −0.4). In the clinically vulnerable cohort, ACOs were associated with a reduction in emergency department visits of 4.1 events per 1000 beneficiary-quarters (95% CI, −7.1 to −1.2) and a decrease in hospitalizations of 2.9 events (95% CI, −5.2 to −0.7) in the clinically vulnerable. Changes in high-cost institutional use in both our full cohort and our clinically vulnerable cohort were negligible or statistically insignificant for ambulatory care sensitive hospitalizations, observation stays, and 30-day readmissions.
Author Manuscript
To determine whether the larger reductions in spending and high-cost institutional use in ACOs with earlier start dates were due to a longer follow-up period, we limited analysis to the first year of post-ACO implementation. Decreases in total spending became smaller in magnitude. This, along with the finding that the January 2013 MSSPs had small and insignificant changes in spending, suggests that reductions in total spending take time to be realized. When further limited to the first 6 months of post-ACO implementation, decreases in total spending were similar in magnitude to the first-year effects, suggesting that changes in spending are relatively constant, increasing slightly over time. Results were robust to the inclusion or exclusion of the number of hierarchical clinical conditions and indicators for specific clinical condition categories.
Discussion
Author Manuscript
Medicare ACO programs are associated with modest savings on average across all beneficiaries, with savings concentrated in clinically vulnerable beneficiaries and use of institutional settings. Accountable care organizations are associated with a 1.3% reduction in hospital spending and a 5% reduction in skilled nursing spending, as well as significant reductions in emergency department use and hospitalizations. We found the magnitude of reductions were not significantly different by the start date of ACOs. We found that the magnitude of reductions was not significantly different by the start date of ACOs, though further exploration revealed slight increases in spending with longer AOC participation. We also find an anticipatory effect of participating in ACO programs that could lower the benchmark spending figures for ACOs, making it less likely for them to achieve savings
JAMA Intern Med. Author manuscript; available in PMC 2017 August 01.
Colla et al.
Page 8
Author Manuscript
according to CMS calculations. While modest in magnitude, these findings for ACOs are consistent with other evaluations of ACO savings2–5,19 and stand in contrast to the failure to demonstrate significant cost savings in care management programs layered on top of the traditional fee-for-service Medicare program.25,26
Author Manuscript
Similar to previous studies of payment reform,2 we observe marked differences across organizations in the effects of these payment programs, ranging from large reductions in spending to large increases in spending. However, some variation in results is to be expected, and while our models include hospital referral region fixed effects, we have not studied each of these local comparisons in depth and continue to know little about why some organizations succeed and others fail.27 Differences in results may be owing to ACO formation effects: the characteristics of beneficiaries attributed to ACOs and those attributed to non-ACOs may be different within markets.28 Factors contributing to success may include ACO participant characteristics such as size, homogeneity, readiness, or structural attributes (for example, whether or not the ACO includes a hospital); market conditions; choice of risk stratification tools; differences in governance models or leadership effectiveness; physician engagement strategies; electronic health records and other health information technology tools; and how providers approached disease management, care transitions, and quality improvement. Early studies of the formation of ACOs offer a sense of the diversity of participating organizations.10,29,30
Author Manuscript
Many ACOs have instituted risk stratification and care management programs targeted at clinically vulnerable patients,31,32 as well as programs to improve patient access to their primary care team in the hope of keeping patients out of the emergency department and the hospital when unnecessary.33,34 These programs appear to be working to a small degree through changes in spending and use associated with the ACO program; overall, we estimate that ACOs were able to save a total of $592 million and reduce high-cost institutional use by 15 000 000 events for hospitalizations and 21 000 000 events for emergency department visits for clinically vulnerable beneficiaries during 2012 and 2013. The effects we report here are similar in magnitude to results reported from the Physician Group Practice Demonstration and the Pioneer program across all patient groups.2,4,5
Author Manuscript
Our analyses have several limitations. First, previous research has shown that diagnoses are sensitive to regional variations that cannot be explained by differences in underlying health,35,36 which may be a limitation of the use of HCCs as a proxy for health status. Our estimates were not sensitive to the inclusion of HCCs as a risk adjustment tool. Second, we analyze only 1 to 2 years of postimplementation data. Third, we did not measure the effect of ACOs on Part D spending, wraparound Medicaid spending, or spillovers into the Medicare Advantage program. Fourth, our data on beneficiary costs and estimated savings do not include the start-up costs invested by the ACOs to get up and running. Additionally, our data cannot study those with substance abuse, patients often included in the clinically vulnerable, due to redaction of these claims. Finally, our use of claims data has limited information on quality of care. We do know, however, that on the quality measures reported to CMS, including for example patient satisfaction with management of care transitions, readmissions, and management of chronic conditions, Medicare ACOs have shown substantial improvement over time.37
JAMA Intern Med. Author manuscript; available in PMC 2017 August 01.
Colla et al.
Page 9
Author Manuscript
Conclusions
Author Manuscript
Our results suggest that the ACO model has modest early benefits in terms of reduced spending and high-cost institutional use for patients with multiple clinical conditions. According to our calculations, approximately 84% of ACOs who achieved statistically significant reductions in total spending in the full cohort received shared savings from CMS in the 2012 to 2013 performance year. Given the vast differences in changes in spending across ACOs, further research on the relationship between activities within ACOs, the institutional characteristics of ACOs, and the service markets in which they operate and changes in spending and high-cost institutional use are essential to better understand what factors contribute to improved care for clinically vulnerable populations. In addition, longerterm research is needed, as it is likely that while some relatively simple changes may have shown rapid results, more structural changes will take time to produce improvements in health care outcomes.
Supplementary Material Refer to Web version on PubMed Central for supplementary material.
Acknowledgments Funding/Support: This research was supported by grants from the Commonwealth Fund (grant No. 20150034), the National Institute on Aging (grant No. 5R33AG044251) and the Dartmouth Clinical and Translational Science Institute (through grant No. UL1TR001086 from the National Center for Advancing Translational Sciences). Role of the Funder/Sponsor: The funders/sponsors had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication.
Author Manuscript
References
Author Manuscript
1. Muhlestein, D.; Gardner, P.; Caughey, W.; deLisle, K. Projected Growth of Accountable Care Organizations. Leavitt Partners. http://leavittpartners.com/2015/12/projected-growth-ofaccountable-care-organizations-2/. Published online December 23, 2015. Accessed May 19, 2016 2. Colla CH, Wennberg DE, Meara E, et al. Spending differences associated with the Medicare Physician Group Practice Demonstration. JAMA. 2012; 308(10):1015–1023. [PubMed: 22968890] 3. McWilliams JM, Hatfield LA, Chernew ME, Landon BE, Schwartz AL. Early Performance of Accountable Care Organizations in Medicare. N Engl J Med. 2016; [published online April 13, 2016]. doi: 10.1056/NEJMsa1600142 4. Nyweide DJ, Lee W, Cuerdon TT, et al. Association of Pioneer Accountable Care Organizations vs traditional Medicare fee for service with spending, utilization, and patient experience. JAMA. 2015; 313(21):2152–2161. [PubMed: 25938875] 5. McWilliams JM, Chernew ME, Landon BE, Schwartz AL. Performance differences in year 1 of pioneer accountable care organizations. N Engl J Med. 2015; 372(20):1927–1936. [PubMed: 25875195] 6. Zusman EE, Carr SJ, Robinson J, et al. Moving toward implementation: the potential for accountable care organizations and private-public partnerships to advance active neighborhood design. Prev Med. 2014; 69(suppl 1):S98–S101. [PubMed: 25117525] 7. Genesis HealthCare. New hospitals and health care providers join successful, cutting-edge federal initiative that cuts costs and puts patients at the center of their care. http://www.prnewswire.com/ news-releases/new-hospitals-and-health-care-providers-join-successful-cutting-edge-federal-
JAMA Intern Med. Author manuscript; available in PMC 2017 August 01.
Colla et al.
Page 10
Author Manuscript Author Manuscript Author Manuscript Author Manuscript
initiative-that-cuts-costs-and-puts-patients-at-the-center-of-their-care-300215344.html. Accessed May 19, 2016 8. Centers for Medicare and Medicaid Services. Comprehensive ESRD Care Model. https:// innovation.cms.gov/initiatives/comprehensive-esrd-care/. Accessed May 19, 2016 9. Kline RM, Bazell C, Smith E, Schumacher H, Rajkumar R, Conway PH. Centers for medicare and medicaid services: using an episode-based payment model to improve oncology care. J Oncol Pract. 2015; 11(2):114–116. [PubMed: 25690596] 10. Lewis VA, Colla CH, Schoenherr KE, Shortell SM, Fisher ES. Innovation in the safety net: integrating community health centers through accountable care. J Gen Intern Med. 2014; 29(11): 1484–1490. [PubMed: 25008217] 11. Bailit, M.; Tobey, R.; Maxwell, J.; Bateman, C. The ACO Conundrum: Safety-Net Hospitals in the Era of Accountable Care. http://www.bailit-health.com/articles/2015-0504-bhp-jsi-rwjf-acoconundrum.pdf. Accessed May 19, 2016 12. Boult C, Reider L, Leff B, et al. The effect of guided care teams on the use of health services: results from a cluster-randomized controlled trial. Arch Intern Med. 2011; 171(5):460–466. [PubMed: 21403043] 13. Counsell SR, Callahan CM, Clark DO, et al. Geriatric care management for low-income seniors: a randomized controlled trial. JAMA. 2007; 298(22):2623–2633. [PubMed: 18073358] 14. Asch SM, Sloss EM, Hogan C, Brook RH, Kravitz RL. Measuring underuse of necessary care among elderly Medicare beneficiaries using inpatient and outpatient claims. JAMA. 2000; 284(18):2325–2333. [PubMed: 11066182] 15. Hempstead K, Delia D, Cantor JC, Nguyen T, Brenner J. The fragmentation of hospital use among a cohort of high utilizers: implications for emerging care coordination strategies for patients with multiple chronic conditions. Med Care. 2014; 52(3 suppl 3):S67–S74. [PubMed: 24561761] 16. Centers for Medicare and Medicaid Services. Chronic Conditions Among Medicare Beneficiaries Chartbook. Baltimore, MD: 2012. 2012 ed 17. Boyd CM, Darer J, Boult C, Fried LP, Boult L, Wu AW. Clinical practice guidelines and quality of care for older patients with multiple comorbid diseases: implications for pay for performance. JAMA. 2005; 294(6):716–724. [PubMed: 16091574] 18. United States. Congressional Budget Office High-cost Medicare beneficiaries. Washington, D.C.: Congressional Budget Office; 2005. 19. Song Z, Rose S, Safran DG, Landon BE, Day MP, Chernew ME. Changes in health care spending and quality 4 years into global payment. N Engl J Med. 2014; 371(18):1704–1714. [PubMed: 25354104] 20. Centers for Medicare and Medicaid Services. Medicare Shared Savings Program Shared Savings and Losses and Assignment Methodology Specifications. 2014. https://www.cms.gov/Medicare/ Medicare-Fee-for-Service-Payment/sharedsavingsprogram/Downloads/Shared-Savings-LossesAssignment-Spec-v2.pdf. Accessed May 19, 2016 21. Pope GC, Kautter J, Ellis RP, et al. Risk adjustment of Medicare capitation payments using the CMS-HCC model. Health Care Financ Rev. 2004; 25(4):119–141. [PubMed: 15493448] 22. Feng Z, Wright B, Mor V. Sharp rise in Medicare enrollees being held in hospitals for observation raises concerns about causes and consequences. Health Aff (Millwood). 2012; 31(6):1251–1259. [PubMed: 22665837] 23. Agency for Healthcare Research and Quality. National Quality Measures Clearinghouse. Ambulatory care sensitive conditions: age-standardized acute care hospitalization rate for conditions where appropriate ambulatory care prevents or reduces the need for admission to the hospital, per 100,000 population younger than age 75 years. 2013. https:// www.qualitymeasures.ahrq.gov/content.aspx?id=48964. Accessed May 19, 2016 24. Eicheldinger C, Bonito A. More accurate racial and ethnic codes for Medicare administrative data. Health Care Financ Rev. 2008; 29(3):27–42. [PubMed: 18567241] 25. Schore JL, Brown RS, Cheh VA. Case management for high-cost Medicare beneficiaries. Health Care Financ Rev. 1999; 20(4):87–101. [PubMed: 11482127]
JAMA Intern Med. Author manuscript; available in PMC 2017 August 01.
Colla et al.
Page 11
Author Manuscript Author Manuscript Author Manuscript
26. Peikes D, Chen A, Schore J, Brown R. Effects of care coordination on hospitalization, quality of care, and health care expenditures among Medicare beneficiaries: 15 randomized trials. JAMA. 2009; 301(6):603–618. [PubMed: 19211468] 27. McWilliams JM, Chernew ME, Zaslavsky AM, Hamed P, Landon BE. Delivery system integration and health care spending and quality for Medicare beneficiaries. JAMA Intern Med. 2013; 173(15):1447–1456. [PubMed: 23780467] 28. Lewis VA, Colla CH, Carluzzo KL, Kler SE, Fisher ES. Accountable Care Organizations in the United States: market and demographic factors associated with formation. Health Serv Res. 2013; 48(6 Pt 1):1840–1858. [PubMed: 24117222] 29. Colla CH, Lewis VA, Bergquist SL, Shortell SM. Accountability across the Continuum: the participation of postacute care providers in accountable care organizations. Health Serv Res. 2016; [published online January 22, 2016]. doi: 10.1111/1475-6773.12442 30. Colla CH, Lewis VA, Shortell SM, Fisher ES. First national survey of ACOs finds that physicians are playing strong leadership and ownership roles. Health Aff (Millwood). 2014; 33(6):964–971. [PubMed: 24889945] 31. Adams AJ, Clark DR, DeLander GE, et al. Report of the AACP task force on patient-centered medical homes and accountable care organizations. Am J Pharm Educ. 2013; 77(7):142. [PubMed: 24052645] 32. Hong CS, Siegel AL, Ferris TG. Caring for high-need, high-cost patients: what makes for a successful care management program? Issue Brief (Commonw Fund). 2014; 19:1–19. [PubMed: 25115035] 33. Klein, S. In focus: Building Accountable Care Organizations That Improve Quality And Lower Costs—A View From The Field. 2010. http://www.commonwealthfund.org/publications/ newsletters/quality-matters/2010/june-july-2010/in-focus. Accessed May 19, 2016 34. UnitedHealth Center for Health Reform & Modernization. Advancing Primary Care Delivery: Practical, Proven, and Scalable Approaches. 2014. http://www.unitedhealthgroup.com/~/ media/UHG/PDF/2014/UNH-Primary-Care-Report-Advancing-Primary-Care-Delivery.ashx. Accessed May 19, 2016 35. Welch HG, Sharp SM, Gottlieb DJ, Skinner JS, Wennberg JE. Geographic variation in diagnosis frequency and risk of death among Medicare beneficiaries. JAMA. 2011; 305(11):1113–1118. [PubMed: 21406648] 36. Song Y, Skinner J, Bynum J, Sutherland J, Wennberg JE, Fisher ES. Regional variations in diagnostic practices. N Engl J Med. 2010; 363(1):45–53. [PubMed: 20463332] 37. Centers for Medicare and Medicaid Services. Medicare ACOs Continue to Improve Quality of Care, Generate Shared Savings. 2015. https://www.cms.gov/Newsroom/MediaReleaseDatabase/ Press-releases/2015-Press-releases-items/2015-08-25.html. Accessed May 19, 2016
Author Manuscript JAMA Intern Med. Author manuscript; available in PMC 2017 August 01.
Colla et al.
Page 12
Author Manuscript
Key Points Question How have Medicare accountable care organizations (ACOs) affected spending and highcost institutional use for all Medicare beneficiaries and specifically clinically vulnerable beneficiaries? Findings Using a difference-in-difference estimation, total spending decreased by $34 per beneficiary-quarter after ACO contract implementation across the overall Medicare cohort and decreased by $114 in the clinically vulnerable cohort. Hospitalization and emergency department visits decreased significantly per beneficiary-quarter in both the overall Medicare cohort and clinically vulnerable cohort.
Author Manuscript
Meaning Medicare ACO programs are associated with modest reductions in spending and highcost institutional use both overall and for clinically vulnerable beneficiaries.
Author Manuscript Author Manuscript JAMA Intern Med. Author manuscript; available in PMC 2017 August 01.
Colla et al.
Page 13
Author Manuscript Figure 1. Mean Quarterly Spending per Beneficiary
Author Manuscript
The average annual spending for (A) all Medicare beneficiaries is $10 377 and (B) the clinically vulnerable cohort, $22 211. ACO indicates accountable care organization.
Author Manuscript Author Manuscript JAMA Intern Med. Author manuscript; available in PMC 2017 August 01.
Colla et al.
Page 14
Author Manuscript Author Manuscript
Figure 2. Range of ACO Effects
Estimates for each ACO are represented in the figure as data points. ACO indicates accountable care organization.
Author Manuscript Author Manuscript JAMA Intern Med. Author manuscript; available in PMC 2017 August 01.
Colla et al.
Page 15
Author Manuscript Figure 3. Reductions in Spending by Hierarchical Condition Category for Clinically Vulnerable Cohort
Author Manuscript
Each bar represents the estimated reduction in total spending for a subset of the clinically vulnerable cohort with the given hierarchical condition category. Beneficiaries may belong to more than one subset.
Author Manuscript Author Manuscript JAMA Intern Med. Author manuscript; available in PMC 2017 August 01.
Author Manuscript
Author Manuscript
Author Manuscript 19.7 16.4 13.7 13.8
70–74
75–79
80–84
>85
Female
18.3
Poverty, %
JAMA Intern Med. Author manuscript; available in PMC 2017 August 01. 8.0 11.8 12.7 25.8 11.4 12.9 5.1
Coronary artery disease
Congestive heart failure
Chronic obstructive pulmonary disease
Diabetes
Cancer
Vascular disease
Polyneuropathy
Chronic conditions, %
21.8
Disabled, %
86.9
Other (white/other) 19.4
5.4
Hispanic
Dual eligibility, %
7.7
Black
Race, %
58.3
21.1
65–69
Sex, %
15.2
8.5
17.7
14.8
28.9
15.8
14.7
11.5
17.6
22.5
19.1
86.7
5.4
7.9
57.6
13.7
12.5
15.8
20.2
22.3
15.4
4.9
12.7
10.8
25.5
13.1
11.8
7.8
22.7
23.9
20.4
85.8
5.0
9.2
57.7
13.4
13.3
16.1
19.5
21.0
16.7
8.4
17.4
13.9
28.8
16.4
14.8
11.3
22.2
25.2
20.7
85.5
5.1
9.5
57.1
13.2
12.0
15.4
19.8
22.0
17.5
Post (2013)
–
14.7
39.9
24.8
50.4
35.5
43.9
26.4
18.4
13.0
20.2
87.2
5.3
7.6
55.4
26.1
21.3
20.7
19.1
12.8
Pre (2009–2011)
–
22.0
48.4
28.9
54.2
39.0
47.9
33.4
17.7
12.7
19.2
87.3
5.3
7.4
55.4
28.8
21.6
21.9
20.9
6.9
Post (2013)
Pre (2009–2011)
Post (2013)
Pre (2009–2011)
JAMA Intern Med. Author manuscript; available in PMC 2017 August 01. Published in final edited form as: JAMA Intern Med. 2016 August 1; 176(8): 1167–1175. doi:10.1001/jamainternmed.2016.2827.
Association Between Medicare Accountable Care Organization Implementation and Spending Among Clinically Vulnerable Beneficiaries
Author Manuscript
Carrie H. Colla, PhD, Valerie A. Lewis, PhD, Lee-Sien Kao, BA, A. James O’Malley, PhD, Chiang-Hua Chang, PhD, MS, and Elliott S. Fisher, MD, MPH The Dartmouth Institute for Health Policy & Clinical Practice, Geisel School of Medicine at Dartmouth, Lebanon, New Hampshire (Colla, Lewis, Kao, Chang, Fisher); Norris Cotton Cancer Center, Manchester, New Hampshire (Colla); The Dartmouth Institute for Health Policy & Clinical Practice, Department of Biomedical Data Science, Geisel School of Medicine at Dartmouth, Lebanon, New Hampshire (O’Malley)
Abstract IMPORTANCE—Accountable care contracts hold physician groups financially responsible for the quality and cost of health care delivered to patients. Focusing on clinically vulnerable patients, those with serious conditions who are responsible for the greatest proportion of spending, may result in the largest effects on both patient outcomes and financial rewards for participating physician groups.
Author Manuscript
OBJECTIVE—To estimate the effect of Medicare accountable care organization (ACO) contracts on spending and high-cost institutional use for all Medicare beneficiaries and for clinically vulnerable beneficiaries. DESIGN, SETTING, AND PARTICIPANTS—For this cohort study, 2 study populations were defined: the overall Medicare population and the clinically vulnerable subgroup of Medicare beneficiaries. The overall Medicare population was based on a random 40% sample drawn from
Corresponding Author: Carrie H. Colla, PhD, The Dartmouth Institute for Health Policy & Clinical Practice, Geisel School of Medicine at Dartmouth, Level 5, WTRB, One Medical Center Dr, Lebanon, NH 03756, ([email protected]). Supplemental content at jamainternalmedicine.com
Author Manuscript
Author Contributions: Dr Colla had full access to all of the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis. Study concept and design: Colla, Lewis, Chang, Fisher. Acquisition, analysis, or interpretation of data: Colla, Lewis, Kao, O’Malley, Chang. Drafting of the manuscript: Colla, Kao, Fisher. Critical revision of the manuscript for important intellectual content: Colla, Lewis, O’Malley, Chang. Statistical analysis: Colla, Lewis, Kao, O’Malley, Chang. Obtained funding: Colla, Lewis. Administrative, technical, or material support: Colla. Study supervision: Colla, O’Malley, Chang, Fisher. Conflict of Interest Disclosures: None reported. Disclaimer: The content of the article is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health. Additional Contributions: The authors are grateful to Stephanie R. Raymond, BA, Senior Programmer/Analyst at The Dartmouth Institute, for superb programming assistance and Ellen R. Meara, PhD, a professor at The Dartmouth Institute, for her insight and expertise. Neither Ms Raymond nor Dr Meara received additional compensation for their contributions.
Colla et al.
Page 2
Author Manuscript
continuously enrolled fee-for-service beneficiaries with at least 1 evaluation and management visit in a calendar year. The clinically vulnerable study population included all Medicare beneficiaries 66 years or older who had at least 3 Hierarchical Condition Categories (HCCs). Beneficiaries entered the cohort during the quarter between January 2009 to December 2011 when they first had at least 3 HCCs and remained in the cohort until death. Cohort entry was restricted to the preperiod to account for potential changes in coding practices after ACO implementation. Difference-in-difference estimations were used to compare changes in health care outcomes for Medicare beneficiaries attributed to physicians in ACOs with those attributed to non-ACO physicians from January 2009 to December 2013. EXPOSURES—Medicare ACOs beginning contracts in January 2012, April 2012, July 2012, and January 2013 through the Pioneer and Medicare Shared Savings Programs.
Author Manuscript
MAIN OUTCOMES AND MEASURES—Total spending per beneficiary-quarter, spending categories, use of hospitals and emergency departments, ambulatory care sensitive admissions, and 30-day readmissions. RESULTS—Total spending decreased by $34 (95% CI, −$52 to −$15) per beneficiary-quarter after ACO contract implementation across the overall Medicare population (n = 15 592 600) and decreased $114 in clinically vulnerable patients (n = 8 673 823) (95% CI, −$178 to −$50). In the overall Medicare cohort, hospitalizations and emergency department visits decreased by 1.3 and 3.0 events per 1000 beneficiaries per quarter, respectively (95% CIs: −2.1 to −0.4 and −4.8 to −1.3), and hospitalizations and emergency department visits decreased in the clinically vulnerable cohort by 2.9 and 4.1 events per 1000 beneficiaries per quarter, respectively (95% CIs: −5.2 to −0.7 and −7.1 to −1.2). Changes in total spending associated with ACOs did not vary by clinical condition of beneficiaries.
Author Manuscript
CONCLUSIONS AND RELEVANCE—Medicare ACO programs are associated with modest reductions in spending and use of hospitals and emergency departments. Savings were realized through reductions in use of institutional settings in clinically vulnerable patients. Accountable care organizations (ACOs) are one of the largest payment and delivery reforms currently under way in the United States. Over 700 ACO contracts are now in place, covering 23 million Americans.1 Accountable care organizations are groups of health care providers collectively held responsible for the cost and quality of care for a defined patient population. Early evidence suggests that ACOs are improving quality and modestly affecting health care costs.2–5 These gains have led to further policy changes intended to accelerate adoption of these and other alternative payment models such as the Next Generation ACO model, Accountable Health Communities model, Comprehensive ESRD Care model, and Oncology Care model.6–9
Author Manuscript
Little is known, however, about how the ACO payment contracts implemented by Medicare may have influenced health care delivery. Accountable care organizations are hypothesized to improve care and lower costs in several ways, including better care coordination and more effective treatment of chronic illness; indeed, early evidence on quality of care improvements suggests that ACOs may be adopting this approach.10,11 Better care, in turn, should reduce the use of high-cost institutional settings through prevention, coordination, and outpatient management. A related mechanism could be that ACOs focus more directly
JAMA Intern Med. Author manuscript; available in PMC 2017 August 01.
Colla et al.
Page 3
Author Manuscript
on the care of patients with complex medical needs. Patients who are older and have multiple chronic conditions have historically received inefficient, inappropriate, and fragmented care.12–18 Studies of early ACO pilot programs found cost savings primarily among high-cost beneficiaries.2,19 However, the effect of Medicare’s current ACO programs on spending and high-cost institutional use for beneficiaries—and especially for clinically vulnerable beneficiaries—remains unknown. In this study, we focus on the question of whether the implementation of Medicare ACOs has had an effect on spending and usage for both overall and for clinically vulnerable Medicare beneficiaries, focusing in particular on the use of high-cost institutional settings including hospital stays, emergency department visits, and postacute care.
Methods Author Manuscript Author Manuscript
We used 5 years (January 2009–December 2013) of Medicare fee-for-service administrative claims data encompassing all Part A and B charges to compare changes in spending and usage for beneficiaries cared for by physicians in ACOs and those cared for by non-ACO physicians. Beneficiaries were annually assigned to an ACO or non-ACO physician group if the sum of charges for a subset of evaluation and management visits to the primary care physicians within the group exceeded the sum of charges for such visits to any other physician group. Following the Centers for Medicare and Medicaid Services (CMS) Medicare Shared Savings Program (MSSP) methodology to attribute patients, we used a set of outpatient codes defining evaluation and management visits to physicians, nurse practitioners, or physician assistants.20 We used a difference-in-difference design to account for time-invariant differences between ACOs and non-ACOs, and differences between the preintervention and postintervention periods. Detailed methodological notes are available in eAppendix in the Supplement. The Dartmouth institutional review board approved this study. Study Populations
Author Manuscript
We defined 2 study populations, one representing the overall Medicare population and a second representing a clinically vulnerable subgroup of Medicare beneficiaries. The overall Medicare population is based on a random 40% sample we drew of continuously enrolled fee-for-service beneficiaries with at least 1 evaluation and management visit in a calendar year. The clinically vulnerable study population includes all Medicare beneficiaries age 66 or older who had at least 3 Hierarchical Condition Categories (HCCs).21 Patients in this cohort are required to have either 1 inpatient diagnosis or 2 outpatient diagnoses in the prior year to be assigned a condition category. Beneficiaries enter the cohort during the quarter from January 2009 to December 2011 when they first have at least 3 HCCs and remain in the cohort until death. We restricted participant entry to the period before ACO contract implementation to account for potential changes in coding practices after ACO implementation.
JAMA Intern Med. Author manuscript; available in PMC 2017 August 01.
Colla et al.
Page 4
Identifying ACOs
Author Manuscript
The health care provider groups in our study joined Medicare ACO programs in January 2012 (32 ACOs); April 2012 (27 ACOs); July 2012 (87 ACOs); and January 2013 (106 ACOs). To compare physician group performance over time and to preserve the relationship between physicians and ACOs, we assigned physicians to a preperiod organization (corresponding to an ACO) if the physicians were associated with that organization in the ACO period. Outcome Variables
Author Manuscript
Our main outcome measures were total spending per quarter and a number of spending categories: acute care, durable medical equipment, facility, tests, long-term care, hospice, imaging, home health, procedures, evaluation and management visits, and skilled nursing facility. We also studied quarterly counts of hospitalizations, emergency department visits, and observation stays.22 Other outcome measures included ambulatory care sensitive admissions23 and 30-day all-cause read-missions in the quarter. Quarterly measurements of outcomes allowed precise representation of an organization’s ACO status, increasing the precision of our analyses compared with yearly measurements. In 2013, Medicare excluded from research files any claims associated with substance abuse. To measure changes in outcomes over time, we applied Medicare’s approach to remove such claims from files for prior years (January 2009–December 2012). Control Variables
Author Manuscript
We grouped beneficiaries by 5-year age categories to allow for nonlinear effects of age. We created indicators for disability as original reason for entitlement; sex; nursing home residence; dual enrollment in Medicare and Medicaid; black, Hispanic, and other race or ethnicity groups24; hospital referral region (HRR) of residence; and 10 of the most prevalent chronic conditions, including end-stage renal disease, coronary artery disease, chronic obstructive pulmonary disease, cancer, diabetes, congestive heart failure, renal failure, polyneuropathy, cardio-respiratory failure and shock, and vascular disease. As all HCCs indicate increased risk status, we considered any beneficiary diagnosed with a condition to have that condition for the remainder of the study period. We measured the proportion in poverty in the patients’ zip code using the 2010 Census. Statistical Analysis
Author Manuscript
To estimate changes in spending and high-cost institutional use associated with ACO contracts, we compared changes in outcome variables over the ACO implementation period for the beneficiary-quarter observations attributed to ACO and non-ACO (control group) care. Our main specification was a difference-in-difference beneficiary-quarter level linear model with time and HRR indicators, with the control group made up of beneficiaries attributed to non-ACO physicians. This design controlled for fixed differences between ACO and non-ACO care, as well as biases from comparisons over time that could reflect broader trends in health care or Medicare beneficiary population health. Because individuals contribute multiple observations across the study period (up to 20 across the 5-year period), we use robust standard errors accounting for the fact that errors were likely clustered by
JAMA Intern Med. Author manuscript; available in PMC 2017 August 01.
Colla et al.
Page 5
Author Manuscript
beneficiary and by HRR, an indicator for the local health care market. Using the subscripts i, j, t, and k for individual, practice group, quarter, and HRR, respectively, the statistical models had the following linear form:
Author Manuscript
The coefficient of primary interest, represented by β1, measures the effect of a patient receiving care from an ACO after the ACO contract begins (indicated by ACOPost). We estimated a single ACO effect for all outcomes, and additionally we estimated total spending effects separately for each ACO wave by program start date and individual ACO. In the latter 2 cases, ACOPost is the interaction of a postperiod indicator with a vector of indicators for each wave of ACOs or for individual ACOs, respectively. The variable ACO can be nonzero at any time to indicate physician groups who later became ACOs, whereas ACOPost can only be nonzero after ACOs have begun Medicare contracts. Because we suspected anticipatory effects of ACO implementation, we defined EarlyPost to indicate the 2 quarters prior to ACO implementation, when the ACO had applied for and then been accepted for participation. The EarlyPost coefficient, β2, quantifies the effect of anticipation compared with earlier preperiod quarters and removes this period of time from the evaluation of the ACOPost coefficient β1. The SocioDem vector captures Medicaid status, disability, nursing home residency, age group, sex, race/ethnicity, and percent poverty in census tract. The Clinical vector includes chronic condition indicators and for the full cohort the beneficiary’s total number of HCCs. The variables γt and ωk denote time adjustment (quarterly indicators, year indicators, and season indicators) and the HRR that the group practices in, respectively. The error term captures idiosyncratic variation in Y. All covariates with continuous or ordinal scales were centered.
Author Manuscript
We chose a linear model because (1) there were few occurrences of zeros owing to the requirement of at least 1 evaluation and management visit and the focus on clinically vulnerable patients who have intense health care usage; (2) distributions were largely symmetrical; (3) if linear models do not fit the data well, our standard errors are biased against finding a significant effect and are therefore conservative; and (4) for ease of interpretation it was desirable for the estimated coefficients to represent a dollar amount or rate. We designed our approach for the clinically vulnerable cohort and used the same models for the full cohort to maintain easy comparability.
Author Manuscript
To determine whether changes in spending and high-cost institutional use in ACOs with earlier start dates were due to a longer follow-up period, we performed a sensitivity analysis limited to the first 6 months and 1 year of post-ACO implementation for each wave. We also performed a sensitivity analysis estimating the association of ACO contracts with changes in spending for 9 clinical cohorts. Additional sensitivity analyses are described further in eAppendix in the Supplement.
JAMA Intern Med. Author manuscript; available in PMC 2017 August 01.
Colla et al.
Page 6
Author Manuscript
Results Descriptive Characteristics
Author Manuscript
On average, spending on the clinically vulnerable cohort was 114% more than on Medicare beneficiaries overall ($22 235 annually in the clinically vulnerable attributed to ACOs vs $10 378 overall), and spending in the clinically vulnerable cohort made up 82% of overall spending in the first quarter of 2009. The clinically vulnerable cohort includes 22% of attributed Medicare beneficiaries. The top 10 conditions identified in the clinically vulnerable cohort were congestive heart failure (37%), specified heart arrhythmias (37%), chronic obstructive pulmonary disease (31%), renal failure (29%), vascular disease (26%), diabetes without complication (24%), cardiorespiratory failure and shock (17%), cancer (12%), polyneuropathy (10%), and stroke (10%). The largest component of total spending for the clinically vulnerable was acute care (36%), followed by skilled nursing facility (11%), evaluation and management visits (10%), and procedures (10%). Spending in the preperiod was slightly greater in beneficiaries attributed to ACOs than for the control group. Demographic and clinical characteristics of beneficiary-quarters attributed to ACO and nonACO care were similar in the preperiod overall and in the clinically vulnerable cohort. Because patients remain in the study cohort after first observation of 3 conditions, we see that the cohort has aged in the postperiod, with associated effects such as decreases in chronic conditions and spending due to mortality in the sickest patients (Table 1). Regression Results
Author Manuscript Author Manuscript
Despite differences in the level of spending between ACOs and control populations, spending over time shows similar trends during the pre-ACO period (Figure 1). We find small significant decreases in spending associated with the Pioneer program and MSSP ACOs. Across all ACOs, average total spending decreased by $34 or 1.3% per beneficiaryquarter (95% CI, −$52 to −$15) (Table 2) and by $114 or 2.0% per beneficiary-quarter (95% CI, −$178 to −$50) in the clinically vulnerable cohort. We found a statistically significant anticipatory decrease in spending in the 6 months leading up to implementation: $17 in the full cohort (95% CI, −$30 to −$3) and −$68 in the clinically vulnerable (95% CI, −$111 to − $26). In the clinically vulnerable cohort, total spending per beneficiary-quarter decreased by $132 or 2.2% (95% CI, −$225 to −$40) for the Pioneer program; $148 (95% CI, −$289 to − $7) for April 2012 MSSPs; $119 (95% CI, −$198 to −$39) for July 2012 MSSPs; and $41 (95% CI, −$105 to $22) for January 2013 MSSPs. A Wald test on the coefficients showed that the total savings achieved by each ACO wave were not statistically different from each other. Estimated changes in spending ranged from savings of $89 (25th percentile) to increased spending of $79 (75th percentile) in the full cohort and savings of $211 (25th percentile) to increased spending of $222 (75th percentile)in the clinically vulnerable (Figure 2). When effects were estimated separately for each of the top condition categories, there were statistically significant decreases in total spending per beneficiary-quarter for all conditions, and decreases across conditions did not differ significantly in magnitude (Figure 3). Adjusting for ACOs that dropped out of the Pioneer program before the end of our study period did not significantly change results.
JAMA Intern Med. Author manuscript; available in PMC 2017 August 01.
Colla et al.
Page 7
Author Manuscript
Reductions in total spending per beneficiary-quarter by ACOs in the postperiod can be explained in part by decreases in acute care spending and high-cost institutional use across all waves. Acute care spending decreased by $12 or 1.4% (95% CI, −$21 to −$4, Table 2) overall and $48 or 2.3% (95% CI, −$79 to −$17) for the clinically vulnerable cohort. Skilled nursing facility spending decreased by $10 or 5.0% (95% CI, −$16 to −$4) overall and $30 or 5.0% (95% CI, −$46 to −$13) for the clinically vulnerable cohort. In the full Medicare cohort, spending decreased slightly for long-term care and had negligible changes for evaluation and management visits. In the clinically vulnerable cohort, spending decreased slightly for both long-term care and evaluation and management visits. Changes in spending were negligible or statistically insignificant for durable medical equipment, facility, test, hospice, imaging, home health, and procedure spending for both the full Medicare and the clinically vulnerable cohorts.
Author Manuscript
In the full Medicare cohort, ACOs were associated with a reduction in emergency department visits of 3.0 events or 1.9% per 1000 beneficiary-quarters (95% CI, −4.8 to −1.3) and a decrease in hospitalizations of 1.3 events or 1.4% (95% CI, −2.1 to −0.4). In the clinically vulnerable cohort, ACOs were associated with a reduction in emergency department visits of 4.1 events per 1000 beneficiary-quarters (95% CI, −7.1 to −1.2) and a decrease in hospitalizations of 2.9 events (95% CI, −5.2 to −0.7) in the clinically vulnerable. Changes in high-cost institutional use in both our full cohort and our clinically vulnerable cohort were negligible or statistically insignificant for ambulatory care sensitive hospitalizations, observation stays, and 30-day readmissions.
Author Manuscript
To determine whether the larger reductions in spending and high-cost institutional use in ACOs with earlier start dates were due to a longer follow-up period, we limited analysis to the first year of post-ACO implementation. Decreases in total spending became smaller in magnitude. This, along with the finding that the January 2013 MSSPs had small and insignificant changes in spending, suggests that reductions in total spending take time to be realized. When further limited to the first 6 months of post-ACO implementation, decreases in total spending were similar in magnitude to the first-year effects, suggesting that changes in spending are relatively constant, increasing slightly over time. Results were robust to the inclusion or exclusion of the number of hierarchical clinical conditions and indicators for specific clinical condition categories.
Discussion
Author Manuscript
Medicare ACO programs are associated with modest savings on average across all beneficiaries, with savings concentrated in clinically vulnerable beneficiaries and use of institutional settings. Accountable care organizations are associated with a 1.3% reduction in hospital spending and a 5% reduction in skilled nursing spending, as well as significant reductions in emergency department use and hospitalizations. We found the magnitude of reductions were not significantly different by the start date of ACOs. We found that the magnitude of reductions was not significantly different by the start date of ACOs, though further exploration revealed slight increases in spending with longer AOC participation. We also find an anticipatory effect of participating in ACO programs that could lower the benchmark spending figures for ACOs, making it less likely for them to achieve savings
JAMA Intern Med. Author manuscript; available in PMC 2017 August 01.
Colla et al.
Page 8
Author Manuscript
according to CMS calculations. While modest in magnitude, these findings for ACOs are consistent with other evaluations of ACO savings2–5,19 and stand in contrast to the failure to demonstrate significant cost savings in care management programs layered on top of the traditional fee-for-service Medicare program.25,26
Author Manuscript
Similar to previous studies of payment reform,2 we observe marked differences across organizations in the effects of these payment programs, ranging from large reductions in spending to large increases in spending. However, some variation in results is to be expected, and while our models include hospital referral region fixed effects, we have not studied each of these local comparisons in depth and continue to know little about why some organizations succeed and others fail.27 Differences in results may be owing to ACO formation effects: the characteristics of beneficiaries attributed to ACOs and those attributed to non-ACOs may be different within markets.28 Factors contributing to success may include ACO participant characteristics such as size, homogeneity, readiness, or structural attributes (for example, whether or not the ACO includes a hospital); market conditions; choice of risk stratification tools; differences in governance models or leadership effectiveness; physician engagement strategies; electronic health records and other health information technology tools; and how providers approached disease management, care transitions, and quality improvement. Early studies of the formation of ACOs offer a sense of the diversity of participating organizations.10,29,30
Author Manuscript
Many ACOs have instituted risk stratification and care management programs targeted at clinically vulnerable patients,31,32 as well as programs to improve patient access to their primary care team in the hope of keeping patients out of the emergency department and the hospital when unnecessary.33,34 These programs appear to be working to a small degree through changes in spending and use associated with the ACO program; overall, we estimate that ACOs were able to save a total of $592 million and reduce high-cost institutional use by 15 000 000 events for hospitalizations and 21 000 000 events for emergency department visits for clinically vulnerable beneficiaries during 2012 and 2013. The effects we report here are similar in magnitude to results reported from the Physician Group Practice Demonstration and the Pioneer program across all patient groups.2,4,5
Author Manuscript
Our analyses have several limitations. First, previous research has shown that diagnoses are sensitive to regional variations that cannot be explained by differences in underlying health,35,36 which may be a limitation of the use of HCCs as a proxy for health status. Our estimates were not sensitive to the inclusion of HCCs as a risk adjustment tool. Second, we analyze only 1 to 2 years of postimplementation data. Third, we did not measure the effect of ACOs on Part D spending, wraparound Medicaid spending, or spillovers into the Medicare Advantage program. Fourth, our data on beneficiary costs and estimated savings do not include the start-up costs invested by the ACOs to get up and running. Additionally, our data cannot study those with substance abuse, patients often included in the clinically vulnerable, due to redaction of these claims. Finally, our use of claims data has limited information on quality of care. We do know, however, that on the quality measures reported to CMS, including for example patient satisfaction with management of care transitions, readmissions, and management of chronic conditions, Medicare ACOs have shown substantial improvement over time.37
JAMA Intern Med. Author manuscript; available in PMC 2017 August 01.
Colla et al.
Page 9
Author Manuscript
Conclusions
Author Manuscript
Our results suggest that the ACO model has modest early benefits in terms of reduced spending and high-cost institutional use for patients with multiple clinical conditions. According to our calculations, approximately 84% of ACOs who achieved statistically significant reductions in total spending in the full cohort received shared savings from CMS in the 2012 to 2013 performance year. Given the vast differences in changes in spending across ACOs, further research on the relationship between activities within ACOs, the institutional characteristics of ACOs, and the service markets in which they operate and changes in spending and high-cost institutional use are essential to better understand what factors contribute to improved care for clinically vulnerable populations. In addition, longerterm research is needed, as it is likely that while some relatively simple changes may have shown rapid results, more structural changes will take time to produce improvements in health care outcomes.
Supplementary Material Refer to Web version on PubMed Central for supplementary material.
Acknowledgments Funding/Support: This research was supported by grants from the Commonwealth Fund (grant No. 20150034), the National Institute on Aging (grant No. 5R33AG044251) and the Dartmouth Clinical and Translational Science Institute (through grant No. UL1TR001086 from the National Center for Advancing Translational Sciences). Role of the Funder/Sponsor: The funders/sponsors had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication.
Author Manuscript
References
Author Manuscript
1. Muhlestein, D.; Gardner, P.; Caughey, W.; deLisle, K. Projected Growth of Accountable Care Organizations. Leavitt Partners. http://leavittpartners.com/2015/12/projected-growth-ofaccountable-care-organizations-2/. Published online December 23, 2015. Accessed May 19, 2016 2. Colla CH, Wennberg DE, Meara E, et al. Spending differences associated with the Medicare Physician Group Practice Demonstration. JAMA. 2012; 308(10):1015–1023. [PubMed: 22968890] 3. McWilliams JM, Hatfield LA, Chernew ME, Landon BE, Schwartz AL. Early Performance of Accountable Care Organizations in Medicare. N Engl J Med. 2016; [published online April 13, 2016]. doi: 10.1056/NEJMsa1600142 4. Nyweide DJ, Lee W, Cuerdon TT, et al. Association of Pioneer Accountable Care Organizations vs traditional Medicare fee for service with spending, utilization, and patient experience. JAMA. 2015; 313(21):2152–2161. [PubMed: 25938875] 5. McWilliams JM, Chernew ME, Landon BE, Schwartz AL. Performance differences in year 1 of pioneer accountable care organizations. N Engl J Med. 2015; 372(20):1927–1936. [PubMed: 25875195] 6. Zusman EE, Carr SJ, Robinson J, et al. Moving toward implementation: the potential for accountable care organizations and private-public partnerships to advance active neighborhood design. Prev Med. 2014; 69(suppl 1):S98–S101. [PubMed: 25117525] 7. Genesis HealthCare. New hospitals and health care providers join successful, cutting-edge federal initiative that cuts costs and puts patients at the center of their care. http://www.prnewswire.com/ news-releases/new-hospitals-and-health-care-providers-join-successful-cutting-edge-federal-
JAMA Intern Med. Author manuscript; available in PMC 2017 August 01.
Colla et al.
Page 10
Author Manuscript Author Manuscript Author Manuscript Author Manuscript
initiative-that-cuts-costs-and-puts-patients-at-the-center-of-their-care-300215344.html. Accessed May 19, 2016 8. Centers for Medicare and Medicaid Services. Comprehensive ESRD Care Model. https:// innovation.cms.gov/initiatives/comprehensive-esrd-care/. Accessed May 19, 2016 9. Kline RM, Bazell C, Smith E, Schumacher H, Rajkumar R, Conway PH. Centers for medicare and medicaid services: using an episode-based payment model to improve oncology care. J Oncol Pract. 2015; 11(2):114–116. [PubMed: 25690596] 10. Lewis VA, Colla CH, Schoenherr KE, Shortell SM, Fisher ES. Innovation in the safety net: integrating community health centers through accountable care. J Gen Intern Med. 2014; 29(11): 1484–1490. [PubMed: 25008217] 11. Bailit, M.; Tobey, R.; Maxwell, J.; Bateman, C. The ACO Conundrum: Safety-Net Hospitals in the Era of Accountable Care. http://www.bailit-health.com/articles/2015-0504-bhp-jsi-rwjf-acoconundrum.pdf. Accessed May 19, 2016 12. Boult C, Reider L, Leff B, et al. The effect of guided care teams on the use of health services: results from a cluster-randomized controlled trial. Arch Intern Med. 2011; 171(5):460–466. [PubMed: 21403043] 13. Counsell SR, Callahan CM, Clark DO, et al. Geriatric care management for low-income seniors: a randomized controlled trial. JAMA. 2007; 298(22):2623–2633. [PubMed: 18073358] 14. Asch SM, Sloss EM, Hogan C, Brook RH, Kravitz RL. Measuring underuse of necessary care among elderly Medicare beneficiaries using inpatient and outpatient claims. JAMA. 2000; 284(18):2325–2333. [PubMed: 11066182] 15. Hempstead K, Delia D, Cantor JC, Nguyen T, Brenner J. The fragmentation of hospital use among a cohort of high utilizers: implications for emerging care coordination strategies for patients with multiple chronic conditions. Med Care. 2014; 52(3 suppl 3):S67–S74. [PubMed: 24561761] 16. Centers for Medicare and Medicaid Services. Chronic Conditions Among Medicare Beneficiaries Chartbook. Baltimore, MD: 2012. 2012 ed 17. Boyd CM, Darer J, Boult C, Fried LP, Boult L, Wu AW. Clinical practice guidelines and quality of care for older patients with multiple comorbid diseases: implications for pay for performance. JAMA. 2005; 294(6):716–724. [PubMed: 16091574] 18. United States. Congressional Budget Office High-cost Medicare beneficiaries. Washington, D.C.: Congressional Budget Office; 2005. 19. Song Z, Rose S, Safran DG, Landon BE, Day MP, Chernew ME. Changes in health care spending and quality 4 years into global payment. N Engl J Med. 2014; 371(18):1704–1714. [PubMed: 25354104] 20. Centers for Medicare and Medicaid Services. Medicare Shared Savings Program Shared Savings and Losses and Assignment Methodology Specifications. 2014. https://www.cms.gov/Medicare/ Medicare-Fee-for-Service-Payment/sharedsavingsprogram/Downloads/Shared-Savings-LossesAssignment-Spec-v2.pdf. Accessed May 19, 2016 21. Pope GC, Kautter J, Ellis RP, et al. Risk adjustment of Medicare capitation payments using the CMS-HCC model. Health Care Financ Rev. 2004; 25(4):119–141. [PubMed: 15493448] 22. Feng Z, Wright B, Mor V. Sharp rise in Medicare enrollees being held in hospitals for observation raises concerns about causes and consequences. Health Aff (Millwood). 2012; 31(6):1251–1259. [PubMed: 22665837] 23. Agency for Healthcare Research and Quality. National Quality Measures Clearinghouse. Ambulatory care sensitive conditions: age-standardized acute care hospitalization rate for conditions where appropriate ambulatory care prevents or reduces the need for admission to the hospital, per 100,000 population younger than age 75 years. 2013. https:// www.qualitymeasures.ahrq.gov/content.aspx?id=48964. Accessed May 19, 2016 24. Eicheldinger C, Bonito A. More accurate racial and ethnic codes for Medicare administrative data. Health Care Financ Rev. 2008; 29(3):27–42. [PubMed: 18567241] 25. Schore JL, Brown RS, Cheh VA. Case management for high-cost Medicare beneficiaries. Health Care Financ Rev. 1999; 20(4):87–101. [PubMed: 11482127]
JAMA Intern Med. Author manuscript; available in PMC 2017 August 01.
Colla et al.
Page 11
Author Manuscript Author Manuscript Author Manuscript
26. Peikes D, Chen A, Schore J, Brown R. Effects of care coordination on hospitalization, quality of care, and health care expenditures among Medicare beneficiaries: 15 randomized trials. JAMA. 2009; 301(6):603–618. [PubMed: 19211468] 27. McWilliams JM, Chernew ME, Zaslavsky AM, Hamed P, Landon BE. Delivery system integration and health care spending and quality for Medicare beneficiaries. JAMA Intern Med. 2013; 173(15):1447–1456. [PubMed: 23780467] 28. Lewis VA, Colla CH, Carluzzo KL, Kler SE, Fisher ES. Accountable Care Organizations in the United States: market and demographic factors associated with formation. Health Serv Res. 2013; 48(6 Pt 1):1840–1858. [PubMed: 24117222] 29. Colla CH, Lewis VA, Bergquist SL, Shortell SM. Accountability across the Continuum: the participation of postacute care providers in accountable care organizations. Health Serv Res. 2016; [published online January 22, 2016]. doi: 10.1111/1475-6773.12442 30. Colla CH, Lewis VA, Shortell SM, Fisher ES. First national survey of ACOs finds that physicians are playing strong leadership and ownership roles. Health Aff (Millwood). 2014; 33(6):964–971. [PubMed: 24889945] 31. Adams AJ, Clark DR, DeLander GE, et al. Report of the AACP task force on patient-centered medical homes and accountable care organizations. Am J Pharm Educ. 2013; 77(7):142. [PubMed: 24052645] 32. Hong CS, Siegel AL, Ferris TG. Caring for high-need, high-cost patients: what makes for a successful care management program? Issue Brief (Commonw Fund). 2014; 19:1–19. [PubMed: 25115035] 33. Klein, S. In focus: Building Accountable Care Organizations That Improve Quality And Lower Costs—A View From The Field. 2010. http://www.commonwealthfund.org/publications/ newsletters/quality-matters/2010/june-july-2010/in-focus. Accessed May 19, 2016 34. UnitedHealth Center for Health Reform & Modernization. Advancing Primary Care Delivery: Practical, Proven, and Scalable Approaches. 2014. http://www.unitedhealthgroup.com/~/ media/UHG/PDF/2014/UNH-Primary-Care-Report-Advancing-Primary-Care-Delivery.ashx. Accessed May 19, 2016 35. Welch HG, Sharp SM, Gottlieb DJ, Skinner JS, Wennberg JE. Geographic variation in diagnosis frequency and risk of death among Medicare beneficiaries. JAMA. 2011; 305(11):1113–1118. [PubMed: 21406648] 36. Song Y, Skinner J, Bynum J, Sutherland J, Wennberg JE, Fisher ES. Regional variations in diagnostic practices. N Engl J Med. 2010; 363(1):45–53. [PubMed: 20463332] 37. Centers for Medicare and Medicaid Services. Medicare ACOs Continue to Improve Quality of Care, Generate Shared Savings. 2015. https://www.cms.gov/Newsroom/MediaReleaseDatabase/ Press-releases/2015-Press-releases-items/2015-08-25.html. Accessed May 19, 2016
Author Manuscript JAMA Intern Med. Author manuscript; available in PMC 2017 August 01.
Colla et al.
Page 12
Author Manuscript
Key Points Question How have Medicare accountable care organizations (ACOs) affected spending and highcost institutional use for all Medicare beneficiaries and specifically clinically vulnerable beneficiaries? Findings Using a difference-in-difference estimation, total spending decreased by $34 per beneficiary-quarter after ACO contract implementation across the overall Medicare cohort and decreased by $114 in the clinically vulnerable cohort. Hospitalization and emergency department visits decreased significantly per beneficiary-quarter in both the overall Medicare cohort and clinically vulnerable cohort.
Author Manuscript
Meaning Medicare ACO programs are associated with modest reductions in spending and highcost institutional use both overall and for clinically vulnerable beneficiaries.
Author Manuscript Author Manuscript JAMA Intern Med. Author manuscript; available in PMC 2017 August 01.
Colla et al.
Page 13
Author Manuscript Figure 1. Mean Quarterly Spending per Beneficiary
Author Manuscript
The average annual spending for (A) all Medicare beneficiaries is $10 377 and (B) the clinically vulnerable cohort, $22 211. ACO indicates accountable care organization.
Author Manuscript Author Manuscript JAMA Intern Med. Author manuscript; available in PMC 2017 August 01.
Colla et al.
Page 14
Author Manuscript Author Manuscript
Figure 2. Range of ACO Effects
Estimates for each ACO are represented in the figure as data points. ACO indicates accountable care organization.
Author Manuscript Author Manuscript JAMA Intern Med. Author manuscript; available in PMC 2017 August 01.
Colla et al.
Page 15
Author Manuscript Figure 3. Reductions in Spending by Hierarchical Condition Category for Clinically Vulnerable Cohort
Author Manuscript
Each bar represents the estimated reduction in total spending for a subset of the clinically vulnerable cohort with the given hierarchical condition category. Beneficiaries may belong to more than one subset.
Author Manuscript Author Manuscript JAMA Intern Med. Author manuscript; available in PMC 2017 August 01.
Author Manuscript
Author Manuscript
Author Manuscript 19.7 16.4 13.7 13.8
70–74
75–79
80–84
>85
Female
18.3
Poverty, %
JAMA Intern Med. Author manuscript; available in PMC 2017 August 01. 8.0 11.8 12.7 25.8 11.4 12.9 5.1
Coronary artery disease
Congestive heart failure
Chronic obstructive pulmonary disease
Diabetes
Cancer
Vascular disease
Polyneuropathy
Chronic conditions, %
21.8
Disabled, %
86.9
Other (white/other) 19.4
5.4
Hispanic
Dual eligibility, %
7.7
Black
Race, %
58.3
21.1
65–69
Sex, %
15.2
8.5
17.7
14.8
28.9
15.8
14.7
11.5
17.6
22.5
19.1
86.7
5.4
7.9
57.6
13.7
12.5
15.8
20.2
22.3
15.4
4.9
12.7
10.8
25.5
13.1
11.8
7.8
22.7
23.9
20.4
85.8
5.0
9.2
57.7
13.4
13.3
16.1
19.5
21.0
16.7
8.4
17.4
13.9
28.8
16.4
14.8
11.3
22.2
25.2
20.7
85.5
5.1
9.5
57.1
13.2
12.0
15.4
19.8
22.0
17.5
Post (2013)
–
14.7
39.9
24.8
50.4
35.5
43.9
26.4
18.4
13.0
20.2
87.2
5.3
7.6
55.4
26.1
21.3
20.7
19.1
12.8
Pre (2009–2011)
–
22.0
48.4
28.9
54.2
39.0
47.9
33.4
17.7
12.7
19.2
87.3
5.3
7.4
55.4
28.8
21.6
21.9
20.9
6.9
Post (2013)
Pre (2009–2011)
Post (2013)
Pre (2009–2011)
