New Marketplace

The State of the Evidence on Payment Reform

Article · July 18, 2018

Over the past decade, health plans, employers, and other health care purchasers, including states, have rushed to move away from traditional fee-for-service payment toward paying health care providers in a way that rewards them for adhering to certain processes of care, achieving certain outcomes for their patients, and providing a superior patient experience. While the payers’ ability to change provider behavior is likely to be negligible when they provide small bonuses for effective care a year after the fact, a greater focus on financial accountability may encourage providers to promote preventive care and look for ways to cut waste. Models that prompt providers to reach a financial target — such as bundled payments, shared risk, and global budgets — are most likely to do this. Though there is much more to learn, we have early insights into which elements of payment reform seem most promising.

In 2010, when Catalyst for Payment Reform (CPR) was founded, it put out an informal inquiry to three of the largest national commercial health plans to determine what proportion of their payments to doctors and hospitals were tied to performance. At that time, they estimated a range of 1% to 3%. In 2013 and 2014, CPR tracked the implementation of payment reform through a formal survey of commercial health plans representing more than 60% of the nation’s commercial covered population. In addition, in 2016 and 2017, CPR supported the Health Care Payment Learning and Action Network in its National Data Collection Effort.

Across these years of data, CPR finds sharp growth — about half of all commercial payments to doctors and hospitals now flow through value-oriented methods. However, none of these efforts have demonstrated conclusively that this increase in value-oriented payments has led to better, more affordable care.

CPR’s Literature Review

CPR scanned the literature to gauge the state of the evidence of payment reform today. Using a variety of sources, we focused on about 75 articles — both independent, academic studies and self-published announcements — on the performance of payment and delivery reform programs across the United States. To find these studies on PubMed or Google, our search terms included the names of payment or delivery models (e.g., pay-for-performance, shared savings, accountable care organization), well-known programs (e.g., the Alternative Quality Contract, the Medicare Shared Savings Program, PROMETHEUS Bundled Pay), and academic authors known to conduct relevant evaluations (e.g., Michael Chernew, Meredith Rosenthal). We also searched through an inventory of payment and delivery reforms prepared by the Duke-Margolis Evidence Hub. Lastly, we scoured the references in the published articles for additional evaluations of payment and delivery reform programs.

As expected, there are major differences between the academic studies and self-published announcements. The academic studies typically apply a rigor to evaluation that self-published announcements, which often highlight only positive outcomes, do not. Here is what we found regarding the value-oriented payment approaches.


Across the seven evaluations of pay-for-performance (P4P) programs we selected for our review, few showed statistically significant improvements in the quality of care, year over year. For example, in the Integrated Healthcare Association’s (IHA) Value-Based P4P Program, most clinical quality measures and patient experience of care composites stayed stable from 2015 to 2016. But over a longer period, these programs often show larger improvements in quality. Over 4 years in IHA’s program, physician organization performance on diabetes care measures improved — blood pressure control (<140/90 mm Hg) improved by 9.8 percentage points and medical attention to nephropathy improved by 5.6 percentage points.

In addition, a study of the Bridges to Excellence (BTE) program, which was launched in 2002 by a group of large employers in collaboration with several health plans and provider organizations, examined whether providers choosing to be recognized by BTE and therefore eligible for bonus payments performed better on a set of performance measures than providers who did not seek or receive recognition or bonuses. Using data from 2003 to 2006, researchers uncovered statistically significant differences in performance between recognized and non-recognized physicians. In particular, physicians recognized as Physician Office Link providers out-performed non-recognized providers on cervical cancer screening, mammography, and A1C testing. And, physicians recognized as Diabetes Care Link providers out-performed non-recognized providers on all four diabetes process measures assessing quality. None of these evaluations found improvements in the cost of health care.


Nonpayment programs have been shown to reduce the delivery of the service for which payers discontinue payment. We found two initiatives — the South Carolina Birth Outcomes Initiative and Healthy Texas Babies Initiative — focused on reducing early elective deliveries (EEDs), which have been shown to offer no clinical benefit to mothers and babies absent medical necessity. Both state Medicaid agencies stopped paying for EEDs and have since seen reductions. In South Carolina, as of 2016, 76% of all birthing hospitals have a rate of 0% of non-medically necessary EEDs, compared to 9.6% in 2011 — much higher than Leapfrog’s recommended rate of 5%. The rate of EEDs in Texas dropped 2.03 percentage points from 10.63% in 2011.

Growth in alternative payment models shared savings shared risk bundled payments population-based payments

  Click To Enlarge.

Shared Savings

Shared savings is quickly becoming the most prevalent payment reform; our review included more than 30 studies on shared savings programs, many of which were released by the sponsor of the program.

Generally, payers use shared savings arrangements with providers who restructure to form accountable care organizations (ACOs). The number of ACOs has grown significantly since the Affordable Care Act spurred their creation in 2010, with almost 1,000 organizations to date. Based on the articles we reviewed, providers paid through shared savings arrangements improve how they deliver care. The Medicare Shared Savings Program (MSSP), run by CMS, has consistently demonstrated high-quality scores, based on an average across four domains of ACO quality performance. In 2016, the aggregate quality score was 93.4%, up from 91% in the previous year and 86% in 2014. However, MSSP’s quality measures have been critiqued for being easily achieved and not centered on patient outcomes. In a private sector example, Intel Corporation’s Connected Care program, which also uses a shared savings payment model, has seen positive patient experience and satisfaction results and statistically significant improvements in diabetes care and depression screenings, among other clinical measures.

The literature also shows that many shared savings programs generate savings as a result of provider organizations spending below the target budget. However, because Medicare and health plans only give payouts and do not recoup money when ACOs overspend, payers most often end up with net losses — although this is not explicitly stated. While many of the ACOs participating in MSSP generated savings, Medicare saw a net loss of $39 million in 2016, about 0.05% of program costs, because it could not recoup payments from ACOs that overspent.

Shared Risk

While shared risk payment arrangements are not as common as shared savings — representing only about 1% of commercial payments in 2014 and the subject of only 11 of the more than 70 articles we reviewed — the evidence for their impact on the quality of care and health care spending is generally positive. Many payers realize net savings under this model because they are able to recoup costs from ACOs that have spent over the budget.

When ACOs realize savings, most often they stem from lower utilization of health care services, such as fewer hospital admissions and emergency department (ED) visits. For example, the Center for Medicare and Medicaid Innovation’s (CMMI) Pioneer program found that ACO participants reduced rates of hospitalizations and ED visits by 8% and 6% respectively, adding to net savings of about $115 per beneficiary. All but two of the studies we studied examined CMMI’s Pioneer program at the program level (how all Pioneer ACOs performed in aggregate) and at the individual ACO level (the performance of Partners HealthCare’s Pioneer ACO, for example). There are far fewer studies available from the private sector. However, in a review of a commercial health plan, Blue Cross Blue Shield of Massachusetts’ Alternative Quality Contract, researchers attributed reduced spending to decreases in volume of services — approximately 40% of claims savings.

Bundled Payment

Results on bundled or episode-based payment models have been mixed. CMMI’s Bundled Payments for Care Improvement (BPCI) initiatives have produced variable outcomes. However, other initiatives, such as the episode-based payment programs implemented by the Medicaid agencies in Arkansas and Tennessee, have had success in reducing unnecessary utilization and episode costs, as well as improving the quality of care for certain conditions. The Pennsylvania Employees Benefit Trust Fund, working with the Health Care Incentives Improvement Institute (HCI3) in a pilot program for total hip and knee replacements, demonstrated decreases in outpatient costs by $3,524 on average, and UnitedHealthcare’s oncology model led to a reduction of cancer episode costs for five medical groups by a combined $33 million.

The Path Forward

This transition from fee-for-service accomplishes nothing unless these reforms are working and balance the significant investments that providers, health plans, and purchasers are making to support these changes — investments such as integrated electronic health records or new staff for care support teams. Even patients may feel frustrated if these changes put barriers between patients and their providers or in any way disrupt the doctor-patient relationship.

While there is some evidence that certain reforms can work, we need better research to learn which approaches work best in what context. Many of the methodological studies of public or private programs lack an independent, rigorous review. Without meaningful, comprehensive information about the effectiveness of payment reforms, purchasers, health plans, and providers will continue to face challenges in their pursuit of higher-value health care.

Call for submissions:

Now inviting expert articles, longform articles, and case studies for peer review


A weekly email newsletter featuring the latest actionable ideas and practical innovations from NEJM Catalyst.

Learn More »

More From New Marketplace
Examples of Stages of AI Technology Development and Diffusion

How Artificial Intelligence Is Changing Health Care Delivery

The development of intelligent machines holds great promise for making health care delivery more accurate, efficient, and accessible, but challenges remain for incorporating AI technology into clinical and administrative settings.

Recommendations to Resolve Information Asymmetry at the Strategic Level

Information Asymmetry: The Untapped Value of the Patient

The knowledge and preferences that patients could — and should — share with clinicians would restore balance to point-of-care interactions, leading to better outcomes and enhanced value.

Key Components for Health Care Systems to Address Patient Affordability

The Next Frontier in Reducing Costs of Care: Patient Affordability

To create meaningful point-of-care guidance so that patients can make informed medical and financial decisions, health system leaders and policymakers can develop interventions to address four major components of a proposed patient affordability scale.

Direct-to-Consumer Telemedicine Is the Biggest Coming Threat to Traditional Health Care Organizations

Survey Snapshot: Mega-Mergers and Telemedicine Accelerate Convenient Care Growth

NEJM Catalyst Insights Council members detail how providers are looking to direct-to-consumer telemedicine and partnerships to meet the differing needs of their patient populations.

Opelka01_pullquote - ACS IPU team-based surgical care bundles playbook

Developing a Playbook for IPU-based Surgical Care and New Payment Models

The complexity associated with most surgery lends itself to the integrated practice unit structure, with its focus on the care team and value-based payment.

Convenient Care Has Been Good Overall for the Health Care Industry

New Marketplace Survey: Convenient Care — Opportunity, Threat, or Both?

A survey of the NEJM Catalyst Insights Council shows conflicting views about both the value of convenient care and what respondents’ organizations should do.

Payer-Provider Partnerships Produce Better Quality Outcomes 3 - community health plan - physician partnership

New Research Shows How Payer-Provider Partnerships Can Accelerate Adoption of Evidence-Based Care

Five best practices that are replicable and scalable are facilitating improved clinical and financial outcomes today.

30-Day Mortality Rates at Non-Teaching and Major Teaching Hospitals 2013-2014 - value-based care at academic medical centers

What Value-Based Payment Means for Academic Medical Centers

Academic medical centers must become as dedicated to advancing operational and clinical efficiency as they have been to advancing the science of medicine.

Medicare Compared to Private Spending Cumulative Growth 2009-2019 - traditional Medicare coverage

Redesigning Medicare to Work for Everyone

A proposal to improve the Medicare benefit package.

Pronovost04_pullquote payer interoperability data exchange

Promoting Interoperability: Roles for Commercial Payers

Interoperability is a business imperative for enhancing value in health care, and providers and payers must collaboratively meet the demands for data exchange.


A weekly email newsletter featuring the latest actionable ideas and practical innovations from NEJM Catalyst.

Learn More »


Platforming Health Care to Transform Care…

Health care leaders need to focus less on ownership and control of the delivery process,…

From the Commonwealth to Obamacare: Reflections…

The former Executive Director of the Commonwealth Health Insurance Connector — a model for the…

Build vs. Buy: What Should Health…

The consolidation craze continues, but vertical integration has yet to demonstrate real progress toward the…

Insights Council

Have a voice. Join other health care leaders effecting change, shaping tomorrow.

Apply Now