Care Redesign

Standardizing Patient Outcomes Measurement

Article · March 14, 2016

The arc of history is increasingly clear: health care is shifting focus from the volume of services delivered to the value created for patients, with “value” defined as the outcomes achieved relative to the costs.1 But progress has been slow and halting, partly because measurement of outcomes that matter to patients, aside from survival, remains limited. And for many conditions, death is a rare outcome whose measurement fails to differentiate excellent from merely competent providers.

Experience in other fields suggests that systematic outcomes measurement is the sine qua non of value improvement. It is also essential to all true value-based reimbursement models being discussed or implemented in health care. The lack of outcomes measurement has slowed down reimbursement reform and led to hesitancy among health care providers to embrace accountability for results.

If we’re to unlock the potential of value-based health care for driving improvement, outcomes measurement must accelerate. That means committing to measuring a minimum sufficient set of outcomes for every major medical condition — with well-defined methods for their collection and risk adjustment — and then standardizing those sets nationally and globally.

Why has arriving at the essential measures of performance been so difficult in health care, when it seems to occur naturally in other fields? First, in health care we’ve allowed “quality” to be defined as compliance with evidence-based practice guidelines rather than as improvement in outcomes. Of the 1958 quality indicators in the National Quality Measures Clearinghouse, for example, only 139 (7%) are actual outcomes and only 32 (<2%) are patient-reported outcomes (see bar graph Categories of Quality Measures Listed in the National Quality Measures Clearinghouse (NQMC)).2 Defaulting to measurement of discrete processes is understandable, given the historical organization of health care delivery around specialty services and fee-for-service payments.

Categories of Quality Measures Listed in the National Quality Measures Clearinghouse

Categories of Quality Measures Listed in the National Quality Measures Clearinghouse. Click To Enlarge.

Yet process measurement has had limited effect on value. Such measures receive little attention from patients, who are interested in results. Process measures don’t truly differentiate among providers, so incentives for improvement are limited. Nor does improving process compliance from 95% to 98% matter much for outcomes. Yet the effort required to measure processes and ensure compliance consumes organizations’ resources and attention, leading to clinician skepticism about the value of measurement, which spills over to outcomes measurement.

Second, the limited outcomes measurement that has occurred has been led overwhelmingly by specialty societies. But outcomes are not strictly related to individual specialties or procedures; they reflect the overall care for a patient’s medical condition, in which multiple specialties are usually involved. What generally matters to patients are outcomes that encompass the whole cycle of care — including health status achieved (e.g., survival, functional status, quality of life); the time, complications, and suffering involved in getting care; and the sustainability of benefits achieved (e.g., time until recurrence).

Specialty societies naturally focus on their constituents, often choosing measures that physicians can reliably control. The perspective expressed, for example, in a cardiology society’s statement that “outcome measures are highly desirable but often difficult to incorporate into performance measure sets because of vulnerability to influences outside the provider’s control”3 distances providers from the work of improving patients’ actual results and contributes to outcomes-measurement paralysis.

Third, efforts at outcomes measurement have overwhelmingly focused on clinical status (e.g., survival and “objective” outcomes that are readily captured by laboratory tests) and left out functional status, even though improving functional status is why patients seek care. Billing data also don’t capture suffering due to the delays, chaos, confusion, and complications that often characterize health care. These omissions reflect clinicians’ inclination to focus on readily accessible data, as well as the fact that many outcome measures developed to date have emerged from controlled clinical trials, which often have a single primary clinical end point. Patient-reported outcomes are beginning to be measured but are not yet routinely captured for most conditions.

Finally, progress on outcomes measurement has been slowed dramatically by the “let a thousand flowers bloom” approach, in which each organization reinvents the wheel, tweaks existing measures and risk factors, or invents ones of their own. Sensitivity to physicians’ concerns about being judged unfairly results in a tendency to exclude patients from outcomes comparisons instead of incorporating accepted risk-adjustment methods. This approach reduces the percentage of patients whose data are included in performance measurement and compromises comparability with data from other providers.

This history has led to a patchwork of inconsistent outcomes measures and definitions used by various provider organizations, specialty societies, payers, countries, and even individual clinicians. There have been no effective mechanisms for standardizing outcomes measures regionally or nationally, much less globally. Each organization that sets out to measure outcomes thus faces an arduous process of agreeing on what to measure and how, and then convincing reluctant providers to go along with it. The ability to compare performance, spark competition, and foster learning is compromised.

The time has come to change this trajectory. Providers, payers, patient-advocacy groups, and regulators can come together to create a process to agree on a minimum sufficient set of outcomes for each important medical condition — including rigorous definitions, risk-adjustment factors, and methods. Then we can agree on standardizing these measures both nationally and internationally. The establishment of standards will speed up measurement, allow providers to collect and share data on outcomes more efficiently, and allow comparisons that will accelerate care improvement.

Some steps have already been taken along this path. Guidelines from professional societies are starting to incorporate more outcomes measures, albeit ones still focused on procedures rather than medical conditions. There are a few examples of societies collaborating on broader sets of outcomes for conditions, though progress remains slow.

There is also a new institutional approach that offers a promising proof of the concept that standardization of outcomes-measure sets can be achieved rapidly for a growing range of conditions. The International Consortium for Health Outcomes Measurement (ICHOM) has convened groups of experts on specific conditions, together with patient representatives, to outline minimum standard outcome sets and risk factors using a structured process. ICHOM has approved or is in the final stages of approval of more than 20 sets covering about 45% of disease burden in the United States and other high-income countries, with many more to come (see table International Consortium for Health Outcomes Measurement’s Standardized Outcome Sets). The international nature of the effort has allowed participants to see that patients with a given condition have the same or similar needs everywhere. Reaching agreement among international groups of clinicians on condition-specific outcomes sets has been surprisingly straightforward.

International Consortium for Health Outcomes Measurement’s Standardized Outcome Sets

International Consortium for Health Outcomes Measurement’s Standardized Outcome Sets. Click To Enlarge.

ICHOM working groups understand that their role is not to devise new outcomes measures but to agree on which well-validated ones, including patient-reported measures, everyone should use. These standards are putting providers, payers, patients, and information technology vendors on a common path for tracking what needs to be tracked, making implementation of outcomes measurement easier and more efficient. Organizations may collect additional measures, but everyone is encouraged to deploy the minimum set.

We think the feasibility of outcomes standardization is now clear, and broad adoption of the standard sets is beginning. The experience thus far demonstrates that respected clinicians are eager to participate, the process of agreeing on standards is practical and effective, and standard sets can be well documented and published in respected journals.

As adoption of these sets spreads rapidly, the tools and methods for implementing them efficiently are being developed. Information technology vendors are creating software solutions to automate outcomes-data collection and aggregation and have begun embedding the standard sets in electronic medical records. A data platform to allow voluntary provider benchmarking and learning on a condition-by-condition basis is under development.

We predict that a time will soon come when it will be hard to believe that measurement of outcomes that mattered to patients was rare in 2016 — and organizations that measured them each did it in their own way. Universal measurement and reporting of outcomes won’t happen overnight. But we believe that agreeing on and implementing respected standard sets of outcomes for each medical condition is a practical and decisive step in accelerating value improvement in health care. This is an agenda whose time has come.

Source Information

From Harvard Business School (M.E.P.), the Boston Consulting Group (S.L.), Press Ganey (T.H.L.), and Harvard Medical School (T.H.L.) — all in Boston.

 

This Perspective article originally appeared in The New England Journal of Medicine.

New Call for Submissions ­to NEJM Catalyst

Connect

A weekly email newsletter featuring the latest actionable ideas and practical innovations from NEJM Catalyst.

Learn More »

More From Care Redesign
Patient Outcomes Stratified by Low, Moderate, and High-Risk HEART Score

Improving Emergency Department Care for Low-Risk Chest Pain

How Kaiser Permanente Southern California improved ED standard of practice for possible acute coronary syndrome by adopting an evidence-based clinical decision tool.

Academic Innovations Collaborative Colorectal Cancer Driver Diagram - Leading Transformational Change in Primary Care Delivery

Five Keys to Leading Transformational Change in Primary Care

Lessons learned from a Harvard Medical School intervention to strengthen primary care delivery that emphasized teamwork, reflection, and leadership engagement.

Providing Free Food as a Treatment for Diabetes Yields Improved Outcomes for Patients While Reducing Cost of Care - Fresh Food Farmacy - Geisinger program for addressing food insecurity in patients with diabetes

Prescribing Food as a Specialty Drug

Geisinger’s program of providing free food as a treatment for diabetes yields improved outcomes for patients while reducing the cost of care.

Care Design - The H-Evolution of Intensive Care Units - ICU and Human Care Bundle Human-Centered Care Model

My Favorite Slide: The ICU and the Human Care Bundle

Eight aspects of care to improve ICU management from a human-centered care model.

Ring01_pullquote_ Specialty Musculoskeletal Care Services for the Underserved

Specialty Care for the Underserved

The opening of a new medical school provided impetus to restructure musculoskeletal services to give the safety-net population timely access to needed specialty care.

Levels of Independent Empowered Self-Dialysis

Is “Empowered Dialysis” the Key to Better Outcomes?

Self-dialysis patients enjoy far lower mortality and hospitalization rates and far better attitudes about treatment. But there are hard limits to its adoption.

cognitive load theory implications for health care pullquote

Cognitive Load and Its Implications for Health Care

If we recognize and address the limits of brainpower, we can become better caregivers.

Integrated Care - Most effective means of integrating mental and behavioral health services

Survey Snapshot: Integrated Care Makes Sense — but Barriers Remain

NEJM Catalyst Insights Council members call for integration of mental and behavioral health services with primary care.

Health Inequities Racial/Ethnic Disparities in Health Care - Choosing Wisely Clinician-Led Approach

Reducing Racial/Ethnic Inequities in Care: A Clinician-Led Approach

Using the “Choosing Wisely” campaign against low-value care as a model for addressing health care disparities.

Lee B. Sacks Photo

Halfway to Zero Serious Safety Events

How daily huddles have played a key role in Advocate Health Care’s journey toward zero serious safety events by 2020.

Connect

A weekly email newsletter featuring the latest actionable ideas and practical innovations from NEJM Catalyst.

Learn More »

Topics

Primary Care

148 Articles

Five Keys to Leading Transformational Change…

Lessons learned from a Harvard Medical School intervention to strengthen primary care delivery that emphasized…

Social Needs

61 Articles

Embedding Health Care in the Community

If we are going to work with local communities, we must humbly acknowledge that we…

Mental Health

18 Articles

Messaging System Helps Caregivers Keep Tabs…

One behavioral health provider pilots cost-effective outreach to patients with SUD that checks up on…

Insights Council

Have a voice. Join other health care leaders effecting change, shaping tomorrow.

Apply Now