Care Redesign

Why Cleveland Clinic Shares Its Outcomes Data with the World

Article · February 29, 2016

Cleveland Clinic has a long history of measuring and reporting data on health outcomes, most famously in our Outcomes Books, the yearly reports on how patients treated in our different departments fare. We’ve realized that you cannot improve something if you don’t measure it and share what you find — so in that vein, I’d like to share some of our experiences in building this system at Cleveland Clinic.

We began tracking clinical outcomes for cardiac patients in 1979, and we have been using such data to facilitate accountability and learning since 1989. In 1998, we began publishing and distributing that data to referring physicians. In 2004, CEO Dr. Toby Cosgrove extended the expectation of measuring and publicly reporting outcomes to other clinical areas. This eventually produced what are now called the Cleveland Clinic Outcomes Books: 14 in all, published annually and publicly available online.

As the chair of the Outcomes Books editorial board, I work with my fellow board members to make the principle of transparency a practical reality and a worldwide source of learning. What we achieve at Cleveland Clinic is obviously not perfect, but allowing all comers to see what we do helps everyone, including us, get better. Indeed, the chief purpose of the Outcomes Books is to be a catalyst for quality improvement in patient care and outcomes. Annually reporting our results, whether good or bad, motivates us to improve them.

Our secondary purpose is to inform medical decision making — specifically, to communicate to a clinician what to expect when referring a patient to Cleveland Clinic for a particular condition. For example, our outcomes data for patients who undergo radical prostatectomy for clinically localized prostate cancer show that the risk for survival without biochemical relapse within five years is 94%. Notably, the purpose is simply to inform the clinical decision maker, not to drive referrals to Cleveland Clinic.

In fact, we obligate ourselves to report all useful outcomes that we measure, regardless of how we look relative to our peers and regardless of what we are required to publicly report. Sometimes clinicians are surprised by how good we are — or startled that we do not perform better than we do. When possible, we compare ourselves with recognized benchmarks or simply with ourselves over time. Even if we cannot observe a meaningful trend or benchmark comparison, we report our outcomes anyway.

How do we guard against cherry-picking outcomes? Each book is reviewed by the Outcomes Books editorial board — a group of 18 volunteers, primarily physicians representing 14 clinical institutes plus a few statisticians. This group helps to identify missing outcomes that should be reported, as well as outcomes that are unclearly presented or poorly measured.

We have been annually producing our Outcomes Books for more than a decade, but we certainly have room for improvement. Sometimes, for particular treatment–condition combinations, we have only volume or process measures. In those cases, we report what we have, with an eye toward better measurement next time. In consultation with Cleveland Clinic’s Quantitative Health Sciences Department, we always look for better data sources and methods of analysis.

Nonetheless, it is challenging to accurately measure all outcomes that are of interest to clinicians. Ideally, data for many measures should come directly from the patient (for example, the severity of hip-related pain one year after a hip-replacement operation). But if patients do not return to Cleveland Clinic for follow-up care, getting that information is not easy.

We do our utmost to grow the number of reported outcomes by challenging the 14 institutes to measure more outcomes as best they can — and to document their progress in a yearly improvement report. Many of the institutes have taken up that challenge.

For health care institutions that want to emulate our outcomes reporting, here are some suggestions:

  1. Identify the target audience, because the audience shapes the reporting. We have chosen peer physicians, but one could argue the case for patients, employers, or even commercial insurers as target audiences. Whatever audience you choose, make the choice early — it will greatly affect how you present the data, the language you use, and the look and feel of your published products.
  2. Recognize that most measures of substantial interest are the long-term ones, so they are likely to take years to collect properly. Fortunately, we were a very early adopter of an electronic health record system, which has greatly facilitated some of our measurement. However, organizations just starting down this road may have a very limited number of outcomes available for reporting, which could be discouraging, although specialties that report to national registries can begin with those data. Wherever you are now in this process, have hope: The many pages of measures that Cleveland Clinic reports across our 14 books has grown considerably, even though we started relatively small.
  3. Accept that reporting outcomes requires resources, and plan to fund and support your effort. Data collection, preparation, analysis, and reporting all take time and effort from many people. If the top leadership of your organization supports the effort to report outcomes, it is much more likely to be sustainable.

I recognize that this advice may not work for every institution, given the wide variation in size, location, clinical population, resources, and so on. My modest hope is that our work at Cleveland Clinic will help you tailor your own outcomes-reporting program so that it serves you and, ultimately, the patients cared for at your institution. In an ideal world, a fully informed consumer and his or her physician could compare expected health outcomes and costs — the total value of care — across all of the institutions where such care is provided.

New call for submissions ­to NEJM Catalyst

Now inviting longform articles

Connect

A weekly email newsletter featuring the latest actionable ideas and practical innovations from NEJM Catalyst.

Learn More »

More From Care Redesign
Charlotte Yeh head shot - hearing aids hearing loss

“You’re Old Without Hearing Aids”— Addressing the Silent Epidemic of Hearing Loss

Hearing loss isn’t a normal consequence of aging. But it is associated with a higher risk of dementia, depression, and falls. The Chief Medical Officer for AARP Services talks about combating this huge but silent epidemic that impacts all ages.

Dentzer01_pullquote - Stone-Age Policies Stifle Modern Virtual Care Solutions

Stone-Age Policies Stifle Modern Solutions

Health care leaders must advocate for regulatory and reimbursement changes to unlock the potential of innovative technology and care team approaches to Parkinson’s and other suitable conditions.

Idiopathic Pulmonary Fibrosis IPF Multidisciplinary Collaborative Care Model

From Consulting to Caring: Care Redesign in Idiopathic Pulmonary Fibrosis

A multidisciplinary collaborative model to address the palliative care needs of patients with idiopathic pulmonary fibrosis resulted in improved end-of-life care and decreased hospital deaths.

Impact of PCSP on Patient Satisfaction at Providence Heart Clinic

Transforming Specialty Practice in Pursuit of Value-Based Care: Results from an Integrated Cardiology Practice

Despite significant primary care reform around patient-centered medical home models, specialty care remains fragmented, with poor communication between primary care and specialists. How should specialty practices be reformed to deliver more coordinated, patient-centered care?

Michael Bennick Yale New Haven Hospital Medical Director of the Patient Experience - Yale Living History Project

The Living History Project: Open-Ended Patient Interviews Create a Therapeutic Bridge

A program at Yale has students conduct open-ended interviews with patients about their lives, their hopes, their values, and what they most want their medical team to know — creating the opportunity for human connection and a better care experience.

Fisher02_pullquote hypertension guidelines

Hypertension Guidelines: Achieving 90% Success

Focused and innovative health systems are managing to control blood pressure for 9 in 10 patients, which is well above the national average of 50% to 60%.

Health Care Organizations Are Moderately Effective in Using Data

Survey Snapshot: Using Data for Change

NEJM Catalyst Insights Council members discuss how data and analytics are being used at their organizations, both now and with the future in mind.

Percentage of U.S. Adult Hemodialysis Patients Achieving Dialysis Adequacy, 2013-2016. Data will be released in early 2019.

Innovation in Dialysis: Continuous Improvement and Implementation

The U.S. dialysis sector has been criticized for its lack of innovation, but this criticism disregards the kidney community’s success in creating — and continuously improving on — dialysis as a safe, globally scaled, quality-oriented outpatient therapy.

Cleveland Clinic Time-to-Treatment Cancer Programming Overall Scorecard 2015-2017 Sample

Reducing Time-to-Treatment for Newly Diagnosed Cancer Patients

How Cleveland Clinic initiated a multidisciplinary program to reduce time-to-treatment and accomplish a 33% reduction.

Treatment Authorization Increases and Rapid Boost in New Mexico Medicaid Members Treated for Chronic HCV

A Collaborative Model to Expand Medicaid Treatment Coverage for Chronic Hepatitis C Virus

How managing the benefit coverage expansion for the treatment of HCV in New Mexico was successfully achieved after less than 2 years.

Connect

A weekly email newsletter featuring the latest actionable ideas and practical innovations from NEJM Catalyst.

Learn More »

Topics

Mental Health

29 Articles

Stay in Your Lane? Clinicians vs.…

Should physicians stay in their clinical lanes when it comes to behavior change and social…

Opioids Epidemic

25 Articles

New Evidence on Stemming Low-Value Prescribing

New research suggests that deploying strong and surprising messages could help to address overprescribing of…

Coordinated Care

134 Articles

Disrupting the Payment Model

We should modernize our payment mechanisms to reflect the reality of our digitally enabled lives.

Insights Council

Have a voice. Join other health care leaders effecting change, shaping tomorrow.

Apply Now