Skip to main content
NEJM Catalyst homepage

Primary Care Visit Cadence Based on Risk: A Comparison of Machine Learning and Provider Judgment

Published March 16, 2022
NEJM Catal Innov Care Deliv 2022;3(4)
DOI: 10.1056/CAT.21.0322

Abstract

More frequent primary care visits are associated with improvements in health outcomes and overall well-being and a reduction in health care disparities. Visit cadence is a core part of Oak Street Health’s value-based care model. Although its providers are generally good at predicting a patient’s risk of mortality, they are less accurate at predicting nonmortality outcomes, and they may not update each patient’s risk level in a timely manner. Oak Street launched a pilot initiative to assess whether machine-learning models could outperform provider visit cadence assignment in predicting three key outcomes: acute inpatient admissions, medical cost, and mortality. Pilot results demonstrated that the models were more accurate than provider judgment alone at identifying patients’ risk of admission and future medical cost. On the basis of these positive findings, Oak Street deployed the machine-learning tiering across the organization, with more than 90% of all eligible patients assigned a tier that is routinely refreshed using the predictive models.

Notes

We thank Mark Bustamante, MD, Michele Mitchell, MD, Rafe Petty, PhD, Scott Belsky, Ezinne Ndukwe, the Risk Stratification Working Group, Weekly Planning medical director partners, pilot participants, Oak Street Health care teams, Pop Health director partners, executive medical director partners, Business Intelligence, Canopy Product and Engineering teams, and the Center for Applied Artificial Intelligence at the University of Chicago.
Surabhi Bhatt, Natalia Majerczyk, Jenna Rose, Adam Cohon, Brian Cozzi, Drew Crenshaw, Alex Kreig, and Griffin Myers have nothing to disclose.

Information & Authors

Information

Published In

NEJM Catalyst Innovations in Care Delivery

History

Published online: March 16, 2022
Published in issue: March 16, 2022

Topics

Authors

Affiliations

Surabhi Bhatt, MS
Manager, Population Health, Oak Street Health, Chicago, Illinois, USA
Natalia Majerczyk
Senior Associate, Population Health, Oak Street Health, Chicago, Illinois, USA
Jenna Rose, MHS
Vice President, Population Health, Oak Street Health, Chicago, Illinois, USA
Adam Cohon, PhD
Data Scientist, Oak Street Health, Chicago, Illinois, USA
Brian Cozzi, MS
Senior Data Scientist, Oak Street Health, Chicago, Illinois, USA
Drew Crenshaw
Chief Population Health Officer, Oak Street Health, Chicago, Illinois, USA
Alex Kreig, PhD
Senior Vice President, Data Science, Oak Street Health, Chicago, Illinois, USA
Griffin Myers, MD, MBA
Chief Medical Officer, Oak Street Health, Chicago, Illinois, USA

Metrics & Citations

Metrics

Altmetrics

Citations

Export citation

Select the format you want to export the citation of this publication.

View Options

View options

PDF

View PDF

Full Text

View Full Text

Media

Figures

Other

Tables

Share

Share

CONTENT LINK

Share

Navigating the Clinician Shortage Crisis - Mobile
Navigating the Clinician Shortage Crisis - Tablet Navigating the Clinician Shortage Crisis - Desktop

Navigating the Clinician Shortage Crisis

Explore the magnitude of the staffing crisis and creative solutions for a path forward.