Leadership

Using Simulations to Improve Physician Leadership Hiring

Case Study · May 16, 2018

To determine whether candidates for department chairs have leadership skills to match their impressive CVs, our academic medical center incorporated simulated employee encounters into our hiring process. We require that chair candidates participate in simulations to assess their skill at navigating moderately tense, challenging conversations with smart, highly motivated physician employees. Almost 30% of otherwise qualified candidates failed the simulations. Three of the four chairs hired under the process have started their tenure and appear to have the respect of their employees.

Key Takeaways

  1. When searching for health care leaders, simulations of tense leader/physician conversations can reveal leadership behaviors that aren’t measurable through interviews, behavioral interviews, CV reviews, or reference checks.

  2. In the majority of cases, search committee members are confident in their appraisal of the success or failure of a candidate participating in a simulation. Even untrained observers know good (and bad) leadership when they see it.

  3. Given the modest time investment to create and execute a simulation, it’s a worthwhile activity to incorporate into a search process, and it can save the organization from the anguish of being tied to a mediocre (or worse) leader.

The Challenge

In our institution, as in most academic medical organizations, chairs are enormously powerful and in some cases are responsible for more than 450 direct or indirectly reporting employees, including hundreds of physicians. The chair is expected to motivate and inspire a diverse group including smart, ambitious, overworked physicians, and also to hold them accountable to the standards of our organization.

It is a task that presents new challenges to most. Department chairs often get to their positions on the strength of their clinical reputation, academic background, publication record, and letter of interest. Typically, their last hurdle is successfully conversing during group and individual interviews.

However, once in a position of authority, all too often they alienate their talented workforce with excessive authoritarianism, poor listening skills, or an inability to manage conflict. In my role as Vice Dean, I know it’s only a matter of time before I have to calm down a physician who has butted heads with a department chair who probably should never have been put into this type of managerial position: the kind of boss who stands on his or her employee’s foot and simultaneously asks what the problem is.

Coping with the fallout from poor leadership takes everyone’s time: mine, the Chief Medical Officer’s, our risk management staff, and our human resources department. It’s bad for morale and our work environment, and it may drive away the talented physicians, nurses, and other clinicians on whom we depend.

Problematic department chairs generally don’t lie or mislead us during our hiring process. It’s the process that is the problem. We are like a bus company hiring bus drivers that asks applicants to talk about driving a bus, instead of showing how they drive a bus through narrow intersections, back up to a fuel tank, or maneuver into a tight parking spot despite rowdy passengers. We needed a way to measure the competencies demanded by a department chair position that don’t show up in a CV or during a standard interview.

The Goal

Determine whether simulated employee encounters could help us assess the interpersonal leadership skills that truly matter in health care leadership, during the interview process.

The Team

I coordinate all our chair searches. There were four search teams for four positions, and in each one, the search committees, consisting of 8 to 10 faculty and a few chairs, were active participants in the process. Two of us, both full professors who have held administrative positions and were familiar with these physician complaints, served as mock physician faculty members during simulations.

The Execution

After explaining the simulation concept and what we hoped to achieve to the Vice President for Health Affairs/Dean and search committees, we began using the simulations in consecutive searches for the chairs of pediatrics, medicine, family and community medicine, and neurology.

I wrote a scenario and distributed it to the candidates a few weeks before their interview, so that they would have time to consider how they might respond. While having the scenario in advance might seem like getting the answers to the exam, in my experience a department chair usually has some warning that a tense faculty member will be wanting to meet, so letting the candidates know about the simulation mimics real life.

Each candidate came in for a 90-minute group interview with the search committee. Those that passed this stage of the search would be invited back for more in-depth multiday interviews. The simulations were part of this initial interview.

About a third of the way through his or her group interview, each chair candidate was asked to interact with one of our “actors” playing a mildly disgruntled young physician/faculty member. In the scenario, the relatively new faculty member has a mild performance issue but also feels he or she is not getting the support necessary to do his or her job effectively, and is respectfully upset with the chair. Other specialty-appropriate details were included. In the scenario, the simulated physician is not “once-in-a-career-enraged,” but rather moderately irritated. At the same time, the scenario notes some performance issue: for example, that the faculty member has been seeing fewer patients than colleagues and has cancelled some clinics, a “no-no” in our culture.

After the interaction, we asked a few follow-up questions to encourage the candidate to reflect on how it went. We always asked, “Is there anything you would have done differently?” The entire process took about 10 minutes.

The Results

These situations are so common that I expected every candidate with any experience leading physicians would be adroit in executing a simple conversation to address the main points.

I was wrong.

Almost a third of the well-qualified candidates (who had impressive CVs, came from reputable institutions, and had otherwise handled the interviews well) failed these simulations. The behaviors that led to the failures varied but were almost universally viewed as problematic by the search committees who voted. Some candidates immediately came down with too much force, ignoring the physician’s concerns and starting with performance concerns (even though in the scenario these were mild). Others lectured and talked too much, failing to listen to the physician’s concerns, and one even pried into the irrelevant personal life of the physician, wondering about his marriage.

The simulations revealed behaviors and stylistic approaches that were not consistent with our values and would probably be problematic for leadership roles in any institution like ours.

In contrast, the successful candidates listened carefully to the physician, noted strategies they might adopt to address his or her frustrations (including tapping other people who might helpful), and generally had a looser, more curious tone. They also all suggested more regular contact in the near future and many ended by saying, “This is the start of a relationship — we don’t need to fix everything today.” The general tone was open, non-defensive, and nonjudgmental, but also firm. The candidates acknowledged and validated the physician’s feelings and perceptions and demonstrated a willingness to address the issues raised.

Notably, a few of the most successful candidates also expressed some regrets after the scenario. One lamented, “I made a joke too early. He wasn’t ready for that yet and I had to work to recover.” This remark showed insight and a willingness to evaluate interactions and learn from them.

It is interesting that at least in this small sample of candidates, the search committees were usually unanimous in evaluating which candidates had passed the simulation and which had failed. Some failed more dramatically than others, but our search committees turned out to be fairly consistent in how they rated a “successful” encounter.

Most candidates stated enthusiasm for the process. We had not anticipated that candidates might want to show off their people-handling skills, but the simulation does give them an additional opportunity to sell themselves to the committee, especially if they have not led a large clinical enterprise or have other “holes” in their CV.

Metrics

Eleven out of 37 candidates, or 29%, failed the simulation. We’ve successfully hired four chairs using this process. Three have started and all appear to have the respect of their physician faculty employees. It will take several more searches, as well as tracking the performance of the chairs we hire, to fully evaluate this approach, but we have built it into our process and are planning to use it for all our executive leadership searches going forward.

Where to Start

  • Identify a common people-management challenge presented in the job. In our case, the scenario requires that the leader hold the physician accountable, but also listen. Survey current leaders to identify a common, mildly tense leadership challenge that would be amenable to a conversation.
  • Anticipate some pushback. Most colleagues were supportive and curious, but our search firm worried that having to do a simulation would chase off talented candidates, and a few search committee members worried the simulation would measure acting rather than other skills. (Some may say that the ability to act is in itself a desirable skill for these roles.)
  • Base the process on the skills you’re trying to measure. We had debate about when to provide the scenario to candidates. In the real world, most of our leaders have some notice about challenging conversations that are coming, and can prepare. Our goal wasn’t a “gotcha” experience, but rather a true measure of the leader’s communication style on a good day. In some contexts, it might be preferable simply to notify candidates that a simulation is coming, but not share details until the time.
  • Recruit “actors” who are familiar with the details that make up the basis for the scenario. For example, if the physician is going to complain about a lack of outpatient support, it would be good for the actor to know exactly how many receptionists, licensed practical nurses, and rooms there are available in a typical clinic.

Call for submissions:

Now inviting expert articles, longform articles, and case studies for peer review

Connect

A weekly email newsletter featuring the latest actionable ideas and practical innovations from NEJM Catalyst.

Learn More »

More From Leadership
Action Steps for Risk-Share Contracts for Medical Devices

Challenges and Best Practices for Health Systems to Consider When Implementing Risk-Share Contracts for Medical Devices

When done right, value-based contracting for medical devices can ameliorate shrinking margins at health systems, leading to a virtuous circle.

Health Care Organizational Culture Emphasizes Patient Care Only Slightly More Than the Bottom Line

Survey Snapshot: Who Should Lead Culture Change?

NEJM Catalyst Insights Council members feel that culture change at their organizations is heading in the right direction, but differ on who it should come from, and reveal too much balance between emphasis on bottom line and emphasis on patient care.

Culture Change Within Health Care Organizations Is Changing for the Better

Leadership Survey: Organizational Culture Is the Key to Better Health Care

Although three-quarters of Insights Council survey respondents say culture change is a high or moderate priority at their organizations, survey results show a lot of work on organizational culture remains to be done.

Metraux01_pullquote - dinners to combat burnout in the health care community

“Breaking Bread” to Combat Burnout

Can a simple dinner create community among health care providers?

IHI HPMS Visual Management Board Example

The Answer to Culture Change: Everyday Management Tactics

Adoption of a clear rhythm-of-performance measurement and communication via huddles and visual management can affect a culture of staff engagement and continuous value improvement.

ajor Themes from Cleveland Clinic Town Halls 2016

Reigniting the Passion to Practice Through a Multi-Pronged Approach

Cleveland Clinic formed the Practice Innovation and Professional Fulfillment Office to create and sustain an environment that allows clinicians and scientists to thrive through barrier removal, culture change, and support for personal well-being.

Percent in Highest Bracket in Patient Satisfaction Scores - Pre-Post Arm Differences for Hospitalists - Duke Coaching Communication Skills Study

Coach, Don’t Just Teach

The effect of one-on-one communication coaching on clinicians’ communication skills and patients’ satisfaction.

Two-Thirds of Organizations Have a Nurse Leader Career Path

Survey Snapshot: Do Nurse Leaders Need Advanced Degrees?

Though NEJM Catalyst Insights Council members acknowledge a lack of advancement opportunities for nurse leaders, two-thirds of their organizations have a nurse leader career path.

Nurse Leaders and Physician Leaders Should Be Considered Equals in Care Delivery - but Views of Nurses and Non-Nurses Differ

Leadership Survey: Nurses as Leaders: Broad Acceptance, Room to Grow

Nurses are traditionally the backbone of patient care. They form the largest percentage of the health care workforce, far outstripping physicians. But are nurses leaders as well as doers?

The CMO Role of the Future - Baptist Health Survey Results

Examining the Continuously Evolving Role of the Chief Medical Officer

Hospital and system leaders need to sharpen the focus of CMO roles to include system-wide considerations beyond the walls of the hospital.

Connect

A weekly email newsletter featuring the latest actionable ideas and practical innovations from NEJM Catalyst.

Learn More »

Topics

Physician Burnout

45 Articles

“Breaking Bread” to Combat Burnout

Can a simple dinner create community among health care providers?

Leading Transformation

264 Articles

Finding the Cause of the Crises:…

Until we redesign our health care system to address our patients’ personal determinants of health,…

Leading Teams

164 Articles

Survey Snapshot: Who Should Lead Culture…

NEJM Catalyst Insights Council members feel that culture change at their organizations is heading in…

Insights Council

Have a voice. Join other health care leaders effecting change, shaping tomorrow.

Apply Now