Transcription
Results of the 2021 NRMPProgram Director SurveyAugust 2021www.nrmp.org
Questions about the contents of this publication may be directed to National Resident MatchingProgram at datarequest@nrmp.org.Questions about the NRMP should be directed to Donna L. Lamb, D.HSc., M.B.A., B.S.N.,President and CEO, National Resident Matching Program, (202) 400-2233 or admin@nrmp.org.Suggested CitationNational Resident Matching Program, Data Release and Research Committee: Results of the2021 NRMP Program Director Survey. National Resident Matching Program, Washington, DC. 2021.Copyright 2021 National Resident Matching Program. All rights reserved. Permission to use,copy, and/or distribute any documentation and/or related images from this publication shall beexpressly obtained from the NRMP.
Table of ContentsIntroduction . 1All Specialties . 3Charts for Individual SpecialtiesAnesthesiology . 14Child Neurology . 25Dermatology . 36Emergency Medicine . 47Family Medicine . 58Internal Medicine . 69Internal Medicine - Pediatrics . 80Neurology. 91Neurological Surgery . 102Obstetrics and Gynecology . 113Orthopaedic Surgery . 124Otolaryngology . 135Pathology . 146Pediatrics . 157Physical Medicine and Rehabilitation . 168Plastic Surgery . 179Psychiatry . 190Radiology-Diagnostic . 201Radiation Oncology . 212Surgery . 223Transitional Year . 234
IntroductionIn March 2021, the National Resident Matching Program (NRMP) conducted its survey of directorsof all programs participating in the Main Residency Match . The Program Director Survey usually is a biennialsurvey conducted by the NRMP in even years (e.g., 2018, 2020) with the primary purpose of characterizing thefactors that Program Directors use to (1) select applicants to interview, and (2) rank applicants forthe Main Residency Match. However, because of the unprecedented circumstances resulting from the COVID19 pandemic and the consequent move to virtual recruitment and interviewing for July 2021 residencyappointments, the NRMP decided to administer the Program Director Survey in 2021.The survey was issued to program directors who certified a rank order list as part of the 2021 Main ResidencyMatch. It was fielded during the 11 days between the Rank Order List Certification Deadline and the start ofMatch Week to prevent match outcomes from influencing respondents' answers. The survey included many ofthe items from the 2020 survey questionnaire along with questions intended to query program directors’experiences with the virtual recruitment process. Specifically, the survey solicited information on: the number of applications received, screened, and reviewed, as well as the number of applicantsinterviewed and ranked;the frequency with which programs interviewed and ranked specific applicant groups;use of test scores in considering which applicants to interview;applicant characteristics considered in both interview selection and ranking; andexperiences with virtual recruitment, including:o approaches used to engage and communicate with potential applicants,o potential challenges posed by the virtual environment, ando whether programs anticipated conducting part or all of the application or selection processesvirtually in the future.General findings concerning the virtual recruitment experience of programs have been published to the NRMPwebsite in a research brief; additional analyses will be reported in a future document.Some items from prior administrations of the Program Director Survey were deleted for the 2021administration in order to allow for robust questioning about the virtual experience while minimizing respondentburden. Deleted items included questions about: specific target scores on USMLE Step 1 and Step 2 CK exams below which programs generally did notgrant interviews and above which they almost always granted interviews;whether programs offered more invitations than interview slots and reasons for that practice;time allowed for applicants to respond to interview invitations;how programs scheduled interviews;preferred modes of communication with and about applicants during Supplemental Offer and AcceptanceProgram (SOAP) rounds; andimportance of factors such as professionalism, quality of patient care, clinical competency, and ethics inassessing residents’ success during residency.Future iterations of the survey will re-introduce questions about interview behaviors and assessment ofapplicant success in residency.The overall response rate for all specialties combined was 23.3 percent (n 1,033). Specialty-specific responserates for Transitional Year programs and programs in the 20 specialties where 10 or more responses weresubmitted are presented in the table below. The “All Others” category combines into a single group 23specialties, including 17 combined programs (e.g., Emergency d Psychiatry), that submitted fewer than 10 responses. The “All Others” category wasonly used in analyses for all specialties combined.NRMP Program Director Survey Results, 20211
SpecialtyAnesthesiologyChild NeurologyDermatologyEmergency MedicineFamily MedicineInternal MedicineInternal Medicine-PediatricsNeurological SurgeryNeurologyObstetrics and GynecologyOrthopaedic SurgeryOtolaryngologyPathology-Anatomic and ClinicalPediatricsPhysical Medicine and RehabilitationPlastic Surgery (Integrated)PsychiatryRadiation ional YearAll OthersTotalSurveys 5861783071462904,429Number 7631421,033Response 4.8%21.2%14.5%23.3%Numbers of responses are presented in most of the graphs. For those graphs reflecting data from multiplesurvey questions, the largest available N from among the survey questions is listed. Numbers of applicantsranked and positions in the Match are self-reported by respondents. Factors considered by programs (and theirmean importance) in selecting applicants for interview and ranking are presented in two sets of figures: Education and Academic Performance Characteristics: includes grades, test scores, andaccreditation status/reputation of applicants’ medical schools.Personal Characteristics and Other Knowledge: includes respondents’ perceptions of applicants’commitment to their specialties, ethics and professionalism, and, as a ranking factor, programs’interview day experiences with applicants.This report presents results on selected items for all specialties combined and separately for each specialtyidentified in the table. The NRMP hopes that applicants, program directors, and medical school officials andfaculty advisors find these data useful as they prepare for and participate in the Main Residency Match.The NRMP's data reporting and research activities are guided by its Data Release and Research Committee.NRMP data and reports can be found at: www.nrmp.org/main-residency-match-data/.NRMP Program Director Survey Results, 20212
All Specialties, Total n 1,033NRMP Program Director Survey Results, 20213
Summary of Program Interviewing and Ranking ActivitiesFigure PD 1Mean Numbers of Applications Received, Interview Invitations,Interviews, and Applicants Ranked, 2021(Total n s Applications Applicationsreceivedrejectedreceivingbased on holistic reviewstandardizedscreenNRMP Program Director Survey Results, 20214Interviewinvitationssent
Figure PD 2Summary of Program Interviewing and Ranking ActivitiesAverage Percentages of Applications Rejected and Reviewed, 2021(Total n 991)1009080706050403020100Percentages of ApplicationsRejected based on standardized screenNRMP Program Director Survey Results, 20215Received holistic review
Figure PD 3Summary of Program Interviewing and Ranking ActivitiesPercentages of Programs Interviewing Candidates by Applicant Type, 20211(Total n 902)1009023348070266360504993494028200352861US MDSr96US DOSrUS MDGradOften1 Some5460301016US DOGradSeldompercentages may not add to 100 because of rounding.NRMP Program Director Survey Results, 2021196NeverUS IMGNon-USIMG
Figure PD 4Use of Standardized Licensure Exams to Select Applicants forInterviewPercentages of Programs Using USMLE to Select US MD and IMG Applicants for Interview,20211,2(Total n 1,011)US 3421401024667717413030203810035275USMLEStep 1USMLEUSMLEStep 2 CK Step 2 CSRequire target score1437142USMLEStep 330USMLEStep 1Seniors and graduates are considered together.percentages may not add to 100 because of rounding.2 Some7USMLEUSMLEStep 2 CK Step 2 CSRequire pass only82210Prefer but do not require target scoreNRMP Program Director Survey Results, 202137364USMLEStep 3Do not consider
Figure PD 5Use of Standardized Licensure Exams to Select Applicants forInterviewPercentages of Programs Using Licensure Exams to Select DO Applicants for Interview, 20211(Total n 2847202930372010027213063114282USMLE Step USMLE Step USMLE Step USMLE Step12 CK2 CS3Require target score147473COMLEXCOMLEXCOMLEXCOMLEXUSA Level 1 USA Level 2 USA Level 2 USA Level 3PECEPrefer but do not require target scoreRequire pass onlyDo not considerDO seniors and DO graduates are considered together.number of respondents who indicated they “seldom” or “often” consider DO senior, DO graduate, or both types of applicants forinterview.3 Some percentages may not add to 100 because of rounding.12 TotalNRMP Program Director Survey Results, 20218
Program Ranking BehaviorFigure PD 6Percentages of Programs Ranking Candidates by Applicant Type, 20211(Total n 960)100903980706050965054202341US MD Sr2667US DO SrUS MDGradSeldompercentages may not add to 100 because of rounding.NRMP Program Director Survey Results, 202118US DOGradNever1Some22484730032714010279OftenUS IMG30Non-USIMG
Figure PD I1Education and Academic Performance Characteristics Consideredin Deciding Whom to Interview (%)USMLE Step 1 scoreMSPEUSMLE Step 2 CK scoreGrades in required clerkshipsAny failed attempt at USMLEClass ranking/quartileGrades in clerkship in preferred specialtyAny failed attempt at COMLEX-USAConsistency of gradesCOMLEX-USA Level 1 scoreAwards/honors in clinical clerkshipsCOMLEX-USA Level 2 CE scoreAOA membershipGHHS membershipPassing USMLE Step 2 CSAwards/honors, clerkship in preferred specialtyContinuous medical education w/o gapsMedical school accreditation statusMedical school reputationPassing COMLEX-USA Level 2 PEAwards/honors in basic sciencesSigma Sigma Phi membershipUSMLE Step 3 scoreCOMLEX-USA Level 3 scoreHow medical school handled virtual rotations8.96.60.0Figure PD 65.270.080.0Percent of Respondents Endorsing90.0100.0Mean Importance of Education and Academic PerformanceCharacteristics Considered in Deciding Whom to Interview13.7USMLE Step 1 scoreMSPEUSMLE Step 2 CK scoreGrades in required clerkshipsAny failed attempt at USMLEClass ranking/quartileGrades in clerkship in preferred specialtyAny failed attempt at COMLEX-USAConsistency of gradesCOMLEX-USA Level 1 scoreAwards/honors in clinical clerkshipsCOMLEX-USA Level 2 CE scoreAOA membershipGHHS membershipPassing USMLE Step 2 CSAwards/honors, clerkship in preferred specialtyContinuous medical education w/o gapsMedical school accreditation statusMedical school reputationPassing COMLEX-USA Level 2 PEAwards/honors in basic sciencesSigma Sigma Phi membershipUSMLE Step 3 scoreCOMLEX-USA Level 3 scoreHow medical school handled virtual rotations4.03.83.93.83.43.73.23.03.01.52.0on a scale of 1 (not at all important) to 5 (very important)NRMP Program Director Survey Results, 2021102.53.03.24.44.13.93.83.53.63.63.73.81.01 8.874.674.186.285.93.73.74.44.23.43.5Mean Importance Rating4.04.55.0
Figure PD I3Personal Characteristics and Other Knowledge of Applicants Considered inDeciding Whom to Interview (%)Letters of recommendation in specialtyPersonal statement (overall)Diversity characteristicsPerceived commitment to specialtyHaving overcome significant obstaclesProfessionalism and ethicsPerceived interest in programLeadership qualitiesVolunteer/extracurricular experiencePersonal prior knowledge of applicantOther life experienceAudition elective/rotation in PD's deptInvolvement and interest in researchAbility to work legally w/o visaVisa statusFluency in language of pt populationNRMP flag for match violationInterest in academic careerAway rotation in specialty elsewhere18.90.0Figure PD 30.040.050.060.070.0Percent of Respondents Endorsing80.090.0100.0Mean Importance of Personal Characteristics and Other Knowledge of ApplicantsConsidered in Deciding Whom to Interview1Letters of recommendation in specialtyPersonal statement (overall)Diversity characteristicsPerceived commitment to specialtyHaving overcome significant obstaclesProfessionalism and ethicsPerceived interest in programLeadership qualitiesVolunteer/extracurricular experiencePersonal prior knowledge of applicantOther life experienceAudition elective/rotation in PD's deptInvolvement and interest in researchAbility to work legally w/o visaVisa statusFluency in language of pt populationNRMP flag for match violationInterest in academic careerAway rotation in specialty 0Rated on a scale of 1 (not at all important) to 5 (very important)NRMP Program Director Survey Results, 2021112.53.03.5Mean Importance 75.573.972.370.14.55.0
Figure PD R1Education and Academic Performance Characteristics Considered in DecidingWhom to Rank (%)USMLE Step 1 scoreMSPEUSMLE Step 2 CK scoreClass ranking/quartileAny failed attempt at USMLEGrades in required clerkshipsCOMLEX-USA Level 2 CE scoreCOMLEX-USA Level 1 scoreAny failed attempt at COMLEX-USAGrades in clerkship in preferred specialtyConsistency of gradesAOA membershipGHHS membershipContinuous medical education w/o gapsPassing USMLE Step 2 CSAwards/honors, clerkship in preferred specialtyAwards/honors in clinical clerkshipsMedical school reputationMedical school accreditation statusPassing COMLEX-USA Level 2 PESigma Sigma Phi membershipAwards/honors in basic sciencesUSMLE Step 3 scoreCOMLEX-USA Level 3 scoreHow medical school handled virtual rotations8.46.15.00.0Figure PD .070.0Percent of Respondents Endorsing80.090.0100.0Mean Importance of Education and Academic Performance CharacteristicsConsidered in Deciding Whom to Rank1USMLE Step 1 scoreMSPEUSMLE Step 2 CK scoreClass ranking/quartileAny failed attempt at USMLEGrades in required clerkshipsCOMLEX-USA Level 2 CE scoreCOMLEX-USA Level 1 scoreAny failed attempt at COMLEX-USAGrades in clerkship in preferred specialtyConsistency of gradesAOA membershipGHHS membershipContinuous medical education w/o gapsPassing USMLE Step 2 CSAwards/honors, clerkship in preferred specialtyAwards/honors in clinical clerkshipsMedical school reputationMedical school accreditation statusPassing COMLEX-USA Level 2 PESigma Sigma Phi membershipAwards/honors in basic sciencesUSMLE Step 3 scoreCOMLEX-USA Level 3 scoreHow medical school handled virtual 21.52.0Rated on a scale of 1 (not at all important) to 5 (very important)NRMP Program Director Survey Results, 1.861.360.43.5Mean Importance Rating4.04.55.0
Figure PD R3Personal Characteristics and Other Knowledge of Applicants Considered inDeciding Whom to Rank (%)Interpersonal skillsInteractions with faculty during interview/visitFeedback from current residentsInteractions with house staff during interview/visitDiversity characteristicsPerceived commitment to specialtyLetters of recommendation in specialtyPerceived interest in programPersonal statementProfessionalism and ethicsLeadership qualitiesHaving overcome significant obstaclesPersonal prior knowledge of applicantOther life experienceVolunteer/extracurricular experienceAudition elective/rotation in PD's deptInvolvement and interest in researchFluency in language of patient populationAbility to work legally w/o visaOther post-interview contactInterest in academic careerNRMP flag for match violationVisa statusApplicant facility with meeting platform techAway rotation in specialty elsewhereSecond interview/visit8.10.0Figure PD .659.860.070.080.0Percent of Respondents Endorsing90.0100.0Mean Importance of Personal Characteristics and Other Knowledge of ApplicantsConsidered in Deciding Whom to Rank1Interpersonal skillsInteractions with faculty during interview/visitFeedback from current residentsInteractions with house staff during interview/visitDiversity characteristicsPerceived commitment to specialtyLetters of recommendation in specialtyPerceived interest in programPersonal statementProfessionalism and ethicsLeadership qualitiesHaving overcome significant obstaclesPersonal prior knowledge of applicantOther life experienceVolunteer/extracurricular experienceAudition elective/rotation in PD's deptInvolvement and interest in researchFluency in language of pt populationAbility to work legally w/o visaOther post-interview contactInterest in academic careerNRMP flag for match violationVisa statusApplicant facility with meeting platform techAway rotation in specialty elsewhereSecond interview/visit4.64.24.13.84.03.93.91.52.0Rated on a scale of 1 (not at all important) to 5 (very important)NRMP Program Director Survey Results, 2021132.53.03.5Mean Importance 84.44.33.73.81.0179.577.587.184.94.14.55.0
Anesthesiology, Total n 42NRMP Program Director Survey Results, 202114
Figure PD AN-1Summary of Program Interviewing and Ranking ActivitiesMean Numbers of Applications Received, Interview Invitations, Interviews, and ApplicantsRanked, 2021(Total n ed basedreceivinginvitations sentonholistic reviewstandardizedscreenNRMP Program Director Survey Results, 202115
Figure PD AN-2Summary of Program Interviewing and Ranking ActivitiesAverage Percentages of Applications Rejected and Reviewed, 2021(Total n 39)1009080706050403020100Percentages of applicationsRejected based on standardized screenNRMP Program Director Survey Results, 202116Received holistic review
Figure PD AN-3Summary of Program Interviewing and Ranking ActivitiesPercentages of Programs Interviewing Candidates by Applicant Type, 20211(Total n S MD SrUS DO SrUS MDGradOften1 Some11US DOGradSeldompercentages may not add to 100 because of rounding.NRMP Program Director Survey Results, 202117Never16US IMG22Non-USIMG
Figure PD AN-4Use of Standardized Licensure Exams to Select Applicants forInterviewPercentages of Programs Using USMLE to Select US MD and IMG Applicants for Interview,20211,2(Total n 42)US 355112414246568244338403020100452946208225USMLE Step USMLE Step USMLE Step USMLE Step12 CK2 CS3Prefer but do not require target scoreSeniors and graduates are considered together.percentages may not add to 100 because of rounding.2 SomeNRMP Program Director Survey Results, 202132271132USMLE Step USMLE Step USMLE Step USMLE Step12 CK2 CS3Require target score1401018Require pass onlyDo not consider
Figure PD AN-5Use of Standardized Licensure Exams to Select Applicants forInterviewPercentages of Programs Using Licensure Exams to Select DO Applicants for Interview, 20211(Total n 42) 5297122241015755COMLEXCOMLEXCOMLEXCOMLEXUSA Level 1 USA Level 2 USA Level 2 USA Level 3PECEUSMLE Step USMLE Step USMLE Step USMLE Step12 CK2 CS3Require target score33739331024402029Prefer but do not require target scoreRequire pass onlyDo not considerDO seniors and DO graduates are considered together.number of respondents who indicated they “seldom” or “often” consider DO senior, DO graduate, or both types of applicants forinterview.3 Some percentages may not add to 100 because of rounding.12 TotalNRMP Program Director Survey Results, 202119
Figure PD AN-6Program Ranking BehaviorPercentages of Programs Ranking Candidates by Applicant Type, 20211(Total n 39)100908071601003073592029106US MDSrUS DOSrUS MDGradNever1Some7272400124170501622US DOGradSeldompercentages may not add to 100 because of rounding.NRMP Program Director Survey Results, 202120Often1315US IMGNon-USIMG
Figure PD AN-I1Education and Academic Performance Characteristics Consideredin Deciding Whom to Interview (%)USMLE Step 1 scoreMSPEUSMLE Step 2 CK scoreGrades in required clerkshipsAny failed attempt at USMLEClass ranking/quartileGrades in clerkship in preferred specialtyAny failed attempt at COMLEX-USAConsistency of gradesCOMLEX-USA Level 1 scoreAwards/honors in clinical clerkshipsCOMLEX-USA Level 2 CE scoreAOA membershipGHHS membershipPassing USMLE Step 2 CSAwards/honors, clerkship in preferred specialtyContinuous medical education w/o gapsMedical school accreditation statusMedical school reputationPassing COMLEX-USA Level 2 PEAwards/honors in basic sciencesSigma Sigma Phi membershipUSMLE Step 3 scoreCOMLEX-USA Level 3 scoreHow medical school handled virtual rotations33.321.47.14.84.80.0Figure PD 2.431.030.040.050.060.070.0Percent of Respondents Endorsing80.090.0100.0Mean Importance of Education and Academic PerformanceCharacteristics Considered in Deciding Whom to Interview1USMLE Step 1 scoreMSPEUSMLE Step 2 CK scoreGrades in required clerkshipsAny failed attempt at USMLEClass ranking/quartileGrades in clerkship in preferred specialtyAny failed attempt at COMLEX-USAConsistency of gradesCOMLEX-USA Level 1 scoreAwards/honors in clinical clerkshipsCOMLEX-USA Level 2 CE scoreAOA membershipGHHS membershipPassing USMLE Step 2 CSAwards/honors, clerkship in preferred specialtyContinuous medical education w/o gapsMedical school accreditation statusMedical school reputationPassing COMLEX-USA Level 2 PEAwards/honors in basic sciencesSigma Sigma Phi membershipUSMLE step 3 scoreCOMLEX-USA Level 3 scoreHow med school handled virtual ted on a scale of 1 (not at all important) to 5 (very important)NRMP Program Director Survey Results, 2021212.53.03.5Mean Importance 0120.031.047.695.290.588.183.383.385.74.04.55.0
Figure PD AN-I3Personal Characteristics and Other Knowledge of Applicants Considered inDeciding Whom to Interview (%)Letters of recommendation in specialtyPersonal statement (overall)Diversity characteristicsPerceived commitment to specialtyHaving overcome significant obstaclesProfessionalism and ethicsPerceived interest in programLeadership qualitiesVolunteer/extracurricular experiencePersonal prior knowledge of applicantOther life experienceAudition elective/rotation in PD's dept.Involvement and interest in researchAbility to work legally w/o visaVisa statusFluency in language of pt populationNRMP flag for match violationInterest in academic careerAway rotation in specialty elsewhere57.133.328.69.5Figure PD AN-I410.020.076.240.535.730.0 40.0 50.0 60.0 70.0Percent of Respondents Endorsing80.090.0100.0Mean Importance of Personal Characteristics and Other Knowledge of ApplicantsConsidered in Deciding Whom to Interview1Letters of recommendation in specialtyPersonal statement (overall)Diversity characteristicsPerceived commitment to specialtyHaving overcome significant obstaclesProfessionalism and ethicsPerceived interest in programLeadership qualitiesVolunteer/extracurricular experiencePersonal prior knowledgeOther life experienceAudition elective/rotation in PD's dept.Involvement and interest in researchAbility to work legally w/o visaVisa statusFluency in language of pt populationNRMP flag for match violationInterest in academic careerAway rotation in specialty 078.685.776.285.778.61.52.0Rated on a scale of 1 (not at all important) to 5 (very important)NRMP Program Director Survey Results, 2021222.53.03.5Mean Importance Rating4.04.55.0
Figure PD AN-R1Education and Academic Performance Characteristics Considered in DecidingWhom to Rank (%)USMLE Step 1 scoreMSPEUSMLE Step 2 CK scoreClass ranking/quartileAny failed attempt at USMLEGrades in required clerkshipsCOMLEX-USA Level 2 CE scoreCOMLEX-USA Level 1 scoreAny failed attempt at COMLEX-USAGrades in clerkship in preferred specialtyConsistency of gradesAOA membershipGHHS membershipContinuous medical education w/o gapsPassing USMLE Step 2 CSAwards/honors, clerkship in preferred specialtyAwards/honors in clinical clerkshipsMedical school reputationMedical school accreditation statusPassing COMLEX-USA Level 2 PESigma Sigma Phi membershipAwards/honors in basic sciencesUSMLE Step 3 scoreCOMLEX-USA Level 3 scoreHow medical school handled virtual rotations47.631.016.72.42.42.40.0Figure PD .770.080.090.0100.0Mean Importance of Education and Academic Performance CharacteristicsConsidered in Deciding Whom to 0.050.060.0Percent of Respondents EndorsingUSMLE Step 1 scoreMSPEUSMLE Step 2 CK scoreClass ranking/quartileAny failed attempt at USMLEGrades in required clerkshipsCOMLEX-USA Level 2 CE scoreCOMLEX-USA Level 1 scoreAny failed attempt at COMLEX-USAGrades in clerkship in preferred specialtyConsistency of gradesAOA membershipGHHS membershipContinuous medical education w/o gapsPassing USMLE Step 2 CSAwards/honors, clerkship in preferred specialtyAwards/honors in clinical clerkshipsMedical school reputationMedical school accreditation statusPassing COMLEX-USA Level 2 PESigma Sigma Phi membershipAwards/honors in basic sciencesUSMLE Step 3 scoreHow medical school handled virtual n Importance Rating4.04.5Rated on a scale of 1 (not at all important) to 5 (very important)No respondent rated the importance of COMLEX-USA Level 3 score as a consideration in deciding which applicants to rank.NRMP Program Director Survey Results, 2021235.0
Figure PD AN-R3Personal Characteristics and Oth
USMLE Step 1. USMLE Step 2 CK. USMLE Step 2 CS. USMLE Step 3. COMLEX-USA Level 1. COMLEX-USA Level 2 CE. COMLEX-USA Level 2 PE. COMLEX-USA Level 3. Require target score. Prefer but do not require target score. Require pass only. Do not consider. Figure PD_5 Use of Standa
