key: cord-0077023-sofzy4yb authors: Slanetz, Priscilla J.; Ngo, Michael; Ali, Kamran; Chapman, Teresa title: The Radiology Residency Application Arms Race—Is Preference Signaling the Answer? date: 2022-04-12 journal: J Am Coll Radiol DOI: 10.1016/j.jacr.2022.02.037 sha: 2417137b3a6969bd738e3cd228e301aa6c5b1ec9 doc_id: 77023 cord_uid: sofzy4yb nan The COVID-19 pandemic has made virtual interviews the norm as students seek to secure a residency position. With the United States Medical Licensing Examination (USMLE) Step 1 examination becoming pass-or-fail next year, residency programs are faced with devising a new way to select appropriate candidates from an increasingly overwhelming number of applications for the available positions. In fact, some programs are experiencing a 20% to 25% increase in applications this year alone. Although programs are being encouraged to implement a more "holistic" approach when selecting students for interviews, the increasing number of applications is making this process quite challenging. Recently, the Association of American Medical Colleges introduced a pilot of preference signaling, a process by which applicants applying to specific specialties can indicate, or "signal," their interest to up to five training programs. With the switch to virtual interviews and a dramatic increase in applications, radiology residency programs are tasked with finding applicants who are not only qualified but also genuinely interested. Preference signaling has been proposed as a possible solution to help programs with this goal. However, requiring applicants to signal programs could make the application process more complicated without adding substantial benefits for the applicant. In addition, it might not even solve the underlying problem of overapplying. Signaling will add another level of complexity that applicants would need to navigate. Without a clear understanding of how programs will use signals in their assessment, there will be differing opinions on the best way to leverage these signals to maximize their chances of obtaining an interview, which could disadvantage applicants without strong mentors to help guide them through this new system. Additionally, the benefits of preference signaling seem minimal. Applicants can already express their interest in a program by participating in away rotations, writing letters of interest, and customizing personal statements. Since these methods exist, the incorporation of signaling may only increase the amount of work for applicants. Furthermore, preference signaling is unlikely to fix the core problem of overapplying. Programs will likely interview applicants who did not signal to their program; thus, overapplying to many programs will increase an applicant's chance of receiving an interview and eventually matching. Rather than implementing a new system that could complicate the application process without addressing the underlying issue of overapplying, efforts should be concentrated on piloting ideas that could minimize the advantage that comes with sending more applications. Preference signaling is an intriguing concept to a program director of a small or university-affiliated program in the heartland of America. Virtual interviews have been beneficial to our program as more candidates get to "see" our program without the added cost of travel. Yet we are never sure who is genuinely interested in the program or using as a filler on their way to interviews at programs with ivory towers. As Step 1 scores become pass or fail, we anticipate even more applications to our program. With limited resources and limited faculty bandwidth to conduct a rigorous review of applications, the applicant review will certainly be daunting for small programs. Would preference signaling help a program like ours, which is in a geographically isolated part of the country? We have many applicants 1 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 with stellar credentials who interview at numerous other programs. Although many of our matched applicants are from the Midwest, having a coastal applicant preference signal our program would be highly valuable in knowing their genuine interest in relocating to the Midwest. Although a seasoned interview committee can certainly help, many interviewees blend in with an impressive body of work in medical school and polished interview skills. Ranking these candidates can become an educated guessing game into "they are great, but will they really come to Wichita?" Although preference signaling is not "the" proliferation treaty that will solve the application arms race, it will certainly offer value in the form of another metric small programs can use to facilitate holistic reviews and interview selections. We do not anticipate a deluge of preference signals, but even one or two may help tilt the odds slightly further in a program's favor to a successful match of a small complement of residents. Response from Teresa Chapman, MD, MA, Diagnostic Radiology Residency Program Director, University of Washington The goals of a residency program director (PD) during the recruitment season are multifold. We are tasked with recruiting, selecting, and successfully admitting the candidates best suited for our training programs' intended aims. This requires an initial team of qualified, energetic, and dedicated selection members who can conduct holistic reviews of the submitted applications and a second team of interviewers with dedicated time to meet with the selected candidates. Ensuring high-quality holistic reviews of every individual within this everenlarging pool of applications is an impossible task. Some form of cursory screening process is required in this selection process-either a rapid reading of the application by an individual or a filtering system based on data such as USMLE or COMLEX Q3 scores. Both methods inevitably risk skipping qualified applicants who, under different circumstances, might have been admitted to our program and thrived. A recent study showed that without available USMLE Step 1 scores, applicant selection is likely to lean more heavily on Step 2 scores and medical school reputation [1] . This has the potentially harmful effect of discounting exceptional individuals with backgrounds from lower socioeconomic resources. Strategies are necessary to reduce the number of applications requiring review. The stated primary goal by the Association of American Medical Colleges for preference signaling is to provide a process for sharing genuine interest in a program that enhances accuracy and fairness [2] . I, and others, believe this will be an important part of the solution to address overapplication-preference signaling is supported by most radiology PDs surveyed about mitigating the overapplication phenomenon [3] . As a PD, I want certainty that our incoming trainees will be happy in their new job. Knowing they are aiming to be in the region or at our university is undeniably reassuring. Key to implementing this feature is the Program Conduct of Conduct Q4 , requiring that (1) programs shall not disclose which applicants signaled or did not signal; (2) programs shall not ask interviewees where they signaled; and (3) programs shall not disclose the number of signals received. The only concern I have about preference signaling is that some programs may make the mistake of limiting their consideration of candidates exclusively to those who signaled, and this is not the intended design outcome. In summary, both graduating medical students and training programs are facing challenges with the residency match related to an exponential increase in applications exacerbated by virtual interview platforms adopted since the COVID-19 pandemic. Given limited interview slots, programs desire to holistically review applicants but realistically need tools to filter and identify the candidates that will excel in the program and are genuinely interested in matching. Students are focused on maximizing their ability to match and often apply broadly to an excessive number of programs to ensure that they match successfully. Given that virtual interviews are here to stay, several approaches to deescalate the rise in applications and help programs make more informed interview decisions have been considered, including increasing the cost of applications, setting an application cap, requiring standardized letters of recommendations, implementing secondary application questions, allowing applicants to rank geographic preferences, and asking applicants to "signal" up to five programs of interest. A recent survey of 2021 otolaryngology applicants and PDs showed that signaling statistically increased an applicant's chance of receiving an interview and a majority viewed signaling positively [4] . If selective (limited to a small number of programs), signaling does achieve its intended result of indicating genuine interest [5] , although many applicants have accomplished this same effect for years through targeted emails, personalized personal statements, or telephone calls to residency program leadership from faculty or a medical school dean. Is preference signaling the answer? The data are not in yet. However, in the 2022 match, radiology residency programs will be participating in a pilot that will not only entail preference signaling, but also allow applicants to rank up to three geographic preferences and answer supplemental application questions highlighting up to five meaningful past experiences. The hope is that this approach will make it easier for programs to select applicants and that applicants will focus on targeting fewer training programs. It remains unclear how this tiered approach will help except that it will create two new ERAS Q5 filters that programs almost certainly will useone based on signaling and one on geographic location. That information, in addition to Step 2 scores, may become the next tools by which programs narrow down the applicant pool. Realistically, however, a holistic review is the only sure way that programs and applicants will find the best match for postgraduate training. 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 Factors influential in the selection of radiology residents in the post-Step 1 world: a discrete choice experiment Association of American Medical Colleges. Supplemental ERAS application guide Should radiology residency interviews remain virtual? Results of a multi-institutional survey inform the debate The otolaryngology residency program preference signaling experience Preference signaling for competitive residency programs in NMRP Director of Early Career Faculty Development and Co-Director of the Academic Writing Program for Boston University Medical Group; President of Massachusetts Radiological Society; Vice President of the Association of University Radiologists; and Subspecialty Chair of the ACR Appropriateness Criteria Breast Imaging Panels. Michael Ngo, BS, is from the Department of Radiology Dr Chapman is a member of the ACGME Radiology Review Committee. The content here represents Dr Chapman's input as a program director and does not reflect the opinions of the Radiology Review Committee. The other authors state that they have no conflict of interest related to the material discussed