Addressing Challenges in Obtaining Emergency Medicine Away Rotations and Standardized Letters of Evaluation Due to COVID-19 Pandemic

Author Affiliation
Linda Katirji, MD University of Kentucky, Department of Emergency Medicine, Lexington, Kentucky
Liza Smith, MD University of Massachusetts Medical School, Baystate Medical Center, Department of Emergency Medicine, Springfield, Massachusetts
Alexis Pelletier-Bui, MD Cooper Medical School of Rowan University, Department of Emergency Medicine, Camden, New Jersey
Emily Hillman, MD, MHPE University of Missouri—Kansas City School of Medicine, Truman Medical Center, Department of Emergency Medicine, Kansas City, Missouri
Xiao Chi Zhang, MD, MS Thomas Jefferson University, Department of Emergency Medicine, Philadelphia, Pennsylvania
Michael Pasirstein, MD, MPH Drexel University College of Medicine, Department of Emergency Medicine, Philadelphia, Pennsylvania
Mark Olaf, DO Geisinger Commonwealth School of Medicine, Department of Emergency Medicine, Scranton, Pennsylvania
Jazmyn Shaw, University of Mississippi School of Medicine, Univeristy of Mississippi Medical Center, Jackson, Mississippi
Douglas Franzen, MD, MEd University of Washington, Department of Emergency Medicine, Seattle, Washington
Ronnie Ren, MD University of Massachusetts Medical School, Baystate Medical Center, Department of Emergency Medicine, Springfield, Massachusetts

 

With the unpredictable future of the coronavirus disease 2019 (COVID-19) pandemic, institutions have begun altering the clinical experience for students and instituting travel bans for both their faculty and students.1 On March 17, 2020, a joint recommendation from the Association of American Medical Colleges and the Liaison Committee on Medical Education was issued, which supported suspending clinical activities for medical students for a two-week minimum.2 There exists precedence for sudden medical school curricular adaptations in response to emerging diseases and disasters, including alterations in planned didactics, distance learning, and other methods of risk mitigation.3-5 Numerous institutions have begun canceling clerkship rotations for visiting students, while others are prohibiting their own students from traveling to complete away rotations. While many institutions have initiated video conferencing and virtual simulation in lieu of clinical exposure, there is increasing concern that these students will suffer from limited opportunities to evaluate and treat patients in emergency department settings and to receive real-time assessment of their clinical skills.

The Council of Residency Directors in Emergency Medicine (CORD) Advising Students Committee in Emergency Medicine (ASC-EM) anticipates institutional and regional variability in both the spread and response to COVID-19. Travel restrictions and host institution rotation closures will impact the number of emergency medicine (EM) rotations EM-bound medical students can complete in an unprecedented manner. They may prevent students from completing any away rotations this academic cycle, challenging the students’ collective ability to obtain EM Standardized Letters of Evaluation (SLOE) outside of their home institution. For students without a home EM program to rotate in, they may not have the ability to obtain any SLOE at all, which could be devastating to their EM residency application.6,7

Historically, SLOEs obtained from home and away EM rotations have served as important tools to determine which candidates to invite for residency interviews.6-9 Approximately 80% of EM programs will not consider an applicant for an interview unless they have at least one SLOE.10,11 In the most recent review of the Emergency Medicine Residents’ Association (EMRA) Match website, of the 175 out of 258 programs self-reporting a SLOE requirement, only 13 programs (7%) stated they would review an applicant without a SLOE while 79 programs (45%) stated they required two SLOEs before considering an applicant for interview.12

Over the past decade, the group SLOE, written by the EM clerkship and residency education team at a residency program, has become the preferred SLOE for residency EM applications.6,8,13,14 Program directors have since held single-author SLOEs, SLOEs from EM faculty not affiliated with a residency program, and non-SLOE format letters of recommendation (LoR) in lesser regard.6,15 In the present COVID-19 pandemic, students without a residency-based home EM rotation will face markedly greater barriers to obtaining these coveted group SLOEs. EM’s emphasis on residency group SLOEs over other letter types creates an undue burden on these vulnerable students and makes the application process intrinsically inequitable. This inequity warrants a reevaluation of the current application practice.

In this continuously evolving, exceptionally challenging time, it is important for the educational community to face these challenges in a united front. ASC-EM proposes the following recommendations for all stakeholders, including EM program leadership, medical schools, and EM-bound medical students, to consider for the upcoming EM application cycle.

For Program Directors:

 

1. Programs should be flexible with their SLOE requirements.

 

ASC-EM recommends for application cycle 2020–2021 that residency program leadership consider reducing the number of SLOEs needed to review an application to one SLOE (or fewer) to account for students who cannot obtain a SLOE at their home institution or from away rotations. We also recommend programs to accept alternative letters of recommendations to act as surrogates for their typical group SLOE requirements as detailed in the paragraphs below.

 

2. Programs should give weight to alternative LoRs that include the traditional SLOE content.

 

Examples of alternative LoRs include, but are not limited to, a SLOE from a home EM rotation at an institution without an associated EM residency program (“orphan” SLOEs),EM sub-specialty SLOEs (ultrasound, toxicology, pediatric EM, emergency medical services, or other sub-specialties), and LoRs written by advisors for the instance that a student has been entirely unsuccessful in obtaining an EM rotation. The CORD website contains instructions and a template for writing such SLOEs.16

 

Given the increased emphasis on alternative LoRs, letter writers must be instructed to address relevant clinical and professional competencies typically seen in the “Qualifications for EM” section of SLOEs. A standard template for this can be found on the CORD website.17

 

For Deans and Letter Writers:

 

3. Writers should use clear language to reflect a student’s loss of opportunities.

 

Medical Student Performance Evaluation (MSPE): Due to the anticipated institutional and regional variability, ASC-EM recommends that institutions include a clear, explicit statement in their MSPE explaining any institutional policy limiting their students’ ability to complete EM rotations.

 

SLOE and alternative LoRs: ASC-EM recommends the inclusion of the following standard verbiage in SLOEs and alternative LoRs to identify students that could not obtain the recommended number of rotations:

“This student was unable to obtain the expected number of residency SLOE opportunities due to uncontrollable circumstances surrounding the COVID-19 pandemic. These circumstances include [include all that apply] home institution prohibiting school-related travel, cancellation of home EM rotation, cancellation of EM away rotations the student had accepted, and inability to find an EM rotation willing to accept students.”

 

For Medical Students:

 

4. Students should consider going on fewer away rotations.

 

We anticipate EM rotations that accept visiting students will become a scarce opportunity that must be shared to maintain a healthy application environment. We ask all stakeholders in the EM application process, including but not limited to faculty advisers, clerkships, and students, to be cognizant of the number of EM rotations each student chooses to complete. Given the possibility of drastically limited EM rotation positions, ASC-EM would like to revise the number of away rotations we have recommended students complete in previous application cycles.

 

Students who can rotate at their home EM program: In the event that a student is able to both travel to institutions accepting visiting students and secure available clerkship positions, that student should not complete more than one away rotation.

 

Students without a home EM program: Students should not complete more than two away rotations.

 

For Institutions and Clerkship Directors Still Accepting Visiting Students:

 

5. Clerkship directors and medical schools should preferentially consider students without a home EM program for an EM clerkship at their institution.

 

To yield a more equitable distribution of scarce audition rotation opportunities, host institutions and their clerkship directors should actively seek applicants who are unable to obtain a SLOE from their home institution.

 

Applicants without a home EM rotation, whether it be due to restrictions on students rotating in their home EM department or lack of a home EM residency program altogether, should communicate that status in their visiting clerkship application, if possible.

 

CORD ASC-EM maintains a living document of medical schools where students lack access to a home EM program, so-called orphan programs. Application reviewers should use this tool to aid their decision making when determining which students to invite for visiting opportunities. The most up to date document can be found here.

 

For Stakeholders Involved in the Restriction of Visiting Rotations:

 

6. The status of EM rotations should be clear and accurate.

 

The status of visiting EM rotations should be accurately represented on relevant platforms such as Visiting Students Learning Opportunities (VSLO). Institutions should work with their respective application platforms to ensure that students cannot apply to rotations that have been or will be canceled due to the COVID-19 pandemic. We encourage institutions to keep the availability indicator for their rotation on EMRA Match for Clerkships up to date as well as the “Information Students Should Know” section for relevant COVID-19 updates.12 Students should not be expected to apply to rotations uncertain of whether the rotation is open or canceled.

 

7. Students should be protected from financial implications of canceled rotations.

 

Financially, students are the most vulnerable group among all stakeholders. Institutions restricting their students from traveling should help their students recoup the money already spent on setting up visiting rotations. Host institutions canceling their visiting rotations should work with their application platform, such as VSLO, to refund students who have already applied to or accepted a rotation there.

 

We understand that these proposed changes may be uncomfortable for programs that have relied on SLOEs to be the most important representation of a student’s abilities, and for students who are eager to be able to demonstrate their competencies in the audition setting.6-8 Ultimately, these recommendations are motivated by the need to preserve the health and safety of our EM community and to ensure that students who traditionally are at the greatest disadvantage in navigating the application process are not excluded entirely from consideration.

Although the COVID-19 pandemic was the impetus for these unique recommendations, our response may be applicable to future, unforeseen circumstances that alter the usual application process. Emergency physicians are known to be adaptable to their ever-changing clinical environment, and we are confident that our flexibility will extend to the academic realm as well.

Footnotes

Section Editor: Mark I. Langdorf, MD, MHPE

Full text available through open access at http://escholarship.org/uc/uciem_westjem

Disclaimer: Due to the rapidly evolving nature of this outbreak, and in the interests of rapid dissemination of reliable, actionable information, this paper went through expedited peer review. Additionally, information should be considered current only at the time of publication and may evolve as the science develops.

Address for Correspondence: Linda Katirji, MD, University of Kentucky, Department of Emergency Medicine, 800 Rose Street Room M-53, Lexington, Kentucky 40536. Email: linda.katirji@uky.edu. 5 / 2020; 21:538 – 541

Submission history: Revision received March 27, 2020; Accepted March 27, 2020

Conflicts of Interest: By the WestJEM article submission agreement, all authors are required to disclose all affiliations, funding sources and financial or management relationships that could be perceived as potential sources of bias. No author has professional or financial relationships with any companies that are relevant to this study. There are no conflicts of interest or sources of funding to declare.

REFERENCES

1. Coronavirus (COVID-19). Available at: https://www.cdc.gov/coronavirus/2019-ncov/index.html. Accessed March 27, 2020.

2. Guidance on Medical Students’ Clinical Participation: Effective Immediately. Available at: https://www.aamc.org/system/files/2020-03/. Accessed March 27, 2020.

3. Starr I. Influenza in 1918: recollections of the epidemic in Philadelphia. 1976. Ann Intern Med. 2006;145(2):138-40.

4. Park SW, Jang HW, Choe YH, et al. Avoiding student infection during a Middle East respiratory syndrome (MERS) outbreak: a single medical school experience. Korean J Med Educ. 2016;28(2):209-17.

5. Hansoti B, Douglass K, Tupesis J, et al. Guidelines for safety of trainees rotating abroad: consensus recommendations from the Global Emergency Medicine Academy of the Society for Academic Emergency Medicine, Council of Emergency Medicine Residency Directors, and the Emergency Medicine Residents’ Association. Acad Emerg Med. 2013;20(4):413-20.

6. Love JN, Smith J, Weizberg M, et al. Council of Emergency Medicine Residency Directors’ standardized letter of recommendation: the program director’s perspective. Acad Emerg Med. 2014;21(6):680-7.

7. Results of the 2018 Program Director Survey. 2018. Available at: www.nrmp.org. Accessed March 27, 2020.

8. Love JN, Ronan-Bentle SE, et al. The Standardized Letter of Evaluation for postgraduate training: a concept whose time has come?. Acad Med. 2016;91(11):1480-2.

9. Griffith M, DeMasi SC, McGrath AJ, et al. Time to reevaluate the away rotation: improving return on investment for students and schools. Acad Med. 2019;94(4):496-500.

10. Negaard M, Assimacopoulos E, Harland K, et al. Emergency medicine residency selection criteria: an update and comparison. AEM Educ Train. 2018;2(2):146-53.

11. King K, Kass D. What do they want from us? A survey of EM program directors on EM application criteria. West J Emerg Med. 2017;18(1):126-8.

12. EMRA Match. Available at: https://webapps.emra.org/utils/spa/match#/search/list/. Accessed March 27, 2020.

13. Grall KH, Hiller KM, Stoneking LR. Analysis of the evaluative components on the Standard Letter of Recommendation (SLOR) in emergency redicine. West J Emerg Med. 2014;15(4):419-23.

14. Girzadas DVJ, Harwood RC, Dearie J, et al. A comparison of standardized and narrative letters of recommendation. Acad Emerg Med. 1998;5(11):1101-4.

15. Jarou Z. EMRA and CORD Student Advising Guide. 2019.

16. The Standardized Letter of Evaluation (SLOE) for Non-EM Residency Faculty. Available at: https://www.cordem.org/resources/residency-management/sloe/sloe—non-em-residency-faculty/. Accessed March 27, 2020.

17. Official CORD Standardized Letter of Evaluation (SLOE). Available at: https://www.cordem.org/globalassets/files/sloe/sloe-2019—non-em-residency-faculty.pdf. Accessed March 27, 2020.