Introduction
Methods
Results
Discussion
Limitations
Conclusion

INTRODUCTION

Epidemics and pandemics present numerous challenges to frontline healthcare workers. These providers must not only take care of patients during a period of uncertainty but must also ensure they protect themselves from exposure. The coronavirus disease 2019 (COVID-19) pandemic has led to the need for new management protocols to be created and implemented rapidly, including clinical guidelines related to the safety of healthcare workers.¹ In the emergency department (ED), aerosol-generating procedures (AGP), such as endotracheal intubation of patients with presumed/confirmed COVID-19, represent the highest risk to healthcare providers due to the aerosolization of viral particles.^2,3 These new guidelines must be quickly tested and disseminated in order to provide safe care.

The process of implementing a new management guideline can take significant time and buy-in from key stakeholders. New protocols typically develop through an iterative process, often in the form of a rapid Plan-Do-Study-Act (PDSA) cycle.^4,5 Through a PDSA process, an educational, operational, or other need is identified and a process designed to fix it. After this initial implementation, feedback is obtained and studied. The initial process is then refined, restarting the cycle. In-situ simulation has previously been shown to be a powerful tool for identifying and correcting latent safety threats as well as process improvements in new hospital units and protocols.^6-8 By using simulation within the space where that process occurs, new guidelines can be tested by those most affected, and comments can be fed back to revise the current workflow.⁹

Simulation is useful not only for process improvement but also to prepare teams for critical events. Prior work has shown that care teams have a better understanding of job responsibilities and improved communication during trauma activations after participating in an in-situ simulation.¹⁰ Surgeons use “simulation-based clinical rehearsals” to practice high-risk procedures prior to performing them on actual patients.^11,12 Similarly, the use of “just-in-time” simulation training, which refers to the opportunity to practice a skill immediately prior to use in the clinical environment, has been shown to be effective in teaching skills and providing refreshers to avoid skill decay.^13-15

The COVID-19 pandemic provides unique circumstances surrounding the implementation of new management guidelines and methods for teaching a large cohort of providers the skills necessary to deliver care in a safe manner. Due to state and federal executive orders prohibiting large gatherings, effectively leading to the cessation of typical in-person learning opportunities for providers, alternative methods for teaching are required.^16,17 This brief innovation details our model for implementing an algorithm for managing the high-risk AGP in patients with presumed COVID-19 diagnosis and highlights our method for both rapidly refining our algorithm through a PDSA process and onboarding our providers to this new management protocol while following social distancing guidelines.

METHODS

Simulation Scenario

Our airway algorithm was developed by this authorship group (BSB and CHH) in coordination with hospital leadership and the Department of Anesthesiology (Supplemental File).¹⁸ To facilitate rapid PDSA cycling of this protocol and to onboard attending and resident physicians to new airway management guidelines, we developed an in-situ simulation scenario featuring a decompensating patient with COVID-19 requiring definitive airway management with intubation. The scenario was designed to fulfill the following primary objectives: 1) demonstrate and adhere to donning and doffing of personal protective equipment (PPE) for high-risk AGPs in suspected COVID-19 patients; 2) perform an AGP while maintaining precautions, including pre-brief, intubation, and post-intubation management; and 3) demonstrate closed-loop communication with an interprofessional team with PPE in place and ongoing infection control procedures. The scenario design process as well as the case itself are further detailed and available for use through the Association of American Medical Colleges iCollaborative.¹⁹ We developed and reviewed the scenario prior to implementation by educational leadership within the physician, nursing, and respiratory therapy groups.

In anticipation of a surge in critically ill patients requiring AGP, we conducted in-situ simulation sessions three times daily, prior to the start of clinical shifts. After one week, sessions were reduced to twice daily. These sessions occurred at the Michigan Medicine Adult Emergency Department, using a resuscitation room that was similar to rooms where patients would be intubated. Exact room was determined at the time of the session, based on room availabilities. Through announcements via email as well as during virtual departmental meetings, we invited all physicians, nurses, and respiratory therapists to participate in order to delineate roles and promote team communication. To comply with guidelines to minimize large gatherings, sessions were limited to the providers who were going to be working in the resuscitation area during the oncoming shift. Simulations were limited to six participants in their typical roles, reflecting the number of providers caring for a patient who requires an AGP in our protocol (two physician providers, two nurses inside the room, one respiratory therapist, and one additional nurse outside the room). If additional providers working that day showed up to the session, they were allowed to observe, following recommended social distancing guidelines. Initial sessions were taught by two authors (BWM and CHH). Additional faculty and residents were subsequently recruited on a volunteer basis to teach these sessions and were provided instruction on teaching methods and observed for a session, following a train-the-trainers framework. To minimize additional infectious risk, teachers were encouraged to sign up to teach sessions that were to occur immediately prior to their own shifts.

Prior to deployment of the simulation sessions, the airway management algorithm was provided to all providers through a link in an online repository Box (Redwood City, CA), although it was not mandatory for providers to review prior to attending the session.²⁰ Simulation sessions focused on introduction of the concepts of appropriate donning of PPE; preparation and planning for intubation; the intubation procedure; post-intubation management; and appropriate doffing of PPE. Following a pre-brief that reviewed the airway management algorithm and demonstration of key elements, the participants engaged in the simulation scenario as a team, using a deliberate practice framework to correct errors in real time, noted by a critical action checklist. Due to national shortages of PPE, simulated equipment, such as Styrofoam masks replicating N95s, were used to practice donning and doffing techniques. Following the session, participants underwent debriefing that reinforced the critical actions.

Airway Algorithm Refinement

The simulation sessions also informed the change process for the airway algorithm, following a PDSA cycle (Figure 1). After the initial implementation of the simulation, we sought feedback on the airway algorithm from participants and any observers present in real time regarding what worked well and how the algorithm could be improved. Additionally, providers were encouraged to email us with any additional feedback based upon their experiences in the clinical environment. This feedback was shared with the entire authorship group, who reviewed the information and used it to inform subsequent iterations of the airway algorithm. As new knowledge regarding best practices became available, this was also incorporated into new versions of the algorithm. We provided updated guidelines in Box for learners to review and refer to as needed.

Following participation in the simulation, the physician participants were asked to complete a retrospective pre/post survey using a five-point Likert scale (1 being extremely uncomfortable, 3 being neither comfortable nor uncomfortable, and 5 being extremely comfortable) regarding their comfort with aspects of the management of AGPs in COVID-19 patients before and after the simulation. Questions included physician level of comfort both before and after the simulation in the following domains: 1) PPE donning and doffing procedures; 2) understanding their role in AGPs; and 3) performing aerosol-generating procedural tasks such as intubation. We determined the mean and 95% confidence intervals (CI) of the survey results, and evaluated the pre- and post-simulation results using two-sided paired t-tests. All statistical computations were performed in SAS v9.2 (SAS Institute; Cary, NC). P value < 0.05 was considered statistically significant. We measured onboarding and reach through attendance at sessions by ED residents and faculty compared to those currently working in the department. Residents who were on off-service rotations and faculty who did not work shifts during the months of March and April were excluded. This study was exempted from institutional review board review by the University of Michigan Medical School Office of Research.

RESULTS

Between March 16–April 1, 2020, 93 physicians completed the simulation training through a total of 37 simulation sessions. Of these physicians, 91.4% (85) were emergency physicians, while 8.6% (eight) were intensivists or anesthesiologists who attended sessions for the purpose of training their own departments in this algorithm. Of the ED providers, 45.9% (39) were residents or fellows and 54.1% (46) were attending physicians. This represented 86.7% (39 of 45) residents and 83.6% (46 of 55) of faculty who worked shifts in the ED during this time.

We received 81 responses from the 93 participants (87% response rate). Thirty (37%) of the providers had participated in an AGP on a suspected or confirmed COVID-19 patient prior to participating in the simulation. The average level of comfort with PPE procedures increased significantly from 2.94 (95% CI, 2.71–3.17) to 4.36 (4.24–4.48), a difference of 1.42 (1.20–1.63, p < 0.001). The providers again showed a significant increase in average comfort level in understanding their role with scores increasing from 3.51 (3.26–3.77) to 4.55 (2.71–3.17), a difference of 1.04 (0.82–1.25, p < 0.001). In addition, providers showed significantly increased comfort in performing procedural tasks such as intubation. Their comfort level increased from 3.08 (2.80–3.35) before to 4.38 (4.23–4.52) after the simulation, a difference of 1.30 points (1.06–1.54, p < 0.001) (Table 1). There was no significant difference in the above scores between the providers who had participated in AGPs in suspected or confirmed COVID-19 patients, and those who had not (p-values 0.33, 0.41, and 0.45, respectively) (Table 2).

During the study period, we created a total of 12 versions of the COVID-19 airway algorithm. Changes occurred in response to several avenues of feedback, as described in the methods. Ever-changing consensus recommendations related to airway management in a new disease required maximal flexibility and adaptability. New knowledge regarding best practices were adapted as they became available. Additionally, all participants were offered the opportunity to provide suggestions for change after participating in the simulation. The airway algorithm was also used by many participants on clinical shift immediately following completion of simulation, leading to the discovery of areas needing refinement. To track modifications to the algorithm we created a descriptive “Change Log,” which is represented in Table 3.

DISCUSSION

The COVID-19 pandemic presents a unique scenario in which new management guidelines must be implemented in a rapid manner to provide healthcare workers the tools necessary to safely perform patient care. The use of in-situ simulation allowed for the simultaneous training and refinement of our airway algorithm. Provider comfort in multiple domains improved significantly following the simulation, independent of whether the providers had participated in an AGP in a suspected or confirmed COVID-19 patient prior to participating in the simulation training. These domains included PPE donning and doffing; knowing one’s role in AGPs; and performing AGPs such as intubations.

During this time, multiple changes took place to the airway algorithm and several themes were noted throughout the revision process. The importance of proper PPE donning/doffing was recognized during initial algorithm development; however, defining the order and type of PPE were continually assessed and modified. Communication barriers were uncovered including need for two-way communication devices. Layout of airway equipment was redesigned from an initial airway bag to a preset airway table and, finally, to separate, modular airway packs.

This study highlights the importance of in-situ simulation training, particularly its impact on provider confidence with high-risk AGPs such as intubation, as well as team roles and PPE donning and doffing. Additionally, it shows that an airway algorithm can be developed and refined in real time based on user feedback and rapidly disseminated to ED providers. Future work will look at the impact of the training on provider outcomes such as adherence to PPE donning and doffing standards, as well as patient outcomes such as success of airway interventions. Additionally, further analysis of data will look at any differences between the original trainers and the secondary teachers to evaluate the quality and consistency of the sessions.

LIMITATIONS

The need to follow social distancing guidelines presented a significant limitation in the number of providers we were able to train at one time. In the setting of a pandemic, access to supplies and equipment was unpredictable. One limitation was the need to adapt to what was available and in stock. Although other hospitals may not be able to reproduce exactly our airway algorithm, the process for implementation is generalizable. Additionally, the recommendations we provided to our learners were best practice recommendations as there was limited evidence supporting a definitive management algorithm in the context of the COVID-19 pandemic.

We did not ask the participants to review the airway algorithm prior to attending the session, although some may have done so. Given that we did not collect data on whether or not participants were familiar with the algorithm prior to the simulation, our results may underestimate the utility of the simulation training. Additionally, as this was a retrospective survey, there is the possibility of recall bias as it relates to participant comfort with the procedure. Although future work will assess whether or not different instructors were more effective teachers, it was not a part of this study and therefore is a potential limitation in understanding the dissemination of content.

CONCLUSION

We successfully implemented a new airway management guideline for patients with suspected COVID-19. The use of in-situ simulation helped providers learn these new guidelines and become familiar with new equipment and protocols over a short time period. Additionally, the feedback obtained through the simulation was useful in refining our algorithm. In-situ simulation is an essential tool for both rapid dissemination and onboarding, as well as process improvement in the context of an epidemic or pandemic.

Footnotes

Section Editors: Muhammad Waseem, MD, and Danya Khoujah, MBBS

Full text available through open access at http://escholarship.org/uc/uciem_westjem

Disclaimer: Due to the rapidly evolving nature of this outbreak, and in the interests of rapid dissemination of reliable, actionable information, this paper went through expedited peer review. Additionally, information should be considered current only at the time of publication and may evolve as the science develops.

Address for Correspondence: Brendan William Munzer, MD, Michigan Medicine, Department of Emergency Medicine, 1500 E Medical Center Dr., Ann Arbor, MI 48109. Email: bmunzer@med.umich.edu. 11 / 2020; 21:99 – 106

Submission history: Revision received May 12, 2020; Submitted July 6, 2020; Accepted July 29, 2020

Conflicts of Interest: By the WestJEM article submission agreement, all authors are required to disclose all affiliations, funding sources and financial or management relationships that could be perceived as potential sources of bias. C.H. Hsu was supported by a National Institutes of Health grant (NIH K12HL133304-01). No other author has professional or financial relationships with any companies that are relevant to this study.

REFERENCES

1. Huh S. How to train the health personnel for protecting themselves from novel coronavirus (COVID-19) infection during their patient or suspected case care. J Educ Eval Health Prof. 2020;17:10.

2. Tran K, Cimon K, Severn M, et al. Aerosol generating procedures and risk of transmission of acute respiratory infections to healthcare workers: a systematic review. PLoS One. 2012;7(4):1-8.

3. Cheung JC-H, Ho LT, Cheng JV, et al. Staff safety during emergency airway management for COVID-19 in Hong Kong. Lancet Respir Med. 2020;8(4):e19.

4. Leape LL, Rogers G, Hanna D, et al. Developing and implementing new safe practices: voluntary adoption through statewide collaboratives. Qual Saf Heal Care. 2006;15(4):289-95.

5. Science of Improvement: Testing Changes. 2012. Available at: http://www.ihi.org/resources/Pages/HowtoImprove/ScienceofImprovementTestingChanges.aspx. Accessed March 27, 2020.

6. Couto TB, Barreto JKS, Marcon FC, et al. Detecting latent safety threats in an interprofessional training that combines in situ simulation with task training in an emergency department. Adv Simul. 2018;3(1):1-7.

7. Brazil V. Translational simulation: not ‘where?’ but ‘why?’ A functional view of in situ simulation. Adv Simul. 2017;2(1):1-5.

8. Kobayashi L, Shapiro MJ, Sucov A, et al. Portable advanced medical simulation for new emergency department testing and orientation. Acad Emerg Med. 2006;13(6):691-5.

9. Shook J. How to go to the Gemba: Go see, ask why, show respect. 2011. Available at: https://www.lean.org/shook/DisplayObject.cfm?o=1843. Accessed April 7, 2020.

10. Miller D, Crandall C, Washington C, et al. Improving teamwork and communication in trauma care through in situ simulations. Acad Emerg Med. 2012;19(5):608-12.

11. Arnold J, Cashin M, Olutoye O. Simulation-based clinical rehearsals as amethod for improving patient safety. JAMA Surg. 2018;153(12):1143-4.

12. Thomas L, Galla C. Building a culture of safety through team training and engagement. BMJ Qual Saf. 2013;22(5):425-34.

13. Braga MS, Tyler MD, Rhoads JM, et al. Effect of just-in-time simulation training on provider performance and patient outcomes for clinical procedures: a systematic review. BMJ Simul Technol Enhanc Learn. 2015;1(3):94-102.

14. Branzetti JB, Adedipe AA, Gittinger MJ, et al. Randomised controlled trial to assess the effect of a just-in-time training on procedural performance: a proof-of-concept study to address procedural skill decay. BMJ Qual Saf. 2017;26(11):881-91.

15. Niles D, Sutton RM, Donoghue A, et al. “Rolling refreshers”: a novel approach to maintain CPR psychomotor skill competence. Resuscitation. 2009;80(8):909-12.

16. Whitmer G. Executive Order 2020-05 (Covid-19) – Rescinded. 2020. Available at: https://www.michigan.gov/whitmer/0,9309,7-387-90499_90705-521595–,00.html. Accessed March 27, 2020.

17. Whitmer G. Executive Order 2020-21 (COVID-19) – Rescinded. 2020. Available at: https://www.michigan.gov/whitmer/0,9309,7-387-90499_90705-522626–,00.html. Accessed March 27, 2020.

18. Hsu CH, Munzer BW, Bassin BS. Preparation and practice make perfect for COVID-19 airway management. 2020. Available at: https://mcircc.umich.edu/latest-news/preparation-and-practice-make-perfect-for-covid-19-airway-management. Accessed April 7, 2020.

19. Doan J, Tucker R, Peterson WJ, et al. COVID-19 airway management: a simulation case for adult emergency department providers. 2020. Available at: https://icollaborative.aamc.org/resource/5070/. Accessed April 7, 2020.

20. Secure Content Management, Workflow, and Collaboration. 2020. Available at: https://www.box.com/home. Accessed March 27, 2020.