Using Medical Student Quality Improvement Projects to Promote Evidence-Based Care in the Emergency Department

Author Affiliation
Michael W. Manning, BS University of South Florida College of Medicine, Department of Emergency Medicine, Tampa, Florida;
Lehigh Valley Hospital, Department of Emergency Medicine, Allentown, Pennsylvania
Eric W. Bean, DO, MBA University of South Florida College of Medicine, Department of Emergency Medicine, Tampa, Florida;
Lehigh Valley Hospital, Department of Emergency Medicine, Allentown, Pennsylvania
Andrew C. Miller, DO University of South Florida College of Medicine, Department of Emergency Medicine, Tampa, Florida;
Lehigh Valley Hospital, Department of Emergency Medicine, Allentown, Pennsylvania
Suzanne J. Templer, DO University of South Florida College of Medicine, Department of Internal Medicine, Tampa, Florida;
Lehigh Valley Hospital, Department of Internal Medicine, Allentown, Pennsylvania
Richard S. Mackenzie, MD, MBOE University of South Florida College of Medicine, Department of Emergency Medicine, Tampa, Florida;
Lehigh Valley Hospital, Department of Emergency Medicine, Allentown, Pennsylvania
David M. Richardson, MD University of South Florida College of Medicine, Department of Emergency Medicine, Tampa, Florida;
Lehigh Valley Hospital, Department of Emergency Medicine, Allentown, Pennsylvania
Kristin A. Bresnan, MD University of South Florida College of Medicine, Department of Family Medicine, Tampa, Florida;
Lehigh Valley Hospital, Department of Family Medicine, Allentown, Pennsylvania
Marna R. Greenberg, DO, MPH University of South Florida College of Medicine, Department of Emergency Medicine, Tampa, Florida;
Lehigh Valley Hospital, Department of Emergency Medicine, Allentown, Pennsylvania

Background
Objectives
Curricular design
Impact/effectiveness

ABSTRACT

Introduction

The Association of American Medical Colleges’ (AAMC) initiative for Core Entrustable Professional Activities for Entering Residency includes as an element of Entrustable Professional Activity 13 to “identify system failures and contribute to a culture of safety and improvement.” We set out to determine the feasibility of using medical students’ action learning projects (ALPs) to expedite implementation of evidence-based pathways for three common patient diagnoses in the emergency department (ED) setting (Atrial fibrillation, congestive heart failure, and pulmonary embolism).

Methods

These prospective quality improvement (QI) initiatives were performed over six months in three Northeastern PA hospitals. Emergency physician mentors were recruited to facilitate a QI experience for third-year medical students for each project. Six students were assigned to each mentor and given class time and network infrastructure support (information technology, consultant experts in lean management) to work on their projects. Students had access to background network data that revealed potential for improvement in disposition (home) for patients.

Results

Under the leadership of their mentors, students accomplished standard QI processes such as performing the background literature search and assessing key stakeholders’ positions that were involved in the respective patient’s care. Students effectively developed flow diagrams, computer aids for clinicians and educational programs, and participated in recruiting champions for the new practice standard. They met with other departmental clinicians to determine barriers to implementation and used this feedback to help set specific parameters to make clinicians more comfortable with the changes in practice that were recommended. All three clinical practice guidelines were initiated at consummation of the students’ projects. After implementation, 86% (38/44) of queried ED providers felt comfortable with medical students being a part of future ED QI initiatives, and 84% (26/31) of the providers who recalled communicating with students on these projects felt they were effective.

Conclusion

Using this novel technique of aligning small groups of medical students with seasoned mentors, it is feasible for medical students to learn important aspects of QI implementation and allows for their engagement to more efficiently move evidence-based medicine from the literature to the bedside.

BACKGROUND

Quality improvement (QI) initiatives to advance patient care have become widespread in healthcare.1 The healthcare industry has adapted many “change” implementation tools from other industries, such as lean management, six sigma, and more recently bidirectional alignment.1 Bidirectional alignment is the idea that an institutional problem should be evaluated and addressed from the bottom-up as well as the top-down.2 This means giving the people on the frontline of care a voice in the ivory tower of organizational priority setting.3 The Association of American Medical Colleges’ (AAMC) initiative for Core Entrustable Professional Activities for Entering Residency includes as an element of Entrustable Professional Activity 13 to “identify system failures and contribute to a culture of safety and improvement.”4 The AAMC Aligning and Educating Quality Initiative has the aspiration of “aligning and educating for quality to assist medical schools in development of curriculum, faculty, and programs in systematic incorporation of these skills starting in the earliest stages of medical careers.5

We designed three educational innovations that stressed bidirectional alignment by pairing senior practitioners in the emergency department (ED) with teams of six third-year medical students on three separate QI initiatives designed to develop clinical pathways for congestive heart failure, pulmonary embolism, and atrial fibrillation. The rationale for such an approach is to pair the experience and knowledge of veteran practitioners with the learning mindset and fresh perspective of medical students to create novel solutions, thus improving quality of care.6 Involving future-oriented learners in the processes of QI better enables organizations to proactively adapt to continually evolving regulations vs. reacting from the top-down with entrenched approaches to meeting standards of care.7

OBJECTIVES

We set out to determine the feasibility of using third-year medical students’ action learning projects (QI projects) to expedite implementation of evidence-based pathways for three common patient diagnoses in the ED setting as well as develop a model for promoting bidirectional alignment at an institutional level. We further evaluated clinician perspectives on using medical students at the forefront of QI pathway development.

CURRICULAR DESIGN

These prospective QI initiatives were performed over six months in three Northeastern PA hospitals. One was a Level I trauma center with an annual census of 90,000, one was a suburban hospital with an annual census of 60,000, and the third was an inner city hospital with an annual census of over 32,000 visits per year. Emergency physician mentors were recruited by medical school faculty to facilitate a QI experience for third-year medical students for each project. These physician sponsor/mentors had no training to lead such QI teams, but all were established leaders in the ED who were familiar with teaching (core emergency medicine [EM] residency faculty) and had participated in QI initiatives previously (examples: the ED vice-chair of QI, a hospital site director, etc). Students were given class time and network infrastructure support (including information technology and consultant experts in lean management) to develop, evaluate, and implement changes in clinical pathways. The timeline and detailed description of the program with faculty time estimates is provided in the table. The network institutional review board (IRB) reviewed the project and found it to be consistent with QI, and thus IRB oversight was not required.

 

Population Health Research Capsule

What do we already know about this issue?

The AAMC Aligning and Educating Quality Initiative has the aspiration of encouraging the development of curriculum for quality improvement skills in the early stages of medical careers.

What was the research question?

Can third year medical students help expedite implementation of evidence-based pathways for common patient diagnoses in the emergency department (ED).

What was the major finding of the study?

Using bidirectional alignment of medical students with mentors, it is feasible for students to learn important aspects of QI.

How does this improve population health?

Using medical students to help promote evidence-based care in the ED indirectly improves population health.

 

Students had access to background network data that revealed potential for improvement in disposition (to home) for patients with all three diagnoses. Each group was expected to use lean management tools, such as plan-do-study-act, to develop a root-cause fishbone diagram to determine the current state, use A3 problem solving, determine and engage the key stakeholders, develop a clinical pathway, recruit champions for change management, and establish a plan for measuring the outcomes of their respective QI initiatives. Following conclusion of the initiatives the students were required to present their projects to peers and the key stakeholders.

The educational methods described were chosen to facilitate bidirectional engagement of senior providers and medical students in order to have a meaningful, team-based impact on QI initiatives in the ED.8 This provided students with the opportunity to learn how clinical practices are evaluated and improved at an institutional level, while enabling the many strata of providers at the clinical frontline to coordinate their efforts to improve quality of care. The students and providers noted challenges when it came to engaging in change management in a hectic and distracting work environment, reconciling multiple pathways from interdisciplinary feedback, and obtaining sufficient data from the electronic medical records. At the conclusion of the projects clinical providers were surveyed regarding their level of comfort with medical students being involved in future QI initiatives in the ED, as well as whether medical student involvement affected their likelihood of using the proposed clinical pathways.

IMPACT/EFFECTIVENESS

Under the leadership of their mentors, students accomplished standard QI processes such as performing the background literature search, assessing key stakeholders’ positions with respect to patient care, and metrics for measuring success. Students effectively developed flow diagrams, computer aids for clinicians, educational programs and participated in recruiting champions for the new practice standard. They met with other departmental clinicians to determine barriers to implementation and used this feedback to help set specific parameters to make clinicians more comfortable with the changes in practice that were recommended. All three clinical practice guidelines (Figures 1–3) were initiated in an orchestrated manner at the consummation of the students’ projects. These guidelines have been implemented for approximately six months.

Figure 3
Atrial fibrillation pathway.

Figure 1
Congestive heart failure pathway.

Figure 2
Pulmonary embolism pathway.

After implementation, 86% (38/44) of the departmental providers felt comfortable with medical students being a part of future ED QI initiatives. Eighty-four percent (26/31) of the providers who recalled communicating with students on these projects (for example as a champion, as a clinician using the pathway, or having received education from the students) felt they were effective. The majority (66%) of providers surveyed felt that using medical students for developing these pathways did not affect their attitude on whether they would use the pathway in clinical practice. Only three providers surveyed felt that using medical students for developing these pathways would make it less likely they would use the pathway.

To date, this curriculum is limited by the fact that we do not have statistical outcome measures to report. However, since initiation, the network and ED QI committees following the implementation of these pathways have had no patient adverse or serious events to report. Additionally, the action learning project described is a curriculum portion of a program for medical students (USF SELECT). The SELECT program has faculty trained in lean methodology and leadership. These resources were available to our network without additional expense or training, although their faculty time is included in the model (Table 1). Whether this training is generalizable to other networks that may not have this robust availability of both medical student faculty or QI infrastructure is unclear.

Table 1Timeline and training for action learning projects.

Task Total hours Faculty Mentor/sponsor Student Start date End date
Identify project sponsors/mentors 4 4 1 0 9/1/2016 10/5/2016
Team development (students receive class training), projects are assigned and ALP starts 3 3 0 3 10/06/2016 10/06/2016
Project management (students receive class training, develop guiding principles, appoint a project leader and manager) 4 4 0 4 11/3 and 1/12/2017 1/12/2017
ALP Group class and/or workgroup time (students have class time to work on projects together) Meet with project sponsor, complete project structure, scope project, draft responsibility chart, develop A3 20 0 20 20 10/6/2016 4/27/2016
Prepare Project Report Out 2 0 0 2 4/27/2017 5/10/2017
Presentation skills (students receive class training) 1 1 0 1 4/27/2017 4/27/2017
ALP class presentations (students present to each other their projects) 4 4 2 4 5/11/2017 5/11/2017
Faculty evaluation of projects 3 3 0 0 5/11/2017 5/19/2017
Summary hours 41 19 23 34+ 9/1/2016 5/19/2017

ALP, action learning project.  +Exact estimate of time for students is not possible. Students had 34 hours of protected class time to complete this work, but the vast majority spent many more hours outside class researching their topics, connecting with champions, and doing departmental staff training.

Using this novel technique of bidirectional alignment of small groups of medical students with seasoned mentors, it is feasible for medical students to learn important aspects of QI implementation and allows for their engagement to more efficiently move evidence-based medicine from the literature to the bedside. Further study with data outcomes to illustrate consistency of algorithm use is needed.

Footnotes

Section Editor: Ed Ullman, MD

Full text available through open access at http://escholarship.org/uc/uciem_westjem

Address for Correspondence: Marna Rayl Greenberg, DO, MPH, Lehigh Valley Hospital, Department of Emergency Medicine, 1200 South Cedar Crest Boulevard, Allentown, PA 18103. Email: Marna.Greenberg@lvh.com 1 / 2018; 19:148 – 157

Submission history: Revision received June 10, 2017; Submitted August 27, 2017; Accepted September 15, 2017

Conflicts of Interest: By the WestJEM article submission agreement, all authors are required to disclose all affiliations, funding sources and financial or management relationships that could be perceived as potential sources of bias. No author has professional or financial relationships with any companies that are relevant to this study. There are no conflicts of interest or sources of funding to declare.

REFERENCES

1. Kaplan HC, Provost LP, Froehle CM, et al. The model for understanding success in quality (MUSIQ): Building a theory of context in healthcare quality improvement. BMJ Qual Saf. 2012;21(1):13-20.

2. Johl K, Gigsby RK. Engaging learners in health system quality improvement efforts. Acad Med. 2017;92(5):593-7.

3. Henderson JC, Venkatraman H. Strategic alignment: leveraging information technology for transforming organizations. IBM Syst J. 1993;32:472-84.

4. Core Entrustable Professional Activities for Entering Residency: Curriculum Developer’s Guide. 2014.

5. Davis NL, Davis NA, Johnson NM, et al. Aligning academic continuing medical education with quality improvement: A model for the 21st century. Acad Med. 2013;88(10):1437-41.

6. Till A, Banerjee , McKimm J. Supporting the engagement of doctors in training in quality improvement and patient safety. Br J Hosp Med (Lond). 2015;76(3):166-9.

7. Wong BM, Holmboe ES. Transforming the academic faculty perspective in graduate medical education to better align educational and clinical outcomes. Acad Med. 2016;91(4):473-9.

8. Trowler V. Student Engagement Literature Review. 2010. Available at: https://www.heacademy.ac.uk/system/files/studentengagementliteraturereview_1.pdf. Accessed June 7, 2017.