Introduction
Methods
Results
Discussion
Limitations
Conclusion
Supplementary information

INTRODUCTION

The Accreditation Council for Graduate Medical Education (ACGME) aims to assure a safe learning environment for residents, in part by trying to mitigate fatigue-related medical errors and promote learner wellness.^1,2 To this end, in 2003 the ACGME broadly enacted duty hour standards as part of their common program requirements. However, in 2008, with ongoing patient safety concerns, the Institute of Medicine (IOM) published “Resident Duty Hours: Enhancing Sleep, Supervision, and Safety.”³ This highly publicized report called for more stringent resident work-load and duty hour limitations to better protect patients. Shortly thereafter, the ACGME published their 2011 Duty Hour Standards: Enhancing Quality of Care, Supervision and Resident Professional Development and revised their work hour standards within their core program requirements (Table 1).^4,5

Even before these revisions, studies evaluating the benefit of work hour limitations demonstrated mixed outcomes.^6,7,8,9,10 One study on patient safety found longer resident work hours to be associated with increased patient length of stay and the number of intensive care unit transfers, but found no association with inpatient mortality or 30-day readmission rate.¹¹ Others suggested scheduling adjustments made by some specialties to comply with work hour standards resulted in increased physician handoffs,^12,13 creating barriers to efficient patient care.^14,15 Residency training programs report significant challenges trying to balance work hour restrictions and enforcement with patient care and educational experiences.^14,16,17 Even residents themselves have questioned the benefit of work hour restrictions, as one recent study suggests that limitations do not change resident burnout or self-reported fatigue.¹⁸

In an attempt to improve resident education, the ACGME held its second Resident Duty Hours in the Learning and Working Environment Congress in March 2016. The ACGME invited 64 national organizations to submit position papers with recommendations to improve the work hour standards and the learning environment, from which 56 were invited to provide oral testimony to the Congress. The American College of Emergency Physicians (ACEP) and the Council of Emergency Medicine Residency Directors (CORD) were invited to testify on behalf of emergency medicine (EM). In 2017 the ACGME used this input to revise their common program requirements in an effort to improve the learning and working environment for residents.⁵

With this article, we describe the processes and outcomes by which ACEP and CORD collaborated and jointly explored the state of opinion of EM educators on the ACGME’s clinical and educational work hour standards, and developed recommendations for the 2016 ACGME Resident Duty Hours in the Learning and Working Environment Congress.

Population Health Research Capsule

What do we already know about this issue?

ACGME duty hour standards have been in place since 2003. Their effects on the EM learning environment have not been extensively reported.

What was the research question?

We sought to gain the perspectives of EM educators and make recommendation regarding the future of ACGME work hour standards.

What was the major finding of the study?

Aside from promoting resident wellness, EM educators largely perceive current work hour standards to have a negative impact on patient safety and the educational experience.

How does this improve population health?

Future revisions of ACGME clinical and work hour standards should aim to prioritize all aspects of the learning environment.

METHODS

In response to the ACGME request for organizational position papers and recommendations on resident learning and the working environment, ACEP and CORD engaged in parallel but collaborative efforts to generate informed, consensus-based responses from both organizations. The University of Virginia Institutional Review Board reviewed the completed project retroactively and deemed this descriptive report to be exempt from review.

In 2016 an 11-member working group of experts in graduate medical education (GME) and EM residency training convened and engaged in iterative discussions to offer EM’s recommendations for future changes to the dimensions of resident work hour requirements and standards governing key aspects of the learning and working environment. Work group members were purposefully selected through an unstructured discussion process by ACEP academic affairs committee leaders (i.e., authors SW, EG, and HH) for their understanding of, and expertise in, GME and to assure diverse opinions on the learning environment from programmatic, institutional, and national perspectives.

Following broad discussion and commentary, the work group developed and administered a 19-item survey to gain feedback regarding the impact of existing ACGME duty hour standards on EM programs in the areas of patient care and safety (five items), programmatic and personnel costs (six items), consultant and EM resident caseload (four items), and educational experience (four items). Respondents were asked to rate the impact of the 2011 ACGME duty hour standards on a bi-directional 5-point Likert scale from significant negative impact to significant positive impact. Comments were solicited within each area of impact (Appendix).

The survey was distributed to a convenience sample of EM GME stakeholders via the CORD organizational email listserv for EM residency programs. This listserv has participation from each of the 167 allopathic and 32 osteopathic accredited EM training programs. These 199 EM GME programs average five listserv members per program for a total listserv membership of 1,034. Members include departmental chairs, vice-chairs, program directors, associate program directors, educational faculty, and program coordinators. We performed survey data analysis using simple descriptive statistics. Comparative statistics were used to highlight significant differences as appropriate. We identified representative comments in each of the four impact areas to exemplify perceived impact in each of the areas.

Informed by relevant resources,⁴ the work group’s experience, and survey and comment data, the work group engaged in unstructured iterative discussion to develop draft position statements and recommendations in three areas requested by the ACGME: a formal position on current ACGME resident duty hour requirements; dimensions of duty hour requirements; and standards governing key aspects of the learning and working environment. The draft statements were combined, edited and refined to generate independent, consensus-based final recommendations from ACEP and CORD. Each organization’s respective board of directors approved their final recommendations prior to submission to the ACGME.

RESULTS

The work group was comprised of four women, four active program directors and six past program directors. All members contributed substantially to the iterative discussions. One hundred fifty-seven EM educational leaders responded to the survey representing 15.2% (157/1,034) of the broader listserv membership. Ninety-two of the 157 (92/157, 58.5%) respondents were program directors, yielding a targeted response rate for EM program directors of 46.2% (92/199). Demographic data, professional positions, and geographic locations of respondents are listed in Table 2. Survey responses are grouped by areas of impact and are presented in Table 3.

The impact of the ACGME duty hour standards is reported to have had a majority negative effect in all four domains (i.e., patient care and safety, programmatic costs and personnel, resident case load and competency, and educational experience), although the magnitude of negative impact was least in most of the education experience categories. The only positive impact found was fostering resident work-life balance and wellness. Representative comments selected from 233 completed text fields pertaining to individual areas of impact are presented in Table 4. The final ACEP and CORD formal position statements on ACGME duty hour standards and recommendations for future changes in both the dimensions of duty hour regulation and standards governing key aspects of the learning and working environment are listed in Table 5.

DISCUSSION

Informed by feedback from EM GME educators, our collaborative, consensus-based process found that the ACGME clinical and educational work hour standards are believed to have overall negative effect on the balance of patient safety and the educational experience. EM educators believe broad work hour regulations have adversely impacted the number of patient handoffs, length of stay, boarding, resident case load, hospital costs, and faculty work load in GME. In addition, the ability of training programs to deliver an effective didactic curriculum and assure resident professional citizenship and accountability has been hampered. The only areas of perceived positive impact were resident wellness and a program’s ability to foster it.

Residency training programs commit to promoting a supportive educational learning environment. In doing so, programs must balance the resident training experience and educational opportunities with resident wellness and patient safety to create a meaningful and effective educational experience. The ACGME strives to ensure this optimal balance through established work- hour standards for residents.⁴ However, EM educators feel that these work hour standards jeopardize the development of personal responsibility and professional accountability that programs work diligently to entrust to their trainees. Furthermore, they are believed to be onerous and cause unnecessary hardship for programs as they monitor and enforce the mandate. EM educators believe that ACGME work hour standards have historically fallen short of their intended outcomes for patient safety and the educational experience, compromising residency programs’ ability to maintain an ideal learning environment.

Patient safety is known to be adversely affected by fatigued decision-making, excessive transitions of care, and, in the emergency department (ED), prolonged length of stay and departmental boarding.^{3,4,19,20,21,22} While ACGME work hour standards are intended to mitigate fatigued decision-making, evidence suggests that they may not be reducing medical errors as expected.^1,10 EM educators believe that work hour standards jeopardize patient safety by increasing transitions across the continuum of patient care and increasing lengths of stay and boarding in the ED. The episodic nature inherent to our specialty’s care allows for EM shift-based schedules to align well with the current ACGME standards. On the other hand, inpatient services do not have the same workflow and frequently are not engaged in straightforward episodic care. For them, the implementation of work hour standards has resulted in an unintended increase in transitions of care and a concomitant loss of patient continuity. EM educators perceive these changes as negatively impacting patient flow in the ED by requiring more handoffs both during the consultation process and in the inpatient setting, creating barriers to efficient and safe patient care across the continuum of care. Additionally, this is believed to have a trickle-down effect of increasing the consultation times, prolonging length of stay, and increasing ED boarding.²³ Given that previous studies have linked ED length of stay and boarding of inpatients to increased patient morbidity and mortality,^19,20,21,22 EM educators encourage the ACGME to consider specialty specific work hour standards allowing for greater alignment of work hour regulations with individual specialty workflow.

Resident and faculty attendance at didactic conferences is critical and necessitated by ACGME program requirements.²⁴ Unfortunately, overlaying conference attendance requirements on the shift-based paradigm that is typically required to meet clinical and educational work hour requirements dramatically decreases a program’s and resident’s ability to be flexible with educational or clinical time. By functionally locking a resident into very distinct work and didactic obligations with strict work hour parameters, residents are not able to autonomously flex their time to promote personal or career development priorities nor to address their personal learning needs. Residents have limited ability to move clinical shifts without violating work hours or compromising conference attendance. Ideally, any standards would afford programs and residents a degree of flexibility to allow individual educational experiences to be maximized.

Both schedule alterations necessary to comply with work hour standards and monitoring of clinical and educational hours have had an additional economic impact on institutions. First, the cost of replacing off-service trainees who are repatriated to their home training programs to fulfill service obligations can be substantial. There are no specific data to determine the amount lost; however, surrogate costs are available. For example, providing just eight hours of care daily by advanced practice providers in the ED can result in substantial costs to a department or organization. It stands to reason that similar effects are felt by other specialties as their resident workforce hours are decreased. Institutions potentially need to re-allocate dollars to fund coverage for changes created by the duty hour standards, shifting funding away from educational programs. Thus, a system has been created by which there is less funding for education without a definitive increase in patient safety or training effectiveness.

Given the increased administrative burden of logging and monitoring resident time, many residency programs have needed to expand their administrative support.¹⁷ Hidden costs for both residency programs and GME offices in order to meet this unfunded mandate cannot be ignored. Compliance has required in some cases that programs purchase electronic management systems and devote faculty and administrator time to review and monitor data. Some have argued that savings from work hours-related improvements in patient safety may justify the increased personnel and administrative costs.²⁵ However, EM educators still believe the ACGME must explore ways to decrease the programmatic administrative burden of monitoring work hour standards compliance.

Another significant concern is the notion that the current emphasis on work hour monitoring appears to engender a “clock punching” mentality, de-emphasizing service, professional citizenship, and personal investment in one’s craft – all critical components of professional development for physicians. Though current requirements allow for continuous work hour limitation exceptions when caring for sick patients, the need to document explanations for these exceptions imposes additional administrative burdens on residents, often resulting in a punitive effect rather than rewarding desired behavior. EM educators encourage the ACGME to consider greater flexibility in clinical and educational work hour standards to promote resident wellness while allowing for the greater development of professional citizenship.

Currently, two large studies investigating the impact of flexible duty hours on resident training are granted work hour waivers.^26,27 Initial data from the Flexibility in Duty Hours Requirements for Surgical Trainees (FIRST) Trial suggest that increased work hour flexibility was not associated with worse patient outcomes or decreased satisfaction with residents’ own well-being or the quality of their education.²⁶ Interestingly, while program directors in this trial perceived more positive effects on safety of patient care, continuity of care, and residents’ ability to attend educational activities, they felt flexible work hours had a positive effect on resident well-being.²⁸

The second trial, Individualized Comparative Effectiveness of Models Optimizing Patient Safety and Resident Education (iCOMPARE), is also a large, multi-institutional study designed to evaluate the efficacy and safety of less restrictive work hours in internal medicine training programs.²⁷ Importantly, this study will evaluate the impact of relaxed work hour restrictions on the measures of patient safety and trainee education. Data from both of these studies will help to inform future clinical and educational work hour restrictions in all specialties.

In spring 2017, the ACGME announced revisions to subsections of the common program requirements pertaining specifically to the regulation of the learning and working environment.⁵ These revisions place greater emphasis on patient safety, quality improvement, supervision and accountability, resident and faculty well-being, and professional development. Simultaneously, they aim to provide greater flexibility to programs and residents in defining their own learning and working environment, minimizing the burdensome documentation requirements for residents and programs alike.⁵ The impact of these revisions is not yet known. Moreover, the changes to the work hour rules do not address all the concerns identified by the EM community as outlined in our work. Consequently, opportunities exist to determine the specific impact of the more restrictive EM, as compared to non-EM, work hour requirements on ED patient safety and the professional development of EM residents.

LIMITATIONS

Our informed consensus-based process for developing recommendations for the ACGME was limited in several ways. First, our survey instrument was primarily derived using input from workgroup members with expertise in EM and medical education, and their personal experience and understanding of the literature. Given the significant time constraint imposed by the ACGME for each organization’s formal position paper, our survey was informed by a limited literature review and we were not able to confirm response process validity by piloting the survey for readability and clarity. It is possible that important topics were misunderstood or excluded from the survey instrument. However, while the overall survey response rate was low (15.2%), the response rate from program directors—those most likely to be familiar with ACGME regulations and their effect on trainees—was better (46.2%). Still, with less than 50% of program directors responding to the survey, there is the potential that our conclusions do not accurately represent all program directors’ opinions, despite including input from the broader GME community.

Additionally, open comments were solicited and reviewed by the work group allowing for all opinions to be considered. Next, with an average of 5.2 listserv members per program, any given institution could have answered the survey more than once. The respondent characteristics suggest that there was broad response, but there is still a possibility that over-representation from one institution may have affected the survey results. Next, we recognize the possibility of bias affecting our results. The survey instrument was created by a group of medical education experts, all of whom work (or have worked) within the ACGME program requirements. While survey categories and questions could have been biased towards outcomes favored by the workgroup based on their collective experience, the creation of the initial survey instrument was guided by existing relevant literature. Moreover, there was diverse input from several EM stakeholders and qualitative responses were reviewed and incorporated into iterative discussion minimizing the risk of any bias from the small work group. Lastly, our qualitative commentary data was not formally coded, but rather iteratively discussed by the expert working group to inform commentary and to derive position statements and recommendations.

CONCLUSION

Emergency Medicine educators believe that ACGME clinical and educational work hour standards have historically negatively impacted the learning environment and do not optimally promote patient safety or the development of resident professional citizenship. EM educators hope that the 2017 revisions to the ACGME clinical work and education standards prioritize all aspects of patient safety, resident wellness, and the ideal learning environment.

Supplementary Information

Footnotes

Section Editor: Sorabh Khandelwal, MD

Full text available through open access at http://escholarship.org/uc/uciem_westjem

Address for Correspondence: Stephen J. Wolf, MD, University of Virginia School of Medicine, Department of Emergency Medicine, P.O. Box 800699, Charlottesville, VA 22908. Email: Sjw2v@virginia.edu. 1 / 2018; 19:49 – 58

Submission history: Revision received June 15, 2017; Submitted November 3, 2017; Accepted November 3, 2017

Conflicts of Interest: By the WestJEM article submission agreement, all authors are required to disclose all affiliations, funding sources and financial or management relationships that could be perceived as potential sources of bias. No author has professional or financial relationships with any companies that are relevant to this study. There are no conflicts of interest or sources of funding to declare.

REFERENCES

1. History of Duty Hours. Available at: http://www.acgme.org/What-We-Do/Accreditation/Duty-Hours/History-of-Duty-Hours. Accessed on June 8, 2017.

2. Duty Hours. Available at: http://www.acgme.org/What-We-Do/Accreditation/Duty-Hours. Accessed on June 28, 2016.

3. Ulmer C, Wolman D, Johns M. Committee on Optimizing Graduate Medical Trainee (Resident) Hours and Work Schedules to Improve Patient Safety, Institute of Medicine Resident Duty Hours: Enhancing Sleep, Supervision, and Safety. 2008.

4. Philibert I, Amis S. The ACGME 2011 Duty Hour Standards: Enhancing Quality of Care, Supervision, and Resident Professional Development. Available at: http://www.acgme.org/What-We-Do/Accreditation/Duty-Hours/Research-and-Testimony. Accessed on June 8, 2017.

5. Common Program Requirements: The Learning and Working Environment (Duty Hours). Available at: https://www.acgme.org/What-We-Do/Accreditation/Duty-Hours. Accessed on June 8, 2017.

6. Moonesinghe SR, Lowery J, Shahi N, et al. Impact of reduction in working hours for doctors in training on postgraduate medical education and patients’ outcomes: systematic review. BMJ. 2011;343:d1580.

7. Philibert I, Nasca T, Brigham T, et al. Duty-hour limits and patient care and resident Outcomes: can high-quality studies offer insight into complex relationships. Annu Rev Med. 2013;64:467-83.

8. Bolster L, Rourke L. The effect of restricting residents’ duty hours on patient safety, resident well-being, and resident education: an updated systematic review. J Grad Med Educ. 2015;7(3):349-63.

9. Rajaram R, Saadat L, Chung J, et al. Impact of the 2011 ACGME resident duty hour reform on hospital patient experience and process-of-care. BMJ Qual Saf. 2016;25(12):962-70.

10. Lin H, Lin E, Auditore S, et al. A narrative review of high-quality literature on the effects of resident duty hours reforms. Acad Med. 2016;91(1):140-50.

11. Ouyang D, Chen JH, Krishnan G, et al. Patient outcomes when housestaff exceed 80 hours per week. Am J Med. 2016;129(9):993-9.e1.

12. Desai SV, Feldman L, Brown L, et al. Effect of the 2011 vs 2003 duty hour regulation-compliant models on sleep duration, trainee education, and continuity of patient care. JAMA Intern Med. 2013;173(8):649-55.

13. Kogan JR, Pinto-Powell R, Brown LA, et al. The impact of resident duty hours reform on the internal medicine core clerkship: results from the clerkship directors in internal medicine survey. Acad Med. 2006;8(12):1038-44.

14. Schuh LA, Kahn MA, Southerland AM, et al. Pilot trial of IOM duty hour recommendations in neurology residency programs: unintended consequences. Neurology. 2011;77(9):883-7.

15. Sussman D, Paul JE. The impact of transitioning from a 24-hour to a 16-hour call model amongst a cohort of Canadian anesthesia residents at McMaster University. Adv Med Educ Pract. 2015;7(6):501-6.

16. Schwartz SI, Galant J, Kaji A, et al. Effect of the 16-hour work limit on general surgery intern operative case volume: a multi-institutional study. JAMA Surg. 2013;148(9):829-33.

17. Vidyarthi A, Auerbach A. Is 80 the cost of saving lives? Reduced duty hours, errors and cost. J Gen Intern Med. 2005;20(10):969-70.

18. Ripp JA, Bellini L, Fallar R, et al. The impact of duty hours restrictions on job burnout in internal medicine residents: a three-institution comparison study. Acad Med. 2015;90(4):494-9.

19. Lee PA, Rowe BH, Innes G, et al. Assessment of consultation impact on emergency department operations through novel metrics of responsiveness and decision-making efficiency. CJEM. 2014;16(3):185-92.

20. Department Crowding: High-Impact Solutions. 2016. Available at: https://www.acep.org/legislation-and-advocacy/practice-management-issues/boarding/crowding/emergency-department-crowding—high-impact-solutions. Accessed on June 8, 2017.

21. Sprivulis PC, Da Silva JA, Jacobs IG, et al. The association between hospital overcrowding and mortality among patients admitted via Western Australian emergency departments. Med J Aust. 2006;184(5):208-12.

22. Singer AJ, Thode HC, Viccellio P, et al. The association between length of emergency department boarding and mortality. Acad Emerg Med. 2011;18(12):1324-29.

23. Mustafa A, Mahgoub S. Understanding and overcoming Barriers to timely discharge from the pediatric units. BMJ Qual Improv Rep. 2016;5.

24. Lefebvre C, Hiestand B, Bond MC, et al. Increasing faculty attendance at emergency medicine residency conferences: does cme credit make a difference. J Grad Med Educ. 2013;5(1):41-5.

25. Nuckols T, Escarce JJ. ACGME Common Program Requirements: Potential Cost Implications of Changes to Resident Duty Hours and Related Changes to the Training Environment Announced on September 28, 2010. Available at: https://www.acgme.org/Portals/0/PDFs/dh-CostAnalysisfor2011CPRs[1].pdf. Accessed on June 8, 2016.

26. Billmoria KY, Chung JQ, Hedges LV, et al. National cluster-randomization trial of duty-hours flexibility in surgical training. N Engl J Med. 2016;374(8):713-27.

27. ClinicalTrialsgov [Internet]. 2000. Available at: https://clinicaltrials.gov/ct2/show/NCT02274818.

28. Saadat LV, Dahlke AR, Rajaran R, et al. Program director perceptions of surgical resident training and patient care under flexible duty hour requirements. J Am Coll Surg. 2016;222(6):1098-105.