Introduction
Methods
Results
Discussion
Limitations
Conclusion
Supplementary information

INTRODUCTION

Education research is an important component of the advancement of any medical discipline, and recent publications have outlined a need for initiatives to improve the quality of education studies and support educators who wish to approach educational challenges, questions, and theory in a scholarly manner.^1-9 Medical educators have reported being limited by the following: 1) time to develop and maintain research skills and engage in all phases of the research process; 2) funding to support time and provide research resources; 3) access to expertise for study design and statistical analyses; 4) access to mentors, both within and outside of emergency medicine (EM); and 5) a sense that education research does not result in extrinsic or intrinsic reward in our current educator paradigm.^10-12 However, there is a gap in our knowledge of how EM educators perceive these barriers, and what solutions would be most helpful to them in achieving their education research goals.

Although workforce studies have described the landscape of emergency physicians in general, little is known about what the academic model looks like for EM educators, and how much variability may exist between departments. ^13,14 The Council of Emergency Medicine Residency Directors (CORD) Education Scholarship Task Force and CORD Academy for Scholarship in Education in Emergency Medicine recommended that the EM education research community analyze the specific needs of EM educators in a rigorous workforce study and needs assessment. Understanding the job descriptions, available resources and staffing for conducting their educational missions, and the needs of the EM educator workforce is a crucial first step to designing and implementing interventions that will improve the quality of education research and scholarship in EM. The purpose of this study was to illuminate the current workforce model for the academic EM educator.

METHODS

Study Setting and Participants

We identified EM residency training programs through the Society of Academic Emergency Medicine (SAEM) residency directory.¹⁵ One member of the program leadership from each program was invited to participate in the study based on available contact information with preference for program director over assistant/associate program director over program coordinator. We collected data between April 2015 and October 2015.

This study was deemed exempt by the institutional review board of Los Angeles Biomedical Research Institute at Harbor-UCLA Medical Center.

Study Design

This was a prospective mixed-methods survey. We identified contact information for potential participants through the SAEM residency directory,¹⁵ programs’ individual websites, and personal knowledge by study team members. Subjects were invited to participate by email and provided with a link to an Internet-based survey. Two follow-up email invitations were sent at weekly intervals to non-responders. Informed consent was implied by those subjects who chose to click on the survey link.

Instrument

To optimize content validity, the instrument was developed by our study group of EM education researchers with recommendations from members of the CORD Education Scholarship Taskforce according to established guidelines for survey research.¹⁶ The survey consisted of multiple-choice, completion, and free-response type items. All items were read aloud and discussed among members of the study group to ensure response process validity, and were then piloted with a small group of representative subjects. We made revisions for clarity based on feedback from pilot testing. In order to maximize response rates, incorporate all available data, and preclude guessing answers to unfamiliar queries, completion of all questions on the survey was not required. The survey instrument is available in Appendix A.

Data Analysis

We calculated and reported descriptive statistics for multiple choice items and completion items with numeric values. Two members of the study team, JJ and WC, independently performed qualitative analysis on the one free-response item using a thematic approach. They examined data line by line to identify recurring concepts and to assign codes, which were then further refined into themes using the constant comparative method.¹⁷ Discrepancies were resolved by discussion and negotiated consensus to establish a final coding scheme, which was applied to all data. A third analyst, LY, using the agreed-upon coding scheme, independently coded the data. The third analyst had an inter-rater agreement of 86.8% with the first two analysts, and disputes were resolved by in-depth discussion.

RESULTS

A total of 112/158 (71%) allopathic programs completed the survey and their responses were analyzed. Because of a low response rate from osteopathic programs 9/25 (36%), we excluded their data from analysis. Characteristics of the programs included in the analysis can be found in Table 1.

The mean number of faculty full time equivalents (FTEs) whose primary role is devoted to the educational mission of the program is 6.92 ± 4.92 [5.87–7.98]. These FTEs are distributed among various roles (Table 2 and Figure 1). These faculty have a mean number of 2.34 ± 1.1 [2.13–2.61] administrative FTEs dedicated to education to support them (Table 3 and Figure 2). Few participants took the provided opportunity to write in additional faculty and administrative roles under the “Other” category. For faculty, responses included ultrasound director, other fellowship directors, resident research director, chair, medical school course director, and remediation director. For administration, responses included assistant residency coordinator, assistant fellowship coordinator, and administrative assistant. Because of the limited number of responses, these data were not formally analyzed.

A total of 81/112 (72.3%) programs responded to the question about clinical hours; 67.9% (55/81) reported having an established standard for the number of hours that core faculty, as defined by the Residency Review Committee, work without grant funding or “buy down” from other internal or external sources. This includes faculty from all academic sections. For those who did have an established standard of clinical hours, the mean number of hours/week for core faculty from all academic sections was 26.34 ± 4.64 [25.11–27.58]. When analyzing how base clinical hours for education faculty were determined, major themes that emerged (in descending order of frequency) were determination by academic/administrative position, uniform departmental base standard, individual negotiation, and adherence to Accreditation Council for Graduate Medical Education (ACGME) guidelines. See Table 4 for results of qualitative analysis.

A total of 31/80 (38.8%) programs reported having a designated person in their department with expertise specific to education research study design and statistical analysis. Of these, 35.5% (11/31) have an education research director.

DISCUSSION

According to our results, a significant portion (approximately 43%) of core faculty are identified by their departments as “education faculty,” or faculty whose primary academic role is devoted to the educational mission of their departments. This likely represents a combination of both perceived importance and practical need. The ACGME requires that EM residency programs maintain a ratio of 1:3 between core faculty and residents.¹⁸ A critical mass of dedicated faculty is required to run a training program efficiently to develop and implement curricula, assess learners, provide mentoring and advising for trainees, participate in residency selection and clinical competency committees, provide scheduling oversight, and ensure continual quality improvement and program evaluation processes are in place.

The majority of education roles described in our study had mean FTEs of less than one, indicating that departments do not have the full spectrum of leadership positions and/or faculty are serving more than one role. This may create added strain on faculty members who strive to complete the duties of multiple key roles or fill in service gaps potentially without additional protected time or added financial benefit. With this information it is easy to see why time has been identified as a limiting factor to performing education research.¹⁰ In addition, burnout and attrition are prevalent in academic medicine.¹⁹ Administrative workload may contribute to burnout, but understanding how educators’ perceptions of the intrinsic reward garnered from their roles is crucial to guide efforts to promote wellness and career satisfaction in academic educators.

Our data also suggest a similar pattern for administrative support staff dedicated to the educational mission of departments. In parallel to the many hats that some education faculty must wear, administrative support staff also appear to perform multiple jobs. It is not clear whether these tasks fall entirely within the realm of education for the administrative staff, or if the departments perceive staff members as purely administrative support rather than an extension of the educational arm of their departments. According to our survey data, the ratio of education faculty to education administrative staff is approximately 3:1. This may represent an additional barrier that educators face in performing scholarship. Without appropriate administrative support, time that faculty could spend on education research and other scholarly endeavors may be diverted to clerical tasks that they must perform themselves. One could argue that this is not the most efficient use of resources.

We found that not all programs have an established standard for clinical hours. Additionally, clinical requirements and how these requirements are determined vary among programs. This may notably contribute to variability in the time and effort that faculty can put towards research and scholarship. It would be interesting to know the degree of impact that clinical load has on scholarly productivity. The mean number of clinical hours/week in this study is approximately 26. If faculty at programs with fewer clinical and administrative hours have a higher degree of scholarly productivity, then this would serve as evidence for allocating more protected time to those who perform education research and scholarship.

We also found that many programs lack personnel with specific methodological expertise in education research, which differs from more traditional research methodology. We postulate that minimal requirements for expertise should include familiarity with qualitative study design as well as familiarity with standard educational formats of hypothesis testing, such as experimental, quasi-experimental, and survey design. This is consistent with current literature citing lack of mentorship and access to expertise in research study design and statistical analysis as barriers.¹⁰ It is conceivable that existing statistical support faculty could expand their toolkit of knowledge to include these methodologies, or additional faculty who are specifically trained in this area could bridge this gap, especially as education scholarship fellowship graduates become increasingly prevalent.

LIMITATIONS

Because this was a survey study the results are subject to the limitations inherent to this type of data collection. Additionally, because of the exclusion of osteopathic programs due to poor response rate, the results are limited to allopathic programs. Since we were not able to obtain data from all programs it is possible that additional opinions were not represented. We desired to keep the survey brief to maximize response and in doing so we may have missed important information. We caution readers to consult multiple sources prior to assigning a specific number of hours for each position in their departments. Many questions are still left unanswered. How are departments funding their education mission? What proportion of EM educators conduct education research? Do educators have enough time to fulfill their academic and scholarly responsibilities and does administrative and clinical workload impact scholarly productivity? What rewards do educators receive for their work and how does this affect their wellness and career satisfaction? It will be important to follow up this study with a comprehensive needs assessment of all relevant stakeholder groups.

CONCLUSION

This study describes the current workforce of EM academic educators and provides further data to support previously identified barriers that educators face in performing scholarship. The results of this study may inform policies and interventions to promote education scholarship and support educators in their academic careers.

Supplementary Information

Footnotes

Section Editor: David A. Wald, DO

Full text available through open access at http://escholarship.org/uc/uciem_westjem

Address for Correspondence: Jaime Jordan, MD, Harbor-UCLA Medical Center, Department of Emergency Medicine, 1000 W. Carson Street, Box 21, Torrance, CA 90502. Email: jordan@emedharbor.edu. 1 / 2017; 18:163 – 168

Submission history: Revision received September 24, 2016; Accepted October 27, 2016

Conflicts of Interest: By the WestJEM article submission agreement, all authors are required to disclose all affiliations, funding sources and financial or management relationships that could be perceived as potential sources of bias. The authors disclosed none.

REFERENCES

1. Sullivan GM, Simpson D, Cook DA, et al. Redefining Quality in Medical Education Research: A Consumer’s View. J Grad Med Educ. 2014;6(3):424-429.

2. Reed DA, Cook DA, Beckman TJ, et al. Association between funding and quality of published medical education research. JAMA. 2007;298(9):1002-1009.

3. McGaghie WC, Issenberg SB, Petrusa ER, et al. A critical review of simulation-based medical education research: 2003–2009. Med Educ. 2010;44(1):50-63.

4. Cook DA, Beckman TJ, Bordage G. Quality of reporting of experimental studies in medical education: a systematic review. Med Educ. 2007;41(8):737-745.

5. Cook DA, Levinson AJ, Garside S. Method and reporting quality in health professions education research: a systematic review. Med Educ. 2011;45(3):227-238.

6. Reed DA, Beckman TJ, Wright SM. An assessment of the methodologic quality of medical education research studies published in The American Journal of Surgery. Am J Surg. 2009;198(3):442-444.

7. Chen FM, Bauchner H, Burstin H. A call for outcomes research in medical education. Acad Med. 2004;79(10):955-960.

8. Lurie SJ. Raising the passing grade for studies of medical education. JAMA. 2003;290(9):1210-1212.

9. Cook DA, Bowen JL, Gerrity MS, et al. Proposed standards for medical education submissions to the Journal of General Internal Medicine. J Gen Intern Med. 2008;23(7):908-913.

10. Yarris LM, Juve AM, Artino AR, et al. Expertise, Time, Money, Mentoring, and Reward: Systematic Barriers That Limit Education Researcher Productivity – Proceedings From the AAMC GEA Workshop. J Grad Med Educ. 2014;6(3):430-6.

11. Zibrowski EM, Weston WW, Goldszmidt MA. ‘I don’t have time’: issues of fragmentation, prioritisation and motivation for education scholarship among medical faculty. Med Educ. 2008;42(9):872-8.

12. Goldszmidt MA, Zibrowski EM, Weston WW. Education scholarship: it’s not just a question of ‘degree.’. Med Teach. 2008;30(1):34-9.

13. Reinhart MA, Munger BS, Rund DA. American Board of Emergency Medicine Longitudinal Study of Emergency Physicians. Ann Emerg Med. 1999;33(1):22-32.

14. Reiter M, Wen LS, Allen BW. The Emergency Medicine Workforce: Profile and Projections. J Emerg Med. 2016;50(4):690-693.

15. Available at: http://beta.saem.org/membership/services/residency-directory. Accessed March 24, 2016.

16. Rickards G, Magee C, Artino AR. You can’t fix by analysis what you’ve spoiled by design: developing survey instruments and collecting validity evidence. J Grad Med Educ. 2012;4(4):407-410.

17. Bradley EH, Curry LA, Devers KJ. Qualitative data analysis for health services research: developing taxonomy, themes, and theory. Health Serv Res. 2007;42:1758-1772.

18. ACGME Emergency Medicine Program Requirements and FAQs. Available at: http://www.acgme.org/Specialties/Program-Requirements-and-FAQs-and-Applications/pfcatid/7/Emergency%20Medicine. Accessed June 1, 2016.

19. Shanafelt TD, West CP, Sloan JA, et al. Career fit and burnout among academic faculty. Arch Intern Med. 2009;169(10):990-5.