Experience with Emergency Ultrasound Training by Canadian Emergency Medicine Residents

Author Affiliation
Daniel J. Kim, MD Vancouver General Hospital, Department of Emergency Medicine, Vancouver, British Columbia, Canada
Jonathan Theoret, MDCM University of British Columbia, Department of Emergency Medicine, Vancouver, British Columbia, Canada
Michael M. Liao, MD Denver Health Medical Center, Department of Emergency Medicine, Denver, Colorado
John L. Kendall, MD Denver Health Medical Center, Department of Emergency Medicine, Denver, Colorado

Introduction
Methods
Results
Discussion
Limitations
Conclusion

ABSTRACT

Introduction: Starting in 2008, emergency ultrasound (EUS) was introduced as a core competency to the Royal College of Physicians and Surgeons of Canada (Royal College) emergency medicine (EM) training standards. The Royal College accredits postgraduate EM specialty training in Canada through 5-year residency programs. The objective of this study is to describe both the current experience with and the perceptions of EUS by Canadian Royal College EM senior residents.

Methods: This was a web-based survey conducted from January to March 2011 of all 39 Canadian Royal College postgraduate fifth-year (PGY-5) EM residents. Main outcome measures were characteristics of EUS training and perceptions of EUS.

Results: Survey response rate was 95% (37/39). EUS was part of the formal residency curriculum for 86% of respondents (32/37). Residents most commonly received training in focused assessment with sonography for trauma, intrauterine pregnancy, abdominal aortic aneurysm, cardiac, and procedural guidance. Although the most commonly provided instructional material (86% [32/37]) was an ultrasound course, 73% (27/37) of residents used educational resources outside of residency training to supplement their ultrasound knowledge. Most residents (95% [35/37]) made clinical decisions and patient dispositions based on their EUS interpretation without a consultative study by radiology. Residents had very favorable perceptions and opinions of EUS.

Conclusion: EUS training in Royal College EM programs was prevalent and perceived favorably by residents, but there was heterogeneity in resident training and practice of EUS. This suggests variability in both the level and quality of EUS training in Canadian Royal College EM residency programs. [West J Emerg Med. 2014;15(3):306–311.]

INTRODUCTION

Emergency ultrasound (EUS) in Canada has developed in a delayed fashion compared to the United States. The Canadian Association of Emergency Physicians (CAEP) initially issued a position statement in 1999 supporting the availability of focused ultrasound 24 hours per day in the emergency department (ED).1 It has since undergone revisions in 2006 and most recently 2012.2,3 The 2006 position statement was the first revision supporting the incorporation of EUS training into emergency medicine (EM) residency programs accredited by the Royal College of Physicians and Surgeons of Canada (Royal College).2 The Royal College accredits postgraduate EM specialty training in Canada through 5-year residency programs. From 2008, EUS was officially introduced as a core competency to the Royal College EM training standards.4

In the United States, the American College of Emergency Physicians (ACEP) first published a position statement supporting the use of ultrasound by emergency physicians in 1990.5 Starting in 1996, the Accreditation Council for Graduate Medical Education (ACGME) EM core curriculum required EUS competence for residency graduation.6 Furthermore, many prominent EM and non-EM organizations have endorsed the use of EUS, including ACEP, the Society for Academic Emergency Medicine (SAEM), the Council of Emergency Medicine Residency Directors (CORD), and the American Institute of Ultrasound in Medicine (AIUM).7–10

Although EUS training has been well described in the United States, there is only a paucity of data about the state of EUS training in Canadian Royal College EM residency programs.11–13 There are currently no data about resident perceptions of EUS training in Canada, yet it is important to incorporate this feedback into training programs to optimize the resident educational experience with ultrasound. Both the Royal College and the ACGME include residents in the accreditation processes of their postgraduate medical programs, through direct participation in accreditation teams and through program evaluations or surveys.14,15 The objective of this study is to describe both the current experience with and the perceptions of EUS by Canadian Royal College EM senior residents.

METHODS

Study Design

This was a web-based survey study approved by the Sunnybrook Health Sciences Research Ethics Board.

Study Setting and Population

All postgraduate fifth-year (PGY-5) Royal College EM residents (39 total residents in 13 residency programs) across Canada were invited to participate in this study. Resident names and contact information were acquired directly from residency program administrators whose contact information is published on the Canadian Resident Matching Service (CaRMS) website.16

Study Protocol

The study investigators designed a website-based survey instrument (Appendix) based on previously published survey studies focusing on EUS training.11,13,17 Seven EM residents reviewed the survey for language and ease of use. Their comments were incorporated into the revision of this instrument. Potential resident participants were emailed a link to the website-based survey on Zoomerang (MarketTools Co, San Francisco, California) in January 2011. The survey consisted of 23 mandatory close-ended questions assessing EUS training and perceptions. Questions assessing perceptions of EUS were answered on a 5-point Likert scale (1=strongly agree, 2=agree, 3=neutral, 4=disagree, 5=strongly disagree). Non-respondents were sent reminder emails at 2, 4, 6, and 8 weeks after the initial email. An incentive in the form of an iTunes (Apple Inc, Cupertino, California) email gift certificate in the amount of $10 was provided for successful survey completion. All respondents were immediately de-identified from their responses after completion of the survey.

Data Analysis

Data were downloaded directly from the web interface and imported into Microsoft Excel (Microsoft Co, Redmond, Washington). We reported descriptive statistics using number and proportion.

RESULTS

The survey response rate was 95% (37/39) of all PGY-5 residents. EUS was part of the formal residency curriculum for 86% (32/37) of respondents. All (100% [37/37]) residents had immediate access to an ultrasound machine in the ED. EUS training was described as minimal for 22% (8/37) of residents, moderate for 51% (19/37), and extensive for 27% (10/37).

Table 1 outlines EUS training received by residents as well as ultrasound applications performed by residents in their own clinical practice. Table 2 summarizes ultrasound-guided procedural training received and ultrasound-guided procedures performed in clinical practice. Table 3 details the different types of EUS instructional material provided by EM residency programs to their residents. The most commonly provided instructional material was an ultrasound course for 86% (32/37). The majority of residents (73% [27/37]) used other educational resources outside of residency training to supplement their EUS knowledge beyond that offered or required by their residency program. Table 3 also breaks down the different types of instructional material used by the 27 respondents who used supplementary educational resources.

Table 1. Breakdown of ultrasound training received and ultrasound applications performed in clinical practice by Canadian Royal College emergency medicine residents.

Table 1.Breakdown of ultrasound training received and ultrasound applications performed in clinical practice by Canadian Royal College emergency medicine residents.

Table 2. Breakdown of ultrasound-guided procedural training received and ultrasound-guided procedures performed in clinical practice by Canadian Royal College emergency medicine residents.

Table 2.Breakdown of ultrasound-guided procedural training received and ultrasound-guided procedures performed in clinical practice by Canadian Royal College emergency medicine residents.

Table 3. Emergency ultrasound instructional material provided by Canadian Royal College emergency medicine residency programs, and alternative educational resources used by emergency medicine residents to supplement their emergency ultrasound knowledge.

306Table3

Almost all respondents (95% [35/37]) make clinical decisions and patient dispositions based on their EUS interpretation without a consultative study by radiology. In this group, 89% (31/35) only apply this type of decision making for specific EUS applications. Table 4 describes these EUS applications. Figure 1 summarizes resident perceptions of EUS and EUS training.

Figure 1. Likert responses to survey questions represented using stacked count data.

Figure 1. Likert responses to survey questions represented using stacked count data.

Table 4.Ultrasound applications for which Canadian Royal College emergency medicine residents make clinical decisions and patient dispositions based on their emergency ultrasound interpretation without formal confirmation.

Table 4.Ultrasound applications for which Canadian Royal College emergency medicine residents make clinical decisions and patient dispositions based on their emergency ultrasound interpretation without formal confirmation.

DISCUSSION

Bedside ultrasound is a paradigm shift from traditional consultative imaging to the performance of a focused, dynamic study to allow direct correlation with a patient’s signs and symptoms.18 It has been shown to improve outcomes, decrease costs, and decrease complications.19–21 The majority of EUS education in the United States occurs during EM residency training, but there is only a paucity of corresponding data about the state of EUS training in Canadian Royal College EM programs and no information about resident perceptions of their EUS training.11–13,17

Our data demonstrate that the majority of Royal College EM residents receive training in EUS as part of their residency curriculum. While EUS training is prevalent, the scope of training is limited to focused assessment with sonography for trauma (FAST), intrauterine pregnancy, abdominal aortic aneurysm (AAA), cardiac, and procedural guidance. This scope satisfies the 2008 Royal College objectives of training in EM and reflects the applications listed in CAEP’s 2006 position statement on EUS.2,4 However, this is a smaller scope of practice compared to the 2008 ACEP EUS guidelines, which additionally list biliary, urinary tract, deep vein thrombosis (DVT), soft tissue/musculoskeletal, thoracic, and ocular as core EUS applications.7 The 2012 CAEP position statement now includes these additional applications as advanced EUS applications.3 There was no significant difference between the EUS applications for which residents received training and the EUS applications performed by residents in their own clinical practice.

Despite the seemingly focused scope of training, more than half of respondents reported using advanced EUS applications like thoracic ultrasound and ultrasound guidance for arterial line placement, foreign body removal, incision and drainage, paracentesis, and peripheral venous cannulation. However, a survey study of Royal College EM program directors in 2011 reported that less than half of all programs offer training in these specific advanced applications.13 This discrepancy between residents and program directors has several possible explanations, including the under-reporting of training by program directors or the over-reporting of training by residents.

Our results provide another possible explanation. With 73% of residents using other educational resources outside of residency training, the use of advanced EUS applications may be driven by the residents themselves. The most commonly used supplementary educational resources were online educational resources (56%), textbooks (52%), and ultrasound courses (52%). Residents had very favorable perceptions and opinions of EUS, and most strongly believed that ultrasound should be performed by emergency physicians. Residents also believed that there was interest by their resident group in expanding the scope of their program’s EUS curriculum. There is a high level of enthusiasm for training in EUS, and educators should be aware that a majority of residents are using supplementary educational resources. It is up to educators to direct residents to EUS resources that are accurate, effective, and evidence-based. We would also argue that educators need to ensure that their faculty continues to hone their skills in such advanced applications to provide appropriate supervision to their residents.

One potential measure of a successful ultrasound training program is whether decisions related to patient care and disposition are made based on the EUS exam interpretation. Almost all respondents (95%) reported that they made clinical decisions and patient dispositions based on their EUS interpretation without a consultative study by radiology. This is surprising considering that only 86% of respondents reported that EUS is part of their formal residency curriculum. This suggests that there are residents who lack core EUS training yet make clinical decisions and dispositions based on their ultrasound exam. Of residents that apply this type of decision making, the majority (89%) make clinical decisions and dispositions only for specific ultrasound applications. The most commonly cited applications were AAA (97%), FAST (87%), and procedural guidance (68%). Respondents seemed uncomfortable in their own ultrasound interpretation of applications that are traditionally performed by radiology, such as biliary, urinary tract, and DVT. Additionally, data from 2011 collected concurrently at the same time as the data from this study reported that 69% of Royal College EM programs had no formal quality assurance process in place for the use of EUS, but in 100% of these programs EM residents and faculty made clinical decisions and patient dispositions based on their EUS interpretation.13 This is concerning, given that both residents and faculty are making clinical decisions and patient dispositions without the safety net of a quality assurance program. The goals of a quality assurance process are to maximize patient safety, ensure accuracy, and improve physician performance. CAEP supports the principle of incorporating a quality improvement program for EUS into the overall ED quality assurance process.2 ACEP states that quality assurance systems are an integral part of an EUS program.7 The lack of quality assurance programs for the use of EUS seems to be a key deficiency in current Royal College EM residency programs that needs to be addressed urgently.

LIMITATIONS

This study specifically surveyed PGY-5 EM residents and reported their responses. As these responses are based on the perceptions of each resident, they may not reflect the actual reality of EUS training in their residency programs. It is also possible that the monetary incentive resulted in rapid and factitious completion of the survey simply to receive the incentive; however, given the small overall value of the incentive, the likelihood of this occurrence is low. Additionally, we did not observe any obvious patterns in the data to suggest such responses. The survey instrument was designed by the study investigators and is not a formally validated survey instrument. Finally, 4 respondents (11%) self-reported participation in an external EUS fellowship program during residency training, so these results may provide an overestimate of EUS training provided by Royal College EM residency programs.

CONCLUSION

EUS training in Royal College EM programs was prevalent and perceived favorably by residents, but there is heterogeneity in resident training and practice of EUS. This suggests variability in both the level and quality of EUS training. These results suggest a potential role for national guidelines to standardize ultrasound training for all Royal College EM programs. Additionally, the use of ultrasound for advanced applications is popular and prevalent among residents. Future research is needed to determine the best methods for delivering EUS education and training.

Footnotes

Conflicts of Interest: By the WestJEM article submission agreement, all authors are required to disclose all affiliations, funding sources and financial or management relationships that could be perceived as potential sources of bias. Michael M. Liao was supported by the Agency for Healthcare Research and Quality (AHRQ) (F32 HS018123). The other authors disclosed none.

Supervising Section Editor: Laleh Gharahbaghian, MD

Address for Correspondence: Daniel Kim, MD, Vancouver General Hospital, Department of Emergency Medicine, 855 12th Ave. W., Vancouver, BC V5Z 1M9, Canada. Email: dkim000@gmail.com. 5 / 2014; 15:306 – 311

Submission history: Revision received April 20, 2013; Submitted July 31, 2013; Accepted September 4, 2013

Full text available through open access at http://escholarship.org/uc/uciem_westjem

REFERENCES

1. Canadian Association of Emergency Physicians. Ultrasonography in the emergency department, 1999 position statement. Feb 1, 1999 Available at: http://caep.ca/resources/position-statements-and-guidelines/ultrasonography-ed-1999. Accessed Mar 12, 2012.
2. Emergency Department Targeted Ultrasound Interest Group, Canadian Association of Emergency Physicians. Emergency department targeted ultrasound: 2006 update. CJEM. 2006;8:170–171. [PubMed]
3. Henneberry RJ, Hanson A, Healey A. et al. Use of point of care sonography by emergency physicians. CJEM.2012;14:106–112. [PubMed]
4. Royal College of Physicians and Surgeons of Canada. Objectives of training in emergency medicine. Ottawa, ON: Royal College of Physicians and Surgeons of Canada; 2008. Available at:http://rcpsc.medical.org/residency/certification/objectives/emergmed_e.pdf. Accessed Jun 21, 2012.
5. American College of Emergency Physicians. Council resolution on ultrasound. Nov 1990 ACEP News.
6. Accreditation Council for Graduate Medical Education. Emergency Medicine Guidelines. 2010 Available at:http://www.acgme.org/acWebsite/RRC_110/110_guidelines.asp. Accessed Jun 21, 2012.
7. American College of Emergency Physicians. Emergency Ultrasound Guidelines. Dallas, TX: American College of Emergency Physicians; 2008. Available at: http://www.acep.org/WorkArea/linkit.aspx?LinkIdentifier=id&ItemID=32878. Accessed Jun 21, 2012.
8. Society for Academic Emergency Medicine. Ultrasound Position Statement. 1991;3:3. SAEM Newsletter.
9. Akhtar S, Theodoro D, Gaspari R. et al. Resident training in emergency ultrasound: consensus recommendations from the 2008 Council of Emergency Medicine Residency Directors conference. Acad Emerg Med. 2009;16:S32–36. [PubMed]
10. American Institute of Ultrasound in Medicine. AIUM officially recognizes ACEP Emergency Ultrasound Guidelines. Nov 17, 2011 AIUM Sound Waves Newsletter. Available at:http://www.aium.org/soundWaves/article.aspx?aId=442&iId=20111117. Accessed Jun 21, 2012.
11. Counselman FL, Sanders A, Slovis CM. et al. The status of bedside ultrasonography training in emergency medicine residency programs. Acad Emerg Med. 2003;10:37–42. [PubMed]
12. Ahern M, Mallin MP, Weitzel S. et al. Variability in ultrasound education among emergency medicine residencies. West J Emerg Med. 2010;11:314–318. [PMC free article] [PubMed]
13. Kim DJ, Theoret J, Liao MM. et al. The current state of ultrasound training in Canadian emergency medicine programs: perspectives from program directors. Acad Emerg Med. 2012;19:1073–1078. [PubMed]
14. Maniate JM. Redesigning a resident program evaluation to strengthen the Canadian residency education accreditation system. Acad Med. 2010;85:1196–1202. [PubMed]
15. Accreditation Council for Graduate Medical Education. Resident-Fellow Survey. Available at:http://www.acgme.org/acgmeweb/DataCollectionSystems/ResidentFellowSurvey.aspx. Accessed Dec 26, 2012.
16. Canadian Resident Matching Service (CaRMS) Available at: http://www.carms.ca/eng/index.shtml. Accessed Mar 12, 2012.
17. Moore CL, Gregg S, Lambert M. Performance, training, quality assurance, and reimbursement of emergency physician-performed ultrasonography at academic medical centers. J Ultrasound Med. 2004;23:459–466.[PubMed]
18. Moore CL, Copel JA. Point-of-care ultrasonography. N Eng J Med. 2011;364:749–757. [PubMed]
19. Melniker LA, Leibner E, McKenney et al. Randomized controlled clinical trial of point-of-care, limited ultrasonography for trauma in the emergency department: the first sonography outcomes assessment program trial.Ann Emerg Med. 2006;48:227–235. [PubMed]
20. Branney SW, Moore EE, Cantrill SV. et al. Ultrasound based key clinical pathway reduces the use of hospital resources for the evaluation of blunt abdominal trauma. J Trauma. 1997;42:1086–1090. [PubMed]
21. Hind D, Calvert N, McWilliams R. et al. Ultrasonic locating devices for central venous cannulation: meta-analysis. BMJ. 2003;16:361–367. [PMC free article] [PubMed]