Background
Objectives
Curricular design
Impact/effectiveness
Limitations
Conclusion

BACKGROUND

Emergency physicians (EPs) are continuously interrupted during patient care.¹ Chisholm et al. found that EPs are interrupted nearly 10 times per hour requiring frequent shifts of attention across tasks.^2-3 How EPs respond to interruptions is just beginning to be better understood.⁴ One such interruption involves the screening of electrocardiograms (ECGs) for life-threatening pathologies.

Task-switching varies with regard to the cognitive load requirements (Figure).^5-6 The ability to task-switch during patient care is something all EPs must learn.^7-8 As they progress through training, more responsibility and larger patient loads require more frequent task-switching. A method for deliberate practice of task-switching is needed to improve performance.⁹

We designed our task-switching simulation “Asteroids® and ECGs” to simulate a situation that required considerable cognitive processing while patient care related tasks (such as ECG interpretation) are gradually introduced. Our goal was to acclimate learners to shifting attention across cognitively demanding tasks.¹⁰ Ultimately, our hope is that resident performance will improve through deliberate practice with task-switching.

OBJECTIVES

We sought to evaluate a task-switching simulation between two cognitively demanding activities with the hope that practice with the simulation might reduce the time required to switch tasks.

CURRICULAR DESIGN

This study was a one-group pretest-posttest design that compared resident performance on ECG interpretation with no distractions to their performance on ECG interpretation while engaged in the video game Asteroids®.

Population

The subjects were residents from our emergency medicine (EM) and EM / internal medicine (EM/IM) programs (N=56).

Measurement/Instrumentation

The ECGs included a normal sinus rhythm or one of these patterns of pathology.

ST-elevation myocardial infarction (STEMI)

Complete heart block

Ventricular tachycardia

S1Q3T3/R-heart strain

Brugada

Electrical alternans

Sinus tachycardia

Atrial fibrillation with rapid ventricular rate or response

Inferior-posterior STEMI

Wellen’s syndrome

Right bundle branch block

Mobitz II Heart Block

ECG interpretation experts reviewed each strip and labeled them with the pathology and rating of difficulty. The pretest and posttest were equated for level of difficulty. A survey specialist familiar with the project developed an evaluation questionnaire.

Study Procedure

The study was conducted during October 2017 with residents rotating through this activity on conference days.

Asteroids® (available at: http://www.freeasteroids.org/) is a video game in which the object is to prevent the player’s “spaceship” from being destroyed by asteroids. The player avoids asteroids by “shooting” or dodging them and receives points for the each asteroid destroyed. Residents were allotted time to try the game. Then they had 15 minutes of uninterrupted time to read eight ECG strips, circle the abnormality, provide a diagnosis, and make a patient management decision.

After the pre-test, residents were instructed to start the video game and treat it as if it were an important clinical task. Once residents started playing, they were provided with ECG strips at random intervals throughout the 15 minutes of the exercise. As in the pretest, residents had to interpret the ECG strips; however under this condition they had to maintain the game. Subjects turned in score logs and completed a survey at the end.

Scoring

ECG pre- and post-tests were scored by assigning one point for identifying the ECG abnormality, and one point for the correct triage decision. Points were summed and converted to a percentage. We also recorded the resident’s video game score.

Data Analysis

We performed analyses using IBM SPSS.¹¹ We first conducted a preliminary three-factor (2×2×3) analysis of variance (ANOVA) with one repeated measure: pre- and post-test score (TIME) by resident post-graduate year and gender. The subsequent significant effect of TIME was analyzed with a paired t-test and effect size.¹²

IMPACT/EFFECTIVENESS

Of 46 eligible residents, 35 (76.1%) participated in the study. Sixty percent were women, and all levels of training were equally represented.

The ANOVA resulted in no significant main-effects or interactions involving gender or postgraduate year (PGY) Level (Table). However, we observed a significant and large TIME effect, suggesting that residents performed worse on the ECG test while task-switching with the video game than they did on the ECG pretest (pre-test mean=63.2, standard deviation [SD]=13.7; Asteroids® mean=47.7; SD=12.5; t= 6.04, degrees of freedom=34, p<.001; effect size=1.19).¹³

All residents said the game made ECG reading more difficult. Most (91.7%) thought task-switching was difficult and more than half (53%) thought they could improve with practice.

The results confirm that the video game served as an effective distractor, requiring a cognitive load to compel EM residents to spend significant amounts of time switching between playing Asteroids® and reading ECGs. Results were similar for residents of both genders and all levels of training. The Asteroids® game yielded substantially lower ECG reading scores for everyone, regardless of their Asteroids® score or experience with gaming. We interpreted this to indicate that the Asteroids® game served as an adequate distractor regardless of previous experience or skill in video gaming. Based on this finding, we believe that this video game could be used to create an inexpensive simulation to practice task-switching. We hope that with deliberate practice under these simulated conditions the residents’ task-switching improves, since cognitive psychology researchers have found evidence that multitasking is a trainable skill.¹⁴

LIMITATIONS

We recognize that while the Asteroids® video game serves as a significant distractor to reading and interpreting ECGs, the cognitive load of actual clinical disruptions may result in more “time to switch tasks” when compared to playing a video game.

CONCLUSION

Interpreting ECGs while playing the Asteroids® lowered ECG reading performance. Our goal was to show that this simulation could be used to improve resident’s task-switching performance.

Footnotes

Section Editor: Chris Merritt, MD, MPH

Full text available through open access at http://escholarship.org/uc/uciem_westjem

Address for Correspondence: David P. Way, MEd, The Ohio State University, Department of Emergency Medicine, 750 Prior Hall, 376 W 10th 10 Ave., Columbus, OH 43210. Email: David.Way@osumc.edu. 1 / 2019; 20:94 – 97

Submission history: Revision received July 12, 2018; Submitted October 5, 2018; Accepted October 13, 2018

Conflicts of Interest: By the WestJEM article submission agreement, all authors are required to disclose all affiliations, funding sources and financial or management relationships that could be perceived as potential sources of bias. No author has professional or financial relationships with any companies that are relevant to this study. There are no conflicts of interest or sources of funding to declare.

REFERENCES

1. Weigl M, Muller A, Holland S, et al. Work conditions, mental workload and patient care quality: a multisource study in the emergency department. BMJ Qual Saf. 2016;25(7):499-508.

2. Chisholm CD, Dornfeld AM, Nelson DR, et al. Work interrupted: a comparison of workplace interruptions in emergency departments and primary care offices. Ann Emerg Med. 2001;38(2):146-51.

3. Chisholm CD, Collison EK, Nelson DR, et al. Emergency department workplace interruptions: Are emergency physicians “interrupt driven” and “multitasking”?. Acad Emerg Med. 2000;7(11):1239-43.

4. Fong A, Ratwani RM. Understanding emergency medicine physicians multitasking behaviors around interruptions. Acad Emerg Med. 2018;25(10):1164-8.

5. Salvucci DD, Taatgen NA. Threaded cognition: an integrated theory of concurrent multitasking. Psychol Rev. 2008;115(1):101-30.

6. Salvucci DD, Taatgen NA, Borst JP. Toward a unified theory of the multitasking continuum: from concurrent performance to task switching, interruption, and resumption. 2009.

7. Heng KW. Teaching and evaluating multitasking ability in emergency medicine residents-what is the best practice?. Int J Emerg Med. 2014;7:41.

8. Counselman FL, Babu K, Edens MA, et al. The 2016 Model of the Clinical Practice of Emergency Medicine. J Emerg Med. 2017;52(6):846-9.

9. Ericsson AE. Enhancing the development of professional performance: Implications from the study of deliberate practice. Development of professional expertise: Toward measurement of expert performance and design of optimal learning environments. 2009:405-31.

10. Free Video Games Project. Free Asteroids. Available at: www.freeasteroids.org/. Accessed October 1–31, 2017.

11. IBM SPSS Statistics for Windows Version 24.0. 2016.

12. Lenhard W, Lenhard A. Calculation of Effect Sizes (#4 Effect size estimates for repeated measures designs). 2016. Available at: https://www.psychometrica.de/effect_size.html. Accessed May 1, 2018.

13. Ellis PD. Thresholds for interpreting effect sizes. 2009. Available at: http://www.polyu.edu.hk/mm/effectsizefaqs/thresholds_for_interpreting_effect_sizes2.html. Accessed on April 5, 2018.

14. Hambrick DZ, Oswald FL, Daroski ES, et al. Predictors of multitasking performance in a synthetic work paradigm. Appl Cogn Psychol. 2009;24:1149-67.