Introduction
Methods
Results
Discussion
Limitations
Conclusion

INTRODUCTION

In 2013, the American College of Emergency Physicians (ACEP) published 10 evidence-based Choosing Wisely® recommendations for emergency department (ED) use of diagnostic tests and treatments,¹ which patients and their providers were encouraged to discuss in order to reduce low-value care. Five of these focused on high-cost imaging. Since the publication of the Choosing Wisely recommendations, a number of tools, including clinical pathways,² computerized decision support (CDS),³ and provider-specific audit and feedback⁴ have focused on improving emergency physicians’ adherence to evidence-based imaging guidelines.

In June 2016, ACEP’s Emergency Quality Network (E-QUAL) began its Reduce Avoidable Imaging Initiative⁵ as part of the Centers for Medicare and Medicaid Services (CMS) Transforming Clinical Practice Initiative, designed to “reduce testing and imaging with low risk patients through the implementation of Choosing Wisely recommendations.” The initiative is a laudable endeavor meant to emphasize the many tools available to assist with adherence to these recommendations. However, there are sparse data on whether EDs have implemented any interventions to improve adherence to guidelines since their initial publication in 2013. Our objective was to investigate whether New England EDs implemented evidence-based interventions to improve adherence to ACEP Choosing Wisely recommendations after their release, and also whether provider-specific audit and feedback for imaging had been implemented in these EDs.

METHODS

Study Settings

This survey study was exempt from institutional review board review. In 2015 we used the 2012 National Emergency Department Inventory⁶ to identify 195 hospital-affiliated EDs in the six New England states of Connecticut, Maine, Massachusetts, New Hampshire, Rhode Island and Vermont. We mailed surveys to their ED directors to assess several structural and process measures of each ED including capabilities, characteristics and policies in 2014 (the year after the release of ACEP’s Choosing Wisely recommendations). These initial mailings included cover letters denoting the endorsement of each state’s ACEP chapter, and were followed up twice with repeat mailings to non-responders.

Survey Questions

The survey included a total of 30 questions, of which two focused on interventions that EDs had implemented targeting the five Choosing Wisely imaging scenarios: head computed tomography (CT) studies (for minor traumatic brain injury [MTBI] and in asymptomatic adults with syncope); chest CT for low-risk pulmonary embolism (PE); lumbar spine magnetic resonance imaging (MRI) for atraumatic low back pain; and abdominal CT for renal colic. For each of the scenarios, respondents were asked dichotomous yes/no subquestions regarding whether they had implemented either a guideline/policy/clinical pathway and/or computerized decision support. Pediatric EDs and EDs without CT/MRI capability to which individual questions might not apply were asked to indicate “NA” (not applicable). “Guideline/policy/clinical pathway” and “computerized decision support” were not further defined to allow respondents flexibility in deciding which of their interventions fell into each category. Respondents were also asked whether their clinicians received provider-specific audit and feedback regarding use of advanced imaging (e.g., their utilization compared to other clinicians in their ED).

Population Health Research Capsule

What do we already know about this issue?

ACEP has recommended a number of tests that can be avoided as part of the Choosing Wisely initiative.

What was the research question?

Do EDs have guidelines, policies, pathways, decision support, or feedback regarding ACEP Choosing Wisely Initiatives?

What was the major finding of the study?

57% have guidelines, policies, or pathways, 40% have decision support, and only 28% provide feedback regarding Choosing Wisely.

How does this improve population health?

Adherence to Choosing Wisely requires more than just education – the use of the evidence-based tools we studied should improve adherence to Choosing Wisely.

Outcome Measures and Statistical Analyses

The outcomes were the presence or absence of at least one reported intervention for each of the five Choosing Wisely imaging scenarios, as well as the use of provider-specific audit and feedback. Data analysis included descriptive statistics and a comparison of state differences using Fisher’s exact test.

RESULTS

Responses were received from 169/195 (87%) of New England EDs; all individual state response rates were >80%. Overall, 101 (60%) of responding EDs had implemented an intervention for at least one Choosing Wisely imaging scenario; a guideline/policy/clinical pathway (57% of EDs) was more frequently reported than CDS (28%) (Figure 1). In addition, 40% of EDs had implemented provider-specific audit and feedback, without significant interstate variation (range: 29–55%).

The most common interventions were for chest CT in patients at low risk of PE (47% of EDs), and head CT in patients with MBTI (45% of EDs) (Figure 2). By state, 63% of Maine EDs had implemented an intervention for head CT in patients with MTBI and 58% of Connecticut EDs had one for PE CT; interventions for the other three scenarios were observed less frequently (≤33% of responding EDs). Interventions were least commonly reported for abdominal CT for renal colic (21% of responding EDs); e.g., only one (8%) Vermont ED reported a policy for this scenario. There were no significant interstate differences in which Choosing Wisely targets had interventions implemented for them.

DISCUSSION

One year after release of the ACEP Choosing Wisely recommendations, most New England EDs focused their interventions on only two imaging scenarios: patients with suspected PE and those with MTBI. While most EDs had a guideline/policy/clinical pathway related to at least one of the Choosing Wisely recommendations, only a minority had implemented CDS related to one of the recommendations. In addition, fewer than half of New England EDs were providing provider-specific audit and feedback about imaging utilization to their clinicians.

The Choosing Wisely recommendations are largely evidence-based and meant to target likely unnecessary and overused imaging studies. Translating these recommendations into clinical practice to reduce low-value care is the next needed step. A recent analysis of the effectiveness of the publication of several Choosing Wisely recommendations on outcomes (including head and lumbar spine imaging) found mixed results.⁷ The engagement of EDs in interventions beyond basic education through the 2016 Reduce Avoidable Imaging Initiative will be key to broad implementation of tools targeting the established Choosing Wisely targets.

For campaigns such as the E-QUAL Reducing Avoidable Imaging Initiative to succeed, understanding current ED interest and practice in imaging re-education is essential to guiding future efforts. From our data, it is evident that a number of EDs, at least in New England, are already focusing on reducing imaging in patients with suspected PE and suspected MTBI. Both conditions have a broader evidence base to guide imaging decisions, including widely disseminated ACEP clinical policies, likely making provider engagement in quality improvement (QI) easier. Conversely, clear evidence gaps remain for two of the other targets —CT for syncope and abdominal CT for renal colic —for which no clinical practice guidelines or many large clinical trials exist. In the case of lumbar spine MRI for back pain, which is supported by the Choosing Wisely campaigns of numerous medical specialty societies and clinical practice guidelines, lower rates of ED QI interventions may reflect that many of the guidelines are still based on expert consensus rather than evidence-based decision instruments. As national efforts such as E-QUAL continue to expand, resources must be dedicated to developing an evidence base and the associated clinical practice guidelines necessary to engender physician trust in recommendations to reduce imaging use historically considered necessary to exclude high-risk, life-threatening diagnoses.

Our work also demonstrates wide variability in the implementation of evidence-based QI strategies, with a notable lack of CDS and provider-specific audit and feedback. There is evidence that both of these interventions can improve the appropriateness of imaging use in the ED^3,4,8,9 – specifically in the scenarios targeted by ACEP’s E-QUAL – and both tools should be considered by EDs looking to improve performance for Choosing Wisely recommendations. Poor adoption of CDS is surprising given the rapid adoption of electronic health records (EHR) in the ED as a result of the CMS Meaningful Use program. However, not all EHRs have easily-customized CDS capabilities, and ED staff may not have had the opportunity to readily implement CDS to address Choosing Wisely recommendations. As our survey preceded implementation of the 2014 Protecting Access to Medicare Act (PAMA) that mandates physician use of CDS, increased adoption of CDS is likely to be reflected in future surveys of EDs.

LIMITATIONS

This study has two main limitations. The first is that it was conducted only in New England, and therefore results may not generalize nationally. We used a survey methodology that relies on self-reporting and we did not assess any potential differences in actual “on the ground” implementation. However, we have no reason to believe that respondents were untruthful, particularly as they were told in the survey instructions that no identifying information would be used and responses would be reported only in aggregate.

CONCLUSION

Our assessment of initial ED efforts undertaken after publication of the Choosing Wisely recommendations shows broad interest in reducing avoidable imaging. However, the QI practices are largely limited to select interventions and certain clinical scenarios. Few EDs have embraced the opportunity to implement multiple evidence-based interventions likely to yield synergistic gains necessary for emergency care to advance the national goals of improving patient-centered and resource-efficient care.¹⁰

Footnotes

Section Editor: Michael Abraham, MD

Full text available through open access at http://escholarship.org/uc/uciem_westjem

Address for Correspondence: Ali S. Raja, MD, MBA, MPH, Massachusetts General Hospital, Department of Emergency Medicine, 55 Fruit Street, Founders 110, Boston, MA 02114. Email: araja@mgh.harvard.edu. 4 / 2017; 18:454 – 458

Submission history: Revision received September 28, 2016; Submitted December 13, 2016; Accepted January 13, 2017

Conflicts of Interest: By the WestJEM article submission agreement, all authors are required to disclose all affiliations, funding sources and financial or management relationships that could be perceived as potential sources of bias. The authors disclosed none.

REFERENCES

1. An initiative of the ABIM Foundation. Available at: http://www.choosingwisely.org/clinician-lists/. Accessed Sep 26, 2016.

2. Raja AS, Greenberg JO, Qaseem A, et al. Evaluation of patients with suspected acute pulmonary embolism: Best practice advice from the Clinical Guidelines Committee of the American College of Physicians. Ann Intern Med. 2015;163(9):701-11.

3. Gupta A, Ip IK, Raja AS, et al. Effect of clinical decision support on documented guideline adherence for head CT in emergency department patients with mild traumatic brain injury. J Am Med Inform Assoc. 2014;21(e2):e347-51.

4. Raja AS, Ip IK, Dunne RM, et al. Effects of performance feedback reports on adherence to evidence-based guidelines in use of CT for evaluation of pulmonary embolism in the emergency department: a randomized trial. AJR Am J Roentgenol. 2015;205(5):936-40.

5. Reduce Avoidable Imaging Initiative. Available at: https://www.acep.org/Advocacy/Reduce-Avoidable-Imaging-Initiative/. Accessed Sep 26, 2016.

6. Available at: http://www.emnet-usa.org/nedi/nedi_usa.htm. Accessed Aug 4, 2016.

7. Rosenberg A, Agiro A, Gottlieb M, et al. Early trends among seven recommendations from the choosing wisely campaign. JAMA Intern Med. 2015;175(12):1913-20.

8. Raja AS, Ip IK, Prevedello LM, et al. Effect of computerized clinical decision support on the use and yield of CT pulmonary angiography in the emergency department. Radiology. 2012;262(2):468-74.

9. Le Grand Rogers R, Narvaez Y, Venkatesh AK, et al. Improving emergency physician performance using audit and feedback: a systematic review. Am J Emerg Med. 2015;33(10):1505-14.

10. Venkatesh AK, Schuur JD. A “Top Five” list for emergency medicine: a policy and research agenda for stewardship to improve the value of emergency care. Am J Emerg Med. 2013;31(10):1520-4.