| Author | Affiliation |
|---|---|
| William Scruggs, MD | Department of Emergency Medicine, University of California Irvine, School of Medicine |
| J. Christian Fox, MD | Department of Emergency Medicine, University of California Irvine, School of Medicine |
| Brian Potts, MD | Department of Emergency Medicine, University of California Irvine, School of Medicine |
| Alexander Zlidenny, MD | Department of Emergency Medicine, University of California Irvine, School of Medicine |
| JoAnne McDonough, MD | Department of Emergency Medicine, University of California Irvine, School of Medicine |
| Craig L. Anderson, MPH, PhD | Department of Emergency Medicine, University of California Irvine, School of Medicine |
| Jarrod Larson, BS | Department of Emergency Medicine, University of California Irvine, School of Medicine |
| Graciela Barajas, BS | Department of Emergency Medicine, University of California Irvine, School of Medicine |
| Mark I. Langdorf, MD, MHPE | Department of Emergency Medicine, University of California Irvine, School of Medicine |
ABSTRACT
Introduction:
To determine the ability of emergency department (ED) physicians to diagnose cholelithiasis with bedside ultrasound.
Methods:
ED gallbladder ultrasounds recorded over 37 months were compared to radiology ultrasound interpretation.
Results:
Of 1,690 ED gallbladder ultrasound scans performed during this period, radiology ultrasound was performed in 575/1690 (34%) cases. ED physician bedside interpretation was 88% sensitive [95% CI, 84–91] and 87% specific [95% CI, 82–91], while positive predictive value (PPV) was 91% [88–94%] and negative predictive value (NPV) was 83% [78–87%], using radiology interpretation as the criterion reference.
Conclusion:
ED physician ultrasound of the gallbladder for cholelithiasis is both sensitive and specific.
INTRODUCTION
As less expensive, portable ultrasound machines became available in the mid-1980s, ultrasound made its debut in the emergency department (ED) as a diagnostic tool.1,2Ultrasound is now an accepted use in the ED by emergency physicians (EPs).3–13 Training in ultrasound is part of the curriculum in 96% of emergency medicine (EM) residencies, and there are a growing number of fellowships in emergency ultrasound for EM–trained physicians.14
Approximately 20 million people in the United States have gallstones, with an additional one million diagnosed each year.15 Traditionally, evaluation involves a right upper quadrant (RUQ) ultrasound by an ultrasound technician and interpretation by a radiologist. However, radiology ultrasound is not universally available to ED patients. ED ultrasonography of the RUQ can result in shorter stays, lower costs, and better patient satisfaction.16,17
Over three years we performed 2,321 RUQ ultrasounds. With this large experience, we attempt to assess the ability of emergency physicians to diagnosis cholelithiasis. This study is the largest sample to date of ED right upper quadrant ultrasound with image confirmation and comparison to radiology criterion reference.
METHODS
We Performed the study in a 35-bed Level I trauma center ED, with a census of 41,000 patients per year, supporting a Post Graduate Year 1–3 EM residency. Thirteen attending emergency physicians and one ultrasound fellow had various levels of expertise with ultrasound. Three attendings were credentialed by the American Registry of Diagnostic Medical Sonography (RDMS) and seven (including the fellow) had sufficient experience to qualify to take the RDMS exam. The remaining three rarely performed ultrasound. Obtaining hospital privileges first required 300 ED ultrasound examinations, over-read by the Director of Emergency Ultrasound, who had completed an emergency ultrasound fellowship (JCF). After this provisional period, three ultrasounds were proctored for each application. Correct performance and interpretation then warranted hospital privileges. During the study period, three emergency physicians had hospital privileges to make clinical decisions based on ED ultrasound.
The 36 residents had performed 0–1000 ultrasounds prior to the 37-month study. During the study period, each performed 200–1200 ED ultrasounds of all applications; 15–200 were of the RUQ. The RUQ application was second only to trauma as the most common application of bedside ultrasound. Residents received 12 hours of didactic ultrasound training per year, in addition to six hours during EM-1 orientation. Faculty attended approximately half of these sessions.
Until July 2004, all ultrasounds were done with a B+K Hawk 2102 ultrasound machine (Copenhagen, Denmark). After that, a Sonosite Titan (Bothell, WA) was also available. Both machines had 3.5–5 MHz abdominal probes and video recorders. Physicians recorded each ultrasound and wrote the bedside interpretation on standard data sheets.
We reviewed emergency department RUQ ultrasounds from July 1, 2001 to August 10, 2004 for gallstones, and examined computer records for radiology ultrasound within one month of the index scan. We did not address other diagnostic ultrasound criteria for cholecystitis. We excluded cases lacking a valid patient identifier, bedside interpretation, video recording, or adequate images as determined at the bedside, or radiologist.
We calculated sensitivity, specificity and predictive values for ED bedside US compared with radiology US interpretations. These parameters were calculated in the usual manner with confidence intervals by the efficient-score method with continuity correction.18
The Institutional Review Board approved the study protocol and documentation of consent was waived.
RESULTS
ED physicians documented 2,321 gallbladder ultrasounds during the study period. Six hundred thirty-one (27%) scans were excluded for lack of: patient identifier (n=26, 1%), bedside interpretation (n=114, 5%), video recording (n=272, 12%), and adequate imaging (n=219, 9%). Of the remaining 1,690 ultrasounds (Figure 1), 575 (34% of 1690 and 25% of 2321) had radiology ultrasound and formed the final study population.
Flow diagram of right upper quadrant emergency department ultrasounds
In the 575 patients who received both bedside and radiology ultrasounds, radiology diagnosed gallstones in 344 of 575 (60%). ED ultrasound was positive for gallstones in 332 (57.7%) patients. ED bedside interpretation was 88% sensitive [95% CI, 84–91%] and 87% specific [82–91%] (Table 1). Positive predictive value (PPV) was 91% [88–94%] and negative predictive value (NPV) was 83% [78–87%].
Results of ED ultrasound compared to subsequent radiology ultrasound diagnosis.
Six percent (144/2321) of bedside ultrasound examinations had inadequate images for emergency physician interpretation, compared to 1.4% (8/575) of ultrasound technologist-acquired examinations which were not interpretable by radiologists.
DISCUSSION
Cholecystosonography is the initial imaging modality for the diagnosis of cholelithiasis.15,19–24 Ultrasound is non-invasive, relatively inexpensive, requires no radiation, and is very accurate in skilled hands. As gallstones are present in 90–95% of acute cholecystitis and association with a sonographic Murphy’s sign yields a PPV of 92%, bedside ultrasound may rapidly drive early diagnosis and disposition. This is important, as emergency physician ability to identify other markers of acute cholecystitis (i.e. pericholecystic fluid and thickened gallbladder wall) is much more limited.
We demonstrate that emergency physicians in this training program are accurate in ultrasound diagnosis of gallstones. The sensitivity and specificity of 88% and 87%, compared to radiology ultrasound, is consistent with the four prior studies in the EM literature as noted in the Table 2.3,25–27
Prior studies from the emergency medicine literature addressing sensitivity and specificity of ED ultrasound.
The present study documents similar sensitivity as previous efforts. The specificity of studies, including this one, is high when ED ultrasound is performed on all patients with abdominal pain, but lower when considering only select patients who also had radiology ultrasound. This verification bias has been described by Shea et al.19 regarding biliary ultrasound.
In our experience, use of radiology ultrasound is more likely when the bedside ultrasound finds abnormalities. Thus the specificity is underestimated. Descriptions of ultrasonographer experience, quality of machine, and level of practitioner (attending vs. resident) are variable in previous studies and may contribute to the differences in accuracy.
The sample size of 575 verified by radiology ultrasound almost doubles previously published experience with this comparison. The radiology literature demonstrates a sensitivity of 81–99% for radiology ultrasound for the diagnosis of cholelithiasis,21,28–33though the majority of the studies demonstrating sensitivities at the lower end of the range were performed in the early years of ultrasound. A rigorous meta-analysis of the radiology literature in 1994 by Shea et al.19 for the diagnosis of cholelithiasis found a sensitivity of 97% and specificity of 95% (unadjusted for verification bias). The adjusted sensitivity was 84% and specificity 99% (adjustment by method of Greenes and Begg – ref29 in Shea). Nevertheless, a variety of textbooks quoted in the same manuscript report sensitivities > 95%, which appears overstated.
Our study demonstrates a 6% rate of inadequate imaging by EPs. This compares to the 18% indeterminate rate reported by Durston and the 5% of cases in the Rosen study in which the gallbladder was not visualized.1,3 The Kendall27 and Schlager3 studies did not comment on their rate of indeterminate scans. Our data suggests that radiology ultrasound is limited by inadequate imaging less frequently, finding only 8/575 (1.4%) to be indeterminate for cholelithiasis.
The increased rate of EP inadequate imaging has several potential explanations. First, EPs typically spend less than 10 minutes on their exams, and likely do not use adjuncts such as patient positioning and water ingestion.27 Second, contracted gallbladders in the ED may distend during the 2–3 hours it takes the ultrasound technologist to respond. Finally, ED ultrasound machines sacrifice image quality for durability, portability, and cost.
We excluded bedside studies with inadequate images from our primary analysis. This mimics real-life practice, as EPs routinely obtain a radiology ultrasound if their own images are inadequate. Ninety-four percent of patients had adequate images in our study, potentially expediting their ED evaluation.
LIMITATIONS
Our study has several limitations. Verification bias is inherent in a retrospective study of a diagnostic test. Three-fourths of patients who had emergency department RUQ ultrasound did not have a confirmatory study by radiology, and it is possible that gallstones were missed completely in those that did not undergo the criterion reference. Conversely, some ED patients undoubtedly had radiology ultrasounds ordered initially, foregoing ED bedside ultrasound.
Second, the clinical and sonographic experience of our physicians varied widely. Paradoxically, some of the most experienced clinicians had limited ultrasound skills whereas many of the junior residents had performed several hundred scans. Finally, our criterion reference lacked pathologic confirmation, a recurrent problem with EM biliary imaging literature.
Given the consistent performance of ED bedside ultrasound, its incorporation in the diagnostic process needs further investigation. The EM and radiology literature lack any likelihood ratios that could be used in a Fagan nomogram to modify the pretest probability for acute cholecystitis.34 The ultimate goal of ED bedside ultrasound is to expedite disposition or consultation of patients with RUQ pain. Although this is commonly done, the process has not been studied quantitatively.
CONCLUSION
We found that emergency physicians are accurate in diagnosing cholelithiasis with bedside ultrasound in the largest sample size to date in emergency medicine ultrasound literature. This study adds to the growing body of evidence supporting the use of ultrasound by emergency physicians for gallbladder pathology.
Footnotes
Submission history: Submitted September 20, 2007; Accepted January 4, 2008.
Full text available through open access at http://escholarship.org/uc/uciem_westjem
Address for correspondence: J. Christian Fox, MD Department of Emergency Medicine, University of California, Irvine, 101 The City Drive, Orange, California 92868
Email: jchristianfox@gmail.com
Conflicts of Interest: By the WestJEM article submission agreement, all authors are required to disclose all affiliations, funding sources, and financial or management relationships that could be perceived as potential sources of bias. The authors disclosed none.
REFERENCES
1. Mateer JR, Jehle D. Ultrasonography in emergency medicine. Acad Emerg Med.1994;1:149–152. [PubMed]
2. Simon BC, Snoey ER. Ultrasound in Emergency and Ambulatory Medicine. 1. St. Louis, MO: Mosby; 1997.
3. Schlager D, et al. A prospective study of ultrasonography in the ED by emergency physicians. Am J Emerg Med. 1994;12:185–189. [PubMed]
4. Jehle D, Guarino J, Karamanoukian H. Emergency department ultrasound in the evaluation of blunt abdominal trauma. Am J Emerg Med. 1993;11:342–346. [PubMed]
5. Lanoix R, et al. A preliminary evaluation of emergency ultrasound in the setting of an emergency medicine training program. Am J Emerg Med. 2000;18:41–45. [PubMed]
6. Kimura A, Otsuka T. Emergency center ultrasonography in the evaluation of hemoperitoneum: a prospective study. J Trauma. 1991;31:20–23. [PubMed]
7. Plummer D. Principles of emergency ultrasound and echocardiography. Ann Emerg Med. 1989;18:1291–1297. [PubMed]
8. Kuhn M, et al. Emergency department ultrasound scanning for abdominal aortic aneurysm: accessible, accurate, and advantageous. Ann Emerg Med. 2000;36:219–223.[PubMed]
9. Henderson SO, et al. Bedside emergency department ultrasonography plus radiography of the kidneys, ureters, and bladder vs intravenous pyelography in the evaluation of suspected ureteral colic. Acad Emerg Med. 1998;5:666–671. [PubMed]
10. Mateer JR, et al. Ultrasonographic examination by emergency physicians of patients at risk for ectopic pregnancy. Acad Emerg Med. 1995;2:867–873. [PubMed]
11. Miller AH, et al. Ultrasound guidance versus the landmark technique for the placement of central venous catheters in the emergency department. Acad Emerg Med.2002;9:800–805. [PubMed]
12. Frazee BW, Snoey ER, Levitt A. Emergency Department compression ultrasound to diagnose proximal deep vein thrombosis. J Emerg Med. 2001;20:107–112. [PubMed]
13. Ma OJ, Mateer JR. Emergency Ultrasound. New York: McGraw-Hill; 2003.
14. Cook T, Roepke T. Prevalence and structure of ultrasound curricula in emergency medicine residencies. J Emerg Med. 1998;16:655–657. [PubMed]
15. National Institutes of Health. Gallstones and laparoscopic cholecystectomy. NIH Consensus Statement, 1992. 1992;10:1–20.
16. Durston W, Carl ML, Guerra W. Patient satisfaction and diagnostic accuracy with ultrasound by emergency physicians. Am J Emerg Med. 1999;17:642–646. [PubMed]
17. Blaivas M, Harwood RA, Lambert MJ. Decreasing length of stay with emergency ultrasound examination of the gallbladder. Acad Emerg Med. 1999;6:1020–1023.[PubMed]
18. Lowry R. [Accessed November 23, 2004];Clinical Research Calculator No. 1.Available at: http://faculty.vassar.edu/lowry/VassarStats.html.
19. Shea JA, et al. Revised estimates of diagnostic test sensitivity and specificity in suspected biliary tract disease. Arch Intern Med. 1994;154:2573–2581. [PubMed]
20. Johnston DE, Kaplan MM. Pathogenesis and treatment of gallstones. N Engl J Med.1993;328:412–421. [PubMed]
21. Hessler PC, et al. High accuracy sonographic recognition of gallstones. AJR Am J Roentgenol. 1981;136:517–520. [PubMed]
22. Braunwald E, editor. Harrison’s Principles of Internal Medicine. 15. New York, NY: McGraw-Hill; 2001.
23. Laing FC. Ultrasonography of the acute abdomen. Radiol Clin North Am.1992;30:389–404. [PubMed]
24. Ralls PW, et al. Real-time sonography in suspected acute cholecystitis. Prospective evaluation of primary and secondary signs. Radiology. 1985;155:767–771. [PubMed]
25. Durston W, et al. Comparison of quality and cost-effectiveness in the evaluation of symptomatic cholelithiasis with different approaches to ultrasound availability in the ED.Am J Emerg Med. 2001;19:260–269. [PubMed]
26. Rosen CL, et al. Ultrasonography by emergency physicians in patients with suspected cholecystitis. Am J Emerg Med. 2001;19:32–36. [PubMed]
27. Kendall JL, Shimp RJ. Performance and interpretation of focused right upper quadrant ultrasound by emergency physicians. J Emerg Med. 2001;21:7–13. [PubMed]
28. Chintapalli KN, et al. Sonographic findings in cases of missed gallstones. J Clin Ultrasound. 1999;27:117–121. [PubMed]
29. Anderson JC, Harned RK. Gray scale ultrasonography of the gallbladder: an evaluation of accuracy and report of additional ultrasound signs. AJR Am J Roentgenol.1977;129:975–977. [PubMed]
30. Crade M, et al. Surgical and pathologic correlation of cholecystosonography and cholecystography. AJR Am J Roentgenol. 1978;131:227–229. [PubMed]
31. McIntosh DM, Penny HF. Gray-scale ultrasonography as a screening procedure in the detection of gallbladder disease. Radiology. 1980;136:725–727. [PubMed]
32. Bartrum RJ, Crow HC, Jr, Foote SR. Ultrasonic and radiographic cholecystography. N Engl J Med. 1977;296:538–541. [PubMed]
33. Cooperberg PL, Burhenne HJ. Real-time ultrasonography. Diagnostic technique of choice in calculous gallbladder disease. N Engl J Med. 1980;302:1277–1279. [PubMed]
34. Trowbridge RL, Rutkowski NK, Shojania KG. Does this patient have acute cholecystitis? JAMA. 2003;289:80–86. [PubMed]
