Author	Affiliation
Margaret Lin-Martore, MD	University of California, San Francisco, Department of Emergency Medicine and Pediatrics, San Francisco, California
Aaron E. Kornblith, MD	University of California, San Francisco, Department of Emergency Medicine and Pediatrics, San Francisco, California
Michael A. Kohn, MD, MPP	Stanford University, Department of Emergency Medicine, Stanford, California; University of California, San Francisco, Department of Epidemiology & Biostatistics, San Francisco, California
Michael Gottlieb, MD	Rush University Medical Center, Department of Emergency Medicine, Chicago, Illinois

Introduction
Methods
Results
Discussion
Limitations
Conclusion

INTRODUCTION

Ileocolic intussusception is the most common cause of gastrointestinal obstruction in children and represents a common abdominal emergency in early childhood.¹ As the ileum telescopes into the cecum, the mesentery is compressed, which leads to venous and lymphatic bowel congestion. As time passes, the process can lead to ischemia, perforation, peritonitis, and significant morbidity. Therefore, rapid diagnosis is paramount. Children with intussusception may present with nonspecific symptoms such as vomiting, abdominal pain, or lethargy.¹ The classic triad of colicky abdominal pain, palpable abdominal mass, and bloody stool are present in less than 50% of children with intussusception, which can make the diagnosis challenging to make on history and physical examination alone.² Additionally, since the majority of cases are seen in children aged 6–36 months,¹ the history is often limited, which can compound the difficulty of diagnosis.

Ultrasound is considered the first-line diagnostic test of choice when evaluating children for intussusception because of its high accuracy and lack of harmful ionizing radiation.³ Radiology-performed ultrasound has been shown to have excellent test characteristics, with high sensitivity (98%) and specificity (98%),⁴ and is far superior to abdominal plain radiography in accurately evaluating children for intussusception.⁵ Moreover, ultrasound for the evaluation of ileocolic intussusception is relatively uncomplicated to learn and can be accurately performed by junior radiology trainees.⁶ Still, radiology-performed ultrasound requires a capable provider, often including a technician and/or radiologist. Such expertise may not be available 24 hours a day at many institutions. Delays from limited access to radiology-performed ultrasound may lead to increased morbidity and mortality.⁷

Point-of-care ultrasound (POCUS) is increasingly used in adult and pediatric emergency medicine for a wide range of applications.^8-10 POCUS for the evaluation of ileocolic intussusception may allow EPs to make the diagnosis at the patient’s bedside and avoid delays in diagnosis. However, it is important to determine the diagnostic accuracy of this approach prior to routine use. The purpose of this systematic review and meta-analysis was to determine the diagnostic accuracy of POCUS in children with possible intussusception by EPs.

METHODS

Our study conforms to the Preferred Reporting Items for Systematic Reviews and Meta-analyses guidelines and was conducted in accordance with best practice recommendations.¹¹ The study was also registered with PROSPERO, the international prospective register of systematic reviews (CRD42019122126).

We conducted a systematic search of PubMed, Embase, the Cumulative Index of Nursing and Allied Health (CINAHL), Latin American and Caribbean Health Sciences Literature database (LILACS), Google Scholar, the Cochrane Database of Systematic Reviews, and the Cochrane Central Register of Controlled Trials to include citations from inception through January 14, 2019. A medical librarian assisted us in our search. In accordance with the recommendations by Bramer and colleagues, only the top 200 Google Scholar search terms were selected.¹² Details of our search strategy are included in the Appendix. In addition to the above, we also hand searched the last five years of conference abstracts from the American College of Emergency Physicians and the Society for Academic Emergency Medicine and the last three years of abstracts from the American Institute of Ultrasound in Medicine (only three years were available) for relevant abstracts. We also reviewed the references of identified studies and review articles for potentially missed articles.

Inclusion criteria consisted of all prospective or retrospective studies assessing the accuracy of POCUS for intussusception in pediatric patients (defined as younger than 18 years of age). There were no language or date restrictions. All studies had to include a gold standard confirmatory test (ie, radiology-performed ultrasound, other radiology imaging, air enema, or patient follow-up). We excluded case reports, case series, studies on practice patients, and adult studies.

Two investigators (MLM, AEK) independently assessed studies for eligibility based on the above criteria. All abstracts meeting inclusion criteria underwent full-text review. Studies determined to meet criteria after full-text review by both investigators were included in the final data analysis. Discrepancies were resolved by consensus between the two investigators and a third party (MG). Two investigators (MLM, AEK) independently extracted data from the included studies. The investigators were trained on extraction and used a predesigned data collection form. The following information was extracted: first author; year; study design; type of publication (ie, abstract or full article); sample size; country; study location (ie, pediatric emergency department [PED], other); median/mean age of patients; number of male patients; ultrasonographer training level (ie, trainee, attending); ultrasound training protocol; ultrasound probe and machine; scanning protocol; gold standard; intussusception rate; true-positive results; false-positive results; true-negative results; and false-negative results. Studies were independently assessed for quality by two investigators (MLM, AEK) using the Quality Assessment of Diagnostic Accuracy Studies–2 (QUADAS-2) Tool.¹³ Discrepancies were resolved by consensus between the two investigators and a third party (MG).

The results were pooled from the included studies using a bivariate mixed-effects model to calculate sensitivity, specificity, positive likelihood ratio (LR+), and negative likelihood ratio (LR−) with 95% confidence intervals (CI).¹⁴ We constructed a summary receiver operating characteristic (sROC) curve with observed study data, and calculated the area under the curve. We assessed heterogeneity between studies graphically by plotting their sensitivity/specificity points on the sROC grid, creating standard forest plots of sensitivity and specificity, and calculating I².¹⁵ We also performed a sensitivity analysis after excluding one study¹⁶ that appeared to be an outlier due to physician training, index test, and reference test. We performed additional sensitivity analyses excluding retrospective studies as well as excluding studies that were reported as abstracts only. We assessed the possibility of publication bias using a scatter plot of the inverse of the square root of the effective sample size vs the diagnostic log odds ratio and reported the p-value for Deeks’ funnel plot asymmetry test.¹⁷ Statistical analysis was completed with Stata/SE, version 15.1 (StataCorp LP, College Station, TX). We used the MIDAS module to perform analyses and construct the figures. For subgroups of fewer than four studies, we used MetaDTA (https://crsu.shinyapps.io/dta_ma/) to pool results.

RESULTS

We identified a total of 791 studies as follows: PubMed yielded 192; Embase 345; CINAHL 48; LILACS four; Google Scholar 200; the Cochrane Central Register of Controlled Trials two; and the Cochrane Database of Systematic Reviews yielded zero. After removal of duplicates, 549 abstracts were reviewed with 26 reviewed as full-text articles or conference abstracts (Figure 1).

Six studies comprising 1303 children were selected for the final analysis with a total of 155 cases (11.9%) of intussusception (Table 1).

Three studies were journal publications^16,18,19 and three were meeting abstracts.^20-22 Studies were conducted from 2010–2017 with the number of children in each study ranging from 44–775. Five studies were conducted in the United States^18-22 and one was performed in Taiwan.¹⁶ All studies were performed in pediatric EDs. Three studies were retrospective,^16,19,21 while three were prospective.^18,20,22 The average age of patients ranged from 12.3 months to 6 years, with studies reporting male gender ranging from 59–68%. In five studies, sonographers were pediatric emergency physicians who had various levels of ultrasound training,^18-22 with some having received relatively brief training on ultrasound while others had performed over 100 POCUS scans. In one study, the pediatric emergency physician performing POCUS was also a board-certified pediatric gastroenterologist.¹⁶ A linear transducer was used in three studies. The transducer type was not described in three studies. The reference standard varied between the six studies. Three studies^18,20,22 used radiology-performed ultrasound as their gold standard, one study¹⁹ used radiology study (either computed tomography, ultrasound or barium enema), and another study¹⁶ used final diagnoses from the ED chart as well as chart review for admitted patients to the wards or return visits. Tryglidas et al²¹ used either radiology over-read of POCUS images or radiology-performed ultrasound as the reference standard.

Overall POCUS was 94.9% sensitive (95% CI, 89.9% to 97.5%) and 99.1% specific (95% CI, 94.7%–99.8%) with a LR+ of 105 (95 % CI, 18–625) and a LR− of 0.05 (95% CI, 0.03–0.10) (Table 2, Figure 2). The area under the sROC curve was 0.95 (95% CI, 0.93 – 0.97), suggesting excellent diagnostic accuracy (Figure 3).

We also evaluated the data for PEM-only trained physicians, by excluding Lin et al¹⁶ (Table 2, Appendix Figure 1), given that the pediatric emergency physician in the study was also a board-certified pediatric gastroenterologist, and found similar sensitivity and specificity: 94.2% sensitive (88.5% to 97.2%) and 97.8% specific (94.1%–99.2%) with a LR+ of 43 (16–117) and a LR− of 0.06 (0.03–0.12) and area under the ROC curve of 0.97.

The study by Lin et al¹⁶ was at high risk for bias (Table 3). In terms of patient selection, this study included all patients with acute abdominal pain rather than those just with suspected intussusception. Out of 775 patients only 15, all under the age of three, were positive for intussusception, and it is unclear in how many children intussusception was suspected clinically. There were also applicability concerns for the index test, as the person who performed POCUS was board-certified in pediatric gastroenterology. Moreover, the diagnostic accuracy data included was for multiple different diagnoses including appendicitis, gastrointestinal infection, renal disease, gynecologic disease, gastrointestinal anomalies, extra-abdominal disease, and nonspecific abdominal pain, as well as for intussusception. Finally, for patients with negative POCUS, not all had received a follow-up radiology study and final diagnosis relied upon ED chart review, hospital course and possible revisits, which led to unclear bias in the reference standard. For these reasons, we also report pooled results after excluding this study (Table 2, Appendix Figure 1).

Additional sensitivity analysis of only prospective studies showed slightly lower sensitivity and similar specificity: 90.4% sensitive (79.0–96.8%) and 98.8% specific (96.9–99.7%) with a LR+ of 74 (28–197) and a LRv of 0.10 (0.04–0.22), and, sensitivity analysis of journal publications only, excluding abstracts, showed similar results to pooled data: 94.7% sensitive (82.3–99.4%) and 99.5% specific (98.8–99.9%) with a LR+ of 204 (77–545) and a LR− of 0.05 (0.01–0.20).

DISCUSSION

This systematic review and meta-analysis demonstrates that POCUS for intussusception by pediatric emergency physicians is both highly sensitive and specific with accuracy similar to that of prior studies of radiology ultrasound for the diagnosis of intussusception.²³ POCUS has the potential to reduce the time to treatment and overall length of stay in the ED. In fact, one study found that the institution of a POCUS protocol for intussusception reduced length of stay by over 200 minutes and shortened the door-to-reduction time by 26 minutes.²⁴

A recent systematic review and meta-analysis by Tsou et al²³ evaluated combined radiologic ultrasound and POCUS, demonstrating similar sensitivity and specificity to our study. However, our study differs in that we excluded radiology ultrasound and focused specifically on POCUS for intussusception. Additionally, the prior review included several studies with significant limitations, including one study²⁵ that reported diagnostic accuracy data for patients who did not necessarily receive an ultrasound. In this retrospective study, patients were divided into two groups, one that was treated by pediatric EPs trained in POCUS for intussusception and one that was treated by pediatric EPs without this training. However, not all patients in the POCUS-trained group actually received a POCUS. The overall sensitivity for the group is reported, but not for the POCUS itself. The authors do report combined sensitivity and positive predictive value for POCUS by pediatric EPs and gastroenterology-performed ultrasound (considered the standard ultrasound in this study), but do not specifically assess the sensitivity and specificity of POCUS by pediatric EPs in isolation. We chose not to include this study for those reasons. Furthermore, they included the study by Lin et al¹⁶ that had a high risk of bias in the patient selection as well as applicability concerns for the index test and that was likely subject to an extreme form of incorporation bias.²⁶ Given these concerns, we performed a sensitivity analysis excluding this study and report these results as well.

When performing POCUS for intussusception, there is not currently a single preferred technique, although multiple have been described.^18,27 These varying techniques can also affect the diagnostic accuracy of a test. We include a protocol (Figure 5) that was developed with POCUS experts and pediatric radiology at our institution.

Begin in the right lower quadrant, using a high-frequency linear probe with the probe marker to the patient’s right side. First, identify the psoas muscle and right iliac vessels as anatomical landmarks. Next, look for the transition from small bowel to large bowel and the ileocecal valve. Perform graded compression, with slow, steady pressure to displace bowel gas. Follow the colon from the right lower quadrant to right upper quadrant until the liver and gallbladder are identified. Rotate the probe marker to patient’s head and scan entire length of transverse colon. Rotate the probe marker back to patient’s right and scan entire length of descending colon, making sure to scan all four quadrants and to rescan any possible lesions.

Typically, an ileocolic intussusception appears as a “target sign” lesion, with one part of bowel (intussusceptum) telescoping into another part of bowel (intussuscipiens). In the transverse axis, the outer wall is thickened and hypoechoic. In the longitudinal axis, a “pseudokidney” sign has been described from the hyperechoic intussusceptum telescoping into the hypoechoic intussuscipiens. Other typical findings of ileocolic intussusception include lymph nodes in mesenteric fat noted in the intussusceptum.³

Based on our findings, POCUS could be considered for early diagnosis of intussusception. However, it is important to consider several limitations of POCUS for intussusception. These include operator dependence and the need for sufficient training. Future studies should establish the ideal training protocol and necessary number of POCUS exams for skill maintenance.

LIMITATIONS

This study has several limitations that are important to consider. First, most studies did not state their specific scanning protocol, so it is unclear whether their specific protocols may have differed. Ultrasound, in general, is user-dependent and can vary based on training, skill, and frequency of practice. In our included studies, there was significant heterogeneity in who performed the POCUS, with some studies having experienced sonographers and others having physicians who had received short trainings. However, we believe this risk is low as prior studies have shown that ultrasound for intussusception can be learned by junior trainees⁶ and do not necessarily have to be performed by experts. Future studies should use standardized scanning protocols to limit variation and assess the test characteristics of physicians using these protocols.

Half of the included studies were abstracts rather than journal articles, which can limit ability to analyze sources of bias. However, when a separate sensitivity analysis was performed on journal articles only, we found similar results for diagnostic accuracy.

Additionally, half of the studies included were retrospective, which can bias the results. To help control for bias from retrospective studies, we also performed a sensitivity analysis without these studies, and the diagnostic accuracy data without retrospective studies showed slightly worse sensitivity, with larger CIs, but similar specificity. This change in sensitivity could be due to bias. The prevalence of intussusception varied among the included studies. The two studies, Lam et al¹⁹ and Trygylidas et al,²¹ with the highest prevalence of intussusception were both retrospective. This may suggest partial verification bias in the retrospective studies.²⁶ One exception to this is Lin et al,¹⁶ which was retrospective, but had a low prevalence of intussusception (2%). However, this study included patients who may not have been suspected to have intussusception initially. Typically, a high prevalence of disease suggests partial verification bias where patients with positive index tests are more likely to get the reference standard test and patients with negative index tests are excluded from the study, meaning that true negatives are excluded (biasing specificity down) and false negatives are excluded (biasing sensitivity up). And indeed, both Lam et al¹⁹ and Trigylidas et al²¹ had relatively high sensitivities and low specificities.

The variation in prevalence of disease also suggests risk of selection bias, where included patients may have been selected who were more or less likely to have intussusception than the typical population where POCUS would be used, which also limits the generalizability of the results. The prospective studies included used convenience sampling based on when a physician trained in POCUS for intussusception was available. This may also limit the generalizability of this data. Also, there was moderate statistical heterogeneity between studies, which may also limit the generalizability of the data.

Larger, prospective studies, controlling for patient selection and physician training, are still needed for the accuracy of POCUS for intussusception. There was no data on patient outcomes or cost of care, and further trials are needed to determine the influence of POCUS on these factors. Finally, it is possible that some studies may have been missed with this search strategy. However, we used an extensive search strategy with the assistance of an experienced medical librarian, so we believe the risk of this is low.

CONCLUSION

POCUS performed by emergency physicians is a highly sensitive and specific test for diagnosis of intussusception in children and has potential to be used as a screening tool. However, additional larger, prospective studies limiting bias are needed to assess the accuracy of POCUS for physicians of various training levels, using standardized protocols, and evaluating how use of POCUS for intussusception correlates with clinical outcomes.

Footnotes

Section Editor: J. Fields, MD

Full text available through open access at http://escholarship.org/uc/uciem_westjem

Address for Correspondence: Margaret Lin-Martore, MD, University of California, San Francisco, Department of Emergency Medicine, 550 16th Street, #5150, San Francisco, CA 94143. Email: Margaret.lin-martore@ucsf.edu. 7 / 2020; 21:1008 – 1016

Submission history: Revision received December 18, 2019; Submitted March 12, 2020; Accepted April 9, 2020

Conflicts of Interest: By the WestJEM article submission agreement, all authors are required to disclose all affiliations, funding sources and financial or management relationships that could be perceived as potential sources of bias. No author has professional or financial relationships with any companies that are relevant to this study. There are no conflicts of interest or sources of funding to declare.

REFERENCES

1. Waseem M, Rosenberg HK. Intussusception. Pediatr Emerg Care. 2008;24(11):793-800.

2. Daneman A, Alton DJ. Intussusception. Issues and controversies related to diagnosis and reduction. Radiol Clin North Am. 1996;34(4):743-56.

3. Edwards EA, Pigg N, Courtier J, et al. Intussusception: past, present and future. Pediatr Radiol. 2017;47(9):1101-8.

4. Hryhorczuk AL, Strouse PJ. Validation of US as a first-line diagnostic test for assessment of pediatric ileocolic intussusception. Pediatr Radiol. 2009;39(10):1075-9.

5. Henderson AA, Anupindi SA, Servaes S, et al. Comparison of 2-view abdominal radiographs with ultrasound in children with suspected intussusception. Pediatr Emerg Care. 2013;29(2):145-50.

6. Eshed I, Gorenstein A, Serour F, et al. Intussusception in children: Can we rely on screening sonography performed by junior residents?. Pediatr Radiol. 2004;34(2):134-7.

7. Meier DE, Coln CD, Rescorla FJ, et al. Intussusception in children: international perspective. World J Surg. 1996;20(8):1035-40.

8. Gottlieb M, Peksa GD, Pandurangadu AV, et al. Utilization of ultrasound for the evaluation of small bowel obstruction: a systematic review and meta-analysis. Am J Emerg Med. 2018;36(2):234-42.

9. Matthew Fields J, Davis J, Alsup C, et al. Accuracy of point-of-care ultrasonography for diagnosing acute appendicitis: a systematic review and meta-analysis. Acad Emerg Med. 2017;24(9):1124-36.

10. Ultrasound guidelines: emergency, point-of-care and clinical ultrasound guidelines in medicine. Ann Emerg Med. 2017;69(5):e27-e54.

11. Moher D, Liberati A, Tetzlaff J, et al. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Ann Intern Med. 2009;151(4):264-9.

12. Bramer WM, Rethlefsen ML, Kleijnen J, et al. Optimal database combinations for literature searches in systematic reviews: a prospective exploratory study. Syst Rev. 2017;6(1):245.

13. Whiting PF, Rutjes AW, Westwood ME, et al. QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies. Ann Intern Med. 2011;155(8):529-36.

14. Chu H, Cole SR. Bivariate meta-analysis of sensitivity and specificity with sparse data: a generalized linear mixed model approach. J Clin Epidemiol. 2006;59(12):1331-2.

15. Higgins JP, Thompson SG, Deeks JJ, et al. Measuring inconsistency in meta-analyses. BMJ. 2003;327(7414):557-60.

16. Lin W-C, Lin C-H. Re-appraising the role of sonography in pediatric acute abdominal pain. Iran J Pediatr. 2013;23(2):177.

17. Deeks JJ, Macaskill P, Irwig L. The performance of tests of publication bias and other sample size effects in systematic reviews of diagnostic test accuracy was assessed. J Clin Epidemiol. 2005;58(9):882-93.

18. Riera A, Hsiao AL, Langhan ML, et al. Diagnosis of intussusception by physician novice sonographers in the emergency department. Ann Emerg Med. 2012;60(3):264-8.

19. Lam SH, Wise A, Yenter C. Emergency bedside ultrasound for the diagnosis of pediatric intussusception: a retrospective review. World J Emerg Med. 2014;5(4):255-8.

20. Muniz A. Ultrasound diagnosis of intussusception by emergency physicians. Acad Emerg Med. 2010;17(5):1-15.

21. Trigylidas T, Kelly J, Hegenbarth M, et al. 395 pediatric emergency medicine-performed point-of-care ultrasound (POCUS) for the diagnosis of intussusception. Ann Emerg Med. 2017;70(4):S155.

22. Zerzan J, Arroyo A, Dickman E, et al. Diagnosing intussusception by bedside ultrasonography in the pediatric emergency department. Acad Emerg Med. 2012;19(Suppl 1):S151.

23. Tsou P-Y, Wang Y-H, Ma Y-K, et al. Accuracy of point-of-care ultrasound and radiology-performed ultrasound for intussusception: a systematic review and meta-analysis. Am J Emerg Med. 2019;37(9):1760-9.

24. Kim JH, Lee J-Y, Kwon JH, et al. Point-of-care ultrasound could streamline the emergency department workflow of clinically nonspecific intussusception. Pediatr Emerg Care. 2020;36(2):e90-e95.

25. Chang Y-J, Hsia S-H, Chao H-C. Emergency medicine physicians performed ultrasound for pediatric intussusceptions. Biomed J. 2013;36(4):175-8.

26. Kohn MA, Carpenter CR, Newman TB. Understanding the direction of bias in studies of diagnostic test accuracy. Acad Emerg Med. 2013;20(11):1194-206.

27. Doniger SJ, Salmon M, Lewiss RE. Point-of-care ultrasonography for the rapid diagnosis of intussusception: a case series. Pediatr Emerg Care. 2016;32(5):340-2.