Introduction
Methods
Results
Discussion
Limitations
Conclusion

INTRODUCTION

Background

The United States is currently experiencing an unprecedented opioid crisis. More than 47,000 people die from an opioid-related overdose each year,¹ and the annual economic burden is estimated to be $504 billion.² Children and adolescents are not impervious to this epidemic. In 2016 alone, more than 88,000 adolescents between the ages of 12–17 years reported misusing opioid medications, making opioids the second most commonly abused illicit substance in the US.³ Physician prescribing is argued to be one driver of the opioid crisis.⁴ One major source of prescribed opioids is the emergency department (ED),⁵ with the treatment of pain identified as the most common reason for ED visits.^6,7 Specifically, guidelines⁸ focused on improving the pain management of pediatric patients and reducing the undertreatment of pain in children with a variety of painful conditions⁹ may have influenced the increase in opioid prescriptions to children and adolescents.

Importance

With a rising emphasis on patient-centered care, concerns over patient satisfaction may be one contributor to the increased opioid prescribing rates observed in the ED.¹⁰ Patient satisfaction is an important tool for assessing quality of care, and with the widespread availability of several commercially available surveys that capture patient experience, results of these questionnaires can now impact a facility’s reputation and profits. As a result, physicians may fear that insufficiently treating pain could lead to decreased patient satisfaction, which would contribute to the continued opioid prescribing habits of these providers.¹¹ Research on the relationship between patient satisfaction and pain management in adult populations is mixed. Some studies have determined that analgesic administration does not correlate with patient satisfaction,^12,13 whereas, a significant link between pain management and quality of care has been shown in other investigations.^14-16

Studies examining this correlation in pediatric samples have received little attention,^17,18 and there is an absence of research that addresses potential statistical interactions between pain severity and the administration of opioids in relation to patient satisfaction in one multivariable model. Margaret and associates found that pain resolution was associated with higher satisfaction; however, differences based on analgesic administration were not assessed.¹⁸ Similarly, Locke and colleagues showed that patients indicating their pain was controlled were more satisfied with their ED experience. But analgesic use was not examined in this investigation.¹⁷ Finally, given the great developmental differences among children ages 0–17 it is necessary to assess how the association between pain and opioid prescribing impacts satisfaction at different age levels.

Goals of This Investigation

The relationship between opioid administration, pain severity, and parent satisfaction (as a proxy of patient satisfaction) is complex and should be assessed using a multivariable analysis that simultaneously considers the impact of both analgesic administration and pain on parent satisfaction. Research that assesses only the role of either pain or opioid use, without including both, will fail to fully capture the complex contribution of opioid administration on perceived quality of care. Therefore, our goal was to determine the influence of opioid analgesic administration on parent satisfaction for pediatric patients discharged from the ED, and to assess whether the pain management-satisfaction relationship was impacted by demographic, clinical, and diagnostic factors.

Population Health Research Capsule

What do we already know about this issue?

In adults, research has identified a significant association between pain management and patient satisfaction; however, this relationship is understudied in pediatric populations.

What was the research question?

We assessed statistical interactions between age, pain, and the prescription of opioids in relation to parental satisfaction with care.

What was the major finding of the study?

Parents of older patients were dissatisfied with their care when their child was prescribed opioids to treat a milder pain condition.

How does this improve population health?

Findings suggest that physicians should consider pediatric patient pain level and age when deciding whether to prescribe an opioid medication.

METHODS

Study Design and Setting

The current study involved a retrospective cohort analysis of parent satisfaction with analgesia administration in the ED. We collected encounter data between May 2018–June 2019 from children who underwent treatment in a pediatric ED in a tertiary children’s hospital. This data source included demographic and clinical variables from an electronic health record (EHR) system and parent satisfaction data that we assessed using a NRC Health survey questionnaire (National Research Corporation, Markham, Ontario, Canada). In total, the parents of 85,804 ED patients began to answer survey questions, and of these 24,761 respondents completed the survey, representing a response rate of 28.9%. All survey data collection methods were approved by the hospital’s institutional review board.

Selection of Participants

The health questionnaire was sent to all parents after discharge from the ED facility. We linked the EHR data and survey responses using unique encounter identifiers present in both data sources. Inclusion criteria were as follows: treated in the ED; being < 18 years; and with an ED stay of 12 hours or less. Because we aimed to assess differences in opioid prescribing for patients without cancer-associated chronic pain or a neoplasm diagnosis we excluded from the analysis International Classification of Diseases, 9^th and 10^th revisions, (ICD-9 and ICD-10) codes C00 through D49; n = 59).^19,20

Measurements

Patient age, ethnicity, gender, low-income insurance status (Medicare/Medi-Cal),* Emergency Severity Index score, length of stay (ranging from 16–716 minutes), and level of pain were abstracted from the EHR. Pain severity ranged from 0 (no pain) to 10 (severe pain), and was conceptualized as the maximum pain score recorded during the patient’s stay using developmentally and situationally appropriate measurement tools (ie, the Neonatal Pain, Agitation and Sedation scale; the Faces, Legs, Activity, Cry, Consolability behavioral pain scale; the faces pain scale, and numeric rating scale). Following the guidelines of Fortier et al,²¹ a pain score equal to or greater than 4 was determined to be clinically significant.

Patient analgesic records during the ED visit were also obtained from the EHR. Specifically, we assessed information on whether the patient was administered an opioid (eg, codeine, hydrocodone, hydromorphone, meperidine, sufentanil, fentanyl, morphine, oxycodone, remifentanil, nalbuphine, methadone, tramadol) and/or non-opioid analgesic (eg, ibuprofen, acetaminophen, naproxen, gabapentin, pregabalin, celecoxib, and triptan). Administered opioids were dispensed during the patient’s ED stay and did not refer to after-visit administrations, as information on medications prescribed after the patient’s ED stay was not accessible in the EHR system. Top patient medical diagnoses were also retrieved and controlled for using the ICD-9 and ICD-10 revisions (0 = absence of a diagnosis, 1 = presence of a diagnosis). Diagnoses that captured less than 1% of patients (eg, sickle cell disease) were not controlled for in the analyses. We used responses to the health questionnaire after patient discharge to measure patient experience. Two items assessing satisfaction with pain and discomfort management were examined (ie, “Did the staff do everything they could to help your child with his/her discomfort?”; and “Did the care providers do everything they could to ease your child’s discomfort?”).

Outcome

We determined parent satisfaction with their child’s emergency care using an NRC Health questionnaire item assessed as an indicator of patient satisfaction in prior research.²² Specifically, parents were asked, “Using a number from 0 to 10, where 0 is the worst facility possible and 10 is the best facility possible, how would you rate this emergency department?” A top-box approach was used to recode this item, with a response of “9” or “10” indicating satisfaction with the ED facility (coded as 1 or “Satisfied”). All other responses represented an undesirable facility rating (coded as 0 or “Not Satisfied”). This top-box methodology is the standard approach for assessing patient satisfaction in US hospitals that use the Hospital Consumer Assessment of Healthcare Providers and Systems.^23-28

Analytic Approach

Bivariate analyses estimated associations between satisfaction with admittance acuity, pain severity, administered analgesics, and the two items assessing pain management experiences. We examined the proportions of patients with positive (Satisfied) and negative (Not Satisfied) facility rating scores across the levels of each variable. Odds ratios (OR) and chi-square P-values were calculated for each association. In addition, we assessed relationships between the two pain and discomfort management survey questions and opioid administration using a chi-square test of association. P-values < 0.05 were determined to be statistically significant in the bivariate analyses.

A multivariable logistic regression model was then estimated to assess the relationship between each predictor and the outcome while controlling for all demographic, clinical, survey, and diagnosis variables. Two-way interactions between age, ethnicity, gender, insurance type, acuity score, length of stay, and pain with opioid use were simultaneously estimated. We also assessed three-way interactions between each covariate with pain and opioid use. We removed non-significant interaction terms before estimating the final model. A Bonferroni correction was applied to account for the estimation of two models, with P < 0.025 concluded to be statistically significant in the multivariable analyses.

RESULTS

Characteristics of the Study Subjects

Respondents were 15,895 pediatric patients and their parents. Overall, 11,995 (75.46%) patients provided a positive ED facility rating, meaning that they were satisfied with their visit (providing a score of a 9 or 10 when asked how they would rate the ED facility). Approximately 3966 (24.95%) expressed clinically significant pain (pain score >/= 4; as defined by Fortier et al²¹); 786 (4.94%) patients were administered an opioid; and 8212 (51.70%) were administered a non-opioid analgesic. Additional descriptive information is displayed in Table 1.

Main Results

Bivariate Analyses

Relationships between all key variables with satisfaction are shown in Table 2. Patients with an acuity score of 1 or 2 (Resuscitation/Emergent) were more likely to provide a positive facility rating than patients with an acuity score of 3 (Urgent) or 4/5 (Less Urgent/Non-Urgent; P = 0.002). Patients expressing more severe pain severities (P < 0.001) and those who were administered opioid analgesics (P = 0.018) were more likely to report they were satisfied with the ED facility. Parents who indicated that the staff and care providers “definitely” did everything they could to help the child with their discomfort were most likely to be satisfied with their patient experience in the ED (both P-values < 0.001).

We also assessed associations between the two pain and discomfort management survey items and opioid administration. Parents of patients administered opioids were more likely to indicate that staff “definitely” did everything they could to help with the child’s discomfort (n = 563, 71.60%) than patients who were not given opioids (n = 9898, 65.50%; χ2 (4) = 14.54, P = 0.006). Similarly, compared to parents whose children did not receive an opioid (n = 6152, 40.70%), those whose child received an opioid analgesic were more likely to indicate that care providers “definitely” did everything they could to ease their child’s discomfort (n = 340, 43.30%, χ2 (4) = 11.52, P = 0.021).

Multivariable Analysis

A multivariable model (see Table 3) controlling for all demographic, clinical, and top diagnosis covariates showed that patients with an acuity score of 1 or 2 (Resuscitation/Emergent) were more likely to provide a positive ED evaluation than patients with an acuity score of 4/5 (Less Urgent/Non-Urgent; P < 0.001). Staying in the ED for a shorter time (ie, shorter length of stay, P < 0.001) and being administered an opioid analgesic (P = 0.007) were both associated with a greater likelihood of indicating a positive facility rating. Interestingly, the administration of non-opioid analgesics was not associated with parent satisfaction (P = 0.131). Also, parents who reported that staff and care providers “definitely” did everything they could to help the child manage their discomfort were more likely to be satisfied than parents that responded “Yes, mostly,” “Yes, somewhat,” or “No” (all P < 0.001).

We assessed the complex relationships between pain, opioid administration, and parent satisfaction by estimating several interaction terms. Findings revealed a significant three-way interaction of age, pain severity, and opioid administration (Figure 1, P = 0.007). To decompose the three-way interaction, simple slopes of the relationship between age and facility rating were estimated and graphed on the pain severity moderator at one standard deviation (SD) below the mean, at the mean, and one SD above the mean for patients who were and were not administered an opioid analgesic during their ED stay.²⁹ All covariates were controlled for in this model. For patients not administered an opioid analgesic, there was no statistically significant relationship between age and facility rating when pain severity was high (+1 SD; b = 0.01, 95% confidence interval [CI], 0.00, 0.03, p = 0.08] or moderate (Mean; b = 0.03, 95% CI, 0.02, 0.04, P = 0.07). However, when pain was mild (−1 SD; b = 0.03, 95% CI, 0.02, 0.04, P < 0.001) and patients did not receive an opioid, parents of older patients reported greater satisfaction than parents of younger patients. Specifically, for patients who did not receive an opioid, parents of older patients, expressing mild pain, were the most satisfied with their experience in the ED.

For patients who were administered opioids, a different pattern emerged. The relationship between age and patient experience was not statistically significant when pain was more severe (+1 SD; b = −0.03, 95% CI, −0.07, 0.02, P = 0.26). Thus, for patients experiencing higher levels of pain, patient age did not impact parent satisfaction. However, when the level of pain was mild (−1 SD; b = −0.11, 95% CI, −0.19, −0.02, P = 0.01) or moderate (Mean; b = −0.07, 95% CI, −0.14, −0.01, P = 0.02) parents of younger children were more likely to provide a positive facility rating than parents of older patients. In other words, pain level did not strongly impact the parent satisfaction of the youngest patients. These patients were the most satisfied when their child received an opioid, regardless of pain severity. In contrast, pain level had an important influence on the parent satisfaction scores of the oldest patients who were given an opioid during their ED stay. The least satisfied group in this sample were parents of 17-year-old patients who were administered an opioid analgesic, despite expressing mild pain severity. For example, parents of the oldest patients (ie, 17-year-olds who were administered opioids were 9.43% more likely to provide a positive facility rating when their child was in more severe rather than mild pain (likelihood rating of 0.922 vs 0.839).

DISCUSSION

Under the conditions of this study, results from the multivariable regression model revealed that parents of patients admitted with a resuscitation or emergent acuity score were more likely satisfied with the ED facility than patients who were admitted with a less urgent or non-urgent acuity rating. A multivariable analysis controlling for demographic, clinical, and top diagnostic covariates showed that opioid analgesic administration was related with parent satisfaction in a pediatric ED setting but non-opioid analgesics were not. Specifically, parents of patients administered an opioid analgesic were more likely to provide a positive facility rating compared to parents of patients who did not receive an opioid. Further, relationships between opioid administration and parent satisfaction were shown to be multifaceted and complex, as demonstrated by the significant interaction of age, pain, and opioid administration. That is, parents of younger patients who received an opioid were the most satisfied with their quality of care, regardless of pain severity; whereas likelihood to provide a positive facility rating substantially decreased for parents of the oldest patients who were administered an opioid to manage mild pain. Additionally, it is important to emphasize that diagnosis (eg, orthopedic injury) did not impact the pattern of results shown in this study, as the regression analyses controlled for common medical aliments.

With the current opioid epidemic, rates of pediatric opioid-related overdose and death continue to increase.³⁰ Markedly, opioid prescribing has been identified as a risk factor of later misuse³¹ and persistent use³² in pediatric patients. Emergency medicine has been recognized as one of the top five specialties that prescribe prescription opioids,⁵ since most ED visits include the treatment of painful medical conditions.^6,7 Consequently, concerns over patient satisfaction might be contributing to this epidemic,¹¹ as previous studies have supported a common belief that administering opioid analgesics will improve patient experience scores in the ED.^14-16 However, findings from this investigation indicate that the relationship between opioid administration and patient experience is more complex than originally believed, and depends on both the age of the patient and their level of pain. When older patients experienced severe pain and were treated with opioid analgesics, parents were satisfied with their ED experience; but, when these patients were given opioids when experiencing lower levels of pain, parents were unsatisfied with the care their child received.

The finding that opioid administration negatively impacted the patient satisfaction of parents with adolescent children admitted to the ED with lower levels of pain should be interpreted in the context of the opioid public health crisis. Studies with different samples of youth patients show that adolescence represents a transitional developmental period characterized by an increase in risky health behaviors, including illicit substance use experimentation.^33,34 Given the link between prescribed opioid use and later misuse shown in other studies,³¹ it seems logical to conclude that parents in this study were dissatisfied with their child’s quality of care when given opioids for a milder pain condition, as exposing the patient to opioid medications in the face of milder pain could represent an unnecessary developmental risk.

This result implies that the administration of opioid medications does not always improve patient satisfaction, and that in some situations, it can actually make perceived clinical care worse. Thus, physicians should consider pain level and age when making decisions about whether to administer an opioid medication to pediatric patients. Also, from a methodological perspective, results of this study highlight the importance of examining pain, opioid use, and satisfaction simultaneously in one model, and imply that future studies should examine and control for all three variables to understand complex relationship between pain and discomfort management and patient experience.

LIMITATIONS

Findings should be interpreted in the context of several limitations. Patients in this study were admitted to the ED of a single, tertiary pediatric institution; thus, findings might not be generalizable to all pediatric ED facilities. Parent satisfaction was measured via self-report. Therefore, parent responses might be impacted by acquiescence bias. Specifically, parents might have felt pressure to provide a positive ED rating although the survey was conducted after the parents left the ED. Information on opioid prescribing after discharge home could not be obtained, which might have served as a confounding variable potentially impacting parent satisfaction. The response rate in this study was 28.9%, which could have biased findings. However, research suggests a small association between response rates and nonresponse bias for surveys such as the NRC health questionnaire.³⁵ Pain severity was recorded by care providers throughout the patient’s ED stay; thus, there could have been some error in the way that pain was interpreted and recorded. Additionally, timeliness of analgesia administration could not be captured in this study. Future investigations might assess changes in pain from triage to discharge to understand how pain management and medication administration impacts satisfaction.

CONCLUSION

Findings from this investigation point to the multifarious nature of the relationship between pain severity, opioid administration, and parent satisfaction, and highlight a potential conflict in patient-physician interactions at the intersection of parent satisfaction and controlled substance administration. Multivariable analyses showed that parents of patients who were given opioids during their stay in the ED were more satisfied but that this relationship was also impacted by pain level and the age of the patient. Parents of older adolescent patients were dissatisfied with their ED experience when their child received opioids to treat a milder pain condition. Although encounters in the ED can be challenging due to time limitations and physician unfamiliarity with a patient’s background, our findings and the cited literature suggest that factors such as patient age, pain, acuity score, and possible risk of opioid misuse should be considered when administering opioid medications. Consequently, ED facilities might consider designing and implementing evidence-based policies and tools that help physicians quickly determine whether opioids should be administered for pain management based on the patient’s characteristics and unique risk of misuse.

Footnotes

Section Editor: Gentry Wilkerson, MD

Full text available through open access at http://escholarship.org/uc/uciem_westjem

Address for Correspondence: Zeev N. Kain, MD, University of California, Irvine, Center on Stress & Health, 505 S. Main Street Suite 940, Orange, California 92868. Email: zkain@uci.edu. 9 / 2021; 22:1167 – 1175

Submission history: Revision received January 13, 2021; Submitted May 28, 2021; Accepted June 11, 2021

Conflicts of Interest: By the WestJEM article submission agreement, all authors are required to disclose all affiliations, funding sources and financial or management relationships that could be perceived as potential sources of bias. Dr. Zeev N. Kain serves as a consultant for Edwards Lifesciences, Medtronic and Huron consulting and is the President of the American College of Perioperative Medicine. Study analyses and manuscript preparation was funded by support from the Kay Family Foundation, Chapman University.

REFERENCES

1. National Vital Statistics System, Mortality. 2018. Available at: https://wonder.cdc.gov. Accessed November 15th, 2019.

2. The underestimated cost of the opioid crisis 2017. 2017. Available at: https://www.whitehouse.gov/sites/whitehouse.gov/files/images/The%20Underestimated%20Cost%20of%20the%20Opioid%20Crisis.pdf. Accessed November 15th, 2019.

3. Kann L, McManus T, Harris WA, et al. Youth risk behavior surveillance—United States, 2017. MMWR Surveill Summ. 2018;67(8):1.

4. Barnett ML, Olenski AR, Jena AB. Opioid-prescribing patterns of emergency physicians and risk of long-term use. N Engl J Med. 2017;376(7):663-73.

5. Volkow ND, McLellan TA, Cotto JH, et al. Characteristics of opioid prescriptions in 2009. JAMA. 2011;305(13):1299-301.

6. Pletcher MJ, Kertesz SG, Kohn MA, et al. Trends in opioid prescribing by race/ethnicity for patients seeking care in us emergency departments. JAMA. 2008;299(1):70-78.

7. Anderson JL, Funni S, Bellolio MF, et al. Prevalence of pediatric pain-related visits and opioid use in the emergency department. Ann Emerg Med. 2018;72(4 Supplement):S91-S91.

8. Fein JA, Zempsky WT, Cravero JP. Relief of pain and anxiety in pediatric patients in emergency medical systems. Pediatrics. 2012;130(5):e1391-e405.

9. Goyal MK, Kuppermann N, Cleary SD, et al. Racial disparities in pain management of children with appendicitis in emergency departments. JAMA Pediatr. 2015;169(11):996-1002.

10. Adams J, Bledsoe GH, Armstrong JH. Are pain management questions in patient satisfaction surveys driving the opioid epidemic?. Am J Public Health. 2016;106(6):985.

11. Zgierska A, Miller M, Rabago D. Patient satisfaction, prescription drug abuse, and potential unintended consequences. JAMA. 2012;307(13):1377-8.

12. Schwartz TM, Tai M, Babu KM, et al. Lack of association between Press Ganey emergency department patient satisfaction scores and emergency department administration of analgesic medications. Ann Emerg Med. 2014;64(5):469-81.

13. Kim H, Lank P, Pang P, et al. ED opioid prescribing is not associated with higher patient satisfaction scores. Am J Emerg Med. 2016;34(10):2032-34.

14. Bhakta HC, Marco CA. Pain management: association with patient satisfaction among emergency department patients. J Emerg Med. 2014;46(4):456-64.

15. Shill J, Taylor DM, Ngui B, et al. Factors associated with high levels of patient satisfaction with pain management. Acad Emerg Med. 2012;19(10):1212-15.

16. Jao K, McD Taylor D, Taylor SE, et al. Simple clinical targets associated with a high level of patient satisfaction with their pain management. Emerg Med Australas. 2011;23(2):195-201.

17. Locke R, Stefano M, Koster A, et al. Optimizing patient/caregiver satisfaction through quality of communication in the pediatric emergency department. Pediatr Emerg Care. 2011;27(11):1016-21.

18. Magaret ND, Clark TA, Warden CR, et al. Patient satisfaction in the emergency department—a survey of pediatric patients and their parents. Acad Emerg Med. 2002;9(12):1379-88.

19. Donaldson CD, Kain ZN, Ehwerhemuepha L, et al. Anxiety and mood disorders impacting physician opioid prescribing in the pediatric hospital setting. J Clin Psychol Med Settings. 2021.

20. Ehwerhemuepha L, Donaldson CD, Kain ZN, et al. Race, ethnicity, and insurance: the association with opioid use in a pediatric hospital setting. J Racial Ethn Health Disparities. 2020.

21. Fortier MA, MacLaren JE, Martin SR, et al. Pediatric pain after ambulatory surgery: Where’s the medication?. Pediatrics. 2009;124(4):e588-e95.

22. Lyu H, Wick EC, Housman M, et al. Patient satisfaction as a possible indicator of quality surgical care. JAMA Surg. 2013;148(4):362-67.

23. Ehwerhemuepha L, Feaster W, Kain Z. Impact of anesthesiologists on parental perioperative satisfaction scores. Paediatr Anesth. 2017;27(9):949-54.

24. Ehwerhemuepha L, Schultz S, Feaster W. Clinical and psychosocial factors associated with patient experience in pediatrics. Clin Pediat. 2018;57(8):937-44.

25. McClelland LE, Vogus TJ. Compassion practices and HCAHPS: Does rewarding and supporting workplace compassion influence patient perceptions?. Health Serv Res. 2014;49(5):1670-83.

26. Levin JM, Winkelman RD, Smith GA, et al. The association between the Hospital Consumer Assessment of Healthcare Providers and Systems (HCAHPS) survey and real-world clinical outcomes in lumbar spine surgery. Spine J. 2017;17(11):1586-93.

27. Godden E, Paseka A, Gnida J, et al. The impact of response rate on Hospital Consumer Assessment of Healthcare Providers and System (HCAHPS) dimension scores. Patient Exp J. 2019;6(1):105-14.

28. Donaldson CD, Bharadwaj A, Giafaglione B, et al. Ethnicity and language differences in patient experience: an analysis of the HCAHPS survey. J Racial Ethn Health Disparities. 2021.

29. Aiken LS, West SG. Multiple Regression: Testing and Interpreting Interactions. 1991.

30. Gaither JR, Shabanova V, Leventhal JM. US national trends in pediatric deaths from prescription and illicit opioids, 1999–2016. JAMA Netw Open. 2018;1(8):e186558-e58.

31. Miech R, Johnston L, O’Malley PM, et al. Prescription opioids in adolescence and future opioid misuse. Pediatrics. 2015;136(5):e1169-77.

32. Harbaugh CM, Lee JS, Hu HM, et al. Persistent opioid use among pediatric patients after surgery. Pediatrics. 2018;141(1):e20172439.

33. Casey B, Jones RM. Neurobiology of the adolescent brain and behavior: implications for substance use disorders. J Am Acad Child Adolesc Psychiatry. 2010;49(12):1189-201.

34. Donaldson CD, Nakawaki B, Crano WD. Variations in parental monitoring and predictions of adolescent prescription opioid and stimulant misuse. Addict Behav. 2015;45:14-21.

35. Halbesleben JR, Whitman MV. Evaluating survey quality in health services research: a decision framework for assessing nonresponse bias. Health Serv Res. 2013;48(3):913-30.