Introduction
Methods
Results
Discussion
Limitations
Conclusion

INTRODUCTION

Sepsis is a life-threatening organ dysfunction caused by a dysregulated host response to infection.
¹
A recent analysis estimated 11 million sepsis-related deaths worldwide, accounting for almost 20% of all global deaths.
²
Sepsis continues to be a major burden to healthcare systems including emergency departments (ED), affecting one of every 120 ED visits.
<sup>3

–

6</sup>
The most recent revision of the sepsis definition (Sepsis-3) stresses the defining feature of sepsis as a “dysregulated host response to infection” and emphasizes focus on quantification of organ dysfunction.
<sup>1

,

7</sup>
The Sepsis-3 definition adopts the Sequential Organ Failure Assessment (SOFA) score as a measure of organ failure, and the clinical criteria of sepsis included acute change in SOFA score.
<sup>7

,

8</sup>

While various scoring systems can be used for prognostication of suspected sepsis patients, the SOFA score is the most validated system and an essential component of a clinical sepsis definition.
⁹
The SOFA score was initially designed to provide population-level insights into acute morbidity in intensive care unit (ICU) patients, but it has become integrated into many aspects of critical care in both ICU and non-ICU settings including the ED.
¹⁰
The SOFA score is based on six organ categories, one for each of the respiratory, cardiovascular, hepatic, coagulation, renal, and neurological systems, each scored from 0 to 4, with an increasing score reflecting worsening organ dysfunction.
¹¹

The severity of respiratory dysfunction is measured with the SOFA score based on the ratio of partial pressure of oxygen (PaO₂) to fraction of inspired oxygen (FiO₂) (PF). The PF ratio provides information about pulmonary gas exchange adjusted for the quantity of oxygen delivered.
¹²
Although PaO₂ is a reference variable, invasive arterial blood gas (ABG) measurements are infrequently performed, and PF ratios are often unavailable for patients outside the ICU.
¹
Furthermore, PaO₂ is often measured once rather than multiple times, which reduces clinical utility in non-ICU settings. In clinical studies, missing PaO₂ values are usually considered normal. As a noninvasive alternative to PaO₂, peripheral oxygen saturation (SpO₂)-based estimation and the SpO₂/FiO₂ (SF) ratio have been proposed, but comparative data of estimation methods including simplified or mathematical models in non-ICU settings are limited and require further validation.
¹²

In this study we aimed to investigate the prognostic accuracy for predicting in-hospital mortality of respiratory SOFA scores by the conventional method of missing value imputation with normal PaO₂– and SpO₂-based estimation methods.

METHODS

Study Design

This was a single-center, retrospective cohort study of patients with suspected infection who presented to the ED of a tertiary-care hospital located in a metropolitan city between December 2017–November 2019. This study was approved by the Institutional Review Board of Samsung Medical Center (No. SMC 2022-08-158-001). The requirement for informed consent was waived given the study’s retrospective nature and anonymized patient data. We followed the guidelines of the Strengthening the Reporting of Observational Studies in Epidemiology Statement (Appendix 1).

Study Population and Definitions

We included patients ≥18 years old with suspected infection who presented to the ED. Suspected infection was defined as cases in which blood culture and antibiotic administration were conducted in the ED.
<sup>1

,

13</sup>
We excluded patients who had limitations on invasive care (eg, patients who had terminal malignancy or who had previously signed a do-not-resuscitate [DNR] order), who presented with cardiac arrest, who had obvious non-infectious conditions such as trauma or bleeding, who were without SpO₂ or FiO₂, or had inadequate data due to our inability to access their electronic health record (EHR).

Data Collection and Outcome Measurements

We collected retrospective cohort data by extraction from the hospital’s clinical data warehouse and review of EHR. Eligible cases were electronically identified by the aforementioned definition. Data extraction was carried out by two designated research coordinators trained on the definition of each variable by the investigator and who were blinded to the study hypothesis. To ensure high quality, one investigator reviewed the EHRs and verified the final data to resolve data conflicts. The following data were retrieved: demographic characteristics including age and gender; comorbidities; vital signs; laboratory data including platelet count, bilirubin, creatinine, lactate, and ABG analysis; vasopressor use; SOFA score; FiO₂ and mechanical ventilation support; infection focus; and outcome-related data including in-hospital mortality and 28-day mortality. For collecting mortality data, we used visit history after discharge, mortality data provided by Statistics Korea, and telephone interviews. The primary endpoint was in-hospital mortality.

Respiratory SOFA Score Assessment

Detailed equations for assessing respiratory SOFA score are shown in Table 1. As a conventional method, we calculated respiratory SOFA by PaO₂ value and imputation as a normal value for missing PaO₂. We used estimated PaO₂ values from SpO₂ based on two previously suggested methods (from Madan et al and Sauthier et al).
<sup>14

,

15</sup>
We replaced all PaO₂ (methods A and C) with estimated values regardless of the presence of measured PaO₂, or we imputed missing PaO₂ with estimated values (methods B and D). We also estimated respiratory SOFA scores by SpO₂ and respiratory support use in all cases (method E) or in cases with missing PaO₂ values (method F). We used a modified model from Valik et al because the original study did not incorporate use of respiratory support.
¹⁶
All SOFA score components were calculated using maximum values during the 24 hours after ED arrival. Estimation of FiO₂ in patients receiving supplementary oxygen is shown in Table S1.

Statistical Analyses

Results are presented as median values with interquartile ranges (IQR) for continuous variables and numbers of patients with percentages for categorical data. Continuous and categorical variables were analyzed by the Kruskal-Wallis test and chi-square test, respectively. We compared prognostic performance of estimated respiratory SOFA score from each method with conventional respiratory SOFA score calculation for predicting in-hospital mortality. The estimated total SOFA scores from estimation methods for respiratory SOFA were compared to the total SOFA score by the conventional method. Discrimination was measured using the area under the receiver operating characteristic curve (AUROC). We also calculated the exact binominal 95% confidence interval (CI) for the AUROC. We measured the differences between conventional respiratory SOFA score AUROC and estimated respiratory SOFA score AUROC using the method proposed by DeLong et al.
¹⁷
Calibration was assessed using calibration plots based on 100 bootstrap replicates. A P-value less than 0.05 was considered significant. We used R version 4.1.3 (R Foundation for Statistical Computing, Vienna, Austria; http://www.R-project.org/) for statistical analysis.

RESULTS

Study Population

We assessed the eligibility of 17,736 adult patients who underwent blood culture and antibiotic administration in the ED from December 2017–November 2019. After excluding patients who had limitations on invasive care (eg, patients who had terminal malignancy or who had previously signed a DNR order), presented with cardiac arrest, had obvious non-infectious conditions such as trauma or bleeding, were missing data on SpO₂ or FiO₂, or had inadequate data due to inability to access the EHR, 15,119 patients were included in the analyses (Figure 1). As shown in Table 2, the overall median age was 63 years, and 8,248 of patients (54.6%) were male. Respiratory tract infection was the most common diagnosis, found in 4,523 patients (29.9%). The median PF ratio was 324.3 (IQR 255.2–388.1). The proportion of patients with missing PF ratio was 56.0%, and patients with data on PF ratio had higher in-hospital mortality (9.3% vs 1.4%; Table S2). The median SF ratio was 452.4 (IQR 443.0–461.9). Overall, the total conventional SOFA score was 2.0 (IQR 1.0, 4.0), and in-hospital mortality was 740 patients (4.9%).

Calibration of Respiratory SOFA Scores

Incidence and in-hospital mortality according to respiratory SOFA scores by the conventional method and the six estimation methods are shown in Figure 2. In-hospital mortality increased as estimated respiratory SOFA score increased in all methods. The calibration curve for in-hospital mortality showed similar calibration for all methods (Figure S1).

Discrimination of Respiratory and Total SOFA Scores

The AUROCs of respiratory SOFA scores for predicting in-hospital mortality by the conventional method and by the six estimation methods are shown in Table 3 and Figure S2. The AUROC for method C (0.772; 95% CI 0.754–0.790) was significantly higher than that of the conventional method (0.755; 95% CI 0.736–0.773). The AUROCs of method B (0.739; 95% CI 0.719–0.759) and method D (0.735; 95% CI 0.715–0.755) were lower than that of the conventional method. The AUROCs of methods A (0.760; 95% CI 0.741–0.779), E (0.761; 95% CI 0.742–0.780), and F (0.758; 95% CI 0.739–0.777) were not significantly different from that of the conventional method.

The AUROCs for total SOFA scores for predicting in-hospital mortality are shown in Table 4. The AUROC for total SOFA score from method E (0.815; 95% CI 0.800–0.831) was statistically higher than that for the conventional method (0.806; 95% CI 0.790–0.822). The AUROCs for methods B and D were lower than that of the conventional method. The AUROCs for methods A, C, and F were similar to that of the conventional method.

DISCUSSION

In this single-ED study of 15,119 patients with suspected infection, PaO₂ values were commonly missing. Compared with a conventional missing value imputation with normal PaO₂, SpO₂-based estimation methods for missing PaO₂ did not improve the prognostic accuracy for predicting in-hospital mortality. In contrast, respiratory SOFA scores estimated by SpO₂, instead of measured and missing PaO₂, yielded higher discrimination for respiratory SOFA assessment (method C using the equation from Sauthier et al) or total SOFA assessment (method E using a modified model from Valik et al). Our study showed that respiratory function assessment based on estimated respiratory SOFA scores from SpO₂ is comparable to the conventional scoring system and could facilitate respiratory dysfunction assessment in the ED. Our study is important because we included patients with suspected infection in a non-ICU setting, where PaO₂ measurement is limited but acute management of sepsis and septic shock usually take place.

The SOFA score is a validated tool for organ failure assessment and for defining clinical sepsis.
<sup>1

,

7</sup>
The association of SOFA score with clinical outcomes has led many investigators to propose it as a potentially valid surrogate in clinical trials.
<sup>3

,

9</sup>
However, accurate respiratory SOFA score evaluation requires an invasive ABG measurement, which is not routinely ordered in patients outside the ICU due to limited resources and substantial risk of failure or complications.
³
Jakobsen et al and Gadrey et al addressed the issue that multiple imputations of large proportions of missing data lead to unreliable outcomes.
<sup>18

,

19</sup>
SpO₂ measured by pulse oximetry is a non-invasive, surrogate marker for tissue oxygenation that is routinely applied to most ED patients, and it can be monitored continuously.
<sup>20

,

21</sup>
Previous studies introduced methods for imputing PaO₂ from SpO₂. Rice et al found that the SF ratio correlates with a simultaneously obtained PF ratio in acute respiratory distress syndrome.
²²
Sauthier et al developed and validated a method to filter SpO₂ streams to estimate PaO₂ using only continuous and noninvasive data.
¹⁵
Valik et al showed that discrimination of mortality causes using SOFA score with respiratory function assessment based on SpO₂ is comparable with that of conventional respiratory function assessment.
¹⁶

All six estimated methods in our study replaced PaO₂ regardless of the presence of measured PaO₂ and yielded higher AUROCs for predicting in-hospital mortality. It is unclear why replacement of all PaO₂ values with estimated SpO₂ yielded better mortality-discriminant power than imputation of only missing PaO₂ values. It may be because it is difficult to perform ABG sequentially in the ED. As it suggests, sequential increases in SOFA score are associated with organ dysfunction.
²³

Selection of the lowest SpO₂ values from continuous monitoring might reflect deterioration in respiratory function better than does one-time PaO₂ measurement. SpO₂ measurement could identify more high-risk patients, including less severe patients, in the absence of PaO₂ values (Table S2). An optimal strategy or equation to assess respiratory SOFA score can be selected considering the clinical settings, severity of patients, and number of PaO₂ measurements. For example, we suggest that a simplified equation might be useful in resource-limited, urgent clinical settings like EDs. Among the six methods, Method E might be a good option for use in an ED. For clinical research, Method C would be preferred to show detailed data about estimated PaO₂ and betted discrimination performance of respiratory SOFA score.

LIMITATIONS

This study has several limitations. First, this was a single-center study conducted in the ED. Second, we were unable to assess pulse oximetry accuracy. There was the possibility that patient factors, such as skin pigmentation and peripheral circulation, affected SpO₂ measurement. Third, there might have been a selection bias in acquiring ABG measurements. For generalizability, further studies including representative patients in non-ICU settings are needed to determine the proper relationship between PaO₂ and SpO₂.

CONCLUSION

Our study shows that respiratory SOFA scores estimated by SpO₂ might have acceptable or higher prognostic accuracy for predicting in-hospital mortality in ED patients with suspected infection who had not routinely undergone arterial blood gas analysis for PaO₂ measurement. These findings suggest that SpO₂-based respiratory SOFA score calculation might be an alternative way to evaluate respiratory organ failure in the ED and clinical research. Further studies for validation and modification of SpO₂-based respiratory SOFA are needed.

Footnotes

Section Editors: Quincy Tran, MD, PhD, and Donna Mendez, MD, EdD

Full text available through open access at http://escholarship.org/uc/uciem_westjem

Address for Correspondence: Tae Gun Shin, MD, Sungkyunkwan University School of Medicine, Department of Emergency Medicine, Samsung Medical Center, 81 Irwon-ro, Gangnam-gu, Seoul 06351, Korea. Email: taegunshin@skku.edu
11 / 2023; 24:1056 – 1063

Submission history: Revision received November 15, 2022; Submitted June 30, 2023; Accepted August 7, 2023

Conflicts of Interest: By the WestJEM article submission agreement, all authors are required to disclose all affiliations, funding sources and financial or management relationships that could be perceived as potential sources of bias. No author has professional or financial relationships with any companies that are relevant to this study. There are no conflicts of interest or sources of funding to declare.

REFERENCES

1.

2.

3.

4.

5.

6.

7.

8.

9.

10.

11.

12.

13.

14.

15.

16.

17.

18.

19.

20.

21.

22.

23.