Introduction
Methods
Results
Discussion
Conclusion

INTRODUCTION

Identifying emergency department (ED) patients at risk for adverse clinical outcomes is an integral part of the early ED evaluation. Prior studies show that vital sign abnormalities, such as elevated respiratory rate, tachycardia, hypotension, and elevated shock index (heart rate [HR]/systolic blood pressure), as well as elevated lactate level identify a population of patients with a relatively higher risk of short-term adverse outcomes. ^1-3 These markers are regularly assessed early in the ED evaluation to help ED providers risk stratify patients.^3,4

While patients with persistent hypotension and shock are clearly at increased risk for adverse outcomes,^2,5-10 risk stratification is more challenging in normotensive and fluid responsive patients.^2,8,11 However, data showing the rates of adverse outcomes among those patients exhibiting markedly abnormal vital signs without shock (persistent hypotension despite resuscitation or need for vasopressors) are lacking. This risk has been assessed to a limited extent in infected patients with elevated lactate but no hypotension, who are shown to have a significant risk of adverse outcomes.^2,8,11 Yet diagnoses are often obscured during the ED evaluation, ¹² making the application of risk stratification data difficult to apply when limited to a single diagnosis. Understanding the rates, types, and predictors of serious adverse outcomes in an undifferentiated ED population exhibiting abnormal vital signs without shock would inform triage decisions, and help practitioners anticipate those patients who may require more aggressive interventions or a higher level of care at disposition.

This study evaluated undifferentiated ED patients who exhibited markedly abnormal vital signs or lactate levels, without overt shock. The objectives of this study were 1) to identify risk factors independently associated with clinical deterioration (defined as intubation, acute renal dysfunction, vasopressor use or death) occurring between hospital admission and discharge, and 2) to understand the overall risk of clinical deterioration in this population.

METHODS

Study Design

This was a prospective, observational cohort study of consecutive patients found to have physiologic instability in the ED. The study was conducted at a large, urban, academic ED with 55,000 annual visits. The derivation study period was November 11, 2012, to January 31, 2013. The validation cohort was from February 1, 2013, to March 20, 2013. This study was granted waiver of informed consent after expedited review from our human subjects committee.

Participants

Inclusion criteria were all adult (age 18 or older) patients with one or more of the following vital signs abnormalities: HR>130 beats/min, respiratory rate >24 breaths/min, systolic blood pressure <90mm/Hg), shock index >1, or lactate >4mmol/L. These criteria were used based on prior studies showing the association of these vital signs and laboratory abnormalities with adverse patient outcomes.^2,3,13-15 Exclusion criteria were the following: patients with tachycardia due to atrial fibrillation with rapid ventricular response or supraventricular tachycardia who were then discharged once rate control was achieved, vital sign abnormalities due to intoxication, withdrawal, psychiatric disorder, seizure, or simple trauma (ie: fracture). We also excluded patients who were discharged from the ED. Lastly, we excluded patients with shock in the ED. Shock was defined as persistent hypotension (systolic blood pressure <90mmHg) despite at least 1L of intravenous fluids or the need for vasopressors to treat hypotension.

We continuously and prospectively screened patients in the ED for possible inclusions using our information technology system. If patients had qualifying vital signs in triage, in nursing notes, or through the bedside monitors (two readings more than five minutes apart), or a serum lactate lactate >4mmol/L, then the patients were identified for possible inclusion in the study. Identified patients then underwent a confirmatory chart review to affirm the presence of inclusion criteria and absence of exclusion criteria. The confirmatory review occurred after patients were discharged and without subsequent knowledge of the hospital course.

Data Collection

Elements of the history of present illness, triage vital signs, physical examination, past medical history, and medications were abstracted for each enrolled patient from the hospital record. Abstraction was performed by research assistants trained, directly supervised by the principal investigator, who periodically reviewed data collection for accuracy, in accordance with published guidelines. ¹⁶ The history of present illness and physical examination portions were abstracted exclusively from the emergency attending and resident charts. Basic demographics, length of stay, and disposition data were obtained from a hospital database. Likewise, all laboratory values were obtained from a hospital database.

An emergency physician adjudicated each patient’s underlying cause of instability, based on accepted definitions.^17,18 Underlying causes were classified as septic, cardiogenic, hemorrhagic, hypovolemic, anaphylactic, neurogenic, and other. To determine inter-rater reliability, a second physician reviewer likewise adjudicated the first 500 charts, and the agreement between the two reviewers was found to be sufficient to proceed with a single adjudication for each patient (kappa=0.8).

Outcome

The primary outcome was clinical deterioration occurring after hospitalization represented by the composite outcome of acute renal failure (creatinine 2× baseline), non-elective intubation, need for vasopressors, or death. This outcome could occur at any point after the patient left the ED until they were discharged from the hospital. Patients with acute renal failure or intubation in the ED qualified as having in-hospital deterioration only if they had new deterioration events after admission. Our secondary outcome was deterioration at any time after presentation to the ED, including any point during hospitalization, between ED triage and hospital discharge. The physician reviewer assessed for the presence and timing of deterioration.

We performed data analysis using SAS v9.3 statistical software (SAS Institute Inc., Cary, NC). Comparison of patient demographics and co-morbidities between patients with and without deterioration was performed with Chi-square for binary variables and Student’s T-Test for continuous variables. We constructed a multivariate logistic regression model to determine predictors of deterioration after admission was constructed. Lactate concentrations were stratified into “high” (≥4.0mmol/L), “intermediate” (4.0mmol/L> lactate ≥2.0mmol/L), and “low” (≤2.0mmol/L). We included a lactate-missing variable to impute for the 158 patients who did not have lactate measured, ¹⁹ although we do not present the results from the lactate missing variable with the model results. Other notable transformations included creating a binary variable for age ≥80 years, bicarbonate ≤20mEq/L, and a binary variable for initial HR≥130 beats per minute. We performed a univariate analysis of each covariate, using a chi-square to assess for a significant relationship. Clinical covariates with p>0.1 were removed from the modeling process. All significant variables were then used to create a logistic regression model with deterioration after admission as the outcome, and a stepwise selection process to create the final model. We validated the model using a validation cohort that consisted of the next 254 continuous patients that met study criteria, and reported the area under the curve (AUC) to assess the model on this group. The validation cohort was identified in the same manner and subjected to the same inclusion and exclusion criteria as the derivation cohort.

We used the logistic regression model as the basis for determining the sample size needed for the study. Based on the n/10 rule, we estimated that we would require at least 50 patients who suffered our primary outcome of deterioration after admission in order to include five predictors in our model. We estimated an in-hospital deterioration rate of 10% for the population based on observations from our initial data collection, and therefore determined at least 500 patients would be required to have five predictors in our model. Our validation cohort was meant to have at least half the number of patients in the derivation cohort: 250 patients.

RESULTS

For our initial cohort (Figure 1), we identified 1,152 patients among 12,050 patients presenting to the ED as having vital signs meeting inclusion criteria. Of these, 620 were excluded (Supplemental Table 1), leaving 532 patients for our analysis. Of these 532 patients, we found 53/532 (9.9%) patients met the primary outcome of deterioration after admission: 22 acute renal dysfunction (4.1%, 95% confidence interval (CI) ±1.3), 20 needing mechanical ventilation (3.8%, 95% CI±1.3), 12 requiring vasopressors (2.3%, 95% CI±1.3) and 37 (7.0%, 95% CI±1.3) who died during hospitalization (Figure 1). Including those patients who had adverse outcomes in the ED, 87 (16.4%, 95% CI±3.2) patients reached the secondary deterioration outcome overall: 46 developed acute renal dysfunction (8.6%, 95% CI±2.4), 31 required mechanical ventilation (5.8% 95% CI±2.0), 12 required vasopressors (2.3%, 95% CI±1.3), and 37 died (7.0% 95% CI±1.3)( Table 1).

Table 2 shows the study demographics and displays the clinical characteristics for the study patient population. Table 3 demonstrates the clinical characteristics between the group of patients who suffered deterioration and those that did not. These tables include an unadjusted univariate measure to determine if a significant difference exists between the two groups for each covariate. The covariates that have a significant relationship (p<0.05) with the outcome are indicated. The covariates with p<0.1 from this table were included in the creation of the logistic regression model to predict in hospital deterioration.

The final logistic regression model predicting deterioration from this patient population is shown in Table 4. The covariates independently associated with adverse outcomes were the following: lactate ≥4.0mmol/L, HR≥130 beats per minute, age ≥80 years, and bicarbonate ≤20mEq/L during the ED stay. The AUC for this derivation model was 0.74, with sensitivity of 70% and specificity 63%.

We compared the rates of covariates from the final model between infectious and non-infectious causes (Figure 2). A HR≥130 was more likely in patients with infection (p<0.01); however, no difference was found in incidence of the other model covariates between infected and non-infected groups. Then the model was re-run with infectious etiology as a binary predictor, the AUC of the model remained 0.74, and the infection term was not significant. The model was re-run on the validation cohort, with AUC=0.70. We used chi-square to test the statistical similarity of the model performed on the derivation and validation populations, which showed no difference between the model’s predictive value (p=0.70). ROC curves showing the model performance in the derivation and validation cohorts are displayed in Figure 3.

DISCUSSION

This study of undifferentiated ED patients with markedly abnormal vital signs or elevated lactate without shock found that a significant proportion (16.4%) of these patients suffered clinical deterioration, and nearly 10% had deterioration events after being admitted from the ED. While not directly assessed, many patients in this population had improvement in hemodynamics during their ED course. This study identified independent risk factors for in-hospital deterioration so that ED and in-patient providers can better anticipate clinical course and appropriately assign level of in-patient care.

In the univariate analysis, we identified covariates associated with deterioration. Some covariates were surprisingly not associated with increased adverse outcomes, including diabetes, and congestive heart failure. Similarly, active cancer has a significant association with deterioration in the univariate analysis, but surprisingly was not significant in the modeling process. The decreased rate of deterioration in patients without any pre-existing medical problems was expected, as was the association of altered mental status with deterioration, since mental status changes can represent a form of organ dysfunction. Also, higher average lactate concentration has been associated with progression of disease,^8,20 and was expected to be associated with increased event rates.

The multivariate logistic regression model allows for each independent covariate’s effect on the deterioration outcome to be determined. This model provides a few significant results for clinicians tasked with determining a disposition for ED patients. An elevated lactate is associated with increased adverse outcomes, even after controlling for patients who did not have a lactate drawn. While the prior studies of lactate concentrations have generally looked at septic patients,^2,7-9,11,20 this result suggests that an elevated lactate level is associated with increased adverse outcomes in this general ED population. Interestingly, a lactate ≥4.0 mmol/L, occurred more frequently in the non-infected patient population, reiterating its usefulness as a predictor in undifferentiated patients,^21,22 Likewise, a bicarbonate ≤20mEq/L, was a significant predictor of deterioration after controlling for elevated lactate levels, which should remind clinicians that acidosis, with or without elevated lactate levels increases the odds of adverse outcomes after hospitalization. Lastly, an initial HR≥130 beats/min increased the odds of deterioration during hospitalization. This occurred more frequently in patients with infection, which may be caused by an adrenergic response to infection or compensation for relative hypovolemia. Regardless, significant tachycardia at presentation likely reflects more serious underlying pathology compared to the other vital sign abnormalities used to triage patients in the ED.

Clinical investigations describing at-risk ED patient populations are in response to the inherent difficulty physicians face in identifying patients who will have adverse outcomes. The present study aligns with prior studies that have shown a clinically meaningful rate of disease progression, ⁸ progressive organ failure,^11,20 and mortality^2,23 in similar populations, albeit with different inclusion criteria. Prior studies have generally been limited to patients with sepsis, whereas this study includes undifferentiated patients. In prior studies that evaluated the demographics of unstable patients, the population of patients with sepsis accounts for roughly 38–43%,^24,25 similar to the 46% of patients in this study with an infectious cause.

Prior studies have also attempted to identify the clinical characteristics of these at-risk populations that are associated with adverse clinical outcomes.^2,9,11,20,26 Howell, et al., shows a strong association between lactate concentrations and mortality among patients without hypotension, although this study was limited to patients with sepsis. The degree to which this association exists in patients with infection versus those without infection remains unknown, but the present study supports the conclusions of the Howell study. In the patient population used by Song, et al., all had a lactate concentration between 2.0 and 4.0mmol/L and suspected infection. Their investigation provides other predictors of disease progression, including initial organ dysfunction and SOFA scores, but again it is limited to a population with infection.

Our model was not limited to a single underlying etiology, but included all causes of instability. This may explain the lack of significant associations between certain covariates and our outcome. Covariates more classically associated with worse outcomes in a single disease may become less significant when used to predict adverse outcomes across a spectrum of diseases. This study does not suggest that these elements would not have a significant effect on outcomes if we were evaluating a single cause of instability, and it does not replace prior studies that evaluate predictors of adverse outcomes within a single etiology.^11,20 Instead, this study is meant to be applicable regardless of the underlying cause, and especially in the undifferentiated patient and early ED evaluation. By enrolling patients regardless of the underlying cause, this study bypassed the need to differentiate patients into infectious and non-infectious categories, which as stated before is inherently difficult during the initial evaluation ¹².

The primary outcome of deterioration represents different types of adverse outcomes that occurred after admission to the hospital. Each type represents a meaningful clinical end-point, as well as significant morbidity and discomfort endured by the patient and increased resource utilization. Importantly, this study may assist clinicians in the early identification of patients with a higher risk of disease progression and adverse outcomes. By facilitating improved risk stratification, our findings may enable more appropriate resource allocation, thereby improving patient outcome and reducing costs associated with care.

Limitations

This study had several limitations. We were able to collect a vast amount of clinical data, but many aspects of the history and physical examination we derived through chart abstraction possibly leading to misclassification bias. The use of a composite outcome that included four different clinical end-points may have been too inclusive. While each end-point does represent a significant adverse outcome, creating a composite outcome from very different end-points may have diminished the strength of association between different covariates and the outcome. It could be argued that death should be used as the single outcome of interest. This may become the foundation for further study; however, we believe that by including the other components of the deterioration outcome, we were able to develop a more sensitive tool that may allow practitioners to intervene earlier thereby avoiding mortality. As well, these other outcomes represent meaningful progression of disease that might be avoided with appropriate early management. Along these same lines, choosing to non-electively intubate or administer vasopressors is physician dependent to a certain extent, and there is a possibility that practice variation could affect whether or not a patient met the primary outcome.

An additional limitation was the large number of patients excluded from this study. Our screening criteria, like many triage screening tools, were overly sensitive in order to capture all moderately sick patients. Therefore, our exclusions were designed to remove those patients whose clinical stability would not be questioned by an experienced provider, i.e, patients with intoxication. Similarly, we excluded patients who were discharged from the ED. Such patients are likely to have had markedly abnormal vital signs or elevated lactate that rapidly improved with intervention suggesting a milder illness not requiring ongoing monitoring or in-patient treatment. However, this may exclude a small number of patients who would have been admitted, and therefore included in the study, if seen by an alternative provider. Also, we did not take into account how hemodynamics or lactate changed during a patient’s ED stay. While such trends clearly influence disposition decisions, the timing of repeat vital signs and lactate measurements was not able to be standardized due to our data collection methods, thereby preventing us from incorporating changes in hemodynamics and lactate into our models. Lastly, we did not assess for do not resuscitate/do not intubate (DNR/DNI) status in the ED or in the hospital. This may have had a significant effect on the rates of patients suffering adverse outcomes. However, age and other comorbidities that can be associated with a DNR/DNI order were not strong predictors of deterioration. Therefore, it is less likely that this variable represents a significant gap in the model.

CONCLUSION

This study provides a framework for understanding the population of emergency patients who exhibit abnormal vital signs or elevated lactate in the absence of overt shock. This population is clinically relevant based on the high rate of adverse outcomes, and our analysis suggests predictors to identify those patients more likely to suffer adverse outcomes during hospitalization. Our results will help clinicians risk stratify these patients and identify the appropriate resuscitation and resource needs. A large amount of unaccounted variability remains in the model predicting deterioration, and future studies should explore the potential of newer medical devices and novel biomarkers for risk stratification.

<media xlink:href=”wjem-16-1059-s001.pdf” mimetype=”application” mime-subtype=”pdf”/></p> </graphic>

<h3>Footnotes</h3>
<p><i>Section Editor:</i> Eric Snoey, MD</p><p>Full text available through open access at <ext-link xlink:href=”http://escholarship.org/uc/uciem_westjem” ext-link-type=”uri”>http://escholarship.org/uc/uciem_westjem</a></p><p>Address for Correspondence: Daniel Henning, MD, MPH, Harborview Medical Center, 325 9th Ave, Box#359702, Seattle, WA 98104. Email: <a href=”mailto:henning2@uw.edu”>henning2@uw.edu</a>. 12 / 2015; 16:1059 – 1066</p><p>Submission history: Revision received May 3, 2015; Submitted August 8, 2015; Accepted September 27, 2015</p><p><i>Conflicts of Interest</i>: By the <i>West</i>JEM article submission agreement, all authors are required to disclose all affiliations, funding sources and financial or management relationships that could be perceived as potential sources of bias. The authors disclosed none.</p>
<h2>REFERENCES</h2>
<p>1. Barfod C, Lauritzen MMP, Danker JK, et al. Abnormal vital signs are strong predictors for intensive care unit admission and in-hospital mortality in adults triaged in the emergency department – a prospective cohort study. <i>Scand J Trauma Resusc Emerg Med</i>. 2012;20(1):28.</p>
<p>2. Howell MD, Donnino M, Clardy P, et al. Occult hypoperfusion and mortality in patients with suspected infection. <i>Intensive Care Med</i>. 2007;33(11):1892-9.</p>
<p>3. McGillicuddy DC, O’Connell FJ, Shapiro NI, et al. Emergency Department Abnormal Vital Sign “Triggers” Program Improves Time to Therapy. <i>Acad Emerg Med</i>. 2011;18(5):483-87.</p>
<p>4. Perman SM, Goyal M, Gaieski DF. Initial emergency department diagnosis and management of adult patients with severe sepsis and septic shock. <i>Scand J Trauma Resusc Emerg Med</i>. 2012;20(1):41.</p>
<p>5. Bone RC, Balk RA, Cerra FB, et al. Definitions for sepsis and organ failure and guidelines for the use of innovative therapies in sepsis. The ACCP/SCCM Consensus Conference Committee. American College of Chest Physicians/Society of Critical Care Medicine. <i>Chest</i>. 1992;101(6):1644-55.</p>
<p>6. Bozza FA, Carnevale R, Japiassú AM, et al. Early fluid resuscitation in sepsis. <i>Shock</i>. 2010;34(Suppl 1):40-3.</p>
<p>7. Freund Y, Delerme S, Goulet H, et al. Serum lactate and procalcitonin measurements in emergency room for the diagnosis and risk-stratification of patients with suspected infection. <i>Biomarkers</i>. 2012.</p>
<p>8. Glickman SW, Cairns CB, Otero RM, et al. Disease Progression in Hemodynamically Stable Patients Presenting to the Emergency Department With Sepsis. <i>Acad Emerg Med</i>. 2010;17(4):383-90.</p>
<p>9. Mikkelsen ME, Miltiades AN, Gaieski DF, et al. Serum lactate is associated with mortality in severe sepsis independent of organ failure and shock. <i>Crit Care Med</i>. 2009;37(5):1670-7.</p>
<p>10. Schuetz P, Jones AE, Aird WC, et al. Endothelial Cell Activation in Emergency Department Patients with Sepsis-Related and Non-Sepsis-Related Hypotension. <i>Shock</i>. 2011;36(2):104-08.</p>
<p>11. Arnold RC, Sherwin R, Shapiro NI, et al. Multicenter Observational Study of the Development of Progressive Organ Dysfunction and Therapeutic Interventions in Normotensive Sepsis Patients in the Emergency Department. <i>Acad Emerg Med</i>. 2013;20(5):433-40.</p>
<p>12. Caterino JM, Stevenson KB. Disagreement Between Emergency Physician and Inpatient Physician Diagnosis of Infection in Older Adults Admitted From the Emergency Department. <i>Acad Emerg Med</i>. 2012;19(8):908-15.</p>
<p>13. Marchick MR, Kline JA, Jones AE. The significance of non-sustained hypotension in emergency department patients with sepsis. <i>Intensive Care Med</i>. 2009;35(7):1261-64.</p>
<p>14. Berger T, Green J, Horeczko T, et al. The Shock Index and Early Recognition of Sepsis in the Emergency Department-A Pilot Study. <i>West J Emerg Med</i>. 2012:1-7.</p>
<p>15. Rady MY, Smithline HA, Blake H, et al. A comparison of the shock index and conventional vital signs to identify acute, critical illness in the emergency department. <i>Ann Emerg Med</i>. 1994;24(4):685-90.</p>
<p>16. Kaji AH, Schriger D, Green S. Looking through the retrospectoscope: reducing bias in emergency medicine chart review studies. <i>Ann Emerg Med</i>. 2014;64(3):292-98.</p>
<p>17. Levy MM, Fink MP, Marshall JC, et al. 2001 SCCM/ESICM/ACCP/ATS/SIS International Sepsis Definitions Conference. <i>Crit Care Med</i>. 2003;31(4):1250-56.</p>
<p>18. Reynolds HR, Hochman JS. Cardiogenic Shock: Current Concepts and Improving Outcomes. <i>Circulation</i>. 2008;117(5):686-97.</p>
<p>19. Greenland S, Finkle WD. A critical look at methods for handling missing covariates in epidemiologic regression analyses. <i>Am J Epidemiol</i>. 1995;142(12):1255-64.</p>
<p>20. Song YH, Shin TG, Kang MJ, et al. Predicting factors associated with clinical deterioration of sepsis patients with intermediate levels of serum lactate. <i>Shock</i>. 2012;38(3):249-54.</p>
<p>21. Choi JY, Lee WH, Yoo TK, et al. A New Severity Predicting Index for Hemorrhagic Shock Using Lactate Concentration and Peripheral Perfusion in a Rat Model. <i>Shock</i>. 2012;38(6):635-41.</p>
<p>22. Régnier M-A, Raux M, Le Manach Y, et al. Prognostic significance of blood lactate and lactate clearance in trauma patients. <i>Anesthesiology</i>. 2012;117(6):1276-88.</p>
<p>23. Shapiro NI, Howell MD, Bates DW, et al. The Association of Sepsis Syndrome and Organ Dysfunction With Mortality in Emergency Department Patients With Suspected Infection. <i>Ann Emerg Med</i>. 2006:1-9.</p>
<p>24. Jones AE, Tayal VS, Sullivan DM, et al. Randomized, controlled trial of immediate versus delayed goal-directed ultrasound to identify the cause of nontraumatic hypotension in emergency department patients*. <i>Crit Care Med</i>. 2004;32(8):1703-08.</p>
<p>25. Jones AE, Craddock PA, Tayal VS, et al. Daignostic accuracy of left ventricular function for identifying sepsis among emergency department patients with nontraumatic symptomatic undifferentiated hypotension. <i>Shock</i>. 2005;24(6):513-17.</p>
<p>26. Brabrand M, Folkestad L, Clausen N, et al. Risk scoring systems for adults admitted to the emergency department: a systematic review. <i>Scand J Trauma Resusc Emerg Med</i>. 2010;18(1):8.</p>

<div id=’displayObjects’>
<sec sec-type=”display-objects”>
<title>Figures and Tables

Flowchart of study enrollment, exclusions, and primary outcome. *See Supplemental Table 1 for rates of exclusion by criteria.