Anticipated resource utilization for injury versus non-injury pediatric visits to emergency departments
© Zonfrillo et al. 2016
Received: 23 December 2015
Accepted: 5 April 2016
Published: 3 May 2016
Childhood injuries are increasingly treated in emergency departments (EDs) but the relationship between injury severity and ED resource utilization has not been evaluated. The objective of this study was to compare resource utilization for pediatric injury-related ED visits across injury-severity levels and with non-injury visits, using standardized, validated scales.
A retrospective analysis of 2004-2008 ED visits from the Pediatric Emergency Care Applied Research Network Core Data Project. Maximum Abbreviated Injury Scale severity (MAIS) and Severity Classification System (SCS) scores were calculated and compared. MAIS and SCS are ordinal scales from 1 (minor injury) to 6, and 1 (low anticipated resource utilization) to 5, respectively. ED length of stay (LOS) and admission percentages were calculated as comparative proxy measures of resource utilization.
There were 763,733 injury visits and 2,328,916 non-injury visits, most with SCS of 2 or 3. Of the injured patients, 59.2 % had an MAIS of 1. ED LOS and admission percentage increased with increasing MAIS from 1-5. LOS and admission percentage increased with increasing SCS in both samples. Median LOS was shorter for injured versus non-injured patients with SCS 3-5. Non-injured patients with SCS 2-5 were more likely admitted than injured patients. Most injured patients had an SCS 3 with an MAIS 1-2, or an SCS 2 with an MAIS 1, with no correlation between the two scales.
While admission rates and LOS increase with increasing AIS and SCS severity, these two classification schemas do not reliably correlate. Similarly, ED visit metrics differ between injured and non-injured patients in similar SCS categories. Although AIS and SCS both have value, these differences should be considered when using these schemas in research and quality improvement.
Injury is the leading cause of mortality and acquired disability in children, (Centers for Disease Control and Prevention 2010) and it is estimated that for every fatal injury there are 25 children hospitalized and 925 treated in the emergency department (ED). (Centers for Disease Control and Prevention 2012) Although fatal childhood injuries have decreased over time, (Centers for Disease Control and Prevention 2012) ED visits for injuries in children have increased. (Thompson et al. 2012; Sharpe et al. 2012; Harris et al. 2011; Howell et al. 2010; D'Ippolito et al. 2010).
We recently described pediatric injury-related ED visits over 5 years from 2004-2008, including individual- and community-level socio-demographic characteristics, and found an increase in ED visits over the study period but with a stable degree of injury severity. (Macy et al. 2015) Although we have evidence of increasing numbers of ED visits by children with low to moderate injury severity, the relationship between measures of injury severity and resource utilization for ED visits by children has had limited exploration. This is important since understanding patterns of anticipated resource needs could have implications for triaging and cohorting of patients in the ED setting.
The goals of this study were to 1) compare resource utilization for pediatric injury-related ED visits versus non-injury visits and 2) compare resource utilization across levels of injury severity using standardized, validated scales.
Investigators obtained data for this retrospective multicenter, multiyear study from the Pediatric Emergency Care Applied Research Network (PECARN) Core Data Project (PCDP), a database established from participating hospitals’ administrative and/or electronic health record data.(Alpern et al. 2006) We conducted analyses using data from 2004 through 2008. The institutional review boards of all participating sites and the data-coordinating center approved this study.
We considered sites eligible for the study based on three criteria: 1) the contribution of data for all study years and 2) the assignment of International Statistical Classification of Diseases 9th Revision Clinical Modification (ICD-9-CM) E-codes to ≥80 % of visits with associated ICD-9-CM codes for injury (800 to 959.9).
Of the 24 EDs contributing data to the PCDP continuously from 2004 to 2008, 16 were included in the analyses. Eight sites were freestanding children’s hospital EDs, 6 sites were separate pediatric EDs within a general ED, and 2 sites were general EDs. Annual pediatric visit numbers ranged from 10,437 to 84,301, with overall admission rates ranging from 3 to 22 %. Twelve of 16 sites were recognized as Level 1 Pediatric Trauma centers either by the American College of Surgeons and/or state or regional designation. Sites were located in the Northeast (n = 3), Mid-Atlantic (n = 5), Midwest (n = 6), and West (n = 2).
ED visits by children <19 years of age were eligible for analysis. We categorized visits as injury-related based on: 1) the presence of an ICD-9-CM code for injury (800-959.9) in the first three diagnoses OR 2) the presence of any non-location E-code (E849.x). The latter criterion was used in order to capture visits with documented injury mechanisms, but without an injury code assigned. For example, a visit with an ICD-9-CM code for limb pain (729.5) AND an E-Code for motor vehicle collision (E813.x) was considered injury-related. Visits were considered non-injury-related if: all of the diagnosis codes were outside of 800-959.9 AND there was no injury mechanism E-code OR the only E-codes were considered “adverse effects” (E870-E879.99, E930-E949.99).
Hospital characteristics included ED type (ED in a freestanding children’s hospital, pediatric ED within a general hospital, or general ED) and designation as a Level 1 Pediatric Trauma Center. Visit-level data elements within the PCDP included patient demographic characteristics (e.g., age, gender, race, payer), ICD-9-CM codes and E-codes, and outcome of the visit (admitted, transferred, ED death, or discharge/other). Child age was categorized according to groupings used by the CDC; <1 year, 1-4 years, 5-9 years, 10-14 years, 15-18 years (Centers for Disease Control and Prevention 2010).
Maximum abbreviated injury scale (MAIS) severity
The AIS is anatomically based, consensus-derived, and is considered the global system of choice for injury severity determination. (Association for the Advancement of Automotive Medicine 2008) MAIS scores were calculated using a two-step process. First, an investigator certified in Abbreviated Injury Scale (AIS) scoring mapped each ICD-9-CM code associated with the visit to the 1998 version of the AIS (AIS98) codes using the ICDMAP-90 software, (MacKenzie et al. 1989) then manually re-mapped codes to the most recent AIS 2005/2008 versions using the AIS manual and the ICD-9-CM injury descriptions, (MacKenzie et al. 1989; Durbin et al. 2001; Association for the Advancement of Automotive Medicine 2008) which yielded the maximum AIS (MAIS) severity score value for each visit. This remapping was necessary to ensure the severities from the most recent manual were used. AIS severity scores are on an ordinal scale and range from 1 (minor) to 6 (untreatable). MAIS 2-6 injuries indicated moderate or more severe injuries. ICD-9-CM codes with insufficient detail to be mapped (e.g., 854, “Intracranial injury of other and unspecified nature”) and visits categorized as injury related based on an E-code without an ICD-9-CM code in the 800-959.9 range could not be mapped to an MAIS. These visits were determined as “un-mapped” and analyzed separately. Injury Severity Scores (ISS) were calculated by summing the squares of squares of the AIS scores of the three most severely injured body regions, and an MAIS 6 in any body region was assigned an ISS value of 75 (Association for the Advancement of Automotive Medicine 2008).
Severity classification system (SCS)
SCS scores were used as one measure of the anticipated resource utilization for the visit. The SCS is a 5-level system in which ICD-9-CM diagnosis codes have been assigned a score related to the anticipated ED resource utilization for the care of a child with that diagnosis, which can be used to compare across any ED diagnosis (Alessandrini et al. 2012) SCS has been previously used to classify severity for various analyses of hospital visits. (Macy et al. 2012; Montalbano et al. 2016; Alpern et al. 2014) For the current study, each case was assigned the maximal SCS score among all ICD-9-CM codes associated with the visit. Within the SCS, a score of 1 indicates minor illness (e.g., diaper dermatitis) and 5 indicates major illness (e.g., septic shock). Each visit was assigned the maximal SCS category based on the highest SCS score among all ICD-9-CM codes associated with the visit.
ED Visit characteristics
Additional measures of resource utilization included length of stay (LOS) and ED visit outcome. LOS was defined as the time between ED triage date/time and ED disposition date/time. ED visit outcome was categorized as admitted, transferred, ED death, or discharged/other (including left against medical advice, left without treatment, and missing).
Descriptive statistics were used to compare ED resource utilization (ED length of stay, discharge status) by SCS and MAIS level. Differences between the distribution of visit type (i.e., injury vs. non-injury) were compared using a chi-square test. Across the MAIS and SCS categories, differences in LOS were assessed using the Kruskal-Wallis test, increasing trend in median LOS was assessed using the likelihood ratio test, and differences in admission percentages were assessed using the Cochran-Armitage trend test. Single variable logistic regression was used to test for differences in the odds of admission/transfer/death between the injury and non-injury visits. Single variable quantile regression was used to compare the median length of stay by visit type. A scatter plot was created to examine the relationship between SCS and MAIS. Jittering was employed to better display the clustering of observations among specific combinations of SCS and MAIS.
Patient and hospital level characteristics of study sample
Injury visits n = 763,733
Non-Injury visits n = 2,328,916
All visits n = 3,092,649
Other Race, non-Hispanic
Pediatric ED/Children’s Hospital
Pediatric ED within General ED
Level 1 Pediatric Trauma Center
ED stay characteristics based on Maximum Abbreviated Injury Scale (MAIS) score
Total injury visits
ED stay characteristic
Visits without MAIS mapping determine
E-code without injury ICD-9
ICD-9 with insufficient detail to be mapped
n = 65,176
n = 109,195
n = 451,753
n = 120,183
n = 16,227
n = 914
n = 236
n = 49
N = 763,733
% of all patients
% died in ED
ED stay characteristics based on maximum Severity Classification Score (SCS) for injury visits
Total injury visits
ED stay characteristic
N = 8,632
N = 8,749
N = 218,681
N = 427,752
N = 73,329
N = 6,197
N = 763,733
% of all patients
% admit/ transfer/ died %f
ED stay characteristics based on maximum Severity Classification Score (SCS) for non-injury visits
Total non-injury visits
ED stay characteristic
N = 118,716
N = 68,919
N = 73,0829
N = 1,097,318
N = 276,787
N = 24,688
N = 2,328,916
% of all patients
% admit/ transfer/ died %f
Comparison of injury to non-injury visits based on Severity Classification System (SCS)
% of all visits
Overall Chi-square for injury vs non-injury <0.0001
ED LOS (mean)
ED LOS (median)
Difference in median LOS between injury and non-injury visits
5.0 (3.3, 6.7)
2.0 (-0.2, 4.2)
8.0 (-8.6, 7.4)
37.0 (36.5, 37.5)
60.0 (59.3, 60.7)
60.0 (54.0, 66.0)
Admit % [For each SCS, the % admitted or transferred)
OR (Injury vs non-injury visits)
0.57 (0.54, 0.59)
1.09 (0.88, 1.36)
0.79 (0.76, 0.82)
0.51 (0.51, 0.52)
0.55 (0.54, 0.56)
0.62 (0.58, 0.66)
Determinable only in injury visits
We demonstrated that admission rates and ED length of stay increased with increasing SCS (for all visits) and MAIS severity (for injury visits). However, there was little correlation between SCS and MAIS for injury visits; increasing SCS did not consistently align with increasing MAIS for injured patients. Additionally, ED visit metrics differed between injured and non-injured patients in the same SCS categories. Specifically, injury visits had, in general, shorter lengths of stay, and were less likely to result in admission when compared to non-injury visits.
The majority of injury visit were MAIS 1 and 2, and while it would be reasonable to speculate that these visits would correspond to SCS 1 and 2, they did not. Instead, we found that although the majority of injuries were minor and could be considered not ‘clinically significant’ (ie, less than MAIS 2), these children still had moderate anticipated resource needs based on SCS scores of 2, 3, or 4. Therefore, these seemingly ‘minor’ injuries still have an important impact on healthcare utilization and ED resources. One example might be a patient who sustains an MAIS 1 laceration that necessitates repair (although this could vary from a very minor laceration easily closed with tissue glue to a small but complicated animal bite on the face with avulsion and requiring complex suturing). In some of these cases, patients may have a longer ED LOS resulting from potentially being assigned a lower triage acuity and/or requiring procedural sedation (including nil per os time, calling a consultant, the procedure, and recovery).
AIS and SCS are two different schemas that can be used to classify ED visits for injury that have important but unique value. (Association for the Advancement of Automotive Medicine 2008; Alessandrini et al. 2012) AIS was originally designed to compare severity of various injuries, while SCS was created as a way to compare all ED visits based on anticipated ED resource utilization. When considering categorization of emergency department injury visits, investigators using administrative datasets should select the schema that most closely aligns with their aims (i.e., injury severity versus resource utilization), or use a combined approach that incorporates both measures. Similarly, the differences in visit metrics for injured vs non-injured patients of the same SCS category should also be considered in future analyses utilizing SCS to describe anticipated resource utilization for ED visits among children. Injured patients had 35-60 min shorter lengths of stay and 5-11 % lower admission rates than non-injured patients for SCS categories 3-5. This may reflect the fact that most injured patients are not diagnostic dilemmas, and that more severely ill patients with medical illness may have increased ED LOS due to waiting for an inpatient bed. Investigators should be aware when using the SCS to compare injured and non-injured patients that their visit characteristics can differ.
The AIS has evolved over time, and many diagnoses in the current manual have severity scores that have either decreased or increased from prior versions. (Association for the Advancement of Automotive Medicine 2008) AIS was originally created as a threat to life scale, but over time has accounted for non-fatal injury morbidity. Given that many AIS 1 injuries in this dataset corresponded to an SCS 3, future versions of the AIS could consider incorporating/accounting for ED resource utilization in addition to injury severity, which could enhance the utility of AIS by using a more global definition of injury burden.
For injured patients, there was a significantly higher proportion of admitted patients with SCS 3 when compared to SCS 2, and a significantly longer LOS for SCS 4 patients when compared to SCS 3 patients, which both demonstrate face validity that the categories correspond to actual ED resource utilization in terms of ED LOS and need for admission. Similar trends were seen with increasing AIS score, although there was decrease in LOS and lower percent of patients admitted for those with MAIS 6. This is likely due to a higher proportion of patients who died in the ED, and/or the smaller sample size in this group.
This analysis has limitations that should be considered. First, since it was not a population-based cohort and most of the ED visits in the database were at pediatrics EDs in children’s hospitals, we were not able to sample children who sought care at other settings. Similarly, measures such as LOS and resource utilization may have institutional and seasonal variability. However, even though this cohort likely had more severely injured children than the general population of injured children seeking ED care across the United States, the majority of the injuries were minor. Another limitation was that we were not able to reliably identify procedures completed during the visit, which could have been related to proxies of resource utilization, including length of stay. Finally, there were visits that could not be mapped to AIS and/or SCS categories, which could bias the results. However, since this mapping was based on ICD-9-CM codes, and the more general/vague injury codes are the most likely to be unmappable, many of these injuries would have mapped to the lowest AIS and SCS categories.
While admission rates and length of stay increase with increasing AIS and SCS severity, these two classification schemas do not reliably correlate with each other. Similarly, ED visit metrics differ between injured and non-injured patients in the same SCS categories. Investigators conducting analyses of administrative datasets to understand resource utilization of the injured should consider these differences carefully when describing severity for injured patients, and comparing their resource utilization to non-injured patients.
Supported by the Health Resources and Services Administration (HRSA), Maternal and Child Health Bureau (MCHB), Emergency Medical Services for Children (EMSC) Program through the Pediatric Emergency Care Applied Research Network (PECARN). PECARN is supported through the following cooperative agreements: U03MC00001, U03MC00003, U03MC00006, U03MC00007, and U03MC00008. MLM and MRZ received support from the Eunice Kennedy Shriver National Institute of Child Health and Human Development (K23HD070913 [to MLM] and K08HD073241 [to MRZ]). RMC received support from the University of Michigan Injury Center through the Centers for Disease Control and Prevention (R49CE002099). The content is solely the responsibility of the authors and does not necessarily represent the official views of the NIH, HRSA, MCHB, EMSC, or CDC.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
- Alessandrini EA, Alpern ER, Chamberlain JM, Shea JA, Holubkov R, Gorelick MH. Developing a diagnosis-based severity classification system for use in emergency medical services for children. Acad Emerg Med. 2012;19:70–8.View ArticleGoogle Scholar
- Alpern ER, Clark AE, Alessandrini EA, Gorelick MH, Kittick M, Stanley RM, Dean JM, Teach SJ, Chamberlain JM, Pediatric Emergency Care Applied Research Network (PECARN). Recurrent and high-frequency use of the emergency department by pediatric patients. Acad Emerg Med. 2014;21:365–73.Google Scholar
- Alpern ER, Stanley RM, Gorelick MH, Donaldson A, Knight S, Teach SJ, Singh T, Mahajan P, Goepp JG, Kuppermann N, Dean JM, Chamberlain JM. Epidemiology of a pediatric emergency medicine research network: the PECARN Core Data Project. Pediatr Emerg Care. 2006;22:689–99.View ArticleGoogle Scholar
- Association for the Advancement of Automotive Medicine (AAAM). The Abbreviated Injury Scale (AIS) 2005 - Update 2008. Barrington, IL: AAAM; 2008.Google Scholar
- Centers for Disease Control and Prevention. CDC Vital Signs. Child Injury Infographic. 2012. http://www.cdc.gov/vitalsigns/childinjury/infographic.html?s_cid=bb-vitalsigns-124. Accessed 16 July 2013.
- Centers for Disease Control and Prevention. 10 Leading Causes of Injury Deaths by Age Group Highlighting Unintentional Injury Deaths, United States - 2010'. 2010. http://www.cdc.gov/injury/wisqars/pdf/10LCID_Unintentional_Deaths_2010-a.pdf. Accessed 14 Jan 2013.
- Centers for Disease Control and Prevention. Vital signs: unintentional injury deaths among persons aged 0-19 years - United States, 2000-2009. MMWR Morb Mortal Wkly Rep. 2012;61:270–6.Google Scholar
- D'Ippolito A, Collins CL, Comstock RD. Epidemiology of pediatric holiday-related injuries presenting to US emergency departments. Pediatrics. 2010;125:931–7.View ArticleGoogle Scholar
- Durbin DR, Localio AR, MacKenzie EJ. Validation of the ICD/AIS MAP for pediatric use. Inj Prev. 2001;7:96–9.View ArticleGoogle Scholar
- Harris VA, Rochette LM, Smith GA. Pediatric injuries attributable to falls from windows in the United States in 1990-2008. Pediatrics. 2011;128:455–62.Google Scholar
- Howell CA, Nelson NG, McKenzie LB. Pediatric and adolescent sledding-related injuries treated in US emergency departments in 1997-2007. Pediatrics. 2010;126:517–24.View ArticleGoogle Scholar
- MacKenzie EJ, Steinwachs DM, Shankar B. Classifying trauma severity based on hospital discharge diagnoses. Validation of an ICD-9CM to AIS-85 conversion table. Med Care. 1989;27:412–22.View ArticleGoogle Scholar
- Macy ML, Hall M, Shah SS, Harding JP, Del Beccaro MA, Hain PD, Hronek C, Alpern ER. Pediatric observation status: are we overlooking a growing population in children’s hospitals? J Hosp Med. 2012;7:530–6.View ArticleGoogle Scholar
- Macy ML, Zonfrillo MR, Cook LJ, Funai T, Goldstick J, Stanley RM, Chamberlain JM, Cunningham RM, Lipton R, Alpern ER, and Pediatric Emergency Care Applied Research N. Patient- and community-level sociodemographic characteristics associated with Emergency Department Visits for childhood injury. J Pediatr. 2015;167:711–8 e1-4.View ArticleGoogle Scholar
- Montalbano A, Rodean J, Kangas J, Lee B, Hall M. Urgent Care and Emergency Department Visits in the Pediatric Medicaid Population. Pediatrics. 2016 Mar 15. [Epub ahead of print].Google Scholar
- Sharpe SJ, Rochette LM, Smith GA. Pediatric battery-related emergency department visits in the United States, 1990-2009. Pediatrics. 2012;129:1111–7.View ArticleGoogle Scholar
- Thompson MC, Chounthirath T, Xiang H, Smith GA. Pediatric inflatable bouncer-related injuries in the United States, 1990-2010. Pediatrics. 2012;130:1076–83.View ArticleGoogle Scholar