Comparing the Accuracy of Mass Casualty Triage Systems in a Pediatric Population

Robert W. Heffernan, E. Brooke Lerner, Courtney H. McKee, Lorin R. Browne, M. Riccardo Colella, J. Marc Liu, Richard B. Schwartz

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

Introduction: It was previously difficult to compare the accuracy of different mass casualty triage systems to one another. This pilot study is one of the first attempts to operationalize an expert panel’s criterion standard definitions of triage categories in a pediatric population in order to compare accuracy between different systems. Objective: To compare the accuracy of 4 different mass casualty triage systems (SALT, JumpSTART, Triage Sieve, and CareFlight) when used for children. Methods: We observed the emergency department triage of patients less than 18 years old presenting to the only pediatric specialty hospital/Level 1 trauma center in Milwaukee County, Wisconsin. A single, certified EMS provider observed each patient’s initial triage in the emergency department and recorded all findings that were necessary to categorize the patient using each of the 4 mass casualty triage systems being studied. Hospital medical records were then reviewed for each patient and assigned a criterion standard triage category based on the treatments received and final disposition. Descriptive statistics were used to compare accuracy, over-, and under-triage rates for each of the triage systems. Results: A total of 115 subjects were enrolled. Of those, 51% were male and 57% were transported by ambulance. When compared to the criterion standard definitions, SALT was found to have the highest accuracy rate (59%; 95% CI 50–68) compared to JumpSTART (57%; 95% CI 48–66), CareFlight (56%; 95% CI 47-65), and TriageSieve (56%; 95% CI 46–65). SALT also had the lowest under-triage rate (33%; 95% CI 24–42) compared to JumpSTART (39%; 95% CI 30–48), CareFlight (39%; 95% CI 30–48), and TriageSieve (39%; 95% CI 30–48). SALT had the highest over-triage rate (6%; 95% CI 2–11) compared to JumpSTART (4%; 95% CI 1–8), CareFlight (5%; 95% CI 1–9), and TriageSieve (5%; 95% CI 1–9). However, the confidence intervals for both the accuracy and under-triage rates overlapped between all triage systems. For each triage system, the most common error was designating a patient as “minimal” that, according to the criterion standard, should have been triaged as “delayed.” Conclusion: We found that the 4 most popular mass casualty triage systems preformed similarly in an emergency department-based pediatric population. None of the systems were extremely accurate, and each demonstrated an unacceptable amount of under-triage. Better differentiating between patients categorized as “minimal” and “delayed” may improve the accuracy of mass casualty triage systems.

Original languageEnglish (US)
Pages (from-to)304-308
Number of pages5
JournalPrehospital Emergency Care
Volume23
Issue number3
DOIs
StatePublished - May 4 2019

Fingerprint

Mass Casualty Incidents
Triage
Pediatrics
Population
Hospital Emergency Service

Keywords

  • mass casualty triage; pediatric triage; disaster; emergency medical services; SALT; JumpSTART; Triage Sieve; CareFlight

ASJC Scopus subject areas

  • Emergency Medicine
  • Emergency

Cite this

Heffernan, R. W., Lerner, E. B., McKee, C. H., Browne, L. R., Colella, M. R., Liu, J. M., & Schwartz, R. B. (2019). Comparing the Accuracy of Mass Casualty Triage Systems in a Pediatric Population. Prehospital Emergency Care, 23(3), 304-308. https://doi.org/10.1080/10903127.2018.1520946

Comparing the Accuracy of Mass Casualty Triage Systems in a Pediatric Population. / Heffernan, Robert W.; Lerner, E. Brooke; McKee, Courtney H.; Browne, Lorin R.; Colella, M. Riccardo; Liu, J. Marc; Schwartz, Richard B.

In: Prehospital Emergency Care, Vol. 23, No. 3, 04.05.2019, p. 304-308.

Research output: Contribution to journalArticle

Heffernan, RW, Lerner, EB, McKee, CH, Browne, LR, Colella, MR, Liu, JM & Schwartz, RB 2019, 'Comparing the Accuracy of Mass Casualty Triage Systems in a Pediatric Population', Prehospital Emergency Care, vol. 23, no. 3, pp. 304-308. https://doi.org/10.1080/10903127.2018.1520946
Heffernan RW, Lerner EB, McKee CH, Browne LR, Colella MR, Liu JM et al. Comparing the Accuracy of Mass Casualty Triage Systems in a Pediatric Population. Prehospital Emergency Care. 2019 May 4;23(3):304-308. https://doi.org/10.1080/10903127.2018.1520946
Heffernan, Robert W. ; Lerner, E. Brooke ; McKee, Courtney H. ; Browne, Lorin R. ; Colella, M. Riccardo ; Liu, J. Marc ; Schwartz, Richard B. / Comparing the Accuracy of Mass Casualty Triage Systems in a Pediatric Population. In: Prehospital Emergency Care. 2019 ; Vol. 23, No. 3. pp. 304-308.
@article{1598b55a547f432eb501278abfaf847c,
title = "Comparing the Accuracy of Mass Casualty Triage Systems in a Pediatric Population",
abstract = "Introduction: It was previously difficult to compare the accuracy of different mass casualty triage systems to one another. This pilot study is one of the first attempts to operationalize an expert panel’s criterion standard definitions of triage categories in a pediatric population in order to compare accuracy between different systems. Objective: To compare the accuracy of 4 different mass casualty triage systems (SALT, JumpSTART, Triage Sieve, and CareFlight) when used for children. Methods: We observed the emergency department triage of patients less than 18 years old presenting to the only pediatric specialty hospital/Level 1 trauma center in Milwaukee County, Wisconsin. A single, certified EMS provider observed each patient’s initial triage in the emergency department and recorded all findings that were necessary to categorize the patient using each of the 4 mass casualty triage systems being studied. Hospital medical records were then reviewed for each patient and assigned a criterion standard triage category based on the treatments received and final disposition. Descriptive statistics were used to compare accuracy, over-, and under-triage rates for each of the triage systems. Results: A total of 115 subjects were enrolled. Of those, 51{\%} were male and 57{\%} were transported by ambulance. When compared to the criterion standard definitions, SALT was found to have the highest accuracy rate (59{\%}; 95{\%} CI 50–68) compared to JumpSTART (57{\%}; 95{\%} CI 48–66), CareFlight (56{\%}; 95{\%} CI 47-65), and TriageSieve (56{\%}; 95{\%} CI 46–65). SALT also had the lowest under-triage rate (33{\%}; 95{\%} CI 24–42) compared to JumpSTART (39{\%}; 95{\%} CI 30–48), CareFlight (39{\%}; 95{\%} CI 30–48), and TriageSieve (39{\%}; 95{\%} CI 30–48). SALT had the highest over-triage rate (6{\%}; 95{\%} CI 2–11) compared to JumpSTART (4{\%}; 95{\%} CI 1–8), CareFlight (5{\%}; 95{\%} CI 1–9), and TriageSieve (5{\%}; 95{\%} CI 1–9). However, the confidence intervals for both the accuracy and under-triage rates overlapped between all triage systems. For each triage system, the most common error was designating a patient as “minimal” that, according to the criterion standard, should have been triaged as “delayed.” Conclusion: We found that the 4 most popular mass casualty triage systems preformed similarly in an emergency department-based pediatric population. None of the systems were extremely accurate, and each demonstrated an unacceptable amount of under-triage. Better differentiating between patients categorized as “minimal” and “delayed” may improve the accuracy of mass casualty triage systems.",
keywords = "mass casualty triage; pediatric triage; disaster; emergency medical services; SALT; JumpSTART; Triage Sieve; CareFlight",
author = "Heffernan, {Robert W.} and Lerner, {E. Brooke} and McKee, {Courtney H.} and Browne, {Lorin R.} and Colella, {M. Riccardo} and Liu, {J. Marc} and Schwartz, {Richard B.}",
year = "2019",
month = "5",
day = "4",
doi = "10.1080/10903127.2018.1520946",
language = "English (US)",
volume = "23",
pages = "304--308",
journal = "Prehospital Emergency Care",
issn = "1090-3127",
publisher = "Informa Healthcare",
number = "3",

}

TY - JOUR

T1 - Comparing the Accuracy of Mass Casualty Triage Systems in a Pediatric Population

AU - Heffernan, Robert W.

AU - Lerner, E. Brooke

AU - McKee, Courtney H.

AU - Browne, Lorin R.

AU - Colella, M. Riccardo

AU - Liu, J. Marc

AU - Schwartz, Richard B.

PY - 2019/5/4

Y1 - 2019/5/4

N2 - Introduction: It was previously difficult to compare the accuracy of different mass casualty triage systems to one another. This pilot study is one of the first attempts to operationalize an expert panel’s criterion standard definitions of triage categories in a pediatric population in order to compare accuracy between different systems. Objective: To compare the accuracy of 4 different mass casualty triage systems (SALT, JumpSTART, Triage Sieve, and CareFlight) when used for children. Methods: We observed the emergency department triage of patients less than 18 years old presenting to the only pediatric specialty hospital/Level 1 trauma center in Milwaukee County, Wisconsin. A single, certified EMS provider observed each patient’s initial triage in the emergency department and recorded all findings that were necessary to categorize the patient using each of the 4 mass casualty triage systems being studied. Hospital medical records were then reviewed for each patient and assigned a criterion standard triage category based on the treatments received and final disposition. Descriptive statistics were used to compare accuracy, over-, and under-triage rates for each of the triage systems. Results: A total of 115 subjects were enrolled. Of those, 51% were male and 57% were transported by ambulance. When compared to the criterion standard definitions, SALT was found to have the highest accuracy rate (59%; 95% CI 50–68) compared to JumpSTART (57%; 95% CI 48–66), CareFlight (56%; 95% CI 47-65), and TriageSieve (56%; 95% CI 46–65). SALT also had the lowest under-triage rate (33%; 95% CI 24–42) compared to JumpSTART (39%; 95% CI 30–48), CareFlight (39%; 95% CI 30–48), and TriageSieve (39%; 95% CI 30–48). SALT had the highest over-triage rate (6%; 95% CI 2–11) compared to JumpSTART (4%; 95% CI 1–8), CareFlight (5%; 95% CI 1–9), and TriageSieve (5%; 95% CI 1–9). However, the confidence intervals for both the accuracy and under-triage rates overlapped between all triage systems. For each triage system, the most common error was designating a patient as “minimal” that, according to the criterion standard, should have been triaged as “delayed.” Conclusion: We found that the 4 most popular mass casualty triage systems preformed similarly in an emergency department-based pediatric population. None of the systems were extremely accurate, and each demonstrated an unacceptable amount of under-triage. Better differentiating between patients categorized as “minimal” and “delayed” may improve the accuracy of mass casualty triage systems.

AB - Introduction: It was previously difficult to compare the accuracy of different mass casualty triage systems to one another. This pilot study is one of the first attempts to operationalize an expert panel’s criterion standard definitions of triage categories in a pediatric population in order to compare accuracy between different systems. Objective: To compare the accuracy of 4 different mass casualty triage systems (SALT, JumpSTART, Triage Sieve, and CareFlight) when used for children. Methods: We observed the emergency department triage of patients less than 18 years old presenting to the only pediatric specialty hospital/Level 1 trauma center in Milwaukee County, Wisconsin. A single, certified EMS provider observed each patient’s initial triage in the emergency department and recorded all findings that were necessary to categorize the patient using each of the 4 mass casualty triage systems being studied. Hospital medical records were then reviewed for each patient and assigned a criterion standard triage category based on the treatments received and final disposition. Descriptive statistics were used to compare accuracy, over-, and under-triage rates for each of the triage systems. Results: A total of 115 subjects were enrolled. Of those, 51% were male and 57% were transported by ambulance. When compared to the criterion standard definitions, SALT was found to have the highest accuracy rate (59%; 95% CI 50–68) compared to JumpSTART (57%; 95% CI 48–66), CareFlight (56%; 95% CI 47-65), and TriageSieve (56%; 95% CI 46–65). SALT also had the lowest under-triage rate (33%; 95% CI 24–42) compared to JumpSTART (39%; 95% CI 30–48), CareFlight (39%; 95% CI 30–48), and TriageSieve (39%; 95% CI 30–48). SALT had the highest over-triage rate (6%; 95% CI 2–11) compared to JumpSTART (4%; 95% CI 1–8), CareFlight (5%; 95% CI 1–9), and TriageSieve (5%; 95% CI 1–9). However, the confidence intervals for both the accuracy and under-triage rates overlapped between all triage systems. For each triage system, the most common error was designating a patient as “minimal” that, according to the criterion standard, should have been triaged as “delayed.” Conclusion: We found that the 4 most popular mass casualty triage systems preformed similarly in an emergency department-based pediatric population. None of the systems were extremely accurate, and each demonstrated an unacceptable amount of under-triage. Better differentiating between patients categorized as “minimal” and “delayed” may improve the accuracy of mass casualty triage systems.

KW - mass casualty triage; pediatric triage; disaster; emergency medical services; SALT; JumpSTART; Triage Sieve; CareFlight

UR - http://www.scopus.com/inward/record.url?scp=85055349461&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85055349461&partnerID=8YFLogxK

U2 - 10.1080/10903127.2018.1520946

DO - 10.1080/10903127.2018.1520946

M3 - Article

C2 - 30196737

AN - SCOPUS:85055349461

VL - 23

SP - 304

EP - 308

JO - Prehospital Emergency Care

JF - Prehospital Emergency Care

SN - 1090-3127

IS - 3

ER -