Biosurveillance evaluation of SNOMED CT's terminology (BEST Trial)

Coverage of chief complaints

Peter L. Elkin, Steven H. Brown, E Andrew Balas, Zelalem Temesgen, Dietlind Wahner-Roedler, David Froehling, Mark Liebow, Brett Trusko, S. Trent Rosenbloom, Greg Poland

Research output: Chapter in Book/Report/Conference proceedingConference contribution

4 Citations (Scopus)

Abstract

The current United States Health Information Technology Standards Panel's interoperability specification for biosurveillance relies heavily on chief complaint data for tracking rates of cases compatible with a case definition for diseases of interest (e.g. Avian Flu). We looked at SNOMED CT to determine how well this large general medical ontology could represent data held in chief complaints. In this experiment we took 50,000 records (Comprehensive Examinations or Limited Examinations from primary care areas at the Mayo Clinic) from December 2003 through February 2005 (Influenza Season). Of these records, 36,097 had non-null Chief Complaints. We randomly selected 1,035 non-null Chief Complaints and two Board-certified internists (one Infectious Diseases specialist and one general internist) reviewed the mappings of the 1,035 chief complaints. Where the reviewers disagreed, a third internist adjudicated. SNOMED CT had a sensitivity of 98.7% for matching clinical terms found in the chief complaint section of the clinical record. The positive predictive value was 97.4%, the negative predictive value was 89.5%, the specificity was 81.0%, the positive likelihood ratio was 5.181 and the negative likelihood ratio was 0.016. We conclude that SNOMED CT and natural language parsing engines can well represent the clinical content of chief complaint fields. Future research should focus on how well the information contained in the chief complaints can be relied upon to provide the basis of a national strategy for biosurveillance. The authors recommend that efforts be made to examine the entire clinical record to determine the level of improvement in the accuracy of biosurveillance that can be achieved if we were to incorporate the entire clinical record into our biosurveillance strategy.

Original languageEnglish (US)
Title of host publicationStudies in Health Technology and Informatics
PublisherIOS Press
Pages797-802
Number of pages6
ISBN (Print)9781586038649
StatePublished - Jan 1 2008

Publication series

NameStudies in Health Technology and Informatics
Volume136
ISSN (Print)0926-9630
ISSN (Electronic)1879-8365

Fingerprint

Biosurveillance
Systematized Nomenclature of Medicine
Terminology
Interoperability
Information technology
Ontology
Health
Engines
Specifications
Medical Informatics
Influenza in Birds
Human Influenza
Communicable Diseases
Primary Health Care
Language
Experiments

Keywords

  • Concept representation
  • Epidemiological Research
  • Standards

ASJC Scopus subject areas

  • Biomedical Engineering
  • Health Informatics
  • Health Information Management

Cite this

Elkin, P. L., Brown, S. H., Balas, E. A., Temesgen, Z., Wahner-Roedler, D., Froehling, D., ... Poland, G. (2008). Biosurveillance evaluation of SNOMED CT's terminology (BEST Trial): Coverage of chief complaints. In Studies in Health Technology and Informatics (pp. 797-802). (Studies in Health Technology and Informatics; Vol. 136). IOS Press.

Biosurveillance evaluation of SNOMED CT's terminology (BEST Trial) : Coverage of chief complaints. / Elkin, Peter L.; Brown, Steven H.; Balas, E Andrew; Temesgen, Zelalem; Wahner-Roedler, Dietlind; Froehling, David; Liebow, Mark; Trusko, Brett; Rosenbloom, S. Trent; Poland, Greg.

Studies in Health Technology and Informatics. IOS Press, 2008. p. 797-802 (Studies in Health Technology and Informatics; Vol. 136).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Elkin, PL, Brown, SH, Balas, EA, Temesgen, Z, Wahner-Roedler, D, Froehling, D, Liebow, M, Trusko, B, Rosenbloom, ST & Poland, G 2008, Biosurveillance evaluation of SNOMED CT's terminology (BEST Trial): Coverage of chief complaints. in Studies in Health Technology and Informatics. Studies in Health Technology and Informatics, vol. 136, IOS Press, pp. 797-802.
Elkin PL, Brown SH, Balas EA, Temesgen Z, Wahner-Roedler D, Froehling D et al. Biosurveillance evaluation of SNOMED CT's terminology (BEST Trial): Coverage of chief complaints. In Studies in Health Technology and Informatics. IOS Press. 2008. p. 797-802. (Studies in Health Technology and Informatics).
Elkin, Peter L. ; Brown, Steven H. ; Balas, E Andrew ; Temesgen, Zelalem ; Wahner-Roedler, Dietlind ; Froehling, David ; Liebow, Mark ; Trusko, Brett ; Rosenbloom, S. Trent ; Poland, Greg. / Biosurveillance evaluation of SNOMED CT's terminology (BEST Trial) : Coverage of chief complaints. Studies in Health Technology and Informatics. IOS Press, 2008. pp. 797-802 (Studies in Health Technology and Informatics).
@inproceedings{d0519a91bb964a6bbfa52235ecfb4093,
title = "Biosurveillance evaluation of SNOMED CT's terminology (BEST Trial): Coverage of chief complaints",
abstract = "The current United States Health Information Technology Standards Panel's interoperability specification for biosurveillance relies heavily on chief complaint data for tracking rates of cases compatible with a case definition for diseases of interest (e.g. Avian Flu). We looked at SNOMED CT to determine how well this large general medical ontology could represent data held in chief complaints. In this experiment we took 50,000 records (Comprehensive Examinations or Limited Examinations from primary care areas at the Mayo Clinic) from December 2003 through February 2005 (Influenza Season). Of these records, 36,097 had non-null Chief Complaints. We randomly selected 1,035 non-null Chief Complaints and two Board-certified internists (one Infectious Diseases specialist and one general internist) reviewed the mappings of the 1,035 chief complaints. Where the reviewers disagreed, a third internist adjudicated. SNOMED CT had a sensitivity of 98.7{\%} for matching clinical terms found in the chief complaint section of the clinical record. The positive predictive value was 97.4{\%}, the negative predictive value was 89.5{\%}, the specificity was 81.0{\%}, the positive likelihood ratio was 5.181 and the negative likelihood ratio was 0.016. We conclude that SNOMED CT and natural language parsing engines can well represent the clinical content of chief complaint fields. Future research should focus on how well the information contained in the chief complaints can be relied upon to provide the basis of a national strategy for biosurveillance. The authors recommend that efforts be made to examine the entire clinical record to determine the level of improvement in the accuracy of biosurveillance that can be achieved if we were to incorporate the entire clinical record into our biosurveillance strategy.",
keywords = "Concept representation, Epidemiological Research, Standards",
author = "Elkin, {Peter L.} and Brown, {Steven H.} and Balas, {E Andrew} and Zelalem Temesgen and Dietlind Wahner-Roedler and David Froehling and Mark Liebow and Brett Trusko and Rosenbloom, {S. Trent} and Greg Poland",
year = "2008",
month = "1",
day = "1",
language = "English (US)",
isbn = "9781586038649",
series = "Studies in Health Technology and Informatics",
publisher = "IOS Press",
pages = "797--802",
booktitle = "Studies in Health Technology and Informatics",
address = "Netherlands",

}

TY - GEN

T1 - Biosurveillance evaluation of SNOMED CT's terminology (BEST Trial)

T2 - Coverage of chief complaints

AU - Elkin, Peter L.

AU - Brown, Steven H.

AU - Balas, E Andrew

AU - Temesgen, Zelalem

AU - Wahner-Roedler, Dietlind

AU - Froehling, David

AU - Liebow, Mark

AU - Trusko, Brett

AU - Rosenbloom, S. Trent

AU - Poland, Greg

PY - 2008/1/1

Y1 - 2008/1/1

N2 - The current United States Health Information Technology Standards Panel's interoperability specification for biosurveillance relies heavily on chief complaint data for tracking rates of cases compatible with a case definition for diseases of interest (e.g. Avian Flu). We looked at SNOMED CT to determine how well this large general medical ontology could represent data held in chief complaints. In this experiment we took 50,000 records (Comprehensive Examinations or Limited Examinations from primary care areas at the Mayo Clinic) from December 2003 through February 2005 (Influenza Season). Of these records, 36,097 had non-null Chief Complaints. We randomly selected 1,035 non-null Chief Complaints and two Board-certified internists (one Infectious Diseases specialist and one general internist) reviewed the mappings of the 1,035 chief complaints. Where the reviewers disagreed, a third internist adjudicated. SNOMED CT had a sensitivity of 98.7% for matching clinical terms found in the chief complaint section of the clinical record. The positive predictive value was 97.4%, the negative predictive value was 89.5%, the specificity was 81.0%, the positive likelihood ratio was 5.181 and the negative likelihood ratio was 0.016. We conclude that SNOMED CT and natural language parsing engines can well represent the clinical content of chief complaint fields. Future research should focus on how well the information contained in the chief complaints can be relied upon to provide the basis of a national strategy for biosurveillance. The authors recommend that efforts be made to examine the entire clinical record to determine the level of improvement in the accuracy of biosurveillance that can be achieved if we were to incorporate the entire clinical record into our biosurveillance strategy.

AB - The current United States Health Information Technology Standards Panel's interoperability specification for biosurveillance relies heavily on chief complaint data for tracking rates of cases compatible with a case definition for diseases of interest (e.g. Avian Flu). We looked at SNOMED CT to determine how well this large general medical ontology could represent data held in chief complaints. In this experiment we took 50,000 records (Comprehensive Examinations or Limited Examinations from primary care areas at the Mayo Clinic) from December 2003 through February 2005 (Influenza Season). Of these records, 36,097 had non-null Chief Complaints. We randomly selected 1,035 non-null Chief Complaints and two Board-certified internists (one Infectious Diseases specialist and one general internist) reviewed the mappings of the 1,035 chief complaints. Where the reviewers disagreed, a third internist adjudicated. SNOMED CT had a sensitivity of 98.7% for matching clinical terms found in the chief complaint section of the clinical record. The positive predictive value was 97.4%, the negative predictive value was 89.5%, the specificity was 81.0%, the positive likelihood ratio was 5.181 and the negative likelihood ratio was 0.016. We conclude that SNOMED CT and natural language parsing engines can well represent the clinical content of chief complaint fields. Future research should focus on how well the information contained in the chief complaints can be relied upon to provide the basis of a national strategy for biosurveillance. The authors recommend that efforts be made to examine the entire clinical record to determine the level of improvement in the accuracy of biosurveillance that can be achieved if we were to incorporate the entire clinical record into our biosurveillance strategy.

KW - Concept representation

KW - Epidemiological Research

KW - Standards

UR - http://www.scopus.com/inward/record.url?scp=44349134517&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=44349134517&partnerID=8YFLogxK

M3 - Conference contribution

SN - 9781586038649

T3 - Studies in Health Technology and Informatics

SP - 797

EP - 802

BT - Studies in Health Technology and Informatics

PB - IOS Press

ER -