Interobserver agreement for EUS in the evaluation and diagnosis of submucosal masses

Frank Gress, Colleen Schmitt, Thomas Savides, Douglas O. Faigel, Marc Catalano, Wahid Wassef, Leor Roubein, Nicholas Nickl, Donato Ciaccia, Manoop Bhutani, Brenda Hoffman, John Paul Affronti

Research output: Contribution to journalArticle

77 Citations (Scopus)

Abstract

Introduction: EUS is an accurate means of evaluating and diagnosing submucosal lesions of the GI tract. The aim of this study was to prospectively determine interobserver agreement for the EUS classification of submucosal masses among endosonographers with different levels of training and experience from multiple centers. Methods: Twenty patients with submucosal mass lesions diagnosed by upper endoscopy underwent EUS. Surgical findings were available for 16 patients. In 4 patients with obvious cystic/vascular structures (i.e., varices) no surgical specimen was necessary. A blinded observer developed a study videotape of critical endoscopic and EUS real-time imaging for each lesion. The videotape was distributed to 10 endosonographers, each with at least 1 year of experience, who independently reviewed the videotape and recorded their diagnosis based on EUS features. These endosonographers used previously agreed-upon standardized EUS diagnostic criteria for each category of lesion. A kappa (κ) statistic, used to evaluate agreement, was calculated for each lesion category for the 10 endosonographers as a group and individually. An overall kappa statistic was also calculated. Significance was analyzed with a two-tailed t test. Results: Agreement was excellent for cystic lesions (κ = 0.80) and extrinsic compressions (κ = 0.94), good for lipoma (κ = 0.65), fair for leiomyoma and vascular lesions (κ = 0.53 and 0.54, respectively), and poor for other submucosal lesions (κ = 0.34). Overall agreement among observers was good (κ = 0.63). Furthermore, a significant association was noted between total years of EUS experience and the number of correct answers (p = 0.01). Conclusions: Interobserver agreement is good for characterizing submucosal masses by EUS. However, it appears to be better for some lesions than others. The overall length of experience with EUS appears to play an important role in the accuracy of this modality in the evaluation of submucosal lesions.

Original languageEnglish (US)
Pages (from-to)71-76
Number of pages6
JournalGastrointestinal Endoscopy
Volume53
Issue number1
DOIs
StatePublished - Jan 1 2001

Fingerprint

Videotape Recording
Angiomyoma
Lipoma
Varicose Veins
Endoscopy
Blood Vessels
Gastrointestinal Tract

ASJC Scopus subject areas

  • Radiology Nuclear Medicine and imaging
  • Gastroenterology

Cite this

Gress, F., Schmitt, C., Savides, T., Faigel, D. O., Catalano, M., Wassef, W., ... Affronti, J. P. (2001). Interobserver agreement for EUS in the evaluation and diagnosis of submucosal masses. Gastrointestinal Endoscopy, 53(1), 71-76. https://doi.org/10.1067/mge.2001.111384

Interobserver agreement for EUS in the evaluation and diagnosis of submucosal masses. / Gress, Frank; Schmitt, Colleen; Savides, Thomas; Faigel, Douglas O.; Catalano, Marc; Wassef, Wahid; Roubein, Leor; Nickl, Nicholas; Ciaccia, Donato; Bhutani, Manoop; Hoffman, Brenda; Affronti, John Paul.

In: Gastrointestinal Endoscopy, Vol. 53, No. 1, 01.01.2001, p. 71-76.

Research output: Contribution to journalArticle

Gress, F, Schmitt, C, Savides, T, Faigel, DO, Catalano, M, Wassef, W, Roubein, L, Nickl, N, Ciaccia, D, Bhutani, M, Hoffman, B & Affronti, JP 2001, 'Interobserver agreement for EUS in the evaluation and diagnosis of submucosal masses', Gastrointestinal Endoscopy, vol. 53, no. 1, pp. 71-76. https://doi.org/10.1067/mge.2001.111384
Gress, Frank ; Schmitt, Colleen ; Savides, Thomas ; Faigel, Douglas O. ; Catalano, Marc ; Wassef, Wahid ; Roubein, Leor ; Nickl, Nicholas ; Ciaccia, Donato ; Bhutani, Manoop ; Hoffman, Brenda ; Affronti, John Paul. / Interobserver agreement for EUS in the evaluation and diagnosis of submucosal masses. In: Gastrointestinal Endoscopy. 2001 ; Vol. 53, No. 1. pp. 71-76.
@article{c02da5f1f53b40518f3680f8f1f1f880,
title = "Interobserver agreement for EUS in the evaluation and diagnosis of submucosal masses",
abstract = "Introduction: EUS is an accurate means of evaluating and diagnosing submucosal lesions of the GI tract. The aim of this study was to prospectively determine interobserver agreement for the EUS classification of submucosal masses among endosonographers with different levels of training and experience from multiple centers. Methods: Twenty patients with submucosal mass lesions diagnosed by upper endoscopy underwent EUS. Surgical findings were available for 16 patients. In 4 patients with obvious cystic/vascular structures (i.e., varices) no surgical specimen was necessary. A blinded observer developed a study videotape of critical endoscopic and EUS real-time imaging for each lesion. The videotape was distributed to 10 endosonographers, each with at least 1 year of experience, who independently reviewed the videotape and recorded their diagnosis based on EUS features. These endosonographers used previously agreed-upon standardized EUS diagnostic criteria for each category of lesion. A kappa (κ) statistic, used to evaluate agreement, was calculated for each lesion category for the 10 endosonographers as a group and individually. An overall kappa statistic was also calculated. Significance was analyzed with a two-tailed t test. Results: Agreement was excellent for cystic lesions (κ = 0.80) and extrinsic compressions (κ = 0.94), good for lipoma (κ = 0.65), fair for leiomyoma and vascular lesions (κ = 0.53 and 0.54, respectively), and poor for other submucosal lesions (κ = 0.34). Overall agreement among observers was good (κ = 0.63). Furthermore, a significant association was noted between total years of EUS experience and the number of correct answers (p = 0.01). Conclusions: Interobserver agreement is good for characterizing submucosal masses by EUS. However, it appears to be better for some lesions than others. The overall length of experience with EUS appears to play an important role in the accuracy of this modality in the evaluation of submucosal lesions.",
author = "Frank Gress and Colleen Schmitt and Thomas Savides and Faigel, {Douglas O.} and Marc Catalano and Wahid Wassef and Leor Roubein and Nicholas Nickl and Donato Ciaccia and Manoop Bhutani and Brenda Hoffman and Affronti, {John Paul}",
year = "2001",
month = "1",
day = "1",
doi = "10.1067/mge.2001.111384",
language = "English (US)",
volume = "53",
pages = "71--76",
journal = "Gastrointestinal Endoscopy",
issn = "0016-5107",
publisher = "Mosby Inc.",
number = "1",

}

TY - JOUR

T1 - Interobserver agreement for EUS in the evaluation and diagnosis of submucosal masses

AU - Gress, Frank

AU - Schmitt, Colleen

AU - Savides, Thomas

AU - Faigel, Douglas O.

AU - Catalano, Marc

AU - Wassef, Wahid

AU - Roubein, Leor

AU - Nickl, Nicholas

AU - Ciaccia, Donato

AU - Bhutani, Manoop

AU - Hoffman, Brenda

AU - Affronti, John Paul

PY - 2001/1/1

Y1 - 2001/1/1

N2 - Introduction: EUS is an accurate means of evaluating and diagnosing submucosal lesions of the GI tract. The aim of this study was to prospectively determine interobserver agreement for the EUS classification of submucosal masses among endosonographers with different levels of training and experience from multiple centers. Methods: Twenty patients with submucosal mass lesions diagnosed by upper endoscopy underwent EUS. Surgical findings were available for 16 patients. In 4 patients with obvious cystic/vascular structures (i.e., varices) no surgical specimen was necessary. A blinded observer developed a study videotape of critical endoscopic and EUS real-time imaging for each lesion. The videotape was distributed to 10 endosonographers, each with at least 1 year of experience, who independently reviewed the videotape and recorded their diagnosis based on EUS features. These endosonographers used previously agreed-upon standardized EUS diagnostic criteria for each category of lesion. A kappa (κ) statistic, used to evaluate agreement, was calculated for each lesion category for the 10 endosonographers as a group and individually. An overall kappa statistic was also calculated. Significance was analyzed with a two-tailed t test. Results: Agreement was excellent for cystic lesions (κ = 0.80) and extrinsic compressions (κ = 0.94), good for lipoma (κ = 0.65), fair for leiomyoma and vascular lesions (κ = 0.53 and 0.54, respectively), and poor for other submucosal lesions (κ = 0.34). Overall agreement among observers was good (κ = 0.63). Furthermore, a significant association was noted between total years of EUS experience and the number of correct answers (p = 0.01). Conclusions: Interobserver agreement is good for characterizing submucosal masses by EUS. However, it appears to be better for some lesions than others. The overall length of experience with EUS appears to play an important role in the accuracy of this modality in the evaluation of submucosal lesions.

AB - Introduction: EUS is an accurate means of evaluating and diagnosing submucosal lesions of the GI tract. The aim of this study was to prospectively determine interobserver agreement for the EUS classification of submucosal masses among endosonographers with different levels of training and experience from multiple centers. Methods: Twenty patients with submucosal mass lesions diagnosed by upper endoscopy underwent EUS. Surgical findings were available for 16 patients. In 4 patients with obvious cystic/vascular structures (i.e., varices) no surgical specimen was necessary. A blinded observer developed a study videotape of critical endoscopic and EUS real-time imaging for each lesion. The videotape was distributed to 10 endosonographers, each with at least 1 year of experience, who independently reviewed the videotape and recorded their diagnosis based on EUS features. These endosonographers used previously agreed-upon standardized EUS diagnostic criteria for each category of lesion. A kappa (κ) statistic, used to evaluate agreement, was calculated for each lesion category for the 10 endosonographers as a group and individually. An overall kappa statistic was also calculated. Significance was analyzed with a two-tailed t test. Results: Agreement was excellent for cystic lesions (κ = 0.80) and extrinsic compressions (κ = 0.94), good for lipoma (κ = 0.65), fair for leiomyoma and vascular lesions (κ = 0.53 and 0.54, respectively), and poor for other submucosal lesions (κ = 0.34). Overall agreement among observers was good (κ = 0.63). Furthermore, a significant association was noted between total years of EUS experience and the number of correct answers (p = 0.01). Conclusions: Interobserver agreement is good for characterizing submucosal masses by EUS. However, it appears to be better for some lesions than others. The overall length of experience with EUS appears to play an important role in the accuracy of this modality in the evaluation of submucosal lesions.

UR - http://www.scopus.com/inward/record.url?scp=0035139836&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0035139836&partnerID=8YFLogxK

U2 - 10.1067/mge.2001.111384

DO - 10.1067/mge.2001.111384

M3 - Article

C2 - 11154492

AN - SCOPUS:0035139836

VL - 53

SP - 71

EP - 76

JO - Gastrointestinal Endoscopy

JF - Gastrointestinal Endoscopy

SN - 0016-5107

IS - 1

ER -