Interobserver agreement of endoscopic ultrasound (EUS) for evaluating submucosal masses

F. Gress, C. Schmitt, T. Savides, L. Roubein, N. Nickl, M. Bhutani, B. Hoffman, John Paul Affronti

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

INTRODUCTION: EUS has been reported to be a very accurate means of evaluating and diagnosing submucosal lesions of the GI tract. AIMS OF STUDY: To determine interobserver reliability for classification of submucosal masses by EUS. METHODS: Twenty patients with submucosal mass lesions diagnosed at upper endoscopy underwent EUS evaluation Surgical findings or FNA cytology were available for 16 patients In 4 patients with obvious cystic/vascular structures (ie, varices) no surgical correlation was necessary. A blinded observer developed a study videotape including critical endoscopic and EUS data for each lesion. The videotape was then distributed to six endosonographers with at least one year of previous experience who then independently reviewed the tape and recorded their diagnosis based upon EUS features These endosonographers had previously agreed upon standardized EUS diagnostic criteria for each category of lesion (extrinsic compression, leiomyoma, vascular, lipoma, cyst, other submucosal lesion ie; carcinoid). The endosonographer independently categorized the lesions. A multiple observer kappa (k) statistic for agreement was calculated for each lesion category and an overall k calculated. Kappa accounts for agreement due to chance alone and standardized ranges are available. RESULTS; We found agreement was excellent for cystic lesions (k=0.80) and extrinsic compressions (k=0.94), good for lipoma (k=0.65), fair for leiomyoma and vascular lesions (k=0.53 & 0.54 respectively) and poor for other submucosal lesions (k=0.34). Overall agreement among observers was good (k=0.63) and highly statistically significant (z=21). CONCLUSION: Interobserver agreement is good for characterizing submucosal masses by EUS. However, it appears to be better for some lesion types than others. Experience may play an important role in the successful use of this modality to evaluate submucosal lesions.

Original languageEnglish (US)
Number of pages1
JournalGastrointestinal Endoscopy
Volume43
Issue number4
DOIs
StatePublished - Jan 1 1996

Fingerprint

Angiomyoma
Videotape Recording
Lipoma
Carcinoid Tumor
Varicose Veins
Endoscopy
Blood Vessels
Cell Biology
Gastrointestinal Tract
Cysts
Ultrasonography

ASJC Scopus subject areas

  • Radiology Nuclear Medicine and imaging
  • Gastroenterology

Cite this

Gress, F., Schmitt, C., Savides, T., Roubein, L., Nickl, N., Bhutani, M., ... Affronti, J. P. (1996). Interobserver agreement of endoscopic ultrasound (EUS) for evaluating submucosal masses. Gastrointestinal Endoscopy, 43(4). https://doi.org/10.1016/S0016-5107(96)80521-9

Interobserver agreement of endoscopic ultrasound (EUS) for evaluating submucosal masses. / Gress, F.; Schmitt, C.; Savides, T.; Roubein, L.; Nickl, N.; Bhutani, M.; Hoffman, B.; Affronti, John Paul.

In: Gastrointestinal Endoscopy, Vol. 43, No. 4, 01.01.1996.

Research output: Contribution to journalArticle

Gress, F, Schmitt, C, Savides, T, Roubein, L, Nickl, N, Bhutani, M, Hoffman, B & Affronti, JP 1996, 'Interobserver agreement of endoscopic ultrasound (EUS) for evaluating submucosal masses', Gastrointestinal Endoscopy, vol. 43, no. 4. https://doi.org/10.1016/S0016-5107(96)80521-9
Gress, F. ; Schmitt, C. ; Savides, T. ; Roubein, L. ; Nickl, N. ; Bhutani, M. ; Hoffman, B. ; Affronti, John Paul. / Interobserver agreement of endoscopic ultrasound (EUS) for evaluating submucosal masses. In: Gastrointestinal Endoscopy. 1996 ; Vol. 43, No. 4.
@article{13059e6d4ff548e793caf4b777c9a7a5,
title = "Interobserver agreement of endoscopic ultrasound (EUS) for evaluating submucosal masses",
abstract = "INTRODUCTION: EUS has been reported to be a very accurate means of evaluating and diagnosing submucosal lesions of the GI tract. AIMS OF STUDY: To determine interobserver reliability for classification of submucosal masses by EUS. METHODS: Twenty patients with submucosal mass lesions diagnosed at upper endoscopy underwent EUS evaluation Surgical findings or FNA cytology were available for 16 patients In 4 patients with obvious cystic/vascular structures (ie, varices) no surgical correlation was necessary. A blinded observer developed a study videotape including critical endoscopic and EUS data for each lesion. The videotape was then distributed to six endosonographers with at least one year of previous experience who then independently reviewed the tape and recorded their diagnosis based upon EUS features These endosonographers had previously agreed upon standardized EUS diagnostic criteria for each category of lesion (extrinsic compression, leiomyoma, vascular, lipoma, cyst, other submucosal lesion ie; carcinoid). The endosonographer independently categorized the lesions. A multiple observer kappa (k) statistic for agreement was calculated for each lesion category and an overall k calculated. Kappa accounts for agreement due to chance alone and standardized ranges are available. RESULTS; We found agreement was excellent for cystic lesions (k=0.80) and extrinsic compressions (k=0.94), good for lipoma (k=0.65), fair for leiomyoma and vascular lesions (k=0.53 & 0.54 respectively) and poor for other submucosal lesions (k=0.34). Overall agreement among observers was good (k=0.63) and highly statistically significant (z=21). CONCLUSION: Interobserver agreement is good for characterizing submucosal masses by EUS. However, it appears to be better for some lesion types than others. Experience may play an important role in the successful use of this modality to evaluate submucosal lesions.",
author = "F. Gress and C. Schmitt and T. Savides and L. Roubein and N. Nickl and M. Bhutani and B. Hoffman and Affronti, {John Paul}",
year = "1996",
month = "1",
day = "1",
doi = "10.1016/S0016-5107(96)80521-9",
language = "English (US)",
volume = "43",
journal = "Gastrointestinal Endoscopy",
issn = "0016-5107",
publisher = "Mosby Inc.",
number = "4",

}

TY - JOUR

T1 - Interobserver agreement of endoscopic ultrasound (EUS) for evaluating submucosal masses

AU - Gress, F.

AU - Schmitt, C.

AU - Savides, T.

AU - Roubein, L.

AU - Nickl, N.

AU - Bhutani, M.

AU - Hoffman, B.

AU - Affronti, John Paul

PY - 1996/1/1

Y1 - 1996/1/1

N2 - INTRODUCTION: EUS has been reported to be a very accurate means of evaluating and diagnosing submucosal lesions of the GI tract. AIMS OF STUDY: To determine interobserver reliability for classification of submucosal masses by EUS. METHODS: Twenty patients with submucosal mass lesions diagnosed at upper endoscopy underwent EUS evaluation Surgical findings or FNA cytology were available for 16 patients In 4 patients with obvious cystic/vascular structures (ie, varices) no surgical correlation was necessary. A blinded observer developed a study videotape including critical endoscopic and EUS data for each lesion. The videotape was then distributed to six endosonographers with at least one year of previous experience who then independently reviewed the tape and recorded their diagnosis based upon EUS features These endosonographers had previously agreed upon standardized EUS diagnostic criteria for each category of lesion (extrinsic compression, leiomyoma, vascular, lipoma, cyst, other submucosal lesion ie; carcinoid). The endosonographer independently categorized the lesions. A multiple observer kappa (k) statistic for agreement was calculated for each lesion category and an overall k calculated. Kappa accounts for agreement due to chance alone and standardized ranges are available. RESULTS; We found agreement was excellent for cystic lesions (k=0.80) and extrinsic compressions (k=0.94), good for lipoma (k=0.65), fair for leiomyoma and vascular lesions (k=0.53 & 0.54 respectively) and poor for other submucosal lesions (k=0.34). Overall agreement among observers was good (k=0.63) and highly statistically significant (z=21). CONCLUSION: Interobserver agreement is good for characterizing submucosal masses by EUS. However, it appears to be better for some lesion types than others. Experience may play an important role in the successful use of this modality to evaluate submucosal lesions.

AB - INTRODUCTION: EUS has been reported to be a very accurate means of evaluating and diagnosing submucosal lesions of the GI tract. AIMS OF STUDY: To determine interobserver reliability for classification of submucosal masses by EUS. METHODS: Twenty patients with submucosal mass lesions diagnosed at upper endoscopy underwent EUS evaluation Surgical findings or FNA cytology were available for 16 patients In 4 patients with obvious cystic/vascular structures (ie, varices) no surgical correlation was necessary. A blinded observer developed a study videotape including critical endoscopic and EUS data for each lesion. The videotape was then distributed to six endosonographers with at least one year of previous experience who then independently reviewed the tape and recorded their diagnosis based upon EUS features These endosonographers had previously agreed upon standardized EUS diagnostic criteria for each category of lesion (extrinsic compression, leiomyoma, vascular, lipoma, cyst, other submucosal lesion ie; carcinoid). The endosonographer independently categorized the lesions. A multiple observer kappa (k) statistic for agreement was calculated for each lesion category and an overall k calculated. Kappa accounts for agreement due to chance alone and standardized ranges are available. RESULTS; We found agreement was excellent for cystic lesions (k=0.80) and extrinsic compressions (k=0.94), good for lipoma (k=0.65), fair for leiomyoma and vascular lesions (k=0.53 & 0.54 respectively) and poor for other submucosal lesions (k=0.34). Overall agreement among observers was good (k=0.63) and highly statistically significant (z=21). CONCLUSION: Interobserver agreement is good for characterizing submucosal masses by EUS. However, it appears to be better for some lesion types than others. Experience may play an important role in the successful use of this modality to evaluate submucosal lesions.

UR - http://www.scopus.com/inward/record.url?scp=10544247088&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=10544247088&partnerID=8YFLogxK

U2 - 10.1016/S0016-5107(96)80521-9

DO - 10.1016/S0016-5107(96)80521-9

M3 - Article

AN - SCOPUS:10544247088

VL - 43

JO - Gastrointestinal Endoscopy

JF - Gastrointestinal Endoscopy

SN - 0016-5107

IS - 4

ER -