Interobserver agreement among endosonographers for staging of pancreatic cancer by endoscopic ultrasound

F. Gress, D. Ciaccia, C. Schmitt, M. Catalano, J. Affronti, K. Binmoeller, P. Stevens, T. Savides, M. Bhutani, L. Roubein, N. Nickl, D. Faigel, J. Birk, C. Lightdale

Research output: Contribution to journalArticle

2 Citations (Scopus)

Abstract

Endoscopic Ultrasound (EUS) has been reported to be an accurate modality for staging pancreatic cancer (CA). However, there is limited data regarding the effects of interobserver variation on the overall accuracy and clinical utility of EUS for staging pancreatic CA. AIM OF STUDY: To determine interobserver reliability for EUS staging of pancreatic tumors. METHODS: Twelve patients with previously diagnosed pancreatic ductal adenocarcinoma underwent staging with EUS. Surgical correlation was obtained in all patients. A blinded observer developed a study videotape of real-time EUS for each case. The videotape was then distributed to ten endosonographers with at least one year of previous experience who independently reviewed the tape and recorded their interpretation of the EUS tumor stage for each case based upon previously reported EUS criteria for staging pancreatic CA. A multiple observer kappa (k) statistic was calculated for each staging category (T, N, and T+N), vascular invasion and overall k. Kappa accounts for agreement due to chance alone and standardized ranges are available. The Light (G) statistic was utilized to allow for the presence of the gold standard. Accuracy was assessed using a simple matrix format. RESULTS: Overall agreement was highly statistically significant for T stage: k=0.22 ( G=5.52, Z=2.35, p<0.01).Observers were more likely to agree with T3 stage tumors (94%) than T2 (40%) or T1 (33%) lesions. The Overall agreement for N stage was highly statistically significant: k=0.23 (G=4.44, Z=4.90, p<0.01). Agreement for absence of nodal involvement (63%) was better than that for the presence of nodal involvement (56%). For overall staging (T+N): k=0.18 (G=9.19, Z=4.98, p<,01). For vascular invasion: k=0.26 (G=3.90, z=3.33, p<.01). The agreement for T and N stage improved as stage increased (p<0.01) and in the presence of vascular invasion (p<0.01). CONCLUSION: Interobserver agreement is good for staging pancreatic tumors by EUS. However, it appears to be better for some tumor stages than others. Experience may play a role in the successful use of this modality to evaluate pancreatic tumors.

Original languageEnglish (US)
JournalGastrointestinal Endoscopy
Volume45
Issue number4
DOIs
StatePublished - Jan 1 1997

Fingerprint

Pancreatic Neoplasms
Blood Vessels
Videotape Recording
Neoplasm Staging
Neoplasms
Observer Variation
Adenocarcinoma
Light

ASJC Scopus subject areas

  • Radiology Nuclear Medicine and imaging
  • Gastroenterology

Cite this

Gress, F., Ciaccia, D., Schmitt, C., Catalano, M., Affronti, J., Binmoeller, K., ... Lightdale, C. (1997). Interobserver agreement among endosonographers for staging of pancreatic cancer by endoscopic ultrasound. Gastrointestinal Endoscopy, 45(4). https://doi.org/10.1016/S0016-5107(97)80596-2

Interobserver agreement among endosonographers for staging of pancreatic cancer by endoscopic ultrasound. / Gress, F.; Ciaccia, D.; Schmitt, C.; Catalano, M.; Affronti, J.; Binmoeller, K.; Stevens, P.; Savides, T.; Bhutani, M.; Roubein, L.; Nickl, N.; Faigel, D.; Birk, J.; Lightdale, C.

In: Gastrointestinal Endoscopy, Vol. 45, No. 4, 01.01.1997.

Research output: Contribution to journalArticle

Gress, F, Ciaccia, D, Schmitt, C, Catalano, M, Affronti, J, Binmoeller, K, Stevens, P, Savides, T, Bhutani, M, Roubein, L, Nickl, N, Faigel, D, Birk, J & Lightdale, C 1997, 'Interobserver agreement among endosonographers for staging of pancreatic cancer by endoscopic ultrasound', Gastrointestinal Endoscopy, vol. 45, no. 4. https://doi.org/10.1016/S0016-5107(97)80596-2
Gress, F. ; Ciaccia, D. ; Schmitt, C. ; Catalano, M. ; Affronti, J. ; Binmoeller, K. ; Stevens, P. ; Savides, T. ; Bhutani, M. ; Roubein, L. ; Nickl, N. ; Faigel, D. ; Birk, J. ; Lightdale, C. / Interobserver agreement among endosonographers for staging of pancreatic cancer by endoscopic ultrasound. In: Gastrointestinal Endoscopy. 1997 ; Vol. 45, No. 4.
@article{eaa54cc069044c78b004f3d95a5abef3,
title = "Interobserver agreement among endosonographers for staging of pancreatic cancer by endoscopic ultrasound",
abstract = "Endoscopic Ultrasound (EUS) has been reported to be an accurate modality for staging pancreatic cancer (CA). However, there is limited data regarding the effects of interobserver variation on the overall accuracy and clinical utility of EUS for staging pancreatic CA. AIM OF STUDY: To determine interobserver reliability for EUS staging of pancreatic tumors. METHODS: Twelve patients with previously diagnosed pancreatic ductal adenocarcinoma underwent staging with EUS. Surgical correlation was obtained in all patients. A blinded observer developed a study videotape of real-time EUS for each case. The videotape was then distributed to ten endosonographers with at least one year of previous experience who independently reviewed the tape and recorded their interpretation of the EUS tumor stage for each case based upon previously reported EUS criteria for staging pancreatic CA. A multiple observer kappa (k) statistic was calculated for each staging category (T, N, and T+N), vascular invasion and overall k. Kappa accounts for agreement due to chance alone and standardized ranges are available. The Light (G) statistic was utilized to allow for the presence of the gold standard. Accuracy was assessed using a simple matrix format. RESULTS: Overall agreement was highly statistically significant for T stage: k=0.22 ( G=5.52, Z=2.35, p<0.01).Observers were more likely to agree with T3 stage tumors (94{\%}) than T2 (40{\%}) or T1 (33{\%}) lesions. The Overall agreement for N stage was highly statistically significant: k=0.23 (G=4.44, Z=4.90, p<0.01). Agreement for absence of nodal involvement (63{\%}) was better than that for the presence of nodal involvement (56{\%}). For overall staging (T+N): k=0.18 (G=9.19, Z=4.98, p<,01). For vascular invasion: k=0.26 (G=3.90, z=3.33, p<.01). The agreement for T and N stage improved as stage increased (p<0.01) and in the presence of vascular invasion (p<0.01). CONCLUSION: Interobserver agreement is good for staging pancreatic tumors by EUS. However, it appears to be better for some tumor stages than others. Experience may play a role in the successful use of this modality to evaluate pancreatic tumors.",
author = "F. Gress and D. Ciaccia and C. Schmitt and M. Catalano and J. Affronti and K. Binmoeller and P. Stevens and T. Savides and M. Bhutani and L. Roubein and N. Nickl and D. Faigel and J. Birk and C. Lightdale",
year = "1997",
month = "1",
day = "1",
doi = "10.1016/S0016-5107(97)80596-2",
language = "English (US)",
volume = "45",
journal = "Gastrointestinal Endoscopy",
issn = "0016-5107",
publisher = "Mosby Inc.",
number = "4",

}

TY - JOUR

T1 - Interobserver agreement among endosonographers for staging of pancreatic cancer by endoscopic ultrasound

AU - Gress, F.

AU - Ciaccia, D.

AU - Schmitt, C.

AU - Catalano, M.

AU - Affronti, J.

AU - Binmoeller, K.

AU - Stevens, P.

AU - Savides, T.

AU - Bhutani, M.

AU - Roubein, L.

AU - Nickl, N.

AU - Faigel, D.

AU - Birk, J.

AU - Lightdale, C.

PY - 1997/1/1

Y1 - 1997/1/1

N2 - Endoscopic Ultrasound (EUS) has been reported to be an accurate modality for staging pancreatic cancer (CA). However, there is limited data regarding the effects of interobserver variation on the overall accuracy and clinical utility of EUS for staging pancreatic CA. AIM OF STUDY: To determine interobserver reliability for EUS staging of pancreatic tumors. METHODS: Twelve patients with previously diagnosed pancreatic ductal adenocarcinoma underwent staging with EUS. Surgical correlation was obtained in all patients. A blinded observer developed a study videotape of real-time EUS for each case. The videotape was then distributed to ten endosonographers with at least one year of previous experience who independently reviewed the tape and recorded their interpretation of the EUS tumor stage for each case based upon previously reported EUS criteria for staging pancreatic CA. A multiple observer kappa (k) statistic was calculated for each staging category (T, N, and T+N), vascular invasion and overall k. Kappa accounts for agreement due to chance alone and standardized ranges are available. The Light (G) statistic was utilized to allow for the presence of the gold standard. Accuracy was assessed using a simple matrix format. RESULTS: Overall agreement was highly statistically significant for T stage: k=0.22 ( G=5.52, Z=2.35, p<0.01).Observers were more likely to agree with T3 stage tumors (94%) than T2 (40%) or T1 (33%) lesions. The Overall agreement for N stage was highly statistically significant: k=0.23 (G=4.44, Z=4.90, p<0.01). Agreement for absence of nodal involvement (63%) was better than that for the presence of nodal involvement (56%). For overall staging (T+N): k=0.18 (G=9.19, Z=4.98, p<,01). For vascular invasion: k=0.26 (G=3.90, z=3.33, p<.01). The agreement for T and N stage improved as stage increased (p<0.01) and in the presence of vascular invasion (p<0.01). CONCLUSION: Interobserver agreement is good for staging pancreatic tumors by EUS. However, it appears to be better for some tumor stages than others. Experience may play a role in the successful use of this modality to evaluate pancreatic tumors.

AB - Endoscopic Ultrasound (EUS) has been reported to be an accurate modality for staging pancreatic cancer (CA). However, there is limited data regarding the effects of interobserver variation on the overall accuracy and clinical utility of EUS for staging pancreatic CA. AIM OF STUDY: To determine interobserver reliability for EUS staging of pancreatic tumors. METHODS: Twelve patients with previously diagnosed pancreatic ductal adenocarcinoma underwent staging with EUS. Surgical correlation was obtained in all patients. A blinded observer developed a study videotape of real-time EUS for each case. The videotape was then distributed to ten endosonographers with at least one year of previous experience who independently reviewed the tape and recorded their interpretation of the EUS tumor stage for each case based upon previously reported EUS criteria for staging pancreatic CA. A multiple observer kappa (k) statistic was calculated for each staging category (T, N, and T+N), vascular invasion and overall k. Kappa accounts for agreement due to chance alone and standardized ranges are available. The Light (G) statistic was utilized to allow for the presence of the gold standard. Accuracy was assessed using a simple matrix format. RESULTS: Overall agreement was highly statistically significant for T stage: k=0.22 ( G=5.52, Z=2.35, p<0.01).Observers were more likely to agree with T3 stage tumors (94%) than T2 (40%) or T1 (33%) lesions. The Overall agreement for N stage was highly statistically significant: k=0.23 (G=4.44, Z=4.90, p<0.01). Agreement for absence of nodal involvement (63%) was better than that for the presence of nodal involvement (56%). For overall staging (T+N): k=0.18 (G=9.19, Z=4.98, p<,01). For vascular invasion: k=0.26 (G=3.90, z=3.33, p<.01). The agreement for T and N stage improved as stage increased (p<0.01) and in the presence of vascular invasion (p<0.01). CONCLUSION: Interobserver agreement is good for staging pancreatic tumors by EUS. However, it appears to be better for some tumor stages than others. Experience may play a role in the successful use of this modality to evaluate pancreatic tumors.

UR - http://www.scopus.com/inward/record.url?scp=4243797045&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=4243797045&partnerID=8YFLogxK

U2 - 10.1016/S0016-5107(97)80596-2

DO - 10.1016/S0016-5107(97)80596-2

M3 - Article

AN - SCOPUS:4243797045

VL - 45

JO - Gastrointestinal Endoscopy

JF - Gastrointestinal Endoscopy

SN - 0016-5107

IS - 4

ER -