Inter- and Intrarater Reliability Using Different Software Versions of E4D Compare in Dental Education

Research output: Contribution to journalArticle

7 Citations (Scopus)

Abstract

The problems associated with intra- and interexaminer reliability when assessing preclinical performance continue to hinder dental educators' ability to provide accurate and meaningful feedback to students. Many studies have been conducted to evaluate the validity of utilizing various technologies to assist educators in achieving that goal. The purpose of this study was to compare two different versions of E4D Compare software to determine if either could be expected to deliver consistent and reliable comparative results, independent of the individual utilizing the technology. Five faculty members obtained E4D digital images of students' attempts (sample model) at ideal gold crown preparations for tooth #30 performed on typodont teeth. These images were compared to an ideal (master model) preparation utilizing two versions of E4D Compare software. The percent correlations between and within these faculty members were recorded and averaged. The intraclass correlation coefficient was used to measure both inter- and intrarater agreement among the examiners. The study found that using the older version of E4D Compare did not result in acceptable intra- or interrater agreement among the examiners. However, the newer version of E4D Compare, when combined with the Nevo scanner, resulted in a remarkable degree of agreement both between and within the examiners. These results suggest that consistent and reliable results can be expected when utilizing this technology under the protocol described in this study.

Original languageEnglish (US)
Pages (from-to)711-718
Number of pages8
JournalJournal of Dental Education
Volume79
Issue number6
StatePublished - Jun 1 2015

Fingerprint

Dental Education
examiner
Software
Technology
Tooth
Tooth Preparation
Tooth Crown
educator
Students
education
gold
Gold
student
ability
performance
software

Keywords

  • assessment
  • CAD/CAM
  • dental education
  • grading
  • interrater reliability
  • intrarater reliability

ASJC Scopus subject areas

  • Medicine(all)

Cite this

@article{7fa9f7b8297b4566949a7ab139669f94,
title = "Inter- and Intrarater Reliability Using Different Software Versions of E4D Compare in Dental Education",
abstract = "The problems associated with intra- and interexaminer reliability when assessing preclinical performance continue to hinder dental educators' ability to provide accurate and meaningful feedback to students. Many studies have been conducted to evaluate the validity of utilizing various technologies to assist educators in achieving that goal. The purpose of this study was to compare two different versions of E4D Compare software to determine if either could be expected to deliver consistent and reliable comparative results, independent of the individual utilizing the technology. Five faculty members obtained E4D digital images of students' attempts (sample model) at ideal gold crown preparations for tooth #30 performed on typodont teeth. These images were compared to an ideal (master model) preparation utilizing two versions of E4D Compare software. The percent correlations between and within these faculty members were recorded and averaged. The intraclass correlation coefficient was used to measure both inter- and intrarater agreement among the examiners. The study found that using the older version of E4D Compare did not result in acceptable intra- or interrater agreement among the examiners. However, the newer version of E4D Compare, when combined with the Nevo scanner, resulted in a remarkable degree of agreement both between and within the examiners. These results suggest that consistent and reliable results can be expected when utilizing this technology under the protocol described in this study.",
keywords = "assessment, CAD/CAM, dental education, grading, interrater reliability, intrarater reliability",
author = "Callan, {Richard S} and Cooper, {Jeril Ransom} and Young, {Nancy Beth Morgan} and Mollica, {Anthony Guy} and Furness, {Alan R} and Looney, {Stephen Warwick}",
year = "2015",
month = "6",
day = "1",
language = "English (US)",
volume = "79",
pages = "711--718",
journal = "Journal of Dental Education",
issn = "0022-0337",
publisher = "American Dental Education Association",
number = "6",

}

TY - JOUR

T1 - Inter- and Intrarater Reliability Using Different Software Versions of E4D Compare in Dental Education

AU - Callan, Richard S

AU - Cooper, Jeril Ransom

AU - Young, Nancy Beth Morgan

AU - Mollica, Anthony Guy

AU - Furness, Alan R

AU - Looney, Stephen Warwick

PY - 2015/6/1

Y1 - 2015/6/1

N2 - The problems associated with intra- and interexaminer reliability when assessing preclinical performance continue to hinder dental educators' ability to provide accurate and meaningful feedback to students. Many studies have been conducted to evaluate the validity of utilizing various technologies to assist educators in achieving that goal. The purpose of this study was to compare two different versions of E4D Compare software to determine if either could be expected to deliver consistent and reliable comparative results, independent of the individual utilizing the technology. Five faculty members obtained E4D digital images of students' attempts (sample model) at ideal gold crown preparations for tooth #30 performed on typodont teeth. These images were compared to an ideal (master model) preparation utilizing two versions of E4D Compare software. The percent correlations between and within these faculty members were recorded and averaged. The intraclass correlation coefficient was used to measure both inter- and intrarater agreement among the examiners. The study found that using the older version of E4D Compare did not result in acceptable intra- or interrater agreement among the examiners. However, the newer version of E4D Compare, when combined with the Nevo scanner, resulted in a remarkable degree of agreement both between and within the examiners. These results suggest that consistent and reliable results can be expected when utilizing this technology under the protocol described in this study.

AB - The problems associated with intra- and interexaminer reliability when assessing preclinical performance continue to hinder dental educators' ability to provide accurate and meaningful feedback to students. Many studies have been conducted to evaluate the validity of utilizing various technologies to assist educators in achieving that goal. The purpose of this study was to compare two different versions of E4D Compare software to determine if either could be expected to deliver consistent and reliable comparative results, independent of the individual utilizing the technology. Five faculty members obtained E4D digital images of students' attempts (sample model) at ideal gold crown preparations for tooth #30 performed on typodont teeth. These images were compared to an ideal (master model) preparation utilizing two versions of E4D Compare software. The percent correlations between and within these faculty members were recorded and averaged. The intraclass correlation coefficient was used to measure both inter- and intrarater agreement among the examiners. The study found that using the older version of E4D Compare did not result in acceptable intra- or interrater agreement among the examiners. However, the newer version of E4D Compare, when combined with the Nevo scanner, resulted in a remarkable degree of agreement both between and within the examiners. These results suggest that consistent and reliable results can be expected when utilizing this technology under the protocol described in this study.

KW - assessment

KW - CAD/CAM

KW - dental education

KW - grading

KW - interrater reliability

KW - intrarater reliability

UR - http://www.scopus.com/inward/record.url?scp=84938881337&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84938881337&partnerID=8YFLogxK

M3 - Article

VL - 79

SP - 711

EP - 718

JO - Journal of Dental Education

JF - Journal of Dental Education

SN - 0022-0337

IS - 6

ER -