TY - JOUR
T1 - A Comparison of Computer-Based Testing and Pencil-and-Paper Testing for Students with a Read-Aloud Accommodation
AU - Flowers, Claudia
AU - Kim, Do Hong
AU - Lewis, Preston
AU - Davis, Violeta Carmen
PY - 2011/3/1
Y1 - 2011/3/1
N2 - This study examined the academic performance and preference of students with disabilities for two types of test administration conditions, computer-based testing (CBT) and pencil-and-paper testing (PPT). Data from a large-scale assessment program were used to examine differences between CBT and PPT academic performance for third to eleventh grade students with a read-aloud accommodation in reading, mathematics, and science. Since random assignment was not possible, propensity score analyses were used to establish equivalent groups and to test for differences in performance. Students in the PPT condition with an adult reader had higher mean scores in almost all academic content areas than those with the CBT read-aloud condition, with effect sizes ranging from extremely small (d =.02) to moderate (d =.69). Differential item functioning (DIF) analyses suggested that most items had negligible DIF and did not favor either the CBT or the PPT conditions. Students and staff reported that students preferred the CBT to the PPT, and students believed they performed better using the computer. Additional research that controls extraneous factors such as instructional time and familiarity with testing environment is recommended to better evaluate the relationship between testing modes and academic performance.
AB - This study examined the academic performance and preference of students with disabilities for two types of test administration conditions, computer-based testing (CBT) and pencil-and-paper testing (PPT). Data from a large-scale assessment program were used to examine differences between CBT and PPT academic performance for third to eleventh grade students with a read-aloud accommodation in reading, mathematics, and science. Since random assignment was not possible, propensity score analyses were used to establish equivalent groups and to test for differences in performance. Students in the PPT condition with an adult reader had higher mean scores in almost all academic content areas than those with the CBT read-aloud condition, with effect sizes ranging from extremely small (d =.02) to moderate (d =.69). Differential item functioning (DIF) analyses suggested that most items had negligible DIF and did not favor either the CBT or the PPT conditions. Students and staff reported that students preferred the CBT to the PPT, and students believed they performed better using the computer. Additional research that controls extraneous factors such as instructional time and familiarity with testing environment is recommended to better evaluate the relationship between testing modes and academic performance.
UR - http://www.scopus.com/inward/record.url?scp=84877103879&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84877103879&partnerID=8YFLogxK
U2 - 10.1177/016264341102600102
DO - 10.1177/016264341102600102
M3 - Article
AN - SCOPUS:84877103879
SN - 0162-6434
VL - 26
SP - 1
EP - 12
JO - Journal of Special Education Technology
JF - Journal of Special Education Technology
IS - 1
ER -