Exploring Pupillometry as a Method to Evaluate Reading Comprehension in VR-based Educational Comics

Kenya Sakamoto, Shizuka Shirai, Jason Orlosky, Hiroyuki Nagataki, Noriko Takemura, Mehrasa Alizadeh, Mayumi Ueda

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Scopus citations

Abstract

Ascertaining the level of reading comprehension in a learner is often a challenging task. Although written tests and self-evaluations can provide feedback as to whether an individual understands a particular topic, they are not real time, do not necessarily provide a full picture of the reader's comprehension, and can be subjective.In this paper, we present initial results of a study to determine better ways to evaluate a user's comprehension and understanding of educational comic books using pupillometry. Our system recreates the reading experience of an immunology comic book in virtual reality (VR), allows users to rate their comprehension of a particular section, and records eye data during the learning task. Through experiments, we explore the potential of this interface to facilitate learning and examine pupil metrics that might be used to automatically classify comprehension and understanding at the category (topic) level. We also discuss numerous design considerations that should be taken into account when designing future interfaces for evaluation of learning or comprehension.

Original languageEnglish (US)
Title of host publicationProceedings - 2020 IEEE Conference on Virtual Reality and 3D User Interfaces, VRW 2020
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages422-426
Number of pages5
ISBN (Electronic)9781728165325
DOIs
StatePublished - Mar 2020
Externally publishedYes
Event2020 IEEE Conference on Virtual Reality and 3D User Interfaces, VRW 2020 - Atlanta, United States
Duration: Mar 22 2020Mar 26 2020

Publication series

NameProceedings - 2020 IEEE Conference on Virtual Reality and 3D User Interfaces, VRW 2020

Conference

Conference2020 IEEE Conference on Virtual Reality and 3D User Interfaces, VRW 2020
Country/TerritoryUnited States
CityAtlanta
Period3/22/203/26/20

Keywords

  • Virtual reality
  • comics
  • education
  • eye tracking

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Computer Science Applications
  • Human-Computer Interaction
  • Media Technology

Fingerprint

Dive into the research topics of 'Exploring Pupillometry as a Method to Evaluate Reading Comprehension in VR-based Educational Comics'. Together they form a unique fingerprint.

Cite this