Using eye-gaze and visualization to augment memory a framework for improving context recognition and recall

Jason Orlosky, Takumi Toyama, Daniel Sonntag, Kiyoshi Kiyokawa

Research output: Chapter in Book/Report/Conference proceedingConference contribution

16 Scopus citations

Abstract

In our everyday lives, bits of important information are lost due to the fact that our brain fails to convert a large portion of short term memory into long term memory. In this paper, we propose a framework that uses an eyetracking interface to store pieces of forgotten information and present them back to the user later with an integrated head mounted display (HMD). This process occurs in three main steps, including context recognition, data storage, and augmented reality (AR) display. We demonstrate the system's ability to recall information with the example of a lost book page by detecting when the user reads the book again and intelligently presenting the last read position back to the user. Two short user evaluations show that the system can recall book pages within 40 milliseconds, and that the position where a user left off can be calculated with approximately 0.5 centimeter accuracy.

Original languageEnglish (US)
Title of host publicationDistributed, Ambient, and Pervasive Interactions - Second International Conference, DAPI 2014, Held as Part of HCI International 2014, Proceedings
PublisherSpringer Verlag
Pages282-291
Number of pages10
ISBN (Print)9783319077871
DOIs
StatePublished - 2014
Externally publishedYes
Event2nd International Conference on Distributed, Ambient and Pervasive Interactions, DAPI 2014 - Held as Part of 16th International Conference on Human-Computer Interaction, HCI International 2014 - Heraklion, Greece
Duration: Jun 22 2014Jun 27 2014

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume8530 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference2nd International Conference on Distributed, Ambient and Pervasive Interactions, DAPI 2014 - Held as Part of 16th International Conference on Human-Computer Interaction, HCI International 2014
Country/TerritoryGreece
CityHeraklion
Period6/22/146/27/14

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Fingerprint

Dive into the research topics of 'Using eye-gaze and visualization to augment memory a framework for improving context recognition and recall'. Together they form a unique fingerprint.

Cite this