Semantic labeling and object registration for augmented reality language learning

Brandon Huynh, Jason Orlosky, Tobias Hollerer

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We propose an Augmented Reality vocabulary learning interface in which objects in a user's environment are automatically recognized and labeled in a foreign language. Using AR for language learning in this manner is still impractical for a number of reasons. Scalable object recognition and consistent labeling of objects is still a significant challenge, and interaction with arbitrary physical objects in AR scenes has consequently not been well explored. To help address these challenges, we present a system that utilizes real-time object recognition to perform semantic labeling and object registration in Augmented Reality. We discuss its implementation, our motivations in designing it, and how it can be applied to AR language learning applications.

Original languageEnglish (US)
Title of host publication26th IEEE Conference on Virtual Reality and 3D User Interfaces, VR 2019 - Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages986-987
Number of pages2
ISBN (Electronic)9781728113777
DOIs
StatePublished - Mar 2019
Externally publishedYes
Event26th IEEE Conference on Virtual Reality and 3D User Interfaces, VR 2019 - Osaka, Japan
Duration: Mar 23 2019Mar 27 2019

Publication series

Name26th IEEE Conference on Virtual Reality and 3D User Interfaces, VR 2019 - Proceedings

Conference

Conference26th IEEE Conference on Virtual Reality and 3D User Interfaces, VR 2019
Country/TerritoryJapan
CityOsaka
Period3/23/193/27/19

Keywords

  • Centered computing
  • Human
  • Mixed and augmented reality
  • Semi
  • Supervised learning
  • Theory and algorithms for application domains

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Media Technology

Fingerprint

Dive into the research topics of 'Semantic labeling and object registration for augmented reality language learning'. Together they form a unique fingerprint.

Cite this