Skip to main content
Presentation
An Immersive Telepresence System using RGB-D Sensors and Head-mounted Display
Proceedings of the IEEE International Symposium on Multimedia
  • Xinzhong Lu, University of Dayton
  • Ju Shen, University of Dayton
  • Saverio Perugini, University of Dayton
  • Jianjun Yang, University of North Georgia
Document Type
Conference Paper
Publication Date
12-1-2015
Abstract
We present a tele-immersive system that enables people to interact with each other in a virtual world using body gestures in addition to verbal communication. Beyond the obvious applications, including general online conversations and gaming, we hypothesize that our proposed system would be particularly beneficial to education by offering rich visual contents and interactivity. One distinct feature is the integration of egocentric pose recognition that allows participants to use their gestures to demonstrate and manipulate virtual objects simultaneously. This functionality enables the instructor to effectively and efficiently explain and illustrate complex concepts or sophisticated problems in an intuitive manner. The highly interactive and flexible environment can capture and sustain more student attention than the traditional classroom setting and, thus, delivers a compelling experience to the students. Our main focus here is to investigate possible solutions for the system design and implementation and devise strategies for fast, efficient computation suitable for visual data processing and network transmission. We describe the technique and experiments in details and provide quantitative performance results, demonstrating our system can be run comfortably and reliably for different application scenarios. Our preliminary results are promising and demonstrate the potential for more compelling directions in cyberlearning.
Document Version
Published Version
Comments

The document available for download is the authors' accepted manuscript. As of this paper's archiving on eCommons, the version of record is forthcoming on IEEE Xplore. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.

Permission documentation is on file.

Publisher
IEEE Computer Society Press
Place of Publication
Los Alamitos, CA
Peer Reviewed
Yes
Keywords
  • Tele-immersive systems,
  • video conferencing,
  • RGB-D systems,
  • virtual reality,
  • virtual environments,
  • interactive media,
  • head-mounted display (HMD)
Citation Information
Xinzhong Lu, Ju Shen, Saverio Perugini and Jianjun Yang. "An Immersive Telepresence System using RGB-D Sensors and Head-mounted Display" Proceedings of the IEEE International Symposium on Multimedia (2015)
Available at: http://works.bepress.com/saverio_perugini/29/