Skip to main content
Article
Towards on-site collaborative robotics: Voice control, co-speech gesture & context-specific object recognition via ad-hoc communication
International Conference of the Association for Robotics in Architecture
  • Thibault Schwartz, HAL Robotics
  • Sebastian Andraos, HAL Robotics
  • Jonathan Nelson, Bond University
  • Chris Knapp, Bond University
  • Bertrand Arnold, Soundisplay
Date of this Version
3-1-2016
Document Type
Conference Presentation
Publication Details

Citation only

Schwartz, T., Andraos, S. Nelson, J., Knapp, C., & Arnold, B. (2016, March). Towards on-site collaborative robotics: Voice control, co-speech gesture & context-specific object recognition via ad-hoc communication. Paper presented at International Conference of the Association for Robotics in Architecture, Walsh Bay, Sydney.

Access the conference

Abstract

This work presents a novel set of accessible, unified hardware and software solutions facilitating the implementation of natural human-machine interactions, as required by collaborative robotics in both indoor and outdoor environments. This extensible framework supports vocal control, co-speech gestures, and object recognition with feature tracking and adaptive resolution. The interactions are based on a new network messaging protocol allowing any device using TCP/IP to share variables with the full abstraction of the original machine software platform and can therefore be used synchronously by a vast array of equipment including CNC machines, industrial robots, construction equipment, mobile devices and PLCs. We conclude with the description of a testing scenario to be deployed during the conference workshop.

Citation Information
Thibault Schwartz, Sebastian Andraos, Jonathan Nelson, Chris Knapp, et al.. "Towards on-site collaborative robotics: Voice control, co-speech gesture & context-specific object recognition via ad-hoc communication" International Conference of the Association for Robotics in Architecture (2016)
Available at: http://works.bepress.com/chris_knapp/13/