Skip to main content
Article
Keyboardless Visual Programming Using Voice, Handwriting, and Gesture
Proceedings of the IEEE Symposium on Visual Languages, 1997
  • Jennifer Leopold, Missouri University of Science and Technology
  • A. Ambler
Abstract

Visual programming languages have facilitated the application development process, improving our ability to express programs, as well as our ability to view, edit and interact with them. Yet even in programming environments, productivity is restricted by the primary input sources: the mouse and the keyboard. As an alternative, we investigate a program development interface which responds to the most natural human communication technologies: voice, handwriting and gesture. Speech- and pen-based systems have yet to find broad acceptance in everyday life because they are insufficiently advantageous to overcome problems with reliability. However, we believe that a visual programming environment with a multimodal user interface properly constrained so as not to exceed the limits of the current technology has the potential to increase programming productivity for not only those people who are manually or visually impaired, but for the general population as well. In this paper we report on such a system.

Meeting Name
IEEE Symposium on Visual Languages, 1997
Department(s)
Computer Science
Keywords and Phrases
  • Application Development,
  • Gesture Recognition,
  • Handicapped Aids,
  • Handwriting Recognition,
  • Human Communication,
  • Human Resource Management,
  • Keyboardless Visual Programming,
  • Manually Impaired,
  • Multimodal User Interface,
  • Pen-Based Systems,
  • Productivity,
  • Program Development Interface,
  • Program Editing,
  • Programming Environments,
  • Reliability,
  • Software Tools,
  • Speech Recognition,
  • Speech-Based Systems,
  • User Interfaces,
  • Visual Languages,
  • Visual Programming,
  • Visual Programming Languages,
  • Visually Impaired,
  • Voice Recognition
Document Type
Article - Conference proceedings
Document Version
Final Version
File Type
text
Language(s)
English
Rights
© 1997 Institute of Electrical and Electronics Engineers (IEEE), All rights reserved.
Publication Date
1-1-1997
Publication Date
01 Jan 1997
Disciplines
Citation Information
Jennifer Leopold and A. Ambler. "Keyboardless Visual Programming Using Voice, Handwriting, and Gesture" Proceedings of the IEEE Symposium on Visual Languages, 1997 (1997)
Available at: http://works.bepress.com/jennifer-leopold/4/