Skip to main content
Article
Modeling the Cost of Misunderstanding Errors in the CMU Communicator Dialog System
Computer Science Department
  • Dan Bohus, Carnegie Mellon University
  • Alexander I Rudnicky, Carnegie Mellon University
Date of Original Version
1-1-2001
Type
Conference Proceeding
Abstract or Description
We describe a data-driven approach that allows us to quantify the costs of various types of errors made by the utterance-level confidence annotator in the Carnegie Mellon Communicator system. Knowing these costs we can determine the optimal tradeoff point between these errors, and tune the confidence annotator accordingly. We describe several models, based on concept transmission efficiency. The models fit our data quite well and the relative costs of errors are in accordance with our intuition. We also find,surprisingly, that for a mixed-initiative system such as the CMU Communicator, false positive and false negative errors trade-off equally over a wide operating range.
Citation Information
Dan Bohus and Alexander I Rudnicky. "Modeling the Cost of Misunderstanding Errors in the CMU Communicator Dialog System" (2001)
Available at: http://works.bepress.com/alexander_rudnicky/19/