Skip to main content
Article
A Principled Approach for Rejection Threshold Optimization in Spoken Dialog Systems
Computer Science Department
  • Dan Bohus, Carnegie Mellon University
  • Alexander I Rudnicky, Carnegie Mellon University
Date of Original Version
1-1-2005
Type
Conference Proceeding
Abstract or Description

A common design pattern in spoken dialog systems is to reject an input when the recognition confidence score falls below a preset rejection threshold. However, this introduces a potentially non-optimal tradeoff between various types of errors such as misunderstandings and false rejections. In this paper, we propose a data-driven method for determining the relative costs of these errors, and then use these costs to optimize state-specific rejection thresholds. We illustrate the use of this approach with data from a spoken dialog system that handles conference room reservations. The results obtained confirm our intuitions about the costs of the errors, and are consistent with anecdotal evidence gathered throughout the use of the system.

Citation Information
Dan Bohus and Alexander I Rudnicky. "A Principled Approach for Rejection Threshold Optimization in Spoken Dialog Systems" (2005)
Available at: http://works.bepress.com/alexander_rudnicky/77/