Skip to main content
Contribution to Book
Recognizing prosody from the lips: Is it possible to extract prosodic focus from lip features?
Faculty of Health and Behavioural Sciences - Papers (Archive)
  • Marion Dohen
  • Helene Loevenbruck
  • Harold C Hill, University of Wollongong
RIS ID
25106
Publication Date
1-1-2009
Publication Details

Dohen, M, Loevenbruck, H and Hill, HC, Recognizing prosody from the lips: Is it possible to extract prosodic focus from lip features?, In Liew, A & Wang, S (Eds), Visual speech recognition: lip segmentation and mapping, 2009, p 416-438, Hershey, USA: Medical Information Science Reference.

Abstract
The aim of this chapter is to examine the possibility of extracting prosodic information from lip features. The authors used two lip feature measurement techniques in order to evaluate the “lip pattern” of prosodic focus in French. Two corpora with Subject-Verb-Object (SVO) sentences were designed. Four focus conditions (S, V, O or neutral) were elicited in a natural dialogue situation. In the first set of experiments, they recorded two speakers of French with front and profile video cameras. The speakers wore blue lipstick and facial markers. In the second set, the authors recorded five speakers with a 3D optical tracker. An analysis of the lip features showed that visible articulatory lip correlates of focus exist for all speakers. Two types of patterns were observed: absolute and differential. A potential outcome of this study is to provide criteria for automatic visual detection of prosodic focus from lip data.
Citation Information
Marion Dohen, Helene Loevenbruck and Harold C Hill. "Recognizing prosody from the lips: Is it possible to extract prosodic focus from lip features?" (2009) p. 416 - 438
Available at: http://works.bepress.com/hhill/16/