Skip to main content
Contribution to Book
Algorithms to Automate Estimation of Time Codes for Captioning Digital Media
PReMI 2009: Lecture Notes in Computer Science (2009)
  • Daniel P. Harvey, II, Eastern Illinois University
  • Peter Ping Liu, Eastern Illinois University
Abstract
Procedures were developed to partially automate the captioning process by estimating caption time codes using plain-text transcripts and audio recordings. Signal analysis is performed on the audio to measure pause location and duration, zero crossing rate (ZCR), and obtain frequency domain data. Algorithms were developed to match pauses in the audio to the ends of sentences in the transcript based on the observation that pause durations are greater at ends of sentences than within sentences. We have observed that ZCR peaks correspond to consonants in speech and that continuous wavelet transforms (CWT) work well for distinguishing between groups of consonants. These measurements will be used to develop algorithms to match selected phonemes in the audio to text in the transcript to supplement the pause matching results.
Keywords
  • captioning digital media,
  • algorithms,
  • zero crossing rate,
  • continuous wavelet transforms
Publication Date
2009
Editor
S. Chaudhury et al. (Eds.)
Publisher
Springer-Verlag
Series
PReMI Proceedings
ISBN
978-3-642-11164-8
Publisher Statement
This paper from the 2009 PReMI conference is available in final published form in the book Pattern Recognition and Machine Intelligence, 2009, 978-3-642-11164-8.
Citation Information
Daniel P. Harvey and Peter Ping Liu. "Algorithms to Automate Estimation of Time Codes for Captioning Digital Media" Berlin, HeidelbergPReMI 2009: Lecture Notes in Computer Science Vol. 5909 (2009)
Available at: http://works.bepress.com/peter_liu/3/