The effects of temporal asynchrony on the intelligibility of accelerated speech

Douglas S. Brungart*, Nandini Iyer, Brian D. Simpson, Virginie van Wassenhove

*Corresponding author for this work

Research output: Contribution to conferencePaperpeer-review

4 Scopus citations

Abstract

When the audio and visual portions of a speech stimulus are presented synchronously, the resulting enhancement in intelligibility is generally much larger than the one obtained when the audio and visual stimuli are presented sequentially. However, perfect synchronization is not required to obtain a substantial audiovisual (AV) benefit: many studies have shown that AV integration is maximum when the audio signal is slightly delayed relative to the visual signal, and other studies have shown that substantial AV intelligibility enhancement typically extends over a 250+ ms range of AV delay values, from a 50 ms lag in the visual stimulus to a 200 ms lag in the audio stimulus. In this study, artificially accelerated speech stimuli were used to examine the impact that speaking rate has on the characteristics of this temporal integration window. The results indicate that maximal AV enhancement occurs over a progressively narrower range of delay values when the speaking rate increases. The results for the fastest speaking rates also show that peak AV enhancement occurred at a larger AV delay value (150ms) than has been reported in previous studies. However, there was no conclusive evidence to suggest that the audio delay value for peak AV enhancement systematically changed with the speaking rate of the stimulus.

Original languageEnglish
Pages19-24
Number of pages6
StatePublished - 2008
Externally publishedYes
Event2008 International Conference on Auditory-Visual Speech Processing, AVSP 2008 - Moreton Island, Australia
Duration: 26 Sep 200829 Sep 2008

Conference

Conference2008 International Conference on Auditory-Visual Speech Processing, AVSP 2008
Country/TerritoryAustralia
CityMoreton Island
Period26/09/0829/09/08

Keywords

  • AV synchrony
  • Time compressed speech

Fingerprint

Dive into the research topics of 'The effects of temporal asynchrony on the intelligibility of accelerated speech'. Together they form a unique fingerprint.

Cite this