This Article Free Full Text (Free PDF) Free References Alert me when this article is cited Alert me if a correction is posted Services Email this article to a friend Similar articles in this journal Similar articles in PubMed Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via Google Scholar Google Scholar Articles by Tye-Murray, N. Articles by Spehar, B. Search for Related Content PubMed PubMed Citation Articles by Tye-Murray, N. Articles by Spehar, B. Social Bookmarking                   What's this?

Auditory and Visual Lexical Neighborhoods in Audiovisual Speech Perception

Washington University School of Medicine, murrayn{at}ent.wustl.edu

Mitchell Sommers, PhD

Department of Psychology, Washington University in St Louis St Louis, Missouri

Brent Spehar, PhD

Washington University School of Medicine

Much evidence suggests that the mental lexicon is organized into auditory neighborhoods, with words that are phonologically similar belonging to the same neighborhood. In this investigation, we considered the existence of visual neighborhoods. When a receiver watches someone speak a word, a neighborhood of homophenes (ie, words that look alike on the face, such as pat and bat) is activated. The simultaneous activation of a word's auditory and visual neighborhoods may, in part, account for why individuals recognize speech better in an auditory—visual condition than what would be predicted by their performance in audition-only and vision-only conditions. A word test was administered to 3 groups of participants in audition-only, vision-only, and auditory—visual conditions, in the presence of 6-talker babble. Test words with sparse visual neighborhoods were recognized more accurately than words with dense neighborhoods in a vision-only condition. Densities of both the acoustic and visual neighborhoods as well as their intersection overlap were predictive of how well the test words were recognized in the auditory—visual condition. These results suggest that visual neighborhoods exist and that they affect auditory—visual speech perception. One implication is that in the presence of dual sensory impairment, the boundaries of both acoustic and visual neighborhoods may shift, adversely affecting speech recognition.

Key Words: Lexical neighborhood • auditory—visual speech perception • integration

CiteULike    Connotea    Del.icio.us    Digg    Reddit    Technorati    What's this?