uu.seUppsala University Publications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Watch and listen – A cross-cultural study of audio-visual-matching behavior in 4.5-month-old infants in German and Swedish talking faces
Uppsala University, Disciplinary Domain of Humanities and Social Sciences, Faculty of Social Sciences, Department of Psychology.
2018 (English)In: Infant Behavior and Development, ISSN 0163-6383, E-ISSN 1879-0453, Vol. 52, p. 121-129Article in journal (Refereed) Published
Abstract [en]

Investigating infants’ ability to match visual and auditory speech segments presented sequentially allows us to understand more about the type of information they encode in each domain, as well as their ability to relate the information. One previous study found that 4.5- month-old infants’ preference for visual French or German speech depended on whether they had previously heard the respective language, suggesting a remarkable ability to encode and relate audio-visual speech cues and to use these to guide their looking behavior. However, French and German differ in their prosody, meaning that perhaps, the infants did not base their matching on phonological or phonetic cues, but on prosody patterns. The present study aimed to address this issue by tracking the eye gaze of 4.5-month-old German and Swedish infants cross-culturally in an intersensory matching procedure, comparing German and Swedish, two same-rhythm-class languages differing in phonetic and phonological attributes but not in prosody. Looking times indicated that even when distinctive prosodic cues were eliminated, 4.5- month-olds were able to extract subtle language properties and sequentially match visual and heard fluent speech. This outcome was the same for different individual speakers for the two modalities, ruling out the possibility that the infants matched speech patterns specific to one individual. This study confirms a remarkably early emerging ability of infants to match auditory and visual information. The fact that the types of information were matched despite sequential presentation demonstrates that the information is retained in short term memory, and thus goes beyond purely perceptual – here-and-now processing.

Place, publisher, year, edition, pages
2018. Vol. 52, p. 121-129
Keywords [en]
Speech perception, Audio-visual matching, Phonological/phonetic cues, Cross-cultural study, Eye-tracking
National Category
Psychology
Identifiers
URN: urn:nbn:se:uu:diva-357648DOI: 10.1016/j.infbeh.2018.05.003ISI: 000444667300014PubMedID: 30007216OAI: oai:DiVA.org:uu-357648DiVA, id: diva2:1239973
Available from: 2018-08-20 Created: 2018-08-20 Last updated: 2018-11-26Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textPubMed

Authority records BETA

Falck-Ytter, Terje

Search in DiVA

By author/editor
Falck-Ytter, Terje
By organisation
Department of Psychology
In the same journal
Infant Behavior and Development
Psychology

Search outside of DiVA

GoogleGoogle Scholar

doi
pubmed
urn-nbn

Altmetric score

doi
pubmed
urn-nbn
Total: 17 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf