The human hippocampus processes both sound and sight
New findings show how the hippocampus integrates auditory and visual information.
The human hippocampus supports auditory coding and multisensory integration. It receives input from multiple sensory systems.
Participants watched short naturalistic movie clips. They saw clips in four formats. These were auditory-only, visual-only, congruent audiovisual, and incongruent audiovisual.
High-resolution fMRI was used to measure activation and representations. Univariate analyses detected only visual responses across hippocampal subregions. Multivariate analyses revealed robust representations of both auditory and visual scenes.
The posterior hippocampus showed enhanced pattern similarity for congruent stimuli. This happened especially in the left hemisphere. The anterior hippocampus showed crossmodal decoding between auditory and visual versions of the same clip. This was driven by the right hemisphere and suggests a more abstract representation.
Whole-brain searchlight analyses revealed parallel effects in cortical regions. These regions are known to support multisensory integration. These findings advance understanding of auditory and multisensory coding in the human hippocampus.
Key facts
- The posterior hippocampus shows multisensory facilitation in the left hemisphere.
- The anterior hippocampus suggests more abstract representation through the right hemisphere.
- Multivariate analyses revealed representations of both auditory and visual scenes.