Cross-modal serial dependence

Poster Presentation: Sunday, May 18, 2025, 2:45 – 6:45 pm, Pavilion
Session: Multisensory Processing: Perception, neural, clinical

Adam Zaidel1 (), Baolin Li2, Biyao Wang2, Yael Shamir-Bercovich1, Benjamin Menashe1, Shir Shalom-Sperber1, Aihua Chen3; 1Bar-Ilan University, Ramat Gan, Israel, 2Shaanxi Normal University, Xi’an, China, 3East China Normal University, Shanghai, China

Serial dependence is often studied within a uni-modal context – primarily, vision. However, our experience of the world is naturally multisensory. In a series of four recent studies, we tested cross-modal serial dependence between vision and other modalities (visual-vestibular self-motion perception, and visual-auditory timing perception). To dissociate the differential effects of previous stimuli and previous choices on current decisions, we fit the data from uni-modal and cross-modal conditions, with a logistic regression model. In general, previous stimuli led to negative (repulsive) effects, while previous choices led to positive (attractive) effects. Cross-modal serial dependence was seen for visual-vestibular self-motion perception. Specifically, previous stimuli elicited a repulsive effect on the subsequent perceptual decision, in both uni-modal and cross-modal conditions. In a follow up experiment, we found that these effects remain even when attention is diverted away from the previous stimuli (using a distractor task). By contrast, in two studies of audio-visual timing perception (perception of duration, and of changes in tempo) repulsive effects of previous stimuli were seen only in uni-modal, but not cross-modal, conditions. Here, I will present the various results from these studies, and discuss what can be learned from the presence or absence, and different types, of cross-modal serial dependence.