Abstract To form a coherent presentation of the world, the brain needs to combine multiple sensory modalities accurately together in the temporal domain. Judgements on the relative timing of audio–visual stimuli are complex, due to the differing propagation speeds of light and sound through the environment and the nervous system, and the dependence of processing latencies on stimulus intensity (Pieron, 1913). Simultaneity judgement (SJ) and temporal order judgement (TOJ) tasks are often used to assess the temporal mechanisms underlying this binding process. However, these tasks consistently produce measures of perceived simultaneity that are uncorrelated with each other, leading to the suggestion that SJ and TOJ tasks could depend on separate neural mechanisms. Parise and Ernst’s (2016) multisensory correlation detector (MCD) model predicts this lack of correlation by assuming two internal processing stages, a lag computation and a correlation. Here we include and empirically evaluate an intensity-dependent processing delay in the MCD model. We estimate the points of subjective simultaneity (PSSs) using both SJ and TOJ tasks for four different visual intensities and a fixed auditory sound level. Evaluation of four variants of the intensity-dependent MCD model shows that the introduction of an early processing delay can predict the different PSS values obtained in the two respective tasks, without the need for later intensity-dependent multisensorial processing stages. Crucially, this early processing delay can be estimated from simple reaction times.

中文翻译：

---

视觉强度相关的响应延迟预测感知的视听同时性

摘要 为了形成对世界的连贯呈现，大脑需要在时间域中将多种感觉模式准确地组合在一起。由于光和声音在环境和神经系统中的传播速度不同，以及处理延迟对刺激强度的依赖性，因此对视听刺激的相对时间的判断很复杂（Pieron，1913）。同时性判断 (SJ) 和时间顺序判断 (TOJ) 任务通常用于评估此绑定过程背后的时间机制。然而，这些任务始终产生彼此不相关的感知同时性测量，导致 SJ 和 TOJ 任务可能依赖于不同的神经机制的建议。Parise 和 Ernst (2016) 的多感官相关检测器 (MCD) 模型通过假设两个内部处理阶段、滞后计算和相关性来预测这种缺乏相关性。在这里，我们包括并凭经验评估 MCD 模型中的强度相关处理延迟。我们使用 SJ 和 TOJ 任务针对四种不同的视觉强度和固定的听觉声级估计主观同时性 (PSS) 点。对强度相关 MCD 模型的四个变体的评估表明，早期处理延迟的引入可以预测在两个各自任务中获得的不同 PSS 值，而无需后期的强度相关多感官处理阶段。至关重要的是，这种早期处理延迟可以通过简单的反应时间来估计。