Are alternation and co-occurrence of stimuli of different sensory modalities conspicuous? In a novel audio-visual oddball paradigm, the P300 was used as an index of the allocation of attention to investigate stimulus- and task-related interactions between modalities. Specifically, we assessed effects of modality alternation and the salience of conjunct oddball stimuli that were defined by the co-occurrence of both modalities. We presented (a) crossmodal audio-visual oddball sequences, where both oddballs and standards were unimodal, but of a different modality (i.e., visual oddball with auditory standard, or vice versa), and (b) oddball sequences where standards were randomly of either modality while the oddballs were a combination of both modalities (conjunct stimuli). Subjects were instructed to attend to one of the modalities (whether part of a conjunct stimulus or not). In addition, we also tested specific attention to the conjunct stimuli. P300-like responses occurred even when the oddball was of the unattended modality. The pattern of event-related potential (ERP) responses obtained with the two crossmodal oddball sequences switched symmetrically between stimulus modalities when the task modality was switched. Conjunct oddballs elicited no oddball response if only one modality was attended. However, when conjunctness was specifically attended, an oddball response was obtained. Crossmodal oddballs capture sufficient attention even when not attended. Conjunct oddballs, however, are not sufficiently salient to attract attention when the task is unimodal. Even when specifically attended, the processing of conjunctness appears to involve additional steps that delay the oddball response.

中文翻译：

---

视觉和听觉之间的注意力相互作用在对交叉模态和联合古怪的事件相关反应中。

不同感觉方式的刺激交替和同时发生是否显着？在一个新的视听古怪范式中，P300 被用作注意力分配的指标，以研究与刺激和任务相关的模式之间的交互。具体来说，我们评估了模态交替的影响和由两种模态的共同出现所定义的联合古怪刺激的显着性。我们提出了 (a) 跨模态视听古怪序列，其中古怪和标准都是单峰的，但具有不同的模态（即具有听觉标准的视觉古怪，反之亦然），以及 (b) 古怪序列，其中标准是随机的任何一种方式，而古怪的是两种方式的组合（联合刺激）。指示受试者注意其中一种方式（无论是否为联合刺激的一部分）。此外，我们还测试了对联合刺激的特殊关注。即使当古怪的人处于无人值守的状态时，也会发生类似 P300 的反应。当任务模式切换时，用两个交叉模式古怪序列获得的事件相关电位 (ERP) 响应模式在刺激模式之间对称切换。如果只参加一种方式，联合古怪不会引起古怪反应。然而，当特别关注连接时，得到了奇怪的反应。即使没有人参与，跨模式的古怪也能吸引足够的注意力。然而，当任务是单峰时，联合古怪并不足以引起注意。即使是特别出席的时候，