Conscious awareness plays a major role in human cognition and adaptive behavior, though its function in multisensory integration is not yet fully understood, hence, questions remain: How does the brain integrate the incoming multisensory signals with respect to different external environments? How are the roles of these multisensory signals defined to adhere to the anticipated behavioral-constraint of the environment? This work seeks to articulate a novel theory on conscious multisensory integration (CMI) that addresses the aforementioned research challenges. Specifically, the well-established contextual field (CF) in pyramidal cells and coherent infomax theory (Kay et al., 1998; Kay and Phillips, 2011) is split into two functionally distinctive integrated input fields: local contextual field (LCF) and universal contextual field (UCF). LCF defines the modulatory sensory signal coming from some other parts of the brain (in principle from anywhere in space-time) and UCF defines the outside environment and anticipated behavior (based on past learning and reasoning). Both LCF and UCF are integrated with the receptive field (RF) to develop a new class of contextually-adaptive neuron (CAN), which adapts to changing environments. The proposed theory is evaluated using human contextual audio-visual (AV) speech modeling. Simulation results provide new insights into contextual modulation and selective multisensory information amplification/suppression. The central hypothesis reviewed here suggests that the pyramidal cell, in addition to the classical excitatory and inhibitory signals, receives LCF and UCF inputs. The UCF (as a steering force or tuner) plays a decisive role in precisely selecting whether to amplify/suppress the transmission of relevant/irrelevant feedforward signals, without changing the content e.g., which information is worth paying more attention to? This, as opposed to, unconditional excitatory and inhibitory activity in existing deep neural networks (DNNs), is called conditional amplification/suppression.

中文翻译：

---

有意识的多感官整合：在生物和深层人工神经网络中引入通用上下文场

意识在人类认知和适应性行为中发挥着重要作用，尽管其在多感官整合中的功能尚未完全了解，因此，问题仍然存在：大脑如何针对不同的外部环境整合传入的多感官信号？如何定义这些多感官信号的作用以遵守环境的预期行为约束？这项工作旨在阐明一种关于有意识多感官整合（CMI）的新颖理论，以解决上述研究挑战。具体来说，锥体细胞和相干信息最大理论中成熟的上下文场（CF）（Kay et al., 1998; Kay and Phillips, 2011）被分为两个功能独特的集成输入场：局部上下文场（LCF）和通用输入场。上下文字段（UCF）。LCF 定义了来自大脑其他部分（原则上来自时空任何地方）的调节感觉信号，UCF 定义了外部环境和预期行为（基于过去的学习和推理）。LCF 和 UCF 都与感受野 (RF) 集成，开发出一类新型上下文自适应神经元 (CAN)，可以适应不断变化的环境。使用人类情境视听 (AV) 语音模型对所提出的理论进行评估。模拟结果为上下文调制和选择性多感官信息放大/抑制提供了新的见解。这里回顾的中心假设表明，除了经典的兴奋性和抑制性信号之外，锥体细胞还接收 LCF 和 UCF 输入。UCF（作为舵机或调谐器）在精确选择是否放大/抑制相关/不相关前馈信号的传输方面起着决定性作用，而不改变内容，例如哪些信息值得更多关注？与现有深度神经网络 (DNN) 中的无条件兴奋和抑制活动相反，这称为条件放大/抑制。