We describe a neurobiologically informed computational model of phasic dopamine signaling to account for a wide range of findings, including many considered inconsistent with the simple reward prediction error (RPE) formalism. The central feature of this PVLV framework is a distinction between a primary value (PV) system for anticipating primary rewards (Unconditioned Stimuli [USs]), and a learned value (LV) system for learning about stimuli associated with such rewards (CSs). The LV system represents the amygdala, which drives phasic bursting in midbrain dopamine areas, while the PV system represents the ventral striatum, which drives shunting inhibition of dopamine for expected USs (via direct inhibitory projections) and phasic pausing for expected USs (via the lateral habenula). Our model accounts for data supporting the separability of these systems, including individual differences in CS-based (sign-tracking) versus US-based learning (goal-tracking). Both systems use competing opponent-processing pathways representing evidence for and against specific USs, which can explain data dissociating the processes involved in acquisition versus extinction conditioning. Further, opponent processing proved critical in accounting for the full range of conditioned inhibition phenomena, and the closely related paradigm of second-order conditioning. Finally, we show how additional separable pathways representing aversive USs, largely mirroring those for appetitive USs, also have important differences from the positive valence case, allowing the model to account for several important phenomena in aversive conditioning. Overall, accounting for all of these phenomena strongly constrains the model, thus providing a well-validated framework for understanding phasic dopamine signaling. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

中文翻译：

---

阶段性多巴胺的系统神经科学模型。

我们描述了一种基于神经生物学的阶段性多巴胺信号传导计算模型，以解释广泛的发现，包括许多被认为与简单奖励预测误差（RPE）形式不一致的发现。该 PVLV 框架的核心特征是用于预测初级奖励（无条件刺激 [US]）的初级价值（PV）系统和用于了解与此类奖励（CS）相关的刺激的学习价值（LV）系统之间的区别。LV 系统代表杏仁核，驱动中脑多巴胺区域的阶段性爆发，而 PV 系统代表腹侧纹状体，驱动预期 US 的多巴胺分流抑制（通过直接抑制投射）和预期 US 的阶段性暂停（通过侧向抑制）。缰核）。我们的模型考虑了支持这些系统可分离性的数据，包括基于 CS（符号跟踪）与基于 US 的学习（目标跟踪）的个体差异。两个系统都使用竞争的对手处理路径，代表支持和反对特定美国的证据，这可以解释将习得条件作用与灭绝条件作用所涉及的过程分离的数据。此外，事实证明，对手处理对于解释所有条件抑制现象以及密切相关的二阶条件作用范式至关重要。最后，我们展示了代表厌恶性美国的其他可分离路径（很大程度上反映了食欲性美国的路径）也与正价情况存在重要差异，从而使该模型能够解释厌恶性条件反射中的几个重要现象。总的来说，考虑所有这些现象强烈限制了模型，从而为理解阶段性多巴胺信号传导提供了一个经过充分验证的框架。（PsycInfo 数据库记录 (c) 2020 APA，保留所有权利）。