This paper describes a framework for modelling dopamine function in the mammalian brain. It proposes that both learning and action planning involve processes minimizing prediction errors encoded by dopaminergic neurons. In this framework, dopaminergic neurons projecting to different parts of the striatum encode errors in predictions made by the corresponding systems within the basal ganglia. The dopaminergic neurons encode differences between rewards and expectations in the goal-directed system, and differences between the chosen and habitual actions in the habit system. These prediction errors trigger learning about rewards and habit formation, respectively. Additionally, dopaminergic neurons in the goal-directed system play a key role in action planning: They compute the difference between a desired reward and the reward expected from the current motor plan, and they facilitate action planning until this difference diminishes. Presented models account for dopaminergic responses during movements, effects of dopamine depletion on behaviour, and make several experimental predictions.

中文翻译：

---

多巴胺在学习和行动推理中的作用

本文描述了哺乳动物大脑中多巴胺功能建模的框架。它提出学习和行动计划都涉及最小化由多巴胺能神经元编码的预测误差的过程。在这个框架中，投射到纹状体不同部分的多巴胺能神经元对基底神经节内相应系统做出的预测错误进行编码。多巴胺能神经元编码目标导向系统中奖励和期望之间的差异，以及习惯系统中选择和习惯行为之间的差异。这些预测错误分别触发了关于奖励和习惯形成的学习。此外，目标导向系统中的多巴胺能神经元在行动计划中起着关键作用：他们计算期望的奖励和当前运动计划的预期奖励之间的差异，并促进行动计划，直到这种差异减少。提出的模型解释了运动过程中的多巴胺能反应、多巴胺消耗对行为的影响，并做出了一些实验预测。