Dopamine Neurons Respond to Errors in the Prediction of Sensory Features of Expected Rewards.,Neuron

当前位置： X-MOL 学术 › Neuron › 论文详情

Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)

Dopamine Neurons Respond to Errors in the Prediction of Sensory Features of Expected Rewards.
Neuron ( IF 14.7 ) Pub Date : 2017-Sep-13 , DOI: 10.1016/j.neuron.2017.08.025
Yuji K Takahashi ₁ , Hannah M Batchelor ₁ , Bing Liu ₁ , Akash Khanna ₂ , Marisela Morales ₁ , Geoffrey Schoenbaum ₃

Affiliation

Midbrain dopamine neurons have been proposed to signal prediction errors as defined in model-free reinforcement learning algorithms. While these algorithms have been extremely powerful in interpreting dopamine activity, these models do not register any error unless there is a difference between the value of what is predicted and what is received. Yet learning often occurs in response to changes in the unique features that characterize what is received, sometimes with no change in its value at all. Here, we show that classic error-signaling dopamine neurons also respond to changes in value-neutral sensory features of an expected reward. This suggests that dopamine neurons have access to a wider variety of information than contemplated by the models currently used to interpret their activity and that, while their firing may conform to predictions of these models in some cases, they are not restricted to signaling errors in the prediction of value.

中文翻译：

多巴胺神经元对预期奖励的感官特征预测错误做出反应。

中脑多巴胺神经元已被提议用于发出无模型强化学习算法中定义的预测错误信号。虽然这些算法在解释多巴胺活动方面非常强大，但这些模型不会记录任何错误，除非预测值与接收值之间存在差异。然而，学习通常是针对所接收的信息的独特特征的变化而发生的，有时其价值根本没有变化。在这里，我们表明，经典的错误信号多巴胺神经元也对预期奖励的价值中性感觉特征的变化做出反应。这表明多巴胺神经元可以获得比目前用于解释其活动的模型所设想的更广泛的信息，并且虽然它们的放电在某些情况下可能符合这些模型的预测，但它们并不局限于多巴胺神经元中的信号错误。价值的预测。

更新日期：2017-09-20

点击分享查看原文

点击收藏

公开下载

阅读更多本刊最新论文本刊介绍/投稿指南11