Different kinds of decision making can be categorized by their differential effect on the agent’s current and future states as well as the computational challenges they pose. Here, we draw a distinction between within-state and state-change decision-making, and propose that a dedicated decision mechanism exists in dorsomedial prefrontal cortex (dmPFC) that is specialized for state-change decisions. We set out a formal framework in which state change decisions may be made on the basis of the integrated momentary reward rate, over the intended time to be spent in a state. A key feature of this framework is that reward rate is expressed as a function of continuous time. We argue that dmPFC is suited for this type of decision making partly due to its ability to track the passage of time. This proposed function of dmPFC is placed in contrast to other evaluative systems such as the orbitofrontal cortex, which is important for careful deliberation within a specific model-space or option-space and within a decision strategy.

不同种类的决策可以根据它们对智能体当前和未来状态的不同影响以及它们带来的计算挑战进行分类。在这里，我们区分了状态内决策和状态变化决策，并建议在背内侧前额叶皮层 (dmPFC) 中存在专门用于状态变化决策的专用决策机制。我们建立了一个正式的框架，在该框架中，可以根据综合瞬时奖励率在预期的状态下花费时间做出状态更改决策。该框架的一个关键特征是奖励率表示为连续时间的函数。我们认为 dmPFC 适合这种类型的决策，部分原因是它能够跟踪时间的流逝。