Reversal learning paradigms are widely used assays of behavioral flexibility with their probabilistic versions being more amenable to studying integration of reward outcomes over time. Prior research suggests differences between initial and reversal learning, including higher learning rates, a greater need for inhibitory control, and more perseveration after reversals. However, it is not well-understood what aspects of stimulus-based reversal learning are unique to reversals, and whether and how observed differences depend on reward probability. Here, we used a visual probabilistic discrimination and reversal learning paradigm where male and female rats selected between a pair of stimuli associated with different reward probabilities. We compared accuracy, rewards collected, omissions, latencies, win-stay/lose-shift strategies, and indices of perseveration across two different reward probability schedules. We found that discrimination and reversal learning are behaviorally more unique than similar: Fit of choice behavior using reinforcement learning models revealed a lower sensitivity to the difference in subjective reward values (greater exploration) and higher learning rates for the reversal phase. We also found latencies to choose the better option were greater in females than males, but only for the reversal phase. Further, animals employed more win-stay strategies during early discrimination and increased perseveration during early reversal learning. Interestingly, a consistent reward probability group difference emerged with a richer environment associated with longer reward collection latencies than a leaner environment. Future studies should systematically compare the neural correlates of fine-grained behavioral measures to reveal possible dissociations in how the circuitry is recruited in each phase. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

中文翻译：

---

基于刺激的概率逆转学习的独特特征。

逆向学习范式是广泛使用的行为灵活性分析，其概率版本更适合研究奖励结果随时间的整合。先前的研究表明，初始学习和逆转学习之间存在差异，包括更高的学习率、对抑制控制的更大需求以及逆转后更多的坚持。然而，基于刺激的逆转学习的哪些方面是逆转所独有的，以及观察到的差异是否以及如何取决于奖励概率，目前还不是很清楚。在这里，我们使用了视觉概率辨别和逆向学习范式，其中雄性和雌性大鼠在与不同奖励概率相关的一对刺激之间进行选择。我们比较了准确性、收集的奖励、遗漏、延迟、赢留/输赢策略，以及跨越两个不同奖励概率表的坚持指数。我们发现歧视和逆转学习在行为上比相似学习更独特：使用强化学习模型的选择行为拟合揭示了对主观奖励值差异的较低敏感性（更大的探索）和更高的逆转阶段学习率。我们还发现，女性选择更好选择的延迟比男性要长，但仅在逆转阶段。此外，动物在早期歧视期间采用了更多的双赢策略，并在早期逆转学习期间增加了坚持。有趣的是，与更精简的环境相比，与更长的奖励收集延迟相关的更丰富的环境出现了一致的奖励概率组差异。未来的研究应该系统地比较细粒度行为测量的神经相关性，以揭示在每个阶段如何招募电路的可能分离。（PsycInfo 数据库记录 (c) 2021 APA，保留所有权利）。