Abstract
Autonomous motivated spatial navigation in animals or robots requires the association between spatial location and value. Hippocampal place cells are involved in goal-directed spatial navigation and the consolidation of spatial memories. Recently, Gauthier and Tank (Neuron 99(1):179–193, 2018. https://doi.org/10.1016/j.neuron.2018.06.008) have identified a subpopulation of hippocampal cells selectively activated in relation to rewarded goals. However, the relationship between these cells’ spiking activity and goal representation remains elusive. We analyzed data from experiments in which rats underwent five consecutive tasks in which reward locations and spatial context were manipulated. We found CA1 populations with properties continuously ranging from place cells to reward cells. Specifically, we found typical place cells insensitive to reward locations, reward cells that only fired at correct rewarded feeders in each task regardless of context, and “hybrid cells” that responded to spatial locations and change of reward locations. Reward cells responded mostly to the reward delivery rather than to its expectation. In addition, we found a small group of neurons that transitioned between place and reward cells properties within the 5-task session. We conclude that some pyramidal cells (if not all) integrate both spatial and reward inputs to various degrees. These results provide insights into the integrative coding properties of CA1 pyramidal cells, focusing on their abilities to carry both spatial and reward information in a mixed and plastic manner. This conjunctive coding property prompts a re-thinking of current computational models of spatial navigation in which hippocampal spatial and subcortical value representations are independent.
Similar content being viewed by others
References
Ainge JA, Tamosiunaite M, Worgotter F, Dudchenko PA (2012) Hippocampal place cells encode intended destination, and not a discriminative stimulus, in a conditional T-maze task. Hippocampus 22(3):534–543. https://doi.org/10.1002/hipo.20919
Barry C, Lever C, Hayman R, Hartley T, Burton S, O’Keefe J, Jeffery K, Burgess N (2006) The boundary vector cell model of place cell firing and spatial memory. Rev Neurosci 17(1–2):71–97
Berridge KC, Kringelbach ML (2015) Pleasure systems in the brain. Neuron 86(3):646–664. https://doi.org/10.1016/j.neuron.2015.02.018
Bittner KC, Grienberger C, Vaidya SP, Milstein AD, Macklin JJ, Suh J, Tonegawa S, Magee JC (2015) Conjunctive input processing drives feature selectivity in hippocampal CA1 neurons. Nat Neurosci 18(8):1133–1142. https://doi.org/10.1038/nn.4062
Boccara CN, Sargolini F, Thoresen VH, Solstad T, Witter MP, Moser EI, Moser MB (2010) Grid cells in pre- and parasubiculum. Nat Neurosci 13(8):987–994. https://doi.org/10.1038/nn.2602
Bush D, Barry C, Manson D, Burgess N (2015) Using grid cells for navigation. Neuron 87(3):507–520. https://doi.org/10.1016/j.neuron.2015.07.006
Cazin N, Llofriu Alonso M, Scleidorovich Chiodi P, Pelc T, Harland B, Weitzenfeld A, Fellous JM, Dominey PF (2019) Reservoir computing model of prefrontal cortex creates novel combinations of previous navigation sequences from hippocampal place-cell replay with spatial reward propagation. PLoS Comput Biol 15(7):e1006624. https://doi.org/10.1371/journal.pcbi.1006624
Chersi F, Burgess N (2015) The cognitive architecture of spatial navigation: hippocampal and striatal contributions. Neuron 88(1):64–77. https://doi.org/10.1016/j.neuron.2015.09.021
Colgin LL, Moser EI, Moser MB (2008) Understanding memory through hippocampal remapping. Trends Neurosci 31(9):469–477. https://doi.org/10.1016/j.tins.2008.06.008
Danielson NB, Zaremba JD, Kaifosh P, Bowler J, Ladow M, Losonczy A (2016) Sublayer-specific coding dynamics during spatial navigation and learning in hippocampal area CA1. Neuron 91(3):652–665. https://doi.org/10.1016/j.neuron.2016.06.020
Deneux T, Kaszas A, Szalay G, Katona G, Lakner T, Grinvald A, Rozsa B, Vanzetta I (2016) Accurate spike estimation from noisy calcium signals for ultrafast three-dimensional imaging of large neuronal populations in vivo. Nat Commun 7:12190. https://doi.org/10.1038/ncomms12190
Deshmukh SS, Knierim JJ (2013) Influence of local objects on hippocampal representations: landmark vectors and memory. Hippocampus 23(4):253–267. https://doi.org/10.1002/hipo.22101
Diba K, Buzsaki G (2007) Forward and reverse hippocampal place-cell sequences during ripples. Nat Neurosci 10(10):1241–1242. https://doi.org/10.1038/nn1961
Dupret D, O’Neill J, Pleydell-Bouverie B, Csicsvari J (2010) The reorganization and reactivation of hippocampal maps predict spatial memory performance. Nat Neurosci 13(8):995–1002. https://doi.org/10.1038/nn.2599
Duvelle E, Grieves RM, Hok V, Poucet B, Arleo A, Jeffery KJ, Save E (2019) Insensitivity of place cells to the value of spatial goals in a two-choice flexible navigation task. J Neurosci 39(13):2522–2541. https://doi.org/10.1523/JNEUROSCI.1578-18.2018
Eichenbaum H (2018) What versus where: non-spatial aspects of memory representation by the hippocampus. Curr Top Behav Neurosci 37:101–117. https://doi.org/10.1007/7854_2016_450
Gauthier JL, Tank DW (2018) A dedicated population for reward coding in the hippocampus. Neuron 99(1):179–193. https://doi.org/10.1016/j.neuron.2018.06.008
Guazzelli A, Arbib MA (1997) NeWG: in search of the rat’s world graph. J Braz Comput Soc. https://doi.org/10.1590/s0104-65001997000200001
Hafting T, Fyhn M, Molden S, Moser MB, Moser EI (2005) Microstructure of a spatial map in the entorhinal cortex. Nature 436(7052):801–806. https://doi.org/10.1038/nature03721
Hardt O, Nadel L (2018) Systems consolidation revisited, but not revised: the promise and limits of optogenetics in the study of memory. Neurosci Lett 680:54–59. https://doi.org/10.1016/j.neulet.2017.11.062
Hinman JR, Dannenberg H, Alexander AS, Hasselmo ME (2018) Neural mechanisms of navigation involving interactions of cortical and subcortical structures. J Neurophysiol 119(6):2007–2029. https://doi.org/10.1152/jn.00498.2017
Hollup SA, Molden S, Donnett JG, Moser MB, Moser EI (2001) Accumulation of hippocampal place fields at the goal location in an annular watermaze task. J Neurosci 21(5):1635–1644
Holscher C, Schnee A, Dahmen H, Setia L, Mallot HA (2005) Rats are able to navigate in virtual environments. J Exp Biol 208(Pt 3):561–569. https://doi.org/10.1242/jeb.01371
Hoydal OA, Skytoen ER, Andersson SO, Moser MB, Moser EI (2019) Object-vector coding in the medial entorhinal cortex. Nature 568(7752):400
Jadhav SP, Kemere C, German PW, Frank LM (2012) Awake hippocampal sharp-wave ripples support spatial memory. Science 336(6087):1454–1458. https://doi.org/10.1126/science.1217230
Jones B, Bukoski E, Nadel L, Fellous JM (2012) Remaking memories: reconsolidation updates positively motivated spatial memory in rats. Learn Mem 19(3):91–98. https://doi.org/10.1101/lm.023408.111
Jones BJ, Pest SM, Vargas IM, Glisky EL, Fellous JM (2015) Contextual reminders fail to trigger memory reconsolidation in aged rats and aged humans. Neurobiol Learn Mem 120:7–15. https://doi.org/10.1016/j.nlm.2015.02.003
Kobayashi T, Tran AH, Nishijo H, Ono T, Matsumoto G (2003) Contribution of hippocampal place cell activity to learning and formation of goal-directed navigation in rats. Neuroscience 117(4):1025–1035. https://doi.org/10.1016/s0306-4522(02)00700-5
Lansink CS, Goltstein PM, Lankelma JV, McNaughton BL, Pennartz CM (2009) Hippocampus leads ventral striatum in replay of place-reward information. PLoS Biol 7(8):e1000173. https://doi.org/10.1371/journal.pbio.1000173
Latuske P, Kornienko O, Kohler L, Allen K (2017) Hippocampal remapping and its entorhinal origin. Front Behav Neurosci 11:253. https://doi.org/10.3389/fnbeh.2017.00253
Lee I, Griffin AL, Zilli EA, Eichenbaum H, Hasselmo ME (2006) Gradual translocation of spatial correlates of neuronal firing in the hippocampus toward prospective reward locations. Neuron 51(5):639–650. https://doi.org/10.1016/j.neuron.2006.06.033
Lee H, Ghim JW, Kim H, Lee D, Jung M (2012) Hippocampal neural correlates for values of experienced events. J Neurosci 32(43):15053–15065. https://doi.org/10.1523/JNEUROSCI.2806-12.2012
Lenck-Santini PP, Rivard B, Muller RU, Poucet B (2005) Study of CA1 place cell activity and exploratory behavior following spatial and nonspatial changes in the environment. Hippocampus 15(3):356–369. https://doi.org/10.1002/hipo.20060
Lever C, Burton S, Jeewajee A, O’Keefe J, Burgess N (2009) Boundary vector cells in the subiculum of the hippocampal formation. J Neurosci 29(31):9771–9777. https://doi.org/10.1523/JNEUROSCI.1319-09.2009
Lieblich I, Arbib M (1982) Multiple representations of space underlying behavior. Behav Brain Sci 5(4):627–640. https://doi.org/10.1017/S0140525X00013959
Liu YZ, Wang Y, Tang W, Zhu JY, Wang Z (2018) NMDA receptor-gated visual responses in hippocampal CA1 neurons. J Physiol 596(10):1965–1979. https://doi.org/10.1113/JP275094
Llofriu M, Tejera G, Contreras M, Pelc T, Fellous JM, Weitzenfeld A (2015) Goal-oriented robot navigation learning using a multi-scale space representation. Neural Netw 72:62–74. https://doi.org/10.1016/j.neunet.2015.09.006
Luo AH, Tahsili-Fahadan P, Wise RA, Lupica CR, Aston-Jones G (2011) Linking context with reward: a functional circuit from hippocampal CA3 to ventral tegmental area. Science 333(6040):353–357. https://doi.org/10.1126/science.1204622
Malvache A, Reichinnek S, Villette V, Haimerl C, Cossart R (2016) Awake hippocampal reactivations project onto orthogonal neuronal assemblies. Science 353(6305):1280–1283. https://doi.org/10.1126/science.aaf3319
Mamad O, Stumpp L, McNamara HM, Ramakrishnan C, Deisseroth K, Reilly RB, Tsanov M (2017) Place field assembly distribution encodes preferred locations. PLoS Biol 15(9):e2002365. https://doi.org/10.1371/journal.pbio.2002365
Markus EJ, Qin YL, Leonard B, Skaggs WE, McNaughton BL, Barnes CA (1995) Interactions between location and task affect the spatial and directional firing of hippocampal neurons. J Neurosci 15(11):7079–7094
Mizumori SJY, Williams JD (1993) Directionally selective mnemonic properties of neurons in the lateral dorsal nucleus of the thalamus of rats. J Neurosci 13(9):4015–4028
Moser MB, Rowland DC, Moser EI (2015) Place cells, grid cells, and memory. Cold Spring Harb Perspect Biol 7(2):a021808. https://doi.org/10.1101/cshperspect.a021808
Nadel L, Samsonovich A, Ryan L, Moscovitch M (2000) Multiple trace theory of human memory: computational, neuroimaging, and neuropsychological results. Hippocampus 10(4):352–368. https://doi.org/10.1002/1098-1063(2000)10:4%3c352:AID-HIPO2%3e3.0.CO;2-D
Navratilova Z, Hoang LT, Schwindel CD, Tatsuno M, McNaughton BL (2012) Experience-dependent firing rate remapping generates directional selectivity in hippocampal place cells. Front Neural Circ 6:6. https://doi.org/10.3389/fncir.2012.00006
Neves G, Cooke SF, Bliss TV (2008) Synaptic plasticity, memory and the hippocampus: a neural network approach to causality. Nat Rev Neurosci 9(1):65–75. https://doi.org/10.1038/nrn2303
O’Keefe J, Dostrovsky J (1971) The hippocampus as a spatial map. Preliminary evidence from unit activity in the freely-moving rat. Brain Res 34(1):171–175. https://doi.org/10.1016/0006-8993(71)90358-1
Olafsdottir HF, Bush D, Barry C (2018) The role of hippocampal replay in memory and planning. Curr Biol 28(1):R37–R50. https://doi.org/10.1016/j.cub.2017.10.073
Park E, Dvorak D, Fenton AA (2011) Ensemble place codes in hippocampus: CA1, CA3, and dentate gyrus place cells have multiple place fields in large environments. PLoS ONE 6(7):e22349. https://doi.org/10.1371/journal.pone.0022349
Pennartz CM, Lee E, Verheul J, Lipa P, Barnes CA, McNaughton BL (2004) The ventral striatum in off-line processing: ensemble reactivation during sleep and modulation by hippocampal ripples. J Neurosci 24(29):6446–6456. https://doi.org/10.1523/JNEUROSCI.0575-04.2004
Poucet B, Hok V (2017) Remembering goal locations. Curr Opin Behav Sci 17:51–56. https://doi.org/10.1016/j.cobeha.2017.06.003
Rolls ET, Xiang JZ (2005) Reward-spatial view representations and learning in the primate hippocampus. J Neurosci 25(26):6167–6174. https://doi.org/10.1523/JNEUROSCI.1481-05.2005
Royer S, Sirota A, Patel J, Buzsaki G (2010) Distinct representations and theta dynamics in dorsal and ventral hippocampus. J Neurosci 30(5):1777–1787. https://doi.org/10.1523/JNEUROSCI.4681-09.2010
Rueckemann JW, Buffalo EA (2017) Spatial responses, immediate experience, and memory in the monkey hippocampus. Curr Opin Behav Sci 17:155–160. https://doi.org/10.1016/j.cobeha.2017.08.008
Sanders H, Ji D, Sasaki T, Leutgeb JK, Wilson MA, Lisman JE (2019) Temporal coding and rate remapping: representation of nonspatial information in the hippocampus. Hippocampus 29(2):111–127. https://doi.org/10.1002/hipo.23020
Sargolini F, Fyhn M, Hafting T, McNaughton BL, Witter MP, Moser MB, Moser EI (2006) Conjunctive representation of position, direction, and velocity in entorhinal cortex. Science 312(5774):758–762. https://doi.org/10.1126/science.1125572
Schlesiger MI, Boublil BL, Hales JB, Leutgeb JK, Leutgeb S (2018) Hippocampal global remapping can occur without input from the medial entorhinal cortex. Cell Rep 22(12):3152–3159. https://doi.org/10.1016/j.celrep.2018.02.082
Scholkopf B, Mallot HA (1995) View-based cognitive mapping and path planning. Adapt Behav 3(3):311–348. https://doi.org/10.1177/105971239500300303
Sekeres MJ, Winocur G, Moscovitch M (2018) The hippocampus and related neocortical structures in memory transformation. Neurosci Lett 680:39–53. https://doi.org/10.1016/j.neulet.2018.05.006
Singer AC, Frank LM (2009) Rewarded outcomes enhance reactivation of experience in the hippocampus. Neuron 64(6):910–921. https://doi.org/10.1016/j.neuron.2009.11.016
Smith DM, Mizumori SJ (2006) Hippocampal place cells, context, and episodic memory. Hippocampus 16(9):716–729. https://doi.org/10.1002/hipo.20208
Solstad T, Boccara CN, Kropff E, Moser MB, Moser EI (2008) Representation of geometric borders in the entorhinal cortex. Science 322(5909):1865–1868. https://doi.org/10.1126/science.1166466
Speakman A, O’Keefe J (1990) Hippocampal complex spike cells do not change their place fields if the goal is moved within a cue controlled environment. Eur J Neurosci 2(6):544–555. https://doi.org/10.1111/j.1460-9568.1990.tb00445.x
Strosslin T, Sheynikhovich D, Chavarriaga R, Gerstner W (2005) Robust self-localisation and navigation based on hippocampal place cells. Neural Netw 18(9):1125–1140. https://doi.org/10.1016/j.neunet.2005.08.012
Taube JS (1995) Head direction cells recorded in the anterior thalamic nuclei of freely moving rats. J Neurosci 15(1 Pt 1):70–86
Tryon VL, Penner MR, Heide SW, King HO, Larkin J, Mizumori SJY (2017) Hippocampal neural activity reflects the economy of choices during goal-directed navigation. Hippocampus 27(7):743–758. https://doi.org/10.1002/hipo.22720
Valdes JL, McNaughton BL, Fellous JM (2015) Offline reactivation of experience-dependent neuronal firing patterns in the rat ventral tegmental area. J Neurophysiol 114(2):1183–1195. https://doi.org/10.1152/jn.00758.2014
Wilber AA, Clark BJ, Forster TC, Tatsuno M, McNaughton BL (2014) Interaction of egocentric and world-centered reference frames in the rat posterior parietal cortex. J Neurosci 34(16):5431–5446. https://doi.org/10.1523/JNEUROSCI.0511-14.2014
Wilson MA, McNaughton BL (1993) Dynamics of the hippocampal ensemble code for space. Science 261(5124):1055–1058
Xiao Z, Nagl S, Lin K, Fellous J-M (2019) Continuous reward-place coding properties of dorsal distal CA1 hippocampus cells. Society for Neuroscience, Chicago
Zhang S, Manahan-Vaughan D (2015) Spatial olfactory learning contributes to place field formation in the hippocampus. Cereb Cortex 25(2):423–432. https://doi.org/10.1093/cercor/bht239
Acknowledgements
We thank Stephanie Nagl, Justin Lines and the members of the laboratory for the collection of the experimental data and also acknowledge the support from NSF: DMS-1821286 (KL) and NSF: Grants 1429929 and 1703340, ONR MURI N000141612829, and N000141512838 (JMF).
Author information
Authors and Affiliations
Corresponding author
Additional information
Communicated by Benjamin Lindner.
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
This article is part of the special issue entitled ‘Complex Spatial Navigation in Animals, Computational Models and Neuro-inspired Robots’.
Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
About this article
Cite this article
Xiao, Z., Lin, K. & Fellous, JM. Conjunctive reward–place coding properties of dorsal distal CA1 hippocampus cells. Biol Cybern 114, 285–301 (2020). https://doi.org/10.1007/s00422-020-00830-0
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00422-020-00830-0