Abstract
Conditioned place preference (CPP) is a widely used model of addiction-related behavior whose underlying mechanism is not understood. In this study, we used dual site silicon probe recordings in freely moving mice to examine interactions between the hippocampus and nucleus accumbens in cocaine CPP. We found that CPP was associated with recruitment of nucleus accumbens medium spiny neurons (MSNs) to fire in the cocaine-paired location, and this recruitment was driven predominantly by selective strengthening of hippocampal inputs arising from place cells that encode the cocaine-paired location. These findings provide in vivo evidence that the synaptic potentiation in the accumbens caused by repeated cocaine administration preferentially affects inputs that were active at the time of drug exposure. This provides a plausible physiological mechanism by which drug use becomes associated with specific environmental contexts.
INTRODUCTION
Cocaine addiction is a debilitating condition for which no highly effective treatments exist, in large part because the underlying mechanisms are not well understood. One of the simplest animal models of a cocaine addiction-related behavior is conditioned place preference (CPP), in which cocaine is repeatedly paired with a specific spatial location causing the animal to spend more time in that location during subsequent exploration. The association of spatial location and drug reward in CPP is believed to be related to clinically relevant drug seeking and relapse triggered by exposure to environmental contexts previously associated with drug use. However, despite its simplicity and relevance, the underlying mechanistic basis of cocaine CPP is still not understood.
The nucleus accumbens (NAc) is a part of the ventral striatum believed to play a central role in reward- and addiction-related behaviors including cocaine CPP. Medium spiny neurons (MSNs) in the NAc are known to fire preferentially near reward sites in over-trained animals1-4, providing a potential substrate for location-reward association. Focal lesions5 or D1 antagonist injections6 in the NAc block CPP acquisition, and focal amphetamine injections into the NAc are sufficient to induce CPP7, suggesting that this location-dependent NAc activity may drive CPP behavior.
A large glutamatergic inputs to the NAc arises from the CA1 and subiculum regions of the hippocampus (HPC)8, which contain “place cells" that fire selectively in specific spatial locations9, 10 or contexts11. Simultaneous HPC-NAc recordings in rats suggest that hippocampal inputs carry spatial information to the NAc4, 12-14, and lesion disconnection experiments indicate that hippocampus-accumbens interactions are necessary for CPP15. However, the mechanism by which these inputs could mediate reward location-dependent MSN activity is not known.
One possibility is based on the well-established finding that hippocampal place cells are disproportionately likely to fire near reward locations16, 17. In this model (Fig. 1a), NAc MSN firing at reward locations passively reflectschanges in hippocampal firing patterns. Focal injection of amphetamine into the hippocampus is sufficient to induce place preference, supporting this possibility18. However, cocaine exposure also potentiates synaptic inputs to the NAc19, 20, and NMDA receptor blockade prevents CPP acquisition21, suggesting that synaptic plasticity in the NAc may be necessary for CPP. Repeated cocaine exposure has been shown to increase the average strength of hippocampal synapses onto D1-positive MSNs in the NAc22, 23, but other studies have shown that potentiation of individual synapses on D1-positive cells requires presynaptic activity24. This led us to consider a second model (Fig. 1a), in which we hypothesize that cocaine conditioning preferentially potentiates synaptic inputs to the NAc that were the most active at the time of cocaine exposure. For hippocampal inputs, this would correspond to synapses arising from place cells that encode the cocaine-paired location.
To determine whether place cell density increase in the rewarded environment alone underlies location-specific MSN firing or whether selective synaptic plasticity is the main contributor, we performed simultaneous dual site silicon probe recordings in the HPC and NAc of freely moving mice in a cocaine CPP paradigm. Our findings indicate that cocaine conditioning recruits location-specific MSN firing in the NAc that is driven by hippocampal inputs. Although cocaine conditioning somewhat increased the density of hippocampal place fields in the cocaine zone, we found that hippocampus-accumbens coupling was also strengthened and that this effect was a larger contributor to location-specific MSN firing than hippocampal place cell enrichment.
RESULTS
Dual site silicon probe recording during cocaine conditioned place preference
To measure functional interactions between the hippocampus and NAc in cocaine CPP, we performed simultaneous silicon probe recordings in both structures during CPP behavior (n = 6 mice) (Fig. 1b). We used established waveform and bursting criteria to identify putative pyramidal cells (PYRs)25, 26 in the hippocampus (n = 561 PYRs) and medium spiny neurons (MSNs) and interneurons (INs) in the NAc (n= 1293 MSNs, 313 INs; Supplementary Fig. 1)27, 28. Recordings were performed before (PRE) and after (POST) animals underwent cocaine place conditioning in a rectangular arena with a removable barrier (Fig. 1c, Supplemental Fig. 2). We recorded 1-3 daily 30-minute PRE sessions prior to five consecutive days of cocaine conditioning, then 1-5 daily 30-minute POST sessions. This conditioning paradigm induced robust CPP in POST sessions (PRE = 27% in cocaine zone, POST = 51%, Wilcoxon rank sum test, n = 12 PRE, 15 POST sessions, P = 1.6 × 10−6; Fig. 1d), which was attributable to an increase in the proportion of time spent immobile in the cocaine zone (Supplementary Fig. 3).
Cocaine conditioning selectively increases MSN firing in the cocaine zone
We found that after cocaine conditioning, NAc MSNs fire at higher rates when the animal is in the cocaine zone than the saline zone (Cocaine index = −0.009 ± 0.011 PRE, 0.094 ± 0.013 POST, n = 545, 748 MSNs, unpaired t-test, P = 4.6 × 10−9; Fig. 2a). This effect was not seen in NAc INs (n = 162, 151 INs, unpaired t-test, P = 0.88, Fig. 2b), and for hippocampal PYRs a trend was noted that failed to reach statistical significance (n = 184, 377 PYRs, P = 0.11, Fig. 2c). However, the density of PYR place fields was higher in the cocaine zone in POST sessions (P = 2. 6 × 10−8, Supplementary Fig. 4). Further, we found that the strength ofbehavioral CPP expression in a given POST session is correlated with the extent of increased MSN firing in the cocaine zone during that session (n = 15 POST sessions, R = 0.62, P = 0.01, Fig. 2d). This correlation occurs only in POST sessions and was not observed in NAc INs (R = 0.3, P = 0.27; Fig. 2e) or hippocampal PYRs (R = 0.1, P = 0.72;Fig. 2f). These observations support our hypothesis that cocaine CPP involves similar reward location-dependent MSN activity to that seen with non-drug rewards and prompted us to explore whether hippocampal inputs provide the location information utilized by MSNs.
MSNs exhibit signatures of decoding spatial location and running speed from hippocampal inputs
Although our CPP protocol was designed to ensure that CPP was hippocampus-dependent15, 29 (Supplementary Fig. 2), we first focused on analysis of spatial firing patterns of MSNs to verify that location-dependent MSN firing was driven by hippocampal inputs. Our initial analysis found that MSNs exhibit spatially biased firing patterns and also exhibit modulation by running speed (not shown). This complicates the analysis of MSN firing because CPP behavior fundamentally entails a strong correlation between movement and spatial location (Supplemental Fig. 3). We attempted to disentangle this issue using generalized linear models (GLMs) and model cross-validation, finding that the best model fit included separate terms for location and speed modulation (Supplemental Fig. 5a-b). The GLM method enabled us to analyze these two phenomena separately and determine that MSNs exhibit running speed modulation that is independent of location and stronger than HPC PYRs (n = 1293 MSNs, 561 PYRs, Wilcoxon rank sum test, P = 3.9 × 10−18), which in turn are more strongly modulated than NAc INs (Fig. 3b, n = 561 PYRs, 313 INs, Wilcoxon rank sum test, P = 3.0 × 10−5). After correcting for running speed, MSNs encoded approximately as much spatial information30 as hippocampal PYRs (Fig. 3c, n = 1293 MSNs, 561 PYRs, Wilcoxon rank sum test, P = 0.20) and significantly more than INs (n = 1293 MSNs, 313 INs, P = 1.1 × 10−38). Since the same MSNs tend to exhibit high spatial information and running speed modulation (Fig. 3d), we hypothesized that they may receive both spatial and speed information via inputs from the hippocampus. To test this, we used GLMs to predict MSN spike trains from combinations of hippocampal activity, location, and running speed (Fig. 3e). Using cross-validation, we found that adding hippocampal activity to a model containing no information other than baseline firing rate led to improvements in prediction quality. However, the improvement in prediction quality was smaller if we added hippocampal activity to a model that already contained information about location (Fig. 3f, n = 1203 MSNs, Wilcoxon signed rank test, P = 4.1 × 10−11) or running speed (Fig. 3g, n = 1203 MSNs, Wilcoxon signed rank test, P, n = 1203 MSNs, Wilcoxon signed rank test, P = 6.3 × 10−23). This is fully consistent with NAc MSNs decoding information about running speed and spatial location from hippocampal inputs. The prediction quality was highest when HPC led NAc by a time lag of ~30 ms (Fig. 3h), suggesting that this effect represented information transfer from HPC to NAc rather than both structures receiving this information from a common input.
Assembly prediction analysis reveals increased hippocampus-accumbens coupling after cocaine conditioning
We next addressed the question of whether hippocampal inputs to the accumbens are strengthened by cocaine conditioning. To test this, we performed an assembly prediction analysis using PYR assemblies as predictors in a linear model that predicts the activity of a single MSN assembly (Fig. 4a, Supplemental Methods). Consistent with our hypothesis that MSNs decode spatial information from hippocampal inputs, we found that the quality of the assembly prediction was correlated with the rate of spatial information encoded by the MSN assembly in POST, but not PRE, sessions (Fig. 4b). The spatial information rate was also higher in POST sessions (Fig. 4c, n = 34, 95 assemblies, Wilcoxon rank sum test, P < 0.05), suggesting that cocaine conditioning strengthens hippocampus-accumbens coupling.
To strengthen our finding that our assembly predictions were not due to hippocampus and accumbens being driven by common inputs or sensory cues in the CPP arena (Fig. 3h), we performed an analysis of sleep replay events. Replay events, which occur during hippocampal sharp-wave ripple oscillations, consist of temporally compressed firing of place cells sequences that encode recently visited spatial locations31-33 and are generated locally in the hippocampus34. We used data from awake exploration of the CPP arena to fit the prediction weights of the GLM, then tested model predictions both on awake data withheld from the training set and on data collected during sleep ripples occurring before and after the animal explored the CPP arena. We found that during pre-exploration sleep, when replay events encoding locations in the CPP arena do not occur, the sleep ripple prediction quality was uncorrelated with wake prediction quality (Fig. 4d). In contrast, during post-exploration sleep the sleep ripple prediction quality was significantly correlated with wake prediction quality in POST sessions (Fig. 4e), indicating strengthened hippocampus-NAc coupling.
Hippocampally-modulated MSNs are preferentially recruited to fire in the cocaine zone
We next turned to the question of whether strengthened hippocampal inputs mediate the recruitment of additional MSN activity in the cocaine zone. To this end, we used simultaneous LFP recordings in the hippocampus to determine how strongly each MSN is phase-locked to the hippocampal theta oscillation. Several prior studies indicate that phase-locking with hippocampal theta is a marker for MSNs receiving strong hippocampal inputs12-14, 35. We found that MSNs with high theta modulation encode more spatial information than MSNs with low theta modulation (Supplemental Fig. 6a) and are overrepresented among cells with either high and low cocaine indices (Fig. 5a, Supplemental Fig. 6b). Dividing the MSNs into high-theta and low-theta halves, we found that the high-theta half shifts after conditioning toward encoding the cocaine zone (PRE 0.0082 ± 0.013, POST 0.087 ± 0.017, n = 261, 351 MSNs; Unpaired t-test, P = 2.7 × 10−4, Fig. 5b), while the low-theta half does not (PRE 0.0027 ± 0.016, POST 0.014 ± 0.016, n = 261, 351 MSNs; Unpaired t-test, P = 0.43, Fig. 5c). This suggests that strengthening of hippocampal inputs underlies recruitment of MSN firing to the cocaine zone.
Selective strengthening of hippocampal inputs is a larger contributor of MSN recruitment to the cocaine zone than increased density of place fields
Increased hippocampally-driven MSN activity in the cocaine zone could be due either to 1) increased hippocampal place field density in the cocaine zone or 2) selective strengthening of synapses arising from PYRs encoding the cocaine zone (Fig. 1a). Our results indicate that the MSNs shift their spatial tuning more than the PYRs (Fig. 2) and that hippocampus-accumbens coupling is strengthened (Fig. 4), both of which support the second model where changes in synaptic strength are responsible. However, PYRs show a nonsignificant trend toward additional firing in the cocaine zone (Fig. 2c) and exhibit a higher density of place fields in the cocaine zone after conditioning (Supplemental Fig. 4), which prompted us to address this question more rigorously. To this end, we fit a GLM to find connection weights that optimally predict MSN activity based solely on hippocampal activity (Fig. 6a). We then used this model with cross validation to generate predictions of each MSN’s spike train, from which we calculated a cocaine index. Although the model contains no explicit location information, the cocaine indices predicted from hippocampal activity alone were significantly correlated with the observed cocaine indices (n = 531, 713 MSNs; PRE R = 0.45, P = 1.2 × 10−7; POST R = 0.59, P = 6.8 × 10−68; Fig.6b), indicating that hippocampal activity is sufficient topredict MSN cocaine index.
To determine whether changes in PYR place fields were responsible for recruitment of MSN activity, we examined the PYR cocaine indices, which summarize the aspects of PYR spatial tuning that contribute to the MSN cocaine index. We compared the distribution of PYR cocaine indices with positive values to those with negative values, which represent PYRs encoding the cocaine and saline zones, respectively. There was no difference in PRE sessions (Fig.6c) but in POST sessions the magnitude of the indices waslarger for cocaine zone PYRs (n = 164, 205 PYRs, median 0.15 vs. 0.24; Wilcoxon rank sum test, P = 2.6 × 10−4, Fig. 6d), confirming that place cells over-represent the cocaine zone. To determine whether this over-representation plays a direct role in the recruitment of additional MSN activity, we adjusted the spike trains of PYRs encoding the cocaine zone so that the distribution of cocaine zone PYR index magnitudes matched those of saline zone PYRs. By comparing predicted MSN cocaine indices before and after the adjustment, we were able to quantify the contribution of PYR place field over-representation to MSN location tuning. In PRE sessions, this adjustment caused no change in predicted MSN cocaine indices (n = 531 MSNs, Wilcoxon signed rank test, P = 0.83, Fig. 6e), but in POST sessions the MSN indices showed asignificant shift away from the cocaine zone (n = 713 MSNs, Wilcoxon signed rank test, P = 5.4 × 10−4, Fig. 6f).
We next performed the same analysis with PYR to MSN connection weights, comparing the weights arising from hippocampal PYRs that encode the saline vs. cocaine zones. In PRE sessions there was no difference (n = 2011, 2036 weights, Wilcoxon rank sum test, P = 0.10; Fig. 6g), but in POST sessions connection weights arising from cocaine zone PYRs were significantly larger (n = 2014, 1981 weights, Wilcoxon rank sum test, P = 1.4 × 10−6; Fig. 6h). To test whether this asymmetry in connection weights was responsible for the recruitment of MSN activity to the cocaine zone, we adjusted connection weights so that the distributions would be equal. In PRE sessions, this adjustment caused no change in MSN cocaine index (n = 531 MSNs, Wilcoxon signed rank test, P = 0.39, Fig. 6i), but in POST sessions the MSN indices showed a significant shift away from the cocaine zone (n = 713 MSNs, Wilcoxon signed rank test, P = 3.4 × 10−8, Fig. 6j).
Since both place field changes and synaptic weight changes contributed significantly to increased MSN activity in the cocaine zone, we compared the changes directly to determine which was a larger contributor. In POST sessions, the two effects contributed equally to the location tuning properties of MSNs encoding the saline zone (n = 355 MSNs, Wilcoxon signed rank test, P = 0.29, Fig. 6k). However, for MSNs encoding the cocaine zone, changes in connections weights were a larger contributor than changes in PYR place fields (n = 340 MSNs, Wilcoxon signed rank test, P = 5.5 × 10−9, Fig. 6l).
DISCUSSION
In this study, we found that cocaine place conditioning recruits NAc MSNs, and to a lesser extent hippocampal PYRs, to fire in the cocaine-paired zone. We also found that MSNs receive information about spatial location from PYRs, cocaine conditioning increases hippocampus-accumbens coupling, and MSNs modulated by the hippocampal theta rhythm show the strongest recruitment to the cocaine zone, all of which suggest that this effect is driven by hippocampal inputs to the NAc. Finally, we found that MSN recruitment is driven predominantly by preferential strengthening of hippocampal inputs encoding the cocaine zone.
Although extracellular recording is not able to make direct measurements of synaptic strength, repeated cocaine exposure has been shown to potentiate hippocampal inputs to NAc MSNs in vitro22, 23, and dopamine-dependent synaptic potentiation in MSNs requires presynaptic activity24. This suggests that hippocampal synapses onto MSNs that arise from place cells encoding the cocaine zone would be preferentially potentiated, providing the most likely cellular substrate for the selective increase in hippocampus-NAc coupling that we observe. This also provides a possible explanation reconciling the conflicting results of Britt et al.23, who found that cocaine selectively strengthened hippocampal inputs to the NAc, and MacAskill et al.36, who found that cocaine selectively strengthened amygdalar inputs. Our results suggest instead that cocaine may preferentially strengthen the most active inputs, which could be predominantly hippocampal or amygdalar depending on the environmental conditions during cocaine exposure. It is worth emphasizing that our place conditioning paradigm (Supplemental Fig. 2) pairs cocaine with a spatial location defined relative to distal navigational cues, while proximal sensory cues were minimized and counterbalanced across cocaine/saline conditions. Under similar conditions, CPP has been shown to be dependent on dorsal hippocampus and not ventral hippocampus or amygdala29, 37, but in CPP paradigms incorporating proximal sensory cues that differ between the cocaine and saline zones, circuits beyond dorsal HPC are likely recruited as well.
Our results appear to contradict those of German et al. 38, who recorded neurons in the NAc during CPP POST sessions in rats and found that NAc MSNs exhibit decreased firing rates in the drug-paired zone. A possible explanation for this difference is that their study used morphine, and ours used cocaine. An interesting paradoxical observation is that both morphine and cocaine produce CPP, self-administration, and other addiction-related behaviors, but cocaine exposure increases the density of dendritic spines in the NAc and morphine decreases it39, 40. This paradox was addressed recently by Graziane et al.41, who found that cocaine exposure forms new spines selectively on D1-positive MSNs, while morphine exposure prunes spines selectively on D2-positive MSNs. Given the previous observation that cocaine selectively potentiates hippocampal inputs onto D1-positive MSNs in the NAc22, it is tempting to speculate that the increased firing we observed in the cocaine-paired zone is attributable to D1-positive MSNs, while the decreased firing German et al. observed in the morphine-paired zone is attributable to D2-positive MSNs. A recent study by Calipari et al.42 using fiber photometry provides some support for this hypothesis, but resolution of this issue will ultimately require future studies combining dual site unit recordings in the hippocampus and NAc with optogenetic tagging43 of D1- or D2-positive MSNs.
Selective plasticity supports a plausible mechanistic model of cocaine CPP in which the NAc acts as an action-location-outcome associator44, 45. We hypothesize that the NAc integrates hippocampal inputs encoding a spatial location and prefrontal cortical inputs encoding an action plan to generate actions appropriate for a given spatial context. Under physiological conditions, performing an action in a specific location that generates a positive reward prediction error causes dopamine release in the NAc46. This would strengthen hippocampal synapses encoding the rewarded location, increasing the expected reward outcome associated with that action/location pairing. During cocaine place conditioning, NAc dopamine levels are artificially elevated, effectively rewarding all actions performed in the cocaine zone and increasing the strength of hippocampal inputs encoding that location. Upon exposure to the cocaine zone in POST sessions, the strengthened hippocampal inputs would drive increased firing in NAc MSNs, leading the animal to engage in activity in the cocaine zone rather than run to the saline zone. Determining whether this model is correct will require further studies involving multisite unit recording and manipulation of prefrontal cortex in CPP.
It is believed that drugs of abuse exert differential effects at various synaptic pathways in the brain – our results suggest that synaptic changes can be specific even at the level of functionally defined subsets of synapses within a single synaptic pathway. This reveals an additional layer of complexity that is not recognized in many circuit models of drug addiction and suggests that some of these models may require revision. Selective plasticity of specific corticostriatal synapses based on presynaptic firing properties has been observed in other striatal regions47 and may represent a canonical mechanism by which sensory and contextual information can bias action selection based on reward history.
ACKNOWLEDGMENTS
The authors thank Gord Fishell, Lisa Roux, and the members of the Buzsáki lab for support and helpful suggestions. We also thank Viola Woo for technical assistance. This work was supported by the Leon Levy Foundation (L.S.), the Brain and Behavior Research Foundation (L.S.), and NIH grants K08 DA036657 (L.S.) and MH107396 (G.B.).
AUTHOR CONTRIBUTIONS
L.S. and G.B. conceived and designed the study. L.S., A.C., and D.C. performed experiments, and L.S., A.P., and A.C. analyzed the data. L.S. and G.B. wrote the paper.