ABSTRACT
Physical activity is an integral part of every mammal’s daily life, and as a driver of Darwinian fitness, required coordinated evolution of the body and brain. The human population is currently in its most historically sedentary state, creating a global health crisis - necessitating improved understanding of exercise motivation. The decision to engage in physical activity can be driven by survival needs (e.g., escaping danger) or by the motivation for the rewarding nature of physical activity itself (e.g., running exercise). Rodents exhibit innate and learned motivation for voluntary wheel running exercise, and over time run for longer durations and distances, reflecting increased incentive salience and motivation for this consummatory behavior. Daily motivation for running is highly variable, which necessitates dynamic coordination of neural and somatic physiology (e.g., action planning and associated metabolic demand) to ensure the ability to carry out the planned activity. Hippocampal sharp wave-ripples (SWRs) evolved both cognitive (e.g., action planning) and metabolic (e.g., blood glucose regulation) functions, suggesting a role in such body-brain coordination. Here we monitored hippocampal CA1 local field potential activity and running levels in adult mice, while manipulating the incentive salience of running. During non-REM (NREM) sleep, the duration of SWRs before (but not after) running positively correlated with future time spent running, while in contrast, the rate of SWR occurrence both before and after exhibited a positive correlation. Because SWR durations reflect information content and rates reflect both information and metabolic signaling, our results suggest multiplexing of SWR dynamics as a mechanism supporting both cognitive and metabolic aspects of exercise. We hypothesize that SWRs coordinate body-brain interactions to a greater extent than previously known.
Introduction
Throughout mammalian evolution, physical activity has been a significant driver of Darwinian fitness, with the body and brain co-evolving, concomitantly increasing in complexity at the level of structure and function1. As spatial navigation behaviors increased, the concurrent need to learn and remember the environment also increased, enhancing success in foraging and reproduction2. Today however, physical inactivity in humans has become a global health crisis3, with sedentary behaviors increasing the risk for a range of health issues including obesity, diabetes, heart disease, stroke, and cancer4. Conversely, physical activity improves physical and mental health5, making understanding exercise motivation a critical and timely scientific and societal issue.
The hippocampus is functionally positioned to play an important yet relatively unexplored role in exercise motivation, as it supports learning and memory6 (including reward learning), planning of future actions7–11 and although less acknowledged is involved in somatic physiology12–14. Critical to all of these functions are CA1 sharp wave-ripples10 (SWRs), during which specific populations (i.e. cell assemblies) of CA1 neurons become highly active8–10,15–17, selected by computations involving interaction between excitation and inhibition10,18,19, sending the final product of hippocampal computation to the rest of the brain10,20–22. Interestingly, recent findings have shown that in addition to cognitive functions (largely involving hippocampal-neocortical dialogue), SWRs serve a specific somatic function: dynamically regulating peripheral glucose levels by communicating with the lateral septum14. The differential translation of hippocampal SWR output by neocortex16,21–26 and lateral septum14,27 may thus enable multiplexing of cognitive and somatic functions. Furthermore, multiple hippocampal rhythms including SWR and theta are entrained to and driven by respiration28–31, furthering the evidence of the important somatic/metabolic role of SWRs. Considering these dynamic roles of SWRs as modulators between the body and brain, we hypothesized that SWRs serve essential functions in behaviors that require enhanced body-brain coordination including physical activity.
Physical activity, in the form of voluntary (but not forced) wheel running, holds positive incentive salience for rodents32–34. Critically, motivation for wheel running exercise can be quantified through the magnitude of the rebound running response after days of wheel deprivation35. We thus investigated dynamics of SWRs during NREM sleep in a rodent model exhibiting high levels of motivation for this behavior36. We monitored hippocampal local field potentials (LFP) before, during, and after two hours of voluntary exercise; both on consecutive days and after days of wheel deprivation32 (deprivation increases incentive salience and thus running levels). Differences in daily motivation to run were associated with changes in sleep architecture and SWR dynamics including rates and durations. These results suggest a previously unknown role for SWRs in the motivation for physical activity.
Results
Plastic motivation for voluntary wheel running in BL/6J x FVB/NJ hybrid mice chronically implanted with silicon probes
To identify relationships between voluntary physical activity and hippocampal network oscillations we monitored wheel running (Fig 1A) and hippocampal extracellular field potentials (Fig 1B) in freely behaving mice under the SRS protocol (Fig 1A; See Methods). Hybrid mice36 were chosen because they are a more ethologically relevant model compared to inbred strains. We analyzed data only from days after which the wheel running experience was no longer novel (i.e. day 3 and on) because novelty generally produces variability in behavior across animals, and specifically alters SWR dynamics8–10,15,16,37 (also see Methods). Time spent running increased over days (Fig 1D; r =0.59, p=0.001), and deprivation resulted in a subsequent rebound response upon return of the wheel (Fig 1C; t(3)=-3.798, p=0.032), confirming mice found wheel running rewarding. We observed canonical relationships between behavioral states and hippocampal oscillations10,22,38: theta oscillations were most prevalent in wake and REM sleep, whereas SWRs were most prevalent in NREM sleep. Importantly, wheel running bouts were accompanied by sustained theta oscillations, resulting in a positive correlation between theta power and time spent running. (Fig 1E; r = 0.68, p=0.001). The SRS protocol thus meets the need of our study in that mice chronically implanted with silicon probes exhibit normal exercise behaviors and hippocampal activity.
A. Behavioral Protocol. B. Example silicon probe recording CA1-DG 64 channel probe with 20 micron spacing implanted during SRS protocol.LFP traces are 150 ms illustrating a SWR event C. Mean running on consecutive and rebound days.( t(3)=-3.798, p=0.032) D. Running over Days (r= 0.59,p= 0.001) E. Hippocampal theta correlates with running duration (r= 0.68, p=0.001).
Anticipation of rewarding exercise results in increased wakefulness and compressed NREM sleep
We quantified relative time spent in different sleep/wake states using established methods39, Fig 2A, and found that on rebound days mice spent significantly more time awake in Pre as compared to Post exercise epochs (p=0.01). We found the opposite relationship for NREM sleep, and over days the percent time in NREM in Pre epochs was negatively correlated with future time spent running (Fig 2C; r=-.676, p=0.0001) The opposite was true for NREM in Post epochs (Fig 2D; r=.426 p=0.026). Intriguingly, in Pre there is a significant negative correlation between SWR rates and the % time spent in NREM sleep (r=-0.6337, p= 0.0003), as well as significant negative correlations between inter-SWR-interval (ISI) and future time spent running (r=-0.50899, p=0.006), suggesting an anticipation driven compression of required SWR mediated computations into a shorter duration of time. This was not the case for Post epoch correlations between ISI and running duration (r=-0.37591, p=0.0533) or SWR rates and the % time spent in NREM (r=0.363, p=0.06). Thus, periods of increased running were preceded, but not followed, by compressed NREM sleep.
A. Representative hypnograms of a consecutive day and a rebound day, for the entire period of recording. Note only one consistent segment of NREM on the rebound day but two on the consecutive day. Also note that on rebound day the mouse was awake the entire period with the wheel, which is not the case on the consecutive day B. Summary figure of the proportion of time spent in wake,NREM and REM states in Pre (top) and Post (bottom) on consecutive and rebound days for one mouse C. Correlation between running and the percentage of time spent in NREM sleep duπng PRE (r=-.676, p=0.0001) D. Correlation between running and the percentage of time spent in NREM sleep during POST (r=.426 p=0.026).
SWR rates correlate with daily exercise performance while SWR durations correlate with future exercise levels
We compared SWRs in NREM sleep in Pre and Post run epochs in adult female mice. Neither SWR mean power or frequency exhibited significant correlations with exercise levels (data not shown). Rates and durations of SWRs, however, were related to daily exercise levels (Fig 3). NREM SWR rates in both Pre and Post epochs were positively correlated with daily running levels (Fig 3: A,B,C), which may be related to the daily energy expenditure of the animals. SWR durations in Pre NREM were significantly positively correlated with future exercise levels which was not observed in Post NREM epochs (Fig 3: D,E,F). In parallel, the percent of long duration40 SWRs were significantly positively correlated with future exercise levels in Pre but not Post (Fig 3: G,H,I). These data suggest that SWRs dynamically encode the motivation for anticipated exercise.
SWR rate in Pre and Post correlate with time spent running (A,B,C). Sharp wave-ripple duration in Pre but not Post NREM sleep is correlated with time spent running. Relationships between Pre and Post run SWR duration (D,E,F) or percent of long duration SWRs (G,H,I) and time spent running. Note that SWR activity before but not after running, as well as the differences between these timepoints, are both significantly positively correlated with time spent running each day. Each color is a single mouse and each point is data from a single day X-axis legend in A is the same for all panels
Discussion
Running is a naturally rewarding consummatory behavior
Our data demonstrate that running is a rewarding behavior in mice. First, we demonstrated that mice increase their running over days. Second, we found that mice exhibit the rebound running response after deprivation, previously only shown in rats 32,35. Interestingly, this behavior was observed after only 7 days of acute running experience, while previous studies in rats reported that this behavior only occurs after habitual, plateau levels of running are reached32,35. Specifically, rebound running distance and rates on days 14 and 21 reached peak levels, above those demonstrated on the final consecutive day of running (day 7). This phenomenon is akin to what occurs after deprivation from other natural or pharmacological reinforcers such as food or drugs of abuse. To this point, we previously used a conditioned place preference model to show that running can be as rewarding as cocaine35. These new findings demonstrate that the motivation comes on board with only 7 days of consummatory behavior of the wheel running experience.
Furthermore, it is important to note that although from the perspective of hippocampal rhythms consummatory behaviors are typically associated with a cessation of theta oscillations and the occurrence of SWRs, exercise32–35 and sex41,42 are two prominent examples of innately rewarding consummatory behaviors which are associated not with SWRs but with sustained theta oscillations.
Exercise modulates sleep architecture during anticipation of the running experience
When mice are anticipating the reward of running, they spend more time awake and less time asleep, with this effect being most prominent during rebound days to the point where some mice spend their entire anticipatory period awake (Fig.2 A,B). Additionally, when mice fall asleep during this anticipatory period, they spend the majority of their time in NREM (compared to REM) sleep with the percentage of NREM sleep negatively correlating to the time spent running (Fig 2C). That is, the more the mouse is motivated to run, the more time they spend awake and the less time they spend in NREM sleep before running. However, after the running experience, high levels of exercise motivation (i.e., time spent running) correspond to more NREM sleep (Fig. 2D). This latter finding is consistent with the human literature showing that both acute (a single bout) and chronic exercise produces longer periods of NREM sleep and shorter periods of REM sleep43. Additionally, extant literature has revealed that exercise enhances overall quality of sleep including shorter sleep onset latency44, time awake after sleep onset and longer total sleep time45. We newly show that during an anticipatory running period, mice will regulate their sleep-wake cycles. That is, the external signal that the experience of running will soon be available alters the circadian pattern of the rodent such that awake periods are more prominent prior to (as compared to after) the running experience. Other literature has shown that such learned responses (e.g., food becoming available at a certain time of day) can alter circadian responses of other consummatory behaviors such as eating/feeding46. Our findings reveal a general phenomenon regarding entrainment of natural behaviors (including physical activity and sleep), and that the timing of when these events occur in relation to one another can affect the temporal relationship of said behaviors.
SWR dynamics encode exercise motivation and performance
SWRs are commonly studied using metrics including oscillation frequency, power, event duration, rate, and (ISI). We found that SWR frequency and power were not related to exercise behaviors, as expected since SWR frequency is in general fixed across and during learning and memory tasks10, with changes in frequency being associated with pathological states10,47,48. In contrast, duration, rate, and ISI demonstrated unique relationships with exercise motivation and performance which suggest a role for SWRs in multiple aspects of exercise behaviors. Of note, in both rate and durations, all correlations were stronger for Pre as compared to Post, with the differences in rates (Pre - Post) showing positive correlation with exercise levels, suggesting anticipatory functions for both SWR rates and durations. Nevertheless, the discrimination between rate and duration of SWRs is paramount, as distinct functions have been ascribed to modulations of each metric. Critically, increased SWR duration is driven by the participation of more neurons (i.e., larger assemblies), which carry more information. These results suggest that the spiking content of SWRs is directly related to the anticipated and rewarding future exercise.
Conclusions
We identified a novel role for SWRs in coordinating neuronal and physical activity: encoding motivation for future exercise in the activity of CA1 cell assemblies in SWRs. This suggests that both motor and cognitive processes are integrated within the same neuronal circuits - evidence for embodied cognition (i.e., the embodied brain). This perspective may help to reconcile the dichotomous theories of the hippocampus as a spatial map versus the seat of learning and memory. The hippocampus may thus be a core embodied center of the brain supporting somatic and cognitive processes, as well as their coordination through time. This perspective directly aligns with the co-evolution of the body and brain.
Importantly these results are novel and separate from SWR preplay49 and replay8,9,15,16. These concepts regard the structure of pre-existing and/or learned spatial maps. Our results instead introduce the novel concept that cell assembly dynamics in NREM SWRs encode a plastic representation of the motivation for a future innate consummatory behavior. We further hypothesize that incepting such activity could be used as a method to increase exercise motivation and performance.
DISCLOSURES
The authors have no disclosures to report.
Methods
Experimental considerations
For all experiments, we utilized four exercise-naïve BL/6J x FVB/NJ female mice. This mouse strain was utilized as previous work 1 has demonstrated high levels of cognitive functioning and low levels of anxiety compared to typical monogenic strains (e.g C57), making them a more ethologically relevant model to study a naturalistic behavior such as physical activity. Considering that this study focused on the motivation for voluntary exercise, we intentionally chose to use females, as the voluntary wheel running distances and rates are 1.5 times that of males2, females run more consistently across the lifespan and have higher mean levels of physical activity2 (particularly at the adult timepoints we are studying). To limit inter-animal variability in both physiology and behavior, all animals were housed identically in the same room of our animal facility, and recordings and behavioral tasks were completed in the same behavioral testing rooms at the same time of day to insure that observed differences were not due to location or circadian rhythms. To minimize effects of age, all mice used were in the range of PND 60. Young adult mice (~PND 60) were used for this study, as wheel running is most robust during this time period. All mice received ad libitum food and water, as food and/or water deprivation have been shown to alter wheel running patterns67. Finally, room temperatures, light/dark cycles, noise level, and odors were monitored and kept constant to eliminate any additional stressors. All procedures were approved by the Institutional Animal Care and Use Committee at Virginia Tech.
Behavioral task
We utilized the Sleep Run Sleep (SRS) protocol for measuring hippocampal activity and exercise behaviors. The SRS protocol was developed to measure hippocampal LFP biomarkers in the context of acute exercise experience. Under the SRS protocol, exercise-naïve female BL/6J x FVB/NJ mice were chronically implanted with a 64-channel silicon probe (Cambridge Neurotech) spanning the hippocampus from the CA1 through the dentate gyrus granular cell layer at 10–12 weeks old. Under the SRS protocol, neural activity is recorded throughout behavioral tests and sleep sessions; this protocol therefore enabled us to examine sleep architecture and signaling before and after behavior. These recordings were obtained during the animal’s light cycle to ensure the capture of substantive sleep physiology. The SRS protocol begins with 90 minutes of sleep in the home cage, followed by 2 hours of running wheel access in a novel cage, and ending with another 90 minutes of sleep in the home cage. The LFP was recorded continuously and synchronized with video of the running phase activity. Following the collection of baseline sleep activity, we collected 7 days of consecutive SRS recordings to examine effects across time. Due to neophobia, we found that the animal’s interaction with the wheel on the first two days was very variable between animals, but stabilized by day 3. Therefore, we only considered data from day 3 and after in our analyses. Two rebound-SRS recordings were collected 7 and 14 days after the last consecutive day to examine rebound running behaviors and hippocampal activity during different motivational states. Running behaviors were analyzed using the MedAssociates, Inc. low-profile wireless running wheel for mice (ENV-047) and wheel running software, as well as manual scoring for total duration of running (seconds) per running phase. Overall, the SRS protocol (informed by our previous work on exercise motivation) allowed us to examine hippocampal physiology during both the initial phase of consecutive-day running and the rebound running response phase on days after deprivation10.
Chronic Hippocampal Extracellular recordings in freely behaving mice
Mice were chronically implanted with 64-channel linear silicon probes (Cambridge NeuroTech) across the hippocampus. These probes allowed us to record electrical activity over >1 mm with 20 microns resolution to identify anatomically localized activity across the dentate gyrus (DG) and CA regions. Recordings were obtained using a digital multiplexing amplifier (Intan Technologies LLC) sampled at 30 kHz and synchronized with overhead video.
Analysis of Local Field Potentials
Analysis was performed using custom MATLAB scripts including those based on freely available functions from the Buzcode toolbox https://github.com/buzsakilab/buzcode.
Ripple Detection
Ripple Detection was performed using standard algorithms as we have previously published3,4.
State Scoring
Segmentation of data into brain states (i.e. Wake, REM, NREM) was performed using previous methods5. Briefly, periods of each state were segregated based upon a combination of characteristic features of LFP and EMG activity.
Statistics
All statistical analyses were performed in MATLAB (MathWorks). We observed highly variable behavior on the first and/or second days in different animals (data not shown), which were no longer present by day 3, as such statistical analyses are restricted to day 3 forward with the exclusion of days in which sleep was not captured within resting epochs. Considering that significant interindividual variability in running distance was observed, we conducted calculations to normalize wheel running distance (e.g., daily distance/maximum daily distance or Z-scored distance), and cross-validated normalization procedures to make accurate and robust quantification of exercise. We investigate the relationship of daily wheel running behaviors on all variables of interest (e.g., SWR rate and duration) by computing the Pearson’s linear correlation coefficient and p-values using a student’s t distribution for a transformation of the correlation.
ACKNOWLEDGMENTS
DFE is supported by grants from The Simons Foundation and The Whitehall Foundation. JCB is supported by the iTHRIV Scholars Program, which is supported in part by the National Center for Advancing Translational Sciences of the NIH (UL1TR003015 and KL2TR003016). CMB is supported by the Virginia Tech School of Neuroscience.
Footnotes
Methods.