Introduction

Division of labor (DOL) in the honeybee is one of the most well explored phenomena in the study of animal behavior. Although studies go back to the 1800s, dedicated experimental work began in the 1930s and has continued to the present with numerous labs approaching the problem from every biological perspective (Rösch 1930; Lindauer 1952; Ribbands 1953; Free 1965; Seeley 1982, 1995; Calderone and Page 1988; Page and Robinson 1991; Page et al. 1992, 2000; Moritz et al. 2001; Page and Erber 2002; Robinson 2002; Grozinger and Robinson 2002; Grozinger et al. 2003; Johnson 2003, 2005, 2008a, b; Robinson et al. 2005; Elekonich and Roberts 2005; Slessor et al. 2005; Whitfield et al. 2003, 2006; Rüeppell et al. 2004; Amdam et al. 2003; Oldroyd and Thompson 2007; Schmickl and Crailsheim 2007, 2008; Beekman et al. 2007; Smith et al. 2008). Given the expansive nature of this work, it is necessary that any researcher take an integrative approach. To facilitate this, a synthesis of behavioral ecology, physiology, and neurobiology approaches to the subject is presented. The biological disciplines included in this study were chosen because they all share a focus on qualitative mechanisms, typically feedback processes, for regulating worker behavior. The important role played by genotypic variability, in contrast, is quantitative in nature, in that it causes variability within the context of general qualitative mechanisms (Calderone and Page 1988, 1991; Breed et al. 1990; Fewell and Bertram 1999; Kryger et al. 2000; Oldroyd and Thompson 2007). I therefore leave the role played by these effects to future work. The paper does not attempt to exhaustively review the many papers on honeybee DOL; instead, it conceptualizes the key results into two models: one at the behavioral level, the push–pull model, that explains the form and adaptive basis of DOL and another at the proximate level that explains how colony level needs are translated into individual-level patterns of physiological development.

Honeybee division of labor

DOL refers to biases in the propensity of individuals to perform different tasks within a group (reviewed in Oster and Wilson 1978; Beshers and Fewell 2001; Smith et al. 2008). In those cases where DOL is so pervasive that workers ignore most tasks, the term, caste, is useful to refer to those individuals with the same task repertoire (Wilson 1976; Seeley 1982; Johnson 2003, 2005). There are two basic classes of DOL across the social insects: between queens and workers and amongst the workers for tasks unrelated to reproduction. We focus on DOL amongst the workers. In this case, there are two major forms: physical and temporal. Physical castes are morphologically specialized for their task and are common in the ants and termites (reviewed in Wilson 1971; Hölldobler and Wilson 1990). Temporal polyethism refers to age correlated biases in task performance and is found throughout the social insects (reviewed in Oster and Wilson 1978; Robinson 1992; Beshers and Fewell 2001). As temporal polyethism is in part based on internal and physiological differences between workers, there is some overlap between these two classes of DOL, such that temporal castes could be considered temporary physical castes (Johnson 2003, 2005; Robinson 2009). The honeybee temporal caste system is depicted in Fig. 1 (based on Seeley 1982; Johnson 2003, 2005, 2008b). There are four castes and a winter bee generalist state. I first describe the task repertoire of each caste then explore the nature of transitions between them from the perspective that DOL is a colony level adaptation (Seeley 1989b; Linksvayer et al. 2009). The review will focus on DOL in the broadest sense. Hence, many fascinating aspects of within-caste task allocation, such as the dance language of the foraging caste, will only be touched upon.

Fig. 1
figure 1

Apis mellifera has two systems of social organization: temporal polyethism in the spring and summer and generalist workers in the winter. Solid arrows indicate natural caste transitions, while the dashed arrows show atypical caste transitions (experimentally induced or due to swarming).The push–pull model for temporal polyethism proposes that nurses are pushed from their caste by the emergence of newly emerged bees, while the middle-aged bees are pulled into the foraging caste via interactions with the foragers. Members of all castes are assumed to be able to switch to the winter state under the appropriate conditions

Cell cleaners

Newly emerged bees cannot fly or sting and are therefore developmentally immature (reviewed in Winston 1987; Calderone 1998). The first days of a bee's life are spent continuing development and acquiring these abilities. The task repertoire during this period consists of cell cleaning, with the rest of the time spent inactive or grooming (Seeley 1982). This group does not comprise a critical functional component of the colony, as members of other castes also clean cells. Hence, this caste may be the result of physiological constraints on honeybee development (Seeley 1982).

Nurses

The nursing caste typically lasts for about 1 week, from ages 4–12 days (Ribbands 1953; Seeley 1982). Nurses feed a proteinaceous section to the young, as opposed to pollen, as is the case for other social bees (Michener 1974). This presumably increases the growth rate of the larva, which do not have to digest tough pollen cuticles. In addition to feeding the brood, nurses also transfer their proteinaceous secretion to the younger and older bees in the nest and are, hence, critical for their development and maintenance (Crailsheim 1991, 1992). Nurses also care for the queen by forming a retinue around her (reviewed in Winston 1987). Bees in the retinue regulate queen behavior via the rate at which they feed her and act as messenger bees by spreading the queen's pheromones about the nest (Velthuis 1972; Seeley 1979).

Middle-aged bees

Middle-aged bees (MAB) remain in their caste for a little over a week, from ages 12–21 days (Seeley 1982; Johnson 2008b). MAB have a task repertoire spread throughout the nest. Although their distribution overlaps that of the nurses, their behavior is quite distinct, as they show no interest in the brood (Johnson 2008b; Fig. 2). Instead, their task repertoire comprises some 15 tasks ranging from nest building and maintenance, to nectar receiving and processing, to guarding the nest entrance (Seeley 1982; Trumbo et al. 1997; Johnson 2003, 2008a, b). Studies suggest the MAB may be broken into two categories with continuous variability between them. Young MAB appear to spend more time on comb building and general colony maintenance, while older MAB may transition to nectar processing and other tasks, which put them nearer the entrance of the nest (Seeley 1995; Trumbo et al. 1997). MAB task allocation is via a coupled localization/diffusion process, which enables them to track changes in task demand over the entire nest without the need for communication amongst themselves about changing task demands (Johnson 2009).

Fig. 2
figure 2

Nurses and middle-aged bees (MAB) have overlapping work zones within the nest, which, along with strong individual-level variation in development rate, led to confusion over whether they were two separate castes. Johnson (2008a, b) showed, using focal animal observations, that nurses and MAB have distinct task repertoires. Nurses stay within the brood nest where they care for brood, while middle-aged bees ignore the brood and focus on all the many other tasks in the nest. That nectar receiving is a key task of MAB, but not nurses, and is apparent by noting the difference in walking between the two castes. Nectar receivers make long circuits from the dance floor to the honeycombs at the top of the nest, while nurses do not leave the brood zone

MAB activities must be tightly coupled to those of the foragers for the colony to collect the 20 kg of honey needed to survive the winter (Seeley 1985). This is because although the foragers collect nectar, they transfer it to MAB near the nest entrance for processing into honey and storage (reviewed in Seeley 1995). Hence, the number of MAB engaged in nectar receiving must be adjusted such that it matches the current foraging rate. The tremble dance, produced by foragers when they determine there are too few nectar receivers, serves to recruit more MAB to nectar receiving (Seeley 1992; Seeley and Tovey 1994). The MAB must also build new comb at a rate sufficient to ensure that enough space is available for incoming nectar (Pratt 1998).

Foragers

Once the transition to foraging is made, bees no longer engage in within-nest tasks (reviewed in Winston 1987; Seeley 1995). Instead, they focus on foraging for the four resources colonies need: propolis, water, pollen, and nectar (reviewed in Robinson 1992; Seeley 1995; Calderone 1998). Of the four, pollen and nectar make up most of the foraging activity, except in periods of heat stress in which water collection can be as labor intensive (reviewed in Seeley 1995). Although biases in the propensity to forage for a specific substance have been found (reviewed in Calderone and Page 1991; Page and Robinson 1991; Beshers and Fewell 2001) and most bees specialize on either pollen or nectar on a given trip (Seeley 1985, 1995), over the course of their foraging career, most bees appear to be generalists (Seeley and Towne 1992). Needless to say, honeybee foraging via the dance language is quite involved and is the subject of much work (reviewed in Seeley 1995; De Vries and Biesmeijer 1998). How the foragers come to a consensus over the selection of a new home during the swarming process is also an active area of research (Seeley and Visscher 2004; Beekman et al. 2006; Visscher 2007).

Natural caste transitions: the push–pull model

Bees living in healthy colonies in the spring and summer undergo three caste transitions: cell cleaner to nurse, nurse to MAB, and MAB to forager. The first transition appears to be a fixed developmental process, in that there is no evidence that it is variable under any conditions (reviewed in Beshers et al. 2001; Amdam and Omholt 2003). Hence, we will focus on the last two transitions from the vantage point of colony level needs. We will not discuss proximate mechanisms (which are left for the second half of the paper), but instead focus on ecological context, information demands, and adaptive bases.

Nurse to MAB transition

Colony survival through the winter is low and dependent on colony size and honey stores (Seeley 1985; Winston 1987). As colonies begin either as swarms or small populations of over-wintered bees, growth rate is thus a central variable for colony fitness. Hence, there should be a premium on not neglecting the brood. Given this, it is likely that the ratio of larva to nurses is the primary variable controlling when a nurse leaves its caste. As long as this ratio is such that nurses are busy, they should stay with their task. In particular, we should expect transitions out of the nursing caste when nurses are replaced by newly emerged bees (Seeley 1985; Amdam and Omholt 2003). Figure 1 reflects this hypothesis by describing this transition as a pushing process, that is, newly emerged bees push older nurses out of the brood nest (Tofts and Franks 1992). Empirical circumstantial support for this hypothesis has long existed, as Milojevic (1940) and Haydak (1963) were able to produce nurses over several months old by continually removing pupal combs from the colony and replacing them with combs of open brood.

MAB to forager transition

The MAB to forager transition is proposed to be considerably more complex than the nurse to MAB transition, as would be expected given the complex nature of cooperation between the MAB and foragers. There are three basic problems: one, maintaining a productive caste ratio between the two groups, two, ensuring the steady replacement of foragers as they die, and three, rapidly boosting the forager population during nectar flows. The first problem was touched on previously. MAB must be available to receive nectar at the maximum rate the foragers can bring it in, while building comb such that the colony does not run out of space (reviewed in Seeley 1995). Hence, not too many of them should switch to foraging no matter how much food is available in the field. The second problem is straightforward, as foraging honeybees have one of the highest metabolic rates known (Williams et al. 2008) and work themselves to death over a couple weeks (Visscher and Dukas 1997). Their continuous replacement is a necessity if the colony is to continue foraging at a steady rate. The third problem has not received as much attention from researchers of DOL (but see Huang and Robinson 1999), but from a behavioral ecology perspective, is a key problem. In many parts of the world, a colony loses weight for much of the summer and gains weight only during short highly profitable nectar flows (reviewed in Seeley 1985). During this time, there is a superabundance of food available, and the problem is to field as many foragers as possible. Thus, when the environment is suitable, all the MAB not necessary for comb building and nectar receiving should be shuffled quickly to the foraging caste to maximize nectar collection. In contrast, when the environment is not suitable (during a dearth), the MAB should avoid becoming foragers, as the transition is associated with physiological changes that shorten a worker's life (reviewed in Amdam and Page 2005) and because it would be more profitable for them to wait until a nectar flow. Thus, we must explain several processes: ensuring sufficient comb builders and nectar receivers, governing the rate at which MAB become component to forage, and the sometimes sudden decision to begin foraging. I propose a two-part model based on a mixture of physiological and behavioral interactions.

Maintaining sufficient comb builders and ensuring a steady rate of forager-ready bees can be solved by pacing the rate that MAB develop with respect to forager mortality. Here, I follow previous work and suggest that the social inhibition model (Huang and Robinson 1992, 1996, 1999; Beshers et al. 2001) governs this process. According to this model, the foragers produce an inhibitor, which suppresses the rate of development of within-nest bees (I assume its main function is to modulate MAB development and not that of nurses). Since forager mortality is a function of work effort (Schmidt-Hempel and Wolf 1988), as the foraging rate increases, so should the rate of MAB development because foragers will collectively produce less inhibitor as their population shrinks (Huang and Robinson 1992, 1996). Recently, Leoncini et al. (2004) identified this inhibitor as ethyl oleate present in the forager's crops and presumably transferred to MAB via trophallaxis.

In contrast to the social inhibition hypothesis, however, I propose that the inhibition process governs the rate at which MAB become competent to forage, but not the actual decision to change caste. This is because studies show that all the physiological machinery for foraging is in place prior to the transition to foraging (reviewed in Robinson 2002) and because the decision to forage appears to be too complex for a simple physiological process to govern. The size of the forager population varies throughout the year (Sekiguchi and Sakagami 1966), as do the demands of MAB. As discussed earlier, the task partitioning between MAB and foragers means that each caste is dependent on the other. Hence, we might expect the decision to switch to foraging to depend on the ratio of nectar receivers to foragers. In short, I propose that the oldest MAB are fully capable of foraging but do not for one of two reasons: one, they are needed as nectar receivers, or two, there is insufficient forage in the field to make it cost effective for them to switch. When either of these conditions changes, they transition to foraging.

The preceding argument proposes that the decision to forage is based on behavioral interactions. A short review of the relevant behavior will therefore be useful. Nectar receivers make circuits between the dance floor where they unload foragers and the top of the nest where they store honey (Seeley 1989a). When there are many receivers relative to foragers, the time it takes foragers to find a receiver is short (reviewed in Seeley 1995). The converse, however, should also be true. Receivers should experience long wait times to find foragers when there are many receivers relative to foragers. It is also often the case where during periods of high nectar influx, all the foragers are busy, and there are few foragers following dances. During such times, one observes that most waggle dances are not being followed. Thus, MAB are searching for foragers needing unloading but only encountering dancing bees. Taken together, all the information necessary for a nectar receiver to determine the ratio of receivers to foragers, and the need for more foragers, is present on the dance floor and could be used to inform the decision to switch caste. Although this hypothesis will require explicit experimental support, there is circumstantial evidence to support it. Seeley (1995) observed during experiments in which he allowed uninhibited recruitment to a feeder that bees he had previously marked as nectar receivers began showing up at the feeder when foraging rates reached high levels. Further, the soldier class of bee is composed of forager-age bees that do not forage (Breed et al. 1990). Although their adaptive value has been proposed to be for defense, it is also likely they are waiting to be recruited to foraging (the two hypotheses are not mutually exclusive).

Growth vs survival/division of labor vs generalists

As Fig. 1 indicates, there is another class of bee vital to honeybee organization, the winter bees. The winter state is characterized by great longevity and a generalist task repertoire (Winston 1987; Omholt 1988). Through the winter, all the bees participate in thermoregulation (reviewed in Southwick 1983). In mid to late winter, long before the foraging season starts, winter bees begin rearing brood, acting as nurses (reviewed in Seeley 1985; Winston 1987). Then, when conditions become favorable, they forage, some at an age of over 280 days (Sekiguchi and Sakagami 1966).

Honeybees, therefore, have two patterns of organization of work: DOL based on specialization in the spring and summer and what appear to be uniform generalists in the winter. These two patterns are not surprising from a behavioral ecology perspective. In the spring and summer, the goal is to grow as rapidly as possible, while also stockpiling the 20 kg of honey needed for over-wintering. To accomplish this, it is necessary to maximize work output at the colony level. DOL is a means of accomplishing this, as specialization leads to higher per capita work output than is possible with generalists (Jeanne 1986, 1999). DOL, however, is costly, in terms of survivorship, as the foragers quickly work themselves to death. In the winter (or dry season in the topics), the goal shifts from growth and work output to survivorship (reviewed in Seeley 1985; Hepburn and Radloff 1998). In this context, each bee is valuable as brood rearing is difficult and costly. Hence, a generalist strategy in which a large investment is made to each bee's longevity and capacity to do any task should be preferable.

A proximate model for temporal polyethism

A proximate model for temporal polyethism must explain two phenomena: the generation of caste-specific physiology and the adaptive mechanisms by which transitions between castes are controlled. Figure 3 illustrates a general hypothesis that accounts for these two phenomena. The mechanism for generating caste-specific physiology is proposed to depend on mutually reinforcing positive feedback mechanisms of behavioral and physiological processes that lock a bee into a particular behavioral phase. I will refer to these as caste priming mechanisms. Information-rich releasers (pheromones or other environment stimuli) are then hypothesized to disrupt specific components of the priming mechanisms to trigger endocrinological cascades that ultimately result in the activation of new priming mechanisms for generating the next caste-specific physiology. Given the honeybee caste system, we must explain the construction of four caste-specific physiologies and then explain what releasers trigger transitions between them. I will first focus on natural transitions before discussing the nature of the atypical transitions observed in colonies with experimentally altered demography.

Fig. 3
figure 3

General proximate model for temporal polyethism. Caste-specific anatomy and physiology is generated via a multifactorial mutually reinforcing priming mechanism. Transitions between castes are controlled by releasers that break the reinforcing mechanism and trigger an endocrinological cascade to the next caste. This simple model explains why so many different factors can all cause a change in caste because a break anywhere in the mutually reinforcing cascade will trigger a transition to the next caste

Cell cleaner development

As mentioned previously, the cell cleaner stage appears to be inflexible. There is thus no priming mechanism for this caste, only a continuous process of development normally ending with the transition to the nursing caste. The only variable appears to be the availability of protein. If the colony has pollen stores, then a transition into the nursing caste occurs, if not, development is compromised (sufficient protein stores for brood food production are likely not present) and bees begin to forage earlier in life (Schulz et al. 1998; Toth et al. 2005).

Nursing priming mechanisms and triggers

Based on existing data, a plausible priming feedback mechanism for the nursing caste has been mapped out (Fig. 4). Two mutually reinforcing processes facilitate a bee developing the physiological capacity to nurse and the propensity to stay within the caste. These processes are centered on two pheromones, queen mandibular gland pheromone (QMP) and brood pheromone (BP). When a worker feeds brood, she is exposed to both pheromones (which co-occur in the brood nest). BP stimulates the hypopharyngeal glands, which trigger pollen feeding, which maintains high vitellogenin (Vg) titers (and high nutritional stores in general), which in turn allows for the production of brood food, and perhaps the partial suppression of the normal age-based rise in juvenile hormone (JH) titer (Mohammedi et al. 1996; Le Conte et al. 2001; Pankiw et al. 1998, 2004; Pankiw and Page 2001; Pankiw 2004a; Guidugli et al. 2005; Nelson et al. 2007). QMP also suppresses JH production, leading to decreased metabolism and slow movement rates, which make a bee unlikely to leave the brood zone (Kaatz et al. 1992; Pankiw et al. 1998). QMP further depresses dopamine (Beggs et al. 2007), which along with other low neurochemical titers in the brain, many of which appear to increase in a purely endogenous aging process, may lead (via unknown neurological mechanisms) to decreased task sensitivity (Taylor et al. 1992; Schulz and Robinson 1999; Pankiw et al. 1998; reviewed in Robinson 2002; Vergoz et al. 2007; Beggs and Mercer 2009). This decreased task sensitivity makes a nurse unlikely to work on tasks unrelated to brood care. The model proposes that a break anywhere in either of these cycles weakens the reinforcing process and facilitates a transition to the middle-aged caste. As mentioned previously, these breaks, or releasers, take the form of information-rich cues or signals that inform a bee when a change in caste is adaptive at the colony level. The most important of these for the nursing to MAB transition is the ratio of nurses to brood. When new workers eclose, the newly emerged bees are proposed to push the old nurses out of the brood zone and into the periphery of the nest. The nurses pushed out of the brood nest are then no longer exposed to either QMP or BP and the priming processes centered on these pheromones are turned off triggering the transition to the MAB caste.

Fig. 4
figure 4

Model for the priming mechanisms of the nursing caste. The central behavior, brood feeding, exposes bees to queen mandibular gland pheromone (QMP) and brood pheromone (BP), two pheromones with multiple priming effects. BP primes bees for the physiological demands of nursing, while QMP makes them unlikely to leave the brood zone and perhaps unresponsive to non-brood-care task stimuli. There are three key releasing mechanisms: pollen availability, forager pheromones, and most important, the nurse to brood ratio (all shown in bold). These releasers relate colony level information to the individual and trigger the adaptive transition to the middle-aged bees' caste

The pushing process itself is proposed to be based on two effects, one physical and the other physiological and behavioral. A brood comb has approximately 6,000 cells (developing larva), but only space for about 2,000 adult bees (Winston 1987; Camazine 1991). This is because the developing bees are stacked vertically within the comb, while the adult bees stand horizontally on it. Thus, when bees emerge, there is physically not enough space on the comb for the nurses and newly emerged bees. Some of this pressure is relieved by the newly emerged bees spending a lot of time within cells, but as the cells get cleaned, this factor decreases. Hence, some of the bees must leave, and the question becomes who. As mentioned previously, the newly emerged bees are continuing development. To do this, they need pollen (located within the brood zone), and recent work suggests that they need heat as well for their flight muscles to develop (Huang, unpublished results). Further, authors have long noticed that newly emerged bees, which are often removed from the nest for marking, always return to the brood zone when returned to the nest (Robinson et al. 1994; Calderone 1998). Thus, in sum, when a comb of brood emerges, there is insufficient space for all the bees to remain in that location, and it is proposed that it is the nurse bees who tend to leave because the newly emerged bees have physiological requirements for development that can only be satisfied within the brood zone.

The MAB state as a long cascade

We now focus on the physiological basis of the MAB. Here, the general model is modified to account for the unique biology of the honeybee. Unlike for the nursing caste, which is proposed to be based on mutually reinforcing mechanisms that freeze a bee in place, it is proposed that the middle-aged caste is a long slow cascade of changing hormonal titers, the end result of which is the capacity to forage. This hypothesis explains why studies have had difficulty defining one clear MAB physiological state (Huang et al. 1994; Huang and Robinson 1995; Cash et al. 2005). It is proposed that the transition out of the nursing caste is dependent on three processes that may or may not interact. These are decreased exposure to BP, decreased exposure to QMP, and exposure to novel task stimuli (Fig. 5). Purely endogenous aging processes that affect various neurochemical titers also likely occur (reviewed in Amdam and Omholt 2003). Although the nature of the MAB defining cascade is poorly understood, as most studies of the proximate basis of DOL have ignored the MAB caste, the following preliminary hypothesis should be useful for guiding future research.

Fig. 5
figure 5

The proximate basis of the middle-aged bees' (MAB) caste is hypothesized to be a long endocrinological cascade that controls the rate at which MAB acquire the capacity to forage. Too little research has focused on the MAB caste to allow for a mechanism as detailed as for nurses. However, there are four basic processes triggered by the following events: decreased exposure to brood pheromone, decreased exposure to queen mandibular gland pheromone, exposure to novel task stimuli, and an endogenous rise in neurochemical titers unrelated to the priming feedback mechanisms. Question marks stress portions of this process that are particularly poorly understood

It is proposed that decreased exposure to BP, which stimulates the HP glands and is associated with pollen feeding (reviewed in Amdam and Omholt 2003; Le Conte and Hefetz 2008), causes a slow decrease in the titer of Vg. Simultaneous with this slow decline in Vg is a slight increase in JH, due to decreased exposure to QMP (Kaatz et al. 1992; Pankiw et al. 1998). JH is hypothesized to further depress Vg levels by inhibiting its synthesis (Fahrbach and Robinson 1996; Pinto et al. 2000). It is also likely that still unknown neural effects of decreased exposure to BP and QMP, along with the exposure to novel task stimuli, allow for the triggering of until now suppressed response thresholds for MAB tasks (Vergoz et al. 2007; Beggs and Mercer 2009). These effects together (high Vg, low JH, and low exposure to both BP and QMP) are proposed to lead to early MAB behavior, which is centered on comb building and nest maintenance. It is then proposed that JH continues to increase at a rate proportional to the amount of inhibitor received via trophallaxis from foragers until a threshold is reached at which point certain neurochemicals, such as octopamine, increase in titer (Harris and Woodring 1999; Wagener-Hulme et al. 1999; Schulz and Robinson 1999; Schulz et al. 2002a, b; Barron et al. 2002; Barron and Robinson 2005; Robinson 2002). An alternative is that high Vg titer inhibits JH production (Guidugli et al. 2005), so once Vg titer falls below a critical threshold, JH production surges triggering other neurochemical changes leading to the final stage of MAB behavior. The developmentally most mature MAB are hypothesized to be fully capable of foraging and to only require input from the releaser (recruitment via the dance language after failure to find work as a receiver) to rapidly make the change to foraging. The releaser would presumably lead to increased expression of the for gene, increase of octopamine in the antennal lobes, and other immediate precursors of foraging (Schulz et al. 2003; Ben-Shahar et al. 2002; Ben-Shahar 2005). Increased expression of the many other genes shown to change in expression with the transition to foraging would ultimately result as well (Whitfield et al. 2003, 2006; Alaux et al. 2009).

Forager priming mechanisms

We have been discussing a developmental process, most of which have a beginning and an end. Thus, we focused either on how workers are frozen in place developmentally (nurses) or the mechanism by which their rate of development is paced (MAB). In the case of the foragers, however, their physiological state is the end point. An elaborate priming mechanism may thus not be necessary for keeping them in place. A physiological mechanism for the maintenance of the forager state may therefore be as simple as the titer of some circulating peptide, such as JH, inhibiting the expression of genes associated with key factors associated with earlier castes (as proposed by Beshers et al. 2001; Amdam and Omholt 2003).

Winter bee priming mechanisms and triggers

The winter bee state is much like the nursing caste, as it is characterized by low JH, active fat body, high Vg, and high immunocompetence (Fukuda and Sekiguchi 1966; Fluri et al. 1982; Huang and Robinson 1995; Amdam and Omholt 2003). It is, therefore, possible that the winter state is simply an extended period in the nursing caste. However, there are reasons why this is not likely the case. Winter bees do not transition out of their state when the amount of brood is low, or when the number of foragers is low, as do nurses. In fact, all of the bees in winter show the same physiological state, so the mechanisms that govern temporal polyethism are likely inactivated. A critical test of how similar nurses and winter bees actually are will be to measure the titers in winter bees of the neurochemicals known to show differential expression with respect to temporal polyethism. Nurses have low levels of dopamine and octopamine, for example, which presumably limits the scope of their behavior (Taylor et al. 1992; Wagener-Hulme et al. 1999; Beggs et al. 2007). If winter bees are generalists, however, and can do any task, then they should have higher levels of these neurochemicals (or at least greater ability to increase them quickly). Data from overage nurses in summer colonies suggests that this could be the case, as these bees have many important physiological differences with normal age nurses (reviewed in Wegener et al. 2009).

The transition to the winter stage obviously occurs with the arrival of the winter. Mattila and Otis (2007) recently showed that among the many cues that are correlated with the arrival of winter, the presence of pollen in the field seems to be the most important. In short, the decline in pollen supply, which is necessary for brood rearing (Keller et al. 2005), leads to a reduction in the amount of brood in the nest. Workers that emerge in colonies with little to no brood transition to the winter bee state (Maurizio 1950; Omholt 1988). With respect to how the older bees know when to transition to the winter state, there is insufficient data for an elaborate hypothesis. Via some still unknown mechanism, the state of a broodless colony with inactive foragers triggers the bees to transition to the winter bee state. Of course, there are many variables associated with this condition that could be used as cues. How winter bees determine that it is time to begin brood rearing in the middle of winter is also poorly understood (Omholt 1987).

Experimentally induced transitions

The model for the proximate basis of temporal polyethism proposes that a mutually reinforcing priming mechanism freezes a worker developmentally in place until an adaptive trigger is received from the environment or colony demography signaling that a change is necessary. Until now, I have focused on the adaptive triggers. However, the model can also explain many cases of experimentally induced transitions via the same mechanism. Instead of an adaptive trigger being received, however, the researcher artificially breaks the reinforcing mechanism in a place that would not happen naturally. Cases of experimentally induced acceleration of development (precocious foraging) can be explained in this way. Experimentally induced caste reversions, in contrast, are likely either of two things: adaptive strategies for reorganizing after a demographic disturbance or experimentally induced transitions to the winter bee (or some hybrid caste) stage.

Many studies have explored the transition to foraging by exposing young workers to substances involved in the transition to foraging. Treatment with JH or octopamine, for example, accelerates the rate at which workers become foragers (reviewed in Beshers et al. 2001; Robinson 2002). As Fig. 3 illustrates, according to the model, the maintenance of the nursing caste is based on reinforcing processes that continually expose a worker to two priming pheromones, BP and QMP. If treatment with JH or octopamine causes the nurse to leave the brood zone more often than normal (by increasing their activity rate (Fussnecker et al. 2006), for example), then it will break this priming mechanism. It is further likely that a break anywhere in the priming mechanism, such as an inability to synthesize a necessary physiological factor (Amdam et al. 2006; Toth et al. 2005; Toth and Robinson 2005), will break the priming mechanisms and trigger the endocrinological cascade to the next caste. I assume that nurses switch to the MAB caste and not directly to foraging in studies of precocious foraging because in such studies, the treatment is applied to the bees and then 7–10 days later, they begin to forage (reviewed in Robinson 2002; Elekonich and Roberts 2005). A likely cause of the lag time between treatment and response is that the nurses transition to the MAB caste first then quickly transition from this caste to the foraging caste.

When the youngest bees are removed from a colony, about 20% of the foragers reacquire the ability to nurse (Page et al. 1992; Robinson 1992; Huang and Robinson 1996). It is clear that both the nurses and the foragers contain chemical signals that modulate the development of both groups and could be the basis of this ability (Huang and Robinson 1992, 1996; Pankiw 2004b; Leoncini et al. 2004). Further, the social inhibition model shows that the forager's inhibitor signal alone (Huang and Robinson 1999; Leoncini et al. 2004) could provide foragers with sufficient information to determine that reversion is necessary. However, it is still not clear whether the foragers use information from their own inhibitory signal, information from the nursing signal (still unidentified but demonstrated by Pankiw 2004b), or both. Modeling alone, which could show that any of the possibilities are plausible, will not address the issue. Experimental studies of colonies in which the young bees have been removed but the colony is supplemented with varying concentrations of their chemical extracts could resolve the question.

Relationship to previous models

The model presented here owes large debts to several previous models. As Calderone (1998) pointed out previously, models such as the social inhibition model (Beshers et al. 2001) and the double repressor model (Amdam and Omholt 2003) are “innate developmental program” models (IDP). They posit that temporal polyethism is a flexible process proscribed by developmental programs that receive inputs from the environment. In contrast, the foraging for work (FFW) model proposes that temporal polyethism is the result of spatial environmental effects (Tofts and Franks 1992; Franks and Tofts 1994). The present model merges the IDP and FFW approaches.

While the IDP approach acknowledges that important input comes from the environment, most of the environmental effects considered relate to colony demography. Other environmental effects, such as the layout of tasks and fluctuations in their demand, are given little emphasis. Thus, while critics of the FFW hypothesis are correct that it neglects key developmental and physiological constraints (reviewed in Calderone and Page 1996; Calderone 1998), it is still likely that the type of spatial effects stressed by the FFW model and the physiological processes of the IDP approach interact to control the dynamics of DOL. The hypothesis proposed for the regulation of the nursing caste is a prime example, as the primer pheromones co-occur together in one region of the nest, and nurses have neurophysiological characteristics that would seem to bias them against leaving this region. Future work will hopefully not only pay greater attention to such spatial effects but also to the rich body of behavioral work (reviewed in Seeley 1995) that can be the basis for hypotheses for caste transitions, such as the MAB to forager transition, that happen too quickly to be based on purely developmental processes.