New Results

A systematic review and meta-analysis of Drosophila short-term-memory genetics: robust reproducibility, but little independent replication

Tayfun Tumkaya, Stanislav Ott, Adam Claridge-Chang
doi: https://doi.org/10.1101/247650

Abstract

Preface We invite memory researchers to submit comments, anonymous or signed, by email, social media, or directly to the manuscript. To read text and figures side-by-side on a desktop, please make a duplicate of this file.

Abstract Geneticists have long used olfactory conditioning techniques in Drosophila to identify the neurons and genes that mediate learning. While this method has characterized an abundance of memory-related genes, little is known about how these genes induce short-term memory (STM) via signaling pathways; characterizing these networks will be essential to developing mechanistic models of memory formation. Here, we investigated why elucidating the STM pathways has been relatively slow. One possibility is that the STM evidence base is weak due to publication of poorly reproducible results, as has been observed in other fields. We examined this hypothesis by performing a systematic review and subsequent meta-analysis of the STM genetics field. Using several metrics to quantify the variation between discovery articles and follow-up studies, we found that seven genes were highly replicated, showed no publication bias, and had generally high reproducibility. However, the remaining ~80% memory genes have not been replicated since their initial discovery. Although we observed only a few studies that investigated gene interactions, the reviewed genes could together account for >1000% memory. This large summed effect size indicates either that some of the gene findings are not reproducible, that many memory genes participate in shared pathways, or that current protocols lack the specificity needed to identify core plasticity memory genes. Mechanistic theories of memory and cognition will require the convergence of evidence from system, circuit, cellular, molecular, and genetic experiments. As this study demonstrates, systematic data synthesis is an essential tool for this integrated brain science.

Introduction

Learning is the process by which external sensory experiences and internal states lead to behavioral adaptation. Learning manifests as physiological changes in the brain, the most prominent of which are alterations to the connections between neurons, known as synaptic plasticity (Takeuchi et al., 2014). The plasticity theory of learning draws on findings from numerous experimental systems, including vertebrate models, most notably mouse, and invertebrate models, such as the sea slug Aplysia californica and the vinegar fly Drosophila melanogaster (Bailey et al., 2015; Cognigni et al., 2017; Ehmann et al., 2017). For decades, the Drosophila model has been used to characterize the neurogenetic mechanisms underlying memory formation (Davis, 2011). Much of our knowledge of the neurogenetics of learning derives from experiments using Pavlovian odor (olfactory) conditioning (Quinn et al., 1974). Olfactory conditioning uses the simultaneous presentation of an odor paired with an inherently valued stimulus, usually painful electric shocks or a nutritious sugar meal (Tempel et al., 1983; Tully and Quinn, 1985). Conditioned animals display altered approach/avoidance responses to subsequent odor presentation. When the post-learning trial is performed within minutes of conditioning, the response is referred to as short-term memory (STM). Starting with rutabaga (rut) and dunce (dnc) in the 1980s, such experiments performed on Drosophila mutants have identified a number of STM genes (Heisenberg, 2003; Keene and Waddell, 2007; Tomchik and Davis, 2013).

Many STM genes are predominantly expressed in a single brain structure, but an integrated model of the overall STM signaling architecture is lacking. This absence contrasts starkly with other Drosophila gene systems. For example, the Drosophila signaling networks underlying both embryonic development (Perrimon et al., 2012; St Johnston and Nüsslein-Volhard, 1992) and the circadian clock (Hardin, 2011) have been characterized in detail. In those cases, our molecular-genetic knowledge has reached such an extent that it informs mathematical models that can recreate key system properties (Fathallah-Shaykh et al., 2009; Segal et al., 2008). It is unknown why genetics has succeeded in defining those aforementioned systems, while delineating similarly complete plasticity pathways has been hard.

Many hypotheses could be put forward to explain why the genetics of memory formation have not yet reached a level of clarity. One such possibility is a weak evidence base. For instance, circadian-rhythm genetics benefits from very large effect-sizes, while memory phenotypes are smaller (Takahashi et al., 2008), making reliable measurements more difficult. Many scientists believe that there is a reproducibility crisis in biomedical research (Baker, 2016), and intense investigations into data reproducibility have ensued (eLife, 2017; Lithgow et al., 2017), including in the fields of cancer research (Begley and Ellis, 2012), drug target identification (Prinz et al., 2011), and human psychology (Anderson et al., 2016; Gilbert et al., 2016; Open Science Collaboration, 2015a). In medical research, scientists routinely assess a field’s evidence base with statistical synthesis (Haidich, 2010). Such meta-research—although relatively rare in the basic biomedical sciences—is growing in importance (Claridge-Chang and Assam, 2016; Nature methods, 2016; Yildizoglu et al., 2015).

To test the hypothesis that the development of an integrated model of STM has been frustrated by irreproducibility, we evaluated the evidence base with a synthetic analysis of loss-of-function alleles. Our systematic review identified 32 STM genes, of which 23 were amenable to meta-analysis. We applied three metrics across several types of replication to quantify reproducibility. The findings on replicated genes were consistent, and statistical evidence for publication bias was absent. These findings refute our hypothesis and confirm good reproducibility. However, independent replication was rare: most replication was reported in follow-up studies from the discovery group; and only seven of the 32 genes—just 22%—were replicated independently. These results indicate that the Drosophila memory-genetics evidence base is divided: a low replication rate for most genes, with robust data integrity for a selected few.

Materials and Methods

Information sources and database search

This review was conducted by searching PubMed and Embase databases on 8th April 2017 with the phrase: “Drosophila AND (learning OR memory) AND (olfactory OR olfaction OR T-maze OR "T maze" OR odorant OR odor) NOT review[Publication Type]”. The query returned 648 and 559 publications from Pubmed and Embase, respectively. The results were downloaded as.csv files, and the two sources were merged. Publications that were not research articles or not written in English were excluded; this resulted in the identification of 743 articles (Figure 1).

Eligibility criteria

The systematic review included studies that met the following six criteria: (1)report STM performance defined as ≤ 5 min memory (Heisenberg, 2003; Yildizoglu et al., 2015); (2) measure STM in adult Drosophila melanogaster; (3) focus on homozygous loss-of-function mutations, including broad RNA interference (RNAi) knockdown mutants; (4) use the T-maze assay; (5) report the full performance index (PI) score for control and experimental flies; and (6) use mutants with intact locomotor activity, olfactory acuity, and brain development processes. Due to the rapid transition of STM to middle-term memory (Heisenberg, 2003), we excluded experiments where the time interval between training and testing was >5 min.

Study selection

Articles were screened for exclusion in four successive stages: (1) title—375 excluded, (2) abstract—232 excluded, (3) full text—84 excluded, and (4) experimental design—2 excluded. After screening, 50 articles that fully satisfied our selection criteria were taken forward for data extraction and meta-analyses (Figure 1).

Figure 1.
Figure 1. Systematic review procedure

PubMed and Embase searches performed in April 2017 identified 743 articles relevant to Drosophila short-term memory genes. A four-stage screening process excluded 693 articles,leaving 50 for further review and meta-analyses.

Data extraction

We extracted the following experimental parameters from the 50 included articles: author, year, figure and panel number, experimental genotypes, control genotypes, full PIs of all conditions, standard error of the mean (SEM), sample size (N), temperature, relative humidity, odor pairs, shock voltage, current type, number of training, number of shocks per training, training duration, and the training–testing time interval. If tabulated data were not available, the PI and SEM were extracted from graphs using the Adobe Illustrator (Adobe Systems USA) measurement tool and extrapolated from the y-axis length to obtain a numerical value.

Summary measures

The PI of the control-group STM can vary considerably between studies (Yildizoglu et al., 2015), which renders inter-study comparisons challenging. As such, we used performance percent change (PPC) as previously described (Yildizoglu et al., 2015). For each experiment, the PPC was calculated as follows:

Embedded Image

The standard error (SE) of the PPC was calculated using the delta approximation (Cramer, 1946; Oehlert, 1992; Yildizoglu et al., 2015), as follows:

Embedded Image

Outlier exclusion

Outliers were excluded from the dataset based on Z-score values, following best practice (Altman, 1968; Pagano et al., 2000). Effect sizes with a Z-score >2 were removed from the dataset. In total, eight experiments conducted on five alleles were excluded and are greyed-out in the corresponding forest plots.

Meta-analysis calculations

Where multiple experiments were available (for 23/32 genes), data were meta-analyzed with a random effects model (RE model) to calculate summary effect sizes. Subgroup analyses were also performed on the genes with data for multiple alleles. (When a subgroup had only one experiment, the fixed effects model was used by default.) Both analyses used the metafor package in R (Viechtbauer and Others, 2010).

Publication bias

For genes where ≥10 internal replicates were available, publication bias was assessed by constructing a funnel plot of effect sizes (Sterne et al., 2011). Effect sizes and corresponding precisions were plotted against each other and inspected for symmetrical distribution around the meta-analytic mean (Light and Pillemer, 1984; Liu, 2011). Egger’s method was then applied to test for bias in each gene’s data (Egger et al., 1997).

Replication terminology

An ad hoc literature search failed to identify definitions of ‘replication’ or ‘reproducibility’ that are broadly accepted and/or statistically formalized. In the context of genetic experiments for STM, we found that replication could have at least four meanings: (1) the sample size of a single experiment; (2) multiple experiments reported in a single discovery study; (3) replication reported in a follow-up study by the discovery laboratory; and (4) genuinely independent replication conducted by at least one group of scientists not involved in the original study. By this taxonomy, definitions 1, 2, and 3 represent dependent replication and definition 4 represents independent replication, which is the most valuable. In the context of loss-of-function genetics, there is the possibility of quantitative and qualitative differences between various alleles; we refer to experiments conducted with an identical allelic state as allelic replication. There is also a delineation between efforts to exactly recreate all conditions of the discovery experiment—direct replication—and experiments that vary conditions, with the ability to generalize discovery findings—conceptual replication (Ioannidis, 2012; Makel et al., 2012).

Reproducibility measures

Published definitions of reproducibility vary widely (McNaught and Wilkinson, 1997; Open Science Collaboration, 2015a; Patil et al., 2016). For the purpose of this meta-analysis, we defined reproducibility as the quantifiable extent of agreement between replicate effect sizes (Open Science Collaboration, 2015b). To estimate this, we adopted three statistical methods. Firstly, we employed heterogeneity (I2), which measures the proportion of variance that cannot be attributed to sampling error. This measure is widely used in meta-analyses and is precisely defined (Higgins et al., 2003); close agreement between studies produces a favorably low heterogeneity. However, poor precision in the constituent studies of a meta-analysis can also result in low heterogeneity, giving the false impression of good reproducibility. To address this limitation, we also used the mean absolute difference (MAD) between all replicates in a set (see below). Although MAD does not incorporate meta-analytic weighting, it has the benefit of being an intuitive, direct measure of overall discrepancies between means and is not confounded by imprecision. Finally, we generated violin plots to compare discovery effect sizes with replicate effect sizes (Open Science Collaboration, 2015b).

Heterogeneity assessment of reproducibility

Meta-analysts source data from several studies to estimate the summary effect size of an intervention. This procedure also inspects the assumption that the included effect sizes are drawn from a common population. Heterogeneity (I2) describes the proportion of meta-analytic variance that is attributable to samples being drawn from different populations, and is calculated using the following formula: Embedded Image where Q is Cochran’s heterogeneity statistic and df is the degrees of freedom (Higgins et al., 2003).

An I2 <50% is considered low, an I2 between 50–75% is considered moderate, and an I2 >75% is considered high heterogeneity (Higgins et al., 2003). Here, we calculated I2 for three groupings, namely: 1) all variants of a gene; 2) inter-allelic heterogeneity between the allelic subgroups; and 3) intra-allelic heterogeneity. We used the metafor library in R (Viechtbauer and Others, 2010).

MAD assessment of reproducibility

Discrepancies between all replicates in the units of the effect size can be reported as MAD (also known as Gini’s mean difference) between all effect sizes in a meta-analysis (David, 1968). We calculated MAD as follows: Embedded Image where PPC is the performance percent change, and k is the total number of PPCs.

A histogram, QQ-plot, and Shapiro-Wilk test showed that the distribution of effect sizes from the largest meta-analysis (rut, Figure 4) were not normally distributed (Shapiro-Wilk P = 0.0015; plots not shown). As MAD is preferred over standard deviation when the data are not normally distributed (Yitzhaki, 2002), we adopted the MAD assessment for all gene analyses. As for I2, MAD compared: intra-allelic replicates; interallelic replicates; and all loss-of-function data for a given gene. Unlike I2, there are no pre-established guidelines that relate arbitrary metric thresholds to verbal descriptors. To place MAD values in context with PPC effect sizes, we chose ≥20% as an arbitrary threshold of high MAD, because only 3/23 meta-analyzed genes had effect sizes ≤ |20%| (Figure 3).

Results

Experimental conditions vary across studies

We found extensive methodological differences between the 50 published studies (Figure 2). The most commonly used odor pair of 3-octanol, 4-methylcyclohexanol (OCT/MCH) (Tully and Quinn, 1985) was used to condition flies in <50% of conditioning experiments, while much of the remainder used benzaldehyde combinations. The experimental temperature and humidity settings also varied widely. Most protocols delivered 12 foot shocks (at either 60 V or 90 V); most training periods lasted for 60 s; the shock type (AC or DC) was not reported for half of the protocols (143 of the 278).

Figure 2.
Figure 2. Methodological variation across conditioning experiments

Distribution of experimental conditions across the 278 analysed experiments from 50 articles. EB = ethyl butyrate, EA = ethyl acetate, AA = amyl acetate, IAA = isoamyl acetate, BA = benzaldehyde, NA = not available.

Most STM genetic studies have not been independently replicated

The reviewed articles implicate 32 genes in Drosophila STM; we summarized the meta-analytic results for each gene in Figure 3. Out of the 32 genes, findings on 17 were replicated in at least one follow-up study. However, 10 of these were internal replications conducted by the discovery group; independent replication studies have been conducted for just seven genes. Moreover, only two genes were characterized by >2 independent replicate studies: rut (6 replicates) and dnc (3 replicates). The other five genes (Neurofibromin 1 (NF1), rugose (rg), Dopamine transporter (DAT), dopamine 1-like receptor (Dop1R1) and fragile X mental retardation 1 (Fmr1)) were replicated by a single independent study. Detailed forest plots and subgroup analyses for individual genes and alleles are shown in Supplementary Figures S1–S15.

Figure 3.
Figure 3. Meta-analytic findings for 32 STM-relevant genes

Summary effect sizes were calculated as performance percent change (PPC) relative to controls (see Methods). Effect sizes reported by independent replications, non-independent replications, and single studies are represented as gold, silver, and bronze diamonds, respectively. Effect sizes reported by one experiment are represented as black dots. Memory alterations in Drosophila mutants ranged from +20% (an STM improvement in trbl mutants), to –134% (an STM defect in ple mutants). The studies show a wide range of iterations, from 6–153. Each iteration reports a full PI score that is derived from ~100 conditioned flies. The total number of experiments for each gene ranges from 1 to 59, where 5HT1B, 5HT2, 5HT7, ple, elm, nemy and Syn are represented by only one experiment and rut is represented by 59 experiments. Abbreviations are as follows: ple = pale; Dop1R1 = Dopamine 1-like receptor 1; 5HT1B = 5-hydroxytryptamine receptor 1B; dnc = dunce; rut = rutabaga; Fmr1 = Fragile X mental retardation 1; 5HT2A = 5-hydroxytryptamine receptor 2A; gish = gilgamesh; sra = sarah; scb = scab; elm = ethanol sensitive with low memory; rg = rugose; Dop2R = Dopamine 2-like receptor; drep-2 = DNA fragmentation factor-related protein 2; 5HT7 = 5-hydroxytryptamine receptor 7; S6KII = Ribosomal protein S6 kinase III; Pp1-87B = Protein phosphatase 1 at 87B; amn = amnesiac; NF1 = Neurofibromin 1; mbm = mushroom body miniature; Nmdar1 = NMDR receptor; DAT = Dopamine transporter; Syn = Synapsin; 14-3-3-Zeta = 14-3-3-Zeta; Fas2 = Fasciclin 2; PKA-RI = Protein kinase, cAMP-dependent, regulatory subunit type 1; Adf1 = Adh transcription factor 1; PQBP1 = Poly-glutamine tract binding protein 1; nemy = no extended memory; Dop1R2 = Dopamine 1-like receptor 2; aru = arouser; trbl = tribbles.

Rut function determines ~57% of STM

Rut was one of the first genes implicated in STM (Livingstone et al., 1984): it encodes an adenylyl cyclase that generates cyclic adenosine monophosphate (cAMP)(Levin et al., 1992). Extending an earlier meta-analysis (Yildizoglu et al., 2015), our review identified rut experiments on 12 loss-of-function alleles and heteroallelic combinations. The STM phenotypes of two alleles (rut2080 and rut1) have been studied by several groups, but other alleles have not been replicated independently. Two of the rut loss-of-function alleles (rut769 and rut1951) showed a much smaller STM impairment compared to the others (Figure 4). These changes in effect size may be due to different degrees of rut deficiency. The aggregate STM reduction caused by loss-of-function rut mutations is –57% [95CI –61, –53] with a moderate overall heterogeneity (I2) of 65%.

Figure 4.
Figure 4. Loss of rut function across different alleles reduces STM by 57%

Meta-analysis of data from rut loss-of-function experiments reveals an overall STM reduction of -57% [95CI -61, -53] with an I2 of 65%. Black squares represent the mean performance percent change (PPC) for corresponding experiments; square sizes represent the relative contribution of each experiment to the meta-analytic average. Data sources are indicated in the study and figure columns; alleles are indicated in their own column. Blue diamonds represent the effect size of the allelic subgroups and the red diamond indicates the overall effect size for rut. All error bars (including diamond vertices) represent the 95% CI. The grey-coloured rows indicate the outliers that were excluded from the calculations based on a Z-score outlier filter (see Methods). This data presentation format is repeated for all other forest plots. FE = fixed effects; RE = random effects.

Dnc lesions reduce STM by two-thirds

Dnc was the first Drosophila gene discovered to modulate memory (Dudai et al., 1976). Subsequent studies have found that dnc encodes a cAMP-specific phosphodiesterase that likely consumes the cAMP generated by RUT activity (Davis and Kiger, 1981). Here, we identified experiments on seven dnc alleles and heteroallelic combinations. The dnc meta-analysis revealed a summary effect size of –67% [95CI -72, -63], with moderate heterogeneity, I2 = 61% (Figure 5).

Figure 5.
Figure 5. Loss of dnc function across different alleles reduces STM by 67%

Meta-analysis of dnc loss-of-function data indicates an overall effect size of -67% [95CI -72, -63] with an I2 of 61%. FE = fixed effects; RE = random effects.

Nf1 function determines ~33% STM

Nf1 encodes a Ras-specific GTPase activating protein; in humans, mice and flies, Nf1 lesions elicit various effects including memory deficits (Guo et al., 2000). Drosophila NF1 interacts with RUT (Guo et al., 2000) in the mushroom body (MB) (Buchanan and Davis, 2010). Here, we identified two STM studies on three loss-of-function Nf1 alleles: studies on two alleles (Nf1P1 and Nf1P2) have been independently replicated but the effect of Nf1c00617 has been investigated only once. Our meta-analysis of all three alleles showed an overall STM decrease of –28% [95CI –34, –22] (Figure 6). However, compared to Nf1P1 and Nf1P2 alleles (–31% and –36% respectively), the effect size of Nf1c00617 (–12%) was low. Because the reduction in male body size associated with NF1 deficiency was also relatively mild in Nf1c00617 mutants, (Buchanan and Davis, 2010), these findings suggest that Nf1c00617 is a weak hypomorph. As such, the best estimate for the contribution of Nf1 to STM is about one-third.

Figure 6.
Figure 6. Loss of Nf1 function across different alleles reduces short-term memory by ~28%

Meta-analysis of Nf1 loss-of-function mutants produced an overall effect size of –28% [95CI -34, -22] with an I2 of 63%. RE = random effects.

Loss of rg function affects STM

Rg encodes an A-kinase anchoring protein (AKAP) that is involved in nervous system development (Shamloula et al., 2002). Loss of rg function decreases STM, while leaving other types of memory intact (Volders et al., 2012). We identified STM studies on six allelic states: three rg hypomorphs (rg1, rgKG02343, rgγ5), an RNAi rg knockdown, a heteroallelic mutant (rg1/rgKG02343) and one amorph (rgFDD). The overall decrease in STM was –43% (Figure 7), but only findings on the rg1 allele were independently replicated (Volders et al., 2012; Zhao et al., 2013). Inducing aberrant MB morphology (Volders et al., 2012; Zhao et al., 2013), the rg null has the strongest effect of all rg alleles on STM (–89%).

Figure 7.
Figure 7. Loss of rg function across different alleles leads to an STM reduction of 43%

Meta-analysis of rg produced an overall effect size of -43% [95CI -53, -32]. Compared to the other alleles, the effect size of the amorphic rgFDD was more than twice as high: –89%. Heterogeneity across experiments was moderate I2 = 72%. FE = fixed effects; PPC = performance percent change; RE = random effects.

Loss of Fmr1 elicits a relatively mild STM phenotype

Fmr1 encodes the fly ortholog of the human FMRP RNA-binding protein associated with Fragile X mental retardation (Zhang et al., 2001). Patients with Fragile X syndrome contain a GGG-triplet expansion in the 5′ untranslated region of Fmr1, which causes hypermethylation and transcriptional silencing (Coffee et al., 2012; Verkerk et al., 1991). Our review identified two studies relating Fmr1 function to STM: one probed the effect of a loss-of-function allele Fmr1Δ50M, while the other used RNAi to knock down Fmr1 (Coffee et al., 2012; Kanellopoulos et al., 2012). The Fmr1Δ50 allele in the homozygous state decreased STM by –77%, while pan-neuronal RNAi knockdown reduced STM by –31% (Figure 8).

Figure 8.
Figure 8. Loss ofFmr1across different alleles reduces STM by 53%

Meta-analysis of Fmr1 indicates an effect size of -53% [95CI -98, -9]. RE = random effects.

Four dopamine-signalling genes affect STM

Dopamine is instrumental to a wide range of behaviours, including STM, and >12 Drosophila genes are associated with dopamine metabolism or signaling (Yamamoto and Seto, 2014). Of these 12 dopamine-related genes, the systematic review identified STM studies performed on four: DAT, ple, Dop1R1, and Dop2R, discussed below.

DAT

Dopamine shuttles across the plasma membrane via the transporter,DAT (Neckameyer and White, 1993; Riemensperger et al., 2011; Zhang et al., 2008). An imbalance in dopamine levels due to altered DAT function is associated with various neurological disorders and addiction in humans (Ueno, 2003; Yang et al., 2007). We found two studies (Ueno et al., 2012; Zhang et al., 2008) that showed that loss of DAT function decreases STM by about –27% (Figure 9A).

Ple

TheDrosophila pale locus encodes the biosynthetic enzyme tyrosinehydroxylase, which is critical for dopamine production. While systemic knockout of ple is lethal, one allele abolishes ple function exclusively in the central nervous system (CNS), thus permitting viability (Riemensperger et al., 2011). Strikingly, absence of dopamine in the CNS inverts STM polarity: instead of avoiding the shock-associated odors, ple mutants actively seek them out—exhibiting a –134% reduction in STM (Figure 3).

Dop1R1 and Dop2R

Four different dopamine receptors have beendescribed in flies: Dop1R1, Dop1R2, Dop2R, and DopEcR (Feng et al., 1996; Gotzes et al., 1994; Hearn et al., 2002; Srivastava et al., 2005). As in mammals, the Drosophila D1-type receptors Dop1R1 and Dop1R2 increase cAMP levels upon dopamine agonism (Beaulieu et al., 2015; Boto et al., 2014). Dop1R1 is expressed in the fan-shaped body, the ellipsoid body and the MB; this receptor has important roles in sleep, arousal, and memory (Andretic et al., 2005; Lebestky et al., 2009; Ueno et al., 2012). In the two studies on this gene (Kim et al., 2007; Qin et al., 2012), two Dop1R1 loss-of-function alleles (Dop1R1In(3LR)234 and Dop1R1f02676) almost completely eliminated learning, with an average STM reduction of –96% (Figure 9B). Dop2R is highly expressed in the MB and decreases cAMP levels in response to dopamine agonism (Scholz-Kornehl and Schwärzel, 2016). We identified one STM study describing a hypomorphic Dop2R mutation that reduced STM by –41% (Scholz-Kornehl and Schwärzel, 2016) (Figure 9C).

Figure 9.
Figure 9. Meta-analyses of genes associated with dopamine signalling

A. Meta-analysis of DAT indicates an overall effect size of –27% [95CI -36,-19].

B. Meta-analysis of Dop1R1 indicates an effect size of –96% [95CI -100, -92]. Dop1R1In(3LR)234 and Dop1R1f02676 are also known as Dop1R1dumb1 and Dop1R1dumb2, respectively.

C. Disruption of Dop2R has an overall effect size of –41%[95CI -47, -35] on short-term memory. PPC = performance percent change; RE = random effects.

Phosphorylation factors are key to STM

Current hypotheses for the mechanisms underlying memory formation invoke protein phosphorylation and dephosphorylation (Alberini, 2009; Kandel, 2012; Margulies et al., 2005). Five phosphorylation-related genes are associated with STM: Protein kinase, cAMP-dependent, regulatorysubunit type 1 (Pka-R1) (Goodwin et al., 1997); Ribosomal S6 serine/ threonine kinase (S6KII) (Putz et al., 2004); Protein phosphatase 1 at 87B (Pp1-87B) (Asztalos et al., 1993); Sarah (sra) (Chang et al., 2003); and gilgamesh (gish) (Tan et al., 2010). Of these, Pka-R1 and S6KII encode kinases (Kalderon and Rubin, 1988; Kim et al., 2006), Pp1-87B encodes a phosphatase (Baksa et al., 1993), sra encodes a calcipressin (a protein that inhibits calcineurin serine/threonine phosphatases) (Chang et al., 2003), and gish encodes a putative kinase (Hummel et al., 2002). Although no STM discovery studies for these genes have been independently replicated to date, internal replicates permitted meta-analysis of all genes except gish (Figures S1–S4; Figure 3). Lesions in these genes produced small-to-moderate STM impairments: Pka-R1 = –25%; Pp1-87B = –30%; gish = –36%; S6KII = –37%; and sra = –51%. Interestingly, none of these loss-of-function mutations completely abolish STM. Including Pka-R1, three of these genes have been characterized in the context of the Rut pathway; sra is thought to interact with the cAMP/PKA pathway (Chang et al., 2003), while epistasis analysis showed that gish STM function is independent of rut (Tan et al., 2010).

STM relies on serotonin receptors

Serotonin (5-hydroxytryptamine; 5-HT) signalling influences numerous Drosophila behaviours, including sleep (Nichols, 2007; Yuan et al., 2006), courtship (Pooryasin and Fiala, 2015), place learning (Sitaraman et al., 2008) and aversive olfactory conditioning. Flies express five serotonin receptors: 5HT1A, 5HT1B, 5HT2A, 5HT2B and 5HT7 (Gasque et al., 2013; Johnson et al., 2011; Majeed et al., 2016). Loss-of-function mutants for three of these receptors (5HT1B, 5HT2A, and 5HT7) have been analyzed by T-maze olfactory conditioning, but no replication studies have been reported. All three mutants exhibited at least moderate learning impairments: a 5HT1B hypomorph impaired STM by –75%, a 5-HT2A lesion reduced STM by –52% and a hypomorphic 5-HT7 mutation decreased STM by –38% (Johnson et al., 2011; Nichols, 2007)(Figure 3).

STM-relevant genes involved in nucleic-acid function

Three STM genes are associated with nucleic acid function: Adhtranscription factor 1 (Adf1); polyglutamine tract-binding protein 1 (PQBP1); and mushroom body miniature (mbm). Adf1 is widely expressed during development (DeZazzo et al., 2000), and has a role in synaptic bouton formation in the larval neuromuscular junction (Timmerman et al., 2013).

PQBP1 encodes a polyglutamine tract-binding protein that acts as a transcriptional repressor (Okazawa et al., 2002; Waragai et al., 1999). Mbm contains a zinc finger motif—suggesting nucleic acid binding function (Raabe et al., 2004) and is necessary for neuroblast ribosomal biogenesis (Hovhanyan et al., 2014). The effects of lesions in these genes on STM are relatively modest, and have not been independently replicated: Adf1 = –21%; PQBP1 = –20%; and mbm = –33% (Figures S5–7) (de Belle and Heisenberg, 1996; DeZazzo et al., 2000; Tamura et al., 2010).

Additional intracellular-signaling genes

Five additional intracellular signalling STM genes have been reported: 14-3-3ζ; Synapsin (Syn); tribbles (trbl); arouser (aru); and DNA fragmentation factor-related protein 2 (Drep2). 14-3-3ζ is preferentially expressed in the MB; loss-of-function alleles produce an STM reduction of –26% STM (Figure S8) (Philip et al., 2001; Skoulakis and Davis, 1996). Syn is a conserved presynaptic phosphoprotein, which among other functions, regulates vesicle recruitment to the readily-releasable pool (Hosaka et al., 1999; Rizzoli and Betz, 2005); meta-analysis of a study with nine STM loss-of-function experiments showed an STM reduction of –26% (Figure 3) (Godenschwege et al., 2004). A trbl lesion uniquely enhanced STM by +20% (Figure S9) (LaFerriere et al., 2008). Hypomorphic aru variants have mildly impaired performance during olfactory conditioning, eliciting an STM reduction of only –14% (Figure S10) (LaFerriere et al., 2011). Drep2 is a synaptic protein expressed in the Drosophila CNS. Drep 2 expression is especially pronounced at the postsynaptic densities of synapses between projection neurons and Kenyon cells (Andlauer et al., 2014); two Drep2 deletion alleles decrease olfactory conditioning performance by –40% (Figure S11)(Andlauer et al., 2014). To date, none of the effects of these five genes on STM have been replicated in an independent follow-up study.

Extracellular-signaling STM genes

Four STM genes were identified with extracellular-signaling functions: NMDA receptor 1 (Nmdar1); Fasciclin 2 (Fas2); scab (scb); and amnesiac (amn). Of these, only findings on amn have been replicated independently. Nmdar1 encodes a subunit of the NMDA receptor (a heteromeric glutamate-gated cation channel), and is weakly expressed throughout the adult fly brain (Xia et al., 2005). An Nmdar1 hypomorphic mutation mildly disrupts olfactory learning by –28% (Figure S12)(Xia et al., 2005). Fas2 is expressed in the MB and is involved in axon guidance and cell adhesion during development (Lin and Goodman, 1994; Schuster et al., 1996), and may facilitate dopaminergic input (Cheng et al., 2001). The meta-analysis of 19 experiments from a study on Fas2 loss-of-function mutants revealed an overall STM impairment of –26% (Figure S13). scb is a plasma-membrane α-integrin involved in cell adhesion, and is hypothesized to remodel synapses during learning (Grotewiel et al., 1998). The meta-analysis of scb loss-of-function data from 23 experiments found in two studies (Beck et al., 2000; Grotewiel et al., 1998) indicated an overall STM reduction of –49% (Figure S14). Amn is a putative neuropeptide gene that is expressed in two MB-extrinsic dorsal-paired-medial neurons (Waddell et al., 2000). Amn function is required for STM formation; meta-analysis of four experiments in three studies found an overall STM impairment of –30% (DeZazzo et al., 1999; Folkers et al., 1993; Tully and Quinn, 1985) (Figure S15).

STM genes with no known molecular function

Two genes with no-known-molecular function have been implicated in STM: ethanol sensitive with low memory (elm); and no extended memory (nemy). Elm is predicted to encode a calcium-binding protein, and influences both ethanol sensitivity and STM (LaFerriere et al., 2008); an insertional elm allele reduced STM by –44% (Figure 3). Nemy is predicted to alter the transcription of neighbouring genes CG8776 and CG8772 ((Kamyshev et al., 2002)); a loss-of-function nemy mutation reduced STM by –17% (Kamyshev et al., 2002)(Figure 3). The STM experiments concerning both of these genes have not yet been replicated.

Replicated findings show no evidence of publication bias

Publication bias is the publication of only positive results and neglection of negative data (Easterbrook et al., 1991). We used a funnel-plot analysis (Egger et al., 1997) to examine whether the meta-analysed data had a SE–effect size relationship consistent with publication bias. For this, we selected genes with ≥10 iterations (N) in the meta-analysis (Egger et al., 1997; Sterne et al., 2011); this selection resulted in nine eligible genes. None of the funnel plots for each gene showed any appreciable asymmetry (Figure 10 A-I). This result is consistent with the proposal that the independently replicated STM data are unbiased.

Figure 10.
Figure 10. Funnel plot analysis of STM genes shows no publication bias

A–I. A comparison of the standard error (a measure of precision) with the performance percentchange (effect sizes from all studies) for each respective gene shows a largely symmetrical distribution around the meta-analytic summary effect size (triangular apex and vertical black line). The Egger’s regression test, which evaluates the significance of the bias, is consistent with the assumption of no publication bias for all genes plotted.

Overall heterogeneity across experiments is low

As previously discussed, the degree of variability across experiments in a meta-analysis can be described by the heterogeneity metric (Higgins et al., 2003). Heterogeneity (I2%) is closely related to reproducibility—the lower the heterogeneity, the more closely inter-study data agree. We calculated heterogeneity for all STM genes. Considering that combining different alleles may increase heterogeneity, we also conducted—where needed—subgroup analyses of individual alleles or heteroallelic combinations. Of the 23 meta-analysed genes, the majority (17) showed low overall heterogeneity (I2 ≤ 50%); only two (amn and Fmr1) showed high overall heterogeneity (I2 > 75%)(Table 1). We observed large differences in inter-allelic heterogeneity among the subgroups of amn, dnc, Fmr1, NF-1, rg, and rut (Table 1). By contrast, intra-allelic heterogeneity was low for all genes except for the aru8.128 allele (I2 = 81.36%)(Supplementary File 2).

View this table:
Table 1: Reproducibility estimates from 23 meta-analyses

Heterogeneity (I2) and mean absolute difference (MAD) values calculated for short-term memory-gene meta-analyses. Heterogeneity indicates the proportion of variance not attributable to sampling error alone; MAD indicates the mean difference between replicates. A hyphen indicates the metric is not applicable to the data set.

Figure 11.
Figure 11. Heterogeneity distribution in the meta-analysed data set

A. Effect size does not correlate with intra-allelic heterogeneity (Adjusted-R2 = -0.016, P = 0.6169). Short-term memory genes are shown as bubbles, with diameters proportional to their sample size and labelled according the replication status (see Figure 3).

B. Internally replicated results show a lower heterogeneity (I2) than those with independent replications. I2 medians for independent replicates = 9.441 (interquartile range, IQR 0 to 59.96), shared-authors = 0 (IQR 0 to 9.24), and single-article = 0 (IQR 0 to 0).

Because small changes in STM are harder to detect than large changes, we hypothesized that genes with subtle performance changes would also have poor reproducibility. To test this hypothesis, we plotted the intra-allelic heterogeneities against allelic effect sizes. We found no relationship between effect size and heterogeneity (adjusted-R2 = -0.016, P = 0.6169, Figure 11A).

As most studies on STM genes have not been replicated, we next asked whether heterogeneity increased when data were derived from independent replications. To test this hypothesis, we grouped the heterogeneity scores according to the allele’s replication status (for classification see Figure 3). As expected, genes with a higher replication status generated more heterogeneous results compared to those with a lower replication status (Figure 11B). Heterogeneity in datasets from independently replicated genes (median = 9.4) was substantially higher than both the heterogeneity of the shared-authors replicates (median = 0) and the within-study replicates (median = 0).

Effect-size reproducibility is high

Due to the drawbacks associated with I2 (see Methods), we also calculated the MAD as an independent estimate of reproducibility; MAD is not biased by the SE. For all tiers of replication, the majority of STM genes had a low MAD <20% (see Methods). Defining high MAD as >20%, only five of the 23 meta-analyzed genes had a high overall MAD: amn, aru, Fmr1, Pp1-87B, and scb (Table 1). Similarly, for inter-allelic and intra-allelic reproducibility, only 10 and five genes had a high MAD, respectively (Table 1, Supplementary File 2). There was no relationship between intra-allelic MAD and the effect size (adjusted-R2 = –0.02, P = 0.789), further supporting the conclusion that small effect sizes are not harder to reproduce (Figure 12A). Between the three replication categories, we observed only subtle differences between the median MAD scores (Figure 12B). Both heterogeneity and MAD measures support that there is good reproducibility in Drosophila STM studies.

Figure 12.
Figure 12. Analysis of reproducibility by mean absolute difference (MAD) scores

A. Effect size does not correlate with MAD scores (Adjusted-R2 = -0.02058, P = 0.789). Short-term memory genes are shown in bubbles that have diameters relative to their sample size, and colors depending on the replication status (gold = independent, silver = shared-author, bronze = single-study.)

B. Internally replicated results show a somewhat lower MAD score than those replicated independently. Medians of the three tiers were only slightly different, and had substantial overlap: independent = 12.63 (interquartile range, IQR 7.05 to 14.3); same-group = 6.07 (IQR 3.28 to 12.96); and single-article = 4.99 (IQR 1.34 to 10.36). PPC = performance percent change.

Figure 13.
Figure 13. Effect sizes between original and follow-up findings are comparable

Absolute performance percent change (|PPC|) values of the earliest T-maze experiments (green) and their independent replicates (orange) were compared. Experimental data are derived from genes for which replicate experiments are available: rut, dnc, NF1, Dop1R1, rg, Fmr1, DAT. The replicate effect sizes are slightly larger than the original effect sizes: median |PPC| for the earliest T-maze studies = 38.12 (interquartile range, IQR 13.54 to 82.07); median |PPC| for all replicates = 57.14 (IQR 31.66 to 70.13), U = 1373.0, P = 0.09.

Independent replications have effect sizes similar to original findings

In psychological science, effect sizes decline substantially between discovery studies and follow-up articles (Open Science Collaboration, 2015b). For the seven STM genes that have been independently replicated, we compared the average effect sizes from the earliest report for each gene with the available replicate effect sizes. In total, 31 experiments from discovery studies were matched with 105 experiments from follow-up studies. Surprisingly, the later T-maze effect sizes were, on average, +19% higher than those reported in earlier publications (Figure 13). This result refutes the hypothesis of low reproducibility, and supports the idea that STM analyses in Drosophila are highly reproducible.

Discussion

Meta-research aspects

Recent meta-research debate has focused on the poor reproducibility of data observed in a number of fields, including the psychological sciences (Open Science Collaboration, 2015b), and preclinical neurosciences (Button et al., 2013), and how the publication of underpowered experiments is driven by incentive structures (Munafò et al., 2017; Nuzzo, 2015; Rosenthal and Rosnow, 2009). While widespread irreproducibility is clearly an important problem in many fields, our data support that this does not hold true for Drosophila genetic studies of olfactory STM. Although publication bias is found in other areas of neuroscience (Mohammad et al., 2016; Sena et al., 2010), funnel plot analysis indicated that STM gene effect-size distributions were unbiased. Moreover, three quantitative measures of reproducibility (heterogeneity, MAD, and effect-size decline) indicated generally high reproducibility. Thus studies in this field appear more reproducible than other areas of brain science.

There are at least two possible interpretations as to why this finding should be. One positive hypothesis would be that the Drosophila STM field has superior data integrity due to the low cost of experiments that allow the use of large sample sizes. Low costs should also mean that independent replication is relatively accessible to other labs, so discovery authors—operating with this knowledge—might favor waiting to publish when key results have been extensively internally replicated. Certainly, our systematic review found ample evidence of extensive internal replication, supporting this positive view. However, the second and more skeptical hypothesis points at the relative dearth of independent replication: of the 32 identified genes, only seven have been independently replicated thus far. The bulk of STM loss-of-function replications have been conducted on dnc and rut mutants, which were both originally identified in the early 1980s (Duerr and Quinn, 1982; Livingstone et al., 1984). For each non-replicated gene, this view proposes either that there is insufficient interest for any other lab to perform a replication experiment, or that an experiment was conducted but never published. This skeptical perspective holds that the replication shortage could be a cryptic form of publication bias. Indeed, our review found no refutation studies, suggesting that the field abandons—rather than refutes—irreproducible memory genes. This abandonment hypothesis would ideally be tested with pre-registered experiments, as was done in psychology (Open Science Collaboration, 2015b).

Limitations

There are two notable limitations to this study. First, a challenge for all meta-analyses is to balance data splitting and clumping to appropriately account for experimental differences. Direct replication is a noble ideal; in practice however, all follow-up experiments are conceptual replicates to varying degrees as there are always differences between experiments. Here, we addressed experimental variation using sub-groups to examine allelic differences, while combining data from all (non-outlier) loss-of-function alleles for a gene. This approach accommodates different alleles, while yielding a single estimate for the overall impact of each gene. We observed that the literature contains little information regarding the severity of individual alleles, or the qualitative or quantitative differences between alleles; reports of quantitative measures of allelic severity (e.g. q-PCR, ELISA, immunohistochemistry analyses) were the exception (Chang et al., 2003; Goodwin et al., 1997; Grotewiel et al., 1998; Han et al., 1992; Qiu and Davis, 1993). Due to this absence, multilevel models that might be constructed to account for this variation are inaccessible (Yildizoglu et al., 2015). Despite this limitation, we view the present method as preferable to narrative review, because meta-analyses are systematic and quantitative.

Second, there remains no optimal method, to date, to quantify reproducibility. As significance testing is now deprecated (Claridge-Chang and Assam, 2016; Cumming and Calin-Jageman, 2016; Gardner and Altman, 1986; Halsey et al., 2015), assessing reproducibility with significance test results was avoided (Open Science Collaboration, 2015b). Nevertheless, the three methods used here also have limitations: heterogeneity incurs the issues described above; MAD is not standardized, so cannot be compared across experimental systems; and effect-size decline can only provide an overview. We propose that variance-type measures of reproducibility are preferable to significance-test-result methods, which inherently introduce arbitrary threshold distortion (Halsey et al., 2015; Yildizoglu et al., 2015).

Genetic aspects

Our meta-analyses produced estimates of the quantitative phenotypes for all STM alleles. An advantage of model-system genetics is the ability to assess two gene lesions in combination; this approach allows geneticists to determine whether such combinations are additive or epistatic. Additivity suggests that two genes function independently, while epistasis (sub-additive or super-additive effect sizes) can mean that they operate in the same pathway. The 32 STM genes could be crossed into 1,024 possible two-way combinations; of these, 164 pairs have an effect-size sum exceeding 100%. Despite this, we detected only a few studies that contained experiments on trans-allelic combinations, including rut–dnc (Scheunemann et al., 2012); rut–gish (Tan et al., 2010); and rut–NF1 (Guo et al., 2000). Although looking for epistasis experiments was not an original goal of the review, the observation (of a systematic set of articles) suggests that integrating existing genes into pathways is largely missing from the field. Including the oddball effect sizes (ple and trbl), the sum of absolute effect sizes for STM genes is 1309% (Figure 3). Assuming that most gene effects are reproducible, it is difficult to account for this memory over-abundance. There are at least two possible explanations. First, many genes may fall into the same pathways: for example, there could be three pathways, each accounting for ~33% of STM and comprising roughly a dozen genes. Second, it may be that the current methods of measuring STM lesions lack specificity, and that disrupting numerous neuronal processes have multifarious effects on both memory formation per se and its preconditions.

All STM-gene-discovery studies demonstrated that the genetic lesion(s) disrupted memory while leaving odor sensitivity, shock sensitivity, and motor function unaffected (Supplementary File 1). These controls establish that a lesion does not affect the constituent sensory–motor systems (Mihalek et al., 1997), with the aim of establishing a specific role in associative functions. Nevertheless, apart from memory, the identified STM genes are reportedly involved in numerous additional biological processes. For example, loss of NF1 function shortens lifespan, increases sensitivity to oxidative stress (Tong et al., 2007), disrupts circadian rhythms (Williams et al., 2001), and produces excessive grooming behaviours (King et al., 2016). The classical STM genes rut and dnc each have pleiotropic effects on at least five non-memory behaviours (Chen and Ganetzky, 2012; Donlea et al., 2009; Gailey et al., 1984; Hong et al., 2008; Kiger and Salz, 1985; Kubli, 2003; McBride et al., 1999; Perrimon et al., 1986; Siegel and Hall, 1979; Tong et al., 2007; Venkatesh et al., 2001; Zhong and Wu, 2004). That all STM genes are broadly pleiotropic raises the question as to whether such factors can be considered memory genes per se, or should be viewed as neuronal-function genes, perhaps with selective importance to memory cells.

The classic example of a preconditional memory lesion is one that disrupts normal MB development, but is not acutely involved in the physiological changes that occur during STM formation. In addition to olfactory-avoidance controls and neuroanatomy, this confound can be addressed, in part, with temporal control of gene function/dysfunction (Dubnau et al., 2001; McGuire et al., 2001, 2003). However, even this protocol cannot differentiate between genes that have an immediate role in associative plasticity and those that are acutely essential to normal memory-cell function. If the latter type are preferentially expressed in the memory cells, they would be almost indistinguishable from core plasticity factors.

From the 32 years of 50 STM genetics papers, only one was published in the review’s most recent three years, suggesting declining efforts in this area (Supplementary Figure S16). However, the emerging circuit-analysis field retains a considerable reliance on the classic learning-gene literature (Cohn et al., 2015; Hige et al., 2015). Nevertheless, a complete theory of memory will require the integration of evidence from system, circuit, cellular, molecular, and genetic analyses; memory genetics remains a topic of crucial importance.

Conclusion

This study investigated the hypothesis that Drosophila memory genetics has limited reproducibility. To address this question, we performed a systematic review of the Drosophila STM genetics field, defined a taxonomy of replication types, performed meta-analyses, and applied several reproducibility metrics. The resulting synthesis does not support the hypothesis but instead indicates that replicated STM gene discovery experiments are highly reproducible, and that the published data are unbiased. The data synthesis also revealed that, while there is extensive internal replication, the rate of independent replication is limited. Total current STM-gene lesions have an estimated sum of deleterious effects of >1000%. Assuming their effects are all reproducible, this finding suggests either that many of the genes fall into shared pathways, or that current protocols lack specificity to identify core associative plasticity factors.

Author contributions

Conceptualization: ACC; Methodology: TT, ACC; Software: TT (R and Python); Data Analysis: TT; Writing – Original Draft: TT, SO; Writing – Revision: TT, SO, ACC; Visualization: TT; Supervision: ACC; Project Administration: ACC; Funding Acquisition: ACC.

Sources of funding

The authors were supported by grants from the Ministry of Education (grant numbers MOE2013-T2-2-054 and MOE2017-T2-1-089) awarded to ACC. TT was supported by a Singapore International Graduate Award from the A*STAR Graduate Academy. SO was supported by a Khoo Postdoctoral Fellowship from Duke–NUS Medical School. The authors received additional support from Duke–NUS Medical School, a Biomedical Research Council block grant to the Institute of Molecular and Cell Biology, and grants from the A*STAR Joint Council Office (grant numbers 1231AFG030 and 1431AFG120) awarded to ACC.

Acknowledgments

The authors would like to thank Pryseley Assam for suggesting mean absolute difference, and Insight Editing London for editing the manuscript.

References

  1. ↵
    Alberini CM (2009) Transcription factors in long-term memory and synaptic plasticity. Physiological reviews 89(1): 121–145.
    OpenUrlCrossRefPubMedWeb of Science
  2. ↵
    Altman EI (1968) FINANCIAL RATIOS, DISCRIMINANT ANALYSIS AND THE PREDICTION OF CORPORATE BANKRUPTCY. The Journal of finance, Blackwell Publishing Ltd 23(4): 589–609.
    OpenUrl
  3. ↵
    Anderson CJ, Bahník Š, Barnett-Cowan M, et al. (2016) Response to Comment on ‘Estimating the reproducibility of psychological science’. Science 351(6277): 1037.
    OpenUrlFREE Full Text
  4. ↵
    Andlauer TFM, Scholz-Kornehl S, Tian R, et al. (2014) Drep-2 is a novel synaptic protein important for learning and memory. eLife 3. Available from: dx.doi.org/10.7554/eLife.03895.
  5. ↵
    Andretic R, van Swinderen B, and Greenspan RJ (2005) Dopaminergic modulation of arousal in Drosophila. Current biology: CB 15(13): 1165–1175.
    OpenUrl
  6. ↵
    Asztalos Z, von Wegerer J, Wustmann G, et al. (1993) Protein phosphatase 1-deficient mutant Drosophila is affected in habituation and associative learning. The Journal of neuroscience: the official journal of the Society for Neuroscience 13(3): 924–930.
    OpenUrlAbstract/FREE Full Text
  7. ↵
    Bailey CH, Kandel ER, and Harris KM (2015) Structural Components of Synaptic Plasticity and Memory Consolidation. Cold Spring Harbor perspectives in biology 7(7): a021758.
    OpenUrlAbstract/FREE Full Text
  8. ↵
    Baker M (2016) 1,500 scientists lift the lid on reproducibility. Nature 533(7604): 452–454.
    OpenUrlCrossRefPubMed
  9. ↵
    Baksa K, Morawietz H, Dombrádi V, et al. (1993) Mutations in the protein phosphatase 1 gene at 87B can differentially affect suppression of position-effect variegation and mitosis in Drosophila melanogaster. Genetics 135(1): 117–125.
    OpenUrlAbstract/FREE Full Text
  10. ↵
    Beaulieu J-M, Espinoza S, and Gainetdinov RR (2015) Dopamine receptors - IUPHAR Review 13. British journal of pharmacology 172(1): 1–23.
    OpenUrlCrossRefPubMed
  11. ↵
    Beck CD, Schroeder B, and Davis RL (2000) Learning performance of normal and mutant Drosophila after repeated conditioning trials with discrete stimuli. The Journal of neuroscience: the official journal of the Society for Neuroscience 20(8): 2944–2953.
    OpenUrlAbstract/FREE Full Text
  12. ↵
    Begley CG and Ellis LM (2012) Drug development: Raise standards for preclinical cancer research. Nature, Nature Publishing Group, a division of Macmillan Publishers Limited. All Rights Reserved. 483(7391): 531–533.
    OpenUrl
  13. ↵
    Boto T, Louis T, Jindachomthong K, et al. (2014) Dopaminergic modulation of cAMP drives nonlinear plasticity across the Drosophila mushroom body lobes. Current biology: CB 24(8): 822–831.
    OpenUrl
  14. ↵
    Buchanan ME and Davis RL (2010) A distinct set of Drosophila brain neurons required for neurofibromatosis type 1-dependent learning and memory. The Journal of neuroscience: the official journal of the Society for Neuroscience 30(30): 10135–10143.
    OpenUrlAbstract/FREE Full Text
  15. ↵
    Button KS, Ioannidis JPA, Mokrysz C, et al. (2013) Power failure: why small sample size undermines the reliability of neuroscience. Nature reviews. Neuroscience 14(5): 365–376.
    OpenUrl
  16. ↵
    Chang KT, Shi Y-J, and Min K-T (2003) The Drosophila homolog of Down’s syndrome critical region 1 gene regulates learning: implications for mental retardation. Proceedings of the National Academy of Sciences of the United States of America 100(26): 15794–15799.
    OpenUrlAbstract/FREE Full Text
  17. ↵
    Cheng Y, Endo K, Wu K, et al. (2001) Drosophila fasciclinII is required for the formation of odor memories and for normal sensitivity to alcohol. Cell 105(6): 757–768.
    OpenUrlCrossRefPubMedWeb of Science
  18. ↵
    Chen X and Ganetzky B (2012) A neuropeptide signaling pathway regulates synaptic growth in Drosophila. The Journal of cell biology 196(4): 529–543.
    OpenUrlAbstract/FREE Full Text
  19. ↵
    Claridge-Chang A and Assam PN (2016) Estimation statistics should replace significance testing. Nature methods 13(2): 108–109.
    OpenUrl
  20. ↵
    Coffee RL Jr, Williamson AJ, Adkins CM, et al. (2012) In vivo neuronal function of the fragile X mental retardation protein is regulated by phosphorylation. Human molecular genetics 21(4): 900–915.
    OpenUrlCrossRefPubMedWeb of Science
  21. ↵
    Cognigni P, Felsenberg J, and Waddell S (2017) Do the right thing: neural network mechanisms of memory formation, expression and update in Drosophila. Current opinion in neurobiology 49: 51–58.
    OpenUrlCrossRef
  22. ↵
    Cohn R, Morantte I, and Ruta V (2015) Coordinated and Compartmentalized Neuromodulation Shapes Sensory Processing in Drosophila. Cell 163(7): 1742–1755.
    OpenUrlCrossRefPubMed
  23. ↵
    Cramer H (1946) Mathematical models of statistics. Princeton Math. Series, (9).
  24. ↵
    Cumming G and Calin-Jageman R (2016) Introduction to the New Statistics: Estimation, Open Science, and Beyond. Routledge.
  25. ↵
    David HA (1968) Miscellanea: Gini’s mean difference rediscovered. Biometrika, Oxford University Press 55(3): 573–575.
    OpenUrlCrossRef
  26. ↵
    Davis RL (2011) Traces of Drosophila memory. Neuron 70(1): 8–19.
    OpenUrlCrossRefPubMedWeb of Science
  27. ↵
    Davis RL and Kiger JA Jr. (1981) Dunce mutants of Drosophila melanogaster: mutants defective in the cyclic AMP phosphodiesterase enzyme system. The Journal of cell biology 90(1): 101–107.
    OpenUrlAbstract/FREE Full Text
  28. ↵
    de Belle JS and Heisenberg M (1996) Expression of Drosophila mushroom body mutations in alternative genetic backgrounds: a case study of the mushroom body miniature gene (mbm). Proceedings of the National Academy of Sciences of the United States of America 93(18): 9875–9880.
    OpenUrlAbstract/FREE Full Text
  29. ↵
    DeZazzo J, Xia S, Christensen J, et al. (1999) Developmental expression of an amn(+) transgene rescues the mutant memory defect of amnesiac adults. The Journal of neuroscience: the official journal of the Society for Neuroscience 19(20): 8740–8746.
    OpenUrlAbstract/FREE Full Text
  30. ↵
    DeZazzo J, Sandstrom D, de Belle S, et al. (2000) nalyot, a mutation of the Drosophila myb-related Adf1 transcription factor, disrupts synapse formation and olfactory memory. Neuron 27(1): 145–158.
    OpenUrlCrossRefPubMedWeb of Science
  31. ↵
    Donlea JM, Ramanan N, and Shaw PJ (2009) Use-dependent plasticity in clock neurons regulates sleep need in Drosophila. Science 324(5923): 105–108.
    OpenUrlAbstract/FREE Full Text
  32. ↵
    Dubnau J, Grady L, Kitamoto T, et al. (2001) Disruption of neurotransmission in Drosophila mushroom body blocks retrieval but not acquisition of memory. Nature 411(6836): 476–480.
    OpenUrlCrossRefPubMedWeb of Science
  33. ↵
    Dudai Y, Jan YN, Byers D, et al. (1976) dunce, a mutant of Drosophila deficient in learning. Proceedings of the National Academy of Sciences of the United States of America 73(5): 1684–1688.
    OpenUrlAbstract/FREE Full Text
  34. ↵
    Duerr JS and Quinn WG (1982) Three Drosophila mutations that block associative learning also affect habituation and sensitization. Proceedings of the National Academy of Sciences of the United States of America 79(11): 3646–3650.
    OpenUrlAbstract/FREE Full Text
  35. ↵
    Easterbrook PJ, Berlin JA, Gopalan R, et al.(1991) Publication bias in clinical research. The Lancet 337(8746): 867–872.
    OpenUrl
  36. ↵
    Egger M, Smith GD, and Phillips AN (1997) Meta-analysis: principles and procedures. BMJ 315(7121): 1533–1537.
    OpenUrlFREE Full Text
  37. ↵
    Ehmann N, Owald D, and Kittel RJ (2017) Drosophila active zones: From molecules to behaviour. Neuroscience research. Available from: dx.doi.org/10.1016/j.neures.2017.11.015.
  38. ↵
    eLife (2017) The challenges of replication. 6. Available from: dx.doi.org/10.7554/eLife.23693.
  39. ↵
    Fathallah-Shaykh HM, Bona JL, and Kadener S (2009) Mathematical model of the Drosophila circadian clock: loop regulation and transcriptional integration. Biophysical journal 97(9): 2399–2408.
    OpenUrlCrossRefPubMedWeb of Science
  40. ↵
    Feng G, Hannan F, Reale V, et al. (1996) Cloning and functional characterization of a novel dopamine receptor from Drosophila melanogaster. The Journal of neuroscience: the official journal of the Society for Neuroscience 16(12): 3925–3933.
    OpenUrlAbstract/FREE Full Text
  41. ↵
    Folkers E, Drain P, and Quinn WG (1993) Radish, a Drosophila mutant deficient in consolidated memory. Proceedings of the National Academy of Sciences of the United States of America 90(17): 8123–8127.
    OpenUrlAbstract/FREE Full Text
  42. ↵
    Gailey DA, Jackson FR, and Siegel RW (1984) Conditioning Mutations in DROSOPHILA MELANOGASTER Affect an Experience-Dependent Behavioral Modification in Courting Males. Genetics 106(4): 613–623.
    OpenUrlAbstract/FREE Full Text
  43. ↵
    Gardner MJ and Altman DG (1986) Confidence intervals rather than P values: estimation rather than hypothesis testing. British medical journal 292(6522): 746–750.
    OpenUrlAbstract/FREE Full Text
  44. ↵
    Gasque G, Conway S, Huang J, et al. (2013) Small molecule drug screening in Drosophila identifies the 5HT2A receptor as a feeding modulation target. Scientific reports 3: srep02120.
    OpenUrl
  45. ↵
    Gilbert DT, King G, Pettigrew S, et al. (2016) Comment on ‘Estimating the reproducibility of psychological science’. Science, American Association for the Advancement of Science 351(6277): 1037–1037.
    OpenUrl
  46. ↵
    Godenschwege TA, Reisch D, Diegelmann S, et al. (2004) Flies lacking all synapsins are unexpectedly healthy but are impaired in complex behaviour. The European journal of neuroscience 20(3): 611–622.
    OpenUrlCrossRefPubMedWeb of Science
  47. ↵
    Goodwin SF, Del Vecchio M, Velinzon K, et al. (1997) Defective learning in mutants of the Drosophila gene for a regulatory subunit of cAMP-dependent protein kinase. The Journal of neuroscience: the official journal of the Society for Neuroscience 17(22): 8817–8827.
    OpenUrlAbstract/FREE Full Text
  48. ↵
    Gotzes F, Balfanz S, and Baumann A (1994) Primary structure and functional characterization of a Drosophila dopamine receptor with high homology to human D1/5 receptors. Receptors & channels 2(2): 131–141.
    OpenUrlPubMedWeb of Science
  49. ↵
    Grotewiel MS, Beck CD, Wu KH, et al. (1998) Integrin-mediated short-term memory in Drosophila. Nature 391(6666): 455–460.
    OpenUrlCrossRefPubMed
  50. ↵
    Guo HF, Tong J, Hannan F, et al. (2000) A neurofibromatosis-1-regulated pathway is required for learning in Drosophila. Nature 403(6772): 895–898.
    OpenUrlCrossRefPubMedWeb of Science
  51. ↵
    Haidich AB (2010) Meta-analysis in medical research. Hippokratia 14(Suppl 1): 29–37.
    OpenUrlPubMed
  52. ↵
    Halsey LG, Curran-Everett D, Vowler SL, et al. (2015) The fickle P value generates irreproducible results. Nature methods 12(3): 179–185.
    OpenUrl
  53. ↵
    Han PL, Levin LR, Reed RR, et al. (1992) Preferential expression of the Drosophila rutabaga gene in mushroom bodies, neural centers for learning in insects. Neuron 9(4): 619–627.
    OpenUrlCrossRefPubMedWeb of Science
  54. ↵
    Hardin PE (2011) Molecular genetic analysis of circadian timekeeping in Drosophila. Advances in genetics 74: 141–173.
    OpenUrlCrossRefPubMed
  55. ↵
    Hearn MG, Ren Y, McBride EW, et al. (2002) A Drosophila dopamine 2-like receptor: Molecular characterization and identification of multiple alternatively spliced variants. Proceedings of the National Academy of Sciences of the United States of America 99(22): 14554–14559.
    OpenUrlAbstract/FREE Full Text
  56. ↵
    Heisenberg M (2003) Mushroom body memoir: from maps to models. Nature reviews. Neuroscience 4(4): 266–275.
    OpenUrl
  57. ↵
    Hige T, Aso Y, Rubin GM, et al. (2015) Plasticity-driven individualization of olfactory coding in mushroom body output neurons. Nature 526(7572): 258–262.
    OpenUrlCrossRefPubMed
  58. ↵
    Higgins JPT, Thompson SG, Deeks JJ, et al. (2003) Measuring inconsistency in meta-analyses. BMJ 327(7414): 557–560.
    OpenUrlFREE Full Text
  59. ↵
    Hong S-T, Bang S, Hyun S, et al. (2008) cAMP signalling in mushroom bodies modulates temperature preference behaviour in Drosophila. Nature 454(7205): 771–775.
    OpenUrlCrossRefPubMedWeb of Science
  60. ↵
    Hosaka M, Hammer RE, and Südhof TC (1999) A phospho-switch controls the dynamic association of synapsins with synaptic vesicles. Neuron 24(2): 377–387.
    OpenUrlCrossRefPubMedWeb of Science
  61. ↵
    Hovhanyan A, Herter EK, Pfannstiel J, et al. (2014) Drosophila mbm is a nucleolar myc and casein kinase 2 target required for ribosome biogenesis and cell growth of central brain neuroblasts. Molecular and cellular biology 34(10): 1878–1891.
    OpenUrlAbstract/FREE Full Text
  62. ↵
    Hummel T, Attix S, Gunning D, et al. (2002) Temporal control of glial cell migration in the Drosophila eye requires gilgamesh, hedgehog, and eye specification genes. Neuron 33(2): 193–203.
    OpenUrlCrossRefPubMedWeb of Science
  63. ↵
    Ioannidis JPA (2012) Why Science Is Not Necessarily Self-Correcting. Perspectives on psychological science: a journal of the Association for Psychological Science 7(6): 645–654.
    OpenUrl
  64. ↵
    Johnson O, Becnel J, and Nichols CD (2011) Serotonin receptor activity is necessary for olfactory learning and memory in Drosophila melanogaster. Neuroscience 192: 372–381.
    OpenUrlCrossRefPubMedWeb of Science
  65. ↵
    Kalderon D and Rubin GM (1988) Isolation and characterization of Drosophila cAMP-dependent protein kinase genes. Genes & development 2(12A): 1539–1556.
    OpenUrlAbstract/FREE Full Text
  66. ↵
    Kamyshev NG, Iliadi KG, Bragina JV, et al. (2002) Novel memory mutants in Drosophila: Behavioral characteristics of the mutant nemy P153. BMC neuroscience, BioMed Central 3(1): 9.
    OpenUrl
  67. ↵
    Kandel ER (2012) The molecular biology of memory: cAMP, PKA, CRE, CREB-1, CREB-2, and CPEB. Molecular brain 5: 14.
    OpenUrl
  68. ↵
    Kanellopoulos AK, Semelidou O, Kotini AG, et al. (2012) Learning and memory deficits consequent to reduction of the fragile X mental retardation protein result from metabotropic glutamate receptor-mediated inhibition of cAMP signaling in Drosophila. The Journal of neuroscience: the official journal of the Society for Neuroscience, Soc Neuroscience 32(38): 13111–13124.
    OpenUrl
  69. ↵
    Keene AC and Waddell S (2007) Drosophila olfactory memory: single genes to complex neural circuits. Nature reviews. Neuroscience 8(5): 341–354.
    OpenUrl
  70. ↵
    Kiger JA and Salz HK (1985) Cyclic Nucleotide Metabolism and Physiology of the Fruit Fly Drosophila melanogaster., Advances in Insect Physiology, Academic Press, pp. 141–179.
  71. ↵
    Kim M, Lee JH, Koh H, et al. (2006) Inhibition of ERK-MAP kinase signaling by RSK during Drosophila development. The EMBO journal 25(13): 3056–3067.
    OpenUrlAbstract/FREE Full Text
  72. ↵
    Kim Y-C, Lee H-G, and Han K-A (2007) D1 dopamine receptor dDA1 is required in the mushroom body neurons for aversive and appetitive learning in Drosophila. The Journal of neuroscience: the official journal of the Society for Neuroscience 27(29): 7640–7647.
    OpenUrlAbstract/FREE Full Text
  73. ↵
    King LB, Koch M, Murphy KR, et al. (2016) Neurofibromin Loss of Function Drives Excessive Grooming in Drosophila. G3 6(4): 1083–1093.
    OpenUrl
  74. ↵
    Kubli E (2003) Sex-peptides: seminal peptides of the Drosophila male. Cellular and molecular life sciences: CMLS 60(8): 1689–1704.
    OpenUrl
  75. ↵
    LaFerriere H, Guarnieri DJ, Sitaraman D, et al. (2008) Genetic dissociation of ethanol sensitivity and memory formation in Drosophila melanogaster. Genetics 178(4): 1895–1902.
    OpenUrlAbstract/FREE Full Text
  76. ↵
    LaFerriere H, Ostrowski D, Guarnieri DJ, et al. (2011) The arouser EPS8L3 gene is critical for normal memory in Drosophila. PloS one 6(7): e22867.
    OpenUrlPubMed
  77. ↵
    Lebestky T, Chang J-SC, Dankert H, et al. (2009) Two different forms of arousal in Drosophila are oppositely regulated by the dopamine D1 receptor ortholog DopR via distinct neural circuits. Neuron 64(4): 522–536.
    OpenUrlCrossRefPubMedWeb of Science
  78. ↵
    Levin LR, Han PL, Hwang PM, et al. (1992) The Drosophila learning and memory gene rutabaga encodes a Ca2+/Calmodulin-responsive adenylyl cyclase. Cell 68(3): 479–489.
    OpenUrlCrossRefPubMedWeb of Science
  79. ↵
    Light RJ and Pillemer DB (1984) Summing Up. Harvard University Press.
  80. ↵
    Lin DM and Goodman CS (1994) Ectopic and increased expression of Fasciclin II alters motoneuron growth cone guidance. Neuron 13(3): 507–523.
    OpenUrlCrossRefPubMedWeb of Science
  81. ↵
    Lithgow GJ, Driscoll M, and Phillips P (2017) A long journey to reproducible results. Nature 548(7668): 387–388.
    OpenUrl
  82. ↵
    Liu JL (2011) The role of the funnel plot in detecting publication and related biases in meta-analysis. Evidence-based dentistry 12(4): 121–122.
    OpenUrlPubMed
  83. ↵
    Livingstone MS, Sziber PP, and Quinn WG (1984) Loss of calcium/ calmodulin responsiveness in adenylate cyclase of rutabaga, a Drosophila learning mutant. Cell 37(1): 205–215.
    OpenUrlCrossRefPubMedWeb of Science
  84. ↵
    Majeed ZR, Abdeljaber E, Soveland R, et al. (2016) Modulatory Action by the Serotonergic System: Behavior and Neurophysiology in Drosophila melanogaster. Neural plasticity 2016: 7291438.
  85. ↵
    Makel MC, Plucker JA, and Hegarty B (2012) Replications in Psychology Research: How Often Do They Really Occur? Perspectives on psychological science: a journal of the Association for Psychological Science 7(6): 537–542.
    OpenUrl
  86. ↵
    Margulies C, Tully T, and Dubnau J (2005) Deconstructing memory in Drosophila. Current biology: CB 15(17): R700–13.
    OpenUrl
  87. ↵
    McBride SM, Giuliani G, Choi C, et al. (1999) Mushroom body ablation impairs short-term memory and long-term memory of courtship conditioning in Drosophila melanogaster. Neuron 24(4): 967–977.
    OpenUrlCrossRefPubMedWeb of Science
  88. ↵
    McGuire SE, Le PT and Davis RL (2001) The role of Drosophila mushroom body signaling in olfactory memory. Science 293(5533): 1330–1333.
    OpenUrlAbstract/FREE Full Text
  89. ↵
    McGuire SE, Le PT, Osborn AJ, et al. (2003) Spatiotemporal rescue of memory dysfunction in Drosophila. Science 302(5651): 1765–1768.
    OpenUrlAbstract/FREE Full Text
  90. ↵
    1. McNaught AD and
    2. Wilkinson A
    (eds)(1997) IUPAC. Compendium of Chemical Terminology, 2nd ed. Oxford: Blackwell Scientific Publications.
  91. ↵
    Mihalek RM, Jones CJ, and Tully T (1997) The Drosophila mutation turnip has pleiotropic behavioral effects and does not specifically affect learning. Learning & memory 3(5): 425–444.
    OpenUrlAbstract/FREE Full Text
  92. ↵
    Mohammad F, Ho J, Woo JH, et al. (2016) Concordance and incongruence in preclinical anxiety models: Systematic review and meta-analyses. Neuroscience and biobehavioral reviews. Available from: dx.doi.org/10.1016/j.neubiorev.2016.04.011.
  93. ↵
    Munafò MR, Nosek BA, Bishop DVM, et al. (2017) A manifesto for reproducible science. Nature Human Behaviour, Nature Publishing Group 1: 0021.
    OpenUrl
  94. ↵
    Nature methods (2016) Meta-analysis in basic biology. Nature Research 13(12): 959–959.
    OpenUrl
  95. ↵
    Neckameyer WS and White K (1993) Drosophila tyrosine hydroxylase is encoded by the pale locus. Journal of neurogenetics 8(4): 189–199.
    OpenUrlCrossRefPubMedWeb of Science
  96. ↵
    Nichols CD (2007) 5-HT2 receptors in Drosophila are expressed in the brain and modulate aspects of circadian behaviors. Developmental neurobiology 67(6): 752–763.
    OpenUrl
  97. ↵
    Nuzzo R (2015) How scientists fool themselves - and how they can stop. Nature 526(7572): 182–185.
    OpenUrlCrossRefPubMed
  98. ↵
    Oehlert GW (1992) A Note on the Delta Method. The American statistician 46(1): 27–29.
    OpenUrlCrossRefWeb of Science
  99. ↵
    Okazawa H, Rich T, Chang A, et al. (2002) Interaction between mutant ataxin-1 and PQBP-1 affects transcription and cell death. Neuron 34(5): 701–713.
    OpenUrlCrossRefPubMedWeb of Science
  100. ↵
    Open Science Collaboration (2015a) PSYCHOLOGY. Estimating the reproducibility of psychological science. Science 349(6251): aac4716.
    OpenUrlAbstract/FREE Full Text
  101. ↵
    Open Science Collaboration (2015b) PSYCHOLOGY. Estimating the reproducibility of psychological science. Science 349(6251): aac4716.
    OpenUrlAbstract/FREE Full Text
  102. ↵
    Pagano M, Gauvreau K, and Pagano M (2000) Principles of biostatistics. Duxbury Pacific Grove, CA.
  103. ↵
    Patil P, Peng RD, and Leek J (2016) A statistical definition for reproducibility and replicability. bioRxiv. Available from: biorxiv.org/content/early/2016/07/29/066803 (accessed 17 June 2017).
  104. ↵
    Perrimon N, Mohler D, Engstrom L, et al. (1986) X-linked female-sterile loci in Drosophila melanogaster. Genetics 113(3): 695–712.
    OpenUrlAbstract/FREE Full Text
  105. ↵
    Perrimon N, Pitsouli C, and Shilo B-Z (2012) Signaling mechanisms controlling cell fate and embryonic patterning. Cold Spring Harbor perspectives in biology 4(8): a005975.
    OpenUrlAbstract/FREE Full Text
  106. ↵
    Philip N, Acevedo SF, and Skoulakis EM (2001) Conditional rescue of olfactory learning and memory defects in mutants of the 14-3-3zeta gene leonardo. The Journal of neuroscience: the official journal of the Society for Neuroscience 21(21): 8417–8425.
    OpenUrlAbstract/FREE Full Text
  107. ↵
    Pooryasin A and Fiala A (2015) Identified Serotonin-Releasing Neurons Induce Behavioral Quiescence and Suppress Mating in Drosophila. The Journal of neuroscience: the official journal of the Society for Neuroscience 35(37): 12792–12812.
    OpenUrlAbstract/FREE Full Text
  108. ↵
    Prinz F, Schlange T, and Asadullah K (2011) Believe it or not: how much can we rely on published data on potential drug targets? Nature reviews. Drug discovery, Nature Publishing Group 10(9): 712–712.
    OpenUrl
  109. ↵
    Putz G, Bertolucci F, Raabe T, et al. (2004) The S6KII (rsk) gene of Drosophila melanogaster differentially affects an operant and a classical learning task. The Journal of neuroscience: the official journal of the Society for Neuroscience 24(44): 9745–9751.
    OpenUrlAbstract/FREE Full Text
  110. ↵
    Qin H, Cressy M, Li W, et al. (2012) Gamma neurons mediate dopaminergic input during aversive olfactory memory formation in Drosophila. Current biology: CB 22(7): 608–614.
    OpenUrl
  111. ↵
    Qiu Y and Davis RL (1993) Genetic dissection of the learning/memory gene dunce of Drosophila melanogaster. Genes & development 7(7B): 1447–1458.
    OpenUrlAbstract/FREE Full Text
  112. ↵
    Quinn WG, Harris WA, and Benzer S (1974) Conditioned behavior in Drosophila melanogaster. Proceedings of the National Academy of Sciences of the United States of America 71(3): 708–712.
    OpenUrlAbstract/FREE Full Text
  113. ↵
    Raabe T, Clemens-Richter S, Twardzik T, et al. (2004) Identification of mushroom body miniature, a zinc-finger protein implicated in brain development of Drosophila. Proceedings of the National Academy of Sciences of the United States of America 101(39): 14276–14281.
    OpenUrlAbstract/FREE Full Text
  114. ↵
    Riemensperger T, Isabel G, Coulom H, et al. (2011) Behavioral consequences of dopamine deficiency in the Drosophila central nervous system. Proceedings of the National Academy of Sciences of the United States of America 108(2): 834–839.
    OpenUrlAbstract/FREE Full Text
  115. ↵
    Rizzoli SO and Betz WJ (2005) Synaptic vesicle pools. Nature reviews. Neuroscience 6(1): 57–69.
    OpenUrl
  116. ↵
    Rosenthal R and Rosnow RL (2009) Artifacts in Behavioral Research: Robert Rosenthal and Ralph L Rosnow’s Classic Books. Oxford University Press, USA.
  117. ↵
    Scheunemann L, Jost E, Richlitzki A, et al. (2012) Consolidated and labile odor memory are separately encoded within the Drosophila brain. The Journal of neuroscience: the official journal of the Society for Neuroscience 32(48): 17163–17171.
    OpenUrlAbstract/FREE Full Text
  118. ↵
    Scholz-Kornehl S and Schwärzel M (2016) Circuit Analysis of a Drosophila Dopamine Type 2 Receptor That Supports Anesthesia-Resistant Memory. The Journal of neuroscience: the official journal of the Society for Neuroscience 36(30): 7936–7945.
    OpenUrlAbstract/FREE Full Text
  119. ↵
    Schuster CM, Davis GW, Fetter RD, et al. (1996) Genetic dissection of structural and functional components of synaptic plasticity. II. Fasciclin II controls presynaptic structural plasticity. Neuron 17(4): 655–667.
    OpenUrlCrossRefPubMedWeb of Science
  120. ↵
    Segal E, Raveh-Sadka T, Schroeder M, et al. (2008) Predicting expression patterns from regulatory sequence in Drosophila segmentation. Nature 451(7178): 535–540.
    OpenUrlCrossRefPubMedWeb of Science
  121. ↵
    Sena ES, van der Worp HB, Bath PMW, et al. (2010) Publication bias in reports of animal stroke studies leads to major overstatement of efficacy. PLoS biology 8(3): e1000344.
    OpenUrlCrossRefPubMed
  122. ↵
    Shamloula HK, Mbogho MP, Pimentel AC, et al. (2002) rugose (rg), a Drosophila A kinase anchor protein, is required for retinal pattern formation and interacts genetically with multiple signaling pathways. Genetics 161(2): 693–710.
    OpenUrlAbstract/FREE Full Text
  123. ↵
    Siegel RW and Hall JC (1979) Conditioned responses in courtship behavior of normal and mutant Drosophila. Proceedings of the National Academy of Sciences of the United States of America 76(7): 3430–3434.
    OpenUrlAbstract/FREE Full Text
  124. ↵
    Sitaraman D, Zars M, Laferriere H, et al. (2008) Serotonin is necessary for place memory in Drosophila. Proceedings of the National Academy of Sciences of the United States of America 105(14): 5579–5584.
    OpenUrlAbstract/FREE Full Text
  125. ↵
    Skoulakis EM and Davis RL (1996) Olfactory learning deficits in mutants for leonardo, a Drosophila gene encoding a 14-3-3 protein. Neuron 17(5): 931–944.
    OpenUrlCrossRefPubMedWeb of Science
  126. ↵
    Srivastava DP, Yu EJ, Kennedy K, et al. (2005) Rapid, nongenomic responses to ecdysteroids and catecholamines mediated by a novel Drosophila G-protein-coupled receptor. The Journal of neuroscience: the official journal of the Society for Neuroscience 25(26): 6145–6155.
    OpenUrlAbstract/FREE Full Text
  127. ↵
    Sterne JAC, Sutton AJ, Ioannidis JPA, et al. (2011) Recommendations for examining and interpreting funnel plot asymmetry in meta-analyses of randomised controlled trials. BMJ 343: d4002.
    OpenUrlFREE Full Text
  128. ↵
    St Johnston D and Nüsslein-Volhard C (1992) The origin of pattern and polarity in the Drosophila embryo. Cell 68(2): 201–219.
    OpenUrlCrossRefPubMedWeb of Science
  129. ↵
    Takahashi JS, Shimomura K, and Kumar V (2008) Searching for genes underlying behavior: lessons from circadian rhythms. Science 322(5903): 909–912.
    OpenUrlAbstract/FREE Full Text
  130. ↵
    Takeuchi T, Duszkiewicz AJ, and Morris RGM (2014) The synaptic plasticity and memory hypothesis: encoding, storage and persistence. Philosophical transactions of the Royal Society of London. Series B, Biological sciences 369(1633): 20130288.
    OpenUrlCrossRefPubMed
  131. ↵
    Tamura T, Horiuchi D, Chen Y-C, et al. (2010) Drosophila PQBP1 regulates learning acquisition at projection neurons in aversive olfactory conditioning. The Journal of neuroscience: the official journal of the Society for Neuroscience 30(42): 14091–14101.
    OpenUrlAbstract/FREE Full Text
  132. ↵
    Tan Y, Yu D, Pletting J, et al. (2010) Gilgamesh is required for rutabaga-independent olfactory learning in Drosophila. Neuron 67(5): 810–820.
    OpenUrlCrossRefPubMed
  133. ↵
    Tempel BL, Bonini N, Dawson DR, et al. (1983) Reward learning in normal and mutant Drosophila. Proceedings of the National Academy of Sciences of the United States of America 80(5): 1482–1486.
    OpenUrlAbstract/FREE Full Text
  134. ↵
    Timmerman C, Suppiah S, Gurudatta BV, et al. (2013) The Drosophila transcription factor Adf-1 (nalyot) regulates dendrite growth by controlling FasII and Staufen expression downstream of CaMKII and neural activity. The Journal of neuroscience: the official journal of the Society for Neuroscience 33(29): 11916–11931.
    OpenUrlAbstract/FREE Full Text
  135. ↵
    Tomchik S and Davis RL (2013) Drosophila memory research through four eras: genetic, molecular biology, neuroanatomy, and systems neuroscience. Invertebrate Learning and Memory, Elsevier: 359–377.
  136. ↵
    Tong JJ, Schriner SE, McCleary D, et al. (2007) Life extension through neurofibromin mitochondrial regulation and antioxidant therapy for neurofibromatosis-1 in Drosophila melanogaster. Nature genetics 39(4): 476–485.
    OpenUrlCrossRefPubMedWeb of Science
  137. ↵
    Tully T and Quinn WG (1985) Classical conditioning and retention in normal and mutant Drosophila melanogaster. Journal of comparative physiology. A. 157(2): 263–277.
    OpenUrlCrossRefPubMed
  138. ↵
    Ueno S-I (2003) Genetic polymorphisms of serotonin and dopamine transporters in mental disorders. The journal of medical investigation: JMI 50(1–2): 25–31.
    OpenUrl
  139. ↵
    Ueno T, Tomita J, Tanimoto H, et al. (2012) Identification of a dopamine pathway that regulates sleep and arousal in Drosophila. Nature neuroscience 15(11): 1516–1523.
    OpenUrlCrossRefPubMed
  140. ↵
    Venkatesh K, Siddhartha G, Joshi R, et al. (2001) Interactions between the inositol 1,4,5-trisphosphate and cyclic AMP signaling pathways regulate larval molting in Drosophila. Genetics 158(1): 309–318.
    OpenUrlAbstract/FREE Full Text
  141. ↵
    Verkerk AJ, Pieretti M, Sutcliffe JS, et al. (1991) Identification of a gene (FMR-1) containing a CGG repeat coincident with a breakpoint cluster region exhibiting length variation in fragile X syndrome. Cell 65(5): 905–914.
    OpenUrlCrossRefPubMedWeb of Science
  142. ↵
    Viechtbauer W and Others (2010) Conducting meta-analyses in R with the metafor package. Journal of statistical software 36(3): 1–48.
    OpenUrl
  143. ↵
    Volders K, Scholz S, Slabbaert JR, et al. (2012) Drosophila rugose is a functional homolog of mammalian Neurobeachin and affects synaptic architecture, brain morphology, and associative learning. The Journal of neuroscience: the official journal of the Society for Neuroscience 32(43): 15193–15204.
    OpenUrlAbstract/FREE Full Text
  144. ↵
    Waddell S, Armstrong JD, Kitamoto T, et al. (2000) The amnesiac gene product is expressed in two neurons in the Drosophila brain that are critical for memory. Cell 103(5): 805–813.
    OpenUrlCrossRefPubMedWeb of Science
  145. ↵
    Waragai M, Lammers CH, Takeuchi S, et al. (1999) PQBP-1, a novel polyglutamine tract-binding protein, inhibits transcription activation by Brn-2 and affects cell survival. Human molecular genetics 8(6): 977–987.
    OpenUrlCrossRefPubMedWeb of Science
  146. ↵
    Williams JA, Su HS, Bernards A, et al. (2001) A circadian output in Drosophila mediated by neurofibromatosis-1 and Ras/MAPK. Science 293(5538): 2251–2256.
    OpenUrlAbstract/FREE Full Text
  147. ↵
    Xia S, Miyashita T, Fu T-F, et al. (2005) NMDA receptors mediate olfactory learning and memory in Drosophila. Current biology: CB 15(7): 603–615.
    OpenUrl
  148. ↵
    Yamamoto S and Seto ES (2014) Dopamine dynamics and signaling in Drosophila: an overview of genes, drugs and behavioral paradigms. Experimental animals / Japanese Association for Laboratory Animal Science 63(2): 107–119.
    OpenUrl
  149. ↵
    Yang B, Chan RCK, Jing J, et al. (2007) A meta-analysis of association studies between the 10-repeat allele of a VNTR polymorphism in the 3′-UTR of dopamine transporter gene and attention deficit hyperactivity disorder. American journal of medical genetics. Part B, Neuropsychiatric genetics: the official publication of the International Society of Psychiatric Genetics, Wiley Online Library 144(4): 541–550.
    OpenUrl
  150. ↵
    Yildizoglu T, Weislogel J-M, Mohammad F, et al. (2015) Estimating Information Processing in a Memory System: The Utility of Meta-analytic Methods for Genetics. PLoS genetics 11(12): e1005718.
    OpenUrl
  151. ↵
    Yitzhaki S (2002) The GMD: A superior Measure of Variability for Non-Normal Distributions. SSRN Electronic Journal. Available from: dx.doi.org/10.2139/ssrn.301740.
  152. ↵
    Yuan Q, Joiner WJ, and Sehgal A (2006) A sleep-promoting role for the Drosophila serotonin receptor 1A. Current biology: CB 16(11): 1051–1062.
    OpenUrl
  153. ↵
    Zhang S, Yin Y, Lu H, et al. (2008) Increased dopaminergic signaling impairs aversive olfactory memory retention in Drosophila. Biochemical and biophysical research communications 370(1): 82–86.
    OpenUrlCrossRefPubMedWeb of Science
  154. ↵
    Zhang YQ, Bailey AM, Matthies HJ, et al. (2001) Drosophila fragile X-related gene regulates the MAP1B homolog Futsch to control synaptic structure and function. Cell 107(5): 591–603.
    OpenUrlCrossRefPubMedWeb of Science
  155. ↵
    Zhao J, Lu Y, Zhao X, et al. (2013) Dissociation of rugose-dependent short-term memory component from memory consolidation in Drosophila. Genes, brain, and behavior 12(6): 626–632.
    OpenUrlCrossRefPubMedWeb of Science
  156. ↵
    Zhong Y and Wu C-F (2004) Neuronal activity and adenylyl cyclase in environment-dependent plasticity of axonal outgrowth in Drosophila. The Journal of neuroscience: the official journal of the Society for Neuroscience 24(6): 1439–1445.
    OpenUrlAbstract/FREE Full Text
Back to top
Posted January 13, 2018.
Download PDF
Email
A systematic review and meta-analysis of Drosophila short-term-memory genetics: robust reproducibility, but little independent replication
Tayfun Tumkaya, Stanislav Ott, Adam Claridge-Chang
bioRxiv 247650; doi: https://doi.org/10.1101/247650
Digg logo Reddit logo Twitter logo CiteULike logo Facebook logo Google logo Mendeley logo
Citation Tools

Subject Area