Towards Reproducible Brain-Wide Association Studies
Abstract
Magnetic resonance imaging (MRI) continues to drive many important neuroscientific advances. However, progress in uncovering reproducible associations between individual differences in brain structure/function and behavioral phenotypes (e.g., cognition, mental health) may have been undermined by typical neuroimaging sample sizes (median N=25)1,2. Leveraging the Adolescent Brain Cognitive Development (ABCD) Study3 (N=11,878), we estimated the effect sizes and reproducibility of these brain-wide associations studies (BWAS) as a function of sample size. The very largest, replicable brain-wide associations for univariate and multivariate methods were r=0.14 and r=0.34, respectively. In smaller samples, typical for brain-wide association studies (BWAS), irreproducible, inflated effect sizes were ubiquitous, no matter the method (univariate, multivariate). Until sample sizes started to approach consortium-levels, BWAS were underpowered and statistical errors assured. Multiple factors contribute to replication failures4–6; here, we show that the pairing of small brain-behavioral phenotype effect sizes with sampling variability is a key element in wide-spread BWAS replication failure. Brain-behavioral phenotype associations stabilize and become more reproducible with sample sizes of N⪆2,000. While investigator-initiated brain-behavior research continues to generate hypotheses and propel innovation, large consortia are needed to usher in a new era of reproducible human brain-wide association studies.
Competing Interest Statement
Nico Dosenbach and Damien Fair are co-founders of Nous Imaging
Subject Area
- Biochemistry (13157)
- Bioengineering (9979)
- Bioinformatics (31996)
- Biophysics (16506)
- Cancer Biology (13575)
- Cell Biology (19296)
- Clinical Trials (138)
- Developmental Biology (10445)
- Ecology (15495)
- Epidemiology (2067)
- Evolutionary Biology (19778)
- Genetics (13090)
- Genomics (18124)
- Immunology (13233)
- Microbiology (30974)
- Molecular Biology (12910)
- Neuroscience (67634)
- Paleontology (495)
- Pathology (2084)
- Pharmacology and Toxicology (3602)
- Physiology (5624)
- Plant Biology (11607)
- Synthetic Biology (3235)
- Systems Biology (7917)
- Zoology (1792)