RT Journal Article SR Electronic T1 SpikeForest: reproducible web-facing ground-truth validation of automated neural spike sorters JF bioRxiv FD Cold Spring Harbor Laboratory SP 2020.01.14.900688 DO 10.1101/2020.01.14.900688 A1 Jeremy F. Magland A1 James J. Jun A1 Elizabeth Lovero A1 Alexander J. Morley A1 Cole L. Hurwitz A1 Alessio P. Buccino A1 Samuel Garcia A1 Alex H. Barnett YR 2020 UL http://biorxiv.org/content/early/2020/01/14/2020.01.14.900688.abstract AB Spike sorting is a crucial but time-intensive step in electrophysiological studies of neuronal activity. While there are many popular software packages for spike sorting, there is little consensus about which are the most accurate under different experimental conditions. SpikeForest is an open-source and reproducible software suite that benchmarks the performance of automated spike sorting algorithms across an extensive, curated database of electrophysiological recordings with ground truth, displaying results interactively on a continuously-updating website. With contributions from over a dozen participating laboratories, our database currently comprises 650 recordings (1.3 TB total size) with around 35,000 ground-truth units. These data include extracellular recordings paired with intracellular voltages, state-of-the-art simulated recordings, and hybrid synthetic datasets. Ten of the most frequently used modern spike sorting codes are wrapped under a common Python framework and evaluated on a compute cluster using an automated pipeline. SpikeForest validates and documents community progress in automated spike sorting, and guides neuroscientists to an optimal choice of sorter and parameters for a wide range of probes and brain regions.