TY - JOUR T1 - Representation Learning of Genomic Sequence Motifs with Convolutional Neural Networks JF - bioRxiv DO - 10.1101/362756 SP - 362756 AU - Peter K. Koo AU - Sean R. Eddy Y1 - 2019/01/01 UR - http://biorxiv.org/content/early/2019/04/11/362756.abstract N2 - Although convolutional neural networks (CNNs) have been applied to a variety of computational genomics problems, there remains a large gap in our understanding of how they build representations of regulatory genomic sequences. Here we perform systematic experiments on synthetic sequences to reveal how CNN architecture, specifically convolutional filter size and max-pooling, influences the extent that sequence motif representations are learned by first layer filters. We find that CNNs designed to foster hierarchical representation learning of sequence motifs – assembling partial features into whole features in deeper layers – tend to learn distributed representations, i.e. partial motifs. On the other hand, CNNs that are designed to limit the ability of hierarchically building sequence motif representations in deeper layers tend to learn more interpretable localist representations, i.e. whole motifs. We then validate that this representation learning principle established from synthetic sequences generalizes to in vivo sequences. ER -