RT Journal Article
SR Electronic
T1 Spectrum preserving tilings enable sparse and modular reference indexing
JF bioRxiv
FD Cold Spring Harbor Laboratory
SP 2022.10.27.513881
DO 10.1101/2022.10.27.513881
A1 Jason Fan
A1 Jamshed Khan
A1 Giulio Ermanno Pibiri
A1 Rob Patro
YR 2022
UL http://biorxiv.org/content/early/2022/10/28/2022.10.27.513881.abstract
AB The reference indexing problem for k-mers is to pre-process a collection of reference genomic sequences ℛ so that the position of all occurrences of any queried k-mer can be rapidly identified. An efficient and scalable solution to this problem is fundamental for many tasks in bioinformatics.In this work, we introduce the spectrum preserving tiling (SPT), a general representation of ℛ that specifies how a set of tiles repeatedly occur to spell out the constituent reference sequences in ℛ. By encoding the order and positions where tiles occur, SPTs enable the implementation and analysis of a general class of modular indexes. An index over an SPT decomposes the reference indexing problem for k-mers into: (1) a k-mer-to-tile mapping; and (2) a tile-to-occurrence mapping. Recently introduced work to construct and compactly index k-mer sets can be used to efficiently implement the k-mer-to-tile mapping. However, implementing the tile-to-occurrence mapping remains prohibitively costly in terms of space. As reference collections become large, the space requirements of the tile-to-occurrence mapping dominates that of the k-mer-to-tile mapping since the former depends on the amount of total sequence while the latter depends on the number of unique k-mers in ℛ.To address this, we introduce a class of sampling schemes for SPTs that trade off speed to reduce the size of the tile-to-reference mapping. We implement a practical index with these sampling schemes in the tool pufferfish2. When indexing over 30,000 bacterial genomes, pufferfish2 reduces the size of the tile-to-occurrence mapping from 86.3GB to 34.6GB while incurring only a 3.6× slowdown when querying k-mers from a sequenced readset.Availability pufferfish2 is implemented in Rust and available at https://github.com/COMBINE-lab/pufferfish2.Competing Interest StatementR.P. is a co-founder of Ocean Genomics Inc.