Abstract
A critical statistical task in the analysis of shotgun proteomics data involves controlling the false discovery rate (FDR) among the reported set of discoveries. This task is most commonly solved at the peptide-spectrum match (PSM) level by using target-decoy competition (TDC), in which a set of observed spectra are searched against a database containing a mixture of real (target) and decoy peptides. The PSM-level procedure can be adapted to the peptide level by selecting the top-scoring PSM per peptide prior to FDR estimation. Here, we investigate both PSM-level and peptide-level FDR control methods and come to two conclusions. First, although the TDC procedure is provably correct under certain assumptions, we observe that one of these assumptions—that incorrect PSMs are independent of one another—is frequently violated. Hence, we empirically demonstrate that TDC-based PSM-level FDR estimates can be liberally biased. We propose that researchers avoid PSM-level results and instead focus on peptide-level analysis. Second, we investigate three ways to carry out peptide level TDC and show that the most common method (“PSM-only”) offers the lowest statistical power in practice. The most powerful method, peptide-level FDR with PSM competition (“PSM-and-peptide”), carries out competition first at the PSM level and then again at the peptide level. In our experiments, this approach yields an average increase of 17% more discovered peptides at a 1% FDR threshold relative to the PSM-only method.
Competing Interest Statement
The authors have declared no competing interest.
