Abstract:The potential of getting a significant number of false positives (FPs) in peptide-spectrum matches (PSMs) obtained by proteomic database search has been well-recognized. Among the attempts to assess FPs, the concomitant use of target and decoy databases is widely practiced. By adjusting filtering criteria, FPs and false discovery rate (FDR) can be controlled at a desired level. Although the target-decoy approach is gaining in popularity, subtle differences in decoy construction (e.g., reversing vs stochastic methods), rate calculation (e.g., total vs unique PSMs), or searching (separate vs composite) do exist among various implementations. In the present study, we evaluated the effects of these differences on FP and FDR estimations using a rat kidney protein sample and the SEQUEST search engine as an example. On the effects of decoy construction, we found that, when a single scoring filter (XCorr) was used, stochastic methods generated a higher estimation of FPs and FDR than sequence reversing methods, likely due to an increase in unique peptides. This higher estimation could largely be attenuated by creating decoy databases similar in effective size but not by a simple normalization with a unique-peptide coefficient. When multiple filters were applied, the differences seen between reversing and stochastic methods significantly diminished, suggesting multiple filterings reduce the dependency on how a decoy is constructed. For a fixed set of filtering criteria, FDR and FPs estimated by using unique PSMs were almost twice those using total PSMs. The higher estimation seemed to be dependent on data acquisition setup. As to the differences between performing separate or composite searches, in general, FDR estimated from the separate search was about three times that from the composite search. The degree of difference gradually decreased as the filtering criteria became more stringent. Paradoxically, the estimated true positives in separate search were higher when multiple filters were used. By analyzing a standard protein mixture, we demonstrated that the higher estimation of FDR and FPs in the separate search likely reflected an overestimation, which could be corrected with a simple merging procedure. Our study illustrates the relative merits of different implementations of the target-decoy strategy, which should be worth contemplating when large-scale proteomic biomarker discovery is to be attempted.

Precursor deconvolution error estimation: The missing puzzle piece in false discovery rate in top‐down proteomics

A Theoretical Foundation of the Target-Decoy Search Strategy for False Discovery Rate Control in Proteomics

Reinvestigating the Correctness of Decoy-Based False Discovery Rate Control in Proteomics Tandem Mass Spectrometry

Improved False Discovery Rate Estimation Procedure for Shotgun Proteomics

Assessment of false discovery rate control in tandem mass spectrometry analysis using entrapment

Decoy-free Protein-Level False Discovery Rate Estimation

Decoy methods for assessing false positives and false discovery rates in shotgun proteomics.

New mixture models for decoy-free false discovery rate estimation in mass-spectrometry proteomics

An algorithm for decoy-free false discovery rate estimation in XL-MS/MS proteomics

FineFDR: Fine-grained Taxonomy-specific False Discovery Rates Control in Metaproteomics

ProteinInferencer: Confident protein identification and multiple experiment comparison for large scale proteomics projects

How to train a post-processor for tandem mass spectrometry proteomics database search while maintaining control of the false discovery rate

NovoBoard: a comprehensive framework for evaluating the false discovery rate and accuracy of de novo peptide sequencing

Comparing Top-Down Proteoform Identification: Deconvolution, PrSM Overlap, and PTM Detection

FLASHIda enables intelligent data acquisition for top–down proteomics to boost proteoform identification counts

FLASHIda: Intelligent data acquisition for top-down proteomics that doubles proteoform level identification count

Data processing of product ion spectra: Methods to control false discovery rate in compound search results for non-targeted metabolomics

Target-Decoy-Based False Discovery Rate Estimation for Large-Scale Metabolite Identification.

Protein Identification False Discovery Rates for Very Large Proteomics Data Sets Generated by Tandem Mass Spectrometry

A Full Window Data Independent Acquisition Method for Deeper Top-down Proteomics

On Correcting The Overestimation Of The Permutation-Based False Discovery Rate Estimator