Abstract:Abstract The analysis of single-cell genomics data presents several statistical challenges, and extensive efforts have been made to produce methods for the analysis of this data that impute missing values, address sampling issues and quantify and correct for noise. In spite of such efforts, no consensus on best practices has been established and all current approaches vary substantially based on the available data and empirical tests. The k-Nearest Neighbor Graph (kNN-G) is often used to infer the identities of, and relationships between, cells and is the basis of many widely used dimensionality-reduction and projection methods. The kNN-G has also been the basis for imputation methods using, e.g. , neighbor averaging and graph diffusion. However, due to the lack of an agreed-upon optimal objective function for choosing hyperparameters, these methods tend to oversmooth data, thereby resulting in a loss of information with regard to cell identity and the specific gene-to-gene patterns underlying regulatory mechanisms. In this paper, we investigate the tuning of kNN- and diffusion-based denoising methods with a novel non-stochastic method for optimally preserving biologically relevant informative variance in single-cell data. The framework, Denoising Expression data with a Weighted Affinity Kernel and Self-Supervision (DEWÄKSS), uses a self-supervised technique to tune its parameters. We demonstrate that denoising with optimal parameters selected by our objective function (i) is robust to preprocessing methods using data from established benchmarks, (ii) disentangles cellular identity and maintains robust clusters over dimension-reduction methods, (iii) maintains variance along several expression dimensions, unlike previous heuristic-based methods that tend to oversmooth data variance, and (iv) rarely involves diffusion but rather uses a fixed weighted kNN graph for denoising. Together, these findings provide a new understanding of kNN- and diffusion-based denoising methods and serve as a foundation for future research. Code and example data for DEWÄKSS is available at https://gitlab.com/Xparx/dewakss/-/tree/Tjarnberg2020branch .

Editing Training Data for kNN Classifiers with Neural Network Ensemble

Label Distribution Learning-Enhanced Dual-KNN for Text Classification

Revisiting K-Nn for Fine-Tuning Pre-trained Language Models

Noise is the Fatal Poison: A Noise-aware Network for Noisy Dataset Classification

Efficient KNN Text Categorization Based on Multiedit and Condensing Techniques

A DNN-Ensemble Method for Error Reduction and Training Data Selection in DNN Based Modeling

KNN-BERT: Fine-Tuning Pre-Trained Models with KNN Classifier

KNN Ensembles for Tweedie Regression: The Power of Multiscale Neighborhoods

Classification of Parkinson’s Disease Utilizing Multi-Edit Nearest-Neighbor and Ensemble Learning Algorithms with Speech Samples

Optimal tuning of weighted kNN- and diffusion-based methods for denoising single cell genomics data

Ensemble Learning with Extremely Randomized k-Nearest Neighbors for Accurate and Efficient Classification

An Optimal Random Projection k Nearest Neighbors Ensemble via Extended Neighborhood Rule for Binary Classification

Rethinking Nearest Neighbors for Visual Classification

An ensemble-driven k-NN approach to ill-posed classification problems

Neural Embeddings for Knn Search in Biological Sequence

Enhancing K-nearest neighbor algorithm: a comprehensive review and performance analysis of modifications

Under-bagging Nearest Neighbors for Imbalanced Classification

An Improved Condensing Algorithm

SpaceEditing: Integrating Human Knowledge into Deep Neural Networks via Interactive Latent Space Editing

Bayes-Decisive Linear KNN with Adaptive Nearest Neighbors

Improved KNN algorithms of spherical regions based on clustering and region division