Abstract:Recurrent neural networks with memory and attention mechanisms are widely used in natural language processing because they can capture short and long term sequential information for diverse tasks. We propose an integrated deep learning model for microbial DNA sequence data, which exploits convolutional neural networks, recurrent neural networks, and attention mechanisms to predict taxonomic classifications and sample-associated attributes, such as the relationship between the microbiome and host phenotype, on the read/sequence level. In this paper, we develop this novel deep learning approach and evaluate its application to amplicon sequences. We apply our approach to short DNA reads and full sequences of 16S ribosomal RNA (rRNA) marker genes, which identify the heterogeneity of a microbial community sample. We demonstrate that our implementation of a novel attention-based deep network architecture, Read2Pheno, achieves read-level phenotypic prediction. Training Read2Pheno models will encode sequences (reads) into dense, meaningful representations: learned embedded vectors output from the intermediate layer of the network model, which can provide biological insight when visualized. The attention layer of Read2Pheno models can also automatically identify nucleotide regions in reads/sequences which are particularly informative for classification. As such, this novel approach can avoid pre/post-processing and manual interpretation required with conventional approaches to microbiome sequence classification. We further show, as proof-of-concept, that aggregating read-level information can robustly predict microbial community properties, host phenotype, and taxonomic classification, with performance at least comparable to conventional approaches. An implementation of the attention-based deep learning network is available at https://github.com/EESI/sequence_attention (a python package) and https://github.com/EESI/seq2att (a command line tool).

DNASimCLR: a contrastive learning-based deep learning approach for gene sequence data classification

Graph Contrastive Learning as a Versatile Foundation for Advanced scRNA-seq Data Analysis

Inferring gene regulatory networks from single-cell gene expression data via deep multi-view contrastive learning

DeepCAC: a deep learning approach on DNA transcription factors classification based on multi-head self-attention and concatenate convolutional neural network

GDCL-NcDA: identifying non-coding RNA-disease associations via contrastive learning between deep graph learning and deep matrix factorization

Learning, visualizing and exploring 16S rRNA structure using an attention-based deep neural network

DSNetax: a deep learning species annotation method based on a deep-shallow parallel framework

Contrastive pre-training for sequence based genomics models

A self-supervised deep learning method for data-efficient training in genomics

A deep learning model embedded framework to distinguish DNA and RNA mutations directly from RNA-seq

Deep enhanced constraint clustering based on contrastive learning for scRNA-seq data

BioDeepfuse: a hybrid deep learning approach with integrated feature extraction techniques for enhanced non-coding RNA classification

CLMB: deep contrastive learning for robust metagenomic binning

Deep learning-based advances and applications for single-cell RNA-sequencing data analysis

Progress on deep learning in genomics

A comparison of deep learning-based pre-processing and clustering approaches for single-cell RNA sequencing data

Supervised Deep Learning with Gene Annotation for Cell Classification

A novel deep learning method for predictive modeling of microbiome data

DeepFormer: a hybrid network based on convolutional neural network and flow-attention mechanism for identifying the function of DNA sequences

Semi-supervised learning with pseudo-labeling compares favorably with large language models for regulatory sequence prediction