Abstract:Genomic malformations are believed to be the driving factors of many diseases. Therefore, understanding the intrinsic mechanisms underlying the genome and informing clinical practices have become two important missions of large-scale genomic research. Recently, high-throughput molecular data have provided abundant information about the whole genome, and have popularized computational tools in genomics. However, traditional machine learning methodologies often suffer from strong limitations when dealing with high-throughput genomic data, because the latter are usually very high dimensional, highly heterogeneous, and can show complicated nonlinear effects. In this thesis, we present five new algorithms or models to address these challenges, each of which is applied to a specific genomic problem.Project 1 focuses on model selection in cancer diagnosis. We develop an efficient algorithm (ADMM-ENSVM) for the Elastic Net Support Vector Machine, which achieves simultaneous variable selection and max-margin classification. On a colon cancer diagnosis dataset, ADMM-ENSVM shows advantages over other SVM algorithms in terms of diagnostic accuracy, feature selection ability, and computational efficiency.Project 2 focuses on model selection in gene correlation analysis. We develop an efficient algorithm (SBLVGG) using the similar methodology as of ADMM-ENSVM for the Latent Variable Gaussian Graphical Model (LVGG). LVGG models the marginal concentration matrix of observed variables as a combination of a sparse matrix and a low rank one. Evaluated on a microarray dataset containing 6,316 genes, SBLVGG is notably faster than the state-of-the-art LVGG solver, and shows that most of the correlation among genes can be effectively explained by only tens of latent factors.Project 3 focuses on ensemble learning in cancer survival analysis. We develop a gradient boosting model (GBMCI), which does not explicitly assume particular forms of hazard functions, but trains an ensemble of regression trees to approximately optimize the concordance index. We benchmark the performance of GBMCI against several popular survival models on a large-scale breast cancer prognosis dataset. GBMCI consistently outperforms other methods based on a number of feature representations, which are heterogeneous and contain missing values. Project 4 focuses on deep learning in gene expression inference (GEIDN). GEIDN is a large-scale neural network, which can infer ~21k target genes jointly from ~1k landmark genes and can naturally capture hierarchical nonlinear interactions among genes. We deploy deep learning techniques (drop out, momentum training, GPU computing, etc.) to train GEIDN. On a dataset of ~129k complete human transcriptomes, GEIDN outperforms both k-nearest neighbor regression and linear regression in predicting >99.96% of the target genes. Moreover, increased network scales help to improve GEIDN, while increased training data benefits GEIDN more than other methods.Project 5 focuses on deep learning in annotating coding and noncoding genetic variants (DANN). DANN is a neural network to differentiate evolutionarily derived alleles from simulated ones with 949 highly heterogeneous features. It can capture nonlinear relationships among features. We train DANN with deep learning techniques like for GEIDN. DANN achieves a 18.90% relative reduction in the error rate and a 14.52% relative increase in the area under the curve over CADD, a state-of-the-art algorithm to annotate genetic variants based on the linear SVM.

Discovering differential genome sequence activity with interpretable and efficient deep learning

DeepDiff: DEEP-learning for predicting DIFFerential gene expression from histone modifications

Degps is a Powerful Tool for Detecting Differential Expression in RNA-sequencing Studies

Learning Tn5 Sequence Bias from ATAC-seq on Naked Chromatin

Biologically Informed Deep Learning to Infer Gene Program Activity in Single Cells

Learning sequence-based regulatory dynamics in single-cell genomics

DeepCAGE: Incorporating Transcription Factors in Genome-wide Prediction of Chromatin Accessibility

DeepHistone: a Deep Learning Approach to Predicting Histone Modifications

DeepChrome: deep-learning for predicting gene expression from histone modifications

Deciphering the Language of Protein-DNA Interactions: A Deep Learning Approach Combining Contextual Embeddings and Multi-Scale Sequence Modeling

A deep generative model for single-cell RNA sequencing with application to detecting differentially expressed genes

DiffChIPL: a differential peak analysis method for high-throughput sequencing data with biological replicates based on limma

Best practices for differential accessibility analysis in single-cell epigenomics

DeepCAPE: A Deep Convolutional Neural Network for the Accurate Prediction of Enhancers.

Chromatin Accessibility Prediction Via a Hybrid Deep Convolutional Neural Network

Deep learning approaches for non-coding genetic variant effect prediction: current progress and future prospects

DExplore: An Online Tool for Detecting Differentially Expressed Genes from mRNA Microarray Experiments

Deep learning sequence-based ab initio prediction of variant effects on expression and disease risk

Machine Learning for Large-Scale Genomics: Algorithms, Models and Applications

Integrating distal and proximal information to predict gene expression via a densely connected convolutional neural network

IChrom-Deep: An Attention-Based Deep Learning Model for Identifying Chromatin Interactions