Abstract:Recently developed deep learning techniques have significantly improved the accuracy of various speech and image recognition systems. In this paper we adapt some of these techniques for protein secondary structure prediction. We first train a series of deep neural networks to predict eight-class secondary structure labels given a protein's amino acid sequence information and find that using recent methods for regularization, such as dropout and weight-norm constraining, leads to measurable gains in accuracy. We then adapt recent convolutional neural network architectures--Inception, ReSNet, and DenseNet with Batch Normalization--to the problem of protein structure prediction. These convolutional architectures make heavy use of multi-scale filter layers that simultaneously compute features on several scales, and use residual connections to prevent underfitting. Using a carefully modified version of these architectures, we achieve state-of-the-art performance of 70.0% per amino acid accuracy on the public CB513 benchmark dataset. Finally, we explore additions from sequence-to-sequence learning, altering the model to make its predictions conditioned on both the protein's amino acid sequence and its past secondary structure labels. We introduce a new method of ensembling such a conditional model with our convolutional model, an approach which reaches 70.6% Q8 accuracy on CB513. We argue that these results can be further refined for larger boosts in prediction accuracy through more sophisticated attempts to control overfitting of conditional models. We aim to release the code for these experiments as part of the TensorFlow repository.

Secondary Protein Structure Prediction Using Neural Networks

Protein secondary structure prediction with a neural network.

A Hopfield Neural Network Based Algorithm for RNA Secondary Structure Prediction

Protein Secondary Structure Prediction Using Neural Network and Simulated Annealing Algorithm

Hybrid Model Of Neural Network And Hidden Markov Model For Protein Secondary Structure Prediction

Prediction of Helix, Strand Segments from Primary Protein Sequences by a Set of Neural Networks

Localnet: A Simple Recurrent Neural Network Model for Protein Secondary Structure Prediction Using Local Amino Acid Sequences Only

Predicting protein secondary structure based on neural network ensemble

Protein Structure Prediction Using Hybrid Neural Network and Fuzzy Inference System

A Novel Approach for Protein Structure Prediction

Protein Secondary Structure Prediction Based on the Amino Acids Conformational Classification and Neural Network Technique

Protein Secondary Structure Prediction Using Deep Multi-scale Convolutional Neural Networks and Next-Step Conditioning

Reaching Optimized Parameter Set, Protein Secondary Structure Prediction Using Neural Network

Next-Step Conditioned Deep Convolutional Neural Networks Improve Protein Secondary Structure Prediction

Predicting protein secondary structure with Neural Machine Translation

Prediction Protein Secondary Structure by Improved BP Neural Network

An Efficient Method for Protein Secondary Structure Prediction

Effective Local and Secondary Protein Structure Prediction by Combining a Neural Network-Based Approach with Extensive Feature Design and Selection without Reliance on Evolutionary Information

A Deep Convolutional Neural Network to Improve the Prediction of Protein Secondary Structure

Combining Deep Neural Networks for Protein Secondary Structure Prediction

An Algorithm Based On Improved Bayesian Inference Network Model For Prediction Protein Secondary Structure