Abstract:Secondary structure prediction is a key step in understanding protein function and biological properties and is highly important in the fields of new drug development, disease treatment, bioengineering, etc. Accurately predicting the secondary structure of proteins helps to reveal how proteins are folded and how they function in cells. The application of deep learning models in protein structure prediction is particularly important because of their ability to process complex sequence information and extract meaningful patterns and features, thus significantly improving the accuracy and efficiency of prediction. In this study, a combined model integrating an improved temporal convolutional network (TCN), bidirectional long short-term memory (BiLSTM), and a multi-head attention (MHA) mechanism is proposed to enhance the accuracy of protein prediction in both eight-state and three-state structures. One-hot encoding features and word vector representations of physicochemical properties are incorporated. A significant emphasis is placed on knowledge distillation techniques utilizing the ProtT5 pretrained model, leading to performance improvements. The improved TCN, achieved through multiscale fusion and bidirectional operations, allows for better extraction of amino acid sequence features than traditional TCN models. The model demonstrated excellent prediction performance on multiple datasets. For the TS115, CB513 and PDB (2018-2020) datasets, the prediction accuracy of the eight-state structure of the six datasets in this paper reached 88.2%, 84.9%, and 95.3%, respectively, and the prediction accuracy of the three-state structure reached 91.3%, 90.3%, and 96.8%, respectively. This study not only improves the accuracy of protein secondary structure prediction but also provides an important tool for understanding protein structure and function, which is particularly applicable to resource-constrained contexts and provides a valuable tool for understanding protein structure and function.

Predicting protein secondary structure with Neural Machine Translation

ProLanGO: Protein Function Prediction Using Neural Machine Translation Based on a Recurrent Neural Network

An Efficient Method for Protein Secondary Structure Prediction

Single-sequence protein structure prediction using a language model and deep learning

Next-Step Conditioned Deep Convolutional Neural Networks Improve Protein Secondary Structure Prediction

Getting to Know Your Neighbor: Protein Structure Prediction Comes of Age with Contextual Machine Learning.

Hybrid Model Of Neural Network And Hidden Markov Model For Protein Secondary Structure Prediction

Protein secondary structure prediction with a neural network.

Prediction Protein Secondary Structure by Improved BP Neural Network

Protein Secondary Structure Prediction Using Deep Multi-scale Convolutional Neural Networks and Next-Step Conditioning

Localnet: A Simple Recurrent Neural Network Model for Protein Secondary Structure Prediction Using Local Amino Acid Sequences Only

A Dynamic Bayesian Network Approach to Protein Secondary Structure Prediction.

A Seqlet-Based Maximum Entropy Markov Approach for Protein Secondary Structure Prediction

Protein Secondary Structure Prediction Based On Bp Neural Network And Quasi-Newton Algorithm

Prediction of Structural Features and Application to Outer Membrane Protein Identification.

Prediction of protein secondary structure by the improved TCN-BiLSTM-MHA model with knowledge distillation

A Protein Structure Prediction Approach Leveraging Transformer and CNN Integration

Accurate prediction of protein torsion angles using evolutionary signatures and recurrent neural network

Secondary Protein Structure Prediction Using Neural Networks

Coupled prediction of protein secondary and tertiary structure

Protein Folds Recognized by an Intelligent Predictor Based-on Evolutionary and Structural Information.