Abstract:In recent years, natural language processing (NLP) models have demonstrated remarkable capabilities in various domains beyond traditional text generation. In this work, we introduce PeptideGPT, a protein language model tailored to generate protein sequences with distinct properties: hemolytic activity, solubility, and non-fouling characteristics. To facilitate a rigorous evaluation of these generated sequences, we established a comprehensive evaluation pipeline consisting of ideas from bioinformatics to retain valid proteins with ordered structures. First, we rank the generated sequences based on their perplexity scores, then we filter out those lying outside the permissible convex hull of proteins. Finally, we predict the structure using ESMFold and select the proteins with pLDDT values greater than 70 to ensure ordered structure. The properties of generated sequences are evaluated using task-specific classifiers - PeptideBERT and HAPPENN. We achieved an accuracy of 76.26% in hemolytic, 72.46% in non-hemolytic, 78.84% in non-fouling, and 68.06% in solubility protein generation. Our experimental results demonstrate the effectiveness of PeptideGPT in de novo protein design and underscore the potential of leveraging NLP-based approaches for paving the way for future innovations and breakthroughs in synthetic biology and bioinformatics. Codes, models, and data used in this study are freely available at: <a class="link-external link-https" href="https://github.com/aayush-shah14/PeptideGPT" rel="external noopener nofollow">this https URL</a>.

PlasmidGPT: a generative framework for plasmid design and annotation

Peptide-GPT: Generative Design of Peptides using Generative Pre-trained Transformers and Bio-informatic Supervision

Generative De Novo Protein Design with Global Context

Global-Context Aware Generative Protein Design

PlasGO: enhancing GO-based function prediction for plasmid-encoded proteins based on genetic structure

ProtGPT2 is a deep unsupervised language model for protein design

AptaGPT: Advancing aptamer design with a generative pre-trained language model

Binary Discriminator Facilitates GPT-based Protein Design

GraphPlas: Refined Classification of Plasmid Sequences Using Assembly Graphs

AbGPT: De Novo Antibody Design via Generative Language Modeling

Deep metric learning improves lab of origin prediction of genetically engineered plasmids

pLannotate: engineered plasmid annotation

PlasmidMaker is a versatile, automated, and high throughput end-to-end platform for plasmid construction

DNAGPT: A Generalized Pre-trained Tool for Versatile DNA Sequence Analysis Tasks

cMolGPT: A Conditional Generative Pre-Trained Transformer for Target-Specific De Novo Molecular Generation

MolGPT: Molecular Generation Using a Transformer-Decoder Model

Protein Design with StructureGPT: a Deep Learning Model for Protein Structure-to-Sequence Translation

PlasmidHunter: Accurate and Fast Prediction of Plasmid Sequences Using Gene Content Profile and Machine Learning

DNAGPT: A Generalized Pre-trained Tool for Multiple DNA Sequence Analysis Tasks

PlasGUN: Gene prediction in plasmid metagenomic short reads using deep learning.

gplasCC: classification and reconstruction of plasmids from short-read sequencing data for any bacterial species