Abstract:During the information retrieval process, individuals locate relevant web pages by entering specific keywords. Nevertheless, if users provide inaccurate keywords or if these keywords are absent from the intended page, the effectiveness of information retrieval will be significantly compromised. Thus, the role of keywords in text processing remains of utmost importance. Particularly in intricate contexts, relying on manual analysis by readers can prove to be both time-intensive and unfeasible. Most existing methods are addressed with limited accuracy, leading to elevated error rates and compromised training capabilities. To overcome these limitations, the proposed approach introduces an automated keyword extraction and ranking system based on deep learning. Several key stages, like data acquisition, pre-processing, tokenization, word-to-vector transformation, keyword classification, and ranking, are used. The effectiveness of this keyword extraction process is evaluated using 500N-KPCrowd, KPTimes, and KP20k datasets. During text pre-processing, eliminating stop words, applying Parts of Speech (PoS) tagging, stemming, and sentence segmentation are undertaken. The pre-processed text is fed into the Deep-KeywordNet model, while the pre-processed input is tokenized into individual words. The Word2Vec (W2V) Skip-gram embedding layer facilitates the categorization of distributed vector representations. The Attention Bidirectional Long Short-Term Memory Gated Convolutional Neural Network (Attn Bi-GCNN), along with the softmax layer, assign class labels, and the network's loss optimization employs the Dwarf Mongoose Algorithm (DMA). Significant keywords are ranked using the Term Frequency-Inverse Average Document Frequency (TF-IADF) model. Remarkably, the overall accuracy achieved through the implementation in PYTHON stands at 98.87%, with a minimized time complexity.

TNT-KID: Transformer-based neural tagger for keyword identification

Unified Keyword Spotting and Audio Tagging on Mobile Devices with Transformers

BTPK-based learning: An Interpretable Method for Named Entity Recognition

Keywords Extraction with Deep Neural Network Model

Nested-TNT: Hierarchical Vision Transformers with Multi-Scale Feature Processing

Deep Model with Neighborhood-Awareness for Text Tagging.

WNtags: A Web-Based Tool For Image Labeling And Retrieval With Lexical Ontologies

Keyword extraction as sequence labeling with classification algorithms

DBTagger: Multi-Task Learning for Keyword Mapping in NLIDBs Using Bi-Directional Recurrent Neural Networks

Deep-KeywordNet: automated english keyword extraction in documents using deep keyword network based ranking

TNTdetect.AI: A Deep Learning Model for Automated Detection and Counting of Tunneling Nanotubes in Microscopy Images

Keyword Spotting Simplified: A Segmentation-Free Approach using Character Counting and CTC re-scoring

BERTić -- The Transformer Language Model for Bosnian, Croatian, Montenegrin and Serbian

A Multi-task Approach to Neural Multi-label Hierarchical Patent Classification Using Transformers

Efficient Large-scale Audio Tagging via Transformer-to-CNN Knowledge Distillation

Interpreting Transformers for Jet Tagging

Movie tag prediction: An extreme multi-label multi-modal transformer-based solution with explanation

Probabilistic Topic Modelling with Transformer Representations

Understood in Translation, Transformers for Domain Understanding

Neuro or Symbolic? Fine-tuned Transformer with Unsupervised LDA Topic Clustering for Text Sentiment Analysis

Enhancing Automatic Keyphrase Labelling with Text-to-Text Transfer Transformer (T5) Architecture: A Framework for Keyphrase Generation and Filtering