Abstract:During the information retrieval process, individuals locate relevant web pages by entering specific keywords. Nevertheless, if users provide inaccurate keywords or if these keywords are absent from the intended page, the effectiveness of information retrieval will be significantly compromised. Thus, the role of keywords in text processing remains of utmost importance. Particularly in intricate contexts, relying on manual analysis by readers can prove to be both time-intensive and unfeasible. Most existing methods are addressed with limited accuracy, leading to elevated error rates and compromised training capabilities. To overcome these limitations, the proposed approach introduces an automated keyword extraction and ranking system based on deep learning. Several key stages, like data acquisition, pre-processing, tokenization, word-to-vector transformation, keyword classification, and ranking, are used. The effectiveness of this keyword extraction process is evaluated using 500N-KPCrowd, KPTimes, and KP20k datasets. During text pre-processing, eliminating stop words, applying Parts of Speech (PoS) tagging, stemming, and sentence segmentation are undertaken. The pre-processed text is fed into the Deep-KeywordNet model, while the pre-processed input is tokenized into individual words. The Word2Vec (W2V) Skip-gram embedding layer facilitates the categorization of distributed vector representations. The Attention Bidirectional Long Short-Term Memory Gated Convolutional Neural Network (Attn Bi-GCNN), along with the softmax layer, assign class labels, and the network's loss optimization employs the Dwarf Mongoose Algorithm (DMA). Significant keywords are ranked using the Term Frequency-Inverse Average Document Frequency (TF-IADF) model. Remarkably, the overall accuracy achieved through the implementation in PYTHON stands at 98.87%, with a minimized time complexity.

Keyword Extraction using the Word Co-occurrence Network Properties that is Independent of Languages and Document Types and Its Evaluation by Prediction of Headline Words

Exploring simultaneous keyword and key sentence extraction: improve graph-based ranking using wikipedia.

Exploring Simultaneous Keyword and Key Sentence Extraction

Keyword Extraction Approach Based on Probabilistic-Entropy, Graph, and Neural Network Methods

An Effective Keyword Search Co-Occurrence Multi-Layer Graph Mining Approach

Keyword Extraction Based on Lexical Chains and Word Co-occurrence for Chinese News Web Pages

Single Document Keyword Extraction for Internet News Articles

A Way to Improve Graph-Based Keyword Extraction

Complex Network based Supervised Keyword Extractor

Research on a Compound Keywords Detection Method Based on Small World Model

Automatic Keywords Extraction Based on Co-Occurrence and Semantic Relationships Between Words

Using virtual edges to extract keywords from texts modeled as complex networks

Chinese Keyword Extraction Based on N-Gram and Word Co-occurrence

Keyword Extraction And Headline Generation Using Novelword Features

Keyword Extraction: A Modern Perspective

News keyword extraction algorithm based on semantic clustering and word graph model

Keywords Extraction with Deep Neural Network Model

Deep-KeywordNet: automated english keyword extraction in documents using deep keyword network based ranking

A Document-Structure-based Complex Network Model for Extracting Text Keywords

A Graph-Based Keyword Extraction Method for Academic Literature Knowledge Graph Construction