Abstract:Natural Language Processing (NLP) deals with analysing, understanding and generating languages likes human. One of the challenges of NLP is training computers to understand the way of learning and using a language as human. Every training session consists of several types of sentences with different context and linguistic structures. Meaning of a sentence depends on actual meaning of main words with their correct positions. Same word can be used as a noun or adjective or others based on their position. In NLP, Word Embedding is a powerful method which is trained on large collection of texts and encoded general semantic and syntactic information of words. Choosing a right word embedding generates more efficient result than others. Most of the papers used pretrained word embedding vector in deep learning for NLP processing. But, the major issue of pretrained word embedding vector is that it can’t use for all types of NLP processing. In this paper, a local word embedding vector formation process have been proposed and shown a comparison between pretrained and local word embedding vectors for Bengali language. The Keras framework is used in Python for local word embedding implementation and analysis section of this paper shows proposed model produced 87.84% accuracy result which is better than fastText pretrained word embedding vectors accuracy 86.75%. Using this proposed method NLP researchers of Bengali language can easily build the specific word embedding vectors for word representation in Natural Language Processing.

Efficient Estimation of Nepali Word Representations in Vector Space

Efficient Non-parametric Estimation of Multiple Embeddings per Word in Vector Space

Estimator Vectors: OOV Word Embeddings based on Subword and Context Clue Estimates

Robust and Consistent Estimation of Word Embedding for Bangla Language by fine-tuning Word2Vec Model

Enriching Word Vectors with Subword Information

Topic Modeling Using Distributed Word Embeddings

A comparative study for wordnet guided text representation

Attention Based Encoder Decoder Model for Video Captioning in Nepali (2023)

Neural Vector Conceptualization for Word Vector Space Interpretation

Non-distributional Word Vector Representations

Using Images to Find Context-Independent Word Representations in Vector Space

Distributed representation of multi-sense words: A loss-driven approach

Named Entity Recognition for Nepali Language

Nepali Video Captioning using CNN-RNN Architecture

Learning Sparse Overcomplete Word Vectors Without Intermediate Dense Representations

Improving Word Vector with Prior Knowledge in Semantic Dictionary.

Can Perplexity Predict Fine-Tuning Performance? An Investigation of Tokenization Effects on Sequential Language Models for Nepali

Estimating Text Similarity based on Semantic Concept Embeddings

Optical Text Recognition in Nepali and Bengali: A Transformer-based Approach

Measuring Word Significance using Distributed Representations of Words

Word Embedding Methods for Word Representation in Deep Learning for Natural Language Processing