Abstract:Due to the rapid growth of deep learning technologies, automatic image description generation is an interesting problem in computer vision and natural language generation. It helps to improve access to photo collections on social media and gives guidance for visually impaired people. Currently, deep neural networks play a vital role in computer vision and natural language processing tasks. The main objective of the work is to generate the grammatically correct description of the image using the semantics of the trained captions. An encoder-decoder framework using the deep neural system is used to implement an image description generation task. The encoder is an image parsing module, and the decoder is a surface realization module. The framework uses Densely connected convolutional neural networks (Densenet) for image encoding and Bidirectional Long Short Term Memory (BLSTM) for language modeling, and the outputs are given to bidirectional LSTM in the caption generator, which is trained to optimize the log-likelihood of the target description of the image. Most of the existing image captioning works use RNN and LSTM for language modeling. RNNs are computationally expensive with limited memory. LSTM checks the inputs in one direction. BLSTM is used in practice, which avoids the problem of RNN and LSTM. In this work, the selection of the best combination of words in caption generation is made using beam search and game theoretic search. The results show the game theoretic search outperforms beam search. The model was evaluated with the standard benchmark dataset Flickr8k. The Bilingual Evaluation Understudy (BLEU) score is taken as the evaluation measure of the system. A new evaluation measure called GCorrectwas used to check the grammatical correctness of the description. The performance of the proposed model achieves greater improvements over previous methods on the Flickr8k dataset. The proposed model produces grammatically correct sentences for images with a GCorrect of 0.040625 and a BLEU score of 69.96%

Image Description Generation based on Deep Learning

Learn, Imagine and Create: Text-to-Image Generation from Prior Knowledge.

Mirrorgan: Learning Text-To-Image Generation By Redescription

Image Description Generator using Deep Learning

LSTM-in-LSTM for Generating Long Descriptions of Images.

Image Caption Generator Using Deep Learning

Deep Learning for Image-to-Text Generation: A Technical Overview

Enhanced Image Captioning with Color Recognition Using Deep Learning Methods

Image-Based Storytelling Using Deep Learning.

Supervised Deep Learning Techniques for Image Description: A Systematic Review

Image Captioning with Object Detection and Localization.

Image Captioning based on Deep Reinforcement Learning

The Long-Short Story of Movie Description

Dense Model for Automatic Image Description Generation with Game Theoretic Optimization

Enhancing Image Description Generation through Deep Reinforcement Learning: Fusing Multiple Visual Features and Reward Mechanisms

An Intelligent Image Caption Generator Model using Deep Learning

Generate Image Descriptions based on Deep RNN and Memory Cells for Images Features

Image Captioning with Deep Bidirectional LSTMs

Fast Image Captioning Using LSTM

Multi-modal gated recurrent units for image description

Enhancing Image Captioning Using Deep Convolutional Generative Adversarial Networks