Abstract:Video description generates natural language sentences that describe the subject, verb, and objects of the targeted Video. The video description has been used to help visually impaired people to understand the content. It is also playing an essential role in devolving human-robot interaction. The dense video description is more difficult when compared with simple Video captioning because of the object’s interactions and event overlapping. Deep learning is changing the shape of computer vision (CV) technologies and natural language processing (NLP). There are hundreds of deep learning models, datasets, and evaluations that can improve the gaps in current research. This article filled this gap by evaluating some state-of-the-art approaches, especially focusing on deep learning and machine learning for video caption in a dense environment. In this article, some classic techniques concerning the existing machine learning were reviewed. And provides deep learning models, a detail of benchmark datasets with their respective domains. This paper reviews various evaluation metrics, including Bilingual Evaluation Understudy (BLEU), Metric for Evaluation of Translation with Explicit Ordering (METEOR), Word Mover’s Distance (WMD), and Recall-Oriented Understudy for Gisting Evaluation (ROUGE) with their pros and cons. Finally, this article listed some future directions and proposed work for context enhancement using key scene extraction with object detection in a particular frame. Especially, how to improve the context of video description by analyzing key frames detection through morphological image analysis. Additionally, the paper discusses a novel approach involving sentence reconstruction and context improvement through key frame object detection, which incorporates the fusion of large language models for refining results. The ultimate results arise from enhancing the generated text of the proposed model by improving the predicted text and isolating objects using various keyframes. These keyframes identify dense events occurring in the video sequence.

Deep learning and knowledge graph for image/video captioning: A review of datasets, evaluation metrics, and methods

Deep Learning Approaches on Image Captioning: A Review

Deep Learning for Video Captioning: A Review

A Thorough Review on Recent Deep Learning Methodologies for Image Captioning

A comprehensive literature review on image captioning methods and metrics based on deep learning technique

A Review of Deep Learning for Video Captioning

Deep Learning Approaches for Image Captioning: Opportunities, Challenges and Future Potential

Visuals to Text: A Comprehensive Review on Automatic Image Captioning

Image captioning using deep learning and python

Exploring Video Captioning Techniques: A Comprehensive Survey on Deep Learning Methods

A Comprehensive Survey of Deep Learning for Image Captioning

A comprehensive review of image caption generation

A comprehensive survey on image captioning: from handcrafted to deep learning-based techniques, a taxonomy and open research issues

Combinatorial Analysis of Deep Learning and Machine Learning Video Captioning Studies: A Systematic Literature Review

Deep Learning for Video Classification and Captioning

Trends in Event Understanding and Caption Generation/Reconstruction in Dense Video: A Review

Supervised Deep Learning Techniques for Image Description: A Systematic Review

Video captioning: a review of theory, techniques and practices

A Review of Deep Learning-Based Remote Sensing Image Caption: Methods, Models, Comparisons and Future Directions

Domain-specific image captioning: a comprehensive review

Image Captioning using Deep Neural Architectures