Abstract:Video description generates natural language sentences that describe the subject, verb, and objects of the targeted Video. The video description has been used to help visually impaired people to understand the content. It is also playing an essential role in devolving human-robot interaction. The dense video description is more difficult when compared with simple Video captioning because of the object’s interactions and event overlapping. Deep learning is changing the shape of computer vision (CV) technologies and natural language processing (NLP). There are hundreds of deep learning models, datasets, and evaluations that can improve the gaps in current research. This article filled this gap by evaluating some state-of-the-art approaches, especially focusing on deep learning and machine learning for video caption in a dense environment. In this article, some classic techniques concerning the existing machine learning were reviewed. And provides deep learning models, a detail of benchmark datasets with their respective domains. This paper reviews various evaluation metrics, including Bilingual Evaluation Understudy (BLEU), Metric for Evaluation of Translation with Explicit Ordering (METEOR), Word Mover’s Distance (WMD), and Recall-Oriented Understudy for Gisting Evaluation (ROUGE) with their pros and cons. Finally, this article listed some future directions and proposed work for context enhancement using key scene extraction with object detection in a particular frame. Especially, how to improve the context of video description by analyzing key frames detection through morphological image analysis. Additionally, the paper discusses a novel approach involving sentence reconstruction and context improvement through key frame object detection, which incorporates the fusion of large language models for refining results. The ultimate results arise from enhancing the generated text of the proposed model by improving the predicted text and isolating objects using various keyframes. These keyframes identify dense events occurring in the video sequence.

Trends in Event Understanding and Caption Generation/Reconstruction in Dense Video: A Review

Dense Events Grounding in Video.

Video description: A comprehensive survey of deep learning approaches

Exploring Video Captioning Techniques: A Comprehensive Survey on Deep Learning Methods

Deep Learning for Video Captioning: A Review

Dense Video Captioning: A Survey of Techniques, Datasets and Evaluation Protocols

A Review of Deep Learning for Video Captioning

Deep learning and knowledge graph for image/video captioning: A review of datasets, evaluation metrics, and methods

Lightweight dense video captioning with cross-modal attention and knowledge-enhanced unbiased scene graph

Event-Centric Hierarchical Representation for Dense Video Captioning

Video captioning – a survey

Video ChatCaptioner: Towards Enriched Spatiotemporal Descriptions

Jointly Localizing and Describing Events for Dense Video Captioning

A Comprehensive Review on Recent Methods and Challenges of Video Description

Parallel Dense Video Caption Generation with Multi-Modal Features

Deep Learning for Video Classification and Captioning

Exploiting long-term temporal dynamics for video captioning

Dense Model for Automatic Image Description Generation with Game Theoretic Optimization

Enhancing Video Event Recognition Using Automatically Constructed Semantic-Visual Knowledge Base.

Hierarchical Context Encoding for Events Captioning in Videos

A Neural ODE and Transformer-based Model for Temporal Understanding and Dense Video Captioning