Abstract:Video description generates natural language sentences that describe the subject, verb, and objects of the targeted Video. The video description has been used to help visually impaired people to understand the content. It is also playing an essential role in devolving human-robot interaction. The dense video description is more difficult when compared with simple Video captioning because of the object’s interactions and event overlapping. Deep learning is changing the shape of computer vision (CV) technologies and natural language processing (NLP). There are hundreds of deep learning models, datasets, and evaluations that can improve the gaps in current research. This article filled this gap by evaluating some state-of-the-art approaches, especially focusing on deep learning and machine learning for video caption in a dense environment. In this article, some classic techniques concerning the existing machine learning were reviewed. And provides deep learning models, a detail of benchmark datasets with their respective domains. This paper reviews various evaluation metrics, including Bilingual Evaluation Understudy (BLEU), Metric for Evaluation of Translation with Explicit Ordering (METEOR), Word Mover’s Distance (WMD), and Recall-Oriented Understudy for Gisting Evaluation (ROUGE) with their pros and cons. Finally, this article listed some future directions and proposed work for context enhancement using key scene extraction with object detection in a particular frame. Especially, how to improve the context of video description by analyzing key frames detection through morphological image analysis. Additionally, the paper discusses a novel approach involving sentence reconstruction and context improvement through key frame object detection, which incorporates the fusion of large language models for refining results. The ultimate results arise from enhancing the generated text of the proposed model by improving the predicted text and isolating objects using various keyframes. These keyframes identify dense events occurring in the video sequence.

Video Scene Analysis: A Machine Learning Perspective

A Review of Machine Learning Methods Applied to Video Analysis Systems

A Generic Approach for Systematic Analysis of Sports Videos

Video Scene Parsing: an Overview of Deep Learning Methods and Datasets

A Survey on Deep Learning Technique for Video Segmentation

Learning Semantic Scene Models by Object Classification and Trajectory Clustering

Discovery of Shared Semantic Spaces for Multi-Scene Video Query and Summarization

A Method of Surveillance Video Structured Based on Gaussian Mixture Model and Support Vector Machine

Deep Learning Techniques for Video Instance Segmentation: A Survey

Automatic video scene segmentation based on spatial-temporal clues and rhythm

Learning a Contextual Multi-Thread Model for Movie/TV Scene Segmentation

Describing video scenarios using deep learning techniques

Scene Segmentation Based on Video Structure and Spectral Methods

Sports Video Analysis on Large-Scale Data

Unsupervised Sports Video Scene Clustering And Its Applications To Story Units Detection

An HMM-based framework for video semantic analysis

Deep Video Anomaly Detection: Opportunities and Challenges

Video Search and Mining

A Review of Deep Learning Based Video Action Recognition Techniques

Introduction to the Special Section on Contextual Object Analysis in Complex Scenes

Trends in Event Understanding and Caption Generation/Reconstruction in Dense Video: A Review