Semantic and structural analysis of TV diving programs

WangFei,LiJin-Tao,ZhangYong-Dong,LinShou-Xun

IF: 1.871

2004-01-01

Journal of Computer Science and Technology

Abstract:Automatic content analysis of sports videos is a valuable and challenging task. Motivated by analogies between a class of sports videos and languages, the authors propose a novel approach for sport...

What problem does this paper attempt to address?

A Survey on Content-Aware Video Analysis for Sports

Huang-Chia Shih

DOI: https://doi.org/10.48550/arXiv.1703.01170

2017-03-03

Computer Vision and Pattern Recognition

Abstract:Sports data analysis is becoming increasingly large-scale, diversified, and shared, but difficulty persists in rapidly accessing the most crucial information. Previous surveys have focused on the methodologies of sports video analysis from the spatiotemporal viewpoint instead of a content-based viewpoint, and few of these studies have considered semantics. This study develops a deeper interpretation of content-aware sports video analysis by examining the insight offered by research into the structure of content under different scenarios. On the basis of this insight, we provide an overview of the themes particularly relevant to the research on content-aware systems for broadcast sports. Specifically, we focus on the video content analysis techniques applied in sportscasts over the past decade from the perspectives of fundamentals and general review, a content hierarchical model, and trends and challenges. Content-aware analysis methods are discussed with respect to object-, event-, and context-oriented groups. In each group, the gap between sensation and content excitement must be bridged using proper strategies. In this regard, a content-aware approach is required to determine user demands. Finally, the paper summarizes the future trends and challenges for sports video analysis. We believe that our findings can advance the field of research on content-aware video analysis for broadcast sports.
A semantic description scheme of soccer video based on MPEG-7

Lin Liu,Xiuzi Ye,Min Yao,Sanyuan Zhang

DOI: https://doi.org/10.1007/978-3-540-30542-2_37

2004-01-01

Abstract:The birth of MPEG-7 brings an international standard for describing the content and semantic information of multimedia resource, and there are multimedia content description schemes in many areas based on MPEG-7. This paper presents a soccer video's semantic description schema based on MPEG-7 Multimedia Description Scheme. Firstly a video is segmented into shots, and then low-level features and events in shots are detected by manual or automatic methods, at last semantics of shots and the video was presented by MPEG-7. To efficiently organize the semantic information of soccer video, this paper focuses on description scheme.
Automatic Video-based Analysis of Athlete Action

Haojie Li,Shouxun Lin,Yongdong Zhang,Kun Tao

DOI: https://doi.org/10.1109/iciap.2007.4362780

2007-01-01

Abstract:Video analysis of athlete action is becoming an important tool for sports training, since it has no intervention to the athlete and there are abundant archived data it can exploit. In this paper we present our work on the automatic analysis of complex individual actions in diving video aiming at providing biometric measurements and visual tools for coaching assistant and performance improving. The main body joint angles of the athlete are automatic obtained by 2D articulated human body model fitting and shape analysis techniques. Two visual analyzing tools: motion panorama and overlay composition, which are extremely suitable for individual sports game training are presented. The encouraging experimental results show the effectiveness of the proposed system.
Text Semantics Based Automatic Summarization for Chinese Videos

xingqi wang,taotao zha,chunming wu,jinglong fang,ming jiang

DOI: https://doi.org/10.1049/cje.2015.07.004

IF: 1.019

2015-01-01

Chinese Journal of Electronics

Abstract:This paper is concerned with the task of automatically summarizing videos, which is important for many video-related applications. Examples include video retrieval, accessing and categorization, et al. Our approach summarizes video semantically from the texts embedded in videos. To improve the accuracy, ant colony algorithm, maximum matching method, Singular value decomposition (SVD) are employed ...
Automatic detection and recognition of athlete actions in diving video

Haojie Li,Si Wu,Shan Ba,Shouxun Lin,Yongdong Zhang

DOI: https://doi.org/10.1007/978-3-540-69429-8_8

2007-01-01

Abstract:This paper presents a system for automatic detecting and recognizing complex individual actions in sports video to facilitate high-level content-based video indexing and retrieval. This is challenging due to the cluttered and dynamic background in sports video which makes object segmentation formidable. Another difficulty is to fully automatically and accurately detect desired actions from long video sequence. We propose three techniques to handle these challenges. Firstly, an efficient approach exploiting dominant motion and semantic color analysis is developed to detecting the highlight clips which contain athlete’s action from video sequences. Secondly, a robust object segmentation algorithm based on adaptive dynamic background construction is proposed to segment the athlete’s body from the clip. Finally, to recognize the segmented body shape sequences, the hidden markov models are slightly modified to make them suitable for noisy data processing. The proposed system for broadcast diving video analysis has achieved 96.6% detection precision; and 85% recognition accuracy for 13 kinds of diving actions.
A mid-level representation framework for semantic sports video analysis.

Ling-Yu Duan,Min Xu,Tat-Seng Chua,Qi Tian,Changsheng Xu

DOI: https://doi.org/10.1145/957013.957020

2003-01-01

Abstract:ABSTRACTSports video has been widely studied due to its tremendous commercial potentials. Despite encouraging results from various specific sports games, it is almost impossible to extend a system for a new sports game because they usually employ different sets of low-level features appropriate for the specific games and closely coupled with the use of game specific rules to detect events or highlights. There is a lack of internal representation and structure to be generic and applicable for many different sports. In this paper, we present a generic mid-level representation framework for semantic sports video analysis. The mid-level representation layer is introduced between the low-level audio-visual processing and high-level semantic analysis. It allows us to separate sports specific knowledge and rules from the low-level and mid-level feature extraction. This makes sports video analysis more efficient, effective, and less ad-hoc for various types of sports. To achieve robustness of the low-level feature analysis, a non-parametric clustering, mean shift procedure, has been successfully applied to both color and motion analysis. The proposed framework has been tested for five field-ball type sports covering duration of about 8 hours. Experiments have shown its robust performance in semantic analysis and event detection. We believe that the proposed mid-level representation framework can be used for event detection, highlight extraction, summarization and personalization of many types of sports video.
Semantic Shot Classification in Sports Video

LY Duan,M Xu,Q Tian

DOI: https://doi.org/10.1117/12.476259

2003-01-01

Abstract:In this paper, we present a unified framework for semantic shot classification in sports videos. Unlike previous approaches, which focus on clustering by aggregating shots with similar low-level features, the proposed scheme makes use of domain knowledge of a specific sport to perform a top-down video shot classification, including identification of video shot classes for each sport, and supervised learning and classification of the given sports video with low-level and middle-level features extracted from the sports video. It is observed that for each sport we can predefine a small number of semantic shot classes, about 5~10, which covers 90~95% of sports broadcasting video. With the supervised learning method, we can map the low-level features to middle-level semantic video shot attributes such as dominant object motion (a player), camera motion patterns, and court shape, etc. On the basis of the appropriate fusion of those middle-level shot classes, we classify video shots into the predefined video shot classes, each of which has a clear semantic meaning. The proposed method has been tested over 4 types of sports videos: tennis, basketball, volleyball and soccer. Good classification accuracy of 85~95% has been achieved. With correctly classified sports video shots, further structural and temporal analysis, such as event detection, video skimming, table of content, etc, will be greatly facilitated.
Semantic Event Extraction From Basketball Games Using Multi-Modal Analysis

Yifan Zhang,Changsheng Xu,Yong Rui,Jinqiao Wang,Hanqing Lu

DOI: https://doi.org/10.1109/ICME.2007.4285119

2007-01-01

Abstract:In this paper, we present a novel multi-modal framework for semantic event extraction from basketball games based on web-casting text and broadcast video. We propose novel approaches to text analysis for event detection and semantics extraction, video analysis for event structure modeling and event moment detection, and text/video alignment for event boundary detection in the video. Compared with existing approaches to event detection in sports video which rely heavily on low-level features directly extracted from video itself, our approach aims to bridge the semantic gap between low-level features and high-level events and facilitates personalization of the sports video. Promising results are reported on real-world video clips by using text analysis, video analysis and text/video alignment.
Content-based Sports Video Analysis and Modeling

Hong Lu,Yap-Peng Tan

DOI: https://doi.org/10.1109/icarcv.2002.1234943

2002-01-01

Abstract:We propose in this paper some new methods for analyzing and modeling sports based on their low-level visual are first automatically identified by using the color features derived from its video are first automatically identified by using the color features derived from its video shots. To improve the performance on the identification of dominant scenes and reduce the dependency on a proper threshold, a comparison on different forms of shot color features, including shot color histograms, their principal components, and subspace linear discriminant representations, is performed. Second, the content compactness and motion attributes of clustered video shots are analyzed to differentiate dominant scene types. A scene transition diagram is then constructed to form a structural descriptor for sports video contents. Third, the video shots belonging to each dominant scene are processed, using customized schemes and domain specific knowledge, to identify interesting play events in the sports video. Experimental results on identification of dominant scenes, structural desprictors and high-level ball videos, are presented to demonstrate the possible applications of the proposed methods.
A Generic Approach for Systematic Analysis of Sports Videos

Ning Zhang,Ling-Yu Duan,Lingfang Li,Qingming Huang,Jun Du,Wen Gao,Ling Guan

DOI: https://doi.org/10.1145/2168752.2168760

2012-01-01

Abstract:Various innovative and original works have been applied and proposed in the field of sports video analysis. However, individual works have focused on sophisticated methodologies with particular sport types and there has been a lack of scalable and holistic frameworks in this field. This article proposes a solution and presents a systematic and generic approach which is experimented on a relatively large-scale sports consortia. The system aims at the event detection scenario of an input video with an orderly sequential process. Initially, domain knowledge-independent local descriptors are extracted homogeneously from the input video sequence. Then the video representation is created by adopting a bag-of-visual-words (BoW) model. The video’s genre is first identified by applying the k-nearest neighbor (k-NN) classifiers on the initially obtained video representation, and various dissimilarity measures are assessed and evaluated analytically. Subsequently, an unsupervised probabilistic latent semantic analysis (PLSA)-based approach is employed at the same histogram-based video representation, characterizing each frame of video sequence into one of four view groups, namely closed-up-view, mid-view, long-view, and outer-field-view. Finally, a hidden conditional random field (HCRF) structured prediction model is utilized for interesting event detection. From experimental results, k-NN classifier using KL-divergence measurement demonstrates the best accuracy at 82.16&percnt; for genre categorization. Supervised SVM and unsupervised PLSA have average classification accuracies at 82.86&percnt; and 68.13&percnt;, respectively. The HCRF model achieves 92.31&percnt; accuracy using the unsupervised PLSA based label input, which is comparable with the supervised SVM based input at an accuracy of 93.08&percnt;. In general, such a systematic approach can be widely applied in processing massive videos generically.
On Semantic Annotation for Sports Video Highlights by Mining User Comments from Live Broadcast Social Network

Po-Fang Hsu,Yao-Chung Fan,Huan Chen

DOI: https://doi.org/10.1007/978-3-030-02613-4_33

2018-10-19

Abstract:In recent years, the idea of viewing online social media as human-powered sensing networks has draw significant attentions in research communities. Great examples are Twitter-based earthquake detection, Influenza detection, and traffic abnormally detection. Following the same viewpoint of the human-powered sensing network, in this paper, we discover the utility of user-generated social texts on social media platform for extracting highlights and annotating the semantics of sport video clips. The basic idea for the leverage of social text is that one can make use of the semantics of the social texts for understanding the corresponding moments of the game. For example, when watching a baseball, the users on social media will timely comments about the play, the team, and the events. By properly analyzing the texts, automatically annotating the sport videos turns out to be possible. However, two research challenges need to be addressed for such an idea: (1) as sport videos are often lengthy, how to precisely locate the moment of important events is a challenge task, (2) social media contents are generated by users on social network platform and contains various information and with noises, and therefore how to distill useful information from noisy social comment is also a challenge. In this paper, we present a weighting scheme to address the issues by estimating the importance of users (and therefore their comments) on social network platforms based on mining the interaction between users on social platforms. Also, we use soccer game videos and baseball game videos as well as social comment from on-line social network as our test data set. The evaluation over real data shows the effectiveness of the proposed framework.
Automatic Detection and Analysis of Player Action in Moving Background Sports Video Sequences

Haojie Li,Jinhui Tang,Si Wu,Yongdong Zhang,Shouxun Lin

DOI: https://doi.org/10.1109/TCSVT.2009.2035833

IF: 5.859

2010-01-01

IEEE Transactions on Circuits and Systems for Video Technology

Abstract:This paper presents a system for automatically detecting and analyzing complex player actions in moving background sports video sequences, aiming at action-based sports videos indexing and providing kinematic measurements for coach assistance and performance improvement. The system works in a coarse-to-fine fashion. For an input video, in the coarse granularity level, we automatically segment the highlights, that is, the video clips containing the desired action as summaries for general user viewing purposes; in the middle granularity level, we recognize the action types to support action-based video indexing and retrieval; and finally in the fine granularity level, the critical kinematic parameters of player action are obtained for sports professionals' training purposes. However, the complex and dynamic background of sports videos and the complexity of player actions bring considerable difficulty to the automatic analysis. To fulfill such a challenging task, robust algorithms including global motion estimation with adaptive outliers filtering, object segmentation based on adaptive background construction, and automatic human body tracking are proposed in this paper. Two visual analyzing tools: motion panorama and overlay composition, are also introduced. Real diving and jump game videos are used to test the proposed system and algorithms, and the extensive and encouraging experimental results show their effectiveness.
Using Webcast Text for Semantic Event Detection in Broadcast Sports Video

Changsheng Xu,Yi-Fan Zhang,Guangyu Zhu,Yong Rui,Hanqing Lu,Qingming Huang

DOI: https://doi.org/10.1109/TMM.2008.2004912

IF: 7.3

2008-01-01

IEEE Transactions on Multimedia

Abstract:Sports video semantic event detection is essential for sports video summarization and retrieval. Extensive research efforts have been devoted to this area in recent years. However, the existing sports video event detection approaches heavily rely on either video content itself, which face the difficulty of high-level semantic information extraction from video content using computer vision and imag...
Video Content Analysis of Human Sports under Engineering Management Incorporating High-Level Semantic Recognition Models

Ruan Hui

DOI: https://doi.org/10.1155/2022/6761857

2022-01-12

Abstract:In this paper, a high-level semantic recognition model is used to parse the video content of human sports under engineering management, and the stream shape of the previous layer is embedded in the convolutional operation of the next layer, so that each layer of the convolutional neural network can effectively maintain the stream structure of the previous layer, thus obtaining a video image feature representation that can reflect the image nearest neighbor relationship and association features. The method is applied to image classification, and the experimental results show that the method can extract image features more effectively, thus improving the accuracy of feature classification. Since fine-grained actions usually share a very high similarity in phenotypes and motion patterns, with only minor differences in local regions, inspired by the human visual system, this paper proposes integrating visual attention mechanisms into the fine-grained action feature extraction process to extract features for cues. Taking the problem as the guide, we formulate the athlete's tacit knowledge management strategy and select the distinctive freestyle aerial skills national team as the object of empirical analysis, compose a more scientific and organization-specific tacit knowledge management program, exert influence on the members in the implementation, and revise to form a tacit knowledge management implementation program with certain promotion value. Group behavior can be identified by analyzing the behavior of individuals and the interaction information between individuals. Individual interactions in a group can be represented by individual representations, and the relationship between individual behaviors can be analyzed by modeling the relationship between individual representations. The performance improvement of the method on mismatched datasets is comparable between the long-short time network based on temporal information and the language recognition method with high-level semantic embedding vectors, with the two methods improving about 12.6% and 23.0%, respectively, compared with the method using the original model and with the i-vector baseline system based on the support vector machine classification method with radial basis functions, with performance improvements about 10.10% and 10.88%, respectively.
Content-Based Analysis and Indexing of Sports Video

M Luo,XS Bai,GY Xu

DOI: https://doi.org/10.1117/12.451094

2002-01-01

Abstract:An explosion of on-line image and video data in digital form is already well underway. With the exponential rise in interactive information exploration and dissemination through the World-Wide Web, the major inhibitors of rapid access to on-line video data are the management of capture and storage, and content-based intelligent search and indexing techniques. This paper proposes an approach for content-based analysis and event-based indexing of sports video. It includes a novel method to organize shots-classifying shots as close shots and far shots, an original idea of blur extent-based event detection, and an innovative local mutation-based algorithm for caption detection and retrieval. Results on extensive real TV programs demonstrate the applicability of our approach.
Video News Indexing Using Semantic-Face

姚青,吴飞

DOI: https://doi.org/10.3969/j.issn.1002-137X.2004.05.053

2004-01-01

Computer Science

Abstract:The human faces in video and image imply lost of semantic contents , thus we can use faces to index and analyze video contents,especially for video news. In order to realize such goal,semantic human faces must be detected and recognized from video stream. This paper presents a new algorithm for semantic clustering and indexing of video news based on semantic-face: in this algorithm,complexion model is first used to detect possible face area; then pre-trained face/non-face support vector machine is used coarse-grained to recognize face and non-face respectively based on face independent component features from possible face area; third, the semantic-face template is used to filter out non-semantic-faces and we get legible and obverse semantic-faces; in the end,video news is segmented and classified into anchorperson shot, interview shot and other news story shot through mixture Gaussian clustering of semantic-faces. Structure used to index and explorer the video news is established. Experiment shows this algorithm works well for video news indexing.
A Unified Framework for Semantic Shot Classification in Sports Videos

Ling‐Yu Duan,Min Xu,Yu Xiaodong,Qi Tian

DOI: https://doi.org/10.1145/641091.641096

2002-01-01

Abstract:In this demonstration, we present a unified framework for semantic shot classification in sports videos. Unlike previous approaches, which focus on clustering by aggregating shots with similar low-level features, the proposed scheme makes use of domain knowledge of specific sport to perform a top-down video shot classification, including identification of video shots classes for each sport, and supervised learning and classification of given sports video with low-level and middle-level features extracted from the sports video. It's observed that for each sport we can predefine a small number of semantic shot classes, 5--10, which cover 90 to 95 % of sports broadcasting video. With supervised learning method, we can map the low-level features to middle-level semantic video shot attributes such as dominant object motion (a player), camera motion patterns, and court shape, etc. On the basis of the appropriate fusion of those middle-level shot attributes, we classify video shots into the predefined video shot classes, each of which has a clear semantic meaning. The proposed method has been tested over 3 types of sports videos: tennis, basketball, and soccer. Good classification results ranging from 80~95% have been achieved. The proposed framework provides a generic solution for sports video semantic shot classification, which can be adapted to a new sport type easily. With correctly classified sports video shots further structural and temporal analysis will be greatly facilitated.
Ontology Based Sports Video Annotation And Summary

Jq Ouyang,Jt Li,Yd Zhang

DOI: https://doi.org/10.1007/978-3-540-30483-8_62

2004-01-01

Abstract:With digital sports video increasing everyday, effective analyzing sports video content becomes more and more important. Effective and efficient representation of video for searching, retrieval, inference and mining is a key problem in knowledge engineering. To describe sports video content efficiently, sports video ontology for video annotation is represented in OWL, a description logic based Web Ontology Language. We describe a user-friendly platform for sports video annotation. Ontology based sports video annotation can facilitate video indexing, retrieval and reasoning in a broad range of applications including Digital Olympic Project in China. Moreover, we present a hierarchical sports video summarization strategy to browse the sports video in a progressive way. In sports video, replay scenes often represent the highlight or interesting event of the video. Hence, our representative scene selection is based on the replay detection algorithm and identical events detection. The basic experimental results show our strategy is effective.
Live Sports Event Detection Based on Broadcast Video and Web-Casting Text

Changsheng Xu,Jinjun Wang,Kongwah Wan,Yiqun Li,Lingyu Duan

DOI: https://doi.org/10.1145/1180639.1180699

2006-01-01

Abstract:Event detection is essential for sports video summarization, indexing and retrieval and extensive research efforts have been devoted to this area. However, the previous approaches are heavily relying on video content itself and require the whole video content for event detection. Due to the semantic gap between low-level features and high-level events, it is difficult to come up with a generic framework to achieve a high accuracy of event detection. In addition, the dynamic structures from different sports domains further complicate the analysis and impede the implementation of live event detection systems. In this paper, we present a novel approach for event detection from the live sports game using web-casting text and broadcast video. Web-casting text is a text broadcast source for sports game and can be live captured from the web. Incorporating web-casting text into sports video analysis significantly improves the event detection accuracy. Compared with previous approaches, the proposed approach is able to: (1) detect live event only based on the partial content captured from the web and TV; (2) extract detailed event semantics and detect exact event boundary, which are very difficult or impossible to be handled by previous approaches; and (3) create personalized summary related to certain event, player or team according to user's preference. We present the framework of our approach and details of text analysis, video analysis and text/video alignment. We conducted experiments on both live games and recorded games. The results are encouraging and comparable to the manually detected events. We also give scenarios to illustrate how to apply the proposed solution to professional and consumer services.
Video Based Diving Movements Composition and Comparison

李永,廖庆敏,邓莹莹

DOI: https://doi.org/10.3321/j.issn:1002-8331.2003.12.022

2003-01-01

Abstract:如何利用计算机视频处理技术,提高体育运动员的科学训练水平,是当前信息处理技术和体育科学技术交叉研究领域的重点问题之一。借助多段运动视频的合成,对各种动作进行观察比较,找出运动员在同一动作上的差异,对于诸如跳水等多项运动而言具有重要的意义。文章根据跳水视频的特点,提出了一种基于运动目标的视频合成算法。通过对不同的方法进行比较实验,结果表明:所提出的算法能很好地完成视频比较,对背景变化具有较强的鲁棒性。另外,算法还可以扩展到多个运动目标比较等应用领域。

Semantic and structural analysis of TV diving programs

A Survey on Content-Aware Video Analysis for Sports

A semantic description scheme of soccer video based on MPEG-7

Automatic Video-based Analysis of Athlete Action

Text Semantics Based Automatic Summarization for Chinese Videos

Automatic detection and recognition of athlete actions in diving video

A mid-level representation framework for semantic sports video analysis.

Semantic Shot Classification in Sports Video

Semantic Event Extraction From Basketball Games Using Multi-Modal Analysis

Content-based Sports Video Analysis and Modeling

A Generic Approach for Systematic Analysis of Sports Videos

On Semantic Annotation for Sports Video Highlights by Mining User Comments from Live Broadcast Social Network

Automatic Detection and Analysis of Player Action in Moving Background Sports Video Sequences

Using Webcast Text for Semantic Event Detection in Broadcast Sports Video

Video Content Analysis of Human Sports under Engineering Management Incorporating High-Level Semantic Recognition Models

Content-Based Analysis and Indexing of Sports Video

Video News Indexing Using Semantic-Face

A Unified Framework for Semantic Shot Classification in Sports Videos

Ontology Based Sports Video Annotation And Summary

Live Sports Event Detection Based on Broadcast Video and Web-Casting Text

Video Based Diving Movements Composition and Comparison