Abstract:Motion characterization plays a critical role in video indexing. An effective way of characterizing camera motion facilitates the video representation, indexing and retrieval tasks. This paper describes a novel nonparametric motion representation to achieve an effective and robust recognition of parts of the video in which camera is static, or panning, or tilting, or zooming, etc. This representation employs the mean shift filtering and the vector histograms to produce a compact description of a motion field. The basic idea is to perform spatio-temporal mode-seeking in the motion feature space and use the histograms-based spatial distributions of dominant motion modes to represent a motion field. Unlike most existing approaches, which focus on the estimation of a parametric motion model from a dense optical flow field (OFF) or a block matching-based motion vector field (MVF), the proposed method combines the motion representation and machine learning techniques (e.g., support vector machines) to perform camera motion analysis from the classification point of view. The main motivation lies in the impossibility of uniformly securing a proper parametric assumption in a wide range of video scenarios. The diverse camera shot sizes and frequent occurrences of bad OFF[MVF necessitates a learning mechanism, which can not only capture the domain-independent parametric constraints, but also acquire the domain-dependent knowledge to tolerate the influence of bad OFF/MVF. In order to improve performance, we can use this learning-based method to train enhanced classifiers aiming at a certain context (i.e., shot size, neighbor OFF/MVFs, and video genre). Other visual cues (e.g., dominant color) can also be incorporated for further motion analysis. Our main aim is to use a generic feature space analysis method to explore a flexible OFF/MVF representation in a nonparametric technique, which could be fed into a learning framework to robustly capture the global motion by incorporating the context information. Results on videos with various types of content (23 191 MVFs culled from MPEG-7 dataset, and 20 000 MVFs culled from broadcast tennis, soccer, and basketball videos) are reported to validate the proposed approach.

Motion-based material characterization in sensor-based sorting

Qualitative analysis of post-consumer and post-industrial waste via near-infrared, visual and induction identification with experimental sensor-based sorting setup

Multiframe-integrated, In-Sensor Computing Using Persistent Photoconductivity

Industrial application for inline material sorting using hyperspectral imaging in the NIR range

Nonparametric Motion Characterization for Robust Classification of Camera Motion Patterns

Object Sorting Using a Global Texture-Shape 3D Feature Descriptor

Color Sensor-Based Object Sorting Robotic Arm

Real-time color-based sorting robotic arm system

An iterative clustering algorithm for classification of object motion direction using infrared sensor array

Pregrasp Object Material Classification by a Novel Gripper Design with Integrated Spectroscopy

Design of assembly line material sorting system based on machine vision

Fast Semantic-Aware Motion State Detection for Visual SLAM in Dynamic Environment

Image-based cell sorting using focused travelling surface acoustic waves

Real-time clustering and multi-target tracking using event-based sensors

Multi-sensor characterization for an improved identification of polymers in WEEE recycling

Infrared Thermography Sensor for Temperature and Speed Measurement of Moving Material

Research on Machine Vision Technology of High Speed Robot Sorting System based on Deep Learning

Classification of Household Materials via Spectroscopy

Image capturing, segmentation and data analysis of shredded refuse streams

Machine vision-based detection of forbidden elements in the high-speed automatic scrap sorting line