Abstract:The significance of telerobotic trajectory segmentation has been demonstrated on a range of skill training and robotic automation tasks. However, the trajectories of telerobot are characterized by complexity and high dimensionality, making it difficult to segment them accurately. Existing methods are often plagued by feature inefficiency, and the clustering methods are also difficult to properly model the trajectories. In addition, over-segmentation also affects the accuracy of the clustering-based segmentation methods. To address above problems, this article presents a new unsupervised approach that automatically segments multimodal trajectory data of a telerobot and solves the problem of over-segmentation through a postpromoting procedure. First, we present an unsupervised visual feature-extraction network, that is, a dense connection spatial convolution network (DCSC) to generate more discriminative features for clustering. The dense convolution and spatial convolution facilitates information flow, enhances feature propagation, and avoids manual annotation. Next, we develop an unsupervised trajectory segmentation method that is called multimodality clustering with Chinese restaurant process (MC-CRP). The model utilizes data from different modalities and segments the trajectory through hierarchical clustering. MC-CRP obtains more accurate results in a short period of time. To further improve the precision of trajectory segmentation, we merge over-segments based on predefined similarity measurements. Extensive experiments on the publicly available data set JIGSAWS show that the presented approach achieves 70.1% silhouette coefficient, 25.1% normalized mutual information, and 71.4% segmentation accuracy. These metrics demonstrate that the presented segmentation approach provides deeper insight into the trajectory features and improve the accuracy of segmentation more efficiently than others.

Unsupervised Approach for Multimodality Telerobotic Trajectory Segmentation

Beyond Traditional Driving Scenes: A Robotic-Centric Paradigm for 2D+3D Human Tracking Using Siamese Transformer Network

From One To Many: Unsupervised Traversable Area Segmentation In Off-Road Environment

Unsupervised Trajectory Segmentation and Promoting of Multi-Modal Surgical Demonstrations

Robot Complex Motion Learning Based on Unsupervised Trajectory Segmentation and Movement Primitives.

Semi-Supervised Video Object Segmentation with Super-Trajectories.

A Deep Trajectory Clustering Method Based on Sequence‐to‐sequence Autoencoder Model

A Feature Based Method for Trajectory Dataset Segmentation and Profiling

A Dual Self-supervised Deep Trajectory Clustering Method.

Hierarchical Semi-Supervised Learning Framework for Surgical Gesture Segmentation and Recognition Based on Multi-Modality Data

Video Object Segmentation via Super-trajectories

MTrajRec: Map-Constrained Trajectory Recovery via Seq2Seq Multi-task Learning

3D Multi-Object Tracking with Semi-Supervised GRU-Kalman Filter

A Critical Perceptual Pre-trained Model for Complex Trajectory Recovery

Deep Trajectory Post-Processing and Position Projection for Single & Multiple Camera Multiple Object Tracking

DIGEST: Deeply supervIsed knowledGE tranSfer neTwork learning for brain tumor segmentation with incomplete multi-modal MRI scans

Super-Trajectory for Video Segmentation

MTrajRec

Unsupervised Trajectory Clustering Via Adaptive Multi-Kernel-Based Shrinkage

TrajectoryFormer: 3D Object Tracking Transformer with Predictive Trajectory Hypotheses

Motion Segmentation Via Robust Subspace Separation in the Presence of Outlying, Incomplete, or Corrupted Trajectories