Movement tracking for train using synchronic detection line

LI Han,LIU Ji-lin,YU Chun-he,YANG Wen-ming

DOI: https://doi.org/10.3969/j.issn.1007-0249.2007.03.008

2007-01-01

Abstract:According to the characteristics of movement object in rail,a new method of object tracking is proposed.It employs structural image,SDL and probabilistic model.The performance of movement tracking in rail is proved by the calculation example.

What problem does this paper attempt to address?

A New Detection and Tracking Algorithm for Moving Objects

潘锋,王宣银,向桂山,梁冬泰

DOI: https://doi.org/10.3969/j.issn.1003-501x.2005.01.012

2005-01-01

Abstract:When both camera and objects are in moving state, the moving objects cannot be detected by common moving objects detection algorithms. For this reason a background matching algorithm combining with inter-frame differential technique is proposed to solve such problem. The moving objects can be effectively extracted with this method. When motion was detected, a Kalman predictor was used to estimate the object’s position in the image. Combined with an incremental PID control approach with dead area, the camera can track the moving objects. Experimental results show that the selection of the matching blocks speeds up the processing speed and improves the stability of the algorithm. Kalman predictor makes the tracking more stable and reliable. This algorithm is characteristics of simplicity, applicability and anti-noise.
Object Tracking Method Based on Incrementally Updating Linear Discriminant Subspace

钱诚,徐舒畅,张引,张三元

DOI: https://doi.org/10.3969/j.issn.1003-6059.2010.02.018

2010-01-01

Pattern Recognition and Artificial Intelligence

Abstract:A method for object tracking is presented to track objects steadily based on incremental linear discriminant analysis.The locations and poses of the object are represented by a set of affine parameters.Resorting to a state transition model,a group of image samples are predicted as candidates of the image patches of the object in the next frame.Their likelihoods of being the object image patch are measured after they are projected into a linear discriminant subspace.Then a sample with maximum likelihood is regarded as the object image patch.Finally,sufficient spanning sets of total scatter matrix and between-class scatter matrix are rotated to update projection matrix for maintaining the discrimination power of the subspace.Experimental results show that the method is robust to variation in appearances of objects and surrounding background,and it is available in affine invariant tracking.
A novel Algorithm for background updating of rail scenery images using SDL method

Han Li,Jilin Liu,Wenming Yang,Zhiwei He

DOI: https://doi.org/10.1109/icosp.2004.1441518

2004-01-01

Abstract:Video surveillance is an important way to obtain the traffic information in the highway. It also can play an important role in the case of railways. The background updating is a very important part of the detection algorithm in video surveillance. The common background models focus on the distribution of isolated pixels. This paper discusses the concept of status synchronization of the rail scenery images at first, and then proposes a novel updating method based on the pixels set in the synchronous detection line (SDL). Finally an experiment is given to test the algorithm. The experiment shows the result what we expected.
Robust Visual Tracking Via CAMShift and Structural Local Sparse Appearance Model

Houqiang Zhao,Ke Xiang,Songxiao Cao,Xuanyin Wang

DOI: https://doi.org/10.1016/j.jvcir.2015.11.008

IF: 2.887

2015-01-01

Journal of Visual Communication and Image Representation

Abstract:This paper addresses issues in visual tracking where videos contain object intersections, pose changes, occlusions, illumination changes, motion blur, and similar color distributed background. We apply the structural local sparse representation method to analyze the background region around the target. After that, we reduce the probability of prominent features in the background and add new information to the target model. In addition, a weighted search method is proposed to search the best candidate target region. To a certain extent, the weighted search method solves the local optimization problem. The proposed scheme, designed to track single human through complex scenarios from videos, has been tested on some video sequences. Several existing tracking methods are applied to the same videos and the corresponding results are compared. Experimental results show that the proposed tracking scheme demonstrates a very promising performance in terms of robustness to occlusions, appearance changes, and similar color distributed background. (C) 2015 Elsevier Inc. All rights reserved.
A Real-Time Method for Railway Track Detection and 3D Fitting Based on Camera and LiDAR Fusion Sensing

Tang,Cao,Yang,Liu,Zhu,Du,Li

DOI: https://doi.org/10.3390/rs16081441

IF: 5

2024-04-19

Remote Sensing

Abstract:Railway track detection, which is crucial for train operational safety, faces numerous challenges such as the curved track, obstacle occlusion, and vibrations during the train's operation. Most existing methods for railway track detection use a camera or LiDAR. However, the vision-based approach lacks essential 3D environmental information about the train, while the LiDAR-based approach tends to detect tracks of insufficient length due to the inherent limitations of LiDAR. In this study, we propose a real-time method for railway track detection and 3D fitting based on camera and LiDAR fusion sensing. Semantic segmentation of the railway track in the image is performed, followed by inverse projection to obtain 3D information of the distant railway track. Then, 3D fitting is applied to the inverse projection of the railway track for track vectorization and LiDAR railway track point segmentation. The extrinsic parameters necessary for inverse projection are continuously optimized to ensure robustness against variations in extrinsic parameters during the train's operation. Experimental results show that the proposed method achieves desirable accuracy for railway track detection and 3D fitting with acceptable computational efficiency, and outperforms existing approaches based on LiDAR, camera, and camera–LiDAR fusion. To the best of our knowledge, our approach represents the first successful attempt to fuse camera and LiDAR data for real-time railway track detection and 3D fitting.

environmental sciences,imaging science & photographic technology,remote sensing,geosciences, multidisciplinary
Novel Multistate Fault Diagnosis and Location Method for Key Components of High-Speed Trains.

Luonan Chang,Zhen Liu,Yuan Shen,Guangjun Zhang

DOI: https://doi.org/10.1109/tie.2020.2977580

IF: 7.7

2021-01-01

IEEE Transactions on Industrial Electronics

Abstract:Images collected by linear scan cameras are stretched and compressed due to the speed regulation of trains. This condition changes the shape of objects and considerably increases the false and missed alarm rates. Moreover, small size and dense distribution of the key components in railway trains increase the difficulty in fault diagnosis. Therefore, a two-module troubleshooting and positioning methodology is proposed, in this article, for state diagnosis of key small components of high-speed running trains. First, the image with deformation is reshaped to be exactly the same as the standard one via omnidirectional scale correlation normalization (OSCN), which performs well even in low texture, high-light situations. Second, we propose three feature-enhanced models to expand the receptive field of deep feature maps. This novel detector, namely, refine-inception net (RIN), not only reduces the rate of missed and false detection, but also minimizes the influence of target size and occlusion. Augmentation is performed to increase robustness because the detector is data driven. Experimental results show that the optimal strategy combining OSCN and RIN can troubleshoot high-speed trains of different models with an accuracy higher than 99%. Our method can be extended to foreign object recognition on the train roof while maintaining railway safety.
Rail Detection Based on LSD and the Least Square Curve Fitting

Yun-Shui Zheng,Yan-Wei Jin,Yu Dong

DOI: https://doi.org/10.1007/s11633-020-1241-4

2020-08-10

International Journal of Automation and Computing

Abstract:It is necessary to rely on the rail gauge to determine whether the object beside the track will affect train operation safety or not. A convenient and fast method based on line segment detector (LSD) and the least square curve fitting to identify the rail in the image is proposed in this paper. The image in front of the train can be obtained through the camera on-board. After preprocessing, it will be divided equally along the longitudinal axis. Utilizing the characteristics of the LSD algorithm, the edges are approximated into multiple line segments. After screening the terminals of the line segments, it can generate the mathematical model of the rail in the image based on the least square. Experiments show that the algorithm in this paper can fit the rail curve accurately and has good applicability and robustness.

automation & control systems,computer science, artificial intelligence
Moving People Tracking with Detection by Latent Semantic Analysis for Visual Surveillance Applications

Peng Zhang,Yanning Zhang,Tony Thomas,Sabu Emmanuel

DOI: https://doi.org/10.1007/s11042-012-1110-4

IF: 2.577

2012-01-01

Multimedia Tools and Applications

Abstract:The latent semantic analysis (LSA) has been widely used in the fields of computer vision and pattern recognition. Most of the existing works based on LSA focus on behavior recognition and motion classification. In the applications of visual surveillance, accurate tracking of the moving people in surveillance scenes, is regarded as one of the preliminary requirement for other tasks such as object recognition or segmentation. However, accurate tracking is extremely hard under challenging surveillance scenes where similarity among multiple objects or occlusion among multiple objects occurs. Usual temporal Markov chain based tracking algorithms suffer from the 'tracking error accumulation problem'. The accumulated errors can finally make the tracking to drift from the target. To handle the problem of tracking drift, some authors have proposed the idea of using detection along with tracking as an effective solution. However, many of the critical issues still remain unsettled in these detection based tracking algorithms. In this paper, we propose a novel moving people tracking with detection based on (probabilistic) LSA. By employing a novel 'twin-pipeline' training framework to find the latent semantic topics of 'moving people', the proposed detection can effectively detect the interest points on moving people in different indoor and outdoor environments with camera motion. Since the detected interest points on different body parts can be used to locate the position of moving people more accurately, by combining the detection with incremental subspace learning based tracking, the proposed algorithms resolves the problem of tracking drift during each target appearance update process. In addition, due to the time independent processing mechanism of detection, the proposed method is also able to handle the error accumulation problem. The detection can calibrate the tracking errors during updating of each state of the tracking algorithm. Extensive, experiments on various surveillance environments using different benchmark datasets have proved the accuracy and robustness of the proposed tracking algorithm. Further, the experimental comparison results clearly show that the proposed tracking algorithm outperforms the well known tracking algorithms such as ISL, AMS and WSL algorithms. Furthermore, the speed performance of the proposed method is also satisfactory for realistic surveillance applications.
A New Tracking Technique: Object Tracking And Identification From Motion

T Chen,M Han,W Hua,Yh Gong,Ts Huang

DOI: https://doi.org/10.1007/978-3-540-45179-2_20

2003-01-01

Abstract:Pattern recognition and object tracking play very important roles in various applications, such as motion capture, object detection/recognition, video surveillance, and human computer interface. One very useful method that is rarely mentioned in literature is performing recognition from the motion cue. In many situations, the motion of an object is very representative and informative; therefore, it is possible to identify the object and its behavior from its motion. In this paper, we propose an original method to both identify and track an object in dynamic scenes. The method works on the situations with occlusions, appearance changes and global camera motions. It does not require prior segmentation or initialization. We test this method on a video database containing 18 World Cup soccer videos recorded from TV to detect and track the soccer ball. The results are satisfying. The results are also integrated into a video indexing system and the improvement on video retrieval is described.
2-D Model Based Tracking of Human Motion

孙怡,王恩亮,安宏杰,胡家升

DOI: https://doi.org/10.3969/j.issn.1006-8961.2002.07.001

2002-01-01

Journal of Image and Graphics

Abstract:Human motion tracking has become a hot issue in the fields of image processing and computer vision. It is receiving increasing attention from more and more researchers due to its wide applications in human-machine interfaces, virtual reality and smart surveillance, robot simulation, etc. In order to track human motion precisely, two methods of automatic tracking are proposed. One method is based on 2-D model. Taking region overlay as the matching criteria, the method adopts a matching procedure from coarse matching to fine matching for establishing the precise correspondence between the 2-D model and real human body motion; the other method is based on the feature of body parts and their connection. By locating the body parts according to their different shapes, the joint connecting the body parts can be located also, and then the human movement can be recovered by 2-D skeleton model. Based on the two methods, real human motion is tracked from simple walking movement to complex gymnastics. The result shows that the method can resist the affection of noise and the variation of intensity, and the position of the overlapped area can be estimated coarsely. Precise result can be acquired in the whole course of the movement of the body.
Railroad track detection in coal mine based on the piecewise linear model

Dong Chai,Shan Liang,Xiaodong Xian

2012-01-01

Abstract:This paper proposed a railroad track detection algorithm based on the piece-wise linear model for a vision based tramcar anti-collision system in coal mines. The main idea of the algorithm is to search for railroad track in a coal tunnel under low and non-uniform illumination and with many noise objects, such as drainage ditches and crossties. Region of Interest (ROI) selection and an improved noise removal method are used to reduce the impact from the noise objects. Then railroad tracks are partitioned into several segments and the most possible line segments of tracks are detected and located in each segment by Hough, which could solve the problem from the low and non-uniform illumination. Finally, line segments are fitted to get a complete track by some rules. The experimental results showed the proposed algorithm is with the good performance and accuracy as well as robustness when tested on three different scenes. © 2012 ISSN 1881-803X.
Ultra-Fast Adaptive Track Detection Network

Hai Ni,Rui Wang,Scarlett Liu

2024-05-22

Abstract:Railway detection is critical for the automation of railway systems. Existing models often prioritize either speed or accuracy, but achieving both remains a challenge. To address the limitations of presetting anchor groups that struggle with varying track proportions from different camera angles, an ultra-fast adaptive track detection network is proposed in this paper. This network comprises a backbone network and two specialized branches (Horizontal Coordinate Locator and Perspective Identifier). The Perspective Identifier selects the suitable anchor group from preset anchor groups, thereby determining the row coordinates of the railway track. Subsequently, the Horizontal Coordinate Locator provides row classification results based on multiple preset anchor groups. Then, utilizing the results from the Perspective Identifier, it generates the column coordinates of the railway track. This network is evaluated on multiple datasets, with the lightweight version achieving an F1 score of 98.68% on the SRail dataset and a detection rate of up to 473 FPS. Compared to the SOTA, the proposed model is competitive in both speed and accuracy. The dataset and code are available at

Computer Vision and Pattern Recognition
A Hybrid Deep Learning Based Framework for Component Defect Detection of Moving Trains

Cen Chen,Kenli Li,Cheng Zhongyao,Francesco Piccialli,Steven C. H. Hoi,Zeng Zeng

DOI: https://doi.org/10.1109/tits.2020.3034239

IF: 8.5

2022-04-01

IEEE Transactions on Intelligent Transportation Systems

Abstract:Defect detection of trains is of great significance for operation safety and maintenance efficiency for railway maintenance. Nowadays, China railway system utilizes high-speed line scan cameras to capture images of critical parts of moving trains. The visual inspection on the images still heavily relies on manual interpretation. To reduce the labor requirements, we propose a novel two-stage deep learning based framework for component defect detection of moving trains. The proposed framework is composed of two major successive stages: detecting train components by using our proposed hierarchical object detection scheme (HOD), and detecting component defects based on multiple neural networks and image processing methods. Our proposed HOD can effectively detect and localize train components from large to small in a hierarchical way. Furthermore, a gated feature fusion method that can extract and combine the hierarchical contextual features and spatial contexts is also proposed to improve the performance. To the best of our knowledge, it is the first time in the literature that component defect detection of moving trains is systematically analyzed. Extensive experiments on real images from China railway system have demonstrated that our framework outperforms the state-of-the-art baselines significantly.

engineering, electrical & electronic,transportation science & technology, civil
Research on the Method of Foreign Object Detection for Railway Tracks Based on Deep Learning

Shanping Ning,Feng Ding,Bangbang Chen

DOI: https://doi.org/10.3390/s24144483

2024-07-11

Abstract:Addressing the limitations of current railway track foreign object detection techniques, which suffer from inadequate real-time performance and diminished accuracy in detecting small objects, this paper introduces an innovative vision-based perception methodology harnessing the power of deep learning. Central to this approach is the construction of a railway boundary model utilizing a sophisticated track detection method, along with an enhanced UNet semantic segmentation network to achieve autonomous segmentation of diverse track categories. By employing equal interval division and row-by-row traversal, critical track feature points are precisely extracted, and the track linear equation is derived through the least squares method, thus establishing an accurate railway boundary model. We optimized the YOLOv5s detection model in four aspects: incorporating the SE attention mechanism into the Neck network layer to enhance the model's feature extraction capabilities, adding a prediction layer to improve the detection performance for small objects, proposing a linear size scaling method to obtain suitable anchor boxes, and utilizing Inner-IoU to refine the boundary regression loss function, thereby increasing the positioning accuracy of the bounding boxes. We conducted a detection accuracy validation for railway track foreign object intrusion using a self-constructed image dataset. The results indicate that the proposed semantic segmentation model achieved an MIoU of 91.8%, representing a 3.9% improvement over the previous model, effectively segmenting railway tracks. Additionally, the optimized detection model could effectively detect foreign object intrusions on the tracks, reducing missed and false alarms and achieving a 7.4% increase in the mean average precision (IoU = 0.5) compared to the original YOLOv5s model. The model exhibits strong generalization capabilities in scenarios involving small objects. This proposed approach represents an effective exploration of deep learning techniques for railway track foreign object intrusion detection, suitable for use in complex environments to ensure the operational safety of rail lines.
REAL-TIME HUMAN TRACKING BASED ON SWITCHING LINEAR DYNAMIC SYSTEM COMBINED WITH ADAPTIVE MEANSHIFT TRACKER

Li Zheyuan,Liu Hong,Xu Chao

DOI: https://doi.org/10.1109/icip.2011.6116106

2011-01-01

Abstract:Real-time human tracking in complex environments usually presents many challenges, such as partial/complete occlusions caused by irregular motion and similar-color distractors. Switching Linear Dynamic System(SLDS) and Meanshift(MS) are two successful approaches, although both have inherent deficiencies, like accumulated prediction and correction errors in SLDS, uncoded attentional and spatial information in Meanshift, respectively. In this paper, a spatial-representive Meanshift and a joint attentional feature histogram from bottom-up and top-down attention models are used to make the tracker more adaptive. Then a tracking algorithm is proposed as adaptive Meanshift embedded SLDS, where four transition matrixes A(s(t)) handle partial/complete occlusions with irregular motion under the framework, and adaptive Meanshift solves short occlusions of similar-color distractors in local search for higher accuracy. Experiments show that this method can work more robustly for partial/complete occlusions among multiple persons compared with adaptive Meanshift and Meanshift embedded SLDS.
Track-monitoring from the Dynamic Response of an Operational Train

George Lederman,Siheng Chen,James Garrett,Jelena Kovacevic,Hae Young Noh,Jacobo Bielak

DOI: https://doi.org/10.1016/j.ymssp.2016.06.041

IF: 8.4

2017-01-01

Mechanical Systems and Signal Processing

Abstract:We explore a data-driven approach for monitoring rail infrastructure from the dynamic response of a train in revenue-service. Presently, track inspection is performed either visually or with dedicated track geometry cars. In this study, we examine a more economical approach where track inspection is performed by analyzing vibration data collected from an operational passenger train. The high frequency with which passenger trains travel each section of track means that faults can be detected sooner than with dedicated inspection vehicles, and the large number of passes over each section of track makes a data-driven approach statistically feasible. We have deployed a test-system on a light-rail vehicle and have been collecting data for the past two years. The collected data underscores two of the main challenges that arise in train-based track monitoring: the speed of the train at a given location varies from pass to pass and the position of the train is not known precisely. In this study, we explore which feature representations of the data best characterize the state of the tracks despite these sources of uncertainty (i.e., in the spatial domain or frequency domain), and we examine how consistently change detection approaches can identify track changes from the data. We show the accuracy of these different representations, or features, and different change detection approaches on two types of track changes, track replacement and tamping (a maintenance procedure to improve track geometry), and two types of data, simulated data and operational data from our test-system. The sensing, signal processing, and data analysis we propose in the study could facilitate safer trains and more cost-efficient maintenance in the future. Moreover, the proposed approach is quite general and could be extended to other parts of the infrastructure, including bridges.
Video-based Adaptive Railway Recognition in Complex Scene

Xiang Qiang,Zhaoyang Zhang,Qiwei Chen,Cheng Wu,Yiming Wang

DOI: https://doi.org/10.1109/icalip.2016.7846527

2016-01-01

Abstract:Adaptively tracking tram railway in video-based complex scene is difficult because of road curving and environment changing. In this paper, we introduce an adaptive railway recognition method by analyzing gray distribution features of railway region. This method firstly segments track regions using multiple thresholds which can be dynamically optimized based on the change of local accumulation histogram with the change of scenes. Then, on the basis of binary image, combined with connectivity and skeleton extraction, track feature points are automatically extracted from the position of the track starting point. A suitable curve model is chosen to construct the railway equation. The proposed method is able to achieve accurate recognition of railway in different scenes.
A Novel Method of Object Detection from a Moving Camera Based on Image Matching and Frame Coupling.

Yong Chen,Rong Hua Zhang,Lei Shang

DOI: https://doi.org/10.1371/journal.pone.0109809

IF: 3.7

2014-01-01

PLoS ONE

Abstract:A new method based on image matching and frame coupling to handle the problems of object detection caused by a moving camera and object motion is presented in this paper. First, feature points are extracted from each frame. Then, motion parameters can be obtained. Sub-images are extracted from the corresponding frame via these motion parameters. Furthermore, a novel searching method for potential orientations improves efficiency and accuracy. Finally, a method based on frame coupling is adopted, which improves the accuracy of object detection. The results demonstrate the effectiveness and feasibility of our proposed method for a moving object with changing posture and with a moving camera.
MotionTrack: Learning Motion Predictor for Multiple Object Tracking

Changcheng Xiao,Qiong Cao,Yujie Zhong,Long Lan,Xiang Zhang,Zhigang Luo,Dacheng Tao

2024-03-11

Abstract:Significant progress has been achieved in multi-object tracking (MOT) through the evolution of detection and re-identification (ReID) techniques. Despite these advancements, accurately tracking objects in scenarios with homogeneous appearance and heterogeneous motion remains a challenge. This challenge arises from two main factors: the insufficient discriminability of ReID features and the predominant utilization of linear motion models in MOT. In this context, we introduce a novel motion-based tracker, MotionTrack, centered around a learnable motion predictor that relies solely on object trajectory information. This predictor comprehensively integrates two levels of granularity in motion features to enhance the modeling of temporal dynamics and facilitate precise future motion prediction for individual objects. Specifically, the proposed approach adopts a self-attention mechanism to capture token-level information and a Dynamic MLP layer to model channel-level features. MotionTrack is a simple, online tracking approach. Our experimental results demonstrate that MotionTrack yields state-of-the-art performance on datasets such as Dancetrack and SportsMOT, characterized by highly complex object motion.

Computer Vision and Pattern Recognition
A Topology Guided Method for Rail-Track Detection

Songyue Yang,Guizhen Yu,Zhangyu Wang,Bin Zhou,Peng Chen,Qiang Zhang

DOI: https://doi.org/10.1109/tvt.2021.3133327

IF: 6.8

2022-02-01

IEEE Transactions on Vehicular Technology

Abstract:Rail-track detection is a core function for automated rail transit perception. However, existing methods cannot effectively detect the rail-tracks in a complex environment, especially in turnout scenarios. In this study, we propose a topology guided method to detect rail-tracks which includes the following four parts: Firstly, a neural network is used to obtain the pixels of the rail-lanes, and the geometric relationship between rail-lanes is mined by inverse perspective transformation. Secondly, the rail-lanes pixels are converted to rail-lanes key points and the topological relationship between the key points. Thirdly, the rail-lanes are reconnected through topological relationships between key points. Finally, the rail-track geometry features are used to match the rail-lanes. Experimental results show that the rail-track level F1 score of the proposed method reached 91.62, which is state-of-the-art (SOTA) in this field. Furthermore, the proposed method has been tested and applied on the Hong Kong Metro Tsuen Wan Line.

telecommunications,engineering, electrical & electronic,transportation science & technology

Movement tracking for train using synchronic detection line

A New Detection and Tracking Algorithm for Moving Objects

Object Tracking Method Based on Incrementally Updating Linear Discriminant Subspace

A novel Algorithm for background updating of rail scenery images using SDL method

Robust Visual Tracking Via CAMShift and Structural Local Sparse Appearance Model

A Real-Time Method for Railway Track Detection and 3D Fitting Based on Camera and LiDAR Fusion Sensing

Novel Multistate Fault Diagnosis and Location Method for Key Components of High-Speed Trains.

Rail Detection Based on LSD and the Least Square Curve Fitting

Moving People Tracking with Detection by Latent Semantic Analysis for Visual Surveillance Applications

A New Tracking Technique: Object Tracking And Identification From Motion

2-D Model Based Tracking of Human Motion

Railroad track detection in coal mine based on the piecewise linear model

Ultra-Fast Adaptive Track Detection Network

A Hybrid Deep Learning Based Framework for Component Defect Detection of Moving Trains

Research on the Method of Foreign Object Detection for Railway Tracks Based on Deep Learning

REAL-TIME HUMAN TRACKING BASED ON SWITCHING LINEAR DYNAMIC SYSTEM COMBINED WITH ADAPTIVE MEANSHIFT TRACKER

Track-monitoring from the Dynamic Response of an Operational Train

Video-based Adaptive Railway Recognition in Complex Scene

A Novel Method of Object Detection from a Moving Camera Based on Image Matching and Frame Coupling.

MotionTrack: Learning Motion Predictor for Multiple Object Tracking

A Topology Guided Method for Rail-Track Detection