A Study of Machine Vision-Based Lane Departure Warning System

YI Qiang,QIN Wen-hu

DOI: https://doi.org/10.3969/j.issn.1671-1041.2007.05.003

2007-01-01

Abstract:This paper presents a machine vision-based lane departure warning system,describes its hardware based on CPCI bus in details,Real-time vision-based detection of lane edge is studied,and put forwards a valid detecting algorithm of lane.

What problem does this paper attempt to address?

A Vision-based Lane Departure Warning Framework

Jiaju Wu,Pengshuai Yin,Xin Shu,Huichou Huang,Fei Liu,Qingyao Wu

DOI: https://doi.org/10.1109/icebe52470.2021.00029

2021-11-01

Abstract:Lane departure warning is an essential function of driver assistance systems. In this paper, we propose a vision-based lane departure warning framework, which can determine whether the vehicle deviates from the lane only with images as input. Our framework combines the deep learning method and traditional line detection algorithm. Specifically, the framework consists of a Lane Boundaries Localization module, a Lane Boundaries Generator module, and a Departure Warning module. The Lane Boundaries Localization module is a deep neural network for finding the area containing lane Boundaries. Then the Lane Boundaries Generator module performs backbone detection and line detection to generate lane boundaries on the located area. After identifying the lane boundaries, the Departure Warning module can quickly determine whether the vehicle deviates from the lane. Additionally, we implemented and deployed our framework to an Android platform and tested its running speed.
A Novel Lane Detection Algorithm Based on Support Vector Machine

Hao Zhang,Dibo Hou,Zekui Zhou

DOI: https://doi.org/10.2529/piers050108144912

2005-01-01

PIERS Online

Abstract:In this paper, a new lane detection algorithm based on support vector machine (SVM) is presented. This algorithm can overcome the flaws when applying traditional lane algorithms which are only applicable to some special situations. The main steps of this algorithm: road surface extraction by using SVM pattern recognition, image morphology operation, transforming the image into a bird-view image by using the relationship of image coordinate system (ICS) and world coordinate system (WCS), getting the center points from the road’s midline, regressing the road shape function by using SVM. Relative to the traditional laser-based sensors and millimeterwave radar which are classified as active sensors, vision-based passive sensor has an advantage that it acquires data in a noninvasive mode and will not alter the environment.
A Lane Departure Warning System with Line-Based Image Processing

Shichun Yi,Keqiang Li,Fangzhen Li,Qiang Zhang

DOI: https://doi.org/10.19562/j.chinasae.qcgc.2014.07.001

2014-01-01

Abstract:With a technique of line-based image processing, a lane mark recognition method and a low-cost lane departure warning system ( LDWS ) are proposed in this paper. Through line-by-line feature extraction and classification, the operation efficiency is enhanced with required memory reduced. On this basis, a low-cost LDWS is designed by using digital camera and 400MHz DSP chip. With no video decoding circuit and extended memory, the hardware complexity of the system is effectively reduced while ensuring a good recognition rate of lane marking. For evaluating the recognition performance of the system, a testing scheme suitable for embedded systems is pro-posed to fulfill a hardware-in-the-loop test on the recognition performance of LDWS based on offline made sample data. The results show that the system can achieve a good recognition rate in typical operating conditions with high stability and real-time performance.
Use of Image Processing in Lane Departure Warning System

Pratik Bhope,Pinakini Samant

DOI: https://doi.org/10.1109/i2ct.2018.8529819

2018-04-01

Abstract:Lane departure warning system is a method which assists a driver and also provides extreme care while car starts to move out of the lane by imparting adaptive cruise control which facilitates in detecting blind spot and providing significantly greater lane divergence warning using image processing. Multilevel fuzzy edge detection algorithm accomplishes improved efficiency and also provides exact detection of lane markings on roads even if there's fading of markings as years pass by. Precision of the device has been discovered to boost extremely by including a strategy that has been provided in this specific paper. It is different out of the conventional edge detection algorithm to identify the lane markings on streets and thereby aid the driver. This particular technique has created a refined and an accurate method which assists the driver with the aid of that type of lane departure warning system. Multitudinous parameters on the highways such as the dimensions of the lane markings, its distance and location from a specific reference point could be captured as well as recognized by several techniques making use of this algorithm which makes use of few image enhancement methodologies.
A Study on Lane Departure Detection Based on Edge Distribution Function

Liu Zhiqiang,Chen Yanbo,Ge Ruhai

DOI: https://doi.org/10.3321/j.issn:1000-680X.2007.07.021

2007-01-01

Abstract:A lane departure detection technique based on edge distribution function(EDF) is presented,in which edge information is used to define EDF,and it can be judged whether the vehicle deviates from the centre of the lane through the analysis on the variation in orientation of lane mark line on road image.By taking the advantage of the important shape features of the EDF-symmetric axis,the effect of the noise related to dynamic road scene is reduced,and the measurement of lane orientation is made possible without considering camera-related parameters,thus enhancing the adaptability to the random and dynamic environment of a road scene.
A Method of Lane Departure Identification Based on Roadside Multi-Sensor Fusion

Pengfei Liu,Guizhen Yu,Bin Zhou,Da Li,Zhangyu Wang

DOI: https://doi.org/10.1061/9780784482933.017

2020-01-01

Abstract:In order to reduce the lane departure accident caused by driver’s negligence, lane departure warning systems (LDWS) have become increasingly prevalent and important. Most proposed approaches mainly focus on how to detect lane markings by single-vehicle systems. However, due to limited detection range and processing ability, the robustness of single-vehicle systems is poor in complex traffic scenarios. Therefore, this paper proposes a method of lane departure identification based on roadside multi-sensor fusion. The time to lane crossing (TLC) is used to identify the lane departure. Compared with a single-vehicle system, the roadside equipment has stronger robustness in special scenarios. This approach also avoids the calculation resource consumption of single-vehicle systems caused by lane detection. The experiment verified that the vehicle detection rate of various scenes exceeded 98%, and the lane departure identification rate was 100%.
Vision-Based Ingenious Lane Departure Warning System for Autonomous Vehicles

Sudha Anbalagan,Ponnada Srividya,B. Thilaksurya,Sai Ganesh Senthivel,G. Suganeshwari,Gunasekaran Raja

DOI: https://doi.org/10.3390/su15043535

IF: 3.9

2023-02-16

Sustainability

Abstract:Lane detection is necessary for developing intelligent Autonomous Vehicles (AVs). Using vision-based lane detection is more cost-effective, requiring less operational power. Images captured by the moving vehicle include varying brightness, blur, and occlusion caused due to diverse locations. We propose a Vision-based Ingenious Lane Departure Warning System (VILDS) for AV to address these challenges. The Generative Adversarial Networks (GAN) of the VILDS choose the most precise features to create images that are identical to the original but have better clarity. The system also uses Long Short-Term Memory (LSTM) to learn the average behavior of the samples to forecast lanes based on a live feed of processed images, which predicts incomplete lanes and increases the reliability of the AV's trajectory. Further, we devise a strategy to improve the Lane Departure Warning System (LDWS) by determining the angle and direction of deviation to predict the AV's Lane crossover. An extensive evaluation of the proposed VILDS system demonstrated the effective working of the lane detection and departure warning system modules with an accuracy of 98.2% and 96.5%, respectively.

environmental sciences,environmental studies,green & sustainable science & technology
Real-time Structured Lane Detection by Monocular Vision

Zhong-chuang HU,Jie CHEN,Zhao-lun GU,Yun-tao QIAN

DOI: https://doi.org/10.16798/j.issn.1003-0530.2017.04.027

2017-01-01

Journal of Signal Processing

Abstract:Lane detection is an important part of advanced driver assistance systems.In this paper,we processed the video in real-time for achieving real-time detection of structured lane.Firstly we used horizontal Sobel operator for enhancing the edge in the area that we needed to process.And then we used LSD (Line Segment Detector) algorithm to extract lines set,which included the representative of the lane markings.The line angle and relative position were used to filter line set,and combined with the number of stable frame to select the best candidate of lane markings.
Lane Detection and Lane Departure Warning System

DOI: https://doi.org/10.30534/ijatcse/2021/1021032021

2021-06-16

International Journal of Advanced Trends in Computer Science and Engineering

Abstract:Lane detection is important for autonomous vehicles. For this reason, many approaches use lane boundary information to locate the vehicle inside the street, or to integrate GPS-based localization. Advanced driverassistance systems are developed to assist drivers in the driving process reducing road accidents. In this work, we present an end-to-end system for lane identification, clustering and classification, based on two cascaded neural networks, that runs in real-time. The first step is camera calibration which is used to remove the effect of lens distortion. Then a canny edge detection algorithm finds the edges of the images. Then the region of interest (ROI) is selected. The ROI is actually based on the rectangular shape appearing at the bottom of the image. ROI removes the unwanted region in the image. The potential lane markers are then determined using the Hough transform to analyze lane boundaries. Once the lane pixels are found, these pixels are continuously scanned to obtain the best linear regression analysis.It is qualified to be applied on highways and urban roadways. It also has been successfully verified in sunny, and rainy conditions for both day and night.

English Else
A robust, real-time and calibration-free lane departure warning system

Islam Gamal,Abdulrahman Badawy,Awab M.W. Al-Habal,Mohammed E.K. Adawy,Keroles K. Khalil,Magdy A. El-Moursy,Ahmed Khattab

DOI: https://doi.org/10.1016/j.micpro.2019.102874

IF: 3.503

2019-11-01

Microprocessors and Microsystems

Abstract:<p>A real-time and calibration-free lane departure warning system algorithm is proposed. The pre-processing stage of the lane departure algorithm is carried out using Gaussian pyramid to smooth the image and reduce its dimensions, which decrease the unnecessary details in the image. A lane detection stage is then developed based on Edge Drawing Lines (EDLines) algorithm that is a real-time line segment detector, which has false detection control. The reference-counting technique is used to track the lane boundaries and predict the missing ones. Experimental results show that the proposed algorithm has accuracy of 99.36% and average processing time of 80 fps (frame per second). The proposed algorithm is efficient to be used in the self-driving systems in the Original Equipment Manufacturers (OEMs) cars.</p>

computer science, theory & methods,engineering, electrical & electronic, hardware & architecture
Study on Urban Expressway Lane Mark Detection in Special Conditions

Xinsheng He,Shishi Wang,Zhiyong Cai,Dongyun Wang

DOI: https://doi.org/10.4028/www.scientific.net/amr.305.164

2011-01-01

Advanced Materials Research

Abstract:Detection algorithm of lane line under the special condition is based on focal and difficult point of lane line departure warning system of computer vision. This article firstly deals with the image compression and grayscale, establishes reasonable region of interest, and remove the non-road information in the image; Then we proceed the probabilistic and statistical computing for the image pixels, draw the gray level histogram. By analyzing the dynamic gray level histogram, we identify the lane line and grey value of the road and automatically calculate the reasonable threshold to binarizate then denoise the images. Last we label the images to reach the goal of identification of lane line and establishment the space between lane line and vehicles. The test results show that: the algorithm mentioned in this paper can not only detect the lane line accurately in real time, but also it enjoys a wide range of applicability to provide reference for improvement of lane line departure warning system.
Advances in Vision-Based Lane Detection: Algorithms, Integration, Assessment, and Perspectives on ACP-Based Parallel Vision

Yang Xing,Chen Lv,Long Chen,Huaji Wang,Hong Wang,Dongpu Cao,Efstathios Velenis,Fei-Yue Wang

DOI: https://doi.org/10.1109/JAS.2018.7511063

2018-01-01

IEEE/CAA Journal of Automatica Sinica

Abstract:Lane detection is a fundamental aspect of most current advanced driver assistance systems (ADASs). A large number of existing results focus on the study of vision-based lane detection methods due to the extensive knowledge background and the low-cost of camera devices. In this paper, previous vision-based lane detection studies are reviewed in terms of three aspects, which are lane detection algor...
Vision-Based Lane-Changing Behavior Detection Using Deep Residual Neural Network

Zhensong Wei,Chao Wang,Peng Hao,Matthew Barth

DOI: https://doi.org/10.48550/arXiv.1911.03565

2019-11-08

Computer Vision and Pattern Recognition

Abstract:Accurate lane localization and lane change detection are crucial in advanced driver assistance systems and autonomous driving systems for safer and more efficient trajectory planning. Conventional localization devices such as Global Positioning System only provide road-level resolution for car navigation, which is incompetent to assist in lane-level decision making. The state of art technique for lane localization is to use Light Detection and Ranging sensors to correct the global localization error and achieve centimeter-level accuracy, but the real-time implementation and popularization for LiDAR is still limited by its computational burden and current cost. As a cost-effective alternative, vision-based lane change detection has been highly regarded for affordable autonomous vehicles to support lane-level localization. A deep learning-based computer vision system is developed to detect the lane change behavior using the images captured by a front-view camera mounted on the vehicle and data from the inertial measurement unit for highway driving. Testing results on real-world driving data have shown that the proposed method is robust with real-time working ability and could achieve around 87% lane change detection accuracy. Compared to the average human reaction to visual stimuli, the proposed computer vision system works 9 times faster, which makes it capable of helping make life-saving decisions in time.
Detection and recognition method of monocular vision traffic safety information for intelligent vehicles

Zhi Jin,Dong-Yuan Ge

DOI: https://doi.org/10.3233/jifs-179987

2020-10-21

Abstract:Intelligent vehicle technology has become a research hot issue in recent ten years, the reason is that intelligent vehicles can not only be used as a flexible weapon platform in the military. And in life, it is also a system that provides convenience and security for people. For example, driverless cars and advanced driver assistance systems (ADAS). Information processing is the key to the degree of intelligence, and the detection and recognition of traffic safety information based on monocular vision is the core of information processing, it’s also the bottleneck problem. Because of the complexity and diversity of the environment have brought great challenges to this problem. In this paper, the existing lane detection methods in structured and semi-structured roads do not specifically consider the problem of weak line detection, two models are proposed. Fuzzy LDA enhancement model is used to enhance the contrast of lane area, another brightness contrast saliency model can be used for robust Lane extraction. Then, two models are applied to lane detection, a two-stage lane detection method is proposed and a blind area vehicle detection method is designed. Firstly, the vehicle area is roughly extracted based on road gray statistics, and then the typical vehicle features are screened finely. Finally, the extracted features and SVM classifiers are used to confirm the candidate regions. Experiments show that: The proposed method can detect the vehicle in the blind area very well and is insensitive to the shape distortion and size change of the vehicle.
Lane Departure Assessment via Enhanced Single Lane-Marking

Yiwei Luo,Ping Li,Gang Shi,Zuowei Liang,Lei Chen,Fengwei An

DOI: https://doi.org/10.3390/s22052024

IF: 3.9

2022-03-04

Sensors

Abstract:Vision-based Lane departure warning system (LDWS) has been widely used in modern vehicles to improve drivability and safety. In this paper, a novel LDWS with precise positioning is proposed. Calibration strategy is first presented through a 3D camera imaging model with only three parallel and equally spaced lines, where the three angles of rotation for the transformation from the camera coordinate system to the world coordinate system are deduced. Then camera height is calculated compared to the previous works using a measured one with potential errors. A criterion for lane departure warning with only one of the two lane-markings is proposed to estimate both yaw angle and distance between the lane-markings and the vehicle. Experiments show that calibration strategy can be easily set up and achieve an average of 98.95% accuracy on the lane departure assessment.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
Robust and real-time lane marking detection for embedded system

Guo Yueting,Zhang Yongjun,Liu Sha,Liu Jun,Zhao Yong

DOI: https://doi.org/10.1007/978-3-319-21969-1_20

2015-01-01

Abstract:Lane marking detection is part of most advanced driver assistance systems (ADAS) as an important component of computer vision. This paper presents a lane detection system based on a novel lane feature extraction approach. The robustness and real-time of algorithm enable different configurations of embedded solutions. The system is divided into three phases. Firstly, using the Prewitt operator we can get the rich useful details and using Shen Jun operator we can get step edge, on the other hand Shen Jun operator is the best filter to detect the symmetrical markings according to the maximum signal noise ratio (SNR) criterion. So we introduce the best compromise method between noise smoothing and edge locating that combining the Prewitt operator with Shen Jun operator to extract lane markings. Then a fast Hough transform based on image pyramid is applied to get the lane lines. The posterior algorithm of reasonably refining the Lane lines angle is introduced to correct to error caused by Hough transform. Finally, robust detection of vehicle’s departure warning is also discussed. Experiment results on real road will be presented to prove the robustness and effectiveness of the proposed lane detection algorithm. © Springer International Publishing Switzerland 2015.
Study on Intelligent Vehicle Anti-collision Forewarning Technology Based on Multi-information Detection

Zh-iqiang LIU,Peng WANG,Hong-mao QIN,Jing-jing ZHONG,Shi-liang SONG

DOI: https://doi.org/10.3969/j.issn.1003-3033.2010.01.026

2010-01-01

Abstract:Driving environment is very complicated, because of the multi-source information of the road, the relative distance with other vehicles or obstacles and driver's state, etc. To obtain more information about the driving, the state messages of the lane, relative distance and speed between the surrounding targets is identified by receiving information from the CCD camera in front of the car, and the driver's attention state information is identified by receiving information from the CCD camera inside, which could effectively reduce the leak detection alarm rate, the false alarm rate and alarm rate of redundancy by using the technology of multi-source information detection. The real-time detection of dangerous or potentially dangerous driving information is used to analyze and judge the driver's state through a constructed safety judgment rule, so as to acquire a reliable anti-collision warning, which is helpful to prevent vehicle collision and optimize the control of the relative distance, relative speed and reaction time. Meanwhile, it also sets a good foundation for the speeding, the increasing of traffic capacity and the realizing of automatic drive.
Lane-change Intention Prediction Using Eye-Tracking Technology: A Systematic Review

Yunxian Pan,Qinyu Zhang,Yifan Zhang,Xianliang Ge,Xiaoqing Gao,Shiyan Yang,Jie Xu

DOI: https://doi.org/10.1016/j.apergo.2022.103775

2022-01-01

Abstract:The aim of this study is to identify the best practices and future research directions for driver lane-change intention (DLCI) prediction using eye-tracking technologies based on a systematic literature review. We searched five academic literature databases and then conducted an in-depth review, structured coding, and analysis of 40 relevant articles. The literature on DLCI prediction is summarized in terms of input features, feature extraction and prediction time windows, labeling methods, and machine learning algorithms. The results show that eye tracking data features along with other data sources can be useful inputs for the prediction of DLCI. Major challenges in this line of research include determining the optimal time window for feature extraction and developing and evaluating the appropriate machine learning algorithm. Suggestions for future research and practice for DLCI prediction in intelligent vehicles are discussed.
Driving Behavior Analysis of Intelligent Vehicle System for Lane Detection Using Vision-Sensor

Deepak Kumar Dewangan,Satya Prakash Sahu

DOI: https://doi.org/10.1109/jsen.2020.3037340

IF: 4.3

2021-03-01

IEEE Sensors Journal

Abstract:Lane detection on the road is the most essential phase of existing advanced driver assistance systems (ADAS). In the current road scheme, the lanes are parallel tracks which are marked based on the different speed limit for the vehicles. Lane markings are defined as driving regions for the vehicles in order to avoid a collision. In an Intelligent Vehicle System (IVS), these markings are being identified by various massive computing techniques and sensor-based mechanisms like radar, LiDAR, and GPS and have high operational costs. However, vision-based detection methods are gaining popularity due to its low cost and better understanding capability of the scene. The proposed study follows computer vision and image processing techniques to examine and learn significant lane features. The approach demonstrates the practical and effective usage of the lane detection model (LDM). The LDM has been designed with a vehicle prototype using Raspberry Pi, which reveals the intelligent behavior against the detected lane lines. The model is less expensive and power-efficient, which confirms the operational capability of the proposed system under a heterogeneous environment.

engineering, electrical & electronic,instruments & instrumentation,physics, applied
Lane departure warning systems and lane line detection methods based on image processing and semantic segmentation: A review

Weiwei Chen,Weixing Wang,Kevin Wang,Zhaoying Li,Huan Li,Sheng Liu

DOI: https://doi.org/10.1016/j.jtte.2020.10.002

2020-12-01

Journal of Traffic and Transportation Engineering (English Edition)

Abstract:<p>Recently, the development and application of lane line departure warning systems have been in the market. For any of the systems, the key part of lane line tracking, lane line identification, or lane line departure warning is whether it can accurately and quickly detect lane lines. Since 1990s, they have been studied and implemented for the situations defined by the good viewing conditions and the clear lane markings on road. After then, the accuracy for particular situations, the robustness for a wide range of scenarios, time efficiency and integration into higher-order tasks define visual lane line detection and tracking as a continuing research subject. At present, these kinds of lane marking line detection methods based on machine vision and image processing can be divided into two categories: the traditional image processing and semantic segmentation (includes deep learning) methods. The former mainly involves feature-based and model-based steps, and which can be classified into similarity- and discontinuity-based ones; and the model-based step includes different parametric straight line, curve or pattern models. The semantic segmentation includes different machine learning, neural network and deep learning methods, which is the new trend for the research and application of lane line departure warning systems. This paper describes and analyzes the lane line departure warning systems, image processing algorithms and semantic segmentation methods for lane line detection.</p>

A Study of Machine Vision-Based Lane Departure Warning System

A Vision-based Lane Departure Warning Framework

A Novel Lane Detection Algorithm Based on Support Vector Machine

A Lane Departure Warning System with Line-Based Image Processing

Use of Image Processing in Lane Departure Warning System

A Study on Lane Departure Detection Based on Edge Distribution Function

A Method of Lane Departure Identification Based on Roadside Multi-Sensor Fusion

Vision-Based Ingenious Lane Departure Warning System for Autonomous Vehicles

Real-time Structured Lane Detection by Monocular Vision

Lane Detection and Lane Departure Warning System

A robust, real-time and calibration-free lane departure warning system

Study on Urban Expressway Lane Mark Detection in Special Conditions

Advances in Vision-Based Lane Detection: Algorithms, Integration, Assessment, and Perspectives on ACP-Based Parallel Vision

Vision-Based Lane-Changing Behavior Detection Using Deep Residual Neural Network

Detection and recognition method of monocular vision traffic safety information for intelligent vehicles

Lane Departure Assessment via Enhanced Single Lane-Marking

Robust and real-time lane marking detection for embedded system

Study on Intelligent Vehicle Anti-collision Forewarning Technology Based on Multi-information Detection

Lane-change Intention Prediction Using Eye-Tracking Technology: A Systematic Review

Driving Behavior Analysis of Intelligent Vehicle System for Lane Detection Using Vision-Sensor

Lane departure warning systems and lane line detection methods based on image processing and semantic segmentation: A review