Abstract:"Autonomous vehicles (AV)" are not a new concept. They have been proposed for the long-term goal of having vehicles driving autonomously in an unknown environment for the purpose of human safety, convenience, and ease of life; both in civilian and military applications. In day-to-day life, humans take such navigational capabilities for granted. The human brain achieves all this simultaneously using mostly the sense of vision. That being one of the strong motivation behind vision based control, it is also desirable to use computer vision systems to achieve low cost, low maintenance autonomous vehicle navigation. Recent results from vision research suggest that visual control may now be feasible and will be a major step in conversion of the sensor system required for autonomous guidance to a vision-based one. In this dissertation, we begin the development of the component capabilities in Computer Vision, for autonomous road navigation for the long-term goal of having autonomous vehicles driving in an unknown environment. This dissertation limits itself to the monocular vision component of sensing and navigation control, and treats the path planning components superficially. Unlike other approaches in literature, this research work presents to achieve a complete vision based autonomous vehicle control reducing the drastic dependency on other sensors. Proposed is a vision solution based on accumulator based parametric transforms to detect navigable regions in the urban environment. The novel accumulator voting scheme is called "Parametric Transform for Lanes (PTL)," which enables detection of multiple lanes and variations of lanes such as exits and intersections possible concurrently. Other than being robust to shadows, invariant to color, width and texture of the road, this PTL is based on a control-motivated philosophy. Thus, this dissertation proposes a novel total image-based control solution to the autonomous vehicle control problem, called "Predictive Control in Image Plane (PCIP)." PTL and PCIP together inherently support control for multiple operations; such as lane following, lane changing, turning at intersections, etc. Thus, the proposed predictive control not only reduces the control complexity but also increases the application space for vehicle control. Research work is also extended to other visual components of autonomous driving such as sign detection, car detection, light detection, cross-walk detection etc. A novel clustering method is proposed for car backlight detection, as well as cross-walk detection. The dissertation explains a complete architecture for the autonomous urban driving and talks about integrating all these modules to achieve smooth control of the AV.

Design and Implementation of a Vision-Based Vehicle Control System for Operational Commands via Human Keypoints Recognition

Development of a Human-Robot Hybrid Intelligent System Based on Brain Teleoperation and Deep Learning SLAM

Intelligent Wheelchair Control System Based on Vision Navigation

Efficient Perception, Planning, and Control Algorithm for Vision-Based Automated Vehicles

Motion Control System Design of a Humanoid Robot Based on Stereo Vision

Remote Control System Based on the Internet and Machine Vision for Tracked Vehicles

On-Board Vision-Language Models for Personalized Autonomous Vehicle Motion Control: System Design and Real-World Validation

Embedded and Real-Time Vehicle Detection System for Challenging On-Road Scenes

Vision-Based Detection, Decision and Control for Autonomous Vehicles in AD Chauffeur

Vision Based Control for Autonomous Vehicle Navigation

Path Planning and Control Algorithm for Intelligent Vehicles under Semi-Structured Road Condition

Vision Based Obstacle Detection and Navigation of an Autonomous Vehicle

Visual Detection and Deep Reinforcement Learning-Based Car Following and Energy Management for Hybrid Electric Vehicles

A Brain-Controlled Vehicle System Based on Steady State Visual Evoked Potentials

Humanlike Driving: Empirical Decision-Making System for Autonomous Vehicles

Face recognition and real-time tracking system based on convolutional neural network and parallel-cascade PID controller

Vision-Based Hand Gesture Recognition for Human-Vehicle Interaction

Attitude Control System of Driverless Vehicle Based on Vision Navigation

A Human-Vehicle Collaborative Simulated Driving System Based on Hybrid Brain-Computer Interfaces and Computer Vision.

The Design of Vision-Based Vechicle