Abstract:The observability of the scale direction in visual–inertial odometry (VIO) under degenerate motions of intelligent and connected vehicles can be improved by fusing Ackermann error state measurements. However, the relative kinematic error measurement model assumes that the vehicle velocity is constant between two consecutive camera states, which degrades the positioning accuracy. To address this problem, a consistent monocular Ackermann VIO, termed MAVIO, is proposed to combine the vehicle velocity and yaw angular rate error measurements, taking into account the lever arm effect between the vehicle and inertial measurement unit (IMU) coordinates with a tightly coupled filter-based mechanism. The lever arm effect is firstly introduced to improve the reliability for information exchange between the vehicle and IMU coordinates. Then, the process model and monocular visual measurement model are presented. Subsequently, the vehicle velocity and yaw angular rate error measurements are directly used to refine the estimator after visual observation. To obtain a global position for the vehicle, the raw Global Navigation Satellite System (GNSS) error measurement model, termed MAVIO-GNSS, is introduced to further improve the performance of MAVIO. The observability, consistency and positioning accuracy were comprehensively compared using real-world datasets. The experimental results demonstrated that MAVIO not only improved the observability of the VIO scale direction under the degenerate motions of ground vehicles, but also resolved the inconsistency problem of the relative kinematic error measurement model of the vehicle to further improve the positioning accuracy. Moreover, MAVIO-GNSS further improved the vehicle positioning accuracy under a long-distance driving state. The source code is publicly available for the benefit of the robotics community.

VAVM: A Flexible Technique for Variable-Angle Around View Monitor System Towards Articulated Engineering Vehicle.

PALVO: Visual Odometry Based on Panoramic Annular Lens.

3-D Surround View for Advanced Driver Assistance Systems.

An adaptive ball-head positioning visual servoing method for aircraft digital assembly

A Method of Video Analysis in Vehicle Based on A Single Pal Camera

Unconstrained Self-Calibration of Stereo Camera on Visually Impaired Assistance Devices.

MIVAS: A Multi-Modal Immersive Virtual Assembly System

Multitarget Adaptive Virtual Fixture Based on Task Learning for Hydraulic Manipulator

An Architecture for Application-Specific Visualization Environment(ASVE)

Object ground lines regression and mapping from fisheye images to around view image for the AVP

Consistent Monocular Ackermann Visual–Inertial Odometry for Intelligent and Connected Vehicle Localization

Around View Monitoring System for Hydraulic Excavators

Vehicle-in-Virtual-Environment Method for ADAS and Connected and Automated Driving Function Development/Demonstration/Evaluation

Self-calibration and visual SLAM with a multi-camera system on a micro aerial vehicle

ViLiVO: Virtual LiDAR-Visual Odometry for an Autonomous Vehicle with a Multi-Camera System

AVM-SLAM: Semantic Visual SLAM with Multi-Sensor Fusion in a Bird's Eye View for Automated Valet Parking

Multi-camera visual SLAM for autonomous navigation of micro aerial vehicles

Monocular Camera Mapping with Pose-Guided Optimization: Enhancing Marking-Level HD Map Accuracy

MAVI: A Research Platform for Telepresence and Teleoperation

Accurate Visual Simultaneous Localization and Mapping (SLAM) against Around View Monitor (AVM) Distortion Error Using Weighted Generalized Iterative Closest Point (GICP)

Development and Calibration of Acoustic Video Camera System for Moving Vehicles