Force Measurement Technology of Vision-Based Tactile Sensor
Bin Fang,Jie Zhao,Nailong Liu,Yuhao Sun,Shixin Zhang,Fuchun Sun,Jianhua Shan,Yiyong Yang
DOI: https://doi.org/10.1002/aisy.202400290
IF: 7.298
2024-01-01
Advanced Intelligent Systems
Abstract:Marker-type vision-based tactile sensors (VTS) realize force sensing by calibrating marker vector information. The tactile visualization can provide high-precision and multimodal force information to promote robotic dexterous manipulation development. Considering VTS's contribution to force measurement, this article reviews the advanced force measurement technologies of VTSs. First, the working principle of marker-type VTSs is introduced, including single-layer markers, double-layer markers, color coding, and optical flow. Then, the relationship between the marker type and the category of force measurement is discussed in detail. On this basis, the process of marker feature extraction is summarized, including image processing and marker-matching technologies. According to the learning approach, force measurement methods are classified into physical and deep learning models. Further, branches of each method are analyzed in terms of input types. Combined with measuring range and precision, the correlation of sensor design, materials, and recognition methods to force measurement performance is further discussed. Finally, the difficulties and challenges are analyzed, and future developments are proposed. This review aims to deepen understanding of the research progress and applications and provide a reference for the research community to promote technology generations in related fields. Force sensing is an important function of marker-type vision-based tactile sensors. This review focuses on force measurement technologies based on visuotactile sensing from sensing principle, marker layer design, information process, and measurement precision, intending to provide a reference for the research community in marker layer design optimization, high-quality force feature extraction, and robot's operating tasks.image (c) 2024 WILEY-VCH GmbH