A Robust Pointer Meter Reading Recognition Method Based on TransUNet and Perspective Transformation Correction

Liufan Tan,Wanneng Wu,Jinxin Ding,Weihao Ye,Cheng Li,Qiaokang Liang

DOI: https://doi.org/10.3390/electronics13132436

IF: 2.9

2024-06-22

Electronics

Abstract:The automatic reading recognition of pointer meters plays a crucial role in data monitoring and analysis in intelligent substations. Existing meter reading methods struggle to address challenging difficulties such as image distortion and varying illumination. To enhance their robustness and accuracy, this study proposes a novel approach that leverages the TransUNet semantic segmentation model and a perspective transformation correction method. Initially, the dial of the pointer meter is localized from the natural background using YOLOv8. Subsequently, after enhancing the image with Gamma correction technology, the scale lines and the pointer within the dial are extracted using the TransUNet model. The distorted or rotated dial can then be corrected through perspective transformation. Finally, the meter readings are accurately obtained by the Weighted Angle Method (WAM). Ablative and comparative experiments on two self-collected datasets clearly verify the effectiveness of the proposed method, with a reading accuracy of 97.81% on Simple-MeterData and 93.39% on Complex-MeterData, respectively.

engineering, electrical & electronic,computer science, information systems,physics, applied

What problem does this paper attempt to address?

### Problems the Paper Aims to Solve

This paper aims to address the challenges faced by substation inspection robots in automatically reading analog meter readings. Specifically, existing methods are inadequate in handling complex conditions such as image distortion and lighting variations. Therefore, this paper proposes a method based on the TransUNet semantic segmentation model and perspective transformation correction to enhance the robustness and accuracy of analog meter reading recognition.

#### Main Issues:
1. **Image Distortion**: Due to limited shooting angles, images may become distorted.
2. **Lighting Variations**: Unpredictable outdoor weather conditions lead to lighting changes that affect image quality.
3. **Pointer Shadow Interference**: Existing methods perform poorly in segmenting the pointer area under complex lighting conditions.
4. **Rotation Correction Difficulty**: Images taken at inclined angles may result in rotation, and existing methods struggle to correct this effectively.

By introducing an additional dial correction stage, this method can correct the image after extracting dial information and before reading recognition, thereby improving reading accuracy. Experimental results show that this method can achieve high reading accuracy on two self-collected datasets (97.81% on Simple-MeterData and 93.39% on Complex-MeterData).