Abstract:The increasing need to develop renewable energy sources to combat climate change has led to a significant rise in demand for photovoltaic (PV) installations. Consequently, accurately detecting and estimating the capacity and potential for electricity generation of these installed PV systems has become crucial for effective energy management. However, due to the limitation of localized mechanism in convolution operations, traditional FCN-based methods face challenges in capturing global dependencies among remote sensing image patches. As a result, they struggle to model long-range interactions between different PV panels with diverse structures, including varying size, shape, and texture, particularly in distributed residential areas. To tackle the challenge of modeling PV panels with diverse structures, we propose a coupled U-Net and Vision Transformer model named TransPV for refining PV semantic segmentation. Specifically, Mix Transformer block is incorporated in the encoder to enhance the modeling of global context, while the U-Shaped structure enables the combination of multi-level features, resulting in enriched feature representation, which helps the model better understand objects in the images, regardless of their shape, size, and texture. In addition, we implement the PointRend module in the decoder to obtain finer segmentation boundary details, and utilize a novel refiner loss function during the training process to alleviate the problem of extremely unbalanced samples. The experimental results from the Heilbronn datasets demonstrate the remarkable performance of our proposed TransPV model in addressing intra-class diversity of PV structures, surpassing previous state-of-the-art methods with an impressive IoU and accuracy of 0.802 and 0.876, respectively. Furthermore, our model exhibits high generalization capability on the BDPV dataset with IoU of 0.745. The obtained results highlight the superiority of TransPV in improving accuracy and addressing diverse structure issues in PV segmentation, which provides valuable insights for optimizing the efficiency and sustainability of renewable energy.

Efficient Region Segmentation of PV Module in Infrared Imagery using Segnet

Deep Learning-based Method for PV Panels Segmentation and Defects Detection with Infrared Images

Two-stage Infrared Images Photovoltaic Panel Extraction Based on Deep Semantic Segmentation.

Deeplab V3+ Based Segmentation Method for PV Panels with Aerial Orthoimages

Generalized deep learning model for photovoltaic module segmentation from satellite and aerial imagery

Mask R-CNN Based Segmentation Method for Satellite Imagery of Photovoltaics Generation Systems

A Hot Spot Detection Method of Photovoltaic Module Based on Image Semantic Segmentation

Accurate and generalizable photovoltaic panel segmentation using deep learning for imbalanced datasets

Combined Hybrid Neural Networks and Swarm Intelligence Optimization Algorithms for Photovoltaic Panel Segmentation From Remote Sensing Images

Infrared Image Segmentation for Photovoltaic Panels Based on Res-UNet

Deep solar PV refiner: A detail-oriented deep learning network for refined segmentation of photovoltaic areas from satellite imagery

Application of a semantic segmentation convolutional neural network for accurate automatic detection and mapping of solar photovoltaic arrays in aerial imagery

TransPV: Refining Photovoltaic Panel Detection Accuracy Through a Vision Transformer-Based Deep Learning Model

Combined multi-level context aggregation and attention mechanism method for photovoltaic panel extraction from high resolution remote sensing images

Rooftop PV Segmenter: A Size-Aware Network for Segmenting Rooftop Photovoltaic Systems from High-Resolution Imagery

Research on Self-Supervised Building Information Extraction with High-Resolution Remote Sensing Images for Photovoltaic Potential Evaluation

Enhancing PV panel segmentation in remote sensing images with constraint refinement modules

Detection of Malfunctioning Modules in Photovoltaic Power Plants using Unsupervised Feature Clustering Segmentation Algorithm

Extracting Photovoltaic Panels From Heterogeneous Remote Sensing Images With Spatial and Spectral Differences

Automatic hot spot detection method for photovoltaic aerial infrared image

A novel framework on intelligent detection for module defects of PV plant combining the visible and infrared images