Abstract:The increasing need to develop renewable energy sources to combat climate change has led to a significant rise in demand for photovoltaic (PV) installations. Consequently, accurately detecting and estimating the capacity and potential for electricity generation of these installed PV systems has become crucial for effective energy management. However, due to the limitation of localized mechanism in convolution operations, traditional FCN-based methods face challenges in capturing global dependencies among remote sensing image patches. As a result, they struggle to model long-range interactions between different PV panels with diverse structures, including varying size, shape, and texture, particularly in distributed residential areas. To tackle the challenge of modeling PV panels with diverse structures, we propose a coupled U-Net and Vision Transformer model named TransPV for refining PV semantic segmentation. Specifically, Mix Transformer block is incorporated in the encoder to enhance the modeling of global context, while the U-Shaped structure enables the combination of multi-level features, resulting in enriched feature representation, which helps the model better understand objects in the images, regardless of their shape, size, and texture. In addition, we implement the PointRend module in the decoder to obtain finer segmentation boundary details, and utilize a novel refiner loss function during the training process to alleviate the problem of extremely unbalanced samples. The experimental results from the Heilbronn datasets demonstrate the remarkable performance of our proposed TransPV model in addressing intra-class diversity of PV structures, surpassing previous state-of-the-art methods with an impressive IoU and accuracy of 0.802 and 0.876, respectively. Furthermore, our model exhibits high generalization capability on the BDPV dataset with IoU of 0.745. The obtained results highlight the superiority of TransPV in improving accuracy and addressing diverse structure issues in PV segmentation, which provides valuable insights for optimizing the efficiency and sustainability of renewable energy.

Understanding rooftop PV panel semantic segmentation of satellite and aerial images for better using machine learning

Two-stage Infrared Images Photovoltaic Panel Extraction Based on Deep Semantic Segmentation.

Combined multi-level context aggregation and attention mechanism method for photovoltaic panel extraction from high resolution remote sensing images

Enhancing PV panel segmentation in remote sensing images with constraint refinement modules

Deep Learning-based Method for PV Panels Segmentation and Defects Detection with Infrared Images

Deeplab V3+ Based Segmentation Method for PV Panels with Aerial Orthoimages

Accurate and generalizable photovoltaic panel segmentation using deep learning for imbalanced datasets

Rooftop PV Segmenter: A Size-Aware Network for Segmenting Rooftop Photovoltaic Systems from High-Resolution Imagery

Generalized deep learning model for photovoltaic module segmentation from satellite and aerial imagery

Mask R-CNN Based Segmentation Method for Satellite Imagery of Photovoltaics Generation Systems

Weakly-semi supervised extraction of rooftop photovoltaics from high-resolution images based on segment anything model and class activation map

A novel weakly-supervised method based on the segment anything model for seamless transition from classification to segmentation: A case study in segmenting latent photovoltaic locations

Combined Hybrid Neural Networks and Swarm Intelligence Optimization Algorithms for Photovoltaic Panel Segmentation From Remote Sensing Images

Multi-resolution dataset for photovoltaic panel segmentation from satellite and aerial imagery

TransPV: Refining Photovoltaic Panel Detection Accuracy Through a Vision Transformer-Based Deep Learning Model

Extracting Photovoltaic Panels From Heterogeneous Remote Sensing Images With Spatial and Spectral Differences

Research on Self-Supervised Building Information Extraction with High-Resolution Remote Sensing Images for Photovoltaic Potential Evaluation

Water photovoltaic plant contaminant identification using visible light images

Deep solar PV refiner: A detail-oriented deep learning network for refined segmentation of photovoltaic areas from satellite imagery

Advances and prospects on estimating solar photovoltaic installation capacity and potential based on satellite and aerial images

Recognition and location of solar panels based on machine vision