Abstract:The impact of soiling on solar panels is an important and well-studied problem in renewable energy sector. In this paper, we present the first convolutional neural network (CNN) based approach for solar panel soiling and defect analysis. Our approach takes an RGB image of solar panel and environmental factors as inputs to predict power loss, soiling localization, and soiling type. In computer vision, localization is a complex task which typically requires manually labeled training data such as bounding boxes or segmentation masks. Our proposed approach consists of specialized four stages which completely avoids localization ground truth and only needs panel images with power loss labels for training. The region of impact area obtained from the predicted localization masks are classified into soiling types using the webly supervised learning. For improving localization capabilities of CNNs, we introduce a novel bi-directional input-aware fusion (BiDIAF) block that reinforces the input at different levels of CNN to learn input-specific feature maps. Our empirical study shows that BiDIAF improves the power loss prediction accuracy by about 3% and localization accuracy by about 4%. Our end-to-end model yields further improvement of about 24% on localization when learned in a weakly supervised manner. Our approach is generalizable and showed promising results on web crawled solar panel images. Our system has a frame rate of 22 fps (including all steps) on a NVIDIA TitanX GPU. Additionally, we collected first of it's kind dataset for solar panel image analysis consisting 45,000+ images.

DeepSolarEye: Power Loss Prediction and Weakly Supervised Soiling Localization via Fully Convolutional Networks for Solar Panels

CNN-based Deep Learning Approach for Micro-crack Detection of Solar Panels

Deep Learning-based Method for PV Panels Segmentation and Defects Detection with Infrared Images

Pseudo Supervised Solar Panel Mapping based on Deep Convolutional Networks with Label Correction Strategy in Aerial Images

Solar Power Plant Detection on Multi-Spectral Satellite Imagery using Weakly-Supervised CNN with Feedback Features and m-PCNN Fusion

Photovoltaic Cell Defect Detection Based on Weakly Supervised Learning With Module-Level Annotations

Solar Cells Surface Defects Detection Based on Deep Learning

Environmental Fault Diagnosis of Solar Panels Using Solar Thermal Images in Multiple Convolutional Neural Networks

A Fault Detection Scheme Utilizing Convolutional Neural Network for PV Solar Panels with High Accuracy

SolNet: A Convolutional Neural Network for Detecting Dust on Solar Panels

Fault Detection and Diagnosis of a Photovoltaic System Based on Deep Learning Using the Combination of a Convolutional Neural Network (CNN) and Bidirectional Gated Recurrent Unit (Bi-GRU)

Region-Based CNN for Anomaly Detection in PV Power Plants Using Aerial Imagery

Solar Cell Surface Defect Inspection Based on Multispectral Convolutional Neural Network

Deep Edge-Based Fault Detection for Solar Panels

SoilingEdge: PV Soiling Power Loss Estimation at the Edge Using Surveillance Cameras

Detection of solar panel defects based on separable convolution and convolutional block attention module

Photovoltaics Plant Fault Detection Using Deep Learning Techniques

CNN based automatic detection of photovoltaic cell defects in electroluminescence images

SoildNet: Soiling Degradation Detection in Autonomous Driving

Deep-Learning-Based Probabilistic Estimation of Solar PV Soiling Loss

Deep-Learning-Based Automatic Detection of Photovoltaic Cell Defects in Electroluminescence Images