Abstract:The emergence of abundant electricity time series (ETS) data provides ample opportunities for various applications in the power systems, including demand-side management, grid stability, and consumer behavior analysis. Deep learning models have advanced ETS modeling by effectively capturing sequence dependence. Nevertheless, learning a generic representation of ETS data for various applications remains challenging due to the inherently complex hierarchical structure of ETS data. Moreover, ETS data exhibits intricate temporal dependencies and is suscepti ble to the influence of exogenous variables. Furthermore, different instances exhibit diverse electricity consumption behavior. In this paper, we propose a foundation model PowerPM to model ETS data, providing a large-scale, off-the-shelf model for power systems. PowerPM consists of a temporal encoder and a hierarchical encoder. The temporal encoder captures both temporal dependencies in ETS data, considering exogenous variables. The hierarchical encoder models the correlation between hierarchy. Furthermore, PowerPM leverages a novel self-supervised pretraining framework consisting of masked ETS modeling and dual-view contrastive learning, which enable PowerPM to capture temporal dependency within ETS windows and aware the discrepancy across ETS windows, providing two different perspectives to learn generic representation. Our experiments involve five real world scenario datasets, comprising private and public data. Through pre-training on massive ETS data, PowerPM achieves SOTA performance on diverse downstream tasks within the private dataset. Impressively, when transferred to the public datasets, PowerPM maintains its superiority, showcasing its remarkable generalization ability across various tasks and domains. Moreover, ablation studies, few-shot experiments provide additional evidence of the effectiveness of our model.

High-dimensional Feature Selection for Power System Congestion Event Prognosis with Enhanced Evolutionary Computation

Transmission System Resilience Enhancement with Extended Steady-state Security Region in Consideration of Uncertain Topology Changes

Sequential Feature Selection for Power System Event Classification Utilizing Wide-Area PMU Data

A Causality Based Feature Selection Approach for Data-Driven Dynamic Security Assessment

Two-Stage Short-Term Power Load Forecasting Based on RFECV Feature Selection Algorithm and a TCN–ECA–LSTM Neural Network

A Two-Stage Feature Selection Method For Power System Transient Stability Status Prediction

Feature selection for transient stability assessment based on kernelized fuzzy rough sets and memetic algorithm

A Holistic Feature Selection Method for Enhanced Short-Term Load Forecasting of Power System

A novel multivariate combined power load forecasting system based on feature selection and multi-objective intelligent optimization

Ensemble Learning for Power Systems TTC Prediction with Wind Farms

Collaborative Optimization Framework for Coupled Power and Transportation Energy Systems Incorporating Integrated Demand Responses and Electric Vehicle Battery State-of-Charge

Feature-Enhanced Deep Learning Method for Electric Vehicle Charging Demand Probabilistic Forecasting of Charging Station

Enhanced Cross Entropy Method for Composite Power System Reliability Evaluation

Distributed Feature Selection for Power System Dynamic Security Region Based on Grid-Partition and Fuzzy-Rough Sets

Multiscale Spatio-Temporal Enhanced Short-term Load Forecasting of Electric Vehicle Charging Stations

Combined Interval Prediction Algorithm Based on Optimal Relevancy, Redundancy and Synergy

User-Level Ultra-Short-Term Load Forecasting Model Based on Optimal Feature Selection and Bahdanau Attention Mechanism

The GRA-two algorithm for massive-scale feature selection problem in power system scenario classification and prediction

Evolutionary Computation for Feature Selection in Classification: A Comprehensive Survey of Solutions, Applications and Challenges

PowerPM: Foundation Model for Power Systems

An Ensemble System to Predict the Spatiotemporal Distribution of Energy Security Weaknesses in Transmission Networks