An extended neural ordinary differential equation network with grey system and its applications

Fangxue Zhang,Xinping Xiao,Mingyun Gao
DOI: https://doi.org/10.1016/j.neucom.2024.127343
IF: 6
2024-04-01
Neurocomputing
Abstract:The neural ordinary differential equation (NODE) has attracted much attention for its applicability in dynamic system modeling and continuous time series analysis. When the sample size is limited, models often exhibit weak generalizability and robustness and are susceptible to overfitting. To address this, a novel multivariate grey neural differential equation model is proposed based on the grey model and NODE. The new model leverages the small-sample modeling capabilities of grey systems to enhance the overall generalizability. When the neural network structure changes, the proposed model can degenerate into other grey models, enhancing inclusiveness and adaptability. Two energy forecasting cases show that the new model achieves average MAPE values of 0.82% and 1.13% on the test sets. These values are significantly better than those of the other 10 benchmark models. Furthermore, the proposed model exhibits superior performance in terms of the MAE, RMSE, STD, and APE metrics compared to those of all contrastive models. This study demonstrates that the new model effectively enhances its predictive capabilities on limited nonlinear data, showcasing higher prediction accuracy, stronger adaptability, and better stability.
computer science, artificial intelligence
What problem does this paper attempt to address?