Study on Five Typical Optimization Models of LSTM

Yu Jianying,Zhou Xuefei,Lu Shiqiang,Xiao Shaoze,Wan Ajun,Zhang Yalei
DOI: https://doi.org/10.1109/cac59555.2023.10450860
2023-01-01
Abstract:LSTM is a special recurrent neural network, which can solve the problem of long-term dependence common in general recurrent neural networks. It can effectively transmit and express the information in a long time series without causing the useful information of a long time ago to be ignored (forgotten). At the same time, LSTM can also solve the problem of gradient disappearance/explosion in RNN. In this paper, we introduce five types of LSTM optimization models, including the current mainstream convolutional neural network (CNN) optimized LSTM model, end-to-end mixed deep learning network model M-B-LSTM, particle swarm optimization algorithm (PSO) optimized LSTM model, deep Long and short term memory network research, and genetic algorithm LSTM structure. The current development trend of LSTM in time series prediction is summarized to provide certain targets for the follow-up research and forecast.
What problem does this paper attempt to address?