LSTM neural network model optimization algorithm based on APSO
CSTR:
Author:
Affiliation:

School of Cyber Science and Engineering, University of International Relations, Beijing 100091, P. R. China

Clc Number:

TP183

Fund Project:

Suppored by National Security High Precision and Advanced Discipline Construction Research Project(2019GA37).

  • Article
  • |
  • Figures
  • |
  • Metrics
  • |
  • Reference
  • |
  • Related
  • |
  • Cited by
  • |
  • Materials
  • |
  • Comments
    Abstract:

    Due to the slow convergence speed of the model with many hidden layers in the LSTM (long short-term memory) recurrent neural network, the updating of its weights and thresholds depends on the gradient descent algorithm, which may lead to the local extremum phenomenon in the weight correction of the network nodes, resulting in the reduction of the generalization ability of the LSTM neural network model. Based on this, this paper proposes an optimized LSTM neural network model based on APSO (accelerated particle swarm optimization) algorithm (APSO-LSTM). In this model, root mean square error is designed as an appropriate value function, and APSO algorithm is used to build an optimization system to optimize the weights of each neuron node globally, so as to improve the prediction performance of the model. The experimental results on the classic DataMarket and UCI datasets show that the prediction accuracy of APSO-LSTM model is significantly improved compared with the traditional LSTM model, which verifies the effectiveness of APSO-LSTM model.

    Reference
    Related
    Cited by
Get Citation

袁琳娜,杨良斌.基于APSOLSTM神经网络模型优化方法研究[J].重庆大学学报,2024,47(8):103~111

Copy
Related Videos

Share
Article Metrics
  • Abstract:
  • PDF:
  • HTML:
  • Cited by:
History
  • Received:July 11,2020
  • Revised:
  • Adopted:
  • Online: September 02,2024
  • Published:
Article QR Code