Abstract:This paper develops a general framework for learning interpretable data representation via Long Short-Term Memory (LSTM) recurrent neural networks over hierarchal graph structures. Instead of learning LSTM models over the pre-fixed structures, we propose to further learn the intermediate interpretable multi-level graph structures in a progressive and stochastic way from data during the LSTM network optimization. We thus call this model the structure-evolving LSTM. In particular, starting with an initial element-level graph representation where each node is a small data element, the structure-evolving LSTM gradually evolves the multi-level graph representations by stochastically merging the graph nodes with high compatibilities along the stacked LSTM layers. In each LSTM layer, we estimate the compatibility of two connected nodes from their corresponding LSTM gate outputs, which is used to generate a merging probability. The candidate graph structures are accordingly generated where the nodes are grouped into cliques with their merging probabilities. We then produce the new graph structure with a Metropolis-Hasting algorithm, which alleviates the risk of getting stuck in local optimums by stochastic sampling with an acceptance probability. Once a graph structure is accepted, a higher-level graph is then constructed by taking the partitioned cliques as its nodes. During the evolving process, representation becomes more abstracted in higher-levels where redundant information is filtered out, allowing more efficient propagation of long-range data dependencies. We evaluate the effectiveness of structure-evolving LSTM in the application of semantic object parsing and demonstrate its advantage over state-of-the-art LSTM models on standard benchmarks.

Explaining and Interpreting LSTMs

Residual Recurrent Neural Networks for Learning Sequential Representations.

Explaining Deep Learning Models for Structured Data using Layer-Wise Relevance Propagation

Towards Interpreting Recurrent Neural Networks Through Probabilistic Abstraction

Evaluating Recurrent Neural Network Explanations

Layer-wise Feedback Propagation

Fundamentals of Recurrent Neural Network (RNN) and Long Short-Term Memory (LSTM) Network

Explainable Online Lane Change Predictions on a Digital Twin with a Layer Normalized LSTM and Layer-wise Relevance Propagation

Understanding LSTM -- a tutorial into Long Short-Term Memory Recurrent Neural Networks

Investigating Explainability Methods in Recurrent Neural Network Architectures for Financial Time Series Data

xLSTM: Extended Long Short-Term Memory

ExplainLFS: Explaining neural architectures for similarity learning from local perturbations in the latent feature space

DeLELSTM: Decomposition-based Linear Explainable LSTM to Capture Instantaneous and Long-term Effects in Time Series

Toward interpretable LSTM-based modeling of hydrological systems

MambaLRP: Explaining Selective State Space Sequence Models

Can recurrent neural networks learn process model structure?

Interpretable Structure-Evolving LSTM

In-Context Explainers: Harnessing LLMs for Explaining Black Box Models

Neural network interpretability with layer-wise relevance propagation: novel techniques for neuron selection and visualization

Layer-Wise Relevance Propagation with Conservation Property for ResNet