Abstract:The purpose of AI-Based schemes in intelligent systems is to advance and optimize system performance. Most intelligent systems adopt sequential data types derived from such systems. Real-time video data, for example, are continuously updated as a sequence to make necessary predictions for efficient system performance. The majority of deep-learning-based network architectures such as long short-term memory (LSTM), data fusion, two streams, and temporal convolutional network (TCN) for sequence data fusion are generally used to enhance robust system efficiency. In this paper, we propose a deep-learning-based neural network architecture for non-fix data that uses both a causal convolutional neural network (CNN) and a long-term recurrent convolutional network (LRCN). Causal CNNs and LRCNs use incorporated convolutional layers for feature extraction, so both architectures are capable of processing sequential data such as time series or video data that can be used in a variety of applications. Both architectures also have extracted features from the input sequence data to reduce the dimensionality of the data and capture the important information, and learn hierarchical representations for effective sequence processing tasks. We have also adopted a concept of series compact convolutional recurrent neural network (SCCRNN), which is a type of neural network architecture designed for processing sequential data combined by both convolutional and recurrent layers compactly, reducing the number of parameters and memory usage to maintain high accuracy. The architecture is challenge-able and suitable for continuously incoming sequence video data, and doing so allowed us to bring advantages to both LSTM-based networks and CNN-based networks. To verify this method, we evaluated it through a sequence learning model with network parameters and memory that are required in real environments based on the UCF-101 dataset, which is an action recognition data set of realistic action videos, collected from YouTube with 101 action categories. The results show that the proposed model in a sequence causal long-term recurrent convolutional network (SCLRCN) provides a performance improvement of at least 12% approximately or more to be compared with the existing models (LRCN and TCN).

A Novel Fusion Framework for Sequential Data using Pre-trained Model

A Novel Sequence-to-Sequence-Based Deep Learning Model for Multistep Load Forecasting.

Fusion Recurrent Neural Network

A multi-feature spatial–temporal fusion network for traffic flow prediction

Features Injected Recurrent Neural Networks for Short-Term Traffic Speed Prediction.

Unleashing the Potential of Spiking Neural Networks for Sequential Modeling with Contextual Embedding.

Residual long short-term memory network with multi-source and multi-frequency information fusion: An application to China's stock market

FPN-fusion: Enhanced Linear Complexity Time Series Forecasting Model

Multi-View Fusion Neural Network for Traffic Demand Prediction

Forecast Network-Wide Traffic States for Multiple Steps Ahead: A Deep Learning Approach Considering Dynamic Non-Local Spatial Correlation and Non-Stationary Temporal Dependency

Transformer Based Spatial-Temporal Fusion Network for Metro Passenger Flow Forecasting.

A Multifeature Fusion Short-Term Traffic Flow Prediction Model Based on Deep Learnings

Deep-Learning-Based Sequence Causal Long-Term Recurrent Convolutional Network for Data Fusion Using Video Data

Ultra short term power load forecasting based on the fusion of Seq2Seq BiLSTM and multi head attention mechanism

A novel hybrid deep learning time series forecasting model based on long-short-term patterns

ST-AFN: a spatial-temporal attention based fusion network for lane-level traffic flow prediction

TransFusion Model Fusion Mechanism Based on Transformer for Traffic Flow Prediction

Multi-Stage Fusion Framework for Short-Term Passenger Flow Forecasting in Urban Rail Transit Systems Using Multi-Source Data

A Robust Hybrid Deep Learning Model for Spatiotemporal Image Fusion

F-net: fusion neural network for vehicle trajectory prediction in autonomous driving

Spatial-temporal multi-factor fusion graph neural network for traffic prediction