Abstract:Applying image-based processing methods to original videos on a framewise level breaks the temporal consistency between consecutive frames. Traditional video temporal consistency methods reconstruct an original frame containing flickers from corresponding nonflickering frames, but the inaccurate correspondence realized by optical flow restricts their practical use. In this article, we propose a temporally broad learning system (TBLS), an approach that enforces temporal consistency between frames. We establish the TBLS as a flat network comprising the input data, consisting of an original frame in an original video, a corresponding frame in the temporally inconsistent video on which the image-based technique was applied, and an output frame of the last original frame, as mapped features in feature nodes. Then, we refine extracted features by enhancing the mapped features as enhancement nodes with randomly generated weights. We then connect all extracted features to the output layer with a target weight vector. With the target weight vector, we can minimize the temporal information loss between consecutive frames and the video fidelity loss in the output videos. Finally, we remove the temporal inconsistency in the processed video and output a temporally consistent video. Besides, we propose an alternative incremental learning algorithm based on the increment of the mapped feature nodes, enhancement nodes, or input data to improve learning accuracy by a broad expansion. We demonstrate the superiority of our proposed TBLS by conducting extensive experiments.

Telescopic broad Bayesian learning for big data stream

TKS-BLS: Temporal Kernel Stationary Broad Learning System for Enhanced Modeling, Anomaly Detection, and Incremental Learning with Application to Ironmaking Processes

Big Learning with Bayesian Methods

Lifelong Bayesian Learning Machines for Streaming Industrial Big Data

Recurrent Broad Learning Systems for Time Series Prediction

Deep Learning for Knowledge-Driven Ontology Stream Prediction.

Dynamic transformation of prior knowledge into Bayesian models for data streams

Time Varying Dynamic Bayesian Network for Nonstationary Events Modeling and Online Inference

Tree Broad Learning System for Small Data Modeling

Incremental Bayesian broad learning system and its industrial application

Robust Sparse Bayesian Learning for Broad Learning with Application to High-Speed Railway Track Monitoring

Sequential sparse Bayesian learning with applications to system identification for damage assessment and recursive reconstruction of image sequences

Deep Optimized Broad Learning System for Applications in Tabular Data Recognition

Multitask Sparse Bayesian Learning with Applications in Structural Health Monitoring

Deep Broad Learning - Big Models for Big Data

Improving Video Temporal Consistency via Broad Learning System

Transfer Entropy Bottleneck: Learning Sequence to Sequence Information Transfer

Feature Selection in the Data Stream Based on Incremental Markov Boundary Learning

A new online learning algorithm for streaming data and decision support with a Bayesian approach

An Active Learning-Based Incremental Deep-Broad Learning Algorithm for Unbalanced Time Series Prediction

A Bayesian Partially Observable Online Change Detection Approach with Thompson Sampling