Abstract:The salient progress of deep learning is accompanied by nonnegligible deficiencies, such as: 1) interpretability problem; 2) requirement for large data amounts; 3) hard to design and tune parameters; and 4) heavy computation complexity. Despite the remarkable achievements of neural networks-based deep models in many fields, the practical applications of deep learning are still limited by these shortcomings. This article proposes a new concept called the lightweight deep model (LDM). LDM absorbs the useful ideas of deep learning and overcomes their shortcomings to a certain extent. We explore the idea of LDM from the perspective of partial least squares (PLS) by constructing a deep PLS (DPLS) model. The feasibility and merits of DPLS are proved theoretically, after that, DPLS is further generalized to a more common form (GDPLS) by adding a nonlinear mapping layer between two cascaded PLS layers in the model structure. The superiority of DPLS and GDPLS is demonstrated through four practical cases involving two regression problems and two classification tasks, in which our model not only achieves competitive performance compared with existing neural networks-based deep models but also is proven to be a more interpretable and efficient method, and we know exactly how it improves performance, how it gives correct results. Note that our proposed model can only be regarded as an alternative to fully connected neural networks at present and cannot completely replace the mature deep vision or language models.

A Deep Residual PLS for Data-Driven Quality Prediction Modeling in Industrial Process

Online dual updating with recursive PLS model and its application in predicting crystal size of purified terephthalic acid (PTA) process

Soft-sensor modeling via neural network PLS approach

Enhancing the Reliability and Accuracy of Data-Driven Dynamic Soft Sensor Based on Selective Dynamic Partial Least Squares Models

Soft-sensing research on the gas phase ethylene polymerization in fluidized bed reactor based on DPCA-RBF network

An Improved Deep Kernel Partial Least Squares and Its Application to Industrial Data Modeling

Multivariate Deep Reconstruction Neural Network for Multi-step-ahead Prediction of Industrial Process Quality Variables

Deep PLS: A Lightweight Deep Learning Model for Interpretable and Efficient Data Analytics

Fast Locally Weighted PLS Modeling for Large-Scale Industrial Processes

Optimal Weighting Distance-Based Similarity for Locally Weighted PLS Modeling

Big Data Quality Prediction in the Process Industry: A Distributed Parallel Modeling Framework

Nonlinear Multivariate Quality Prediction Based on OSC-SVM-PLS

Cooperative Deep Dynamic Feature Extraction and Variable Time-Delay Estimation for Industrial Quality Prediction

Deep Residual Principal Component Analysis As Feature Engineering for Industrial Data Analytics

Deep Learning for Industrial KPI Prediction: when Ensemble Learning Meets Semi-Supervised Data

Final Quality Prediction Method for New Batch Processes Based on Improved JYKPLS Process Transfer Model

A Multiphase Dual Attention-Based LSTM Neural Network for Industrial Product Quality Prediction

Deep Learning of Partially Labeled Data for Quality Prediction Based on Stacked Target-Related Laplacian Autoencoder.

Quality relevant data-driven modeling and monitoring of multivariate dynamic processes: the dynamic T-PLS approach.

Deep Information Retention Network‐Enabled Data Modeling for Key Quality Indicator Prediction in the Chemical Industry