Experimental and clinical studies of the pathophysiology and management of acute spinal cord injury.

Charles Tator

DOI: https://doi.org/10.1080/10790268.1996.11719436

1996-10-01

Abstract:

What problem does this paper attempt to address?

Human-cyber-physical System for Operation in Nuclear Reactor Possessing Asymmetric Multi-Task Learning-Based Predicting Framework

Yixiong Feng,Xiangyu Jiang,Zhaoxi Hong,Zhiwu Li,Hengyuan Si,Bingtao Hu,Zhifeng Zhang,Hao Qiu,Jianrong Tan

DOI: https://doi.org/10.1016/j.jmsy.2022.07.008

IF: 12.1

2022-01-01

Journal of Manufacturing Systems

Abstract:This work proposes a novel architecture of a human-cyber-physical system (HCPS) to operate nuclear reactors in the context of next-generation artificial intelligence (NGAI) technologies. Developing the generation IV nuclear power plant requires NGAI to fulfill intelligent operation and thereby enhance reliability and safety. Nevertheless, the NGAI based on machine computing is limited in auto-cognition whereas humans are adept in information processing. Operation states prediction is served as a specific scene to investigate the key enabling technologies (KETs) in HCPS, where humans are elevated to a supervisory level for NGAI technologies. Humans interact with NGAI in two-stage which comprise the initial construction and later upgradation of an intelligent prediction framework. In this paper, asymmetric multitask learning (AMTL) is elaborated as a KET which is essential to implementing intelligent prediction in HCPS. AMTL simultaneously trains multi-tasks and permits asymmetric information transfer between tasks. The amount of transfer varies with inter-task relatedness and individual task losses, thereby preventing negative transfer and enhancing accuracy. Furthermore, the improved AMTL is adapted for the small and imbalanced samples of tasks. A sparse and directed regularisation graph is introduced to visualise the correlation between tasks, reflecting the physical mechanism as well. Finally, the improved AMTL is utilized to predict reactivity of a specific pressurised water reactor (PWR), which validates the efficiency and accuracy.
Multivariate Deep Reconstruction Neural Network for Multi-step-ahead Prediction of Industrial Process Quality Variables

Yuwei Chen,Xinmin Zhang,Zhihuan Song,Manabu Kano

DOI: https://doi.org/10.1016/j.ifacol.2023.10.1400

2023-01-01

IFAC-PapersOnLine

Abstract:In industrial processes, deep learning has been widely used to solve the soft sensing problem. Multi-step-ahead prediction is one of the most challenging problems in the field of soft sensors. Recently, N-Beats has been proposed as a promising deep neural architecture for multi-step prediction, but it can only be used for univariate time series prediction, not for industrial soft sensor modeling. Inspired by N-Beats, a novel deep learning model, multivariate deep reconstruction neural network (MDRNN), is proposed for multivariate time series prediction in this work. MDRNN is designed on the basis of a doubly residual structure with a deep stack of fully-connect layers. MDRNN inherits the merits of N-Beats and incorporates the “doubly residual stacking” idea into the industrial soft sensor modeling to improve the prediction accuracy. To evaluate the feasibility and effectiveness of the proposed MDRNN, it is applied to the quality prediction task and validated with two real-world industrial processes. The application results demonstrated that the proposed MDRNN can achieve higher prediction accuracy compared to the existing N-Beats and Multilayer Perceptron (MLP)-based methods.
Deep Neural Network-Embedded Stochastic Nonlinear State-Space Models and Their Applications to Process Monitoring

Kai Wang,Junghui Chen,Zhihuan Song,Yalin Wang,Chunhua Yang

DOI: https://doi.org/10.1109/tnnls.2021.3086323

IF: 14.255

2022-01-01

IEEE Transactions on Neural Networks and Learning Systems

Abstract:Process complexities are characterized by strong nonlinearities, dynamics, and uncertainties. Monitoring such a complex process requires a high-quality model describing the corresponding nonlinear dynamic behavior. The proposed model is constructed using deep neural networks (DNNs) to represent the state transition and observation generation, both of which constitute a stochastic nonlinear state-space model. A new bidirectional recurrent neural network (RNN), creating a connection of the hidden layer between a forward RNN and a backward RNN, is proposed to generate the filtering estimation and the smoothing estimation of process states which further generate observations with DNN-based process models. The smoothing estimator and the process model are first learned offline with all collected samples. Then the filtering estimator is fine-tuned by the learned smoother and process models to achieve real-time monitoring since the filter state is estimated based on the past and the current observations. Two indices are designed based on the learned model for monitoring the process anomaly. The proposed process monitoring model can deal with complex nonlinearities, process dynamics, and process uncertainties, all of which can be very challenging for the existing methods, such as kernel mapping and stacked auto-encoder. Two case studies validate that the effectiveness of the proposed method outperforms the other comparative methods by at least 10% when using the averaged fault detection rate in the industrial experimental data.
Prediction of human initial operation situation in confined space with a multi-task deep neural network

Mingyue Yin,Jianguang Li,Silu Wang,Yuxuan Yan

DOI: https://doi.org/10.1016/j.engappai.2024.109297

IF: 8

2024-09-14

Engineering Applications of Artificial Intelligence

Abstract:Most large manufacturing fields still rely on manual operations, requiring operators to enter the Confined Space (CS) to conduct assembly and maintenance tasks. The ergonomics analysis combined with the Digital Human Model (DHM) can provide valuable suggestions and guidance for product structure design and process planning. Due to the particularity of CS, the current algorithms applied to DHM operation planning are not suitable for CS operations. To address this challenge, we introduce a novel approach to predict the initial operation situation in CS. The Restriction State Expression Model for Bi-Directional Confined Space (RSEMfBDCS) is introduced to quantify the restricted degree, and a novel multi-task deep neural network, as the Human Operation Situation Prediction Network in CS (HOSPNiCS) is developed to predict the initial operation situation in CS, which includes operation reachability, the initial OPI, and the initial OPII of the operators. Training and Verifying by the data collected from the real operation cases, HOSPNiCS distinguishes whether the manual operation is reachable with an average accuracy of 0.996, and the average accuracy for initial OPI prediction can reach 0.957. For initial OPII prediction, HOSPNiCS has an average distance error of 0.036 m and an average angle error of 0.395°. Based on the proposed approach, the engineering designers can swiftly ascertain operation reachability and get the initial OPI and OPII of DHM with the help of the prediction results. In light of this, the human operation simulation would be more practical for future human factor analysis.

automation & control systems,computer science, artificial intelligence,engineering, electrical & electronic, multidisciplinary
Human-machine Interface for a Master-Slave Hydraulic Manipulator with Vision Enhancement and Auditory Feedback

Ruqi Ding,Min Cheng,Zenan Han,Feng Wang,Bing Xu

DOI: https://doi.org/10.1016/j.autcon.2022.104145

IF: 10.3

2022-01-01

Automation in Construction

Abstract:This paper proposes a novel human-machine interface (HMI) for addressing the operational inefficiency problem owing to the asymmetrical workspace mapping in master-slave hydraulic manipulators. An augmented reality based head-mounted display system combining binocular vision with real-time virtual modeling was designed for demonstrating the commanded motion, and a hidden-appearance visualization rule was established for reducing visual interference, caused by the occlusion effect. An auditory feedback interface was designed for providing an additional cue for the master-slave position error. Eighteen participants were required for executing two typical tasks for validation. The test results indicated that the task completion time was reduced using the proposed HMI, and the number of collisions with surrounding items was reduced. Although the subjective feeling evaluation showed no statistical improvement owing to the visual fatigue and limited definition of the augmented reality scene, the proposed HMI is a practical method for improving the operational efficiency of hydraulic manipulators.
Operational time-series data modeling via LSTM network integrating principal component analysis based on human experience

Ke Yang,Yi-liu Liu,Yu-nan Yao,Shi-dong Fan,Ali Mosleh

DOI: https://doi.org/10.1016/j.jmsy.2020.11.020

IF: 12.1

2021-10-01

Journal of Manufacturing Systems

Abstract:<p>Today's information technologies involve increasingly intelligent systems, which come at the cost of increasingly complex equipment. Modern monitoring systems collect multi-measuring-point and long-term data which make equipment health prediction a "big data" problem. It is difficult to extract information from such condition monitoring data to accurately estimate or predict health statuses. Deep learning is a powerful tool for big data processing that is widely utilized in image and speech recognition applications, and can also provide effective predictions in industrial processes. This paper proposes the Long Short-term Memory Integrating Principal Component Analysis based on Human Experience (HEPCA-LSTM), which uses operational time-series data for equipment health prognostics. Principal component analysis based on human experience is first conducted to extract condition parameters from the condition monitoring system. The long short-term memory (LSTM) framework is then constructed to predict the target status. Finally, a dynamic update of the prediction model with incoming data is performed at a certain interval to prevent any model misalignment caused by the drifting of relevant variables. The proposed model is validated on a practical case and found to outperform other prediction methods. It utilizes a powerful deep learning analysis method, the LSTM, to fully process big condition monitoring series data; it effectively extracts the features involved with human experience and takes dynamic updates into consideration.</p>

engineering, manufacturing, industrial,operations research & management science
An Attention Mechanism Oriented Hybrid CNN-RNN Deep Learning Architecture of Container Terminal Liner Handling Conditions Prediction

Bin Li,Yuqing He

DOI: https://doi.org/10.1155/2021/3846078

2021-07-08

Abstract:The booming computational thinking and deep learning make it possible to construct agile, efficient, and robust deep learning-driven decision-making support engine for the operation of container terminal handling systems (CTHSs). Within the conceptual framework of computational logistics, an attention mechanism oriented hybrid convolutional neural network and recurrent neural network deep learning architecture (AMO-HCR-DLA) is proposed technically to predict the container terminal liner handling conditions that mainly include liner handling time (LHT) and total working time of quay crane farm (TWT-QCF) for a calling liner. Consequently, the container terminal oriented logistics generalized computation (CTO-LGC) automation and intelligence are established tentatively by AMO-HCR-DLA. A typical regional container terminal hub of China is selected to design, implement, execute, and evaluate the AMO-HCR-DLA with the actual production data. In the case of severe vibration of LHT and TWT-QCF, while forecasting the handling conditions of 210 ships based on the CTO-LGC running log of four years, the forecasting error of LHT within one hour is more than 97% and that of TWT-QCF within six hours accounts for 89.405%. When predicting the operating conditions of 300 liners by the log of five years, the forecasting deviation of LHT within one hour is more than striking 99% and that of TWT-QCF within six hours reaches up to 94.010% as well. All are far superior to the predicting outcomes by the classical algorithms of machine learning and deep learning. Hence, the AMO-HCR-DLA shows excellent performance for the prediction of CTHS with the low and stable computational consuming. It also demonstrates the feasibility, credibility, and realizability of the computing architecture and design paradigm of AMO-HCR-DLA preliminarily.
A Multi-Step Sequence-to-Sequence Model with Attention LSTM Neural Networks for Industrial Soft Sensor Application

Lianwei Ma,Yuan Zhao,Bin Wang,Feifan Shen

DOI: https://doi.org/10.1109/jsen.2023.3266104

IF: 4.3

2023-01-01

IEEE Sensors Journal

Abstract:Soft sensor technology is widely used in industries to handle highly nonlinear, dynamic, time-dependent sequence data of industrial processes for predicting the key variables associated with auxiliary process variables. Many existing soft sensor algorithms based on deep learning are able to build complex nonlinear models but ignore the dynamic characteristics of processes. The long short-term memory (LSTM) neural network is exploited to solve the modeling issue, which is related to strong time-varying features. In this article, a novel multistep sequence-to-sequence model based on attention LSTM (MA-LSTM) neural networks is proposed to improve the soft sensor modeling performance of industrial processes with strong dynamics and nonlinearity. The LSTM-based encoder–decoder architecture with the attention mechanism is applied to extract inherent characteristics relevant to the quality variables and capture both the long- and short-term dependences of sequence data. Instead of the traditional sequence-to-point quality prediction architecture, the improved architecture is designed to predict multistep quality variables, and the intermediate results are fed into an additional 1-D weighted convolution module to obtain accurate prediction results. The superiority of the proposed framework is demonstrated through a debutanizer column case and a sulfur recovery process.
Multi-Sensor Prognostics using an Unsupervised Health Index based on LSTM Encoder-Decoder

Pankaj Malhotra,Vishnu TV,Anusha Ramakrishnan,Gaurangi Anand,Lovekesh Vig,Puneet Agarwal,Gautam Shroff

DOI: https://doi.org/10.48550/arXiv.1608.06154

IF: 5.414

2016-08-22

Machine Learning

Abstract:Many approaches for estimation of Remaining Useful Life (RUL) of a machine, using its operational sensor data, make assumptions about how a system degrades or a fault evolves, e.g., exponential degradation. However, in many domains degradation may not follow a pattern. We propose a Long Short Term Memory based Encoder-Decoder (LSTM-ED) scheme to obtain an unsupervised health index (HI) for a system using multi-sensor time-series data. LSTM-ED is trained to reconstruct the time-series corresponding to healthy state of a system. The reconstruction error is used to compute HI which is then used for RUL estimation. We evaluate our approach on publicly available Turbofan Engine and Milling Machine datasets. We also present results on a real-world industry dataset from a pulverizer mill where we find significant correlation between LSTM-ED based HI and maintenance costs.
GAN-Based Multi-Task Learning Approach for Prognostics and Health Management of IIoT

Sourajit Behera,Rajiv Misra,Alberto Sillitti

DOI: https://doi.org/10.1109/tase.2023.3267860

IF: 6.636

2023-01-01

IEEE Transactions on Automation Science and Engineering

Abstract:Health assessment (HA) & remaining useful life (RUL) estimation, the two essential pillars of the prognostics and health management (PHM) paradigm, help improve industrial equipment reliability while reducing maintenance costs. However, reported works treat HA and RUL estimation as disjoint problems though there exist unexploited similarities among these related issues. Additionally, in practical industrial working scenarios, equipment(s) stay in a normal condition for most of its lifespan, leading to a disproportionate training dataset, hampering the prediction accuracy. To overcome the above problems, we propose a data-driven multi-task learning framework aided by a novel least squares recurrent auxiliary classifier generative adversarial network (LS-R-ACGAN). LS-R-ACGAN employs recurrent neural networks (RNNs) in its generator & discriminator networks for multi-variate fault data generation while overcoming the vanishing gradient problem of ACGANs. Post-data-augmentation, a balanced training dataset, trains a multi-task learning model based on a deep gated RNN (DGRU) for joint HA and RUL estimation. Our simulations use the C-MAPSS dataset for testing the proposed approach’s accuracy. The final results showcase improvements by at least $sim$ 3.54% and $sim$ 2.38% on the RMSE and Score metric over existing state-of-the-art works suggesting its competitiveness and competence for real-world implementations. Note to Practitioners—This study attacks multiple presumptions concerning the maintenance of complex systems including, ample availability of fault samples alongside normal samples and solving only one of the problems, i.e., health assessment (HA) or remaining useful life (RUL) estimations rather than both. Popular artificial intelligence (AI) based solutions rely heavily upon the quantity of training data for desired performance outcomes. However, in real-life industrial scenarios, fault instances are rare, inherently resulting in an imbalanced dataset. Additionally, it is both labor-intensive and costly to repeat multiple experiments for gathering required data as the equipment(s) pass through short-lived fault states. Thus conventional AI-based solutions may end up producing biased predictions. This work proposes to solve the imbalanced training dataset problem along with joint HA and RUL estimations, in one solution pipeline, currently unexplored in majority of the existing works in the literature. LS-R-ACGAN generates ample diverse fault samples for reducing the degree of imbalance between normal and fault classes. Subsequently, after data augmentation, the balanced training dataset helps train a multi-task learning model for joint HA and RUL estimations. The proposed framework has been implemented and tested on a benchmark dataset proving its superiority over multiple existing methods in the literature.

automation & control systems
A multi-task analysis and modelling paradigm using LSTM for multi-source monitoring data of inland vessels

Zhi Yuan,Jingxian Liu,Yi Liu,Qian Zhang,Ryan Wen Liu

DOI: https://doi.org/10.1016/j.oceaneng.2020.107604

IF: 5

2020-10-01

Ocean Engineering

Abstract:<p>The vessel monitoring data provide important information for people to understand the vessel dynamic status in real time and make appropriate decisions in vessel management and operations. However, some of the essential data may be incomplete or unavailable. In order to recover or predict the missing information and best exploit the vessels monitoring data, this paper combines statistical analysis, data mining and neural network methods to propose a multi-task analysis and modelling framework for multi-source monitoring data of inland vessels. Specifically, an advanced neural network, Long Short-Term Memory (LSTM) was tailored and employed to tackle three important tasks, including vessel trajectory repair, engine speed modelling and fuel consumption prediction. The developed models have been validated using the real-life vessel monitoring data and shown to outperform some other widely used modelling methods. In addition, statistics and data technologies were employed for data extraction, classification and cleaning, and an algorithm was designed for identification of the vessel navigational state.</p>

engineering, civil, ocean, marine,oceanography
Smart industrial IoT empowered crowd sensing for safety monitoring in coal mine

Jing Zhang,Qichen Yan,Xiaogang Zhu,Keping Yu

DOI: https://doi.org/10.1016/j.dcan.2022.08.002

IF: 6.348

2022-08-01

Digital Communications and Networks

Abstract:The crowd sensing technology can realize the sensing and computing of people, machines, and environment in smart industrial IoT-based coal mine, which provides a solution for safety monitoring through distributed intelligence optimization. However, due to the difficulty of neural network training to achieve global optimality and the fact that traditional LSTM methods do not consider the relationship between adjacent machines, the accuracy of human body position prediction and pressure value prediction is not high. To solve these problems, this paper proposes a smart industrial IoT empowered crowd sensing for safety monitoring in coal mine. First, we propose a Particle Swarm Optimization-Elman Neural Network (PE) algorithm for the mobile human position prediction. Second, we propose an ADI-LSTM neural network prediction algorithm for pressure values of machines supports in underground mines.Among them, our proposed PE algorithm has the lowest average cumulative prediction error, and the trajectory fit rate is improved by 24.1%, 13.9% and 8.7% compared with Kalman filtering, Elman and Kalman plus Elman algorithms, respectively. Meanwhile, compared with single-input ARIMA, RNN, LSTM, and GRU, the RMSE values of our proposed ADI-LSTM are reduced by 36.6%, 52%, 32%, and 13.7%, respectively; and the MAPE values are reduced by 0.0003%, 0.9482%, 1.1844%, and 0.3620%, respectively.© 2015 Published by Elsevier Ltd.

telecommunications
Human factors engineering simulated analysis in administrative, operational and maintenance loops of nuclear reactor control unit using artificial intelligence and machine learning techniques

Abdulrahman Khamaj,Abdulelah M Ali,Rajasekaran Saminathan,Shanmugasundaram M

DOI: https://doi.org/10.1016/j.heliyon.2024.e30866

IF: 3.776

2024-05-08

Heliyon

Abstract:The nuclear reactor control unit employs human factor engineering to ensure efficient operations and prevent any catastrophic incidents. This sector is of utmost importance for public safety. This study focuses on simulated analysis of specific areas of nuclear reactor control, specifically administration, operation, and maintenance, using artificial intelligence software. The investigation yields effective artificial intelligence algorithms that capture the essential and non-essential components of numerous parameters to be monitored in nuclear reactor control. The investigation further examines the interdependencies between various parameters and validates the statistical outputs of the model through attribution analysis. Furthermore, a Multivariant ANOVA analysis is conducted to identify the interactive plots and mean plots of crucial parameters interactions. The artificial intelligence algorithms demonstrate the correlation between the number of vacant staff jobs and both the frequency of license event reports each year and the ratio of contract employees to regular employees in the administrative domain. An AI method uncovers the relationships between the operator failing rate (OFR), operator processed errors (OEE), and operations at limited time frames (OLC). The AI algorithm reveals the interdependence between equipment in the out of service (EOS), progressive maintenance schedule (PRMR), and preventive maintenance schedules (PMRC). Effective machine learning neural network models are derived from generative adversarial network (GAN) algorithms and proposed for administrative, operational and maintenance loops of nuclear reactor control unit.
Human risk recognition and prediction in manned submersible diving tasks driven by deep learning models

Yidan Qiao,Haotian Li,Dengkai Chen,Hang Zhao,Lin Ma,Yao Wang

DOI: https://doi.org/10.1016/j.aei.2024.102893

IF: 8.8

2024-10-27

Advanced Engineering Informatics

Abstract:The complexity of human cognition is increased by the multiple and interactive information clusters brought about by the application of advanced intelligent information technologies. Especially in systems operating in extreme regions far from society, human errors are more pronounced than ever before. Prolonged social isolation, extreme weightless or overweight environments, stressful atmospheres, and lack of situational awareness are all added potential elements contributing to human risk. Although the development of human reliability analysis methods and their variants continues to mature, accurately predicting the potential risk of dynamic human behavior from sparse and discrete events remains a great challenge. We focus on deep learning computational architectures that are similar to the cognitive processes and mechanisms of the brain, and build neural networks that match the perceptual activation and memory cycling of the cognitive features of the brain. This study focuses on investigating the ability of the joint SNN-ITLSTM network to predict human error behavior and the clusters of performance shaping factors that effectively characterize the far-social nature. Combining the bionic properties of SNN and the temporal update mechanism of LSTM in the form of hierarchical events constitutes a computationally efficient network architecture. Our results show that the joint model proposed in this study has the performance to strengthen temporal influences and characterize cognitive features of the brain.

engineering, multidisciplinary,computer science, artificial intelligence
MALS-Net: A Multi-Head Attention-Based LSTM Sequence-to-Sequence Network for Socio-Temporal Interaction Modelling and Trajectory Prediction

Fuad Hasan,Hailong Huang

DOI: https://doi.org/10.3390/s23010530

IF: 3.9

2023-01-04

Sensors

Abstract:Predicting the trajectories of surrounding vehicles is an essential task in autonomous driving, especially in a highway setting, where minor deviations in motion can cause serious road accidents. The future trajectory prediction is often not only based on historical trajectories but also on a representation of the interaction between neighbouring vehicles. Current state-of-the-art methods have extensively utilized RNNs, CNNs and GNNs to model this interaction and predict future trajectories, relying on a very popular dataset known as NGSIM, which, however, has been criticized for being noisy and prone to overfitting issues. Moreover, transformers, which gained popularity from their benchmark performance in various NLP tasks, have hardly been explored in this problem, presumably due to the accumulative errors in their autoregressive decoding nature of time-series forecasting. Therefore, we propose MALS-Net, a Multi-Head Attention-based LSTM Sequence-to-Sequence model that makes use of the transformer's mechanism without suffering from accumulative errors by utilizing an attention-based LSTM encoder-decoder architecture. The proposed model was then evaluated in BLVD, a more practical dataset without the overfitting issue of NGSIM. Compared to other relevant approaches, our model exhibits state-of-the-art performance for both short and long-term prediction.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
Long-Short-Term-Memory-Based Deep Stacked Sequence-to-Sequence Autoencoder for Health Prediction of Industrial Workers in Closed Environments Based on Wearable Devices

Weidong Xu,Jingke He,Weihua Li,Yi He,Haiyang Wan,Wu Qin,Zhuyun Chen

DOI: https://doi.org/10.3390/s23187874

2023-09-14

Abstract:To reduce the risks and challenges faced by frontline workers in confined workspaces, accurate real-time health monitoring of their vital signs is essential for improving safety and productivity and preventing accidents. Machine-learning-based data-driven methods have shown promise in extracting valuable information from complex monitoring data. However, practical industrial settings still struggle with the data collection difficulties and low prediction accuracy of machine learning models due to the complex work environment. To tackle these challenges, a novel approach called a long short-term memory (LSTM)-based deep stacked sequence-to-sequence autoencoder is proposed for predicting the health status of workers in confined spaces. The first step involves implementing a wireless data acquisition system using edge-cloud platforms. Smart wearable devices are used to collect data from multiple sources, like temperature, heart rate, and pressure. These comprehensive data provide insights into the workers' health status within the closed space of a manufacturing factory. Next, a hybrid model combining deep learning and support vector machine (SVM) is constructed for anomaly detection. The LSTM-based deep stacked sequence-to-sequence autoencoder is specifically designed to learn deep discriminative features from the time-series data by reconstructing the input data and thus generating fused deep features. These features are then fed into a one-class SVM, enabling accurate recognition of workers' health status. The effectiveness and superiority of the proposed approach are demonstrated through comparisons with other existing approaches.
Nonintrusive Load Monitoring Based on Sequence-to-sequence Model with Attention Mechanism

WANG Ke,ZHONG Haiwang,YU Nanpeng,XIA Qing

DOI: https://doi.org/10.13334/j.0258-8013.pcsee.181123

2019-01-01

Abstract:Author(s): Wang, K; Zhong, H; Yu, N; Xia, Q | Abstract: Nonintrusive load monitoring (NILM) is one of the key applications of big data analytics in smart power distribution systems for end-use customers. A successful implementation of nonintrusive load monitoring can improve the knowledge of load, and has great potential in increasing demand side response. Traditional nonintrusive load monitoring algorithms have long suffered from the problems of high misjudgment rate and low accuracy of disaggregated power value. To address these problems, the deep learning framework was adopted. Specifically, a nonintrusive load monitoring model based on sequence-to-sequence (seq2seq) model with attention mechanism was proposed. The model first embeds the input active power time sequence into a high dimensional vector, extracts information with a long short term memory (LSTM)-based encoder, and then selects the most relevant information to decode and reaches the final disaggregation results with a decoder wrapped by attention mechanism. Compared with existing models, the proposed deep learning network structure increases model's ability to extract and utilize information dramatically. The proposed model was tested on the REFITPowerData dataset, and compared with the state-of-the-art model.
Condition assessment and predictive maintenance for contact probe using health index and encoder‐decoder LSTM model

Shun‐Sun Luk,Yanwen Jin,Xiaoge Zhang,Vincent To‐Yee Ng,Jingyuan Huang,Chak‐Nam Wong

DOI: https://doi.org/10.1002/qre.3668

2024-10-07

Quality and Reliability Engineering International

Abstract:Contact probe is broadly used for the continuous monitoring of microelectronic components in manufacturing industries. False rejection of fine product due to defective contact probe significantly reduces the yield in production. Traditionally, defect detection for contact probes heavily depends on a valid range manually defined by engineers over the measured value of certain parameters. However, the subjective range defined according to engineer experience is prone to trigger a high rate of false alarms due to the inherent noise in the measured parameters. To address this issue, we construct a health index (HI) with the contact resistance‐directly‐related features to help monitor and assess the condition of contact probe. Based on the established HI, we develop Long Short‐Term Memory (LSTM) encoder‐decoder machine learning model to assess the condition of contact probe by forecasting the HI value in the future. Encoders from LSTM and convolutional neural network (CNN) are selected as the encoder‐decoder architecture for the sequence‐to‐sequence prediction due to their advantage in extracting the correlation of features at different scales. An explainable Artificial Intelligence (XAI) technique named Local interpretable model‐agnostic explanations (LIME) is used to quantify the contribution of each feature to the model prediction. The encoder from CNN is found to outperform the LSTM encoder in extracting the inter‐feature correlation. Finally, the predicted HI is used to signal the alarm for the maintenance action of contact probe when its value is below a predefined threshold. Comparison between the action alarm triggered by the developed HI and the actual maintenance records suggests that the proposed approach achieves at least 75% accuracy for the triggered alarm in the next 15 mins.

engineering, industrial, multidisciplinary,operations research & management science
Regulation of drosophila folylpolyglutamates during development

E. Duke,D. Priest

DOI: https://doi.org/10.1007/BF00221061

IF: 3.842

1990-09-21

Molecular and Cellular Biochemistry

Abstract:
MCTAN: A Novel Multichannel Temporal Attention-Based Network for Industrial Health Indicator Prediction

Lei Ren,Yuxin Liu,Di Huang,Keke Huang,Chunhua Yang

DOI: https://doi.org/10.1109/tnnls.2021.3136768

IF: 14.255

2023-01-01

IEEE Transactions on Neural Networks and Learning Systems

Abstract:Health indicator prediction, such as remaining useful life prediction and product quality prediction, is an important aspect of industrial intelligence. It is essential to process the massive multichannel industrial time series collected from the Industrial Internet of Things for the industrial health indicator prediction. At present, there are still three issues that need to be considered for industrial health indicator prediction. First, it is difficult to directly connect the distant positions in the industrial time series to extract the temporal relations, which decreases the efficiency of extracting the potential long-distance temporal relations and training networks. Second, it should be fully considered that data from different channels have different contributions. Equally dealing with the contributions of each channel will weaken the representational ability of prediction networks. Third, the loss function deals with early predictions and delay predictions equally, which will lead to high risks caused by delay predictions. In this article, for these issues, a novel multichannel temporal attention-based network (MCTAN) is proposed for industrial health indicator prediction, which can weigh contributions of different channels through the channel attention while avoiding the loss of the temporal information and directly connect each time series position to the local fields of the sequence through the multi-head local attention mechanism to efficiently extract potential long-distance temporal relations. Then, a weighted mean square error loss function differently dealing with early predictions and delay predictions by setting dynamic weights is presented to reduce delay predictions. Next, to deal with the above-mentioned issues systematically, a framework combining data preprocessing and MCTAN collaboratively is introduced to predict industrial health indicators through multichannel time series. Finally, the experiments are carried out on the commercial modular aero-propulsion system simulation dataset to measure the performances, including the accuracy of industrial health indicator predictions and the inference speed.

Experimental and clinical studies of the pathophysiology and management of acute spinal cord injury.

Human-cyber-physical System for Operation in Nuclear Reactor Possessing Asymmetric Multi-Task Learning-Based Predicting Framework

Multivariate Deep Reconstruction Neural Network for Multi-step-ahead Prediction of Industrial Process Quality Variables

Deep Neural Network-Embedded Stochastic Nonlinear State-Space Models and Their Applications to Process Monitoring

Prediction of human initial operation situation in confined space with a multi-task deep neural network

Human-machine Interface for a Master-Slave Hydraulic Manipulator with Vision Enhancement and Auditory Feedback

Operational time-series data modeling via LSTM network integrating principal component analysis based on human experience

An Attention Mechanism Oriented Hybrid CNN-RNN Deep Learning Architecture of Container Terminal Liner Handling Conditions Prediction

A Multi-Step Sequence-to-Sequence Model with Attention LSTM Neural Networks for Industrial Soft Sensor Application

Multi-Sensor Prognostics using an Unsupervised Health Index based on LSTM Encoder-Decoder

GAN-Based Multi-Task Learning Approach for Prognostics and Health Management of IIoT

A multi-task analysis and modelling paradigm using LSTM for multi-source monitoring data of inland vessels

Smart industrial IoT empowered crowd sensing for safety monitoring in coal mine

Human factors engineering simulated analysis in administrative, operational and maintenance loops of nuclear reactor control unit using artificial intelligence and machine learning techniques

Human risk recognition and prediction in manned submersible diving tasks driven by deep learning models

MALS-Net: A Multi-Head Attention-Based LSTM Sequence-to-Sequence Network for Socio-Temporal Interaction Modelling and Trajectory Prediction

Long-Short-Term-Memory-Based Deep Stacked Sequence-to-Sequence Autoencoder for Health Prediction of Industrial Workers in Closed Environments Based on Wearable Devices

Nonintrusive Load Monitoring Based on Sequence-to-sequence Model with Attention Mechanism

Condition assessment and predictive maintenance for contact probe using health index and encoder‐decoder LSTM model

Regulation of drosophila folylpolyglutamates during development

MCTAN: A Novel Multichannel Temporal Attention-Based Network for Industrial Health Indicator Prediction