Abstract:Hard Disk Drive (HDD) failures in datacenters are costly - from catastrophic data loss to a question of goodwill, stakeholders want to avoid it like the plague. An important tool in proactively monitoring against HDD failure is timely estimation of the Remaining Useful Life (RUL). To this end, the Self-Monitoring, Analysis and Reporting Technology employed within HDDs (S.M.A.R.T.) provide critical logs for long-term maintenance of the security and dependability of these essential data storage devices. Data-driven predictive models in the past have used these S.M.A.R.T. logs and CNN/RNN based architectures heavily. However, they have suffered significantly in providing a confidence interval around the predicted RUL values as well as in processing very long sequences of logs. In addition, some of these approaches, such as those based on LSTMs, are inherently slow to train and have tedious feature engineering overheads. To overcome these challenges, in this work we propose a novel transformer architecture - a Temporal-fusion Bi-encoder Self-attention Transformer (TFBEST) for predicting failures in hard-drives. It is an encoder-decoder based deep learning technique that enhances the context gained from understanding health statistics sequences and predicts a sequence of the number of days remaining before a disk potentially fails. In this paper, we also provide a novel confidence margin statistic that can help manufacturers replace a hard-drive within a time frame. Experiments on Seagate HDD data show that our method significantly outperforms the state-of-the-art RUL prediction methods during testing over the exhaustive 10-year data from Backblaze (2013-present). Although validated on HDD failure prediction, the TFBEST architecture is well-suited for other prognostics applications and may be adapted for allied regression problems.

DiskTransformer: A Transformer Network for Hard Disk Failure Prediction

A Failure Prediction Approach Based on BiLSTM and Deep Feature Extractor for Hard Disk Drives.

Fault Prediction for Distribution Network Based on CNN and LightGBM Algorithm

Hidformer: Hierarchical Dual-Tower Transformer Using Multi-Scale Mergence for Long-Term Time Series Forecasting

TFBEST: Dual-Aspect Transformer with Learnable Positional Encoding for Failure Prediction

Hard Drive Failure Prediction Using Big Data

Disk failure prediction based on multi-layer domain adaptive learning

ZTE-Predictor: Disk Failure Prediction System Based on LSTM

Hard drive failure prediction using Decision Trees

Hard Disk Failure Prediction Based on Lightgbm with CID.

Health Status Assessment and Failure Prediction for Hard Drives with Recurrent Neural Networks

Failure Prediction of Hard Disk Drives Based on Adaptive Rao–Blackwellized Particle Filter Error Tracking Method

Temporal-Contextual Attention Network for Solid-State Drive Failure Prediction in Data Centers

Temperature and Fault Prediction of Transformer in Distribution Station Based on Digital Twin Model

Remaining Useful Life Estimation of Hard Disk Drives using Bidirectional LSTM Networks

DGTL-Net: A Deep Generative Transfer Learning Network for Fault Diagnostics on New Hard Disks

Classification Based Hard Disk Drive Failure Prediction: Methodologies, Performance Evaluation and Comparison.

A New Method for Transformer Fault Prediction Based on Multifeature Enhancement and Refined Long Short-Term Memory

Global and local information integrated network for remaining useful life prediction

Collaborative Intelligent Prediction Method for Remaining Useful Life of Hard Disks Based on Heterogeneous Federated Transfer

Remaining lifespan prediction on multiple types of hard disks under conditions of data imbalance