Explore deep auto-coder and big data learning to hard drive failure prediction: a two-level semi-supervised model

Predicting impending failure of hard disk drives (HDDs) is crucial to avoid losing essential data and service downtime. However, most HDD failure prediction is being challenged by using labelled data itself to evaluate failure rate, while the fact that HDDs deteriorate gradually cannot be described...

Full description

Saved in:
Bibliographic Details
Main Authors: Yan Ding, Yunan Zhai, Yujuan Zhai, Jia Zhao
Format: Article
Language:English
Published: Taylor & Francis Group 2022-12-01
Series:Connection Science
Subjects:
Online Access:http://dx.doi.org/10.1080/09540091.2021.2008320
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Predicting impending failure of hard disk drives (HDDs) is crucial to avoid losing essential data and service downtime. However, most HDD failure prediction is being challenged by using labelled data itself to evaluate failure rate, while the fact that HDDs deteriorate gradually cannot be described and exploited suitably. Most works on the Self-Monitoring and Reporting Technology (SMART) system attributes utilize simple and traditional methods from machine learning and statistics to achieve HDD failure prediction. So, we propose a novel two-level prediction model Dab, hard Drive failure prediction based on deep Auto-coder and Big data learning, to exploit SMART data for better online HDD failure prediction, constructing detection sub-models of anomaly and health degree. With better accuracy, better performance, better prediction earnings, and proactive fault tolerance, Dab has reduced false alarm rate (FAR) and maintenance cost, and improved failure detection rate (FDR), reliability and robustness of large-scale storage systems.
ISSN:0954-0091
1360-0494