Towards a Standard Benchmarking Framework for Domain Adaptation in Intelligent Fault Diagnosis
Domain shift is a major problem facing contemporary data-based intelligent fault diagnosis (IFD) solutions. While domain adaptation (DA) methods have been proposed to address this issue, standardizing DA benchmarks has not received much attention. Existing studies often use ad-hoc evaluation methods...
Saved in:
| Main Author: | |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2025-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10869441/ |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1823859599990587392 |
|---|---|
| author | Mohammed M. Farag |
| author_facet | Mohammed M. Farag |
| author_sort | Mohammed M. Farag |
| collection | DOAJ |
| description | Domain shift is a major problem facing contemporary data-based intelligent fault diagnosis (IFD) solutions. While domain adaptation (DA) methods have been proposed to address this issue, standardizing DA benchmarks has not received much attention. Existing studies often use ad-hoc evaluation methods with inconsistent dataset partitioning, labeling, and evaluation criteria. We propose an integrated benchmarking framework to bridge the gap between DA development and evaluation research. Our framework incorporates domain shift key factors such as operating conditions (OCs) and fault levels (FLs) into dataset partitioning, labeling, and evaluation phases. The fault dataset is split into distinct subsets using FLs and OCs as partitioning parameters, while maintaining the original diagnostic classification labels. The DA method is comprehensively evaluated under controlled conditions using permuted subset pairs of the partitioned dataset. The framework is applied to two popular datasets – the Case Western Reserve University (CWRU) and Paderborn University (PU) bearing fault datasets. We demonstrate the framework’s capabilities and application mechanisms using a CNN classifier and an adversarial DA algorithm. Benchmarking results reveal significant accuracy drops from 99% to 36% and 45% with variances of 15% and 20% for the CWRU and PU datasets, respectively, under controlled domain shift conditions. The proposed framework establishes a foundation for standardizing IFD DA benchmarks, bridging the gap between development and evaluation research. |
| format | Article |
| id | doaj-art-30da828e9f4949b1a8c296ed4625a143 |
| institution | Kabale University |
| issn | 2169-3536 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj-art-30da828e9f4949b1a8c296ed4625a1432025-02-11T00:00:42ZengIEEEIEEE Access2169-35362025-01-0113244262445310.1109/ACCESS.2025.353781710869441Towards a Standard Benchmarking Framework for Domain Adaptation in Intelligent Fault DiagnosisMohammed M. Farag0https://orcid.org/0000-0002-0739-3631Electrical Engineering Department, College of Engineering, King Faisal University, Al Ahsa, Saudi ArabiaDomain shift is a major problem facing contemporary data-based intelligent fault diagnosis (IFD) solutions. While domain adaptation (DA) methods have been proposed to address this issue, standardizing DA benchmarks has not received much attention. Existing studies often use ad-hoc evaluation methods with inconsistent dataset partitioning, labeling, and evaluation criteria. We propose an integrated benchmarking framework to bridge the gap between DA development and evaluation research. Our framework incorporates domain shift key factors such as operating conditions (OCs) and fault levels (FLs) into dataset partitioning, labeling, and evaluation phases. The fault dataset is split into distinct subsets using FLs and OCs as partitioning parameters, while maintaining the original diagnostic classification labels. The DA method is comprehensively evaluated under controlled conditions using permuted subset pairs of the partitioned dataset. The framework is applied to two popular datasets – the Case Western Reserve University (CWRU) and Paderborn University (PU) bearing fault datasets. We demonstrate the framework’s capabilities and application mechanisms using a CNN classifier and an adversarial DA algorithm. Benchmarking results reveal significant accuracy drops from 99% to 36% and 45% with variances of 15% and 20% for the CWRU and PU datasets, respectively, under controlled domain shift conditions. The proposed framework establishes a foundation for standardizing IFD DA benchmarks, bridging the gap between development and evaluation research.https://ieeexplore.ieee.org/document/10869441/Standard benchmarkdomain adaptationtransfer learningintelligent fault diagnosisbearing faults |
| spellingShingle | Mohammed M. Farag Towards a Standard Benchmarking Framework for Domain Adaptation in Intelligent Fault Diagnosis IEEE Access Standard benchmark domain adaptation transfer learning intelligent fault diagnosis bearing faults |
| title | Towards a Standard Benchmarking Framework for Domain Adaptation in Intelligent Fault Diagnosis |
| title_full | Towards a Standard Benchmarking Framework for Domain Adaptation in Intelligent Fault Diagnosis |
| title_fullStr | Towards a Standard Benchmarking Framework for Domain Adaptation in Intelligent Fault Diagnosis |
| title_full_unstemmed | Towards a Standard Benchmarking Framework for Domain Adaptation in Intelligent Fault Diagnosis |
| title_short | Towards a Standard Benchmarking Framework for Domain Adaptation in Intelligent Fault Diagnosis |
| title_sort | towards a standard benchmarking framework for domain adaptation in intelligent fault diagnosis |
| topic | Standard benchmark domain adaptation transfer learning intelligent fault diagnosis bearing faults |
| url | https://ieeexplore.ieee.org/document/10869441/ |
| work_keys_str_mv | AT mohammedmfarag towardsastandardbenchmarkingframeworkfordomainadaptationinintelligentfaultdiagnosis |