Multi-spectral fusion power equipment fault recognition based on prompt learning
To address the issue of weak fault recognition ability of power equipment in single-spectrum images, a multi-spectral fusion recognition method based on prompt learning is proposed. A multi-spectral imaging system is used to capture images of normal and faulty power equipment, collecting multi-spect...
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | zho |
| Published: |
EDP Sciences
2025-04-01
|
| Series: | Xibei Gongye Daxue Xuebao |
| Subjects: | |
| Online Access: | https://www.jnwpu.org/articles/jnwpu/full_html/2025/02/jnwpu2025432p410/jnwpu2025432p410.html |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849335967472680960 |
|---|---|
| author | YAO Yiyang DU Zexing ZHOU Guoqing WANG Qing |
| author_facet | YAO Yiyang DU Zexing ZHOU Guoqing WANG Qing |
| author_sort | YAO Yiyang |
| collection | DOAJ |
| description | To address the issue of weak fault recognition ability of power equipment in single-spectrum images, a multi-spectral fusion recognition method based on prompt learning is proposed. A multi-spectral imaging system is used to capture images of normal and faulty power equipment, collecting multi-spectral data including visible light, infrared, and ultraviolet. The collected dataset is annotated with text labels for training the large model. The generalization ability of the large model in power equipment fault recognition is verified, and the original large model is tested on the collected dataset for device type and fault recognition. Trainable prompts based on infrared and ultraviolet images are designed for parameter updates. Throughout the training process, the parameters of the pre-trained large model remain fixed, and only the designed lightweight prompts are updated, significantly reducing the number of training parameters and alleviating the model's dependence on large-scale datasets. The proposed method is compared with several existing methods, and the results demonstrate that this approach can greatly improve the accuracy of power equipment fault recognition, achieving an accuracy of 90.14%. Ablation experiments and visual results further validate the effectiveness of the method. Additionally, the proposed method optimizes only a small number of trainable parameters, ensuring its efficiency. |
| format | Article |
| id | doaj-art-1ac068acf9cb4a139a2cee46e5a2a263 |
| institution | Kabale University |
| issn | 1000-2758 2609-7125 |
| language | zho |
| publishDate | 2025-04-01 |
| publisher | EDP Sciences |
| record_format | Article |
| series | Xibei Gongye Daxue Xuebao |
| spelling | doaj-art-1ac068acf9cb4a139a2cee46e5a2a2632025-08-20T03:45:07ZzhoEDP SciencesXibei Gongye Daxue Xuebao1000-27582609-71252025-04-0143241041710.1051/jnwpu/20254320410jnwpu2025432p410Multi-spectral fusion power equipment fault recognition based on prompt learningYAO Yiyang0DU Zexing1ZHOU Guoqing2WANG Qing3School of Computer Science, Northwestern Polytechnical UniversitySchool of Computer Science, Northwestern Polytechnical UniversitySchool of Computer Science, Northwestern Polytechnical UniversitySchool of Computer Science, Northwestern Polytechnical UniversityTo address the issue of weak fault recognition ability of power equipment in single-spectrum images, a multi-spectral fusion recognition method based on prompt learning is proposed. A multi-spectral imaging system is used to capture images of normal and faulty power equipment, collecting multi-spectral data including visible light, infrared, and ultraviolet. The collected dataset is annotated with text labels for training the large model. The generalization ability of the large model in power equipment fault recognition is verified, and the original large model is tested on the collected dataset for device type and fault recognition. Trainable prompts based on infrared and ultraviolet images are designed for parameter updates. Throughout the training process, the parameters of the pre-trained large model remain fixed, and only the designed lightweight prompts are updated, significantly reducing the number of training parameters and alleviating the model's dependence on large-scale datasets. The proposed method is compared with several existing methods, and the results demonstrate that this approach can greatly improve the accuracy of power equipment fault recognition, achieving an accuracy of 90.14%. Ablation experiments and visual results further validate the effectiveness of the method. Additionally, the proposed method optimizes only a small number of trainable parameters, ensuring its efficiency.https://www.jnwpu.org/articles/jnwpu/full_html/2025/02/jnwpu2025432p410/jnwpu2025432p410.html提示学习多模态融合电力设备故障识别 |
| spellingShingle | YAO Yiyang DU Zexing ZHOU Guoqing WANG Qing Multi-spectral fusion power equipment fault recognition based on prompt learning Xibei Gongye Daxue Xuebao 提示学习 多模态融合 电力设备 故障识别 |
| title | Multi-spectral fusion power equipment fault recognition based on prompt learning |
| title_full | Multi-spectral fusion power equipment fault recognition based on prompt learning |
| title_fullStr | Multi-spectral fusion power equipment fault recognition based on prompt learning |
| title_full_unstemmed | Multi-spectral fusion power equipment fault recognition based on prompt learning |
| title_short | Multi-spectral fusion power equipment fault recognition based on prompt learning |
| title_sort | multi spectral fusion power equipment fault recognition based on prompt learning |
| topic | 提示学习 多模态融合 电力设备 故障识别 |
| url | https://www.jnwpu.org/articles/jnwpu/full_html/2025/02/jnwpu2025432p410/jnwpu2025432p410.html |
| work_keys_str_mv | AT yaoyiyang multispectralfusionpowerequipmentfaultrecognitionbasedonpromptlearning AT duzexing multispectralfusionpowerequipmentfaultrecognitionbasedonpromptlearning AT zhouguoqing multispectralfusionpowerequipmentfaultrecognitionbasedonpromptlearning AT wangqing multispectralfusionpowerequipmentfaultrecognitionbasedonpromptlearning |