Data Quality Improvement Method for Power Equipment Condition Based on Stacked Denoising Autoencoders Improved by Particle Swarm Optimization
Big data related to power equipment condition is experiencing explosive growth. However, equipment failures and personnel errors result in dirty data, having a negative effect on data quality and subsequent analysis results. Therefore, data cleaning is of great significance. Most existing research f...
Saved in:
| Main Author: | |
|---|---|
| Format: | Article |
| Language: | zho |
| Published: |
Editorial Office of Journal of Shanghai Jiao Tong University
2025-06-01
|
| Series: | Shanghai Jiaotong Daxue xuebao |
| Subjects: | |
| Online Access: | https://xuebao.sjtu.edu.cn/article/2025/1006-2467/1006-2467-59-6-780.shtml |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849421347899310080 |
|---|---|
| author | JI Rong, HOU Huijuan, SHENG Gehao, ZHANG Lijing, SHU Bo, JIANG Xiuchen |
| author_facet | JI Rong, HOU Huijuan, SHENG Gehao, ZHANG Lijing, SHU Bo, JIANG Xiuchen |
| author_sort | JI Rong, HOU Huijuan, SHENG Gehao, ZHANG Lijing, SHU Bo, JIANG Xiuchen |
| collection | DOAJ |
| description | Big data related to power equipment condition is experiencing explosive growth. However, equipment failures and personnel errors result in dirty data, having a negative effect on data quality and subsequent analysis results. Therefore, data cleaning is of great significance. Most existing research focuses on direct identification and elimination of abnormal data, which compromises the integrity of the data. In order to solve this problem, a data cleaning method based on improved stack noise reduction autoencoder is proposed in this paper. First, particle swarm optimization is used to optimize the hyperparameters of the stack noise reduction autoencoder. Then, the characteristics of the autoencoder is used to extract and restore the data features to clean the data. The method improves data quality of power equipment condition by repairing isolated data points and filling in missing data, which is simple and efficient for improving the accuracy and integrity of the data set. Finally, the historical operation data of power equipment is taken as an example. The simulation results show that the proposed method outperforms other classical methods providing good cleaning results for data sets with different abnormal degrees in different running states. The proposed method offers an effective solution for improving the quality of power equipment status data effectively. |
| format | Article |
| id | doaj-art-a9b9c95033014d53b01068f2d1ca54df |
| institution | Kabale University |
| issn | 1006-2467 |
| language | zho |
| publishDate | 2025-06-01 |
| publisher | Editorial Office of Journal of Shanghai Jiao Tong University |
| record_format | Article |
| series | Shanghai Jiaotong Daxue xuebao |
| spelling | doaj-art-a9b9c95033014d53b01068f2d1ca54df2025-08-20T03:31:30ZzhoEditorial Office of Journal of Shanghai Jiao Tong UniversityShanghai Jiaotong Daxue xuebao1006-24672025-06-0159678078810.16183/j.cnki.jsjtu.2023.388Data Quality Improvement Method for Power Equipment Condition Based on Stacked Denoising Autoencoders Improved by Particle Swarm OptimizationJI Rong, HOU Huijuan, SHENG Gehao, ZHANG Lijing, SHU Bo, JIANG Xiuchen0a. College of Smart Energy; b. Department of Electrical Engineering, Shanghai Jiao Tong University, Shanghai 200240, ChinaBig data related to power equipment condition is experiencing explosive growth. However, equipment failures and personnel errors result in dirty data, having a negative effect on data quality and subsequent analysis results. Therefore, data cleaning is of great significance. Most existing research focuses on direct identification and elimination of abnormal data, which compromises the integrity of the data. In order to solve this problem, a data cleaning method based on improved stack noise reduction autoencoder is proposed in this paper. First, particle swarm optimization is used to optimize the hyperparameters of the stack noise reduction autoencoder. Then, the characteristics of the autoencoder is used to extract and restore the data features to clean the data. The method improves data quality of power equipment condition by repairing isolated data points and filling in missing data, which is simple and efficient for improving the accuracy and integrity of the data set. Finally, the historical operation data of power equipment is taken as an example. The simulation results show that the proposed method outperforms other classical methods providing good cleaning results for data sets with different abnormal degrees in different running states. The proposed method offers an effective solution for improving the quality of power equipment status data effectively.https://xuebao.sjtu.edu.cn/article/2025/1006-2467/1006-2467-59-6-780.shtmlpower equipmentstatus datastacked denoising autoencoderdata cleaning |
| spellingShingle | JI Rong, HOU Huijuan, SHENG Gehao, ZHANG Lijing, SHU Bo, JIANG Xiuchen Data Quality Improvement Method for Power Equipment Condition Based on Stacked Denoising Autoencoders Improved by Particle Swarm Optimization Shanghai Jiaotong Daxue xuebao power equipment status data stacked denoising autoencoder data cleaning |
| title | Data Quality Improvement Method for Power Equipment Condition Based on Stacked Denoising Autoencoders Improved by Particle Swarm Optimization |
| title_full | Data Quality Improvement Method for Power Equipment Condition Based on Stacked Denoising Autoencoders Improved by Particle Swarm Optimization |
| title_fullStr | Data Quality Improvement Method for Power Equipment Condition Based on Stacked Denoising Autoencoders Improved by Particle Swarm Optimization |
| title_full_unstemmed | Data Quality Improvement Method for Power Equipment Condition Based on Stacked Denoising Autoencoders Improved by Particle Swarm Optimization |
| title_short | Data Quality Improvement Method for Power Equipment Condition Based on Stacked Denoising Autoencoders Improved by Particle Swarm Optimization |
| title_sort | data quality improvement method for power equipment condition based on stacked denoising autoencoders improved by particle swarm optimization |
| topic | power equipment status data stacked denoising autoencoder data cleaning |
| url | https://xuebao.sjtu.edu.cn/article/2025/1006-2467/1006-2467-59-6-780.shtml |
| work_keys_str_mv | AT jironghouhuijuanshenggehaozhanglijingshubojiangxiuchen dataqualityimprovementmethodforpowerequipmentconditionbasedonstackeddenoisingautoencodersimprovedbyparticleswarmoptimization |