Electricity Data Quality Enhancement Strategy Based on Low-Rank Matrix Recovery
Electricity consumption data form the foundation for the efficient and reliable operation of smart grids and are a critical component for ensuring effective data mining. However, due to factors such as meter failures and extreme weather conditions, anomalies frequently occur in the data, which adver...
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2025-02-01
|
| Series: | Energies |
| Subjects: | |
| Online Access: | https://www.mdpi.com/1996-1073/18/4/944 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850082090693951488 |
|---|---|
| author | Guo Xu Xinliang Teng Lei Zhang Jianjun Xu |
| author_facet | Guo Xu Xinliang Teng Lei Zhang Jianjun Xu |
| author_sort | Guo Xu |
| collection | DOAJ |
| description | Electricity consumption data form the foundation for the efficient and reliable operation of smart grids and are a critical component for ensuring effective data mining. However, due to factors such as meter failures and extreme weather conditions, anomalies frequently occur in the data, which adversely impact the performance of data-driven applications. Given the near full-rank nature of low-voltage distribution area electricity consumption data, this paper employs clustering to enhance the low-rank property of the data. Addressing common issues such as missing data, sparse noise, and Gaussian noise in electricity consumption data, this paper proposes a multi-norm optimization model based on low-rank matrix theory. Specifically, the truncated nuclear norm is used as an approximation of matrix rank, while the <inline-formula><math xmlns="http://www.w3.org/1998/Math/MathML" display="inline"><semantics><msub><mi>L</mi><mn>1</mn></msub></semantics></math></inline-formula>-norm and <i>F</i>-norm are employed to constrain sparse noise and Gaussian noise, respectively. The model is solved using the Alternating Direction Method of Multipliers (ADMM), achieving a unified framework for handling missing data and noise processing within the model construction. Comparative experiments on both synthetic and real-world datasets demonstrate that the proposed method can accurately recover measurement data under various noise contamination scenarios and different distributions of missing data. Moreover, it effectively separates principal components of the data from noise contamination. |
| format | Article |
| id | doaj-art-443f470471ba413c9c8fa2cdbf0d7563 |
| institution | DOAJ |
| issn | 1996-1073 |
| language | English |
| publishDate | 2025-02-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Energies |
| spelling | doaj-art-443f470471ba413c9c8fa2cdbf0d75632025-08-20T02:44:35ZengMDPI AGEnergies1996-10732025-02-0118494410.3390/en18040944Electricity Data Quality Enhancement Strategy Based on Low-Rank Matrix RecoveryGuo Xu0Xinliang Teng1Lei Zhang2Jianjun Xu3School of Electrical Engineering and Information, Northeast Petroleum University, Ranghu Road, Daqing 163318, ChinaSchool of Electrical Engineering and Information, Northeast Petroleum University, Ranghu Road, Daqing 163318, ChinaCollege of Electronic Engineering, Nanjing Xiaozhuang University, Hongjing Avenue, Nanjing 211171, ChinaSchool of Electrical Engineering and Information, Northeast Petroleum University, Ranghu Road, Daqing 163318, ChinaElectricity consumption data form the foundation for the efficient and reliable operation of smart grids and are a critical component for ensuring effective data mining. However, due to factors such as meter failures and extreme weather conditions, anomalies frequently occur in the data, which adversely impact the performance of data-driven applications. Given the near full-rank nature of low-voltage distribution area electricity consumption data, this paper employs clustering to enhance the low-rank property of the data. Addressing common issues such as missing data, sparse noise, and Gaussian noise in electricity consumption data, this paper proposes a multi-norm optimization model based on low-rank matrix theory. Specifically, the truncated nuclear norm is used as an approximation of matrix rank, while the <inline-formula><math xmlns="http://www.w3.org/1998/Math/MathML" display="inline"><semantics><msub><mi>L</mi><mn>1</mn></msub></semantics></math></inline-formula>-norm and <i>F</i>-norm are employed to constrain sparse noise and Gaussian noise, respectively. The model is solved using the Alternating Direction Method of Multipliers (ADMM), achieving a unified framework for handling missing data and noise processing within the model construction. Comparative experiments on both synthetic and real-world datasets demonstrate that the proposed method can accurately recover measurement data under various noise contamination scenarios and different distributions of missing data. Moreover, it effectively separates principal components of the data from noise contamination.https://www.mdpi.com/1996-1073/18/4/944low-rank matrix recoverytruncated nuclear normmulti-norm optimizationalternating direction multiplier methodclusteringelectricity data |
| spellingShingle | Guo Xu Xinliang Teng Lei Zhang Jianjun Xu Electricity Data Quality Enhancement Strategy Based on Low-Rank Matrix Recovery Energies low-rank matrix recovery truncated nuclear norm multi-norm optimization alternating direction multiplier method clustering electricity data |
| title | Electricity Data Quality Enhancement Strategy Based on Low-Rank Matrix Recovery |
| title_full | Electricity Data Quality Enhancement Strategy Based on Low-Rank Matrix Recovery |
| title_fullStr | Electricity Data Quality Enhancement Strategy Based on Low-Rank Matrix Recovery |
| title_full_unstemmed | Electricity Data Quality Enhancement Strategy Based on Low-Rank Matrix Recovery |
| title_short | Electricity Data Quality Enhancement Strategy Based on Low-Rank Matrix Recovery |
| title_sort | electricity data quality enhancement strategy based on low rank matrix recovery |
| topic | low-rank matrix recovery truncated nuclear norm multi-norm optimization alternating direction multiplier method clustering electricity data |
| url | https://www.mdpi.com/1996-1073/18/4/944 |
| work_keys_str_mv | AT guoxu electricitydataqualityenhancementstrategybasedonlowrankmatrixrecovery AT xinliangteng electricitydataqualityenhancementstrategybasedonlowrankmatrixrecovery AT leizhang electricitydataqualityenhancementstrategybasedonlowrankmatrixrecovery AT jianjunxu electricitydataqualityenhancementstrategybasedonlowrankmatrixrecovery |