Intelligent quality control method for marine buoy data based on transformer encoder and BiLSTM
Ocean moored buoys are essential ocean monitoring devices that are permanently moored in the sea to collect real-time hydrological and meteorological data. In response to the anomalies and missing data in datasets collected from ocean moored buoys, this paper innovatively established an intelligent...
Saved in:
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2025-04-01
|
| Series: | Frontiers in Marine Science |
| Subjects: | |
| Online Access: | https://www.frontiersin.org/articles/10.3389/fmars.2025.1528587/full |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849310686825414656 |
|---|---|
| author | Miaomiao Song Miaomiao Song Miaomiao Song Saiyu Gao Saiyu Gao Shixuan Liu Shixuan Liu Shixuan Liu Yuzhe Xu Yuzhe Xu Yuzhe Xu Shizhe Chen Jiming Zhang Jiming Zhang Jiming Zhang Wenqing Li Wenqing Li Wenqing Li Keke Zhang Keke Zhang Keke Zhang Xiao Fu Xiao Fu Xiao Fu |
| author_facet | Miaomiao Song Miaomiao Song Miaomiao Song Saiyu Gao Saiyu Gao Shixuan Liu Shixuan Liu Shixuan Liu Yuzhe Xu Yuzhe Xu Yuzhe Xu Shizhe Chen Jiming Zhang Jiming Zhang Jiming Zhang Wenqing Li Wenqing Li Wenqing Li Keke Zhang Keke Zhang Keke Zhang Xiao Fu Xiao Fu Xiao Fu |
| author_sort | Miaomiao Song |
| collection | DOAJ |
| description | Ocean moored buoys are essential ocean monitoring devices that are permanently moored in the sea to collect real-time hydrological and meteorological data. In response to the anomalies and missing data in datasets collected from ocean moored buoys, this paper innovatively established an intelligent quality control Transformer-Encoder-BiLSTM model. This model can impute missing data and identify anomalies in buoy datasets. The model first uses the multi-head attention mechanism of the Transformer Encoder to extract global features from time-series data of buoy observations. Subsequently, it utilizes the BiLSTM network for temporal reasoning training to capture dynamic changes within the time series, predicted data. Finally, using the predicted data as a benchmark, the model conducts anomaly detection, fills in missing values, and rectifies stuck values. We conducted a series of comprehensive experiments, with the data from Buoy No. 0199 in Qingdao, China as an illustrative example. The experimental results indicate that the performance indicator R² of the model is above 0.9, the accuracy of quality control is above 97%, while both precision and recall are above 84%. The F1 scores range between 81.61% and 90.09%. These experiments demonstrate that this method exhibits high accuracy and efficiency in filling in missing data, rectifying stuck values and identifying anomalous data, showing broad application potential. |
| format | Article |
| id | doaj-art-c1776db984054b2aaf80ae307a1e8b7c |
| institution | Kabale University |
| issn | 2296-7745 |
| language | English |
| publishDate | 2025-04-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Marine Science |
| spelling | doaj-art-c1776db984054b2aaf80ae307a1e8b7c2025-08-20T03:53:39ZengFrontiers Media S.A.Frontiers in Marine Science2296-77452025-04-011210.3389/fmars.2025.15285871528587Intelligent quality control method for marine buoy data based on transformer encoder and BiLSTMMiaomiao Song0Miaomiao Song1Miaomiao Song2Saiyu Gao3Saiyu Gao4Shixuan Liu5Shixuan Liu6Shixuan Liu7Yuzhe Xu8Yuzhe Xu9Yuzhe Xu10Shizhe Chen11Jiming Zhang12Jiming Zhang13Jiming Zhang14Wenqing Li15Wenqing Li16Wenqing Li17Keke Zhang18Keke Zhang19Keke Zhang20Xiao Fu21Xiao Fu22Xiao Fu23Institute of Oceanographic Instrumentation, Qilu University of Technology (Shandong Academy of Sciences), Qingdao, ChinaLaoshan Laboratory, Qingdao, ChinaSchool of Ocean Technology Sciences, Qilu University of Technology (Shandong Academy of Sciences), Qingdao, ChinaInstitute of Oceanographic Instrumentation, Qilu University of Technology (Shandong Academy of Sciences), Qingdao, ChinaSchool of Ocean Technology Sciences, Qilu University of Technology (Shandong Academy of Sciences), Qingdao, ChinaInstitute of Oceanographic Instrumentation, Qilu University of Technology (Shandong Academy of Sciences), Qingdao, ChinaLaoshan Laboratory, Qingdao, ChinaSchool of Ocean Technology Sciences, Qilu University of Technology (Shandong Academy of Sciences), Qingdao, ChinaInstitute of Oceanographic Instrumentation, Qilu University of Technology (Shandong Academy of Sciences), Qingdao, ChinaLaoshan Laboratory, Qingdao, ChinaSchool of Ocean Technology Sciences, Qilu University of Technology (Shandong Academy of Sciences), Qingdao, ChinaLaoshan Laboratory, Qingdao, ChinaInstitute of Oceanographic Instrumentation, Qilu University of Technology (Shandong Academy of Sciences), Qingdao, ChinaLaoshan Laboratory, Qingdao, ChinaSchool of Ocean Technology Sciences, Qilu University of Technology (Shandong Academy of Sciences), Qingdao, ChinaInstitute of Oceanographic Instrumentation, Qilu University of Technology (Shandong Academy of Sciences), Qingdao, ChinaLaoshan Laboratory, Qingdao, ChinaSchool of Ocean Technology Sciences, Qilu University of Technology (Shandong Academy of Sciences), Qingdao, ChinaInstitute of Oceanographic Instrumentation, Qilu University of Technology (Shandong Academy of Sciences), Qingdao, ChinaLaoshan Laboratory, Qingdao, ChinaSchool of Ocean Technology Sciences, Qilu University of Technology (Shandong Academy of Sciences), Qingdao, ChinaInstitute of Oceanographic Instrumentation, Qilu University of Technology (Shandong Academy of Sciences), Qingdao, ChinaLaoshan Laboratory, Qingdao, ChinaSchool of Ocean Technology Sciences, Qilu University of Technology (Shandong Academy of Sciences), Qingdao, ChinaOcean moored buoys are essential ocean monitoring devices that are permanently moored in the sea to collect real-time hydrological and meteorological data. In response to the anomalies and missing data in datasets collected from ocean moored buoys, this paper innovatively established an intelligent quality control Transformer-Encoder-BiLSTM model. This model can impute missing data and identify anomalies in buoy datasets. The model first uses the multi-head attention mechanism of the Transformer Encoder to extract global features from time-series data of buoy observations. Subsequently, it utilizes the BiLSTM network for temporal reasoning training to capture dynamic changes within the time series, predicted data. Finally, using the predicted data as a benchmark, the model conducts anomaly detection, fills in missing values, and rectifies stuck values. We conducted a series of comprehensive experiments, with the data from Buoy No. 0199 in Qingdao, China as an illustrative example. The experimental results indicate that the performance indicator R² of the model is above 0.9, the accuracy of quality control is above 97%, while both precision and recall are above 84%. The F1 scores range between 81.61% and 90.09%. These experiments demonstrate that this method exhibits high accuracy and efficiency in filling in missing data, rectifying stuck values and identifying anomalous data, showing broad application potential.https://www.frontiersin.org/articles/10.3389/fmars.2025.1528587/fullocean moored buoydata quality controltransformer encoderBiLSTManomaly detectiondata correction |
| spellingShingle | Miaomiao Song Miaomiao Song Miaomiao Song Saiyu Gao Saiyu Gao Shixuan Liu Shixuan Liu Shixuan Liu Yuzhe Xu Yuzhe Xu Yuzhe Xu Shizhe Chen Jiming Zhang Jiming Zhang Jiming Zhang Wenqing Li Wenqing Li Wenqing Li Keke Zhang Keke Zhang Keke Zhang Xiao Fu Xiao Fu Xiao Fu Intelligent quality control method for marine buoy data based on transformer encoder and BiLSTM Frontiers in Marine Science ocean moored buoy data quality control transformer encoder BiLSTM anomaly detection data correction |
| title | Intelligent quality control method for marine buoy data based on transformer encoder and BiLSTM |
| title_full | Intelligent quality control method for marine buoy data based on transformer encoder and BiLSTM |
| title_fullStr | Intelligent quality control method for marine buoy data based on transformer encoder and BiLSTM |
| title_full_unstemmed | Intelligent quality control method for marine buoy data based on transformer encoder and BiLSTM |
| title_short | Intelligent quality control method for marine buoy data based on transformer encoder and BiLSTM |
| title_sort | intelligent quality control method for marine buoy data based on transformer encoder and bilstm |
| topic | ocean moored buoy data quality control transformer encoder BiLSTM anomaly detection data correction |
| url | https://www.frontiersin.org/articles/10.3389/fmars.2025.1528587/full |
| work_keys_str_mv | AT miaomiaosong intelligentqualitycontrolmethodformarinebuoydatabasedontransformerencoderandbilstm AT miaomiaosong intelligentqualitycontrolmethodformarinebuoydatabasedontransformerencoderandbilstm AT miaomiaosong intelligentqualitycontrolmethodformarinebuoydatabasedontransformerencoderandbilstm AT saiyugao intelligentqualitycontrolmethodformarinebuoydatabasedontransformerencoderandbilstm AT saiyugao intelligentqualitycontrolmethodformarinebuoydatabasedontransformerencoderandbilstm AT shixuanliu intelligentqualitycontrolmethodformarinebuoydatabasedontransformerencoderandbilstm AT shixuanliu intelligentqualitycontrolmethodformarinebuoydatabasedontransformerencoderandbilstm AT shixuanliu intelligentqualitycontrolmethodformarinebuoydatabasedontransformerencoderandbilstm AT yuzhexu intelligentqualitycontrolmethodformarinebuoydatabasedontransformerencoderandbilstm AT yuzhexu intelligentqualitycontrolmethodformarinebuoydatabasedontransformerencoderandbilstm AT yuzhexu intelligentqualitycontrolmethodformarinebuoydatabasedontransformerencoderandbilstm AT shizhechen intelligentqualitycontrolmethodformarinebuoydatabasedontransformerencoderandbilstm AT jimingzhang intelligentqualitycontrolmethodformarinebuoydatabasedontransformerencoderandbilstm AT jimingzhang intelligentqualitycontrolmethodformarinebuoydatabasedontransformerencoderandbilstm AT jimingzhang intelligentqualitycontrolmethodformarinebuoydatabasedontransformerencoderandbilstm AT wenqingli intelligentqualitycontrolmethodformarinebuoydatabasedontransformerencoderandbilstm AT wenqingli intelligentqualitycontrolmethodformarinebuoydatabasedontransformerencoderandbilstm AT wenqingli intelligentqualitycontrolmethodformarinebuoydatabasedontransformerencoderandbilstm AT kekezhang intelligentqualitycontrolmethodformarinebuoydatabasedontransformerencoderandbilstm AT kekezhang intelligentqualitycontrolmethodformarinebuoydatabasedontransformerencoderandbilstm AT kekezhang intelligentqualitycontrolmethodformarinebuoydatabasedontransformerencoderandbilstm AT xiaofu intelligentqualitycontrolmethodformarinebuoydatabasedontransformerencoderandbilstm AT xiaofu intelligentqualitycontrolmethodformarinebuoydatabasedontransformerencoderandbilstm AT xiaofu intelligentqualitycontrolmethodformarinebuoydatabasedontransformerencoderandbilstm |