Accurate Rainfall Prediction Using GNSS PWV Based on Pre-Trained Transformer Model

With an increase in the intensity and frequency of extreme rainfall events, there is a pressing need for accurate rainfall nowcasting applications. In recent years, precipitable water vapor (PWV) data obtained from GNSS observations have been widely used in rainfall prediction. Unlike previous studi...

Full description

Saved in:
Bibliographic Details
Main Authors: Wenjie Yin, Chen Zhou, Yuan Tian, Hui Qiu, Wei Zhang, Hua Chen, Pan Liu, Qile Zhao, Jian Kong, Yibin Yao
Format: Article
Language:English
Published: MDPI AG 2025-06-01
Series:Remote Sensing
Subjects:
Online Access:https://www.mdpi.com/2072-4292/17/12/2023
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:With an increase in the intensity and frequency of extreme rainfall events, there is a pressing need for accurate rainfall nowcasting applications. In recent years, precipitable water vapor (PWV) data obtained from GNSS observations have been widely used in rainfall prediction. Unlike previous studies mainly focusing on rainfall occurrences, this study proposes a transformer-based model for hourly rainfall prediction, integrating the GNSS PWV and ERA5 meteorological data. The proposed model employs the ProbSparse self-attention to efficiently capture long-range dependencies in time series data, crucial for correlating historical PWV variations with rainfall events. Additionally, the adoption of the DILATE loss function better captures the structural and timing aspects of rainfall prediction. Furthermore, traditional rainfall prediction models are typically trained on datasets specific to one region, which limits their generalization ability due to regional meteorological differences and the scarcity of data in certain areas. Therefore, we adopt a pre-training and fine-tuning strategy using global datasets to mitigate data scarcity in newly deployed GNSS stations, enhancing model adaptability to local conditions. The evaluation results demonstrate satisfactory performance over other methods, with the fine-tuned model achieving an MSE = 3.954, DTW = 0.232, and TDI = 0.101. This approach shows great potential for real-time rainfall nowcasting in a local area, especially with limited data.
ISSN:2072-4292