Homogenization of the Probability Distribution of Climatic Time Series: A Novel Algorithm

The aim of the homogenization of climatic time series is to remove non-climatic biases from the observed data, which are caused by technical or environmental changes during the period of observations. This bias removal is generally more successful for long-term trends and annual means than for month...

Full description

Saved in:
Bibliographic Details
Main Author: Peter Domonkos
Format: Article
Language:English
Published: MDPI AG 2025-05-01
Series:Atmosphere
Subjects:
Online Access:https://www.mdpi.com/2073-4433/16/5/616
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1850127576647860224
author Peter Domonkos
author_facet Peter Domonkos
author_sort Peter Domonkos
collection DOAJ
description The aim of the homogenization of climatic time series is to remove non-climatic biases from the observed data, which are caused by technical or environmental changes during the period of observations. This bias removal is generally more successful for long-term trends and annual means than for monthly and daily values. The homogenization of probability distribution (HPD) may improve data accuracy even for daily data when the signal-to-noise ratio favors its application. HPD can be performed by quantile matching or spatial interpolations, but both of them have drawbacks. This study presents a new algorithm which helps to increase homogenization accuracy in all temporal and spatial scales. The new method is similar to quantile matching, but section mean values of the probability distribution function (PDF) are compared instead of individual daily values. The input dataset of the algorithm is identical with the homogenization results for section means of the studied time series. The algorithm decides about statistical significance for each break detected during the homogenization of the section means, and skips the insignificant breaks. Correction terms for removing the inhomogeneity biases of PDF are calculated jointly by a Benova-like equation system, a low pass filter is used for smoothing the prime results, and the mean value of the input time series between two consecutive detected breaks is preserved for each of such sections. This initial version does not deal with seasonal variations either during HPD or in other steps of the homogenization. The method has been tested connecting HPD to ACMANTv5.3, and using overall 8 wind speed and relative humidity datasets of the benchmark of European project INDECIS. The results show 4 to 12 percent RMSE reduction by HPD in all temporal scales, except for the extreme tails where a part of the results are weaker.
format Article
id doaj-art-e997106a98d0481bbfdddee008b4c713
institution OA Journals
issn 2073-4433
language English
publishDate 2025-05-01
publisher MDPI AG
record_format Article
series Atmosphere
spelling doaj-art-e997106a98d0481bbfdddee008b4c7132025-08-20T02:33:38ZengMDPI AGAtmosphere2073-44332025-05-0116561610.3390/atmos16050616Homogenization of the Probability Distribution of Climatic Time Series: A Novel AlgorithmPeter Domonkos0Independent Researcher, 43500 Tortosa, SpainThe aim of the homogenization of climatic time series is to remove non-climatic biases from the observed data, which are caused by technical or environmental changes during the period of observations. This bias removal is generally more successful for long-term trends and annual means than for monthly and daily values. The homogenization of probability distribution (HPD) may improve data accuracy even for daily data when the signal-to-noise ratio favors its application. HPD can be performed by quantile matching or spatial interpolations, but both of them have drawbacks. This study presents a new algorithm which helps to increase homogenization accuracy in all temporal and spatial scales. The new method is similar to quantile matching, but section mean values of the probability distribution function (PDF) are compared instead of individual daily values. The input dataset of the algorithm is identical with the homogenization results for section means of the studied time series. The algorithm decides about statistical significance for each break detected during the homogenization of the section means, and skips the insignificant breaks. Correction terms for removing the inhomogeneity biases of PDF are calculated jointly by a Benova-like equation system, a low pass filter is used for smoothing the prime results, and the mean value of the input time series between two consecutive detected breaks is preserved for each of such sections. This initial version does not deal with seasonal variations either during HPD or in other steps of the homogenization. The method has been tested connecting HPD to ACMANTv5.3, and using overall 8 wind speed and relative humidity datasets of the benchmark of European project INDECIS. The results show 4 to 12 percent RMSE reduction by HPD in all temporal scales, except for the extreme tails where a part of the results are weaker.https://www.mdpi.com/2073-4433/16/5/616climate datatime serieshomogenizationquantile matchingACMANTHPDTS
spellingShingle Peter Domonkos
Homogenization of the Probability Distribution of Climatic Time Series: A Novel Algorithm
Atmosphere
climate data
time series
homogenization
quantile matching
ACMANT
HPDTS
title Homogenization of the Probability Distribution of Climatic Time Series: A Novel Algorithm
title_full Homogenization of the Probability Distribution of Climatic Time Series: A Novel Algorithm
title_fullStr Homogenization of the Probability Distribution of Climatic Time Series: A Novel Algorithm
title_full_unstemmed Homogenization of the Probability Distribution of Climatic Time Series: A Novel Algorithm
title_short Homogenization of the Probability Distribution of Climatic Time Series: A Novel Algorithm
title_sort homogenization of the probability distribution of climatic time series a novel algorithm
topic climate data
time series
homogenization
quantile matching
ACMANT
HPDTS
url https://www.mdpi.com/2073-4433/16/5/616
work_keys_str_mv AT peterdomonkos homogenizationoftheprobabilitydistributionofclimatictimeseriesanovelalgorithm