Articles | Volume 26, issue 23
https://doi.org/10.5194/hess-26-6137-2022
© Author(s) 2022. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
https://doi.org/10.5194/hess-26-6137-2022
© Author(s) 2022. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Technical Note: Space–time statistical quality control of extreme precipitation observations
Abbas El Hachem
CORRESPONDING AUTHOR
Institute for Modelling Hydraulic and Environmental Systems, University of Stuttgart, 70569 Stuttgart, Germany
Jochen Seidel
Institute for Modelling Hydraulic and Environmental Systems, University of Stuttgart, 70569 Stuttgart, Germany
Florian Imbery
Deutscher Wetterdienst, Offenbach, Germany
Thomas Junghänel
Deutscher Wetterdienst, Offenbach, Germany
András Bárdossy
Institute for Modelling Hydraulic and Environmental Systems, University of Stuttgart, 70569 Stuttgart, Germany
Related authors
Abbas El Hachem, Jochen Seidel, and András Bárdossy
Hydrol. Earth Syst. Sci., 29, 1335–1357, https://doi.org/10.5194/hess-29-1335-2025, https://doi.org/10.5194/hess-29-1335-2025, 2025
Short summary
Short summary
The influence of climate change on areal precipitation extremes is examined. After an upscaling of reference observations, the climate model data are corrected, and a downscaling to a finer spatial scale is done. For different temporal durations and spatial scales, areal precipitation extremes are derived. The final result indicates an increase in the expected rainfall depth compared to reference values. However, the increase varied with the duration and area size.
Abbas El Hachem, Jochen Seidel, Tess O'Hara, Roberto Villalobos Herrera, Aart Overeem, Remko Uijlenhoet, András Bárdossy, and Lotte de Vos
Hydrol. Earth Syst. Sci., 28, 4715–4731, https://doi.org/10.5194/hess-28-4715-2024, https://doi.org/10.5194/hess-28-4715-2024, 2024
Short summary
Short summary
This study presents an overview of open-source quality control (QC) algorithms for rainfall data from personal weather stations (PWSs). The methodology and usability along technical and operational guidelines for using every QC algorithm are presented. All three QC algorithms are available for users to explore in the OpenSense sandbox. They were applied in a case study using PWS data from the Amsterdam region in the Netherlands. The results highlight the necessity for data quality control.
András Bárdossy, Jochen Seidel, and Abbas El Hachem
Hydrol. Earth Syst. Sci., 25, 583–601, https://doi.org/10.5194/hess-25-583-2021, https://doi.org/10.5194/hess-25-583-2021, 2021
Short summary
Short summary
In this study, the applicability of data from private weather stations (PWS) for precipitation interpolation was investigated. Due to unknown errors and biases in these observations, a two-step filter was developed that uses indicator correlations and event-based spatial precipitation patterns. The procedure was tested and cross validated for the state of Baden-Württemberg (Germany). The biggest improvement is achieved for the shortest time aggregations.
Abbas El Hachem, Jochen Seidel, and András Bárdossy
Hydrol. Earth Syst. Sci., 29, 1335–1357, https://doi.org/10.5194/hess-29-1335-2025, https://doi.org/10.5194/hess-29-1335-2025, 2025
Short summary
Short summary
The influence of climate change on areal precipitation extremes is examined. After an upscaling of reference observations, the climate model data are corrected, and a downscaling to a finer spatial scale is done. For different temporal durations and spatial scales, areal precipitation extremes are derived. The final result indicates an increase in the expected rainfall depth compared to reference values. However, the increase varied with the duration and area size.
Sanika Baste, Daniel Klotz, Eduardo Acuña Espinoza, Andras Bardossy, and Ralf Loritz
EGUsphere, https://doi.org/10.5194/egusphere-2025-425, https://doi.org/10.5194/egusphere-2025-425, 2025
Short summary
Short summary
This study evaluates the extrapolation performance of Long Short-Term Memory (LSTM) networks in rainfall-runoff modeling, specifically under extreme conditions. The findings reveal that the LSTM cannot predict discharge values beyond a theoretical limit, which is well below the extremity of its training data. This behavior results from the LSTM's gating structures rather than saturation of cell states alone.
Abbas El Hachem, Jochen Seidel, Tess O'Hara, Roberto Villalobos Herrera, Aart Overeem, Remko Uijlenhoet, András Bárdossy, and Lotte de Vos
Hydrol. Earth Syst. Sci., 28, 4715–4731, https://doi.org/10.5194/hess-28-4715-2024, https://doi.org/10.5194/hess-28-4715-2024, 2024
Short summary
Short summary
This study presents an overview of open-source quality control (QC) algorithms for rainfall data from personal weather stations (PWSs). The methodology and usability along technical and operational guidelines for using every QC algorithm are presented. All three QC algorithms are available for users to explore in the OpenSense sandbox. They were applied in a case study using PWS data from the Amsterdam region in the Netherlands. The results highlight the necessity for data quality control.
Amy C. Green, Chris Kilsby, and András Bárdossy
Hydrol. Earth Syst. Sci., 28, 4539–4558, https://doi.org/10.5194/hess-28-4539-2024, https://doi.org/10.5194/hess-28-4539-2024, 2024
Short summary
Short summary
Weather radar is a crucial tool in rainfall estimation, but radar rainfall estimates are subject to many error sources, with the true rainfall field unknown. A flexible model for simulating errors relating to the radar rainfall estimation process is implemented, inverting standard processing methods. This flexible and efficient model performs well in generating realistic weather radar images visually for a large range of event types.
András Bárdossy and Faizan Anwar
Hydrol. Earth Syst. Sci., 27, 1987–2000, https://doi.org/10.5194/hess-27-1987-2023, https://doi.org/10.5194/hess-27-1987-2023, 2023
Short summary
Short summary
This study demonstrates the fact that the large river flows forecasted by the models show an underestimation that is inversely related to the number of locations where precipitation is recorded, which is independent of the model. The higher the number of points where the amount of precipitation is recorded, the better the estimate of the river flows.
Dhiraj Raj Gyawali and András Bárdossy
Hydrol. Earth Syst. Sci., 26, 3055–3077, https://doi.org/10.5194/hess-26-3055-2022, https://doi.org/10.5194/hess-26-3055-2022, 2022
Short summary
Short summary
In this study, different extensions of the degree-day model were calibrated on snow-cover distribution against freely available satellite snow-cover images. The calibrated models simulated the distribution very well in Baden-Württemberg (Germany) and Switzerland. In addition to reliable identification of snow cover, the melt outputs from the calibrated models were able to improve the flow simulations in different catchments in the study region.
Jieru Yan, Fei Li, András Bárdossy, and Tao Tao
Hydrol. Earth Syst. Sci., 25, 3819–3835, https://doi.org/10.5194/hess-25-3819-2021, https://doi.org/10.5194/hess-25-3819-2021, 2021
Short summary
Short summary
Accurate spatial precipitation estimates are important in various fields. An approach to simulate spatial rainfall fields conditioned on radar and rain gauge data is proposed. Unlike the commonly used Kriging methods, which provide a Kriged mean field, the output of the proposed approach is an ensemble of estimates that represents the estimation uncertainty. The approach is robust to nonlinear error in radar estimates and is shown to have some advantages, especially when estimating the extremes.
András Bárdossy, Jochen Seidel, and Abbas El Hachem
Hydrol. Earth Syst. Sci., 25, 583–601, https://doi.org/10.5194/hess-25-583-2021, https://doi.org/10.5194/hess-25-583-2021, 2021
Short summary
Short summary
In this study, the applicability of data from private weather stations (PWS) for precipitation interpolation was investigated. Due to unknown errors and biases in these observations, a two-step filter was developed that uses indicator correlations and event-based spatial precipitation patterns. The procedure was tested and cross validated for the state of Baden-Württemberg (Germany). The biggest improvement is achieved for the shortest time aggregations.
Cited articles
Bárdossy, A. and Kundzewicz, Z.: Geostatistical methods for detection of
outliers in groundwater quality spatial fields, J. Hydrol., 115, 343–359, https://doi.org/10.1016/0022-1694(90)90213-H, 1990. a, b
Barnett, V. and Lewis, T.: Outliers in statistical data, John Wiley and Sons, Hoboken, NJ, ISBN 978-0-471-93094-5, 1994. a
Bayerisches Landesamt für Umwelt (lfu Bayern): Landesmessnetz Wasserstand und Abfluss, https://www.gkd.bayern.de, last access: 7 October 2020. a
Bayerisches Landesamt für Umwelt: Wasserstand und Abfluss,
https://www.lfu.bayern.de/wasser/wasserstand_abfluss/index.htm (last access: 1 September 2020), 2022. a
Burkardt, J.: The truncated normal distribution, Department of Scientific
Computing Website, Florida State University, 1, 35,
https://people.sc.fsu.edu/~jburkardt/presentations/truncated_normal.pdf (last access: 1 June 2022), 2014. a
Durre, I., Menne, M. J., Gleason, B. E., Houston, T. G., and Vose, R. S.:
Comprehensive automated quality assurance of daily surface observations, J. Appl. Meteorol. Clim., 49, 1615–1633, 2010. a
DWD Climate Data Center (CDC): Historical hourly RADOLAN grids of precipitation depth (GIS-readable), version 2.5, https://opendata.dwd.de/climate_environment/CDC/grids_germany/hourly/radolan/historical/bin/ (last access: 1 June 2022), 2021a. a
DWD Climate Data Center (CDC): Historical hourly station observations of precipitation for Germany, version v21.3, https://opendata.dwd.de/climate_environment/CDC (last access: 15 September 2022), 2021b. a
El Hachem, A.: AbbasElHachem/qcpcp: Data and code used in the HESS paper (Technical Note: Space-Time Statistical Quality Control of Extreme Precipitation Observations), Zenodo [code], https://doi.org/10.5281/zenodo.7310836, 2022. a
Hawkins, D. M.: Identification of outliers, Springer, Dordrecht,
https://doi.org/10.1007/978-94-015-3994-4, 1980. a
Hubbard, K., Goddard, S., Sorensen, W., Wells, N., and Osugi, T.: Performance
of quality assurance procedures for an applied climate information system, J. Atmos. Ocean. Tech., 22, 105–112, 2005. a
Iglewicz, B. and Hoaglin, D.: The ASQC basic references in quality control:
statistical techniques, in: How to detect and handle outliers, vol. 16, edited by: Mykytka, E., ASQC Quality Press, Milwaukee, WI, 1–87, ISBN 9780873892476, 1993. a
Ingleby, N. B. and Lorenc, A. C.: Bayesian quality control using multivariate
normal distributions, Q. J. Roy. Meteorol. Soc., 119, 1195–1225, 1993. a
Kaspar, F., Müller-Westermeier, G., Penda, E., Mächel, H., Zimmermann, K., Kaiser-Weiss, A., and Deutschländer, T.: Monitoring of climate change in Germany – data, products and services of Germany's National Climate Data Centre, Adv. Sci. Res., 10, 99–106,
https://doi.org/10.5194/asr-10-99-2013, 2013. a
Klemeš, V.: Tall tales about tails of hydrological distributions. I, J. Hydrol. Eng., 5, 227–231, 2000. a
Krige, D. G.: A statistical approach to some basic mine valuation problems on
the Witwatersrand, J. S. Afr. Inst. Min. Metallurg., 52, 119–139, 1951. a
Lebrenz, H. and Bárdossy, A.: Geostatistical interpolation by quantile kriging, Hydrol. Earth Syst. Sci., 23, 1633–1648, https://doi.org/10.5194/hess-23-1633-2019, 2019. a
Matheron, G.: Traité de géostatistique appliquée, Vol. 14 of
Mémoires du Bureau de Recherches Géologiques et Minières,
Editions Technip, Paris, http://cg.ensmp.fr/bibliotheque/public/MATHERON_Publication_02396.pdf (last access 6 January 2021), 1962. a
Qi, Y., Martinaitis, S., Zhang, J., and Cocks, S.: A real-time automated
quality control of hourly rain gauge data based on multiple sensors in MRMS
system, J. Hydrometeorol., 17, 1675–1691, 2016. a
Quenouille, M. H.: Approximate tests of correlation in time-series, J. Roy. Stat. Soc. Ser. B, 11, 68–84, 1949. a
Quenouille, M. H.: Notes on Bias in Estimation, Biometrika, 43, 353–360, 1956. a
Spengler, R.: The new quality control and monitoring system of the Deutscher
Wetterdienst, in: vol. 330, Proceedings of the WMO Technical Conference on Meteorological and Environmental Instruments and Methods of Observation, Bratislava, Slovak Republic, 2(1), 23–25 September 2002. a
Yu, W., Ai, T., and Shao, S.: The analysis and delimitation of Central Business District using network kernel density estimation, J. Transp. Geogr., 45, 32–47, 2015. a
Short summary
Through this work, a methodology to identify outliers in intense precipitation data was presented. The results show the presence of several suspicious observations that strongly differ from their surroundings. Many identified outliers did not have unusually high values but disagreed with their neighboring values at the corresponding time steps. Weather radar and discharge data were used to distinguish between single events and false observations.
Through this work, a methodology to identify outliers in intense precipitation data was...