Articles | Volume 28, issue 23
https://doi.org/10.5194/hess-28-5149-2024
© Author(s) 2024. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
https://doi.org/10.5194/hess-28-5149-2024
© Author(s) 2024. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
An intercomparison of four gridded precipitation products over Europe using an extension of the three-cornered-hat method
ECMWF, Bonn, Germany
Thomas Haiden
ECMWF, Reading, UK
Matthieu Chevallier
ECMWF, Reading, UK
Related authors
Katherine Grayson, Stephan Thober, Aleksander Lacima-Nadolnik, Ivan Alsina-Ferrer, Llorenç Lledó, Ehsan Sharifi, and Francisco Doblas-Reyes
Geosci. Model Dev., 18, 5873–5890, https://doi.org/10.5194/gmd-18-5873-2025, https://doi.org/10.5194/gmd-18-5873-2025, 2025
Short summary
Short summary
We present One_Pass (v0.8.0), a Python package enabling computation of statistics from streamed global climate model output using one-pass algorithms. Users often need statistics covering periods longer than the stream duration, requiring algorithms that do not store full time series. One-pass methods address this need while avoiding full data archiving, offering memory-efficient, accurate results for high-performance computing (HPC) workflows and downstream applications like bias adjustment.
Núria Pérez-Zanón, Louis-Philippe Caron, Silvia Terzago, Bert Van Schaeybroeck, Llorenç Lledó, Nicolau Manubens, Emmanuel Roulin, M. Carmen Alvarez-Castro, Lauriane Batté, Pierre-Antoine Bretonnière, Susana Corti, Carlos Delgado-Torres, Marta Domínguez, Federico Fabiano, Ignazio Giuntoli, Jost von Hardenberg, Eroteida Sánchez-García, Verónica Torralba, and Deborah Verfaillie
Geosci. Model Dev., 15, 6115–6142, https://doi.org/10.5194/gmd-15-6115-2022, https://doi.org/10.5194/gmd-15-6115-2022, 2022
Short summary
Short summary
CSTools (short for Climate Service Tools) is an R package that contains process-based methods for climate forecast calibration, bias correction, statistical and stochastic downscaling, optimal forecast combination, and multivariate verification, as well as basic and advanced tools to obtain tailored products. In addition to describing the structure and methods in the package, we also present three use cases to illustrate the seasonal climate forecast post-processing for specific purposes.
Katja Weigel, Lisa Bock, Bettina K. Gier, Axel Lauer, Mattia Righi, Manuel Schlund, Kemisola Adeniyi, Bouwe Andela, Enrico Arnone, Peter Berg, Louis-Philippe Caron, Irene Cionni, Susanna Corti, Niels Drost, Alasdair Hunter, Llorenç Lledó, Christian Wilhelm Mohr, Aytaç Paçal, Núria Pérez-Zanón, Valeriu Predoi, Marit Sandstad, Jana Sillmann, Andreas Sterl, Javier Vegas-Regidor, Jost von Hardenberg, and Veronika Eyring
Geosci. Model Dev., 14, 3159–3184, https://doi.org/10.5194/gmd-14-3159-2021, https://doi.org/10.5194/gmd-14-3159-2021, 2021
Short summary
Short summary
This work presents new diagnostics for the Earth System Model Evaluation Tool (ESMValTool) v2.0 on the hydrological cycle, extreme events, impact assessment, regional evaluations, and ensemble member selection. The ESMValTool v2.0 diagnostics are developed by a large community of scientists aiming to facilitate the evaluation and comparison of Earth system models (ESMs) with a focus on the ESMs participating in the Coupled Model Intercomparison Project (CMIP).
Katherine Grayson, Stephan Thober, Aleksander Lacima-Nadolnik, Ivan Alsina-Ferrer, Llorenç Lledó, Ehsan Sharifi, and Francisco Doblas-Reyes
Geosci. Model Dev., 18, 5873–5890, https://doi.org/10.5194/gmd-18-5873-2025, https://doi.org/10.5194/gmd-18-5873-2025, 2025
Short summary
Short summary
We present One_Pass (v0.8.0), a Python package enabling computation of statistics from streamed global climate model output using one-pass algorithms. Users often need statistics covering periods longer than the stream duration, requiring algorithms that do not store full time series. One-pass methods address this need while avoiding full data archiving, offering memory-efficient, accurate results for high-performance computing (HPC) workflows and downstream applications like bias adjustment.
Núria Pérez-Zanón, Louis-Philippe Caron, Silvia Terzago, Bert Van Schaeybroeck, Llorenç Lledó, Nicolau Manubens, Emmanuel Roulin, M. Carmen Alvarez-Castro, Lauriane Batté, Pierre-Antoine Bretonnière, Susana Corti, Carlos Delgado-Torres, Marta Domínguez, Federico Fabiano, Ignazio Giuntoli, Jost von Hardenberg, Eroteida Sánchez-García, Verónica Torralba, and Deborah Verfaillie
Geosci. Model Dev., 15, 6115–6142, https://doi.org/10.5194/gmd-15-6115-2022, https://doi.org/10.5194/gmd-15-6115-2022, 2022
Short summary
Short summary
CSTools (short for Climate Service Tools) is an R package that contains process-based methods for climate forecast calibration, bias correction, statistical and stochastic downscaling, optimal forecast combination, and multivariate verification, as well as basic and advanced tools to obtain tailored products. In addition to describing the structure and methods in the package, we also present three use cases to illustrate the seasonal climate forecast post-processing for specific purposes.
Katja Weigel, Lisa Bock, Bettina K. Gier, Axel Lauer, Mattia Righi, Manuel Schlund, Kemisola Adeniyi, Bouwe Andela, Enrico Arnone, Peter Berg, Louis-Philippe Caron, Irene Cionni, Susanna Corti, Niels Drost, Alasdair Hunter, Llorenç Lledó, Christian Wilhelm Mohr, Aytaç Paçal, Núria Pérez-Zanón, Valeriu Predoi, Marit Sandstad, Jana Sillmann, Andreas Sterl, Javier Vegas-Regidor, Jost von Hardenberg, and Veronika Eyring
Geosci. Model Dev., 14, 3159–3184, https://doi.org/10.5194/gmd-14-3159-2021, https://doi.org/10.5194/gmd-14-3159-2021, 2021
Short summary
Short summary
This work presents new diagnostics for the Earth System Model Evaluation Tool (ESMValTool) v2.0 on the hydrological cycle, extreme events, impact assessment, regional evaluations, and ensemble member selection. The ESMValTool v2.0 diagnostics are developed by a large community of scientists aiming to facilitate the evaluation and comparison of Earth system models (ESMs) with a focus on the ESMs participating in the Coupled Model Intercomparison Project (CMIP).
Chiara Marsigli, Elizabeth Ebert, Raghavendra Ashrit, Barbara Casati, Jing Chen, Caio A. S. Coelho, Manfred Dorninger, Eric Gilleland, Thomas Haiden, Stephanie Landman, and Marion Mittermaier
Nat. Hazards Earth Syst. Sci., 21, 1297–1312, https://doi.org/10.5194/nhess-21-1297-2021, https://doi.org/10.5194/nhess-21-1297-2021, 2021
Short summary
Short summary
This paper reviews new observations for the verification of high-impact weather and provides advice for their usage in objective verification. New observations include remote sensing datasets, products developed for nowcasting, datasets derived from telecommunication systems, data collected from citizens, reports of impacts and reports from insurance companies. This work has been performed in the framework of the Joint Working Group on Forecast Verification Research (JWGFVR) of the WMO.
Cited articles
Abdalla, S. and De Chiara, G.: Estimating Random Errors of Scatterometer, Altimeter, and Model Wind Speed Data, IEEE J. Sel. Top. Appl., 10, 2406–2414, https://doi.org/10.1109/JSTARS.2017.2659220, 2017. a
Alemohammad, S. H., McColl, K. A., Konings, A. G., Entekhabi, D., and Stoffelen, A.: Characterization of precipitation product errors across the United States using multiplicative triple collocation, Hydrol. Earth Syst. Sci., 19, 3489–3503, https://doi.org/10.5194/hess-19-3489-2015, 2015. a
Anthes, R. and Rieckh, T.: Estimating observation and model error variances using multiple data sets, Atmos. Meas. Tech., 11, 4239–4260, https://doi.org/10.5194/amt-11-4239-2018, 2018. a
Beck, H. E., Pan, M., Roy, T., Weedon, G. P., Pappenberger, F., van Dijk, A. I. J. M., Huffman, G. J., Adler, R. F., and Wood, E. F.: Daily evaluation of 26 precipitation datasets using Stage-IV gauge-radar data for the CONUS, Hydrol. Earth Syst. Sci., 23, 207–224, https://doi.org/10.5194/hess-23-207-2019, 2019. a, b
Becker, T., Bechtold, P., and Sandu, I.: Characteristics of convective precipitation over tropical Africa in storm‐resolving global simulations, Q. J. Roy. Meteor. Soc., 147, 4388–4407, https://doi.org/10.1002/qj.4185, 2021. a
Bessac, J. and Naveau, P.: Forecast score distributions with imperfect observations, Advances in Statistical Climatology, Meteorology and Oceanography, 7, 53–71, https://doi.org/10.5194/ascmo-7-53-2021, 2021. a
Bowler, N. E.: Accounting for the effect of observation errors on verification of MOGREPS, Meteorol. Appl., 15, 199–205, https://doi.org/10.1002/met.64, 2008. a
Candille, G. and Talagrand, O.: Impact of observational error on the validation of ensemble prediction systems, Q. J. Roy. Meteor. Soc., 134, 959–971, https://doi.org/10.1002/qj.268, 2008. a
Copernicus Climate Change Service: E-OBS version 26.0e, https://surfobs.climate.copernicus.eu/dataaccess/access_eobs.php, last access: 11 November 2024a. a
Copernicus Climate Change Service: ERA5 hourly data on single levels from 1940 to present, Climate Data Store [data set], https://doi.org/10.24381/cds.adbb2d47, last access: 11 November 2024b. a
Cornes, R. C., van der Schrier, G., van den Besselaar, E. J. M., and Jones, P. D.: An Ensemble Version of the E-OBS Temperature and Precipitation Data Sets, J. Geophys. Res.-Atmos., 123, 9391–9409, https://doi.org/10.1029/2017JD028200, 2018. a
Duc, L. and Saito, K.: Verification in the presence of observation errors: Bayesian point of view, Q. J. Roy. Meteor. Soc., 144, 1063–1090, https://doi.org/10.1002/qj.3275, 2018. a
Gruber, A., Su, C. H., Crow, W. T., Zwieback, S., Dorigo, W. A., and Wagner, W.: Estimating error cross-correlations in soil moisture data sets using extended collocation analysis, J. Geopys. Res.-Atmos., 121, 1208–1219, https://doi.org/10.1002/2015JD024027, 2016. a
Hersbach, H., Bell, B., Berrisford, P., Hirahara, S., Horányi, A., Muñoz‐Sabater, J., Nicolas, J., Peubey, C., Radu, R., Schepers, D., Simmons, A., Soci, C., Abdalla, S., Abellan, X., Balsamo, G., Bechtold, P., Biavati, G., Bidlot, J., Bonavita, M., Chiara, G., Dahlgren, P., Dee, D., Diamantakis, M., Dragani, R., Flemming, J., Forbes, R., Fuentes, M., Geer, A., Haimberger, L., Healy, S., Hogan, R. J., Hólm, E., Janisková, M., Keeley, S., Laloyaux, P., Lopez, P., Lupu, C., Radnoti, G., Rosnay, P., Rozum, I., Vamborg, F., Villaume, S., and Thépaut, J.: The ERA5 global reanalysis, Q. J. Roy. Meteor. Soc., 146, 1999–2049, https://doi.org/10.1002/qj.3803, 2020. a, b
Hersbach, H., Bell, B., Berrisford, P., Biavati, G., Horányi, A., Muñoz Sabater, J., Nicolas, J., Peubey, C., Radu, R., Rozum, I., Schepers, D., Simmons, A., Soci, C., Dee, D., and Thépaut, J.-N.: ERA5 hourly data on single levels from 1940 to present, https://doi.org/10.24381/cds.adbb2d47, 2023. a
Hoffmann, J., Bauer, P., Sandu, I., Wedi, N., Geenen, T., and Thiemert, D.: Destination Earth – A digital twin in support of climate services, Climate Services, 30, 100394, https://doi.org/10.1016/J.CLISER.2023.100394, 2023. a
Hou, A. Y., Kakar, R. K., Neeck, S., Azarbarzin, A. A., Kummerow, C. D., Kojima, M., Oki, R., Nakamura, K., and Iguchi, T.: The Global Precipitation Measurement Mission, B. Am. Meteorol. Soc., 95, 701–722, https://doi.org/10.1175/BAMS-D-13-00164.1, 2014. a
Hoyer, S. and Hamman, J.: xarray: N-D labeled arrays and datasets in Python, Journal of Open Research Software, 5, 10, https://doi.org/10.5334/jors.148, 2017. a
Huffman, G., Stocker, E., Bolvin, D., Nelkin, E., and Tan, J.: GPM IMERG Final Precipitation L3 1 day 0.1 degree × 0.1 degree V07, https://doi.org/10.5067/GPM/IMERGDF/DAY/07, 2023. a, b
Huffman, G. J., Bolvin, D. T., Braithwaite, D., Hsu, K., Joyce, R., Kidd, C., Nelkin, E. J., Sorooshian, S., Tan, J., and Xie, P.: NASA Global Precipitation Measurement (GPM) Integrated Multi-satellitE Retrievals for GPM (IMERG) Algorithm Theoretical Basis Document Version 06, Tech. rep., NASA, https://gpm.nasa.gov/sites/default/files/2020-05/IMERG_ATBD_V06.3.pdf (last access: 11 November 2024), 2020. a, b
Huuskonen, A., Saltikoff, E., and Holleman, I.: The Operational Weather Radar Network in Europe, B. Am. Meteorol. Soc., 95, 897–907, https://doi.org/10.1175/BAMS-D-12-00216.1, 2014. a
Janssen, P. A., Abdalla, S., Hersbach, H., and Bidlot, J. R.: Error Estimation of Buoy, Satellite, and Model Wave Height Data, J. Atmos. Ocean. Technol., 24, 1665–1677, https://doi.org/10.1175/JTECH2069.1, 2007. a
Lavers, D. A., Simmons, A., Vamborg, F., and Rodwell, M. J.: An evaluation of ERA5 precipitation for climate monitoring, Q. J. Roy. Meteor. Soc., 148, 3152–3165, https://doi.org/10.1002/qj.4351, 2022. a
Lledó, L.: Jupyter notebook containing all the analyses, github [code], https://github.com/lluritu/4CH_precip_comparison/, last access: 11 November 2024. a
Massari, C., Crow, W., and Brocca, L.: An assessment of the performance of global rainfall estimates without ground-based observations, Hydrol. Earth Syst. Sci., 21, 4347–4361, https://doi.org/10.5194/hess-21-4347-2017, 2017. a
Navarro, A., García-Ortega, E., Merino, A., Sánchez, J., Kummerow, C., and Tapiador, F.: Assessment of IMERG Precipitation Estimates over Europe, Remote Sens., 11, 2470, https://doi.org/10.3390/rs11212470, 2019. a
O, S., Foelsche, U., Kirchengast, G., Fuchsberger, J., Tan, J., and Petersen, W. A.: Evaluation of GPM IMERG Early, Late, and Final rainfall estimates using WegenerNet gauge data in southeastern Austria, Hydrol. Earth Syst. Sci., 21, 6559–6572, https://doi.org/10.5194/hess-21-6559-2017, 2017. a
O'Carroll, A. G., Eyre, J. R., and Saunders, R. W.: Three-Way Error Analysis between AATSR, AMSR-E, and In Situ Sea Surface Temperature Observations, J. Atmos. Ocean. Technol., 25, 1197–1207, https://doi.org/10.1175/2007JTECHO542.1, 2008. a
Pan, M., Fisher, C. K., Chaney, N. W., Zhan, W., Crow, W. T., Aires, F., Entekhabi, D., and Wood, E. F.: Triple collocation: Beyond three estimates and separation of structural/non-structural errors, Remote Sens. Environ., 171, 299–310, https://doi.org/10.1016/j.rse.2015.10.028, 2015. a, b
Premoli, A. and Tavella, P.: A revisited three-cornered hat method for estimating frequency standard instability, IEEE T. Instrum. Meas., 42, 7–13, https://doi.org/10.1109/19.206671, 1993. a
Prigent, C.: Precipitation retrieval from space: An overview, C. R. Geosci., 342, 380–389, https://doi.org/10.1016/j.crte.2010.01.004, 2010. a
Ramon, J., Lledó, L., Ferro, C. A. T., and Doblas‐Reyes, F. J.: Uncertainties in the observational reference: implications in skill assessment and model ranking of seasonal predictions, Q. J. Roy. Meteor. Soc., https://doi.org/10.1002/qj.4628, 2023. a
Roebeling, R. A., Wolters, E. L. A., Meirink, J. F., and Leijnse, H.: Triple Collocation of Summer Precipitation Retrievals from SEVIRI over Europe with Gridded Rain Gauge and Weather Radar Data, J. Hydrometeorol., 13, 1552–1566, https://doi.org/10.1175/JHM-D-11-089.1, 2012. a
Saltikoff, E., Haase, G., Delobbe, L., Gaussiat, N., Martet, M., Idziorek, D., Leijnse, H., Novák, P., Lukach, M., and Stephan, K.: OPERA the Radar Project, Atmosphere, 10, 320, https://doi.org/10.3390/atmos10060320, 2019. a
Sun, Q., Miao, C., Duan, Q., Ashouri, H., Sorooshian, S., and Hsu, K. L.: A Review of Global Precipitation Data Sets: Data Sources, Estimation, and Intercomparisons, Rev. Geophys., 56, 79–107, https://doi.org/10.1002/2017RG000574, 2018. a, b
Vogelzang, J. and Stoffelen, A.: Quadruple Collocation Analysis of In-Situ, Scatterometer, and NWP Winds, J. Geophys. Res.-Oceans, 126, e2021JC017189, https://doi.org/10.1029/2021JC017189, 2021. a
Zwieback, S., Scipal, K., Dorigo, W., and Wagner, W.: Structural and statistical properties of the collocation technique for error characterization, Nonlin. Processes Geophys., 19, 69–80, https://doi.org/10.5194/npg-19-69-2012, 2012. a, b
Short summary
High-quality observational datasets are essential to perform forecast verification and improve weather forecast services. When it comes to verifying precipitation, a high-resolution, global-coverage and good-quality dataset is not yet available. This research analyses the strengths and shortcomings of four observational products that employ complementary measurement techniques to estimate surface precipitation. Satellites provide good spatial coverage, but other products are still more accurate.
High-quality observational datasets are essential to perform forecast verification and improve...