Articles | Volume 28, issue 20
https://doi.org/10.5194/hess-28-4539-2024
https://doi.org/10.5194/hess-28-4539-2024
Research article
 | 
23 Oct 2024
Research article |  | 23 Oct 2024

Assessing rainfall radar errors with an inverse stochastic modelling framework

Amy C. Green, Chris Kilsby, and András Bárdossy
Abstract

Weather radar is a crucial tool for rainfall observation and forecasting, providing high-resolution estimates in both space and time. Despite this, radar rainfall estimates are subject to many error sources – including attenuation, ground clutter, beam blockage and drop-size distribution – with the true rainfall field unknown. A flexible stochastic model for simulating errors relating to the radar rainfall estimation process is implemented, inverting standard weather radar processing methods and imposing path-integrated attenuation effects, a stochastic drop-size-distribution field, and sampling and random errors. This can provide realistic weather radar images, of which we know the true rainfall field and the corrected “best-guess” rainfall field which would be obtained if they were observed in a real-world case. The structure of these errors is then investigated, with a focus on the frequency and behaviour of “rainfall shadows”. Half of the simulated weather radar images have at least 3 % of their significant rainfall rates shadowed, and 25 % have at least 45 km2 containing rainfall shadows, resulting in underestimation of the potential impacts of flooding. A model framework for investigating the behaviour of errors relating to the radar rainfall estimation process is demonstrated, with the flexible and efficient tool performing well in generating realistic weather radar images visually for a large range of event types.

1 Introduction

Precipitation is challenging to measure accurately, due to its intermittent nature, spatio-temporal variability and sensitivity to environmental conditions (Savina et al.2012). For urban hydrology, weather radar plays an increasingly important role in quantitative precipitation estimation, due to the high spatio-temporal resolution of the information needed (Thorndahl et al.2017). The small sizes of urban catchments and the intended hydrological applications – particularly for real time or near real time – require information about precipitation fields at small temporal and spatial scales, from 1–10 min and 1–5 km, respectively (Berne et al.2004; Ochoa-Rodriguez et al.2015; De Vos et al.2017; Thorndahl et al.2017; Shehu and Haberlandt2021).

Despite the suitability of weather radar for obtaining high-resolution rainfall estimates, there are many sources of error in the estimation process, with different sources of uncertainty reviewed in numerous studies (Michelson et al.2005; Meischner2005; Villarini and Krajewski2010; Ośróka et al.2014; Ciach and Gebremichael2020). Errors include radar calibration and stability problems, contamination by clutter and anomalous propagation, occultation, a beam-broadening effect with non-uniform beam filling, attenuation and assumptions made about the drop-size distribution (DSD) (Marshall and Palmer1948; Harrison et al.2000). Some error sources can be corrected for, such as bias and systematic errors, ground clutter (Gabella and Notarpietro2002; Ventura and Tabary2013; Li et al.2013) and attenuation (Nicol and Austin2003; Krämer2008; Jacobi and Heistermann2016), resulting in significantly improved reliability. Correction procedures are often limited due to the cumulative nature of errors from a superposition of different sources, with complex approaches showing only modest improvements to estimates. Information on the rainfall field is lost, irretrievable, and we do not even know how often this happens.

There is therefore an ongoing need to account for errors in the radar rainfall estimation process (Villarini and Krajewski2010; Seo et al.2018), and uncertainties should be acknowledged and modelled (Ciach et al.2007; Gires et al.2012; Villarini et al.2014; Rico-Ramirez et al.2015). The poor quantification of uncertainties was highlighted as a fundamental issue in AghaKouchak et al. (2010a) and expanded in AghaKouchak et al. (2010b). An error model described in Hasan et al. (2014) found that uncertainties were easily identifiable for unbiased reflectivity–rainfall (ZR) relationships, incorporating radar reflectivity uncertainties in Hasan et al. (2016). Variograms were used to represent radar rainfall uncertainties (Cecinati et al.2017), eliminating the need for a covariance matrix for faster and more flexible calculation of the spatial correlation of errors. Uijlenhoet and Berne (2008) created a stochastic model of range profiles for the DSD, using a Monte Carlo framework (Berne and Uijlenhoet2006) to estimate uncertainties using two attenuation correction schemes. Yan et al. (2021) imposed random and non-linear radar errors on simulated rainfall fields, with ZR relationship errors appearing to have little influence overall.

Error quantification is challenging, and errors propagate into future estimates for any model which requires rainfall as an input. The fundamental limitation in radar correction is that the “true” rainfall field is not available for comparisons. In this study, the aim is to work backwards to obtain an estimate of the uncertainty in the radar rainfall estimation process. Using a new model for simulating realistic space–time rainfall event fields with high resolution (matching that of a UK standard C-band weather radar) (Green et al.2024), a clustered parameterization based on radar rainfall events from High Moorsley weather radar operated by the UK Met Office was extracted. These simulation outputs are treated as the true rainfall field. Errors relating to each step of the radar rainfall estimation process are then imposed on the simulated rainfall field to obtain an ensemble of spatio-temporal error fields for each event in a stochastic manner, forming a superposition of different error sources. This is done by inverting standard radar processing methods, allowing identification of the frequency of the occurrence and extent of the loss of important information.

In this study, the data and study area are first discussed in Sect. 2, together with the simulation methods applied to obtain realistic space–time rainfall fields. The methodology for the radar error model is then outlined in detail in Sect. 3, with detailed explanations for each step of the model. Example event results are discussed in Sect. 4.24.5, with more general results based on event images given in Sect. 4.64.9. A discussion and conclusions are given in Sect. 5, with model limitations, potential for generalization and future work also discussed.

2 Data

An ensemble of realistic rainfall events is used, generated using the clustered rainfall model outlined in Green et al. (2024). This model uses fast Fourier transform (FFT) methods to efficiently generate three-dimensional rainfall event fields with a high resolution matching that of radar data (1 km, 5 min) for a 200×200 km domain. Events have prescribed properties, including the correlation structure, spatial anisotropy, spatio-temporal anisotropy, marginal distribution, non-zero rainfall proportions and advection. The model is used with multi-dimensional scaling and hierarchical clustering to parameterize rainfall event simulations for 100 rainfall events.

A year of processed dual-polarization C-band weather radar data is used to parameterize simulations of realistic space–time rainfall fields. This is obtained from weather radar from High Moorsley (Met Office2003), which is located near Durham, England (54°4820′′ N, 001°2832′′ W), with a wavelength and frequency of 5.3 cm and 5.6 GHz, respectively. This operates between five elevation angles from 0.5 to 2° with 1° beam width, taking a scan at each elevation approximately every 5 min.

3 Radar error model

This section outlines a novel model for imposing errors in the radar rainfall estimation process on a rainfall field, focusing on four main error sources: random noise effects, attenuation effects, DSD error and sampling through estimation variance. Section 3.13.3 describe the error model in more detail, outlined in Fig. 1 and written in Python. While the model is by no means comprehensive, random error is included. This is designed to provide a framework for investigating the impact of these errors, improving understanding of the estimation process.

https://hess.copernicus.org/articles/28/4539/2024/hess-28-4539-2024-f01

Figure 1Schematic for imposing the radar error model on simulated rainfall fields, outlined in more detail in Sect. 3.13.5.

Download

3.1 Re-projecting to polar coordinates

The simulated rainfall fields are given on a regular three-dimensional Cartesian grid. To apply radar processing methods in reverse, the data must be re-projected into a polar coordinate system. Using nearest-neighbour interpolation methods, the Cartesian grid is converted into polar data

(1) Z ( t , x , y ) Z ( t , θ , r )

for ray angles θ=1,2,360 with ray bins r=1,2,167 of width 600 m and average elevation angle 1°. This mirrors the radar configuration of the High Moorsley weather radar used for parameterization. The different elevation angles and the differences in the sampling sizes of the pixels are incorporated through the use of estimation variance in Sect. 3.5.

3.2 Attenuation effects

A constrained gate-by-gate approach is applied to estimate the path-integrated attenuation (PIA) for each radar ray by inverting standard forward-attenuation models (Krämer and Verworn2008; Jacobi and Heistermann2016). Inverting the process gives an estimated attenuated reflectivity Zi rate for the ith bin of width Δr as

(2) Z i ^ = Z i , corr - j = 0 i - 1 k j ^  and k i ^ = c Z corr , i + ( 2 Δ r - 1 ) j = 0 i - 1 k j ^ d

for constants c and d. This results in a realistic radar image of attenuated reflectivity in a polar coordinate system at each time step of the event, denoted by Zcorr(t,θ,r). Using the scheme described above, for rainfall intensity R(t) at time t, we get a PIA estimate PIA(t) of

(3) R ̃ ( t ) = R ( t ) - PIA R ( t ) ( t ) if R ( t ) PIA R ( t ) ( t ) , 0 otherwise ,

where PIA(t)=f{R(t)} is a function based on the estimation algorithm outlined in Jacobi and Heistermann (2016).

3.3 Random noise effects

When considering empirical variograms for weather radar images, Pegram and Clothier (2001) found that 10 % of the variability in images corresponded to nugget effects, highlighting the need for random noise effects in radar pixel simulations. This noise is also evident in the marginal distributions of radar images, with the full year and an example “dry” day image for the High Moorsley weather radar given in Fig. 2, showing a large number of values in the range −32 to 0 dBZ. Although rainfall rates of less than 0.01 mm h−1 are hardly noticeable in terms of rainfall accumulations, this high density of low-reflectivity rates in radar images may have a significant effect on attenuation estimates along the radar rays. This noise may be attributed to the measuring apparatus, non-meteorological echoes or most likely a combination of various different sources. Errors are treated as random noise, representing a combination of errors from unknown sources clearly evident in real radar images.

https://hess.copernicus.org/articles/28/4539/2024/hess-28-4539-2024-f02

Figure 2Histograms of an example dry radar image (blue) and all radar pixels above −32 dBZ (orange) for the High Moorsley weather radar for the year 2019, where unz is the reflectivity rate corresponding to the non-zero rainfall threshold of 0.1 mm h−1.

Download

The random noise field is added to rainfall values to prevent numerical instabilities, with the marginal distribution from Fig. 2 converted to rainfall rates in Fig. 3. When considering the logarithm of weather radar noise (i.e. dry day images and values (dBZ) corresponding to rainfall rates less than 0.1 mm h−1), these are sufficiently Gaussian to satisfy the assumption of a log-normal marginal distribution for random noise effects. A log-normal marginal distribution allows for a simple and easy transformation when simulating the field using Gaussian random field theory. Empirical variograms of these values were estimated to identify an appropriate correlation structure, which has a very short correlation range of around 5 km. The optimal spatial transformation for minimizing least squares between the marginal variogram values of the two spatial dimensions is used to estimate field anisotropy from empirical variogram fields, with estimates suggesting that isotropy of random noise fields is a valid assumption in this case. The three-dimensional noise field denoted by ε(t,x,y) is assumed to be log-normal, with a marginal distribution of

(4) ε LN μ ε , Σ ε 2 ,

where με=-5.3 and σε=1.7. A Gaussian random field is simulated with an exponential correlation structure of ρε(h)=exp{-h/rε} for a short range with rε=5 and a nugget effect of nε=0.35. This is transformed using an inverse Gaussian score transformation and then exponentiated, resulting in a random noise field with the desired marginal distribution and correlation structure. An example field is included in Fig. 3, from which we can see that the variability is slightly higher than in existing images. This is however selected to preserve the proportion of −32 dBZ reflectivity rates in images, with any values less than −32 dBZ treated as −32 dBZ.

https://hess.copernicus.org/articles/28/4539/2024/hess-28-4539-2024-f03

Figure 3Histograms of low rainfall rates (and logarithms) corresponding to empirical random noise (i.e. in the range -32<Z10) obtained from High Moorsley weather radar for the year 2019 (blue), together with an example simulated noise field (orange).

Download

3.4 Drop-size-distribution errors

Attenuated rainfall rates R̃(t) can then be added to the three-dimensional noise field ε(t,x,y), which can then be converted into a reflectivity field. A ZR relationship is typically used, of the form Z=10log 10(aRb) for reflectivity Z (dBZ), rainfall R (mm h−1) and constants a and b, which typically take the values a=200 and b=1.6 (Harrison et al.2000). Constant values for a and b are based on the assumption that the DSD varies spatially and temporally in a way characteristic of a particular rainfall or weather type. Despite this, a fixed ZR relationship results in a severe underestimation of peak rainfall intensities due to the failure to account for natural variations in the DSD with intensity (Schleiss et al.2020). Lee et al. (2007) indicated that the overall DSD variability cannot be adequately explained by a single parameter. In Libertino et al. (2015), a varying ZR relationship in space and time improved rainfall accumulations at the event scale when compared to a fixed relationship.

A large amount of scatter around the average power-law relationship is related to the various microphysical processes that are responsible for the DSD variability. To account for this variability, in an attempt to generate more realistic reflectivity images, we assume that a=A(x,y) is a two-dimensional field varying in space. As the simulated rainfall events all have a fairly short duration (6 h or less), a constant DSD in time is initially used. This assumes that A is fairly constant over the time period considered, although the model is flexible and the dimensions of A can easily be extended to include time.

Parameters in the ZR relationship typically take values in the ranges a(30,1000) and b(0.8,2) (Battan and Theiss1973; Smith and Krajewski1993), and so parameter b is still treated as constant but is sampled from a Gaussian distribution with a low variance centred around a value of μb=1.6. This gives attenuated reflectivity estimates of

(5) Z ̃ ( t ) = 10 log 10 A R ̃ ( t ) + ε ( t ) b

for

(6) A ( x , y ) N 2 μ a , { 1 + g ( x , y ) } Σ a b N μ b , σ b 2

for correlation structure ρa=σaexp{-h/ra}, where μa=220, σa=2, ra=30, μb=1.6 and σb=0.02. The function g(x,y)=ΣE(x,y) is the estimation variance based on the pixel location (xy) and on the proportion of the rainfall volume that the radar can see for a given distance, which is discussed further in Sect. 3.5. Attenuated reflectivity fields are rounded to one decimal place and are limited by a minimum value of −32 dBZ, as is the case for actual reflectivity data.

3.5 Radar sampling

Due to the nature of weather radar sampling, polar observations close to the receiver sample from a much smaller volume than those further away, as can be seen for an example pixel in Fig. 4. Earth curvature effects, cloud height and bright band effects also impact the sampling volume, and furthermore radar observations above the freezing level are unavailable due to the high reflectivity of melting precipitation (Hooper and Kippax1950; Kitchen et al.1994; Hall et al.2015).

https://hess.copernicus.org/articles/28/4539/2024/hess-28-4539-2024-f04

Figure 4Schematic of a radar ray sampling volume for an example pixel, denoted as a vertical column.

Download

To address this, sampling errors are included as part of the DSD model designed to increase uncertainty in the DSD where the volume of rainfall sampled by the radar beam is lower. Areas where it is unrealistic for the radar beam to be sampling rainfall (e.g. above the bright band level or outside the base and top of the cloud) are removed with flexible model parameters which can be adjusted. In this case, the configuration of High Moorsley weather radar is used (see Sect. 2).

The radar sampling error is defined using estimation variance principles by representing the change in uncertainty between the actual and sampled volumes. Assuming a pixel is a vertical column denoted by V dependent on the radar configuration and the distance of the pixel from the weather radar, parts of this vertical column will be sampled by the radar, denoted by ν (see Fig. 6). The estimation variance σE can be defined as

(7) σ E = 2 γ ( V , ν ) - γ ( ν , ν ) - γ ( V , V ) ,

where γ is the mean variogram and V and ν are the total and sampled volumes, respectively. By discretizing the vertical pixel into small blocks, we can estimate the empirical variograms in Eq. (7), with an example of discretized blocks contributing to each term in Fig. 5 based on a variogram model for the vertical distribution of the DSD.

https://hess.copernicus.org/articles/28/4539/2024/hess-28-4539-2024-f05

Figure 5Example of variogram contributions for a discretized volume V. A given volume ν is sampled, highlighting an example of discretized blocks contributing to empirical variogram estimation for each of the terms in Eq. (7).

Download

We consider a vertical column of rainfall, assuming that the cloud base, bright band and cloud top are 1, 4 and 10 km and assuming an exponential variogram model for below the bright band level. Discretizing the vertical column of rainfall into blocks of height 10 m (see Fig. 6), the empirical distances for each discretized block are calculated using the variogram model. Parameterization is based on analyses of vertical weather radar data (Berne et al.2005), considering the vertical raindrop volume distribution for a range of rainfall rates and heights. The variance of sampling volumes in different ranges supported the concept, with simulations compared to vertical radar images for validation.

https://hess.copernicus.org/articles/28/4539/2024/hess-28-4539-2024-f06

Figure 6Example of the vertical structure of a rainfall pixel, with discretized blocks representing the volume V and the volume sampled by the radar beam ν highlighted in yellow.

Download

4 Results

In this section, the performance of the model is considered by looking at example fields for each step of the simulation process. We consider 100 rainfall events simulated using the methods outlined in Green et al. (2024) and parameterized by radar rainfall events from High Moorsley weather radar (see Sect. 2). For each event, the model was run n=100 times to obtain an ensemble of weather radar images. To enable direct comparisons, each radar image is corrected using a standard radar rainfall estimation process resulting in corrected rainfall for each ensemble member, similar to what would be obtained from a radar rainfall image. This includes an attenuation correction (Jacobi and Heistermann2016), a ZR relationship (Harrison et al.2017) and re-projection onto a Cartesian grid to allow for direct comparisons with the original simulated rainfall field R.

https://hess.copernicus.org/articles/28/4539/2024/hess-28-4539-2024-f07

Figure 7Step-by-step error model fields, including the (a) simulated rainfall field R(t), (b) attenuation PIA, (c) attenuated rainfall R̃(t), (d) random noise field ε(t), (e) attenuated rainfall with random noise R̃(t)+ε(t) and (f) attenuated reflectivity Z̃(t) for a single time step of an example simulated event.

Download

Defining the difference between the simulated true rainfall field (R) and the corrected rainfall field (Rcorr,i) after applying the radar error model as the error, we consider specific events R, individual event time steps R(t) throughout the ensemble (i.e. image-based) and the behaviour of all events. To investigate the capacity of the radar error model to capture uncertainty, we consider the error metrics outlined below.

  1. The mean bias between corrected ensemble members and original simulated rainfall

    (8) BIAS ( R ) = 1 n i = 1 n R - R corr , i

    for ensemble members i=1, …, 100

  2. The root-mean-square error (RMSE) across the ensemble

    (9) RMSE ( R ) = 1 n i = 1 n R - R corr , i 2
  3. The pixel variability throughout the ensemble, using the standard deviation

    (10) SD R corr = i = 1 n R corr , i - R corr , i 2 n
  4. The minimum and maximum RMSE values across the ensemble

    (11) RMSE min ( R ) = min i = 1 , , n R - R corr , i 2 and RMSE max ( R ) = max i = 1 , , n R - R corr , i 2
  5. The average error across the ensemble, as a percentage of the original simulated rainfall field for all non-zero simulated rainfall pixels

    (12) p R = 1 n i = 1 n 1 - R corr , i R × 100 %

    where R>0.

Additional metrics are defined to identify cases where significant amounts of rainfall are missing in corrected rainfall fields. Crane (1979) referred to distortions in storm structures, as a result of attenuation, as shadows. In this study we define rainfall shadows as areas where information about the rainfall field is lost from a simulated weather radar image after correction methods have been applied. A formal definition of a rainfall shadow in this case is taken to be a pixel where the simulated rainfall is significant (i.e. R>1 mm h−1) but the corrected rainfall is much lower (less than 10 %) than the original simulated rate (i.e. Rcorr/R0.1|R>1).

We first consider example fields for each stage of the error model in Sect. 4.1 and then three events which show high bias and low and high variability in Sect. 4.24.4, quantified based on the above metrics at an event level. The behaviour of individual radar images is considered by looking at the average, minimum and maximum behaviours over the ensemble, including the variability. Attempts are made to find metrics and properties of rainfall images with the aim of identifying instances where there is a very high level of uncertainty or error arising from the rainfall estimation process. The impact of the rainfall location with respect to the radar is considered, together with identifying how often significant information on the rainfall field is lost. For individual image-based errors, we introduce three image metrics below relating to rainfall shadows:

  1. ARS is the actual area (km2) of the radar image that contains rainfall shadows.

  2. LARS is the largest single area (km2) of rainfall shadows in a radar image.

  3. PRS is the proportion of significant rainfall (i.e. R>1 mm h−1) that is shadowed.

https://hess.copernicus.org/articles/28/4539/2024/hess-28-4539-2024-f08

Figure 8(a) Simulated rainfall field, (b) example reflectivity and (c) corrected rainfall field for simulated event A (video link at https://zenodo.org/record/8029394/files/true_sim_rainfall_133.mp4?download=1, last access: 16 October 2024).

Download

https://hess.copernicus.org/articles/28/4539/2024/hess-28-4539-2024-f09

Figure 9(a) Average bias, (b) average RMSE, (c) pixel variability (SD), (d) maximum RMSE, (e) minimum RMSE and (f) average proportional error for simulated event A (video link at https://zenodo.org/record/8029394/files/errors_and_var133.mp4?download=1, last access: 16 October 2024).

Download

4.1 Example fields

For an example time step of a simulated event, each stage of the radar error model process is given in Fig. 7. The final radar image (Fig. 7f) appears realistic, with clear areas of rainfall similar to raw radar images obtained from the High Moorsley weather radar. A significant proportion of the signal is attenuated towards the edge of the domain, particularly in the top right of the image.

4.2 Event A: high bias

The event shown in Fig. 8a has an area of moderate-intensity rainfall in the centre of the image with a large extent, resulting in high bias. The simulated radar image for an ensemble member associated with the event looks realistic, with the reflectivity and corrected rainfall rates (see Fig. 8b and c) showing significant rainfall amounts missing throughout. The average bias, RMSE and pixel variability corresponding to the event in Fig. 8 are given in Fig. 9. The average bias and RMSE are very high (see Fig. 9a and b), taking values over 5 mm h−1.

https://hess.copernicus.org/articles/28/4539/2024/hess-28-4539-2024-f10

Figure 10(a) Percentage of corrected rainfall that is less than 10 % of the original simulated field and (b) frequency of shadowed pixels over the ensemble for simulated event A (video link at https://zenodo.org/record/8029394/files/shadowed_133.mp4?download=1, last access: 16 October 2024).

Download

https://hess.copernicus.org/articles/28/4539/2024/hess-28-4539-2024-f11

Figure 11(a) Simulated rainfall field, (b) example reflectivity and (c) corrected rainfall field for simulated event B (video link at , last access: 16 October 2024).

Download

Figure 9c shows very low pixel variability for most of the image, which is reflected in the range of RMSE values throughout the ensemble given in Fig. 9d and e, with a large area in the centre of the image showing a bias and RMSE greater than 5 mm h−1, suggesting that the rainfall is consistently underestimated throughout the ensemble. A large area of moderate-intensity rainfall on top of the radar is overcorrected, mimicking effects resulting from full attenuation of the radar signal by intervening rainfall. In this case, the correction techniques will not improve the image significantly, and so information on a large portion of the rainfall field is lost, particularly when forward-attenuation correction algorithms are implemented.

This result is reiterated when looking at the rainfall shadows in Fig. 10b, where around one-fourth of the image is shadowed for 100 % of the ensemble members. This event has a very high average bias, with pixel variability varying drastically throughout the image. Large areas of rainfall are missing, and the differing variability throughout and spatial distribution of the error structure suggest that a mean field bias or multiplicative correction would not improve the estimates significantly. The information on the rainfall structure and rates would be lost in this case.

4.3 Event B: low variability

Figure 11a shows a rainfall event with a small extent of light rainfall and mostly dry conditions throughout the image, resulting in low variability throughout the simulated ensemble. There is a small amount of light rainfall in the centre left of the radar domain, with the corrected rainfall image in Fig. 11c exhibiting lower rainfall rates here than the original simulated rainfall. The radar image in Fig. 11 appears realistic, with a small amount of signal damping towards the left of the image in a range beyond the rainfall seen in Fig. 11a.

https://hess.copernicus.org/articles/28/4539/2024/hess-28-4539-2024-f12

Figure 12(a) Average bias, (b) average RMSE, (c) pixel variability (SD), (d) maximum RMSE, (e) minimum RMSE and (f) average proportional error for simulated event B (video link at https://zenodo.org/record/8029394/files/errors_and_var49.mp4?download=1, last access: 16 October 2024).

Download

https://hess.copernicus.org/articles/28/4539/2024/hess-28-4539-2024-f13

Figure 13(a) Percentage of corrected rainfall that is less than 10 % of the original simulated field and (b) frequency of shadowed pixels over the ensemble for simulated event B (video link at https://zenodo.org/record/8029394/files/shadowed_49.mp4?download=1, last access: 16 October 2024).

Download

The corresponding bias and RMSE for this event are given in Fig. 12, together with the pixel variability and maximum and minimum RMSEs over the ensemble and the average proportional error. Over the ensemble, the average bias (see Fig. 12a) is close to zero, except for the low-intensity rainfall areas (with at most 0.5 mm h−1), with low average, minimum and maximum RMSEs in Fig. 12b, d and e. The pixel variability is slightly higher in the rainfall area (see Fig. 12c), with pixels at a larger distance from the transmitter in this area showing lower pixel variability (less than 0.02 mm h−1) and the remaining variability appearing uniform. In Fig. 13b, the rainfall is shadowed in 100 % of the rainfall ensemble (i.e. all the ensemble members) in the area of low-intensity rainfall identified in Fig. 11. The frequency of shadows over the ensemble mostly has values of either zero or one. This event has very low variability between the ensemble members, likely due to (mostly) non-zero rainfall amounts in the images.

https://hess.copernicus.org/articles/28/4539/2024/hess-28-4539-2024-f14

Figure 14(a) Simulated rainfall field, (b) example reflectivity and (c) corrected rainfall field for simulated event C, with high-intensity rainfall (average throughout the event over 10 mm h−1) highlighted in red (video link at https://zenodo.org/record/8029394/files/true_sim_rainfall_64.mp4?download=1, last access: 16 October 2024).

Download

https://hess.copernicus.org/articles/28/4539/2024/hess-28-4539-2024-f15

Figure 15(a) Average bias, (b) average RMSE, (c) pixel variability (SD), (d) maximum RMSE, (e) minimum RMSE and (f) average proportional error for simulated event C, with high-intensity rainfall (average throughout the event over 10 mm h−1) highlighted in red (video link at https://zenodo.org/record/8029394/files/errors_and_var64.mp4?download=1, last access: 16 October 2024).

Download

4.4 Event C: high variability

Figure 14 shows an event with a small area of heavy rainfall rates, which results in high variability in event errors. Most of the radar domain shows zero rainfall rates, except for a very small area of high-intensity rainfall (greater than 100 mm h−1) towards the top of the domain. The example radar image (see Fig. 14b) is again realistic, showing mostly noise. Radial lines in the top right past a small amount of high-intensity rainfall suggest that attenuation effects have not been sufficiently corrected. In Fig. 14c the corrected rainfall image has areas of high-intensity rainfall which are overestimated due to cumulative errors introduced as part of forward-attenuation correction procedures. Although there is no large area of high-intensity rainfall, the rainfall field's spatial distribution has still been significantly impacted by the errors caused by attenuation.

From Fig. 15a and b, these radial lines show a positive average. However, none of these exceeds 0.2 mm h−1. Errors are not noticeable from the maximum RMSE field but have a much higher minimum RMSE than the rest of the image (see Fig. 15d and e). In this case, it appears that the attenuated high-intensity rainfall has been overcorrected, showing an average proportional error greater than one. Pixels within the affected rays at distances further from the radar transmitter are underestimated. Although these are mostly light rainfall rates, the rays have been significantly impacted, showing a clear gap when comparing the simulated and corrected rainfall fields.

https://hess.copernicus.org/articles/28/4539/2024/hess-28-4539-2024-f16

Figure 16(a) Percentage of corrected rainfall less than 10 % of the original simulated field and (b) frequency of shadowed pixels over the ensemble for simulated event C, with high-intensity rainfall (average throughout the event over 10 mm h−1) highlighted in red (video link at https://zenodo.org/record/8029394/files/shadowed_64.mp4?download=1, last access: 16 October 2024).

Download

The shadowed pixels in Fig. 16 show radial lines in areas where the corrected rainfall is less than 10 % of the simulated rainfall. Most of these pixels do not have significant rainfall rates and so are not classed as shadowed, with only a handful of pixels showing shadows and none for 100 % of the ensemble, resulting in high variability within the ensemble.

From the videos of event errors, this high-intensity rainfall moves across the image, affecting different rays, with some pixels showing rainfall shadows past the high-intensity rainfall. This is not consistent throughout the ensemble, with most pixels showing shadows in less than 100 % of the ensemble members. This small area of high-intensity rainfall has resulted in high variability across the ensemble, which is impacted significantly by the overestimation of high-intensity rainfall rates, with the DSD error also contributing to the variability for such a high rainfall rate.

4.5 Specific events: summary

In cases where the absolute bias is low, rainfall shadows may still exist, suggesting that average bias is a poor metric to use when identifying event errors. Even with a low absolute bias, the rainfall could be overestimated for pixels closer to the radar and underestimated past these pixels (which is very common along radar rays where attenuation has been overestimated). In these cases, the spatial distribution of rainfall is often incorrect, which could have detrimental effects when using the rainfall fields for any quantitative modelling. Typically, events with high bias correspond to events with large rainfall shadows, with shadow frequencies close to either zero or one, suggesting that, in cases where there is high bias, the model uncertainty is low. Simulated rainfall events which exhibited high ensemble variability resulted from potential interactions between small areas of high-intensity rainfall and DSD errors, which corresponded to higher variability in shadows throughout the ensemble. Videos of all the simulated events (and the corresponding errors) are available in Green (2023).

4.6 Individual image-based errors: average ensemble behaviour

The relationship between the average rainfall rate and the proportion of rainfall in an image with the image RMSE is shown in Fig. 17a, showing that events with high average rainfall rates and large, heavy rainfall proportions have the highest RMSE. Images showing fairly low proportions (i.e. 5 %–10 %) of heavy rainfall still exhibit a fairly high RMSE. Figure 17b shows the relationship between the mean and standard deviation of non-zero rainfall rates with the image RMSE, showing a higher RMSE for events with a high average and standard deviation in non-zero rainfall rates. This may be due to the large errors resulting in large gradients between pixels, where a large rainfall rate along a ray damps the signal so that subsequent observations are much lower, increasing the pixel variability in images.

https://hess.copernicus.org/articles/28/4539/2024/hess-28-4539-2024-f17

Figure 17(a) Average rainfall rate and proportion of significant rainfall and (b) average and standard deviation of non-zero rainfall, coloured according to the image RMSE for event images.

Download

Figure 18 shows the average rainfall rate (see Fig. 18a–e) and the proportion of non-zero rainfall (see Fig. 18f–j) in event images for the average bias, RMSE, ARS, PRS and LARS. For higher rainfall rates and proportions of rainfall, the bias increases, with low proportions of low rainfall rates exhibiting a negative average bias. This is also the case for the average non-zero rainfall rates. However, the relationship between the proportion of non-zero rainfall and the RMSE is less distinct, highlighting the significant impact of very small areas of intense rainfall rates on the image's RMSE. Figure 18 also shows that there are some low average rainfall rates and proportions of non-zero rainfall which correspond to high areas of the shadowed rainfall. This may be attributed to noise. However, this does suggest again that events do not need to include intense large-scale rainfall areas to result in significant rainfall shadows. The proportion of shadowed rainfall also appears to increase exponentially as the average non-zero rainfall rate increases, which is not the case with the proportion of rainfall in the images.

https://hess.copernicus.org/articles/28/4539/2024/hess-28-4539-2024-f18

Figure 18Average rainfall rate (a–e) and proportion of non-zero rainfall (f–j) for metrics including average bias, RMSE, area of rainfall shadowed (ARS), proportion of rainfall shadowed (PRS) and largest rainfall shadow area (LARS) for ensemble images of all events.

Download

The relationships in Fig. 18 are heavily skewed by a high density of images with low average rainfall rates and proportions. For a clearer image of the behaviour for event images, see the average rainfall rates of 0.1, 0.5 and 1 mm h−1 in Fig. 19. This shows a much clearer relationship between the corrected rainfall field and the rainfall shadows, with strong correlations between the average bias and the average rainfall rate (see Fig. 19a, f and k). The relationship becomes less clear for higher rainfall thresholds for conditional averages, with the strongest correlation between the non-zero rainfall average and the RMSE (see Fig. 19b).

https://hess.copernicus.org/articles/28/4539/2024/hess-28-4539-2024-f19

Figure 19Average thresholded rainfall rate for R(t)>0.1 mm h−1 (a–e), R(t)>0.5 mm h−1 (f–j) and R(t)>1 mm h−1 (k–o) for metrics including average bias, RMSE, ARS, PRS and LARS for ensemble images of all events.

Download

https://hess.copernicus.org/articles/28/4539/2024/hess-28-4539-2024-f20

Figure 20Standard deviation of the ensemble bias (a) and RMSE (b) for average non-zero rainfall rates of ensemble images for all events.

Download

From Fig. 19c, h and d, the ARS in the images may increase exponentially with increasing average rainfall rates. However, this may be skewed by the small number of images with very high ARS values (larger than 1000 km2). For the thresholded rainfall rates, most correspond to a low ARS value but appear to increase exponentially, particularly in Fig. 19c. There are some images with low ARS values which have high-threshold rainfall rates, which may be a result of small areas of high-intensity rainfall, where there are no resulting shadows as there are no other areas of significant rainfall rates (R(t)). The relationship between the proportion of rainfall is more complex (see Fig. 19d, i and n), with two distinct types of image behaviour. While a correlation is evident between the conditional average rainfall rates and the PRS values, there is clearly a large number of images with low average rainfall rates and large PRS values. These high PRS values with low average rainfall rates most likely correspond to images with a very low proportion of rainfall rates large enough to be classed as shadows. If just 1 rainfall pixel is shadowed, there would be a large increase in the PRS value in this case, highlighting the impact that shadows have on images with low rainfall extents, with fairly low average rainfall rates.

From Fig. 19e, j and o the LARS values appear to have a similar relationship with the ARS values. However, these are again skewed by very high ARS values, and so the relationship is less clear. Considering that the overall average behaviour of the ensemble does not take full advantage of the model framework and different ensemble member properties, important variation information is lost, which may have increased understanding of the uncertainty associated with the radar rainfall estimation process.

4.7 Individual image-based errors: ensemble variability

The variability between the ensemble members for each event image is considered using the ensemble standard deviation to identify areas where the event errors have a high level of uncertainty in image properties. Figure 20a shows the relationship between the average non-zero rainfall rate and the standard deviation of the image bias, showing rainfall images with an average non-zero rainfall rate of less than 0.5 mm h−1. There is no clear relationship between the average rainfall and variability in the bias of estimates. For images with an average non-zero rainfall rate above 0.5 mm h−1, there appears to be a strong positive correlation between the two, suggesting that, past this image threshold, the uncertainty in the image bias is directly proportional to the average non-zero rainfall rate.

The relationship between the average non-zero rainfall rate and the image's RMSE variability in Fig. 20b is very different, appearing to be inversely proportional to the variability in the image's RMSE. This may be attributed to the fact that, for higher rainfall rates, there are more rainfall shadows. In areas where there are rainfall shadows, the variability between the ensemble members decreases significantly due to the effects of the radar ray signal being fully damped. There is a moderate relationship between the variability PRS and the average non-zero rainfall. However, this is less distinct.

https://hess.copernicus.org/articles/28/4539/2024/hess-28-4539-2024-f21

Figure 21Standard deviation of the ARS (a), PRS (b) and LARS (c) for average non-zero rainfall rates of ensemble images for all events.

Download

The standard deviations of the ARS, PRS and LARS are given in Fig. 21. From Fig. 21a we can see that the uncertainty in the ARS increases with an increasing average rainfall rate, with similar behaviour for the LARS in the images (see Fig. 21c). However, there are a lot of images with no ARS skewing the relationship. Again, the relationship between the average non-zero rainfall rate and the variability of the PRS is not clear (see Fig. 21b).

4.8 Rainfall location: second moment of area

The location of rainfall with respect to the radar location will also impact the error structure, which is reflected in the variability in the PRS for different average rainfall rates. Atlas and Banks (1951) stated that distortion due to range attenuation includes displacement towards the radar of maximum intensity, packing contours on the near side of the storm and suggesting that the location of high-intensity rainfall will also have an impact on errors. The amount of rainfall lost to attenuation effects is likely to be higher for images with high-intensity rainfall in a more central location, due to the cumulative nature of attenuation effects along a radar ray. As illustrated in Fig. 22, the occurrence of rainfall close to the radar transmitter affects more rays, and its attenuation affects more “downstream” pixels. There is evidence of this in Fig. 9, where high-intensity rainfall occurred in the centre of the image, resulting in very high errors.

https://hess.copernicus.org/articles/28/4539/2024/hess-28-4539-2024-f22

Figure 22Schematic of the different effects high-intensity rainfall has on radar rays based on its location within the domain.

Download

To formally investigate this, we introduce the second moment of area of a rainfall (or reflectivity) image, estimated by considering the centroid of each image using the second areal moment. For the rainfall field R(t) on a Cartesian grid with dimensions (NxNy), the second moment of area can be estimated as

(13) M R ( t ) = x = 1 N x y = 1 N y R ( x , y , t ) d ( x , y ) 2 = x = 1 N x y = 1 N y R ( x , y , t ) x - r x 2 + y - r y 2 ,

where d(x,y)=(x-rx)2+(y-ry)2 is the distance of a pixel from the radar location (rxry). Both the actual and normalized rainfall fields are used to see the different impacts between the shapes of the field, with and without considering the actual magnitudes of the estimates. The normalized image moments M̃R(t) are defined as

(14) M ̃ R ( t ) = x = 1 N x y = 1 N y R ( x , y , t ) R tot ( t ) x - r x 2 + y - r y 2 ,

where Rtot(t)=xyR(x,y,t) is the total rainfall (R(t)).

https://hess.copernicus.org/articles/28/4539/2024/hess-28-4539-2024-f23

Figure 23Second moment of area (a–e) and normalized second moment of area (f–j) for metrics including average bias, RMSE, ARS, PRS and LARS for ensemble images of all events.

Download

Figure 23 shows the relationship between the second moment of area MR(t) and the normalized second moment of area M̃R(t) for event images and corresponding ensemble metrics including the average bias, RMSE, ARS, LARS and PRS. There are significant differences between the moments and normalized moments, with positive correlations for image moments and an inverse relationship for normalized image moments, which is particularly prominent when considering the RMSE. There is a significant positive correlation between image moment and RMSE, ARS and PRS, with the relationship for LARS being less clear.

https://hess.copernicus.org/articles/28/4539/2024/hess-28-4539-2024-f24

Figure 24Second moment of area (a–e) and normalized second moment of area (f–j) for ensemble metric variability (standard deviation), including average bias, RMSE, ARS, PRS and LARS for ensemble images.

Download

This suggests that, for the second moment of area calculated on rainfall rates, the strong non-linear dependence on absolute rainfall amount overrides all other information on the field, such as rainfall location. For the normalized second moment of area, this dependence has been removed, and so the relationship is solely based on the impact of the rainfall location. In this case, a smaller second moment of area (corresponding to a more central rainfall location) suggests larger rainfall shadows.

Figure 24 shows the relationship between the second moment of area and the normalized second moment of area for events, together with the ensemble uncertainty for the image metrics given in Fig. 23. This shows that images with a larger image moment have a lower RMSE standard deviation. The normalized image moments appear to be positively correlated with the standard deviation of the bias and RMSE and negatively correlated with the ARS, PRS and LARS. The variability in rainfall shadows, for both the ARS and PRS, appears to decrease with increasing normalized image moments.

Image moments could be a key piece of information when attempting to identify radar images with high uncertainty in estimates, particularly when using moments calculated from normalized rainfall rates across an image. In conclusion, this analysis suggests that a second moment of area has the potential to identify high uncertainty and missing information.

4.9 Rainfall shadow frequency

The aim of this section is to identify how often rainfall shadows occur. Due to ensemble variability, to ensure that frequencies are not overestimated, we consider the “best-case scenario” over the ensemble. In terms of the ensemble, for each image the ensemble member with the lowest errors is selected. This prevents overestimation, and as rainfall fields are parameterized with existing corrected radar rainfall images that may themselves be subject to rainfall shadows, the simulations may inherently underestimate the frequencies, so considering the minimum likelihood of occurrence makes intuitive sense. Percentiles are given for the minimum LARS, PRS and ARS in Table 1.

Table 1Percentiles for the empirical cumulative distribution functions (ECDFs) for the minimum ensemble rainfall shadow proportions, largest shadowed areas and actual rainfall shadowed for all events.

Download Print Version | Download XLSX

The empirical cumulative distribution functions for the minimum LARS, PRS and ARS are estimated for simulated events, with attenuation estimated from rainfall and reflectivity and given in Fig. 25. From the median of the proportion of the rainfall images simulated, half of the images have at least 3 % of their significant rainfall rates shadowed. When considering the ARS in the images, we see that 25 % of the images have an ARS of 45 km2 and that 5 % have a LARS of over 50 km2. A missing area of significant rainfall of this size, particularly for small or urban catchments, constitutes a major underestimation of flood risk, resulting in incorrect information provided in flood warnings. This highlights the importance of gaining an improved understanding of rainfall shadows and provides a motivation for this project and future research in this area. Gaps caused by the rainfall shadows identified would result in underprediction of flooding, impacting both flood warnings and flood defence designs.

https://hess.copernicus.org/articles/28/4539/2024/hess-28-4539-2024-f25

Figure 25Empirical cumulative distribution functions (ECDFs) for the minimum ensemble proportion, together with the largest and actual areas of image-containing rainfall shadows for all events.

Download

5 Discussion and conclusions

Errors relating to several different aspects of the radar rainfall estimation process are considered, using a radar error model outlined in detail. This model is applied to realistic simulated rainfall events in a stochastic manner, generating an ensemble of radar images corresponding to each time step of a rainfall event. A log-normal random noise field was imposed on rainfall estimates to account for underlying non-specific noise. The DSD uncertainty is included by replacing the multiplicative parameter a in the ZR relationship with a two-dimensional spectral random field, with field variability determined by radar sampling volumes. Attenuation effects are imposed by inverting standard gate-by-gate correction algorithms (Jacobi and Heistermann2016). To enable direct comparison between the simulated rainfall before and after imposing the radar error model, each radar image is corrected using a standard radar rainfall estimation process. This results in a corrected rainfall field for each ensemble member, similar to what would be obtained from real radar rainfall images, allowing us to identify when and where significant and/or systematic errors may occur.

This concept provides a methodology for developing a better understanding of errors related to the radar rainfall estimation process. By generating a true rainfall field and subsequently imposing errors to allow for comparison with correct best-guess stochastic radar rainfall estimates, we can address the fundamental limitation of weather radar correction schemes – that the real rainfall field is not known for comparison. An investigation of the spatio-temporal behaviour of the error structure is then possible, which provides key information on the radar rainfall estimation process.

A relationship between rainfall shadows, high bias and uncertainty related to the amount of rainfall (i.e. proportions and rates) in images was found. The impact of the rainfall location with respect to the weather radar is considered by introducing the second moment of area, showing that more central rainfall in the radar domain results in higher errors and variability. The minimum likelihood of rainfall shadows showed that 50 % of the simulated images have at least 3 % of their significant rainfall shadowed. In addition, 25 % of the images had an ARS of over 45 km2, with the minimum LARS of 5 % of the images exceeding an area of 50 km2. This gap would result in underestimation of potential impacts of flooding. This highlights the importance of gaining an improved understanding of rainfall shadows and provides the motivation for this project and future research in this area. Weather radar alone cannot be used for rainfall estimation, as information is regularly missed.

5.1 Impact and transferability

Improved high-resolution rainfall estimates are needed for flood forecasting by stakeholders and water managers, particularly in (near) real time, for nowcasting and probable ensemble forecasting. The radar error model outlined in this study produces visually realistic radar images, capturing key properties of radar images, with many potential uses for the model framework, some of which are outlined below:

  1. Identification of radar rainfall properties which correspond to high errors and uncertainties could be extended and used in a probabilistic manner to better condition merged rainfall fields. Identify areas where the spatial distribution of the rainfall cannot be trusted (i.e. occasions where rainfall shadows are likely, such as areas past high-intensity rainfall). This includes information on the frequency and location of rainfall shadows as a merging criterion (i.e. putting more weight on rainfall information from other sources when rainfall shadows are likely to occur at a given location).

  2. Apply the model to gridded rain gauge fields or forecasts, for comparison with the corresponding weather radar images, to better identify and understand radar rainfall errors.

  3. The importance of complex and efficient radar gauge merging methods is emphasized in this study. These methods do not trust the spatial distribution of rainfall provided by weather radars alone. Additional information from other sensors is needed, such as opportunistic sensors, citizen science data, rain gauges and microwave links. This study has provided a framework for methods assessing the performance of these merging techniques.

  4. Determine the optimal locations for weather radars or rain gauges, such as establishing rain gauge networks in areas where rainfall shadows are more likely and not in densely populated areas (e.g. cities), where it may be too late for warnings on missing information.

  5. Assess how radar rainfall errors propagate into hydrological and hydrodynamic modelling, considering the impact that the incorrect distribution of rainfall has on discharge and flood depths.

5.2 Limitations and future work

A powerful framework for investigating radar rainfall errors has been developed and demonstrated, with model design allowing for a high degree of flexibility and several natural extensions. The influence of different correction methods for the radar rainfall estimation process and the impact this has on the error structure should be investigated using the methodology in this study.

Some error sources in radar rainfall estimation are not included in the radar error model, as they were beyond the scope of this study. To improve the model, additional sources of error could easily be included (e.g. radar calibration errors using an additive error (dBZ) and bright-band effects using a vertical representation of different weather types and seasons of events). Mountainous regions are typically subject to more errors due to beam blockage from topography. However, this could quite easily be included in the model through an additive error based on existing clutter maps from the weather radar of interest. It would be interesting to repeat the study with different DSD structures, changing the correlation structure and marginal distribution of this (previously Gaussian) field. A dependence between DSD parameters could be imposed, as a varying ZR relationship in space and time improved rainfall accumulations at the event scale (Libertino et al.2015).

Close to the radar, measurement volumes are small, systematically increasing in size with distance from the radar. Although as part of the radar error model the spatial sampling aspect is considered through the estimation variance, radar measurements are taken to be instantaneous (as opposed to rain gauge measurements, which are temporal aggregations by definition). The implications of these space–time sampling properties mean that temporally we only have a snapshot of the pixel behaviour at a given time. Correlation structure variability in space and time was incorporated through a spatio-temporal anisotropy factor, without explicitly accounting for the different data sampling between the two dimensions. The simulation environment could be modified to account for the temporal sampling issue by simulating temporally at a higher resolution than existing radar images and sampling these to reproduce the snapshot effect. Methods could also be developed within an inverse modelling framework (Grundmann et al.2019) to obtain field uncertainty in (near) real time.

5.3 Concluding remarks

The overarching aim of this study is to contribute towards improvements in the radar rainfall estimation process by gaining an improved understanding of the frequency and location of the error structure relating to the process. With this in mind, we explore and exploit space–time properties of rainfall and reflectivity to gain an improved understanding of the error structure between the two, investigating the extent of uncertainties in the radar rainfall estimation process. This study has presented an innovative model for investigating uncertainties in the radar rainfall estimation process, providing a flexible tool that has many potential future applications. The radar error model, outlined in detail, generates a stochastic ensemble of radar images corresponding to an existing rainfall field by inverting the radar rainfall estimation process. This model incorporates many different error sources, including the drop-size distribution, attenuation effects, random noise and radar sampling. This provides a method for identifying when and where radar errors are likely to occur and how often information about the rainfall field is lost, significantly impacting the spatial rainfall field. The insights from this study provide an improved understanding of the error structure between rainfall and reflectivity, together with the extent of uncertainties in the radar estimation process. A framework has been provided to investigate the impact of errors relating to the radar rainfall estimation process, with many potential hydrological applications.

Code availability

The underlying software code is publicly available in RadErr available on GitHub (https://github.com/amyycb/raderr) (Green2024).

Data availability

The underlying research data were generated using methods in Green et al. (2024) parameterized using data from the NIMROD dataset (http://catalogue.ceda.ac.uk/uuid/82adec1f896af6169112d09cc1174499/, Met Office2003).

Author contributions

ACG: conceptualization, methodology, software, formal analysis, investigation, data curation, writing – original draft, visualization. CK: conceptualization, methodology, writing – review and editing, supervision. AB: conceptualization, methodology, supervision.

Competing interests

At least one of the (co-)authors is a member of the editorial board of Hydrology and Earth System Sciences. The peer-review process was guided by an independent editor, and the authors also have no other competing interests to declare.

Disclaimer

Publisher's note: Copernicus Publications remains neutral with regard to jurisdictional claims made in the text, published maps, institutional affiliations, or any other geographical representation in this paper. While Copernicus Publications makes every effort to include appropriate place names, the final responsibility lies with the authors.

Acknowledgements

This work is funded by the Natural Environment Research Council (NERC)-sponsored Data, Risk and Environmental Analytical Methods (DREAM) Centre for Doctoral Training in risk and mitigation research using big data. We thank two anonymous referees for their detailed and constructive reviews which have resulted in significant improvements to the paper.

Financial support

This research has been supported by the Natural Environment Research Council (grant no. NE/M009009/1).

Review statement

This paper was edited by Efrat Morin and reviewed by two anonymous referees.

References

AghaKouchak, A., Bárdossy, A., and Habib, E.: Conditional simulation of remotely sensed rainfall data using a non-Gaussian v-transformed copula, Adv. Water Resour., 33, 624–634, https://doi.org/10.1016/j.advwatres.2010.02.010, 2010a. a

AghaKouchak, A., Habib, E., and Bárdossy, A.: A comparison of three remotely sensed rainfall ensemble generators, Atmos. Res., 98, 387–399, https://doi.org/10.1016/j.atmosres.2010.07.016, 2010b.  a

Atlas, D. and Banks, H. C.: The Interpretation of Microwave Reflections From Rainfall, J. Meteorol., 8, 271–282, https://doi.org/10.1175/1520-0469(1951)008<0271:tiomrf>2.0.co;2, 1951. a

Battan, L. J. and Theiss, J. B.: Wind Gradients and Variance of Doppler Spectra in Showers Viewed Horizontally, J. Appl. Meteorol., 12, 688–693, https://doi.org/10.1175/1520-0450(1973)012<0688:wgavod>2.0.co;2, 1973. a

Berne, A. and Uijlenhoet, R.: Quantitative analysis of X-band weather radar attenuation correction accuracy, Nat. Hazards Earth Syst. Sci., 6, 419–425, https://doi.org/10.5194/nhess-6-419-2006, 2006. a

Berne, A., Delrieu, G., Creutin, J. D., and Obled, C.: Temporal and spatial resolution of rainfall measurements required for urban hydrology, J. Hydrol., 299, 166–179, https://doi.org/10.1016/j.jhydrol.2004.08.002, 2004. a

Berne, A., Delrieu, G., and Andrieu, H.: Estimating the vertical structure of intense Mediterranean precipitation using two X-band weather radar systems, J. Atmos. Ocean. Tech., 22, 1656–1675, https://doi.org/10.1175/JTECH1802.1, 2005. a

Cecinati, F., Rico-Ramirez, M. A., Heuvelink, G. B., and Han, D.: Representing radar rainfall uncertainty with ensembles based on a time-variant geostatistical error modelling approach, J. Hydrol., 548, 391–405, https://doi.org/10.1016/j.jhydrol.2017.02.053, 2017. a

Ciach, G. J. and Gebremichael, M.: Empirical Distribution of Conditional Errors in Radar Rainfall Products, Geophys. Res. Lett., 47, 1–8, https://doi.org/10.1029/2020GL090237, 2020. a

Ciach, G. J., Krajewski, W. F., and Villarini, G.: Product-error-driven uncertainty model for probabilistic quantitative precipitation estimation with NEXRAD data, J. Hydrometeorol., 8, 1325–1347, https://doi.org/10.1175/2007JHM814.1, 2007. a

Crane, R. K.: Automatic Cell Detection and Tracking, IEEE T. Geosci. Elect., 17, 250–262, https://doi.org/10.1109/TGE.1979.294654, 1979. a

De Vos, L., Leijnse, H., Overeem, A., and Uijlenhoet, R.: The potential of urban rainfall monitoring with crowdsourced automatic weather stations in Amsterdam, Hydrol. Earth Syst. Sci., 21, 765–777, https://doi.org/10.5194/hess-21-765-2017, 2017. a

Gabella, M. and Notarpietro, R.: ERAD 2002 Ground clutter characterization and elimination in mountainous terrain, Proceedings of ERAD, 305–311, https://www.copernicus.org/erad/online/erad-305.pdf (last access: 16 October 2024), 2002. a

Gires, A., Onof, C., Maksimovic, C., Schertzer, D., Tchiguirinskaia, I., and Simoes, N.: Quantifying the impact of small scale unmeasured rainfall variability on urban runoff through multifractal downscaling: A case study, J. Hydrol., 442–443, 117–128, https://doi.org/10.1016/j.jhydrol.2012.04.005, 2012. a

Green, A. C.: Radar rainfall errors, Zenodo [data set], https://doi.org/10.5281/zenodo.8029394, 2023. a

Green, A. C.: RadErr, GitHub [code], https://github.com/amyycb/raderr) (last access: 16 October 2024), 2024. a

Green, A. C., Kilsby, C., and Bardossy, A.: A framework for space-time modelling of rainfall events for hydrological applications of weather radar, J. Hydrol., 630, 130630, https://doi.org/10.1016/j.jhydrol.2024.130630, 2024. a, b, c, d

Grundmann, J., Hörning, S., and Bárdossy, A.: Stochastic reconstruction of spatio-Temporal rainfall patterns by inverse hydrologic modelling, Hydrol. Earth Syst. Sci., 23, 225–237, https://doi.org/10.5194/hess-23-225-2019, 2019. a

Hall, W., Rico-Ramirez, M. A., and Krämer, S.: Classification and correction of the bright band using an operational C-band polarimetric radar, J. Hydrol., 531, 248–258, https://doi.org/10.1016/j.jhydrol.2015.06.011, 2015. a

Harrison, D., Norman, K., Darlington, T., Adams, D., Husnoo, N., and Sandford, C.: The Evolution Of The Met Office Radar Data Quality Control And Product Generation System: RADARNET, in: 37th Conference on Radar Meteorology, 14–18- September 2015, Embassy Suites Conference Center, Norman, Oklahoma, p. 14B.2, https://ams.confex.com/ams/37RADAR/webprogram/Manuscript/Paper275684/RadarnetNextGeneration_AMS_2015.pdf (last access: 16 October 2024), 2017. a

Harrison, D. L., Driscoll, S. J., and Kitchen, M.: Improving precipitation estimates from weather radar using quality control and correction techniques, Meteorol. Appl., 7, 135–144, 2000. a, b

Hasan, M. M., Sharma, A., Johnson, F., Mariethoz, G., and Seed, A.: Correcting bias in radar ZR relationships due to uncertainty in point rain gauge networks, J. Hydrol., 519, 1668–1676, https://doi.org/10.1016/j.jhydrol.2014.09.060, 2014. a

Hasan, M. M., Sharma, A., Mariethoz, G., Johnson, F., and Seed, A.: Improving radar rainfall estimation by merging point rainfall measurements within a model combination framework, Adv. Water Resour., 97, 205–218, https://doi.org/10.1016/j.advwatres.2016.09.011, 2016. a

Hooper, J. E. N. and Kippax, A. A.: The bright band – a phenomenon associated with radar echoes from falling rain, Q. J. Roy. Meteorol. Soc., 76, 125–132, https://doi.org/10.1002/qj.49707632803, 1950. a

Jacobi, S. and Heistermann, M.: Benchmarking attenuation correction procedures for six years of single-polarized C-band weather radar observations in South-West Germany, Geomatics, Nat. Hazards Risk, 7, 1785–1799, https://doi.org/10.1080/19475705.2016.1155080, 2016. a, b, c, d, e

Kitchen, M., Brown, R., and Davies, A. G.: Real‐time correction of weather radar data for the effects of bright band, range and orographic growth in widespread precipitation, Q. J. Roy. Meteorol. Soc., 120, 1231–1254, https://doi.org/10.1002/qj.49712051906, 1994. a

Krämer, S.: Quantitative Radardatenaufbereitung für die Niederschalgsvorhersage und die Siedlungsentwässerung, Leibniz Universität Hannover, Mitteilungen des Instituts für Wasserwirtschaft, Hydrologie und landwirtschaftlichen Wasserbau, Heft 92, p. 392, 2008. a

Krämer, S. and Verworn, H.-R.: Improved C-band radar data processing for real time control of urban drainage systems, in: 11th International Conferenc on Urban Drainage, 23–26- September 2018, 1–10, https://doi.org/10.2166/wst.2009.282, 2008. a

Lee, G. W., Seed, A. W., and Zawadzki, I.: Modeling the variability of drop size distributions in space and time, J. Appl. Meteorol. Clim., 46, 742–756, https://doi.org/10.1175/JAM2505.1, 2007. a

Li, Y., Zhang, G., Doviak, R. J., Lei, L., and Cao, Q.: A new approach to detect ground clutter mixed with weather signals, IEEE T. Geosci. Remote, 51, 2373–2387, https://doi.org/10.1109/TGRS.2012.2209658, 2013. a

Libertino, A., Allamano, P., Claps, P., Cremonini, R., and Laio, F.: Radar estimation of intense rainfall rates through adaptive calibration of the ZR relation, Atmosphere, 6, 1559–1577, https://doi.org/10.3390/atmos6101559, 2015. a, b

Marshall, J. S. and Palmer, W. M. K.: The Distribution of Raindrops With Size, J. Meteorol., 5, 165–166, https://doi.org/10.1175/1520-0469(1948)005<0165:tdorws>2.0.co;2, 1948. a

Meischner, P.: Weather Radar – Principles and Advanced Applications, https://books.google.com/books/about/Weather_Radar.html?id=pnNNi9gD1CIC (last access: 16 October 2024), 2005. a

Met Office: Met Office Rain Radar Data from the NIMROD System, NCAS British Atmospheric Data Centre [data set], http://catalogue.ceda.ac.uk/uuid/82adec1f896af6169112d09cc1174499/ (last access: 16 October 2024), 2003. a, b

Michelson, D., Einfalt, T., Holleman, I., Gjertsen, U., Friedrich, K., Haase, G., Lindskog, M., and Jurczyk, A.: Weather radar data quality in Europe – quality control and characterization, Publications Office of the European Union Weather radar data quality in Europe – Publications Office of the EU, ISBN 92-898-0018-6, 2005. a

Nicol, J. C. and Austin, G. L.: Attenuation correction constraint for single-polarisation weather radar, Meteorol. Appl., 10, 345–354, https://doi.org/10.1017/S1350482703001051, 2003. a

Ochoa-Rodriguez, S., Wang, L. P., Gires, A., Pina, R. D., Reinoso-Rondinel, R., Bruni, G., Ichiba, A., Gaitan, S., Cristiano, E., Assel, J. V., Kroll, S., Murlà-Tuyls, D., Tisserand, B., Schertzer, D., Tchiguirinskaia, I., Onof, C., Willems, P., Veldhuis, M. C. T., Van Assel, J., Kroll, S., Murlà-Tuyls, D., Tisserand, B., Schertzer, D., Tchiguirinskaia, I., Onof, C., Willems, P., and Ten Veldhuis, M. C.: Impact of spatial and temporal resolution of rainfall inputs on urban hydrodynamic modelling outputs: A multi-catchment investigation, J. Hydrol., 531, 389–407, https://doi.org/10.1016/j.jhydrol.2015.05.035, 2015. a

Ośródka, K., Szturc, J., and Jurczyk, A.: Chain of data quality algorithms for 3-D single-polarization radar reflectivity (RADVOL-QC system), Meteorol. Appl., 21, 256–270, https://doi.org/10.1002/met.1323, 2014. a

Pegram, G. G. and Clothier, A. N.: Downscaling rainfields in space and time, using the String of Beads model in time series mode, Hydrol. Earth Syst. Sci., 5, 175–186, https://doi.org/10.5194/hess-5-175-2001, 2001. a

Rico-Ramirez, M. A., Liguori, S., and Schellart, A. N. A.: Quantifying radar-rainfall uncertainties in urban drainage flow modelling, J. Hydrol., 528, 17–28, https://doi.org/10.1016/j.jhydrol.2015.05.057, 2015. a

Savina, M., Schäppi, B., Molnar, P., Burlando, P., and Sevruk, B.: Comparison of a tipping-bucket and electronic weighing precipitation gage for snowfall, in: Rainfall in the Urban Context: Forecasting, Risk and Climate Change, vol. 103, Elsevier B.V., 45–51, https://doi.org/10.1016/j.atmosres.2011.06.010, 2012. a

Schleiss, M., Olsson, J., Berg, P., Niemi, T., Kokkonen, T., Thorndahl, S., Nielsen, R., Nielsen, J. E., Bozhinova, D., Pulkkinen, S., Ellerbæk Nielsen, J., Bozhinova, D., and Pulkkinen, S.: The accuracy of weather radar in heavy rain: A comparative study for Denmark, the Netherlands, Finland and Sweden, Hydrol. Earth Syst. Sci., 24, 3157–3188, https://doi.org/10.5194/hess-24-3157-2020, 2020. a

Seo, B. C., Krajewski, W. F., Quintero, F., ElSaadani, M., Goska, R., Cunha, L. K., Dolan, B., Wolff, D. B., Smith, J. A., Rutledge, S. A., and Petersen, W. A.: Comprehensive evaluation of the IFloodS Radar rainfall products for hydrologic applications, J. Hydrometeorol., 19, 1793–1813, https://doi.org/10.1175/JHM-D-18-0080.1, 2018. a

Shehu, B. and Haberlandt, U.: Relevance of merging radar and rainfall gauge data for rainfall nowcasting in urban hydrology, J. Hydrol., 594, 125931, https://doi.org/10.1016/j.jhydrol.2020.125931, 2021. a

Smith, J. A. and Krajewski, W. F.: A modeling study of rainfall rate‐reflectivity relationships, Water Resour. Res., 29, 2505–2514, https://doi.org/10.1029/93WR00962, 1993. a

Thorndahl, S., Einfalt, T., Willems, P., Nielsen, J. E., Veldhuis, M. C. T., Arnbjerg-Nielsen, K., Rasmussen, M. R., Molnar, P., Ellerbæk Nielsen, J., Ten Veldhuis, M. C., Arnbjerg-Nielsen, K., Rasmussen, M. R., and Molnar, P.: Weather radar rainfall data in urban hydrology, Hydrol. Earth Syst. Sci., 21, 1359–1380, https://doi.org/10.5194/hess-21-1359-2017, 2017.  a, b

Uijlenhoet, R. and Berne, A.: Stochastic simulation experiment to assess radar rainfall retrieval uncertainties associated with attenuation and its correction, Hydrol. Earth Syst. Sci., 12, 587–601, https://doi.org/10.5194/hess-12-587-2008, 2008. a

Ventura, J. F. I. and Tabary, P.: The new French operational polarimetric radar rainfall rate product, J. Appl. Meteorol. Clim., 52, 1817–1835, https://doi.org/10.1175/jamc-d-12-0179.1, 2013. a

Villarini, G. and Krajewski, W. F.: Review of the different sources of uncertainty in single polarization radar-based estimates of rainfall, Surv. Geophys., 31, 107–129, https://doi.org/10.1007/s10712-009-9079-x, 2010. a, b

Villarini, G., Seo, B.-C., Serinaldi, F., and Krajewski, W. F.: Spatial and temporal modeling of radar rainfall uncertainties, Atmos. Res., 135, 91–101, 2014. a

Yan, J., Li, F., Bárdossy, A., and Tao, T.: Conditional simulation of spatial rainfall fields using random mixing: A study that implements full control over the stochastic process, Hydrol. Earth Syst.Sci., 25, 3819–3835, https://doi.org/10.5194/hess-25-3819-2021, 2021. a

Download
Short summary
Weather radar is a crucial tool in rainfall estimation, but radar rainfall estimates are subject to many error sources, with the true rainfall field unknown. A flexible model for simulating errors relating to the radar rainfall estimation process is implemented, inverting standard processing methods. This flexible and efficient model performs well in generating realistic weather radar images visually for a large range of event types.