In this paper we present a non-stationary stochastic generator for radar rainfall fields based on the short-space Fourier transform (SSFT). The statistical properties of rainfall fields often exhibit significant spatial heterogeneity due to variability in the involved physical processes and influence of orographic forcing. The traditional approach to simulate stochastic rainfall fields based on the Fourier filtering of white noise is only able to reproduce the global power spectrum and spatial autocorrelation of the precipitation fields. Conceptually similar to wavelet analysis, the SSFT is a simple and effective extension of the Fourier transform developed for space–frequency localisation, which allows for using windows to better capture the local statistical structure of rainfall. The SSFT is used to generate stochastic noise and precipitation fields that replicate the local spatial correlation structure, i.e. anisotropy and correlation range, of the observed radar rainfall fields. The potential of the stochastic generator is demonstrated using four precipitation cases observed by the fourth generation of Swiss weather radars that display significant non-stationarity due to the coexistence of stratiform and convective precipitation, differential rotation of the weather system and locally varying anisotropy. The generator is verified in its ability to reproduce both the global and the local Fourier power spectra of the precipitation field. The SSFT-based stochastic generator can be applied and extended to improve the probabilistic nowcasting of precipitation, design storm simulation, stochastic numerical weather prediction (NWP) downscaling, and also for other geophysical applications involving the simulation of complex non-stationary fields.
Precipitation exhibits a large spatial and temporal variability over a wide range of scales (Lovejoy and Schertzer, 2006). Such complexity represents a continuous challenge in the practice of observing, understanding and simulating precipitation processes. Despite great efforts, the measurement and prediction of rainfall at fine space–time resolutions is still associated with large errors. Consequently, it is of crucial importance to accurately characterise the uncertainty related to its measurement and prediction, in particular for hydrometeorological applications that are sensitive to input precipitation uncertainty (Zappa et al., 2010).
For medium-range weather forecasting at synoptic and mesoscales, the forecast
uncertainty is usually considered by perturbing the initial conditions of
numerical weather prediction (NWP) models to generate an ensemble of possible
future realisations. However, the NWP approach for uncertainty quantification
is often not adapted for several hydrological applications, when high spatial
and temporal resolution is required. A typical application for very short-term
forecasting (nowcasting) of radar rainfall at a 5 min update rate would
need ideally the generation of 50–100 realisations of precipitation fields
for the next 6 h in less than 5 min. Assuming 1 s of computational
time per realisation, it already requires 60 min on a single processor (50
realisations
It has been long observed that rainfall fields exhibit spatial and temporal organisation, which is consistent with the scaling and multifractal framework (Schertzer and Lovejoy, 1987; Menabde et al., 1997). This observation is convenient since it allows for developing parsimonious stochastic simulation methods, which are able to generate realistic precipitation fields that depend only on a few parameters. Stochastic rainfall generators are effective in characterising the uncertainty related to the measurement and forecasting of precipitation and they constitute the core of most statistical design storm techniques, probabilistic nowcasting and NWP downscaling methods.
An ideal stochastic rainfall generator for hydrometeorological applications
should be able to
simulate large precipitation fields (> 500 reproduce the observed spatial and temporal autocorrelation of the observed
precipitation fields; reproduce the observed power-law scaling behaviour of the rainfall fields
(ideally the multifractal scaling of different moments of order
reproduce the observed marginal distribution of rainfall rates (often
skewed); take into account the rainfall intermittency and the effects due to the rain/no-rain
transition; integrate in a flexible way possible sources of predictability (NWP
forecasts, analogues, orography, etc.); handle the spatial and temporal non-stationarity of the statistical properties of
precipitation.
This paper focuses particularly on point 7 and presents a non-stationary spatial stochastic rainfall generator, which is able to reproduce the local variability and anisotropy of the observed precipitation fields.
There is abundant literature on random field generators using geostatistical (Goovaerts, 1997; Lantuéjoul, 2002) and multifractal approaches (Menabde et al., 1997; Lovejoy and Schertzer, 2006). A widely used covariance-based geostatistical random field generator in hydrology is based on the turning bands method (TBM; see a review in Lantuéjoul, 2002), which reduces the problem of simulating a multi-dimensional Gaussian random field to the simulation of a set of independent uni-dimensional autocorrelated Gaussian processes along random orientations (for practical implementations in hydrology refer to Mantoglou and Wilson, 1982; Tompson et al., 1989). In the context of precipitation, Leblois and Creutin (2013) adapted the TBM to simulate unconditional stochastic fields, which reproduce the correct intermittency and advection of precipitation fields, which was further extended for ensemble precipitation nowcasting by Caseri et al. (2016). Schleiss et al. (2014) also followed the geostatistical approach by using sequential Gaussian simulations (SGS) to generate conditional and unconditional radar rainfall fields, which realistically decay towards zero when moving out from the wet regions (concept of “dry drift”). Despite the speed-up strategies implemented, both the SGS and TBM approaches are still too computationally demanding to generate large precipitation ensembles over extended domains for real-time applications.
Another class of algorithms relies on the fast Fourier transform (FFT), which has efficient and easy to use libraries in most programming languages. The Wiener–Khintchine theorem (Wiener, 1930; Khintchine, 1934) states that the power spectral density (generally referred to as “power spectrum”) of a wide-sense stationary random process can be obtained as the Fourier transform of the autocorrelation (autocovariance) function of that process. Thus, it becomes clear that stochastic simulation methods based on covariance or variogram can be easily reformulated by exploiting the FFT to achieve increased computational efficiency (Marcotte, 1996). In addition, the representation of data in Fourier space can enhance our understanding of the underlying generating mechanism and scaling behaviour of rainfall.
One of the most straightforward and widely used stochastic noise generation techniques is the filtering of a white noise field using a Fourier spectrum characterised by a power-law behaviour (linear relationship in log–log plot of power vs. frequency). The inverse Fourier transform of the filtered noise field directly provides a spatially correlated field, which reproduces the chosen power-law spectrum (for example corresponding to an exponential covariance function). This stochastic generator will be referred to as global FFT noise throughout the paper. The FFT provides an efficient solution to simulate fractional Brownian motion fields (Mandelbrot and Van Ness, 1968), multi-dimensional and also multivariate autocorrelated random fields (Robin et al., 1993). Fractional noise integration is particularly useful to model geophysical processes, which exhibit Fourier spectra following power laws of fractional order (Schertzer and Lovejoy, 1987), in particular precipitation fields (Menabde et al., 1997; Lovejoy and Schertzer, 2006).
There is a long list of probabilistic precipitation estimation, nowcasting, design storm and NWP downscaling techniques that exploit the FFT noise to generate ensembles of stochastic rainfall fields. One of the most advanced probabilistic nowcasting techniques is the Short-Term Ensemble Prediction System (STEPS; Bowler et al., 2006), which represents the uncertainty due to rainfall growth and decay processes by adding stochastic perturbations to a deterministic radar extrapolation forecast. The radar rainfall field is decomposed in Fourier space into an eight-level multiplicative cascade to allow for representing the scale dependence of the predictability of precipitation. The rainfall cascade is blended scale by scale with a cascade of spatially correlated noise fields to consider the different rate of development of precipitation at different spatial scales. STEPS is operationally used at the Australian Bureau of Meteorology, the UK Met Office and the Royal Meteorological Institute of Belgium, and is in continuous development (see Seed et al., 2013; Foresti et al., 2016). The STEPS framework was also used for design storm generation to produce realistic synthetic rainfall fields (Seed et al., 1999; Niemi et al., 2016). SBMcast is another well-known probabilistic nowcasting system, which employs the FFT noise technique (Berenguer et al., 2011). It is based on the “String of Beads” model of Pegram and Clothier (2001a, b), which simulates the joint evolution of global radar rainfall field statistics that define the general storm behaviour (wet area ratio and image mean flux, i.e. rainfall fraction and mean rainfall) and the local rainfall. Metta et al. (2009) developed a probabilistic nowcasting system that exploits a Langevin-type model for the evolution of Fourier phases to generate isotropic stochastic rainfall fields. A similar approach was implemented within the RainFARM model of Rebora et al. (2006b) for stochastic NWP precipitation downscaling in space and time. STREAP (Paschalis et al., 2013) also uses the Fourier transform for design storm generation to produce Gaussian random fields with an exponentially decaying isotropic autocorrelation function. Atencia and Zawadzki (2014) used the power spectrum of the last observed radar rainfall field to generate spatially correlated and anisotropic stochastic perturbations for ensemble precipitation nowcasting. Niemi et al. (2014) parametrised the two-dimensional (2-D) power spectrum of precipitation fields to obtain a Fourier filter able to simulate anisotropic stochastic rainfall fields for design storm generation (Niemi et al., 2016).
Stochastic noise generators are also increasingly used to characterise the residual radar measurement uncertainty (Ciach et al., 2007) for ensemble quantitative precipitation estimation (ensemble QPE). An important group of techniques generates the stochastic perturbations by LU or Cholesky decomposition of the covariance matrix, which represents the multiplicative radar and rain gauge errors (see, e.g., Germann et al., 2009; Villarini et al., 2009). Given the direct link between the covariance and the Fourier spectrum via the Wiener–Khintchine theorem, it is not a surprise to observe that FFT-based noise generators are also used for ensemble radar-based QPE (Jordan et al., 2003; Pegram et al., 2011). An interesting question is how to condition the unconditional rainfall ensembles to rain gauges, e.g. as done in the conditional merging of Sinclair and Pegram (2005) or the random mixing approach of Bardossy and Hörning (2016). It is worth mentioning that Velasco-Forero et al. (2009) and Schiemann et al. (2011) also took advantage of the Wiener–Khintchine theorem to obtain 2-D positive definite correlograms directly from radar rainfall images for improved blending with rain gauge measurements.
Apart from few exceptions, the stochastic generators presented above assume spatial stationarity, i.e. uniformity of the generator across space. As a consequence the generator is only able to produce spatially homogeneous noise fields (see point 7 in the requirements of the generator at the beginning of the Introduction). More precisely, they cannot represent and simulate non-stationary fields that display an heterogeneous distribution of autocorrelation range and/or anisotropy.
The non-stationarity in the local statistical properties becomes easily visible when stratiform and convective precipitation coexist in different regions of the radar domain or when there are clear local anisotropies in different directions (see for example Fig. 1). The need for a non-stationary stochastic noise generator is even more relevant in regions with complex orography, such as Switzerland, where the statistical properties and predictability of precipitation are strongly controlled by orographic forcing (Panziera and Germann, 2010; Mandapaka et al., 2012; Foresti and Seed, 2014, 2015). A few approaches have been proposed to adapt the stochastic generators to better capture the local variability of precipitation. Pathirana and Herath (2002) and Badas et al. (2006) proposed to filter or remove the heterogeneities of the precipitation field before applying a homogeneous multifractal downscaling technique and re-adding the trend after running the stochastic simulation. A similar strategy was employed in a recent STEPS implementation, which computes the local mean and variance of the rainfall field on a regular grid to remove the local non-stationarity before adding the homogeneous stochastic perturbations (Seed et al., 2013). However, these strategies are not able to generate noise fields that reflect the local 2-D power spectrum and anisotropy of precipitation fields. When applied for nowcasting of weather situations presenting strong local anisotropies, the stochastic perturbations gradually destroy the original spatial structure and important information is rapidly lost. The need for a more flexible approach to directly consider the non-stationarity of real-world geophysical fields such as rainfall was already pointed out by Lovejoy and Schertzer (2013). The same authors argued that the estimation of the generator over small sections of the field in a moving window fashion suffers from the small sample size. Therefore, they proposed to model the spatial variation of the variables defining the generator using a non-linear extension of generalised scale invariance (GSI), whose estimation, however, is also not trivial (Lovejoy and Schertzer, 2013).
Example of non-stationarities in a radar rainfall field of
512 km
The contribution of this paper is the design of a non-stationary stochastic rainfall generator based on the short-space Fourier transform (SSFT; Hinman et al., 1984). The idea is to extend the short-time Fourier transform (STFT; Kovačević et al., 2013) for 2-D spatial fields both for local Fourier analysis and stochastic simulation. Conceptually similar to the wavelet transform (Kumar and Foufoula-Georgiou, 1997; Kovačević et al., 2013), the STFT and SSFT allow for time–frequency and space–frequency localisation respectively; i.e. they enable performing a local moving window Fourier analysis to account for non-stationarity in the statistical properties of the signal (in our case a 2-D precipitation field). The traditional global FFT noise technique can be easily extended by performing local Fourier filtering of white noise in a moving window fashion using the local Fourier transform of the precipitation field as filter. The obtained locally correlated noise field (denoted as SSFT noise) automatically reproduces the local correlation structure of the target precipitation field. In this study we want to investigate to which extent it is reasonable to estimate a local stochastic generator from the data considering the larger uncertainty due to the reduced sample size.
In order to demonstrate the advantage of using a non-stationary noise generator, we selected four non-stationary rainfall fields from the fourth generation of Swiss dual-polarisation weather radar composite. We verified the ability of the generator in replicating the global and local statistical properties of the precipitation fields (Fourier spectrum, anisotropy). The SSFT noise generator will open the doors for enhanced probabilistic precipitation estimation and nowcasting, design storm generation and stochastic NWP downscaling. Geostatistical interpolation methods considering the local anisotropy (e.g. Boisvert et al., 2009; Gyasi-Agyei, 2016) could also be extended to perform local stochastic simulation.
The paper is organised as follows. Section 2 describes the global Fourier-based method for generating spatially correlated stochastic noise fields (FFT noise). Section 3 explains the generation of locally correlated stochastic noise based on the SSFT noise and Sect. 4 makes use of synthetic data produced with parametric methods in order to illustrate and test the functioning of the novel approach. Section 5 presents four selected radar rainfall fields characterised by strong non-stationarities. The four precipitation cases are thus used for the verification of the local SSFT noise generator in comparison with the global FFT noise generator, in particular its ability to reproduce both the global and local structure of precipitation fields. At the end of the Sect. 5, we provide two examples demonstrating the potential applications of the local noise generator. First, we present stochastic simulations of synthetic radar rainfall fields by appropriate local adjustment of the noise fields. Then, we introduce the temporal structure of the precipitation field by using the local noise as a shock term in an auto-regressive process in the context of a simplified stochastic precipitation nowcast. Section 6 concludes the paper and enumerates possible applications and extensions of the generator for stochastic precipitation simulation.
This section formulates the model to generate 2-D spatially correlated noise and precipitation fields. Such fields should reproduce the spatial scaling, and thus spatial autocorrelation, of the target radar rainfall field. The numerical simulation of such random fields is based on the idea of filtering a Gaussian white noise field using the power-law Fourier spectrum of the precipitation field, also known as fractional integration (Schertzer and Lovejoy, 1987). The following sections explain the basic principles of the Fourier transform and how it can be used for simulation of stationary spatially correlated random fields.
The corner stone of signal processing theory (Stankovic et al., 2013) is the
idea that a signal
If the signal
That leads us to the next step, which is the expansion of the Fourier
transform to the analysis of stochastic spatial signals – stochastic fields.
The expanded, 2-D Fourier transform (2-D FT) would be, as a matter of fact,
the corner stone of image processing theory (Stankovic et al., 2012). Namely,
using 2-D FT a field
In order to obtain the autocorrelation function, the signal needs to be standardised by removal of the mean and division by the standard deviation; otherwise only the non-centred autocovariance is obtained. Using the Wiener–Khintchine theorem and exploiting the speed of FFT one can compute the autocorrelation function of regularly sampled signals very efficiently (Marcotte, 1996; Velasco-Forero et al., 2009; Schiemann et al., 2011). On the other side, the classical approach to derive the spatial autocorrelation function would require computing all the Euclidean distances between pairs of points located at different ranges and along different directions.
Aside from the complete 2-D information about field power
spectral density (
One of the most noteworthy properties of the Fourier transform is a
significantly facilitated convolution in the spatial (or temporal) domain.
Namely, the convolution of two fields
In analysing real, observed fields, we actually never deal with the
continuous functions (e.g.
Namely, the straightforward way of generating a stationary correlated noise
field, i.e. a stochastic field with the overall spatial correlation of a
natural rainfall field, is the non-parametric filtering of a white noise
field (
The most important drawback of the obtained stationary correlated noise field
is its spatial stationarity. Namely, as already pointed out, the obtained
spectrum (
In Sect. 2.2 the white noise field was filtered by the actual DFT of the rainfall field without any parametrisation of the distribution of power as a function of frequency and direction. This is referred to as non-parametric filtering of white noise and allows for automatic simulation of the observed anisotropies and variability of the spectral slope as a function of scale (Seed et al., 2013). This approach is particularly effective for cases with sufficient precipitation coverage over the radar domain and in the absence of measurement noise.
On the other hand, for cases with a small fraction of precipitation, the Fourier transform suffers from the small sample size. As a consequence, the power spectrum becomes noisy and it may be hard to observe the anisotropy or the power-law rainfall scaling behaviour. In order to increase the sample size and reduce the noise, a more stable Fourier power spectrum can be computed by averaging the spectra of a sequence of precipitation fields as done by Niemi et al. (2014). This strategy could be helpful in particular when computing local Fourier transforms for the SSFT (see Sect. 3.1).
Instead, it is common to parametrise the 2-D or 1-D power spectra using
simple power-law scaling models for rainfall. The parametrisation of 2-D
power spectra can be achieved by constructing an anisotropic filter that
considers isolines of constant power as a function of frequency based on the
principle of GSI (Niemi et al., 2014). A simpler
isotropic scaling model can be constructed from the radially averaged 1-D
power spectrum by neglecting the field anisotropy. A power-law fit of the
rainfall field power vs. spatial frequency in log–log plot is generally
sufficient for the task. More refined models acknowledge the presence of a
scaling break in the power-law around 10–20 km by fitting two spectral
exponents (
The following section introduces the concept of SSFT, and explains how the former is used in overcoming the evoked issue of spatial stationarity in the simulation of spatially correlated noise fields.
The concept of SSFT is introduced through its more intuitive 1-D temporal equivalent and then extended to the 2-D spatial case. Namely, the phase of the Fourier representation of a time series contains information about the temporal distribution of spectral components, but its interpretation proves to be difficult. Therefore, due to the increasing need to face the non-stationarity of the signal, numerous advanced methods have been proposed (Stankovic et al., 2013), all of which can be gathered under the umbrella of time–frequency signal analysis (TFSA).
The most intuitive and representative TFSA method is the STFT, which provides Fourier spectra of localised parts of a
signal:
The original signal can be obtained by integrating over all individual inverse FT:
Analogously to the Fourier transform, the STFT can be
expanded to the spatial domain, becoming the
SSFT:
The critical part concerns choosing the size of the window, as well as its
shape. Namely, due to the uncertainty principle, a smaller window in the
space domain, i.e. a better space resolution, results in a worse frequency
resolution, and vice versa. Choosing an appropriate function
Equivalently to the convolution in space domain, which corresponds to the
product in its frequency counterpart (Eq. 7), the product in space domain
forms a Fourier pair with the convolution of the spectra. Therefore, the
localisation of the field in space, with the window function
The most intuitive choice of a window would be a simple rectangular function
of width
However, as it can be seen in Fig. 2, the side lobes of
The corresponding FT decreases proportionally to the
FT pairs for rectangular and Hanning windows (values normalised to unity).
As already stated previously, in the context of numerous diverse applications, the most obvious drawback of a conventionally derived correlated noise field is its spatial stationarity. Tackling that issue, which is the main motivation and idea of this work, is conceptually quite simple: it comes down to the replacement of the Fourier transform, in both non-parametric and parametric filters, with the SSFT.
Namely, instead of deriving either a parametrised or non-parametrised (Eq. 8)
Fourier spectrum of the entire rainfall field in order to filter white noise,
here we derive a number of local spectra by focusing at different parts of
the field. This is done by sliding and centring the window at positions
In the following step, the local spectra are convolved with a white noise
field
By using only the amplitude spectrum of the rainfall field (its absolute
value), rather than perturbing the phase of the rainfall field, we are
actually imposing the random phase of the white noise field, and slightly
perturbing the amplitude. This way we preserve the local anisotropy, while
simultaneously benefiting from the phase coherence in the final
recomposition; i.e. it decreases the need for the overlapping. The
recomposition of the final non-stationary field is obtained by summing over
all the local spatially correlated noise fields:
The novel concept can be intuitively demonstrated, or rather illustrated,
using a synthetic data set. Namely, instead of using Eq. (9) (i.e. the
non-parametric approach), here we rely on parametric filtering in order to
prescribe a power spectrum to a field of Gaussian white noise. The most
straightforward approach is to use an isotropic power-law filter:
Examples of 512 px
The same filtering can be applied locally, so that a set of
As a next step, the method was tested in its ability to reproduce the locally varying anisotropy of a synthetic target image. This target image was produced by means of the GSI model as presented by Niemi et al. (2014). The method was firstly introduced by Lovejoy and Schertzer (1985) to describe the scaling behaviour of anisotropy within multifractal fields. The GSI method has the advantage of being able to model the scale dependence of anisotropy using only few parameters. It should be noted that the parametrisation of anisotropy can also be done with 2-D anisotropic autocorrelation functions as can be found in the field of geostatistics. In such cases, the corresponding filter in the Fourier space is obtained with the Wiener–Khintchine theorem (Eq. 6).
In a similar way as in Fig. 4, the set of arbitrary parameters of the GSI model was spatially varied in order to produce a target image with changing anisotropy. The result of the simulation is presented in Fig. 5a. We tested again the ability of the global and local non-parametric generators to reproduce the spatial heterogeneities introduced in the target field and the results are presented in Fig. 5b and c. While generally the global generator could only learn and reproduce the same average anisotropy, the local approach managed to localise the distinct patterns of the field. In particular, the method is effective in producing the correct angle of anisotropy.
In the non-parametric local realisations presented in Figs. 4c and 5c, one can notice a certain contraction of the contours of the autocorrelation functions compared to the references in the target field. This means that the non-parametric realisations exhibit slightly lower correlation ranges. We believe that this is caused by a combination of minor source of errors associated with the use of the Hanning window and imperfections in the white noise. Hardly preventable, these minor deviations are the integral part of the method. It should also be noted that some degree of localisation can still be found in the result of the global non-parametric simulations. This is believed to be the effect of the residual phase information contained in the global Fourier spectrum used for the white noise filtering (Sect. 2.2). However, this will not be the case with a parametric filter, as no phase information would be available.
The side length of the window function used to estimate the local Fourier spectrum is expected to affect the accuracy of the estimation. In fact, if too large a window is used, then the localisation gets less and less informative and the assumption of stationarity within the window becomes weaker. The global approach represents a particular case, when the window size equals the image size. On the other hand, if a too small a window is used, we lose information at wavelengths larger than the window itself and the filter may become ill-defined due to a limited sample size.
In Fig. 6, non-zero synthetic realisations of 512 px
The radially averaged 1-D centred power spectra of synthetic
realisations with spectral slope
Precipitation fields from the MeteoSwiss operational radar product for QPE (Germann et al., 2006) were employed for testing the method with real data. In 2015, this weather radar product corresponded to the Cartesian composite of four C-band Doppler radars equipped with dual polarisation (Germann et al., 2015). It should be noted that the radar on the Weissfluhgipfel became operational only in 2016 and it is thus not included in this analysis (Fig. 7).
The 512 km
The raw volumetric radar data undergo a sophisticated signal processing in order to guarantee the best possible precipitation estimates at ground level in a predominately alpine environment. The processing chain includes ground clutter removal by means of a clutter-elimination decision tree including dual-polarisation moments, visibility correction, correction for the vertical profile of reflectivity (VPR), global and local bias correction. For more details, the reader is referred to Germann et al. (2006).
Spatial resolution of the final Cartesian radar grid is 1 km and the
temporal sampling is 5 min. In this study, the original images are cropped
to a 512 km
The choice of the rainfall threshold and of the value associated with zero
rain in dBZ is quite critical and affects the Fourier spectrum, in
particular at high spatial frequencies. In fact, a larger step at the
rain/no-rain transition has the effect of increasing the power at high
frequencies, thus decreasing the absolute value of the spectral slope
The first case study is taken from an event on 30 March 2015 and is presented
in Fig. 8a. The main north-westerly flow is associated with strong orographic
blocking on the northern slopes of the Alps, producing persistent stratiform
precipitation on a large portion of the country. At the same time, a squall
line develops to the north and rapidly moves to the south-east following the
displacement of the cold front. These two features display contrasting
spatial characteristics: the pre-frontal, orographic precipitation has low
intensity and a long range of spatial autocorrelation, while the cold front
produces convective activity organised on a straight line with a different
orientation angle. The squall line is clearly visible in the 2-D power
spectrum as a horizontal line passing through the centre of the spectrum
(Fig. 8a, centre). In the 2-D autocorrelation function in the bottom panel of
Fig. 8a, these two distinct patterns translate at larger scales into a main
anisotropy of approximately 45
Radar rainfall fields (top row), 2-D Fourier spectra zoomed on
wavelengths > 13 km and rotated by 90
The second case study is from 15 May 2015 at 16:00 UTC and is illustrated in
Fig. 8b. The south-easterly flow pushes convective cells to the southern Alps
where they are blocked by the mountain ridge. At the same time, narrow bands
of precipitation are distributed on the northern and western portions of the
image while moving south-west. Overall, the apparent motion field has a
anticlockwise rotation about the centre of the image and is responsible
for the appearance of the local anisotropies. These two distinct
precipitation structures have pronounced anisotropies at 90
The third case study belongs to an event on 8 June 2015 at 02:30 UTC (Fig. 9a). The image is characterised by a distinct active line of thunderstorms along the southern Prealps. This is originated from weak easterly currents bringing humid air towards the Alps that is then destabilised by the transition of an occluded front. Precipitation in the northern side of the Alps is instead associated with a low pressure at ground level. These two main features have strong differences in both orientation and correlation ranges that are caused by the presence of the Alps.
Radar rainfall fields (top row), 2-D Fourier spectra zoomed on
wavelengths > 13 km and rotated by 90
The fourth and final case study is from 15 June 2015 at 11:45 UTC (Fig. 9b). This case is not characterised by any distinct large-scale anisotropy as the precipitation patterns look almost isotropic. Instead, it is easy to notice a north–south gradient in the autocorrelation ranges of the rainfall patterns. In fact, the northern side of the Alps is principally characterised by patches of stratiform precipitation of low intensity, while in the southern part of the image there are small-scale precipitation structures only in correspondence of topographical features.
Localised 2-D autocorrelation functions (black contours for 0.5,
0.6, 0.7, 0.8 and 0.9 correlation coefficients) for all four case studies
(rain rates in black and white) and the corresponding non-parametric
stochastic simulations using both the global and local generators. The image
domain is 512 km
Both global and local noise generators were tested to detect and model the local non-stationarities in the weather radar images presented above. The local SSFT generator was applied with a window side length of 256 km (i.e. half of the original field size), a Hanning window function and no overlapping. Such settings allow for a clear representation and interpretation of the results. The global FFT generator can be seen as a particular case of the local SSFT generator with the window side length equal to the field size, 512 km in this case.
Figure 10 presents for all case studies the 2-D autocorrelation functions within the four windows of 256 km side length as shown by the grid. The latter is computed and averaged over 20 realisations of global and local noise, while only the first realisation is shown in the background as an example. It should be noted that the notion of local is defined by the choice of the window size, as there is the assumption of homogeneity of statistical properties within a single window. The visual comparison shows that for all four cases, only the local approach can effectively reproduce the non-stationarities as defined in the reference images on the left. It is easy to notice how the global generator systematically produces average autocorrelation functions that are driven by the main anisotropies observed in the field. As already discussed in the synthetic examples in Sect. 4, small differences between the reference 2-D autocorrelation functions and those computed from the obtained SSFT noise fields are believed to be linked to sources of errors caused by the windowed approach, such as the use of the Hanning window.
Arguably, even for a 256 km window the assumption of stationarity appears as weak and this is noticeable by the presence of abrupt changes between some of the adjacent windows. The use of smaller windows and the introduction of some degree of overlapping between successive windows will guarantee a smoother transition over the field.
The goal of the global FFT noise generator is to impose the same power spectrum observed in the precipitation radar image to a field of Gaussian white noise. The local SSFT noise generator has the advantage of being able to localise this operation in order to account for non-stationarities. However, a legitimite question is whether the local SSFT noise generator is still able to reproduce the global power spectrum, despite representing the precipitation as a convolution of localised Fourier transforms. The analysis over synthetic data (see Fig. 6) showed that there is a loss of power in the spectrum for wavelengths larger than the window size. The same analysis can be done with the precipitation fields presented above, thus introducing all the complexities associated with real data. For this verification we computed the radially averaged 1-D power spectra of the target rainfall field, the global FFT noise and the local SSFT noise using three different window sizes (264, 128 and 64 km). For the sake of comparison, all the power spectra were centred to have a zero mean.
The 1-D power spectra in Fig. 11 show that overall both global and local FFT
approaches manage to impose to uncorrelated white noise a similar scaling
behaviour as observed in the reference rain analysis. However, it is easy to
notice the loss of power at large wavelengths associated with the reduction
of the window size. Moreover, the magnitude of the deviation varies between
the four case studies. Interestingly, the last case study in Fig. 11d
displays the least significant deviations at large wavelengths, while it is
also associated with the lowest spectral slope (i.e. the least negative
A first application of the SSFT generator is related to design storms. In order to dimension the size of hydraulic infrastructure (sewer systems, hydroelectric dams, artificial banks and bridges, etc.), it is important to model the maximum expected flood and discharge under different weather situations. The probable maximum precipitation (PMP) can be computed by running NWP models using extreme input conditions or by stochastic simulation of a large number of synthetic rainfall fields, e.g. using statistics from extreme events that occurred in the past.
The FFT noise and SSFT noise fields already reproduce the power spectrum and spatial autocorrelation function of the rainfall fields, but they do not replicate the same marginal statistics (empirical statistical distribution, mean and variance, wet area ratio, etc.). There are different techniques that are used in order to transform the noise fields so that they reproduce the statistics of rainfall fields. A well-established approach is to threshold the noise field to have the same wet area ratio (WAR) of the target rainfall field and to rescale the non-zero values to have the same marginal mean precipitation, usually known as “shift and scale” (Pegram and Clothier, 2001a, b; Berenguer et al., 2011). A similar method attempts to match the observed mean and standard deviation of the precipitation field (Seed et al., 1999; Niemi et al., 2014). More sophisticated methods apply a quantile–quantile transformation to match exactly the same empirical distribution of observed precipitation values, which is also known as probability matching or anamorphosis (Metta et al., 2009; Schleiss et al., 2014).
All these transformation techniques share the same dilemma; i.e.
changing the marginal statistics of the noise fields perturbs their power
spectra (Metta et al., 2009). More precisely, the noise fields accurately
reproduce the power spectrum of the precipitation fields but not their
marginal statistics. On the other hand, the simulated precipitation fields
accurately reproduce the marginal statistics but the power spectra are
slightly perturbed. Following the approach of Pegram and Clothier (2001a, b),
a local adjustment of the noise is applied.
Observed wet area ratio (WAR From the noise field, The marginal mean and marginal standard deviation with respect to The noise field Finally, all values in
Steps 1 to 5 can be applied at once to the whole image or more locally within
smaller windows. In this case, values of MM
We applied the above procedure at a resolution of 64 km to a number of realisations of correlated Gaussian noise generated using the rainfall field of case study 1 (30 March 2015). The original field and the three stochastic realisations are presented in Fig. 12 for both globally and locally generated noise. The use of a locally modulated noise allows one to better reproduce some of the specific features of the original rainfall field, such as the squall line in the upper portion of the image. Not all realisations produced this local feature with the same realism and still some residual noise affects the quality of the output. Nevertheless, we consider the examples in Fig. 12 as a significant improvement in the context of stochastic simulation of precipitation fields.
The 1-D centred power spectra of precipitation fields for the four case studies are represented in red. In black are the corresponding average spectra of 20 non-parametric noise field realisations with decreasing window sizes.
Three stochastic realisations conditioned to case study 1 (30 March
2015) after local adjustment at 64 km resolution of correlated global FFT
(left) and local SSFT (centre) Gaussian noise. The top right panel shows the
actual observed field. Parameters of the local SSFT generator: window
size
Probabilistic precipitation nowcasting represents a common application of
fields of stochastic noise and it can be helpful to illustrate how to
simulate the temporal structure of precipitation. The unknown temporal
evolution of precipitation due to growth and decay processes (often
considered in Lagrangian coordinates) is usually modelled by auto-regressive
models (AR) of the order of 1 or 2 (see Pegram and Clothier, 2001a, b; Seed, 2003;
Bowler et al., 2006; Berenguer et al., 2011; Seed et al., 2013; Atencia and
Zawadzki, 2014). A time series following a first-order auto-regressive
process (AR(1)) can be constructed as follows:
The problem becomes more complicated when trying to model the temporal evolution of 2-D precipitation fields, which requires preserving the joint spatial correlation between different points in the domain. In other words, using a 2-D field of white noise as shock term would end up destroying the spatial structure of the precipitation field after a few time steps. The shock term should serve as a model for the expected forecast errors, which are known to be correlated in both space and time. The classical approach is to filter a field of stationary FFT noise using an AR(1) model that evolves with the same Lagrangian autocorrelation of the precipitation field. This generates a time series of spatially and temporally correlated noise fields that can be used as shock terms in Eq. (25) (Bowler et al., 2006). The auto-regressive filtering of correlated noise fields allows one to condition the future rainfall realisations to the last observed rainfall field and to effectively model the growth of forecast errors by imposing appropriate spatial and temporal correlations.
Example of simplified stochastic rainfall nowcasting for case study
2 (15 May 2015). Here the advection component is neglected and the movement
of the rainfall field is assumed to be zero. Growth and decay processes are
simulated stochastically using an AR(1) process with a
globally
However, in the presence of non-stationary precipitation fields, it is not adequate to simply use stationary FFT noise, which does not represent the local characteristics of the field. In fact, as the time progresses the global noise will gradually destroy the local anisotropies and inject too much variability within areas of smoother stratiform rain, or conversely not enough variability in convective regions. Therefore, we expect the local SSFT noise to provide a more realistic and locally adaptive shock term.
In order to test this hypothesis, we generated two time series of stochastic
precipitation fields, one using the global and one using the local shock
term. Figure 13 illustrates an example of stochastic precipitation nowcasting
using a simple AR(1) model to simulate the temporal variability of rainfall
due to unknown growth and decay processes. The correlation of the AR(1)
process has been set to the Eulerian temporal autocorrelation with the
previous radar rainfall field. The visual comparison for increasing
lead times (
In this paper we proposed a novel approach for the generation of non-stationary stochastic rainfall fields. The main idea behind this work consists in the simulation of a stochastic rainfall field in order to preserve not only global spatial correlation properties of the target precipitation field, but also the spatial distribution of its local correlation ranges and anisotropies. This is achieved by replacing the 2-D Fourier transform in both non-parametric and parametric conventional filtering of white noise, with the short-space Fourier transform (SSFT). Namely, instead of convolving the white noise field with the entire precipitation field, we perform the convolution locally, by employing a carefully parametrised moving window. This way, we obtain a spatially correlated noise field, which locally reproduces the spectral properties of the observed rainfall field, i.e. which conserves its local correlation ranges and anisotropies.
We illustrated the potential of the non-stationary generator with synthetic and real precipitation data and demonstrated the advantages of the local approach in the presence of non-stationarities. We showed how the non-stationary correlated noise can be locally adjusted to generate realistic stochastic simulations of radar precipitations fields. As a final experiment, we introduced the temporal structure of rainfall in the context of precipitation nowcasting using an auto-regressive process. We demonstrated that the local shock term can help to preserve the spatial heterogeneities of the original field during the simulation of the temporal evolution of precipitation.
The negative effect of localising the Fourier transform is a loss of power at scales larger than the window size, whose magnitude depends on the global spectral slope. In other words, precipitation fields displaying large-scale patterns suffer more from such loss of power. Ways to account for such an effect are currently under study. Other sources of errors associated with the method itself, such as the use of a Hanning window, were found to slightly affect the reproduction of local autocorrelation structure. However, we believe that these limitations are compensated for by the benefits introduced by the new approach.
The non-stationary stochastic generator was designed in the context of ensemble quantitative precipitation estimation and nowcasting, blending and downscaling of NWP models, and design storms modelling. As already mentioned in the Introduction (Sect. 1.1), several stochastic rainfall models based on the global Fourier filtering of white noise can be reformulated using the local non-stationary SSFT generator.
The residual radar measurement uncertainty can be effectively modelled by the non-stationary generator to obtain QPE ensembles, which reproduce the local statistical characteristics and anisotropy of the observed rainfall fields (Jordan et al., 2003; Ciach et al., 2007; Villarini et al., 2009; Germann et al., 2009; Cecinati et al., 2017). In addition, we believe that current radar rain gauge merging and adjustment techniques (e.g. Sideris et al., 2014) can be further extended to generate QPE ensembles conditioned onto the rain gauges, for example by following the conditional merging approach of Sinclair and Pegram (2005).
A demonstrative application of the local SSFT generator for stochastic precipitation nowcasting was presented in Sect. 5.5. A complete nowcasting model would also need an optical flow technique for the Lagrangian extrapolation of the stochastic radar rainfall fields. In the example presented in this paper, the stochastic perturbations are generated by using the same set of local Fourier spectra estimated at analysis time for all forecast lead times. An interesting scientific question would be to analyse the persistence and predictability of the local Fourier spectra, which in turn will control the future evolution of the local properties of the stochastic rainfall fields. This question is particularly important to design ensemble precipitation nowcasting systems that better represent the forecast uncertainty.
For longer forecast ranges (e.g. 24–48 h), the statistical properties of the radar rainfall field at analysis time become even more obsolete and should not be used to generate the stochastic perturbations. Current FFT-based downscaling techniques simplify the problem by using a fixed climatological isotropic parametric filter (Rebora et al., 2006a; Pierce et al., 2010). As a consequence all the downscaled NWP fields share the same small-scale precipitation features, independently on the NWP field that needs to be downscaled. A more flexible approach would involve the generation of the stochastic perturbations that adapt to the local properties and anisotropy of the NWP forecast.
Finally, the extension of the non-stationary generator for design storms would need additional components to model the storm arrival process (duration of dry and wet spells) and the temporal evolution of the mean areal statistics (global IMF and WAR); see e.g. Paschalis et al. (2013).
The SSFT generator makes a certain number of assumptions and can be further
developed. In its current implementation the rainfall field is convolved by
rectangular or Hanning windows of fixed size, which assumes the stationarity of
rainfall properties within the window. However, the dimension or length of
stationary regions within a rainfall field could also depend on spatial
location. For example, there may be a small region of
50 km
Another interesting problem that deserves more research relates to the choice of the optimal window type. In particular, the use of different windows, for instance a top flat Hanning, might help to improve the reproduction of the true local correlation structure of rainfall.
A practical problem of the local Fourier analysis is the inevitable loss of power at wavelengths larger than the window size, which becomes more accentuated for decreasing window sizes. For smaller window sizes, the local Fourier spectrum could be parametrised and the scaling behaviour extrapolated to scales larger than the window size to compensate for the loss of power. Another option that we are currently exploring is the implementation of a nested approach where the rainfall field is subsequently divided into smaller and smaller boxes for Fourier analysis. In this way, the information coming from boxes at different sizes can be merged into one optimal local Fourier spectrum.
Finally, the Fourier filtering of white Gaussian noise is a particular case of a broader class of continuous-in-scale multifractal simulation methods (Lovejoy and Schertzer, 2010). Instead of filtering white Gaussian noise, the universal multifractal simulation techniques are based on the filtering of Lévy noise, which provides more flexibility for modelling of multiscaling precipitation fields. An interesting extension of the method would be to exploit the SSFT approach for non-stationary continuous-in-scale multifractal simulation.
We have provided on GitHub a basic implementation of the code in Python together
with the four radar rainfall images used in this study. This supplementary material is available at the following address:
The authors declare that they have no conflict of interest.
This study was supported by the Swiss National Science Foundation Ambizione project “Precipitation attractor from radar and satellite data archives and implications for seamless very short-term forecasting” (PZ00P2_161316). We thank Isztar Zawadzki, Geoff Pegram and the anonymous reviewer for the comments and fruitful discussion. We are also grateful to Tero Niemi for providing the basic code and explanations on the generalised-scale invariance and to Carlos Velasco-Forero for his comments. Edited by: R. Uijlenhoet Reviewed by: G. Pegram and one anonymous referee