Creating spatially coherent rainfall patterns with high temporal resolution from data with lower temporal resolution is necessary in many geoscientific applications. From a statistical perspective, this presents a high- dimensional, highly underdetermined problem. Recent advances in machine learning provide methods for learning such probability distributions. We test the usage of generative adversarial networks (GANs) for estimating the full probability distribution of spatial rainfall patterns with high temporal resolution, conditioned on a field of lower temporal resolution. The GAN is trained on rainfall radar data with hourly resolution. Given a
new field of daily precipitation sums, it can sample scenarios of spatiotemporal patterns with sub-daily resolution. While the generated
patterns do not perfectly reproduce the statistics of observations,
they are visually hardly distinguishable from real patterns. Limitations that we found are that providing additional input (such as geographical information) to the GAN surprisingly leads to worse results, showing that it is not trivial to increase the amount of used input information. Additionally, while in principle the GAN should learn the probability distribution in itself, we still needed expert judgment to determine at which point the training should stop, because longer training leads to worse results.
Introduction
Precipitation time series at sub-daily temporal resolution are required
for numerous applications in environmental modeling. Especially in
hydrology, with small to medium catchments whose rainfall–runoff response
strongly depends on the temporal rainfall distribution, sub-daily
precipitation data are necessary to simulate flood peaks accurately.
However, in many settings, precipitation sums only over timescales
longer than the needed ones exist. Past sub-daily precipitation records
are often only available at short record lengths e.g.,,
and many future climate projections (GCM–RCM outputs) provide 6-hourly
or daily precipitation sums .
To deal with this wide absence of sub-daily precipitation data, several
procedures to disaggregate precipitation were proposed in recent years.
These include multiplicative cascade models e.g.,,
the method of fragments e.g.,
and complex stochastic methods based on, e.g., the randomized Bartlett–Lewis
model e.g.,.
and used artificial neural networks (ANNs) to perform rainfall disaggregation. provide a comparison of different univariate precipitation disaggregation approaches, and an overview of the historical development of precipitation disaggregation frameworks can be found in . Many of these methods are carried out on a station-by-station basis , while others also deal with the more challenging problem of temporal disaggregation of whole spatial fields e.g.,.
In this study, we consider the latter, and we deal with the problem
as a purely statistical one. For a given 2D (nlat×nlon) field c, representing the daily sum of precipitation, we want to generate a corresponding 3D field of sub-daily precipitation (tres×nlat×nlon) yabs. Since this is a highly underdetermined problem, it is our goal to model the probability distribution
Pyabs|c.
The sum of yabs over the tres dimension must equal c; therefore we can introduce the 3D vector of fractions of the daily sum yfrac, defined via
yfrac,tij=yabs,tij/cij
with t, i and j being the indices of the tres,lat and long dimension, and reformulate the problem as
Pyfrac|c
with the constraint that
∑tyfrac,tij=1.
Thus we want to model the probability distribution of fractions of the daily precipitation sum, given the daily precipitation sum. The data dimensionality of this problem increases drastically with increasing size of nlat and nlong, as the condition c has a dimensionality of nlat×nlong, and the target yfrac has even higher dimensionality nlat×nlong×tres. Here we use nlat=nlong=16 and tres=24 (corresponding to hourly resolution) and thus dimensionalities of 256 and 6144, respectively. This makes statistically inferring the probability distribution P in principle very challenging, even given large amounts of training data. One approach to circumvent this would be building statistical models with information about the underlying problems and then fitting the parameter of these models to the available observations. However, recent advances in machine learning have made it possible to directly infer high-dimensional probability distributions. The most widely used are generative adversarial networks (GANs) . GANs are a special class of artificial neural networks that were originally developed for estimating the probability distribution of images, with the goal of sampling (or “generating”) images from these distributions (widely known as “deep fakes”). Especially in their conditional formulation they are potentially very useful for physics-related problems, such as the one considered in this study. GANs are a very active research field in the machine-learning community, and their architectures and training methods are constantly improved e.g.,.
Given the probabilistic nature of many physical problems and the high dimensionality of problems in particular in Earth-science-related fields, they provide an interesting pathway for new applications. For example, have used a GAN to infer the 2D vertical structure of clouds, given 1D observations of lower-resolution satellite observations. GANs have also been used in the modeling of complex chaotic systems e.g., and have been proposed for stochastic parameterization in geophysical models and weather forecasting .
In this study we use measurements of precipitation from weather radars. We train the network on the daily sum of the measurements and the corresponding 1-hourly patterns of precipitation. To our best knowledge, GANs have not yet been used in the context of precipitation disaggregation. With this study we want assess whether GANs can be a useful tool in temporal precipitation disaggregation. Additionally, we want to provide our developed tool (RainDisaggGAN) as a ready-to-use tool to researchers and practitioners who are interested in creating sub-daily data from spatially distributed daily time series. All the software used for this study and the trained GAN are openly available in the accompanying repository.
In this study, we use the word “distribution” solely for probability distributions. In the hydrological literature, “distribution” is often also used for spatial and temporal patterns of rainfall. To avoid confusion, here we refer to these strictly as “patterns”.
MethodsData
We use openly available precipitation radar data from the Swedish Meteorological and Hydrological Institute (SMHI). The data are available from 2009 to present. Here we use measurements from 2009 to 2018. The data cover Sweden and parts of the surrounding area (Fig. ) and have a temporal resolution of 5 min.
Domain of the used SMHI radar data covering most parts of Sweden.
The radar reflectivities Z (units dBZ) are converted to rainfall R in mm h-1 via
R=10Z/102001/1.5.
We then compute the daily sums and use them as the condition and the 24 corresponding 1-hourly fractions as the target. The spatial resolution is
∼2×2 km. We use all available 16×16 (∼32×32 km) pixel samples (shifted by 16 px, so not including overlapping boxes) from the data that have no missing data in any of the pixels at any time of the
day and that satisfy the following condition: at least 20 px must exceed 5 mm d-1. This is done to exclude days with very little precipitation from the training. The exact thresholds were chosen without specific physical reasons. We repeated our analysis with 3 and 7 mm d-1, and the results were similar (not shown). For the training period 2009–2016 this results in 177 909 samples and for the test period 2017–2018 in 59 122 samples. We do not differentiate between different precipitation types (e.g., snow, hail) and for readability use “rainfall” and “precipitation” as synonyms. We have to note that excluding all days below the mentioned threshold changes the base sample. Therefore all results on precipitation statistics have to be interpreted in the way that they represent only the statistics for “wet days”. This is the case both for the observations shown and for the samples generated by our GAN method. The latter is evaluated only on days with rainfall sums above the threshold; therefore they are directly comparable to the observed statistics of all days above threshold. When using our method in practice, one would have to decide whether one also uses the GAN for predicting the patterns for days below the threshold (even though such days have not been included in the training) or not.
GAN
We use the GAN type called Wasserstein GAN (WGAN) . A WGAN consists – such as all GANs – of two neural network: the generator, which generates “fake” samples, and a discriminator (called “critic” in WGANs) that judges whether a sample is real or not. In our conditional GAN, the generator takes as input a 16×16 field of daily sums as the condition and a vector of random numbers and generates a 24×16×16 field of precipitation fractions. The critic takes as input the 16×16 condition and a 24×16×16 sample of fractions and judges whether it is a fake example or not. The generator and the critic are trained alternately. The critic is trained with a combination of real and fake examples and “taught” to differentiate between them. The generator is then trained to “fool” the critic. The trained generator can then be used to generate fraction scenarios y^frac from daily sum fields. These can then be converted to precipitation scenarios y^abs via
y^abs,tij=y^frac,tij⋅cij.
A sketch of the principle of a conditional GAN is shown in Fig. a, and our specific approach for generating rainfall scenarios is sketched in Fig. b.
(a) Principle of a conditional GAN. (b) Sketch of the method.
We use a WGAN with gradient penalty and pixel normalization . For details of the training process and GANs in general, we refer to the original papers. Our architecture is based on deep convolutional GANs (DCGAN, ). The input of the generator is a vector of length 100 for the random numbers and a vector of the flattened 16×16 condition. This is followed by a fully connected layer of size 256×2×2×3; three 3D upsampling and 3D convolution layers with increasing dimension and decreasing filter size, each followed by a pixel normalization; and finally a 3D convolution output layer. It would also be possible to use convolutional layers on the input condition before flattening it, even though we have not tested this. Especially for larger domains this might improve the GAN. All layers except the output layer have rectified linear unit (ReLu) activation functions. The output layer uses a softmax layer that does a logistic regression over the nres dimension. With this, the generator automatically satisfies Eq. (). The critic has a corresponding mirrored
architecture, with four strided 3D convolution layers, following the philosophy of using striding instead of downsampling from . Both networks are optimized with the Adam optimizer over 50 epochs. After 20 epochs the quality of the generator started to decrease (by visual inspection of samples generated from the train set); therefore we used the saved generator after 20 epochs. Training 20 epochs took 8 h on a single NVIDIA Tesla V100 GPU. The architecture resulted, through experimentation with different architectures and training methods. The networks were developed with the Keras and Tensorflow frameworks. For the details of the architectures, we refer to Appendix and the code published together with this paper.
Baseline algorithms
In this section we describe two simple disaggregation methods that are used as baselines in this study.
Random fraction from training
As the simplest baseline, we select random fractions yfrac from the training data, and we use these fractions together with the daily sum from the testing set as prediction. This is, per definition, unconditional on the daily sum.
RainFARM
As a further baseline algorithm we use an adaption of the RainFARM method
from . RainFARM is an algorithm for spatiotemporal downscaling of short-term precipitation forecasts. It estimates the
slopes α and β of the spatial and temporal power spectra of the low-resolution (low resolution both in time and in space) field. These slopes are also assumed constant for scales smaller than the smallest scales in the low-resolution fields. With α and β, a random power spectrum corresponding to these slopes is generated, with higher spatial and temporal resolution. From this spectrum, a spatial precipitation field is created and scaled to have the same values as the low-resolution field on the scales that are covered by the low-resolution field.
Here we adapt these ideas to our problem. In contrast to RainFARM, we do not use spatial downscaling, only temporal. Further, since we actually have data with higher time resolution available in the training set, we do not estimate the spectral slopes from the starting field and then extrapolate them; rather we estimate them from the hourly resolution data in the training set. Estimating the temporal slope from the starting field would not be possible anyway, because our starting field has only a single time step (the 24 h sum).
The temporal slope β is estimated the following way: we take a random selection of 500 daily 16×16 fields with hourly resolution. For each day, a fast Fourier transform (FFT) is performed over the time dimension, and the absolute power spectrum for each grid point and each sample is computed. Now all grid points and samples are put together in a single linear regression equation, in which the logarithm of the power is regressed against the logarithm of the corresponding wavenumber
log(P)=-β⋅log(ω)+c.
The same is done for the spatial slope α. Here, anisotropy for the two spatial dimensions is assumed:
log(P)=-α⋅logkx2+ky2+c.
Now following the RainFARM algorithm, we generate a Fourier spectrum with the spectral slopes α and β. In our case it ranges over all spatial scales in a 16×16 px part of our data, and from 2π/24 h to 2π/1 h in angular frequency. We start with uniform random distributed phases ϕ(kx,ky,ω) and compute the random power spectrum g^ as
g^kx,ky,ω=e-iϕkx,ky,ωkx2+ky2-α/2ω-β,
which subsequently is scaled to unit variance:
g^scaled=g^/stdg^.
The (not-yet-correctly-scaled) precipitation field r̃ is obtained via inverse FFT and exponentiation:
r̃=exprealifftg^scaled.
The actual precipitation field is now computed via scaling r̃, such that the daily sum at each grid point corresponds to the input daily sum for each sample:
r(x,y,t)=pobs(x,y)/r(x,y,t).
For each daily sum, an infinite number of different realizations r can be obtained via starting from different random phases ϕ(kx,ky,ω).
Additional inputs
In our main architecture, we use only fields of daily rainfall sums as input. This is the minimum possible architecture and therefore also the most generic one for different applications. As an extension, we also use two alternative architectures that provide additional inputs to the network. In the first alternate architecture, we input the day of the year for each sample as additional input. Since the day of the year “doy” is a circular variable (1 is as close to 2 as it is to 365), it is converted to two variables d1, d2 via
d1=sin2πdoy365,d2=cos2πdoy365,
and these two variables are expanded (repeated) to have the same size as the precipitation input field and added as additional channels to the input
condition. Leap days are treated as 1 January.
In the second alternate architecture we use the longitude of the sample as
additional input (normalized to [0, 1]). While Sweden has a much larger north–south than east–west extent, the typical precipitation patterns are more dependent on longitude than latitude, because of the large contrast in orography (mountains in the west, flat in the middle, coast in the east).
Validation
Validation of a trained GAN is a complex and difficult topic. The high-dimensional probability distribution we want to infer is per definition not known (otherwise we would not need the GAN); therefore we cannot directly validate it. This is an inherent problem in generative modeling. We will therefore compare certain statistical properties of the generated samples with the same statistical properties of the real data. We also want to point out that while our method is conditional, it should not be confused with a standard supervised learning method. In the latter, one would assume that there is one “correct” target and train the predictions on this target. In our problem we also have one observed target sub-daily precipitation pattern, but we assume that there are infinitely many possible target patterns for each condition. Our approach is thus much closer to purely generative modeling (learning only the general distribution of
rainfall patterns, not conditioned on anything) than to supervised learning (including probabilistic methods in supervised learning). Still, if interpreted with care, it is possible to use probabilistic forecast evaluation scores. Here we use the widely used continuous ranked probability score (CRPS; ):
CRPS(F,y)=∫x(F(x)-H(x-y))2dx,
with the cumulative distribution function (CDF) F(x) of the forecast distribution, the true value y and the Heaviside step function H(x).
The computation is done with the “properscoring” Python library, which estimates the CRPS via the empirical cumulative distribution function built up by the different scenarios (for each event in the test set, 10 000 scenarios are made with the GAN). The CRPS is computed on a forecast-by-forecast basis. For each forecast, we compute the CRPS for each grid point and each hour of the day separately, and then we average over all grid points and hours. Finally, the CRPS is averaged over all forecasts in the test set.
Additionally, we compare the distributions of the generated events with the distributions of the observations. This does not give any information on how well the generated events for a given daily sum correspond to the real daily distribution of that particular day, but it gives information on whether the overall distribution is correct. For this we compute empirical cumulative distribution functions (ECDFs) and logarithmic spectral distances. The computation of the spectral distances is done in the spatial domain. The hours of the day are treated as individual samples. For each spatial field, the discrete radial absolute Fourier power spectrum pi(ω) is computed. Then, for each combination of spatial fields and corresponding spectra p1, p2, the logarithmic spectral distance d is computed as
dp1,p2=∑Nωi10⋅logp1ωi/p2ωi2/ωi.
Additionally, the spectral distance between different methods and observations is computed as well. Here, the distances between all combinations of samples from method1 (GAN) and samples from method2 (RainFARM) are computed.
Real and generated examples of the fraction of hourly precipitation
patterns for one daily precipitation sum and the hourly precipitation itself. Panel (a) shows the generated fractions, and (b) shows the corresponding hourly precipitation patterns. The leftmost column of each panel displays the daily sum precipitation field used as the condition. The remaining columns show the values for every third hour. The first row presents the observed distribution over the day. The remaining rows show examples generated by the GAN.
As Fig. , but for a different daily precipitation sum. Note that for very low precipitation amounts, fractions (panel a) might still be high.
Patterns generated with the RainFARM baseline algorithm, for the same days as in Figs. and .
Examples of area-averaged precipitation scenarios over a single day. The black line shows the observed precipitation, and the green lines show
100 generated ones. The colored lines show 10 generated ones, where each color uses exactly the same noise in all four plots.
(a) Daily cycle of 10 000 randomly selected real observations, and scenarios generated by conditioning on exactly the same 10 000 daily sums. (b) Cumulative distribution functions of generated and observed hourly area mean precipitation (upper panel) and hourly point-level precipitation (lower panel), same data as in (a).
Results
Figures and show examples of generated rainfall distributions for two randomly chosen daily sum conditions from a randomly chosen location. For each case, 10 hourly patterns are generated with the same daily sum condition from the test dataset. The figures are to be read as follows: the first row in panel (a) shows the per-grid-point fraction of observed precipitation every 3 h, and the following rows present the scenarios generated by the GAN (the same figure but in hourly resolution can be found in Figs. and ). Panel (b) shows the same information, but then scaled by the daily precipitation sum at each grid point. In the example of Fig. precipitation occurred relatively evenly distributed over the whole day. As expected, due to the many possible patterns that can be associated with a single daily sum, there is a lot of
variation in the GAN-generated patterns. In row 3, for example, precipitation is concentrated in the first half of the day, whereas in the next-to-last row, it is concentrated at the end of the day. Patterns generated by RainFARM are displayed in Fig. . RainFARM generates hourly precipitation in regions where the original daily precipitation field is nonzero, and rainfall is distributed quite evenly over the whole day. This matches the observed situation in Fig. a well but does not conform with the short-term rainfall observed in panel (b), which is better captured by the GAN scenarios (Fig. ). More examples are included in the accompanying data and code repository. Except for boundary problems at the outermost pixels, the patterns seem to be indistinguishable by eye. In applications where the boundary problem would be an issue, one could use a larger domain and then remove the boundary. Figure shows area means of precipitation per hour. Each panel shows the real pattern for one condition (in black) and 100 patterns generated from the same condition (in green). While it is important that individual samples look reasonable, it is also crucial that the generated sample follows the same distributions as the real pattern. Albeit it is impossible to check whether the GAN recreates the full inter-dependent probability distribution (as we use the GAN to solve this problem in lack of a better method), we can at least check whether the typical sub-daily distribution is captured by the GAN. In the real data, the fractions are not equally distributed over the day, meaning that some times of the day often have higher fractions of the daily sum than others. For this, we randomly select 10 000 samples from the test data and generate a single generator example for each. Then we analyze the daily cycle of the 10 000 real patterns and the 10 000 generated ones. The result is shown in
Fig. a (Fig. a including outliers). When looking at the fractions, the generated distribution seems in general to reasonably follow the real distribution. There are, however, some deviations, mainly an underestimation of the daily cycle. When it comes to the daily cycle of precipitation corresponding to these fractions, the generator does
a worse job. Here the daily cycle is even more underestimated; thus the generator has too little dependency of precipitation on the hour of day. As additional validation, Fig. b shows cumulative distribution functions of the observed and generated hourly precipitation patterns, for the same data as the daily-cycle analysis. Shown are the distribution both of the area means and of point observations. The plots are capped to exclude very low precipitation amounts. The full plots are shown in Fig. b. In general the distribution of the generated patterns follows the distribution of the observations well. However, they generate too many hourly events with precipitation amounts around 1 mm h-1, and on grid point level, the GAN extends to higher maximum precipitation amounts. At very low precipitation amounts (Fig. b) the distributions seem to be very different. This might be caused by the fact that the softmax output of the network cannot generate values of exactly zero for the fraction, and thus the precipitation cannot be exactly zero either, except when the day sum is zero. Here, however, one has to consider that such extremely small precipitation amounts are usually of no importance. Additionally, due to the way the data are stored, the radar data cannot go down to zero, but have a minimum slightly above 10-4 mm h-1.
Figure shows the distribution of spectral distances of the observations and of the generated patterns and the distribution of spectral distances between observed and generated patterns, all computed on 500 randomly selected samples from the test set. The spectral differences are very similar for both methods and for the observations. Notable is that the observations have a slightly wider right-hand tail than the generated ones, especially compared to RainFARM.
Next, we check whether the GAN actually learns to use the condition input. It could be that the GAN only learns the general distribution of precipitation patterns, without connecting it to the daily sum at all. This could in principle partly be answered by the green lines in Fig. ; however this is difficult to do by eye, and it would also be hard to differentiate between the influence of the condition and the influence of the randomness of the noise used as input for the generator. Therefore, we also generated 10 examples for each real one, using the same noise for all four panels. Thus generated sample 1 uses the same noise for all conditions, and sample 2 uses the same (different from sample 1) noise for all conditions and so on. The result is shown in the 10 colored lines in Fig. . The patterns generated for different conditions are similar, but not identical. For example, the blue line has a distinct peak between 15 and 20 h only in panel (a), and the
peak of the yellow line between 1–5 h is slightly different in all panels. This means that dependent on the condition, different daily fractions are produced. As an additional test on the influence of the condition, we randomly select two conditions, sample 1000 patterns from each condition (using the same 1000 noise vectors for each condition) and then compute the distribution for each hour of the day, similarly to Fig. . The result for two distinctly different conditions is shown in Fig. (Fig. with outliers). As can be seen, the distributions are not the same for both conditions. At 10 of the 24 h of the day, the distributions are significantly different (p<0.05 with two-sample Kolmogorov–Smirnov test). For conditions that are very similar, there is no significant difference at any hour of the day (not shown). This confirms the result from above that the
GAN has at least to some extent learned to use the condition. Verifying the conditional relationships is difficult to impossible: the high dimension of the condition would cause any type of binning or grouping to result in either a very low sample size for each group or groups whose conditions are different only in some of the dimensions, and therefore a verification is not attempted here.
Distribution of hourly logarithmic spectral distances (d) for the observed patterns (blue), patterns generated with the GAN (yellow), patterns generated with RainFARM (green), and distances between patterns observed and generated with GAN (red) and between patterns observed and generated with RainFARM (purple), for 500 d (resulting in 12 000 h) from the test set.
Example of daily area mean distributions generated from two different daily sum conditions. For each conditions 1000 scenarios were generated. In all bar plots outliers are not shown. The same plots with outliers are shown in Appendix .
Finally, we compute the CRPS of the generated patterns. The result is shown in Table . The GAN has a slightly lower CRPS than RainFARM and random, indicating that it has a higher probabilistic skill. While the difference is small, it is highly significant. This was tested with the one-sample t test against the null hypothesis that the mean of the differences is zero (p=0, down to machine precision) and with bootstrapping (p<0.01). A one-sample test was chosen because all three methods were tested on exactly the same test samples, and the scores are therefore not independent.
CRPS scores of GAN and baseline methods for 10 000 test samples.
MethodGANRainFARMRandomCRPS [mm h-1]0.2540.2850.26Architectures with additional inputs
When training our first alternative architecture with day of year as additional input, the training did not succeed and only resulted in
very unrealistic generated patterns (not shown). This might be caused by the fact that with day of the year as input, the network could be susceptible to overfitting, especially since we are excluding non-rain days from the training data. The second alternative architecture – with longitude as additional input – was slightly more successful. The results for the longitude architecture are shown in the Appendix (Fig. ). Shown is the daily cycle of 10 000 randomly selected observations and scenarios generated from these. The results are presented for all samples in the eastern and in the western half of the domain separately. The daily cycle of the generated samples is not very realistic, in either of the domains. In
general, even though less dramatic than the day-of-year input, the additional longitude input seems to have disturbed the training of the network and in fact made it worse than the base architecture without any additional inputs.
Discussion and conclusion
In this study we used a generative adversarial network (GAN) to generate possible scenarios of hourly precipitation fields, conditioned on a field of daily precipitation sums. The network was trained on 8 years (2009–2016) of hourly observations of Swedish precipitation radar data and the corresponding fields of daily precipitation sum. The trained network can generate reasonable-looking hourly scenarios and thus seems to be able to approximate the probability distribution of the spatiotemporal rainfall patterns. By eye, the generated patterns are nearly indistinguishable from the real patterns. Additionally, the spectral distances of the generated patterns are similar to the observed ones. We showed that the network does not simply learn a general distribution of precipitation patterns, but it is also able to use the conditional daily sum field to some extent. It thus learns a dependency of the probability distribution of rainfall patterns on the daily sum. This result is supported by the GAN CRPS being slightly better but in the same order of magnitude as CRPS of randomly selected and RainFARM-generated patterns. We were, however, not able to find a reasonable way to verify this inferred dependency on the daily sum, and its quality hence remains unverified for now. Close inspection of the statistics of many generated samples showed partial agreement but also some deviation from the real statistics, pointing to potential limitations of the method, at least in its current implementation. Adding additional information (longitude and day of the year) to our GAN architecture was not successful. Not only was the GAN unable to learn the influence of the additional parameters on the probability distribution of the patterns, it also did worse on the general probability distribution. This shows that it is not possible to simply add
additional information to an architecture that works without additional inputs. The “black-box” nature of GANs makes it hard to even speculate about a possible reason for this. A further question left open is the suitability of the presented approach for larger domain sizes. The 16×16 (∼32×32 km) pixel approach was chosen with a small catchment in the Alps in mind, which we plan to study in more detail. Recent tests with a 64×64 px domain revealed a decreasing performance. However, such tests are computationally very expensive, and we suspect that our training might have been too short (too few training epochs). Notwithstanding this, this topic needs further inspection. With our GAN architecture, it is not possible to ensure spatial and temporal continuity when applying the GAN to regions or timeframes that are neighbors in time or space. This could be remedied with the approach presented in . Furthermore, as a cautionary remark, we point out that the approach presented in this paper only makes sense if the training data come from the same climatic conditions as the input data, and the trained GAN should not (or only after careful evaluation) be transferred to other regions. This is because spatial rainfall distributions differ between different (climatic) regions. Finally, expert judgment is still necessary in deciding when to stop the training of the GAN, since after some time the quality of the generated patterns deteriorated. This can potentially be a severe limitation in practice. Detailed study and development will therefore be necessary to further improve the method and also to make it less dependent on expert judgment.
We conclude that with our current knowledge, it is in principle possible to use GANs in the context of spatial precipitation disaggregation, however only with care and in addition to expert judgment. We hope that this study serves as a starting ground for the hydrological community to work further on assessing the potential of GANs for precipitation disaggregation.
This study was mainly intended as a proof of concept, in order to assess whether it is principally possible to use GANs for temporarily disaggregating spatial rainfall patterns. Whether the method also proves useful in rainfall–runoff modeling will be assessed in a follow-up study. This runoff modeling could include future climate scenarios. In such a setting it has to be noted that our method – as most other methods – makes a stationarity assumption, meaning that it assumes that the probability distribution of rainfall patterns is always the same (except for the dependency on the daily rainfall sum). In a future (warmer) climate, however, the typical patterns might be different.
When the problems with additional inputs that we encountered are eventually solved, it would be interesting to also test inputting other meteorological variables such as temperature, wind speed or air pressure. These might contain information on the current weather pattern, which itself can have an impact on the possible sub-daily precipitation patterns. This might also be a way to – at least partly – deal with the problem of non-stationarity in the future climate scenarios mentioned above. Additionally, our method could be combined with other machine-learning methods. For example, an unsupervised
classification scheme could be used prior to training the GAN. With this, the events could be categorized into a number of different classes, and then an individual GAN could be trained for each class. Alternatively, the class label could be added as input to the GAN. The latter would take the burden of implicitly classifying the events from the GAN.
It would also be of interest to modify the loss function used for the training of the networks and include constraints on the statistics of the data (for example the reproduction of the daily cycle), following the ideas of . This might eliminate the problems of deviation from the real statistics mentioned earlier. Another option would be to step back from the purely data-driven approach and try to include physical constraints directly in the GAN.
Variational autoencoders , which are another type of neural network that can be used to infer high-dimensional (potentially conditional) probability distributions, might also be an attractive alternative to the GAN presented here.
Finally, from a scientific point of view it would be a very appealing attempt using techniques from the emerging field of explainable AI for the challenging task of using the trained GAN for inferring knowledge about the underlying physical processes.
The generator consists of the following layers: dense layer with size 3072, upsampling3D, convolution3D (256 channels, kernel size 2×2×2),
pixelnormalization, upsampling3D, convolution3D (128 channels, kernel size
2×2×2), pixelnormalization, upsampling3D, convolution3D (64 channels, kernel size 2×2×2), pixelnormalization, convolution3D (1 channel, kernel size 3×3×3) and softmax (along the first dimension).
The critic consists of the following layers: convolution3D (64 channels), convolution3D (128 channels), convolution3D (256 channels) and dense (1 node).
The critic uses dropout regularization (dropout probability 0.25) after each convolution layer. All convolution layers (except the last one in the generator) use a leaky ReLu activation function with α=0.2.
Both the critic and the generator are trained with the Adam optimizer
with parameters lr=0.0001, β1=0 and β2=0.9 (the values recommend by ).
As Fig. , but with all hours shown.
As Fig. , but with all hours shown.
(a) Daily cycle of 10 000 randomly selected real observations and scenarios generated by conditioning on exactly the same 10 000 daily sums. Same as Fig. a but with outliers shown. (b) Cumulative distribution functions of generated and observed hourly area mean precipitation (upper panel) and hourly point-level precipitation (lower panel); same data as in (a). Same as Fig. b, but with the full range on the x axis.
Example of daily area mean distributions generated from two different daily sum conditions. For each condition, 1000 scenarios were generated. In all bar plots, outliers are not shown. The same plots as Fig. but with outliers.
Results from the network with longitude as additional input. Daily
cycle of 10 000 randomly selected real observations and scenarios generated by conditioning on exactly the same 10 000 daily sums, split up into western and eastern halves of the domain.
Code and data availability
The SMHI radar data can be freely obtained from http://opendata-download-radar.smhi.se/ (last access: 9 June 2021) . The software developed for this study, as well as the trained generator, is available in Sebastian Scher's GitHub repository at https://github.com/sipposip/pr-disagg-radar-gan (last access: 9 June 2021) . Additionally, on final publication, the repository will be archived at Zenodo under the reserved DOI 10.5281/zenodo.3733065.
Author contributions
SP initiated the study. SeS developed and implemented the GAN, analyzed the data and drafted the manuscript. Both authors interpreted the results and helped in improving the manuscript.
Competing interests
The authors declare that they have no conflict of interest.
Acknowledgements
We thank Lea Beusch for interesting discussions. The computations were done on resources provided by the Swedish National Infrastructure for Computing (SNIC) at the High Performance Computing Center North (HPC2N) and National Supercomputer Centre (NSC). The authors acknowledge the Swedish Meteorological and Hydrological Institute (SMHI) for making the radar data freely available. Stefanie Peßenteiner has been funded by the Austrian Climate Research Programme (ACRP, 9th call; project RunSed-CC, grant number KR16AC0K13305).
Financial support
This research has been supported by the Austrian Climate Research Programme (grant no. KR16AC0K13305).
Review statement
This paper was edited by Nadav Peleg and reviewed by Jussi Leinonen and Daniele Nerini.
ReferencesAdadi, A. and Berrada, M.: Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI), IEEE Access, 6, 52138–52160, 10.1109/ACCESS.2018.2870052, 2018.
Arjovsky, M., Chintala, S., and Bottou, L.: Wasserstein GAN, arXiv: preprint,
arXiv:1701.07875 [cs, stat], 2017.Bihlo, A.: A generative adversarial network approach to (ensemble) weather
prediction, Neural Netw., 139, 1–16, 10.1016/j.neunet.2021.02.003, 2021.Breinl, K. and Di Baldassarre, G.: Space-time disaggregation of precipitation
and temperature across different climates and spatial scales, J. Hydrol.: Reg. Stud., 21, 126–146, 10.1016/j.ejrh.2018.12.002, 2019.Burian, S. J., Durrans, S. R., Tomic̆, S., Pimmel, R. L., and Chung Wai,
N.: Rainfall Disaggregation Using Artificial Neural Networks, J. Hydrol. Eng-ASCE, 5, 299–307, 10.1061/(ASCE)1084-0699(2000)5:3(299), 2000.
Burian, S. J., Durrans, S. R., Nix, S. J., and Pitt, R. E.: Training Artificial Neural Networks to Perform Rainfall Disaggregation, J. Hydrol. Eng., 6, 43–51, 2001.Chollet, F., et al.: Keras, GitHub, available at: https://github.com/keras-team/keras
(last access: 9 June 2021), 2015.Di Baldassarre, G., Castellarin, A., and Brath, A.: Relationships between
statistics of rainfall extremes and mean annual precipitation: an application
for design-storm estimation in northern central Italy, Hydrol. Earth Syst. Sci., 10, 589–601, 10.5194/hess-10-589-2006, 2006.Förster, K., Hanzer, F., Winter, B., Marke, T., and Strasser, U.: An
Open-Source MEteoroLOgical Observation Time Series DISaggregation Tool (MELODIST v0.1.1), Geosci. Model Dev., 9, 2315–2333,
10.5194/gmd-9-2315-2016, 2016.
Gagne II, D. J., Christensen, H. M., Subramanian, A. C., and Monahan, A. H.: Machine Learning for Stochastic Parameterization: Generative Adversarial Networks in the Lorenz '96 Model, arXiv: preprint, arXiv:1909.04711 [nlin, physics:physics, stat], 2019.
Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., and Bengio, Y.: Generative Adversarial Nets, in: Advances in Neural Information Processing Systems 27, edited by: Ghahramani, Z., Welling, M., Cortes, C., Lawrence, N. D., and Weinberger, K. Q., Curran Associates, Inc., 2672–2680, 2014.
Gulrajani, I., Ahmed, F., Arjovsky, M., Dumoulin, V., and Courville, A.:
Improved Training of Wasserstein GANs, arXiv: preprint, arXiv:1704.00028 [cs, stat], 2017.Hersbach, H.: Decomposition of the Continuous Ranked Probability Score for
Ensemble Prediction Systems, Weather Forecast., 15, 559–570,
10.1175/1520-0434(2000)015<0559:DOTCRP>2.0.CO;2, 2000.
Karras, T., Aila, T., Laine, S., and Lehtinen, J.: Progressive Growing of
GANs for Improved Quality, Stability, and Variation, arXiv: preprint,
arXiv:1710.10196 [cs, stat], 2018.
King, R., Hennigh, O., Mohan, A., and Chertkov, M.: From Deep to Physics-Informed Learning of Turbulence: Diagnostics, arXiv: preprint, arXiv:1810.07785 [nlin, physics:physics, stat], 2018.
Kingma, D. P. and Ba, J.: Adam: A Method for Stochastic Optimization, arXiv: preprint, arXiv:1412.6980 [cs], 2017.
Kingma, D. P. and Welling, M.: Auto-Encoding Variational Bayes, arXiv: preprint arXiv:1312.6114 [cs, stat], 2014.Koutsoyiannis, D. and Onof, C.: Rainfall Disaggregation Using Adjusting
Procedures on a Poisson Cluster Model, J. Hydrol., 246, 109–122, 10.1016/S0022-1694(01)00363-8, 2001.Koutsoyiannis, D., Onof, C., and Wheater, H. S.: Multivariate Rainfall
Disaggregation at a Fine Timescale, Water Resour. Res., 39, 1173, 10.1029/2002WR001600, 2003.Kumar, J., Brooks, B.-G. J., Thornton, P. E., and Dietze, M. C.: Sub-daily
Statistical Downscaling of Meteorological Variables Using Neural Networks, Proced. Comput. Sci., 9, 887–896, 10.1016/j.procs.2012.04.095, 2012.Leinonen, J., Guillaume, A., and Yuan, T.: Reconstruction of Cloud Vertical
Structure With a Generative Adversarial Network, Geophys. Res. Lett., 46, 7035–7044, 10.1029/2019GL082532, 2019.Leinonen, J., Nerini, D., and Berne, A.: Stochastic Super-Resolution for
Downscaling Time-Evolving Atmospheric Fields With a Generative Adversarial
Network, IEEE T. Geosci. Remote, 10.1109/TGRS.2020.3032790, in press, 2020.Lewis, E., Fowler, H., Alexander, L., Dunn, R., McClean, F., Barbero, R.,
Guerreiro, S., Li, X.-F., and Blenkinsop, S.: GSDR: A Global Sub-Daily Rainfall Dataset, J. Climate, 32, 4715–4729, 10.1175/JCLI-D-18-0143.1, 2019.Martín, A., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G. S., Davis, A., Dean, J., Devin, M., Ghemawat, S., Goodfellow, I., Harp, A., Irving, G., Isard, M., Jia, Y., Jozefowicz, R., Kaiser, L., Kudlur, M., Levenberg, J., Mané, D., Monga, R., Moore, S., Murray, D., Olah, C., Schuster, M., Shlens, J., Steiner, B., Sutskever, I., Talwar, K.,
Tucker, P., Vanhoucke, V., Vasudevan, V., Viégas, F., Vinyals, O., Warden, P., Wattenberg, M., Wicke, M., Yu, Y., and Zheng, X.: TensorFlow: Large-Scale Machine Learning on Heterogeneous Systems, google research,
available at:
https://static.googleusercontent.com/media/research.google.com/en//pubs/archive/45166.pdf (last access: 9 June 2021), 2015.
Mirza, M. and Osindero, S.: Conditional Generative Adversarial Nets, arXiv: preprint, arXiv:1411.1784 [cs, stat], 2014.Müller, H. and Haberlandt, U.: Temporal Rainfall Disaggregation Using a
Multiplicative Cascade Model for Spatial Application in Urban Hydrology, J. Hydrol., 556, 847–864, 10.1016/j.jhydrol.2016.01.031, 2018.Müller-Thomy, H. and Sikorska-Senoner, A. E.: Does the complexity in
temporal precipitation disaggregation matter for a lumped hydrological
model?, Hydrolog. Sci. J., 64, 1453–1471, 10.1080/02626667.2019.1638926, 2019.Pui, A., Sharma, A., Mehrotra, R., Sivakumar, B., and Jeremiah, E.: A
Comparison of Alternatives for Daily to Sub-Daily Rainfall Disaggregation, J. Hydrol., 470-471, 138–157, 10.1016/j.jhydrol.2012.08.041, 2012.
Radford, A., Metz, L., and Chintala, S.: Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks, arXiv: preprint,
arXiv:1511.06434 [cs], 2016.Raut, B. A., Seed, A. W., Reeder, M. J., and Jakob, C.: A Multiplicative
Cascade Model for High-Resolution Space-Time Downscaling of Rainfall, J. Geophys. Res.-Atmos., 123, 2050–2067, 10.1002/2017JD027148, 2018.Rebora, N., Ferraris, L., von Hardenberg, J., and Provenzale, A.: RainFARM:
Rainfall Downscaling by a Filtered Autoregressive Model, J. Hydrometeorol., 7, 724–738, 10.1175/JHM517.1, 2006.
Samek, W., Wiegand, T., and Müller, K.-R.: Explainable Artificial Intelligence: Understanding, Visualizing and Interpreting Deep Learning Models, arXiv: preprint, arXiv:1708.08296 [cs, stat], 2017.Scher, S.: pr-disagg-radar-gan, Github, available at: https://github.com/sipposip/pr-disagg-radar-gan, last access: 9 June 2021.Scher, S. and Peßenteiner, S.: pr-disagg-gan, Zenodo, 10.5281/zenodo.3733065, 2020.
Sharma, A. and Srikanthan, S.: Continuous Rainfall Simulation: A Nonparametric Alternative, in: 30th Hydrology & Water Resources Symposium: Past, Present & Future, 4–7 December 2006, Launceston, Tasmania, p. 86, 2006.SMHI: Länksida för radar nedladdningstjänster, available at: http://opendata-download-radar.smhi.se/, last access: 9 June 2021.Verfaillie, D., Déqué, M., Morin, S., and Lafaysse, M.: The method
ADAMONT v1.0 for statistical adjustment of climate projections applicable
to energy balance land surface models, Geosci. Model Dev., 10, 4257–4283, 10.5194/gmd-10-4257-2017, 2017.Westra, S., Mehrotra, R., Sharma, A., and Srikanthan, R.: Continuous Rainfall
Simulation: 1. A Regionalized Subdaily Disaggregation Approach, Water Resour. Res., 48, 1535, 10.1029/2011WR010489, 2012.Wu, J.-L., Kashinath, K., Albert, A., Chirila, D., Prabhat, and Xiao, H.:
Enforcing Statistical Constraints in Generative Adversarial Networks for Modeling Chaotic Dynamical Systems, J. Comput. Phys., 406, 109209, 10.1016/j.jcp.2019.109209, 2020.