Articles | Volume 29, issue 15
https://doi.org/10.5194/hess-29-3687-2025
https://doi.org/10.5194/hess-29-3687-2025
Research article
 | 
12 Aug 2025
Research article |  | 12 Aug 2025

Infilling of missing rainfall radar data with a memory-assisted deep learning approach

Johannes Meuer, Laurens M. Bouwer, Frank Kaspar, Roman Lehmann, Wolfgang Karl, Thomas Ludwig, and Christopher Kadow
Abstract

Incomplete spatiotemporal meteorological observations can result in misinterpretations of the current climate state, uncertainties in early warning systems, or inaccuracies in nowcasting models and can thereby pose significant challenges in hydrology research or similar applications. Traditional statistical methods for infilling missing precipitation data demand substantial computational resources and fail over large areas with sparse data – like temporary outages of weather radars. Although recent machine learning advancements have shown promise in addressing missing meteorological or satellite observations, they typically focus on spatial aspects, overlooking the complex spatiotemporal variability characteristic of precipitation, especially during extreme events. We propose a deep convolutional neural network enhanced with a memory component to better account for temporal changes in precipitation fields. This approach can analyse arbitrary sequences from before and/or after the incomplete observation of interest. Our model is trained and evaluated on the hourly RADKLIM dataset, which features 1 km resolution precipitation data derived from combined radar and weather stations across Germany. By infilling both artificial and actual data gaps of RADKLIM, we demonstrate the model's effectiveness, providing detailed insights into its capabilities during significant rainfall events, such as those in May 2012 and July 2021, including those responsible for the Ahrtal flood. This novel approach represents a step forward in hydrological applications, potentially improving the way we predict and manage water-related events by increasing the accuracy and reliability of precipitation data analysis.

Share
1 Introduction

The process of producing accurate climate information is crucial for informing policy as well as for applications in various sectors, e.g. water management or agriculture. For example, nowcasting of events such as thunderstorms, heavy rainfall, and snowfall plays a vital role in assessing and planning the management of water resources, flood hazards, urban runoff, and climate variability for long-term trends (James et al.2018; Lang2002; Wapler et al.2012; Teegavarapu et al.2018). Precipitation data collected by weather radars are an important source of information for such applications, but the reliability and accuracy of these applications depend heavily on the quality of the data. However, temporally and spatially continuous systems are often plagued by outages that lead to missing values (Teegavarapu et al.2018; Geiss and Hardin2021; Kadow et al.2020; Barrios et al.2018), and radars in particular are prone to technical challenges such as blocking of radar beams and near-ground dead zones (Winterrath et al.2017; Geiss and Hardin2021). To illustrate this, consider Fig. 1, which shows three data samples taken from the RADKLIM dataset of Germany's meteorological service Deutscher Wetterdienst (DWD) (Winterrath et al.2018a). This dataset is generated using a process that merges radar observations with weather station measurements to produce continuous spatial and temporal precipitation pattern data across Germany at different temporal resolutions (5 min and 1 h). However, due to outages, the radars were not able to monitor precipitation in the shaded grey areas, as shown in the figure.

https://hess.copernicus.org/articles/29/3687/2025/hess-29-3687-2025-f01

Figure 1Examples of missing precipitation recordings after radar outages in the RADKLIM dataset (Winterrath et al.2018a) on 24 June 2002 of three sequential hours. The grey regions highlight the radars that failed to record any precipitation.

Such problems can lead to misinterpretation or increased uncertainty in observations and predictions. Methods to fill gaps in climate data range from statistical approaches such as spatial interpolation (Smith et al.1996; Oliver and Webster1990; Teegavarapu et al.2018; Simanton and Osborn1980; Teegavarapu and Chandramouli2005; Verworn and Haberlandt2011) and linear regression (Vislocky and Fritsch1995) to machine learning approaches such as support vector machines (Landot et al.2008). Kriging (Oliver and Webster1990), inverse distance weighting (Simanton and Osborn1980), and linear weight optimization (Teegavarapu et al.2018) provide good estimates for pointwise reconstructions, but their ability to provide good spatial reconstructions is limited by nearby existing values. This is also shown by Verworn and Haberlandt (2011), who estimate spatial precipitation patterns in northern Germany based on nearby weather stations and radar images. Using only weather stations and statistical reconstruction methods results in overly smooth precipitation maps, while including additional radar information results in much more realistic spatial patterns. Their study highlights not only the limitations of statistical approaches to spatial reconstruction but also the importance of spatially complete radar images.

Data-driven image inpainting is used to repair image damage caused by raindrops, to improve the quality of old images, or to increase the resolution of low-quality images (Yu et al.2018; Liu et al.2018; Elharrouss et al.2020), but also to fill gaps in climate data by training a model on large datasets to learn the complex patterns within the data. For example, Shibata et al. (2018) use inpainting to reconstruct incomplete satellite images of sea surface temperatures, and Geiss and Hardin (2021) propose a generative adversarial network (GAN) to fill gaps in patchy radar images. Kadow et al. (2020) apply partial convolutions (Liu et al.2018) to reconstruct missing values in global surface temperature grids. Partial convolutions are able to reconstruct missing values in arbitrarily shaped regions, which is particularly useful when dealing with missing observational data.

While data-driven techniques have shown promising results, they only take into account the spatial relationships in the data, not the temporal variability. On the other hand, while geostatistical approaches take into account data distributions from the past, they lack the ability to create realistic spatial features, especially when considering large regions with missing values or “moving” weather systems that drive rainfall patterns. To address these limitations, we propose a data-driven image inpainting model that is capable of reconstructing arbitrarily shaped missing value regions using partial convolutions by Liu et al. (2018) while also taking into account the spatiotemporal relationships in the data using a convolutional long-short term memory (LSTM) approach by Xingjian et al. (2015).

The remainder of this paper is organized as follows: Sect. 2 describes the datasets used and the methodological framework implemented for the infilling of missing precipitation data. Section 3 presents the experimental results and provides a comprehensive discussion of the performance of the proposed models. Finally, Sect. 4 summarizes the key findings of the study and discusses potential future research directions. The appendices provide additional details on the models' architectures, evaluation metrics, experimental overview, and additional results.

2 Data and methods

2.1 Data

This study is based on the RADKLIM-dataset of DWD, Germany's national meteorological service. RADKLIM is a dataset of reprocessed gauge-adjusted radar data (Winterrath et al.2017, 2018a). DWD operates a network of 17 weather radar stations (C-band; Lengfeld et al.2019) as well as a network of several hundred ground-based rain gauges (Kaspar and Mächel2023). Weather radars send pulses of electromagnetic energy into the atmosphere and measure reflectivity to monitor the movement, intensity, and type of precipitation, such as rain, snow, and hail. However, radars cannot observe precipitation directly. In contrast, rain gauges can provide only incomplete spatial information of precipitation events, depending on the density of the network. To derive quantitative precipitation estimates (QPEs), the signals from weather radars can be combined with measurements from the rain gauges. To provide timely information, especially for water management applications, DWD derives QPEs in real time by adjusting radar observations with data from the German rain gauge network (RADOLAN: Radar Online Adjustment). The information is stored as precipitation intensities with an intensity resolution of 0.1 mm and a spatial resolution of 1 km2, resulting in a 900×1100 km grid for Germany, and is provided in real time within 30 min of the last measurement. The data are provided at 5-minute and hourly time frequencies. The products might contain gaps caused by outages of radars, e.g. due to technical failures or regular maintenance. The archived collection of operationally produced RADOLAN data is also inhomogeneous in time, as it was produced with the current hardware and software configuration at the time of creation. To provide a dataset suitable for climatological application, the radar reflectivities have been reprocessed (i.e. the same set of algorithms for artefacts and attenuation correction as well as adjustments to rain gauge observations has been applied) to create a homogeneous set of precipitation observations covering the period from 2001 onwards (“RADKLIM”, Lengfeld et al.2019). In this study, we focus on the hourly grids of RADKLIM (Winterrath et al.2018a) (based on RADOLAN RW) for training and evaluation spanning 2001–2022.

2.2 Model

2.2.1 Image inpainting U-net

We use an image inpainting U-net (Ronneberger et al.2015) as a baseline model for reconstructing missing value regions in precipitation data. This model takes a single precipitation grid as input. Each data sample contains an observed precipitation grid with no missing values (i.e. the original RADKLIM data, considered as “ground truth” in our analysis), a binary missing value mask, and a masked grid obtained by element-wise multiplication of the original observations and the mask. This allows us to simulate missing value regions in complete radar images. We replace conventional convolutional operations in the U-net with partial convolutions by Liu et al. (2018). The automatic mask updating mechanism in these operations efficiently handles irregularly shaped holes in missing value masks, outperforming other methods trained only on regularly shaped holes (Liu et al.2018). Equation (1) defines partial convolution operations that show improved inpainting results, especially for large and irregularly shaped missing value regions. The first term describes the masking of the input data I with the mask M and applies a scaling factor depending on the number of ones in M. The weight matrix W represents the trainable weights of the network. The second term describes the mechanism for updating the mask after each convolution. If the convolution has been able to apply its output to at least one valid input value, that position is marked as valid. The architecture of our baseline convolutional neural network (CNN) is illustrated in Appendix A1.

(1) i = W T ( I M ) sum ( 1 ) sum ( M ) + b , if sum ( M ) > 0 0 , otherwise m = 1 , if sum ( M ) > 0 0 , otherwise

2.2.2 Temporal memory module

Precipitation estimation is a challenging spatiotemporal problem, as it involves highly nonlinear patterns in both time and space (Xingjian et al.2015; Tian et al.2019). To incorporate temporal information, we propose a straightforward channel-based approach that includes sequences of precipitation grids within the input data, rather than considering only grids of single time steps. We can arbitrarily define the number of time steps to consider. The dimension of the channel is equal to the number of time steps considered as input data. The output of the network is a tensor representing a reconstructed precipitation grid for a single time step. The detailed architecture can be seen in Appendix A2.

This channel-based approach has limitations in distinguishing between long-term and short-term relationships in the data. To address this, Xingjian et al. (2015) proposed a convolutional long short-term memory (LSTM) network for precipitation nowcasting, which extends the original fully connected LSTM architecture of Hochreiter and Schmidhuber (1997) with convolutional structures. The network takes as input a sequence of time-continuous precipitation grids collected from weather radars. The equations of the fully connected LSTM are modified to incorporate convolutional operations, given by Eq. (2).

(2) f t = σ ( W f x * X t + W f h * H t - 1 + W f c C t - 1 + b f ) i t = σ ( W i x * X t + W i h * H t - 1 + W i c C t - 1 + b i ) g t = tanh ( W g x * X t + W g h * H t - 1 + b g ) C t = f t C t - 1 + i t g t o t = σ ( W o x * X t + W o h H t - 1 + W o c + b o ) h t = o t tanh ( C t )

The W and b variables are weights and biases that are learnt by the model. The memory states Ct and Ct−1, the hidden states Ht and Ht−1, and the gates ft, it, ot, and gt are represented as three-dimensional matrices, with input channels in the first dimension and a two-dimensional spatial precipitation field in the other two dimensions. The Hadamard product is denoted by , and the convolutional operation is denoted by *. The convolutional LSTM is implemented in an encoder–decoder architecture similar to the future predictor model proposed by Srivastava et al. (2015). The combination of spatial data processing using CNNs and sequential data processing using LSTMs has been shown to outperform each technique used individually.

Instead of processing the data sequences in the channel dimension, the input sequence is iteratively passed through the set of Eq. (2). Note that these operations are applied only to the precipitation tensors, not to the mask tensors. Similar to the autoencoder of Srivastava et al. (2015), the decoder reconstructs the input sequence in reverse order. As a result, the output tensors from the encoder are provided to the decoder in reverse order. This speeds up the weight optimization, as the model primarily considers short-range correlations (Srivastava et al.2015). Appendix A3 shows how we implemented the LSTM module.

2.3 Technical implementation

The models presented in this study were implemented in Python using the PyTorch deep learning framework by Facebook (2025), chosen for its flexibility and efficiency in developing and training neural networks. PyTorch's dynamic computation graph and extensive support for GPU acceleration made it an ideal choice for training the models.

For model training and evaluation, we utilized A100 80 GB GPUs, which provided the necessary computational power for handling large datasets and complex model architectures. The use of these high-performance GPUs enabled efficient processing and reduced the training time for both the baseline and more computationally intensive LSTM models. The models were trained on high-performance hardware to ensure that they could effectively scale to meet the demands of large-scale image inpainting tasks and complex climate data gap-filling.

2.4 Experimental design

Due to radar outages, which are still quite common, many grids from the RADKLIM dataset contain missing values. We have therefore created a dataset containing only complete radar images where no radar outages have occurred and a dataset containing missing values where radar outages have occurred. In addition, the DWD introduced three new radar stations in 2014/2015 to the original 14 radar stations to improve spatial coverage. Therefore, we performed separate analyses on data from only 14 radars over the complete time range and from all 17 radars from 2015 onwards.

An overview of the different experiments can be found in Appendix C1, where we trained three models on each experiment: the baseline, channel-based and LSTM architectures.

In order to comprehensively evaluate our proposed models, our first experiment consists of a single missing value mask covering a significant area in central Germany. This gap was caused by three radar outages in January 2012, resulting in a 3 h data absence (see Appendix F). The chosen area presents an additional challenge because it encompasses the Harz Mountains, renowned for intricate precipitation patterns influenced by terrain (Panziera et al.2011).

In the second experiment, we trained the three models on all the complete hourly data from 2001–2022 covered by 14 radars. We extracted a mask dataset by setting all missing values from the remaining incomplete hourly data to 0 and the existing values to 1. During training, we combined the complete data with all the extracted missing value masks. This gave us the most reliable models for infilling real case scenarios with missing values.

In our third and final experiment, we looked at a recent flood event caused by extreme precipitation, training our models on complete data from 2015–2018, covered by all 17 radars. In July 2021, Germany was hit by massive rainfall events, and the resulting floods caused more than 180 deaths and billions of euros in damage. The return period of the 24 h rainfall is estimated to be around 500 years, with an even longer return period in the most affected area (Mohr et al.2023).

3 Results and discussion

Our performance evaluation relies on a range of metrics: (1) root mean square error (RMSE in mm h−1), (2) absolute mean error (AME in mm h−1), (3) temporal correlation over the spatial mean (rxy,time), (4) mean spatial correlation (rxy,space), and (5) spatial correlation of the sum over time (rxy,sum). Detailed explanations of these calculations are provided in Appendix B. The models were trained on complete grids from 2001 to 2022 covered by 14 radars and excluding the evaluation years, utilizing the missing data mask from Appendix F. We specifically chose the years 2007, 2012, and 2016, which were not part of the training data, to allow meaningful comparisons across three distinct annual cycles. Metrics were then computed by infilling simulated missing values for 2007, 2012, and 2016 with the same mask and averaging the results across these years.

Figure 2 (detailed in Table D1) shows that the channel-based model outperforms the baseline model in terms of pixel-wise (RMSE) and average (AME) precipitation reconstruction and maintains a good temporal correlation. However, the baseline model outperforms the channel-based model in terms of spatial metrics (rxy,space and rxy,sum), indicating that it is better at reconstructing the spatial distribution per time step as well as the total amount of precipitation at a fixed location. This may be due to the underestimation of precipitation in the channel-based approach, which can be seen in Fig. 3. The final model including the temporal memory module is the best performing model, with the highest scores for temporal, spatial, and summed correlations and the lowest errors (RMSE and AME).

https://hess.copernicus.org/articles/29/3687/2025/hess-29-3687-2025-f02

Figure 2Verification metrics of the baseline model (blue) with the channel-based memory approach (green) and the advanced temporal memory module (red). and indicate that a high value and a low value, respectively, should be aimed for.

Download

https://hess.copernicus.org/articles/29/3687/2025/hess-29-3687-2025-f03

Figure 3Average difference between the predicted precipitation in the infilled area and the actual precipitation measured. The field is an average of all infilled grids from 2007, 2012, and 2016. A negative value means that too little precipitation was predicted, and a positive value means that too much was predicted.

Download

We further explore the results of the first experiment using the scatter plots in Fig. 4, which provides a visual comparison between the model predictions and the observations. The baseline approach exhibits the largest spread with respect to the spatial average precipitation, while the channel approach underestimates, especially average fields with low precipitation. Here, the LSTM model provides the most accurate results. In the matter of reconstructing the temporal average at each grid point, the results of the baseline model feature the worst overall approximation and major outliers between 0.05 and 0.1 mm h−1, indicating overestimation of precipitation at specific grid points. The channel-based approach reduces the number of outliers in this range but still exhibits overestimations between 0.1 and 0.15 mm h−1, as well as underestimations at most grid points. The LSTM provides the best estimations for the time-averaged grid points, being closest to the red line with much smaller outliers.

https://hess.copernicus.org/articles/29/3687/2025/hess-29-3687-2025-f04

Figure 4(a), (b), (c) show the spatial average of precipitation for each time step from 2007, 2012, and 2016. (d), (e), (f) show the temporal average of all grids in 2007, 2012, and 2016 for each grid point. Both calculations were performed on the infilled area only. The red line marks the optimal results.

Download

In Fig. 5, we make a visual comparison of reconstructed grids for this single missing value mask scenario. Here, we consider a rainfall event from May 2012. The results from the channel-based approach again show an underestimation of precipitation during the event. On the other hand, the baseline and LSTM approaches give very similar results compared to the original RADKLIM data. However, the LSTM has some artificial chequerboard patterns, which were also observed by Liu et al. (2018) from the original partial convolutions.

https://hess.copernicus.org/articles/29/3687/2025/hess-29-3687-2025-f05

Figure 5(a), (b) show the input to the models (simulated missing value region in grey) and the original RADKLIM data. (c), (d), (e) show the infilled grids from our three models. This exact event was recorded on 31 May 2012 18:00 CET.

Figure 6 shows results from our second experiment, a visual comparison of infilled images generated by the baseline and LSTM models from the June 2002 radar outages, where we have no original observations. The baseline model was provided with a single time step for each infill application, while the LSTM was additionally provided with the two previous and subsequent time steps. Comparing images (a) and (b) from the baseline model (centre), a large region of precipitation disappears within 1 hour. In contrast, the LSTM model is able to preserve this by incorporating the temporal information of the previous 2 hours. It is clear that the LSTM model produces the most realistic results, while the spatial patterns are also best approximated with this model.

https://hess.copernicus.org/articles/29/3687/2025/hess-29-3687-2025-f06

Figure 6Comparison of the patchy rainfall records (top row) used as input to our infilling models with the reconstructed results from the baseline model (centre row) and from the LSTM model (bottom row).

Figure 7 shows the results from the third experiment, which is a snapshot of the Ahrtal rainfall event (top row). We masked out a large region of precipitation west of the location of the largest flooding (Ahr river basin) and applied the LSTM model to infill this region. We have also applied the infilling of this region to 20 consecutive hours of the extreme rainfall event and show the accumulated rainfall over this period (bottom row). A complete map of the event and the reconstruction can be seen in Appendix Fig. E1. Here, we can see a limitation of our model, which leads to an underestimation of the extreme rainfall. The model predicts a total rainfall of 70.76 mm in the Ahr basin over the 20 h period, whereas the original observed rainfall was 101.89 mm. This amounts to an accuracy of 69.5 %. However, in the event of radar failure during such events, our method could still potentially provide an estimate of rainfall over the affected region based on nearby radar data and help improve flood forecasting and risk assessment.

https://hess.copernicus.org/articles/29/3687/2025/hess-29-3687-2025-f07

Figure 7A zoomed-in illustration of the extreme precipitation event in the Ahrtal on 14 July 2021. The entire area can be seen in Fig. E1. The Ahr river basin is highlighted by a grey border. Here, we compare the original RADKLIM data with the output of the LSTM model. (a), (b), (c) show a reconstruction of a single hour (18:00 CET) in mm h−1. (d), (e), (f) show the accumulated amount of precipitation in mm from reconstructions over 20 h (between 02:00 and 21:00 h on 14 July 2021).

The evaluation of the proposed models shows that the LSTM model outperforms the baseline and channel-based approaches in terms of overall accuracy. The model consistently improves performance across all evaluation metrics (Fig. 2), as well as through visual analysis of the scatter plots in Fig. 4 and infilled images in Fig. 6. However, it should be noted that the LSTM model also requires significantly more hardware resources and computing time for training compared to the other models. For example, the baseline model took approximately 10 h to train for 100k iterations on an A100 GPU, consuming around 10 GB of GPU memory. In contrast, the LSTM model required roughly 40 h for the same number of iterations, consuming 60 GB of GPU memory. During inference, this time is greatly reduced, with the baseline model taking about 1 s per prediction and the LSTM model taking 5 s per prediction. Nevertheless, this may impact the feasibility and scalability of implementing the LSTM model in certain operational settings with limited computing resources. Hence, a careful trade-off analysis may be necessary when choosing the most appropriate model for a specific application.

In the final step, we filled in all hourly data from 2001 to 2022 using our LSTM model, which was trained on data from 17 radar stations. This enhanced dataset extends radar coverage to periods before 2014, ensuring both spatial and temporal consistency. The infilled dataset will be made available for public access upon publication of this study. A few selected samples from this dataset are shown in Appendix G1.

The results of our study demonstrate that the memory-assisted deep learning approach, particularly the LSTM-based model, outperforms the baseline convolutional models in infilling missing radar rainfall data. This indicates that incorporating temporal dependencies significantly enhances reconstruction accuracy. This finding highlights the importance of capturing temporal dependencies in precipitation reconstruction. Furthermore, our deep learning approach avoids the excessive smoothing observed in traditional interpolation methods, leading to more realistic precipitation patterns.

Despite the good performance, our approach has certain limitations. One notable issue is the underestimation of extreme rainfall events, as observed in the Ahrtal flood case study. This may be due to the known inherent difficulty of machine learning models in predicting rare and highly localized extreme values, which are often underrepresented in the training data (Charlton-Perez et al.2024; Xu et al.2024; Zhong et al.2024). Future work could address this by incorporating additional features such as atmospheric pressure, wind speed, temperature, and humidity fields.

Another limitation is the computational cost of training and deploying LSTM-based models. While they outperform simpler methods, their training process requires significant computational resources, which may not be feasible for operational nowcasting systems with real-time constraints. A potential trade-off could involve using a hybrid approach where simpler models handle routine infilling, while the LSTM model is reserved for high-impact scenarios.

Nevertheless, the implications of these findings are significant for hydrology and meteorology. Accurate rainfall reconstructions are crucial for flood forecasting, climate monitoring, and weather prediction models. By improving the reliability of precipitation data, our method can enhance the accuracy of early warning systems and support better decision-making for disaster response and water resource management:

  1. More accurate rainfall estimates can lead to better flood predictions, reducing uncertainty in early warning systems.

  2. Long-term datasets with fewer gaps allow for better trend analysis and climate change assessments.

  3. Reliable precipitation data inform irrigation planning and drought mitigation strategies.

Our method can also be integrated into existing operational meteorological systems, helping to mitigate the impact of radar outages and ensuring continuity in rainfall monitoring.

While our results are promising, several avenues for future research could enhance the model’s performance and applicability:

  1. Hybrid models: combining physics-based numerical weather prediction models with deep learning techniques could improve performance and efficiency, particularly for extreme events.

  2. Transfer learning: training the model on a diverse set of meteorological data, including satellite and ground-based observations, could enhance its generalizability to different regions and climate conditions.

  3. Attention-based models: exploring attention mechanisms, such as those used in transformer architectures, could help capture long-range dependencies more effectively and efficiently than LSTMs.

  4. Multi-source data integration: incorporating additional meteorological variables (e.g. temperature, wind speed, atmospheric pressure) may improve model accuracy by providing a more comprehensive representation of precipitation dynamics.

  5. Operational deployment: research into optimizing model efficiency for real-time applications could make deep-learning-based infilling viable for nowcasting systems.

4 Conclusions

Incomplete precipitation data can lead to misinterpretations of climate conditions, uncertainties in early warning systems, and inaccuracies in nowcasting models, posing challenges for hydrological and meteorological applications. Addressing this issue, we proposed and evaluated three machine learning models for infilling missing precipitation data: A basic inpainting model, a straightforward channel-based approach that considers a sequence of time steps as input, and an LSTM approach as an advancement of the channel-based approach. We trained and evaluated our models on hourly precipitation data over Germany. The results of the evaluation showed that the LSTM model outperforms the baseline and channel-based approaches in terms of overall performance, the baseline model has a larger prediction error, and the channel-based model has a tendency to underestimate precipitation. However, the LSTM model also requires significantly more hardware resources and computing time compared to the other models, while the other models already perform quite well. Increasing the complexity of the model can improve the results, with the understanding that it requires more resources than other models. Our analysis highlights the potential of machine learning models to be used for efficiently infilling missing precipitation data. The tangible advantage of employing the infilled data generated by our models requires exploration through an examination of how the data might enhance the accuracy and performance of other nowcasting models that depend on the same dataset. Future applications of our research could include a cascaded approach, using the baseline model for immediate results, the channel-based model for better temporal estimation, and finally the best results with the LSTM model with the largest latency. We also see scope for additional applications, beyond the infilling of missing radar data. By combining information on observed rainfall data from rain gauges, additional spatial information could be gained, and the accuracy of the rainfall information can be improved.

Appendix A: Model
https://hess.copernicus.org/articles/29/3687/2025/hess-29-3687-2025-f08

Figure A1The architecture of the baseline model.

Download

https://hess.copernicus.org/articles/29/3687/2025/hess-29-3687-2025-f09

Figure A2The architecture of the channel-based model.

Download

https://hess.copernicus.org/articles/29/3687/2025/hess-29-3687-2025-f10

Figure A3The architecture of the LSTM model.

Download

Appendix B: Formulas
(B1)RMSE=1NWHt=0N-1i=0W-1j=0H-1(xt,i,j-yt,i,j)2(B2)AME=|1Nt=0N-1(1WHi=0W-1j=0H-1xt,i,j-1WHi=0W-1j=0H-1yt,i,j)|(B3)rxy,Time=t=0N-1Tx,tTy,t-TxTy(t=0N-1Tx,t2-Tx)(t=0N-1Ty,t2-Ty)(B4)rxy,Space=i=0WH-1xt,iyt,i-xtyt(i=0WH-1xt,i2-xt)(i=0WH-1yt,i2-yt)(B5)rxy,Sum=i=0WH-1Σ(xi)Σ(yi)-Σ(yi)Σ(y)(i=0WH-1Σ(xi)2-Σ(x))(i=0WH-1Σ(yi)2-Σ(y))
Appendix C: Experiment overview

Table C1An overview of all the experiments that we performed.

* Excluding the years 2007, 2012, and 2016.

Download Print Version | Download XLSX

Appendix D: Metric results

Table D1Verification metrics of the baseline model, the channel-based memory approach, and the advanced LSTM approach. and in the columns indicate that a high value and a low value, respectively, should be aimed for. The bold text highlights the best performing model among the channel-based models and the advanced approaches.

Download Print Version | Download XLSX

Appendix E: Ahrtal results
https://hess.copernicus.org/articles/29/3687/2025/hess-29-3687-2025-f11

Figure E1Illustration of the extreme precipitation event in the Ahrtal on 14 July 2021 over the entire area of Germany. The Ahr river basin is highlighted by grey hatching. Here, we compare the original RADKLIM data with the output of the LSTM model. (a), (b), (c) show a reconstruction of a single hour (18:00 CET) in mm h−1. (d), (e), (f) show the accumulated amount of precipitation in mm from reconstructions over 20 h (between 02:00 and 21:00 h on 14 July 2021).

Appendix F: Training mask
https://hess.copernicus.org/articles/29/3687/2025/hess-29-3687-2025-f12

Figure F1Real case study of radar outages that occurred in January 2012. Four overlapping radars failed at the same time, causing a large region with missing values (grey) in the precipitation recording.

Appendix G: Infilled samples
https://hess.copernicus.org/articles/29/3687/2025/hess-29-3687-2025-f13

Figure G1A selection of infilled samples using the LSTM model. (a)(d) and (i)(l) show samples from the original dataset, and (e)(h) and (m)(p) show the corresponding infilled versions.

Code and data availability

The code used for the analysis and simulations in this study is openly accessible at https://github.com/FREVA-CLINT/climatereconstructionAI (last access: 29 August 2023; https://doi.org/10.5281/zenodo.3766740, Meuer et al.2024). The repository contains scripts written in Python, along with detailed documentation to facilitate replication and further exploration of the methodologies employed. The data utilized in this research were obtained from Germany's meteorological service (Deutscher Wetterdienst, DWD). Hourly radar-based precipitation data (RADKLIM) covering the study period are available under an open data licence: https://doi.org/10.5676/DWD/RADKLIM_RW_V2017.002 (Winterrath et al.2018b). A fully infilled version next to the original data of the hourly precipitation data will be made available to the public upon publication of this study.

Author contributions

JM, LB, and CK conceived the study. JM designed the research methodology, conducted data analysis, collected and processed the data used in the study, and wrote the paper. All authors contributed to the interpretation of results and provided critical feedback throughout the paper preparation. All authors contributed to the writing and editing of the paper.

Competing interests

The contact author has declared that none of the authors has any competing interests.

Disclaimer

Publisher’s note: Copernicus Publications remains neutral with regard to jurisdictional claims made in the text, published maps, institutional affiliations, or any other geographical representation in this paper. While Copernicus Publications makes every effort to include appropriate place names, the final responsibility lies with the authors.

Acknowledgements

The authors are grateful to the German Climate Computing Center (DKRZ) for providing the hardware for the calculations and to Germany's meteorological service (DWD) for providing the RADKLIM data that were used for this study. This work was supported by the Horizon Europe project EXPECT (Towards an Integrated Capability to Explain and Predict Regional Climate Changes) under grant agreement 101137656 (Christopher Kadow). Johannes Meuer is funded by the German Science Foundation (DFG), provided by the research unit FOR 2820, titled “Revisiting The Volcanic Impact on Atmosphere and Climate-Preparations for the Next Big Volcanic Eruption” (VolImpact), with the project number 398006378. Johannes Meuer, Roman Lehmann, and Wolfgang Karl acknowledge support from the Karlsruhe Institute of Technology (KIT). Thomas Ludwig and Christopher Kadow are funded by the German Climate Computing Center (DKRZ). Laurens Bouwer acknowledges support from the Helmholtz Association under the research programme “Changing Earth – Sustaining our Future”. Frank Kaspar acknowledges support from the German Weather Service (DWD).

Financial support

This research has been funded by the German Climate Computing Center, EU Horizon Europe (grant no. 101137656), and German Science Foundation (grant no. FOR 2820).

Review statement

This paper was edited by Lelys Bravo de Guenni and reviewed by two anonymous referees.

References

Barrios, A., Trincado, G., and Garreaud, R.: Alternative approaches for estimating missing climate data: application to monthly precipitation records in South-Central Chile, Forest Ecosystems, 5, 1–10, 2018. a

Charlton-Perez, A. J., Dacre, H. F., Driscoll, S., Gray, S. L., Harvey, B., Harvey, N. J., Hunt, K. M., Lee, R. W., Swaminathan, R., Vandaele, R., and Volonté, A.: Do AI models produce better weather forecasts than physics-based models? A quantitative evaluation case study of Storm Ciarán, npj Climate and Atmospheric Science, 7, 93, https://doi.org/10.1038/s41612-024-00638-w, 2024. a

Elharrouss, O., Almaadeed, N., Al-Maadeed, S., and Akbari, Y.: Image inpainting: A review, Neural Process. Lett., 51, 2007–2028, 2020. a

Facebook: Pytorch, https://pytorch.org/ (last access: 10 April 2025), 2025. a

Geiss, A. and Hardin, J. C.: Inpainting radar missing data regions with deep learning, Atmos. Meas. Tech., 14, 7729–7747, https://doi.org/10.5194/amt-14-7729-2021, 2021. a, b, c

Hochreiter, S. and Schmidhuber, J.: Long short-term memory, Neural Comput., 9, 1735–1780, 1997. a

James, P. M., Reichert, B. K., and Heizenreder, D.: NowCastMIX: Automatic integrated warnings for severe convection on nowcasting time scales at the German Weather Service, Weather Forecast., 33, 1413–1433, 2018. a

Kadow, C., Hall, D. M., and Ulbrich, U.: Artificial intelligence reconstructs missing climate information, Nat. Geosci., 13, 408–413, 2020. a, b

Kaspar, F. and Mächel, H.: Beobachtung von Klima und Klimawandel in Mitteleuropa und Deutschland, edited by: Brasseur, G. P., Jacob, D., and Schuck-Zöller, S., Klimawandel in Deutschland, https://doi.org/10.1007/978-3-662-66696-8_3, 2023. a

Landot, T., Sgellari, S., Lima, C., and Lall, U.: In-filling missing historical daily rainfall data study, Final Report, South Florida Water Management District, Columbia University, New York, NY, https://scholar.google.com/scholar?hl=en&q=Landot+T,+Sgellari+S,+Lima+C,+Lall+U.+2008.+In% E2% 80% 90filling+missing+historical+daily+rainfall+data+study.+Final+Report,+South+Florida+Water+Management+District,+Columbia+University,+New+York,+NY (last access: 20 January 2024), 2008. a

Lang, P.: Konrad, Umweltwissenschaften und Schadstoff-Forschung, 14, 212, https://doi.org/10.1007/BF03038827, 2002. a

Lengfeld, K., Winterrath, T., Junghänel, T., Hafer, M., and Becker, A.: Characteristic spatial extent of hourly and daily precipitation events in Germany derived from 16 years of radar data, Characteristic spatial extent of hourly and daily precipitation events in Germany derived from 16 years of radar data, Meteorol. Z., 28, 363–378, 2019. a, b

Liu, G., Reda, F. A., Shih, K. J., Wang, T.-C., Tao, A., and Catanzaro, B.: Image inpainting for irregular holes using partial convolutions, arXiv [preprint], https://doi.org/10.48550/arXiv.1804.07723, 2018. a, b, c, d, e, f

Meuer, J., Plésiat, É., Inoue, N., Witte, M., Seitz, S., and Kadow, C.: FREVA-CLINT/climatereconstructionAI: Guacamole (v1.0.4), Zenodo [code], https://doi.org/10.5281/zenodo.13767317, 2024. a

Mohr, S., Ehret, U., Kunz, M., Ludwig, P., Caldas-Alvarez, A., Daniell, J. E., Ehmele, F., Feldmann, H., Franca, M. J., Gattke, C., Hundhausen, M., Knippertz, P., Küpfer, K., Mühr, B., Pinto, J. G., Quinting, J., Schäfer, A. M., Scheibel, M., Seidel, F., and Wisotzky, C.: A multi-disciplinary analysis of the exceptional flood event of July 2021 in central Europe – Part 1: Event description and analysis, Nat. Hazards Earth Syst. Sci., 23, 525–551, https://doi.org/10.5194/nhess-23-525-2023, 2023. a

Oliver, M. A. and Webster, R.: Kriging: a method of interpolation for geographical information systems, Int. J. Geogr. Inf. Syst., 4, 313–332, 1990. a, b

Panziera, L., Germann, U., Gabella, M., and Mandapaka, P.: NORA–Nowcasting of Orographic Rainfall by means of Analogues, Q. J. Roy. Meteor. Soc., 137, 2106–2123, 2011. a

Ronneberger, O., Fischer, P., and Brox, T.: U-net: Convolutional networks for biomedical image segmentation, in: International Conference on Medical image computing and computer-assisted intervention, Springer, 234–241, https://doi.org/10.1007/978-3-319-24574-4_28, 2015. a

Shibata, S., Iiyama, M., Hashimoto, A., and Minoh, M.: Restoration of sea surface temperature satellite images using a partially occluded training set, in: 2018 24th International Conference on Pattern Recognition (ICPR), ICPR 2018, Beijing, China, 20–24 August 2018, 2771–2776, https://doi.org/10.1109/ICPR.2018.8546261, 2018. a

Simanton, J. R. and Osborn, H. B.: Reciprocal-distance estimate of point rainfall, J. Hydr. Div., 106, 1242–1246, 1980. a, b

Smith, T. M., Reynolds, R. W., Livezey, R. E., and Stokes, D. C.: Reconstruction of historical sea surface temperatures using empirical orthogonal functions, J. Climate, 9, 1403–1420, 1996. a

Srivastava, N., Mansimov, E., and Salakhudinov, R.: Unsupervised learning of video representations using lstms, in: International conference on machine learning, ICML 2015, Lille, France, 6–11 July 2015, https://dl.acm.org/doi/10.5555/3045118.3045209, 843–852, 2015. a, b, c

Teegavarapu, R. S. and Chandramouli, V.: Improved weighting methods, deterministic and stochastic data-driven models for estimation of missing precipitation records, J. Hydrol., 312, 191–206, 2005. a

Teegavarapu, R. S., Aly, A., Pathak, C. S., Ahlquist, J., Fuelberg, H., and Hood, J.: Infilling missing precipitation records using variants of spatial interpolation and data-driven methods: use of optimal weighting parameters and nearest neighbour-based corrections, Int. J. Climatol., 38, 776–793, 2018.  a, b, c, d

Tian, L., Li, X., Ye, Y., Xie, P., and Li, Y.: A generative adversarial gated recurrent unit model for precipitation nowcasting, IEEE Geosci. Remote S., 17, 601–605, 2019. a

Verworn, A. and Haberlandt, U.: Spatial interpolation of hourly rainfall – effect of additional information, variogram inference and storm properties, Hydrol. Earth Syst. Sci., 15, 569–584, https://doi.org/10.5194/hess-15-569-2011, 2011. a, b

Vislocky, R. L. and Fritsch, J. M.: Generalized additive models versus linear regression in generating probabilistic MOS forecasts of aviation weather parameters, Weather Forecast., 10, 669–680, 1995. a

Wapler, K., Goeber, M., and Trepte, S.: Comparative verification of different nowcasting systems to support optimisation of thunderstorm warnings, Adv. Sci. Res., 8, 121–127, 2012. a

Winterrath, T., Brendel, C., Hafer, M., Junghänel, T., Klameth, A., Walawender, E., Weigl, E., and Becker, A.: Erstellung einer radargestützten Niederschlagsklimatologie, https://refubium.fu-berlin.de/bitstream/handle/fub188/21892/251_pdf.pdf?sequence=1 (last access: 15 January 2024), 2017. a, b

Winterrath, T., Brendel, C., Hafer, M., Junghänel, T., Klameth, A., Lengfeld, K., Walawender, E., Weigl, E., and Becker, A.: RADKLIM Version 2017.002: Reprocessed gauge-adjusted radar data, one-hour precipitation sums (RW), Deutscher Wetterdienst (DWD) [data set], https://doi.org/10.5676/DWD/RADKLIM_RW_V2017.002, 2018a. a, b, c, d

Winterrath, T., Brendel, C., Hafer, M., Junghänel, T., Klameth, A., Lengfeld, K., Walawender, E., Weigl, E., and Becker, A.: Radar-based gauge-adjusted one-hour precipitation sum climatology Version 2017.002 Gridded Precipitation Data for Germany version v2017.02, Deutscher Wetterdienst (DWD) [data set], https://doi.org/10.5676/DWD/RADKLIM_RW_V2017.002, 2018b. a

Xingjian, S., Chen, Z., Wang, H., Yeung, D.-Y., Wong, W.-K., and Woo, W.-c.: Convolutional LSTM network: A machine learning approach for precipitation nowcasting, in: Advances in neural information processing systems, Adv. Neur. In., 28, 802–810, https://proceedings.neurips.cc/paper/2015/file/07563a3fe3bbe7e3ba84431ad9d055af-Paper.pdf (last access: 25 June 2023), 2015. a, b, c

Xu, W., Chen, K., Han, T., Chen, H., Ouyang, W., and Bai, L.: Extremecast: Boosting extreme value prediction for global weather forecast, arXiv [preprint], https://doi.org/10.48550/arXiv.2402.01295, 2 February 2024. a

Yu, J., Lin, Z., Yang, J., Shen, X., Lu, X., and Huang, T. S.: Generative image inpainting with contextual attention, arXiv [preprint], https://doi.org/10.48550/arXiv.1801.07892, 2018. a

Zhong, X., Chen, L., Liu, J., Lin, C., Qi, Y., and Li, H.: FuXi-Extreme: Improving extreme rainfall and wind forecasts with diffusion model, Science China Earth Sciences, 67, 3696–3708, https://doi.org/10.1007/s11430-023-1427-x, 2024. a

Download
Short summary
Our study focuses on filling in missing precipitation data using an advanced neural network model. Traditional methods for estimating missing climate information often struggle in large regions where data are scarce. Our solution, which incorporates recent advances in machine learning, captures the intricate patterns of precipitation over time, especially during extreme weather events. Our model shows good performance in reconstructing large regions of missing rainfall radar data.
Share