Articles | Volume 24, issue 9
https://doi.org/10.5194/hess-24-4523-2020
© Author(s) 2020. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
https://doi.org/10.5194/hess-24-4523-2020
© Author(s) 2020. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Research article
| 
17 Sep 2020
Research article |
| 17 Sep 2020
| 17 Sep 2020
Histogram via entropy reduction (HER): an information-theoretic alternative for geostatistics
Stephanie Thiesen
CORRESPONDING AUTHOR
Institute of Water Resources and River Basin Management, Karlsruhe Institute of Technology, Karlsruhe, Germany
Diego M. Vieira
Department for Microsystems Engineering, University of Freiburg,
Freiburg, Germany
Bernstein Center Freiburg, University of Freiburg, Freiburg, Germany
Mirko Mälicke
Institute of Water Resources and River Basin Management, Karlsruhe Institute of Technology, Karlsruhe, Germany
Ralf Loritz
Institute of Water Resources and River Basin Management, Karlsruhe Institute of Technology, Karlsruhe, Germany
J. Florian Wellmann
Computational Geosciences and Reservoir Engineering, RWTH Aachen
University, Aachen, Germany
Uwe Ehret
Institute of Water Resources and River Basin Management, Karlsruhe Institute of Technology, Karlsruhe, Germany
Related authors
No articles found.
Friedrich Carl, Peter Achtziger-Zupančič, Jian Yang, Marlise Colling Cassel, and Florian Wellmann
EGUsphere, https://doi.org/10.5194/egusphere-2025-3203, https://doi.org/10.5194/egusphere-2025-3203, 2025
This preprint is open for discussion and under review for Solid Earth (SE).
Short summary
Short summary
A method for shape quantification based on geometrical parameters is proposed alongside a set of regular geometries established as geomodeling benchmarks. Dimensions, gradient and curvature data is obtained on cross-sections. Data analyses provide insight into the main geometrical characteristics of the benchmark models and visualizes geometrical dis-/similarities between bodies. The method and benchmarks are usable in geomodeling workflows and structural comparisons based on sparse data.
Sarah Quỳnh-Giang Ho and Uwe Ehret
Hydrol. Earth Syst. Sci., 29, 2785–2810, https://doi.org/10.5194/hess-29-2785-2025, https://doi.org/10.5194/hess-29-2785-2025, 2025
Short summary
Short summary
In this paper, we use models to demonstrate that even small flood reservoirs – which capture water to avoid floods downstream – can be repurposed to release water in drier conditions without affecting their ability to protect against floods. By capturing water and releasing it once levels are low, we show that reservoirs can greatly increase the water available in drought. Having more water available to the reservoir, however, is not necessarily better for drought protection.
Denise Degen, Moritz Ziegler, Oliver Heidbach, Andreas Henk, Karsten Reiter, and Florian Wellmann
Solid Earth, 16, 477–502, https://doi.org/10.5194/se-16-477-2025, https://doi.org/10.5194/se-16-477-2025, 2025
Short summary
Short summary
Obtaining reliable estimates of the subsurface state distributions is essential to determine the location of, e.g., potential nuclear waste disposal sites. However, providing these is challenging since it requires solving the problem numerous times, yielding high computational cost. To overcome this, we use a physics-based machine learning method to construct surrogate models. We demonstrate how it produces physics-preserving predictions, which differentiates it from purely data-driven approaches.
Judith Nijzink, Ralf Loritz, Laurent Gourdol, Davide Zoccatelli, Jean François Iffly, and Laurent Pfister
Earth Syst. Sci. Data Discuss., https://doi.org/10.5194/essd-2024-482, https://doi.org/10.5194/essd-2024-482, 2025
Preprint under review for ESSD
Short summary
Short summary
The CAMELS-LUX dataset (Catchment Attributes and MEteorology for Large-sample Studies – LUXembourg) contains hydrologic, meteorologic and thunderstorm formation relevant atmospheric time series of 56 Luxembourgish catchments (2004–2021). These catchments are characterized by a large physiographic variety on a relatively small scale in a homogeneous climate. The dataset can be applied for (regional) hydrological analyses.
Manuel Álvarez Chaves, Eduardo Acuña Espinoza, Uwe Ehret, and Anneli Guthke
EGUsphere, https://doi.org/10.5194/egusphere-2025-1699, https://doi.org/10.5194/egusphere-2025-1699, 2025
Short summary
Short summary
This study evaluates hybrid hydrological models that combine physics-based and data-driven components, using Information Theory to measure their relative contributions. When testing conceptual models with LSTMs that adjust parameters over time, we found performance primarily comes from the data-driven component, with physics constraints adding minimal value. We propose a quantitative tool to analyse this behaviour and suggest a workflow for diagnosing hybrid models.
Eduardo Acuña Espinoza, Frederik Kratzert, Daniel Klotz, Martin Gauch, Manuel Álvarez Chaves, Ralf Loritz, and Uwe Ehret
Hydrol. Earth Syst. Sci., 29, 1749–1758, https://doi.org/10.5194/hess-29-1749-2025, https://doi.org/10.5194/hess-29-1749-2025, 2025
Short summary
Short summary
Long short-term memory (LSTM) networks have demonstrated state-of-the-art performance for rainfall-runoff hydrological modelling. However, most studies focus on predictions at a daily scale, limiting the benefits of sub-daily (e.g. hourly) predictions in applications like flood forecasting. In this study, we introduce a new architecture, multi-frequency LSTM (MF-LSTM), designed to use inputs of various temporal frequencies to produce sub-daily (e.g. hourly) predictions at a moderate computational cost.
Maria Staudinger, Anna Herzog, Ralf Loritz, Tobias Houska, Sandra Pool, Diana Spieler, Paul D. Wagner, Juliane Mai, Jens Kiesel, Stephan Thober, Björn Guse, and Uwe Ehret
EGUsphere, https://doi.org/10.5194/egusphere-2025-1076, https://doi.org/10.5194/egusphere-2025-1076, 2025
Short summary
Short summary
Four process-based and four data-driven hydrological models are compared using different training data. We found process-based models to perform better with small data sets but stop learning soon, while data-driven models learn longer. The study highlights the importance of memory in data and the impact of different data sampling methods on model performance. The direct comparison of these models is novel and provides a clear understanding of their performance under various data conditions.
Eduardo Acuña Espinoza, Ralf Loritz, Frederik Kratzert, Daniel Klotz, Martin Gauch, Manuel Álvarez Chaves, and Uwe Ehret
Hydrol. Earth Syst. Sci., 29, 1277–1294, https://doi.org/10.5194/hess-29-1277-2025, https://doi.org/10.5194/hess-29-1277-2025, 2025
Short summary
Short summary
Data-driven techniques have shown the potential to outperform process-based models in rainfall–runoff simulations. Hybrid models, combining both approaches, aim to enhance accuracy and maintain interpretability. Expanding the set of test cases to evaluate hybrid models under different conditions, we test their generalization capabilities for extreme hydrological events.
Sanika Baste, Daniel Klotz, Eduardo Acuña Espinoza, Andras Bardossy, and Ralf Loritz
EGUsphere, https://doi.org/10.5194/egusphere-2025-425, https://doi.org/10.5194/egusphere-2025-425, 2025
Short summary
Short summary
This study evaluates the extrapolation performance of Long Short-Term Memory (LSTM) networks in rainfall-runoff modeling, specifically under extreme conditions. The findings reveal that the LSTM cannot predict discharge values beyond a theoretical limit, which is well below the extremity of its training data. This behavior results from the LSTM's gating structures rather than saturation of cell states alone.
Ashish Manoj J, Ralf Loritz, Hoshin Gupta, and Erwin Zehe
Hydrol. Earth Syst. Sci. Discuss., https://doi.org/10.5194/hess-2024-375, https://doi.org/10.5194/hess-2024-375, 2024
Revised manuscript under review for HESS
Short summary
Short summary
Traditional hydrological models typically operate in a forward mode, simulating streamflow and other catchment fluxes based on precipitation input. In this study, we explored the possibility of reversing this process—inferring precipitation from streamflow data—to improve flood event modelling. We then used the generated precipitation series to run hydrological models, resulting in more accurate estimates of streamflow and soil moisture.
Ralf Loritz, Alexander Dolich, Eduardo Acuña Espinoza, Pia Ebeling, Björn Guse, Jonas Götte, Sibylle K. Hassler, Corina Hauffe, Ingo Heidbüchel, Jens Kiesel, Mirko Mälicke, Hannes Müller-Thomy, Michael Stölzle, and Larisa Tarasova
Earth Syst. Sci. Data, 16, 5625–5642, https://doi.org/10.5194/essd-16-5625-2024, https://doi.org/10.5194/essd-16-5625-2024, 2024
Short summary
Short summary
The CAMELS-DE dataset features data from 1582 streamflow gauges across Germany, with records spanning from 1951 to 2020. This comprehensive dataset, which includes time series of up to 70 years (median 46 years), enables advanced research on water flow and environmental trends and supports the development of hydrological models.
Andrea L. Campoverde, Uwe Ehret, Patrick Ludwig, and Joaquim G. Pinto
Geosci. Model Dev. Discuss., https://doi.org/10.5194/gmd-2024-134, https://doi.org/10.5194/gmd-2024-134, 2024
Revised manuscript not accepted
Short summary
Short summary
We looked at how well the model WRF-Hydro performed during the 2018 drought event in the River Rhine basin, even though it is typically used for floods. We used the meteorological ERA5 reanalysis dataset to simulate River Rhine’s streamflow and adjusted the model using parameters and actual discharge measurements. We focused on Lake Constance, a key part of the basin, but found issues with the model’s lake outflow simulation. By removing the lake module, we obtained more accurate results.
Eduardo Acuña Espinoza, Ralf Loritz, Manuel Álvarez Chaves, Nicole Bäuerle, and Uwe Ehret
Hydrol. Earth Syst. Sci., 28, 2705–2719, https://doi.org/10.5194/hess-28-2705-2024, https://doi.org/10.5194/hess-28-2705-2024, 2024
Short summary
Short summary
Hydrological hybrid models promise to merge the performance of deep learning methods with the interpretability of process-based models. One hybrid approach is the dynamic parameterization of conceptual models using long short-term memory (LSTM) networks. We explored this method to evaluate the effect of the flexibility given by LSTMs on the process-based part.
Denise Degen, Daniel Caviedes Voullième, Susanne Buiter, Harrie-Jan Hendricks Franssen, Harry Vereecken, Ana González-Nicolás, and Florian Wellmann
Geosci. Model Dev., 16, 7375–7409, https://doi.org/10.5194/gmd-16-7375-2023, https://doi.org/10.5194/gmd-16-7375-2023, 2023
Short summary
Short summary
In geosciences, we often use simulations based on physical laws. These simulations can be computationally expensive, which is a problem if simulations must be performed many times (e.g., to add error bounds). We show how a novel machine learning method helps to reduce simulation time. In comparison to other approaches, which typically only look at the output of a simulation, the method considers physical laws in the simulation itself. The method provides reliable results faster than standard.
Michael Hillier, Florian Wellmann, Eric A. de Kemp, Boyan Brodaric, Ernst Schetselaar, and Karine Bédard
Geosci. Model Dev., 16, 6987–7012, https://doi.org/10.5194/gmd-16-6987-2023, https://doi.org/10.5194/gmd-16-6987-2023, 2023
Short summary
Short summary
Neural networks can be used effectively to model three-dimensional geological structures from point data, sampling geological interfaces, units, and structural orientations. Existing neural network approaches for this type of modelling are advanced by the efficient incorporation of unconformities, new knowledge inputs, and improved data fitting techniques. These advances permit the modelling of more complex geology in diverse geological settings, different-sized areas, and various data regimes.
Uwe Ehret and Pankaj Dey
Hydrol. Earth Syst. Sci., 27, 2591–2605, https://doi.org/10.5194/hess-27-2591-2023, https://doi.org/10.5194/hess-27-2591-2023, 2023
Short summary
Short summary
We propose the
c-u-curvemethod to characterize dynamical (time-variable) systems of all kinds.
Uis for uncertainty and expresses how well a system can be predicted in a given period of time.
Cis for complexity and expresses how predictability differs between different periods, i.e. how well predictability itself can be predicted. The method helps to better classify and compare dynamical systems across a wide range of disciplines, thus facilitating scientific collaboration.
Mohammad Moulaeifard, Simon Bernard, and Florian Wellmann
Geosci. Model Dev., 16, 3565–3579, https://doi.org/10.5194/gmd-16-3565-2023, https://doi.org/10.5194/gmd-16-3565-2023, 2023
Short summary
Short summary
In this work, we propose a flexible framework to generate and interact with geological models using explicit surface representations. The essence of the work lies in the determination of the flexible control mesh, topologically similar to the main geological structure, watertight and controllable with few control points, to manage the geological structures. We exploited the subdivision surface method in our work, which is commonly used in the animation and gaming industry.
Patrick Ludwig, Florian Ehmele, Mário J. Franca, Susanna Mohr, Alberto Caldas-Alvarez, James E. Daniell, Uwe Ehret, Hendrik Feldmann, Marie Hundhausen, Peter Knippertz, Katharina Küpfer, Michael Kunz, Bernhard Mühr, Joaquim G. Pinto, Julian Quinting, Andreas M. Schäfer, Frank Seidel, and Christina Wisotzky
Nat. Hazards Earth Syst. Sci., 23, 1287–1311, https://doi.org/10.5194/nhess-23-1287-2023, https://doi.org/10.5194/nhess-23-1287-2023, 2023
Short summary
Short summary
Heavy precipitation in July 2021 led to widespread floods in western Germany and neighboring countries. The event was among the five heaviest precipitation events of the past 70 years in Germany, and the river discharges exceeded by far the statistical 100-year return values. Simulations of the event under future climate conditions revealed a strong and non-linear effect on flood peaks: for +2 K global warming, an 18 % increase in rainfall led to a 39 % increase of the flood peak in the Ahr river.
Susanna Mohr, Uwe Ehret, Michael Kunz, Patrick Ludwig, Alberto Caldas-Alvarez, James E. Daniell, Florian Ehmele, Hendrik Feldmann, Mário J. Franca, Christian Gattke, Marie Hundhausen, Peter Knippertz, Katharina Küpfer, Bernhard Mühr, Joaquim G. Pinto, Julian Quinting, Andreas M. Schäfer, Marc Scheibel, Frank Seidel, and Christina Wisotzky
Nat. Hazards Earth Syst. Sci., 23, 525–551, https://doi.org/10.5194/nhess-23-525-2023, https://doi.org/10.5194/nhess-23-525-2023, 2023
Short summary
Short summary
The flood event in July 2021 was one of the most severe disasters in Europe in the last half century. The objective of this two-part study is a multi-disciplinary assessment that examines the complex process interactions in different compartments, from meteorology to hydrological conditions to hydro-morphological processes to impacts on assets and environment. In addition, we address the question of what measures are possible to generate added value to early response management.
Michał P. Michalak, Lesław Teper, Florian Wellmann, Jerzy Żaba, Krzysztof Gaidzik, Marcin Kostur, Yuriy P. Maystrenko, and Paulina Leonowicz
Solid Earth, 13, 1697–1720, https://doi.org/10.5194/se-13-1697-2022, https://doi.org/10.5194/se-13-1697-2022, 2022
Short summary
Short summary
When characterizing geological/geophysical surfaces, various geometric attributes are calculated, such as dip angle (1D) or dip direction (2D). However, the boundaries between specific values may be subjective and without optimization significance, resulting from using default color palletes. This study proposes minimizing cosine distance among within-cluster observations to detect 3D anomalies. Our results suggest that the method holds promise for identification of megacylinders or megacones.
Ralf Loritz, Maoya Bassiouni, Anke Hildebrandt, Sibylle K. Hassler, and Erwin Zehe
Hydrol. Earth Syst. Sci., 26, 4757–4771, https://doi.org/10.5194/hess-26-4757-2022, https://doi.org/10.5194/hess-26-4757-2022, 2022
Short summary
Short summary
In this study, we combine a deep-learning approach that predicts sap flow with a hydrological model to improve soil moisture and transpiration estimates at the catchment scale. Our results highlight that hybrid-model approaches, combining machine learning with physically based models, are a promising way to improve our ability to make hydrological predictions.
Mirko Mälicke
Geosci. Model Dev., 15, 2505–2532, https://doi.org/10.5194/gmd-15-2505-2022, https://doi.org/10.5194/gmd-15-2505-2022, 2022
Short summary
Short summary
I preset SciKit-GStat, a well-documented and tested Python package for variogram estimation. The variogram is the core means of geostatistics, which almost all other methods rely on. Geostatistical interpolation and field generation are widely spread in geoscience, i.e., for data assimilation or modeling.
While SciKit-GStat focuses on effective and intuitive variogram estimation, it can interface with other prominent packages and make its variograms available for a multitude of methods.
Alexander Sternagel, Ralf Loritz, Brian Berkowitz, and Erwin Zehe
Hydrol. Earth Syst. Sci., 26, 1615–1629, https://doi.org/10.5194/hess-26-1615-2022, https://doi.org/10.5194/hess-26-1615-2022, 2022
Short summary
Short summary
We present a (physically based) Lagrangian approach to simulate diffusive mixing processes on the pore scale beyond perfectly mixed conditions. Results show the feasibility of the approach for reproducing measured mixing times and concentrations of isotopes over pore sizes and that typical shapes of breakthrough curves (normally associated with non-uniform transport in heterogeneous soils) may also occur as a result of imperfect subscale mixing in a macroscopically homogeneous soil matrix.
Erwin Zehe, Ralf Loritz, Yaniv Edery, and Brian Berkowitz
Hydrol. Earth Syst. Sci., 25, 5337–5353, https://doi.org/10.5194/hess-25-5337-2021, https://doi.org/10.5194/hess-25-5337-2021, 2021
Short summary
Short summary
This study uses the concepts of entropy and work to quantify and explain the emergence of preferential flow and transport in heterogeneous saturated porous media. We found that the downstream concentration of solutes in preferential pathways implies a downstream declining entropy in the transverse distribution of solute transport pathways. Preferential flow patterns with lower entropies emerged within media of higher heterogeneity – a stronger self-organization despite a higher randomness.
Alexander Schaaf, Miguel de la Varga, Florian Wellmann, and Clare E. Bond
Geosci. Model Dev., 14, 3899–3913, https://doi.org/10.5194/gmd-14-3899-2021, https://doi.org/10.5194/gmd-14-3899-2021, 2021
Short summary
Short summary
Uncertainty is an inherent property of any model of the subsurface. We show how geological topology information – how different regions of rocks in the subsurface are connected – can be used to train uncertain geological models to reduce uncertainty. More widely, the method demonstrates the use of probabilistic machine learning (Bayesian inference) to train structural geological models on auxiliary geological knowledge that can be encoded in graph structures.
Alexander Sternagel, Ralf Loritz, Julian Klaus, Brian Berkowitz, and Erwin Zehe
Hydrol. Earth Syst. Sci., 25, 1483–1508, https://doi.org/10.5194/hess-25-1483-2021, https://doi.org/10.5194/hess-25-1483-2021, 2021
Short summary
Short summary
The key innovation of the study is a method to simulate reactive solute transport in the vadose zone within a Lagrangian framework. We extend the LAST-Model with a method to account for non-linear sorption and first-order degradation processes during unsaturated transport of reactive substances in the matrix and macropores. Model evaluations using bromide and pesticide data from irrigation experiments under different flow conditions on various timescales show the feasibility of the method.
Elnaz Azmi, Uwe Ehret, Steven V. Weijs, Benjamin L. Ruddell, and Rui A. P. Perdigão
Hydrol. Earth Syst. Sci., 25, 1103–1115, https://doi.org/10.5194/hess-25-1103-2021, https://doi.org/10.5194/hess-25-1103-2021, 2021
Short summary
Short summary
Computer models should be as simple as possible but not simpler. Simplicity refers to the length of the model and the effort it takes the model to generate its output. Here we present a practical technique for measuring the latter by the number of memory visits during model execution by
Strace, a troubleshooting and monitoring program. The advantage of this approach is that it can be applied to any computer-based model, which facilitates model intercomparison.
Ralf Loritz, Markus Hrachowitz, Malte Neuper, and Erwin Zehe
Hydrol. Earth Syst. Sci., 25, 147–167, https://doi.org/10.5194/hess-25-147-2021, https://doi.org/10.5194/hess-25-147-2021, 2021
Short summary
Short summary
This study investigates the role and value of distributed rainfall in the runoff generation of a mesoscale catchment. We compare the performance of different hydrological models at different periods and show that a distributed model driven by distributed rainfall yields improved performances only during certain periods. We then step beyond this finding and develop a spatially adaptive model that is capable of dynamically adjusting its spatial model structure in time.
Uwe Ehret, Rik van Pruijssen, Marina Bortoli, Ralf Loritz, Elnaz Azmi, and Erwin Zehe
Hydrol. Earth Syst. Sci., 24, 4389–4411, https://doi.org/10.5194/hess-24-4389-2020, https://doi.org/10.5194/hess-24-4389-2020, 2020
Short summary
Short summary
In this paper we propose adaptive clustering as a new method for reducing the computational efforts of distributed modelling. It consists of identifying similar-acting model elements during the runtime, clustering them, running the model for just a few representatives per cluster, and mapping their results to the remaining model elements in the cluster. With the example of a hydrological model, we show that this saves considerable computation time, while largely maintaining the output quality.
Cited articles
Allard, D., Comunian, A., and Renard, P.: Probability aggregation methods in
geoscience, Math. Geosci., 44, 545–581, https://doi.org/10.1007/s11004-012-9396-3, 2012.
Bárdossy, A.: Copula-based geostatistical models for groundwater quality
parameters, Water Resour. Res., 42, 1–12, https://doi.org/10.1029/2005WR004754, 2006.
Batty, M.: Spatial Entropy, Geogr. Anal., 6, 1–31,
https://doi.org/10.1111/j.1538-4632.1974.tb01014.x, 1974.
Bell, G., Hey, T., and Szalay, A.: Computer science: Beyond the data deluge,
Science, 323, 1297–1298, https://doi.org/10.1126/science.1170411, 2009.
Bianchi, M. and Pedretti, D.: An entrogram-based approach to describe spatial heterogeneity with applications to solute transport in porous media, Water Resour. Res., 54, 4432–4448, https://doi.org/10.1029/2018WR022827, 2018.
Branch, M. A., Coleman, T. F., and Li, Y.: A subspace, interior, and conjugate gradient method for large-scale bound-constrained minimization
problems, SIAM J. Sci. Comput., 21, 1–23, https://doi.org/10.1137/S1064827595289108,
1999.
Brunsell, N. A.: A multiscale information theory approach to assess spatial-temporal variability of daily precipitation, J. Hydrol., 385, 165–172, https://doi.org/10.1016/j.jhydrol.2010.02.016, 2010.
Chapman, T. G.: Entropy as a measure of hydrologic data uncertainty and model performance, J. Hydrol., 85, 111–126, https://doi.org/10.1016/0022-1694(86)90079-X, 1986.
Chicco, D.: Ten quick tips for machine learning in computational biology,
BioData Min., 10, 1–17, https://doi.org/10.1186/s13040-017-0155-3, 2017.
Cover, T. M. and Thomas, J. A.: Elements of information theory, 2nd Edn.,
John Wiley & Sons, New Jersey, USA, 2006.
Darscheid, P.: Quantitative analysis of information flow in hydrological
modelling using Shannon information measures, Karlsruhe Institute of
Technology, Karlsruhe, 73 pp., 2017.
Darscheid, P., Guthke, A., and Ehret, U.: A maximum-entropy method to estimate discrete distributions from samples ensuring nonzero probabilities,
Entropy, 20, 601, https://doi.org/10.3390/e20080601, 2018.
Fix, E. and Hodges Jr., J. L.: Discriminatory analysis, non-parametric
discrimination, Project 21-49-004, Report 4, USA School of Aviation Medicine, Texas, https://doi.org/10.2307/1403797, 1951.
Gneiting, T. and Raftery, A. E.: Strictly proper scoring rules, prediction,
and estimation, J. Am. Stat. Assoc., 102, 359–378, https://doi.org/10.1198/016214506000001437, 2007.
Gong, W., Yang, D., Gupta, H. V., and Nearing, G.: Estimating information
entropy for hydrological data: one dimensional case, Water Resour. Res., 1,
5003–5018, https://doi.org/10.1002/2014WR015874, 2014.
Good, I. J.: Rational decisions, J. Roy. Stat. Soc., 14, 107–114, 1952.
Goovaerts, P.: Geostatistics for natural resources evaluation, Oxford Univers., New York, 1997.
Hristopulos, D. T. and Baxevani, A.: Effective probability distribution
approximation for the reconstruction of missing data, Stoch. Environ. Res.
Risk A., 34, 235–249, https://doi.org/10.1007/s00477-020-01765-5, 2020.
Journel, A. G.: Nonparametric estimation of spatial distributions, J. Int.
Assoc. Math. Geol., 15, 445–468, https://doi.org/10.1007/BF01031292, 1983.
Journel, A. G.: Combining knowledge from diverse sources: an alternative to
traditional data independence hypotheses, Math. Geol., 34, 573–596,
https://doi.org/10.1023/A:1016047012594, 2002.
Journel, A. G. and Huijbregts, C. J.: Mining geostatistics, Academic Press, London, UK, ISBN 0-12-391050-1, 1978.
Kazianka, H. and Pilz, J.: Spatial Interpolation Using Copula-Based
Geostatistical Models, in: geoENV VII – Geostatistics for Environmental
Applications, Springer, Berlin, 307–319, https://doi.org/10.1007/978-90-481-2322-3_27, 2010.
Kitanidis, P. K.: Introduction to geostatistics: applications in hydrogeology, Cambridge University Press, Cambridge, UK, 1997.
Knuth, K. H.: Optimal data-based binning for histograms, online preprint: arXiv:physics/0605197v2 [physics.data-an], 2013.
Krige, D. G.: A statistical approach to some mine valuation and allied problems on the Witwatersrand, Master's thesis, University of Witwatersrand, Witwatersrand, 1951.
Krishnan, S.: The tau model for data redundancy and information combination in earth sciences: theory and application, Math. Geosci., 40, 705–727,
https://doi.org/10.1007/s11004-008-9165-5, 2008.
Leopold, L. B. and Langbein, W. B.: The concept of entropy in landscape
evolution, US Geol. Surv. Prof. Pap. 500-A, US Geological Survey, Washington, 1962.
Li, J. and Heap, A. D.: A review of spatial interpolation methods for
environmental scientists, 2008/23, Geosci. Aust., Canberra, 137 pp., 2008.
Li, J. and Heap, A. D.: A review of comparative studies of spatial interpolation methods in environmental sciences: Performance and impact factors, Ecol. Inform., 6, 228–241, https://doi.org/10.1016/j.ecoinf.2010.12.003, 2011.
Li, J. and Heap, A. D.: Spatial interpolation methods applied in the
environmental sciences: A review, Environ. Model. Softw., 53, 173–189,
https://doi.org/10.1016/j.envsoft.2013.12.008, 2014.
Liu, D., Wang, D., Wang, Y., Wu, J., Singh, V. P., Zeng, X., Wang, L., Chen,
Y., Chen, X., Zhang, L., and Gu, S.: Entropy of hydrological systems under
small samples: uncertainty and variability, J. Hydrol., 532, 163–176, https://doi.org/10.1016/j.jhydrol.2015.11.019, 2016.
Loritz, R., Gupta, H., Jackisch, C., Westhoff, M., Kleidon, A., Ehret, U., and Zehe, E.: On the dynamic nature of hydrological similarity, Hydrol. Earth Syst. Sci., 22, 3663–3684, https://doi.org/10.5194/hess-22-3663-2018, 2018.
Loritz, R., Kleidon, A., Jackisch, C., Westhoff, M., Ehret, U., Gupta, H., and Zehe, E.: A topographic index explaining hydrological similarity by accounting for the joint controls of runoff formation, Hydrol. Earth Syst. Sci., 23, 3807–3821, https://doi.org/10.5194/hess-23-3807-2019, 2019.
Mälicke, M. and Schneider, H. D. Scikit-GStat 0.2.6: A scipy flavored
geostatistical analysis toolbox written in Python (Version v0.2.6), Zenodo,
https://doi.org/10.5281/zenodo.3531816, 2019.
Mälicke, M., Hassler, S. K., Blume, T., Weiler, M., and Zehe, E.: Soil moisture: variable in space but redundant in time, Hydrol. Earth Syst. Sci., 24, 2633–2653, https://doi.org/10.5194/hess-24-2633-2020, 2020.
Manchuk, J. G. and Deutsch, C. V.: Robust solution of normal (kriging)
equations, available at: http://www.ccgalberta.com (last access: 10 September 2020), 2007.
Mishra, A. K., Özger, M., and Singh, V. P.: An entropy-based investigation into the variability of precipitation, J. Hydrol., 370, 139–154, https://doi.org/10.1016/j.jhydrol.2009.03.006, 2009.
Myers, D. E.: Spatial interpolation: an overview, Geoderma, 62, 17–28, https://doi.org/10.1016/0016-7061(94)90025-6, 1993.
Naimi, B.: On uncertainty in species distribution modelling, Doctoral
thesis, University of Twente, Twente, 2015.
Nearing, G. S. and Gupta, H. V.: Information vs. Uncertainty as the Foundation for a Science of Environmental Modeling, available at: http://arxiv.org/abs/1704.07512 (last access: 10 September 2020), 2017.
Oliver, M. A. and Webster, R.: A tutorial guide to geostatistics: Computing
and modelling variograms and kriging, Catena, 113, 56–69,
https://doi.org/10.1016/j.catena.2013.09.006, 2014.
Pechlivanidis, I. G., Jackson, B., Mcmillan, H., and Gupta, H. V.: Robust
informational entropy-based descriptors of flow in catchment hydrology, Hydrolog. Sci. J., 61, 1–18, https://doi.org/10.1080/02626667.2014.983516, 2016.
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Blondel, M., Thirion, B., Grisel, O., Prettenhofer, P., Weiss, R., Dubourg, V., Vanderplas, J., Passos, A., Cournapeau, D., Brucher, M., Perrot, M., and Duchesnay, É.: Scikit-learn: Machine Learning in Python, J. Mach. Learn. Res., 12, 2825–2830, 2011.
Pham, T. D.: GeoEntropy: A measure of complexity and similarity, Pattern
Recognit., 43, 887–896, https://doi.org/10.1016/j.patcog.2009.08.015, 2010.
Putter, H. and Young, G. A.: On the effect of covariance function estimation
on the accuracy of kriging predictors, Bernoulli, 7, 421–438, 2001.
Rasmussen, C. E. and Williams, C. K. I.: Gaussian processes for machine
learning, MIT Press, London, 2006.
Roodposhti, M. S., Aryal, J., Shahabi, H., and Safarrad, T.: Fuzzy Shannon
entropy: a hybrid GIS-based landslide susceptibility mapping method, Entropy, 18, 343, https://doi.org/10.3390/e18100343, 2016.
Roulston, M. S. and Smith, L. A.: Evaluating probabilistic forecasts using
information theory, Mon. Weather Rev., 130, 1653–1660,
https://doi.org/10.1175/1520-0493(2002)130<1653:EPFUIT>2.0.CO;2,
2002.
Ruddell, B. L. and Kumar, P.: Ecohydrologic process net- works: 1. Identification, Water Resour. Res., 45, 1–23, https://doi.org/10.1029/2008WR007279, 2009.
Scott, D. W.: Scott bin width, Biometrika, 66, 605–610,
https://doi.org/10.1093/biomet/66.3.605, 1979.
Shannon, C. E.: A mathematical theory of communication, Bell Syst. Tech. J.,
27, 379–423, 623–656, 1948.
Shepard, D.: A two-dimensional interpolation function for irregularly-spaced
data, in: Proceedings of the 1968 23rd ACM National Conference, 27–29 August 1968, New York, 517–524, 1968.
Singh, V. P.: Entropy theory and its application in environmental and water engineering, 1st Edn., John Wiley & Sons, West Sussex, UK, ISBN 978-1-119-97656-1, 2013.
Solomatine, D. P. and Ostfeld, A.: Data-driven modelling: some past experiences and new approaches, J. Hydroinform., 10, 3–22,
https://doi.org/10.2166/hydro.2008.015, 2008.
Tarantola, A.: Inverse problem theory and methods for model parameter
estimation, Siam, Philadelphia, 2005.
Tarantola, A. and Valette, B.: Inverse problems = quest for information,
J. Geophys., 50, 159–170, 1982.
Thiesen, S., Darscheid, P., and Ehret, U.: Identifying rainfall-runoff events in discharge time series: A data-driven method based on Information Theory, Hydrol. Earth Syst. Sci., 23, 1015–1034, https://doi.org/10.5194/hess-23-1015-2019, 2019.
Thiesen, S., Vieira, D. M., and Ehret, U.: KIT-HYD/HER: version v1.4), Zenodo, https://doi.org/10.5281/zenodo.3614718, 2020.
Weijs, S. V.: Information theory for risk-based water system operation, Technische Universiteit Delft, Delft, 210 pp., 2011.
Weijs, S. V., van Nooijen, R., and van de Giesen, N.: Kullback–Leibler
divergence as a forecast skill score with classic reliability–resolution–uncertainty decomposition, Mon. Weather Rev., 138, 3387–3399, https://doi.org/10.1175/2010mwr3229.1, 2010.
Wellmann, J. F.: Information theory for correlation analysis and estimation of uncertainty reduction in maps and models, Entropy, 15, 1464–1485,
https://doi.org/10.3390/e15041464, 2013.
Yakowitz, S. J. and Szidarovszky, F.: A comparison of kriging with nonparametric regression methods, J. Multivar. Anal., 16, 21–53, 1985.
Short summary
A spatial interpolator has been proposed for exploring the information content of the data in the light of geostatistics and information theory. It showed comparable results to traditional interpolators, with the advantage of presenting generalization properties. We discussed three different ways of combining distributions and their implications for the probabilistic results. By its construction, the method provides a suitable and flexible framework for uncertainty analysis and decision-making.
A spatial interpolator has been proposed for exploring the information content of the data in...
