Articles | Volume 25, issue 4
https://doi.org/10.5194/hess-25-2187-2021
© Author(s) 2021. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
https://doi.org/10.5194/hess-25-2187-2021
© Author(s) 2021. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Technical note: Diagnostic efficiency – specific evaluation of model performance
Robin Schwemmle
CORRESPONDING AUTHOR
University of Freiburg, Faculty of Environment and Natural Resources,
Chair of Hydrology, Freiburg, Germany
Dominic Demand
University of Freiburg, Faculty of Environment and Natural Resources,
Chair of Hydrology, Freiburg, Germany
Markus Weiler
University of Freiburg, Faculty of Environment and Natural Resources,
Chair of Hydrology, Freiburg, Germany
Related authors
Robin Schwemmle, Hannes Leistert, Andreas Steinbrich, and Markus Weiler
Geosci. Model Dev., 17, 5249–5262, https://doi.org/10.5194/gmd-17-5249-2024, https://doi.org/10.5194/gmd-17-5249-2024, 2024
Short summary
Short summary
The new process-based hydrological toolbox model, RoGeR (https://roger.readthedocs.io/), can be used to estimate the components of the hydrological cycle and the related travel times of pollutants through parts of the hydrological cycle. These estimations may contribute to effective water resources management. This paper presents the toolbox concept and provides a simple example of providing estimations to water resources management.
Jonas Pyschik and Markus Weiler
EGUsphere, https://doi.org/10.5194/egusphere-2025-2411, https://doi.org/10.5194/egusphere-2025-2411, 2025
Short summary
Short summary
This study introduces a new method of detecting how water moves quickly through certain paths in soil, bypassing the usual, slower flow. By analysing natural water markers in soil samples taken at different depths, we identified unusual flow patterns. Our method is simple and non-invasive, and can be used to cover large areas. This helps us to better understand how water travels through the ground, which is important for managing water resources and protecting the environment.
Heinke Paulsen and Markus Weiler
Hydrol. Earth Syst. Sci., 29, 2309–2319, https://doi.org/10.5194/hess-29-2309-2025, https://doi.org/10.5194/hess-29-2309-2025, 2025
Short summary
Short summary
This technical note describes the development of a weighing forest floor grid lysimeter. The device is needed to investigate the dynamics of the water balance components of the organic layer in forests, quantifying precipitation, drainage, evaporation, and storage. We designed a setup that can be easily rebuilt and that is cost-effective, which allows for customized applications. Performance metrics from laboratory results and initial field data are presented.
Markus Weiler, Julia Krumm, Ingo Haag, Hannes Leistert, Max Schmit, Andreas Steinbrich, and Andreas Hänsler
EGUsphere, https://doi.org/10.5194/egusphere-2025-1519, https://doi.org/10.5194/egusphere-2025-1519, 2025
Short summary
Short summary
Pluvial (flash) floods, caused by intense local rainfall, result in surface runoff and overland flow, making them different from fluvial floods. A new Pluvial Flood Index (PFI) combines precipitation, hydrological, and hydrodynamic processes to assess surface flooding hazards. The PFI, based on flood hazard areas, helps forecast flash floods and supports real-time warning systems, aiding municipal decision-making, preparedness, and planning.
Jonas Pyschik, Stefan Seeger, Barbara Herbstritt, and Markus Weiler
Hydrol. Earth Syst. Sci., 29, 525–534, https://doi.org/10.5194/hess-29-525-2025, https://doi.org/10.5194/hess-29-525-2025, 2025
Short summary
Short summary
We developed a device (named VapAuSa) that automates stable water isotope analysis. Stable water isotopes are a natural tracer that many researchers use to investigate water (re-)distribution processes in environmental systems. VapAuSa helps to analyse such environmental samples by automating a formerly tedious manual process, allowing for higher sample throughput. This enables larger sampling campaigns, as more samples can be processed before reaching their limited storage time.
Robin Schwemmle, Hannes Leistert, Andreas Steinbrich, and Markus Weiler
Geosci. Model Dev., 17, 5249–5262, https://doi.org/10.5194/gmd-17-5249-2024, https://doi.org/10.5194/gmd-17-5249-2024, 2024
Short summary
Short summary
The new process-based hydrological toolbox model, RoGeR (https://roger.readthedocs.io/), can be used to estimate the components of the hydrological cycle and the related travel times of pollutants through parts of the hydrological cycle. These estimations may contribute to effective water resources management. This paper presents the toolbox concept and provides a simple example of providing estimations to water resources management.
Barbara Herbstritt, Benjamin Gralher, Stefan Seeger, Michael Rinderer, and Markus Weiler
Hydrol. Earth Syst. Sci., 27, 3701–3718, https://doi.org/10.5194/hess-27-3701-2023, https://doi.org/10.5194/hess-27-3701-2023, 2023
Short summary
Short summary
We present a method to collect water vapor samples into bags in the field without an in-field analyser, followed by isotope analysis in the lab. This new method resolves even fine-scaled natural isotope variations. It combines low-cost and lightweight components for maximum spatial and temporal flexibility regarding environmental setups. Hence, it allows for sampling even in terrains that are rather difficult to access, enabling future extended isotope datasets in soil sciences and ecohydrology.
Stefan Seeger and Markus Weiler
Hydrol. Earth Syst. Sci., 27, 3393–3404, https://doi.org/10.5194/hess-27-3393-2023, https://doi.org/10.5194/hess-27-3393-2023, 2023
Short summary
Short summary
This study proposes a low-budget method to quantify the radial distribution of water transport velocities within trees at a high spatial resolution. We observed a wide spread of water transport velocities within a tree stem section, which were on average 3 times faster than the flux velocity. The distribution of transport velocities has implications for studies that use water isotopic signatures to study root water uptake and usually assume uniform or even implicitly infinite velocities.
Andreas Hänsler and Markus Weiler
Hydrol. Earth Syst. Sci., 26, 5069–5084, https://doi.org/10.5194/hess-26-5069-2022, https://doi.org/10.5194/hess-26-5069-2022, 2022
Short summary
Short summary
Spatially explicit quantification of design storms is essential for flood risk assessment and planning. However, available datasets are mainly based on spatially interpolated station-based design storms. Since the spatial interpolation of the data inherits a large potential for uncertainty, we develop an approach to be able to derive spatially explicit design storms on the basis of weather radar data. We find that our approach leads to an improved spatial representation of design storms.
Anne Hartmann, Markus Weiler, Konrad Greinwald, and Theresa Blume
Hydrol. Earth Syst. Sci., 26, 4953–4974, https://doi.org/10.5194/hess-26-4953-2022, https://doi.org/10.5194/hess-26-4953-2022, 2022
Short summary
Short summary
Analyzing the impact of soil age and rainfall intensity on vertical subsurface flow paths in calcareous soils, with a special focus on preferential flow occurrence, shows how water flow paths are linked to the organization of evolving landscapes. The observed increase in preferential flow occurrence with increasing moraine age provides important but rare data for a proper representation of hydrological processes within the feedback cycle of the hydro-pedo-geomorphological system.
Nils Hinrich Kaplan, Theresa Blume, and Markus Weiler
Hydrol. Earth Syst. Sci., 26, 2671–2696, https://doi.org/10.5194/hess-26-2671-2022, https://doi.org/10.5194/hess-26-2671-2022, 2022
Short summary
Short summary
This study is analyses how characteristics of precipitation events and soil moisture and temperature dynamics during these events can be used to model the associated streamflow responses in intermittent streams. The models are used to identify differences between the dominant controls of streamflow intermittency in three distinct geologies of the Attert catchment, Luxembourg. Overall, soil moisture was found to be the most important control of intermittent streamflow in all geologies.
Benjamin Gralher, Barbara Herbstritt, and Markus Weiler
Hydrol. Earth Syst. Sci., 25, 5219–5235, https://doi.org/10.5194/hess-25-5219-2021, https://doi.org/10.5194/hess-25-5219-2021, 2021
Short summary
Short summary
We scrutinized the quickest currently available method for stable isotope analysis of matrix-bound water. Simulating common procedures, we demonstrated the limits of certain materials currently used and identified a reliable and cost-efficient alternative. Further, we calculated the optimum proportions of important protocol aspects critical for precise and accurate analyses. Our unifying protocol suggestions increase data quality and comparability as well as the method's general applicability.
Jan Greiwe, Markus Weiler, and Jens Lange
Biogeosciences, 18, 4705–4715, https://doi.org/10.5194/bg-18-4705-2021, https://doi.org/10.5194/bg-18-4705-2021, 2021
Short summary
Short summary
We analyzed variability in diel nitrate patterns at three locations in a lowland stream. Comparison of time lags between monitoring sites with water travel time indicated that diel patterns were created by in-stream processes rather than transported downstream from an upstream point of origin. Most of the patterns (70 %) could be explained by assimilatory nitrate uptake. The remaining patterns suggest seasonally varying dominance and synchronicity of different biochemical processes.
Stefan Seeger and Markus Weiler
Biogeosciences, 18, 4603–4627, https://doi.org/10.5194/bg-18-4603-2021, https://doi.org/10.5194/bg-18-4603-2021, 2021
Short summary
Short summary
We developed a setup for fully automated in situ measurements of stable water isotopes in soil and the stems of fully grown trees. We used this setup in a 12-week field campaign to monitor the propagation of a labelling pulse from the soil up to a stem height of 8 m.
We could observe trees shifting their main water uptake depths multiple times, depending on water availability.
The gained knowledge about the temporal dynamics can help to improve water uptake models and future study designs.
Andreas Hänsler and Markus Weiler
Hydrol. Earth Syst. Sci. Discuss., https://doi.org/10.5194/hess-2021-366, https://doi.org/10.5194/hess-2021-366, 2021
Manuscript not accepted for further review
Short summary
Short summary
Spatially explicit quantification on design storms are essential for flood risk assessment. However this information can be only achieved from substantially long records of rainfall measurements, usually only available for a few stations. Hence, design storms estimates from these few stations are then spatially interpolated leading to a major source of uncertainty. Therefore we defined a methodology to extend spatially explicit weather radar data to be used for the estimation of design storms.
Anne Hartmann, Markus Weiler, Konrad Greinwald, and Theresa Blume
Hydrol. Earth Syst. Sci. Discuss., https://doi.org/10.5194/hess-2021-242, https://doi.org/10.5194/hess-2021-242, 2021
Manuscript not accepted for further review
Short summary
Short summary
Our field observation-based examination of flow path evolution, soil formation and vegetation succession across ten millennia on calcareous parent material shows how water flow paths and subsurface water storage are linked to the organization of evolving landscapes. We provide important but rare data and observations for a proper handling of hydrologic processes and their role within the feedback cycle of the hydro-pedo-geomorphological system.
Axel Schaffitel, Tobias Schuetz, and Markus Weiler
Geosci. Model Dev., 14, 2127–2142, https://doi.org/10.5194/gmd-14-2127-2021, https://doi.org/10.5194/gmd-14-2127-2021, 2021
Short summary
Short summary
This paper presents FluSM, an algorithm to derive the water balance from soil moisture and metrological measurements. This data-driven water balance framework uses soil moisture as an input and therefore is applicable for cases with unclear processes and lacking parameters. In a case study, we apply FluSM to derive the water balance of 15 different permeable pavements under field conditions. These findings are of special interest for urban hydrology.
Michael Rinderer, Jaane Krüger, Friederike Lang, Heike Puhlmann, and Markus Weiler
Biogeosciences, 18, 1009–1027, https://doi.org/10.5194/bg-18-1009-2021, https://doi.org/10.5194/bg-18-1009-2021, 2021
Short summary
Short summary
We quantified the lateral and vertical subsurface flow (SSF) and P concentrations of three beech forest plots with contrasting soil properties during sprinkling experiments. Vertical SSF was 2 orders of magnitude larger than lateral SSF, and both consisted mainly of pre-event water. P concentrations in SSF were high during the first 1 to 2 h (nutrient flushing) but nearly constant thereafter. This suggests that P in the soil solution was replenished fast by mineral or organic sources.
Merle Koelbing, Tobias Schuetz, and Markus Weiler
Hydrol. Earth Syst. Sci. Discuss., https://doi.org/10.5194/hess-2021-24, https://doi.org/10.5194/hess-2021-24, 2021
Revised manuscript not accepted
Short summary
Short summary
Based on a unique and comprehensive data set of urban micro-meteorological variables, which were observed with a mobile climate station, we developed a new method to transfer mesoscale reference potential evapotranspiration to the urban microscale in street canyons. Our findings can be transferred easily to existing urban hydrologic models to improve modelling results with a more precise estimate of potential evapotranspiration on street level.
Anne Hartmann, Markus Weiler, and Theresa Blume
Earth Syst. Sci. Data, 12, 3189–3204, https://doi.org/10.5194/essd-12-3189-2020, https://doi.org/10.5194/essd-12-3189-2020, 2020
Short summary
Short summary
Our analysis of soil physical and hydraulic properties across two soil chronosequences of 10 millennia in the Swiss Alps provides important observation of the evolution of soil hydraulic behavior. A strong co-evolution of soil physical and hydraulic properties was revealed by the observed change of fast-draining coarse-textured soils to slow-draining soils with a high water-holding capacity in correlation with a distinct change in structural properties and organic matter content.
Daniel Beiter, Markus Weiler, and Theresa Blume
Hydrol. Earth Syst. Sci., 24, 5713–5744, https://doi.org/10.5194/hess-24-5713-2020, https://doi.org/10.5194/hess-24-5713-2020, 2020
Short summary
Short summary
We investigated the interactions between streams and their adjacent hillslopes in terms of water flow. It could be revealed that soil structure has a strong influence on how hillslopes connect to the streams, while the groundwater table tells us a lot about when the two connect. This observation could be used to improve models that try to predict whether or not hillslopes are in a state where a rain event will be likely to produce a flood in the stream.
Maria Staudinger, Stefan Seeger, Barbara Herbstritt, Michael Stoelzle, Jan Seibert, Kerstin Stahl, and Markus Weiler
Earth Syst. Sci. Data, 12, 3057–3066, https://doi.org/10.5194/essd-12-3057-2020, https://doi.org/10.5194/essd-12-3057-2020, 2020
Short summary
Short summary
The data set CH-IRP provides isotope composition in precipitation and streamflow from 23 Swiss catchments, being unique regarding its long-term multi-catchment coverage along an alpine–pre-alpine gradient. CH-IRP contains fortnightly time series of stable water isotopes from streamflow grab samples complemented by time series in precipitation. Sampling conditions, catchment and climate information, lab standards and errors are provided together with areal precipitation and catchment boundaries.
Nils Hinrich Kaplan, Theresa Blume, and Markus Weiler
Hydrol. Earth Syst. Sci., 24, 5453–5472, https://doi.org/10.5194/hess-24-5453-2020, https://doi.org/10.5194/hess-24-5453-2020, 2020
Short summary
Short summary
In recent decades the demand for detailed information of spatial and temporal dynamics of the stream network has grown in the fields of eco-hydrology and extreme flow prediction. We use temporal streamflow intermittency data obtained at various sites using innovative sensing technology as well as spatial predictors to predict and map probabilities of streamflow intermittency. This approach has the potential to provide intermittency maps for hydrological modelling and management practices.
Michael Stoelzle, Maria Staudinger, Kerstin Stahl, and Markus Weiler
Proc. IAHS, 383, 43–50, https://doi.org/10.5194/piahs-383-43-2020, https://doi.org/10.5194/piahs-383-43-2020, 2020
Short summary
Short summary
The role of recharge and catchment storage is crucial to understand streamflow drought sensitivity. Here we introduce a model experiment with recharge stress tests as complement to climate scenarios to quantify the streamflow drought sensitivities of catchments in Switzerland. We identified a pre-drought period of 12 months as maximum storage-memory for the study catchments. From stress testing, we found up to 200 days longer summer streamflow droughts and minimum flow reductions of 50 %–80 %.
Cited articles
Addor, N., Newman, A. J., Mizukami, N., and Clark, M. P.: The CAMELS data
set: catchment attributes and meteorology for large-sample studies, in:
version 2.0 ed., UCAR/NCAR, Boulder, CO, 2017.
Beck, H. E., van Dijk, A. I. J. M., de Roo, A., Dutra, E., Fink, G., Orth,
R., and Schellekens, J.: Global evaluation of runoff from 10 state-of-the-art hydrological models, Hydrol. Earth Syst. Sci., 21, 2881–2903, https://doi.org/10.5194/hess-21-2881-2017, 2017.
Clark, M. P., Slater, A. G., Rupp, D. E., Woods, R. A., Vrugt, J. A., Gupta,
H. V., Wagener, T., and Hay, L. E.: Framework for Understanding Structural
Errors (FUSE): A modular framework to diagnose differences between hydrological models, Water Resour. Res., 44, W00B02, https://doi.org/10.1029/2007wr006735, 2008.
Clark, M. P., Kavetski, D., and Fenicia, F.: Pursuing the method of multiple
working hypotheses for hydrological modeling, Water Resour. Res., 47,
W09301, https://doi.org/10.1029/2010wr009827, 2011.
Coxon, G., Freer, J., Westerberg, I. K., Wagener, T., Woods, R., and Smith,
P. J.: A novel framework for discharge uncertainty quantification applied to
500 UK gauging stations, Water Resour. Res., 51, 5531–5546,
https://doi.org/10.1002/2014wr016532, 2015.
Fowler, K., Peel, M., Western, A., and Zhang, L.: Improved Rainfall-Runoff
Calibration for Drying Climate: Choice of Objective Function, Water Resour. Res., 54, 3392–3408, https://doi.org/10.1029/2017wr022466, 2018.
Ghotbi, S., Wang, D., Singh, A., Blöschl, G., and Sivapalan, M.: A New
Framework for Exploring Process Controls of Flow Duration Curves, Water
Resour. Res., 56, e2019WR026083, https://doi.org/10.1029/2019WR026083, 2020.
Grundmann, J., Hörning, S., and Bárdossy, A.: Stochastic reconstruction of spatio-temporal rainfall patterns by inverse hydrologic
modelling, Hydrol. Earth Syst. Sci., 23, 225–237, https://doi.org/10.5194/hess-23-225-2019, 2019.
Gupta, H. V., Wagener, T., and Liu, Y.: Reconciling theory with observations: elements of a diagnostic approach to model evaluation, Hydrol. Process., 22, 3802–3813, https://doi.org/10.1002/hyp.6989, 2008.
Gupta, H. V., Kling, H., Yilmaz, K. K., and Martinez, G. F.: Decomposition
of the mean squared error and NSE performance criteria: Implications for
improving hydrological modelling, J. Hydrology, 377, 80–91,
https://doi.org/10.1016/j.jhydrol.2009.08.003, 2009.
Hirpa, F. A., Salamon, P., Beck, H. E., Lorini, V., Alfieri, L., Zsoter, E.,
and Dadson, S. J.: Calibration of the Global Flood Awareness System (GloFAS)
using daily streamflow data, J. Hydrol., 566, 595–606,
https://doi.org/10.1016/j.jhydrol.2018.09.052, 2018.
Knoben, W. J. M., Freer, J. E., and Woods, R. A.: Technical note: Inherent
benchmark or not? Comparing Nash–Sutcliffe and Kling–Gupta efficiency
scores, Hydrol. Earth Syst. Sci., 23, 4323–4331, https://doi.org/10.5194/hess-23-4323-2019, 2019.
Mizukami, N., Rakovec, O., Newman, A. J., Clark, M. P., Wood, A. W., Gupta,
H. V., and Kumar, R.: On the choice of calibration metrics for “high-flow”
estimation using hydrologic models, Hydrol. Earth Syst. Sci., 23, 2601–2614,
https://doi.org/10.5194/hess-23-2601-2019, 2019.
Nash, J. E. and Sutcliffe, J. V.: River flow forecasting through conceptual
models part I – A discussion of principles, J. Hydrol., 10, 282–290, https://doi.org/10.1016/0022-1694(70)90255-6, 1970.
Newman, A., Sampson, K., Clark, M. P., Bock, A., Viger, R. J., and Blodgett, D.: A large-sample watershed-scale hydrometeorological dataset for the contiguous USA, UCAR/NCAR, Boulder, CO, https://doi.org/10.5065/D6MW2F4D, 2014.
Newman, A. J., Clark, M. P., Sampson, K., Wood, A., Hay, L. E., Bock, A.,
Viger, R. J., Blodgett, D., Brekke, L., Arnold, J. R., Hopson, T., and Duan,
Q.: Development of a large-sample watershed-scale hydrometeorological data
set for the contiguous USA: data set characteristics and assessment of
regional variability in hydrologic model performance, Hydrol. Earth Syst.
Sci., 19, 209–223, https://doi.org/10.5194/hess-19-209-2015, 2015.
Newman, A. J., Mizukami, N., Clark, M. P., Wood, A. W., Nijssen, B., and
Nearing, G.: Benchmarking of a Physically Based Hydrologic Model, J.
Hydrometeorol., 18, 2215–2225, https://doi.org/10.1175/jhm-d-16-0284.1, 2017.
Pechlivanidis, I., Jackson, B., and McMillan, H.: The use of entropy as a
model diagnostic in rainfall-runoff modelling, in: International Congress on
Environmental Modelling and Software, Ottawa, Canada, 2010.
Schaefli, B. and Gupta, H. V.: Do Nash values have value?, Hydrol. Process., 21, 2075–2080, https://doi.org/10.1002/hyp.6825, 2007.
Schwemmle, R.: schwemro/diag-eff, Git Hub, available at: https://github.com/schwemro/diag-eff, last access: 22 April 2021.
Schwemmle, R., Demand, D., and Weiler, M.: schwemro/diag-eff: Third release, Zenodo, https://doi.org/10.5281/zenodo.4590174, 2021.
Shafii, M., Basu, N., Craig, J. R., Schiff, S. L., and Van Cappellen, P.: A
diagnostic approach to constraining flow partitioning in hydrologic models
using a multiobjective optimization framework, Water Resour. Res., 53,
3279–3301, https://doi.org/10.1002/2016wr019736, 2017.
Staudinger, M., Stoelzle, M., Cochand, F., Seibert, J., Weiler, M., and
Hunkeler, D.: Your work is my boundary condition!: Challenges and approaches
for a closer collaboration between hydrologists and hydrogeologists, J. Hydrol., 571, 235–243, https://doi.org/10.1016/j.jhydrol.2019.01.058, 2019.
Towner, J., Cloke, H. L., Zsoter, E., Flamig, Z., Hoch, J. M., Bazo, J.,
Coughlan de Perez, E., and Stephens, E. M.: Assessing the performance of
global hydrological models for capturing peak river flows in the Amazon
basin, Hydrol. Earth Syst. Sci., 23, 3057–3080, https://doi.org/10.5194/hess-23-3057-2019, 2019.
Vogel, R. M. and Fennessey, N. M.: Flow Duration Curves. I: New Interpretation and Confidence Intervals, J. Water Resour. Plan. Manage., 120, 485–504, https://doi.org/10.1061/(ASCE)0733-9496(1994)120:4(485), 1994.
Wagener, T., and Gupta, H. V.: Model identification for hydrological
forecasting under uncertainty, Stochastic Environmental Research and Risk
Assessment, 19, 378-387, 10.1007/s00477-005-0006-5, 2005.
Yatheendradas, S., Wagener, T., Gupta, H., Unkrich, C., Goodrich, D.,
Schaffner, M., and Stewart, A.: Understanding uncertainty in distributed
flash flood forecasting for semiarid regions, Water Resour. Res., 44,
W05S19, https://doi.org/10.1029/2007wr005940, 2008.
Yilmaz, K. K., Gupta, H. V., and Wagener, T.: A process-based diagnostic
approach to model evaluation: Application to the NWS distributed hydrologic
model, Water Resources Research, 44, 10.1029/2007wr006716, 2008.
Zipper, S. C., Dallemagne, T., Gleeson, T., Boerman, T. C., and Hartmann, A.: Groundwater Pumping Impacts on Real Stream Networks: Testing the Performance of Simple Management Tools, Water Resour. Res., 54, 5471–5486, https://doi.org/10.1029/2018wr022707, 2018.
Short summary
A better understanding of the reasons why model performance is unsatisfying represents a crucial part for meaningful model evaluation. We propose the novel diagnostic efficiency (DE) measure and diagnostic polar plots. The proposed evaluation approach provides a diagnostic tool for model developers and model users and facilitates interpretation of model performance.
A better understanding of the reasons why model performance is unsatisfying represents a crucial...