Articles | Volume 28, issue 15
https://doi.org/10.5194/hess-28-3665-2024
https://doi.org/10.5194/hess-28-3665-2024
Technical note
 | 
13 Aug 2024
Technical note |  | 13 Aug 2024

Technical Note: The divide and measure nonconformity – how metrics can mislead when we evaluate on different data partitions

Daniel Klotz, Martin Gauch, Frederik Kratzert, Grey Nearing, and Jakob Zscheischler

Related authors

How to deal w___ missing input data
Martin Gauch, Frederik Kratzert, Daniel Klotz, Grey Nearing, Deborah Cohen, and Oren Gilon
EGUsphere, https://doi.org/10.5194/egusphere-2025-1224,https://doi.org/10.5194/egusphere-2025-1224, 2025
This preprint is open for discussion and under review for Hydrology and Earth System Sciences (HESS).
Short summary
Technical note: An approach for handling multiple temporal frequencies with different input dimensions using a single LSTM cell
Eduardo Acuña Espinoza, Frederik Kratzert, Daniel Klotz, Martin Gauch, Manuel Álvarez Chaves, Ralf Loritz, and Uwe Ehret
Hydrol. Earth Syst. Sci., 29, 1749–1758, https://doi.org/10.5194/hess-29-1749-2025,https://doi.org/10.5194/hess-29-1749-2025, 2025
Short summary
Analyzing the generalization capabilities of a hybrid hydrological model for extrapolation to extreme events
Eduardo Acuña Espinoza, Ralf Loritz, Frederik Kratzert, Daniel Klotz, Martin Gauch, Manuel Álvarez Chaves, and Uwe Ehret
Hydrol. Earth Syst. Sci., 29, 1277–1294, https://doi.org/10.5194/hess-29-1277-2025,https://doi.org/10.5194/hess-29-1277-2025, 2025
Short summary
Unveiling the Limits of Deep Learning Models in Hydrological Extrapolation Tasks
Sanika Baste, Daniel Klotz, Eduardo Acuña Espinoza, Andras Bardossy, and Ralf Loritz
EGUsphere, https://doi.org/10.5194/egusphere-2025-425,https://doi.org/10.5194/egusphere-2025-425, 2025
Short summary
EARLS: A runoff reconstruction dataset for Europe
Daniel Klotz, Peter Miersch, Thiago V. M. do Nascimento, Fabrizio Fenicia, Martin Gauch, and Jakob Zscheischler
Earth Syst. Sci. Data Discuss., https://doi.org/10.5194/essd-2024-450,https://doi.org/10.5194/essd-2024-450, 2025
Preprint under review for ESSD
Short summary

Related subject area

Subject: Catchment hydrology | Techniques and Approaches: Theory development
Causal relationships of vegetation productivity with root zone water availability and atmospheric dryness at the catchment scale
Guta Wakbulcho Abeshu, Hong-Yi Li, Mingjie Shi, and L. Ruby Leung
Hydrol. Earth Syst. Sci., 29, 1847–1864, https://doi.org/10.5194/hess-29-1847-2025,https://doi.org/10.5194/hess-29-1847-2025, 2025
Short summary
Annual memory in the terrestrial water cycle
Wouter R. Berghuijs, Ross A. Woods, Bailey J. Anderson, Anna Luisa Hemshorn de Sánchez, and Markus Hrachowitz
Hydrol. Earth Syst. Sci., 29, 1319–1333, https://doi.org/10.5194/hess-29-1319-2025,https://doi.org/10.5194/hess-29-1319-2025, 2025
Short summary
Can system dynamics explain long-term hydrological behaviors? The role of endogenous linking structure
Xinyao Zhou, Zhuping Sheng, Kiril Manevski, Rongtian Zhao, Qingzhou Zhang, Yanmin Yang, Shumin Han, Jinghong Liu, and Yonghui Yang
Hydrol. Earth Syst. Sci., 29, 159–177, https://doi.org/10.5194/hess-29-159-2025,https://doi.org/10.5194/hess-29-159-2025, 2025
Short summary
Catchment hydrological response and transport are affected differently by precipitation intensity and antecedent wetness
Julia L. A. Knapp, Wouter R. Berghuijs, Marius G. Floriancic, and James W. Kirchner
Hydrol. Earth Syst. Sci. Discuss., https://doi.org/10.5194/hess-2024-371,https://doi.org/10.5194/hess-2024-371, 2024
Revised manuscript accepted for HESS
Short summary
Characterizing nonlinear, nonstationary, and heterogeneous hydrologic behavior using ensemble rainfall–runoff analysis (ERRA): proof of concept
James W. Kirchner
Hydrol. Earth Syst. Sci., 28, 4427–4454, https://doi.org/10.5194/hess-28-4427-2024,https://doi.org/10.5194/hess-28-4427-2024, 2024
Short summary

Cited articles

Addor, N., Newman, A. J., Mizukami, N., and Clark, M. P.: The CAMELS data set: catchment attributes and meteorology for large-sample studies, Hydrol. Earth Syst. Sci., 21, 5293–5313, https://doi.org/10.5194/hess-21-5293-2017, 2017. a, b
Beven, K.: Benchmarking hydrological models for an uncertain future, Hydrol. Process., 37, e14882, https://doi.org/10.1002/hyp.14882, 2023. a
Clark, M. P., Vogel, R. M., Lamontagne, J. R., Mizukami, N., Knoben, W. J., Tang, G., Gharari, S., Freer, J. E., Whitfield, P. H., Shook, K. R., and Papalexiou, S. M.: The abuse of popular performance metrics in hydrologic modeling, Water Resour. Res., 57, e2020WR029001, https://doi.org/10.1029/2020WR029001, 2021. a, b, c, d, e, f
Duc, L. and Sawada, Y.: A signal-processing-based interpretation of the Nash–Sutcliffe efficiency, Hydrol. Earth Syst. Sci., 27, 1827–1839, https://doi.org/10.5194/hess-27-1827-2023, 2023. a
Feng, D., Beck, H., Lawson, K., and Shen, C.: The suitability of differentiable, physics-informed machine learning hydrologic models for ungauged regions and climate change impact assessment, Hydrol. Earth Syst. Sci., 27, 2357–2373, https://doi.org/10.5194/hess-27-2357-2023, 2023. a
Download
Short summary
The evaluation of model performance is essential for hydrological modeling. Using performance criteria requires a deep understanding of their properties. We focus on a counterintuitive aspect of the Nash–Sutcliffe efficiency (NSE) and show that if we divide the data into multiple parts, the overall performance can be higher than all the evaluations of the subsets. Although this follows from the definition of the NSE, the resulting behavior can have unintended consequences in practice.
Share