Articles | Volume 28, issue 15
https://doi.org/10.5194/hess-28-3665-2024
https://doi.org/10.5194/hess-28-3665-2024
Technical note
 | 
13 Aug 2024
Technical note |  | 13 Aug 2024

Technical Note: The divide and measure nonconformity – how metrics can mislead when we evaluate on different data partitions

Daniel Klotz, Martin Gauch, Frederik Kratzert, Grey Nearing, and Jakob Zscheischler

Model code and software

Acompaning code for Technical Note: The divide and measure nonconformity D. Klotz https://github.com/danklotz/a-damn-paper/tree/main

Download
Short summary
The evaluation of model performance is essential for hydrological modeling. Using performance criteria requires a deep understanding of their properties. We focus on a counterintuitive aspect of the Nash–Sutcliffe efficiency (NSE) and show that if we divide the data into multiple parts, the overall performance can be higher than all the evaluations of the subsets. Although this follows from the definition of the NSE, the resulting behavior can have unintended consequences in practice.