Articles | Volume 21, issue 1
https://doi.org/10.5194/hess-21-423-2017
© Author(s) 2017. This work is distributed under
the Creative Commons Attribution 3.0 License.
the Creative Commons Attribution 3.0 License.
https://doi.org/10.5194/hess-21-423-2017
© Author(s) 2017. This work is distributed under
the Creative Commons Attribution 3.0 License.
the Creative Commons Attribution 3.0 License.
Research article
| 
25 Jan 2017
Research article |
| 25 Jan 2017
Looking beyond general metrics for model comparison – lessons from an international model intercomparison study
Water Resources Section, Faculty of Civil Engineering and Geosciences, Delft University of Technology, P.O. Box 5048, 2600 GA Delft, the Netherlands
Laurène Bouaziz
Department Catchment and Urban Hydrology, Deltares, Boussinesqweg 1, 2629 HV Delft, the Netherlands
Jan De Niel
Hydraulics division, Department of Civil Engineering, KU Leuven, Kasteelpark Arenberg 40, 3001 Leuven, Belgium
Claudia Brauer
Hydrology and Quantitative Water Management Group, Wageningen University and Research, P.O. Box 47, 6700 AA Wageningen, the Netherlands
Benjamin Dewals
University of Liège, Place du 20-Août 7, 4000 Liège, Belgium
Gilles Drogue
LOTERR-UFR SHS, Université de Lorraine, Île du Saulcy, 57045 Metz CEDEX 1, France
Fabrizio Fenicia
Eawag, Überlandstrasse 133, 8600 Dübendorf, Switzerland
Benjamin Grelier
LOTERR-UFR SHS, Université de Lorraine, Île du Saulcy, 57045 Metz CEDEX 1, France
Jiri Nossent
Flanders Hydraulics Research, Berchemlei 115, 2140 Antwerp, Belgium
Vrije Universiteit Brussel (VUB), Department of Hydrology and Hydraulic Engineering, Boulevard de la Plaine 2, 1050 Brussels, Belgium
Fernando Pereira
Flanders Hydraulics Research, Berchemlei 115, 2140 Antwerp, Belgium
Hubert Savenije
Water Resources Section, Faculty of Civil Engineering and Geosciences, Delft University of Technology, P.O. Box 5048, 2600 GA Delft, the Netherlands
Guillaume Thirel
Irstea, Hydrosystems and Bioprocesses Research Unit (HBAN), 1, rue Pierre-Gilles de Gennes, CS 10030, 92761 Antony CEDEX, France
Patrick Willems
Hydraulics division, Department of Civil Engineering, KU Leuven, Kasteelpark Arenberg 40, 3001 Leuven, Belgium
Vrije Universiteit Brussel (VUB), Department of Hydrology and Hydraulic Engineering, Boulevard de la Plaine 2, 1050 Brussels, Belgium
Viewed
Total article views: 4,548 (including HTML, PDF, and XML)
Cumulative views and downloads
(calculated since 20 Jul 2016)
| HTML | XML | Total | Supplement | BibTeX | EndNote | |
|---|---|---|---|---|---|---|
| 2,655 | 1,775 | 118 | 4,548 | 499 | 101 | 112 |
- HTML: 2,655
- PDF: 1,775
- XML: 118
- Total: 4,548
- Supplement: 499
- BibTeX: 101
- EndNote: 112
Total article views: 3,858 (including HTML, PDF, and XML)
Cumulative views and downloads
(calculated since 25 Jan 2017)
| HTML | XML | Total | Supplement | BibTeX | EndNote | |
|---|---|---|---|---|---|---|
| 2,255 | 1,490 | 113 | 3,858 | 312 | 93 | 104 |
- HTML: 2,255
- PDF: 1,490
- XML: 113
- Total: 3,858
- Supplement: 312
- BibTeX: 93
- EndNote: 104
Total article views: 690 (including HTML, PDF, and XML)
Cumulative views and downloads
(calculated since 20 Jul 2016)
| HTML | XML | Total | Supplement | BibTeX | EndNote | |
|---|---|---|---|---|---|---|
| 400 | 285 | 5 | 690 | 187 | 8 | 8 |
- HTML: 400
- PDF: 285
- XML: 5
- Total: 690
- Supplement: 187
- BibTeX: 8
- EndNote: 8
Cited
34 citations as recorded by crossref.
- Using the classical model for structured expert judgment to estimate extremes: a case study of discharges in the Meuse River G. Rongen et al. 10.5194/hess-28-2831-2024
- Hydrologic impacts of changing land use and climate in the Veneto lowlands of Italy A. Pijl et al. 10.1016/j.ancene.2018.04.001
- Systematic increase in model complexity helps to identify dominant streamflow mechanisms in two small forested basins P. David et al. 10.1080/02626667.2019.1585858
- Uncertainty Analysis of Climate Change Impact on River Flow Extremes Based on a Large Multi-Model Ensemble J. De Niel et al. 10.1007/s11269-019-02370-0
- A Brief Analysis of Conceptual Model Structure Uncertainty Using 36 Models and 559 Catchments W. Knoben et al. 10.1029/2019WR025975
- Correspondence Between Model Structures and Hydrological Signatures: A Large‐Sample Case Study Using 508 Brazilian Catchments P. David et al. 10.1029/2021WR030619
- Technical note: Testing the connection between hillslope-scale runoff fluctuations and streamflow hydrographs at the outlet of large river basins R. Mantilla et al. 10.5194/hess-28-1373-2024
- Peut-on estimer l’effet du changement climatique sur l’écoulement à l’exutoire d’un bassin sans modèle pluie-débit ? un test de la méthode de transfert climat-écoulement par régression dans le bassin transnational de la meuse B. Grelier et al. 10.4267/climatologie.1232
- Quels scénarios de débordement de l'Ourthe (Belgique) en réponse à une variabilité climatique long terme ? B. Grelier et al. 10.4000/physio-geo.7423
- HydroBench: Jupyter supported reproducible hydrological model benchmarking and diagnostic tool E. Moges et al. 10.3389/feart.2022.884766
- A Ranking of Hydrological Signatures Based on Their Predictability in Space N. Addor et al. 10.1029/2018WR022606
- A distributed simple dynamical systems approach (dS2 v1.0) for computationally efficient hydrological modelling at high spatio-temporal resolution J. Buitink et al. 10.5194/gmd-13-6093-2020
- Physically consistent conceptual rainfall–runoff model for urbanized catchments M. Saadi et al. 10.1016/j.jhydrol.2021.126394
- Crossing the rural–urban boundary in hydrological modelling: How do conceptual rainfall–runoff models handle the specificities of urbanized catchments? M. Saadi et al. 10.1002/hyp.13808
- Catchment response to intense rainfall: Evaluating modelling hypotheses P. Astagneau et al. 10.1002/hyp.14676
- Spatially Distributed Conceptual Hydrological Model Building: A Generic Top‐Down Approach Starting From Lumped Models Q. Tran et al. 10.1029/2018WR023566
- Learning from hydrological models’ challenges: A case study from the Nelson basin model intercomparison project M. Ahmed et al. 10.1016/j.jhydrol.2023.129820
- Understanding each other's models: an introduction and a standard representation of 16 global water models to support intercomparison, improvement, and communication C. Telteu et al. 10.5194/gmd-14-3843-2021
- Emulator-enabled approximate Bayesian computation (ABC) and uncertainty analysis for computationally expensive groundwater models T. Cui et al. 10.1016/j.jhydrol.2018.07.005
- Automatic Model Structure Identification for Conceptual Hydrologic Models D. Spieler et al. 10.1029/2019WR027009
- Quantifying Uncertainty in Food Security Modeling S. Shoaib et al. 10.3390/agriculture11010033
- Technical note: Hydrology modelling R packages – a unified analysis of models and practicalities from a user perspective P. Astagneau et al. 10.5194/hess-25-3937-2021
- On the choice of calibration metrics for “high-flow” estimation using hydrologic models N. Mizukami et al. 10.5194/hess-23-2601-2019
- Modular Assessment of Rainfall–Runoff Models Toolbox (MARRMoT) v1.2: an open-source, extendable framework providing implementations of 46 conceptual hydrologic models as continuous state-space formulations W. Knoben et al. 10.5194/gmd-12-2463-2019
- On the correlation between precipitation and potential evapotranspiration climate change signals for hydrological impact analyses J. De Niel et al. 10.1080/02626667.2019.1587615
- Great Lakes Runoff Intercomparison Project Phase 3: Lake Erie (GRIP-E) J. Mai et al. 10.1061/(ASCE)HE.1943-5584.0002097
- Toward robust pattern similarity metric for distributed model evaluation E. Yorulmaz et al. 10.1007/s00477-024-02790-4
- When does a parsimonious model fail to simulate floods? Learning from the seasonality of model bias P. Astagneau et al. 10.1080/02626667.2021.1923720
- The effect of calibration data length on the performance of a conceptual hydrological model versus LSTM and GRU: A case study for six basins from the CAMELS dataset G. Ayzel & M. Heistermann 10.1016/j.cageo.2021.104708
- Hydrological modelling at multiple sub-daily time steps: Model improvement via flux-matching A. Ficchì et al. 10.1016/j.jhydrol.2019.05.084
- Behind the scenes of streamflow model performance L. Bouaziz et al. 10.5194/hess-25-1069-2021
- Constraining Conceptual Hydrological Models With Multiple Information Sources R. Nijzink et al. 10.1029/2017WR021895
- Why do we have so many different hydrological models? A review based on the case of Switzerland P. Horton et al. 10.1002/wat2.1574
- Improving the structure of a hydrological model to forecast catchment response to intense rainfall P. Astagneau et al. 10.1080/27678490.2024.2341027
34 citations as recorded by crossref.
- Using the classical model for structured expert judgment to estimate extremes: a case study of discharges in the Meuse River G. Rongen et al. 10.5194/hess-28-2831-2024
- Hydrologic impacts of changing land use and climate in the Veneto lowlands of Italy A. Pijl et al. 10.1016/j.ancene.2018.04.001
- Systematic increase in model complexity helps to identify dominant streamflow mechanisms in two small forested basins P. David et al. 10.1080/02626667.2019.1585858
- Uncertainty Analysis of Climate Change Impact on River Flow Extremes Based on a Large Multi-Model Ensemble J. De Niel et al. 10.1007/s11269-019-02370-0
- A Brief Analysis of Conceptual Model Structure Uncertainty Using 36 Models and 559 Catchments W. Knoben et al. 10.1029/2019WR025975
- Correspondence Between Model Structures and Hydrological Signatures: A Large‐Sample Case Study Using 508 Brazilian Catchments P. David et al. 10.1029/2021WR030619
- Technical note: Testing the connection between hillslope-scale runoff fluctuations and streamflow hydrographs at the outlet of large river basins R. Mantilla et al. 10.5194/hess-28-1373-2024
- Peut-on estimer l’effet du changement climatique sur l’écoulement à l’exutoire d’un bassin sans modèle pluie-débit ? un test de la méthode de transfert climat-écoulement par régression dans le bassin transnational de la meuse B. Grelier et al. 10.4267/climatologie.1232
- Quels scénarios de débordement de l'Ourthe (Belgique) en réponse à une variabilité climatique long terme ? B. Grelier et al. 10.4000/physio-geo.7423
- HydroBench: Jupyter supported reproducible hydrological model benchmarking and diagnostic tool E. Moges et al. 10.3389/feart.2022.884766
- A Ranking of Hydrological Signatures Based on Their Predictability in Space N. Addor et al. 10.1029/2018WR022606
- A distributed simple dynamical systems approach (dS2 v1.0) for computationally efficient hydrological modelling at high spatio-temporal resolution J. Buitink et al. 10.5194/gmd-13-6093-2020
- Physically consistent conceptual rainfall–runoff model for urbanized catchments M. Saadi et al. 10.1016/j.jhydrol.2021.126394
- Crossing the rural–urban boundary in hydrological modelling: How do conceptual rainfall–runoff models handle the specificities of urbanized catchments? M. Saadi et al. 10.1002/hyp.13808
- Catchment response to intense rainfall: Evaluating modelling hypotheses P. Astagneau et al. 10.1002/hyp.14676
- Spatially Distributed Conceptual Hydrological Model Building: A Generic Top‐Down Approach Starting From Lumped Models Q. Tran et al. 10.1029/2018WR023566
- Learning from hydrological models’ challenges: A case study from the Nelson basin model intercomparison project M. Ahmed et al. 10.1016/j.jhydrol.2023.129820
- Understanding each other's models: an introduction and a standard representation of 16 global water models to support intercomparison, improvement, and communication C. Telteu et al. 10.5194/gmd-14-3843-2021
- Emulator-enabled approximate Bayesian computation (ABC) and uncertainty analysis for computationally expensive groundwater models T. Cui et al. 10.1016/j.jhydrol.2018.07.005
- Automatic Model Structure Identification for Conceptual Hydrologic Models D. Spieler et al. 10.1029/2019WR027009
- Quantifying Uncertainty in Food Security Modeling S. Shoaib et al. 10.3390/agriculture11010033
- Technical note: Hydrology modelling R packages – a unified analysis of models and practicalities from a user perspective P. Astagneau et al. 10.5194/hess-25-3937-2021
- On the choice of calibration metrics for “high-flow” estimation using hydrologic models N. Mizukami et al. 10.5194/hess-23-2601-2019
- Modular Assessment of Rainfall–Runoff Models Toolbox (MARRMoT) v1.2: an open-source, extendable framework providing implementations of 46 conceptual hydrologic models as continuous state-space formulations W. Knoben et al. 10.5194/gmd-12-2463-2019
- On the correlation between precipitation and potential evapotranspiration climate change signals for hydrological impact analyses J. De Niel et al. 10.1080/02626667.2019.1587615
- Great Lakes Runoff Intercomparison Project Phase 3: Lake Erie (GRIP-E) J. Mai et al. 10.1061/(ASCE)HE.1943-5584.0002097
- Toward robust pattern similarity metric for distributed model evaluation E. Yorulmaz et al. 10.1007/s00477-024-02790-4
- When does a parsimonious model fail to simulate floods? Learning from the seasonality of model bias P. Astagneau et al. 10.1080/02626667.2021.1923720
- The effect of calibration data length on the performance of a conceptual hydrological model versus LSTM and GRU: A case study for six basins from the CAMELS dataset G. Ayzel & M. Heistermann 10.1016/j.cageo.2021.104708
- Hydrological modelling at multiple sub-daily time steps: Model improvement via flux-matching A. Ficchì et al. 10.1016/j.jhydrol.2019.05.084
- Behind the scenes of streamflow model performance L. Bouaziz et al. 10.5194/hess-25-1069-2021
- Constraining Conceptual Hydrological Models With Multiple Information Sources R. Nijzink et al. 10.1029/2017WR021895
- Why do we have so many different hydrological models? A review based on the case of Switzerland P. Horton et al. 10.1002/wat2.1574
- Improving the structure of a hydrological model to forecast catchment response to intense rainfall P. Astagneau et al. 10.1080/27678490.2024.2341027
Latest update: 20 Nov 2024
Short summary
In this study, the rainfall–runoff models of eight international research groups were compared for a set of subcatchments of the Meuse basin to investigate the influence of certain model components on the modelled discharge. Although the models showed similar performances based on general metrics, clear differences could be observed for specific events. The differences during drier conditions could indeed be linked to differences in model structures.
In this study, the rainfall–runoff models of eight international research groups were compared...
