Articles | Volume 29, issue 3
https://doi.org/10.5194/hess-29-683-2025
© Author(s) 2025. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
https://doi.org/10.5194/hess-29-683-2025
© Author(s) 2025. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Research article
| 
05 Feb 2025
Research article |
| 05 Feb 2025
| 05 Feb 2025
Lack of robustness of hydrological models: a large-sample diagnosis and an attempt to identify hydrological and climatic drivers
Léonard Santos
Université Paris-Saclay, INRAE, UR HYCAR, Antony, France
Vazken Andréassian
CORRESPONDING AUTHOR
Université Paris-Saclay, INRAE, UR HYCAR, Antony, France
Torben O. Sonnenborg
GEUS, Copenhagen, Denmark
Göran Lindström
SMHI, Norrköping, Sweden
Alban de Lavenne
Université Paris-Saclay, INRAE, UR HYCAR, Antony, France
SMHI, Norrköping, Sweden
Charles Perrin
Université Paris-Saclay, INRAE, UR HYCAR, Antony, France
Lila Collet
Université Paris-Saclay, INRAE, UR HYCAR, Antony, France
now at: EDF R&D, OSIRIS Department, 7 boulevard Gaspard Monge, 91120 Palaiseau, France
Guillaume Thirel
Université Paris-Saclay, INRAE, UR HYCAR, Antony, France
Related authors
Guillaume Thirel, Léonard Santos, Olivier Delaigue, and Charles Perrin
Hydrol. Earth Syst. Sci., 28, 4837–4860, https://doi.org/10.5194/hess-28-4837-2024, https://doi.org/10.5194/hess-28-4837-2024, 2024
Short summary
Short summary
We discuss how mathematical transformations impact calibrated hydrological model simulations. We assess how 11 transformations behave over the complete range of streamflows. Extreme transformations lead to models that are specialized for extreme streamflows but show poor performance outside the range of targeted streamflows and are less robust. We show that no a priori assumption about transformations can be taken as warranted.
Pierre Nicolle, Vazken Andréassian, Paul Royer-Gaspard, Charles Perrin, Guillaume Thirel, Laurent Coron, and Léonard Santos
Hydrol. Earth Syst. Sci., 25, 5013–5027, https://doi.org/10.5194/hess-25-5013-2021, https://doi.org/10.5194/hess-25-5013-2021, 2021
Short summary
Short summary
In this note, a new method (RAT) is proposed to assess the robustness of hydrological models. The RAT method is particularly interesting because it does not require multiple calibrations (it is therefore applicable to uncalibrated models), and it can be used to determine whether a hydrological model may be safely used for climate change impact studies. Success at the robustness assessment test is a necessary (but not sufficient) condition of model robustness.
Guillaume Evin, Benoit Hingray, Guillaume Thirel, Agnès Ducharne, Laurent Strohmenger, Lola Corre, Yves Tramblay, Jean-Philippe Vidal, Jérémie Bonneau, François Colleoni, Joël Gailhard, Florence Habets, Frédéric Hendrickx, Louis Héraut, Peng Huang, Matthieu Le Lay, Claire Magand, Paola Marson, Céline Monteil, Simon Munier, Alix Reverdy, Jean-Michel Soubeyroux, Yoann Robin, Jean-Pierre Vergnes, Mathieu Vrac, and Eric Sauquet
EGUsphere, https://doi.org/10.5194/egusphere-2025-2727, https://doi.org/10.5194/egusphere-2025-2727, 2025
This preprint is open for discussion and under review for Hydrology and Earth System Sciences (HESS).
Short summary
Short summary
Explore2 provides hydrological projections for 1,735 French catchments. Using QUALYPSO, this study assesses uncertainties, including internal variability. By the end of the century, low flows are projected to decline in southern France under high emissions, while other indicators remain uncertain. Emission scenarios and regional climate models are key uncertainty sources. Internal variability is often as large as climate-driven changes.
Taha-Abderrahman El Ouahabi, François Bourgin, Charles Perrin, and Vazken Andréassian
EGUsphere, https://doi.org/10.5194/egusphere-2025-3586, https://doi.org/10.5194/egusphere-2025-3586, 2025
This preprint is open for discussion and under review for Hydrology and Earth System Sciences (HESS).
Short summary
Short summary
To improve hydrological uncertainty estimation, recent studies have explored machine learning (ML)-based post-processing approaches. Among these, quantile random forests (QRF) are increasingly used for their balance between interpretability and performance. We develop a hydrologically informed QRF trained in a multi-site setting. Our results show that the regional QRF approach is beneficial, particularly in catchments where local information is insufficient.
Eric Sauquet, Guillaume Evin, Sonia Siauve, Ryma Aissat, Patrick Arnaud, Maud Bérel, Jérémie Bonneau, Flora Branger, Yvan Caballero, François Colléoni, Agnès Ducharne, Joël Gailhard, Florence Habets, Frédéric Hendrickx, Louis Héraut, Benoît Hingray, Peng Huang, Tristan Jaouen, Alexis Jeantet, Sandra Lanini, Matthieu Le Lay, Claire Magand, Louise Mimeau, Céline Monteil, Simon Munier, Charles Perrin, Olivier Robelin, Fabienne Rousset, Jean-Michel Soubeyroux, Laurent Strohmenger, Guillaume Thirel, Flore Tocquer, Yves Tramblay, Jean-Pierre Vergnes, and Jean-Philippe Vidal
EGUsphere, https://doi.org/10.5194/egusphere-2025-1788, https://doi.org/10.5194/egusphere-2025-1788, 2025
This preprint is open for discussion and under review for Hydrology and Earth System Sciences (HESS).
Short summary
Short summary
The Explore2 project has provided an unprecedented set of hydrological projections in terms of the number of hydrological models used and the spatial and temporal resolution. The results have been made available through various media. Under the high-emission scenario, the hydrological models mostly agree on the decrease in seasonal flows in the south of France, confirming its hotspot status, and on the decrease in summer flows throughout France, with the exception of the northern part of France.
Yves Tramblay, Guillaume Thirel, Laurent Strohmenger, Guillaume Evin, Lola Corre, Louis Heraut, and Eric Sauquet
EGUsphere, https://doi.org/10.5194/egusphere-2025-1635, https://doi.org/10.5194/egusphere-2025-1635, 2025
Short summary
Short summary
How climate change impacts floods in France? Using simulations for 3000 rivers in climate projections, results show that flood trends vary depending on the region. In the north, floods may become more severe, but in many other areas, the trends are mixed. Floods from intense rainfall are becoming more frequent, while snowmelt floods are strongly decreasing. Overall, the study shows that understanding what causes floods is key to predicting how they are likely to change with the climate.
Olivier Delaigue, Guilherme Mendoza Guimarães, Pierre Brigode, Benoît Génot, Charles Perrin, Jean-Michel Soubeyroux, Bruno Janet, Nans Addor, and Vazken Andréassian
Earth Syst. Sci. Data, 17, 1461–1479, https://doi.org/10.5194/essd-17-1461-2025, https://doi.org/10.5194/essd-17-1461-2025, 2025
Short summary
Short summary
This dataset covers 654 rivers all flowing in France. The provided time series and catchment attributes will be of interest to those modelers wishing to analyze hydrological behavior and perform model assessments.
Vazken Andréassian, Guilherme Mendoza Guimarães, Alban de Lavenne, and Julien Lerat
EGUsphere, https://doi.org/10.5194/egusphere-2025-414, https://doi.org/10.5194/egusphere-2025-414, 2025
Short summary
Short summary
Using 4122 catchments from four continents, we investigate how annual streamflow depends on climate variables (rainfall and potential evaporation) and on the season when precipitation occurs, using and index representing the synchronicity between precipitation and potential evaporation. In all countries and under the main climates represented, synchronicity is, after precipitation, the second most important factor to explain annual streamflow variations.
Guillaume Thirel, Léonard Santos, Olivier Delaigue, and Charles Perrin
Hydrol. Earth Syst. Sci., 28, 4837–4860, https://doi.org/10.5194/hess-28-4837-2024, https://doi.org/10.5194/hess-28-4837-2024, 2024
Short summary
Short summary
We discuss how mathematical transformations impact calibrated hydrological model simulations. We assess how 11 transformations behave over the complete range of streamflows. Extreme transformations lead to models that are specialized for extreme streamflows but show poor performance outside the range of targeted streamflows and are less robust. We show that no a priori assumption about transformations can be taken as warranted.
Thibault Hallouin, François Bourgin, Charles Perrin, Maria-Helena Ramos, and Vazken Andréassian
Geosci. Model Dev., 17, 4561–4578, https://doi.org/10.5194/gmd-17-4561-2024, https://doi.org/10.5194/gmd-17-4561-2024, 2024
Short summary
Short summary
The evaluation of the quality of hydrological model outputs against streamflow observations is widespread in the hydrological literature. In order to improve on the reproducibility of published studies, a new evaluation tool dedicated to hydrological applications is presented. It is open source and usable in a variety of programming languages to make it as accessible as possible to the community. Thus, authors and readers alike can use the same tool to produce and reproduce the results.
Ralph Bathelemy, Pierre Brigode, Vazken Andréassian, Charles Perrin, Vincent Moron, Cédric Gaucherel, Emmanuel Tric, and Dominique Boisson
Earth Syst. Sci. Data, 16, 2073–2098, https://doi.org/10.5194/essd-16-2073-2024, https://doi.org/10.5194/essd-16-2073-2024, 2024
Short summary
Short summary
The aim of this work is to provide the first hydroclimatic database for Haiti, a Caribbean country particularly vulnerable to meteorological and hydrological hazards. The resulting database, named Simbi, provides hydroclimatic time series for around 150 stations and 24 catchment areas.
Tom Loree, Hervé Squividant, Josette Launay, Alban de Lavenne, and Christophe Cudennec
Proc. IAHS, 385, 85–89, https://doi.org/10.5194/piahs-385-85-2024, https://doi.org/10.5194/piahs-385-85-2024, 2024
Short summary
Short summary
A scientific model to simulate river discharges in un-measured locations is made available via a service on the web for end-users. It is shown how this allows an increasing uptake by non-modelers, for the benefit of hydrological assessments and management.
Cyril Thébault, Charles Perrin, Vazken Andréassian, Guillaume Thirel, Sébastien Legrand, and Olivier Delaigue
Hydrol. Earth Syst. Sci., 28, 1539–1566, https://doi.org/10.5194/hess-28-1539-2024, https://doi.org/10.5194/hess-28-1539-2024, 2024
Short summary
Short summary
Streamflow forecasting is useful for many applications, ranging from population safety (e.g. floods) to water resource management (e.g. agriculture or hydropower). To this end, hydrological models must be optimized. However, a model is inherently wrong. This study aims to analyse the contribution of a multi-model approach within a variable spatial framework to improve streamflow simulations. The underlying idea is to take advantage of the strength of each modelling framework tested.
Nils Poncet, Philippe Lucas-Picher, Yves Tramblay, Guillaume Thirel, Humberto Vergara, Jonathan Gourley, and Antoinette Alias
Nat. Hazards Earth Syst. Sci., 24, 1163–1183, https://doi.org/10.5194/nhess-24-1163-2024, https://doi.org/10.5194/nhess-24-1163-2024, 2024
Short summary
Short summary
High-resolution convection-permitting climate models (CPMs) are now available to better simulate rainstorm events leading to flash floods. In this study, two hydrological models are compared to simulate floods in a Mediterranean basin, showing a better ability of the CPM to reproduce flood peaks compared to coarser-resolution climate models. Future projections are also different, with a projected increase for the most severe floods and a potential decrease for the most frequent events.
Trine Enemark, Rasmus Bødker Madsen, Torben O. Sonnenborg, Lærke Therese Andersen, Peter B. E. Sandersen, Jacob Kidmose, Ingelise Møller, Thomas Mejer Hansen, Karsten Høgh Jensen, and Anne-Sophie Høyer
Hydrol. Earth Syst. Sci., 28, 505–523, https://doi.org/10.5194/hess-28-505-2024, https://doi.org/10.5194/hess-28-505-2024, 2024
Short summary
Short summary
In this study, we demonstrate an approach to evaluate the interpretation uncertainty within a manually interpreted geological model in a groundwater model. Using qualitative estimates of uncertainties, several geological realizations are developed and implemented in groundwater models. We confirm existing evidence that if the conceptual model is well defined, interpretation uncertainties within the conceptual model have limited impact on groundwater model predictions.
Laurent Strohmenger, Eric Sauquet, Claire Bernard, Jérémie Bonneau, Flora Branger, Amélie Bresson, Pierre Brigode, Rémy Buzier, Olivier Delaigue, Alexandre Devers, Guillaume Evin, Maïté Fournier, Shu-Chen Hsu, Sandra Lanini, Alban de Lavenne, Thibault Lemaitre-Basset, Claire Magand, Guilherme Mendoza Guimarães, Max Mentha, Simon Munier, Charles Perrin, Tristan Podechard, Léo Rouchy, Malak Sadki, Myriam Soutif-Bellenger, François Tilmant, Yves Tramblay, Anne-Lise Véron, Jean-Philippe Vidal, and Guillaume Thirel
Hydrol. Earth Syst. Sci., 27, 3375–3391, https://doi.org/10.5194/hess-27-3375-2023, https://doi.org/10.5194/hess-27-3375-2023, 2023
Short summary
Short summary
We present the results of a large visual inspection campaign of 674 streamflow time series in France. The objective was to detect non-natural records resulting from instrument failure or anthropogenic influences, such as hydroelectric power generation or reservoir management. We conclude that the identification of flaws in flow time series is highly dependent on the objectives and skills of individual evaluators, and we raise the need for better practices for data cleaning.
Olivier Delaigue, Pierre Brigode, Guillaume Thirel, and Laurent Coron
Hydrol. Earth Syst. Sci., 27, 3293–3327, https://doi.org/10.5194/hess-27-3293-2023, https://doi.org/10.5194/hess-27-3293-2023, 2023
Short summary
Short summary
Teaching hydrological modeling is an important, but difficult, matter. It requires appropriate tools and teaching material. In this article, we present the airGRteaching package, which is an open-source software tool relying on widely used hydrological models. This tool proposes an interface and numerous hydrological modeling exercises representing a wide range of hydrological applications. We show how this tool can be applied to simple but real-life cases.
Tanja Denager, Torben O. Sonnenborg, Majken C. Looms, Heye Bogena, and Karsten H. Jensen
Hydrol. Earth Syst. Sci., 27, 2827–2845, https://doi.org/10.5194/hess-27-2827-2023, https://doi.org/10.5194/hess-27-2827-2023, 2023
Short summary
Short summary
This study contributes to improvements in the model characterization of water and energy fluxes. The results show that multi-objective autocalibration in combination with mathematical regularization is a powerful tool to improve land surface models. Using the direct measurement of turbulent fluxes as the target variable, parameter optimization matches simulations and observations of latent heat, whereas sensible heat is clearly biased.
Ane LaBianca, Mette H. Mortensen, Peter Sandersen, Torben O. Sonnenborg, Karsten H. Jensen, and Jacob Kidmose
Hydrol. Earth Syst. Sci., 27, 1645–1666, https://doi.org/10.5194/hess-27-1645-2023, https://doi.org/10.5194/hess-27-1645-2023, 2023
Short summary
Short summary
The study explores the effect of Anthropocene geology and the computational grid size on the simulation of shallow urban groundwater. Many cities are facing challenges with high groundwater levels close to the surface, yet urban planning and development seldom consider its impact on the groundwater resource. This study illustrates that the urban subsurface infrastructure significantly affects the groundwater flow paths and the residence time of shallow urban groundwater.
Eva Sebok, Hans Jørgen Henriksen, Ernesto Pastén-Zapata, Peter Berg, Guillaume Thirel, Anthony Lemoine, Andrea Lira-Loarca, Christiana Photiadou, Rafael Pimentel, Paul Royer-Gaspard, Erik Kjellström, Jens Hesselbjerg Christensen, Jean Philippe Vidal, Philippe Lucas-Picher, Markus G. Donat, Giovanni Besio, María José Polo, Simon Stisen, Yvan Caballero, Ilias G. Pechlivanidis, Lars Troldborg, and Jens Christian Refsgaard
Hydrol. Earth Syst. Sci., 26, 5605–5625, https://doi.org/10.5194/hess-26-5605-2022, https://doi.org/10.5194/hess-26-5605-2022, 2022
Short summary
Short summary
Hydrological models projecting the impact of changing climate carry a lot of uncertainty. Thus, these models usually have a multitude of simulations using different future climate data. This study used the subjective opinion of experts to assess which climate and hydrological models are the most likely to correctly predict climate impacts, thereby easing the computational burden. The experts could select more likely hydrological models, while the climate models were deemed equally probable.
Alban de Lavenne, Vazken Andréassian, Louise Crochemore, Göran Lindström, and Berit Arheimer
Hydrol. Earth Syst. Sci., 26, 2715–2732, https://doi.org/10.5194/hess-26-2715-2022, https://doi.org/10.5194/hess-26-2715-2022, 2022
Short summary
Short summary
A watershed remembers the past to some extent, and this memory influences its behavior. This memory is defined by the ability to store past rainfall for several years. By releasing this water into the river or the atmosphere, it tends to forget. We describe how this memory fades over time in France and Sweden. A few watersheds show a multi-year memory. It increases with the influence of groundwater or dry conditions. After 3 or 4 years, they behave independently of the past.
Antoine Pelletier and Vazken Andréassian
Hydrol. Earth Syst. Sci., 26, 2733–2758, https://doi.org/10.5194/hess-26-2733-2022, https://doi.org/10.5194/hess-26-2733-2022, 2022
Short summary
Short summary
A large part of the water cycle takes place underground. In many places, the soil stores water during the wet periods and can release it all year long, which is particularly visible when the river level is low. Modelling tools that are used to simulate and forecast the behaviour of the river struggle to represent this. We improved an existing model to take underground water into account using measurements of the soil water content. Results allow us make recommendations for model users.
Thibault Lemaitre-Basset, Ludovic Oudin, Guillaume Thirel, and Lila Collet
Hydrol. Earth Syst. Sci., 26, 2147–2159, https://doi.org/10.5194/hess-26-2147-2022, https://doi.org/10.5194/hess-26-2147-2022, 2022
Short summary
Short summary
Increasing temperature will impact evaporation and water resource management. Hydrological models are fed with an estimation of the evaporative demand of the atmosphere, called potential evapotranspiration (PE). The objectives of this study were (1) to compute the future PE anomaly over France and (2) to determine the impact of the choice of the method to estimate PE. Our results show that all methods present similar future trends. No method really stands out from the others.
H. E. Markus Meier, Madline Kniebusch, Christian Dieterich, Matthias Gröger, Eduardo Zorita, Ragnar Elmgren, Kai Myrberg, Markus P. Ahola, Alena Bartosova, Erik Bonsdorff, Florian Börgel, Rene Capell, Ida Carlén, Thomas Carlund, Jacob Carstensen, Ole B. Christensen, Volker Dierschke, Claudia Frauen, Morten Frederiksen, Elie Gaget, Anders Galatius, Jari J. Haapala, Antti Halkka, Gustaf Hugelius, Birgit Hünicke, Jaak Jaagus, Mart Jüssi, Jukka Käyhkö, Nina Kirchner, Erik Kjellström, Karol Kulinski, Andreas Lehmann, Göran Lindström, Wilhelm May, Paul A. Miller, Volker Mohrholz, Bärbel Müller-Karulis, Diego Pavón-Jordán, Markus Quante, Marcus Reckermann, Anna Rutgersson, Oleg P. Savchuk, Martin Stendel, Laura Tuomi, Markku Viitasalo, Ralf Weisse, and Wenyan Zhang
Earth Syst. Dynam., 13, 457–593, https://doi.org/10.5194/esd-13-457-2022, https://doi.org/10.5194/esd-13-457-2022, 2022
Short summary
Short summary
Based on the Baltic Earth Assessment Reports of this thematic issue in Earth System Dynamics and recent peer-reviewed literature, current knowledge about the effects of global warming on past and future changes in the climate of the Baltic Sea region is summarised and assessed. The study is an update of the Second Assessment of Climate Change (BACC II) published in 2015 and focuses on the atmosphere, land, cryosphere, ocean, sediments, and the terrestrial and marine biosphere.
Ida Karlsson Seidenfaden, Torben Obel Sonnenborg, Jens Christian Refsgaard, Christen Duus Børgesen, Jørgen Eivind Olesen, and Dennis Trolle
Hydrol. Earth Syst. Sci., 26, 955–973, https://doi.org/10.5194/hess-26-955-2022, https://doi.org/10.5194/hess-26-955-2022, 2022
Short summary
Short summary
This study investigates how the spatial nitrate reduction in the subsurface may shift under changing climate and land use conditions. This change is investigated by comparing maps showing the spatial nitrate reduction in an agricultural catchment for current conditions, with maps generated for future projected climate and land use conditions. Results show that future climate flow paths may shift the catchment reduction noticeably, while implications of land use changes were less substantial.
Paul Royer-Gaspard, Vazken Andréassian, and Guillaume Thirel
Hydrol. Earth Syst. Sci., 25, 5703–5716, https://doi.org/10.5194/hess-25-5703-2021, https://doi.org/10.5194/hess-25-5703-2021, 2021
Short summary
Short summary
Most evaluation studies based on the differential split-sample test (DSST) endorse the consensus that rainfall–runoff models lack climatic robustness. In this technical note, we propose a new performance metric to evaluate model robustness without applying the DSST and which can be used with a single hydrological model calibration. Our work makes it possible to evaluate the temporal transferability of any hydrological model, including uncalibrated models, at a very low computational cost.
Alexis Jeantet, Hocine Henine, Cédric Chaumont, Lila Collet, Guillaume Thirel, and Julien Tournebize
Hydrol. Earth Syst. Sci., 25, 5447–5471, https://doi.org/10.5194/hess-25-5447-2021, https://doi.org/10.5194/hess-25-5447-2021, 2021
Short summary
Short summary
The hydrological subsurface drainage model SIDRA-RU is assessed at the French national scale, using a unique database representing the large majority of the French drained areas. The model is evaluated following its capacity to simulate the drainage discharge variability and the annual drained water balance. Eventually, the temporal robustness of SIDRA-RU is assessed to demonstrate the utility of this model as a long-term management tool.
Pierre Nicolle, Vazken Andréassian, Paul Royer-Gaspard, Charles Perrin, Guillaume Thirel, Laurent Coron, and Léonard Santos
Hydrol. Earth Syst. Sci., 25, 5013–5027, https://doi.org/10.5194/hess-25-5013-2021, https://doi.org/10.5194/hess-25-5013-2021, 2021
Short summary
Short summary
In this note, a new method (RAT) is proposed to assess the robustness of hydrological models. The RAT method is particularly interesting because it does not require multiple calibrations (it is therefore applicable to uncalibrated models), and it can be used to determine whether a hydrological model may be safely used for climate change impact studies. Success at the robustness assessment test is a necessary (but not sufficient) condition of model robustness.
Paul C. Astagneau, Guillaume Thirel, Olivier Delaigue, Joseph H. A. Guillaume, Juraj Parajka, Claudia C. Brauer, Alberto Viglione, Wouter Buytaert, and Keith J. Beven
Hydrol. Earth Syst. Sci., 25, 3937–3973, https://doi.org/10.5194/hess-25-3937-2021, https://doi.org/10.5194/hess-25-3937-2021, 2021
Short summary
Short summary
The R programming language has become an important tool for many applications in hydrology. In this study, we provide an analysis of some of the R tools providing hydrological models. In total, two aspects are uniformly investigated, namely the conceptualisation of the models and the practicality of their implementation for end-users. These comparisons aim at easing the choice of R tools for users and at improving their usability for hydrology modelling to support more transferable research.
Laurène J. E. Bouaziz, Fabrizio Fenicia, Guillaume Thirel, Tanja de Boer-Euser, Joost Buitink, Claudia C. Brauer, Jan De Niel, Benjamin J. Dewals, Gilles Drogue, Benjamin Grelier, Lieke A. Melsen, Sotirios Moustakas, Jiri Nossent, Fernando Pereira, Eric Sprokkereef, Jasper Stam, Albrecht H. Weerts, Patrick Willems, Hubert H. G. Savenije, and Markus Hrachowitz
Hydrol. Earth Syst. Sci., 25, 1069–1095, https://doi.org/10.5194/hess-25-1069-2021, https://doi.org/10.5194/hess-25-1069-2021, 2021
Short summary
Short summary
We quantify the differences in internal states and fluxes of 12 process-based models with similar streamflow performance and assess their plausibility using remotely sensed estimates of evaporation, snow cover, soil moisture and total storage anomalies. The dissimilarities in internal process representation imply that these models cannot all simultaneously be close to reality. Therefore, we invite modelers to evaluate their models using multiple variables and to rely on multi-model studies.
Manon Cassagnole, Maria-Helena Ramos, Ioanna Zalachori, Guillaume Thirel, Rémy Garçon, Joël Gailhard, and Thomas Ouillon
Hydrol. Earth Syst. Sci., 25, 1033–1052, https://doi.org/10.5194/hess-25-1033-2021, https://doi.org/10.5194/hess-25-1033-2021, 2021
Pierre Nicolle, François Besson, Olivier Delaigue, Pierre Etchevers, Didier François, Matthieu Le Lay, Charles Perrin, Fabienne Rousset, Dominique Thiéry, François Tilmant, Claire Magand, Timothée Leurent, and Élise Jacob
Proc. IAHS, 383, 381–389, https://doi.org/10.5194/piahs-383-381-2020, https://doi.org/10.5194/piahs-383-381-2020, 2020
Cited articles
Beck, H. E., Zimmermann, N. E., McVicar, T. R., Vergopolan, N., Berg, A., and Wood, E. F.: Present and future Köppen-Geiger climate classification maps at 1-km resolution, Sci. Data, 5, 180214, https://doi.org/10.1038/sdata.2018.214, 2018.
Birhanu, D., Kim, H., Jang, C., and Park, S.: Does the Complexity of Evapotranspiration and Hydrological Models Enhance Robustness?, Sustainability, 10, 2837, https://doi.org/10.3390/su10082837, 2018.
Blöschl, G., Bierkens, M. F. P., Chambel, A. et al.: Twenty-three unsolved problems in hydrology (UPH) – a community perspective, Hydrol. Sci. J., 64, 1141–1158, https://doi.org/10.1080/02626667.2019.1620507, 2019.
Brigode, P., Oudin, L., and Perrin, C.: Hydrological model parameter instability: A source of additional uncertainty in estimating the hydrological impacts of climate change?, J. Hydrol., 476, 410–425, https://doi.org/10.1016/j.jhydrol.2012.11.012, 2013.
Broderick, C., Matthews, T., Wilby, R. L., Bastola, S., and Murphy, C.: Transferability of hydrological models and ensemble averaging methods between contrasting climatic periods, Water Resour. Res., 52, 8343–8373, https://doi.org/10.1002/2016WR018850, 2016.
Coron, L., Andréassian, V., Bourqui, M., Perrin, C., and Hendrickx, F.: Pathologies of hydrological models used in changing climatic conditions: A review, IAHS-AISH Publication, 344, 39–44, 2011.
Coron, L., Andréassian, V., Perrin, C., Lerat, J., Vaze, J., Bourqui, M., and Hendrickx, F.: Crash testing hydrological models in contrasted climate conditions: An experiment on 216 Australian catchments, Water Resour. Res., 48, W05552, https://doi.org/10.1029/2011WR011721, 2012.
Coron, L., Andréassian, V., Perrin, C., Bourqui, M., and Hendrickx, F.: On the lack of robustness of hydrologic models regarding water balance simulation: a diagnostic approach applied to three models of increasing complexity on 20 mountainous catchments, Hydrol. Earth Syst. Sci., 18, 727–746, https://doi.org/10.5194/hess-18-727-2014, 2014.
Coron, L., Thirel, G., Delaigue, O., Perrin, C., and Andréassian, V.: The suite of lumped GR hydrological models in an R package, Environ. Modell. Softw., 94, 166–171, https://doi.org/10.1016/j.envsoft.2017.05.002, 2017.
Coron, L., Delaigue, O., Thirel, G., Dorchies, D., Perrin, C., and Michel, C.: airGR: Suite of GR Hydrological Models for Precipitation-Runoff Modelling, R package version 1.6.12, https://doi.org/10.32614/CRAN.package.airGR, 2021.
Dakhlaoui, H., Ruelland, D., Tramblay, Y., and Bargaoui, Z.: Evaluating the robustness of conceptual rainfall-runoff models under climate variability in northern Tunisia, J. Hydrol., 550, 201–217, https://doi.org/10.1016/j.jhydrol.2017.04.032, 2017.
Dakhlaoui, H., Ruelland, D., and Tramblay, Y.: A bootstrap-based differential split-sample test to assess the transferability of conceptual rainfall-runoff models under past and future climate variability, J. Hydrol., 575, 470–486, https://doi.org/10.1016/j.jhydrol.2019.05.056, 2019.
Delaigue, O., Génot, B., Mendoza Guimarães, G., Lebecherel, L., Brigode, P., and Bourgin, P. Y.: Database of watershed-scale hydroclimatic observations in France, INRAE, https://webgr.inrae.fr/eng/Media/Files/base-de-donnees/bdd_hydroclim_manuel.pdf (last access: 31 December 2024), 2022.
Delaigue, O., Génot, B., Mendoza Guimarães, G., Lebecherel, L., Brigode, P., and Bourgin, P. Y.: BDD-HydroClim: Database of catchment-scale hydroclimatic observations in France, INRAE [data set], https://webgr.inrae.fr/outils/bases-de-donnees/bdd-hydroclim (last access: 30 January 2025), 2024.
de Lavenne, A. and Andréassian, V.: Impact of climate seasonality on catchment yield: A parameterization for commonly-used water balance formulas, J. Hydrol., 558, 266–274, https://doi.org/10.1016/j.jhydrol.2018.01.009, 2018.
de Lavenne, A., Andréassian, V., Crochemore, L., Lindström, G., and Arheimer, B.: Quantifying multi-year hydrological memory with Catchment Forgetting Curves, Hydrol. Earth Syst. Sci., 26, 2715–2732, https://doi.org/10.5194/hess-26-2715-2022, 2022.
de Marsily, G., Combes, P., and Goblet, P.: Comment on `Ground-water models cannot be validated', edited by: Konikow, L. F. and Bredehoeft, J. D., Adv. Water Resour., 15, 367–369, 1992.
Donnelly-Makowecki, L. M. and Moore, R. D.: Hierarchical testing of three rainfall–runoff models in small forested catchments, J. Hydrol., 219, 136–152, https://doi.org/10.1016/S0022-1694(99)00056-6, 1999.
Fowler, K. J. A., Peel, M. C., Western, A. W., Zhang, L., and Peterson, T. J.: Simulating runoff under changing climatic conditions: Revisiting an apparent deficiency of conceptual rainfall-runoff models, Water Resour. Res., 52, 1820–1846, https://doi.org/10.1002/2015WR018068, 2016.
Gelfan, A., Kalugin, A., Krylenko, I., Nasonova, O., Gusev, Y., and Kovalev, E.: Does a successful comprehensive evaluation increase confidence in a hydrological model intended for climate impact assessment?, Clim. Change, 163, 1165–1185, https://doi.org/10.1007/s10584-020-02930-z, 2020.
Gelfan, A. N. and Millionshchikova, T. D.: Validation of a Hydrological Model Intended for Impact Study: Problem Statement and Solution Example for Selenga River Basin, Water Resour., 45, 90–101, https://doi.org/10.1134/S0097807818050354, 2018.
Gharari, S., Hrachowitz, M., Fenicia, F., and Savenije, H. H. G.: An approach to identify time consistent model parameters: sub-period calibration, Hydrol. Earth Syst. Sci., 17, 149–161, https://doi.org/10.5194/hess-17-149-2013, 2013.
Graham, D. and Butts, M.: Flexible, integrated watershed modelling with MIKE SHE, in: Watershed Models, edited by: Singh, V. P. and Frevert, D. K., CRC Press, Boca Raton, 245–272, 2005.
Gupta, H. V., Kling, H., Yilmaz, K. K., and Martinez, G. F.: Decomposition of the mean squared error and NSE performance criteria: Implications for improving hydrological modelling, J. Hydrol., 377, 80–91, https://doi.org/10.1016/j.jhydrol.2009.08.003, 2009.
Henriksen, H. J., Jakobsen, A., Pasten-Zapata, E., Troldborg, L., and Sonnenborg, T. O.: Assessing the impacts of climate change on hydrological regimes and fish EQR in two Danish catchments, J. Hydrol., Reg. Stud., 34, 100798, https://doi.org/10.1016/j.ejrh.2021.100798, 2021.
Højberg, A. L., Troldborg, L., Stisen, S., Christensen, B. B. S., and Henriksen, H. J.: Stakeholder driven update and improvement of a national water resources model, Environ. Modell. Softw., 40, 202–213, https://doi.org/10.1016/j.envsoft.2012.09.010, 2013.
Hrachowitz, M. and Clark, M. P.: HESS Opinions: The complementary merits of competing modelling philosophies in hydrology, Hydrol. Earth Syst. Sci., 21, 3953–3973, https://doi.org/10.5194/hess-21-3953-2017, 2017.
Johansson, B.: Estimation of areal precipitation for hydrological modelling in Sweden, Göteborg: Göteborg university, ISSN 1400-3813, http://hdl.handle.net/2077/15575 (last access: 7 January 2025), 2002.
Klemeš, V.: Operational testing of hydrological simulation models, Hydrol. Sci. J., 31, 13–24, https://doi.org/10.1080/02626668609491024, 1986.
Lan, T., Lin, K., Xu, C.-Y., Tan, X., and Chen, X.: Dynamics of hydrological-model parameters: mechanisms, problems and solutions, Hydrol. Earth Syst. Sci., 24, 1347–1366, https://doi.org/10.5194/hess-24-1347-2020, 2020.
Leleu, I., Tonnelier, I., Puechberty, R., Gouin, P., Viquendi, I., Cobos, L., Foray, A., Baillon, M., and Ndima, P.-O.: La refonte du système d'information national pour la gestion et la mise à disposition des données hydrométriques, La Houille Blanche, 100, 25–32, https://doi.org/10.1051/lhb/2014004, 2014.
Lindström, G.: Lake water levels for calibration of the S-HYPE model, Hydrol. Res., 47, 672–682, https://doi.org/10.2166/nh.2016.019, 2016.
Lindström, G., Pers, C., Rosberg, J., Strömqvist, J., and Arheimer, B.: Development and testing of the HYPE (Hydrological Predictions for the Environment) water quality model for different spatial scales, Hydrol. Res., 41, 295–319, https://doi.org/10.2166/nh.2010.007, 2010.
Mann, H. B. and Whitney, D. R.: On a Test of Whether one of Two Random Variables is Stochastically Larger than the Other, Ann. Mathe. Stat., 18, 50–60, https://doi.org/10.1214/aoms/1177730491, 1947.
Montanari, A., Young, G., Savenije, H. H. G., Hughes, D., Wagener, T., Ren, L. L., Koutsoyiannis, D., Cudennec, C., Toth, E., Grimaldi, S., Blöschl, G., Sivapalan, M., Beven, K., Gupta, H., Hipsey, M., Schaefli, B., Arheimer, B., Boegh, E., Schymanski, S. J., Di Baldassarre, G., Yu, B., Hubert, P., Huang, Y., Schumann, A., Post, D. A., Srinivasan, V., Harman, C., Thompson, S., Rogger, M., Viglione, A., McMillan, H., Characklis, G., Pang, Z., and Belyaev, V.: “Panta Rhei – Everything Flows”: Change in hydrology and society – The IAHS Scientific Decade 2013–2022, Hydrol. Sci. J., 58, 1256–1275, https://doi.org/10.1080/02626667.2013.809088, 2013.
Nash, J. E. and Sutcliffe, J. V.: River flow forecasting through conceptual models part I – A discussion of principles, J. Hydrol., 10, 282–290, https://doi.org/10.1016/0022-1694(70)90255-6, 1970.
Nicolle, P., Andréassian, V., Royer-Gaspard, P., Perrin, C., Thirel, G., Coron, L., and Santos, L.: Technical note: RAT – a robustness assessment test for calibrated and uncalibrated hydrological models, Hydrol. Earth Syst. Sci., 25, 5013–5027, https://doi.org/10.5194/hess-25-5013-2021, 2021.
Oudin, L., Hervieu, F., Michel, C., Perrin, C., Andréassian, V., Anctil, F., and Loumagne, C.: Which potential evapotranspiration input for a lumped rainfall–runoff model?: Part 2 – Towards a simple and efficient potential evapotranspiration model for rainfall–runoff modelling, J. Hydrol., 303, 290–306, https://doi.org/10.1016/j.jhydrol.2004.08.026, 2005.
Pachauri, R. K., Allen, M. R., Barros, V. R., Broome, J., Cramer, W., Christ, R., Church, J. A., Clarke, L., Dahe, Q., and Dasgupta, P.: Climate change 2014: synthesis report. Contribution of Working Groups I, II and III to the fifth assessment report of the Intergovernmental Panel on Climate Change, edited by: Meyer, L. A., Ipcc, 151 pp., https://www.ipcc.ch/report/ar5/syr/ (last access: 30 December 2024), 2014.
Pelletier, A. and Andréassian, V.: Hydrograph separation: an impartial parametrisation for an imperfect method, Hydrol. Earth Syst. Sci., 24, 1171–1187, https://doi.org/10.5194/hess-24-1171-2020, 2020.
Perrin, C., Michel, C., and Andréassian, V.: Improvement of a parsimonious model for streamflow simulation, J. Hydrol., 279, 275–289, https://doi.org/10.1016/S0022-1694(03)00225-7, 2003.
Pushpalatha, R., Perrin, C., Le Moine, N., Mathevet, T., and Andréassian, V.: A downward structural sensitivity analysis of hydrological models to improve low-flow simulation, J. Hydrol., 411, 66–76, https://doi.org/10.1016/j.jhydrol.2011.09.034, 2011.
Rau, P., Bourrel, L., Labat, D., Ruelland, D., Frappart, F., Lavado, W., Dewitte, B., and Felipe, O.: Assessing multidecadal runoff (1970–2010) using regional hydrological modelling under data and water scarcity conditions in Peruvian Pacific catchments, Hydrol. Process., 33, 20–35, https://doi.org/10.1002/hyp.13318, 2019.
Refsgaard, J. C. and Knudsen, J.: Operational Validation and Intercomparison of Different Types of Hydrological Models, Water Resour. Res., 32, 2189–2202, https://doi.org/10.1029/96WR00896, 1996.
Refsgaard, J. C., Madsen, H., Andréassian, V., Arnbjerg-Nielsen, K., Davidson, T. A., Drews, M., Hamilton, D. P., Jeppesen, E., Kjellström, E., Olesen, J. E., Sonnenborg, T. O., Trolle, D., Willems, P., and Christensen, J. H.: A framework for testing the ability of models to project climate change and its impacts, Clim. Change, 122, 271–282, https://doi.org/10.1007/s10584-013-0990-2, 2014.
SCHAPI: Hydroportail, Site de référence d'accès aux données hydrométriques et hydrologiques en France, eaufrance [data set], https://www.hydro.eaufrance.fr/ (last access: 20 January 2025), Service central d'hydrométéorologie et d'appui à la prévision des inondations (SCHAPI), 2022.
Scharling, M.: Climate Grid Denmark: Precipitation, air temperature and potential evapotranspiration 20×20 and 40×40 km, Danish Meteorological Institute, 48 pp., https://www.dmi.dk/fileadmin/user_upload/Rapporter/TR/1999/tr99-12.pdf (last access: 31 December 2024), 1999.
Scharling, M. and Kern-Hansen, C.: Climate Grid Denmark, Dataset for use in research and education, Daily and monthly values 1989–2010, 10×10 km precipitation sum, 20×20 km average temperature, accumulated potential evaporation (Makkink), average wind speed, accumulated global radiation., Danish Meteorological Institute, https://www.dmi.dk/fileadmin/Rapporter/TR/tr12-10.pdf (last access: 31 December 2024), 2012.
Seibert, J.: Reliability of Model Predictions Outside Calibration Conditions: Paper presented at the Nordic Hydrological Conference (Røros, Norway 4–7 August 2002), Hydrol. Res., 34, 477–492, https://doi.org/10.2166/nh.2003.0019, 2003.
Sleziak, P., Szolgay, J., Hlavčová, K., Duethmann, D., Parajka, J., and Danko, M.: Factors controlling alterations in the performance of a runoff model in changing climate conditions, J. Hydrol. Hydromechan., 66, 381–392, https://doi.org/10.2478/johh-2018-0031, 2018.
Stephens, C. M., Marshall, L. A., and Johnson, F. M.: Investigating strategies to improve hydrologic model performance in a changing climate, J. Hydrol., 579, 124219, https://doi.org/10.1016/j.jhydrol.2019.124219, 2019.
Stisen, S., Sonnenborg, T. O., Højberg, A. L., Troldborg, L., and Refsgaard, J. C.: Evaluation of Climate Input Biases and Water Balance Issues Using a Coupled Surface–Subsurface Model, Vadose Zone J., 10, 37–53, https://doi.org/10.2136/vzj2010.0001, 2011.
Strömqvist, J., Arheimer, B., Dahné, J., Donnelly, C., and Lindström, G.: Water and nutrient predictions in ungauged basins: set-up and evaluation of a model at the national scale, Hydrol. Sci. J., 57, 229–247, https://doi.org/10.1080/02626667.2011.637497, 2012.
Thirel, G., Andréassian, V., Perrin, C., Audouy, J.-N., Berthet, L., Edwards, P., Folton, N., Furusho, C., Kuentz, A., Lerat, J., Lindström, G., Martin, E., Mathevet, T., Merz, R., Parajka, J., Ruelland, D., and Vaze, J.: Hydrology under change: an evaluation protocol to investigate how hydrological models deal with changing catchments, Hydrol. Sci. J., 60, 1184–1199, https://doi.org/10.1080/02626667.2014.967248, 2015.
Valéry, A., Andréassian, V., and Perrin, C.: “As simple as possible but not simpler”: What is useful in a temperature-based snow-accounting routine? Part 2 – Sensitivity analysis of the Cemaneige snow accounting routine on 380 catchments, J. Hydrol., 517, 1176–1187, https://doi.org/10.1016/j.jhydrol.2014.04.058, 2014.
van Roosmalen, L., Christensen, B. S. B., and Sonnenborg, T. O.: Regional Differences in Climate Change Impacts on Groundwater and Stream Discharge in Denmark, Vadose Zone J., 6, 554–571, https://doi.org/10.2136/vzj2006.0093, 2007.
Vaze, J., Post, D. A., Chiew, F. H. S., Perraud, J.-M., Viney, N. R., and Teng, J.: Climate non-stationarity – Validity of calibrated rainfall–runoff models for use in climate change studies, J. Hydrol., 394, 447–457, https://doi.org/10.1016/j.jhydrol.2010.09.018, 2010.
Vidal, J.-P., Martin, E., Franchistéguy, L., Baillon, M., and Soubeyroux, J.-M.: A 50-year high-resolution atmospheric reanalysis over France with the Safran system, Int. J. Climatol., 30, 1627–1644, https://doi.org/10.1002/joc.2003, 2010.
Westerberg, I. K. and McMillan, H. K.: Uncertainty in hydrological signatures, Hydrol. Earth Syst. Sci., 19, 3951–3968, https://doi.org/10.5194/hess-19-3951-2015, 2015.
Westra, S., Thyer, M., Leonard, M., Kavetski, D., and Lambert, M.: A strategy for diagnosing and interpreting hydrological model nonstationarity, Water Resour. Res., 50, 5090–5113, https://doi.org/10.1002/2013WR014719, 2014.
Wilcoxon, F.: Individual Comparisons by Ranking Methods, Biometrics Bull., 1, 80–83, https://doi.org/10.2307/3001968, 1945.
Xu, C.: Operational testing of a water balance model for predicting climate change impacts, Agr. Forest Meteorol., 98–99, 295–304, https://doi.org/10.1016/S0168-1923(99)00106-9, 1999.
Zeng, L., Xiong, L., Liu, D., Chen, J., and Kim, J.-S.: Improving Parameter Transferability of GR4J Model under Changing Environments Considering Nonstationarity, Water, 11, 2029, https://doi.org/10.3390/w11102029, 2019.
Short summary
This work investigates how hydrological models are transferred to a period in which climate conditions are different to the ones of the period in which they were set up. The robustness assessment test built to detect dependencies between model error and climatic drivers was applied to three hydrological models in 352 catchments in Denmark, France and Sweden. Potential issues are seen in a significant number of catchments for the models, even though the catchments differ for each model.
This work investigates how hydrological models are transferred to a period in which climate...
