Articles | Volume 25, issue 9
https://doi.org/10.5194/hess-25-5013-2021
© Author(s) 2021. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
https://doi.org/10.5194/hess-25-5013-2021
© Author(s) 2021. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Technical note
| 
17 Sep 2021
Technical note |
| 17 Sep 2021
| 17 Sep 2021
Technical note: RAT – a robustness assessment test for calibrated and uncalibrated hydrological models
Pierre Nicolle
Université Paris-Saclay, INRAE, UR HYCAR, Antony, France
now at: Laboratoire Eau & Environnement, Université Gustave Eiffel, Nantes, France
Vazken Andréassian
CORRESPONDING AUTHOR
Université Paris-Saclay, INRAE, UR HYCAR, Antony, France
Paul Royer-Gaspard
Université Paris-Saclay, INRAE, UR HYCAR, Antony, France
Charles Perrin
Université Paris-Saclay, INRAE, UR HYCAR, Antony, France
Guillaume Thirel
Université Paris-Saclay, INRAE, UR HYCAR, Antony, France
Laurent Coron
EDF, DTG, Toulouse, France
Léonard Santos
Université Paris-Saclay, INRAE, UR HYCAR, Antony, France
Related authors
Juliette Godet, Pierre Nicolle, Nabil Hocini, Eric Gaume, Philippe Davy, Frederic Pons, Pierre Javelle, Pierre-André Garambois, Dimitri Lague, and Olivier Payrastre
Earth Syst. Sci. Data, 17, 2963–2983, https://doi.org/10.5194/essd-17-2963-2025, https://doi.org/10.5194/essd-17-2963-2025, 2025
Short summary
Short summary
This paper describes a dataset that includes input, output, and validation data for the simulation of flash flood hazards and three specific flash flood events in the French Mediterranean region. This dataset is particularly valuable as flood mapping methods often lack sufficient benchmark data. Additionally, we demonstrate how the hydraulic method we used, named Floodos, produces highly satisfactory results.
Juliette Godet, Eric Gaume, Pierre Javelle, Thomas Dias, Pierre Nicolle, and Olivier Payrastre
Abstr. Int. Cartogr. Assoc., 9, 16, https://doi.org/10.5194/ica-abs-9-16-2025, https://doi.org/10.5194/ica-abs-9-16-2025, 2025
Juliette Godet, Eric Gaume, Pierre Javelle, Pierre Nicolle, and Olivier Payrastre
Hydrol. Earth Syst. Sci., 28, 1403–1413, https://doi.org/10.5194/hess-28-1403-2024, https://doi.org/10.5194/hess-28-1403-2024, 2024
Short summary
Short summary
This work was performed in order to precisely address a point that is often neglected by hydrologists: the allocation of points located on a river network to grid cells, which is often a mandatory step for hydrological modelling.
Maryse Charpentier-Noyer, Daniela Peredo, Axelle Fleury, Hugo Marchal, François Bouttier, Eric Gaume, Pierre Nicolle, Olivier Payrastre, and Maria-Helena Ramos
Nat. Hazards Earth Syst. Sci., 23, 2001–2029, https://doi.org/10.5194/nhess-23-2001-2023, https://doi.org/10.5194/nhess-23-2001-2023, 2023
Short summary
Short summary
This paper proposes a methodological framework designed for event-based evaluation in the context of an intense flash-flood event. The evaluation adopts the point of view of end users, with a focus on the anticipation of exceedances of discharge thresholds. With a study of rainfall forecasts, a discharge evaluation and a detailed look at the forecast hydrographs, the evaluation framework should help in drawing robust conclusions about the usefulness of new rainfall ensemble forecasts.
Pierre Nicolle, François Besson, Olivier Delaigue, Pierre Etchevers, Didier François, Matthieu Le Lay, Charles Perrin, Fabienne Rousset, Dominique Thiéry, François Tilmant, Claire Magand, Timothée Leurent, and Élise Jacob
Proc. IAHS, 383, 381–389, https://doi.org/10.5194/piahs-383-381-2020, https://doi.org/10.5194/piahs-383-381-2020, 2020
Léonard Santos, Anthony Thomas, Gaëlle Tallec, Laurent Mounereau, Aaron Bluche, Bruno Lemaire, Rania Louafi, and Guillaume Thirel
EGUsphere, https://doi.org/10.5194/egusphere-2025-4197, https://doi.org/10.5194/egusphere-2025-4197, 2025
This preprint is open for discussion and under review for Hydrology and Earth System Sciences (HESS).
Short summary
Short summary
Water resources will be heavily impacted by climate change in the future, with low flows and water demand satisfaction expected to decline. This study uses an integrated water resources management model to examine future water demand scenarios, revealing that climate change will be the primary driver of changes. While adapting water uses could mitigate negative impacts, this will not be enough to adapt to climate change. The irrigation sector is expected to be the most impacted.
Guillaume Evin, Benoit Hingray, Guillaume Thirel, Agnès Ducharne, Laurent Strohmenger, Lola Corre, Yves Tramblay, Jean-Philippe Vidal, Jérémie Bonneau, François Colleoni, Joël Gailhard, Florence Habets, Frédéric Hendrickx, Louis Héraut, Peng Huang, Matthieu Le Lay, Claire Magand, Paola Marson, Céline Monteil, Simon Munier, Alix Reverdy, Jean-Michel Soubeyroux, Yoann Robin, Jean-Pierre Vergnes, Mathieu Vrac, and Eric Sauquet
EGUsphere, https://doi.org/10.5194/egusphere-2025-2727, https://doi.org/10.5194/egusphere-2025-2727, 2025
This preprint is open for discussion and under review for Hydrology and Earth System Sciences (HESS).
Short summary
Short summary
Explore2 provides hydrological projections for 1,735 French catchments. Using QUALYPSO, this study assesses uncertainties, including internal variability. By the end of the century, low flows are projected to decline in southern France under high emissions, while other indicators remain uncertain. Emission scenarios and regional climate models are key uncertainty sources. Internal variability is often as large as climate-driven changes.
Taha-Abderrahman El Ouahabi, François Bourgin, Charles Perrin, and Vazken Andréassian
EGUsphere, https://doi.org/10.5194/egusphere-2025-3586, https://doi.org/10.5194/egusphere-2025-3586, 2025
This preprint is open for discussion and under review for Hydrology and Earth System Sciences (HESS).
Short summary
Short summary
To improve hydrological uncertainty estimation, recent studies have explored machine learning (ML)-based post-processing approaches. Among these, quantile random forests (QRF) are increasingly used for their balance between interpretability and performance. We develop a hydrologically informed QRF trained in a multi-site setting. Our results show that the regional QRF approach is beneficial, particularly in catchments where local information is insufficient.
Juliette Godet, Pierre Nicolle, Nabil Hocini, Eric Gaume, Philippe Davy, Frederic Pons, Pierre Javelle, Pierre-André Garambois, Dimitri Lague, and Olivier Payrastre
Earth Syst. Sci. Data, 17, 2963–2983, https://doi.org/10.5194/essd-17-2963-2025, https://doi.org/10.5194/essd-17-2963-2025, 2025
Short summary
Short summary
This paper describes a dataset that includes input, output, and validation data for the simulation of flash flood hazards and three specific flash flood events in the French Mediterranean region. This dataset is particularly valuable as flood mapping methods often lack sufficient benchmark data. Additionally, we demonstrate how the hydraulic method we used, named Floodos, produces highly satisfactory results.
Eric Sauquet, Guillaume Evin, Sonia Siauve, Ryma Aissat, Patrick Arnaud, Maud Bérel, Jérémie Bonneau, Flora Branger, Yvan Caballero, François Colléoni, Agnès Ducharne, Joël Gailhard, Florence Habets, Frédéric Hendrickx, Louis Héraut, Benoît Hingray, Peng Huang, Tristan Jaouen, Alexis Jeantet, Sandra Lanini, Matthieu Le Lay, Claire Magand, Louise Mimeau, Céline Monteil, Simon Munier, Charles Perrin, Olivier Robelin, Fabienne Rousset, Jean-Michel Soubeyroux, Laurent Strohmenger, Guillaume Thirel, Flore Tocquer, Yves Tramblay, Jean-Pierre Vergnes, and Jean-Philippe Vidal
EGUsphere, https://doi.org/10.5194/egusphere-2025-1788, https://doi.org/10.5194/egusphere-2025-1788, 2025
This preprint is open for discussion and under review for Hydrology and Earth System Sciences (HESS).
Short summary
Short summary
The Explore2 project has provided an unprecedented set of hydrological projections in terms of the number of hydrological models used and the spatial and temporal resolution. The results have been made available through various media. Under the high-emission scenario, the hydrological models mostly agree on the decrease in seasonal flows in the south of France, confirming its hotspot status, and on the decrease in summer flows throughout France, with the exception of the northern part of France.
Yves Tramblay, Guillaume Thirel, Laurent Strohmenger, Guillaume Evin, Lola Corre, Louis Heraut, and Eric Sauquet
EGUsphere, https://doi.org/10.5194/egusphere-2025-1635, https://doi.org/10.5194/egusphere-2025-1635, 2025
Short summary
Short summary
How climate change impacts floods in France? Using simulations for 3000 rivers in climate projections, results show that flood trends vary depending on the region. In the north, floods may become more severe, but in many other areas, the trends are mixed. Floods from intense rainfall are becoming more frequent, while snowmelt floods are strongly decreasing. Overall, the study shows that understanding what causes floods is key to predicting how they are likely to change with the climate.
Olivier Delaigue, Guilherme Mendoza Guimarães, Pierre Brigode, Benoît Génot, Charles Perrin, Jean-Michel Soubeyroux, Bruno Janet, Nans Addor, and Vazken Andréassian
Earth Syst. Sci. Data, 17, 1461–1479, https://doi.org/10.5194/essd-17-1461-2025, https://doi.org/10.5194/essd-17-1461-2025, 2025
Short summary
Short summary
This dataset covers 654 rivers all flowing in France. The provided time series and catchment attributes will be of interest to those modelers wishing to analyze hydrological behavior and perform model assessments.
Juliette Godet, Eric Gaume, Pierre Javelle, Thomas Dias, Pierre Nicolle, and Olivier Payrastre
Abstr. Int. Cartogr. Assoc., 9, 16, https://doi.org/10.5194/ica-abs-9-16-2025, https://doi.org/10.5194/ica-abs-9-16-2025, 2025
Vazken Andréassian, Guilherme Mendoza Guimarães, Alban de Lavenne, and Julien Lerat
EGUsphere, https://doi.org/10.5194/egusphere-2025-414, https://doi.org/10.5194/egusphere-2025-414, 2025
Short summary
Short summary
Using 4122 catchments from four continents, we investigate how annual streamflow depends on climate variables (rainfall and potential evaporation) and on the season when precipitation occurs, using and index representing the synchronicity between precipitation and potential evaporation. In all countries and under the main climates represented, synchronicity is, after precipitation, the second most important factor to explain annual streamflow variations.
Léonard Santos, Vazken Andréassian, Torben O. Sonnenborg, Göran Lindström, Alban de Lavenne, Charles Perrin, Lila Collet, and Guillaume Thirel
Hydrol. Earth Syst. Sci., 29, 683–700, https://doi.org/10.5194/hess-29-683-2025, https://doi.org/10.5194/hess-29-683-2025, 2025
Short summary
Short summary
This work investigates how hydrological models are transferred to a period in which climate conditions are different to the ones of the period in which they were set up. The robustness assessment test built to detect dependencies between model error and climatic drivers was applied to three hydrological models in 352 catchments in Denmark, France and Sweden. Potential issues are seen in a significant number of catchments for the models, even though the catchments differ for each model.
Guillaume Thirel, Léonard Santos, Olivier Delaigue, and Charles Perrin
Hydrol. Earth Syst. Sci., 28, 4837–4860, https://doi.org/10.5194/hess-28-4837-2024, https://doi.org/10.5194/hess-28-4837-2024, 2024
Short summary
Short summary
We discuss how mathematical transformations impact calibrated hydrological model simulations. We assess how 11 transformations behave over the complete range of streamflows. Extreme transformations lead to models that are specialized for extreme streamflows but show poor performance outside the range of targeted streamflows and are less robust. We show that no a priori assumption about transformations can be taken as warranted.
Thibault Hallouin, François Bourgin, Charles Perrin, Maria-Helena Ramos, and Vazken Andréassian
Geosci. Model Dev., 17, 4561–4578, https://doi.org/10.5194/gmd-17-4561-2024, https://doi.org/10.5194/gmd-17-4561-2024, 2024
Short summary
Short summary
The evaluation of the quality of hydrological model outputs against streamflow observations is widespread in the hydrological literature. In order to improve on the reproducibility of published studies, a new evaluation tool dedicated to hydrological applications is presented. It is open source and usable in a variety of programming languages to make it as accessible as possible to the community. Thus, authors and readers alike can use the same tool to produce and reproduce the results.
Ralph Bathelemy, Pierre Brigode, Vazken Andréassian, Charles Perrin, Vincent Moron, Cédric Gaucherel, Emmanuel Tric, and Dominique Boisson
Earth Syst. Sci. Data, 16, 2073–2098, https://doi.org/10.5194/essd-16-2073-2024, https://doi.org/10.5194/essd-16-2073-2024, 2024
Short summary
Short summary
The aim of this work is to provide the first hydroclimatic database for Haiti, a Caribbean country particularly vulnerable to meteorological and hydrological hazards. The resulting database, named Simbi, provides hydroclimatic time series for around 150 stations and 24 catchment areas.
Cyril Thébault, Charles Perrin, Vazken Andréassian, Guillaume Thirel, Sébastien Legrand, and Olivier Delaigue
Hydrol. Earth Syst. Sci., 28, 1539–1566, https://doi.org/10.5194/hess-28-1539-2024, https://doi.org/10.5194/hess-28-1539-2024, 2024
Short summary
Short summary
Streamflow forecasting is useful for many applications, ranging from population safety (e.g. floods) to water resource management (e.g. agriculture or hydropower). To this end, hydrological models must be optimized. However, a model is inherently wrong. This study aims to analyse the contribution of a multi-model approach within a variable spatial framework to improve streamflow simulations. The underlying idea is to take advantage of the strength of each modelling framework tested.
Nils Poncet, Philippe Lucas-Picher, Yves Tramblay, Guillaume Thirel, Humberto Vergara, Jonathan Gourley, and Antoinette Alias
Nat. Hazards Earth Syst. Sci., 24, 1163–1183, https://doi.org/10.5194/nhess-24-1163-2024, https://doi.org/10.5194/nhess-24-1163-2024, 2024
Short summary
Short summary
High-resolution convection-permitting climate models (CPMs) are now available to better simulate rainstorm events leading to flash floods. In this study, two hydrological models are compared to simulate floods in a Mediterranean basin, showing a better ability of the CPM to reproduce flood peaks compared to coarser-resolution climate models. Future projections are also different, with a projected increase for the most severe floods and a potential decrease for the most frequent events.
Juliette Godet, Eric Gaume, Pierre Javelle, Pierre Nicolle, and Olivier Payrastre
Hydrol. Earth Syst. Sci., 28, 1403–1413, https://doi.org/10.5194/hess-28-1403-2024, https://doi.org/10.5194/hess-28-1403-2024, 2024
Short summary
Short summary
This work was performed in order to precisely address a point that is often neglected by hydrologists: the allocation of points located on a river network to grid cells, which is often a mandatory step for hydrological modelling.
Laurent Strohmenger, Eric Sauquet, Claire Bernard, Jérémie Bonneau, Flora Branger, Amélie Bresson, Pierre Brigode, Rémy Buzier, Olivier Delaigue, Alexandre Devers, Guillaume Evin, Maïté Fournier, Shu-Chen Hsu, Sandra Lanini, Alban de Lavenne, Thibault Lemaitre-Basset, Claire Magand, Guilherme Mendoza Guimarães, Max Mentha, Simon Munier, Charles Perrin, Tristan Podechard, Léo Rouchy, Malak Sadki, Myriam Soutif-Bellenger, François Tilmant, Yves Tramblay, Anne-Lise Véron, Jean-Philippe Vidal, and Guillaume Thirel
Hydrol. Earth Syst. Sci., 27, 3375–3391, https://doi.org/10.5194/hess-27-3375-2023, https://doi.org/10.5194/hess-27-3375-2023, 2023
Short summary
Short summary
We present the results of a large visual inspection campaign of 674 streamflow time series in France. The objective was to detect non-natural records resulting from instrument failure or anthropogenic influences, such as hydroelectric power generation or reservoir management. We conclude that the identification of flaws in flow time series is highly dependent on the objectives and skills of individual evaluators, and we raise the need for better practices for data cleaning.
Olivier Delaigue, Pierre Brigode, Guillaume Thirel, and Laurent Coron
Hydrol. Earth Syst. Sci., 27, 3293–3327, https://doi.org/10.5194/hess-27-3293-2023, https://doi.org/10.5194/hess-27-3293-2023, 2023
Short summary
Short summary
Teaching hydrological modeling is an important, but difficult, matter. It requires appropriate tools and teaching material. In this article, we present the airGRteaching package, which is an open-source software tool relying on widely used hydrological models. This tool proposes an interface and numerous hydrological modeling exercises representing a wide range of hydrological applications. We show how this tool can be applied to simple but real-life cases.
Maryse Charpentier-Noyer, Daniela Peredo, Axelle Fleury, Hugo Marchal, François Bouttier, Eric Gaume, Pierre Nicolle, Olivier Payrastre, and Maria-Helena Ramos
Nat. Hazards Earth Syst. Sci., 23, 2001–2029, https://doi.org/10.5194/nhess-23-2001-2023, https://doi.org/10.5194/nhess-23-2001-2023, 2023
Short summary
Short summary
This paper proposes a methodological framework designed for event-based evaluation in the context of an intense flash-flood event. The evaluation adopts the point of view of end users, with a focus on the anticipation of exceedances of discharge thresholds. With a study of rainfall forecasts, a discharge evaluation and a detailed look at the forecast hydrographs, the evaluation framework should help in drawing robust conclusions about the usefulness of new rainfall ensemble forecasts.
Eva Sebok, Hans Jørgen Henriksen, Ernesto Pastén-Zapata, Peter Berg, Guillaume Thirel, Anthony Lemoine, Andrea Lira-Loarca, Christiana Photiadou, Rafael Pimentel, Paul Royer-Gaspard, Erik Kjellström, Jens Hesselbjerg Christensen, Jean Philippe Vidal, Philippe Lucas-Picher, Markus G. Donat, Giovanni Besio, María José Polo, Simon Stisen, Yvan Caballero, Ilias G. Pechlivanidis, Lars Troldborg, and Jens Christian Refsgaard
Hydrol. Earth Syst. Sci., 26, 5605–5625, https://doi.org/10.5194/hess-26-5605-2022, https://doi.org/10.5194/hess-26-5605-2022, 2022
Short summary
Short summary
Hydrological models projecting the impact of changing climate carry a lot of uncertainty. Thus, these models usually have a multitude of simulations using different future climate data. This study used the subjective opinion of experts to assess which climate and hydrological models are the most likely to correctly predict climate impacts, thereby easing the computational burden. The experts could select more likely hydrological models, while the climate models were deemed equally probable.
Alban de Lavenne, Vazken Andréassian, Louise Crochemore, Göran Lindström, and Berit Arheimer
Hydrol. Earth Syst. Sci., 26, 2715–2732, https://doi.org/10.5194/hess-26-2715-2022, https://doi.org/10.5194/hess-26-2715-2022, 2022
Short summary
Short summary
A watershed remembers the past to some extent, and this memory influences its behavior. This memory is defined by the ability to store past rainfall for several years. By releasing this water into the river or the atmosphere, it tends to forget. We describe how this memory fades over time in France and Sweden. A few watersheds show a multi-year memory. It increases with the influence of groundwater or dry conditions. After 3 or 4 years, they behave independently of the past.
Antoine Pelletier and Vazken Andréassian
Hydrol. Earth Syst. Sci., 26, 2733–2758, https://doi.org/10.5194/hess-26-2733-2022, https://doi.org/10.5194/hess-26-2733-2022, 2022
Short summary
Short summary
A large part of the water cycle takes place underground. In many places, the soil stores water during the wet periods and can release it all year long, which is particularly visible when the river level is low. Modelling tools that are used to simulate and forecast the behaviour of the river struggle to represent this. We improved an existing model to take underground water into account using measurements of the soil water content. Results allow us make recommendations for model users.
Thibault Lemaitre-Basset, Ludovic Oudin, Guillaume Thirel, and Lila Collet
Hydrol. Earth Syst. Sci., 26, 2147–2159, https://doi.org/10.5194/hess-26-2147-2022, https://doi.org/10.5194/hess-26-2147-2022, 2022
Short summary
Short summary
Increasing temperature will impact evaporation and water resource management. Hydrological models are fed with an estimation of the evaporative demand of the atmosphere, called potential evapotranspiration (PE). The objectives of this study were (1) to compute the future PE anomaly over France and (2) to determine the impact of the choice of the method to estimate PE. Our results show that all methods present similar future trends. No method really stands out from the others.
Paul Royer-Gaspard, Vazken Andréassian, and Guillaume Thirel
Hydrol. Earth Syst. Sci., 25, 5703–5716, https://doi.org/10.5194/hess-25-5703-2021, https://doi.org/10.5194/hess-25-5703-2021, 2021
Short summary
Short summary
Most evaluation studies based on the differential split-sample test (DSST) endorse the consensus that rainfall–runoff models lack climatic robustness. In this technical note, we propose a new performance metric to evaluate model robustness without applying the DSST and which can be used with a single hydrological model calibration. Our work makes it possible to evaluate the temporal transferability of any hydrological model, including uncalibrated models, at a very low computational cost.
Alexis Jeantet, Hocine Henine, Cédric Chaumont, Lila Collet, Guillaume Thirel, and Julien Tournebize
Hydrol. Earth Syst. Sci., 25, 5447–5471, https://doi.org/10.5194/hess-25-5447-2021, https://doi.org/10.5194/hess-25-5447-2021, 2021
Short summary
Short summary
The hydrological subsurface drainage model SIDRA-RU is assessed at the French national scale, using a unique database representing the large majority of the French drained areas. The model is evaluated following its capacity to simulate the drainage discharge variability and the annual drained water balance. Eventually, the temporal robustness of SIDRA-RU is assessed to demonstrate the utility of this model as a long-term management tool.
Paul C. Astagneau, Guillaume Thirel, Olivier Delaigue, Joseph H. A. Guillaume, Juraj Parajka, Claudia C. Brauer, Alberto Viglione, Wouter Buytaert, and Keith J. Beven
Hydrol. Earth Syst. Sci., 25, 3937–3973, https://doi.org/10.5194/hess-25-3937-2021, https://doi.org/10.5194/hess-25-3937-2021, 2021
Short summary
Short summary
The R programming language has become an important tool for many applications in hydrology. In this study, we provide an analysis of some of the R tools providing hydrological models. In total, two aspects are uniformly investigated, namely the conceptualisation of the models and the practicality of their implementation for end-users. These comparisons aim at easing the choice of R tools for users and at improving their usability for hydrology modelling to support more transferable research.
Laurène J. E. Bouaziz, Fabrizio Fenicia, Guillaume Thirel, Tanja de Boer-Euser, Joost Buitink, Claudia C. Brauer, Jan De Niel, Benjamin J. Dewals, Gilles Drogue, Benjamin Grelier, Lieke A. Melsen, Sotirios Moustakas, Jiri Nossent, Fernando Pereira, Eric Sprokkereef, Jasper Stam, Albrecht H. Weerts, Patrick Willems, Hubert H. G. Savenije, and Markus Hrachowitz
Hydrol. Earth Syst. Sci., 25, 1069–1095, https://doi.org/10.5194/hess-25-1069-2021, https://doi.org/10.5194/hess-25-1069-2021, 2021
Short summary
Short summary
We quantify the differences in internal states and fluxes of 12 process-based models with similar streamflow performance and assess their plausibility using remotely sensed estimates of evaporation, snow cover, soil moisture and total storage anomalies. The dissimilarities in internal process representation imply that these models cannot all simultaneously be close to reality. Therefore, we invite modelers to evaluate their models using multiple variables and to rely on multi-model studies.
Manon Cassagnole, Maria-Helena Ramos, Ioanna Zalachori, Guillaume Thirel, Rémy Garçon, Joël Gailhard, and Thomas Ouillon
Hydrol. Earth Syst. Sci., 25, 1033–1052, https://doi.org/10.5194/hess-25-1033-2021, https://doi.org/10.5194/hess-25-1033-2021, 2021
Pierre Nicolle, François Besson, Olivier Delaigue, Pierre Etchevers, Didier François, Matthieu Le Lay, Charles Perrin, Fabienne Rousset, Dominique Thiéry, François Tilmant, Claire Magand, Timothée Leurent, and Élise Jacob
Proc. IAHS, 383, 381–389, https://doi.org/10.5194/piahs-383-381-2020, https://doi.org/10.5194/piahs-383-381-2020, 2020
Cited articles
Andréassian, V., Perrin, C., Berthet, L., Le Moine, N., Lerat, J., Loumagne, C., Oudin, L., Mathevet, T., Ramos, M.-H., and Valéry, A.: HESS Opinions ”Crash tests for a standardized evaluation of hydrological models”, Hydrol. Earth Syst. Sci., 13, 1757–1764, https://doi.org/10.5194/hess-13-1757-2009, 2009.
Andréassian, V., Le Moine, N., Perrin, C., Ramos, M.-H., Oudin, L.,
Mathevet, T., Lerat, J., and Berthet, L.: All that glitters is not gold: the case
of calibrating hydrological models, Hydrol Process., 26, 2206–2210,
https://doi.org/10.1002/hyp.9264, 2012.
Bellprat, O., Kotlarski, S., Lüthi, D., and Schär, C.: Physical
constraints for temperature biases in climate models: limits of temperature
biases, Geophys. Res. Lett., 40, 4042–4047, https://doi.org/10.1002/grl.50737, 2013.
Beven, K.: Facets of uncertainty: epistemic uncertainty, non-stationarity,
likelihood, hypothesis testing, and communication, Hydrol. Sci. J., 61,
1652–1665, https://doi.org/10.1080/02626667.2015.1031761, 2016.
Bisselink, B., Zambrano-Bigiarini, M., Burek, P., and de Roo, A.: Assessing
the role of uncertain precipitation estimates on the robustness of
hydrological model parameters under highly variable climate conditions, J.
Hydrol.-Regional Studies, 8, 112–129, https://doi.org/10.1016/j.ejrh.2016.09.003, 2016.
Blöschl, G., Bierkens, M. F. P., Chambel, A., et al.: Twenty-three Unsolved Problems in Hydrology – a
community perspective, Hydrol. Sci. J., 64, 1141–1158, https://doi.org/10.1080/02626667.2019.1620507, 2019.
Brigode, P., Paquet, E., Bernardara, P., Gailhard, J., Garavaglia, F., Ribstein, P., Bourgin, F., Perrin, C., and Andréassian, V.: Dependence of model-based extreme flood estimation on
the calibration period: case study of the Kamp River (Austria), Hydrol. Sci.
J., 60, 1424–1437, https://doi.org/10.1080/02626667.2015.1006632, 2015.
Broderick, C., Matthews, T., Wilby, R. L., Bastola, S., and Murphy, C.:
Transferability of hydrological models and ensemble averaging methods
between contrasting climatic periods, Water Resour. Res., 52, 8343–8373,
https://doi.org/10.1002/2016WR018850, 2016.
Coron, L., Andréassian, V., Perrin, C., Lerat, J., Vaze, J., Bourqui,
M., and Hendrickx, F.: Crash testing hydrological models in contrasted
climate conditions: An experiment on 216 Australian catchments, Water Resour.
Res., 48, W05552, https://doi.org/10.1029/2011WR011721, 2012.
Coron, L., Andréassian, V., Perrin, C., Bourqui, M., and Hendrickx, F.: On the lack of robustness of hydrologic models regarding water balance simulation: a diagnostic approach applied to three models of increasing complexity on 20 mountainous catchments, Hydrol. Earth Syst. Sci., 18, 727–746, https://doi.org/10.5194/hess-18-727-2014, 2014.
Coron, L., Andréassian, V., Bourqui, M., Perrin, C., and Hendrickx, F.:
Pathologies of hydrological models used in changing climatic conditions: a
review, in: Hydro-climatology: Variability and Change, edited by: Franks, S., Boegh, E., Blyth, E., Hannah, D., and Yilmaz, K., IAHS Red Books Series, IAHS, Wallingford,
344, 39–44, 2016.
Coron, L., Thirel, G., Delaigue, O., Perrin, C., and Andréassian, V.: The
Suite of Lumped GR Hydrological Models in an R package. Environ. Model.
Softw., 94, 337, https://doi.org/10.1016/j.envsoft.2017.05.002,
2017.
Coron, L., Delaigue, O., Thirel, G., Perrin, C., and Michel, C.: airGR: Suite
of GR Hydrological Models for Precipitation-Runoff Modelling, R package
version 1.4.3.65, https://doi.org/10.15454/ex11na, 2020.
Dakhlaoui, H., Ruelland, D., Tramblay, Y., and Bargaoui, Z.: Evaluating the
robustness of conceptual rainfall-runoff models under climate variability in
northern Tunisia, J. Hydrol., 550, 201–217, https://doi.org/10.1016/j.jhydrol.2017.04.032, 2017.
Dakhlaoui, H., Ruelland, D., and Tramblay, Y.: A bootstrap-based differential
split-sample test to assess the transferability of conceptual
rainfall-runoff models under past and future climate variability, J. Hydrol.,
575, 470–486, https://doi.org/10.1016/j.jhydrol.2019.05.056,
2019.
Delaigue, O., Génot, Lebecherel, L., Brigode, P., and Bourgin, P. Y.: Base
de données hydroclimatiques observées à l'échelle de la
France. IRSTEA. IRSTEA, UR HYCAR, Équipe Hydrologie des bassins
versants, Antony, available at:
https://webgr.inrae.fr/en/activities/database-1-2/ (last access: 1 September 2021), 2018.
Donelly-Makowecki, L. M. and Moore, R. D.: Hierarchical testing of three
rainfall-runoff models in small forested catchments, J. Hydrol., 219, 136–152,
1999.
Efstratiadis, A., Nalbantis, I., and Koutsoyiannis, D.: Hydrological
modelling of temporally-varying catchments: facets of change and the value
of information, Hydrol. Sci. J., 60, 1438–1461, https://doi.org/10.1080/02626667.2014.982123, 2015.
Fowler, K., Coxon, G., Freer, J., Peel, M., Wagener, T., Western, A., Woods, R., and Zhang, L.: Simulating Runoff Under Changing Climatic Conditions: A
Framework for Model Improvement, Water Resour. Res., 54, 9812–9832, https://doi.org/10.1029/2018WR023989, 2018.
Gaborit, É., Ricard, S., Lachance-Cloutier, S., Anctil, F., and
Turcotte, R.: Comparing global and local calibration schemes from a
differential split-sample test perspective, Can. J. Earth Sci., 52, 990–999,
https://doi.org/10.1139/cjes-2015-0015, 2015.
Gelfan, A., Motovilov, Y., Krylenko, I., Moreido, V., and Zakharova, E.:
Testing robustness of the physically-based ECOMAG model with respect to
changing conditions, Hydrol. Sci. J., 60, 1266–1285, https://doi.org/10.1080/02626667.2014.935780, 2015.
Gelfan, A. N. and Millionshchikova, T. D.: Validation of a Hydrological Model
Intended for Impact Study: Problem Statement and Solution Example for
Selenga River Basin, Water Resour., 45, 90–101, https://doi.org/10.1134/S0097807818050354, 2018.
Gupta, H. V., Kling, H., Yilmaz, K. K., and Martinez, G. F.: Decomposition of
the mean squared error and NSE performance criteria: Implications for
improving hydrological modelling, J. Hydrol., 377, 80–91, https://doi.org/10.1016/j.jhydrol.2009.08.003, 2009.
Hughes, D. A.: Simulating temporal variability in catchment response using a
monthly rainfall-runoff model, Hydrol. Sci. J., 60, 1286–1298, https://doi.org/10.1080/02626667.2014.909598, 2015.
Klemeš, V.: Operational testing of hydrologic simulation models, Hydrol.
Sci. J., 31, 13–24, https://doi.org/10.1080/02626668609491024,
1986.
Kling, H., Stanzel, P., Fuchs, M., and Nachtnebel, H.-P.: Performance of the
COSERO precipitation-runoff model under non-stationary conditions in basins
with different climates, Hydrol. Sci. J., 60, 1374–1393, https://doi.org/10.1080/02626667.2014.959956, 2015.
Krysanova, V., Donnelly, C., Gelfan, A., Gerten, D., Arheimer, B.,
Hattermann, F., and Kundzewicz, Z. W.: How the performance of hydrological
models relates to credibility of projections under climate change, Hydrol.
Sci. J., 63, 696–720, https://doi.org/10.1080/02626667.2018.1446214, 2018.
Larson, S. C.: The shrinkage of the coefficient of multiple correlation, J.
Educ. Psychol., 22, 45–55, https://doi.org/10.1037/h0072400,
1931.
Leleu, I., Tonnelier, I., Puechberty, R., Gouin, P., Viquendi, I., Cobos, L., Foray, A., Baillon, M., and Ndima, P.-O.: La refonte du système d'information national pour la
gestion et la mise à disposition des données hydrométriques, La
Houille Blanche, 100, 25–32, https://doi.org/10.1051/lhb/2014004, 2014.
Li, C. Z., Zhang, L., Wang, H., Zhang, Y. Q., Yu, F. L., and Yan, D. H.: The transferability of hydrological models under nonstationary climatic conditions, Hydrol. Earth Syst. Sci., 16, 1239–1254, https://doi.org/10.5194/hess-16-1239-2012, 2012.
Li, H., Beldring, S., and Xu, C.-Y.: Stability of model performance and
parameter values on two catchments facing changes in climatic conditions,
Hydrol. Sci. J., 60, 1317–1330, https://doi.org/10.1080/02626667.2014.978333, 2015.
Magand, C., Ducharne, A., Le Moine, N., and Brigode, P.: Parameter
transferability under changing climate: case study with a land surface model
in the Durance watershed, France, Hydrol. Sci. J., 60, 1408–1423, https://doi.org/10.1080/02626667.2014.993643, 2015.
Montanari, A., Young, G., Savenije, H. H. G., Hughes, D., Wagener, T., Ren, L. L., Koutsoyiannis, D., Cudennec, C., Toth, E., Grimaldi, S., Blöschl, G., Sivapalan, M., Beven, K., Gupta, H., Hipsey, M., Schaefli, B., Arheimer, B., Boegh, E., Schymanski, S. J., Di Baldassarre, G., Yu, B., Hubert, P., Huang, Y., Schumann, A., Post, D. A., Srinivasan, V., Harman, C., Thompson, S., Rogger, M., Viglione, A., McMillan, H., Characklis, G., Pang, Z., and Belyaev, V.: “Panta Rhei – Everything Flows”: Change in hydrology
and society – The IAHS Scientific Decade 2013–2022, Hydrol. Sci. J., 58,
1256–1275, https://doi.org/10.1080/02626667.2013.809088, 2013.
Mosteller, F. and Tukey, J. W.: Data Analysis, Including Statistics, The
Collected Works of John W. Tukey Graphics, 5, 1965–1985, 1988.
Motavita, D. F., Chow, R., Guthke, A., and Nowak, W.: The comprehensive
differential split-sample test: A stress-test for hydrological model
robustness under climate variability, J. Hydrol., 573, 501–515, https://doi.org/10.1016/j.jhydrol.2019.03.054, 2019.
Nicolle, P., Pushpalatha, R., Perrin, C., François, D., Thiéry, D., Mathevet, T., Le Lay, M., Besson, F., Soubeyroux, J.-M., Viel, C., Regimbeau, F., Andréassian, V., Maugis, P., Augeard, B., and Morice, E.: Benchmarking hydrological models for low-flow simulation and forecasting on French catchments, Hydrol. Earth Syst. Sci., 18, 2829–2857, https://doi.org/10.5194/hess-18-2829-2014, 2014.
Oudin, L., Hervieu, F., Michel, C., Perrin, C., Andréassian, V., Anctil,
F., and Loumagne, C.: Which potential evapotranspiration input for a lumped
rainfall-runoff model?: Part 2-Towards a simple and efficient potential
evapotranspiration model for rainfall-runoff modelling, J. Hydrol., 303,
290–306, https://doi.org/10.1016/j.jhydrol.2004.08.026, 2005.
Perrin, C., Michel, C., and Andréassian, V.: Improvement of a
parsimonious model for streamflow simulation, J. Hydrol., 279, 275–289,
https://doi.org/10.1016/S0022-1694(03)00225-7, 2003.
Popper, K.: The logic of scientific discovery, Routledge, London, 1959.
Rau, P., Bourrel, L., Labat, D., Ruelland, D., Frappart, F., Lavado, W., Dewitte, B., and Felipe, O.: Assessing multidecadal runoff (1970–2010) using regional
hydrological modelling under data and water scarcity conditions in Peruvian
Pacific catchments, Hydrol. Process., 33, 20–35, https://doi.org/10.1002/hyp.13318, 2019.
Refsgaard, J. C. and Henriksen, H. J.: Modelling guidelines–terminology and
guiding principles, Adv. Water Resour., 27, 71–82, https://doi.org/10.1016/j.advwatres.2003.08.006, 2004.
Refsgaard, J. C. , Madsen, H., Andréassian, V., Arnbjerg-Nielsen, K., Davidson, T. A., Drews, M., Hamilton, D. P., Jeppesen, E., Kjellström, E., Olesen, J. E., Sonnenborg, T. O., Trolle, D., Willems, P., and Christensen, J. H.: A framework for testing the ability of models to
project climate change and its impacts, Clim. Change, 122, 271–282,
https://doi.org/10.1007/s10584-013-0990-2, 2013.
Roberts, D. R., Bahn, V., Ciuti, S., Boyce, M. S., Elith, J., Guillera-Arroita, G., Hauenstein, S., Lahoz-Monfort, J. J., Schröder, B., Thuiller, W., Warton, D. I., Wintle, B. A., Hartig, F., and Dormann, C. F.: Cross-validation strategies for data with temporal,
spatial, hierarchical, or phylogenetic structure, Ecography, 40, 913–929,
https://doi.org/10.1111/ecog.02881, 2017.
Royer-Gaspard, P., Andréassian, V., and Thirel, G.: Technical note: PMR – a proxy metric to assess hydrological model robustness in a changing climate, Hydrol. Earth Syst. Sci. Discuss. [preprint], https://doi.org/10.5194/hess-2021-58, in review, 2021.
Seibert, J.: Reliability of model predictions outside calibration conditions,
Nord. Hydrol., 34, 477–492, https://doi.org/10.2166/nh.2003.0019,
2003.
Seifert, D., Sonnenborg, T. O., Refsgaard, J. C., Højberg, A. L., and
Troldborg, L.: Assessment of hydrological model predictive ability given
multiple conceptual geological models, Water Resour. Res., 48, W06503,
https://doi.org/10.1029/2011WR011149, 2012.
Seiller, G., Anctil, F., and Perrin, C.: Multimodel evaluation of twenty lumped hydrological models under contrasted climate conditions, Hydrol. Earth Syst. Sci., 16, 1171–1189, https://doi.org/10.5194/hess-16-1171-2012, 2012.
Tanaka, T. and Tachikawa, Y.: Testing the applicability of a kinematic
wave-based distributed hydrological model in two climatically contrasting
catchments, Hydrol. Sci. J., 60, 1361–1373, https://doi.org/10.1080/02626667.2014.967693, 2015.
Taver, V., Johannet, A., Borrell-Estupina, V., and Pistre, S.: Feed-forward
vs recurrent neural network models for non-stationarity modelling using data
assimilation and adaptivity, Hydrol. Sci. J., 60, 1242–1265, https://doi.org/10.1080/02626667.2014.967696, 2015.
Teutschbein, C. and Seibert, J.: Is bias correction of regional climate model (RCM) simulations possible for non-stationary conditions?, Hydrol. Earth Syst. Sci., 17, 5061–5077, https://doi.org/10.5194/hess-17-5061-2013, 2013.
Thirel, G., Andréassian, V., Perrin, C., Audouy, J.-N., Berthet, L., Edwards, P., Folton, N., Furusho, C., Kuentz, A., Lerat, J., Lindström, G., Martin, E., Mathevet, T., Merz, R., Parajka, J., Ruelland, D., and Vaze, J.: Hydrology under change: an evaluation protocol to
investigate how hydrological models deal with changing catchments, Hydrol.
Sci. J., 60, 1184–1199, https://doi.org/10.1080/02626667.2014.967248, 2015a.
Thirel, G., Andréassian, V., and Perrin, C.: On the need to test
hydrological models under changing conditions, Hydrol. Sci. J., 60, 1165–1173,
https://doi.org/10.1080/02626667.2015.1050027, 2015b.
Vaze, J., Post, D. A., Chiew, F. H. S., Perraud, J. M., Viney, N. R., and
Teng, J.: Climate non-stationarity - Validity of calibrated rainfall-runoff
models for use in climate change studies, J. Hydrol., 394, 447–457, https://doi.org/10.1016/j.jhydrol.2010.09.018, 2010.
Vidal, J.-P., Martin, E., Franchistéguy, L., Baillon, M., and
Soubeyroux, J.-M.: A 50-year high-resolution atmospheric reanalysis over
France with the Safran system, Int. J. Climatol., 30, 1627–1644, https://doi.org/10.1002/joc.2003, 2010.
Vormoor, K., Heistermann, M., Bronstert, A., and Lawrence, D.: Hydrological
model parameter (in)stability – “crash testing” the HBV model under
contrasting flood seasonality conditions, Hydrol. Sci. J., 63, 991–1007,
https://doi.org/10.1080/02626667.2018.1466056, 2018.
Wilby, R. L.: A global hydrology research agenda fit for the 2030s, Hydrol
Res., 50, 1464–1480, https://doi.org/10.2166/nh.2019.100, 2019.
Xu, C.: Climate Change and Hydrologic Models: A Review of Existing Gaps and
Recent Research Developments, Water Resour. Manage., 13, 369–382, https://doi.org/10.1023/A:1008190900459, 1999.
Yu, B. and Zhu, Z.: A comparative assessment of AWBM and SimHyd for forested
watersheds, Hydrol. Sci. J., 60, 1200–1212, https://doi.org/10.1080/02626667.2014.961924, 2015.
Short summary
In this note, a new method (RAT) is proposed to assess the robustness of hydrological models. The RAT method is particularly interesting because it does not require multiple calibrations (it is therefore applicable to uncalibrated models), and it can be used to determine whether a hydrological model may be safely used for climate change impact studies. Success at the robustness assessment test is a necessary (but not sufficient) condition of model robustness.
In this note, a new method (RAT) is proposed to assess the robustness of hydrological models....
