Articles | Volume 17, issue 7
https://doi.org/10.5194/hess-17-2893-2013
© Author(s) 2013. This work is distributed under
the Creative Commons Attribution 3.0 License.
the Creative Commons Attribution 3.0 License.
https://doi.org/10.5194/hess-17-2893-2013
© Author(s) 2013. This work is distributed under
the Creative Commons Attribution 3.0 License.
the Creative Commons Attribution 3.0 License.
Technical note
| 
24 Jul 2013
Technical note |
| 24 Jul 2013
Technical Note: Method of Morris effectively reduces the computational demands of global sensitivity analysis for distributed watershed models
J. D. Herman
Department of Civil and Environmental Engineering, Cornell University, Ithaca, New York, USA
J. B. Kollat
Department of Civil and Environmental Engineering, Pennsylvania State University, University Park, Pennsylvania, USA
P. M. Reed
Department of Civil and Environmental Engineering, Cornell University, Ithaca, New York, USA
T. Wagener
Department of Civil Engineering, University of Bristol, Queen's Building, Bristol, UK
Related authors
Nusrat Molla, John DeIonno, Thilo Gross, and Jonathan Herman
Earth Syst. Dynam., 13, 1677–1688, https://doi.org/10.5194/esd-13-1677-2022, https://doi.org/10.5194/esd-13-1677-2022, 2022
Short summary
Short summary
How the structure of resource governance systems affects how they respond to change is not yet well understood. We model the stability of thousands of different governance systems, revealing that greater diversity and interdependence among actors are destabilizing, while venue shopping and advocacy organizations are stabilizing. This study suggests that complexity in governance corresponds to responsiveness to change, while providing insight into managing them to balance adaptivity and stability
Marina R. L. Mautner, Laura Foglia, and Jonathan D. Herman
Hydrol. Earth Syst. Sci., 26, 1319–1340, https://doi.org/10.5194/hess-26-1319-2022, https://doi.org/10.5194/hess-26-1319-2022, 2022
Short summary
Short summary
Sensitivity analysis can be harnessed to evaluate effects of model uncertainties on planning outcomes. This study explores how observation and parameter uncertainty propagate through a hydrogeologic model to influence the ranking of decision alternatives. Using global sensitivity analysis and evaluation of aquifer management objectives, we evaluate how physical properties of the model and choice of observations for calibration can lead to variations in decision-relevant model outputs.
Robert Reinecke, Laura Foglia, Steffen Mehl, Jonathan D. Herman, Alexander Wachholz, Tim Trautmann, and Petra Döll
Hydrol. Earth Syst. Sci., 23, 4561–4582, https://doi.org/10.5194/hess-23-4561-2019, https://doi.org/10.5194/hess-23-4561-2019, 2019
Short summary
Short summary
Recently, the first global groundwater models were developed to better understand surface-water–groundwater interactions and human water use impacts. However, the reliability of model outputs is limited by a lack of data as well as model assumptions required due to the necessarily coarse spatial resolution. In this study we present the first global maps of model sensitivity according to their parameterization and build a foundation to improve datasets, model design, and model understanding.
N. W. Chaney, J. D. Herman, P. M. Reed, and E. F. Wood
Hydrol. Earth Syst. Sci., 19, 3239–3251, https://doi.org/10.5194/hess-19-3239-2015, https://doi.org/10.5194/hess-19-3239-2015, 2015
Short summary
Short summary
Land surface modeling is playing an increasing role in global monitoring and prediction of extreme hydrologic events. However, uncertainties in parameter identifiability limit the reliability of model predictions. This study makes use of petascale computing to perform a comprehensive evaluation of land surface modeling for global flood and drought monitoring and suggests paths forward to overcome the challenges posed by parameter uncertainty.
J. D. Herman, J. B. Kollat, P. M. Reed, and T. Wagener
Hydrol. Earth Syst. Sci., 17, 5109–5125, https://doi.org/10.5194/hess-17-5109-2013, https://doi.org/10.5194/hess-17-5109-2013, 2013
Nusrat Molla, John DeIonno, Thilo Gross, and Jonathan Herman
Earth Syst. Dynam., 13, 1677–1688, https://doi.org/10.5194/esd-13-1677-2022, https://doi.org/10.5194/esd-13-1677-2022, 2022
Short summary
Short summary
How the structure of resource governance systems affects how they respond to change is not yet well understood. We model the stability of thousands of different governance systems, revealing that greater diversity and interdependence among actors are destabilizing, while venue shopping and advocacy organizations are stabilizing. This study suggests that complexity in governance corresponds to responsiveness to change, while providing insight into managing them to balance adaptivity and stability
Marina R. L. Mautner, Laura Foglia, and Jonathan D. Herman
Hydrol. Earth Syst. Sci., 26, 1319–1340, https://doi.org/10.5194/hess-26-1319-2022, https://doi.org/10.5194/hess-26-1319-2022, 2022
Short summary
Short summary
Sensitivity analysis can be harnessed to evaluate effects of model uncertainties on planning outcomes. This study explores how observation and parameter uncertainty propagate through a hydrogeologic model to influence the ranking of decision alternatives. Using global sensitivity analysis and evaluation of aquifer management objectives, we evaluate how physical properties of the model and choice of observations for calibration can lead to variations in decision-relevant model outputs.
Charles Rougé, Patrick M. Reed, Danielle S. Grogan, Shan Zuidema, Alexander Prusevich, Stanley Glidden, Jonathan R. Lamontagne, and Richard B. Lammers
Hydrol. Earth Syst. Sci., 25, 1365–1388, https://doi.org/10.5194/hess-25-1365-2021, https://doi.org/10.5194/hess-25-1365-2021, 2021
Short summary
Short summary
Amid growing interest in using large-scale hydrological models for flood and drought monitoring and forecasting, it is important to evaluate common assumptions these models make. We investigated the representation of reservoirs as separate (non-coordinated) infrastructure. We found that not appropriately representing coordination and control processes can lead a hydrological model to simulate flood and drought events that would not occur given the coordinated emergency response in the basin.
Robert Reinecke, Laura Foglia, Steffen Mehl, Jonathan D. Herman, Alexander Wachholz, Tim Trautmann, and Petra Döll
Hydrol. Earth Syst. Sci., 23, 4561–4582, https://doi.org/10.5194/hess-23-4561-2019, https://doi.org/10.5194/hess-23-4561-2019, 2019
Short summary
Short summary
Recently, the first global groundwater models were developed to better understand surface-water–groundwater interactions and human water use impacts. However, the reliability of model outputs is limited by a lack of data as well as model assumptions required due to the necessarily coarse spatial resolution. In this study we present the first global maps of model sensitivity according to their parameterization and build a foundation to improve datasets, model design, and model understanding.
N. W. Chaney, J. D. Herman, P. M. Reed, and E. F. Wood
Hydrol. Earth Syst. Sci., 19, 3239–3251, https://doi.org/10.5194/hess-19-3239-2015, https://doi.org/10.5194/hess-19-3239-2015, 2015
Short summary
Short summary
Land surface modeling is playing an increasing role in global monitoring and prediction of extreme hydrologic events. However, uncertainties in parameter identifiability limit the reliability of model predictions. This study makes use of petascale computing to perform a comprehensive evaluation of land surface modeling for global flood and drought monitoring and suggests paths forward to overcome the challenges posed by parameter uncertainty.
K. A. Sawicz, C. Kelleher, T. Wagener, P. Troch, M. Sivapalan, and G. Carrillo
Hydrol. Earth Syst. Sci., 18, 273–285, https://doi.org/10.5194/hess-18-273-2014, https://doi.org/10.5194/hess-18-273-2014, 2014
J. D. Herman, J. B. Kollat, P. M. Reed, and T. Wagener
Hydrol. Earth Syst. Sci., 17, 5109–5125, https://doi.org/10.5194/hess-17-5109-2013, https://doi.org/10.5194/hess-17-5109-2013, 2013
S. E. Thompson, M. Sivapalan, C. J. Harman, V. Srinivasan, M. R. Hipsey, P. Reed, A. Montanari, and G. Blöschl
Hydrol. Earth Syst. Sci., 17, 5013–5039, https://doi.org/10.5194/hess-17-5013-2013, https://doi.org/10.5194/hess-17-5013-2013, 2013
P. A. Troch, G. Carrillo, M. Sivapalan, T. Wagener, and K. Sawicz
Hydrol. Earth Syst. Sci., 17, 2209–2217, https://doi.org/10.5194/hess-17-2209-2013, https://doi.org/10.5194/hess-17-2209-2013, 2013
Related subject area
Subject: Catchment hydrology | Techniques and Approaches: Uncertainty analysis
A data-centric perspective on the information needed for hydrological uncertainty predictions
A decomposition approach to evaluating the local performance of global streamflow reanalysis
Technical note: Complexity–uncertainty curve (c-u-curve) – a method to analyse, classify and compare dynamical systems
Technical note: The CREDIBLE Uncertainty Estimation (CURE) toolbox: facilitating the communication of epistemic uncertainty
Why do our rainfall–runoff models keep underestimating the peak flows?
Use of expert elicitation to assign weights to climate and hydrological models in climate impact studies
Pitfalls and a feasible solution for using KGE as an informal likelihood function in MCMC methods: DREAM(ZS) as an example
Benchmarking global hydrological and land surface models against GRACE in a medium-sized tropical basin
Guidance on evaluating parametric model uncertainty at decision-relevant scales
Quantifying input uncertainty in the calibration of water quality models: reordering errors via the secant method
Sequential data assimilation for real-time probabilistic flood inundation mapping
Key challenges facing the application of the conductivity mass balance method: a case study of the Mississippi River basin
Coupled machine learning and the limits of acceptability approach applied in parameter identification for a distributed hydrological model
A systematic assessment of uncertainties in large-scale soil loss estimation from different representations of USLE input factors – a case study for Kenya and Uganda
Technical note: Uncertainty in multi-source partitioning using large tracer data sets
Assessment of climate change impact and difference on the river runoff in four basins in China under 1.5 and 2.0 °C global warming
A likelihood framework for deterministic hydrological models and the importance of non-stationary autocorrelation
Technical note: Analytical sensitivity analysis and uncertainty estimation of baseflow index calculated by a two-component hydrograph separation method with conductivity as a tracer
Understanding the water cycle over the upper Tarim Basin: retrospecting the estimated discharge bias to atmospheric variables and model structure
The effect of input data resolution and complexity on the uncertainty of hydrological predictions in a humid vegetated watershed
Parameter uncertainty analysis for an operational hydrological model using residual-based and limits of acceptability approaches
Technical note: Pitfalls in using log-transformed flows within the KGE criterion
Improvement of model evaluation by incorporating prediction and measurement uncertainty
Transferability of climate simulation uncertainty to hydrological impacts
Intercomparison of different uncertainty sources in hydrological climate change projections for an alpine catchment (upper Clutha River, New Zealand)
Mapping (dis)agreement in hydrologic projections
Consistency assessment of rating curve data in various locations using Bidirectional Reach (BReach)
The critical role of uncertainty in projections of hydrological extremes
Residual uncertainty estimation using instance-based learning with applications to hydrologic forecasting
Characterizing and reducing equifinality by constraining a distributed catchment model with regional signatures, local observations, and process understanding
Effects of uncertainty in soil properties on simulated hydrological states and fluxes at different spatio-temporal scales
Extending flood forecasting lead time in a large watershed by coupling WRF QPF with a distributed hydrological model
Quantifying uncertainty on sediment loads using bootstrap confidence intervals
Event-scale power law recession analysis: quantifying methodological uncertainty
Disentangling timing and amplitude errors in streamflow simulations
Reliability of lumped hydrological modeling in a semi-arid mountainous catchment facing water-use changes
Using dry and wet year hydroclimatic extremes to guide future hydrologic projections
Uncertainty contributions to low-flow projections in Austria
Accounting for dependencies in regionalized signatures for predictions in ungauged catchments
Climate change and its impacts on river discharge in two climate regions in China
Uncertainty in hydrological signatures
Climate model uncertainty versus conceptual geological uncertainty in hydrological modeling
Estimation of predictive hydrologic uncertainty using the quantile regression and UNEEC methods and their comparison on contrasting catchments
Transferring global uncertainty estimates from gauged to ungauged catchments
Spatial sensitivity analysis of snow cover data in a distributed rainfall-runoff model
Uncertainty reduction and parameter estimation of a distributed hydrological model with ground and remote-sensing data
The skill of seasonal ensemble low-flow forecasts in the Moselle River for three different hydrological models
Flow pathways and nutrient transport mechanisms drive hydrochemical sensitivity to climate change across catchments with different geology and topography
The importance of hydrological uncertainty assessment methods in climate change impact studies
Regional water balance modelling using flow-duration curves with observational uncertainties
Andreas Auer, Martin Gauch, Frederik Kratzert, Grey Nearing, Sepp Hochreiter, and Daniel Klotz
Hydrol. Earth Syst. Sci., 28, 4099–4126, https://doi.org/10.5194/hess-28-4099-2024, https://doi.org/10.5194/hess-28-4099-2024, 2024
Short summary
Short summary
This work examines the impact of temporal and spatial information on the uncertainty estimation of streamflow forecasts. The study emphasizes the importance of data updates and global information for precise uncertainty estimates. We use conformal prediction to show that recent data enhance the estimates, even if only available infrequently. Local data yield reasonable average estimations but fall short for peak-flow events. The use of global data significantly improves these predictions.
Tongtiegang Zhao, Zexin Chen, Yu Tian, Bingyao Zhang, Yu Li, and Xiaohong Chen
Hydrol. Earth Syst. Sci., 28, 3597–3611, https://doi.org/10.5194/hess-28-3597-2024, https://doi.org/10.5194/hess-28-3597-2024, 2024
Short summary
Short summary
The local performance plays a critical part in practical applications of global streamflow reanalysis. This paper develops a decomposition approach to evaluating streamflow analysis at different timescales. The reanalysis is observed to be more effective in characterizing seasonal, annual and multi-annual features than daily, weekly and monthly features. Also, the local performance is shown to be primarily influenced by precipitation seasonality, longitude, mean precipitation and mean slope.
Uwe Ehret and Pankaj Dey
Hydrol. Earth Syst. Sci., 27, 2591–2605, https://doi.org/10.5194/hess-27-2591-2023, https://doi.org/10.5194/hess-27-2591-2023, 2023
Short summary
Short summary
We propose the
c-u-curvemethod to characterize dynamical (time-variable) systems of all kinds.
Uis for uncertainty and expresses how well a system can be predicted in a given period of time.
Cis for complexity and expresses how predictability differs between different periods, i.e. how well predictability itself can be predicted. The method helps to better classify and compare dynamical systems across a wide range of disciplines, thus facilitating scientific collaboration.
Trevor Page, Paul Smith, Keith Beven, Francesca Pianosi, Fanny Sarrazin, Susana Almeida, Liz Holcombe, Jim Freer, Nick Chappell, and Thorsten Wagener
Hydrol. Earth Syst. Sci., 27, 2523–2534, https://doi.org/10.5194/hess-27-2523-2023, https://doi.org/10.5194/hess-27-2523-2023, 2023
Short summary
Short summary
This publication provides an introduction to the CREDIBLE Uncertainty Estimation (CURE) toolbox. CURE offers workflows for a variety of uncertainty estimation methods. One of its most important features is the requirement that all of the assumptions on which a workflow analysis depends be defined. This facilitates communication with potential users of an analysis. An audit trail log is produced automatically from a workflow for future reference.
András Bárdossy and Faizan Anwar
Hydrol. Earth Syst. Sci., 27, 1987–2000, https://doi.org/10.5194/hess-27-1987-2023, https://doi.org/10.5194/hess-27-1987-2023, 2023
Short summary
Short summary
This study demonstrates the fact that the large river flows forecasted by the models show an underestimation that is inversely related to the number of locations where precipitation is recorded, which is independent of the model. The higher the number of points where the amount of precipitation is recorded, the better the estimate of the river flows.
Eva Sebok, Hans Jørgen Henriksen, Ernesto Pastén-Zapata, Peter Berg, Guillaume Thirel, Anthony Lemoine, Andrea Lira-Loarca, Christiana Photiadou, Rafael Pimentel, Paul Royer-Gaspard, Erik Kjellström, Jens Hesselbjerg Christensen, Jean Philippe Vidal, Philippe Lucas-Picher, Markus G. Donat, Giovanni Besio, María José Polo, Simon Stisen, Yvan Caballero, Ilias G. Pechlivanidis, Lars Troldborg, and Jens Christian Refsgaard
Hydrol. Earth Syst. Sci., 26, 5605–5625, https://doi.org/10.5194/hess-26-5605-2022, https://doi.org/10.5194/hess-26-5605-2022, 2022
Short summary
Short summary
Hydrological models projecting the impact of changing climate carry a lot of uncertainty. Thus, these models usually have a multitude of simulations using different future climate data. This study used the subjective opinion of experts to assess which climate and hydrological models are the most likely to correctly predict climate impacts, thereby easing the computational burden. The experts could select more likely hydrological models, while the climate models were deemed equally probable.
Yan Liu, Jaime Fernández-Ortega, Matías Mudarra, and Andreas Hartmann
Hydrol. Earth Syst. Sci., 26, 5341–5355, https://doi.org/10.5194/hess-26-5341-2022, https://doi.org/10.5194/hess-26-5341-2022, 2022
Short summary
Short summary
We adapt the informal Kling–Gupta efficiency (KGE) with a gamma distribution to apply it as an informal likelihood function in the DiffeRential Evolution Adaptive Metropolis DREAM(ZS) method. Our adapted approach performs as well as the formal likelihood function for exploring posterior distributions of model parameters. The adapted KGE is superior to the formal likelihood function for calibrations combining multiple observations with different lengths, frequencies and units.
Silvana Bolaños Chavarría, Micha Werner, Juan Fernando Salazar, and Teresita Betancur Vargas
Hydrol. Earth Syst. Sci., 26, 4323–4344, https://doi.org/10.5194/hess-26-4323-2022, https://doi.org/10.5194/hess-26-4323-2022, 2022
Short summary
Short summary
Using total water storage (TWS) from GRACE satellites, we assess the reliability of global hydrological and land surface models over a medium-sized tropical basin with a well-developed gauging network. We find the models poorly represent TWS for the monthly series, but they improve in representing seasonality and long-term trends. We conclude that GRACE provides a valuable dataset to benchmark global simulations of TWS change, offering a useful tool to improve global models in tropical basins.
Jared D. Smith, Laurence Lin, Julianne D. Quinn, and Lawrence E. Band
Hydrol. Earth Syst. Sci., 26, 2519–2539, https://doi.org/10.5194/hess-26-2519-2022, https://doi.org/10.5194/hess-26-2519-2022, 2022
Short summary
Short summary
Watershed models are used to simulate streamflow and water quality, and to inform siting and sizing decisions for runoff and nutrient control projects. Data are limited for many watershed processes that are represented in such models, which requires selecting the most important processes to be calibrated. We show that this selection should be based on decision-relevant metrics at the spatial scales of interest for the control projects. This should enable more robust project designs.
Xia Wu, Lucy Marshall, and Ashish Sharma
Hydrol. Earth Syst. Sci., 26, 1203–1221, https://doi.org/10.5194/hess-26-1203-2022, https://doi.org/10.5194/hess-26-1203-2022, 2022
Short summary
Short summary
Decomposing parameter and input errors in model calibration is a considerable challenge. This study transfers the direct estimation of an input error series to their rank estimation and develops a new algorithm, i.e., Bayesian error analysis with reordering (BEAR). In the context of a total suspended solids simulation, two synthetic studies and a real study demonstrate that the BEAR method is effective for improving the input error estimation and water quality model calibration.
Keighobad Jafarzadegan, Peyman Abbaszadeh, and Hamid Moradkhani
Hydrol. Earth Syst. Sci., 25, 4995–5011, https://doi.org/10.5194/hess-25-4995-2021, https://doi.org/10.5194/hess-25-4995-2021, 2021
Short summary
Short summary
In this study, daily observations are assimilated into a hydrodynamic model to update the performance of modeling and improve the flood inundation mapping skill. Results demonstrate that integrating data assimilation with a hydrodynamic model improves the performance of flood simulation and provides more reliable inundation maps. A flowchart provides the overall steps for applying this framework in practice and forecasting probabilistic flood maps before the onset of upcoming floods.
Hang Lyu, Chenxi Xia, Jinghan Zhang, and Bo Li
Hydrol. Earth Syst. Sci., 24, 6075–6090, https://doi.org/10.5194/hess-24-6075-2020, https://doi.org/10.5194/hess-24-6075-2020, 2020
Short summary
Short summary
Baseflow separation plays a critical role in science-based management of water resources. This study addressed key challenges hindering the application of the generally accepted conductivity mass balance (CMB). Monitoring data for over 200 stream sites of the Mississippi River basin were collected to answer the following questions. What are the characteristics of a watershed that determine the method suitability? What length of monitoring data is needed? How can the parameters be more accurate?
Aynom T. Teweldebrhan, Thomas V. Schuler, John F. Burkhart, and Morten Hjorth-Jensen
Hydrol. Earth Syst. Sci., 24, 4641–4658, https://doi.org/10.5194/hess-24-4641-2020, https://doi.org/10.5194/hess-24-4641-2020, 2020
Christoph Schürz, Bano Mehdi, Jens Kiesel, Karsten Schulz, and Mathew Herrnegger
Hydrol. Earth Syst. Sci., 24, 4463–4489, https://doi.org/10.5194/hess-24-4463-2020, https://doi.org/10.5194/hess-24-4463-2020, 2020
Short summary
Short summary
The USLE is a commonly used model to estimate soil erosion by water. It quantifies soil loss as a product of six inputs representing rainfall erosivity, soil erodibility, slope length and steepness, plant cover, and support practices. Many methods exist to derive these inputs, which can, however, lead to substantial differences in the estimated soil loss. Here, we analyze the effect of different input representations on the estimated soil loss in a large-scale study in Kenya and Uganda.
Alicia Correa, Diego Ochoa-Tocachi, and Christian Birkel
Hydrol. Earth Syst. Sci., 23, 5059–5068, https://doi.org/10.5194/hess-23-5059-2019, https://doi.org/10.5194/hess-23-5059-2019, 2019
Short summary
Short summary
The applications and availability of large tracer data sets have vastly increased in recent years leading to research into the contributions of multiple sources to a mixture. We introduce a method based on Taylor series approximation to estimate the uncertainties of such sources' contributions. The method is illustrated with examples of hydrology (14 tracers) and a MATLAB code is provided for reproducibility. This method can be generalized to any number of tracers across a range of disciplines.
Hongmei Xu, Lüliu Liu, Yong Wang, Sheng Wang, Ying Hao, Jingjin Ma, and Tong Jiang
Hydrol. Earth Syst. Sci., 23, 4219–4231, https://doi.org/10.5194/hess-23-4219-2019, https://doi.org/10.5194/hess-23-4219-2019, 2019
Short summary
Short summary
1.5 and 2 °C have become targets in the discussion of climate change impacts. However, climate research is also challenged to provide more robust information on the impact of climate change at local and regional scales to assist the development of sound scientific adaptation and mitigation measures. This study assessed the impacts and differences of 1.5 and 2.0 °C global warming on basin-scale river runoff by examining four river basins covering a wide hydroclimatic setting in China.
Lorenz Ammann, Fabrizio Fenicia, and Peter Reichert
Hydrol. Earth Syst. Sci., 23, 2147–2172, https://doi.org/10.5194/hess-23-2147-2019, https://doi.org/10.5194/hess-23-2147-2019, 2019
Short summary
Short summary
The uncertainty of hydrological models can be substantial, and its quantification and realistic description are often difficult. We propose a new flexible probabilistic framework to describe and quantify this uncertainty. It is show that the correlation of the errors can be non-stationary, and that accounting for temporal changes in correlation can lead to strongly improved probabilistic predictions. This is a promising avenue for improving uncertainty estimation in hydrological modelling.
Weifei Yang, Changlai Xiao, and Xiujuan Liang
Hydrol. Earth Syst. Sci., 23, 1103–1112, https://doi.org/10.5194/hess-23-1103-2019, https://doi.org/10.5194/hess-23-1103-2019, 2019
Short summary
Short summary
This paper analyzed the sensitivity of the baseflow index to the parameters of the conductivity two-component hydrograph separation method. The results indicated that the baseflow index is more sensitive to the conductivity of baseflow and the separation method may be more suitable for the long time series in a small watershed. After considering the mutual offset of the measurement errors of conductivity and streamflow, the uncertainty in baseflow index was reduced by half.
Xudong Zhou, Jan Polcher, Tao Yang, Yukiko Hirabayashi, and Trung Nguyen-Quang
Hydrol. Earth Syst. Sci., 22, 6087–6108, https://doi.org/10.5194/hess-22-6087-2018, https://doi.org/10.5194/hess-22-6087-2018, 2018
Short summary
Short summary
Model bias is commonly seen in discharge simulation by hydrological or land surface models. This study tested an approach with the Budyko hypothesis to retrospect the estimated discharge bias to different bias sources including the atmospheric variables and model structure. Results indicate that the bias is most likely caused by the forcing variables, and the forcing bias should firstly be assessed and reduced in order to perform pertinent analysis of the regional water cycle.
Linh Hoang, Rajith Mukundan, Karen E. B. Moore, Emmet M. Owens, and Tammo S. Steenhuis
Hydrol. Earth Syst. Sci., 22, 5947–5965, https://doi.org/10.5194/hess-22-5947-2018, https://doi.org/10.5194/hess-22-5947-2018, 2018
Short summary
Short summary
The paper analyzes the effect of two input data (DEMs and the combination of soil and land use data) with different resolution and complexity on the uncertainty of model outputs (the predictions of streamflow and saturated areas) and parameter uncertainty using SWAT-HS. Results showed that DEM resolution has significant effect on the spatial pattern of saturated areas and using complex soil and land use data may not necessarily improve model performance or reduce model uncertainty.
Aynom T. Teweldebrhan, John F. Burkhart, and Thomas V. Schuler
Hydrol. Earth Syst. Sci., 22, 5021–5039, https://doi.org/10.5194/hess-22-5021-2018, https://doi.org/10.5194/hess-22-5021-2018, 2018
Léonard Santos, Guillaume Thirel, and Charles Perrin
Hydrol. Earth Syst. Sci., 22, 4583–4591, https://doi.org/10.5194/hess-22-4583-2018, https://doi.org/10.5194/hess-22-4583-2018, 2018
Short summary
Short summary
The Kling and Gupta efficiency (KGE) is a score used in hydrology to evaluate flow simulation compared to observations. In order to force the evaluation on the low flows, some authors used the log-transformed flow to calculate the KGE. In this technical note, we show that this transformation should be avoided because it produced numerical flaws that lead to difficulties in the score value interpretation.
Lei Chen, Shuang Li, Yucen Zhong, and Zhenyao Shen
Hydrol. Earth Syst. Sci., 22, 4145–4154, https://doi.org/10.5194/hess-22-4145-2018, https://doi.org/10.5194/hess-22-4145-2018, 2018
Short summary
Short summary
In this study, the cumulative distribution function approach (CDFA) and the Monte Carlo approach (MCA) were used to develop two new approaches for model evaluation within an uncertainty framework. These proposed methods could be extended to watershed models to provide a substitution for traditional model evaluations within an uncertainty framework.
Hui-Min Wang, Jie Chen, Alex J. Cannon, Chong-Yu Xu, and Hua Chen
Hydrol. Earth Syst. Sci., 22, 3739–3759, https://doi.org/10.5194/hess-22-3739-2018, https://doi.org/10.5194/hess-22-3739-2018, 2018
Short summary
Short summary
Facing a growing number of climate models, many selection methods were proposed to select subsets in the field of climate simulation, but the transferability of their performances to hydrological impacts remains doubtful. We investigate the transferability of climate simulation uncertainty to hydrological impacts using two selection methods, and conclude that envelope-based selection of about 10 climate simulations based on properly chosen climate variables is suggested for impact studies.
Andreas M. Jobst, Daniel G. Kingston, Nicolas J. Cullen, and Josef Schmid
Hydrol. Earth Syst. Sci., 22, 3125–3142, https://doi.org/10.5194/hess-22-3125-2018, https://doi.org/10.5194/hess-22-3125-2018, 2018
Lieke A. Melsen, Nans Addor, Naoki Mizukami, Andrew J. Newman, Paul J. J. F. Torfs, Martyn P. Clark, Remko Uijlenhoet, and Adriaan J. Teuling
Hydrol. Earth Syst. Sci., 22, 1775–1791, https://doi.org/10.5194/hess-22-1775-2018, https://doi.org/10.5194/hess-22-1775-2018, 2018
Short summary
Short summary
Long-term hydrological predictions are important for water management planning, but are also prone to uncertainty. This study investigates three sources of uncertainty for long-term hydrological predictions in the US: climate models, hydrological models, and hydrological model parameters. Mapping the results revealed spatial patterns in the three sources of uncertainty: different sources of uncertainty dominate in different regions.
Katrien Van Eerdenbrugh, Stijn Van Hoey, Gemma Coxon, Jim Freer, and Niko E. C. Verhoest
Hydrol. Earth Syst. Sci., 21, 5315–5337, https://doi.org/10.5194/hess-21-5315-2017, https://doi.org/10.5194/hess-21-5315-2017, 2017
Short summary
Short summary
Consistency in stage–discharge data is investigated using a methodology called Bidirectional Reach (BReach). Various measurement stations in the UK, New Zealand and Belgium are selected based on their historical ratings information and their characteristics related to data consistency. When applying a BReach analysis on them, the methodology provides results that appear consistent with the available knowledge and thus facilitates a reliable assessment of (in)consistency in stage–discharge data.
Hadush K. Meresa and Renata J. Romanowicz
Hydrol. Earth Syst. Sci., 21, 4245–4258, https://doi.org/10.5194/hess-21-4245-2017, https://doi.org/10.5194/hess-21-4245-2017, 2017
Short summary
Short summary
Evaluation of the uncertainty in projections of future hydrological extremes in the mountainous catchment was performed. The uncertainty of the estimate of 1-in-100-year return maximum flow based on the 1971–2100 time series exceeds 200 % of its median value with the largest influence of the climate model uncertainty, while the uncertainty of the 1-in-100-year return minimum flow is of the same order (i.e. exceeds 200 %) but it is mainly influenced by the hydrological model parameter uncertainty.
Omar Wani, Joost V. L. Beckers, Albrecht H. Weerts, and Dimitri P. Solomatine
Hydrol. Earth Syst. Sci., 21, 4021–4036, https://doi.org/10.5194/hess-21-4021-2017, https://doi.org/10.5194/hess-21-4021-2017, 2017
Short summary
Short summary
We generate uncertainty intervals for hydrologic model predictions using a simple instance-based learning scheme. Errors made by the model in some specific hydrometeorological conditions in the past are used to predict the probability distribution of its errors during forecasting. We test it for two different case studies in England. We find that this technique, even though conceptually simple and easy to implement, performs as well as some other sophisticated uncertainty estimation methods.
Christa Kelleher, Brian McGlynn, and Thorsten Wagener
Hydrol. Earth Syst. Sci., 21, 3325–3352, https://doi.org/10.5194/hess-21-3325-2017, https://doi.org/10.5194/hess-21-3325-2017, 2017
Short summary
Short summary
Models are tools for understanding how watersheds function and may respond to land cover and climate change. Before we can use models towards these purposes, we need to ensure that a model adequately represents watershed-wide observations. In this paper, we propose a new way to evaluate whether model simulations match observations, using a variety of information sources. We show how this information can reduce uncertainty in inputs to models, reducing uncertainty in hydrologic predictions.
Gabriele Baroni, Matthias Zink, Rohini Kumar, Luis Samaniego, and Sabine Attinger
Hydrol. Earth Syst. Sci., 21, 2301–2320, https://doi.org/10.5194/hess-21-2301-2017, https://doi.org/10.5194/hess-21-2301-2017, 2017
Short summary
Short summary
Three methods are used to characterize the uncertainty in soil properties. The effect on simulated states and fluxes is quantified using a distributed hydrological model. Different impacts are identified as function of the perturbation method, of the model outputs and of the spatio-temporal resolution. The study underlines the importance of a proper characterization of the uncertainty in soil properties for a correct assessment of their role and further improvements in the model application.
Ji Li, Yangbo Chen, Huanyu Wang, Jianming Qin, Jie Li, and Sen Chiao
Hydrol. Earth Syst. Sci., 21, 1279–1294, https://doi.org/10.5194/hess-21-1279-2017, https://doi.org/10.5194/hess-21-1279-2017, 2017
Short summary
Short summary
Quantitative precipitation forecast produced by the WRF model has a similar pattern to that estimated by rain gauges in a southern China large watershed, hydrological model parameters should be optimized with QPF produced by WRF, and simulating floods by coupling the WRF QPF with a distributed hydrological model provides a good reference for large watershed flood warning and could benefit the flood management communities due to its longer lead time.
Johanna I. F. Slaets, Hans-Peter Piepho, Petra Schmitter, Thomas Hilger, and Georg Cadisch
Hydrol. Earth Syst. Sci., 21, 571–588, https://doi.org/10.5194/hess-21-571-2017, https://doi.org/10.5194/hess-21-571-2017, 2017
Short summary
Short summary
Determining measures of uncertainty on loads is not trivial, as a load is a product of concentration and discharge per time point, summed up over time. A bootstrap approach enables the calculation of confidence intervals on constituent loads. Ignoring the uncertainty on the discharge will typically underestimate the width of 95 % confidence intervals by around 10 %. Furthermore, confidence intervals are asymmetric, with the largest uncertainty on the upper limit.
David N. Dralle, Nathaniel J. Karst, Kyriakos Charalampous, Andrew Veenstra, and Sally E. Thompson
Hydrol. Earth Syst. Sci., 21, 65–81, https://doi.org/10.5194/hess-21-65-2017, https://doi.org/10.5194/hess-21-65-2017, 2017
Short summary
Short summary
The streamflow recession is the period following rainfall during which flow declines. This paper examines a common method of recession analysis and identifies sensitivity of the technique's results to necessary, yet subjective, methodological choices. The results have implications for hydrology, sediment and solute transport, and geomorphology, as well as for testing numerous hydrologic theories which predict the mathematical form of the recession.
Simon Paul Seibert, Uwe Ehret, and Erwin Zehe
Hydrol. Earth Syst. Sci., 20, 3745–3763, https://doi.org/10.5194/hess-20-3745-2016, https://doi.org/10.5194/hess-20-3745-2016, 2016
Short summary
Short summary
While the assessment of "vertical" (magnitude) errors of streamflow simulations is standard practice, "horizontal" (timing) errors are rarely considered. To assess their role, we propose a method to quantify both errors simultaneously which closely resembles visual hydrograph comparison. Our results reveal differences in time–magnitude error statistics for different flow conditions. The proposed method thus offers novel perspectives for model diagnostics and evaluation.
Paul Hublart, Denis Ruelland, Inaki García de Cortázar-Atauri, Simon Gascoin, Stef Lhermitte, and Antonio Ibacache
Hydrol. Earth Syst. Sci., 20, 3691–3717, https://doi.org/10.5194/hess-20-3691-2016, https://doi.org/10.5194/hess-20-3691-2016, 2016
Short summary
Short summary
Our paper explores the reliability of conceptual catchment models in the dry Andes. First, we show that explicitly accounting for irrigation water use improves streamflow predictions during dry years. Second, we show that sublimation losses can be easily incorporated into temperature-based melt models without increasing model complexity too much. Our work also highlights areas requiring additional research, including the need for a better conceptualization of runoff generation processes.
Stephen Oni, Martyn Futter, Jose Ledesma, Claudia Teutschbein, Jim Buttle, and Hjalmar Laudon
Hydrol. Earth Syst. Sci., 20, 2811–2825, https://doi.org/10.5194/hess-20-2811-2016, https://doi.org/10.5194/hess-20-2811-2016, 2016
Short summary
Short summary
This paper presents an important framework to improve hydrologic projections in cold regions. Hydrologic modelling/projections are often based on model calibration to long-term data. Here we used dry and wet years as a proxy to quantify uncertainty in projecting hydrologic extremes. We showed that projections based on long-term data could underestimate runoff by up to 35% in boreal regions. We believe the hydrologic modelling community will benefit from new insights derived from this study.
Juraj Parajka, Alfred Paul Blaschke, Günter Blöschl, Klaus Haslinger, Gerold Hepp, Gregor Laaha, Wolfgang Schöner, Helene Trautvetter, Alberto Viglione, and Matthias Zessner
Hydrol. Earth Syst. Sci., 20, 2085–2101, https://doi.org/10.5194/hess-20-2085-2016, https://doi.org/10.5194/hess-20-2085-2016, 2016
Short summary
Short summary
Streamflow estimation during low-flow conditions is important for estimation of environmental flows, effluent water quality, hydropower operations, etc. However, it is not clear how the uncertainties in assumptions used in the projections translate into uncertainty of estimated future low flows. The objective of the study is to explore the relative role of hydrologic model calibration and climate scenarios in the uncertainty of low-flow projections in Austria.
Susana Almeida, Nataliya Le Vine, Neil McIntyre, Thorsten Wagener, and Wouter Buytaert
Hydrol. Earth Syst. Sci., 20, 887–901, https://doi.org/10.5194/hess-20-887-2016, https://doi.org/10.5194/hess-20-887-2016, 2016
Short summary
Short summary
The absence of flow data to calibrate hydrologic models may reduce the ability of such models to reliably inform water resources management. To address this limitation, it is common to condition hydrological model parameters on regionalized signatures. In this study, we justify the inclusion of larger sets of signatures in the regionalization procedure if their error correlations are formally accounted for and thus enable a more complete use of all available information.
H. Xu and Y. Luo
Hydrol. Earth Syst. Sci., 19, 4609–4618, https://doi.org/10.5194/hess-19-4609-2015, https://doi.org/10.5194/hess-19-4609-2015, 2015
Short summary
Short summary
This study quantified the climate impact on river discharge in the River Huangfuchuan in semi-arid northern China and the River Xiangxi in humid southern China. Climate projections showed trends toward warmer and wetter conditions, particularly for the River Huangfuchuan. The main projected hydrologic impact was a more pronounced increase in annual discharge in both catchments. Peak flows are projected to appear earlier than usual in the River Huangfuchuan and later than usual in River Xiangxi.
I. K. Westerberg and H. K. McMillan
Hydrol. Earth Syst. Sci., 19, 3951–3968, https://doi.org/10.5194/hess-19-3951-2015, https://doi.org/10.5194/hess-19-3951-2015, 2015
Short summary
Short summary
This study investigated the effect of uncertainties in data and calculation methods on hydrological signatures. We present a widely applicable method to evaluate signature uncertainty and show results for two example catchments. The uncertainties were often large (i.e. typical intervals of ±10–40% relative uncertainty) and highly variable between signatures. It is therefore important to consider uncertainty when signatures are used for hydrological and ecohydrological analyses and modelling.
T. O. Sonnenborg, D. Seifert, and J. C. Refsgaard
Hydrol. Earth Syst. Sci., 19, 3891–3901, https://doi.org/10.5194/hess-19-3891-2015, https://doi.org/10.5194/hess-19-3891-2015, 2015
Short summary
Short summary
The impacts of climate model uncertainty and geological model uncertainty on hydraulic head, stream flow, travel time and capture zones are evaluated. Six versions of a physically based and distributed hydrological model, each containing a unique interpretation of the geological structure of the model area, are forced by 11 climate model projections. Geology is the dominating uncertainty source for travel time and capture zones, while climate dominates for hydraulic heads and steam flow.
N. Dogulu, P. López López, D. P. Solomatine, A. H. Weerts, and D. L. Shrestha
Hydrol. Earth Syst. Sci., 19, 3181–3201, https://doi.org/10.5194/hess-19-3181-2015, https://doi.org/10.5194/hess-19-3181-2015, 2015
F. Bourgin, V. Andréassian, C. Perrin, and L. Oudin
Hydrol. Earth Syst. Sci., 19, 2535–2546, https://doi.org/10.5194/hess-19-2535-2015, https://doi.org/10.5194/hess-19-2535-2015, 2015
T. Berezowski, J. Nossent, J. Chormański, and O. Batelaan
Hydrol. Earth Syst. Sci., 19, 1887–1904, https://doi.org/10.5194/hess-19-1887-2015, https://doi.org/10.5194/hess-19-1887-2015, 2015
F. Silvestro, S. Gabellani, R. Rudari, F. Delogu, P. Laiolo, and G. Boni
Hydrol. Earth Syst. Sci., 19, 1727–1751, https://doi.org/10.5194/hess-19-1727-2015, https://doi.org/10.5194/hess-19-1727-2015, 2015
M. C. Demirel, M. J. Booij, and A. Y. Hoekstra
Hydrol. Earth Syst. Sci., 19, 275–291, https://doi.org/10.5194/hess-19-275-2015, https://doi.org/10.5194/hess-19-275-2015, 2015
Short summary
Short summary
This paper investigates the skill of 90-day low-flow forecasts using three models. From the results, it appears that all models are prone to over-predict runoff during low-flow periods using ensemble seasonal meteorological forcing. The largest range for 90-day low-flow forecasts is found for the GR4J model. Overall, the uncertainty from ensemble P forecasts has a larger effect on seasonal low-flow forecasts than the uncertainty from ensemble PET forecasts and initial model conditions.
J. Crossman, M. N. Futter, P. G. Whitehead, E. Stainsby, H. M. Baulch, L. Jin, S. K. Oni, R. L. Wilby, and P. J. Dillon
Hydrol. Earth Syst. Sci., 18, 5125–5148, https://doi.org/10.5194/hess-18-5125-2014, https://doi.org/10.5194/hess-18-5125-2014, 2014
Short summary
Short summary
We projected potential hydrochemical responses in four neighbouring catchments to a range of future climates. The highly variable responses in streamflow and total phosphorus (TP) were governed by geology and flow pathways, where larger catchment responses were proportional to greater soil clay content. This suggests clay content might be used as an indicator of catchment sensitivity to climate change, and highlights the need for catchment-specific management plans.
M. Honti, A. Scheidegger, and C. Stamm
Hydrol. Earth Syst. Sci., 18, 3301–3317, https://doi.org/10.5194/hess-18-3301-2014, https://doi.org/10.5194/hess-18-3301-2014, 2014
I. K. Westerberg, L. Gong, K. J. Beven, J. Seibert, A. Semedo, C.-Y. Xu, and S. Halldin
Hydrol. Earth Syst. Sci., 18, 2993–3013, https://doi.org/10.5194/hess-18-2993-2014, https://doi.org/10.5194/hess-18-2993-2014, 2014
Cited articles
Alton, P., Mercado, L., and North, P.: A sensitivity analysis of the land-surface scheme JULES conducted for three forest biomes: Biophysical parameters, model processes, and meteorological driving data, Global Biogeochemical Cy., 20, GB1008, https://doi.org/10.1029/2005GB002653, 2006.
Archer, G., Saltelli, A., and Sobol, I.: Sensitivity measures, ANOVA-like techniques and the use of bootstrap, J. Stat. Comput. Simul., 58, 99–120, 1997.
Bastidas, L., Hogue, T., Sorooshian, S., Gupta, H., and Shuttleworth, W.: Parameter sensitivity analysis for different complexity land surface models using multicriteria methods, J. Geophys. Res., 111, 20101, https://doi.org/10.1029/2005JD006377, 2006.
Burnash, R. and Singh, V.: The NWS River Forecast System-Catchment Modeling, in: Computer Models of Watershed Hydrology, 311–366, Water Resour. Publ., Littleton, Colorado, 1995.
Campolongo, F., Cariboni, J., and Saltelli, A.: An effective screening design for sensitivity analysis of large models, Environ. Modell. Softw., 22, 1509–1518, 2007.
Campolongo, F., Saltelli, A., and Cariboni, J.: From screening to quantitative sensitivity analysis. A unified approach, Comput. Phys. Commun., 182, 978–988, 2011.
Carpenter, T. M., Georgakakos, K. P., and Sperfslagea, J. A.: On the parametric and NEXRAD-radar sensitivities of a distributed hydrologic model suitable for operational use, J. Hydrol., 253, 169–193, 2001.
Cloke, H., Pappenberger, F., and Renaud, J.: Multi–method global sensitivity analysis (MMGSA) for modelling floodplain hydrological processes, Hydrol. Process., 22, 1660–1674, 2008.
Demaria, E., Nijssen, B., and Wagener, T.: Monte Carlo sensitivity analysis of land surface parameters using the Variable Infiltration Capacity model, J. Geophys. Res, 112, D11113, https://doi.org/10.1029/2006JD007534, 2007.
Efron, B. and Tibshirani, R. J.: An introduction to the bootstrap, Vol. 57, Chapman & Hall/CRC, 1994.
Franchini, M., Wendling, J., Obled, C., and Todini, E.: Physical interpretation and sensitivity analysis of the TOPMODEL, J. Hydrol., 175, 293–338, 1996.
Freer, J., Beven, K., and Ambroise, B.: Bayesian estimation of uncertainty in runoff prediction and the value of data: An application of the GLUE approach, Water Resour. Res., 32, 2161–2173, 1996.
Gupta, Wagener, T., and Liu, Y.: Reconciling theory with observations: elements of a diagnostic approach to model evaluation, Hydrolog. Process., 22, 3802–3813, 2008.
Gupta, H., Sorooshian, S., and Yapo, P.: Toward improved calibration of hydrologic models: Multiple and noncommensurable measures of information, Water Resour. Res., 34, 751–763, 1998.
Hadka, D. and Reed, P.: MOEAFramework: An open-source Java framework for multiobjective optimization, available at: http://moeaframework.org, version 1.17, 2012.
Hall, J., Tarantola, S., Bates, P., and Horritt, M.: Distributed sensitivity analysis of flood inundation model calibration, J. Hydraul. Eng., 131, 117–126, 2005.
Herman, J. D., Reed, P. M., and Wagener, T.: Time-varying sensitivity analysis clarifies the effects of watershed model formulation on model behavior, Water Resour. Res., 49, 1400–1414, https://doi.org/10.1002/wrcr.20124, 2013.
Homma, T. and Saltelli, A.: Importance measures in global sensitivity analysis of nonlinear models, Reliability Eng. Syst. Safe., 52, 1–17, 1996.
Hornberger, G. and Spear, R.: Approach to the preliminary analysis of environmental systems, J. Environ. Manage., 12, 7–18, 1981.
Koren, V., Reed, S., Smith, M., Zhang, Z., and Seo, D.-J.: Hydrology laboratory research modeling system (HL-RMS) of the US national weather service, J. Hydrol., 291, 297–318, 2004.
Moreda, F., Koren, V., Zhang, Z., Reed, S., and Smith, M.: Parameterization of distributed hydrological models: learning from the experiences of lumped modeling, J. Hydrol., 320, 218–237, 2006.
Morris, M. D.: Factorial Sampling Plans for Preliminary Computational Experiments, Technometrics, 33, 161–174, ArticleType: research-article/Full publication date: May, 1991/Copyright1991 American Statistical Association and American Society for Quality, 1991.
Muleta, M. and Nicklow, J.: Sensitivity and uncertainty analysis coupled with automatic calibration for a distributed watershed model, J. Hydrol., 306, 127–145, 2005.
Nossent, J. and Bauwens, W.: Application of a normalized Nash-Sutcliffe efficiency to improve the accuracy of the Sobol'sensitivity analysis of a hydrological model, in: EGU General Assembly Conference Abstracts, 14, p. 237, available at: http://adsabs.harvard.edu/abs/2012EGUGA..14..237N, 2012a.
Nossent, J. and Bauwens, W.: Optimising the convergence of Sobol sensitivity analysis for an environmental model: application of an appropriate estimate for the square of the expectation value and total variance, in: International Environmental Modelling and Software Society 2012 International Congress on Environmental Modelling and Software. Managing Resources of a Limited Planet: Pathways and Visions under Uncertainty, Sixth Biennial Meeting, Leipzig, Germany, edited by: Seppelt, R., Voinov, A., Lange, S., and Bankamp, D., 1080–1087, 2012b.
Nossent, J., Elsen, P., and Bauwens, W.: Sobol sensitivity analysis of a complex environmental model, Environ. Modell. Softw., 26, 1515–1525, 2011.
Pujol, G., Iooss, B., and Janon, A.: Sensitivity Analysis Package, available at: http://cran.r-project.org/web/packages/sensitivity/index.html, R package version 1.7-0, 2013.
Reed, S., Koren, V., Smith, M., Zhang, Z., Moreda, F., Seo, D.-J., and DMIP Participants, A.: Overall distributed model intercomparison project results, J. Hydrol., 298, 27–60, 2004.
Reusser, D. and Zehe, E.: Inferring model structural deficits by analyzing temporal dynamics of model performance and parameter sensitivity, Water Resour. Res., 47, W07550, https://doi.org/10.1029/2010WR009946, 2011.
Reusser, D., Buytaert, W., and Zehe, E.: Temporal dynamics of model parameter sensitivity for computationally expensive models with the Fourier amplitude sensitivity test, Water Resour. Res., 47, W07551, https://doi.org/10.1029/2010WR009947, 2011.
Ruano, M., Ribes, J., Seco, A., and Ferrer, J.: An improved sampling strategy based on trajectory design for application of the Morris method to systems with many input factors, Environ. Modell. Softw., 37, 103–109, 2012.
Saltelli, A.: Making best use of model evaluations to compute sensitivity indices, Comput. Phys. Commun., 145, 280–297, 2002.
Saltelli, A., Ratto, M., Andres, T., Campolongo, F., Cariboni, J., Gatelli, D., Saisana, M., and Tarantola, S.: Global sensitivity analysis: the primer, Wiley Online Library, 2008.
Sieber, A. and Uhlenbrook, S.: Sensitivity analyses of a distributed catchment model to verify the model structure, J. Hydrol., 310, 216–235, 2005.
Smith, M. B., Seo, D.-J., Koren, V. I., Reed, S. M., Zhang, Z., Duan, Q., Moreda, F., and Cong, S.: The distributed model intercomparison project (DMIP): motivation and experiment design, J. Hydrol., 298, 4–26, 2004.
Smith, M. B., Koren, V., Reed, S., Zhang, Z., Zhang, Y., Moreda, F., Cui, Z., Mizukami, N., Anderson, E. A., and Cosgrove, B. A.: The distributed model intercomparison project – Phase 2: Motivation and design of the Oklahoma experiments, J. Hydrol., 418–419, 3–16, 2012.
Sobol', I.: Global sensitivity indices for nonlinear mathematical models and their Monte Carlo estimates, Mathe. Comput. Simul., 55, 271–280, 2001.
Tang, Y., Reed, P., Van Werkhoven, K., and Wagener, T.: Advancing the identification and evaluation of distributed rainfall–runoff models using global sensitivity analysis, Water Resour. Res., 43, W06415, https://doi.org/10.1029/2006WR005813, 2007a.
Tang, Y., Reed, P., Wagener, T., and van Werkhoven, K.: Comparing sensitivity analysis methods to advance lumped watershed model identification and evaluation, Hydrol. Earth Syst. Sci., 11, 793–817, https://doi.org/10.5194/hess-11-793-2007, 2007b.
van Griensven, A., Meixner, T., Grunwald, S., Bishop, T., Diluzio, M., and Srinivasan, R.: A global sensitivity analysis tool for the parameters of multi-variable catchment models, J. Hydrol., 324, 10–23, 2006.
Van Werkhoven, K., Wagener, T., Reed, P., and Tang, Y.: Characterization of watershed model behavior across a hydroclimatic gradient, Water Resour. Res., 44, W01429, https://doi.org/10.1029/2007WR006271, 2008a.
Van Werkhoven, K., Wagener, T., Reed, P., and Tang, Y.: Rainfall characteristics define the value of streamflow observations for distributed watershed model identification, Geophys. Res. Lett, 35, L11403, https://doi.org/10.1029/2008GL034162, 2008b.
Van Werkhoven, K., Wagener, T., Reed, P., and Tang, Y.: Sensitivity–guided reduction of parametric dimensionality for multi–objective calibration of watershed models, Adv. Water Resour., 32, 1154–1169, 2009.
Wagener, T., Boyle, D. P., Lees, M. J., Wheater, H. S., Gupta, H. V., and Sorooshian, S.: A framework for development and application of hydrological models, Hydrol. Earth Syst. Sci., 5, 13–26, https://doi.org/10.5194/hess-5-13-2001, 2001.
Wagener, T., Reed, P., van Werkhoven, K., Tang, Y., and Zhang, Z.: Advances in the identification and evaluation of complex environmental systems models, J. Hydroinform., 11, 266–281, 2009.
Yang, J.: Convergence and uncertainty analyses in Monte–Carlo based sensitivity analysis, Environ. Modell. Softw., 26, 444–457, 2011.
Zaehle, S., Sitch, S., Smith, B., and Hatterman, F.: Effects of parameter uncertainties on the modeling of terrestrial biosphere dynamics, Global Biogeochem. Cy., 19, GB3020, https://doi.org/10.1029/2004GB002395, 2005.
