the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
A large-sample investigation into uncertain climate change impacts on high flows across Great Britain
Gemma Coxon
Jim Freer
Jan Seibert
Thorsten Wagener
Download
- Final revised paper (published on 07 Nov 2022)
- Supplement to the final revised paper
- Preprint (discussion started on 29 Jun 2021)
- Supplement to the preprint
Interactive discussion
Status: closed
-
RC1: 'Comment on hess-2021-321', Anonymous Referee #1, 22 Jul 2021
Lane et al. present an analysis of high flow metrics for 346 catchments in a future climate, considering 30 different parameter fields and 12 different RCMs. Although there is really nothing substantially wrong with the approach, especially when the goal is to support policy making, I think scientifically there are some missed opportunities which makes that the scientific gain of this study is currently limited.
Several choices are not properly substantiated. All RCMs are based on one single GCM. Why only one, and why this one? It reads as if this is not necessarily the GCM that performs best in the region of GB. DECIPHeR gives nice opportunities to test multiple model structures, why only one, and why only Topmodel? Only RCP8.5 is considered, why only this one and what would that imply for the results? Why were different datasets used for P and PET for the bias correction? Both datasets seem to have both variables. Why was snow not included as process in the hydrological model? I was surprised that T was not required as input for the hydrological model (indeed, to simulate snow processes), to only find at the end of the discussion that snow was not accounted for - with a reference to eastern Scotland where the snow fraction can be up to 0.17. There might be valid reasons for each of these choices, but they can be better explained.
At several places, it is mentioned that caution should be taken when interpreting the results (related to snow, see later point, and to potential groundwater flow). Not even widely discussed are the catchments with reservoirs/regulated flow (they are only mentioned as being excluded for the analysis of the evaluation of the model chain, but how many of the 346 are (heavily) regulated? are they spatially clustered? and how can we somehow validate the simulation of these catchments if the regulation is not included in the model structure?). Taken into account these three factors (snow, groundwater, regulation) that require caution in the interpretation, it becomes a bit difficult to determine which numbers have meaning, and which don't. Given that uncertainty estimation is one aspect of this study, it are precisely these kind of aspects that might need more attention.
Besides that many choices are not well substantiated, I think there are some missed opportunities in analyzing and presenting the effect of uncertainty (in this case, introduced by RCMs and parameters). For instance in Figure 7, one could expect that the parameters have influence on the non-linear relation between precip and Q1, while it is precisely the median of the parameter sets that is displayed here (same for the runoff coefficient). Therefore, after reading the manuscript, I still don't have the feeling I fully comprehend the uncertainty in the projections and their implications for the results.
In spite of what is written in the introduction ("Many studies have attempted to quantify the impact of these uncertainties by using multiple GCMs/RCMs, bias correction techniques, hydrological model structures and/or hydrological model parameter sets and propagating these uncertainties through the modelling chain. However, these studies are often focused on small catchment samples as the large numbers of simulations needed are computationally demanding"), there are studies that sample several steps of the modelling chain for a large sample of catchments (see references below, sorry to refer to my own work), and which might be useful in the discussion to put the results into perspective (how do these results compare to accounting for different GCMs and different hydrological model structures?).
*Melsen et al. "Mapping disagreement in hydrologic projections", HESS 2018
*Chegwidden et al., "How Do Modeling Decisions Affect the Spread Among Hydrologic Climate Change Projections? Exploring a Large Ensemble of Simulations Across a Diversity of Hydroclimates", Earths Future 2019,
*Queen et al., "Ubiquitous increases in flood magnitude in the Columbia River basin under climate change", HESS, 2021Last minor thing: In the discussion (l. 430) the selection of a metric is referred to as a source of uncertainty. I'm not sure I entirely agree with that. Different metrics will lead to different results, simply because they evaluate different things. That is, in my opinion, not uncertainty but simply the result of a (hopefuly deliberate) choice. It does show, however, that it can be useful to evaluate multiple metrics.
l. 244; average flow is not necessarily equal to median flow.
If this review sounds a bit harsh, it is because I know the authors can do better. Most of the material is already there, therefore I am confident that the authors will be able to improve the manuscript such that it will add more to the scientific literature.
Lieke Melsen
Wageningen UniversityCitation: https://doi.org/10.5194/hess-2021-321-RC1 -
AC1: 'Reply on RC1', Rosanna Lane, 22 Nov 2021
Response to Reviewer 1. Review comments have been included in bold, with our responses to each comment below.
RC: Lane et al. present an analysis of high flow metrics for 346 catchments in a future climate, considering 30 different parameter fields and 12 different RCMs. Although there is really nothing substantially wrong with the approach, especially when the goal is to support policy making, I think scientifically there are some missed opportunities which makes that the scientific gain of this study is currently limited.
Response:
Thank you for your helpful feedback and for taking the time to write a review. Whilst we agree the results of the paper will be useful to support policy making, it is primarily a science based paper. As such, the paper explores the complex issues of uncertainty evaluation within national catchment responses under climate change. It highlights the value in considering hydrological model parameter uncertainties (found to be especially important for catchments in southeast England), and investigates how predicted responses to climatic change differ over regions and national scales that also depend on catchment characteristics and geoclimatic regimes.
RC: Several choices are not properly substantiated...
Response:
We do not agree with this assertion. Ultimately all climate impact modelling papers will have made different methodological choices and simplifications. Here, we focused on analysing uncertain climate impacts at the national scale, which is already computationally demanding within a high resolution (1.2km2 average HRU scale) distributed model. Additionally we evaluate the model parameter uncertainties and impacts of these cascades on streamflow changes. This goes beyond previous national studies for Britain, which have not previously considered hydrological parameter uncertainties over such a large number of catchments.
We respond to comments on each choice separately below. In response to these comments we will add to the methods and data section to ensure that it is clear why our methodological choices were made.
RC: All RCMs are based on one single GCM. Why only one, and why this one? It reads as if this is not necessarily the GCM that performs best in the region of GB. Only RCP8.5 is considered, why only this one and what would that imply for the results?
Response:
The aim of this study was to explore hydrological model parameter uncertainties within a national climate impact study. We selected the UKCP18 climate projections to help us meet this aim as they have many advantages over other products, including 1) they were the nationally recognised highest resolution RCM climate model outputs available for a continuous time period over GB, 2) they were specifically developed for the UK and previous UKCP products have formed the basis of UK climate policy (Murphy et al. 2018), 3) they include a measure of climate uncertainty through the use of an RCM ensemble, 4) as RCM projections they are high resolution (12km) and have full spatial and temporal coherence which is needed to evaluate future climate change impacts on high flows in a spatially distributed hydrological model, 5) they are the newest national climate projections for GB, including the latest developments in climate modelling capability and scientific understanding, and have not yet been comprehensively analysed in other studies.
The UKCP18 projections only included RCM simulations for a single GCM, but still explored some climate uncertainties through the use of an RCM ensemble. This approach was also used for the UKCP09 climate projections which have been used in many UK climate impact studies (e.g. Prudhomme et al. 2013, Bell et al. 2016, Kay et al. 2018). The RCM ensemble was considered sufficient for our aim of assessing the hydrological model uncertainties within a national climate impact study. Importantly, we also found that minor differences between the RCM runs resulted in a huge variation of hydrological implications, showing that the RCM parameterisations which may be expected to be less influential were crucial after all. We are aware that the use of a different GCM would produce differing results, and this limitation is recognised in our discussion (lines 445-452). In response to all reviewers commenting on the use of a single GCM, we will clarify why the UKCP18 product was chosen in section 2.3. We will also make the limitations of this clearer in the discussion, adding that other GCMs may result in different precipitation trends into the future.
UKCP18 also only included RCM projections for the RCP8.5 scenario. We considered this the most important scenario to look at for two reasons: 1) it shows the ‘worst case’ and so will most likely show the largest expected changes, 2) the emissions in RCP8.5 are in close agreement with historical total cumulative CO2 emissions and more and more are looking like a plausible future (Schwalm et al. 2020). But again we recognise that our results would have been different if an alternative scenario had been used, and we acknowledge that it is best to use multiple scenarios if the information is available. In response to reviewer comments, we will 1) add a sentence to section 2.3 emphasizing that the RCP8.5 was the only available scenario and gives a ‘worst case’ and at this time ‘most likely’ future projection, 2) expand on the discussion of missing uncertainty sources to include emissions scenario and the impact this might have.
RC: DECIPHeR gives nice opportunities to test multiple model structures, why only one, and why only Topmodel?
Response:
We previously developed a modelling framework that uses spatial parameterisations which are nationally consistent and reflect core parametric uncertainties, constrained by available data using MPR (Lane et al. 2021). Our next step was to apply the model setup from Lane et al. (2021) to evaluate the hydrological modelling uncertainties when driving the model with a set of climate change scenarios. This manuscript presents the first GB-wide study to include hydrological model parameter uncertainties alongside RCM uncertainties, and further explores the relationship between catchment characteristics, climatic changes and changing high flows across a large sample of catchments. For this climate impact study, it was important to use the DECIPHeR model structure based on topographic flow gradients as a primary metric to define hydrological similarity as it has already been evaluated and parameterised across Great Britain (Coxon et al. 2019; Lane et al. 2021). We would like to note that DECIPHeR is not TOPMODEL except that topography is an important driver of hydrological response.
Whilst testing model structural variability was not an aim of this study, we agree with you that DECIPHeR gives a great opportunity to test different model structures and this is an ongoing research goal. Adding additional structures for different geologies, general climate variations, land management practices and human impacts is ongoing research that will take time to develop from our findings of Lane et al. (2021). However, that does not detract from the importance and need of quantifying uncertainties in hydrological impacts with our recent national model simulations.
RC: Why were different datasets used for P and PET for the bias correction? Both datasets seem to have both variables.
Response: The CHESS dataset uses CEH-GEAR as its rainfall data - we refer to the original dataset as is standard practice and to make clear the source of the data. The CEH-GEAR rainfall dataset does not include PET.
RC: Why was snow not included as process in the hydrological model? I was surprised that T was not required as input for the hydrological model (indeed, to simulate snow processes), to only find at the end of the discussion that snow was not accounted for - with a reference to eastern Scotland where the snow fraction can be up to 0.17. There might be valid reasons for each of these choices, but they can be better explained.
Response: Snow was not included as a process in the hydrological model because it affects so few catchments (95% of the catchments included in this study have less than 6% of precipitation falling as snow ). The exception to this is in the Cairngorm mountains in Scotland where the fraction of precipitation falling as snow can reach 17% (Coxon et al. 2020).Consequently, we included this in the discussion so that readers were fully aware of this limitation. We will ensure that modelling decisions are better explained in the revised manuscript.
RC: At several places, it is mentioned that caution should be taken when interpreting the results (related to snow, see later point, and to potential groundwater flow). Not even widely discussed are the catchments with reservoirs/regulated flow (they are only mentioned as being excluded for the analysis of the evaluation of the model chain, but how many of the 346 are (heavily) regulated? are they spatially clustered? and how can we somehow validate the simulation of these catchments if the regulation is not included in the model structure?). Taken into account these three factors (snow, groundwater, regulation) that require caution in the interpretation, it becomes a bit difficult to determine which numbers have meaning, and which don't. Given that uncertainty estimation is one aspect of this study, it are precisely these kind of aspects that might need more attention.
Response:
Of the 346 catchments analysed, the majority (60%) have no reservoirs in the catchment. 71 gauges (20%) have 1-5 reservoirs upstream, and 20% of gauges have more than 5 reservoirs upstream. While 40% of gauges do have a reservoir in the catchment, the capacity of the reservoirs is an additional important indicator of its impact on the flow time series as many of these reservoirs have a small capacity relative to the average precipitation and flow at the gauge. Of the 346 gauges, only 20 (5%) had a capacity greater than 10% of mean annual rainfall.
We excluded catchments with reservoirs/ regulated flows from the evaluation of the model chain because we would not expect the model to accurately simulate these flows without reservoir information in the model structure. However, in response to this comment we explored how the model error in simulating AMAX, Q1, Q10 and Q50 varied between the catchments with regulated flows/ reservoirs and those without. We found that there was not a reduction in performance between the catchments with regulated flows/reservoirs and those without - and will add these extra plots to the supplementary information.
To respond to this comment, we will include information about reservoirs in the supplementary information.
RC: Besides that many choices are not well substantiated, I think there are some missed opportunities in analyzing and presenting the effect of uncertainty (in this case, introduced by RCMs and parameters). For instance in Figure 7, one could expect that the parameters have influence on the non-linear relation between precip and Q1, while it is precisely the median of the parameter sets that is displayed here (same for the runoff coefficient). Therefore, after reading the manuscript, I still don't have the feeling I fully comprehend the uncertainty in the projections and their implications for the results.
Response: Again, we do not agree that ‘many’ of our choices are not well substantiated. When creating Figure 7 we explored using different hydrological parameter sets, and ended up selecting the median as the choice of parameter set made little difference to the overall picture. We will add plots to the supplementary information to demonstrate how this plot changes for different hydrological model parameter set selections, as well as to demonstrate how this plot differs for other precipitation quantiles and flow statistics.
RC: In spite of what is written in the introduction ("Many studies have attempted to quantify the impact of these uncertainties by using multiple GCMs/RCMs, bias correction techniques, hydrological model structures and/or hydrological model parameter sets and propagating these uncertainties through the modelling chain. However, these studies are often focused on small catchment samples as the large numbers of simulations needed are computationally demanding"), there are studies that sample several steps of the modelling chain for a large sample of catchments (see references below, sorry to refer to my own work), and which might be useful in the discussion to put the results into perspective (how do these results compare to accounting for different GCMs and different hydrological model structures?). *Melsen et al. "Mapping disagreement in hydrologic projections", HESS 2018 *Chegwidden et al., "How Do Modeling Decisions Affect the Spread Among Hydrologic Climate Change Projections? Exploring a Large Ensemble of Simulations Across a Diversity of Hydroclimates", Earths Future 2019, *Queen et al., "Ubiquitous increases in flood magnitude in the Columbia River basin under climate change", HESS, 2021
Response: Thank you for highlighting these papers - we will add references into the discussion to further support section 4.3. We note that two of these studies are focused on a single multi-nested river basin, albeit of considerable size. And that Melsen et al. focused purely on the sign of change and did not use any form of weightings to define the quality and fit of the ensembles of model simulations. We shall discuss these issues in our revised manuscript.
RC: Last minor thing: In the discussion (l. 430) the selection of a metric is referred to as a source of uncertainty. I'm not sure I entirely agree with that. Different metrics will lead to different results, simply because they evaluate different things. That is, in my opinion, not uncertainty but simply the result of a (hopefully deliberate) choice. It does show, however, that it can be useful to evaluate multiple metrics.
Response: We agree with you on this. We will alter the text from “The selection of metrics used to explore climate impacts was a further source of uncertainty; the picture of climate change impacts on flows differed between the four metrics presented here.” to “The overall picture of climate change impact on flows differed between the four selected metrics, showing the importance of metric selection and consideration of multiple metrics in model evaluation and impact studies.”
RC: l. 244; average flow is not necessarily equal to median flow.
Response: We agree and will change ‘average’ to ‘median.’
RC: If this review sounds a bit harsh, it is because I know the authors can do better. Most of the material is already there, therefore I am confident that the authors will be able to improve the manuscript such that it will add more to the scientific literature.
Response: We appreciate the thought and suggestions that have gone into your review. Of course we feel more strongly that our contribution highlights a number of core aspects and delves into the uncertainty problem nationally in a way that has rarely (and never in the case of UK climate simulations) been seen.
References:
Bell, V. A., Kay, A. L., Davies, H. N., & Jones, R. G. (2016). An assessment of the possible impacts of climate change on snow and peak river flows across Britain. Climatic Change, 136(3), 539-553.
Coxon, G., Freer, J., Lane, R., Dunne, T., Knoben, W. J., Howden, N. J., ... & Woods, R. (2019). DECIPHeR v1: dynamic fluxEs and connectivity for predictions of HydRology. Geoscientific Model Development, 12(6), 2285-2306.
Coxon, G., Addor, N., Bloomfield, J. P., Freer, J., Fry, M., Hannaford, J., ... & Woods, R. (2020). CAMELS-GB: Hydrometeorological time series and landscape attributes for 671 catchments in Great Britain. Earth System Science Data, 12(4), 2459-2483.
Kay, A. L., Bell, V. A., Guillod, B. P., Jones, R. G., & Rudd, A. C. (2018). National-scale analysis of low flow frequency: historical trends and potential future changes. Climatic Change, 147(3), 585-599.
Lane, R. A., Freer, J. E., Coxon, G., & Wagener, T. (2021). Incorporating Uncertainty into Multiscale Parameter Regionalisation to Evaluate the Performance of Nationally Consistent Parameter Fields for a Hydrological Model. Water Resources Research, e2020WR0283
Murphy, J. M., Harris, G. R., Sexton, D. M. H., Kendon, E. J., Bett, P. E., Clark, R. T., ... & Yamazaki, S. T. (2018). UKCP18 land projections: Science report.
Prudhomme, C., Haxton, T., Crooks, S., Jackson, C., Barkwith, A., Williamson, J., ... & Watts, G. (2013). Future Flows Hydrology: an ensemble of daily river flow and monthly groundwater levels for use for climate change impact assessment across Great Britain. Earth System Science Data, 5(1), 101-107.
Schwalm, C. R., Glendon, S., & Duffy, P. B. (2020). RCP8. 5 tracks cumulative CO2 emissions. Proceedings of the National Academy of Sciences, 117(33), 19656-19657.
Citation: https://doi.org/10.5194/hess-2021-321-AC1
-
AC1: 'Reply on RC1', Rosanna Lane, 22 Nov 2021
-
RC2: 'Comment on hess-2021-321', Anonymous Referee #2, 30 Jul 2021
I reviewed the manuscript “A large-sample investigation into uncertain climate change impacts on high flows across Great Britain” by Lane et al. The main goal of this work is to present climate change impact projections on high flows for GB including climate model and hydrological model parameter uncertainties.
There is nothing substantially new in this study: national scale studies already exist, studies with more options considered for each step of the modelling chain exist, and studies with a more thorough evaluation of the uncertainties exist.
Overall, the study has some potential. Unfortunately, some methodological choices are questionable and do not reflect the state-of-the-art. Namely, the fact that one RCP only is used, one GCM only is used, that periods are not 30-year long and the reference period overlaps the “future” of RCPs is disturbing. Some figures are not properly introduced (I am not sure I understood well what is presented based on the captions).
To summarize, I must say I failed to learn new insight neither on a methodological point of view nor on the future of GB floods (as one GCM and one RCP are used only).
In addition, I second all comments from reviewer 1.
Below are my major remarks, as well as miscellaneous minor or moderate points to tackle.
Major remarks:
A single GCM is used. I was very surprised to discover that the authors made the choice of using a single GCM. That's a rather unusual set up for this analysis: GCMs account for a large part of uncertainties in hydrological projections!
The justification that comes at lines 145-147 (I understand it as the will to only sample the warmer range of possible climate outputs) is not convincing to me: another GCM, with a rather similar temperature pattern, might result in a very different precipitation evolution in the future - not all GCMs will result in intensified precipitation with similar spatial patterns, intensity and seasonality. As a consequence, the use of this single GCM might be interesting to estimate the warmer range of future temperature, but not at all to estimate the future range of hydrological variables!
Choice of the study periods. The authors state that “changes in flow metrics between the baseline (1985 –2010) and future (2050 –2075) periods were evaluated.”. Why these choices? These are quite unusual for several reasons:
- the baseline contains 5 years with "future" GHG emission trajectories (2006-2010)
- the periods do not cover the classical 30-year period used to estimate climatology (WMO recommendation)
In addition, nowadays many studies assess the impact of climate change over the whole future period, using moving windows, which is a clear step forward as it allows to identify emergence times and trends.
Warmup period: Line 233: I find this justification rather disappointing. There are many ways to avoid throwing 5 years of climate data during the pre-RCP period (i.e. < 2005):
- using RCM data < 1981 for warmup (but I understand that it was not made available by Met Office, which is very surprising as most climate models usually start in 1950 or 1970 at least)
- using observed climate data from <1981 for warmup
- recycling RCM data from 1981-1985 for obtaining 1981 initial states
Partially wrong assertions: Line 331: This assertion is partially erroneous for me. The sources of uncertainties depend a lot on the indicator that is studied. This is not necessarily true for low flows, as shown in more recent studies as those cited by the authors. See:
- Vidal, J.-P., Hingray, B., Magand, C., Sauquet, E., and Ducharne, A.: Hierarchy of climate and hydrological uncertainties in transient low-flow projections, Hydrol. Earth Syst. Sci., 20, 3651–3672, https://doi.org/10.5194/hess-20-3651-2016, 2016
- or Parajka, J., Blaschke, A. P., Blöschl, G., Haslinger, K., Hepp, G., Laaha, G., Schöner, W., Trautvetter, H., Viglione, A., and Zessner, M.: Uncertainty contributions to low-flow projections in Austria, Hydrol. Earth Syst. Sci., 20, 2085–2101, https://doi.org/10.5194/hess-20-2085-2016, 2016.
- or Thibault Lemaitre-Basset, Lila Collet, Guillaume Thirel, Juraj Parajka, Guillaume Evin & Benoît Hingray (2021) Climate change impact and uncertainty analysis on hydrological extremes in a French Mediterranean catchment, Hydrological Sciences Journal, 66:5, 888-903, DOI: 10.1080/02626667.2021.1895437
In addition, RCPs also represent an important source of uncertainty that is not considered in this study
Miscellaneous:
Abstract: evolution of discharge is mentioned, but with no reference to the RCP that is chosen. Please add this information
Line 37: the authors often refer to rain or rainfall, and sometimes to precipitation. As GB is overall rather affected by snowfall, the term precipitation might be preferred
Line 69-70: This is not clear for me why the authors think (and state) that. Using a large sample of catchments results in a diversity of relationships between climate change and hydrological response (see what you say in lines 37 to 39).
Line 114-116: Now I understand better and interpret lines 69-70 differently. This needs to be clarified
Section 2.1 : RCP still not mentioned. The use of a single GCM is also not mentioned here.
Line 127: it is rather surprising to see quantile 50 introduced as a high flow metric.
Line163-166: RCMs are blamed for precipitation overestimation and PET variance overprediction. Since RCMs are forced by a GCM, this GCM could be blamed as well for these issues. I see no proof that this comes from RCMs only.
Line 222-225: Not 100% clear for me: does that mean that among the 35000 parameter sets, only 30 of them gave mean KGE above 0.8?
Line 232: Why these choices?
Section 3.1: This section deals with climatological indicators, not meteorological changes
Line 258: Figure 3 is cited before Figure 2. Please inverse the 2 figures
Line 343-344: The P-Q relationship seems rather linear to me in this graph, except for the highest increase values. Maybe develop how you identify a non-linearity on this plot, as I might have misread it.
Line 384: Not clear, what do you mean by large studies?
Line 435: this precision come 100 lines too late (see comment for line 331).
Line 446-449: RCPs are missing here
Figure 2: i) not quite sure why Npeaks is not shown here. ii) In addition, one row could be added to this plot: the position of observed indicator among the projected indicators OR the median error. The min and max errors indeed only inform on extreme errors. iii) For the observed-driven simulation part, I guess that the uncertainty bounds come from the 20 parameter sets, whereas for the RCM-driven one it comes from the 20 parameter sets * 12 RCMs. It is correct? Please precise in the caption. iv) This is again a quite unusual way to present results, as errors coming from the GCM-RCM chain are mixed with errors coming from the hydrological model. We usually separate these two sources: simulations of the model forced by meteo observations are compared to observed discharges - which qualifies the hydrological model error/performance-, and then only simulations of the model forced by GCM/RCM data over the reference period are compared with simulations of the model forced by observed meteo data - which qualifies the bias induced by climate models.
Figure 3 & 6 & 7 & 8 caption: please remind the periods
Figure 5 caption “the median flow value from the hydrological parameter sets”: this is unclear, please reformulate
Figure 6 caption: Do you really average parameter values? It seems odd, as those parameter values would not be consistent together. The caption is insufficiently clear for understanding how this figure was obtained
Citation: https://doi.org/10.5194/hess-2021-321-RC2 -
AC2: 'Reply on RC2', Rosanna Lane, 22 Nov 2021
Response to Reviewer 2. Review comments have been included in bold, with our responses to each comment below.
RC: I reviewed the manuscript “A large-sample investigation into uncertain climate change impacts on high flows across Great Britain” by Lane et al. The main goal of this work is to present climate change impact projections on high flows for GB including climate model and hydrological model parameter uncertainties. There is nothing substantially new in this study: national scale studies already exist, studies with more options considered for each step of the modelling chain exist, and studies with a more thorough evaluation of the uncertainties exist. Overall, the study has some potential. Unfortunately, some methodological choices are questionable and do not reflect the state-of-the-art. Namely, the fact that one RCP only is used, one GCM only is used, that periods are not 30-year long and the reference period overlaps the “future” of RCPs is disturbing. Some figures are not properly introduced (I am not sure I understood well what is presented based on the captions). To summarize, I must say I failed to learn new insight neither on a methodological point of view nor on the future of GB floods (as one GCM and one RCP are used only). In addition, I second all comments from reviewer 1. Below are my major remarks, as well as miscellaneous minor or moderate points to tackle.
Response: Thank you for taking the time to review our paper and for your feedback, we have responded to all of the comments below. We disagree that we do not present anything substantially new. This study provides the first spatially consistent GB projections including both climate ensembles and hydrological model parameter uncertainties.
RC: A single GCM is used. I was very surprised to discover that the authors made the choice of using a single GCM. That's a rather unusual set up for this analysis: GCMs account for a large part of uncertainties in hydrological projections! The justification that comes at lines 145-147 (I understand it as the will to only sample the warmer range of possible climate outputs) is not convincing to me: another GCM, with a rather similar temperature pattern, might result in a very different precipitation evolution in the future - not all GCMs will result in intensified precipitation with similar spatial patterns, intensity and seasonality. As a consequence, the use of this single GCM might be interesting to estimate the warmer range of future temperature, but not at all to estimate the future range of hydrological variables!
Response:
We defer to the same responses we provided to Reviewer 1.
The aim of this study was to explore hydrological model parameter uncertainties within a national climate impact study. We selected the UKCP18 climate projections to help us meet this aim as they have many advantages over other products, including 1) they were the nationally recognised highest resolution RCM climate model outputs available for a continuous run period over GB, 2) they were specifically developed for the UK and previous UKCP products have formed the basis of UK climate policy (Murphy et al. 2018), 3) they include a measure of climate uncertainty through the use of an RCM ensemble, 4) as RCM projections they are high resolution (12km) and have full spatial and temporal coherence which is needed for a spatially distributed hydrological model, 5) they are the newest national climate projections for GB, including the latest developments in climate modelling capability and scientific understanding, and have not yet been comprehensively analysed in other studies.
The UKCP18 projections only included RCM simulations for a single GCM, but still explored some climate uncertainties through the use of an RCM ensemble. This approach was also used for the UKCP09 climate projections which have been used in many UK climate impact studies (e.g. Prudhomme et al. 2013, Bell et al. 2016, Kay et al. 2018). The RCM ensemble was considered sufficient for our aim of assessing the hydrological model uncertainties within a national climate impact study. Importantly, we also found that minor differences between the RCM runs resulted in a huge variation of hydrological implications, showing that the RCM parameterisations which may be expected to be less influential were crucial after all. We are aware that the use of a different GCM would produce differing results, and we mentioned this in our discussion (lines 445-452). In response to all reviewers commenting on the use of a single GCM, we will clarify why the UKCP18 product was chosen in section 2.3. We will also make the limitations of this clearer in the discussion, adding that other GCMs may result in different precipitation trends into the future.
UKCP18 also only included RCM projections for the RCP8.5 scenario. We considered this the most important scenario to look at for two reasons: 1) it shows the ‘worst case’ and so will most likely show the largest expected changes, 2) the emissions in RCP8.5 are in close agreement with historical total cumulative CO2 emissions and more and more are looking like a plausible future (Schwalm et al. 2020). But again we recognise that our results would have been different if an alternative scenario had been used, and we acknowledge that it is best to use multiple scenarios if the information is available. In response to reviewer comments, we will 1) add a sentence to section 2.3 emphasizing that the RCP8.5 was the only available scenario and gives a ‘worst case’, 2) expand on the discussion of missing uncertainty sources to include emissions scenario and the impact this might have.
RC: Choice of the study periods. The authors state that “changes in flow metrics between the baseline (1985 –2010) and future (2050 –2075) periods were evaluated.”. Why these choices? These are quite unusual for several reasons:
- the baseline contains 5 years with "future" GHG emission trajectories (2006-2010)
- the periods do not cover the classical 30-year period used to estimate climatology (WMO recommendation)
In addition, nowadays many studies assess the impact of climate change over the whole future period, using moving windows, which is a clear step forward as it allows to identify emergence times and trends.
Warmup period: Line 233: I find this justification rather disappointing. There are many ways to avoid throwing 5 years of climate data during the pre-RCP period (i.e. < 2005):
- using RCM data < 1981 for warmup (but I understand that it was not made available by Met Office, which is very surprising as most climate models usually start in 1950 or 1970 at least)
- using observed climate data from <1981 for warmup
- recycling RCM data from 1981-1985 for obtaining 1981 initial statesResponse:
The 25-year baseline and future periods were selected to allow the maximum distance between the baseline and future.
The choice of a 1985-2010 baseline was due to 1) the need for a long model spin-up period as this is required for some catchments in the south-east of England, 2) the choice to have baseline and future periods that were at least 25 years long.
Thank you for your suggestions on how to reduce the need for a long model spin-up, we will consider these options for future work and of course would have used RCM data pre-1981 if it had been available. You are correct that the 2006-2010 climate data does include an element of predictive information, but 1981-2010 is the standard baseline of the WMO and is offered as an alternative baseline for users of the UKCP18 products (Murphy et al. 2018).
We agree that moving window analysis enables an interesting analysis of trends, and will consider this for future work. However, our aim was to present a national overview of potential changes using a spatial model, and this is easiest to visualise using baseline and future time-slices.
RC: Partially wrong assertions: Line 331: This assertion is partially erroneous for me. The sources of uncertainties depend a lot on the indicator that is studied. This is not necessarily true for low flows, as shown in more recent studies as those cited by the authors.
Response: Thank you for highlighting this and for your suggested references, we agree with your comment. We will amend this sentence to “RCM parameters were a larger source of uncertainty in median and high flow changes than hydrological model parameters (see Figure 6). This finding agrees with previous studies that have investigated high flows, which generally find climate models to be the largest source of uncertainty in hydrological climate impact assessments (Addor et al., 2014; Bosshard et al., 2013; Kay et al., 2009).”
RC: In addition, RCPs also represent an important source of uncertainty that is not considered in this study.
Response: See our response to the ‘A single GCM is used’ comment above.
References:
Bell, V. A., Kay, A. L., Davies, H. N., & Jones, R. G. (2016). An assessment of the possible impacts of climate change on snow and peak river flows across Britain. Climatic Change, 136(3), 539-553.
Kay, A. L., Bell, V. A., Guillod, B. P., Jones, R. G., & Rudd, A. C. (2018). National-scale analysis of low flow frequency: historical trends and potential future changes. Climatic Change, 147(3), 585-599.
Murphy, J. M., Harris, G. R., Sexton, D. M. H., Kendon, E. J., Bett, P. E., Clark, R. T., ... & Yamazaki, S. T. (2018). UKCP18 land projections: Science report.
Prudhomme, C., Haxton, T., Crooks, S., Jackson, C., Barkwith, A., Williamson, J., ... & Watts, G. (2013). Future Flows Hydrology: an ensemble of daily river flow and monthly groundwater levels for use for climate change impact assessment across Great Britain. Earth System Science Data, 5(1), 101-107.
Schwalm, C. R., Glendon, S., & Duffy, P. B. (2020). RCP8. 5 tracks cumulative CO2 emissions. Proceedings of the National Academy of Sciences, 117(33), 19656-19657.
Citation: https://doi.org/10.5194/hess-2021-321-AC2
-
AC2: 'Reply on RC2', Rosanna Lane, 22 Nov 2021
-
RC3: 'Comment on hess-2021-321', Anonymous Referee #3, 13 Sep 2021
This is a well written paper by a strong team of researchers. My main comment is on their Section 2.3 - The authors are limiting their investigation by using a single GCM and scenario for projecting into the future. RCMs are essentially interpolators although with good physical realism. They work off lower and lateral boundaries that are simulated by the GCM. These lower and lateral boundaries have considerable biases unfortunately, and I often feel the use of RCMs without accounting for these biases as doing disservice to the use the simulation may have. We know that RCMs are well grounded to the topography, and hence one needs to question whether the RCM simulations with biased boundary conditions are essentially simulating the effect of the topography or the true change warming is about to unfold.
There are two ways of correcting this limitation and unfortunately, both require a bit of work on the part of the authors. The first of these is to remove systematic biases in the lateral and lower boundaries that form the inputs into the RCMs. By this I am not referring to the post-processing bias correction the authors have perfomed here, but the bias in the boundary conditions before the RCM is run. This, however, requires new RCM runs which is a significant effort in terms of computing and time. The authors may want to go through the papers below that illustrate how useful this can be:
Rocheta, E., Evans, J. P. & Sharma, A. Correcting lateral boundary biases in regional climate modelling: the effect of the relaxation zone. Climate Dynamics 55, 2511-2521, doi:10.1007/s00382-020-05393-1 (2020).
Kim, Y., Evans, J. P., Sharma, A. & Rocheta, E., Geophysical Research Letters, Spatial, temporal, and multivariate bias in regional climate model simulations. 48, e2020GL092058 (2021).The other way of addressing this limitation is to use multiple GCMs as the basis for boundary variables that feed into the RCM. While this does not address the biased boundary inputs the RCMs is subject to, it atleast produces an envelope of the uncertainty that results from the use of a single (biased) GCM. This is the approach most researchers use in climate change assessment, often coupled with a post-processing step involving bias correction. I realise the authors may be limited in their access to RCM simulations from other GCMs, but, if so, need to atleast discuss the implications this may have on their overall findings.
The only other comment I have is regarding the use of the distributional bias correction adopted. Given the importance of antecedent conditions (which the authos have noted), not considering bias in persistence attributes can misrepresent the relationship between pre-storm wetness and storm extremes. This is evident even in urban catchments where one would usually not expect antecedent conditions to matter. It may be worthwhile for the authors to assess this dependence in their bias corrected precipitations and observations, incase there is a bias present. This may be especially important in those catchments where they are seeing a decrease in flood magnitudes.
Citation: https://doi.org/10.5194/hess-2021-321-RC3 -
AC3: 'Reply on RC3', Rosanna Lane, 22 Nov 2021
Response to Reviewer 3. Review comments have been included in bold, with our responses to each comment below.
RC: This is a well written paper by a strong team of researchers.
Response: Thank you for taking the time to review our manuscript and for your suggestions.
RC: My main comment is on their Section 2.3 - The authors are limiting their investigation by using a single GCM and scenario for projecting into the future.
Response:
We defer to the same responses we provided to reviewers 1 and 2.
The aim of this study was to explore hydrological model parameter uncertainties within a national climate impact study. We selected the UKCP18 climate projections to help us meet this aim as they have many advantages over other products, including 1) they were the nationally recognised highest resolution RCM climate model outputs available for a continuous time period over GB, 2) they were specifically developed for the UK and previous UKCP products have formed the basis of UK climate policy (Murphy et al. 2018), 3) they include a measure of climate uncertainty through the use of an RCM ensemble, 4) as RCM projections they are high resolution (12km) and have full spatial and temporal coherence which is needed to evaluate future climate change impacts on high flows in a spatially distributed hydrological model, 5) they are the newest national climate projections for GB, including the latest developments in climate modelling capability and scientific understanding, and have not yet been comprehensively analysed in other studies.
The UKCP18 projections only included RCM simulations for a single GCM, but still explored some climate uncertainties through the use of an RCM ensemble. This approach was also used for the UKCP09 climate projections which have been used in many UK climate impact studies (e.g. Prudhomme et al. 2013, Bell et al. 2016, Kay et al. 2018). The RCM ensemble was considered sufficient for our aim of assessing the hydrological model uncertainties within a national climate impact study. Importantly, we also found that minor differences between the RCM runs resulted in a huge variation of hydrological implications, showing that the RCM parameterisations which may be expected to be less influential were crucial after all. We are aware that the use of a different GCM would produce differing results, and this limitation is recognised in our discussion (lines 445-452). In response to all reviewers commenting on the use of a single GCM, we will clarify why the UKCP18 product was chosen in section 2.3. We will also make the limitations of this clearer in the discussion, adding that other GCMs may result in different precipitation trends into the future.
UKCP18 also only included RCM projections for the RCP8.5 scenario. We considered this the most important scenario to look at for two reasons: 1) it shows the ‘worst case’ and so will most likely show the largest expected changes, 2) the emissions in RCP8.5 are in close agreement with historical total cumulative CO2 emissions and more and more are looking like a plausible future (Schwalm et al. 2020). But again we recognise that our results would have been different if an alternative scenario had been used, and we acknowledge that it is best to use multiple scenarios if the information is available. In response to reviewer comments, we will 1) add a sentence to section 2.3 emphasizing that the RCP8.5 was the only available scenario and gives a ‘worst case’ and at this time ‘most likely’ future projection, 2) expand on the discussion of missing uncertainty sources to include emissions scenario and the impact this might have.
RC: RCMs are essentially interpolators although with good physical realism. They work off lower and lateral boundaries that are simulated by the GCM. These lower and lateral boundaries have considerable biases unfortunately, and I often feel the use of RCMs without accounting for these biases as doing disservice to the use the simulation may have. We know that RCMs are well grounded to the topography, and hence one needs to question whether the RCM simulations with biased boundary conditions are essentially simulating the effect of the topography or the true change warming is about to unfold. There are two ways of correcting this limitation and unfortunately, both require a bit of work on the part of the authors. The first of these is to remove systematic biases in the lateral and lower boundaries that form the inputs into the RCMs. By this I am not referring to the post-processing bias correction the authors have perfomed here, but the bias in the boundary conditions before the RCM is run. This, however, requires new RCM runs which is a significant effort in terms of computing and time. The authors may want to go through the papers below that illustrate how useful this can be:
Rocheta, E., Evans, J. P. & Sharma, A. Correcting lateral boundary biases in regional climate modelling: the effect of the relaxation zone. Climate Dynamics 55, 2511-2521, doi:10.1007/s00382-020-05393-1 (2020).
Kim, Y., Evans, J. P., Sharma, A. & Rocheta, E., Geophysical Research Letters, Spatial, temporal, and multivariate bias in regional climate model simulations. 48, e2020GL092058 (2021).
The other way of addressing this limitation is to use multiple GCMs as the basis for boundary variables that feed into the RCM. While this does not address the biased boundary inputs the RCMs is subject to, it atleast produces an envelope of the uncertainty that results from the use of a single (biased) GCM. This is the approach most researchers use in climate change assessment, often coupled with a post-processing step involving bias correction. I realise the authors may be limited in their access to RCM simulations from other GCMs, but, if so, need to at least discuss the implications this may have on their overall findings.
Response: Thank you for these suggestions. We are not running the RCMs ourselves, so while this is an interesting idea it is not feasible in the context of our study. We do note in the discussion that a single GCM was used and therefore we do not sample the full range of climate uncertainty. In response to these reviewer comments we will extend the discussion on implications of using a single GCM but with an ensemble of RCM’s (as stated in response to the comment above).
RC: The only other comment I have is regarding the use of the distributional bias correction adopted. Given the importance of antecedent conditions (which the authors have noted), not considering bias in persistence attributes can misrepresent the relationship between pre-storm wetness and storm extremes. This is evident even in urban catchments where one would usually not expect antecedent conditions to matter. It may be worthwhile for the authors to assess this dependence in their bias corrected precipitations and observations, incase there is a bias present. This may be especially important in those catchments where they are seeing a decrease in flood magnitudes.
Response:
We agree that bias in persistence attributes is an important and challenging issue. While bias in precipitation persistence has been evaluated in the climate modelling community (Armal et al. 2020; Kumar et al. 2013; Moon et al. 2019), we have not seen any papers where it has been addressed for hydrological modelling.
The choice of bias correction methodology is difficult, with a balance between correcting the data as much as necessary for meaningful hydrological simulations, but not making those methodologies too complex and thus even more difficult to justify as being plausible in future climates. We selected the distributional bias correction approach as it suitably corrects both high and low precipitation events (opposed to for example monthly mean bias correction which simply scales both light and heavy rainfall by the same percentage). This was successful in correcting the overall distribution of precipitation, including the mean daily rainfall bias and heavy rainfall biases discussed in the supplement S1. The bias correction we applied also significantly improved RCM overestimation of the number of rainy days (Figure S4), resulting in the RCMs having a similar number of wet days to the observations. It’s important to recognise here that we cannot correct weather sequences that are likely to hold in future scenarios. We can only readily correct a statistical distribution approach to climate model output, indeed some colleagues do not correct at all and only look at the delta changes between current and future periods (e.g. Bell et al. 2009, Bell et al. 2012). Whilst we recognise the dangers in doing that (i.e. that you might be in a different non-linear rainfall-runoff response of catchment states by using uncorrected simulations), at least such approaches are not changing the physics within the models. Here we believe, for current best practice, we have taken the rational approach to statistical correcting that has improved wet/dry day RCM outputs and thus in part has improved such biases. We believe exploring these issues further would take a considerable amount of research to understand the nuances and impacts and how persistence bias changes are relevant for future scenario simulations, this is a very challenging piece of research. We will write more about this in our revised manuscript and discuss the issues.
In response to this comment, we will therefore note that climate models have biases in persistence attributes, and therefore may not be able to simulate persistent wet/dry periods well.
References:
Armal, S., Devineni, N., Krakauer, N. Y., & Khanbilvardi, R. (2020). Simulating precipitation in the Northeast United States using a climate‐informed K‐nearest neighbour algorithm. Hydrological Processes, 34(20), 3966-3980.
Bell, V. A., Kay, A. L., Jones, R. G., Moore, R. J., & Reynard, N. S. (2009). Use of soil data in a grid-based hydrological model to estimate spatial variation in changing flood risk across the UK. Journal of Hydrology, 377(3-4), 335-350.
Bell, V. A., Kay, A. L., Cole, S. J., Jones, R. G., Moore, R. J., & Reynard, N. S. (2012). How might climate change affect river flows across the Thames Basin? An area-wide analysis using the UKCP09 Regional Climate Model ensemble. Journal of Hydrology, 442, 89-104.
Bell, V. A., Kay, A. L., Davies, H. N., & Jones, R. G. (2016). An assessment of the possible impacts of climate change on snow and peak river flows across Britain. Climatic Change, 136(3), 539-553.
Kay, A. L., Bell, V. A., Guillod, B. P., Jones, R. G., & Rudd, A. C. (2018). National-scale analysis of low flow frequency: historical trends and potential future changes. Climatic Change, 147(3), 585-599.
Kumar, Sanjiv, Venkatesh Merwade, James L. Kinter III, and Dev Niyogi. "Evaluation of temperature and precipitation trends and long-term persistence in CMIP5 twentieth-century climate simulations." Journal of Climate 26, no. 12 (2013): 4168-4185.
Moon, Heewon, Lukas Gudmundsson, Benoit P. Guillod, Vuruputur Venugopal, and Sonia I. Seneviratne. "Intercomparison of daily precipitation persistence in multiple global observations and climate models." Environmental Research Letters 14, no. 10 (2019): 105009.
Murphy, J. M., Harris, G. R., Sexton, D. M. H., Kendon, E. J., Bett, P. E., Clark, R. T., ... & Yamazaki, S. T. (2018). UKCP18 land projections: Science report.
Prudhomme, C., Haxton, T., Crooks, S., Jackson, C., Barkwith, A., Williamson, J., ... & Watts, G. (2013). Future Flows Hydrology: an ensemble of daily river flow and monthly groundwater levels for use for climate change impact assessment across Great Britain. Earth System Science Data, 5(1), 101-107.
Schwalm, C. R., Glendon, S., & Duffy, P. B. (2020). RCP8. 5 tracks cumulative CO2 emissions. Proceedings of the National Academy of Sciences, 117(33), 19656-19657.
Citation: https://doi.org/10.5194/hess-2021-321-AC3
-
AC3: 'Reply on RC3', Rosanna Lane, 22 Nov 2021