the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
| 05 Jan 2022
Comparing seasonal streamflow forecast systems for management of a fresh water reservoir in the Netherlands
Abstract. For efficient management of the Dutch surface water reservoir Lake IJssel, (sub)seasonal forecasts of the water volumes going in and out of the reservoir are potentially of great interest. Here, streamflow forecasts were analyzed for the river Rhine at Lobith, which is partly routed through the river IJssel, the main influx into the reservoir. We analyzed multiple seasonal forecast data sets derived from EFAS, E-HYPE and HTESSEL, which differ in their underlying hydrological formulation, but are all forced with similar input from the ECMWF SEAS5 meteorological forecasts. We post-processed the streamflow forecasts using quantile matching (QM) and analyzed several forecast quality metrics. Forecast performance was assessed based on the available reforecast period, as well as on individual summer seasons. QM increased forecast skill for nearly all metrics evaluated. Particularly HTESSEL, a land surface scheme that is not optimized for hydrology, needed the largest correction. Averaged over the reforecast period, forecasts were skillful for the longest lead times in spring and early summer. For this period, E-HYPE showed the highest skill; Later in summer, however, skill deteriorated after 1–2 months. When investigating specific years with either low or high flow conditions, forecast skill increased with the extremity of the event. Although raw forecasts for both E-HYPE and EFAS were more skilful than HTESSEL, bias correction based on QM can significantly reduce the difference. In operational mode, the three forecast systems show comparable skill. In general, dry conditions can be forecasted with high success rates up to three months ahead, which is very promising for successful use of Rhine streamflow forecasts in downstream reservoir management.
- Preprint
(4832 KB) - Metadata XML
- BibTeX
- EndNote
Status: closed
-
RC1: 'Comment on hess-2021-604', Anonymous Referee #1, 22 Feb 2022
The comment was uploaded in the form of a supplement: https://hess.copernicus.org/preprints/hess-2021-604/hess-2021-604-RC1-supplement.pdf
- AC1: 'Reply on RC1', Ruud Hurkmans, 06 May 2022
-
RC2: 'Comment on hess-2021-604', Anonymous Referee #2, 02 Mar 2022
I would like to thank the editor for the opportunity to review this manuscript.
This study investigates the performance of three continental- / global-scale streamflow forecasting systems (HTESSEL, EFAS and E-Hype) in predicting inflows to Lake Ijssel – a major surface water reservoir in the Netherlands. All three forecasting systems are driven with ECMWF SEAS5 seasonal climate forecasts but differ in their underlying hydrological modelling approach. The authors applied bias correction to streamflow forecasts using Quantile Mapping and subsequently assessed the skill of raw and post-processed forecasts for predicting inflows. A particular focus was placed on dry conditions, i.e. the predictability of low-flow events.
In my view, the overall focus of the study to compare three leading continental- or global-scale streamflow forecasting systems for predicting streamflow at the local-scale is interesting and I believe the study has applications and implications that may be relevant to a wider audience, e.g. how to best translate outputs from continental- or global-scale streamflow forecasts into local-scale applications. However, my main concern relates to the novelty of the study. In its current form, the manuscript is written similar to a Technical Report that describes methods and results of forecast post-processing and verification applied to one single study location, without sufficiently linking it to the research context, and may be of interest to a very local audience. I am missing an attempt to generalise the findings and place them into a broader context and emphasise implications that are applicable in other regions too (using Lake Ijssel inflows as a case study). If the authors addressed this, I believe the study would be of interest to a wider audience.
The study design and methodology (including post-processing and forecast verification) are robust. While more advanced streamflow post-processing methods exist and could be investigated, the authors clearly show an improvement in skill for the study location of interest. The application of multiple verification metrics (continuous ranked probability skill score, mean error, Brier skill score and reliability diagrams) to 23 years of hindcast data, in a cross-validation approach, is appropriate and thorough.
Major comments:
- Novelty and relevance to a wider audience: As outlined above, the novelty of the study and relevance to a wider audience is not very clear. I would ask the authors to place the work into a broader research context and interpret the results more broadly, highlighting implications for researchers and practitioners in other regions. While the introduction places the research into a wider context to some extent, there is no clear link between the introduction and the rest of the manuscript which describes the results in a very detailed way, focusing on one individual location. It would be great if the authors could come back to the broader research gap in their discussion and conclusions, and interpret the results more broadly, e.g. what are key messages for the hydrological community who aim to apply regional- or global-scale seasonal streamflow forecasts for individual catchments? How does this study compare to similar systems implemented in other parts of the world? What are advantages and disadvantages of the described approach?
- Results and Discussion: The results section is very comprehensive and describes the results of the forecasting approach in a very detailed way, focusing on a range of forecast performance metrics. However, I am missing an interpretation that goes beyond simply describing the results. The discussion section itself is very short and immediately starts with limitations of the study and further research, without an actual discussion and interpretation of the study findings. I would ask the authors to add more discussion of their results – linking them back to their research aims or questions that are outlined in the introduction, placing them into the context of the existing literature and highlighting implications or applications of the findings (followed by limitations and further research, as is already included). Potential points of discussion: What can we learn from these results that is relevant in other regions? Can some of the differences in results be traced back to differences in the underlying specifications of the hydrological models (e.g. consideration of routing) and what does it mean for other locations? Could a multi-model ensemble approach be useful?
- Readability: I had difficulties following some sections. The manuscript would benefit from revision with the aim of re-wording sections and sentences to be clearer and more concise. Additionally, there are some typos throughout the text (I have included a few examples under “minor comments” but it applies to the manuscript overall).
Other comments / suggestions:
- Some of the results and figures are very detailed and could be presented in a more concise or synthesised way. A few suggestions and observations in relation to the figures:
- Figures 4-6: Could you present the results for each forecasting system (raw and bias corrected outputs) and each lead time, aggregated over all months (April to September), to be able to compare the systems more generally? One possibility could be to add an additional sub plot that presents aggregated results across all months.
- Figure 10: Similar as above, it would be great to see the overall RPSS scores aggregated over all years and months, to compare the three systems directly with each other. Would it be possible to add another sub plot that presents the results aggregated across all years and months?
- Figure 11: I found it a little unusual to see the years on the x-axis, but in order of dryness / wetness. Would it be possible to use annual streamflow as x-axis (i.e. presenting forecast skill as a function of average streamflow)?
- Figure 12: It is not clear to me what the right column of Figure 12 shows. It would be good to provide more explanation in the text and/or caption – how could this be interpreted and used?
Minor comments:
- P2 L47: Please change “takes” to “take” and remove “also”.
- P3 L61: Space missing after “as follows.”
- P3 L79: I suggest to change “data forecasting systems” to “seasonal forecasting systems”.
- P6 L135-136: Please change “is investigated 3.2.2” to “is investigated in Section 3.2.2”.
- P8 L175: “using” instead of “usiing”
Citation: https://doi.org/10.5194/hess-2021-604-RC2 - AC2: 'Reply on RC2', Ruud Hurkmans, 06 May 2022
Status: closed
-
RC1: 'Comment on hess-2021-604', Anonymous Referee #1, 22 Feb 2022
The comment was uploaded in the form of a supplement: https://hess.copernicus.org/preprints/hess-2021-604/hess-2021-604-RC1-supplement.pdf
- AC1: 'Reply on RC1', Ruud Hurkmans, 06 May 2022
-
RC2: 'Comment on hess-2021-604', Anonymous Referee #2, 02 Mar 2022
I would like to thank the editor for the opportunity to review this manuscript.
This study investigates the performance of three continental- / global-scale streamflow forecasting systems (HTESSEL, EFAS and E-Hype) in predicting inflows to Lake Ijssel – a major surface water reservoir in the Netherlands. All three forecasting systems are driven with ECMWF SEAS5 seasonal climate forecasts but differ in their underlying hydrological modelling approach. The authors applied bias correction to streamflow forecasts using Quantile Mapping and subsequently assessed the skill of raw and post-processed forecasts for predicting inflows. A particular focus was placed on dry conditions, i.e. the predictability of low-flow events.
In my view, the overall focus of the study to compare three leading continental- or global-scale streamflow forecasting systems for predicting streamflow at the local-scale is interesting and I believe the study has applications and implications that may be relevant to a wider audience, e.g. how to best translate outputs from continental- or global-scale streamflow forecasts into local-scale applications. However, my main concern relates to the novelty of the study. In its current form, the manuscript is written similar to a Technical Report that describes methods and results of forecast post-processing and verification applied to one single study location, without sufficiently linking it to the research context, and may be of interest to a very local audience. I am missing an attempt to generalise the findings and place them into a broader context and emphasise implications that are applicable in other regions too (using Lake Ijssel inflows as a case study). If the authors addressed this, I believe the study would be of interest to a wider audience.
The study design and methodology (including post-processing and forecast verification) are robust. While more advanced streamflow post-processing methods exist and could be investigated, the authors clearly show an improvement in skill for the study location of interest. The application of multiple verification metrics (continuous ranked probability skill score, mean error, Brier skill score and reliability diagrams) to 23 years of hindcast data, in a cross-validation approach, is appropriate and thorough.
Major comments:
- Novelty and relevance to a wider audience: As outlined above, the novelty of the study and relevance to a wider audience is not very clear. I would ask the authors to place the work into a broader research context and interpret the results more broadly, highlighting implications for researchers and practitioners in other regions. While the introduction places the research into a wider context to some extent, there is no clear link between the introduction and the rest of the manuscript which describes the results in a very detailed way, focusing on one individual location. It would be great if the authors could come back to the broader research gap in their discussion and conclusions, and interpret the results more broadly, e.g. what are key messages for the hydrological community who aim to apply regional- or global-scale seasonal streamflow forecasts for individual catchments? How does this study compare to similar systems implemented in other parts of the world? What are advantages and disadvantages of the described approach?
- Results and Discussion: The results section is very comprehensive and describes the results of the forecasting approach in a very detailed way, focusing on a range of forecast performance metrics. However, I am missing an interpretation that goes beyond simply describing the results. The discussion section itself is very short and immediately starts with limitations of the study and further research, without an actual discussion and interpretation of the study findings. I would ask the authors to add more discussion of their results – linking them back to their research aims or questions that are outlined in the introduction, placing them into the context of the existing literature and highlighting implications or applications of the findings (followed by limitations and further research, as is already included). Potential points of discussion: What can we learn from these results that is relevant in other regions? Can some of the differences in results be traced back to differences in the underlying specifications of the hydrological models (e.g. consideration of routing) and what does it mean for other locations? Could a multi-model ensemble approach be useful?
- Readability: I had difficulties following some sections. The manuscript would benefit from revision with the aim of re-wording sections and sentences to be clearer and more concise. Additionally, there are some typos throughout the text (I have included a few examples under “minor comments” but it applies to the manuscript overall).
Other comments / suggestions:
- Some of the results and figures are very detailed and could be presented in a more concise or synthesised way. A few suggestions and observations in relation to the figures:
- Figures 4-6: Could you present the results for each forecasting system (raw and bias corrected outputs) and each lead time, aggregated over all months (April to September), to be able to compare the systems more generally? One possibility could be to add an additional sub plot that presents aggregated results across all months.
- Figure 10: Similar as above, it would be great to see the overall RPSS scores aggregated over all years and months, to compare the three systems directly with each other. Would it be possible to add another sub plot that presents the results aggregated across all years and months?
- Figure 11: I found it a little unusual to see the years on the x-axis, but in order of dryness / wetness. Would it be possible to use annual streamflow as x-axis (i.e. presenting forecast skill as a function of average streamflow)?
- Figure 12: It is not clear to me what the right column of Figure 12 shows. It would be good to provide more explanation in the text and/or caption – how could this be interpreted and used?
Minor comments:
- P2 L47: Please change “takes” to “take” and remove “also”.
- P3 L61: Space missing after “as follows.”
- P3 L79: I suggest to change “data forecasting systems” to “seasonal forecasting systems”.
- P6 L135-136: Please change “is investigated 3.2.2” to “is investigated in Section 3.2.2”.
- P8 L175: “using” instead of “usiing”
Citation: https://doi.org/10.5194/hess-2021-604-RC2 - AC2: 'Reply on RC2', Ruud Hurkmans, 06 May 2022
Viewed
| HTML | XML | Total | BibTeX | EndNote | |
|---|---|---|---|---|---|
| 902 | 310 | 44 | 1,256 | 40 | 31 |
- HTML: 902
- PDF: 310
- XML: 44
- Total: 1,256
- BibTeX: 40
- EndNote: 31
Viewed (geographical distribution)
| Country | # | Views | % |
|---|
| Total: | 0 |
| HTML: | 0 |
| PDF: | 0 |
| XML: | 0 |
- 1