Articles | Volume 26, issue 21
https://doi.org/10.5194/hess-26-5493-2022
https://doi.org/10.5194/hess-26-5493-2022
Technical note
 | 
04 Nov 2022
Technical note |  | 04 Nov 2022

Technical note: Data assimilation and autoregression for using near-real-time streamflow observations in long short-term memory networks

Grey S. Nearing, Daniel Klotz, Jonathan M. Frame, Martin Gauch, Oren Gilon, Frederik Kratzert, Alden Keefe Sampson, Guy Shalev, and Sella Nevo

Related authors

On the predictability of turbulent fluxes from land: PLUMBER2 MIP experimental description and preliminary results
Gab Abramowitz, Anna Ukkola, Sanaa Hobeichi, Jon Cranko Page, Mathew Lipson, Martin G. De Kauwe, Samuel Green, Claire Brenner, Jonathan Frame, Grey Nearing, Martyn Clark, Martin Best, Peter Anthoni, Gabriele Arduini, Souhail Boussetta, Silvia Caldararu, Kyeungwoo Cho, Matthias Cuntz, David Fairbairn, Craig R. Ferguson, Hyungjun Kim, Yeonjoo Kim, Jürgen Knauer, David Lawrence, Xiangzhong Luo, Sergey Malyshev, Tomoko Nitta, Jerome Ogee, Keith Oleson, Catherine Ottlé, Phillipe Peylin, Patricia de Rosnay, Heather Rumbold, Bob Su, Nicolas Vuichard, Anthony P. Walker, Xiaoni Wang-Faivre, Yunfei Wang, and Yijian Zeng
Biogeosciences, 21, 5517–5538, https://doi.org/10.5194/bg-21-5517-2024,https://doi.org/10.5194/bg-21-5517-2024, 2024
Short summary
HESS Opinions: Never train a Long Short-Term Memory (LSTM) network on a single basin
Frederik Kratzert, Martin Gauch, Daniel Klotz, and Grey Nearing
Hydrol. Earth Syst. Sci., 28, 4187–4201, https://doi.org/10.5194/hess-28-4187-2024,https://doi.org/10.5194/hess-28-4187-2024, 2024
Short summary
A data-centric perspective on the information needed for hydrological uncertainty predictions
Andreas Auer, Martin Gauch, Frederik Kratzert, Grey Nearing, Sepp Hochreiter, and Daniel Klotz
Hydrol. Earth Syst. Sci., 28, 4099–4126, https://doi.org/10.5194/hess-28-4099-2024,https://doi.org/10.5194/hess-28-4099-2024, 2024
Short summary
Technical Note: The divide and measure nonconformity – how metrics can mislead when we evaluate on different data partitions
Daniel Klotz, Martin Gauch, Frederik Kratzert, Grey Nearing, and Jakob Zscheischler
Hydrol. Earth Syst. Sci., 28, 3665–3673, https://doi.org/10.5194/hess-28-3665-2024,https://doi.org/10.5194/hess-28-3665-2024, 2024
Short summary
Hybrid forecasting: blending climate predictions with AI models
Louise J. Slater, Louise Arnal, Marie-Amélie Boucher, Annie Y.-Y. Chang, Simon Moulds, Conor Murphy, Grey Nearing, Guy Shalev, Chaopeng Shen, Linda Speight, Gabriele Villarini, Robert L. Wilby, Andrew Wood, and Massimiliano Zappa
Hydrol. Earth Syst. Sci., 27, 1865–1889, https://doi.org/10.5194/hess-27-1865-2023,https://doi.org/10.5194/hess-27-1865-2023, 2023
Short summary

Related subject area

Subject: Catchment hydrology | Techniques and Approaches: Modelling approaches
Catchments do not strictly follow Budyko curves over multiple decades, but deviations are minor and predictable
Muhammad Ibrahim, Miriam Coenders-Gerrits, Ruud van der Ent, and Markus Hrachowitz
Hydrol. Earth Syst. Sci., 29, 1703–1723, https://doi.org/10.5194/hess-29-1703-2025,https://doi.org/10.5194/hess-29-1703-2025, 2025
Short summary
Scale dependency in modeling nivo-glacial hydrological systems: the case of the Arolla basin, Switzerland
Anne-Laure Argentin, Pascal Horton, Bettina Schaefli, Jamal Shokory, Felix Pitscheider, Leona Repnik, Mattia Gianini, Simone Bizzi, Stuart N. Lane, and Francesco Comiti
Hydrol. Earth Syst. Sci., 29, 1725–1748, https://doi.org/10.5194/hess-29-1725-2025,https://doi.org/10.5194/hess-29-1725-2025, 2025
Short summary
Extended-range forecasting of stream water temperature with deep-learning models
Ryan S. Padrón, Massimiliano Zappa, Luzi Bernhard, and Konrad Bogner
Hydrol. Earth Syst. Sci., 29, 1685–1702, https://doi.org/10.5194/hess-29-1685-2025,https://doi.org/10.5194/hess-29-1685-2025, 2025
Short summary
Technical note: An approach for handling multiple temporal frequencies with different input dimensions using a single LSTM cell
Eduardo Acuña Espinoza, Frederik Kratzert, Daniel Klotz, Martin Gauch, Manuel Álvarez Chaves, Ralf Loritz, and Uwe Ehret
Hydrol. Earth Syst. Sci., 29, 1749–1758, https://doi.org/10.5194/hess-29-1749-2025,https://doi.org/10.5194/hess-29-1749-2025, 2025
Short summary
Projections of streamflow intermittence under climate change in European drying river networks
Louise Mimeau, Annika Künne, Alexandre Devers, Flora Branger, Sven Kralisch, Claire Lauvernet, Jean-Philippe Vidal, Núria Bonada, Zoltán Csabai, Heikki Mykrä, Petr Pařil, Luka Polović, and Thibault Datry
Hydrol. Earth Syst. Sci., 29, 1615–1636, https://doi.org/10.5194/hess-29-1615-2025,https://doi.org/10.5194/hess-29-1615-2025, 2025
Short summary

Cited articles

Abrahart, R. J. and See, L.: Comparing neural network and autoregressive moving average techniques for the provision of continuous river flow forecasts in two contrasting catchments, Hydrol. Proc., 14, 2157–2172, 2000. a
Addor, N., Newman, A. J., Mizukami, N., and Clark, M. P.: The CAMELS data set: catchment attributes and meteorology for large-sample studies, Hydrol. Earth Syst. Sci., 21, 5293–5313, https://doi.org/10.5194/hess-21-5293-2017, 2017.  a, b, c, d
Bannister, R.: A review of operational methods of variational and ensemble-variational data assimilation, Q. J. Roy. Meteor. Soc., 143, 607–633, 2017. a
Bengio, S., Vinyals, O., Jaitly, N., and Shazeer, N.: Scheduled sampling for sequence prediction with recurrent neural networks, arXiv [preprint], https://doi.org/10.48550/arXiv.1506.03099, 2015. a
Cameron, D., Kneale, P., and See, L.: An evaluation of a traditional and a neural net modelling approach to flood forecasting for an upland catchment, Hydrol. Proc., 16, 1033–1046, https://doi.org/10.1002/hyp.317, 2002. a
Download
Short summary
When designing flood forecasting models, it is necessary to use all available data to achieve the most accurate predictions possible. This manuscript explores two basic ways of ingesting near-real-time streamflow data into machine learning streamflow models. The point we want to make is that when working in the context of machine learning (instead of traditional hydrology models that are based on bio-geophysics), it is not necessary to use complex statistical methods for injecting sparse data.
Share