Articles | Volume 26, issue 21
Technical note
04 Nov 2022
Technical note |  | 04 Nov 2022

Technical note: Data assimilation and autoregression for using near-real-time streamflow observations in long short-term memory networks

Grey S. Nearing, Daniel Klotz, Jonathan M. Frame, Martin Gauch, Oren Gilon, Frederik Kratzert, Alden Keefe Sampson, Guy Shalev, and Sella Nevo

Related authors

HESS Opinions: Never train an LSTM on a single basin
Frederik Kratzert, Martin Gauch, Daniel Klotz, and Grey Nearing
Hydrol. Earth Syst. Sci. Discuss.,,, 2024
Preprint under review for HESS
Short summary
On the predictability of turbulent fluxes from land: PLUMBER2 MIP experimental description and preliminary results
Gab Abramowitz, Anna Ukkola, Sanaa Hobeichi, Jon Cranko Page, Mathew Lipson, Martin De Kauwe, Sam Green, Claire Brenner, Jonathan Frame, Grey Nearing, Martyn Clark, Martin Best, Peter Anthoni, Gabriele Arduini, Souhail Boussetta, Silvia Caldararu, Kyeungwoo Cho, Matthias Cuntz, David Fairbairn, Craig Ferguson, Hyungjun Kim, Yeonjoo Kim, Jürgen Knauer, David Lawrence, Xiangzhong Luo, Sergey Malyshev, Tomoko Nitta, Jerome Ogee, Keith Oleson, Catherine Ottlé, Phillipe Peylin, Patricia de Rosnay, Heather Rumbold, Bob Su, Nicolas Vuichard, Anthony Walker, Xiaoni Wang-Faivre, Yunfei Wang, and Yijian Zeng
EGUsphere,,, 2024
Short summary
Hybrid forecasting: blending climate predictions with AI models
Louise J. Slater, Louise Arnal, Marie-Amélie Boucher, Annie Y.-Y. Chang, Simon Moulds, Conor Murphy, Grey Nearing, Guy Shalev, Chaopeng Shen, Linda Speight, Gabriele Villarini, Robert L. Wilby, Andrew Wood, and Massimiliano Zappa
Hydrol. Earth Syst. Sci., 27, 1865–1889,,, 2023
Short summary
Flood forecasting with machine learning models in an operational framework
Sella Nevo, Efrat Morin, Adi Gerzi Rosenthal, Asher Metzger, Chen Barshai, Dana Weitzner, Dafi Voloshin, Frederik Kratzert, Gal Elidan, Gideon Dror, Gregory Begelman, Grey Nearing, Guy Shalev, Hila Noga, Ira Shavitt, Liora Yuklea, Moriah Royz, Niv Giladi, Nofar Peled Levi, Ofir Reich, Oren Gilon, Ronnie Maor, Shahar Timnat, Tal Shechter, Vladimir Anisimov, Yotam Gigi, Yuval Levin, Zach Moshe, Zvika Ben-Haim, Avinatan Hassidim, and Yossi Matias
Hydrol. Earth Syst. Sci., 26, 4013–4032,,, 2022
Short summary
Deep learning rainfall–runoff predictions of extreme events
Jonathan M. Frame, Frederik Kratzert, Daniel Klotz, Martin Gauch, Guy Shalev, Oren Gilon, Logan M. Qualls, Hoshin V. Gupta, and Grey S. Nearing
Hydrol. Earth Syst. Sci., 26, 3377–3392,,, 2022
Short summary

Related subject area

Subject: Catchment hydrology | Techniques and Approaches: Modelling approaches
Toward interpretable LSTM-based modeling of hydrological systems
Luis Andres De la Fuente, Mohammad Reza Ehsani, Hoshin Vijai Gupta, and Laura Elizabeth Condon
Hydrol. Earth Syst. Sci., 28, 945–971,,, 2024
Short summary
Flow intermittence prediction using a hybrid hydrological modelling approach: influence of observed intermittence data on the training of a random forest model
Louise Mimeau, Annika Künne, Flora Branger, Sven Kralisch, Alexandre Devers, and Jean-Philippe Vidal
Hydrol. Earth Syst. Sci., 28, 851–871,,, 2024
Short summary
What controls the tail behaviour of flood series: rainfall or runoff generation?
Elena Macdonald, Bruno Merz, Björn Guse, Viet Dung Nguyen, Xiaoxiang Guan, and Sergiy Vorogushyn
Hydrol. Earth Syst. Sci., 28, 833–850,,, 2024
Short summary
Seasonal prediction of end-of-dry-season watershed behavior in a highly interconnected alluvial watershed in northern California
Claire Kouba and Thomas Harter
Hydrol. Earth Syst. Sci., 28, 691–718,,, 2024
Short summary
Glaciers determine the sensitivity of hydrological processes to perturbed climate in a large mountainous basin on the Tibetan Plateau
Yi Nan and Fuqiang Tian
Hydrol. Earth Syst. Sci., 28, 669–689,,, 2024
Short summary

Cited articles

Abrahart, R. J. and See, L.: Comparing neural network and autoregressive moving average techniques for the provision of continuous river flow forecasts in two contrasting catchments, Hydrol. Proc., 14, 2157–2172, 2000. a
Addor, N., Newman, A. J., Mizukami, N., and Clark, M. P.: The CAMELS data set: catchment attributes and meteorology for large-sample studies, Hydrol. Earth Syst. Sci., 21, 5293–5313,, 2017.  a, b, c, d
Bannister, R.: A review of operational methods of variational and ensemble-variational data assimilation, Q. J. Roy. Meteor. Soc., 143, 607–633, 2017. a
Bengio, S., Vinyals, O., Jaitly, N., and Shazeer, N.: Scheduled sampling for sequence prediction with recurrent neural networks, arXiv [preprint],, 2015. a
Cameron, D., Kneale, P., and See, L.: An evaluation of a traditional and a neural net modelling approach to flood forecasting for an upland catchment, Hydrol. Proc., 16, 1033–1046,, 2002. a
Short summary
When designing flood forecasting models, it is necessary to use all available data to achieve the most accurate predictions possible. This manuscript explores two basic ways of ingesting near-real-time streamflow data into machine learning streamflow models. The point we want to make is that when working in the context of machine learning (instead of traditional hydrology models that are based on bio-geophysics), it is not necessary to use complex statistical methods for injecting sparse data.