Articles | Volume 28, issue 13
https://doi.org/10.5194/hess-28-3051-2024
https://doi.org/10.5194/hess-28-3051-2024
Research article
 | 
15 Jul 2024
Research article |  | 15 Jul 2024

When ancient numerical demons meet physics-informed machine learning: adjoint-based gradients for implicit differentiable modeling

Yalan Song, Wouter J. M. Knoben, Martyn P. Clark, Dapeng Feng, Kathryn Lawson, Kamlesh Sawadekar, and Chaopeng Shen

Related authors

Deep dive into hydrologic simulations at global scale: harnessing the power of deep learning and physics-informed differentiable models (δHBV-globe1.0-hydroDL)
Dapeng Feng, Hylke Beck, Jens de Bruijn, Reetik Kumar Sahu, Yusuke Satoh, Yoshihide Wada, Jiangtao Liu, Ming Pan, Kathryn Lawson, and Chaopeng Shen
Geosci. Model Dev., 17, 7181–7198, https://doi.org/10.5194/gmd-17-7181-2024,https://doi.org/10.5194/gmd-17-7181-2024, 2024
Short summary
Technical note: How many models do we need to simulate hydrologic processes across large geographical domains?
Wouter J. M. Knoben, Ashwin Raman, Gaby J. Gründemann, Mukesh Kumar, Alain Pietroniro, Chaopeng Shen, Yalan Song, Cyril Thébault, Katie van Werkhoven, Andrew W. Wood, and Martyn P. Clark
Hydrol. Earth Syst. Sci. Discuss., https://doi.org/10.5194/hess-2024-279,https://doi.org/10.5194/hess-2024-279, 2024
Preprint under review for HESS
Short summary
FROSTBYTE: a reproducible data-driven workflow for probabilistic seasonal streamflow forecasting in snow-fed river basins across North America
Louise Arnal, Martyn P. Clark, Alain Pietroniro, Vincent Vionnet, David R. Casson, Paul H. Whitfield, Vincent Fortin, Andrew W. Wood, Wouter J. M. Knoben, Brandi W. Newton, and Colleen Walford
Hydrol. Earth Syst. Sci., 28, 4127–4155, https://doi.org/10.5194/hess-28-4127-2024,https://doi.org/10.5194/hess-28-4127-2024, 2024
Short summary
Metamorphic testing of machine learning and conceptual hydrologic models
Peter Reichert, Kai Ma, Marvin Höge, Fabrizio Fenicia, Marco Baity-Jesi, Dapeng Feng, and Chaopeng Shen
Hydrol. Earth Syst. Sci., 28, 2505–2529, https://doi.org/10.5194/hess-28-2505-2024,https://doi.org/10.5194/hess-28-2505-2024, 2024
Short summary
On the predictability of turbulent fluxes from land: PLUMBER2 MIP experimental description and preliminary results
Gab Abramowitz, Anna Ukkola, Sanaa Hobeichi, Jon Cranko Page, Mathew Lipson, Martin De Kauwe, Sam Green, Claire Brenner, Jonathan Frame, Grey Nearing, Martyn Clark, Martin Best, Peter Anthoni, Gabriele Arduini, Souhail Boussetta, Silvia Caldararu, Kyeungwoo Cho, Matthias Cuntz, David Fairbairn, Craig Ferguson, Hyungjun Kim, Yeonjoo Kim, Jürgen Knauer, David Lawrence, Xiangzhong Luo, Sergey Malyshev, Tomoko Nitta, Jerome Ogee, Keith Oleson, Catherine Ottlé, Phillipe Peylin, Patricia de Rosnay, Heather Rumbold, Bob Su, Nicolas Vuichard, Anthony Walker, Xiaoni Wang-Faivre, Yunfei Wang, and Yijian Zeng
EGUsphere, https://doi.org/10.5194/egusphere-2023-3084,https://doi.org/10.5194/egusphere-2023-3084, 2024
Short summary

Related subject area

Subject: Catchment hydrology | Techniques and Approaches: Modelling approaches
Multi-scale soil moisture data and process-based modeling reveal the importance of lateral groundwater flow in a subarctic catchment
Jari-Pekka Nousu, Kersti Leppä, Hannu Marttila, Pertti Ala-aho, Giulia Mazzotti, Terhikki Manninen, Mika Korkiakoski, Mika Aurela, Annalea Lohila, and Samuli Launiainen
Hydrol. Earth Syst. Sci., 28, 4643–4666, https://doi.org/10.5194/hess-28-4643-2024,https://doi.org/10.5194/hess-28-4643-2024, 2024
Short summary
Catchment response to climatic variability: implications for root zone storage and streamflow predictions
Nienke Tempel, Laurène Bouaziz, Riccardo Taormina, Ellis van Noppen, Jasper Stam, Eric Sprokkereef, and Markus Hrachowitz
Hydrol. Earth Syst. Sci., 28, 4577–4597, https://doi.org/10.5194/hess-28-4577-2024,https://doi.org/10.5194/hess-28-4577-2024, 2024
Short summary
Hybrid hydrological modeling for large alpine basins: a semi-distributed approach
Bu Li, Ting Sun, Fuqiang Tian, Mahmut Tudaji, Li Qin, and Guangheng Ni
Hydrol. Earth Syst. Sci., 28, 4521–4538, https://doi.org/10.5194/hess-28-4521-2024,https://doi.org/10.5194/hess-28-4521-2024, 2024
Short summary
Karst aquifer discharge response to rainfall interpreted as anomalous transport
Dan Elhanati, Nadine Goeppert, and Brian Berkowitz
Hydrol. Earth Syst. Sci., 28, 4239–4249, https://doi.org/10.5194/hess-28-4239-2024,https://doi.org/10.5194/hess-28-4239-2024, 2024
Short summary
HESS Opinions: Never train a Long Short-Term Memory (LSTM) network on a single basin
Frederik Kratzert, Martin Gauch, Daniel Klotz, and Grey Nearing
Hydrol. Earth Syst. Sci., 28, 4187–4201, https://doi.org/10.5194/hess-28-4187-2024,https://doi.org/10.5194/hess-28-4187-2024, 2024
Short summary

Cited articles

Aboelyazeed, D., Xu, C., Hoffman, F. M., Liu, J., Jones, A. W., Rackauckas, C., Lawson, K., and Shen, C.: A differentiable, physics-informed ecosystem modeling and learning framework for large-scale inverse problems: demonstration with photosynthesis simulations, Biogeosciences, 20, 2671–2692, https://doi.org/10.5194/bg-20-2671-2023, 2023. 
Addor, N., Newman, A. J., Mizukami, N., and Clark, M. P.: Catchment Attributes and MEteorology for Large-Sample studies (CAMELS) version 2.0, NCAR, https://doi.org/10.5065/D6G73C3Q, 2017. 
Aghakouchak, A. and Habib, E.: Application of a Conceptual Hydrologic Model in Teaching Hydrologic Processes, Int. J. Eng. Educ., 26, 963–973, 2010. 
Bandai, T.: Inverse Modeling of Soil Moisture Dynamics: Estimation of Soil Hydraulic Properties and Surface Water Flux, PhD thesis, University of California, Merced, California, USA, 172 pp., https://escholarship.org/uc/item/8gb9m1gm#article_main (last access: 11 July 2024), 2022. 
Beck, H. E., van Dijk, A. I. J. M., de Roo, A., Miralles, D. G., McVicar, T. R., Schellekens, J., and Bruijnzeel, L. A.: Global-scale regionalization of hydrologic model parameters, Water Resour. Res., 52, 3599–3622, https://doi.org/10.1002/2015WR018247, 2016. 
Download
Short summary
Differentiable models (DMs) integrate neural networks and physical equations for accuracy, interpretability, and knowledge discovery. We developed an adjoint-based DM for ordinary differential equations (ODEs) for hydrological modeling, reducing distorted fluxes and physical parameters from errors in models that use explicit and operation-splitting schemes. With a better numerical scheme and improved structure, the adjoint-based DM matches or surpasses long short-term memory (LSTM) performance.