Articles | Volume 28, issue 13
https://doi.org/10.5194/hess-28-3051-2024
https://doi.org/10.5194/hess-28-3051-2024
Research article
 | 
15 Jul 2024
Research article |  | 15 Jul 2024

When ancient numerical demons meet physics-informed machine learning: adjoint-based gradients for implicit differentiable modeling

Yalan Song, Wouter J. M. Knoben, Martyn P. Clark, Dapeng Feng, Kathryn Lawson, Kamlesh Sawadekar, and Chaopeng Shen

Related authors

On the predictability of turbulent fluxes from land: PLUMBER2 MIP experimental description and preliminary results
Gab Abramowitz, Anna Ukkola, Sanaa Hobeichi, Jon Cranko Page, Mathew Lipson, Martin G. De Kauwe, Samuel Green, Claire Brenner, Jonathan Frame, Grey Nearing, Martyn Clark, Martin Best, Peter Anthoni, Gabriele Arduini, Souhail Boussetta, Silvia Caldararu, Kyeungwoo Cho, Matthias Cuntz, David Fairbairn, Craig R. Ferguson, Hyungjun Kim, Yeonjoo Kim, Jürgen Knauer, David Lawrence, Xiangzhong Luo, Sergey Malyshev, Tomoko Nitta, Jerome Ogee, Keith Oleson, Catherine Ottlé, Phillipe Peylin, Patricia de Rosnay, Heather Rumbold, Bob Su, Nicolas Vuichard, Anthony P. Walker, Xiaoni Wang-Faivre, Yunfei Wang, and Yijian Zeng
Biogeosciences, 21, 5517–5538, https://doi.org/10.5194/bg-21-5517-2024,https://doi.org/10.5194/bg-21-5517-2024, 2024
Short summary
Deep dive into hydrologic simulations at global scale: harnessing the power of deep learning and physics-informed differentiable models (δHBV-globe1.0-hydroDL)
Dapeng Feng, Hylke Beck, Jens de Bruijn, Reetik Kumar Sahu, Yusuke Satoh, Yoshihide Wada, Jiangtao Liu, Ming Pan, Kathryn Lawson, and Chaopeng Shen
Geosci. Model Dev., 17, 7181–7198, https://doi.org/10.5194/gmd-17-7181-2024,https://doi.org/10.5194/gmd-17-7181-2024, 2024
Short summary
Technical note: How many models do we need to simulate hydrologic processes across large geographical domains?
Wouter J. M. Knoben, Ashwin Raman, Gaby J. Gründemann, Mukesh Kumar, Alain Pietroniro, Chaopeng Shen, Yalan Song, Cyril Thébault, Katie van Werkhoven, Andrew W. Wood, and Martyn P. Clark
Hydrol. Earth Syst. Sci. Discuss., https://doi.org/10.5194/hess-2024-279,https://doi.org/10.5194/hess-2024-279, 2024
Revised manuscript under review for HESS
Short summary
FROSTBYTE: a reproducible data-driven workflow for probabilistic seasonal streamflow forecasting in snow-fed river basins across North America
Louise Arnal, Martyn P. Clark, Alain Pietroniro, Vincent Vionnet, David R. Casson, Paul H. Whitfield, Vincent Fortin, Andrew W. Wood, Wouter J. M. Knoben, Brandi W. Newton, and Colleen Walford
Hydrol. Earth Syst. Sci., 28, 4127–4155, https://doi.org/10.5194/hess-28-4127-2024,https://doi.org/10.5194/hess-28-4127-2024, 2024
Short summary
Metamorphic testing of machine learning and conceptual hydrologic models
Peter Reichert, Kai Ma, Marvin Höge, Fabrizio Fenicia, Marco Baity-Jesi, Dapeng Feng, and Chaopeng Shen
Hydrol. Earth Syst. Sci., 28, 2505–2529, https://doi.org/10.5194/hess-28-2505-2024,https://doi.org/10.5194/hess-28-2505-2024, 2024
Short summary

Related subject area

Subject: Catchment hydrology | Techniques and Approaches: Modelling approaches
The significance of the leaf area index for evapotranspiration estimation in SWAT-T for characteristic land cover types of West Africa
Fabian Merk, Timo Schaffhauser, Faizan Anwar, Ye Tuo, Jean-Martial Cohard, and Markus Disse
Hydrol. Earth Syst. Sci., 28, 5511–5539, https://doi.org/10.5194/hess-28-5511-2024,https://doi.org/10.5194/hess-28-5511-2024, 2024
Short summary
Improved representation of soil moisture processes through incorporation of cosmic-ray neutron count measurements in a large-scale hydrologic model
Eshrat Fatima, Rohini Kumar, Sabine Attinger, Maren Kaluza, Oldrich Rakovec, Corinna Rebmann, Rafael Rosolem, Sascha E. Oswald, Luis Samaniego, Steffen Zacharias, and Martin Schrön
Hydrol. Earth Syst. Sci., 28, 5419–5441, https://doi.org/10.5194/hess-28-5419-2024,https://doi.org/10.5194/hess-28-5419-2024, 2024
Short summary
Spatio-temporal patterns and trends of streamflow in water-scarce Mediterranean basins
Laia Estrada, Xavier Garcia, Joan Saló-Grau, Rafael Marcé, Antoni Munné, and Vicenç Acuña
Hydrol. Earth Syst. Sci., 28, 5353–5373, https://doi.org/10.5194/hess-28-5353-2024,https://doi.org/10.5194/hess-28-5353-2024, 2024
Short summary
A large-sample modelling approach towards integrating streamflow and evaporation data for the Spanish catchments
Patricio Yeste, Matilde García-Valdecasas Ojeda, Sonia R. Gámiz-Fortis, Yolanda Castro-Díez, Axel Bronstert, and María Jesús Esteban-Parra
Hydrol. Earth Syst. Sci., 28, 5331–5352, https://doi.org/10.5194/hess-28-5331-2024,https://doi.org/10.5194/hess-28-5331-2024, 2024
Short summary
Seasonal variation in land cover estimates reveals sensitivities and opportunities for environmental models
Daniel T. Myers, David Jones, Diana Oviedo-Vargas, John Paul Schmit, Darren L. Ficklin, and Xuesong Zhang
Hydrol. Earth Syst. Sci., 28, 5295–5310, https://doi.org/10.5194/hess-28-5295-2024,https://doi.org/10.5194/hess-28-5295-2024, 2024
Short summary

Cited articles

Aboelyazeed, D., Xu, C., Hoffman, F. M., Liu, J., Jones, A. W., Rackauckas, C., Lawson, K., and Shen, C.: A differentiable, physics-informed ecosystem modeling and learning framework for large-scale inverse problems: demonstration with photosynthesis simulations, Biogeosciences, 20, 2671–2692, https://doi.org/10.5194/bg-20-2671-2023, 2023. 
Addor, N., Newman, A. J., Mizukami, N., and Clark, M. P.: Catchment Attributes and MEteorology for Large-Sample studies (CAMELS) version 2.0, NCAR, https://doi.org/10.5065/D6G73C3Q, 2017. 
Aghakouchak, A. and Habib, E.: Application of a Conceptual Hydrologic Model in Teaching Hydrologic Processes, Int. J. Eng. Educ., 26, 963–973, 2010. 
Bandai, T.: Inverse Modeling of Soil Moisture Dynamics: Estimation of Soil Hydraulic Properties and Surface Water Flux, PhD thesis, University of California, Merced, California, USA, 172 pp., https://escholarship.org/uc/item/8gb9m1gm#article_main (last access: 11 July 2024), 2022. 
Beck, H. E., van Dijk, A. I. J. M., de Roo, A., Miralles, D. G., McVicar, T. R., Schellekens, J., and Bruijnzeel, L. A.: Global-scale regionalization of hydrologic model parameters, Water Resour. Res., 52, 3599–3622, https://doi.org/10.1002/2015WR018247, 2016. 
Download
Short summary
Differentiable models (DMs) integrate neural networks and physical equations for accuracy, interpretability, and knowledge discovery. We developed an adjoint-based DM for ordinary differential equations (ODEs) for hydrological modeling, reducing distorted fluxes and physical parameters from errors in models that use explicit and operation-splitting schemes. With a better numerical scheme and improved structure, the adjoint-based DM matches or surpasses long short-term memory (LSTM) performance.