Improving hydrologic models for predictions and process understanding using Neural ODEs

Abstract. Deep learning methods have frequently outperformed conceptual hydrologic models in rainfall-runoff modelling. Attempts of investigating the internals of such deep learning models are being made but traceability of model states and processes and their interrelations to model input and output is not yet fully given. Direct interpretability of mechanistic processes has always been considered as asset of conceptual models that helps to gain system understanding aside of predictability. We introduce hydrologic Neural Ordinary Differential Equation (ODE) models that perform as well as state-of-the-art deep learning methods in stream flow prediction while maintaining the ease of interpretability of conceptual hydrologic models. In Neural ODEs, internal processes that are represented in differential equations are substituted by neural networks. Therefore, Neural ODE models enable fusing deep learning with mechanistic modelling. We demonstrate the basin-specific predictive performance for several hundred catchments of the continental USA. For exemplary basins, we analyse the dynamics of states and processes learned by the model-internal neural networks. Finally, we discuss the potential of Neural ODE models in hydrology.