Baydin, A. G., Pearlmutter, B. A., Radul, A. A., and Siskind, J. M.: Automatic differentiation in machine learning: a survey, J. Mach. Learn. Res., 18, 1–43,
https://doi.org/10.1016/j.advwatres.2018.01.009, 2018.
a,
b
Bengio, Y.: Practical recommendations for gradient-based training of deep
architectures, in: Neural Networks: Tricks of the Trade, 2nd Edn., edited by: Montavon, G., Orr, G. B., and Müller, K.-R., Springer, 437–478,
https://doi.org/10.1007/978-3-642-35289-8, 2012.
a
Brocca, L., Moramarco, T., Melone, F., and Wagner, W.: A new method for
rainfall estimation through soil moisture observations, Geophys. Res. Lett.,
40, 853–858,
https://doi.org/10.1002/grl.50173, 2013.
a
Brunone, B., Ferrante, M., Romano, N., and Santini, A.: Numerical simulations
of one-dimensional infiltration into layered soils with the Richards equation
using different estimates of the interlayer conductivity, Vadose Zone J., 2,
193–200,
https://doi.org/10.2113/2.2.193, 2003.
a
Buckingham, E.: Studies on the movement of soil moisture, Bull. 38, USDA,
Bureau of Soils, 1907. a
Byrd, R. H., Lu, P., Nocedal, J., and Zhu, C.: A limited memory algorithm for
bound constrained optimization, J. Sci. Comput., 16, 1190–1208,
https://doi.org/10.1137/0916069, 1995.
a
Celia, M. A., Bouloutas, E. T., and Zarba, R. L.: A general mass-conservative numerical solution for the unsaturated flow equation, Water Resour. Res., 26, 1483–1496,
https://doi.org/10.1029/WR026i007p01483, 1990.
a
Clément, J.-B., Golay, F., Ersoy, M., and Sous, D.: An adaptive strategy
for discontinuous Galerkin simulations of Richards' equation: Application to
multi-materials dam wetting, Adv. Water Resour., 151, 103897,
https://doi.org/10.1016/j.advwatres.2021.103897, 2021.
a
Depina, I., Jain, S., Valsson, S. M., and Gotovac, H.: Application of
physics-informed neural networks to inverse problems in unsaturated
groundwater flow, Georisk, 16, 21–36,
https://doi.org/10.1080/17499518.2021.1971251, 2021.
a
Dijkema, J., Koonce, J. E., Shillito, R. M., Ghezzehei, T. A., Berli, M.,
van der Ploeg, M. J., and van Genuchten, M. T.: Water distribution in an
arid zone soil: Numerical analysis of data from a large weighing lysimeter,
Vadose Zone J., 1–17,
https://doi.org/10.2136/vzj2017.01.0035, 2017.
a
Fuks, O. and Tchelepi, H. A.: Limitations of physics informed machine learning for nonlinear two-phase transport in porous media, J. Mach. Learn. Model. Comput., 1, 19–37,
https://doi.org/10.1615/.2020033905, 2020.
a
Gardner, W. R.: Some steady-state solutions of the unsaturated moisture flow
equation with application to evaporation from a water table, Soil Sci., 85,
228–232, 1958. a
Ghezzehei, T. A., Kneafsey, T. J., and Su, G. W.: Correspondence of the
Gardner and van Genuchten-Mualem relative permeability function parameters,
Water Resour. Res., 43, 1–7,
https://doi.org/10.1029/2006WR005339, 2007.
a
Glorot, X. and Bengio, Y.: Understanding the difficulty of training deep
feedforward neural networks, in: Proceedings of the thirteenth international
conference on artificial intelligence and statistics, 13–15 May 2010, Sardinia, Italy, 249–256, 2010. a
He, Q., Brajas-solano, D., Tartakovsky, G., and Tartakovsky, A. M.:
Physics-informed neural networks for multiphysics data assimilation with
application to subsurface transport, Adv. Water Resour., 141, 103610,
https://doi.org/10.1016/j.advwatres.2020.103610, 2020.
a,
b
Hornik, K.: Approximation capabilities of multilayer neural network, Neural
Networks, 4, 251–257, 1991. a
Jagtap, A. D. and Karniadakis, G. E.: Extended physics-informed neural
networks (XPINNs): A generalized space-time domain decomposition based deep
learning framework for nonlinear partial differential equations, Commun.
Comput. Phys., 28, 2002–2041,
https://doi.org/10.4208/cicp.oa-2020-0164, 2020.
a,
b,
c,
d,
e,
f,
g
Jagtap, A. D., Kawaguchi, K., and Karniadakis, G. E.: Adaptive activation
functions accelerate convergence in deep and physics-informed neural networks, J. Comput. Phys., 404, 109136,
https://doi.org/10.1016/j.jcp.2019.109136, 2020.
a,
b,
c,
d,
e,
f
Jin, X., Cai, S., Li, H., and Karniadakis, G. E.: NSFnets (Navier-Stokes flow
nets): Physics-informed neural networks for the incompressible Navier-Stokes
equations, J. Comput. Phys., 426, 109951,
https://doi.org/10.1016/j.jcp.2020.109951, 2021.
a
Karniadakis, G. E., Kevrekidis, I. G., Lu, L., Perdikaris, P., Wang, S., and
Yang, L.: Physics-informed machine learning, Nat. Rev. Phys., 3, 422–440,
https://doi.org/10.1038/s42254-021-00314-5, 2021.
a,
b,
c,
d
Kingma, D. P. and Ba, J. B.: Adam: A method for stochastic optimization, in:
Proceedings of the 3rd international conference on learning representations,
7–9 May 2014, San Diego, CA, USA,
https://doi.org/10.48550/arXiv.1412.6980, 2014.
a
Labolle, E. M. and Clausnitzer, V.: Comment on Russo [1991], Serrano [1990,
1998], and other applications of the water-content-based form of Richards'
equation to heterogeneous soils, Water Resour. Res., 35, 605–607, 1999. a
Lagaris, I. E., Likas, A., and Fotiadis, D. I.: Artificial neural networks for solving ordinary and partial differential equations, IEEE T. Neural Netw. Learn. Syst., 9, 987–1000,
https://doi.org/10.1109/72.712178, 1998.
a,
b
LeCun, Y., Bottou, L., Orr, G. B., and Müller, K.-R.: Efficient
backprop, in: Neural Networks: Tricks of the Trade, 2nd Edn., edited by: Montavon, G., Orr, G. B., and Müller, K.-R., Springer, 9–48,
https://doi.org/10.1007/978-3-642-35289-8_3, 2012.
a,
b
Li, N., Yue, X. Y., and Wang, W. K.: Inverse estimation of spatiotemporal flux boundary conditions in unsaturated water flow modeling, Water Resour. Res., 57, e2020WR028030,
https://doi.org/10.1029/2020WR028030, 2021.
a
Li, Z., Kovachki, N., Azizzadenesheli, K., Liu, B., Bhattacharya, K., Stuart,
A., and Anandkumar, A.: Fourier neural operator for parametric partial differential equations, in: International conference on learning and
representations, 4 May 2021, Vienna, Austria,
https://resolver.caltech.edu/CaltechAUTHORS:20201106-120140981 (last access: 30 August 2022), 2021. a
Lu, L., Jin, P., Pang, G., Zhang, Z., and Karniadakis, G. E.: Learning
nonlinear operators via DeepONet based on the universal approximation theorem
of operators, Nat. Mach. Intel., 3, 218–229,
https://doi.org/10.1038/s42256-021-00302-5, 2021a.
a
Lu, L., Meng, X., Mao, Z., and Karniadakis, G. E.: DeepXDE: A deep learning
library for solving differential equations, SIAM Rev., 63, 208–228,
https://doi.org/10.1137/19M1274067, 2021b.
a,
b
Mishra, S. and Molinaro, R.: Estimates on the generalization error of physics-informed neural networks for approximating PDEs, IMA J. Numer. Anal., drab093,
https://doi.org/10.1093/imanum/drab093, 2022.
a,
b,
c,
d
Nearing, G. S., Kratzert, F., Sampson, A. K., Pelissier, C. S., Klotz, D.,
Frame, J. M., Prieto, C., and Gupta, H. V.: What role does hydrological
science play in the age of machine learning?, Water Resour. Res., 57,
e2020WR028091,
https://doi.org/10.1029/2020WR028091, 2021.
a
Paszke, A., Gross, S., Massa, F., Lerer, A., Bradbury, J., Chanan, G., Killeen, T., Lin, Z., Gimelshein, N., Antiga, L., Desmaison, A., Köpf, A., Yang, E., DeVito, Z., Raison, M., Tejani, A., Chilamkurthy, S., Steiner, B., Fang, L., Bai, J., and Chintala, S.: PyTorch: An imperative style,
high-performance deep learning library, in: 33rd conference on neural
information processing systems, 8–14 December 2019, Vancouver, Canada,
https://doi.org/10.48550/arXiv.1912.01703, 2019.
a
Petra, N. and Stadler, G.: Model variational inverse problems governed by
partial differential equations, Tech. rep., The Institute for Computational
Engineering and Sciences, The University of Texas at Austin, 2011. a
Pries, C. E. H., Castanha, C., Porras, R. C., and Torn, M. S.: The whole-soil
carbon flux in response to warming, Science, 359, 1420–1423,
https://doi.org/10.1126/science.aao0457, 2017.
a
Psaros, A. F., Meng, X., Zou, Z., Guo, L., and Karniadakis, G. E.: Uncertainty quantification in scientific machine learning: Methods, metrics, and comparisons, arXiv [preprint], arXiv:2201.07766v1,
https://doi.org/10.48550/arXiv.2201.07766, 2022.
a
Radu, F. A., Pop, I. S., and Knabner, P.: Error estimates for a mixed finite
element discretization of some degenerate parabolic equations, Numer. Math.,
109, 285–311,
https://doi.org/10.1007/s00211-008-0139-9, 2008.
a
Raghu, M., Poole, B., Kleinberg, J., Ganguli, S., and Dickstein, J. S.: On the expressive power of deep neural networks, in: 34th International Conference on Machine Learning, 6–11 August 2017, Sydney, Australia,
https://doi.org/10.48550/arXiv.1606.05336, 2017.
a
Raissi, M., Perdikaris, P., and Karniadakis, G. E.: Physics-informed neural
networks: A deep learning framework for solving forward and inverse problems
involving nonlinear partial differential equations, J. Comput. Phys., 378, 686–707,
https://doi.org/10.1016/j.jcp.2018.10.045, 2019.
a,
b
Raissi, M., Yazdani, A., and Karniadakis, G. E.: Hidden fluid mechanics:
Learning velocity and pressure fields from flow visualizations, Science, 367, 1026–1030,
https://doi.org/10.1126/science.aaw4741, 2020.
a
Robinson, D. A., Campbell, C. S., Hopmans, J. W., Hornbuckle, B. K., Jones, S. B., Knight, R., Ogden, F., Selker, J., and Wendroth, O.: Soil moisture
measurement for ecological and hydrological watershed-scale observatories: A
review, Vadose Zone J., 7, 358–389,
https://doi.org/10.2136/vzj2007.0143, 2008.
a
Sadeghi, M., Tuller, M., Warrick, A., Babaeian, E., Parajuli, K., Gohardoust,
M. R., and Jones, S. B.: An analytical model for estimation of land surface
net water flux from near-surface soil moisture observations, J. Hydrol., 570, 26–37,
https://doi.org/10.1016/j.jhydrol.2018.12.038, 2019.
a
Scudeler, C., Putti, M., and Paniconi, C.: Mass-conservative reconstruction of Galerkin velocity fields for transport simulations, Adv. Water Resour., 94, 470–485,
https://doi.org/10.1016/j.advwatres.2016.06.011, 2016.
a
Sheng, W., Zhou, R., Sadeghi, M., Babaeian, E., Robinson, D. A., Tuller, M.,
and Jones, S. B.: A TDR array probe for monitoring near-surface soil moisture distribution, Vadose Zone J., 16, 1–8,
https://doi.org/10.2136/vzj2016.11.0112, 2017.
a
Shin, Y., Darbon, J., and Karniadakis, G. E.: On the convergence of physics
informed neural networks for linear second-order elliptic and parabolic type
PDEs, Commun. Comput. Phys., 28, 2042–2074,
https://doi.org/10.4208/cicp.oa-2020-0193, 2020.
a,
b
Šimůnek, J., Šejna, M., Saito, H., Sakai, M., and van Genuchten, M. T.: The HYDRUS-1D software package for simulating the one-dimensional
movement of water, heat, and multiple solutes in variably saturated media,
Version 4.17, Department of Environmental Sciences, University of California
Riverside, Riverside, 2013.
a,
b,
c,
d,
e
Srivastava, R. and Yeh, T. C. J.: Analytical solutions for one-dimensional,
transient infiltration toward the water table in homogeneous and layered
soils, Water Resour. Res., 27, 753–762,
https://doi.org/10.1029/90WR02772, 1991.
a,
b,
c,
d,
e,
f,
g,
h,
i
Sun, L., Gao, H., Pan, S., and Wang, J.: Surrogate modeling for fluid flows
based on physics-constrained deep learning without simulation data, Comput.
Meth. Appl. Mech. Eng., 361, 112732,
https://doi.org/10.1016/j.cma.2019.112732, 2020.
a,
b
Tartakovsky, A. M., Marrero, C. O., Perdikaris, P., Tartakovsky, G. D., and
Barajas-Solano, D.: Physics-informed deep neural networks for learning
parameters and constitutive relationships in subsurface flow problems, Water
Resour. Res., 56, e2019WR026731,
https://doi.org/10.1029/2019wr026731, 2020.
a
Vereecken, H., Huisman, J. A., Bogena, H., Vanderborght, J., Vrugt, J. A., and Hopmans, J. W.: On the value of soil moisture measurements in vadose zone
hydrology: A review, Water Resour. Res., 44, W00D06,
https://doi.org/10.1029/2008WR006829, 2008.
a
Virtanen, P., Gommers, R., Oliphant, T. E., Haberland, M., Reddy, T.,
Cournapeau, D., Burovski, E., Peterson, P., Weckesser, W., Bright, J.,
van der Walt, S. J., Brett, M., Wilson, J., Millman, K. J., Mayorov, N.,
Nelson, A. R. J., Jones, E., Kern, R., Larson, E., Carey, C. J., Polat, I.,
Feng, Y., Moore, E. W., VanderPlas, J., Laxalde, D., Perktold, J., Cimrman,
R., Henriksen, I., Quintero, E. A., Harris, C. R., Archibald, A. M., Ribeiro,
A. H., Pedregosa, F., van Mulbregt, P., and SciPy 1.0 Contributors: fundamental algorithms for scientific computing in Python, Nat. Methods, 17, 261–272,
https://doi.org/10.1038/s41592-019-0686-2, 2020.
a
Wang, S., Teng, Y., and Perdikaris, P.: Understanding and mitigating gradient
flow pathologies in physics-informed neural networks, SIAM J. Sci. Comput.,
43, A3055–A3081, 2021.
a,
b,
c,
d
Wang, S., Yu, X., and Perdikaris, P.: When and why PINNs fail to train: A
neural tangent kernel perspective, J. Comput. Phys., 449, 110768, 2022.
a,
b
