Simultaneous imposition of initial and boundary conditions via decoupled physics-informed neural networks for solving initial-boundary value problems

Expand
  • 1.Deep Learning Architecture Research Center, Sejong University, Seoul 05006, Republic of Korea
    2.Soete Laboratory, Department of Electrical Energy, Metals, Mechanical Constructions, and Systems, Faculty of Engineering and Architecture, Ghent University, Gent 9000, Belgium
    3.College of Engineering, Yuan Ze University, Taoyuan 32026, Taiwan, China
J. H. LEE, E-mail: jhlee@sejong.ac.kr

Received date: 2024-09-11

  Revised date: 2025-02-08

  Online published: 2025-04-07

Supported by

Project supported by the Basic Science Research Program through the National Research Foundation (NRF) of Korea funded by the Ministry of Science and ICT (No. RS-2024-00337001)

Copyright

© Shanghai University 2025

Abstract

Enforcing initial and boundary conditions (I/BCs) poses challenges in physics-informed neural networks (PINNs). Several PINN studies have gained significant achievements in developing techniques for imposing BCs in static problems; however, the simultaneous enforcement of I/BCs in dynamic problems remains challenging. To overcome this limitation, a novel approach called decoupled physics-informed neural network (dPINN) is proposed in this work. The dPINN operates based on the core idea of converting a partial differential equation (PDE) to a system of ordinary differential equations (ODEs) via the space-time decoupled formulation. To this end, the latent solution is expressed in the form of a linear combination of approximation functions and coefficients, where approximation functions are admissible and coefficients are unknowns of time that must be solved. Subsequently, the system of ODEs is obtained by implementing the weighted-residual form of the original PDE over the spatial domain. A multi-network structure is used to parameterize the set of coefficient functions, and the loss function of dPINN is established based on minimizing the residuals of the gained ODEs. In this scheme, the decoupled formulation leads to the independent handling of I/BCs. Accordingly, the BCs are automatically satisfied based on suitable selections of admissible functions. Meanwhile, the original ICs are replaced by the Galerkin form of the ICs concerning unknown coefficients, and the neural network (NN) outputs are modified to satisfy the gained ICs. Several benchmark problems involving different types of PDEs and I/BCs are used to demonstrate the superior performance of dPINN compared with regular PINN in terms of solution accuracy and computational cost.

Cite this article

K. A. LUONG, M. A. WAHAB, J. H. LEE . Simultaneous imposition of initial and boundary conditions via decoupled physics-informed neural networks for solving initial-boundary value problems[J]. Applied Mathematics and Mechanics, 2025 , 46(4) : 763 -780 . DOI: 10.1007/s10483-025-3240-7

References

[1] TORO, E. F. Riemann Solvers and Numerical Methods for Fluid Dynamics: a Practical Introduction, Springer Science & Business Media, Berlin (2013)
[2] REDDY, J. N. An Introduction to the Finite Element Method, McGraw-Hill, New York (1993)
[3] MüLLER, E. H. and SCHEICHL, R. Massively parallel solvers for elliptic partial differential equations in numerical weather and climate prediction. Quarterly Journal of the Royal Meteorological Society, 140(685), 2608–2624 (2014)
[4] LEVEQUE, R. J. Finite Difference Methods for Ordinary and Partial Differential Equations: Steady-State and Time-Dependent Problems, SIAM, Philadelphia (2007)
[5] KORIC, S., HIBBELER, L. C., and THOMAS, B. G. Explicit coupled thermo-mechanical finite element model of steel solidification. International Journal for Numerical Methods in Engineering, 78(1), 1–31 (2009)
[6] WARBURTON, G. B. The Dynamical Behaviour of Structures, Pergamon Press, Oxford (1976)
[7] DOUGLAS, J. and DUPONT, T. Galerkin methods for parabolic equations with nonlinear boundary conditions. Numerische Mathematik, 20, 213–237 (1973)
[8] RAISSI, M., PERDIKARIS, P., and KARNIADAKIS, G. E. Physics-informed neural networks: a deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations. Journal of Computational Physics, 378, 686–707 (2019)
[9] BAYDIN, A. G., PEARLMUTTER, B. A., RADUL, A. A., and SISKIND, J. M. Automatic differentiation in machine learning: a survey. Journal of Machine Learning Research, 18(153), 1–43 (2018)
[10] LE-DUC, T., LEE, S., NGUYEN-XUAN, H., and LEE, J. A hierarchically normalized physics-informed neural network for solving differential equations: application for solid mechanics problems. Engineering Applications of Artificial Intelligence, 133, 108400 (2024)
[11] TRINH, D. T., LUONG, K. A., and LEE, J. An analysis of functionally graded thin-walled beams using physics-informed neural networks. Engineering Structures, 301, 117290 (2024)
[12] YANG, Y. and MESRI, Y. Learning by neural networks under physical constraints for simulation in fluid mechanics. Computers & Fluids, 248, 105632 (2022)
[13] YIN, M., ZHENG, X., HUMPHREY, J. D., and KARNIADAKIS, G. E. Non-invasive inference of thrombus material properties with physics-informed neural networks. Computer Methods in Applied Mechanics and Engineering, 375, 113603 (2021)
[14] SUKUMAR, N. and SRIVASTAVA, A. Exact imposition of boundary conditions with distance functions in physics-informed deep neural networks. Computer Methods in Applied Mechanics and Engineering, 389, 114333 (2022)
[15] LUONG, K. A., LE-DUC, T., LEE, S., and LEE, J. A novel normalized reduced-order physics-informed neural network for solving inverse problems. Engineering with Computers, 40, 3253–3272 (2024)
[16] SAMANIEGO, E., ANITESCU, C., GOSWAMI, S., NGUYEN-THANH, V. M., GUO, H., HAMDIA, K., ZHUANG, X., and RABCZUK, T. An energy approach to the solution of partial differential equations in computational mechanics via machine learning: concepts, implementation and applications. Computer Methods in Applied Mechanics and Engineering, 362, 112790 (2020)
[17] LI, W., BAZANT, M. Z., and ZHU, J. A physics-guided neural network framework for elastic plates: comparison of governing equations-based and energy-based approaches. Computer Methods in Applied Mechanics and Engineering, 383, 113933 (2021)
[18] SCHMIDHUBER, J. Deep learning in neural networks: an overview. Neural Networks, 61, 85–117 (2015)
[19] STOER, J. and BULIRSCH, R. Introduction to Numerical Analysis, Springer, New York (1980)
[20] RAZZAGHI, M. and RAZZAGHI, M. Fourier series direct method for variational problems. International Journal of Control, 48(3), 887–895 (1988)
[21] HORN, R. A. and JOHNSON, C. R. Matrix Analysis, Cambridge University Press, Cambridge (1985)
[22] LUONG, K. A., LE-DUC, T., and LEE, J. Automatically imposing boundary conditions for boundary value problems by unified physics-informed neural network. Engineering with Computers, 40, 1717–1739 (2024)
[23] ABADI, M., BARHAM, P., CHEN, J., CHEN, Z., DAVIS, A., DEAN, J., DEVIN, M., GHEMAWAT, S., IRVING, G., ISARD, M., KUDLUR, M., LEVENBERG, J., MONGA, R., MOORE, S., MURRAY, D. G., STEINER, B., TUCKER, P., VASUDEVAN, V., WARDEN, P., WICKE, M., YU, Y., and ZHENG, X. Q. TensorFlow: a system or large-scale machine learning. Proceedings of the 12th USENIX Symposium on Operating Systems Design and Implementation, Georgia, 265–283 (2016)
[24] KINGMA, D. P. and BA, J. Adam: a method for stochastic optimization. International Conference on Learning Representations, California (2015)
[25] LIU, D. C. and NOCEDAL, J. On the limited memory BFGS method for large scale optimization. Mathematical Programming, 45(1), 503–528 (1989)
[26] MUKUNDAN, V. and AWASTHI, A. Linearized implicit numerical method for Burgers' equation. Nonlinear Engineering, 5(4), 219–234 (2016)
[27] LUONG, K. A., LE-DUC, T., and LEE, J. Deep reduced-order least-square method — a parallel neural network structure for solving beam problems. Thin-Walled Structures, 191, 111044 (2023)
[28] LIN, J. H., WILLIAMS, F. W., and BENNETT, P. N. Direct Ritz method for random seismic response for non-uniform beams. Structural Engineering and Mechanics: an International Journal, 2(3), 285–294 (1994)
[29] KARNAKOV, P., LITVINOV, S., and KOUMOUTSAKOS, P. Solving inverse problems in physics by optimizing a discrete loss: fast and accurate learning without neural networks. PNAS Nexus, 3(1), 005 (2024)
Outlines

/

APS Journals | CSTAM Journals | AMS Journals | EMS Journals | ASME Journals