Randomized radial basis function neural network for solving multiscale elliptic equations
Ordinary deep neural network (DNN)-based methods frequently encounter difficulties when tackling multiscale and high-frequency partial differential equations. To overcome these obstacles and improve computational accuracy and efficiency, this paper presents the Randomized Radial Basis Function Neura...
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IOP Publishing
2025-01-01
|
| Series: | Machine Learning: Science and Technology |
| Subjects: | |
| Online Access: | https://doi.org/10.1088/2632-2153/ad979c |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1823860513055965184 |
|---|---|
| author | Yuhang Wu Ziyuan Liu Wenjun Sun Xu Qian |
| author_facet | Yuhang Wu Ziyuan Liu Wenjun Sun Xu Qian |
| author_sort | Yuhang Wu |
| collection | DOAJ |
| description | Ordinary deep neural network (DNN)-based methods frequently encounter difficulties when tackling multiscale and high-frequency partial differential equations. To overcome these obstacles and improve computational accuracy and efficiency, this paper presents the Randomized Radial Basis Function Neural Network (RRNN), an innovative approach explicitly crafted for solving multiscale elliptic equations. The RRNN method commences by decomposing the computational domain into non-overlapping subdomains. Within each subdomain, the solution to the localized subproblem is approximated by a RRNN with a Gaussian kernel. This network is distinguished by the random assignment of width and center coefficients for its activation functions, thereby rendering the training process focused solely on determining the weight coefficients of the output layer. For each subproblem, similar to the Petrov–Galerkin finite element method, a linear system will be formulated on the foundation of a weak formulation. Subsequently, a selection of collocation points is stochastically sampled at the boundaries of the subdomain, ensuring the satisfaction of C ^0 and C ^1 continuity and boundary conditions to couple these localized solutions. The network is ultimately trained using the least squares method to ascertain the output layer weights. To validate the RRNN method’s effectiveness, an extensive array of numerical experiments has been executed. The RRNN is firstly compared with a variety of DNN methods based on gradient descent optimization. The comparative analysis demonstrates the RRNN’s superior performance with respect to computational accuracy and training time. Furthermore, it is contrasted with to local extreme learning machine method, which also utilizes domain decomposition and the least squares method. The comparative findings suggest that the RRNN method can attain enhanced accuracy at a comparable computational cost, particularly pronounced in scenarios with a smaller scale ratio ɛ . |
| format | Article |
| id | doaj-art-9aa9d4c5ec0e4b2e910907989339bdbd |
| institution | Kabale University |
| issn | 2632-2153 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | IOP Publishing |
| record_format | Article |
| series | Machine Learning: Science and Technology |
| spelling | doaj-art-9aa9d4c5ec0e4b2e910907989339bdbd2025-02-10T13:12:44ZengIOP PublishingMachine Learning: Science and Technology2632-21532025-01-016101503310.1088/2632-2153/ad979cRandomized radial basis function neural network for solving multiscale elliptic equationsYuhang Wu0https://orcid.org/0009-0003-0719-3140Ziyuan Liu1Wenjun Sun2Xu Qian3College of Sciences, National University of Defense Technology , Changsha, Hunan 410073, People’s Republic of China; Institute of Applied Physics and Computational Mathematics , Beijing 100094, People’s Republic of ChinaCollege of Sciences, National University of Defense Technology , Changsha, Hunan 410073, People’s Republic of ChinaInstitute of Applied Physics and Computational Mathematics , Beijing 100094, People’s Republic of ChinaCollege of Sciences, National University of Defense Technology , Changsha, Hunan 410073, People’s Republic of ChinaOrdinary deep neural network (DNN)-based methods frequently encounter difficulties when tackling multiscale and high-frequency partial differential equations. To overcome these obstacles and improve computational accuracy and efficiency, this paper presents the Randomized Radial Basis Function Neural Network (RRNN), an innovative approach explicitly crafted for solving multiscale elliptic equations. The RRNN method commences by decomposing the computational domain into non-overlapping subdomains. Within each subdomain, the solution to the localized subproblem is approximated by a RRNN with a Gaussian kernel. This network is distinguished by the random assignment of width and center coefficients for its activation functions, thereby rendering the training process focused solely on determining the weight coefficients of the output layer. For each subproblem, similar to the Petrov–Galerkin finite element method, a linear system will be formulated on the foundation of a weak formulation. Subsequently, a selection of collocation points is stochastically sampled at the boundaries of the subdomain, ensuring the satisfaction of C ^0 and C ^1 continuity and boundary conditions to couple these localized solutions. The network is ultimately trained using the least squares method to ascertain the output layer weights. To validate the RRNN method’s effectiveness, an extensive array of numerical experiments has been executed. The RRNN is firstly compared with a variety of DNN methods based on gradient descent optimization. The comparative analysis demonstrates the RRNN’s superior performance with respect to computational accuracy and training time. Furthermore, it is contrasted with to local extreme learning machine method, which also utilizes domain decomposition and the least squares method. The comparative findings suggest that the RRNN method can attain enhanced accuracy at a comparable computational cost, particularly pronounced in scenarios with a smaller scale ratio ɛ .https://doi.org/10.1088/2632-2153/ad979cmultiscale elliptic equationsrandomized radial basis function neural networkdomain decompositionweak formulationleast squares method |
| spellingShingle | Yuhang Wu Ziyuan Liu Wenjun Sun Xu Qian Randomized radial basis function neural network for solving multiscale elliptic equations Machine Learning: Science and Technology multiscale elliptic equations randomized radial basis function neural network domain decomposition weak formulation least squares method |
| title | Randomized radial basis function neural network for solving multiscale elliptic equations |
| title_full | Randomized radial basis function neural network for solving multiscale elliptic equations |
| title_fullStr | Randomized radial basis function neural network for solving multiscale elliptic equations |
| title_full_unstemmed | Randomized radial basis function neural network for solving multiscale elliptic equations |
| title_short | Randomized radial basis function neural network for solving multiscale elliptic equations |
| title_sort | randomized radial basis function neural network for solving multiscale elliptic equations |
| topic | multiscale elliptic equations randomized radial basis function neural network domain decomposition weak formulation least squares method |
| url | https://doi.org/10.1088/2632-2153/ad979c |
| work_keys_str_mv | AT yuhangwu randomizedradialbasisfunctionneuralnetworkforsolvingmultiscaleellipticequations AT ziyuanliu randomizedradialbasisfunctionneuralnetworkforsolvingmultiscaleellipticequations AT wenjunsun randomizedradialbasisfunctionneuralnetworkforsolvingmultiscaleellipticequations AT xuqian randomizedradialbasisfunctionneuralnetworkforsolvingmultiscaleellipticequations |