Discretization-independent surrogate modeling of physical fields around variable geometries using coordinate-based networks

Numerical solutions of partial differential equations require expensive simulations, limiting their application in design optimization, model-based control, and large-scale inverse problems. Surrogate modeling techniques aim to decrease computational expense while retaining dominant solution feature...

Full description

Saved in:
Bibliographic Details
Main Authors: James Duvall, Karthik Duraisamy
Format: Article
Language:English
Published: Cambridge University Press 2025-01-01
Series:Data-Centric Engineering
Subjects:
Online Access:https://www.cambridge.org/core/product/identifier/S2632673624000212/type/journal_article
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1850190396841263104
author James Duvall
Karthik Duraisamy
author_facet James Duvall
Karthik Duraisamy
author_sort James Duvall
collection DOAJ
description Numerical solutions of partial differential equations require expensive simulations, limiting their application in design optimization, model-based control, and large-scale inverse problems. Surrogate modeling techniques aim to decrease computational expense while retaining dominant solution features and characteristics. Existing frameworks based on convolutional neural networks and snapshot-matrix decomposition often rely on lossy pixelization and data-preprocessing, limiting their effectiveness in realistic engineering scenarios. Recently, coordinate-based multilayer perceptron networks have been found to be effective at representing 3D objects and scenes by regressing volumetric implicit fields. These concepts are leveraged and adapted in the context of physical-field surrogate modeling. Two methods toward generalization are proposed and compared: design-variable multilayer perceptron (DV-MLP) and design-variable hypernetworks (DVH). Each method utilizes a main network which consumes pointwise spatial information to provide a continuous representation of the solution field, allowing discretization independence and a decoupling of solution and model size. DV-MLP achieves generalization through the use of a design-variable embedding vector, while DVH conditions the main network weights on the design variables using a hypernetwork. The methods are applied to predict steady-state solutions around complex, parametrically defined geometries on non-parametrically-defined meshes, with model predictions obtained in less than a second. The incorporation of random Fourier features greatly enhanced prediction and generalization accuracy for both approaches. DVH models have more trainable weights than a similar DV-MLP model, but an efficient batch-by-case training method allows DVH to be trained in a similar amount of time as DV-MLP. A vehicle aerodynamics test problem is chosen to assess the method’s feasibility. Both methods exhibit promising potential as viable options for surrogate modeling, being able to process snapshots of data that correspond to different mesh topologies.
format Article
id doaj-art-2c635d3e4bc4414b82fb2f024eeedf73
institution OA Journals
issn 2632-6736
language English
publishDate 2025-01-01
publisher Cambridge University Press
record_format Article
series Data-Centric Engineering
spelling doaj-art-2c635d3e4bc4414b82fb2f024eeedf732025-08-20T02:15:17ZengCambridge University PressData-Centric Engineering2632-67362025-01-01610.1017/dce.2024.21Discretization-independent surrogate modeling of physical fields around variable geometries using coordinate-based networksJames Duvall0https://orcid.org/0000-0001-6398-8819Karthik Duraisamy1https://orcid.org/0000-0002-3519-8147Department of Aerospace Engineering, University of Michigan, Ann Arbor, MI, USADepartment of Aerospace Engineering, University of Michigan, Ann Arbor, MI, USANumerical solutions of partial differential equations require expensive simulations, limiting their application in design optimization, model-based control, and large-scale inverse problems. Surrogate modeling techniques aim to decrease computational expense while retaining dominant solution features and characteristics. Existing frameworks based on convolutional neural networks and snapshot-matrix decomposition often rely on lossy pixelization and data-preprocessing, limiting their effectiveness in realistic engineering scenarios. Recently, coordinate-based multilayer perceptron networks have been found to be effective at representing 3D objects and scenes by regressing volumetric implicit fields. These concepts are leveraged and adapted in the context of physical-field surrogate modeling. Two methods toward generalization are proposed and compared: design-variable multilayer perceptron (DV-MLP) and design-variable hypernetworks (DVH). Each method utilizes a main network which consumes pointwise spatial information to provide a continuous representation of the solution field, allowing discretization independence and a decoupling of solution and model size. DV-MLP achieves generalization through the use of a design-variable embedding vector, while DVH conditions the main network weights on the design variables using a hypernetwork. The methods are applied to predict steady-state solutions around complex, parametrically defined geometries on non-parametrically-defined meshes, with model predictions obtained in less than a second. The incorporation of random Fourier features greatly enhanced prediction and generalization accuracy for both approaches. DVH models have more trainable weights than a similar DV-MLP model, but an efficient batch-by-case training method allows DVH to be trained in a similar amount of time as DV-MLP. A vehicle aerodynamics test problem is chosen to assess the method’s feasibility. Both methods exhibit promising potential as viable options for surrogate modeling, being able to process snapshots of data that correspond to different mesh topologies.https://www.cambridge.org/core/product/identifier/S2632673624000212/type/journal_articleaerodynamicshypernetworksneural networkssurrogate model
spellingShingle James Duvall
Karthik Duraisamy
Discretization-independent surrogate modeling of physical fields around variable geometries using coordinate-based networks
Data-Centric Engineering
aerodynamics
hypernetworks
neural networks
surrogate model
title Discretization-independent surrogate modeling of physical fields around variable geometries using coordinate-based networks
title_full Discretization-independent surrogate modeling of physical fields around variable geometries using coordinate-based networks
title_fullStr Discretization-independent surrogate modeling of physical fields around variable geometries using coordinate-based networks
title_full_unstemmed Discretization-independent surrogate modeling of physical fields around variable geometries using coordinate-based networks
title_short Discretization-independent surrogate modeling of physical fields around variable geometries using coordinate-based networks
title_sort discretization independent surrogate modeling of physical fields around variable geometries using coordinate based networks
topic aerodynamics
hypernetworks
neural networks
surrogate model
url https://www.cambridge.org/core/product/identifier/S2632673624000212/type/journal_article
work_keys_str_mv AT jamesduvall discretizationindependentsurrogatemodelingofphysicalfieldsaroundvariablegeometriesusingcoordinatebasednetworks
AT karthikduraisamy discretizationindependentsurrogatemodelingofphysicalfieldsaroundvariablegeometriesusingcoordinatebasednetworks