1,720,985 research outputs found
A Comprehensive Deep Learning-Based Approach to Reduced Order Modeling of Nonlinear Time-Dependent Parametrized PDEs
Full text linkConventional reduced order modeling techniques such as the reduced basis (RB) method (relying, e.g., on proper orthogonal decomposition (POD)) may incur in severe limitations when dealing with nonlinear time-dependent parametrized PDEs, as these are strongly anchored to the assumption of modal linear superimposition they are based on. For problems featuring coherent structures that propagate over time such as transport, wave, or convection-dominated phenomena, the RB method may yield inefficient reduced order models (ROMs) when very high levels of accuracy are required. To overcome this limitation, in this work, we propose a new nonlinear approach to set ROMs by exploiting deep learning (DL) algorithms. In the resulting nonlinear ROM, which we refer to as DL-ROM, both the nonlinear trial manifold (corresponding to the set of basis functions in a linear ROM) as well as the nonlinear reduced dynamics (corresponding to the projection stage in a linear ROM) are learned in a non-intrusive way by relying on DL algorithms; the latter are trained on a set of full order model (FOM) solutions obtained for different parameter values. We show how to construct a DL-ROM for both linear and nonlinear time-dependent parametrized PDEs. Moreover, we assess its accuracy and efficiency on different parametrized PDE problems. Numerical results indicate that DL-ROMs whose dimension is equal to the intrinsic dimensionality of the PDE solutions manifold are able to efficiently approximate the solution of parametrized PDEs, especially in cases for which a huge number of POD modes would have been necessary to achieve the same degree of accuracy
PTPI-DL-ROMs: Pre-trained physics-informed deep learning-based reduced order models for nonlinear parametrized PDEs
No full textAmong several recently proposed data-driven Reduced Order Models (ROMs), the coupling of Proper Orthogonal Decompositions (POD) and deep learning-based ROMs (DL-ROMs) has proved to be a successful strategy to construct non-intrusive, highly accurate, surrogates for the real time solution of parametric nonlinear time-dependent PDEs. Inexpensive to evaluate, POD-DL-ROMs are also relatively fast to train, thanks to their limited complexity. However, POD-DL-ROMs account for the physical laws governing the problem at hand only through the training data, that are usually obtained through a full order model (FOM) relying on a highfidelity discretization of the underlying equations. Moreover, the accuracy of POD-DL-ROMs strongly depends on the amount of available data. In this paper, we consider a major extension of POD-DL-ROMs by enforcing the fulfillment of the governing physical laws in the training process - that is, by making them physics-informed - to compensate for possible scarce and/or unavailable data and improve the overall reliability. To do that, we first complement POD-DLROMs with a trunk net architecture, endowing them with the ability to compute the problem's solution at every point in the spatial domain, and ultimately enabling a seamless computation of the physics-based loss by means of the strong continuous formulation. Then, we introduce an efficient training strategy that limits the notorious computational burden entailed by a physics-informed training phase. In particular, we take advantage of the few available data to develop a low-cost pre-training procedure; then, we fine-tune the architecture in order to further improve the prediction reliability. Accuracy and efficiency of the resulting pre-trained physics-informed DL-ROMs (PTPI-DL-ROMs) are then assessed on a set of test cases ranging from non-affinely parametrized advection-diffusion-reaction equations, to nonlinear problems like the Navier-Stokes equations for fluid flows
Handling geometrical variability in nonlinear reduced order modeling through Continuous Geometry-Aware DL-ROMs
No full textDeep Learning-based Reduced Order Models (DL-ROMs) provide nowadays a well-established class of accurate surrogate models for complex physical systems described by parameterised PDEs, by nonlinearly compressing the solution manifold into a handful of latent coordinates. Until now, design and application of DL-ROMs mainly focused on physically parameterised problems. Within this work, we provide a novel extension of these architectures to problems featuring geometrical variability and parameterised domains, namely, we propose Continuous Geometry-Aware DL-ROMs (CGA-DL-ROMs). In particular, the space-continuous nature of the proposed architecture matches the need to deal with multi-resolution datasets, which are quite common in the case of geometrically parameterised problems. Moreover, CGA-DL-ROMs are endowed with a strong inductive bias that makes them aware of geometrical parametrizations, thus enhancing both the compression capability and the overall performance of the architecture. Within this work, we justify our findings through a thorough theoretical analysis, and we practically validate our claims by means of a series of numerical tests encompassing physically-and-geometrically parameterised PDEs, ranging from the unsteady Navier–Stokes equations for fluid dynamics to advection–diffusion–reaction equations for mathematical biology
Error estimates for POD-DL-ROMs: a deep learning framework for reduced order modeling of nonlinear parametrized PDEs enhanced by proper orthogonal decomposition
No full textPOD-DL-ROMs have been recently proposed as an extremely versatile strategy to build accurate and reliable reduced order models (ROMs) for nonlinear parametrized partial differential equations, combining (i) a preliminary dimensionality reduction obtained through proper orthogonal decomposition (POD) for the sake of efficiency, (ii) an autoencoder architecture that further reduces the dimensionality of the POD space to a handful of latent coordinates, and (iii) a dense neural network to learn the map that describes the dynamics of the latent coordinates as a function of the input parameters and the time variable. Within this work, we aim at justifying the outstanding approximation capabilities of POD-DL-ROMs by means of a thorough error analysis, showing how the sampling required to generate training data, the dimension of the POD space, and the complexity of the underlying neural networks, impact on the solutions us to formulate practical criteria to control the relative error in the approximation of the solution field of interest, and derive general error estimates. Furthermore, we show that, from a theoretical point of view, POD-DL-ROMs outperform several deep learning-based techniques in terms of model complexity. Finally, we validate our findings by means of suitable numerical experiments, ranging from parameter-dependent operators analytically defined to several parametrized PDEs
On latent dynamics learning in nonlinear reduced order modeling
No full textIn this work, we present the novel mathematical framework of latent dynamics models (LDMs) for reduced order modeling of parameterized nonlinear time-dependent PDEs. Our framework casts this latter task as a nonlinear dimensionality reduction problem, while constraining the latent state to evolve accordingly to an unknown dynamical system. A time-continuous setting is employed to derive error and stability estimates for the LDM approximation of the full order model (FOM) solution. We analyze the impact of using an explicit Runge-Kutta scheme in the time-discrete setting, resulting in the 4 LDM formulation, and further explore the learnable setting, 4LDM theta, where deep neural networks approximate the discrete LDM components, while providing a bounded approximation error with respect to the FOM. Moreover, we extend the concept of parameterized Neural ODE - a possible way to build data-driven dynamical systems with varying input parameters - to be a convolutional architecture, where the input parameters information is injected by means of an affine modulation mechanism, while designing a convolutional autoencoder neural network able to retain spatial- coherence, thus enhancing interpretability at the latent level. Numerical experiments, including the Burgers' and the advection-diffusion-reaction equations, demonstrate the framework's ability to obtain a time-continuous approximation of the FOM solution, thus being able to query the LDM approximation at any given time instance while retaining a prescribed level of accuracy. Our findings highlight the remarkable potential of the proposed LDMs, representing a mathematically rigorous framework to enhance the accuracy and approximation capabilities of reduced order modeling for time-dependent parameterized PDEs
Efficient approximation of cardiac mechanics through reduced-order modeling with deep learning-based operator approximation
No full textReducing the computational time required by high-fidelity, full-order models (FOMs) for the solution of problems in cardiac mechanics is crucial to allow the translation of patient-specific simulations into clinical practice. Indeed, while FOMs, such as those based on the finite element method, provide valuable information on the cardiac mechanical function, accurate numerical results can be obtained at the price of very fine spatio-temporal discretizations. As a matter of fact, simulating even just a few heartbeats can require up to hours of wall time on high-performance computing architectures. In addition, cardiac models usually depend on a set of input parameters that are calibrated in order to explore multiple virtual scenarios. To compute reliable solutions at a greatly reduced computational cost, we rely on a reduced basis method empowered with a new deep learning-based operator approximation, which we refer to as Deep-HyROMnet technique. Our strategy combines a projection-based POD-Galerkin method with deep neural networks for the approximation of (reduced) nonlinear operators, overcoming the typical computational bottleneck associated with standard hyper-reduction techniques employed in reduced-order models (ROMs) for nonlinear parametrized systems. This method can provide extremely accurate approximations to parametrized cardiac mechanics problems, such as in the case of the complete cardiac cycle in a patient-specific left ventricle geometry. In this respect, a 3D model for tissue mechanics is coupled with a 0D model for external blood circulation; active force generation is provided through an adjustable parameter-dependent surrogate model as input to the tissue 3D model. The proposed strategy is shown to outperform classical projection-based ROMs, in terms of orders of magnitude of computational speed-up, and to return accurate pressure-volume loops in both physiological and pathological cases. Finally, an application to a forward uncertainty quantification analysis, unaffordable if relying on a FOM, is considered, involving output quantities of interest such as, for example, the ejection fraction or the maximal rate of change in pressure in the left ventricle.CI
Deep learning-based surrogate models for parametrized PDEs: Handling geometric variability through graph neural networks
No full textMesh-based simulations play a key role when modeling complex physical systems that, in many disciplines across science and engineering, require the solution to parametrized time-dependent nonlinear partial differential equations (PDEs). In this context, full order models (FOMs), such as those relying on the finite element method, can reach high levels of accuracy, however often yielding intensive simulations to run. For this reason, surrogate models are developed to replace computationally expensive solvers with more efficient ones, which can strike favorable trade-offs between accuracy and efficiency. This work explores the potential usage of graph neural networks (GNNs) for the simulation of time-dependent PDEs in the presence of geometrical variability. In particular, we propose a systematic strategy to build surrogate models based on a data-driven time-stepping scheme where a GNN architecture is used to efficiently evolve the system. With respect to the majority of surrogate models, the proposed approach stands out for its ability of tackling problems with parameter-dependent spatial domains, while simultaneously generalizing to different geometries and mesh resolutions. We assess the effectiveness of the proposed approach through a series of numerical experiments, involving both two- and three-dimensional problems, showing that GNNs can provide a valid alternative to traditional surrogate models in terms of computational efficiency and generalization to new scenarios
Projection-based reduced order models for parameterized nonlinear time-dependent problems arising in cardiac mechanics
Full text linkThe numerical simulation of several virtual scenarios arising in cardiac mechanics poses a computational challenge that can be alleviated if traditional full-order models (FOMs) are replaced by reduced order models (ROMs). For example, in the case of problems involving a vector of input parameters related, e.g., to material coefficients, projection-based ROMs provide mathematically rigorous physics-driven surrogate ROMs. In this work we demonstrate how, once trained, ROMs yield extremely accurate predictions (according to a prescribed tolerance) - yet cheaper than the ones provided by FOMs - of the structural deformation of the left ventricular tissue over an entire heartbeat, and of related output quantities of interest, such as the pressure-volume loop, for any desired input parameter values within a prescribed parameter range. However, the construction of ROM approximations for time-dependent cardiac mechanics is not straightforward, because of the highly nonlinear and multiscale nature of the problem, and almost never addressed. Our approach relies on the reduced basis method for parameterized partial differential equations. This technique performs a Galerkin projection onto a low-dimensional space for the displacement variable; the reduced space is built from a set of solution snapshots obtained for different input parameter values and time instances - of the high-fidelity FOM, through the proper orthogonal decomposition technique. Then, suitable hyper-reduction techniques, such as the Discrete Empirical Interpolation Method, are exploited to efficiently handle nonlinear and parameter-dependent terms. In this work we show how a fast and reliable approximation of the time-dependent cardiac mechanical model can be achieved by a projection-based ROM, taking into account both passive and active mechanics for the left ventricle providing all the building blocks of the methodology, and highlighting those challenging aspects that are still open
Long-time prediction of nonlinear parametrized dynamical systems by deep learning-based reduced order models
Full text linkDeep learning-based reduced order models (DL-ROMs) have been recently proposed to overcome common limitations shared by conventional ROMs-built, e.g., through proper orthogonal decomposition (POD)-when applied to nonlinear time-dependent parametrized PDEs. In particular, POD-DL-ROMs can achieve an extremely good efficiency in the training stage and faster than realtime performances at testing, thanks to a prior dimensionality reduction through POD and a DL-based prediction framework. Nonetheless, they share with conventional ROMs unsatisfactory performances regarding time extrapolation tasks. This work aims at taking a further step towards the use of DL algorithms for the efficient approximation of parametrized PDEs by introducing the & mu;t-POD-LSTM-ROM framework. This latter extends the POD-DL-ROMs by adding a two-fold architecture taking advantage of long short-term memory (LSTM) cells, ultimately allowing long-term prediction of complex systems' evolution, with respect to the training window, for unseen input parameter values. Numerical results show that & mu;t-POD-LSTM-ROMs enable the extrapolation for time windows up to 15 times larger than the training time interval, also achieving better performances at testing than PODDL-ROMs
POD-Enhanced Deep Learning-Based Reduced Order Models for the Real-Time Simulation of Cardiac Electrophysiology in the Left Atrium
Full text linkThe numerical simulation of multiple scenarios easily becomes computationally prohibitive for cardiac electrophysiology (EP) problems if relying on usual high-fidelity, full order models (FOMs). Likewise, the use of traditional reduced order models (ROMs) for parametrized PDEs to speed up the solution of the aforementioned problems can be problematic. This is primarily due to the strong variability characterizing the solution set and to the nonlinear nature of the input-output maps that we intend to reconstruct numerically. To enhance ROM efficiency, we proposed a new generation of non-intrusive, nonlinear ROMs, based on deep learning (DL) algorithms, such as convolutional, feedforward, and autoencoder neural networks. In the proposed DL-ROM, both the nonlinear solution manifold and the nonlinear reduced dynamics used to model the system evolution on that manifold can be learnt in a non-intrusive way thanks to DL algorithms trained on a set of FOM snapshots. DL-ROMs were shown to be able to accurately capture complex front propagation processes, both in physiological and pathological cardiac EP, very rapidly once neural networks were trained, however, at the expense of huge training costs. In this study, we show that performing a prior dimensionality reduction on FOM snapshots through randomized proper orthogonal decomposition (POD) enables to speed up training times and to decrease networks complexity. Accuracy and efficiency of this strategy, which we refer to as POD-DL-ROM, are assessed in the context of cardiac EP on an idealized left atrium (LA) geometry and considering snapshots arising from a NURBS (non-uniform rational B-splines)-based isogeometric analysis (IGA) discretization. Once the ROMs have been trained, POD-DL-ROMs can efficiently solve both physiological and pathological cardiac EP problems, for any new scenario, in real-time, even in extremely challenging contexts such as those featuring circuit re-entries, that are among the factors triggering cardiac arrhythmias
- …
