Solubilization and characterization of the insect neuronal sodium channel

H. Moskowitz,E. Zlotkin,D. Gordon

DOI: https://doi.org/10.1016/0304-3940(91)90081-4

IF: 3.197

1991-04-01

Neuroscience Letters

Abstract:

What problem does this paper attempt to address?

A deep learning based reduced order modeling for stochastic underground flow problems

Yiran Wang,Eric Chung,Shubin Fu,Yiran Wang,Eric Chung,Shubin Fu

DOI: https://doi.org/10.1016/j.jcp.2022.111449

IF: 4.645

2022-10-15

Journal of Computational Physics

Abstract:In this paper, we propose a deep learning based reduced order modeling method for stochastic underground flow problems in highly heterogeneous media. We aim to utilize supervised learning to build a reduced surrogate mapping from the stochastic parameter space that characterizes the possible highly heterogeneous media to the solution space of a stochastic flow problem. Offline preparation includes collecting a set of full-order solutions to form a global snapshot space and extracting dominating POD modes using a particular well-designed spectral problem to represent full-order solutions. Due to the small dimension of reduced-order solutions, the complexity of neural network is significantly lightened, which effectively relieves the burden of training. We adopt the generalized multiscale finite element method (GMsFEM), where a set of local multiscale basis functions that can capture the heterogeneity of the media and source information are constructed to efficiently generate globally defined snapshot space. In an online stage, one can rapidly obtain the reduced-order pressure and then corresponding full-order solution is recovered using a linear transformation. Due to the decoupling of offline and online procedures, the proposed reduced order method serves as a non-intrusive tool that can achieve fast simulations independent of input parameters. Rigorous theoretical analyses are provided and extensive numerical experiments for linear and nonlinear stochastic flows are provided to verify the superior performance of the proposed method.

physics, mathematical,computer science, interdisciplinary applications
Combined space-time reduced-order model with 3D deep convolution for extrapolating fluid dynamics

Indu Kant Deo,Rui Gao,Rajeev Jaiman

DOI: https://doi.org/10.48550/arXiv.2211.00307

2022-11-01

Abstract:There is a critical need for efficient and reliable active flow control strategies to reduce drag and noise in aerospace and marine engineering applications. While traditional full-order models based on the Navier-Stokes equations are not feasible, advanced model reduction techniques can be inefficient for active control tasks, especially with strong non-linearity and convection-dominated phenomena. Using convolutional recurrent autoencoder network architectures, deep learning-based reduced-order models have been recently shown to be effective while performing several orders of magnitude faster than full-order simulations. However, these models encounter significant challenges outside the training data, limiting their effectiveness for active control and optimization tasks. In this study, we aim to improve the extrapolation capability by modifying network architecture and integrating coupled space-time physics as an implicit bias. Reduced-order models via deep learning generally employ decoupling in spatial and temporal dimensions, which can introduce modeling and approximation errors. To alleviate these errors, we propose a novel technique for learning coupled spatial-temporal correlation using a 3D convolution network. We assess the proposed technique against a standard encoder-propagator-decoder model and demonstrate a superior extrapolation performance. To demonstrate the effectiveness of 3D convolution network, we consider a benchmark problem of the flow past a circular cylinder at laminar flow conditions and use the spatio-temporal snapshots from the full-order simulations. Our proposed 3D convolution architecture accurately captures the velocity and pressure fields for varying Reynolds numbers. Compared to the standard encoder-propagator-decoder network, the spatio-temporal-based 3D convolution network improves the prediction range of Reynolds numbers outside of the training data.

Fluid Dynamics,Machine Learning
Data-driven reduced order model with temporal convolutional neural network

Pin Wu,Junwu Sun,Xuting Chang,Wenjie Zhang,Rossella Arcucci,Yike Guo,Christopher C. Pain

DOI: https://doi.org/10.1016/j.cma.2019.112766

IF: 6.588

2020-03-01

Computer Methods in Applied Mechanics and Engineering

Abstract:This paper presents a novel model reduction method based on proper orthogonal decomposition and temporal convolutional neural network. The method generates basis functions of the flow field by proper orthogonal decomposition, and the coefficients are taken as the low-dimensional features. Temporal convolutional neural network is used to construct the model for predicting low-dimensional features. In this work, the training data are obtained from high fidelity numerical simulation. Compared with recurrent networks, temporal convolutional neural network is more effective with fewer parameters. The model reduction method developed here depends only on the solution of flow field. The performance of the new reduced order model is evaluated using numerical case: flow past a cylinder. Experimental results illustrate that time cost is reduced by three orders of magnitude, and convolutional architecture is beneficial to construct reduced order model. The speed-up ratio is linear with the computational scale of the numerical simulation.

mechanics,engineering, multidisciplinary,mathematics, interdisciplinary applications
Deep neural networks for nonlinear model order reduction of unsteady flows

Hamidreza Eivazi,Hadi Veisi,Mohammad Hossein Naderi,Vahid Esfahanian

DOI: https://doi.org/10.1063/5.0020526

IF: 4.6

2020-10-01

Physics of Fluids

Abstract:Unsteady fluid systems are nonlinear high-dimensional dynamical systems that may exhibit multiple complex phenomena in both time and space. Reduced Order Modeling (ROM) of fluid flows has been an active research topic in the recent decade with the primary goal to decompose complex flows into a set of features most important for future state prediction and control, typically using a dimensionality reduction technique. In this work, a novel data-driven technique based on the power of deep neural networks for ROM of the unsteady fluid flows is introduced. An autoencoder network is used for nonlinear dimension reduction and feature extraction as an alternative for singular value decomposition (SVD). Then, the extracted features are used as an input for a long short-term memory (LSTM) network to predict the velocity field at future time instances. The proposed autoencoder-LSTM method is compared with non-intrusive reduced order models based on dynamic mode decomposition (DMD) and proper orthogonal decomposition. Moreover, an autoencoder-DMD algorithm is introduced for ROM, which uses the autoencoder network for dimensionality reduction rather than SVD rank truncation. The results show that the autoencoder-LSTM method is considerably capable of predicting fluid flow evolution, where higher values for the coefficient of determination R2 are obtained using autoencoder-LSTM compared to other models.

mechanics,physics, fluids & plasmas
Combined space–time reduced-order model with three-dimensional deep convolution for extrapolating fluid dynamics

Indu Kant Deo,Rui Gao,Rajeev Jaiman

DOI: https://doi.org/10.1063/5.0145071

IF: 4.6

2023-04-08

Physics of Fluids

Abstract:There is a critical need for efficient and reliable active flow control strategies to reduce drag and noise in aerospace and marine engineering applications. While traditional full-order models based on the Navier–Stokes equations are not feasible, advanced model reduction techniques can be inefficient for active control tasks, especially with strong non-linearity and convection-dominated phenomena. Using convolutional recurrent autoencoder network architectures, deep-learning-based reduced-order models have been recently shown to be effective while performing several orders of magnitude faster than full-order simulations. However, these models encounter significant challenges outside the training data, limiting their effectiveness for active control and optimization tasks. In this study, we aim to improve the extrapolation capability by modifying the network architecture and integrating coupled space–time physics as an implicit bias. Reduced-order models via deep learning generally employ decoupling in spatial and temporal dimensions, which can introduce modeling and approximation errors. To alleviate these errors, we propose a novel technique for learning coupled spatial–temporal correlation using a three-dimensional convolution network. We assess the proposed technique against a standard encoder–propagator–decoder model and demonstrate a superior extrapolation performance. To demonstrate the effectiveness of the three-dimensional convolution network, we consider a benchmark problem of the flow past a circular cylinder at laminar flow conditions and use the spatiotemporal snapshots from the full-order simulations. Our proposed three-dimensional convolution architecture accurately captures the velocity and pressure fields for varying Reynolds numbers. Compared to the standard encoder–propagator–decoder network, the spatiotemporal-based three-dimensional convolution network improves the prediction range of Reynolds numbers outside of the training data.

mechanics,physics, fluids & plasmas
Data-driven reduced order modeling of environmental hydrodynamics using deep autoencoders and neural ODEs

Sourav Dutta,Peter Rivera-Casillas,Orie M. Cecil,Matthew W. Farthing,Emma Perracchione,Mario Putti

DOI: https://doi.org/10.48550/arXiv.2107.02784

2021-07-07

Abstract:Model reduction for fluid flow simulation continues to be of great interest across a number of scientific and engineering fields. In a previous work [<a class="link-https" data-arxiv-id="2104.13962" href="https://arxiv.org/abs/2104.13962">arXiv:2104.13962</a>], we explored the use of Neural Ordinary Differential Equations (NODE) as a non-intrusive method for propagating the latent-space dynamics in reduced order models. Here, we investigate employing deep autoencoders for discovering the reduced basis representation, the dynamics of which are then approximated by NODE. The ability of deep autoencoders to represent the latent-space is compared to the traditional proper orthogonal decomposition (POD) approach, again in conjunction with NODE for capturing the dynamics. Additionally, we compare their behavior with two classical non-intrusive methods based on POD and radial basis function interpolation as well as dynamic mode decomposition. The test problems we consider include incompressible flow around a cylinder as well as a real-world application of shallow water hydrodynamics in an estuarine system. Our findings indicate that deep autoencoders can leverage nonlinear manifold learning to achieve a highly efficient compression of spatial information and define a latent-space that appears to be more suitable for capturing the temporal dynamics through the NODE framework.

Machine Learning
Non-Intrusive Reduced-Order Modeling Using Uncertainty-Aware Deep Neural Networks and Proper Orthogonal Decomposition: Application to Flood Modeling

Pierre Jacquier,Azzedine Abdedou,Vincent Delmas,Azzeddine Soulaimani

DOI: https://doi.org/10.1016/j.jcp.2020.109854

2020-09-30

Abstract:Deep Learning research is advancing at a fantastic rate, and there is much to gain from transferring this knowledge to older fields like Computational Fluid Dynamics in practical engineering contexts. This work compares state-of-the-art methods that address uncertainty quantification in Deep Neural Networks, pushing forward the reduced-order modeling approach of Proper Orthogonal Decomposition-Neural Networks (POD-NN) with Deep Ensembles and Variational Inference-based Bayesian Neural Networks on two-dimensional problems in space. These are first tested on benchmark problems, and then applied to a real-life application: flooding predictions in the Mille Îles river in the Montreal, Quebec, Canada metropolitan area. Our setup involves a set of input parameters, with a potentially noisy distribution, and accumulates the simulation data resulting from these parameters. The goal is to build a non-intrusive surrogate model that is able to know when it does not know, which is still an open research area in Neural Networks (and in AI in general). With the help of this model, probabilistic flooding maps are generated, aware of the model uncertainty. These insights on the unknown are also utilized for an uncertainty propagation task, allowing for flooded area predictions that are broader and safer than those made with a regular uncertainty-uninformed surrogate model. Our study of the time-dependent and highly nonlinear case of a dam break is also presented. Both the ensembles and the Bayesian approach lead to reliable results for multiple smooth physical solutions, providing the correct warning when going out-of-distribution. However, the former, referred to as POD-EnsNN, proved much easier to implement and showed greater flexibility than the latter in the case of discontinuities, where standard algorithms may oscillate or fail to converge.

Computational Physics,Data Analysis, Statistics and Probability
Deep Convolutional Recurrent Autoencoders for Flow Field Prediction

Sandeep R. Bukka,Allan Ross Magee,Rajeev K. Jaiman

DOI: https://doi.org/10.1115/omae2020-18556

2020-08-03

Abstract:Abstract In this paper, an end-to-end nonlinear model reduction methodology is presented based on the convolutional recurrent autoencoder networks. The methodology is developed in the context of overall data-driven reduced order model framework proposed in the paper. The basic idea behind the methodology is to obtain the low dimensional representations via convolutional neural networks and evolve these low dimensional features via recurrent neural networks in time domain. The high dimensional representations are constructed from the evolved low dimensional features via transpose convolutional neural networks. With an unsupervised training strategy, the model serves as an end to end tool which can evolve the flow state of the nonlinear dynamical system. The convolutional recurrent autoencoder network model is applied on the problem of flow past bluff bodies for the first time. To demonstrate the effectiveness of the methodology, two canonical problems namely the flow past plain cylinder and the flow past side-by-side cylinders are explored in this paper. Pressure and velocity fields of the unsteady flow are predicted in future via the convolutional recurrent autoencoder model. The performance of the model is satisfactory for both the problems. Specifically, the multiscale nature and the gap flow dynamics of the side-by-side cylinders are captured by the proposed data-driven model reduction methodology. The error metrics, the normalized squared error and the normalized reconstruction error are considered for the assessment of the data-driven framework.
Non-intrusive reduced order modeling of natural convection in porous media using convolutional autoencoders: comparison with linear subspace techniques

T. Kadeethum,F. Ballarin,Y. Choi,D. O'Malley,H. Yoon,N. Bouklas

DOI: https://doi.org/10.1016/j.advwatres.2021.104098

2021-07-29

Abstract:Natural convection in porous media is a highly nonlinear multiphysical problem relevant to many engineering applications (e.g., the process of $\mathrm{CO_2}$ sequestration). Here, we present a non-intrusive reduced order model of natural convection in porous media employing deep convolutional autoencoders for the compression and reconstruction and either radial basis function (RBF) interpolation or artificial neural networks (ANNs) for mapping parameters of partial differential equations (PDEs) on the corresponding nonlinear manifolds. To benchmark our approach, we also describe linear compression and reconstruction processes relying on proper orthogonal decomposition (POD) and ANNs. We present comprehensive comparisons among different models through three benchmark problems. The reduced order models, linear and nonlinear approaches, are much faster than the finite element model, obtaining a maximum speed-up of $7 \times 10^{6}$ because our framework is not bound by the Courant-Friedrichs-Lewy condition; hence, it could deliver quantities of interest at any given time contrary to the finite element model. Our model's accuracy still lies within a mean squared error of 0.07 (two-order of magnitude lower than the maximum value of the finite element results) in the worst-case scenario. We illustrate that, in specific settings, the nonlinear approach outperforms its linear counterpart and vice versa. We hypothesize that a visual comparison between principal component analysis (PCA) or t-Distributed Stochastic Neighbor Embedding (t-SNE) could indicate which method will perform better prior to employing any specific compression strategy.

Computational Engineering, Finance, and Science,Machine Learning,Numerical Analysis
Deep-learning assisted reduced order model for high-dimensional flow prediction from sparse data

Jiaxin Wu,Dunhui Xiao,Min Luo

DOI: https://doi.org/10.1063/5.0166114

2023-06-22

Abstract:The reconstruction and prediction of full-state flows from sparse data are of great scientific and engineering significance yet remain challenging, especially in applications where data are sparse and/or subjected to noise. To this end, this study proposes a deep-learning assisted non-intrusive reduced order model (named DCDMD) for high-dimensional flow prediction from sparse data. Based on the compressed sensing (CS)-Dynamic Mode Decomposition (DMD), the DCDMD model is distinguished by two novelties. Firstly, a sparse matrix is defined to overcome the strict random distribution condition of sensor locations in CS, thus allowing flexible sensor deployments and requiring very few sensors. Secondly, a deep-learning-based proxy is invoked to acquire coherent flow modes from the sparse data of high-dimensional flows, thereby addressing the issue of defining sparsity and the stringent incoherence condition in the conventional CSDMD. The two advantageous features, combined with the fact that the model retains flow physics in the online stage, lead to significant enhancements in accuracy and efficiency, as well as superior insensitivity to data noises (i.e., robustness), in both reconstruction and prediction of full-state flows. These are demonstrated by three benchmark examples, i.e., cylinder wake, weekly-mean sea surface temperature and isotropic turbulence in a periodic square area.

Fluid Dynamics
Modelling spatiotemporal turbulent dynamics with the convolutional autoencoder echo state network

Alberto Racca,Nguyen Anh Khoa Doan,Luca Magri

DOI: https://doi.org/10.48550/arXiv.2211.11379

IF: 0.673

2022-11-21

Fluid Dynamics

Abstract:The spatiotemporal dynamics of turbulent flows is chaotic and difficult to predict. This makes the design of accurate and stable reduced-order models challenging. The overarching objective of this paper is to propose a nonlinear decomposition of the turbulent state for a reduced-order representation of the dynamics. We divide the turbulent flow into a spatial problem and a temporal problem. First, we compute the latent space, which is the manifold onto which the turbulent dynamics live (i.e., it is a numerical approximation of the turbulent attractor). The latent space is found by a series of nonlinear filtering operations, which are performed by a convolutional autoencoder (CAE). The CAE provides the decomposition in space. Second, we predict the time evolution of the turbulent state in the latent space, which is performed by an echo state network (ESN). The ESN provides the decomposition in time. Third, by assembling the CAE and the ESN, we obtain an autonomous dynamical system: the convolutional autoncoder echo state network (CAE-ESN). This is the reduced-order model of the turbulent flow. We test the CAE-ESN on a two-dimensional flow. We show that, after training, the CAE-ESN (i) finds a latent-space representation of the turbulent flow that has less than 1% of the degrees of freedom than the physical space; (ii) time-accurately and statistically predicts the flow in both quasiperiodic and turbulent regimes; (iii) is robust for different flow regimes (Reynolds numbers); and (iv) takes less than 1% of computational time to predict the turbulent flow than solving the governing equations. This work opens up new possibilities for nonlinear decompositions and reduced-order modelling of turbulent flows from data.
Reduced-Order Flood Modeling Using Uncertainty-Aware Deep Neural Networks

Pierre Jacquier,Azzedine Abdedou,Azzeddine Soulaïmani

DOI: https://doi.org/10.5194/egusphere-egu2020-3726

2020-03-23

Abstract:Key Words: Uncertainty Quantification, Deep Learning, Space-Time POD, Flood Modeling While impressive results have been achieved in the well-known fields where Deep Learning allowed for breakthroughs such as computer vision, language modeling, or content generation [1], its impact on different, older fields is still vastly unexplored. In computational fluid dynamics and especially in Flood Modeling, many phenomena are very high-dimensional, and predictions require the use of finite element or volume methods, which can be, while very robust and tested, computational-heavy and may not prove useful in the context of real-time predictions. This led to various attempts at developing Reduced-Order Modeling techniques, both intrusive and non-intrusive. One late relevant addition was a combination of Proper Orthogonal Decomposition with Deep Neural Networks (POD-NN) [2]. Yet, to our knowledge, in this example and more generally in the field, little work has been conducted on quantifying uncertainties through the surrogate model. In this work, we aim at comparing different novel methods addressing uncertainty quantification in reduced-order models, pushing forward the POD-NN concept with ensembles, latent-variable models, as well as encoder-decoder models. These are tested on benchmark problems, and then applied to a real-life application: flooding predictions in the Mille-Iles river in Laval, QC, Canada. For the flood modeling application, our setup involves a set of input parameters resulting from onsite measures. High-fidelity solutions are then generated using our own finite-volume code CuteFlow, which is solving the highly nonlinear Shallow Water Equations. The goal is then to build a non-intrusive surrogate model, that&#8217;s able to know what it knows, and more importantly, know when it doesn&#8217;t, which is still an open research area as far as neural networks are concerned [3]. REFERENCES [1] C. Szegedy, S. Ioffe, V. Vanhoucke, and A. A. Alemi, &#8220;Inception-v4, inception-resnet and the impact of residual connections on learning&#8221;, in Thirty-First AAAI Conference on Artificial Intelligence, 2017. [2] Q. Wang, J. S. Hesthaven, and D. Ray, &#8220;Non-intrusive reduced order modeling of unsteady flows using artificial neural networks with application to a combustion problem&#8221;, Journal of Computational Physics, vol. 384, pp. 289&#8211;307, May 2019. [3] B. Lakshminarayanan, A. Pritzel, and C. Blundell, &#8220;Simple and scalable predictive uncertainty estimation using deep ensembles&#8221;, in Advances in Neural Information Processing Systems, 2017, pp. 6402&#8211;6413.
Data-driven reduced order modeling for parametrized time-dependent flow problems

Zhengxiao Ma,Jian Yu,Ruoye Xiao

DOI: https://doi.org/10.1063/5.0098122

IF: 4.6

2022-07-06

Physics of Fluids

Abstract:Physics of Fluids, Volume 34, Issue 7, July 2022. This paper proposes a nonintrusive reduced basis (RB) method based on dynamic mode decomposition (DMD) for parameterized time-dependent flows. In the offline stage, the reduced basis functions are extracted by a two-step proper orthogonal decomposition algorithm. Then, a novel hybrid DMD regression model that combines windowed DMD and optimized DMD is introduced for the temporal evolution of the RB coefficients. To improve the stability of this method for complex nonlinear problems, we introduce a threshold value to modify the DMD eigenvalues and eigenvectors. Moreover, the interpolation of the coefficients in parameter space is conducted by a feedforward neural network or random forest algorithm. The prediction of the RB solution at a new time/parameter value can be recovered at a low computational cost in the online stage, which is completely decoupled from the high-fidelity dimension. We demonstrate the performance of the proposed model with two cases: (i) laminar flow past a two-dimensional cylinder and (ii) turbulent flow around a three-dimensional SD7003 airfoil. The results show reasonable efficiency and robustness of this novel reduced-order model.

mechanics,physics, fluids & plasmas
A non-intrusive reduced-order modelling for uncertainty propagation of time-dependent problems using a B-splines Bézier elements-based method and Proper Orthogonal Decomposition: application to dam-break flows

Azzedine Abdedou,Azzeddine Soulaïmani

DOI: https://doi.org/10.48550/arXiv.2105.09300

2021-05-16

Abstract:A proper orthogonal decomposition-based B-splines Bézier elements method (POD-BSBEM) is proposed as a non-intrusive reduced-order model for uncertainty propagation analysis for stochastic time-dependent problems. The method uses a two-step proper orthogonal decomposition (POD) technique to extract the reduced basis from a collection of high-fidelity solutions called snapshots. A third POD level is then applied on the data of the projection coefficients associated with the reduced basis to separate the time-dependent modes from the stochastic parametrized coefficients. These are approximated in the stochastic parameter space using B-splines basis functions defined in the corresponding Bézier element. The accuracy and the efficiency of the proposed method are assessed using benchmark steady-state and time-dependent problems and compared to the reduced order model-based artificial neural network (POD-ANN) and to the full-order model-based polynomial chaos expansion (Full-PCE). The POD-BSBEM is then applied to analyze the uncertainty propagation through a flood wave flow stemming from a hypothetical dam-break in a river with a complex bathymetry. The results confirm the ability of the POD-BSBEM to accurately predict the statistical moments of the output quantities of interest with a substantial speed-up for both offline and online stages compared to other techniques.

Numerical Analysis,Computational Engineering, Finance, and Science
Reduced-order Deep Learning for Flow Dynamics

Min Wang,Siu Wun Cheung,Wing Tat Leung,Eric T. Chung,Yalchin Efendiev,Mary Wheeler

DOI: https://doi.org/10.48550/arXiv.1901.10343

2019-01-30

Abstract:In this paper, we investigate neural networks applied to multiscale simulations and discuss a design of a novel deep neural network model reduction approach for multiscale problems. Due to the multiscale nature of the medium, the fine-grid resolution gives rise to a huge number of degrees of freedom. In practice, low-order models are derived to reduce the computational cost. In our paper, we use a non-local multicontinuum (NLMC) approach, which represents the solution on a coarse grid [18]. Using multi-layer learning techniques, we formulate and learn input-output maps constructed with NLMC on a coarse grid. We study the features of the coarse-grid solutions that neural networks capture via relating the input-output optimization to $l_1$ minimization of PDE solutions. In proposed multi-layer networks, we can learn the forward operators in a reduced way without computing them as in POD like approaches. We present soft thresholding operators as activation function, which our studies show to have some advantages. With these activation functions, the neural network identifies and selects important multiscale features which are crucial in modeling the underlying flow. Using trained neural network approximation of the input-output map, we construct a reduced-order model for the solution approximation. We use multi-layer networks for the time stepping and reduced-order modeling, where at each time step the appropriate important modes are selected. For a class of nonlinear problems, we suggest an efficient strategy. Numerical examples are presented to examine the performance of our method.

Numerical Analysis
Non-intrusive inference reduced order model for fluids using linear multistep neural network

Xuping Xie,Guannan Zhang,Clayton G. Webster

DOI: https://doi.org/10.48550/arXiv.1809.07820

2018-12-04

Abstract:In this effort we propose a data-driven learning framework for reduced order modeling of fluid dynamics. Designing accurate and efficient reduced order models for nonlinear fluid dynamic problems is challenging for many practical engineering applications. Classical projection-based model reduction methods generate reduced systems by projecting full-order differential operators into low-dimensional subspaces. However, these techniques usually lead to severe instabilities in the presence of highly nonlinear dynamics, which dramatically deteriorates the accuracy of the reduced-order models. In contrast, our new framework exploits linear multistep networks, based on implicit Adams-Moulton schemes, to construct the reduced system. The advantage is that the method optimally approximates the full order model in the low-dimensional space with a given supervised learning task. Moreover, our approach is non-intrusive, such that it can be applied to other complex nonlinear dynamical systems with sophisticated legacy codes. We demonstrate the performance of our method through the numerical simulation of a two-dimensional flow past a circular cylinder with Reynolds number Re = 100. The results reveal that the new data-driven model is significantly more accurate than standard projection-based approaches.

Computational Physics,Fluid Dynamics
Reduced-order modeling of unsteady fluid flow using neural network ensembles

Rakesh Halder,Mohammadmehdi Ataei,Hesam Salehipour,Krzysztof Fidkowski,Kevin Maki

DOI: https://doi.org/10.1063/5.0207978

2024-08-09

Abstract:The use of deep learning has become increasingly popular in reduced-order models (ROMs) to obtain low-dimensional representations of full-order models. Convolutional autoencoders (CAEs) are often used to this end as they are adept at handling data that are spatially distributed, including solutions to partial differential equations. When applied to unsteady physics problems, ROMs also require a model for time-series prediction of the low-dimensional latent variables. Long short-term memory (LSTM) networks, a type of recurrent neural network useful for modeling sequential data, are frequently employed in data-driven ROMs for autoregressive time-series prediction. When making predictions at unseen design points over long time horizons, error propagation is a frequently encountered issue, where errors made early on can compound over time and lead to large inaccuracies. In this work, we propose using bagging, a commonly used ensemble learning technique, to develop a fully data-driven ROM framework referred to as the CAE-eLSTM ROM that uses CAEs for spatial reconstruction of the full-order model and LSTM ensembles for time-series prediction. When applied to two unsteady fluid dynamics problems, our results show that the presented framework effectively reduces error propagation and leads to more accurate time-series prediction of latent variables at unseen points.

Fluid Dynamics,Machine Learning
Reduced order modeling of dynamical systems using artificial neural networks applied to water circulation

Alberto Costa Nogueira Jr,João Lucas de Sousa Almeida,Guillaume Auger,Campbell D. Watson

DOI: https://doi.org/10.1007/978-3-030-59851-8_8

2021-02-18

Abstract:General circulation models are essential tools in weather and hydrodynamic simulation. They solve discretized, complex physical equations in order to compute evolutionary states of dynamical systems, such as the hydrodynamics of a lake. However, high-resolution numerical solutions using such models are extremely computational and time consuming, often requiring a high performance computing architecture to be executed satisfactorily. Machine learning (ML)-based low-dimensional surrogate models are a promising alternative to speed up these simulations without undermining the quality of predictions. In this work, we develop two examples of fast, reliable, low-dimensional surrogate models to produce a 36 hour forecast of the depth-averaged hydrodynamics at Lake George NY, USA. Our ML approach uses two widespread artificial neural network (ANN) architectures: fully connected neural networks and long short-term memory. These ANN architectures are first validated in the deterministic and chaotic regimes of the Lorenz system and then combined with proper orthogonal decomposition (to reduce the dimensionality of the incoming input data) to emulate the depth-averaged hydrodynamics of a flow simulator called SUNTANS. Results show the ANN-based reduced order models have promising accuracy levels (within 6% of the prediction range) and advocate for further investigation into hydrodynamic applications.

Atmospheric and Oceanic Physics,Fluid Dynamics
Non-intrusive Surrogate Modeling for Parametrized Time-dependent PDEs using Convolutional Autoencoders

Stefanos Nikolopoulos,Ioannis Kalogeris,Vissarion Papadopoulos

DOI: https://doi.org/10.48550/arXiv.2101.05555

2021-04-23

Abstract:This work presents a non-intrusive surrogate modeling scheme based on machine learning technology for predictive modeling of complex systems, described by parametrized time-dependent PDEs. For these problems, typical finite element approaches involve the spatiotemporal discretization of the PDE and the solution of the corresponding linear system of equations at each time step. Instead, the proposed method utilizes a convolutional autoencoder in conjunction with a feed forward neural network to establish a low-cost and accurate mapping from the problem's parametric space to its solution space. For this purpose, time history response data are collected by solving the high-fidelity model via FEM for a reduced set of parameter values. Then, by applying the convolutional autoencoder to this data set, a low-dimensional representation of the high-dimensional solution matrices is provided by the encoder, while the reconstruction map is obtained by the decoder. Using the latent representation given by the encoder, a feed-forward neural network is efficiently trained to map points from the problem's parametric space to the compressed version of the respective solution matrices. This way, the encoded response of the system at new parameter values is given by the neural network, while the entire response is delivered by the decoder. This approach effectively bypasses the need to serially formulate and solve the system's governing equations at each time increment, thus resulting in a significant cost reduction and rendering the method ideal for problems requiring repeated model evaluations or 'real-time' computations. The elaborated methodology is demonstrated on the stochastic analysis of time-dependent PDEs solved with the Monte Carlo method, however, it can be straightforwardly applied to other similar-type problems, such as sensitivity analysis, design optimization, etc.

Numerical Analysis,Artificial Intelligence,Machine Learning
Reduced-order Model for Fluid Flows via Neural Ordinary Differential Equations

Carlos J.G. Rojas,Andreas Dengel,Mateus Dias Ribeiro

DOI: https://doi.org/10.48550/arXiv.2102.02248

2021-02-20

Abstract:Reduced order models play an important role in the design, optimization and control of dynamical systems. In recent years, there has been an increasing interest in the application of data-driven techniques for model reduction that can decrease the computational burden of numerical solutions, while preserving the most important features of complex physical problems. In this paper, we use the proper orthogonal decomposition to reduce the dimensionality of the model and introduce a novel generative neural ODE (NODE) architecture to forecast the behavior of the temporal coefficients. With this methodology, we replace the classical Galerkin projection with an architecture characterized by the use of a continuous latent space. We exemplify the methodology on the dynamics of the Von Karman vortex street of the flow past a cylinder generated by a Large-eddy Simulation (LES)-based code. We compare the NODE methodology with an LSTM baseline to assess the extrapolation capabilities of the generative model and present some qualitative evaluations of the flow reconstructions.

Fluid Dynamics,Computational Physics

Solubilization and characterization of the insect neuronal sodium channel

A deep learning based reduced order modeling for stochastic underground flow problems

Combined space-time reduced-order model with 3D deep convolution for extrapolating fluid dynamics

Data-driven reduced order model with temporal convolutional neural network

Deep neural networks for nonlinear model order reduction of unsteady flows

Combined space–time reduced-order model with three-dimensional deep convolution for extrapolating fluid dynamics

Data-driven reduced order modeling of environmental hydrodynamics using deep autoencoders and neural ODEs

Non-Intrusive Reduced-Order Modeling Using Uncertainty-Aware Deep Neural Networks and Proper Orthogonal Decomposition: Application to Flood Modeling

Deep Convolutional Recurrent Autoencoders for Flow Field Prediction

Non-intrusive reduced order modeling of natural convection in porous media using convolutional autoencoders: comparison with linear subspace techniques

Deep-learning assisted reduced order model for high-dimensional flow prediction from sparse data

Modelling spatiotemporal turbulent dynamics with the convolutional autoencoder echo state network

Reduced-Order Flood Modeling Using Uncertainty-Aware Deep Neural Networks

Data-driven reduced order modeling for parametrized time-dependent flow problems

A non-intrusive reduced-order modelling for uncertainty propagation of time-dependent problems using a B-splines Bézier elements-based method and Proper Orthogonal Decomposition: application to dam-break flows

Reduced-order Deep Learning for Flow Dynamics

Non-intrusive inference reduced order model for fluids using linear multistep neural network

Reduced-order modeling of unsteady fluid flow using neural network ensembles

Reduced order modeling of dynamical systems using artificial neural networks applied to water circulation

Non-intrusive Surrogate Modeling for Parametrized Time-dependent PDEs using Convolutional Autoencoders

Reduced-order Model for Fluid Flows via Neural Ordinary Differential Equations