Abstract:Recurrent Neural Networks (RNNs) have emerged as an interesting alternative to conventional material modeling approaches, particularly for nonlinear path dependent materials. Remarkable computational enhancements are obtained using RNNs compared to classical approaches such as the computational homogenization method. However, RNN predictive errors accumulate, leading to issues when predicting temporal dependencies in time series data. This study aims to address and mitigate inaccuracies induced by neural networks in predicting path dependent plastic deformations of short fiber reinforced composite materials. We propose using an approach of Test Time data Augmentation (TTA), which, to the best of the authors knowledge, is previously untested in the context of RNNs. The method is based on augmenting the input test data using random rotations and subsequently rotating back the predicted output signal. By aggregating the back rotated predictions, a more accurate prediction compared to individual predictions is obtained. Our analysis also demonstrates improved shape consistency between the prediction and the target pseudo time signal. Additionally, this method provides an uncertainty estimation which correlates with the absolute prediction error. The TTA approach is reproducible with different randomly generated data augmentations, establishing a promising framework for optimizing predictions of deep learning models. We believe there are broader implications of the proposed method for various fields reliant on accurate predictive data driven modeling.

What problem does this paper attempt to address?

### What problems does this paper attempt to solve? This paper aims to solve the inaccuracy problems that occur when using Recurrent Neural Networks (RNNs) to predict the path - dependent plastic deformation of Short - Fiber Reinforced Composites (SFRCs). Specifically, the paper focuses on the following key issues: 1. **Accumulation of RNN prediction errors**: In time - series data, the prediction errors of RNNs will accumulate as the time step increases, resulting in a larger deviation between the prediction results and the actual values. 2. **Accurate prediction of path - dependent plastic behavior**: For non - linear path - dependent materials, such as short - fiber - reinforced composites, existing methods are difficult to accurately capture their complex mechanical behaviors. Especially when the stress is close to zero, the prediction results often contain a large amount of noise. 3. **Insufficient uncertainty estimation**: Existing RNN models lack reliable uncertainty estimation, which limits their reliability in practical applications. To solve the above problems, the authors propose a Test - Time Data Augmentation (TTA) method. TTA obtains more accurate prediction results by randomly rotating the input test data during the inference stage and rotating the predicted output signal back to the original coordinate system. In addition, TTA can also provide uncertainty estimation related to the absolute prediction error. #### Overview of specific methods - **Data augmentation**: Generate multiple different input configurations by randomly rotating the input data. - **Multi - prediction aggregation**: Send each rotated input into the RNN model to obtain multiple prediction results and rotate these prediction results back to the original coordinate system. - **Result aggregation**: Reduce the noise and error in a single prediction and improve the prediction accuracy by taking the average of multiple prediction results. - **Uncertainty estimation**: Quantify the uncertainty of prediction by calculating the standard deviation of multiple prediction results. This method not only improves the prediction accuracy of the RNN model but also provides reliable uncertainty estimation, making the model more robust and reliable when dealing with complex material behaviors.

Test-time data augmentation: improving predictions of recurrent neural network models of composites

Augmentation of scarce data -- a new approach for deep-learning modeling of composites

Augmentation of scarce data—A new approach for deep-learning modeling of composites

Machine Learning and Materials Informatics Approaches for Predicting Transverse Mechanical Properties of Unidirectional CFRP Composites with Microvoids

Recurrent neural networks and transfer learning for elasto-plasticity in woven composites

A micromechanics-based recurrent neural networks model for path-dependent cyclic deformation of short fiber composites

Predicting the Strength of Composites with Computer Vision Using Small Experimental Datasets

Applying neural networks to analyse the properties and structure of composite materials

Transfer learning for enhancing the homogenization-theory-based prediction of elasto-plastic response of particle/fiber-reinforced composites

Anomaly Detection with Test Time Augmentation and Consistency Evaluation

Combining transfer learning and statistical measures to predict performance of composite materials with limited data

Enhanced prediction of transverse mechanical behavior of unidirectional fiber-reinforced composites using new spatial descriptors based on deep neural networks

Ensemble Augmentation for Deep Neural Networks Using 1-D Time Series Vibration Data

Deep neural networks based predictive-generative framework for designing composite materials

Predicting the material behavior of recycled composites: Experimental analysis and deep learning hybrid approach

Physically recurrent neural networks for path-dependent heterogeneous materials: embedding constitutive models in a data-driven surrogate

Neural network-based prediction of the long-term time-dependent mechanical behavior of laminated composite plates with arbitrary hygrothermal effects

Optimal pre-train/fine-tune strategies for accurate material property predictions

Predicting Mechanical Properties from Microstructure Images in Fiber-reinforced Polymers using Convolutional Neural Networks

TTVD: Towards a Geometric Framework for Test-Time Adaptation Based on Voronoi Diagram

Test-Time Augmentation Meets Variational Bayes