Abstract:For over a decade, machine learning (ML) models have been making strides in computer vision and natural language processing (NLP), demonstrating high proficiency in specialized tasks. The emergence of large-scale language and generative image models, such as ChatGPT and Stable Diffusion, has significantly broadened the accessibility and application scope of these technologies. Traditional predictive models are typically constrained to mapping input data to numerical values or predefined categories, limiting their usefulness beyond their designated tasks. In contrast, contemporary models employ representation learning and generative modeling, enabling them to extract and encode key insights from a wide variety of data sources and decode them to create novel responses for desired goals. They can interpret queries phrased in natural language to deduce the intended output. In parallel, the application of ML techniques in materials science has advanced considerably, particularly in areas like inverse design, material prediction, and atomic modeling. Despite these advancements, the current models are overly specialized, hindering their potential to supplant established industrial processes. Materials science, therefore, necessitates the creation of a comprehensive, versatile model capable of interpreting human-readable inputs, intuiting a wide range of possible search directions, and delivering precise solutions. To realize such a model, the field must adopt cutting-edge representation, generative, and foundation model techniques tailored to materials science. A pivotal component in this endeavor is the establishment of an extensive, centralized dataset encompassing a broad spectrum of research topics. This dataset could be assembled by crowdsourcing global research contributions and developing models to extract data from existing literature and represent them in a homogenous format. A massive dataset can be used to train a central model that learns the underlying physics of the target areas, which can then be connected to a variety of specialized downstream tasks. Ultimately, the envisioned model would empower users to intuitively pose queries for a wide array of desired outcomes. It would facilitate the search for existing data that closely matches the sought-after solutions and leverage its understanding of physics and material-behavior relationships to innovate new solutions when pre-existing ones fall short.

Physical model material identification method based on progressive function enhancement network

Material State Identification of the Conveyor Belt Based on Inception-v4

Automatic coloring method for three-dimensional model based on reinforcement learning

A Deep Learning Method for Material Performance Recognition in Laser Additive Manufacturing

Improving direct physical properties prediction of heterogeneous materials from imaging data via convolutional neural network and a morphology-aware generative model

MaterialSeg3D: Segmenting Dense Materials from 2D Priors for 3D Assets

Study on 3D Clothing Color Application Based on Deep Learning-Enabled Macro-Micro Adversarial Network and Human Body Modeling

Center-environment feature models for materials image segmentation based on machine learning

Material Fingerprinting: Identifying and Predicting Perceptual Attributes of Material Appearance

Mining Sufficient Knowledge via Progressive Feature Fusion for Efficient Material Recognition

MDD-Net: A novel defect detection model of material microscope image

A deep material network for multiscale topology learning and accelerated nonlinear modeling of heterogeneous materials

Material Identification System with Sound Simulation Assisted Method in VR/AR Scenarios.

Photo-to-Shape Material Transfer for Diverse Structures

A Deep Learning Labeling Method for Material Microstructure Image Segmentation

Gathering Effective Information for Real-Time Material Recognition

High Fidelity Virtual Try-on Network Via Semantic Adaptation and Distributed Componentization

Adaptive Residual Convolutional Neural Network for Compressive Strength Prediction of Energetic Materials Using SEM Images

Point cloud enhancement optimization and high-fidelity texture reconstruction methods for air material via fusion of 3D scanning and neural rendering

A material acquisition method and system based on neural network

Advancing materials science through next-generation machine learning