Abstract:The recognition and classification of the diversity of materials that exist in the environment around us are a key visual competence that computer vision systems focus on in recent years. Understanding the identification of materials in distinct images involves a deep process that has made usage of the recent progress in neural networks which has brought the potential to train architectures to extract features for this challenging task. This project uses state-of-the-art Convolutional Neural Network (CNN) techniques and Support Vector Machine (SVM) classifiers in order to classify materials and analyze the results. Building on various widely used material databases collected, a selection of CNN architectures is evaluated to understand which is the best approach to extract features in order to achieve outstanding results for the task. The results gathered over four material datasets and nine CNNs outline that the best overall performance of a CNN using a linear SVM can achieve up to ~92.5% mean average precision, while applying a new relevant direction in computer vision, transfer learning. By limiting the amount of information extracted from the layer before the last fully connected layer, transfer learning aims at analyzing the contribution of shading information and reflectance to identify which main characteristics decide the material category the image belongs to. In addition to the main topic of my project, the evaluation of the nine different CNN architectures, it is questioned if, by using the transfer learning instead of extracting the information from the last convolutional layer, the total accuracy of the system created improves. The results of the comparison emphasize the fact that the accuracy and performance of the system improve, especially in the datasets which consist of a large number of images.

Integrating Deep Features for Material Recognition

Gathering Effective Information for Real-Time Material Recognition

An Evaluation of Convolutional Neural Networks on Material Recognition

Ensemble Feature Learning for Material Recognition with Convolutional Neural Networks

Deep Dilated Convolutional Network for Material Recognition

Mining Sufficient Knowledge via Progressive Feature Fusion for Efficient Material Recognition

Deep Learning for Material recognition: most recent advances and open challenges

Integrating Local Material Recognition with Large-Scale Perceptual Attribute Discovery

Learning Multi-Scale Representations for Material Classification

A Noise-robust Feature Fusion Model Combining Non-local Attention for Material Recognition.

A Deep Learning Method for Material Performance Recognition in Laser Additive Manufacturing

Material Classification using Neural Networks

Transfer Learning for Material Classification using Convolutional Networks

Material Recognition from Local Appearance in Global Context

Multi-View Learning for Material Classification

Integration of Deep Learning with Vibration-Based Identification Method

Multi-modal broad learning for material recognition

Material recognition in the wild with the Materials in Context Database

Deep convolutional filter banks for texture recognition and segmentation

Deep Convolutional Neural Networks Applied to Ultrasonic Images for Material Texture Recognition

Single-ToF-camera-based Material Identification Using Depth and Intensity Data Fusion