Abstract:Material attributes have been shown to provide a discriminative intermediate representation for recognizing materials, especially for the challenging task of recognition from local material appearance (i.e., regardless of object and scene context). In the past, however, material attributes have been recognized separately preceding category recognition. In contrast, neuroscience studies on material perception and computer vision research on object and place recognition have shown that attributes are produced as a by-product during the category recognition process. Does the same hold true for material attribute and category recognition? In this paper, we introduce a novel material category recognition network architecture to show that perceptual attributes can, in fact, be automatically discovered inside a local material recognition framework. The novel material-attribute-category convolutional neural network (MAC-CNN) produces perceptual material attributes from the intermediate pooling layers of an end-to-end trained category recognition network using an auxiliary loss function that encodes human material perception. To train this model, we introduce a novel large-scale database of local material appearance organized under a canonical material category taxonomy and careful image patch extraction that avoids unwanted object and scene context. We show that the discovered attributes correspond well with semantically-meaningful visual material traits via Boolean algebra, and enable recognition of previously unseen material categories given only a few examples. These results have strong implications in how perceptually meaningful attributes can be learned in other recognition tasks.

Discovering localized attributes for fine-grained recognition

Attribute-correlated Local Regions for Deep Relative Attributes Learning

Learning Predictable And Discriminative Attributes For Visual Recognition

Learning Concise and Descriptive Attributes for Visual Recognition

Learning Regions and Descriptors for Fine-grained Recognition

Fine-Grained Recognition Via Attribute-Guided Attentive Feature Aggregation

Robust Attribute-Based Visual Recognition Using Discriminative Latent Representation.

Fine-Grained Imag E Categorization by Localizing Tiny Object Parts from Unannotated Images

Appearance-based Complex-Attributes Learning for Fine-Grained Recognition

Extracting Effective Image Attributes with Refined Universal Detection

Fine-Grained Image Categorization by Localizing TinyObject Parts from Unannotated Images

Integrating Local Material Recognition with Large-Scale Perceptual Attribute Discovery

Selective Parts For Fine-Grained Recognition

Picking Neural Activations for Fine-Grained Recognition

Discovering Attribute Shades of Meaning with the Crowd

Human Attribute Recognition by Rich Appearance Dictionary

Rethinking Attribute Localization for Zero-Shot Learning

Pose-Based Discriminative-Attributes Learning for Fine-Grained Recognition

Attributes-Guided and Pure-Visual Attention Alignment for Few-Shot Recognition

Deep Attributes from Context-Aware Regional Neural Codes

Face Attribute Recognition Via End-to-end Weakly Supervised Regional Location