Abstract:The computer-aided diagnosis (CAD) system can provide a reference basis for the clinical diagnosis of skin diseases. Convolutional neural networks (CNNs) can not only extract visual elements such as colors and shapes but also semantic features. As such they have made great improvements in many tasks of dermoscopy images. The imaging of dermoscopy has no principal orientation, indicating that there are a large number of skin lesion rotations in the datasets. However, CNNs lack rotation invariance, which is bound to affect the robustness of CNNs against rotations. To tackle this issue, we propose a rotation meanout (RM) network to extract rotation-invariant features from dermoscopy images. In RM, each set of rotated feature maps corresponds to a set of outputs of the weight-sharing convolutions and they are fused using meanout strategy to obtain the final feature maps. Through theoretical derivation, the proposed RM network is rotation-equivariant and can extract rotation-invariant features when followed by the global average pooling (GAP) operation. The extracted rotation-invariant features can better represent the original data in classification and retrieval tasks for dermoscopy images. The RM is a general operation, which does not change the network structure or increase any parameters, and can be flexibly embedded in any part of CNNs. Extensive experiments are conducted on a dermoscopy image dataset. The results show that our method outperforms other anti-rotation methods and achieves great improvements in skin disease classification and retrieval tasks, indicating the potential of rotation invariance in the field of dermoscopy images.

Deep Rotation Equivariant Network

Direction-Sensitivity Features Ensemble Network for Rotation-Invariant Face Detection.

Rotation equivariant vector field networks

RINet: Efficient 3D Lidar-Based Place Recognition Using Rotation Invariant Neural Network

Equivariance-bridged SO(2)-Invariant Representation Learning using Graph Convolutional Network

Rotation Equivariance and Invariance in Convolutional Neural Networks

Rotation-Invariant Feature Learning Via Convolutional Neural Network with Cyclic Polar Coordinates Convolutional Layer

Polar Coordinate Convolutional Neural Network: from Rotation-Invariance to Translation-Invariance

RRL:Regional Rotation Layer in Convolutional Neural Networks

Rotation-Equivariant Deep Learning for Diffusion MRI

Rotation-Invariant Deep Embedding for Remote Sensing Images

Achieving Rotation Invariance in Convolution Operations: Shifting from Data-Driven to Mechanism-Assured

Harmonic Networks: Deep Translation and Rotation Equivariance

Rethinking Local-to-global Representation Learning for Rotation-Invariant Point Cloud Analysis

Discrete Rotation Equivariance for Point Cloud Recognition

On Representation of 3D Rotation in the Context of Deep Learning

Efficient Rotation Invariance in Deep Neural Networks through Artificial Mental Rotation

A rotation meanout network with invariance for dermoscopy image classification and retrieval

Rotation-Invariant Feature Learning for Object Detection in VHR Optical Remote Sensing Images by Double-Net

Rotation Invariance Neural Network

Efficient Equivariant Network