Max-Normalized Radon Cumulative Distribution Transform for Limited Data Classification

Matthias Beckmann,Robert Beinert,Jonas Bresch
2024-11-25
Abstract:The Radon cumulative distribution transform (R-CDT) exploits one-dimensional Wasserstein transport and the Radon transform to represent prominent features in images. It is closely related to the sliced Wasserstein distance and facilitates classification tasks, especially in the small data regime, like the recognition of watermarks in filigranology. Here, a typical issue is that the given data may be subject to affine transformations caused by the measuring process. The aim of this paper is to make the R-CDT and the related sliced Wasserstein distance invariant under affine transformations. For this, we propose a two-step normalization of the R-CDT and prove that our novel transform allows linear separation of affinely transformed image classes. The theoretical results are supported by numerical experiments showing a significant increase of the classification accuracy compared to the original R-CDT.
Numerical Analysis,Information Theory
What problem does this paper attempt to address?
The main problem that this paper attempts to solve is to make the Radon Cumulative Distribution Transform (R - CDT) and the related Sliced Wasserstein Distance invariant to affine transformations in the limited - data classification task. Specifically: 1. **Background problems**: - In image classification tasks, especially in the case of small datasets, R - CDT and Sliced Wasserstein Distance have been proven to be effective feature representation methods. - However, these methods perform poorly when dealing with images that have undergone affine transformations (such as translation, rotation, scaling, etc.), because these transformations will change the feature representation of the images. 2. **Research motivation**: - The motivation of the paper comes from the application in watermark recognition, especially in the field of filigranology. Watermark recognition is very important for the dating and author identification of historical manuscripts. - The main problem in automated classification is the large number of categories and the small number of samples in each category, and there are other affine transformation problems caused by non - standardized recording methods. 3. **Research objectives**: - Propose a new method to make R - CDT and Sliced Wasserstein Distance invariant to affine transformations. - Achieve this goal by introducing the Maximum - Normalized Radon Cumulative Distribution Transform (mNR - CDT). 4. **Solutions**: - The paper proposes a two - step normalization scheme. By normalizing R - CDT, it is made invariant to affine transformations. - The specific steps include: 1. **First - step normalization**: Ensure that the R - CDT projection has zero mean and unit standard deviation. 2. **Second - step normalization**: Deal with the re - ordering problem by taking the maximum value in all directions and define mNR - CDT. 5. **Theoretical and experimental verification**: - Theoretically, the paper proves that mNR - CDT can make the affine - transformed image classes linearly separable (Theorem 1). - The experimental results show that, compared with the original R - CDT, mNR - CDT has a significant improvement in classification accuracy on small datasets. In summary, this paper aims to improve the R - CDT method so that it can better cope with the challenges brought by affine transformations, thereby enhancing the performance of image classification tasks (especially in the case of small datasets).