A Comparative Study for Non-rigid Image Registration and Rigid Image Registration

Xiaoran Zhang,Hexiang Dong,Di Gao,Xiao Zhao

DOI: https://doi.org/10.48550/arXiv.2001.03831

2020-01-12

Abstract:Image registration algorithms can be generally categorized into two groups: non-rigid and rigid. Recently, many deep learning-based algorithms employ a neural net to characterize non-rigid image registration function. However, do they always perform better? In this study, we compare the state-of-art deep learning-based non-rigid registration approach with rigid registration approach. The data is generated from Kaggle Dog vs Cat Competition \url{<a class="link-external link-https" href="https://www.kaggle.com/c/dogs-vs-cats/" rel="external noopener nofollow">this https URL</a>} and we test the algorithms' performance on rigid transformation including translation, rotation, scaling, shearing and pixelwise non-rigid transformation. The Voxelmorph is trained on rigidset and nonrigidset separately for comparison and we also add a gaussian blur layer to its original architecture to improve registration performance. The best quantitative results in both root-mean-square error (RMSE) and mean absolute error (MAE) metrics for rigid registration are produced by SimpleElastix and non-rigid registration by Voxelmorph. We select representative samples for visual assessment.

Computer Vision and Pattern Recognition,Image and Video Processing

What problem does this paper attempt to address?

The problem that this paper attempts to solve is to evaluate and compare the performance of rigid image registration and non - rigid image registration methods under different transformation types, especially whether deep - learning methods are always superior to traditional methods. Specifically, the author focuses on the following points:

1. **Evaluating the superiority of deep - learning methods**: In recent years, many deep - learning - based algorithms have been used for non - rigid image registration, but whether these methods are always superior to traditional rigid registration methods has not been fully verified. Therefore, the author hopes to answer this question by comparing the two.

2. **Comparing rigid and non - rigid transformations**: The author focuses not only on rigid transformations (such as translation, rotation, scaling, shearing, etc.), but also on pixel - level non - rigid transformations. In this way, a comprehensive understanding of the performance of different methods in handling different types of transformations can be obtained.

3. **Dataset generation and testing**: In order to make a fair comparison, the author used the dataset from the Kaggle Dog vs Cat competition and generated fixed images through the Spatial Transformer Network. This can ensure the consistency and repeatability of the test data.

4. **Improving the Voxelmorph model**: The author improved the existing Voxelmorph model by adding a Gaussian blur layer to improve the quality of the registration results, especially in rigid transformation tasks.

5. **Quantitative and qualitative evaluation**: By calculating the root - mean - square error (RMSE) and the mean - absolute - error (MAE), as well as visual evaluation, the author comprehensively evaluated the performance of different methods.

### Main contributions

- Generated training and test data using the dataset from the Kaggle Dog vs Cat competition.
- Reproduced and improved the Voxelmorph model, and improved the registration results by adding a Gaussian blur layer.
- Compared several state - of - the - art rigid and non - rigid registration methods, including SimpleElastix, ORB and intensity - based registration methods.

### Conclusions

Through experiments, the author found that:
- In rigid transformation tasks, SimpleElastix performs the best.
- In pixel - level non - rigid transformation tasks, Voxelmorph(RN) (Voxelmorph trained with a rigid dataset) achieved the best results.
- Adding a Gaussian blur layer significantly improved the performance of Voxelmorph in some tasks.

Overall, this study shows that deep - learning methods are not always superior to traditional methods and provides valuable references for future research.