Augmentation Policy Generation for Image Classification Using Large Language Models

Ant Duru,Alptekin Temizel

2024-10-17

Abstract:Automated data augmentation methods have significantly improved the performance and generalization capability of deep learning models in image classification. Yet, most state-of-the-art methods are optimized on common benchmark datasets, limiting their applicability to more diverse or domain-specific data, such as medical datasets. In this paper, we propose a strategy that uses large language models to automatically generate efficient augmentation policies, customized to fit the specific characteristics of any dataset and model architecture. The proposed method iteratively interacts with an LLM to obtain and refine the augmentation policies on model performance feedback, creating a dataset-agnostic data augmentation pipeline. The proposed method was evaluated on medical imaging datasets, showing a clear improvement over state-of-the-art methods. The proposed approach offers an adaptive and scalable solution. Although it increases computational cost, it significantly boosts model robustness, automates the process, and minimizes the need for human involvement during model development.

Computer Vision and Pattern Recognition

What problem does this paper attempt to address?

The problem that this paper attempts to solve is: Most of the existing automated data augmentation methods are optimized for common benchmark datasets, which restricts their application in more diverse or specific fields (such as medical image datasets). Therefore, these methods are difficult to adapt to the unique characteristics of different datasets, especially in cases where domain - specific knowledge is required.

To solve this problem, the author proposes a new strategy, which uses large - language models (LLM) to automatically generate efficient data augmentation strategies. This method, through iterative interactions with LLM, continuously optimizes the augmentation strategy based on model performance feedback, thereby creating an adaptive data augmentation pipeline that matches the characteristics of the dataset and the model architecture. Specifically, the goals of this method are:

1. **Improve the generalization ability of the model**: By generating customized augmentation strategies, make deep - learning models perform better in image classification tasks.
2. **Reduce human intervention**: Automate the process of generating and optimizing augmentation strategies, reducing the need for manual selection and adjustment.
3. **Adapt to multiple data types**: Provide a general - purpose data augmentation solution that is applicable to various types of datasets without the need for specific adjustments for each dataset.

Through this method, the author hopes to significantly improve the performance of the model on different medical image datasets and demonstrate its advantages over the existing state - of - the - art methods.