Multi-Teacher Multi-Objective Meta-Learning for Zero-Shot Hyperspectral Band Selection

Jie Feng,Xiaojian Zhong,Di Li,Weisheng Dong,Ronghua Shang,Licheng Jiao
2024-06-12
Abstract:Band selection plays a crucial role in hyperspectral image classification by removing redundant and noisy bands and retaining discriminative ones. However, most existing deep learning-based methods are aimed at dealing with a specific band selection dataset, and need to retrain parameters for new datasets, which significantly limits their <a class="link-external link-http" href="http://generalizability.To" rel="external noopener nofollow">this http URL</a> address this issue, a novel multi-teacher multi-objective meta-learning network (M$^3$BS) is proposed for zero-shot hyperspectral band selection. In M$^3$BS, a generalizable graph convolution network (GCN) is constructed to generate dataset-agnostic base, and extract compatible meta-knowledge from multiple band selection tasks. To enhance the ability of meta-knowledge extraction, multiple band selection teachers are introduced to provide diverse high-quality experiences.strategy Finally, subsequent classification tasks are attached and jointly optimized with multi-teacher band selection tasks through multi-objective meta-learning in an end-to-end trainable way. Multi-objective meta-learning guarantees to coordinate diverse optimization objectives automatically and adapt to various datasets simultaneously. Once the optimization is accomplished, the acquired meta-knowledge can be directly transferred to unseen datasets without any retraining or fine-tuning. Experimental results demonstrate the effectiveness and efficiency of our proposed method on par with state-of-the-art baselines for zero-shot hyperspectral band selection.
Computer Vision and Pattern Recognition
What problem does this paper attempt to address?
The problem that this paper attempts to solve is the insufficient generalization ability of existing deep - learning methods in hyperspectral band selection. Specifically, most of the existing deep - learning - based methods can only handle specific band - selection datasets, and need to retrain model parameters when encountering new datasets, which greatly limits their versatility. To solve this problem, the paper proposes a new multi - teacher multi - objective meta - learning network (M3BS) for zero - shot hyperspectral band selection. By introducing the multi - teacher strategy and the multi - objective meta - learning framework, M3BS aims to extract dataset - independent meta - knowledge, so as to achieve direct transfer application to unseen datasets without any retraining or fine - tuning. ### Main Contributions 1. **General - purpose GCN**: A generalizable graph convolution network (GCN) is constructed, which can extract consistent meta - knowledge from different datasets, enabling M3BS to perform hyperspectral band selection in zero - shot situations. 2. **Multi - teacher diversity integration**: By introducing multiple representative and reliable teacher models, additional supervision signals are provided, enhancing the generalization ability and adaptability of M3BS to unseen samples in zero - shot learning. 3. **Multi - objective meta - learning optimization**: A multi - objective meta - learning framework is adopted to automatically coordinate multiple optimization objectives and improve multiple band - selection tasks from multiple datasets simultaneously, so that the obtained meta - knowledge can be directly transferred from seen samples to unseen samples. ### Method Overview 1. **Spatial - spectral general - purpose GCN**: A spatial - spectral graph structure is constructed, representing the bands of the hyperspectral image and their spatial and spectral relationships as vertices and edges of the graph. The dataset - independent basic features are extracted through GCN and decomposed into learnable dataset - independent bases and dataset - specific coefficients. 2. **CNN classifier**: A CNN - based classifier is attached to evaluate the effect of the selected band combinations and output the classification probability distribution. 3. **Multi - teacher diversity integration**: Multiple teacher models are introduced to provide diverse high - quality experiences to enhance the ability of meta - knowledge extraction. 4. **Multi - objective meta - learning optimization**: Through the uncertainty - based multi - objective meta - learning process, the band - selection and classification tasks are jointly optimized to ensure that the model has good generalization ability. In conclusion, this paper aims to improve the generalization ability of the hyperspectral band - selection model through the multi - teacher multi - objective meta - learning framework, enabling it to be directly applied to unseen datasets without retraining or fine - tuning.