Remote Sensing Image Coding for Machines on Semantic Segmentation via Contrastive Learning
Junxi Zhang,Zhenzhong Chen,Shan Liu
DOI: https://doi.org/10.1109/tgrs.2024.3479190
IF: 8.2
2024-11-01
IEEE Transactions on Geoscience and Remote Sensing
Abstract:Due to the huge data volume of high-resolution remote sensing imagery (RSI) and limited transmission bandwidth, RSIs are typically compressed for efficient transmission and storage. However, most of the existing compression algorithms are developed based on optimizing for the human perceptual that are not suitable for remote sensing image applications where RSIs are usually used for machine interpretation tasks, such as semantic segmentation for ground–object recognition. In this article, we propose an image coding for machines (ICMs) paradigm based on contrastive learning in a fully supervised manner to boost semantic segmentation of compressed RSIs. Specifically, we build an end-to-end compression framework to make full use of the global semantic information by clustering intracategory projected embeddings and spacing intercategory embeddings apart, to compensate for the loss of feature discriminability during the compression process and reconstruct the decision boundaries between different categories. Compared to the state-of-the-art image compression methods, our proposed method significantly improves the performance of semantic segmentation on the remote sensing labeling benchmark datasets.
imaging science & photographic technology,remote sensing,engineering, electrical & electronic,geochemistry & geophysics