Abstract:Faced with the problem of incompatibility between traditional information acquisition mode and spaceborne earth observation tasks, starting from the general mathematical model of compressed sensing, a theoretical model of block compressed sensing was established, and a full-process adaptive coding and decoding compressed sensing framework for remote sensing images was proposed, which includes five parts: mode selection, feature factor extraction, adaptive shape segmentation, adaptive sampling rate allocation and image reconstruction. Unlike previous semi-adaptive or local adaptive methods, the advantages of the adaptive encoding and decoding method proposed in this paper are mainly reflected in four aspects: (1) Ability to select encoding modes based on image content, and maximizing the use of the richness of the image to select appropriate sampling methods; (2) Capable of utilizing image texture details for adaptive segmentation, effectively separating complex and smooth regions; (3) Being able to detect the sparsity of encoding blocks and adaptively allocate sampling rates to fully explore the compressibility of images; (4) The reconstruction matrix can be adaptively selected based on the size of the encoding block to alleviate block artifacts caused by non-stationary characteristics of the image. Experimental results show that the method proposed in this article has good stability for remote sensing images with complex edge textures, with the peak signal-to-noise ratio and structural similarity remaining above 35 dB and 0.8. Moreover, especially for ocean images with relatively simple image content, when the sampling rate is 0.26, the peak signal-to-noise ratio reaches 50.8 dB, and the structural similarity is 0.99. In addition, the recovered images have the smallest BRISQUE value, with better clarity and less distortion. In the subjective aspect, the reconstructed image has clear edge details and good reconstruction effect, while the block effect is effectively suppressed. The framework designed in this paper is superior to similar algorithms in both subjective visual and objective evaluation indexes, which is of great significance for alleviating the incompatibility between traditional information acquisition methods and satellite-borne earth observation missions.
environmental sciences,imaging science & photographic technology,remote sensing,geosciences, multidisciplinary
What problem does this paper attempt to address?
### Problems Addressed by the Paper
The paper primarily addresses the incompatibility between traditional information retrieval methods and spaceborne Earth observation missions, proposing a novel fully adaptive encoding-decoding compressed sensing framework.
#### Specific Problems
1. **Limitations of Traditional Compressed Sensing Methods**:
- Traditional compressed sensing methods observe and reconstruct remote sensing images as a whole, requiring a large amount of storage space to store the measurement matrix and increasing the difficulty of reconstruction.
- Block Compressed Sensing (BCS) alleviates the high storage and computational complexity issues through independent measurement and non-overlapping block recovery. However, it mostly adopts uniform segmentation and fixed sampling rates, ignoring the different characteristics of texture distribution in different parts of the image.
2. **Image Reconstruction Quality at Low Sampling Rates**:
- When using the same observation matrix for sampling measurements, the non-stationary characteristics of the image may lead to block artifacts, especially at lower sampling rates. This results in too many sampling points in smooth areas and too few in texture-rich areas, thereby affecting the image reconstruction quality.
#### Solutions
To address the above issues, the paper proposes a fully adaptive encoding-decoding compressed sensing framework, which includes the following aspects:
1. **Mode Selection Phase**:
- The OTSU method is designed to calculate the optimal threshold between background and target pixels, and adaptively select the image processing mode (complex mode and simple mode) based on the optimal threshold.
2. **Feature Factor Extraction Phase**:
- A saliency model based on edge roughness is established, using Robert and Prewitt operators to describe global feature saliency expression, and constructing corresponding saliency models under complex and simple modes.
3. **Adaptive Morphological Segmentation Phase**:
- The idea of image quadtree segmentation is introduced. Based on the set maximum and minimum coding blocks (CB), feature saliency factors are used as constraints, and a top-down segmentation strategy is adopted to recursively divide the image space into different hierarchical tree structures.
4. **Adaptive Sampling Rate Allocation Phase**:
- An image sparsity judgment criterion is developed. According to the different information densities between different coding blocks, sparsity is adaptively set as the information density function of a given coding block, and the sampling rate is adaptively allocated.
5. **Adaptive Image Reconstruction Phase**:
- An Adaptive Block Compressed Orthogonal Matching Pursuit (ABCS-OMP) algorithm is proposed. It adaptively selects the reconstruction matrix and sparse basis according to the type of coding block, sets the iterative threshold based on known sparsity, and uses the OMP algorithm to reconstruct the coding block.
The framework performs well in experimental results, especially in remote sensing images with complex edge textures, maintaining high levels of Peak Signal-to-Noise Ratio (PSNR) and Structural Similarity Index (SSIM). For relatively simple image content such as ocean images, it can also achieve high PSNR and SSIM at lower sampling rates. Additionally, the restored images have the minimum BRISQUE value, higher clarity, and less distortion. Overall, the framework outperforms similar algorithms in both subjective visual and objective evaluation metrics, significantly alleviating the incompatibility between traditional information retrieval methods and satellite-borne Earth observation missions.