Features Combined Binary Descriptor Based on Voted Ring-Sampling Pattern

Hongmin Liu,Qianqian Zhang,Bin Fan,Zhiheng Wang,Junwei Han

DOI: https://doi.org/10.1109/tcsvt.2019.2943595

IF: 5.859

2020-10-01

IEEE Transactions on Circuits and Systems for Video Technology

Abstract:Most existing binary descriptors are only based on intensity and simply compare averaged intensities of one sample pair to obtain binary output. To address this issue, we propose a novel ring-sampling pattern based binary descriptor encoding both intensity and gradient. For intensity coding, a ring-sampling pattern is presented to define a number of sample points and their neighboring points given an interest point. The intensity difference between two sample points is obtained by performing the comparisons of the intensities of their corresponding neighboring points directly. Further, a majority based voting strategy is employed to obtain compact representation (1 bit or 3 bits) based on all these intensity difference among neighboring points. As for gradient coding, the gradient orientation histogram is computed for each sample point, and the gradient difference of two sample points is obtained by comparing the gradient magnitude on each orientation bin. The raw binary descriptor is constructed by concentrating the intensity and gradient differences of all the sample pairs, and two feature selection strategies are proposed to obtain the final compact descriptor, named as Features Combined Binary Descriptor based on Voted Ring-Sampling Pattern (BDVRP). The experimental results on the tasks of object recognition and image matching demonstrate the superiority and the effectiveness of the proposed descriptor, with comparison to the state-of-the-art hand-crafted binary descriptors.

engineering, electrical & electronic

What problem does this paper attempt to address?

The problem this paper attempts to address is the poor performance of existing binary descriptors in image feature matching. Specifically, most existing binary descriptors are based solely on intensity information and obtain binary outputs by simply comparing the average intensities of sample pairs. This method provides limited information and has poor robustness to image transformations such as blurring, JPEG compression, and lighting changes.

To tackle these issues, the paper proposes a new binary descriptor based on a circular sampling pattern that encodes both intensity and gradient information. The main contributions include:

1. **Circular Sampling Pattern**: A dense circular sampling pattern is proposed, which obtains intensity binary tests by directly comparing the intensities of neighboring points around the sample points, rather than comparing the average intensities around two sample points. This pattern provides more discriminative information and avoids time-consuming smoothing operations.
2. **Majority Voting Strategy**: A majority voting strategy is employed to convert the long binary strings representing intensity tests into 1-bit or 3-bit values, making the descriptor more compact and improving robustness to image transformations, especially blurring and JPEG compression.
3. **Incorporating Gradient Information**: By comparing the gradient differences in the histogram of gradient directions of two sample points, gradient information is also encoded into the descriptor, further enhancing its discriminative power.

With these improvements, the proposed descriptor demonstrates superiority and effectiveness in object recognition and image matching tasks, outperforming existing handcrafted binary descriptors.