On the mechanisms and putative pathways involving neuroimmune interactions.

J. Haddad

DOI: https://doi.org/10.1016/j.bbrc.2008.04.012

2008-06-13

Abstract:

What problem does this paper attempt to address?

Unsupervised person re‐identification based on adaptive information supplementation and foreground enhancement

Qiang Wang,Zhihong Huang,Huijie Fan,Shengpeng Fu,Yandong Tang

DOI: https://doi.org/10.1049/ipr2.13277

IF: 2.3

2024-11-26

IET Image Processing

Abstract:We design an adaptive foreground enhancement module (AFEM), which can adaptively enhance the foreground pedestrian features of the input features, obtain more discriminative features, enhance the clustering effect and more accurate pseudo labels. We propose an adaptive information supplement (AIS) method that can adaptively supplement global features with finer‐grained local information to obtain features that are better suited for person re‐identification and effectively reduce the noise of pseudo‐labels. Unsupervised person re‐identification has attracted vital interest because of its ability to protect privacy, significantly lower the expense of manual annotation, and eliminate the need for data labels. General unsupervised methods train the network only through global features, which causes the fine‐grained information contained in local features to be ignored in the recognition process, resulting in large amounts of label noise and affecting the recognition accuracy. Moreover, more robust pedestrian features can also improve the accuracy of clustering and enable unsupervised person re‐identification to obtain better results. To address these issues, first, a dual‐branch structure was proposed, which separately obtains the global features of the pedestrian and the local features by dividing the global features into a few equal sections. Then, an adaptive information supplementation (AIS) method based on the k‐nearest neighbor algorithm is designed to ascertain each local feature's relevance to the global features, calculating adaptive weight scores for information supplementation. Finally, these weight scores are used to reallocate the weights of the global features in each part, acquiring features that contain more pedestrian information during the representation learning process. These better features are used to reduce label noise to obtain more accurate pseudo‐labels. Second, an adaptive foreground enhancement module (AFEM) was proposed and inserted before clustering to increase the robustness of pedestrian features, which increases the precision of the pseudo‐labels that are produced after clustering. Experiments on Market‐1501, DukeMTMC‐reID, and MSMT17 demonstrate that the proposed method achieves better results than state‐of‐the‐art methods in fully unsupervised person re‐identification tasks.

computer science, artificial intelligence,engineering, electrical & electronic,imaging science & photographic technology
Dual Attention Matching Network for Context-Aware Feature Sequence based Person Re-Identification

Jianlou Si,Honggang Zhang,Chun-Guang Li,Jason Kuen,Xiangfei Kong,Alex C. Kot,Gang Wang

DOI: https://doi.org/10.1109/CVPR.2018.00562

2018-01-01

Abstract: Typical person re-identification (ReID) methods usually describe each pedestrian with a single feature vector and match them in a task-specific metric space. However, the methods based on a single feature vector are not sufficient enough to overcome visual ambiguity, which frequently occurs in real scenario. In this paper, we propose a novel end-to-end trainable framework, called Dual ATtention Matching network (DuATM), to learn context-aware feature sequences and perform attentive sequence comparison simultaneously. The core component of our DuATM framework is a dual attention mechanism, in which both intra-sequence and inter-sequence attention strategies are used for feature refinement and feature-pair alignment, respectively. Thus, detailed visual cues contained in the intermediate feature sequences can be automatically exploited and properly compared. We train the proposed DuATM network as a siamese network via a triplet loss assisted with a de-correlation loss and a cross-entropy loss. We conduct extensive experiments on both image and video based ReID benchmark datasets. Experimental results demonstrate the significant advantages of our approach compared to the state-of-the-art methods.
Unleashing Potential of Unsupervised Pre-Training with Intra-Identity Regularization for Person Re-Identification

Zizheng Yang,Xin Jin,Kecheng Zheng,Feng Zhao

DOI: https://doi.org/10.1109/cvpr52688.2022.01390

2022-01-01

Abstract:Existing person reidentification (ReID) methods typically load the pretrained ImageNet weights for initialization directly. However, as a fine-grained classification task, ReID is more challenging and there exists a large domain gap between ImageNet classification. Inspired by the great success of self-supervised representation learning with contrastive objectives, in this paper, we design an Unsupervised Pretraining framework for reidentification (UP-ReID) based on the contrastive learning (CL) pipeline. During the pre-training, we attempt to address two critical issues for learning fine-grained ReID features: (1) the augmentations in the CL pipeline usually distort the discriminative clues in person images, and (2) the fine-grained local features of person images are not fully-explored. Therefore, we introduce an intra-identity (1 2 -) regularization in the UP-ReID, which is instantiated as two constraints coming from the global image and local patch aspects, respectively. A global consistency constraint is enforced between augmented and original person images to increase robustness to augmentation, while an intrinsic contrastive constraint among local patches of each image is employed to fully explore the local discriminative clues. Extensive experiments on multiple popular reid datasets, PersonX, Market1501, CUHK03, and MSMT17, demonstrate that our UP-ReID pretrained model can significantly benefit the downstream ReID fine-tuning and achieve state-of-the-art performance.
Fully Unsupervised Person Re-identification viaSelective Contrastive Learning

Bo Pang,Deming Zhai,Junjun Jiang,Xianming Liu

DOI: https://doi.org/10.48550/arXiv.2010.07608

2021-03-04

Abstract:Person re-identification (ReID) aims at searching the same identity person among images captured by various cameras. Unsupervised person ReID attracts a lot of attention recently, due to it works without intensive manual annotation and thus shows great potential of adapting to new conditions. Representation learning plays a critical role in unsupervised person ReID. In this work, we propose a novel selective contrastive learning framework for unsupervised feature learning. Specifically, different from traditional contrastive learning strategies, we propose to use multiple positives and adaptively sampled negatives for defining the contrastive loss, enabling to learn a feature embedding model with stronger identity discriminative representation. Moreover, we propose to jointly leverage global and local features to construct three dynamic dictionaries, among which the global and local memory banks are used for pairwise similarity computation and the mixture memory bank are used for contrastive loss definition. Experimental results demonstrate the superiority of our method in unsupervised person ReID compared with the state-of-the-arts.

Computer Vision and Pattern Recognition
A Novel Attention-Driven Framework for Unsupervised Pedestrian Re-identification with Clustering Optimization

Xuan Wang,Zhaojie Sun,Abdellah Chehri,Gwanggil Jeon,Yongchao Song

DOI: https://doi.org/10.1016/j.patcog.2023.110045

IF: 8

2023-10-22

Pattern Recognition

Abstract:Unsupervised pedestrian re-identification (re-ID) is not merely a visual recognition task; it represents a significant sub-field within the domain of pattern recognition. Despite the remarkable success of Convolutional Neural Networks (CNN) in re-ID, they still face challenges in handling variations in pose, occlusion, and lighting conditions. To effectively tackle these challenges, it is imperative to prioritize implementing efficient sampling strategies. We propose a Novel Attention-Driven Framework for Unsupervised Pedestrian re-ID with Clustering Optimization (AFC) to address the above issues. First, we introduce a new attention mechanism that enhances multi-scale spatial attention and reduces the number of trainable parameters. Then, we employed a straightforward and effective method of group sampling. In addition, we apply a clustering consensus approach to estimate pseudo-label similarity in continuous training and use temporal propagation and ensembles to improve pseudo-labels. Extensive experiments on Market-1501, duketmc-reID and MSMT17 datasets show that our method achieves significant performance improvement in unsupervised pedestrian re-ID, which provides important theoretical and practical value for the research on deep fusion of pattern recognition field with pedestrian re-ID and promotes the further development of the related fields.

computer science, artificial intelligence,engineering, electrical & electronic
Unsupervised Joint Contrastive Learning for Aerial Person Re-Identification and Remote Sensing Image Classification

Guoqing Zhang,Jiqiang Li,Zhonglin Ye

DOI: https://doi.org/10.3390/rs16020422

IF: 5

2024-01-22

Remote Sensing

Abstract:Unsupervised person re-identification (Re-ID) aims to match the query image of a person with images in the gallery without the use of supervision labels. Most existing methods usually generate pseudo-labels through clustering algorithms for contrastive learning, which inevitably results in noisy labels assigned to samples. In addition, methods that only apply contrastive learning at the clustering level fail to fully consider instance-level relationships between instances. Motivated by this, we propose a joint contrastive learning (JCL) framework for unsupervised person Re-ID. Our proposed method involves creating two memory banks to store features of cluster centroids and instances and applies cluster and instance-level contrastive learning, respectively, to jointly optimize the neural networks. The cluster-level contrastive loss is used to promote feature compactness within the same cluster and reinforce identity similarity. The instance-level contrastive loss is used to distinguish easily confused samples. In addition, we use a WaveBlock attention module (WAM), which can continuously wave feature map blocks and introduce attention mechanisms to produce more robust feature representations of a person without considerable information loss. Furthermore, we enhance the quality of our clustering by leveraging camera label information to eliminate clusters containing single camera captures. Extensive experimental results on two widely used person Re-ID datasets verify the effectiveness of our JCL method. Meanwhile, we also used two remote sensing datasets to demonstrate the generalizability of our method.

environmental sciences,imaging science & photographic technology,remote sensing,geosciences, multidisciplinary
MCFR: multi-confidence contrastive learning with feature refined for unsupervised person re-identification

Wanru Peng,Houjin Chen,Yanfeng Li,Jia Sun

DOI: https://doi.org/10.1007/s00371-023-02890-2

2023-06-09

Abstract:Unsupervised person re-identification (re-ID) aims to identify the same person in unsupervised settings, which is a realistic and challenging problem due to getting rid of the dependence on annotations. Existing pseudo-label-based methods have been proved to be effective by discriminative representation learning and high-quality pseudo labels. However, there are some undesirable similarity structures in images affected by different states (e.g., backgrounds, occlusions, or other target confusions) which may generate noisy labels and lead to model degradation. To tackle the above issues, this paper analyzes the key factors for unsupervised re-ID performance from two perspectives: network structure and loss function. Specifically, we propose a multi-confidence contrastive learning with feature refinement (MCFR) model which can enhance the feature discriminative ability and meanwhile alleviate the impact of noisy data. For network architecture, a feature refined block is embedded into a multi-branch network, constructing FR-net. For loss function, a multi-confidence contrastive loss (MCCL) based on similarity and confidence relationship is developed. MCCL can flexibly update the list of hard negative samples in clusters and outliers, promoting the model by learning from confident samples. Extensive experiments including visualizations and ablation studies validate the effectiveness of each component in the MCFR model. Additionally, compared with the state-of-the-art unsupervised re-ID methods, our method achieves considerable performance on three benchmark datasets.

computer science, software engineering
An Attention-Driven Two-Stage Clustering Method for Unsupervised Person Re-identification

Zilong Ji,Xiaolong Zou,Xiaohan Lin,Xiao Liu,Tiejun Huang,Si Wu

DOI: https://doi.org/10.1007/978-3-030-58604-1_2

2020-01-01

Abstract:The progressive clustering method and its variants, which iteratively generate pseudo labels for unlabeled data and per form feature learning, have shown great process in unsupervised person re-identification (re-id). However, they have an intrinsic problem of modeling the in-camera variability of images successfully, that is, pedestrian features extracted from the same camera tend to be clustered into the same class. This often results in a non-convergent model in the real world application of clustering based re-id models, leading to degenerated performance. In the present study, we propose an attention-driven two-stage clustering (ADTC) method to solve this problem. Specifically, our method consists of two strategies. Firstly, we use an unsupervised attention kernel to shift the learned features from the image background to the pedestrian foreground, which results in more informative clusters. Secondly, to aid the learning of the attention driven clustering model, we separate the clustering process into two stages. We first use kmeans to generate the centroids of clusters (stage 1) and then apply the k-reciprocal Jaccard distance (KRJD) metric to re-assign data points to each cluster (stage 2). By iteratively learning with the two strategies, the attentive regions are gradually shifted from the background to the foreground and the features become more discriminative. Using two benchmark datasets Market1501 and DukeMTMC, we demonstrate that our model outperforms other state-of-the-art unsupervised approaches for person re-id.
Camera Contrast Learning for Unsupervised Person Re-Identification

Guoqing Zhang,Hongwei Zhang,Weisi Lin,Arun Kumar Chandran,Xuan Jing

DOI: https://doi.org/10.1109/tcsvt.2023.3240001

IF: 5.859

2023-01-01

IEEE Transactions on Circuits and Systems for Video Technology

Abstract:Unsupervised person re-identification (Re-ID) aims at finding the most informative features from unlabeled person datasets. Some recent approaches adopted camera-aware strategies for model training and have thereby achieved highly promising results. However, these methods simultaneously address intra-ID discrepancies of all cameras and require independent learning under each camera, which increases the complexity of algorithm. To resolve this issue, we present a camera contrast learning framework for unsupervised person Re-ID. Our method first proposes a time-based camera contrastive learning module to facilitate model learning. At each iteration, we follow the time contrast principle to select one camera centroid as proxy of each cluster. By enforcing the samples to converge to positive proxies, the correlation between features and cameras can gradually be reduced. Moreover, we design a 3-dimensional attention module to further reduce intra-ID discrepancies caused by background shifts. By re-weighting each feature map element in a spatial-channel order, our module can exactly find identity-invariant semantic cues from regions of interest in person images, no matter how the background change. Experimental results on several popular datasets prove that our work surpasses existing unsupervised person Re-ID approaches to a remarkable extent. The source codes can be found in https://github.com/HongweiZhang97/CCL.

engineering, electrical & electronic
Salience-Guided Cascaded Suppression Network for Person Re-identification

Xuesong Chen,Canmiao Fu,Yong Zhao,Feng Zheng,Jingkuan Song,Rongrong Ji,Yi Yang

DOI: https://doi.org/10.1109/CVPR42600.2020.00336

2020-01-01

Abstract:Employing attention mechanisms to model both global and local features as a final pedestrian representation has become a trend for person re-identification (Re-ID) algorithms. A potential limitation of these methods is that they focus on the most salient features, but the re-identification of a person may rely on diverse clues masked by the most salient features in different situations, e.g., body, clothes or even shoes. To handle this limitation, we propose a novel Salience-guided Cascaded Suppression Network (SCSN) which enables the model to mine diverse salient features and integrate these features into the final representation by a cascaded manner. Our work makes the following contributions: (i) We observe that the previously learned salient features may hinder the network from learning other important information. To tackle this limitation, we introduce a cascaded suppression strategy, which enables the network to mine diverse potential useful features that be masked by the other salient features stage-by-stage and each stage integrates different feature embedding for the last discriminative pedestrian representation. (ii) We propose a Salient Feature Extraction (SFE) unit, which can suppress the salient features learned in the previous cascaded stage and then adaptively extracts other potential salient feature to obtain different clues of pedestrians. (iii) We develop an efficient feature aggregation strategy that fully increases the network's capacity for all potential salience features. Finally, experimental results demonstrate that our proposed method outperforms the state-of-the-art methods on four large-scale datasets. Especially, our approach exceeds the current best method by over 7% on the CUHK03 dataset.
Asymmetric double networks mutual teaching for unsupervised person Re-identification

Miaohui Zhang,Kaifang Li,Jianxin Ma,Xile Wang

DOI: https://doi.org/10.1016/j.neunet.2023.11.001

Abstract:Unsupervised person re-identification (Re-ID) has always been challenging in computer vision. It has received much attention from researchers because it does not require any labeled information and can be freely deployed to new scenarios. Most unsupervised person Re-ID research studies produce and optimize pseudo-labels by iterative clustering algorithms on a single network. However, these methods are easily affected by noisy labels and feature variations caused by camera shifts, which will limit the optimization of pseudo-labels. In this paper, we propose an Asymmetric Double Networks Mutual Teaching (ADNMT) architecture that uses two asymmetric networks to generate pseudo-labels for each other by clustering, and the pseudo-labels are updated and optimized by alternate training. Specifically, ADNMT contains two asymmetric networks. One network is a multiple granularity network, which extracts pedestrian features of multiple granularity that correspond to numerous classifiers, and the other network is a conventional backbone network, which extracts pedestrian features that correspond to a classifier. Furthermore, because the camera style changes seriously affect the generalization ability of the proposed model, this paper designs Similarity Compensation of Inter-Camera (SCIC) and Similarity Suppression of Intra-Camera (SSIC) according to the camera ID of the pedestrian images to optimize the similarity measure. Extensive experiments on multiple Re-ID benchmark datasets show that our proposed method achieves superior performance compared with the state-of-the-art unsupervised person re-identification methods.
Attributes-Assisted Joint Contrastive Learning for Person Re-Identification

Qingru Wu,Zhiheng Zhou,Chang Niua,Xiaosheng Liua,Bo Lia

DOI: https://doi.org/10.1109/jiot.2024.3354822

IF: 10.6

2024-01-01

IEEE Internet of Things Journal

Abstract:Person re-identification (Re-ID) is a crucial technology for intelligent security in Internet of Things (IoT) systems. Recently, unsupervised learning has been widely used for person Re-ID due to its generalization property. However, the effectiveness of commonly used unsupervised clustering methods heavily relies on the quality of the clustered pseudo-labels. Moreover, pedestrian shots in real scenes are prone to factors such as occlusion. In this paper, we propose a novel Global and Local Joint Contrastive Learning (GLCL) framework based on the memory bank. Specifically, we establish separate memory banks for global and local features, which are updated using global simple samples and local hard samples. The GLCL module helps excavate information from simple and hard samples, aiming to overcome the effects of poor retrieval scenarios such as background clutter and occlusion. Additionally, we design an Attributes-Assisted Clustering (AAC)) module that utilizes pedestrian attributes to refine the clustering results. The AAC module can effectively reduce the impact of pseudo-label noise owing to the supplementary information offered by attributes. Our approach shows improved performance in person Re-ID tasks in complex scenarios, providing a promising solution for intelligent security systems in the IoT. Experimental results demonstrate the superiority of our proposed method.

computer science, information systems,telecommunications,engineering, electrical & electronic
Global Relation-Aware Contrast Learning for Unsupervised Person Re-Identification

Hongwei Zhang,Guoqing Zhang,Yuhao Chen,Yuhui Zheng

DOI: https://doi.org/10.1109/tcsvt.2022.3194084

IF: 5.859

2022-12-10

IEEE Transactions on Circuits and Systems for Video Technology

Abstract:The goal of unsupervised person re-identification (Re-ID) is to use unlabeled person images to learn discriminative features. In recent years, many approaches have adopted clustered pseudo labels to construct proxies for contrastive learning, and have thereby achieved great success. However, existing methods of this kind only utilize local structures within IDs to design their proxies while ignoring the relations between samples of different IDs, which limits the improvement for inter-ID discriminative ability. To resolve this issue, we propose a Global Relation-Aware Contrast Learning (GRACL) method for the task of unsupervised Re-ID. Our method first sets up two proxies for each cluster to capture the inter- and intra-ID relations respectively, which enables us to both effectively increase inter-ID variances and reduce the intra-ID discrepancies. Specifically, the samples that are most different from those in different clusters are selected as inter-ID relation-aware proxies, while those that are least similar to samples from the same clusters are employed as intra-ID relation-aware proxies. With the aid of these proxies, we design both inter- and intra-ID relation-aware contrastive learning modules to facilitate model learning. By pulling each sample close to the positive proxy, we can obtain identity-invariant discriminative features. Experiments on five widely-used Re-ID datasets prove that our GRACL model outperforms current state-of-the-art approaches to a remarkable extent.

engineering, electrical & electronic
Information complementary attention-based multidimension feature learning for person re-identification

Mingyang Wang,Hui Ma,Yiwei Huang

DOI: https://doi.org/10.1016/j.engappai.2023.106348

IF: 8

2023-05-05

Engineering Applications of Artificial Intelligence

Abstract:With the need for criminal investigation technology and the development of deep learning , the task of person re-identification has gradually become a research hotspot. Recently, various neural network-based person re-identification technologies designed by researchers have shown excellent results. However, most of the frameworks focus on complex structural design or redundant networks to guide model construction, which hugely increases the cost of train and application cost. In addition, the correlation between the channel information and spatial information on the pedestrian feature map is also relatively lacking. Therefore, we design a lightweight attention module to address the lack of correlation question response. The proposed module sequentially extracts person images' channel and spatial features and effectively associates the two kinds of information through sequential connections. The proposed attention module has a simple structure, and the parameter increase in the backbone network is tiny. We place the fuse module in each feature extraction layer to focus on the pedestrian information extracted by each layer. To solve the problem of complex model structure, we choose the residual network as the backbone network and the attention mechanism to extract person features without using pose point estimation or additional network assistance to reduce model complexity. We adjust the drop rate of the person classification layer to improve the model's generalization ability. We estimate the performance of our method on three public datasets: Market-1501, DukeMTMC-reID, and CUHK03 (both detected and labeled) demonstrate the proposed method's effectiveness and obtain highly competitive performance on the three datasets.

automation & control systems,computer science, artificial intelligence,engineering, electrical & electronic, multidisciplinary
Towards Discriminative Representation Learning for Unsupervised Person Re-identification

Takashi Isobe,Dong Li,Lu Tian,Weihua Chen,Yi Shan,Shengjin Wang

DOI: https://doi.org/10.1109/iccv48922.2021.00841

2021-01-01

Abstract:In this work, we address the problem of unsupervised domain adaptation for person re-ID where annotations are available for the source domain but not for target. Previous methods typically follow a two-stage optimization pipeline, where the network is first pre-trained on source and then fine-tuned on target with pseudo labels created by feature clustering. Such methods sustain two main limitations. (1) The label noise may hinder the learning of discriminative features for recognizing target classes. (2) The domain gap may hinder knowledge transferring from source to target. We propose three types of technical schemes to alleviate these issues. First, we propose a cluster-wise contrastive learning algorithm (CCL) by iterative optimization of feature learning and cluster refinery to learn noise-tolerant representations in the unsupervised manner. Second, we adopt a progressive domain adaptation (PDA) strategy to gradually mitigate the domain gap between source and target data. Third, we propose Fourier augmentation (FA) for further maximizing the class separability of re-ID models by imposing extra constraints in the Fourier space. We observe that these proposed schemes are capable of facilitating the learning of discriminative feature representations. Experiments demonstrate that our method consistently achieves notable improvements over the state-of-the-art unsupervised re-ID methods on multiple benchmarks, e.g., surpassing MMT largely by 8.1%, 9.9%, 11.4% and 11.1% mAP on the Market-to-Duke, Duke-to-Market, Market-to-MSMT and Duke-to-MSMT tasks, respectively.
Improving unsupervised pedestrian re‐identification with enhanced feature representation and robust clustering

Jiang Luo,Lingjun Liu

DOI: https://doi.org/10.1049/cvi2.12309

IF: 1.484

2024-08-29

IET Computer Vision

Abstract:The authors improve the robustness of multi‐granularity features by means of relational networks and convolutional neural network‐based dual branching structure. The introduction of a clustering method with discretisation measure solves the problem of inhomogeneous data distribution and cluster quality, and the application of clustering contrast learning improves the consistency of feature updating. Pedestrian re‐identification (re‐ID) is an important research direction in computer vision, with extensive applications in pattern recognition and monitoring systems. Due to uneven data distribution, and the need to solve clustering standards and similarity evaluation problems, the performance of unsupervised methods is limited. To address these issues, an improved unsupervised re‐ID method, called Enhanced Feature Representation and Robust Clustering (EFRRC), which combines EFRRC is proposed. First, a relation network that considers the relations between each part of the pedestrian's body and other parts is introduced, thereby obtaining more discriminative feature representations. The network makes the feature at the single‐part level also contain partial information of other body parts, making it more discriminative. A global contrastive pooling (GCP) module is introduced to obtain the global features of the image. Second, a dispersion‐based clustering method, which can effectively evaluate the quality of clustering and discover potential patterns in the data is designed. This approach considers a wider context of sample‐level pairwise relationships for robust cluster affinity assessment. It effectively addresses challenges posed by imbalanced data distributions in complex situations. The above structures are connected through a clustering contrastive learning framework, which not only improves the discriminative power of features and the accuracy of clustering, but also solves the problem of inconsistent clustering updates. Experimental results on three public datasets demonstrate the superiority of our method over existing unsupervised re‐ID methods.

computer science, artificial intelligence,engineering, electrical & electronic
Distribution-Guided Hierarchical Calibration Contrastive Network for Unsupervised Person Re-Identification

Yongxi Li,Wenzhong Tang,Shuai Wang,Shengsheng Qian,Changsheng Xu

DOI: https://doi.org/10.1109/tcsvt.2024.3371088

IF: 5.859

2024-01-01

IEEE Transactions on Circuits and Systems for Video Technology

Abstract:The person re-identification task aims to retrieve the same identity under different cameras. The main difficulties of the task lie in the collection of a large amount of annotated data and the diversity of pedestrians. Therefore, how to learn a robust and discriminative representation feature with unlabeled data is the key to this task. The pseudo label based methods have shown significant effectiveness in the field by generating pseudo labels from unlabeled data instead of ground-truth labels. However, existing researches typically suffer two limitations: (1) The extracted features are insufficient to reflect the subtle local semantics; (2) The pseudo labels generated by clustering methods cannot avoid introducing noise, which will seriously affect the performance of the discriminative feature. In this paper, to address the above problems, we propose a Distribution-Guided Hierarchical Calibration Contrastive Network (DHCCN) to better exploit local clues and hierarchical representation, which can consider cross-granularity consistency and reduce the noise of pseudo labels by the calibrated feature distribution. A Hierarchical Feature Extractor is employed to capture the multi-granularity response of each image, and fuse both global salience and local subtle texture information of a pedestrian to generate the hierarchical feature. In addition, to reduce the error of the pseudo labels, we introduce a Feature Distribution Corrector to calibrate noisy features of low-confidence samples evaluated by a Gaussian Mixture Model. At last, we integrate cross-granularity consistency constraint by the difference between the global and local feature, which can help generate more accurate feature embedding and improve robustness of the model. Therefore, we can receive a performance that is close to the supervised person re-identification task by narrowing the gap between the pseudo and ground-truth label. Experiments on four standard benchmarks demonstrate the effectiveness of our method against the state-of-the-art unsupervised re-identification methods. The code is available at https://github.com/Li-Yongxi/2023-DHCCN.

engineering, electrical & electronic
3C: Confidence-Guided Clustering and Contrastive Learning for Unsupervised Person Re-Identification

Mingxiao Zheng,Yanpeng Qu,Changjing Shang,Longzhi Yang,Qiang Shen

2024-08-18

Abstract:Unsupervised person re-identification (Re-ID) aims to learn a feature network with cross-camera retrieval capability in unlabelled datasets. Although the pseudo-label based methods have achieved great progress in Re-ID, their performance in the complex scenario still needs to sharpen up. In order to reduce potential misguidance, including feature bias, noise pseudo-labels and invalid hard samples, accumulated during the learning process, in this pa per, a confidence-guided clustering and contrastive learning (3C) framework is proposed for unsupervised person Re-ID. This 3C framework presents three confidence degrees. i) In the clustering stage, the confidence of the discrepancy between samples and clusters is proposed to implement a harmonic discrepancy clustering algorithm (HDC). ii) In the forward-propagation training stage, the confidence of the camera diversity of a cluster is evaluated via a novel camera information entropy (CIE). Then, the clusters with high CIE values will play leading roles in training the model. iii) In the back-propagation training stage, the confidence of the hard sample in each cluster is designed and further used in a confidence integrated harmonic discrepancy (CHD), to select the informative sample for updating the memory in contrastive learning. Extensive experiments on three popular Re-ID benchmarks demonstrate the superiority of the proposed framework. Particularly, the 3C framework achieves state-of-the-art results: 86.7%/94.7%, 45.3%/73.1% and 47.1%/90.6% in terms of mAP/Rank-1 accuracy on Market-1501, the com plex datasets MSMT17 and VeRi-776, respectively. Code is available at <a class="link-external link-https" href="https://github.com/stone5265/3C-reid" rel="external noopener nofollow">this https URL</a>.

Computer Vision and Pattern Recognition
Transfer easy to hard: Adversarial contrastive feature learning for unsupervised person re-identification

Haoxuanye Ji,Le Wang,Sanping Zhou,Wei Tang,Nanning Zheng,Gang Hua

DOI: https://doi.org/10.1016/j.patcog.2023.109973

IF: 8

2023-09-23

Pattern Recognition

Abstract:Unsupervised Person Re-Identification (Re-ID) is challenging due to the lack of ground-truth labels. Most existing methods address this problem by progressively mining high-confidence pseudo labels to guide the feature learning process. However, how to construct hard-enough samples while maintaining the fidelity of pseudo labels in these samples remains an open issue in the machine learning community. To tackle this challenge, we design a simple yet effective adversarial contrastive feature learning (ACFL) framework, which enhances the discriminative capability of features by introducing more transformed hard samples in the feature learning process. Specifically, it mainly consists of a discriminative feature learning module and a hard sample generation module. The discriminative feature learning module extracts recognizable features of unlabeled training samples to estimate the high-confidence relationship between samples. Then, the hard sample generation module utilizes these high-confidence relationships between samples to transfer all samples into the hard ones via an adversarial learning strategy. Finally, the generated hard samples are further fed into DFL to learn discriminative features for person Re-ID. Extensive experiments on Market-1501, DukeMTMC-reID, and MSMT17 datasets show that our method compares favorably with state-of-the-art methods.

computer science, artificial intelligence,engineering, electrical & electronic
Person Reidentification via Multi-Feature Fusion With Adaptive Graph Learning

Runwu Zhou,Xiaojun Chang,Lei Shi,Yi-Dong Shen,Yi Yang,Feiping Nie

DOI: https://doi.org/10.1109/TNNLS.2019.2920905

IF: 14.255

2020-01-01

IEEE Transactions on Neural Networks and Learning Systems

Abstract:The goal of person reidentification (Re-ID) is to identify a given pedestrian from a network of nonoverlapping surveillance cameras. Most existing works follow the supervised learning paradigm which requires pairwise labeled training data for each pair of cameras. However, this limits their scalability to real-world applications where abundant unlabeled data are available. To address this issue, we propose a multi-feature fusion with adaptive graph learning model for unsupervised Re-ID. Our model aims to negotiate comprehensive assessment on the consistent graph structure of pedestrians with the help of special information of feature descriptors. Specifically, we incorporate multi-feature dictionary learning and adaptive multi-feature graph learning into a unified learning model such that the learned dictionaries are discriminative and the subsequent graph structure learning is accurate. An alternating optimization algorithm with proved convergence is developed to solve the final optimization objective. Extensive experiments on four benchmark data sets demonstrate the superiority and effectiveness of the proposed method.

On the mechanisms and putative pathways involving neuroimmune interactions.

Unsupervised person re‐identification based on adaptive information supplementation and foreground enhancement

Dual Attention Matching Network for Context-Aware Feature Sequence based Person Re-Identification

Unleashing Potential of Unsupervised Pre-Training with Intra-Identity Regularization for Person Re-Identification

Fully Unsupervised Person Re-identification viaSelective Contrastive Learning

A Novel Attention-Driven Framework for Unsupervised Pedestrian Re-identification with Clustering Optimization

Unsupervised Joint Contrastive Learning for Aerial Person Re-Identification and Remote Sensing Image Classification

MCFR: multi-confidence contrastive learning with feature refined for unsupervised person re-identification

An Attention-Driven Two-Stage Clustering Method for Unsupervised Person Re-identification

Camera Contrast Learning for Unsupervised Person Re-Identification

Salience-Guided Cascaded Suppression Network for Person Re-identification

Asymmetric double networks mutual teaching for unsupervised person Re-identification

Attributes-Assisted Joint Contrastive Learning for Person Re-Identification

Global Relation-Aware Contrast Learning for Unsupervised Person Re-Identification

Information complementary attention-based multidimension feature learning for person re-identification

Towards Discriminative Representation Learning for Unsupervised Person Re-identification

Improving unsupervised pedestrian re‐identification with enhanced feature representation and robust clustering

Distribution-Guided Hierarchical Calibration Contrastive Network for Unsupervised Person Re-Identification

3C: Confidence-Guided Clustering and Contrastive Learning for Unsupervised Person Re-Identification

Transfer easy to hard: Adversarial contrastive feature learning for unsupervised person re-identification

Person Reidentification via Multi-Feature Fusion With Adaptive Graph Learning