基于柔性加权原型对比学习的无监督可见光-红外行人重识别

Soft-Weight Prototype Contrastive Learning for Unsupervised Visible-Infrared Person Re-Identification

  • 摘要: 无监督可见光-红外行人重识别(Unsupervised Visible-Infrared Person Re-identification,USⅥ-ReID)是一项非常重要且具有挑战性的任务。USⅥ-ReID的关键挑战是在不依赖任何跨模态标注的情况下有效地生成伪标签并建立跨模态对应。近年来,通过聚类算法生成伪标签的方法在USⅥ-ReID中得到了越来越多的关注。然而,以前的方法只是选择代表个体的单一类中心原型或按照一定的策略随机选择原型来建立跨模态对应。这不仅忽略了个体特征的多样性,也没有考虑聚类过程中错误样本对模型训练的影响。为了解决这个问题,本文提出了一种柔性加权原型对比学习(Soft-Weight Prototype Contrastive Learning, SWPCL)方法。该方法首先设计了一个柔性原型(Soft Prototype, SP)选择策略,根据个体特征之间的相似度选择质心原型的最近邻样本作为柔性原型,为模型提供丰富的正监督信息。为了进一步消除错误原型对模型训练的干扰,提出了一种柔性加权(Soft-Weight, SW)策略,定量地度量所选的柔性原型相对于当前质心原型的相关性, 将选择到的原型通过柔性加权的方式结合到对比学习中。最后,引入了一种渐进式对比学习(Progressive Contrastive Learning, PCL)策略,将模型的注意力逐渐转移到柔性原型上,避免聚类退化。在SYSU-MM01和RegDB两个公共数据集上的大量实验证明了所提出的柔性加权原型对比学习方法的有效性。

     

    Abstract: Unsupervised visible-infrared person re-identification (USⅥ-ReID) is a highly important and challenging task. The key difficulty lies in effectively generating pseudo-labels and establishing cross-modality correspondences without relying on any annotations. Recently, generating pseudo-labels using clustering algorithms has attracted increasing attention in USⅥ-ReID. However, previous methods typically selected a single centroid prototype to represent an individual or randomly selected prototypes based on a fixed strategy for cross-modal correspondence. This approach not only overlooks the diversity of individual characteristics but also fails to account for the negative impact of incorrect samples on model training during clustering. To address these issues, we propose soft-weight prototype contrastive learning (SWPCL). This method first introduces a soft prototype (SP) selection strategy, which selects the nearest neighbor samples of the centroid prototype as the soft prototype based on the similarity between individual features, providing rich positive supervised information to the model. To further eliminate the interference of erroneous prototypes on model training, a soft-weight (SW) strategy is proposed to quantitatively measure the correlation between each selected soft prototype and the corresponding centroid prototype. These prototypes are then integrated into contrastive learning through a soft-weighting mechanism. Finally, a progressive learning strategy is introduced to gradually shift the model's focus toward reliable soft prototypes, thereby avoiding clustering degradation. Extensive experiments on the public SYSU-MM01 and RegDB datasets demonstrate the effectiveness of the proposed SWPCL method.

     

/

返回文章
返回