Skip to main content
Article
On the Stability and Generalization of Triplet Learning
Proceedings of the 37th AAAI Conference on Artificial Intelligence, AAAI 2023
  • Jun Chen, Huazhong Agricultural University
  • Hong Chen, Huazhong Agricultural University
  • Xue Jiang, Southern University of Science and Technology
  • Bin Gu, Mohamed Bin Zayed University of Artificial Intelligence
  • Weifu Li, Huazhong Agricultural University
  • Tieliang Gong, Xi'an Jiaotong University
  • Feng Zheng, Southern University of Science and Technology
Document Type
Conference Proceeding
Abstract

Triplet learning, i.e. learning from triplet data, has attracted much attention in computer vision tasks with an extremely large number of categories, e.g., face recognition and person re-identification. Albeit with rapid progress in designing and applying triplet learning algorithms, there is a lacking study on the theoretical understanding of their generalization performance. To fill this gap, this paper investigates the generalization guarantees of triplet learning by leveraging the stability analysis. Specifically, we establish the first general high-probability generalization bound for the triplet learning algorithm satisfying the uniform stability, and then 1 obtain the excess risk bounds of the order O(n−2 logn) for both stochastic gradient descent (SGD) and regularized risk minimization (RRM), where 2n is approximately equal to the number of training samples. Moreover, an optimistic generalization bound in expectation as fast as O(n−1) is derived for RRM in a low noise case via the on-average stability analysis. Finally, our results are applied to triplet metric learning to characterize its theoretical underpinning.

DOI
10.1609/aaai.v37i6.25859
Publication Date
6-26-2023
Keywords
  • Machine Learning,
  • Learning Theory
Comments

Access available at AAAI OJS

Open Source Publishing system

Citation Information
J. Chen, et al, “On the Stability and Generalization of Triplet Learning”, AAAI, vol. 37, no. 6, pp. 7033-7041, Jun. 2023. doi:10.1609/aaai.v37i6.25859