OpenLDN: Learning to Discover Novel Classes for Open-World Semi-Supervised Learning
Document Type
Conference Proceeding
Publication Title
Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Abstract
Semi-supervised learning (SSL) is one of the dominant approaches to address the annotation bottleneck of supervised learning. Recent SSL methods can effectively leverage a large repository of unlabeled data to improve performance while relying on a small set of labeled data. One common assumption in most SSL methods is that the labeled and unlabeled data are from the same data distribution. However, this is hardly the case in many real-world scenarios, which limits their applicability. In this work, instead, we attempt to solve the challenging open-world SSL problem that does not make such an assumption. In the open-world SSL problem, the objective is to recognize samples of known classes, and simultaneously detect and cluster samples belonging to novel classes present in unlabeled data. This work introduces OpenLDN that utilizes a pairwise similarity loss to discover novel classes. Using a bi-level optimization rule this pairwise similarity loss exploits the information available in the labeled set to implicitly cluster novel class samples, while simultaneously recognizing samples from known classes. After discovering novel classes, OpenLDN transforms the open-world SSL problem into a standard SSL problem to achieve additional performance gains using existing SSL methods. Our extensive experiments demonstrate that OpenLDN outperforms the current state-of-the-art methods on multiple popular classification benchmarks while providing a better accuracy/training time trade-off. Code: https://github.com/nayeemrizve/OpenLDN. © 2022, The Author(s), under exclusive license to Springer Nature Switzerland AG.
First Page
382
Last Page
401
DOI
10.1007/978-3-031-19821-2_22
Publication Date
10-23-2022
Keywords
Novel classes, Open-world, Semi-supervised learning
Recommended Citation
M.N. Rizve, N. Kardan, S. Khan, F.S. Khan, and M. Shah, "OpenLDN: Learning to Discover Novel Classes for Open-World Semi-Supervised Learning", in Computer Vision (ECCV 2022), Lecture Notes in Computer Science, vol 13691, pp. 382-401, Oct. 2022, doi:10.1007/978-3-031-19821-2_22
Additional Links
preprint available on arXiv: https://arxiv.org/abs/2207.02261
Comments
IR conditions: non-described