Status | 已发表Published |
Title | Contrastive semantic disentanglement in latent space for generalized zero-shot learning |
Creator | |
Date Issued | 2022-12-05 |
Source Publication | Knowledge-Based Systems
![]() |
ISSN | 0950-7051 |
Volume | 257 |
Abstract | The target of generalized zero-shot learning (GZSL) is to train a model that can classify data samples from both seen categories and unseen categories under the circumstances that only the labeled samples from seen categories are available. In this paper, we propose a GZSL approach based on conditional generative models that adopts a contrastive disentanglement learning framework to disentangle visual information in the latent space. Specifically, our model encodes original and generated visual features into a latent space in which these visual features are disentangled into semantic-related and semantic-unrelated representations. The proposed contrastive learning framework leverages class-level and instance-level supervision, where it not only formulates contrastive loss based on semantic-related information at the instance level, but also exploits semantic-unrelated representations and the corresponding semantic information to form negative sample pairs at the class level to further facilitate disentanglement. Then, GZSL classification is performed by training a supervised model (e.g, softmax classifier) based only on semantic-related representations. The experimental results show that our model achieves state-of-the-art performance on several benchmark datasets, especially for unseen categories. The source code of the proposed model is available at: https://github.com/fwt-team/GZSL. |
Keyword | Contrastive learning Feature disentanglement Generalized zero-shot learning Generative model Wasserstein GAN |
DOI | 10.1016/j.knosys.2022.109949 |
URL | View source |
Indexed By | SCIE |
Language | 英语English |
WOS Research Area | Computer Science |
WOS Subject | Computer Science, Artificial Intelligence |
WOS ID | WOS:000894032800015 |
Scopus ID | 2-s2.0-85140141038 |
Citation statistics | |
Document Type | Journal article |
Identifier | http://repository.uic.edu.cn/handle/39GCC9TT/10153 |
Collection | Faculty of Science and Technology |
Corresponding Author | Fan, Wentao |
Affiliation | 1.Department of Computer Science,Beijing Normal University-Hong Kong Baptist University United International College,Zhuhai,Guangdong,China 2.Department of Computer Science and Technology,Huaqiao University,Xiamen,China 3.BNU-UIC Institute of Artificial Intelligence and Future Networks,Beijing Normal University (BNU),Zhuhai,China 4.Guangdong Key Lab of AI and Multi-Modal Data Processing,BNU-HKBU United International College (UIC),Zhuhai,Guangdong,China |
First Author Affilication | Beijing Normal-Hong Kong Baptist University |
Corresponding Author Affilication | Beijing Normal-Hong Kong Baptist University |
Recommended Citation GB/T 7714 | Fan, Wentao,Liang, Chen,Wang, Tian. Contrastive semantic disentanglement in latent space for generalized zero-shot learning[J]. Knowledge-Based Systems, 2022, 257. |
APA | Fan, Wentao, Liang, Chen, & Wang, Tian. (2022). Contrastive semantic disentanglement in latent space for generalized zero-shot learning. Knowledge-Based Systems, 257. |
MLA | Fan, Wentao,et al."Contrastive semantic disentanglement in latent space for generalized zero-shot learning". Knowledge-Based Systems 257(2022). |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment