Status | 已发表Published |
Title | Continuous image anomaly detection based on contrastive lifelong learning |
Creator | |
Date Issued | 2023-07-01 |
Source Publication | Applied Intelligence
![]() |
ISSN | 0924-669X |
Volume | 53Issue:14Pages:17693-17707 |
Abstract | With the development of deep learning techniques, an increasing number of anomaly detection methods based on deep neural networks have been proposed during the last decade. Nevertheless, these methods often suffer from catastrophic forgetting when trained on continuously arriving data samples, as deep neural networks quickly forget the knowledge obtained from previous training while adjusting to learning new information. In this work, we propose a contrastive lifelong learning model for image anomaly detection. Rather than adopting CNN-based neural networks as in other anomaly detection approaches to learn representations from training samples, we propose a contrastive learning framework for anomaly detection in which Vision Transformer (VIT) is adopted for extracting promising representations. Two nonlinear structures (projector and predictor) are integrated into our model, which is helpful in improving the performance of anomaly detection. Moreover, a lifelong learning framework that contains teacher and student networks is deployed in our model, which is able to mitigate the problem of catastrophic forgetting in image anomaly detection. By leveraging both lifelong learning and contrastive learning frameworks, our model is able to progressively perform image anomaly detection where the problem of catastrophic forgetting can be greatly mitigated. We demonstrate the effectiveness of the proposed anomaly detection method by conducting experiments on multiple image data sets. |
Keyword | Contrastive learning Image anomaly detection Knowledge distillation Lifelong learning |
DOI | 10.1007/s10489-022-04401-7 |
URL | View source |
Indexed By | SCIE |
Language | 英语English |
WOS Research Area | Computer Science |
WOS Subject | Computer Science, Artificial Intelligence |
WOS ID | WOS:000912252800001 |
Scopus ID | 2-s2.0-85146350218 |
Citation statistics | |
Document Type | Journal article |
Identifier | http://repository.uic.edu.cn/handle/39GCC9TT/10785 |
Collection | Beijing Normal-Hong Kong Baptist University |
Corresponding Author | Fan, Wentao |
Affiliation | 1.Department of Computer Science, Beijing Normal University-Hong Kong Baptist University United International College, Zhuhai, China 2.Department of Computer Science and Technology, Huaqiao University, Xiamen, China 3.Guangdong Provincial Key Laboratory of Interdisciplinary Research and Application for Data Science, BNU-HKBU United International College, Zhuhai, China 4.Concordia Institute for Information Systems Engineering (CIISE), Concordia University, Montreal, Canada |
First Author Affilication | Beijing Normal-Hong Kong Baptist University |
Corresponding Author Affilication | Beijing Normal-Hong Kong Baptist University |
Recommended Citation GB/T 7714 | Fan, Wentao,Shangguan, Weimin,Bouguila, Nizar. Continuous image anomaly detection based on contrastive lifelong learning[J]. Applied Intelligence, 2023, 53(14): 17693-17707. |
APA | Fan, Wentao, Shangguan, Weimin, & Bouguila, Nizar. (2023). Continuous image anomaly detection based on contrastive lifelong learning. Applied Intelligence, 53(14), 17693-17707. |
MLA | Fan, Wentao,et al."Continuous image anomaly detection based on contrastive lifelong learning". Applied Intelligence 53.14(2023): 17693-17707. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment