Status | 已发表Published |
Title | Attention-based Local Mean K-Nearest Centroid Neighbor Classifier |
Creator | |
Date Issued | 2022-09-01 |
Source Publication | Expert Systems with Applications
![]() |
ISSN | 0957-4174 |
Volume | 201 |
Abstract | Among classic data mining algorithms, the K-Nearest Neighbor (KNN)-based methods are effective and straightforward solutions for the classification tasks. However, most KNN-based methods do not fully consider the impact across different training samples in classification tasks, which leads to performance decline. To address this issue, we propose a method named Attention-based Local Mean K-Nearest Centroid Neighbor Classifier (ALMKNCN), bridging the nearest centroid neighbor computing with the attention mechanism, which fully considers the influence of each training query sample. Specifically, we first calculate the local centroids of each class with the given query pattern. Then, our ALMKNCN introduces the attention mechanism to calculate the weight of pseudo-distance between the test sample to each class centroid. Finally, based on attention coefficient, the distances between the query sample and local mean vectors are weighted to predict the classes for query samples. Extensive experiments are carried out on real data sets and synthetic data sets by comparing ALMKNCN with the state-of-art KNN-based methods. The experimental results demonstrate that our proposed ALMKNCN outperforms the compared methods with large margins. |
Keyword | Attention mechanism Data mining K-Nearest Neighbor Pattern classification |
DOI | 10.1016/j.eswa.2022.117159 |
URL | View source |
Indexed By | SCIE |
Language | 英语English |
WOS Research Area | Computer Science ; Engineering ; Operations Research & Management Science |
WOS Subject | Computer Science, Artificial IntelligenceEngineering, Electrical & Electronic ; Operations Research & Management Science |
WOS ID | WOS:000830169300017 |
Scopus ID | 2-s2.0-85129118704 |
Citation statistics | |
Document Type | Journal article |
Identifier | http://repository.uic.edu.cn/handle/39GCC9TT/10589 |
Collection | Faculty of Science and Technology |
Corresponding Author | Huang, Rui |
Affiliation | 1.Department of Computer and Information Engineering,Xiamen University of Technology,Xiamen,361024,China 2.Institute of High Performance Computing,Agency for Science,Technology and Research,Singapore 3.Department of Precision Instrument,Center for Brain Inspired Computing Research,Tsinghua University,Beijing,100084,China 4.BNU-UIC Institute of Artificial Intelligence and Future Networks,Beijing Normal University (BNU Zhuhai),China |
Recommended Citation GB/T 7714 | Ma, Ying,Huang, Rui,Yan, Minget al. Attention-based Local Mean K-Nearest Centroid Neighbor Classifier[J]. Expert Systems with Applications, 2022, 201. |
APA | Ma, Ying, Huang, Rui, Yan, Ming, Li, Guoqi, & Wang, Tian. (2022). Attention-based Local Mean K-Nearest Centroid Neighbor Classifier. Expert Systems with Applications, 201. |
MLA | Ma, Ying,et al."Attention-based Local Mean K-Nearest Centroid Neighbor Classifier". Expert Systems with Applications 201(2022). |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment