Title | Preserving Dynamic Attention for Long-Term Spatial-Temporal Prediction |
Creator | |
Date Issued | 2020 |
Conference Name | 26th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD 2020 |
Source Publication | Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining
![]() |
ISBN | 978-1-4503-7998-4 |
Pages | 36-46 |
Conference Date | July 6 - 10, 2020 |
Conference Place | Virtual Event, CA, USA |
Publisher | Association for Computing Machinery |
Abstract | Effective long-term predictions have been increasingly demanded in urban-wise data mining systems. Many practical applications, such as accident prevention and resource pre-allocation, require an extended period for preparation. However, challenges come as long-term prediction is highly error-sensitive, which becomes more critical when predicting urban-wise phenomena with complicated and dynamic spatial-temporal correlation. Specifically, since the amount of valuable correlation is limited, enormous irrelevant features introduce noises that trigger increased prediction errors. Besides, after each time step, the errors can traverse through the correlations and reach the spatial-temporal positions in every future prediction, leading to significant error propagation. To address these issues, we propose a Dynamic Switch-Attention Network (DSAN) with a novel Multi-Space Attention (MSA) mechanism that measures the correlations between inputs and outputs explicitly. To filter out irrelevant noises and alleviate the error propagation, DSAN dynamically extracts valuable information by applying self-attention over the noisy input and bridges each output directly to the purified inputs via implementing a switch-attention mechanism. Through extensive experiments on two spatial-temporal prediction tasks, we demonstrate the superior advantage of DSAN in both short-term and long-term predictions. The source code can be obtained from https://github.com/hxstarklin/DSAN. © 2020 Owner/Author. |
Keyword | attention mechanism long-term prediction mining spatial-temporal information neural network |
DOI | 10.1145/3394486.3403046 |
URL | View source |
Indexed By | CPCI-S |
Language | 英语English |
WOS Research Area | Computer Science |
WOS Subject | Computer Science ; Artificial Intelligence ; Computer Science, Information Systems ; Computer Science, Theory & Methods |
WOS ID | WOS:000749552300005 |
Citation statistics | |
Document Type | Conference paper |
Identifier | http://repository.uic.edu.cn/handle/39GCC9TT/4466 |
Collection | Graduate School |
Affiliation | 1.State Key Lab of IoTSC FST, University of Macau, Macau, China 2.Joint AI and Future Network Research Institute, BNU (Zhuhai) & UIC IoTSC, University of Macau, Macau 3.Shanghai Jiaotong University, China |
Recommended Citation GB/T 7714 | Lin, Haoxing,Bai, Rufan,Jia, Weijiaet al. Preserving Dynamic Attention for Long-Term Spatial-Temporal Prediction[C]: Association for Computing Machinery, 2020: 36-46. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment