A Text Category Detection and Information Extraction Algorithm with Deep Learning

doi:10.1088/1742-6596/1982/1/012047

科研成果详情

题名	A Text Category Detection and Information Extraction Algorithm with Deep Learning
作者	Wu，Xiaohan 1; Wu，Zejun 2; Feng，Yuqi 3
发表日期	2021-08-02
会议录名称	Journal of Physics: Conference Series
ISSN	1742-6588
卷号	1982
期号	1
摘要	In order to solve the problem that the text classification model based on neural network is easy to over-fit and ignore the key words in sentences in the training process, a Bi-GRU Chinese text classification model based on hierarchical Attention mechanism is proposed. The model introduces the idea of layering, uses bi-directional gated cyclic neural network to learn the text representation at word level and sentence level, uses Self-Attention hierarchical model to obtain the information of the influence of words and sentences on text classification, shares the weight between embedded layer and softmax layer by binding, and uses AMSBound optimization method to obtain the optimal weight matrix quickly and effectively while reducing the parameters in the model. Two commonly used Chinese data sets, FudanSet and THUCNews, are tested on the long Chinese text classification data set FudanSet. The experimental results show that the accuracy, recall rate and F-score of this model are better than Text-CNN model, Attention-BiLSTM model and Bi-GRU_CNN model, and the accuracy, recall rate and F-score index are improved by 5.9%, 5.8% and 4.6%, respectively.
关键词	adaptive boundary gradient optimization method bi-directional gated loop unit Chinese text classification hierarchical attention mechanism weight binding
DOI	10.1088/1742-6596/1982/1/012047
URL	查看来源
语种	英语English
Scopus入藏号	2-s2.0-85112744987
引用统计	被引频次[WOS]：0 [WOS记录] [WOS相关记录]
文献类型	会议论文
条目标识符	https://repository.uic.edu.cn/handle/39GCC9TT/5974
专题	北师香港浸会大学
通讯作者	Wu，Xiaohan
作者单位	1.BNU-HKBU United International College (UIC),Division of Business and Management (DBM),China 2.School of Cyber Science and Engineering,Wuhan University,Wuhan,China 3.College of Mechanical and Electrical Engineering,Northeast Forestry University,Harbin,China
第一作者单位	北师香港浸会大学
通讯作者单位	北师香港浸会大学
推荐引用方式 GB/T 7714	Wu，Xiaohan,Wu，Zejun,Feng，Yuqi. A Text Category Detection and Information Extraction Algorithm with Deep Learning[C], 2021.