基于内联关系的方面级情感分析方法

doi:10.12066/j.issn.1007-2861.2265

摘要/Abstract

摘要：

方面级情感分析 (aspect-based sentiment analysis, ABSA) 旨在预测给定文本中特定目标的情感极性. 研究表明, 利用注意力机制对目标及其上下文进行建模, 可以获得更有效的情感分类特征表达. 然而, 目前常用的方法是通过对特定目标使用平均向量来计算该目标上下文的注意权值, 这类方法无法突出文本中个别单词对于整个句子的重要性. 因此, 提出了一种基于内联关系的方面级情感分析方法, 该方法可以对目标和上下文进行建模, 将关注点放在目标的关键词上, 以学习更有效的上下文表示. 首先使用门控循环单元 (gated recurrent unit, GRU) 对方面信息和句中单词进行融合分布式表达; 然后将分布式表达输入到结合注意力机制的长短时记忆网络 (long short-term memory network, LSTM), 通过查询机制来增加内联关系的权重, 最终得到方面级情感分类. 该模型在公开数据集上进行的实验结果表明, 该方法是有效的, 精确度均超过基线模型.

关键词: 方面, 情感分析, 内联关系, 门控循环单元, 长短时记忆网络

Abstract:

Aspect-based sentiment analysis (ABSA) predicts the sentiment polarity of particular entities in given sentences. Studies show that the most effective methods use features obtained by modelling entities and their contexts with attention to sentiment prediction. However, these methods calculate the attention weights of contexts by using mean vectors for target entities. In addition, these methods cannot highlight the importance of individual words in the text of whole sentences. Therefore, this study proposes an aspect-based sentiment analysis method that can model the inner relations with memory networks, where networks can learn more effective contextual representations. First, gated recurrent units (GRUs) are used to embed the distributed representations of aspect words and words in sentences. Then, a long short-term memory network (LSTM) takes the distributed representation as input to increase the weights of entities according to the attention-based contextual relationship. Finally, through a query mechanism, aspect-based sentiment polarity is obtained. The proposed model is tested on the open-source datasets Semeval-2014 and Semeval-2016, with results showing that the proposed method is effective and the accuracy is higher than that of the baselines.

Key words: aspect, sentiment analysis, inner relation, gated recurrent unit (GRU), long short-term memory (LSTM)

中图分类号:

TP183

张克, 张文俊, 朱蕴文, 邢毅雪. 基于内联关系的方面级情感分析方法[J]. 上海大学学报(自然科学版), 2022, 28(1): 157-169.

ZHANG Ke, ZHANG Wenjun, ZHU Yunwen, XING Yixue. Inner-relation modelling with memory networks in aspect-based sentiment analysis[J]. Journal of Shanghai University（Natural Science Edition）, 2022, 28(1): 157-169.

图/表 6

图1

表1

表2

表3

表4

图2

参考文献 33

[1]	刘全, 梁斌, 徐进, 等. 一种用于基于方面情感分析的深度分层网络模型[J]. 计算机学报, 2018, 41(12): 3-18.
[2]	孙小婉, 王英, 王鑫, 等. 面向双注意力网络的特定方面情感分析模型[J]. 计算机研究与发展, 2019, 11: 2384-2395.
[3]	Kiritchenko S, Zhu X, Cherry C, et al. Nrc-canada-2014: detecting aspects and sentiment in customer reviews [C]// Proceedings of the 8th International Workshop on Semantic Evaluation (SEMEVAL 2014). 2014: 437-442.
[4]	Manek A S, Deepa S P, Chandra M M, et al. Aspect term extraction for sentiment analysis in large movie reviews using Gini Index feature selection method and SVM classifier[J]. World Wide Web-internet & Web Information Systems, 2019, 20(2): 135-154.
[5]	Liang B, Liu Q, Xu J, et al. Aspect-based sentiment analysis based on multi-attentionCNN[J]. Journal of Computer Research and Development, 2017, 54(8): 1724-1735.
[6]	Yao L, Rong H T, Chu C, et al. Mining aspects in online comments with attention and Bi-LSTM [C]// 2019 5th International Conference on Big Data Computing and Communications (BIGCOM). 2019: 288-292.
[7]	Meng W, Wei Y, Liu P, et al. Aspect based sentiment analysis with feature enhanced attention CNN-BiLSTM[J]. IEEE Access, 2019(7): 167240-167249.
[8]	Luong M T, Pham H, Manning C D. Effective approaches to attention-based neural machine translation [C]// Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing (EMNLP). 2015: 1412-1421.
[9]	Jiang L, Yu M, Zhou M, et al. Target-dependent twitter sentiment classification [C]// Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics (ACL). 2011: 151-160.
[10]	Do H H, Prasad P W C, Maag A, et al. Deep learning for aspect-based sentiment analysis: a comparative review[J]. Expert Systems with Applications, 2019(118): 272-299.
[11]	Jiang N, Tian F, Li J, et al. MAN: mutual attention neural networks model for aspect-level sentiment classification in siot[J]. IEEE Internet of Things Journal, 2020(1): 1.
[12]	Tang D, Qin B, Liu T. Aspect level sentiment classification with deep memory network [C]// Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing (EMNLP). 2016: 214-224.
[13]	Yin Y, Song Y, Zhang M. Document-level multi-aspect sentiment classification as machine comprehension [C]// Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing (EMNLP). 2017: 2044-2054.
[14]	Yang C, Kim T, Wang R Z, et al. Show, attend, and translate: unsupervised image translation with self-regularization and attention[J]. IEEE Transactions on Image Processing, 2019, 10(28): 4845-4856.
[15]	Wang Y, Huang M, Zhu X, et al. Attention-based LSTM for aspect-level sentiment classification [C]// Empirical Methods in Natural Language Processing. 2016: 606-615.
[16]	Tay Y, Tuan L A, Hui S C. Learning to attend via word-aspect associative fusion for aspect-based sentiment analysis [C]// Proceedings of the Thirty-Second Aaai Conference on Artificial Intelligence (AAAI). 2018: 5956-5963.
[17]	Ma D, Li S, Zhang X, et al. Interactive attention networks for aspect-level sentiment classification [C]// Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence (IJCAI). 2017: 4069-4074.
[18]	Ma Y, Peng H, Cambria E. Targeted aspect-based sentiment analysis via embedding commonsense knowledge into an attentive LSTM [C]// Proceedings of the Thirty-Second AAAI Conference On Artificial Intelligence (AAAI). 2018: 5876-5883.
[19]	Zhuang L, Schouten K, Frasincar F. SOBA: semi-automated ontology builder for aspect-based sentiment analysis[J]. Journal of Web Semantics, 2020, 60: 100-144.
[20]	Baas F, Bus O, Osinga A, et al. Exploring lexico-semantic patterns for aspect-based sentiment analysis [C]// Proceedings of the 34th ACM/SIGAPP Symposium on Applied Computing. 2019: 984-992.
[21]	Khine W L K, Nyein T T A. Applying deep learning approach to targeted aspect-based sentiment analysis for restaurant domain [C]// 2019 International Conference on Advanced Information Technologies (ICAIT). 2019: 206-211.
[22]	Weston J, Chopra S, Bordes A. Memory networks [C]// International Conference on Learning Representations (ICLR). 2015: 2440-2448.
[23]	Sukhbaatar S, Szlam A, Weston J, et al. End-to-end memory networks [C]// Neural Information Processing Systems. 2015: 2440-2448.
[24]	Tang D, Qin B, Liu T, et al. Aspect level sentiment classification with deep memorynetwork [C]// Empirical Methods In Natural Language Processing. 2016: 214-224.
[25]	Chen P, Sun Z, Bing L, et al. Recurrent attention network on memory for aspect sentiment analysis [C]// Empirical Methods In Natural Language Processing. 2017: 452-461.
[26]	Pennington J, Socher R, Manning C D, et al. Glove: global vectors for word represen-tation [C]// Proceeding of the 2014 Empirical Methods in Natural Language Processing. 2014: 1532-1543.
[27]	Wang S, Wang J, Wang Z, et al. Multiple emotion tagging for multimedia data by exploiting high-order dependencies among emotions[J]. IEEE Transactions on Multimedia, 2015, 17(12): 2185-2197. doi: 10.1109/TMM.2015.2484966
[28]	Kingma D P, Ba J. Adam: A method for stochastic optimization [C]// 3rd International Conference on Learning Representations. 2015: 7-9.
[29]	Yang C, Zhang H, Jiang B, et al. Aspect-based sentiment analysis with alternating co-attention networks[J]. Information Processing and Management, 2019, 56(3): 463-478. doi: 10.1016/j.ipm.2018.12.004
[30]	Ma D, Li S, Zhang X, et al. Interactive attention networks for aspect-level sentiment classification [C]// International Joint Conference on Artificial Intelligence. 2017: 4068-4074.
[31]	Fan F, Feng Y, Zhao D, et al. Multi-grained attention network for aspect-level sentiment classification [C]// Empirical Methods in Natural Language Processing. 2018: 3433-3442.
[32]	Xu Q, Zhu L, Dai T, et al. Aspect-based sentiment classification with multi-attentionnetwork [EB/OL]. [2020-12-30]. https://xueshu.baidu.com/usercenter/paper/show?paperid=1q100emox06qom901j3jov30ca396844&site=xueshu_se.
[33]	Wu S, Xu Y, Wu F, et al. Aspect-based sentiment analysis via fusing multiple sources of textual knowledge[J]. Knowledge Based Systems, 2019, 183(11): 1-16.