Skip to main content
SpringerLink
Log in

Constructing domain-dependent sentiment dictionary for sentiment analysis

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

Sentiment dictionary is of great value to sentiment analysis, which is used widely in sentiment analysis compositionality. However, the sentiment polarity and intensity of the word may vary from one domain to another. In this paper, we introduce a novel approach to build domain-dependent sentiment dictionary, SentiDomain. We propose a weak supervised neural model that aims at learning a set of sentiment clusters embedding from the sentence global representation of the target domain. The model is trained on unlabeled data with weak supervision by reconstructing the input sentence representation from the resulting representation. Furthermore, we also propose an attention-based LSTM model to address aspect-level sentiment analysis task based on the sentiment score retrieved from the proposed dictionary. The key idea is to weight-down the non-sentiment parts among aspect-related information in a given sentence. Our extensive experiments on both English and Chinese benchmark datasets have shown that compared to the state-of-the-art alternatives, our proposals can effectively improve polarity detection.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

Notes

  1. Pre-trained model of GloVe is available from www.stanford.edu

  2. Tool for data visualization, it is available on Plotly.

References

  1. Ahmed M, Chen Q, Wang Y, Li Z (2019) Hint-embedding attention-based LSTM for aspect identification sentiment analysis. In: Pacific Rim international conference on artificial intelligence, Springer, pp 569–581

  2. Baccianella S, Esuli A, Sebastiani F (2010) SentiWordNet 3.0: an enhanced lexical resource for sentiment analysis and opinion mining. In: Proceedings of the seventh conference on international language resources and evaluation (LREC’10)

  3. Bradley M, Lang P (1997) Affective norms for English words (ANEW): stimuli, instruction manual and affective ratings. Technical report no. c-1, Center for Research in Psychophysiology, University of Florida, Gainesville, FL

  4. Brody S, Elhadad N (2010) An unsupervised aspect-sentiment model for online reviews. In: Human language technologies: the 2010 annual conference of the North American chapter of the Association for Computational Linguistics, Association for Computational Linguistics, pp 804–812

  5. Cambria E (2016) Affective computing and sentiment analysis. IEEE Intell Syst 31(2):102–107

    Article  Google Scholar 

  6. Chen M (2017) Efficient vector representation for documents through corruption. arXiv:170702377

  7. Chen P, Sun Z, Bing L, Yang W (2017) Recurrent attention network on memory for aspect sentiment analysis. In: Proceedings of the 2017 conference on empirical methods in natural language processing, pp 452–461

  8. Devlin J, Chang MW, Lee K, Toutanova K (2018) BERT: pre-training of deep bidirectional transformers for language understanding. arXiv:181004805

  9. Ding X, Liu B (2007) The utility of linguistic rules in opinion mining. In: Proceedings of the 30th annual international ACM SIGIR conference on research and development in information retrieval, ACM, pp 811–812

  10. Eisenstein J (2017) Unsupervised learning for lexicon-based classification. In: Thirty-first AAAI conference on artificial intelligence

  11. Fu P, Lin Z, Yuan F, Wang W, Meng D (2018) Learning sentiment-specific word embedding via global sentiment representation. In: Thirty-second AAAI conference on artificial intelligence

  12. Gatti L, Guerini M, Turchi M (2016) Sentiwords: deriving a high precision and high coverage lexicon for sentiment analysis. IEEE Trans Affect Comput 7(4):409–421

    Article  Google Scholar 

  13. Guerini M, Gatti L, Turchi M (2013) Sentiment analysis: how to derive prior polarities from SentiWordNet. arXiv:13095843

  14. He R, Lee WS, Ng HT, Dahlmeier D (2017) An unsupervised neural attention model for aspect extraction. In: Proceedings of the 55th annual meeting of the Association for Computational Linguistics (volume 1: long papers), vol 1, pp 388–397

  15. He R, Lee WS, Ng HT, Dahlmeier D (2018) Effective attention modeling for aspect-level sentiment classification. In: Proceedings of the 27th international conference on computational linguistics, pp 1121–1131

  16. Hu M, Liu B (2004) Mining and summarizing customer reviews. In: Proceedings of the tenth ACM SIGKDD international conference on knowledge discovery and data mining, ACM, pp 168–177

  17. Iyyer M, Guha A, Chaturvedi S, Boyd-Graber J, Daumé III H (2016) Feuding families and former friends: unsupervised learning for dynamic fictional relationships. In: Proceedings of the 2016 conference of the North American chapter of the Association for Computational Linguistics: human language technologies, pp 1534–1544

  18. Jiang L, Yu M, Zhou M, Liu X, Zhao T (2011) Target-dependent twitter sentiment classification. In: Proceedings of the 49th annual meeting of the Association for Computational Linguistics: human language technologies—volume 1, Association for Computational Linguistics, pp 151–160

  19. Jindal N, Liu B (2006) Identifying comparative sentences in text documents. In: Proceedings of the 29th annual international ACM SIGIR conference on research and development in information retrieval, ACM, pp 244–251

  20. Liu B (2012) Sentiment analysis and opinion mining, vol 5. Synthesis lectures on human language technologies. Morgan & Claypool Publishers, San Rafael, pp 1–167

    Google Scholar 

  21. Luo L, Ao X, Song Y, Li J, Yang X, He Q, Yu D (2019) Unsupervised neural aspect extraction with sememes. In: Proceedings of 28th international joint conference on artificial intelligence, pp 5123–5129

  22. Ma D, Li S, Zhang X, Wang H (2017) Interactive attention networks for aspect-level sentiment classification. arXiv:170900893

  23. Mikolov T, Yih Wt, Zweig G (2013) Linguistic regularities in continuous space word representations. In: Proceedings of the 2013 conference of the North American chapter of the Association for Computational Linguistics: human language technologies, pp 746–751

  24. Mohammad SM, Kiritchenko S, Zhu X (2013) NRC-Canada: building the state-of-the-art in sentiment analysis of tweets. arXiv:13086242

  25. Mudinas A, Zhang D, Levene M (2018) Bootstrap domain-specific sentiment classifiers from unlabeled corpora. Trans Assoc Comput Linguist 6:269–285

    Article  Google Scholar 

  26. Nasukawa T, Yi J (2003) Sentiment analysis: capturing favorability using natural language processing. In: Proceedings of the 2nd international conference on knowledge capture, ACM, pp 70–77

  27. Neviarouskaya A, Prendinger H, Ishizuka M (2011) Affect analysis model: novel rule-based approach to affect sensing from text. Nat Lang Eng 17(1):95–135

    Article  Google Scholar 

  28. Pang B, Lee L et al (2008) Opinion mining and sentiment analysis. Found Trends Inf Retr 2(1–2):1–135

    Article  Google Scholar 

  29. Pennington J, Socher R, Manning C (2014) Glove: global vectors for word representation. In: Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP), pp 1532–1543

  30. Perez-Rosas V, Banea C, Mihalcea R (2012) Learning sentiment lexicons in Spanish. In: LREC, vol 12, p 73

  31. Peters ME, Neumann M, Iyyer M, Gardner M, Clark C, Lee K, Zettlemoyer L (2018) Deep contextualized word representations. arXiv:180205365

  32. Polanyi L, Zaenen A (2006) Contextual valence shifters. In: Shanahan JG, Qu Y, Wiebe J (eds) Computing attitude and affect in text: theory and applications. Springer, Dordrecht, pp 1–10

    Google Scholar 

  33. Pontiki M, Galanis D, Pavlopoulos J, Papageorgiou H, Androutsopoulos I, Manandhar S (2014) Semeval-2014 task 4: aspect based sentiment analysis. In: Proceedings of 10th international workshop on semantic evaluation (SemEval-2014), pp 27–35

  34. Qian Q, Huang M, Lei J, Zhu X (2016) Linguistically regularized LSTMs for sentiment classification. arXiv:161103949

  35. Radford A, Narasimhan K, Salimans T, Sutskever I (2018) Improving language understanding by generative pre-training. https://s3-us-west-2.amazonaws.com/openai-assets/researchcovers/languageunsupervised/language_understanding_paper.pdf. Accessed 2018

  36. Shi C, Chen Q, Sha L, Li S, Sun X, Wang H, Zhang L (2018) Auto-dialabel: Labeling dialogue data with unsupervised learning. In: Proceedings of the 2018 conference on empirical methods in natural language processing, pp 684–689

  37. Socher R, Karpathy A, Le QV, Manning CD, Ng AY (2014) Grounded compositional semantics for finding and describing images with sentences. Trans Assoc Comput Linguist 2(1):207–218

    Article  Google Scholar 

  38. Taboada M, Brooke J, Tofiloski M, Voll K, Stede M (2011) Lexicon-based methods for sentiment analysis. Comput Linguist 37(2):267–307

    Article  Google Scholar 

  39. Tang D, Wei F, Yang N, Zhou M, Liu T, Qin B (2014) Learning sentiment-specific word embedding for twitter sentiment classification. In: Proceedings of the 52nd annual meeting of the Association for Computational Linguistics (volume 1: long papers), pp 1555–1565

  40. Tang D, Qin B, Feng X, Liu T (2015a) Effective LSTMs for target-dependent sentiment classification. arXiv:151201100

  41. Tang D, Wei F, Qin B, Yang N, Liu T, Zhou M (2015b) Sentiment embeddings with applications to sentiment analysis. IEEE Trans Knowl Data Eng 28(2):496–509

    Article  Google Scholar 

  42. Tang D, Qin B, Liu T (2016) Aspect level sentiment classification with deep memory network. arXiv:160508900

  43. Tay Y, Tuan LA, Hui SC (2018) Learning to attend via word-aspect associative fusion for aspect-based sentiment analysis. In: Thirty-second AAAI conference on artificial intelligence

  44. Wang Y, Huang M, Zhao L et al (2016) Attention-based LSTM for aspect-level sentiment classification. In: Proceedings of the 2016 conference on empirical methods in natural language processing, pp 606–615

  45. Wang Y, Chen Q, Ahmed M, Li Z, Pan W, Liu H (2019) Joint inference for aspect-level sentiment analysis by deep neural networks and linguistic hints. IEEE Trans Knowl Data Eng. https://doi.org/10.1109/TKDE.2019.2947587

    Article  Google Scholar 

  46. Warriner AB, Kuperman V, Brysbaert M (2013) Norms of valence, arousal, and dominance for 13,915 English lemmas. Behav Res Methods 45(4):1191–1207

    Article  Google Scholar 

  47. Weston J, Bengio S, Usunier N (2011) Wsabie: scaling up to large vocabulary image annotation. IJCAI 11:2764–2770

    Google Scholar 

  48. Xing FZ, Pallucchini F, Cambria E (2019) Cognitive-inspired domain adaptation of sentiment lexicons. Inf Process Manag 56(3):554–564

    Article  Google Scholar 

  49. Xue W, Li T (2018) Aspect based sentiment analysis with gated convolutional networks. In: Proceedings of the 56th annual meeting of the Association for Computational Linguistics

  50. Zhang H, Huang W, Liu L, Chow TWW (2019) Learning to match clothing from textual feature-based compatible relationships. IEEE Transactions on Industrial Informatics, Proceedings of the CIKM, ACM, 2018, pp. 843–852

  51. Zhao WX, Jiang J, Yan H, Li X (2010) Jointly modeling aspects and opinions with a MaxEnt-LDA hybrid. In: Proceedings of the 2010 conference on empirical methods in natural language processing, Association for Computational Linguistics, pp 56–65

Download references

Author information

Authors and Affiliations

  1. School of Computer Science, Northwestern Polytechnical University, Xi’an, Shaanxi, People’s Republic of China

    Murtadha Ahmed, Qun Chen & Zhanhuai Li

  2. Key Laboratory of Big Data Storage and Management, Northwestern Polytechnical University, Ministry of Industry and Information Technology, Xi’an, Shaanxi, People’s Republic of China

    Murtadha Ahmed, Qun Chen & Zhanhuai Li

Authors
  1. Murtadha Ahmed
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Qun Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Zhanhuai Li
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Murtadha Ahmed.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ahmed, M., Chen, Q. & Li, Z. Constructing domain-dependent sentiment dictionary for sentiment analysis. Neural Comput & Applic 32, 14719–14732 (2020). https://doi.org/10.1007/s00521-020-04824-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-020-04824-8

Keywords

Search

Navigation