Skip to main content
SpringerLink
Log in

Contextual Features and Optimal Hierarchical Attention Networks for Sentiment Classification Under Data Streaming Environment

  • Published:
Mobile Networks and Applications Aims and scope Submit manuscript

Abstract

The endemic growth of online reviews has attracted the users to post their opinions in the social network. This growth made the classification of sentiment process an interesting domain in both industrial and academic research. Various sentiment classification techniques are developed to perform sentiment analysis, but the acquisition of sentiment grade is not precisely performed. Hence, this paper devises novel optimization driven classifier for classifying the sentiment grades. Here, the reviews are considered wherein the features are mined using reviews. In addition, significant features, like, SentiWordNet-based features, statistical features, context-based features, and Term Frequency-Inverse Document Frequency (TF-IDF)-based features are obtained from review. These features are adapted in Hierarchical Attention Network (HAN) to categorize sentiment grade. The training of HAN is performed using the proposed Competitive Swarm Water Wave Optimization (CSWWO) algorithm. The developed CSWWO algorithm is newly designed by integrating the Competitive Swarm Optimizer (CSO) and Water Wave Optimization (WWO) technique. Thus, the proposed CSWWO-based HAN model categorizes the sentiment into five classes, poor, better, good, very good, and excellent. At last, data stream handling is performed by concept drift detection and prototype-based adaption. Hence, the proposed CSWWO-based HAN offered enhanced performance with maximal accuracy of 93%, minimal True Positive Rate (TPR) of 93.9%, and maximal True Negative Rate (TNR) of 91.7%.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1.
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  1. Kurian DDMK, Vishnupriya S, Ramesh R, Divya G, Divya D, Kurian MK, Vishnupriya S, Ramesh R, Divya G, Divya D (2015) Big data sentiment analysis using Hadoop. Int J Innov Res Sci Technol 1(11):92–96

    Google Scholar 

  2. Hajiali M (2020) Big data and sentiment analysis: a comprehensive and systematic literature review. Concurrency and Computation: Practice and Experience 32(14):e5671

  3. Wang H, Xu Z, Fujita H, Liu S (2016) Towards felicitous decision making: An overview on challenges and trends of Big Data. Inf Sci 367:747–765

    Article  Google Scholar 

  4. Wagdarikar AMU, Senapati RK (2019) Haar Wavelet Transform and Multiobjective Cost Function for Video Watermarking. Multimedia Res 2(4):33–42

    Google Scholar 

  5. Kim H, Jeong Y-S (2019) Sentiment Classification Using Convolutional Neural Networks. Appl Sci 9(11):2347

    Article  Google Scholar 

  6. Zhao S, Ding G, Gao Y, Han J (2017) Approximating discrete probability distribution of image emotions by multi-modal features fusion. Transfer 1000(1):4669–4675

    Google Scholar 

  7. Zhang S, Xinyun X, Pang Y, Han J (2020) Multi-layer Attention Based CNN for Target-Dependent Sentiment Classification. Neural Process Lett 51(3):2089–2103

    Article  Google Scholar 

  8. Zhao S, Gao Y, Ding G, Chua TS (2017) Real-time multimedia social event detection in microblog. IEEE Trans Cybern 48(11):3218–3231

    Article  Google Scholar 

  9. Hirschberg J, Manning CD (2015) Advances in natural language processing. Science 349(6245):261–266

    Article  MathSciNet  Google Scholar 

  10. Wang B, He W, Yang Z, Xiong S (2020) An Unsupervised Sentiment Classification method based on Multi-level Fuzzy Computing and Multi-criteria Fusion. IEEE Access 8:145422–145434

    Article  Google Scholar 

  11. Cristin R (2020) Hybridized Algorithm: Spectrum Sensing and Minimization of PAPR in the MIMO System. J Netw Commun Syst 3(2):18–26

  12. Zhou X, Liang W, Huang S, Fu M (2019) Social recommendation with large-scale group decision-making for cyber-enabled online service. IEEE Trans Comput Soc Syst 6(5):1073–1082

    Article  Google Scholar 

  13. Jin N, Jiaxian W, Ma X, Yan K, Mo Y (2020) Multi-task learning model based on Multi-scale CNN and LSTM for sentiment classification. IEEE Access 8:77060–77072

    Article  Google Scholar 

  14. Zhou X, Liang W, Kevin I, Wang K, Shimizu S (2019) Multi-modality behavioral influence analysis for personalized recommendations in health social media environment. IEEE Trans Comput Soc Syst 6(5):888–897

    Article  Google Scholar 

  15. Ravikumar S, Vennila H, Deepak R (2019) Optimal Positioning of Distributed Generator using Hybrid Optimization algorithm in Radial Distribution System. J Comput Mech Power Syst Control 2(4):1–9

    Article  Google Scholar 

  16. Kayum SN, Alsalim H, Tonellot T-L, Momin A (2020) A Fault Tolerant Implementation for a Massively Parallel Seismic Framework. 2020 IEEE High Performance Extreme Computing Conference (HPEC), pp. 1–8

  17. Kayum S, Rogowski M (2019) High-Performance Computing Applications Transition to the Cloud in Upstream. Fourth EAGE Workshop on High Performance Computing for Upstream 2019 2019(1):1–5

    Google Scholar 

  18. Wang Z, Joo V, Tong C, Xin X, Chin HC (2014) “Anomaly detection through enhanced sentiment analysis on social media data”, In proceedings of 2014 IEEE 6th international conference on cloud computing technology and science, pp. 917–922

  19. Wang Z, Lin Z (2020) Optimal Feature Selection for Learning-Based Algorithms for Sentiment Classification. Cogn Comput 12(1):238–248

    Article  Google Scholar 

  20. Cambria E, Hussain A, Durrani T, Havasi C, Eckl C, Munro J (2010) “Sentic computing for patient centered applications”, In proceedings of IEEE 10th International Conference on Signal Processing Proceedings, pp.1279–1282

  21. Zainuddin N, Selamat A, Ibrahim R (2017) Hybrid sentiment classification on Twitter aspect-based sentiment analysis. Appl Intell 48(5):1218–1232

    Google Scholar 

  22. Rasool A, Tao R, Kamyab M, Hayat S (2020) GAWA-A Feature Selection Method for Hybrid Sentiment Classification. IEEE Access 8:191850–191861

    Article  Google Scholar 

  23. Kalaivani P, Shunmuganathan KL (2015) Feature reduction based on genetic algorithm and hybrid model for opinion mining. Scientific Programming 2015:12

  24. Lai S, Xu L, Liu K, Zhao J (2015) Recurrent convolutional neural networks for text classification, In proceedings of Twenty-ninth AAAI conference on artificial intelligence

  25. Zhao C, Wangb S, Li D (2020) Multi-source domain adaptation with joint learning for cross-domain sentiment classification. Knowl-Based Syst 191:105254

    Article  Google Scholar 

  26. Oyebode O, Alqahtani F, Orji R (2020) Using machine learning and thematic analysis methods to evaluate mental health apps based on user reviews. IEEE Access 8:111141–111158

    Article  Google Scholar 

  27. Shelke NM, Deshpande S, Thakre V (2017) Exploiting expectation maximization algorithm for sentiment analysis of product reviews, In proceedings of 2017 International Conference on Inventive Communication and Computational Technologies (ICICCT), pp.390–396

  28. Darekar RV, Dhande AP (2019) Emotion Recognition from Speech Signals Using DCNN with Hybrid GA-GWO Algorithm. Multimedia Res 2(4):12–22

    Google Scholar 

  29. Liu G, Xu X, Deng B, Chen S, Li L (2016) A hybrid method for bilingual text sentiment classification based on deep learning, In proceedings of 2016 17th IEEE/ACIS International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing (SNPD), pp. 93–98

  30. UmutSalur M, Aydin I (2020) A Novel Hybrid Deep Learning Model for Sentiment Classification. IEEE Access 8:58080–58093

    Article  Google Scholar 

  31. Wint ZZ, Manabe Y, Aritsugi M (2018) Deep learning-based sentiment classification in social network services datasets, In proceedings of 2018 IEEE International Conference on Big Data, Cloud Computing, Data Science & Engineering (BCD), pp. 91–96

  32. Yang Z, Yang D, Dyer C, He X, Smola A and Hovy E (2016) Hierarchical attention networks for document classification, In Proceedings of the 2016 conference of the North American chapter of the association for computational linguistics: human language technologies, pp. 1480–1489

  33. HAN architecture taken from, “https://github.com/kk7nc/Text_Classification#hierarchical-attention-networks”, for sentiment classification, Accessed on December 2020

  34. Ranjan NM, Prasad RS (2018) LFNN: Lion fuzzy neural network-based evolutionary model for text classification using context and sense-based features. Appl Soft Comput 71:994–1008

    Article  Google Scholar 

  35. Cheng R, Jin Y (2014) A Competitive Swarm Optimizer for Large Scale Optimization. IEEE Trans Cybern 45(2):191–204

    Article  Google Scholar 

  36. Zheng YJ (2015) Water wave optimization: a new nature-inspired metaheuristics. Comput Oper Res 55:1–11

    Article  MathSciNet  Google Scholar 

  37. Ghosh M, Kar A (2013) Unsupervised linguistic approach for sentiment classification from online reviews using SentiWordNet 3.0. Int J Eng Res Technol 2(9):55–60

  38. Raab C, Heusinger M, Schleif F-M (2020) Reactive Soft Prototype Computing for Concept Drift Streams, arXiv:2007.05432v1, Neurocomputing 2020. https://doi.org/10.48550/arXiv.2007.05432

  39. Consumer Reviews of Amazon Product dataset taken from “https://www.kaggle.com/datafiniti/consumer-reviews-of-amazon-products”, accessed on December 2020

  40. Large Movie Review Dataset taken from “http://ai.stanford.edu/~amaas/data/sentiment/”, accessed on December 2020

Download references

Author information

Authors and Affiliations

  1. Computer Science and Engineering, Kongu Engineering College, Erode, India

    R. S. Mohana & N. Sasipriyaa

  2. Computer Technology–UG, Kongu Engineering College, Erode, India

    S. Kalaiselvi

Authors
  1. R. S. Mohana
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. S. Kalaiselvi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. N. Sasipriyaa
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to R. S. Mohana.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Mohana, R.S., Kalaiselvi, S. & Sasipriyaa, N. Contextual Features and Optimal Hierarchical Attention Networks for Sentiment Classification Under Data Streaming Environment. Mobile Netw Appl 27, 1995–2009 (2022). https://doi.org/10.1007/s11036-022-01970-2

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11036-022-01970-2

Keywords

Search

Navigation