Skip to main content

Advertisement

SpringerLink
Log in

Air pollution prediction based on factory-aware attentional LSTM neural network

  • Regular Paper
  • Published:
Computing Aims and scope Submit manuscript

Abstract

With air quality issues becoming ever greater global concerns, many countries are facing numerous air pollution problems. Among all the particulate matter of air pollution, PM2.5 (whose aerodynamic diameter is 2.5 μm or less) is of particular concern. Long-term exposure to high concentrations of PM2.5 can negatively affect human health. The negative effects of PM2.5 make forecast its concentration an urgent need. In this paper, we propose a novel Factory-aware Attentional LSTM Model (FAA-LSTM) for PM2.5 air pollution predictions. The proposed model collects air pollution data from both the monitor stations and micro air quality sensors, in which a spatial transformation is designed to obtain the local area data of PM2.5 grids. Next, a novel factory-aware attention mechanism over a long short-term memory (LSTM) neural network is proposed to extract the hidden features of industrial factors and derive their factory attention weights on the influences of PM2.5 concentrations. The influence of neighboring factory data over local PM2.5 grids can be weighted to discover the importance of PM2.5 concentrations of neighboring areas. Moreover, the model combines these heterogeneous data and the global station data to forecast PM2.5 concentrations. The experiment’s evaluation is conducted using both air pollution data and industrial data. The results show that the factory-aware attention mechanism helps to improve the prediction performance by exploring the effect of the factory distribution on PM2.5 pollutants in the local areas. While monitoring stations have been established to collect air quality information and forecast air quality, few studies have taken the different monitoring areas and industrial features into account. The proposed novel model considering PM2.5 concentrations from local neighboring areas and global station, and industrial data as features can effectively indicate the impact of PM2.5 pollution with industrial emissions and spatial relationships. Our research work can improve the prediction accuracy of PM2.5 and contribute to increasing the practical value for air quality management.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

References

  1. Akimoto H (2003) Global air quality and pollution. Science 302(5651):1716–1719

    Article  Google Scholar 

  2. Song C, He J, Wu L, Jin T, Chen X, Li R, Ren P, Zhang L, Mao H (2017) Health burden attributable to ambient PM2.5 in China. Environ Pollut 223:575–586

    Article  Google Scholar 

  3. Xing Y-F, Xu Y-H, Shi M-H, Lian Y-X (2016) The impact of PM2.5 on the human respiratory system. J Thorac Dis 8(1):E69

    Google Scholar 

  4. Huang P, Zhang J, Tang Y, Liu L (2015) Spatial and temporal distribution of PM2.5 pollution in Xi’an City, China. Int J Environ Res Public Health 12(6):6608–6625

    Article  Google Scholar 

  5. Zheng Y, Yi X, Li M, Li R, Shan Z, Chang E, Li T (2015) Forecasting fine-grained air quality based on big data. In: Proceedings of the 21th ACM SIGKDD international conference on knowledge discovery and data mining 2015. ACM, pp 2267–2276

  6. Yi X, Zhang J, Wang Z, Li T, Zheng Y (2018) Deep distributed fusion network for air quality prediction. In: Proceedings of the 24th ACM SIGKDD International conference on knowledge discovery & data mining, London, United Kingdom, pp 965–973

  7. Gocheva-Ilieva SG, Ivanov AV, Voynikova DS, Boyadzhiev DT (2014) Time series analysis and forecasting for air pollution in small urban area: an SARIMA and factor analysis approach. Stoch Env Res Risk Assess 28(4):1045–1060

    Article  Google Scholar 

  8. Ho C-H, Chang P-T, Hung K-C, Lin K-P (2019) Developing intuitionistic fuzzy seasonality regression with particle swarm optimization for air pollution forecasting. Ind Manag Data Syst 119:561–577

    Article  Google Scholar 

  9. Chen Y (2018) Prediction algorithm of PM2.5 mass concentration based on adaptive BP neural network. Computing 100(8):825–838

    Article  Google Scholar 

  10. Suleiman A, Tight M, Quinn A (2019) Applying machine learning methods in managing urban concentrations of traffic-related particulate matter (PM10 and PM2.5). Atmos Pollut Res 10(1):134–144

    Article  Google Scholar 

  11. Hao Y, Tian C (2019) The study and application of a novel hybrid system for air quality early-warning. Appl Soft Comput 74:729–746

    Article  MathSciNet  Google Scholar 

  12. Lin Y-C, Lee S-J, Ouyang C-S, Wu C-H (2020) Air quality prediction by neuro-fuzzy modeling approach. Appl Soft Comput 86:105898

    Article  Google Scholar 

  13. Witten IH, Frank E, Hall MA, Pal CJ (2017) Data mining: practical machine learning tools and techniques. Morgan Kaufmann, Los Altos

    Google Scholar 

  14. Zhang D, Woo SS (2020) Real time localized air quality monitoring and prediction through mobile and fixed IoT sensing network. IEEE Access 8:89584–89594

    Article  Google Scholar 

  15. Motlagh NH, Lagerspetz E, Nurmi P, Li X, Varjonen S, Mineraud J, Siekkinen M, Rebeiro-Hargrave A, Hussein T, Petaja T (2020) Toward massive scale air quality monitoring. IEEE Commun Mag 58(2):54–59

    Article  Google Scholar 

  16. Li X, Peng L, Yao X, Cui S, Hu Y, You C, Chi T (2017) Long short-term memory neural network for air pollutant concentration predictions: Method development and evaluation. Environ Pollut 231:997–1004

    Article  Google Scholar 

  17. Kang GK, Gao JZ, Chiao S, Lu S, Xie G (2018) Air quality prediction: big data and machine learning approaches. Int J Environ Sci Dev 9(1):8–16

    Article  Google Scholar 

  18. Ehrlich C, Noll G, Kalkoff W-D, Baumbach G, Dreiseidler A (2007) PM10, PM2.5 and PM1.0—emissions from industrial plants—results from measurement programmes in Germany. Atmos Environ 41(29):6236–6254

    Article  Google Scholar 

  19. Rodrıguez S, Querol X, Alastuey A, Viana M-M, Alarcon M, Mantilla E, Ruiz C (2004) Comparative PM10–PM2.5 source contribution study at rural, urban and industrial sites during PM episodes in Eastern Spain. Sci Total Environ 328(1–3):95–113

    Article  Google Scholar 

  20. Chan KY, Jian L (2013) Identification of significant factors for air pollution levels using a neural network based knowledge discovery system. Neurocomputing 99:564–569

    Article  Google Scholar 

  21. Hu D, Jiang J (2013) A study of smog issues and PM2.5 pollutant control strategies in China. J Environ Prot 4(07):746

    Article  Google Scholar 

  22. Querol X, Alastuey A, Moreno T, Viana M, Castillo S, Pey J, Rodríguez S, Artiñano B, Salvador P, Sánchez M (2008) Spatial and temporal variations in airborne particulate matter (PM10 and PM2.5) across Spain 1999–2005. Atmos Environ 42(17):3964–3979

    Article  Google Scholar 

  23. Jerrett M, Burnett RT, Ma R, Pope CA III, Krewski D, Newbold KB, Thurston G, Shi Y, Finkelstein N, Calle EE (2005) Spatial analysis of air pollution and mortality in Los Angeles. Epidemiology 16:727–736

    Article  Google Scholar 

  24. Kracht O, Parravicini F, Gerboles M (2015) Temporal trends of spatial correlation within the PM10 time series of the AirBase ambient air quality database. Int J Environ Pollut 58(1–2):63–78

    Article  Google Scholar 

  25. Kurt A, Oktay AB (2010) Forecasting air pollutant indicator levels with geographic models 3 days in advance using neural networks. Expert Syst Appl 37(12):7986–7992

    Article  Google Scholar 

  26. Li C, Hsu NC, Tsay S-C (2011) A study on the potential applications of satellite data in air quality monitoring and forecasting. Atmos Environ 45(22):3663–3675

    Article  Google Scholar 

  27. Nieto PG, Combarro EF, del Coz Díaz J, Montañés E (2013) A SVM-based regression model to study the air quality at local scale in Oviedo urban area (Northern Spain): a case study. Appl Math Comput 219(17):8923–8937

    Google Scholar 

  28. Lal B, Tripathy SS (2012) Prediction of dust concentration in open cast coal mine using artificial neural network. Atmos Pollut Res 3(2):211–218

    Article  Google Scholar 

  29. Lu W, Wang W, Leung AY, Lo S-M, Yuen RK, Xu Z, Fan H (2020) Air pollutant parameter forecasting using support vector machines. In: Neural Networks, 2002. IJCNN'02. Proceedings of the 2002 international joint conference on 2002. IEEE, pp 630–635

  30. Ali S, Dacey S (2017) Online scalable SVM ensemble learning method (OSSELM) for spatio-temporal air pollution analysis. Int J Data Min Knowl Manag Process 7:21–38

    Article  Google Scholar 

  31. Grivas G, Chaloulakou A (2006) Artificial neural network models for prediction of PM10 hourly concentrations, in the Greater Area of Athens, Greece. Atmos Environ 40(7):1216–1229

    Article  Google Scholar 

  32. Zhang C, Yan J, Li C, Rui X, Liu L, Bie R (2016) On estimating air pollution from photos using convolutional neural network. In: Proceedings of the 2016 ACM on multimedia conference 2016. ACM, pp 297–301

  33. Biancofiore F, Busilacchio M, Verdecchia M, Tomassetti B, Aruffo E, Bianco S, Di Tommaso S, Colangeli C, Rosatelli G, Di Carlo P (2017) Recursive neural network model for analysis and forecast of PM10 and PM2.5. Atmos Pollut Res 8(4):652–659

    Article  Google Scholar 

  34. Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput 9(8):1735–1780

    Article  Google Scholar 

  35. Sutskever I, Vinyals O, Le QV (2014) Sequence to sequence learning with neural networks. In: Advances in neural information processing systems 2014, pp 3104–3112

  36. Chen K, Zhou Y, Dai F (2015) A LSTM-based method for stock returns prediction: a case study of China stock market. In: 2015 IEEE international conference on big data (Big Data) 2015. IEEE, pp 2823–2824

  37. Zhao J, Deng F, Cai Y, Chen J (2019) Long short-term memory-fully connected (LSTM-FC) neural network for PM2.5 concentration prediction. Chemosphere 220:486–492

    Article  Google Scholar 

  38. Wen C, Liu S, Yao X, Peng L, Li X, Hu Y, Chi T (2019) A novel spatiotemporal convolutional long short-term neural network for air pollution prediction. Sci Total Environ 654:1091–1099

    Article  Google Scholar 

  39. Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser Ł, Polosukhin I (2017) Attention is all you need. In: Advances in neural information processing systems 2017, pp 6000–6010

  40. Yang Z, Yang D, Dyer C, He X, Smola A, Hovy E (2016) Hierarchical attention networks for document classification. In: Proceedings of the 2016 conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies 2016, pp 1480–1489

  41. Xie J, Hou Y, Wang Y, Wang Q, Li B, Lv S, Vorotnitsky YI (2020) Chinese text classification based on attention mechanism and feature-enhanced fusion neural network. Computing 102(3):683–700

  42. Cheng W, Shen Y, Zhu Y, Huang L (2018) A neural attention model for urban air quality inference: learning the weights of monitoring stations. In: The thirty-second AAAI conference on artificial intelligence 2018

Download references

Acknowledgements

This research was conducted in collaboration with CAMEO InfoTech Inc., and was supported by the Ministry of Science and Technology of Taiwan under Grant No. MOST 108-2410-H-009-046-MY2.

Author information

Authors and Affiliations

  1. Institute of Information Management, National Chiao Tung University, Hsinchu City, Taiwan

    Duen-Ren Liu, Yi-Kuan Hsu & Huan-Jian Jau

  2. Department of Materials Science and Engineering, National Chiao Tung University, Hsinchu City, Taiwan

    Hsing-Yu Chen

Authors
  1. Duen-Ren Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yi-Kuan Hsu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Hsing-Yu Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Huan-Jian Jau
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Duen-Ren Liu.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Liu, DR., Hsu, YK., Chen, HY. et al. Air pollution prediction based on factory-aware attentional LSTM neural network. Computing 103, 75–98 (2021). https://doi.org/10.1007/s00607-020-00849-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00607-020-00849-y

Keywords

Mathematics Subject Classification

Search

Navigation