Skip to main content
SpringerLink
Log in

A data aggregation based approach to exploit dynamic spatio-temporal correlations for citywide crowd flows prediction in fog computing

  • 1194: Secured and Efficient Convergence of Artificial Intelligence and Internet of Things
  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Accurate and timely predicting citywide traffic crowd flows precisely is crucial for public safety and traffic management in smart cities. Nevertheless, its crucial challenge lies in how to model multiple complicated spatial dependencies between different regions, dynamic temporal laws among different time intervals with external factors such as holidays, events, and weather. Some existing work leverage the long short-term memory (LSTM) and convolutional neural network (CNN) to explore temporal relations and spatial relations, respectively; which have outperformed the classical statistical methods. However, it is difficult for these approaches to jointly model spatial and temporal correlations. To address this problem, we propose a dynamic deep hybrid spatio-temporal neural network namely DHSTNet, to predict traffic flows in every region of a city with high accuracy. In particular, our DSHTNet model comprises four properties i.e., closeness volume, daily volume, trend volume, and external branch, respectively. Moreover, the projected model dynamically assigns different weights to various branches and, then, integrate outputs of four properties to produce final prediction outcomes. The model has been evaluated, both for offline and online predictions, using an edge/fog infrastructure where training happens on the remote cloud and prediction occurs at the edge i.e. in the proximity of users. Extensive experiments and evaluation on two real-world datasets demonstrate the advantage of the proposed model, in terms of high accuracy over prevailing state-of-the-art baseline methods. Moreover, we apply the exaggeration approach based on an attention mechanism to the above model, called as AAtt-DHSTNet; to predict citywide short-term traffic crowd flows; and show its notable performance in the traffic flows prediction. The aggregation method collects information from the related time series, remove redundancy and, thus, increases prediction speed and accuracy. Our empirical evaluation suggests that the AAtt-DHSTNet model is approximately 20.8% and 8.8% more accurate than the DHSTNet technique, for two different real-world traffic datasets.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15

Similar content being viewed by others

References

  1. Abadi A, Rajabioun T, Ioannou PA, et al. (2015) Traffic flow prediction for road transportation networks with limited traffic data. IEEE Trans Intell Transp Syst 16(2):653–662

    Google Scholar 

  2. Abdulhai B, Porwal H, Recker W (2002) Short-term traffic flow prediction using neuro-genetic algorithms. ITS J Intell Transp Syst J 7(1):3–41

    Article  Google Scholar 

  3. Ali A, Zhu Y, Chen Q, Yu J, Cai H (2019) Leveraging spatio-temporal patterns for predicting citywide traffic crowd flows using deep hybrid neural networks. In: 2019 IEEE 25th international conference on parallel and distributed systems, ICPADS, IEEE, pp 125–132

  4. Altché F, de La Fortelle A (2017) An lstm network for highway trajectory prediction. In: 2017 IEEE 20th international conference on intelligent transportation systems, ITSC, IEEE, pp 353–359

  5. Ashish V, Noam S, Niki P, Jakob U, Llion J, Gomez AN, Kaiser Ł, Polosukhin I (2017) attention is all you need, Advances in Neural Information Processing Systems (NIPS). In: Guyon I, Luxburg UV, Bengio S, Wallach H, Fergus R, Vishwanathan S, Garnett R (eds) Curran Associates, Inc 5998–6008

  6. Bahdanau D, Cho K, Bengio Y Neural machine translation by jointly learning to align and translate. arXiv:1409.0473

  7. Bahdanau D, Chorowski J, Serdyuk D, Brakel P, Bengio Y (2016) End-to-end attention-based large vocabulary speech recognition. In: 2016 IEEE international conference on acoustics, speech and signal processing, ICASSP, IEEE, pp 4945–4949

  8. Chandra SR, Al-Deek H (2009) Predictions of freeway traffic speeds and volumes using vector autoregressive models. J Intell Transp Syst 13(2):53–72

    Article  Google Scholar 

  9. Chen W, An J, Li R, Fu L, Xie G, Bhuiyan MZA, Li K (2018) A novel fuzzy deep-learning approach to traffic flow prediction with uncertain spatial–temporal data features. Futur Gener Comput Syst 89:78–88

    Article  Google Scholar 

  10. Chen P-T, Chen F, Qian Z (2014) Road traffic congestion monitoring in social media with hinge-loss markov random fields. In: 2014 IEEE international conference on data mining, IEEE, pp 80–89

  11. Chen T, Guestrin C (2016) Xgboost: A scalable tree boosting system. In: Proceedings of the 22nd acm sigkdd international conference on knowledge discovery and data mining, ACM, pp 785–794

  12. Chen C, Li K, Ouyang A, Tang Z, Li K (2017) Gpu-accelerated parallel hierarchical extreme learning machine on flink for big data. IEEE Trans Syst Man Cybern Syst 47(10):2740–2753

    Article  Google Scholar 

  13. Chen C, Li K, Teo SG, Chen G, Zou X, Yang X, Vijay RC, Feng J, Zeng Z (2018) Exploiting spatio-temporal correlations with multiple 3d convolutional neural networks for citywide vehicle flow prediction. In: 2018 IEEE international conference on data mining, ICDM, IEEE, pp 893–898

  14. Chen C, Li K, Teo SG, Zou X, Li K, Zeng Z (2020) Citywide traffic flow prediction based on multiple gated spatio-temporal convolutional neural networks. ACM Transactions on Knowledge Discovery from Data (TKDD) 14(4):1–23

    Article  Google Scholar 

  15. Chen C, Li K, Teo SG, Zou X, Wang K, Wang J, Zeng Z (2019) Gated residual recurrent graph neural networks for traffic prediction. In: Proceedings of the AAAI conference on artificial intelligence, Vol 33, pp 485–492

  16. Cho K, Van Merriënboer B, Gulcehre C, Bahdanau D, Bougares F, Schwenk H, Bengio Y Learning phrase representations using rnn encoder-decoder for statistical machine translation. arXiv:1406.1078

  17. Chorowski JK, Bahdanau D, Serdyuk D, Cho K, Bengio Y (2015) Attention-based models for speech recognition. In: Advances in neural information processing systems, pp 577–585

  18. Das M, Ghosh SK (2019) Fb-step: a fuzzy bayesian network based data-driven framework for spatio-temporal prediction of climatological time series data. Expert Syst Appl 117:211–227

    Article  Google Scholar 

  19. Feng X, Guo J, Qin B, Liu T, Liu Y (2017) Effective deep memory networks for distant supervised relation extraction. In: IJCAI, pp. 4002–4008

  20. Gillam L, Katsaros K, Dianati M, Mouzakitis A (2018) Exploring edges for connected and autonomous driving, in: IEEE INFOCOM 2018-IEEE conference on computer communications workshops, INFOCOM WKSHPS, IEEE, pp 148–153

  21. Glorot X, Bengio Y (2010) Understanding the difficulty of training deep feedforward neural networks. In: Proceedings of the thirteenth international conference on artificial intelligence and statistics, pp 249–256

  22. Graves A, Mohamed A-r, Hinton G (2013) Speech recognition with deep recurrent neural networks. In: 2013 IEEE international conference on acoustics, speech and signal processing, IEEE, pp 6645–6649

  23. Jain A, Zamir AR, Savarese S, Saxena A (2016) Structural-rnn: Deep learning on spatio-temporal graphs. In: Proceedings of the ieee conference on computer vision and pattern recognition, pp 5308–5317

  24. Jeong Y-S, Byon Y-J, Castro-Neto MM, Easa SM (2013) Supervised weighting-online learning algorithm for short-term traffic flow prediction. IEEE Trans Intell Transp Syst 14(4):1700–1707

    Article  Google Scholar 

  25. Khan AA, Zakarya M, Khan R (2019) Energy-aware dynamic resource management in elastic cloud datacenters. Simul Model Pract Theory 92:82–99

    Article  Google Scholar 

  26. Khan AA, Zakarya M, Khan R, Rahman IU, Khan M et al (2020) An energy, performance efficient resource consolidation scheme for heterogeneous cloud datacenters. J Netw Comput Appl 150:102497

    Article  Google Scholar 

  27. Kingma DP, Ba J Adam: A method for stochastic optimization. arXiv:1412.6980

  28. Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. In: Advances in neural information processing systems, pp 1097–1105

  29. Li X, Pan G, Wu Z, Qi G, Li S, Zhang D, Zhang W, Wang Z (2012) Prediction of urban human mobility using large-scale taxi traces and its applications. Front Comput Sci 6(1):111–121

    MathSciNet  Google Scholar 

  30. Liang Y, Ke S, Zhang J, Yi X, Zheng Y (2018) Geoman: Multi-level attention networks for geo-sensory time series prediction. In: IJCAI, pp 3428–3434

  31. Lippi M, Bertini M, Frasconi P (2013) Short-term traffic flow forecasting: an experimental comparison of time-series analysis and supervised learning. IEEE Trans Intell Transp Syst 14(2):871–882

    Article  Google Scholar 

  32. Lv Y, Duan Y, Kang W, Li Z, Wang F-Y (2014) Traffic flow prediction with big data: a deep learning approach. IEEE Trans Intell Transp Syst 16(2):865–873

    Google Scholar 

  33. Ma X, Dai Z, He Z, Ma J, Wang Y, Wang Y (2017) Learning traffic as images: a deep convolutional neural network for large-scale transportation network speed prediction. Sensors 17(4):818

    Article  Google Scholar 

  34. Man-Chun T, Jian-Min X, Zong-Yuan M Traffic flow modelling and on-ramp optimal control in freeways. China Journal of Highway and Transport 13(4) 83–85

  35. Man-Chun T, Luo-Bin F, Jian-Min X Traffic flow prediction based on hybrid arima and ann model, China Journal of Highway and Transport 4(86) 118–121

  36. Moreira-Matias L, Gama J, Ferreira M, Mendes-Moreira J, Damas L (2013) Predicting taxi–passenger demand using streaming data. IEEE Trans Intell Transp Syst 14(3):1393–1402

    Article  Google Scholar 

  37. Shekhar S, Williams BM (2007) Adaptive seasonal time series models for forecasting short-term traffic flow. Transp Res Rec 2024(1):116–125

    Article  Google Scholar 

  38. Sun S, Zhang C, Yu G (2006) A bayesian network approach to traffic flow forecasting. IEEE Trans Intell Transp Syst 7(1):124–132

    Article  Google Scholar 

  39. Sutskever I, Martens J, Hinton GE (2011) Generating text with recurrent neural networks. In: Proceedings of the 28th international conference on machine learning (ICML-11), pp 1017–1024

  40. Tong Y, Chen Y, Zhou Z, Chen L, Wang J, Yang Q, Ye J, Lv W (2017) The simpler the better: a unified approach to predicting original taxi demands based on large-scale online platforms. In: Proceedings of the 23rd ACM SIGKDD international conference on knowledge discovery and data mining, ACM, pp 1653–1662

  41. Van Lint J, Van Hinsbergen C (2012) Short-term traffic and travel time prediction models. Artific Intell Appl Critical Transp Issues 22(1):22–41

    Google Scholar 

  42. Vinyals O, Ravuri SV, Povey D (2012) Revisiting recurrent neural networks for robust asr. In: 2012 IEEE international conference on acoustics, speech and signal processing, ICASSP, IEEE, pp 4085–4088

  43. Wang H, Wang N, Yeung D-Y (2015) Collaborative deep learning for recommender systems. In: Proceedings of the 21th ACM SIGKDD international conference on knowledge discovery and data mining, pp 1235–1244

  44. Wei H, Wang Y, Wo T, Liu Y, Xu J (2016) Zest: a hybrid model on predicting passenger demand for chauffeured car service. In: Proceedings of the 25th ACM international on conference on information and knowledge management, ACM, pp 2203–2208

  45. Williams BM, Hoel LA (2003) Modeling and forecasting vehicular traffic flow as a seasonal arima process: Theoretical basis and empirical results. J Transp Eng 129(6):664–672

    Article  Google Scholar 

  46. Williams RJ, Zipser D (1989) A learning algorithm for continually running fully recurrent neural networks. Neural Comput 1(2):270–280

    Article  Google Scholar 

  47. Wu Y, Tan H Short-term traffic flow forecasting with spatial-temporal correlation in a hybrid deep learning framework. arXiv:1612.01022

  48. Xingjian S, Chen Z, Wang H, Yeung D-Y, Wong W-K, Woo W-c (2015) Convolutional lstm network: A machine learning approach for precipitation nowcasting. In: Advances in neural information processing systems, pp 802–810

  49. Xiong C, Merity S, Socher R (2016) Dynamic memory networks for visual and textual question answering. In: International conference on machine learning, pp 2397–2406

  50. Xu K, Ba J, Kiros R, Cho K, Courville A, Salakhudinov R, Zemel R, Bengio Y (2015) Show, attend and tell: Neural image caption generation with visual attention. In: International conference on machine learning, pp 2048–2057

  51. Xu Z, Wang Y, Long M, Wang J, KLiss M (2018) Predcnn: Predictive learning with cascade convolutions. In: IJCAI, pp 2940–2947

  52. Yang Z, Yuan Y, Wu Y, Cohen WW, Salakhutdinov RR (2016) Review networks for caption generation. In: Advances in neural information processing systems, pp 2361–2369

  53. Yao H, Tang X, Wei H, Zheng G, Yu Y, Li Z Modeling spatial-temporal dynamics for traffic prediction. arXiv:1803.01254

  54. Yao H, Tang X, Wei H, Zheng G, Yu Y, Li Z Modeling spatial-temporal dynamics for traffic prediction, arXiv:1803.01254

  55. Yao H, Tang X, Wei H, Zheng G, Li Z (2019) Revisiting spatial-temporal similarity: A deep learning framework for traffic prediction. In: Proceedings of the AAAI conference on artificial intelligence, Vol 33, pp 5668–5675

  56. Yu R, Li Y, Shahabi C, Demiryurek U, Liu Y (2017) Deep learning: a generic approach for extreme condition traffic forecasting. In: Proceedings of the 2017 SIAM International Conference on Data Mining, SIAM, pp 777–785

  57. Zakarya M, Gillam L (2019) Managing energy, performance and cost in large scale heterogeneous datacenters using migrations. Futur Gener Comput Syst 93:529–547

    Article  Google Scholar 

  58. Zeng Z, Xulei Y, Qiyun Y, Meng Y, Le Z (2019) Sese-net: Self-supervised deep learning for segmentation. Pattern Recogn Lett 128:23–29

    Article  Google Scholar 

  59. Zhang L, Shi Z, Cheng M-M, Liu Y, Bian J-W, Zhou JT, Zheng G, Zeng Z Nonlinear regression via deep negative correlation learning. IEEE Transactions on Pattern Analysis and Machine Intelligence

  60. Zhang J, Wang F-Y, Wang K, Lin W-H, Xu X, Chen C (2011) Data-driven intelligent transportation systems: a survey. IEEE Trans Intell Transp Syst 12(4):1624–1639

    Article  Google Scholar 

  61. Zhang J, Zheng Y, Qi D (2017) Deep spatio-temporal residual networks for citywide crowd flows prediction. In: AAAI, pp 1655–1661

  62. Zhang J, Zheng Y, Qi D, Li R, Yi X (2016) Dnn-based prediction model for spatio-temporal data. In: Proceedings of the 24th ACM SIGSPATIAL international conference on advances in geographic information systems, ACM, pp 92

  63. Zhang J, Zheng Y, Qi D, Li R, Yi X, Li T (2018) Predicting citywide crowd flows using deep spatio-temporal residual networks. Artif Intell 259:147–166

    Article  MathSciNet  Google Scholar 

  64. Zhang J, Zheng Y, Sun J, Qi D (2019) Flow prediction in spatio-temporal networks based on multitask deep learning. IEEE Transactions on Knowledge and Data Engineering

  65. Zhou Y, Li J, Chen H, Wu Y, Wu J, Chen L (2020) A spatiotemporal attention mechanism-based model for multi-step citywide passenger demand prediction. Inf Sci 513:372–385

    Article  Google Scholar 

  66. Zivot E, Wang J (2006) Vector autoregressive models for multivariate time series. Modeling Financial Time Series with S-Plus®, pp 385–429

Download references

Acknowledgements

This research is financially supported, in part, by the National Key Research and Development Program (No. 2018AAA0100503, No. 2018AAA0100500), National Science Foundation of China (No. 61772341, No. 61472254, No. 61772338 and No. 61672240), Shanghai Municipal Science and Technology Commission (No. 18511103002, No. 19510760500, 19511101500), the Innovation and Entrepreneurship Foundation for overseas high-level talents of Shenzhen (No. KQJSCX20180329191021388), the Program for Changjiang Young Scholars in the University of China, the Program for China Top Young Talents, the Program for Shanghai Top Young Talents, Shanghai Engineering Research Center of Digital Education Equipment, and SJTU Global Strategic Partnership Fund (2019 SJTU-HKUST).

Author information

Authors and Affiliations

  1. Department of Computer Science and Engineering, Shanghai Jiao Tong University, Minhang District, China

    Ahmad Ali & Yanmin Zhu

  2. Department of Computer Science, Abdul Wali Khan University, Mardan, Pakistan

    Muhammad Zakarya

Authors
  1. Ahmad Ali
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yanmin Zhu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Muhammad Zakarya
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding authors

Correspondence to Yanmin Zhu or Muhammad Zakarya.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

This paper is an extended version of our manuscript [3], which was presented at the 2019 IEEE 25th international Conference on Parallel and Distributed Systems (ICPADS); and has appeared in the IEEE conference proceedings.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ali, A., Zhu, Y. & Zakarya, M. A data aggregation based approach to exploit dynamic spatio-temporal correlations for citywide crowd flows prediction in fog computing. Multimed Tools Appl 80, 31401–31433 (2021). https://doi.org/10.1007/s11042-020-10486-4

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-020-10486-4

Keywords

Search

Navigation