Skip to main content

Advertisement

SpringerLink
Log in

Integrating simulation and signal processing in tracking complex social systems

  • S.I. : SBP-BRIMS2017
  • Published:
Computational and Mathematical Organization Theory Aims and scope Submit manuscript

Abstract

Data that continuously track the dynamics of large populations have the potential to revolutionize how we study complex social systems. However, coping with massive, noisy, unstructured, and disparate data streams is not easy. In this paper, we describe a particle filter algorithm that integrates signal processing and simulation modeling to study complex social systems using massive, noisy, unstructured data. This integration enables researchers to specify and track the dynamics of real-world complex social systems by building a simulation model. To show the effectiveness of this algorithm, we infer city-scale traffic dynamics from the observed trajectories of a small number of probe vehicles uniformly sampled from the system. The results show that our model can not only track and predict human mobility, but also explain how traffic is generated through the movements of individual vehicles. The algorithm and its application point to a new way of bringing together modelers and data miners to turn the real world into a living lab.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

Notes

  1. Code and data are available at https://goo.gl/vOu8HH.

  2. A video animation is available at https://goo.gl/OLmDYW. Two web-based animations are available at https://goo.gl/8qkC7h; https://goo.gl/dGvFbz. Click Play button at the upper left corner to begin the animation.

References

  • Bales RF (1950) Interaction process analysis; a method for the study of small groups. Addison-Wesley, Cambridge

    Google Scholar 

  • Batty M (2007) Cities and complexity: understanding cities with cellular automata, agent-based models, and fractals. MIT Press, Cambridge

    Google Scholar 

  • Blondel VD, Decuyper A, Krings G (2015) A survey of results on mobile phone datasets analysis. EPJ Data Sci 4(1):10

    Article  Google Scholar 

  • Borgatti SP (2006) Identifying sets of key players in a social network. Comput Math Org Theory 12(1):21–34

    Article  Google Scholar 

  • Borshchev A (2013) The big book of simulation modeling: multimethod modeling with anylogic 6. AnyLogic North America, Chicago

    Google Scholar 

  • Boyen X (2002) Inference and learning in complex stochastic processes. Ph.D. thesis, Stanford University

  • Castellano C, Fortunato S, Loreto V (2009) Statistical physics of social dynamics. Rev Mod Phys 81(2):591–646

    Article  Google Scholar 

  • Cioffi-Revilla C (2014) Introduction to computational social science, vol 10. Springer, New York, pp 978–1

    Book  Google Scholar 

  • de Montjoye YA, Smoreda Z, Trinquart R, Ziemlicki C, Blondel VD (2014) D4D-Senegal: the second mobile phone data for development challenge. arXiv:1407.4885

  • Del Moral P (2004) Feynman-Kac formulae: genealogical and interacting particle systems with applications. Springer, New York

    Book  Google Scholar 

  • Delre SA, Jager W, Janssen MA (2007) Diffusion dynamics in small-world networks with heterogeneous consumers. Comput Math Org Theory 13(2):185–202

    Article  Google Scholar 

  • Dong W, Pentland A (2007) Modeling influence between experts. In: Artifical intelligence for human computing, Springer, Berlin, pp 170–189

  • Dong W, Lepri B, Cappelletti A, Pentland AS, Pianesi F, Zancanaro M (2007) Using the influence model to recognize functional roles in meetings. In: Proceedings of the 9th international conference on multimodal interfaces, ACM, pp 271–278

  • Dong W, Lepri B, Pentland AS (2011) Modeling the co-evolution of behaviors and social relationships using mobile phone data. In: Proceedings of the 10th international conference on mobile and ubiquitous multimedia, ACM, pp 134–143

  • Dong W, Heller K, Pentland AS (2012) Modeling infection with multi-agent dynamics. In: International conference on social computing, behavioral-cultural modeling, and prediction, Springer, New York, pp 172–179

  • Dong W, Olguin-Olguin D, Waber B, Kim T (2012) Mapping organizational dynamics with body sensor networks. In: 2012 ninth international conference on wearable and implantable body sensor networks, IEEE, pp 130–135

  • Dong W, Pentland AS, Heller KA (2012) Graph-coupled HMMs for modeling the spread of infection. In: Proceedings of the twenty-eighth conference on uncertainty in artificial intelligence, AUAI Press, Arlington, pp 227–236 (2012)

  • Epstein JMM (2007) Generative social science: studies in agent-based computational modeling (Princeton studies in complexity). Princeton University Press, Princeton

    Google Scholar 

  • Eubank S, Guclu H, Kumar VA, Marathe MV, Srinivasan A, Toroczkai Z, Wang N (2004) Modelling disease outbreaks in realistic urban social networks. Nature 429(6988):180–184

    Article  Google Scholar 

  • Fan K, Eisenberg M, Walsh A, Aiello A, Heller K (2015) Hierarchical graph-coupled hmms for heterogeneous personalized health data. In: Proceedings of the 21th ACM SIGKDD international conference on knowledge discovery and data mining, ACM, pp 239–248

  • Fang L, Yang F, Dong W, Guan T, Qiao C (2017) Expectation propagation with stochastic kinetic model in complex interaction systems. In: Advances in neural information processing systems 30

  • Forrester JW (1961) Industrial dynamics. MIT Press, Cambridge

    Google Scholar 

  • Forrester JW (1969) Urban dynamics, vol 114. MIT Press, Cambridge

    Google Scholar 

  • Gillespie DT (2007) Stochastic simulation of chemical kinetics. Annu Rev Phys Chem 58:35–55

    Article  Google Scholar 

  • Goldenberg A, Zheng AX, Fienberg SE, Airoldi EM (2010) A survey of statistical network models. Found Trends Mach Learn 2(2):129–233

    Article  Google Scholar 

  • Goodfellow I, Bengio Y, Courville A (2016) Deep learning. MIT Press, Cambridge

    Google Scholar 

  • Goss PJ, Peccoud J (1998) Quantitative modeling of stochastic systems in molecular biology by using stochastic petri nets. Proc Natl Acad Sci 95(12):6750–6755

    Article  Google Scholar 

  • Grassmann WK (1977) Transient solutions in markovian queueing systems. Comput Oper Res 4:47–53

    Article  Google Scholar 

  • Guan T, Dong W, Koutsonikolas D, Challen G, Qiao C (2015) Robust, cost-effective and scalable localization in large indoor areas. In: 2015 IEEE Global Communications Conference (GLOBECOM), IEEE, pp 1–6

  • Guan T, Dong W, Koutsonikolas D, Qiao C (2017) Fine-grained location extraction and prediction with little known data. In: Proceedings of the 2017 IEEE wireless communications and networking conference, IEEE Communications Society

  • Heylighen F (1999) Collective intelligence and its implementation on the web: algorithms to develop a collective mental map. Comput Math Org Theory 5(3):253–280

    Article  Google Scholar 

  • Jin Y, Levitt RE (1996) The virtual design team: a computational model of project organizations. Comput Math Org Theory 2(3):171–195

    Article  Google Scholar 

  • Marsan MA, Balbo G, Conte G, Donatelli S, Franceschinis G (1994) Modelling with generalized stochastic Petri nets. Wiley, New York

    Google Scholar 

  • MATSim development team (ed.) (2007) MATSIM-T: aims, approach and implementation. Tech. rep., IVT, ETH Zürich, Zürich

  • Murphy KP (2002) Dynamic bayesian networks: representation, inference and learning. Ph.D. thesis, University of California, Berkeley

  • Newell A, Simon HA et al (1972) Human problem solving, vol 104. Prentice-Hall, Englewood Cliffs

    Google Scholar 

  • Olguín DO, Waber BN, Kim T, Mohan A, Ara K, Pentland A (2009) Sensible organizations: technology and methodology for automatically measuring organizational behavior. IEEE Trans Syst Man Cybern Part B Cybern 39(1):43–55

    Article  Google Scholar 

  • Pan W, Dong W, Cebrian M, Kim T, Fowler J, Pentland A (2012) Modeling dynamical influence in human interaction: Using data to make better inferences about influence within social systems. IEEE Signal Process Mag 29(2):77–86

    Article  Google Scholar 

  • Pearl J (2014) Probabilistic reasoning in intelligent systems: networks of plausible inference. Morgan Kaufmann, Burlington

    Google Scholar 

  • Pentland A, Heibeck T (2010) Honest signals: how they shape our world. MIT Press, Cambridge

    Google Scholar 

  • Petri CA, Reisig W (2008) Petri net. Scholarpedia 3(4):6477

    Article  Google Scholar 

  • Pokhriyal N, Dong W, Govindaraju V (2015) Virtual networks and poverty analysis in Senegal. arXiv:1506.03401

  • Pons P, Latapy M (2006) Computing communities in large networks using random walks. J Graph Algorithm Appl 10(2):191–218

    Article  Google Scholar 

  • Smith GL, Schmidt SF, McGee LA (1962) Application of statistical filter theory to the optimal estimation of position and velocity on board a circumlunar vehicle. National Aeronautics and Space Administration

  • Waddell P (2002) Urbansim: modeling urban development for land use, transportation, and environmental planning. J Am Plan Assoc 68(3):297–314

    Article  Google Scholar 

  • Ward JA, Evans AJ, Malleson NS (2016) Dynamic calibration of agent-based models using data assimilation. R Soc Open Sci 3(4):150703

    Article  Google Scholar 

  • Wilkinson DJ (2011) Stochastic modelling for systems biology. CRC Press, Boca Raton

    Google Scholar 

  • Wulsin D, Fox E, Litt B (2013) Parsing epileptic events using a Markov switching process model for correlated time series. In: International Conference on Machine Learning, pp 356–364

  • Xu Z, Dong W, Srihari SN (2016) Using social dynamics to make individual predictions: variational inference with stochastic kinetic model. Adv Neural Inf Process Syst 29:2775–2783

    Google Scholar 

  • Ziemke D, Nagel K, Bhat C (2015) Integrating cemdap and matsim to increase the transferability of transport demand models. Transp Res Rec 2493:117–125

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science and Engineering, University at Buffalo, Buffalo, NY, USA

    Fan Yang & Wen Dong

Authors
  1. Fan Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Wen Dong
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Wen Dong.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yang, F., Dong, W. Integrating simulation and signal processing in tracking complex social systems. Comput Math Organ Theory 26, 1–22 (2020). https://doi.org/10.1007/s10588-018-9276-6

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10588-018-9276-6

Keywords

Search

Navigation