Julien Cumin
Abstract
Autonomy and adaptability are essential components of ambient intelligence. For example, in smart homes, proactive acting and occupants advising, adapted to current and future contexts of living, are essential to go beyond limitations of previous domotic services. To reach such autonomy and adaptability, ambient systems need to automatically grasp their users’ ambient context. In particular, users’ activities and availabilities for communication are valuable pieces of contextual information that can help such systems to adapt to user needs and behaviours. While significant research work exists on activity recognition in homes, less attention has been given to prediction of future activities, as well as to availability recognition and prediction in general. In this article, we investigate several Dynamic Bayesian Network (DBN) architectures for activity and availability prediction of occupants in homes, including our novel model, called Past SItuations to predict the NExt Situation (PSINES). This predictive architecture utilizes context information, sensor event aggregations, and latent user cognitive states to accurately predict future home situations based on previous situations. We experimentally evaluate PSINES, as well as intermediate DBN architectures, on multiple state-of-the-art datasets, with prediction accuracies of up to 89.52% for activity and 82.08% for availability on the Orange4Home dataset.
- James L. Crowley and Joelle Coutaz. 2015. An ecological view of smart home technologies. In Proceedings of the European Conference on Ambient Intelligence. Springer, 1–16.Google Scholar
- Shaoen Wu, Jacob B. Rendall, Matthew J. Smith, Shangyu Zhu, Junhong Xu, Honggang Wang, Qing Yang, and Pinle Qin. 2017. Survey on prediction algorithms in smart homes. IEEE IoT J. 4, 3 (2017), 636–644.Google Scholar
- Claude Elwood Shannon. 1948. A mathematical theory of communication. Bell Syst. Tech. J. 27 (1948), 623–656.Google ScholarCross Ref
- Rakesh Agrawal and Ramakrishnan Srikant. 1994. Fast algorithms for mining association rules in large databases. In Proceedings of the 20th International Conference on Very Large Data Bases. Morgan Kaufmann, 487–499.Google ScholarDigital Library
- Heikki Mannila, Hannu Toivonen, and A. Inkeri Verkamo. 1997. Discovery of frequent episodes in event sequences. Data Min. Knowl. Discov. 1, 3 (1997), 259–289.Google ScholarDigital Library
- Jiawei Han, Jian Pei, and Yiwen Yin. 2000. Mining frequent patterns without candidate generation. In ACM Sigmod Record, Vol. 29. ACM, 1–12.Google ScholarDigital Library
- M. J. Zaki, S. Parthasarathy, M. Ogihara, and W. Li. 1997. New algorithms for fast discovery of association rules. In Proceedings of the 3rd International Conference on Knowledge Discovery and Data Mining. AAAI Press, 283–286.Google Scholar
- Karthik Gopalratnam and Diane J. Cook. 2007. Online sequential prediction via incremental parsing: The active leZi algorithm. IEEE Intell. Syst. 22, 1 (2007), 52–58.Google ScholarDigital Library
- Amiya Bhattacharya and Sajal K. Das. 2002. Lezi-update: An information-theoretic framework for personal mobility tracking in pcs networks. Wireless Netw. 8, 2--3 (2002), 121–135.Google ScholarDigital Library
- Muhammad Raisul Alam, Mamun Bin Ibne Reaz, and M. A. Mohd Ali. 2012. SPEED: An inhabitant activity prediction algorithm for smart homes. IEEE Trans. Syst. Man Cybernet. A: Syst. Hum. 42, 4 (2012), 985–990.Google ScholarDigital Library
- Piotr Augustyniak and Grażyna Ślusarczyk. 2018. Graph-based representation of behavior in detection and prediction of daily living activities. Comput. Biol. Med. 95 (2018), 261–270.Google ScholarCross Ref
- Sawsan Mahmoud, Ahmad Lotfi, and Caroline Langensiepen. 2013. Behavioural pattern identification and prediction in intelligent environments. Appl. Soft Comput. 13, 4 (2013), 1813–1822.Google ScholarDigital Library
- Henry Kautz, Oren Etzioni, Dieter Fox, and Dan Weld. 2003. Foundations of Assisted Cognition Systems. Technical Report. Computer Science Department, University of Washington.Google Scholar
- Dorothy N. Monekosso and Paolo Remagnino. 2009. Anomalous behavior detection: Supporting independent living. In Intelligent Environments. Methods, Algorithms and Applications. Springer-Verlag, London, 33--48.Google Scholar
- Han Saem Park and Sung Bae Cho. 2010. Predicting user activities in the sequence of mobile context for ambient intelligence environment using dynamic Bayesian network. In Proceedings of the 2nd International Conference on Agents and Artificial Intelligence (ICAART’10).Google Scholar
- Jihang Ye, Zhe Zhu, and Hong Cheng. 2013. What’s your next move: User activity prediction in location-based social networks. In Proceedings of the 2013 SIAM International Conference on Data Mining. SIAM, 171–179.Google ScholarCross Ref
- Ashesh Jain, Avi Singh, Hema S. Koppula, Shane Soh, and Ashutosh Saxena. 2016. Recurrent neural networks for driver activity anticipation via sensory-fusion architecture. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA’16). IEEE, 3118–3125.Google ScholarDigital Library
- Sungjoon Choi, Eunwoo Kim, and Songhwai Oh. 2013. Human behavior prediction for smart homes using deep learning.. In Proceedings of the IEEE International Conference on Robot 8 Human Interactive Communication (RO-MAN’13), Vol. 2013. 173.Google Scholar
- Younggi Kim, Jihoon An, Minseok Lee, and Younghee Lee. 2017. An activity-embedding approach for next-activity prediction in a multi-user smart space. In Proceedings of the IEEE International Conference on Smart Computing (SMARTCOMP’17). IEEE, 1–6.Google ScholarCross Ref
- Iram Fatima, Muhammad Fahim, Young-Koo Lee, and Sungyoung Lee. 2013. A unified framework for activity recognition-based behavior analysis and action prediction in smart homes. Sensors 13, 2 (2013), 2682–2699.Google ScholarCross Ref
- Abdulsalam Yassine, Shailendra Singh, and Atif Alamri. 2017. Mining human activity patterns from smart home big data for health care applications. IEEE Access 5 (2017), 13131–13141.Google ScholarCross Ref
- Shailendra Singh, Abdulsalam Yassine, and Shervin Shirmohammadi. 2016. Incremental mining of frequent power consumption patterns from smart meters big data. In Proceedings of the Electrical Power and Energy Conference (EPEC’16). IEEE, 1–6.Google ScholarCross Ref
- Ehsan Nazerfard and Diane J. Cook. 2015. CRAFFT: An activity prediction model based on Bayesian networks. J. Ambient Intell. Human. Comput. 6, 2 (2015), 193–205.Google ScholarCross Ref
- Yoshinao Takemae, Takehiko Ohno, Ikuo Yoda, and Shinji Ozawa. 2006. Estimating human interruptibility in the home for remote communication. In CHI’06 Extended Abstracts on Human Factors in Computing Systems. ACM, 1397–1402.Google Scholar
- Kristine S. Nagel, James M. Hudson, and Gregory D. Abowd. 2004. Predictors of availability in home life context-mediated communication. In Proceedings of the 2004 ACM Conference on Computer Supported Cooperative Work. ACM, 497–506.Google Scholar
- Chien-Ming Huang and Bilge Mutlu. 2014. Learning-based modeling of multimodal behaviors for humanlike robots. In Proceedings of the 2014 ACM/IEEE International Conference on Human-robot Interaction. ACM, 57–64.Google ScholarDigital Library
- Jina Lee, Stacy Marsella, David Traum, Jonathan Gratch, and Brent Lance. 2007. The rickel gaze model: A window on the mind of a virtual human. In Proceedings of the International Workshop on Intelligent Virtual Agents. Springer, 296–303.Google ScholarDigital Library
- Alaeddine Mihoub and Grégoire Lefebvre. 2019. Wearables and social signal processing for smarter public presentations. ACM Trans. Interact. Intell. Syst. 9, 2--3 (2019), 1--24.Google ScholarDigital Library
- Diane J. Cook, Aaron S. Crandall, Brian L. Thomas, and Narayanan C. Krishnan. 2013. CASAS: A smart home in a box. Computer 46, 7 (2013), 62–69.Google ScholarDigital Library
- Julien Cumin, Grégoire Lefebvre, Fano Ramparany, and James L. Crowley. 2017. A dataset of routine daily activities in an instrumented home. In Proceedings of the International Conference on Ubiquitous Computing and Ambient Intelligence. Springer, 413–425.Google Scholar
- Klaus Greff, Rupesh K. Srivastava, Jan Koutník, Bas R. Steunebrink, and Jürgen Schmidhuber. 2016. LSTM: A search space odyssey. IEEE Trans. Neur. Netw. Learn. Syst. 28, 10 (2016), 2222–2232.Google ScholarCross Ref
- Julien Cumin, Grégoire Lefebvre, Fano Ramparany, and James L. Crowley. 2017. Human activity recognition using place-based decision fusion in smart homes. In Proceedings of the International and Interdisciplinary Conference on Modeling and Using Context. Springer, 137–150.Google Scholar
Index Terms
- PSINES: Activity and Availability Prediction for Adaptive Ambient Intelligence
Recommendations
A Centralized Approach to an Ambient Assisted Living Application: An Intelligent Home
IWANN '09: Proceedings of the 10th International Work-Conference on Artificial Neural Networks: Part II: Distributed Computing, Artificial Intelligence, Bioinformatics, Soft Computing, and Ambient Assisted Living<em>Ambient Assisted Living </em> (AAL) includes assistance to carry out daily activities, health and activity monitoring, enhancing safety and security, getting access to, medical and emergency systems. But home environments are challengeable as they'...
AnAbEL: towards empowering people living with dementia in ambient assisted living
AbstractAmbient assisted living aims to support the well-being of people with special needs by offering assistive solutions. Systems focused on dementia increase the autonomy of people living with dementia by monitoring their activities. Topics such as ...
Ambient Assisted Living and Care in The Netherlands: The Voice of the User
Technology can assist older adults to remain living in the community. Within the realm of information and communication technologies, smart homes are drifting toward the concept of ambient assisted living (AAL). AAL-systems are more responsive to user ...
Comments