Individual Behavior Modeling with Sensors Using Process Mining

[EN] Understanding human behavior can assist in the adoption of satisfactory health interventions and improved care. One of the main problems relies on the definition of human behaviors, as human activities depend on multiple variables and are of dynamic nature. Although smart homes have advanced in the latest years and contributed to unobtrusive human behavior tracking, artificial intelligence has not coped yet with the problem of variability and dynamism of these behaviors. Process mining is an emerging discipline capable of adapting to the nature of high-variate data and extract knowledge to define behavior patterns. In this study, we analyze data from 25 in-house residents acquired with indoor location sensors by means of process mining clustering techniques, which allows obtaining workflows of the human behavior inside the house. Data are clustered by adjusting two variables: the similarity index and the Euclidean distance between workflows. Thereafter, two main models are created: (1) a workflow view to analyze the characteristics of the discovered clusters and the information they reveal about human behavior and (2) a calendar view, in which common behaviors are rendered in the way of a calendar allowing to detect relevant patterns depending on the day of the week and the season of the year. Three representative patients who performed three different behaviors: stable, unstable, and complex behaviors according to the proposed approach are investigated. This approach provides human behavior details in the manner of a workflow model, discovering user paths, frequent transitions between rooms, and the time the user was in each room, in addition to showing the results into the calendar view increases readability and visual attraction of human behaviors, allowing to us detect patterns happening on special days.This research was funded by ITACA SABIEN and partially supported by CONICYT REDI 170136.Dogan, O.; Martinez-Millana, A.; Rojas, E.; Sepulveda, M.; Munoz Gama, J.; Traver Salcedo, V.; Fernández Llatas, C. (2019). Individual Behavior Modeling with Sensors Using Process Mining. Electronics. 8(7):1-17. https://doi.org/10.3390/electronics8070766S11787Gubbi, J., Buyya, R., Marusic, S., & Palaniswami, M. (2013). Internet of Things (IoT): A vision, architectural elements, and future directions. Future Generation Computer Systems, 29(7), 1645-1660. doi:10.1016/j.future.2013.01.010Guo, B., Zhang, D., Wang, Z., Yu, Z., & Zhou, X. (2013). Opportunistic IoT: Exploring the harmonious interaction between human and the internet of things. Journal of Network and Computer Applications, 36(6), 1531-1539. doi:10.1016/j.jnca.2012.12.028Riley, W. T., Nilsen, W. J., Manolio, T. A., Masys, D. R., & Lauer, M. (2015). News from the NIH: potential contributions of the behavioral and social sciences to the precision medicine initiative. Translational Behavioral Medicine, 5(3), 243-246. doi:10.1007/s13142-015-0320-5Xue-Wen Chen, & Xiaotong Lin. (2014). Big Data Deep Learning: Challenges and Perspectives. IEEE Access, 2, 514-525. doi:10.1109/access.2014.2325029Atzori, L., Iera, A., & Morabito, G. (2010). The Internet of Things: A survey. Computer Networks, 54(15), 2787-2805. doi:10.1016/j.comnet.2010.05.010Mamlin, B. W., & Tierney, W. M. (2016). The Promise of Information and Communication Technology in Healthcare: Extracting Value From the Chaos. The American Journal of the Medical Sciences, 351(1), 59-68. doi:10.1016/j.amjms.2015.10.015Bayo-Monton, J.-L., Martinez-Millana, A., Han, W., Fernandez-Llatas, C., Sun, Y., & Traver, V. (2018). Wearable Sensors Integrated with Internet of Things for Advancing eHealth Care. Sensors, 18(6), 1851. doi:10.3390/s18061851Larry Jameson, J., & Longo, D. L. (2015). Precision Medicine—Personalized, Problematic, and Promising. Obstetrical & Gynecological Survey, 70(10), 612-614. doi:10.1097/01.ogx.0000472121.21647.38Chaaraoui, A. A., Climent-Pérez, P., & Flórez-Revuelta, F. (2012). A review on vision techniques applied to Human Behaviour Analysis for Ambient-Assisted Living. Expert Systems with Applications, 39(12), 10873-10888. doi:10.1016/j.eswa.2012.03.005Botia, J. A., Villa, A., & Palma, J. (2012). Ambient Assisted Living system for in-home monitoring of healthy independent elders. Expert Systems with Applications, 39(9), 8136-8148. doi:10.1016/j.eswa.2012.01.153Bamis, A., Lymberopoulos, D., Teixeira, T., & Savvides, A. (2010). The BehaviorScope framework for enabling ambient assisted living. Personal and Ubiquitous Computing, 14(6), 473-487. doi:10.1007/s00779-010-0282-zDogan, O., Bayo-Monton, J.-L., Fernandez-Llatas, C., & Oztaysi, B. (2019). Analyzing of Gender Behaviors from Paths Using Process Mining: A Shopping Mall Application. Sensors, 19(3), 557. doi:10.3390/s19030557Fernández-Llatas, C., Benedi, J.-M., García-Gómez, J., & Traver, V. (2013). Process Mining for Individualized Behavior Modeling Using Wireless Tracking in Nursing Homes. Sensors, 13(11), 15434-15451. doi:10.3390/s131115434Martinez-Millana, A., Lizondo, A., Gatta, R., Vera, S., Salcedo, V., & Fernandez-Llatas, C. (2019). Process Mining Dashboard in Operating Rooms: Analysis of Staff Expectations with Analytic Hierarchy Process. International Journal of Environmental Research and Public Health, 16(2), 199. doi:10.3390/ijerph16020199Fernandez-Llatas, C., Lizondo, A., Monton, E., Benedi, J.-M., & Traver, V. (2015). Process Mining Methodology for Health Process Tracking Using Real-Time Indoor Location Systems. Sensors, 15(12), 29821-29840. doi:10.3390/s151229769Mshali, H., Lemlouma, T., Moloney, M., & Magoni, D. (2018). A survey on health monitoring systems for health smart homes. International Journal of Industrial Ergonomics, 66, 26-56. doi:10.1016/j.ergon.2018.02.002Kim, E., Helal, S., & Cook, D. (2010). Human Activity Recognition and Pattern Discovery. IEEE Pervasive Computing, 9(1), 48-53. doi:10.1109/mprv.2010.7Li, N., & Becerik-Gerber, B. (2011). Performance-based evaluation of RFID-based indoor location sensing solutions for the built environment. Advanced Engineering Informatics, 25(3), 535-546. doi:10.1016/j.aei.2011.02.004Fang, S.-H., Wang, C.-H., Huang, T.-Y., Yang, C.-H., & Chen, Y.-S. (2012). An Enhanced ZigBee Indoor Positioning System With an Ensemble Approach. IEEE Communications Letters, 16(4), 564-567. doi:10.1109/lcomm.2012.022112.120131Álvarez-García, J. A., Barsocchi, P., Chessa, S., & Salvi, D. (2013). Evaluation of localization and activity recognition systems for ambient assisted living: The experience of the 2012 EvAAL competition. Journal of Ambient Intelligence and Smart Environments, 5(1), 119-132. doi:10.3233/ais-120192Byrne, C., Collier, R., & O’Hare, G. (2018). A Review and Classification of Assisted Living Systems. Information, 9(7), 182. doi:10.3390/info9070182Manzoor, A., Truong, H.-L., Calatroni, A., Roggen, D., Bouroche, M., Clarke, S., … Dustdar, S. (2013). Analyzing the impact of different action primitives in designing high-level human activity recognition systems. Journal of Ambient Intelligence and Smart Environments, 5(5), 443-461. doi:10.3233/ais-130223Lee, S., Ha, K., & Lee, K. (2006). A pyroelectric infrared sensor-based indoor location-aware system for the smart home. IEEE Transactions on Consumer Electronics, 52(4), 1311-1317. doi:10.1109/tce.2006.273150Conca, T., Saint-Pierre, C., Herskovic, V., Sepúlveda, M., Capurro, D., Prieto, F., & Fernandez-Llatas, C. (2018). Multidisciplinary Collaboration in the Treatment of Patients With Type 2 Diabetes in Primary Care: Analysis Using Process Mining. Journal of Medical Internet Research, 20(4), e127. doi:10.2196/jmir.8884Lee, J., Bagheri, B., & Kao, H.-A. (2015). A Cyber-Physical Systems architecture for Industry 4.0-based manufacturing systems. Manufacturing Letters, 3, 18-23. doi:10.1016/j.mfglet.2014.12.00

08091 Abstracts Collection -- Logic and Probability for Scene Interpretation

From 25.2.2008 to Friday 29.2.2008, the Dagstuhl Seminar 08091 ``Logic and Probability for Scene Interpretation\u27\u27 was held in the International Conference and Research Center (IBFI), Schloss Dagstuhl. During the seminar, several participants presented their current research, and ongoing work and open problems were discussed. Abstracts of the presentations given during the seminar as well as abstracts of seminar results and ideas are put together in this paper

Context-Independent Task Knowledge for Neurosymbolic Reasoning in Cognitive Robotics

One of the current main goals of artificial intelligence and robotics research is the creation of an artificial assistant which can have flexible, human like behavior, in order to accomplish everyday tasks. A lot of what is context-independent task knowledge to the human is what enables this flexibility at multiple levels of cognition. In this scope the author analyzes how to acquire, represent and disambiguate symbolic knowledge representing context-independent task knowledge, abstracted from multiple instances: this thesis elaborates the incurred problems, implementation constraints, current state-of-the-art practices and ultimately the solutions newly introduced in this scope. The author specifically discusses acquisition of context-independent task knowledge from large amounts of human-written texts and their reusability in the robotics domain; the acquisition of knowledge on human musculoskeletal dependencies constraining motion which allows a better higher level representation of observed trajectories; the means of verbalization of partial contextual and instruction knowledge, increasing interaction possibilities with the human as well as contextual adaptation. All the aforementioned points are supported by evaluation in heterogeneous setups, to bring a view on how to make optimal use of statistical & symbolic applications (i.e. neurosymbolic reasoning) in cognitive robotics. This work has been performed to enable context-adaptable artificial assistants, by bringing together knowledge on what is usually regarded as context-independent task knowledge

Network Analysis with Stochastic Grammars

Digital forensics requires significant manual effort to identify items of evidentiary interest from the ever-increasing volume of data in modern computing systems. One of the tasks digital forensic examiners conduct is mentally extracting and constructing insights from unstructured sequences of events. This research assists examiners with the association and individualization analysis processes that make up this task with the development of a Stochastic Context -Free Grammars (SCFG) knowledge representation for digital forensics analysis of computer network traffic. SCFG is leveraged to provide context to the low-level data collected as evidence and to build behavior profiles. Upon discovering patterns, the analyst can begin the association or individualization process to answer criminal investigative questions. Three contributions resulted from this research. First , domain characteristics suitable for SCFG representation were identified and a step -by- step approach to adapt SCFG to novel domains was developed. Second, a novel iterative graph-based method of identifying similarities in context-free grammars was developed to compare behavior patterns represented as grammars. Finally, the SCFG capabilities were demonstrated in performing association and individualization in reducing the suspect pool and reducing the volume of evidence to examine in a computer network traffic analysis use case

An analysis of the application of AI to the development of intelligent aids for flight crew tasks

This report presents the results of a study aimed at developing a basis for applying artificial intelligence to the flight deck environment of commercial transport aircraft. In particular, the study was comprised of four tasks: (1) analysis of flight crew tasks, (2) survey of the state-of-the-art of relevant artificial intelligence areas, (3) identification of human factors issues relevant to intelligent cockpit aids, and (4) identification of artificial intelligence areas requiring further research