Revisión del estado del arte sobre tendencias tecnológicas para el análisis del comportamiento y actividades humanas

The study of human behavior allows the knowledge about people's behaviors, behavior determined by multiple factors: cultural, social, psychological, genetic, religious, among others, which affect the relationships and interaction with the environment. The infinity of data in our lives and the search for behavioral patterns from that data has been an amazing work whose benefit is focused on the determined patterns and intelligent analysis that lead to new knowledge. A significant amount of resources from pattern recognition in human activities and daily life has had greater dominance in the management of mobility, health and wellness.The current paper presents a review of technologies for human behavior analysis and use as tools for diagnosis, assistance, for interaction in intelligent environments and assisted robotics applications. The main scope is to give an overview of the technological advances in the analysis of human behavior, activities of daily living and mobility, and the benefits obtained.El estudio del comportamiento humano permite el conocimiento sobre las conductas de las personas, conducta determinada por múltiples factores: culturales, sociales, psicológicos, genéticos, religiosos, entre otros; que inciden en las relaciones y la interacción con el entorno. La infinidad de datos en nuestras vidas y la búsqueda de patrones de comportamiento a partir de esos datos ha sido un trabajo asombroso cuyo provecho se centra en los patrones determinados y el análisis inteligente que conducen a nuevos conocimientos. Una cantidad significativa de recursos a partir del reconocimiento de patrones en las actividades humanas y de vida diaria ha tenido mayor dominio en la gestión de la movilidad, la salud y bienestar.El actual documento presenta una revisión de las tecnologías para el análisis del comportamiento humano y del uso como herramientas para el diagnóstico, asistencia, para la interacción en ambientes inteligentes y aplicaciones de robótica asistida. El alcance principal es dar una visión general de los avances tecnológicos en el análisis del comportamiento humano, actividades de la vida diaria y movilidad, y de los beneficios obtenidos

PEMANFAATAN MEDIA AUGMENTED REALITY (AR) IPA INTEGRATIF KEARIFAN LOKAL DI SEKOLAH DASAR

PEMANFAATAN MEDIA AUGMENTED REALITY (AR) IPA INTEGRATIF KEARIFAN LOKAL DI SEKOLAH DASAR Ana Riani Universitas Negeri Jakarta Email : [email protected] Abstract: This study aims to develop learning media based on the Augmented Reality as a form of learning media that facilitates abstracs material become real, and is able to support the learning process in an effort to improve student learning understanding. The method used is research and development with the 4D (Four D) Model. This research was conducted on fifth grade students at the Aren Jaya XVIII Elementary School, Kota Bekasi, Indonesia. Data collection techniques used were tests, interviews, questionnaires, and documents. The results of this research can be concluded that learning media based on Augmented Reality in blood circulation system integrated martial art is developed effectively and can be uses to assistance as a teacher's aid in delivering learning material. Keyword : Augmented Reality media, Blood Circulation System, Martial Art Abstrak : penelitian ini bertujuan untuk mengembangkan media pembelajaran berbasis Augmented sebagai salah satu bentuk media pembelajaran yang memfasilitasi materi yang abstrak menjadi lebih nyata dan diharapkan mampu mendukung proses pembelajaran dalam upaya peningkatan hasil belajar pada siswa sekolah dasar. Metode penelitian menggunakan pendekatan research and development dengan model yang digunakan 4D (four D). Penelitian ini dilakukan pada siswa kelas V di Sekolah Dasar Negeri Aren Jaya XVIII Kota Bekasi-Indonesia. Teknik pengumpulan data yang digunakan adalah tes, wawancara, angket, dan dokumen. Hasil dalam penelitian ini dapat disimpulkan bahwa media berbasis Augmented Reality sistem peredaran darah terintegrasi Penjaskes gerak dasar pencak silat ini layak dan dapat digunakan sebagai alat bantu guru dalam menyampaikan materi pembelajaran kelas V sekolah dasar. Kata Kunci : Media Augmented Reality, Sistem peredaran darah, Pencak sila

Human Avtivity Recognition Using Smartphones

Human activity recognition is a problem of classifying activity of a human using accelerometer and gyroscope data recorded by smartphones into well-defined movements. However, it is still a challenging problem to compute a large number of observations in each second and it is also hard to translate the measurements from smartphones into physical activity patterns. In the past few decades, researchers have designed different human activities recognition systems using different algorithms. In this paper, I investigate different approaches to HAR system based on smartphones. I provide a comparison of these approaches and provide recommendations of the best performing solution

A Context-Aware mHealth System for Online Physiological Monitoring in Remote Healthcare

Physiological or biological stress is an organism’s response to a stressor such as an environmental condition or a stimulus. The identification of physiological stress while performing the activities of daily living is an important field of health research in preventive medicine. Activities initiate a dynamic physiological response that can be used as an indicator of the overall health status. This is especially relevant to high risk groups; the assessment of the physical state of patients with cardiovascular diseases in daily activities is still very difficult. This paper presents a context-aware telemonitoring platform, IPM-mHealth, that receives vital parameters from multiple sensors for online, real-time analysis. IPM-mHealth provides the technical basis for effectively evaluating patients’ physiological conditions, whether inpatient or at home, through the relevance between physical function and daily activities. The two core modules in the platform include: 1) online activity recognition algorithms based on 3-axis acceleration sensors and 2) a knowledge-based, conditional-reasoning decision module which uses context information to improve the accuracy of determining the occurrence of a potentially dangerous abnormal heart rate. Finally, we present relevant experiments to collect cardiac information and upper-body acceleration data from the human subjects. The test results show that this platform has enormous potential for use in long-term health observation, and can help us define an optimal patient activity profile through the automatic activity analysis

Feature extraction and feature selection in smartphone-based activity recognition

Nowadays, smartphones are gradually being integrated in our daily lives, and they can be considered powerful tools for monitoring human activities. However, due to the limitations of processing capability and energy consumption of smartphones compared to standard machines, a trade-off between performance and computational complexity must be considered when developing smartphone-based systems. In this paper, we shed light on the importance of feature selection and its impact on simplifying the activity classification process which enhances the computational complexity of the system. Through an in-depth survey on the features that are widely used in state-of-the-art studies, we selected the most common features for sensor-based activity classification, namely conventional features. Then, in an experimental study with 10 participants and using 2 different smartphones, we investigated how to reduce system complexity while maintaining classification performance by replacing the conventional feature set with an optimal set. For this reason, in the considered scenario, the users were instructed to perform different static and dynamic activities, while freely holding a smartphone in their hands. In our comparison to the state-of-the-art approaches, we implemented and evaluated major classification algorithms, including the decision tree and Bayesian network. We demonstrated that replacing the conventional feature set with an optimal set can significantly reduce the complexity of the activity recognition system with only a negligible impact on the overall system performance

Using wearable sensors for real-time recognition tasks in games of martial arts – An initial experiment

Abstract — Beside their stunning graphics, modern entertainment systems feature ever-higher levels of immersive userinteraction. Today, this is mostly achieved by virtual (VR) and augmented reality (AR) setups. On top of these, we envision to add ambient intelligence and context awareness to gaming applications in general and games of martial arts in particular. To this end, we conducted an initial experiment with inexpensive body-worn gyroscopes and acceleration sensors for the Chum Kiu motion sequence in Wing Chun (a popular form of Kung Fu). The resulting data confirm the feasibility of our vision. Fine-tuned adaptations of various thresholding and patternmatching techniques known from the fields of computational intelligence and signal processing should suffice to automate the analysis and recognition of important Wing Chun movements in real time. Moreover, the data also seem to allow for the possibility of automatically distinguishing between certain levels of expertise and quality in executing the movements

Analysis and enhancement of interpersonal coordination using inertial measurement unit solutions

Die heutigen mobilen Kommunikationstechnologien haben den Umfang der verbalen und textbasierten Kommunikation mit anderen Menschen, sozialen Robotern und künstlicher Intelligenz erhöht. Auf der anderen Seite reduzieren diese Technologien die nonverbale und die direkte persönliche Kommunikation, was zu einer gesellschaftlichen Thematik geworden ist, weil die Verringerung der direkten persönlichen Interaktionen eine angemessene Wahrnehmung sozialer und umgebungsbedingter Reizmuster erschweren und die Entwicklung allgemeiner sozialer Fähigkeiten bremsen könnte. Wissenschaftler haben aktuell die Bedeutung nonverbaler zwischenmenschlicher Aktivitäten als soziale Fähigkeiten untersucht, indem sie menschliche Verhaltensmuster in Zusammenhang mit den jeweilgen neurophysiologischen Aktivierungsmustern analzsiert haben. Solche Querschnittsansätze werden auch im Forschungsprojekt der Europäischen Union "Socializing sensori-motor contingencies" (socSMCs) verfolgt, das darauf abzielt, die Leistungsfähigkeit sozialer Roboter zu verbessern und Autismus-Spektrumsstörungen (ASD) adäquat zu behandeln. In diesem Zusammenhang ist die Modellierung und das Benchmarking des Sozialverhaltens gesunder Menschen eine Grundlage für theorieorientierte und experimentelle Studien zum weiterführenden Verständnis und zur Unterstützung interpersoneller Koordination. In diesem Zusammenhang wurden zwei verschiedene empirische Kategorien in Abhängigkeit von der Entfernung der Interagierenden zueinander vorgeschlagen: distale vs. proximale Interaktionssettings, da sich die Struktur der beteiligten kognitiven Systeme zwischen den Kategorien ändert und sich die Ebene der erwachsenden socSMCs verschiebt. Da diese Dissertation im Rahmen des socSMCs-Projekts entstanden ist, wurden Interaktionssettings für beide Kategorien (distal und proximal) entwickelt. Zudem wurden Ein-Sensor-Lösungen zur Reduzierung des Messaufwands (und auch der Kosten) entwickelt, um eine Messung ausgesuchter Verhaltensparameter bei einer Vielzahl von Menschen und sozialen Interaktionen zu ermöglichen. Zunächst wurden Algorithmen für eine kopfgetragene Trägheitsmesseinheit (H-IMU) zur Messung der menschlichen Kinematik als eine Ein-Sensor-Lösung entwickelt. Die Ergebnisse bestätigten, dass die H-IMU die eigenen Gangparameter unabhängig voneinander allein auf Basis der Kopfkinematik messen kann. Zweitens wurden—als ein distales socSMC-Setting—die interpersonellen Kopplungen mit einem Bezug auf drei interagierende Merkmale von „Übereinstimmung“ (engl.: rapport) behandelt: Positivität, gegenseitige Aufmerksamkeit und Koordination. Die H-IMUs überwachten bestimmte soziale Verhaltensereignisse, die sich auf die Kinematik der Kopforientierung und Oszillation während des Gehens und Sprechens stützen, so dass der Grad der Übereinstimmung geschätzt werden konnte. Schließlich belegten die Ergebnisse einer experimentellen Studie, die zu einer kollaborativen Aufgabe mit der entwickelten IMU-basierten Tablet-Anwendung durchgeführt wurde, unterschiedliche Wirkungen verschiedener audio-motorischer Feedbackformen für eine Unterstützung der interpersonellen Koordination in der Kategorie proximaler sensomotorischer Kontingenzen. Diese Dissertation hat einen intensiven interdisziplinären Charakter: Technologische Anforderungen in den Bereichen der Sensortechnologie und der Softwareentwicklung mussten in direktem Bezug auf vordefinierte verhaltenswissenschaftliche Fragestellungen entwickelt und angewendet bzw. gelöst werden—und dies in zwei unterschiedlichen Domänen (distal, proximal). Der gegebene Bezugsrahmen wurde als eine große Herausforderung bei der Entwicklung der beschriebenen Methoden und Settings wahrgenommen. Die vorgeschlagenen IMU-basierten Lösungen könnten dank der weit verbreiteten IMU-basierten mobilen Geräte zukünftig in verschiedene Anwendungen perspektiv reich integriert werden.Today’s mobile communication technologies have increased verbal and text-based communication with other humans, social robots and intelligent virtual assistants. On the other hand, the technologies reduce face-to-face communication. This social issue is critical because decreasing direct interactions may cause difficulty in reading social and environmental cues, thereby impeding the development of overall social skills. Recently, scientists have studied the importance of nonverbal interpersonal activities to social skills, by measuring human behavioral and neurophysiological patterns. These interdisciplinary approaches are in line with the European Union research project, “Socializing sensorimotor contingencies” (socSMCs), which aims to improve the capability of social robots and properly deal with autism spectrum disorder (ASD). Therefore, modelling and benchmarking healthy humans’ social behavior are fundamental to establish a foundation for research on emergence and enhancement of interpersonal coordination. In this research project, two different experimental settings were categorized depending on interactants’ distance: distal and proximal settings, where the structure of engaged cognitive systems changes, and the level of socSMCs differs. As a part of the project, this dissertation work referred to this spatial framework. Additionally, single-sensor solutions were developed to reduce costs and efforts in measuring human behaviors, recognizing the social behaviors, and enhancing interpersonal coordination. First of all, algorithms using a head worn inertial measurement unit (H-IMU) were developed to measure human kinematics, as a baseline for social behaviors. The results confirmed that the H-IMU can measure individual gait parameters by analyzing only head kinematics. Secondly, as a distal sensorimotor contingency, interpersonal relationship was considered with respect to a dynamic structure of three interacting components: positivity, mutual attentiveness, and coordination. The H-IMUs monitored the social behavioral events relying on kinematics of the head orientation and oscillation during walk and talk, which can contribute to estimate the level of rapport. Finally, in a new collaborative task with the proposed IMU-based tablet application, results verified effects of different auditory-motor feedbacks on the enhancement of interpersonal coordination in a proximal setting. This dissertation has an intensive interdisciplinary character: Technological development, in the areas of sensor and software engineering, was required to apply to or solve issues in direct relation to predefined behavioral scientific questions in two different settings (distal and proximal). The given frame served as a reference in the development of the methods and settings in this dissertation. The proposed IMU-based solutions are also promising for various future applications due to widespread wearable devices with IMUs.European Commission/HORIZON2020-FETPROACT-2014/641321/E