147 research outputs found

    Learning Behavioral Representations of Routines From Large-scale Unlabeled Wearable Time-series Data Streams using Hawkes Point Process

    Full text link
    Continuously-worn wearable sensors enable researchers to collect copious amounts of rich bio-behavioral time series recordings of real-life activities of daily living, offering unprecedented opportunities to infer novel human behavior patterns during daily routines. Existing approaches to routine discovery through bio-behavioral data rely either on pre-defined notions of activities or use additional non-behavioral measurements as contexts, such as GPS location or localization within the home, presenting risks to user privacy. In this work, we propose a novel wearable time-series mining framework, Hawkes point process On Time series clusters for ROutine Discovery (HOT-ROD), for uncovering behavioral routines from completely unlabeled wearable recordings. We utilize a covariance-based method to generate time-series clusters and discover routines via the Hawkes point process learning algorithm. We empirically validate our approach for extracting routine behaviors using a completely unlabeled time-series collected continuously from over 100 individuals both in and outside of the workplace during a period of ten weeks. Furthermore, we demonstrate this approach intuitively captures daily transitional relationships between physical activity states without using prior knowledge. We also show that the learned behavioral patterns can assist in illuminating an individual's personality and affect.Comment: 2023 9th ACM SIGKDD International Workshop on Mining and Learning From Time Series (MiLeTS 2023

    Intelligent Biosignal Analysis Methods

    Get PDF
    This book describes recent efforts in improving intelligent systems for automatic biosignal analysis. It focuses on machine learning and deep learning methods used for classification of different organism states and disorders based on biomedical signals such as EEG, ECG, HRV, and others

    Early Abstraction of Inertial Sensor Data for Long-Term Deployments

    Get PDF
    Advances in microelectronics over the last decades have led to miniaturization of computing devices and sensors. A driving force to use these in various application scenarios is the desire to grasp physical phenomena from the environment, objects and living entities. We investigate sensing in two particularly challenging applications: one where small sensor modules are worn by people to detect their activities, and one where wirelessly networked sensors observe events over an area. This thesis takes a data-driven approach, focusing on human motion and vibrations caused by trains that are captured by accelerometer sensors as time series and shall be analyzed for characteristic patterns. For both, the acceleration sensor must be sampled at relatively high rates in order to capture the essence of the phenomena, and remain active for long stretches of time. The large amounts of gathered sensor data demand novel approaches that are able to swiftly process the data while guaranteeing accurate classification results. The following contributions are made in particular: * A data logger that would suit the requirements of long-term deployments is designed and evaluated. In a power profiling study both hardware components and firmware parameters are thoroughly tested, revealing that the sensor is able to log acceleration data at a sampling rate of 100 Hertz for up to 14 full days on a single battery charge. * A technique is proposed that swiftly and accurately abstracts an original signal with a set of linear segments, thus preserving its shape, while being twice as fast as a similar method. This allows for more efficient pattern matching, since for each pattern only a fraction of data points must be considered. A second study shows that this algorithm can perform data abstraction directly on a data logger with limited resources. * The railway monitoring scenario requires streaming vibration data to be analyzed for particular sparse and complex events directly on the sensor node, extracting relevant information such as train type or length from the shape of the vibration footprint. In a study conducted on real-world data, a set of efficient shape features is identified that facilitates train type prediction and length estimation with very high accuracies. * To achieve fast and accurate activity recognition for long-term bipolar patients monitoring scenarios, we present an approach that relies on the salience of motion patterns (motifs) that are characteristic for the target activity. These motifs are accumulated by using a symbolic abstraction that encodes the shape of the original signal. A large-scale study shows that a simple bag-of-words classifier trained with extracted motifs is on par with traditional approaches regarding the accuracy, while being much faster. * Some activities are hard to predict from acceleration data alone with the aforementioned approach. We argue that human-object interactions, captured as human motion and grasped objects through RFID, are an ideal supplement. A custom bracelet-like antenna to detect objects from up to 14 cm is proposed, along with a novel benchmark to evaluate such wearable setups. By aiming for wearable and wirelessly networked sensor systems, these contributions apply for particularly challenging applications that require long-term deployments of miniature sensors in general. They form the basis of a framework towards efficient event detection that relies heavily on early data abstraction and shape-based features for time series, while focusing less on the classification techniques

    Activity recognition in naturalistic environments using body-worn sensors

    Get PDF
    Phd ThesisThe research presented in this thesis investigates how deep learning and feature learning can address challenges that arise for activity recognition systems in naturalistic, ecologically valid surroundings such as the private home. One of the main aims of ubiquitous computing is the development of automated recognition systems for human activities and behaviour that are sufficiently robust to be deployed in realistic, in-the-wild environments. In most cases, the targeted application scenarios are people’s daily lives, where systems have to abide by practical usability and privacy constraints. We discuss how these constraints impact data collection and analysis and demonstrate how common approaches to the analysis of movement data effectively limit the practical use of activity recognition systems in every-day surroundings. In light of these issues we develop a novel approach to the representation and modelling of movement data based on a data-driven methodology that has applications in activity recognition, behaviour imaging, and skill assessment in ubiquitous computing. A number of case studies illustrate the suitability of the proposed methods and outline how study design can be adapted to maximise the benefit of these techniques, which show promising performance for clinical applications in particular.SiDE research hu

    JIDOKA. Integration of Human and AI within Industry 4.0 Cyber Physical Manufacturing Systems

    Get PDF
    This book is about JIDOKA, a Japanese management technique coined by Toyota that consists of imbuing machines with human intelligence. The purpose of this compilation of research articles is to show industrial leaders innovative cases of digitization of value creation processes that have allowed them to improve their performance in a sustainable way. This book shows several applications of JIDOKA in the quest towards an integration of human and AI within Industry 4.0 Cyber Physical Manufacturing Systems. From the use of artificial intelligence to advanced mathematical models or quantum computing, all paths are valid to advance in the process of human–machine integration

    Digitizing arquetypal human expereience through physiological signals

    Get PDF
    The problem of capturing human experience is relevant in many application domains. In fact, the process of describing and sharing individual experience lies at the heart of human culture. This advancement came at a price of losing some of the multidimensional aspects of primary, bodily experience during its projection into the symbolic formThroughout the courses of our lives we learn a great deal of information about the world from other people's experience. Besides the ability to share utilitarian experience such as whether a particular plant is poisonous, humans have developed a sophisticated competency of social signaling that enables us to express and decode emotional experience. The natural way of sharing emotional experiences requires those who share to be co-present during this event. However, people have overcome the limitation of physical presence by creating a symbolic system of representations.Recent research in the field of affective computing has addressed the question of digitization and transmission of emotional experience through monitoring and interpretation of physiological signals. Although the outcomes of this research represent a great step forward in developing a technology that supports sharing of emotional experiences, they do not seem to help in preserving the original phenomenological experience during the aforementioned projection. This circumstance is explained by the fact that in affective computing the focus of investigation has been aimed at emotional experiences which can be consciously evaluated and described by individuals themselves. Therefore, generally speaking, applying an affective computing technique for capturing emotions of an individual is not a deeper or more precise way to project her experience into the symbolic form than asking this person to write down a description of her emotions on a piece of paper. One can say that so far the research in affective computing has aimed at delivering technology that could automate the projection but it has not considered the problem of improving the projection in order to preserve more of the multidimensional aspects of human experience.This dissertation examines whether human experience, which individuals are not able to consciously transpose into the symbolic representation, can still be captured using the techniques of affective computing.First, a theoretical framework for description of human experience which is not accessible for conscious awareness was formulated. This framework was based on the work of Carl Jung who introduced a model of a psyche that includes three levels: consciousness, the personal unconscious and the collective unconscious. Consciousness is the external layer of the psyche that consists of those thoughts and emotions which are available for one¿s conscious recollection. The personal unconscious represents a repository for all of an individual¿s feelings, memories, knowledge and thoughts that are not conscious at a given moment of time.The collective unconscious is a repository of universal modes and behaviors that are similar in all individuals. According to Jung, the collective unconscious is populated with archetypes. Archetypes are prototypical categories of objects, people and situations that existed across evolutionary time and in different cultures.Esta tesis doctoral examina si la experiencia humana, que los individuos no pueden transponer conscientemente a la representación simbólica, aún puede capturarse utilizando las técnicas de computación afectiva. Primero, se formula un marco teórico para la descripción de la experiencia humana que no es accesible para la conciencia consciente. Este marco se basó en el trabajo de Carl Jung, quien introdujo un modelo de psique que incluye tres niveles: la conciencia, el inconsciente personal y el inconsciente colectivo. Habiendo definido nuestro marco teórico, realizamos un experimento en el que se mostraron a los sujetos estímulos visuales y auditivos de bases de datos estandarizadas para la obtención de emociones conscientes. Aparte de los estímulos para las emociones conscientes, los sujetos fueron expuestos a estímulos que representaban el arquetipo del yo. Durante la presentación de los estímulos cardiovasculares se registraron las señales de los sujetos. Los resultados experimentales indicaron que las respuestas de la frecuencia cardíaca de los participantes fueron únicas para cada categoría de estímulos, incluido el arquetípico. Estos hallazgos dieron impulso a realizar otro estudio en el que se examinó un espectro más amplio de experiencias arquetípicas. En nuestro segundo estudio, hicimos un cambio de estímulos visuales y auditivos a estímulos audiovisuales porque se esperaba que los videos fueran más eficientes en la obtención de emociones conscientes y experiencias arquetípicas que las imágenes fijas o los sonidos. La cantidad de arquetipos aumentó y los sujetos en general fueron estimulados a sentir ocho experiencias arquetípicas diferentes. También preparamos estímulos para emociones conscientes. En este experimento, las señales fisiológicas incluyeron actividades cardiovasculares, electrodérmicas, respiratorias y temperatura de la piel. El análisis estadístico sugirió que las experiencias arquetípicas podrían diferenciarse en función de las activaciones fisiológicas. Además, se construyeron varios modelos de predicción basados en los datos fisiológicos recopilados. Estos modelos demostraron la capacidad de clasificar los arquetipos con una precisión que era considerablemente más alta que el nivel de probabilidad. Como los resultados del segundo estudio sugirieron una relación positiva entre las experiencias arquetípicas y las activaciones de señales fisiológicas, parecía razonable realizar otro estudio para confirmar la generalización de nuestros hallazgos. Sin embargo, antes de comenzar un nuevo experimento, se decidió construir una herramienta que pudiera facilitar la recopilación de datos fisiológicos y el reconocimiento de experiencias arquetípicas, así como de emociones conscientes. Tal herramienta nos ayudaría a nosotros y a otros investigadores a realizar experimentos sobre la experiencia humana. Nuestra herramienta funciona en "tablets" y admite la recopilación y el análisis de datos de sensores fisiológicos. El último estudio se realizó utilizando una metodología similar al segundo experimento con varias modificaciones que tenían como objetivo obtener resultados más sólidos. El esfuerzo de realizar este estudio se redujo considerablemente al usar la herramienta desarrollada. Durante el experimento, sólo medimos las actividades cardiovasculares y electrodérmicas de los sujetos porque nuestros experimentos anteriores mostraron que estas dos señales contribuyeron significativamente a la clasificación de las emociones conscientes y las experiencias arquetípicas. El análisis estadístico indicó una relación significativa entre los arquetipos retratados en los videos y las respuestas fisiológicas de los sujetos. Además, utilizando métodos de minería de datos, creamos modelos de predicción que fueron capaces de reconocer las experiencias arquetípicas con una precisión menor que en el segundo estudio, pero todavía considerablemente..

    Digitizing arquetypal human expereience through physiological signals

    Get PDF
    The problem of capturing human experience is relevant in many application domains. In fact, the process of describing and sharing individual experience lies at the heart of human culture. This advancement came at a price of losing some of the multidimensional aspects of primary, bodily experience during its projection into the symbolic formThroughout the courses of our lives we learn a great deal of information about the world from other people's experience. Besides the ability to share utilitarian experience such as whether a particular plant is poisonous, humans have developed a sophisticated competency of social signaling that enables us to express and decode emotional experience. The natural way of sharing emotional experiences requires those who share to be co-present during this event. However, people have overcome the limitation of physical presence by creating a symbolic system of representations.Recent research in the field of affective computing has addressed the question of digitization and transmission of emotional experience through monitoring and interpretation of physiological signals. Although the outcomes of this research represent a great step forward in developing a technology that supports sharing of emotional experiences, they do not seem to help in preserving the original phenomenological experience during the aforementioned projection. This circumstance is explained by the fact that in affective computing the focus of investigation has been aimed at emotional experiences which can be consciously evaluated and described by individuals themselves. Therefore, generally speaking, applying an affective computing technique for capturing emotions of an individual is not a deeper or more precise way to project her experience into the symbolic form than asking this person to write down a description of her emotions on a piece of paper. One can say that so far the research in affective computing has aimed at delivering technology that could automate the projection but it has not considered the problem of improving the projection in order to preserve more of the multidimensional aspects of human experience.This dissertation examines whether human experience, which individuals are not able to consciously transpose into the symbolic representation, can still be captured using the techniques of affective computing.First, a theoretical framework for description of human experience which is not accessible for conscious awareness was formulated. This framework was based on the work of Carl Jung who introduced a model of a psyche that includes three levels: consciousness, the personal unconscious and the collective unconscious. Consciousness is the external layer of the psyche that consists of those thoughts and emotions which are available for one¿s conscious recollection. The personal unconscious represents a repository for all of an individual¿s feelings, memories, knowledge and thoughts that are not conscious at a given moment of time.The collective unconscious is a repository of universal modes and behaviors that are similar in all individuals. According to Jung, the collective unconscious is populated with archetypes. Archetypes are prototypical categories of objects, people and situations that existed across evolutionary time and in different cultures.Esta tesis doctoral examina si la experiencia humana, que los individuos no pueden transponer conscientemente a la representación simbólica, aún puede capturarse utilizando las técnicas de computación afectiva. Primero, se formula un marco teórico para la descripción de la experiencia humana que no es accesible para la conciencia consciente. Este marco se basó en el trabajo de Carl Jung, quien introdujo un modelo de psique que incluye tres niveles: la conciencia, el inconsciente personal y el inconsciente colectivo. Habiendo definido nuestro marco teórico, realizamos un experimento en el que se mostraron a los sujetos estímulos visuales y auditivos de bases de datos estandarizadas para la obtención de emociones conscientes. Aparte de los estímulos para las emociones conscientes, los sujetos fueron expuestos a estímulos que representaban el arquetipo del yo. Durante la presentación de los estímulos cardiovasculares se registraron las señales de los sujetos. Los resultados experimentales indicaron que las respuestas de la frecuencia cardíaca de los participantes fueron únicas para cada categoría de estímulos, incluido el arquetípico. Estos hallazgos dieron impulso a realizar otro estudio en el que se examinó un espectro más amplio de experiencias arquetípicas. En nuestro segundo estudio, hicimos un cambio de estímulos visuales y auditivos a estímulos audiovisuales porque se esperaba que los videos fueran más eficientes en la obtención de emociones conscientes y experiencias arquetípicas que las imágenes fijas o los sonidos. La cantidad de arquetipos aumentó y los sujetos en general fueron estimulados a sentir ocho experiencias arquetípicas diferentes. También preparamos estímulos para emociones conscientes. En este experimento, las señales fisiológicas incluyeron actividades cardiovasculares, electrodérmicas, respiratorias y temperatura de la piel. El análisis estadístico sugirió que las experiencias arquetípicas podrían diferenciarse en función de las activaciones fisiológicas. Además, se construyeron varios modelos de predicción basados en los datos fisiológicos recopilados. Estos modelos demostraron la capacidad de clasificar los arquetipos con una precisión que era considerablemente más alta que el nivel de probabilidad. Como los resultados del segundo estudio sugirieron una relación positiva entre las experiencias arquetípicas y las activaciones de señales fisiológicas, parecía razonable realizar otro estudio para confirmar la generalización de nuestros hallazgos. Sin embargo, antes de comenzar un nuevo experimento, se decidió construir una herramienta que pudiera facilitar la recopilación de datos fisiológicos y el reconocimiento de experiencias arquetípicas, así como de emociones conscientes. Tal herramienta nos ayudaría a nosotros y a otros investigadores a realizar experimentos sobre la experiencia humana. Nuestra herramienta funciona en "tablets" y admite la recopilación y el análisis de datos de sensores fisiológicos. El último estudio se realizó utilizando una metodología similar al segundo experimento con varias modificaciones que tenían como objetivo obtener resultados más sólidos. El esfuerzo de realizar este estudio se redujo considerablemente al usar la herramienta desarrollada. Durante el experimento, sólo medimos las actividades cardiovasculares y electrodérmicas de los sujetos porque nuestros experimentos anteriores mostraron que estas dos señales contribuyeron significativamente a la clasificación de las emociones conscientes y las experiencias arquetípicas. El análisis estadístico indicó una relación significativa entre los arquetipos retratados en los videos y las respuestas fisiológicas de los sujetos. Además, utilizando métodos de minería de datos, creamos modelos de predicción que fueron capaces de reconocer las experiencias arquetípicas con una precisión menor que en el segundo estudio, pero todavía considerablemente..

    Models and Analysis of Vocal Emissions for Biomedical Applications

    Get PDF
    The MAVEBA Workshop proceedings, held on a biannual basis, collect the scientific papers presented both as oral and poster contributions, during the conference. The main subjects are: development of theoretical and mechanical models as an aid to the study of main phonatory dysfunctions, as well as the biomedical engineering methods for the analysis of voice signals and images, as a support to clinical diagnosis and classification of vocal pathologies

    Trajectory Data Mining in Mouse Models of Stroke

    Get PDF
    Contains fulltext : 273912.pdf (Publisher’s version ) (Open Access)Radboud University, 04 oktober 2022Promotor : Kiliaan, A.J. Co-promotor : Wiesmann, M.167 p
    corecore