5,783 research outputs found
VOLUNTARY CONTROL OF BREATHING ACCORDING TO THE BREATHING PATTERN DURING LISTENING TO MUSIC AND NON-CONTACT MEASUREMENT OF HEART RATE AND RESPIRATION
We investigated if listening to songs changes breathing pattern which changes autonomic responses such as heart rate (HR) and heart rate variability (HRV) or change in breathing pattern is a byproduct of listening to songs or change in breathing pattern as well as listening to songs causes changes in autonomic responses. Seven subjects (4 males and 3 females) participated in a pilot study where they listened to two types of songs and used a custom developed biofeedback program to control their breathing pattern to match the one recorded during listening to the songs.
Coherencies between EEG, breathing pattern and RR intervals (RRI) were calculated to study the interaction with neural responses. Trends in HRV varied only during listening to songs, suggesting that autonomic response was affected by listening to songs irrespective of control of breathing. Effective coherence during songs while spontaneously breathing was more than during silence and during control of breathing. These results, although preliminary, suggest that listening to songs as well as change in breathing patterns changes the autonomic response but the effect of listening to songs may surpass the effect of changes in breathing.
We explored feasibility of using non-contact measurements of HR and breathing rate (BR) by using recently developed Facemesh and other methods for tracking regions of interests from videos of faces of subjects. Performance was better for BR than HR, and over currently used methods. However, refinement of the approach would be needed to get the precision required for detecting subtle changes
Data-driven multivariate and multiscale methods for brain computer interface
This thesis focuses on the development of data-driven multivariate and multiscale methods
for brain computer interface (BCI) systems. The electroencephalogram (EEG), the
most convenient means to measure neurophysiological activity due to its noninvasive nature,
is mainly considered. The nonlinearity and nonstationarity inherent in EEG and its
multichannel recording nature require a new set of data-driven multivariate techniques to
estimate more accurately features for enhanced BCI operation. Also, a long term goal
is to enable an alternative EEG recording strategy for achieving long-term and portable
monitoring.
Empirical mode decomposition (EMD) and local mean decomposition (LMD), fully
data-driven adaptive tools, are considered to decompose the nonlinear and nonstationary
EEG signal into a set of components which are highly localised in time and frequency. It
is shown that the complex and multivariate extensions of EMD, which can exploit common
oscillatory modes within multivariate (multichannel) data, can be used to accurately
estimate and compare the amplitude and phase information among multiple sources, a
key for the feature extraction of BCI system. A complex extension of local mean decomposition
is also introduced and its operation is illustrated on two channel neuronal
spike streams. Common spatial pattern (CSP), a standard feature extraction technique
for BCI application, is also extended to complex domain using the augmented complex
statistics. Depending on the circularity/noncircularity of a complex signal, one of the
complex CSP algorithms can be chosen to produce the best classification performance
between two different EEG classes.
Using these complex and multivariate algorithms, two cognitive brain studies are
investigated for more natural and intuitive design of advanced BCI systems. Firstly, a Yarbus-style auditory selective attention experiment is introduced to measure the user
attention to a sound source among a mixture of sound stimuli, which is aimed at improving
the usefulness of hearing instruments such as hearing aid. Secondly, emotion experiments
elicited by taste and taste recall are examined to determine the pleasure and displeasure
of a food for the implementation of affective computing. The separation between two
emotional responses is examined using real and complex-valued common spatial pattern
methods.
Finally, we introduce a novel approach to brain monitoring based on EEG recordings
from within the ear canal, embedded on a custom made hearing aid earplug. The new
platform promises the possibility of both short- and long-term continuous use for standard
brain monitoring and interfacing applications
CardioCam: Leveraging Camera on Mobile Devices to Verify Users While Their Heart is Pumping
With the increasing prevalence of mobile and IoT devices (e.g., smartphones, tablets, smart-home appliances), massive private and sensitive information are stored on these devices. To prevent unauthorized access on these devices, existing user verification solutions either rely on the complexity of user-defined secrets (e.g., password) or resort to specialized biometric sensors (e.g., fingerprint reader), but the users may still suffer from various attacks, such as password theft, shoulder surfing, smudge, and forged biometrics attacks. In this paper, we propose, CardioCam, a low-cost, general, hard-to-forge user verification system leveraging the unique cardiac biometrics extracted from the readily available built-in cameras in mobile and IoT devices. We demonstrate that the unique cardiac features can be extracted from the cardiac motion patterns in fingertips, by pressing on the built-in camera. To mitigate the impacts of various ambient lighting conditions and human movements under practical scenarios, CardioCam develops a gradient-based technique to optimize the camera configuration, and dynamically selects the most sensitive pixels in a camera frame to extract reliable cardiac motion patterns. Furthermore, the morphological characteristic analysis is deployed to derive user-specific cardiac features, and a feature transformation scheme grounded on Principle Component Analysis (PCA) is developed to enhance the robustness of cardiac biometrics for effective user verification. With the prototyped system, extensive experiments involving 25 subjects are conducted to demonstrate that CardioCam can achieve effective and reliable user verification with over 99% average true positive rate (TPR) while maintaining the false positive rate (FPR) as low as 4%
MilliSonic: Pushing the Limits of Acoustic Motion Tracking
Recent years have seen interest in device tracking and localization using
acoustic signals. State-of-the-art acoustic motion tracking systems however do
not achieve millimeter accuracy and require large separation between
microphones and speakers, and as a result, do not meet the requirements for
many VR/AR applications. Further, tracking multiple concurrent acoustic
transmissions from VR devices today requires sacrificing accuracy or frame
rate. We present MilliSonic, a novel system that pushes the limits of acoustic
based motion tracking. Our core contribution is a novel localization algorithm
that can provably achieve sub-millimeter 1D tracking accuracy in the presence
of multipath, while using only a single beacon with a small 4-microphone
array.Further, MilliSonic enables concurrent tracking of up to four smartphones
without reducing frame rate or accuracy. Our evaluation shows that MilliSonic
achieves 0.7mm median 1D accuracy and a 2.6mm median 3D accuracy for
smartphones, which is 5x more accurate than state-of-the-art systems.
MilliSonic enables two previously infeasible interaction applications: a) 3D
tracking of VR headsets using the smartphone as a beacon and b) fine-grained 3D
tracking for the Google Cardboard VR system using a small microphone array
Structurally Rich Movement: Measuring Movement for Empirical Psychology and Examining the Dynamic Complexity of Affect Regulation in Behavior
Movement not only permeates human life, but structures dimensions of experience. Phenomenological theory points to the dynamic congruency of movement and emotion, via the body schema, as shaping affectivity. For psychology, this calls for an understanding of behavior beyond being discrete events, but also manifesting kinetic melodies. Yet there is a gap in existing methodology for empirically studying the three-dimensional characteristics of human movement continuously across segments of the body. A potential line of research in this area, implicit affect regulation capacities, was described to inform the selection of instrumentation, measurement, and calculations of dynamic structure that would, theoretically, best measure movement for this and likely other purposes.
Regarding instrumentation, an active motion capture system based on the Xbox Kinect and iPiSoft software was selected. Regarding measurement, rotational kinetic energy was identified from the biomechanics literature to meet this requirement. Calculations of dynamic structure focused on a measure of complexity, or structural richness, called multivariate multiscale sample entropy (MMSE).
The agreement between the active system and a gold standard passive motion capture system was assessed on two components of rotational kinetic energy, rotational magnitude velocity and segment length, and on dynamic structure calculations. Two MFA actors (one male and one female) and a male professor of theater performed a total of 20 movement sequences, which were concurrently measured by the two systems.
The active motion capture system satisfactorily estimated dynamic movement in agreement with the passive system. It also estimated summary measures in high agreement with the passive system. Calculations of dynamic structure were in satisfactory agreement as well. Analyses of MMSE calculations from the active system data provided initial evidence that this process could characterize movement complexity as structural richness, perhaps describable as the body moving as a coherent whole over time. The instrumentation and data processing procedure described in this project can be used to validly measure dynamic movement in psychology. Limitations of the study and future directions in the research and methods are discussed
Effectiveness of Remote PPG Construction Methods: A Preliminary Analysis
The contactless recording of a photoplethysmography (PPG) signal with a Red-Green-Blue (RGB) camera is known as remote photoplethysmography (rPPG). Studies have reported on the positive impact of using this technique, particularly in heart rate estimation, which has led to increased research on this topic among scientists. Therefore, converting from RGB signals to constructing an rPPG signal is an important step. Eight rPPG methods (plant-orthogonal-to-skin (POS), local group invariance (LGI), the chrominance-based method (CHROM), orthogonal matrix image transformation (OMIT), GREEN, independent component analysis (ICA), principal component analysis (PCA), and blood volume pulse (PBV) methods) were assessed using dynamic time warping, power spectrum analysis, and Pearson’s correlation coefficient, with different activities (at rest, during exercising in the gym, during talking, and while head rotating) and four regions of interest (ROI): the forehead, the left cheek, the right cheek, and a combination of all three ROIs. The best performing rPPG methods in all categories were the POS, LGI, and OMI methods; each performed well in all activities. Recommendations for future work are provided
- …