A Modular Approach for Synchronized Wireless Multimodal Multisensor Data Acquisition in Highly Dynamic Social Settings

Existing data acquisition literature for human behavior research provides wired solutions, mainly for controlled laboratory setups. In uncontrolled free-standing conversation settings, where participants are free to walk around, these solutions are unsuitable. While wireless solutions are employed in the broadcasting industry, they can be prohibitively expensive. In this work, we propose a modular and cost-effective wireless approach for synchronized multisensor data acquisition of social human behavior. Our core idea involves a cost-accuracy trade-off by using Network Time Protocol (NTP) as a source reference for all sensors. While commonly used as a reference in ubiquitous computing, NTP is widely considered to be insufficiently accurate as a reference for video applications, where Precision Time Protocol (PTP) or Global Positioning System (GPS) based references are preferred. We argue and show, however, that the latency introduced by using NTP as a source reference is adequate for human behavior research, and the subsequent cost and modularity benefits are a desirable trade-off for applications in this domain. We also describe one instantiation of the approach deployed in a real-world experiment to demonstrate the practicality of our setup in-the-wild.Comment: 9 pages, 8 figures, Proceedings of the 28th ACM International Conference on Multimedia (MM '20), October 12--16, 2020, Seattle, WA, USA. First two authors contributed equall

Development of a Signal Processing Library for Extraction of SpO2, HR, HRV, and RR from Photoplethysmographic Waveforms

Non-invasive remote physiological monitoring of soldiers on the battlefield has the potential to provide fast, accurate status assessments that are key to improving the survivability of critical injuries. The development of WPI’s wearable wireless pulse oximeter, designed for field-based applications, has allowed for the optimization of important hardware features such as physical size and power management. However, software-based digital signal processing (DSP) methods are still required to perform physiological assessments. This research evaluated DSP methods that were capable of providing arterial oxygen saturation (SpO2), heart rate (HR), heart rate variability (HRV), and respiration rate (RR) measurements derived from data acquired using a single optical sensor. In vivo experiments were conducted to evaluate the accuracies of the processing methods across ranges of physiological conditions. Of the algorithms assessed, 13 SpO2 methods, 1 HR method, 6 HRV indices, and 4 RR methods were identified that provided clinically acceptable measurement accuracies and could potentially be employed in a wearable pulse oximeter