RAPID: Retrofitting IEEE 802.11ay Access Points for Indoor Human Detection and Sensing

In this work we present RAPID, a joint communication and radar (JCR) system based on next-generation IEEE 802.11ay WiFi networks operating in the 60 GHz band. In contrast to most existing approaches for human sensing at millimeter-waves, which employ special-purpose radars to retrieve the small-scale Doppler effect (micro-Doppler) caused by human motion, RAPID achieves radar-level sensing accuracy by retrofitting IEEE 802.11ay access points. For this, it leverages the IEEE 802.11ay beam training mechanism to accurately localize and track multiple individuals, while the in-packet beam tracking fields are exploited to extract the desired micro-Doppler signatures from the time-varying phase of the channel impulse response (CIR). The proposed approach enables activity recognition and person identification with IEEE 802.11ay wireless networks without requiring modifications to the packet structure specified by the standard. RAPID is implemented on an IEEE 802.11ay-compatible FPGA platform with phased antenna arrays, which estimates the CIR from the reflections of transmitted packets. The proposed system is evaluated on a large dataset of CIR measurements, proving robustness across different environments and subjects, and outperforming state-of-the-art sub-6 GHz WiFi sensing techniques. Using two access points, RAPID reliably tracks multiple subjects, reaching activity recognition and person identification accuracies of 94% and 90%, respectively.Comment: 16 pages, 18 figures, 4 table

Privacy-preserving human mobility and activity modelling

The exponential proliferation of digital trends and worldwide responses to the COVID-19 pandemic thrust the world into digitalization and interconnectedness, pushing increasingly new technologies/devices/applications into the market. More and more intimate data of users are collected for positive analysis purposes of improving living well-being but shared with/without the user's consent, emphasizing the importance of making human mobility and activity models inclusive, private, and fair. In this thesis, I develop and implement advanced methods/algorithms to model human mobility and activity in terms of temporal-context dynamics, multi-occupancy impacts, privacy protection, and fair analysis. The following research questions have been thoroughly investigated: i) whether the temporal information integrated into the deep learning networks can improve the prediction accuracy in both predicting the next activity and its timing; ii) how is the trade-off between cost and performance when optimizing the sensor network for multiple-occupancy smart homes; iii) whether the malicious purposes such as user re-identification in human mobility modelling could be mitigated by adversarial learning; iv) whether the fairness implications of mobility models and whether privacy-preserving techniques perform equally for different groups of users. To answer these research questions, I develop different architectures to model human activity and mobility. I first clarify the temporal-context dynamics in human activity modelling and achieve better prediction accuracy by appropriately using the temporal information. I then design a framework MoSen to simulate the interaction dynamics among residents and intelligent environments and generate an effective sensor network strategy. To relieve users' privacy concerns, I design Mo-PAE and show that the privacy of mobility traces attains decent protection at the marginal utility cost. Last but not least, I investigate the relations between fairness and privacy and conclude that while the privacy-aware model guarantees group fairness, it violates the individual fairness criteria.Open Acces

Acoustic indoor localization employing code division multiple access

Thesis (Master)--Izmir Institute of Technology, Electronics and Communication Engineering, Izmir, 2010Includes bibliographical references (leaves: 107-108)Text in English; Abstract: Turkish and Englishxvi, 160 69 leavesIndoor localization becomes a demand that comes into prominence day by day. Although extensively used outdoor location systems have been proposed, they can not operate in indoor applications. Hence new investigations have been carried on for accurate indoor localization in the last decade. In this thesis, a new indoor location system, that aims to locate an entity within an accuracy of about 2 cm using ordinary and inexpensive off-the-shelf devices, has been proposed and an implementation has been applied to evaluate the system performance. Therefore, time of arrival measurements of acoustic signals, which are binary phase shift keying modulated Gold code sequences using direct sequence spread spectrum technique, are done. Direct sequence-code division multiple access is applied to perform simultaneous accurate distance measurements and provides immunity to noise and interference. Two methods have been proposed for the location estimation. The first method takes the average of four location estimates obtained by trilateration technique. In the second method, only a single robust position estimate is obtained using three distances while the least reliable fourth distance measurement is not taken into account. The system performance is evaluated at positions from two height levels using two sets of variables determined by experimental results. The precision distributions in the work area and the precision versus accuracy plots depict the system performance for different sets of variables. The proposed system provides location estimates of better than 2 cm accuracy within 99% precision. Eventually, created graphical user interface provides a user friendly environment to adjust the parameters

A Review of Indoor Millimeter Wave Device-based Localization and Device-free Sensing Technologies and Applications

The commercial availability of low-cost millimeter wave (mmWave) communication and radar devices is starting to improve the penetration of such technologies in consumer markets, paving the way for large-scale and dense deployments in fifth-generation (5G)-and-beyond as well as 6G networks. At the same time, pervasive mmWave access will enable device localization and device-free sensing with unprecedented accuracy, especially with respect to sub-6 GHz commercial-grade devices. This paper surveys the state of the art in device-based localization and device-free sensing using mmWave communication and radar devices, with a focus on indoor deployments. We first overview key concepts about mmWave signal propagation and system design. Then, we provide a detailed account of approaches and algorithms for localization and sensing enabled by mmWaves. We consider several dimensions in our analysis, including the main objectives, techniques, and performance of each work, whether each research reached some degree of implementation, and which hardware platforms were used for this purpose. We conclude by discussing that better algorithms for consumer-grade devices, data fusion methods for dense deployments, as well as an educated application of machine learning methods are promising, relevant and timely research directions.Comment: 43 pages, 13 figures. Accepted in IEEE Communications Surveys & Tutorials (IEEE COMST

Neural Networks for Indoor Human Activity Reconstructions

Low cost, ubiquitous, tagless, and privacy aware indoor monitoring is essential to many existing or future applications, such as assisted living of elderly persons. We explore how well different types of neural networks in basic configurations can extract location and movement information from noisy experimental data (with both high-pitch and slow drift noise) obtained from capacitive sensors operating in loading mode at ranges much longer that the diagonal of their plates. Through design space exploration, we optimize and analyze the location and trajectory tracking inference performance of multilayer perceptron (MLP), autoregressive feedforward, 1D Convolutional (1D-CNN), and Long-Short Term Memory (LSTM) neural networks on experimental data collected using four capacitive sensors with 16 cm x 16 cm plates deployed on the boundaries of a 3 m x 3 m open space in our laboratory. We obtain the minimum error using a 1D-CNN [0.251 m distance Root Mean Square Error (RMSE) and 0.307 m Average Distance Error (ADE)] and the smoothest trajectory inference using an LSTM, albeit with higher localization errors (0.281 m RMSE and 0.326 m ADE). 1D Convolutional and window-based neural networks have best inference accuracy and smoother trajectory reconstruction. LSTMs seem to infer best the person movement dynamics