Spatial Detection of Multiple Movement Intentions from SAM-Filtered Single-Trial MEG for a high performance BCI

The objective of this study is to test whether human intentions to sustain or cease movements in right and left hands can be decoded reliably from spatially filtered single trial magneto-encephalographic (MEG) signals. This study was performed using motor execution and motor imagery movements to achieve a potential high performance Brain-Computer interface (BCI). Seven healthy volunteers, naïve to BCI technology, participated in this study. Signals were recorded from 275-channel MEG and synthetic aperture magnetometry (SAM) was employed as the spatial filter. The four-class classification for natural movement intentions was performed offline; Genetic Algorithm based Mahalanobis Linear Distance (GA-MLD) and direct-decision tree classifier (DTC) techniques were adopted for the classification through 10-fold cross-validation. Through SAM imaging, strong and distinct event related desynchronisation (ERD) associated with sustaining, and event related synchronisation (ERS) patterns associated with ceasing of hand movements were observed in the beta band (15 - 30 Hz). The right and left hand ERD/ERS patterns were observed on the contralateral hemispheres for motor execution and motor imagery sessions. Virtual channels were selected from these cortical areas of high activity to correspond with the motor tasks as per the paradigm of the study. Through a statistical comparison between SAM-filtered virtual channels from single trial MEG signals and basic MEG sensors, it was found that SAM-filtered virtual channels significantly increased the classification accuracy for motor execution (GA-MLD: 96.51 ± 2.43 %) as well as motor imagery sessions (GA-MLD: 89.69 ± 3.34%). Thus, multiple movement intentions can be reliably detected from SAM-based spatially-filtered single trial MEG signals. MEG signals associated with natural motor behavior may be utilized for a reliable high-performance brain-computer interface (BCI) and may reduce long-term training compared with conventional BCI methods using rhythm control. This may prove tremendously helpful for patients suffering from various movement disorders to improve their quality of life

A Review of Indoor Millimeter Wave Device-based Localization and Device-free Sensing Technologies and Applications

The commercial availability of low-cost millimeter wave (mmWave) communication and radar devices is starting to improve the penetration of such technologies in consumer markets, paving the way for large-scale and dense deployments in fifth-generation (5G)-and-beyond as well as 6G networks. At the same time, pervasive mmWave access will enable device localization and device-free sensing with unprecedented accuracy, especially with respect to sub-6 GHz commercial-grade devices. This paper surveys the state of the art in device-based localization and device-free sensing using mmWave communication and radar devices, with a focus on indoor deployments. We first overview key concepts about mmWave signal propagation and system design. Then, we provide a detailed account of approaches and algorithms for localization and sensing enabled by mmWaves. We consider several dimensions in our analysis, including the main objectives, techniques, and performance of each work, whether each research reached some degree of implementation, and which hardware platforms were used for this purpose. We conclude by discussing that better algorithms for consumer-grade devices, data fusion methods for dense deployments, as well as an educated application of machine learning methods are promising, relevant and timely research directions.Comment: 43 pages, 13 figures. Accepted in IEEE Communications Surveys & Tutorials (IEEE COMST

Deep Learning for Audio Signal Processing

Given the recent surge in developments of deep learning, this article provides a review of the state-of-the-art deep learning techniques for audio signal processing. Speech, music, and environmental sound processing are considered side-by-side, in order to point out similarities and differences between the domains, highlighting general methods, problems, key references, and potential for cross-fertilization between areas. The dominant feature representations (in particular, log-mel spectra and raw waveform) and deep learning models are reviewed, including convolutional neural networks, variants of the long short-term memory architecture, as well as more audio-specific neural network models. Subsequently, prominent deep learning application areas are covered, i.e. audio recognition (automatic speech recognition, music information retrieval, environmental sound detection, localization and tracking) and synthesis and transformation (source separation, audio enhancement, generative models for speech, sound, and music synthesis). Finally, key issues and future questions regarding deep learning applied to audio signal processing are identified.Comment: 15 pages, 2 pdf figure

Mental state estimation for brain-computer interfaces

Mental state estimation is potentially useful for the development of asynchronous brain-computer interfaces. In this study, four mental states have been identified and decoded from the electrocorticograms (ECoGs) of six epileptic patients, engaged in a memory reach task. A novel signal analysis technique has been applied to high-dimensional, statistically sparse ECoGs recorded by a large number of electrodes. The strength of the proposed technique lies in its ability to jointly extract spatial and temporal patterns, responsible for encoding mental state differences. As such, the technique offers a systematic way of analyzing the spatiotemporal aspects of brain information processing and may be applicable to a wide range of spatiotemporal neurophysiological signals

Spatial encoding in primate hippocampus during free navigation.

The hippocampus comprises two neural signals-place cells and θ oscillations-that contribute to facets of spatial navigation. Although their complementary relationship has been well established in rodents, their respective contributions in the primate brain during free navigation remains unclear. Here, we recorded neural activity in the hippocampus of freely moving marmosets as they naturally explored a spatial environment to more explicitly investigate this issue. We report place cells in marmoset hippocampus during free navigation that exhibit remarkable parallels to analogous neurons in other mammalian species. Although θ oscillations were prevalent in the marmoset hippocampus, the patterns of activity were notably different than in other taxa. This local field potential oscillation occurred in short bouts (approximately .4 s)-rather than continuously-and was neither significantly modulated by locomotion nor consistently coupled to place-cell activity. These findings suggest that the relationship between place-cell activity and θ oscillations in primate hippocampus during free navigation differs substantially from rodents and paint an intriguing comparative picture regarding the neural basis of spatial navigation across mammals