Fuzzy decision-making fuser (FDMF) for integrating human-machine autonomous (HMA) systems with adaptive evidence sources

© 2017 Liu, Pal, Marathe, Wang and Lin. A brain-computer interface (BCI) creates a direct communication pathway between the human brain and an external device or system. In contrast to patient-oriented BCIs, which are intended to restore inoperative or malfunctioning aspects of the nervous system, a growing number of BCI studies focus on designing auxiliary systems that are intended for everyday use. The goal of building these BCIs is to provide capabilities that augment existing intact physical and mental capabilities. However, a key challenge to BCI research is human variability; factors such as fatigue, inattention, and stress vary both across different individuals and for the same individual over time. If these issues are addressed, autonomous systems may provide additional benefits that enhance system performance and prevent problems introduced by individual human variability. This study proposes a human-machine autonomous (HMA) system that simultaneously aggregates human and machine knowledge to recognize targets in a rapid serial visual presentation (RSVP) task. The HMA focuses on integrating an RSVP BCI with computer vision techniques in an image-labeling domain. A fuzzy decision-making fuser (FDMF) is then applied in the HMA system to provide a natural adaptive framework for evidence-based inference by incorporating an integrated summary of the available evidence (i.e., human and machine decisions) and associated uncertainty. Consequently, the HMA system dynamically aggregates decisions involving uncertainties from both human and autonomous agents. The collaborative decisions made by an HMA system can achieve and maintain superior performance more efficiently than either the human or autonomous agents can achieve independently. The experimental results shown in this study suggest that the proposed HMA system with the FDMF can effectively fuse decisions from human brain activities and the computer vision techniques to improve overall performance on the RSVP recognition task. This conclusion demonstrates the potential benefits of integrating autonomous systems with BCI systems

The impact of vigorous cycling exercise on visual attention: a study with the BR8 wireless dry EEG system

Many studies have reported that exercise can influence cognitive performance. But advancing our understanding of the interrelations between psychology and physiology in sports neuroscience requires the study of real-time brain dynamics during exercise in the field. Electroencephalography (EEG) is one of the most powerful brain imaging technologies. However, the limited portability and long preparation time of traditional wet-sensor systems largely limits their use to laboratory settings. Wireless dry-sensor systems are emerging with much greater potential for practical application in sports. Hence, in this paper, we use the BR8 wireless dry-sensor EEG system to measure P300 brain dynamics while cycling at various intensities. The preparation time was mostly less than 2 min as BR8 system’s dry sensors were able to attain the required skin-sensor interface impedance, enabling its operation without any skin preparation or application of conductive gel. Ten participants performed four sessions of a 3 min rapid serial visual presentation (RSVP) task while resting and while cycling. These four sessions were pre-CE (RSVP only), low-CE (RSVP in 40–50% of max heart rate), vigorous-CE (RSVP in 71–85% of max heart rate) and post-CE (RSVP only). The recorded brain signals demonstrate that the P300 amplitudes, observed at the Pz channel, for the target and non-target responses were significantly different in all four sessions. The results also show decreased reaction times to the visual attention task during vigorous exercise, enriching our understanding of the ways in which exercise can enhance cognitive performance. Even though only a single channel was evaluated in this study, the quality and reliability of the measurement using these dry sensor-based EEG systems is clearly demonstrated by our results. Further, the smooth implementation of the experiment with a dry system and the success of the data analysis demonstrate that wireless dry EEG devices can open avenues for real-time measurement of cognitive functions in athletes outside the laboratory