Assessing neurosky's usability to detect attention levels in an assessment exercise

This paper presents the results of a usability evaluation of the NeuroSky's MindSet (MS). Until recently most Brain Computer Interfaces (BCI) have been designed for clinical and research purposes partly due to their size and complexity. However, a new generation of consumer-oriented BCI has appeared for the video game industry. The MS, a headset with a single electrode, is based on electro-encephalogram readings (EEG) capturing faint electrical signals generated by neural activity. The electrical signal across the electrode is measured to determine levels of attention (based on Alpha waveforms) and then translated into binary data. This paper presents the results of an evaluation to assess the usability of the MS by defining a model of attention to fuse attention signals with user-generated data in a Second Life assessment exercise. The results of this evaluation suggest that the MS provides accurate readings regarding attention, since there is a positive correlation between measured and self-reported attention levels. The results also suggest there are some usability and technical problems with its operation. Future research is presented consisting of the definition a standardized reading methodology and an algorithm to level out the natural fluctuation of users' attention levels if they are to be used as inputs

An Exploration of User Engagement in HCI

Engagement is a concept of the utmost importance in human computer interaction, not only for informing the design and implementation of interfaces, but also for enabling more sophisticated interfaces capable of adapting to users. While the notion of engagement is actively being studied in a diverse set of domains, the term has been used to refer to a number of related, but different concepts. This paper represents a first attempt at exploring a number of important concepts that the term has been used to refer to, of relevance to both human-human and human-machine interaction modelling

Experimento de medição do nível de Atenção do Estudante: o uso da Mídia Interativa como Estímulo Resposta

Os tipos de atenção estudados pela literatura científica estão se tornandocada vez mais consistentes com as atividades do ser humano. Uma interação eficazpode fazer com que a atenção seja usada como um recurso de estímulo resposta.Por ser um recurso importante, a atenção deve ser medida com indicadoresquantitativos. Um método usado para medir isso é a aquisição do processamento einterpretação do tipo de onda EEG (Eletroencefalograma). O artigo apresenta umestudo comparativo entre métodos clássicos e métodos interativos para investigar aatenção e mensura os resultados observados

Developing a portable, customizable, single-channel EEG device for homecare and validating it against a commercial EEG device

There are several commercial electroencephalography (EEG) devices on the market; however, affordable devices are not versatile for diverse research applications. The purpose of this project was to investigate how to develop a low-cost, portable, single-channel EEG system for a research institute that could be used for neurofeedback-related applications in homecare. A device comparison was intended to examine what system requirements such a system would need to achieve the secondary objective of developing a neurofeedback application that demonstrates the functionalities of the new device. A portable, single-channel EEG device prototype was realized that consisted of an amplifier module called EEG Click, a single-board microcontroller, an electrode cable, some disposable wet electrode pads, and a custom 3D-printed headband. Three pieces of software were developed: firmware for the prototype, two supporting computer applications for data recording, and visual neurofeedback. The neurofeedback application replayed a first-person view roller coaster video at a varying frame rate based on the theta band's mean power spectral density (PSD). The prototype was compared against a commercial device, InteraXon MUSE 2 (Muse). Technical measurements included determining the amplitude-frequency characteristics and signal quality, such as signal-to-noise ratio (SNR), spurious-free dynamic range (SFDR), and total harmonic distortion (THD). Furthermore, four physiological measurements were performed on six human test subjects, aged between 21-31 (mean: 26.0, std: 3.11), to compare the altered brain activity and induced artifacts between the two devices. The four tests were respiratory exercise, head movement exercise, eye movement exercise, and paced auditory serial addition test (PASAT), where each measurement included several epochs with various stimuli. After the recordings, PSD was calculated for each bandpass filtered epoch, then the spectra were split into theta (4-8 Hz), alpha (8-12 Hz), and beta bands (12-30 Hz). The PSD values were averaged within each frequency band, and then these baseline-corrected mean values were the input for the repeated measures ANOVA statistical analysis. Results revealed that the amplitude-frequency characteristic of the prototype was low-pass filter-like and had a smaller slope than Muse's. The prototype's SNR, including and excluding the first five harmonics, was 6 dB higher, while SFDR and THD for the first five harmonics were roughly the same as Muse's. The two devices were comparable in detecting changes in most physiological measurements. Some differences between the two devices were that Muse was able to detect changes in respiratory activity in the beta band (F(8,16) = 2.510, p = .056), while the prototype was more sensitive to eye movement, especially lateral and circular eye movement in theta (F(2,8) = 9.144, p = .009) and alpha (F(2,8) = 6.095, p = .025) bands. A low-cost, portable EEG prototype was successfully realized and validated. The prototype was capable of performing homecare neurofeedback in the theta band. The results indicated it is worth exploring further the capabilities of the prototype. Since the sample size was too small, more complex physiological measurements with more test subjects would be more conclusive. Nevertheless, the findings are promising; the prototype may become a product once

Low-cost methodologies and devices applied to measure, model and self-regulate emotions for Human-Computer Interaction

En aquesta tesi s'exploren les diferents metodologies d'anàlisi de l'experiència UX des d'una visió centrada en usuari. Aquestes metodologies clàssiques i fonamentades només permeten extreure dades cognitives, és a dir les dades que l'usuari és capaç de comunicar de manera conscient. L'objectiu de la tesi és proposar un model basat en l'extracció de dades biomètriques per complementar amb dades emotives (i formals) la informació cognitiva abans esmentada. Aquesta tesi no és només teòrica, ja que juntament amb el model proposat (i la seva evolució) es mostren les diferents proves, validacions i investigacions en què s'han aplicat, sovint en conjunt amb grups de recerca d'altres àrees amb èxit.En esta tesis se exploran las diferentes metodologías de análisis de la experiencia UX desde una visión centrada en usuario. Estas metodologías clásicas y fundamentadas solamente permiten extraer datos cognitivos, es decir los datos que el usuario es capaz de comunicar de manera consciente. El objetivo de la tesis es proponer un modelo basado en la extracción de datos biométricos para complementar con datos emotivos (y formales) la información cognitiva antes mencionada. Esta tesis no es solamente teórica, ya que junto con el modelo propuesto (y su evolución) se muestran las diferentes pruebas, validaciones e investigaciones en la que se han aplicado, a menudo en conjunto con grupos de investigación de otras áreas con éxito.In this thesis, the different methodologies for analyzing the UX experience are explored from a user-centered perspective. These classical and well-founded methodologies only allow the extraction of cognitive data, that is, the data that the user is capable of consciously communicating. The objective of this thesis is to propose a methodology that uses the extraction of biometric data to complement the aforementioned cognitive information with emotional (and formal) data. This thesis is not only theoretical, since the proposed model (and its evolution) is complemented with the different tests, validations and investigations in which they have been applied, often in conjunction with research groups from other areas with success

Analisis gelombang otak low alpha high alpha low beta high beta dan theta menggunakan alat Neurosky Mindwave Mobile Headset untuk mengidentifikasi kelelahan supervisor pabrik menggunakan metode Means Comparison Test (MCT)

Brain-Computer Interface (BCI) adalah jalur komunikasi langsung antara otak dan perangkat eksternal (Tan dan Nijholt, 2010). Dengan kata lain, BCI adalah bidang kajian untuk memanfaatkan gelombang listrik yang dipancarkan oleh otak dan ditangkap oleh sensor seperti Electroencephalography (EEG), ke dalam aplikasi komputer. Kelelahan merupakan suatu keadaan yang sulit dipisahkan dalam kehidupan manusia, sehingga sedapat mungkin kelelahan tersebut dihindarkan ketika seseorang hendak melakukan pekerjaanya agar performa kerja yang diharapkan dapat terpenuhi. Dengan mendeteksi secara dini kelelahan tersebut maka setidaknya kelelahan dapat dihindarkan, salah satunya kelelahan mental. Belum adanya penelitian ilmiah yang menyebutkan bahwa kelelahan mental dapat diketahui melalui gelombang otak menjadikan penelitian ini sebagai penelitian dasar untuk mendeteksi kelelahan. Penelitian dilakukan dengan menganalisis dan mengidentifikasi gelombang otak low alpha, high alpha, low beta, high beta dan theta dari supervisor pabrik. Keluaran dari penelitian ini didapati standar kelelahan dari seorang supervisor pabrik. =============================================================================================== Brain Computer Interface (BCI) is a direct communication route between the brain and an external device (Tan and Nijholt, 2010). in other words, BCI is a subject which analyze the waves effused by the brain and captured by sensor such as Electroencephalography (EEG) into a computer software. fatigue is an inseperable part of human life so that it is important to be avoided in order to go for the desired work performance. By early detection, it is expexted that fatigue , especially mental fatigue, can be avoided. the fact that it is not scientifically proven yet that mental fatigue can be detected by the wave effused by the brain make this research the base of fatigue detector development. this reserach is done by analyzing and identifying low alpha, high alpha, low beta, high beta and tetha brainwave of a manufacturing supervisor. the result of the research will indicate the fatigue level of a manufacturing supervisor

Aplicação da tecnologia interface cérebro-computador em recursos educacionais : o reconhecimento de emoções

Esta tese teve por objetivo investigar os fenômenos das emoções desencadeadas, observando as frequências das regiões em que ocorrem diferentes impulsos cerebrais dos estudantes ao utilizarem diferentes recursos educacionais de ciências por meio da mensuração cerebral com eletroencefalogramas (EEG). Os recursos educacionais escolhidos foram: vídeos, realidade virtual e a assistente virtual ALEXA. A escolha por estes recursos diz respeito, especialmente, aos impactos na aprendizagem, à usabilidade e à inovação para o ensino de ciências. O fenômeno dos estados emocionais dos estudantes durante a realização de atividades com os recursos citados foi registrada com o uso de sensores EEG portáteis, que são equipamentos que medem ondas cerebrais de forma não invasiva. Foram definidas similaridades nas classificações para os padrões de frequência cerebral encontrados, normalizando as diferenças que precisam ser sensíveis as regiões das frequências cerebrais. Métodos de diferentes emoções e evidências foram usados para fornecer características similares, além de técnicas de EEG, observando o mapeamento da ativação em que ocorre. Os resultados apontaram que os estudos com sensores vestíveis podem detectar sinais diferenciáveis para vários estados mentais dos estudantes. Isso ficou evidente durante as análises que trouxeram as faixas medidas em Hert e a predominância das ondas apresentadas foram as ondas alpha e beta em sua maior concentração. Este resultado traz a importância da capacidade da leitura da atividade cerebral e sua portabilidade em ambiente de sala de aula. Essa pesquisa mostra que a leitura de ondas cerebrais EEG pode ser uma ferramenta relevante para o ensino de ciências utilizadas como Interface Cérebro-Computador. Nos estudos foram observadas as emoções dos estudantes sob o aspecto dos recursos educacionais conduzido por meio de um software de leitura de atividade cerebral e o uso de sensores EEG. O estudo encontrou diferenças significativas no estado emocional em diferentes recursos educacionais sendo os valores de emoções mensurados nas diferentes situações o que mais predominou foi em que ocorreu mais animação visual Com isso, esperamos contribuir com o conhecimento sobre as relações entre os recursos educacionais emergentes em ciências e os fenômenos das emoções desencadeadas no estudante durante seu uso e realização.This objective aimed to investigate the triggered phenomena and emotions, observing the frequencies of the regions in which different characteristics of the students were used in different educational science resources, through brain measurement with electroencephaly (EEG). The chosen resources were: videos, virtual reality and ALEXA virtual assistant. The choice for these resources for Science Teaching, especially the impacts on learning, usability and innovation for Science Teaching. The phenomenon of students' attention while carrying out activities with the aforementioned resources was recorded using portable EEG devices, which are equipment that measure waves invasively. were found for the brain frequency patterns found, such as differences that need to be included as regions of similar frequencies, being normalized. Attention methods and combination tests were used for characteristics such as, in addition to offering techniques and similar stimuli. The results indicate that studies with wearable sensors can detect different signals for various mental states of students. This, during the period of observed waves, were presented as being the songs that were presented as being the predominant waves of Hertz. This result brings the importance of the ability to read brain activity and its portability in a classroom environment. This shows that reading EEG research waves can be a relevant tool for Science Teaching used as a Brain Computer Interface. In the studies, emotions and the phenomenon of students were o bserved under the aspect of reading resources of brain sensors and the use of EEG. The study of significant differences in attention and emotions in different media, with the values of attention and emotions measured in the different differences, which predominated where more visual stimuli occurred. The emerging resources in Science and the phenomena of attention and emotions triggered in the student during their use and realization

Intensidade da atenção do estudante : registro de EEG no contexto de audiovisual e mídias interativas

Avanços tecnológicos recentes com técnicas de EEG (eletroencefalogramas), permitem que a atividade elétrica do cérebro seja registrada usando dispositivos acessíveis para usuários finais. Existe um número ainda pequeno de educadores que começaram a utilizar o EEG para mensurar a intensidade da atenção com os conteúdos audiovisuais e multimídias. Através das ferramentas interativas os educadores também ganham novas oportunidades educacionais, tais como as interações, que podem aumentar a motivação dos alunos e transmitir valiosas competências na mídia através do framework do H5P. Neste trabalho apresentou-se um novo conceito baseado em tecnologias de Interface Cérebro-Computador. Hoje, existe na indústria um dispositivo portátil em formato de headset que está sendo utilizado como fonte para o diagnóstico e feedbacks de partes indicadoras do cérebro. A ferramenta utilizou um vídeo interativo com o uso de um framework em um desktop exibindo os dados de EEG gravados em tempo real empregando as tecnologias de Interface Cérebro-Computador. No software Neuroexperimenter foram demonstrados sinais elétricos e ondas envolvendo uma interação entre o conteúdo abordado no vídeo e os feedbacks do sensor com valores de atenção. Para esse trabalho utilizou-se a plataforma H5P (conteúdo HTML5 interativo) como ferramenta para o reconhecimento do potencial cognitivo, possibilidades lúdicas e interacionais. Essa plataforma potencializa a atenção, sendo parte no processo de ensino aprendizagem. A pesquisa abordou os participantes que foram avaliados em seus processos de atenção através da leitura de EEG. Para a verificação da eficácia do sistema foi utilizado o equipamento de EEG conhecido como Mindwave Neurosky, à fim de mensurar os níveis de atenção do participante. O estado atencional de um indivíduo pode ser determinado por meio de parâmetros fisiológicos, uma métrica importante que pode ser extraída é a classificação da atenção. Com o uso da tecnologia Neuroexperimenter, o estudo mostrou que o estado de atenção do estudante é evidenciado através da intensidade elétrica com oscilações neuronais e trouxe os resultados através de dados brutos, buscando os estados de atenção efetivos e não efetivos. Os resultados do estudo foram bem-sucedidos e corroboram a afirmação que o algoritmo de atenção do dispositivo EEG de fato representa a atenção do participante. Esta Tese propôs uma abordagem de validade usando as descobertas da neurociência em relação as métricas fisiológicas de atenção. Esta abordagem foi demonstrada com o dispositivo EEG vestível Mindwave. Com base nos resultados entre as bandas de frequências e os valores de atenção calculados pelo dispositivo, pode-se observar que houve oscilações evidenciadas no estado e processo de atenção.Recent technological advances with EEG (electroencephalogram) techniques allow the electrical activity of the brain to be recorded using devices accessible to end users. There is still a small number of educators who have started to use the EEG to measure the intensity of attention with audiovisual and multimedia contents. Through interactive tools, educators also gain new educational opportunities, such as interactions, which can increase student motivation and convey valuable media skills through the framework. This work presents a new concept based on brain-computer interface technologies. Today, there is a handheld device in the industry in the form of a headset that is being used as a source for diagnosis and feedback from the indicating parts of the brain. The tool uses an interactive video with the use of a framework on a desktop displaying EEG data recorded in real time using Computer Interface technologies. The Neuroexperimenter software will demonstrate electrical signals and waves involving an interaction between the content covered in the video and sensor feedbacks with attention values. For this work, the H5P platform (interactive HTML5 content) is used as a tool for the recognition of cognitive potential, playful and interactional possibilities. This platform enhances attention, being part of the teaching-learning process. The research addresses the participants who will be evaluated in their attention processes through EEG reading. To verify the effectiveness of the system, the EEG equipment known as Mindwave Neurosky will be used, in order to measure the participant's attention levels. The attentional state of an individual can be determined through physiological parameters, an important metric that can be extracted is the attention classification. With the use of Neuroexperimenter technology, the study showed that the student's states of attention are evidenced through electrical intensity with neuronal oscillations and brought the results through raw data, seeking effective and non-effective states of attention. The results of the study were successful and support the assertion that the attention algorithm of the EEG device in fact represents the participant's attention. This thesis proposed a validity approach using the findings of neuroscience in relation to physiological metrics of attention. This approach was demonstrated with the Mindwave Mobile wearable EEG device. Based on the results between the frequency bands and the attention values calculated by the device, it can be concluded that there were evidenced oscillations in the states and processes of attention.Los recientes avances tecnológicos con las técnicas de EEG (electroencefalogramas) permiten registrar la actividad eléctrica del cerebro utilizando dispositivos accesibles para los usuarios finales. Aún existe un reducido número de educadores que han comenzado a utilizar el EEG para medir la intensidad de la atención con contenidos audiovisuales y multimedia. A través de herramientas interactivas, los educadores también obtienen nuevas oportunidades educativas, como interacciones, que pueden aumentar la motivación de los estudiantes e impartir valiosas habilidades de medios a través del marco H5P. En este trabajo se presentó un nuevo concepto basado en tecnologías de Interfaz Cerebro-Computadora. Hoy en día, existe un dispositivo de mano en la industria en forma de auriculares que se utiliza como fuente de diagnóstico y retroalimentación de las partes indicadoras del cerebro. La herramienta utilizó un video interactivo usando un marco en un escritorio que muestra los datos de EEG registrados en tiempo real empleando tecnologías de interfaz cerebro-computadora. En el software Neuroexperimenter se demostraron señales eléctricas y ondas que implican una interacción entre el contenido cubierto en el video y las retroalimentaciones del sensor con valores de atención. Para este trabajo se utilizó la plataforma H5P (contenido interactivo HTML5) como herramienta para el reconocimiento del potencial cognitivo, las posibilidades lúdicas e interactivas. Esta plataforma potencia la atención, siendo parte del proceso de enseñanza-aprendizaje. La investigación se acercó a los participantes que fueron evaluados en sus procesos de atención a través de la lectura de EEG. Para verificar la efectividad del sistema, se utilizó el equipo de EEG conocido como Mindwave Neurosky, con el fin de medir los niveles de atención del participante. El estado de atención de un individuo se puede determinar a través de parámetros fisiológicos, una métrica importante que se puede extraer es la clasificación de la atención. Con el uso de la tecnología Neuroexperimenter, el estudio mostró que el estado de atención del estudiante se evidencia a través de la intensidad eléctrica con oscilaciones neuronales y trajo los resultados a través de datos brutos, buscando estados de atención efectivos e ineficaces. Los resultados del estudio fueron exitosos y respaldan la afirmación de que el algoritmo de atención del dispositivo EEG representa de hecho la atención del participante. Esta tesis propuso un enfoque de validez utilizando los hallazgos de la neurociencia en relación con las métricas fisiológicas de la atención. Este enfoque se ha demostrado con el dispositivo EEG portátil Mindwave. Con base en los resultados entre las bandas de frecuencia y los valores de atención calculados por el dispositivo, se puede observar que se evidenciaron oscilaciones en el estado y proceso de atención

Modelling and computer system development for usage of e-government services for persons with disabilities

Cilj ove doktorske disertacije je da predstavi model i računarski sistem koji rešava problem osoba sa invaliditetom koja nisu u mogućnosti da koriste ruke ili funkciju govora u ostvarivanju komunikacije. Disertacija se bavi problematikom mogućnosti primene ekonomski pristupačnih asistivnih tehnologija u domenu primene servisa elektronske uprave. Od asistivnih tehnologija disertacija istražuje mogućnosti primene neinvazivne BCI tehnologije u poređenju sa sistemima baziranih na HD kamerama. Razvijen je računarski sistem koji omogućava integraciju u operativni sistem i upotrebu računara za unos komandi upotrebom detekcije moždanih talasa.The main objective of this doctoral thesis is to present the model and a computer system that solves the communication problem of people with disabilities (people who cannot use their hands or the function of speech communication). The dissertation researches the possibility to apply economic affordable assistive technologies in the field of application of e-government services. Thesis explores the possibilities of application of non-invasive BCI technology compared to systems based on HD cameras. Has been developed a computer system that allows the integration into the operating system that allow to enter commands by the detection of brain waves