221 research outputs found
Hybrid Human-Machine Interface to Mouse Control for Severely Disabled People
This paper describes a hybrid human-machine interface, based on electro-oculogram (EOG) and electromyogram (EMG), which allows the mouse control of a personal computer using eye movement and the voluntary contraction of any facial muscle. The bioelectrical signals are sensed through adhesives electrodes, and acquired by a custom designed portable and wireless system. The mouse can be moved in any direction, vertical, horizontal and diagonal, by two EOG channels and the EMG signal is used to perform the mouse click action. Blinks are avoided by a decision algorithm and the natural reading of the screen is possible with a specially designed software. A virtual keyboard was used for the experiments with healthy people and with a severely disabled patient. The results demonstrate an intuitive and accessible control, evaluated in terms of performance, time for task execution and user´s acceptance. Besides, a quantitative index to estimate the training impact was computed with good results.Fil: López Celani, Natalia Martina. Universidad Nacional de San Juan. Facultad de Ingeniería. Departamento de Electrónica y Automática. Gabinete de Tecnología Médica; ArgentinaFil: Orosco, Eugenio Conrado. Universidad Nacional de San Juan. Facultad de Ingeniería. Instituto de Automática; ArgentinaFil: Pérez Berenguer, María Elisa. Universidad Nacional de San Juan. Facultad de Ingeniería. Departamento de Electrónica y Automática. Gabinete de Tecnología Médica; ArgentinaFil: Bajinay, Sergio. Universidad Nacional de San Juan. Facultad de Ingeniería. Departamento de Electrónica y Automática. Gabinete de Tecnología Médica; ArgentinaFil: Zanetti, Roberto. Universidad Nacional de San Juan. Facultad de Ingeniería. Departamento de Electrónica y Automática. Gabinete de Tecnología Médica; ArgentinaFil: Valentinuzzi, Maximo. Universidad Nacional de San Juan. Facultad de Ingeniería. Departamento de Electrónica y Automática. Gabinete de Tecnología Médica; Argentin
Utilizing Visual Attention and Inclination to Facilitate Brain-Computer Interface Design in an Amyotrophic Lateral Sclerosis Sample
Individuals who suffer from amyotrophic lateral sclerosis (ALS) have a loss of motor control and possibly the loss of speech. A brain-computer interface (BCI) provides a means for communication through nonmuscular control. Visual BCIs have shown the highest potential when compared to other modalities; nonetheless, visual attention concepts are largely ignored during the development of BCI paradigms. Additionally, individual performance differences and personal preference are not considered in paradigm development. The traditional method to discover the best paradigm for the individual user is trial and error. Visual attention research and personal preference provide the building blocks and guidelines to develop a successful paradigm. This study is an examination of a BCI-based visual attention assessment in an ALS sample. This assessment takes into account the individual’s visual attention characteristics, performance, and personal preference to select a paradigm. The resulting paradigm is optimized to the individual and then tested online against the traditional row-column paradigm. The optimal paradigm had superior performance and preference scores over row-column. These results show that the BCI needs to be calibrated to individual differences in order to obtain the best paradigm for an end user
A concept-environment for computer-based augmentative and alternative communication founded on a systematic review
Introduction: locked-In Syndrome is admittedly the worst case of motor and speech impairment, it seriously damages the ability of oral and gestural communication of patients. In recent years, alternative and augmentative communication technology has provided resources to restore these patients' ability to communicate. Methods: in order to relate and classify the main methods with that purpose, this work conducted a systematic review on several journal databases. Results: we found 203 related papers and 55 of them were selected to compose the study. After that, we classified them into three major groups and we identified the main difficulties when using each approach. Conclusion: in order to overcome these difficulties, we propose a new system concept to develop an adaptive, robust and low cost communication environment. The proposed system is composed of five modules: data entry, communication, aid to the caregiver and external interaction
Improving object segmentation by using EEG signals and rapid serial visual presentation
This paper extends our previous work on the potential of EEG-based brain computer interfaces to segment salient objects in images.
The proposed system analyzes the Event Related Potentials (ERP) generated by the rapid serial visual presentation of windows on the image.
The detection of the P300 signal allows estimating a saliency map of the image, which is used to seed a semi-supervised object segmentation algorithm.
Thanks to the new contributions presented in this work, the average Jaccard index was improved from to when processed in our publicly available dataset of images, object masks and captured EEG signals.
This work also studies alternative architectures to the original one, the impact of object occupation in each image window, and a more robust evaluation based on statistical analysis and a weighted F-score
Análise de propriedades intrínsecas e extrínsecas de amostras biométricas para detecção de ataques de apresentação
Orientadores: Anderson de Rezende Rocha, Hélio PedriniTese (doutorado) - Universidade Estadual de Campinas, Instituto de ComputaçãoResumo: Os recentes avanços nas áreas de pesquisa em biometria, forense e segurança da informação trouxeram importantes melhorias na eficácia dos sistemas de reconhecimento biométricos. No entanto, um desafio ainda em aberto é a vulnerabilidade de tais sistemas contra ataques de apresentação, nos quais os usuários impostores criam amostras sintéticas, a partir das informações biométricas originais de um usuário legítimo, e as apresentam ao sensor de aquisição procurando se autenticar como um usuário válido. Dependendo da modalidade biométrica, os tipos de ataque variam de acordo com o tipo de material usado para construir as amostras sintéticas. Por exemplo, em biometria facial, uma tentativa de ataque é caracterizada quando um usuário impostor apresenta ao sensor de aquisição uma fotografia, um vídeo digital ou uma máscara 3D com as informações faciais de um usuário-alvo. Em sistemas de biometria baseados em íris, os ataques de apresentação podem ser realizados com fotografias impressas ou com lentes de contato contendo os padrões de íris de um usuário-alvo ou mesmo padrões de textura sintéticas. Nos sistemas biométricos de impressão digital, os usuários impostores podem enganar o sensor biométrico usando réplicas dos padrões de impressão digital construídas com materiais sintéticos, como látex, massa de modelar, silicone, entre outros. Esta pesquisa teve como objetivo o desenvolvimento de soluções para detecção de ataques de apresentação considerando os sistemas biométricos faciais, de íris e de impressão digital. As linhas de investigação apresentadas nesta tese incluem o desenvolvimento de representações baseadas nas informações espaciais, temporais e espectrais da assinatura de ruído; em propriedades intrínsecas das amostras biométricas (e.g., mapas de albedo, de reflectância e de profundidade) e em técnicas de aprendizagem supervisionada de características. Os principais resultados e contribuições apresentadas nesta tese incluem: a criação de um grande conjunto de dados publicamente disponível contendo aproximadamente 17K videos de simulações de ataques de apresentações e de acessos genuínos em um sistema biométrico facial, os quais foram coletados com a autorização do Comitê de Ética em Pesquisa da Unicamp; o desenvolvimento de novas abordagens para modelagem e análise de propriedades extrínsecas das amostras biométricas relacionadas aos artefatos que são adicionados durante a fabricação das amostras sintéticas e sua captura pelo sensor de aquisição, cujos resultados de desempenho foram superiores a diversos métodos propostos na literature que se utilizam de métodos tradicionais de análise de images (e.g., análise de textura); a investigação de uma abordagem baseada na análise de propriedades intrínsecas das faces, estimadas a partir da informação de sombras presentes em sua superfície; e, por fim, a investigação de diferentes abordagens baseadas em redes neurais convolucionais para o aprendizado automático de características relacionadas ao nosso problema, cujos resultados foram superiores ou competitivos aos métodos considerados estado da arte para as diferentes modalidades biométricas consideradas nesta tese. A pesquisa também considerou o projeto de eficientes redes neurais com arquiteturas rasas capazes de aprender características relacionadas ao nosso problema a partir de pequenos conjuntos de dados disponíveis para o desenvolvimento e a avaliação de soluções para a detecção de ataques de apresentaçãoAbstract: Recent advances in biometrics, information forensics, and security have improved the recognition effectiveness of biometric systems. However, an ever-growing challenge is the vulnerability of such systems against presentation attacks, in which impostor users create synthetic samples from the original biometric information of a legitimate user and show them to the acquisition sensor seeking to authenticate themselves as legitimate users. Depending on the trait used by the biometric authentication, the attack types vary with the type of material used to build the synthetic samples. For instance, in facial biometric systems, an attempted attack is characterized by the type of material the impostor uses such as a photograph, a digital video, or a 3D mask with the facial information of a target user. In iris-based biometrics, presentation attacks can be accomplished with printout photographs or with contact lenses containing the iris patterns of a target user or even synthetic texture patterns. In fingerprint biometric systems, impostor users can deceive the authentication process using replicas of the fingerprint patterns built with synthetic materials such as latex, play-doh, silicone, among others. This research aimed at developing presentation attack detection (PAD) solutions whose objective is to detect attempted attacks considering different attack types, in each modality. The lines of investigation presented in this thesis aimed at devising and developing representations based on spatial, temporal and spectral information from noise signature, intrinsic properties of the biometric data (e.g., albedo, reflectance, and depth maps), and supervised feature learning techniques, taking into account different testing scenarios including cross-sensor, intra-, and inter-dataset scenarios. The main findings and contributions presented in this thesis include: the creation of a large and publicly available benchmark containing 17K videos of presentation attacks and bona-fide presentations simulations in a facial biometric system, whose collect were formally authorized by the Research Ethics Committee at Unicamp; the development of novel approaches to modeling and analysis of extrinsic properties of biometric samples related to artifacts added during the manufacturing of the synthetic samples and their capture by the acquisition sensor, whose results were superior to several approaches published in the literature that use traditional methods for image analysis (e.g., texture-based analysis); the investigation of an approach based on the analysis of intrinsic properties of faces, estimated from the information of shadows present on their surface; and the investigation of different approaches to automatically learning representations related to our problem, whose results were superior or competitive to state-of-the-art methods for the biometric modalities considered in this thesis. We also considered in this research the design of efficient neural networks with shallow architectures capable of learning characteristics related to our problem from small sets of data available to develop and evaluate PAD solutionsDoutoradoCiência da ComputaçãoDoutor em Ciência da Computação140069/2016-0
CNPq, 142110/2017-5CAPESCNP
From corporeality to virtual reality: theorizing literacy, bodies, and technology in the emerging media of virtual, augmented, and mixed realities
This dissertation explores the relationships between literacy, technology, and bodies in the emerging media of Virtual Reality (VR), Augmented Reality (AR), and Mixed Reality (MR). In response to the recent, rapid emergence of new media forms, questions arise as to how and why we should prepare to compose in new digital media. To interrogate the newness accorded to new media composing, I historicize the literacy practices demanded by new media by examining digital texts, such as video games and software applications, alongside analogous “antiquated” media, such as dioramas and museum exhibits. Comparative textual analysis of analogous digital and non-digital VR, AR, and MR texts reveals new media and “antiquated” media utilize common characteristics of dimensionality, layering, and absence/presence, respectively. The establishment of shared traits demonstrates how media operate on a continuum of mutually held textual practices; despite their distinctive forms, new media texts do not represent either a hierarchical or linear progression of maturing development. Such an understanding aids composing in new VR, AR, and MR media by enabling composers to make fuller use of prior knowledge in a rapidly evolving new media environment, a finding significant both for educators and communicators. As these technologies mature, we will continue to compose both traditional and new forms of texts. As such, we need literacy theory that attends to both the traditional and the new and also is comprehensive enough to encompass future acts of composing in media yet to emerge
Classificação de pacientes para adaptação de cadeira de rodas inteligente
Doutoramento em Engenharia InformáticaA importância e preocupação dedicadas à autonomia e independência das
pessoas idosas e dos pacientes que sofrem de algum tipo de deficiência tem
vindo a aumentar significativamente ao longo das últimas décadas. As
cadeiras de rodas inteligentes (CRI) são tecnologias que podem ajudar este
tipo de população a aumentar a sua autonomia, sendo atualmente uma área
de investigação bastante ativa. Contudo, a adaptação das CRIs a pacientes
específicos e a realização de experiências com utilizadores reais são assuntos
de estudo ainda muito pouco aprofundados.
A cadeira de rodas inteligente, desenvolvida no âmbito do Projeto IntellWheels,
é controlada a alto nível utilizando uma interface multimodal flexível,
recorrendo a comandos de voz, expressões faciais, movimentos de cabeça e
através de joystick. Este trabalho teve como finalidade a adaptação automática
da CRI atendendo às características dos potenciais utilizadores.
Foi desenvolvida uma metodologia capaz de criar um modelo do utilizador. A
investigação foi baseada num sistema de recolha de dados que permite obter
e armazenar dados de voz, expressões faciais, movimentos de cabeça e do
corpo dos pacientes. A utilização da CRI pode ser efetuada em diferentes
situações em ambiente real e simulado e um jogo sério foi desenvolvido
permitindo especificar um conjunto de tarefas a ser realizado pelos
utilizadores. Os dados foram analisados recorrendo a métodos de extração de
conhecimento, de modo a obter o modelo dos utilizadores. Usando os
resultados obtidos pelo sistema de classificação, foi criada uma metodologia
que permite selecionar a melhor interface e linguagem de comando da cadeira
para cada utilizador.
A avaliação para validação da abordagem foi realizada no âmbito do Projeto
FCT/RIPD/ADA/109636/2009 - "IntellWheels - Intelligent Wheelchair with
Flexible Multimodal Interface". As experiências envolveram um vasto conjunto
de indivíduos que sofrem de diversos níveis de deficiência, em estreita
colaboração com a Escola Superior de Tecnologia de Saúde do Porto e a
Associação do Porto de Paralisia Cerebral. Os dados recolhidos através das
experiências de navegação na CRI foram acompanhados por questionários
preenchidos pelos utilizadores. Estes dados foram analisados estatisticamente,
a fim de provar a eficácia e usabilidade na adequação da interface da CRI ao
utilizador. Os resultados mostraram, em ambiente simulado, um valor de
usabilidade do sistema de 67, baseado na opinião de uma amostra de
pacientes que apresentam os graus IV e V (os mais severos) de Paralisia
Cerebral. Foi também demonstrado estatisticamente que a interface atribuída
automaticamente pela ferramenta tem uma avaliação superior à sugerida pelos
técnicos de Terapia Ocupacional, mostrando a possibilidade de atribuir
automaticamente uma linguagem de comando adaptada a cada utilizador.
Experiências realizadas com distintos modos de controlo revelaram a
preferência dos utilizadores por um controlo compartilhado com um nível de
ajuda associado ao nível de constrangimento do paciente. Em conclusão, este
trabalho demonstra que é possível adaptar automaticamente uma CRI ao
utilizador com claros benefícios a nível de usabilidade e segurança.The importance and concern given to the autonomy and independence of
elderly people and patients suffering from some kind of disability has been
growing significantly in the last few decades. Intelligent wheelchairs (IW) are
technologies that can increase the autonomy and independence of this kind of
population and are nowadays a very active research area. However, the
adaptations to users’ specificities and experiments with real users are topics
that lack deeper studies.
The intelligent wheelchair, developed in the context of the IntellWheels project,
is controlled at a high-level through a flexible multimodal interface, using voice
commands, facial expressions, head movements and joystick as its main input
modalities. This work intended to develop a system enabling the automatic
adaptation, to the user characteristics, of the previously developed intelligent
wheelchair.
A methodology was created enabling the creation of a user model. The
research was based on the development of a data gathering system, enabling
the collection and storage of data from voice commands, facial expressions,
head and body movements from several patients with distinct disabilities such
as Cerebral Palsy. The wheelchair can be used in different situations in real
and simulated environments and a serious game was developed where
different tasks may be performed by users.
Data was analysed using knowledge discovery methods in order to create an
automatic patient classification system. Based on the classification system, a
methodology was developed enabling to select the best wheelchair interface
and command language for each patient.
Evaluation was performed in the context of Project FCT/RIPD/ADA/109636/
2009 – “IntellWheels – Intelligent Wheelchair with Flexible Multimodal
Interface”. Experiments were conducted, using a large set of patients suffering
from severe physical constraints in close collaboration with Escola Superior de
Tecnologia de Saúde do Porto and Associação do Porto de Paralisia Cerebral.
The experiments using the intelligent wheelchair were followed by user
questionnaires. The results were statistically analysed in order to prove the
effectiveness and usability of the adaptation of the Intelligent Wheelchair
multimodal interface to the user characteristics. The results obtained in a
simulated environment showed a 67 score on the system usability scale based
in the opinion of a sample of cerebral palsy patients with the most severe cases
IV and V of the Gross Motor Function Scale. It was also statistically
demonstrated that the data analysis system advised the use of an adapted
interface with higher evaluation than the one suggested by the occupational
therapists, showing the usefulness of defining a command language adapted to
each user. Experiments conducted with distinct control modes revealed the
users' preference for a shared control with an aid level taking into account the
level of constraint of the patient. In conclusion, this work demonstrates that it is
possible to adapt an intelligent wheelchair to the user with clear usability and
safety benefits
- …