Combining brain-computer interfaces and assistive technologies: state-of-the-art and challenges

In recent years, new research has brought the field of EEG-based Brain-Computer Interfacing (BCI) out of its infancy and into a phase of relative maturity through many demonstrated prototypes such as brain-controlled wheelchairs, keyboards, and computer games. With this proof-of-concept phase in the past, the time is now ripe to focus on the development of practical BCI technologies that can be brought out of the lab and into real-world applications. In particular, we focus on the prospect of improving the lives of countless disabled individuals through a combination of BCI technology with existing assistive technologies (AT). In pursuit of more practical BCIs for use outside of the lab, in this paper, we identify four application areas where disabled individuals could greatly benefit from advancements in BCI technology, namely,“Communication and Control”, “Motor Substitution”, “Entertainment”, and “Motor Recovery”. We review the current state of the art and possible future developments, while discussing the main research issues in these four areas. In particular, we expect the most progress in the development of technologies such as hybrid BCI architectures, user-machine adaptation algorithms, the exploitation of users’ mental states for BCI reliability and confidence measures, the incorporation of principles in human-computer interaction (HCI) to improve BCI usability, and the development of novel BCI technology including better EEG devices

Critical considerations for a closed-loop medication administration system

In recent years, the serious consequences of medical error are realized by both healthcare practitioners and the public because of the critical direct injury towards the involved patients and the high indirect costs subsequently all around the world. The utilization of information and communication technology in this field is recognized to have the potential of improving the quality of clinical treatment and reducing medical errors. To achieve safe and high-quality healthcare service, a closed-loop medication administration is an efficient solution since all the processes are monitored and recorded by the system. Among all the clinical staff, nurses play the most integral role in the whole patient care process in hospitals, including medication administration process with the potential of the medical errors to be recognized, handled and prohibited by nursing staff. Mobile nursing system may have the possibility to improve the efficiency and patient safety through the achievement of closed-loop medication administration

Improving Drivers’ Behaviour When Partial Driving Automation Fails

With the advent of automated vehicle systems, the role of drivers has changed to a more supervisory role. However, it is known that all vehicles with Level 2 (L2) systems have a very specific operational design domain (ODD) and can only function on limited conditions. Hence, it is important for drivers to perceive the situations properly and regain the control from the L2 system when needed. As suggested by past research, designing an informative interface could help drivers in their new supervision and intervention role while driving with L2 vehicles by providing feedback to drivers when hazards or event that may cause system failure are detected. On the other hand there are many situations where these vehicles cannot detect hazards and provide any feedback prior to the event. In these cases, training programs which provide drivers with an experience of these system limitations and allow them to practice dealing with such limitations can prove to be effective countermeasures. The objective of the current study is to employ different methods (designing HMI and training drivers) to increase drivers’ situational awareness regarding operational design domain (ODD) and improve drivers performance in transfer of control situations while driving with level 2 (L2) automation features. This study includes two experiments- in first experiment, an informative dashboard interface was designed and tested through three phases (observation, prototyping, testing). Results from the testing phase showed that drivers who received the newly designed dashboards took back control more effectively and had more situational awareness compared to the control group. In the second experiment, a PC-based training program was designed and tested to improve drivers takeover response and situational awareness when L2 systems reach their ODD limits. Results showed drivers in the PC-based training group took back control more effectively when L2 systems reached their ODD limits and had more situational awareness compared to the drivers who received user manual or placebo training

A tablet computer-assisted motor and language skills training programme to promote communication development in children with autism: development and pilot study

Autism is a heterogenous condition, encompassing many different subtypes and presentations. Of those people with autism who lack communicative speech, some are more skilled at receptive language than their expressive difficulty might suggest. This disparity between what can be spoken and what can be understood correlates with motor and especially oral motor abilities, and thus may be a consequence of limits to oral motor skill. Point OutWords, tablet-based software targeted for this subgroup, builds on autistic perceptual and cognitive strengths to develop manual motor and oral motor skills prerequisite to communication by pointing or speaking. Although typical implementations of user-centred design rely on communicative speech, Point OutWords users were involved as co-creators both directly via their own nonverbal behavioural choices and indirectly via their communication therapists’ reports; resulting features include vectorised, high-contrast graphics, exogenous cues to help capture and maintain attention, customisable reinforcement prompts, and accommodation of open-loop visuomotor control

Conveying User Experience in Business-to-Business Environment

Tässä työssä käsittelen käyttäjäkokemuslähtöisen tuotesuunnittelun mahdollisuuksia vaikuttaa erottautumistekijöihin teollisissa yrityksissä, jotka toimivat B2B ympäristössä. Työn tavoitteena on tarkastella kokemuspohjaisen suunnittelun teoreettisia lähtökohtia, ottaen huomioon muotoilun, kognitiotieteiden ja kauppatieteiden alojen tutkimuspohja. B2B ympäristön tarkastelu on tämän työn yksi painopisteistä, koska siinä tuotteen omistus ja käyttö jakautuvat asiakkaiden ja käyttäjien kesken. Tämä toisaalta vaikuttaa tuotteen suunnittelun lähtökohtiin, sen markkinointiin, myyntiin ja vastaavasti asiakas- ja käyttäjäkokemukseen. Työ on tehty FIMECC:in aloittaman UXUS projektin yhteydessä. Projektin tarkoitus on tutkia ja soveltaa käyttäjäkokemuksen lähtökohtia teollisessa ympäristössä. Työssäni pyrin kehittämään teoreettisen ajatusmallin, jolla asiakkaiden ja käyttäjien kokemuksia voidaan tarkastella eri tasoilla ja ottaa huomioon suunnitteluprosessin varhaisissa vaiheissa. Tämä malli pohjautuu osittain psykologisiin teorioihin, jotka tulevat esille aikaisemmissa tutkimuksissa mm. Carver ja Scheier (1998); Sheldon, K.M., Elliot, A.J., Kim, Y. ja Kasser, T. (2001). Ajatusmallin ensisijainen tarkoitus on toimia tukityökaluna tuottajayrityksen tuotekehityksen ja markkinoinnin yksiköille kun halutaan soveltaa kokemuslähtöisen suunnittelun periaatteita yrityksen toiminnassa. Mallin toinen tarkoitus on toimia perustana teolliseen ympäristöön soveltuvien kokemusmittareiden kehitykselle. Työn toinen osio keskittyy yheden UXUS projektin yrityskumppanin toiminnan tutkimiseen (Rocla). Tässä osiossa pyrin kehittämään kokemusmittariston, jonka tarkoituksena on huomioida tuottajayrityksen, tuotevälittäjien, asiakkaiden ja käyttäjien näkemyksiä tuotteiden ominaisuuksista ja kokemuksista sekä mahdollistaa vertailu näiden osapuolten välillä. Kerätyn aineiston ja vertailun tarkoitus on auttaa tuotekehitys- ja markkinointitiimien työtä kun määritetään uusien tuotteiden kehityskriteerit ja myyntiargumentit. Kokemusmittariston sunnittelussa käytän sekä teoreettisia lähtökohtia, jotka käydään läpi työn alussa, että kymmentä johtajatason henkilön haastattelutulosta Roclan tuotekehityksen, markkinoinnin ja myynnin yksiköistä. Tämän lisäksi sovellan ajatuksia keskusteluista, joita käytiin läpi lukuisissa tutkijatapaamisissa, kenttä- ja yritysvierailuilla. Ehdotetun kokemusmittariston avulla kerään aineistoa 57:ltä kokeneelta varastotuotevälittäjältä. Välittäjät vertasivat kahta erityyppistä varastokonetta heidän kokemuksiensa perusteella ja myös osoittivat näkemyksensä psykologisten tarpeiden tärkeydestä asiakkaiden ja käyttäjien näkökulmasta. Aineiston analyysi osoittaa, että vaikka välittäjät kokivat selkeitä eroja tuotteiden visuaalisen ulkonön viehättävyydessä, tämä tekijän tärkeys oli yleisesti vähäinen (mm. osittain linjassa Diefenbach, S. ja Hassenzahl, M. (2011) tulosten kanssa). Tämä tulos tukee ajatusta siitä, jos kokemuspohjaisia lähtökohtia halutaan soveltaa erottautumistekijöinä B2B ympäristössä, niiden pitää olla vahvasti ja selkeästi yhdistettynä taloudellisiin mittareihin.The main goal of this study is to investigate theoretical background behind user experience (UX) paradigm and its possible implementation in industrial product development within business-to-business (B-to-B) environment. This work is conducted in the realm of UXUS project (User Experience and Usability in complex Systems), which was initiated by FIMECC (Finnish Metals and Engineering Competence Cluster) in 2010. In contrast to business-to-consumer environment, B-to-B setting separates ownership and actual use of the product. My aim lies in elaborating on various impacts of this separation on user and customer experiences and possible ways to communicate benefits of better UX to customers and equipment distributors. In the content of this paper, I introduce a theoretical thinking model for approaching experiences in industrial product development and an experimental questionnaire set, which is meant to capture different aspects of product and operating environment experiences. I test the proposed questionnaire set with 57 experienced warehouse equipment distributors who evaluate two separate industrial products. Results indicate that distributors are able to appreciate differences in hedonic qualities of industrial equipment and that visual appearance is a major factor in indicated product perceptions. However, overall hedonic qualities were perceived as less important compared to utilitarian qualities, which is partially in line with consumer product findings by DIEFENBACH, et al. (2011). I also find that distributors were unable to appreciate the importance of three major psychological needs (relatedness, autonomy and competence as indicated by SHELDON, et al., 2001) in industrial product development. I also analyze interviews of ten managers from warehouse equipment manufacturing company Rocla to investigate whether individuals working in separate departments perceive implications of UX paradigm differently. Findings indicate that individuals dealing with R&D activities stress the importance of end-users in deriving criteria for product development whereas individuals dealing with marketing and sales activities emphasize the role of personal relationships with customers. The longrun aim of this research direction is to assess strategic potential of UX paradigm for industrial product manufacturers

A perspective review on integrating VR/AR with haptics into STEM education for multi-sensory learning

As a result of several governments closing educational facilities in reaction to the COVID-19 pandemic in 2020, almost 80% of the world’s students were not in school for several weeks. Schools and universities are thus increasing their efforts to leverage educational resources and provide possibilities for remote learning. A variety of educational programs, platforms, and technologies are now accessible to support student learning; while these tools are important for society, they are primarily concerned with the dissemination of theoretical material. There is a lack of support for hands-on laboratory work and practical experience. This is particularly important for all disciplines related to science, technology, engineering, and mathematics (STEM), where labs and pedagogical assets must be continuously enhanced in order to provide effective study programs. In this study, we describe a unique perspective to achieving multi-sensory learning through the integration of virtual and augmented reality (VR/AR) with haptic wearables in STEM education. We address the implications of a novel viewpoint on established pedagogical notions. We want to encourage worldwide efforts to make fully immersive, open, and remote laboratory learning a reality.European Union through the Erasmus+ Program under Grant 2020-1-NO01-KA203-076540, project title Integrating virtual and AUGMENTED reality with WEARable technology into engineering EDUcation (AugmentedWearEdu), https://augmentedwearedu.uia.no/ [34] (accessed on 27 March 2022). This work was also supported by the Top Research Centre Mechatronics (TRCM), University of Agder (UiA), Norwa