Barehand Mode Switching in Touch and Mid-Air Interfaces

Raskin defines a mode as a distinct setting within an interface where the same user input will produce results different to those it would produce in other settings. Most interfaces have multiple modes in which input is mapped to different actions, and, mode-switching is simply the transition from one mode to another. In touch interfaces, the current mode can change how a single touch is interpreted: for example, it could draw a line, pan the canvas, select a shape, or enter a command. In Virtual Reality (VR), a hand gesture-based 3D modelling application may have different modes for object creation, selection, and transformation. Depending on the mode, the movement of the hand is interpreted differently. However, one of the crucial factors determining the effectiveness of an interface is user productivity. Mode-switching time of different input techniques, either in a touch interface or in a mid-air interface, affects user productivity. Moreover, when touch and mid-air interfaces like VR are combined, making informed decisions pertaining to the mode assignment gets even more complicated. This thesis provides an empirical investigation to characterize the mode switching phenomenon in barehand touch-based and mid-air interfaces. It explores the potential of using these input spaces together for a productivity application in VR. And, it concludes with a step towards defining and evaluating the multi-faceted mode concept, its characteristics and its utility, when designing user interfaces more generally

Motor Learning and Motor Control Mechanisms in an Haptic Dyad

The word \u201cdyad\u201d defines the interaction between two human or cybernetic organisms. During such interaction, there is an organized flow of information between the two elements of the dyad, in a fully bidirectional manner. With this mutual knowledge they are able to understand the actual state of the dyad as well as the previous states and, in some cases, to predict a response for possible scenarios. In the studies presented in this thesis we aim to understand the kind of information exchanged during dyadic interaction and the way this information is communicated from one individual to another not only in a purely dyadic context but also in a more general social sense, namely dissemination of knowledge via physical and non-physical interpersonal interactions. More specifically, the focus of the experimental activities will be on motor learning and motor control mechanisms, in the general context of embodied motor cognition. Solving a task promotes the creation of an internal representation of the dynamical characteristics of the working environment. An understanding of the environmental characteristics allows the subjects to become proficient in such task. We also intended to evaluate the application of such a model when it is created and applied under different conditions and using different body parts. For example, we investigated how human subjects can generalize the acquired model of a certain task, carried out by means of the wrist, in the sense of mapping the skill from the distal degrees of freedom of the wrist to the proximal degrees of freedom of the arm (elbow & shoulder), under the same dynamical conditions. In the same line of reasoning, namely that individuals solving a certain task need to develop an internal model of the environment, we investigated in which manner different skill levels of the two partners of a dyad interfere with the overall learning/training process. It is known indeed that internal models are essential for allowing dyadic member to apply different motor control strategies for completing the task. Previous studies have shown that the internal model created in a solo performance can be shared and exploited in a dyadic collaboration to solve the same task. In our study we went a step forward by demonstrating that learning an unstable task in a dyad propitiates the creation of a shared internal model of the task, which includes the representation of the mutual forces applied by the partners. Thus when the partners in the dyad have different knowledge levels of the task, the representation created by the less proficient partner can be mistaken since it may include the proficient partner as part of the dynamical conditions of the task instead of as the assistance helping him to complete the experiments. For this reason we implemented a dyadic learning protocol that allows the na\uefve subject to explore and create an accurate internal model, while exploiting, at the same time, the advantage of working with an skilled partner

Motor learning induced neuroplasticity in minimally invasive surgery

Technical skills in surgery have become more complex and challenging to acquire since the introduction of technological aids, particularly in the arena of Minimally Invasive Surgery. Additional challenges posed by reforms to surgical careers and increased public scrutiny, have propelled identification of methods to assess and acquire MIS technical skills. Although validated objective assessments have been developed to assess motor skills requisite for MIS, they poorly understand the development of expertise. Motor skills learning, is indirectly observable, an internal process leading to relative permanent changes in the central nervous system. Advances in functional neuroimaging permit direct interrogation of evolving patterns of brain function associated with motor learning due to the property of neuroplasticity and has been used on surgeons to identify the neural correlates for technical skills acquisition and the impact of new technology. However significant gaps exist in understanding neuroplasticity underlying learning complex bimanual MIS skills. In this thesis the available evidence on applying functional neuroimaging towards assessment and enhancing operative performance in the field of surgery has been synthesized. The purpose of this thesis was to evaluate frontal lobe neuroplasticity associated with learning a complex bimanual MIS skill using functional near-infrared spectroscopy an indirect neuroimaging technique. Laparoscopic suturing and knot-tying a technically challenging bimanual skill is selected to demonstrate learning related reorganisation of cortical behaviour within the frontal lobe by shifts in activation from the prefrontal cortex (PFC) subserving attention to primary and secondary motor centres (premotor cortex, supplementary motor area and primary motor cortex) in which motor sequences are encoded and executed. In the cross-sectional study, participants of varying expertise demonstrate frontal lobe neuroplasticity commensurate with motor learning. The longitudinal study involves tracking evolution in cortical behaviour of novices in response to receipt of eight hours distributed training over a fortnight. Despite novices achieving expert like performance and stabilisation on the technical task, this study demonstrates that novices displayed persistent PFC activity. This study establishes for complex bimanual tasks, that improvements in technical performance do not accompany a reduced reliance in attention to support performance. Finally, least-squares support vector machine is used to classify expertise based on frontal lobe functional connectivity. Findings of this thesis demonstrate the value of interrogating cortical behaviour towards assessing MIS skills development and credentialing.Open Acces

New Trends in Neuromechanics and Motor Rehabilitation

Neuromechanics has been used to identify optimal rehabilitation protocols that successfully improve motor deficits in various populations, such as elderly people and individuals with neurological diseases (e.g., stroke, Parkinson’s disease, and essential tremor). By investigating structural and functional changes in the central and peripheral nervous systems based on neuromechanical theories and findings, we can expand our knowledge regarding underlying neurophysiological mechanisms and specific motor impairment patterns before and after therapies to further develop new training programs (e.g., non-invasive brain stimulation). Thus, the aim of this Special Issue is to present the main contributions of researchers and rehabilitation specialists in biomechanics, motor control, neurophysiology, neuroscience, and rehabilitation science. The current collection provides new neuromechanical approaches addressing theoretical, methodological, and practical topics for facilitating motor recovery progress

Laterality in Chimpanzees: Links with Behavioural Style and Social Networks

This thesis presents a series of studies investigating laterality in chimpanzees and its links with personality examined as behavioural style and social networks. The studies presented in this work were conducted by observing a group of 19 chimpanzees in captivity and present new findings in this species. However, this thesis has a broad evolutionary perspective, addressing important questions regarding personality and laterality that could prove helpful to the understanding of the evolution of laterality in vertebrates. Chapter 1 offers a general review of the three main areas of knowledge investigated: laterality, animal personality and primate social networks. Then, the first study of this project, presented in Chapter 2, began by exploring hand preference in the chimpanzee group, investigating spontaneous actions and unimanual tasks and expanding previous research by studying posture, between-task consistency and temporal stability. Chapter 3 investigated additional measures of motor laterality and proposed a novel way of measuring laterality in primates. Together, Chapters 2 and 3 directly examine laterality in chimpanzees and serve as the base from which to explore the links between laterality, personality and social networks in the subsequent studies. If lateralization is rooted in emotional processing and hemispheric lateralization, then individual differences in behaviour (particularly those that reflect emotional expression) would show a relationship with individual laterality. In order to address this question, Chapter 4 studies behavioural style in chimpanzees and its possible link with laterality. Simultaneously, if intraspecific coordination plays a role in the development of population level laterality, similarly lateralised individuals would likely have strong bonds to coordinate with each other. Chapter 5 introduces the approach and techniques of social network analysis and uses them to explore and describe the social structure of the group while describing the integration of a new adult chimpanzee. Chapter 6 applies social network analysis to explore if laterality plays a role in the way the group is structured. Lastly, Chapter 7 integrates all empirical chapters and presents the final discussion and conclusions of the thesis

Utilising virtual reality in pain management : a systematic review

Virtual reality (VR) offers patient with a drug free supplement, an alternative or complementary therapy to traditional pain management. VR technology allowing its use in a wide variety of settings in the medicine world. So, we would like to evaluate the current existing evidence supporting VR in pain management. We conducted a systematic review of interventional and observational studies that examined VR applications in pain management between 2010 and 2019. We used Scopus databases, PubMed, Web of Science, Ovid MEDLINE and EBSCOhost to identify the studies using keywords “patient”, “virtual reality”, “medicine” and “pain management”. Data was obtained by two investigators and agreement was reached with the involvement of a third and fourth investigator. Narrative synthesis for all research was done. A total of 451 citations were identified, among which 12 studies met the criteria for inclusion. Studies involve various countries with participant age ranging from 6 to 75 years old. Studies were small, employed different design, instrument and measure for outcome. Studies addressed experimental, acute and chronic pain with four categories of condition which are burn injury, orthopedic diseases and chronic headache. VR was effective during the procedure in experimental and acute pain management. Majority of studies involving VR in painful physical rehabilitation therapy found VR reduced chronic pain and some provide evidence of lasting analgesia effect of VR after therapy. The usage of VR in chronic pain in term of psychological and cognitive behavioral therapy (CBT) showed improvement of positive mood, emotional and motivation that could lead to improvement of quality of life. VR also useful to elicit findings during painful cervical kinematics assessment in chronic neck pain. VR is a promising technology to be applied in managing chronic and acute pain. Some research showed that VR usage is able to provide lasting effect of analgesia even after VR session. However, there is a need for long term, larger sample sizes and well controlled studies to show clinical and cost-effectiveness for this technology to be used in clinical settings

The cortical integration of tactile sensation in complex regional pain syndrome

Much is still unknown about sensory and perceptual changes in the cortex associated with complex regional pain syndrome (CRPS). This PhD aimed to investigate cortical integration of tactile sensation of the hand specifically the fingers, and how this might be altered in CRPS. A match-paired cross-sectional design was used in a series of neuroimaging and psychophysical studies on patients with unilateral upper limb CRPS (n=21). Clinical characteristics were described and compared with age, gender and hand dominance matched controls (Chapter 2). Methodological improvements for fine-grained fingertip mapping in the primary somatosensory cortex were piloted (n=1) in two separate experiments (Chapter 3). Single fingertip stimulation versus bilateral simultaneous fingertip stimulation was compared using phase encoded functional magnetic resonance imaging (fMRI). Fine-grained fMRI maps of the fingertips in S1 in CRPS were described. Structural morphometry measures underlying the functional S1 fingertip maps including cortical thickness were analysed with step-wise mixed modelling with a priori hypothesised effects including hand dominance and medication. Patient characteristics including pain- related measures were correlated with morphometry measures (Chapter 4). A new finger illusion experiment was applied for the first time in patients with CRPS (Chapter 5). The pilot found that bilateral tactile stimulus was most suitable for use in CRPS and had superior time efficiency. Disordered S1 functional fingertip maps in CRPS with no distinct pattern were found using this stimulus, when compared to the orderly homogenous map pattern in healthy controls. These functional imaging observations were strengthened by the key finding that increased cortical thickness underlying these maps together with hand dominance predicted group (CRPS versus healthy controls) membership. An abnormal finger illusion response in CRPS compared to controls, also suggests a disruption to normal efficiencies of bimanual hand representation cortically, not previously reported. In conclusion, disruption to cortical integration of tactile sensation in CRPS is suggested from the results. These changes also suggest cortical representation of differences in hand dominance rather than CRPS-sided-differences predicted those with CRPS in this study. Future directions to test these suggested cortically mediated changes in CRPS were explored