A design pattern for multimodal and multidevice user interfaces

In this paper, we introduce the MVIC pattern for creating multidevice and multimodal interfaces. We discuss the advantages provided by introducing a new component to the MVC pattern for those interfaces which must adapt to different devices and modalities. The proposed solution is based on an input model defining equivalent and complementary sequence of inputs for the same interaction. In addition, we discuss Djestit, a javascript library which allows creating multidevice and multimodal input models for web applications, applying the aforementioned pattern. The library supports the integration of multiple devices (Kinect 2, Leap Motion, touchscreens) and different modalities (gestural, vocal and touch). Copyright is held by the owner/author(s)

Separating gesture detection and application control concerns with a multimodal architecture

Comunicação apresentada na conferência internacional - CIT 2015, realizada de 26-28 de outubro de 2015Gesture-controlled applications typically are tied to specific gestures, and also tied to specific recognition methods and specific gesture-detection devices. We propose a concernseparation architecture, which mediates the following concerns: gesture acquisition; gesture recognition; and gestural control. It enables application developers to respond to gesture-independent commands, recognized using plug-in gesture-recognition modules that process gesture data via both device-dependent and deviceindependent data formats and callbacks. Its feasibility is demonstrated with a sample implementation

Neural Contributions to Physical Activity: From the Brain to the Muscle and Back Again

The thesis aims to explore the neural contribution to physical activity. The work is divided into two chapters containing research conducted in Italy, France or both states. The first chapter includes four behavioural studies aimed at evaluating the reciprocal relationship between physical activity and cognition. The second chapter contains two neurophysiological studies aimed at investigating the muscle length and the type of contraction's contribution to the activity of the motor system. Chapter one investigates how motor condition influences cognitive processes and vice versa. Several studies suggested that engaging in physical activity programs elicits a wide range of neural changes. One of those is enhancing cognitive performance (e.g., working memory or information processing speed). On the other side, specific cognitive interventions (e.g., action observation or motor imagery) can ameliorate motor performance. This reciprocal interaction could produce adverse effects if people exceed one of these two activities, which induce a fatiguing state. Chapter two looks into the activity of the corticomotor system as a function of muscle length and type of contraction. After a general introduction exploring previous studies investigating the role of muscle length (in static and dynamic form) on the corticomotor system, the chapter will present two studies. The first study examined the influence of muscle length on neuromuscular function and corticospinal excitability. The second study investigated the difference in primary motor cortex excitability when preparing concentric and eccentric contractions

Scapular Muscle Assessment in Patients with Lateral Epicondylalgia

The role rehabilitation plays in the management of patients with lateral epicondylalgia (LE) remains elusive secondary to high recurrence rates. Addressing scapular muscle deficits may be important in the rehabilitation of patients with LE. However, it is unknown if scapular muscle impairments exist in a working population of patients with LE. The purpose of this dissertation was to assess scapular muscle strength and endurance in a working population of patients with LE. Clinical scapular muscle assessment tools are limited in their ability to isolate specific muscles. Rehabilitative ultrasound imaging (RUSI) is a potentially useful tool but few studies have investigated its utility. Absolute muscle thickness measurements were obtained on healthy individuals for the lower trapezius (LT) and serratus anterior (SA) under three conditions (arm at rest, arm elevated with a low load, arm elevated with a high load). For both the LT and SA, a significant distinction could be made in muscle thickness between rest and a loaded condition but not between the two load conditions. Furthermore, excellent reliability was demonstrated for both muscles. It is unknown whether arm dominance plays a role in scapular muscle assessments. Therefore, healthy individuals between the ages of 30 and 65 were recruited to compare the effect of arm dominance on scapular muscle strength, endurance, and change in thickness measured by RUSI. Results indicate that arm dominance does significantly affect some measures of scapular muscle strength and endurance. However, the differences between the dominant and non-dominant limbs were not beyond measurement error. Scapular muscle strength, endurance, and change in muscle thickness of the LT and SA were assessed in 28 patients presenting with signs and symptoms consistent with LE. LT strength, SA strength, middle trapezius strength, endurance, and change in SA thickness were significantly less in patients with LE compared to matched controls. SA and LT strength were significantly less in the involved limb compared to the uninvolved limb in patients with LE. The results suggest that assessing scapular muscle endurance as well as LT and SA strength is indicated when evaluating patients with LE, and the results should be compared to normative data

Computational Intelligence in Electromyography Analysis

Electromyography (EMG) is a technique for evaluating and recording the electrical activity produced by skeletal muscles. EMG may be used clinically for the diagnosis of neuromuscular problems and for assessing biomechanical and motor control deficits and other functional disorders. Furthermore, it can be used as a control signal for interfacing with orthotic and/or prosthetic devices or other rehabilitation assists. This book presents an updated overview of signal processing applications and recent developments in EMG from a number of diverse aspects and various applications in clinical and experimental research. It will provide readers with a detailed introduction to EMG signal processing techniques and applications, while presenting several new results and explanation of existing algorithms. This book is organized into 18 chapters, covering the current theoretical and practical approaches of EMG research

The impact of exercise in children and adolescents with movement impairment

The relationship between level of movement skill and fitness in children and adolescents plays an important role in improving physical activity (PA) and health. Children with poor motor proficiency and coordination categorised as having movement impairment (MI) often choose a more sedentary lifestyle as a consequence of their movement difficulties and inefficient movement patterns. The literature has highlighted the association between movement difficulties and disengagement with sport and play; citing physiological and psychosocial aspects as limiting factors. Furthermore, children with MI who do engage in PA often participate at lower intensities and fail to attain recommended levels. Consequently, there is limited knowledge regarding how youth respond to various exercise intensities in relationship to MI. Additional research is warranted to fully understand the neurophysiological mechanisms (underpinnings) and limitations that may explain the association between PA and movement skills in MI. Therefore, the aim of this thesis is to better understand the physiological and perceptual responses during and following exercise of different intensities for exercise prescription in children and adolescents with movement impairment (MI). A comprehensive, systematic literature review was conducted of the recent available studies on interventions focused on PA and fitness in children and adolescents with MI (Chapter 2). This review provided the background for the other three studies included in this thesis and evaluated the efficacy of interventions on physical fitness and psychosocial outcomes. The findings highlighted the range of intervention designs that have the potential for improving physical fitness and performance, however, larger RCT studies with follow-up periods are needed. In Chapter 3, a review of the common methods used to describe and measure components of fitness was summarised. The primary focus of this chapter was to review the background literature validating and providing a rationale for the methods used throughout this thesis. In Chapter 4, the physiological and perceptual responses during and following an acute bout of high and low-intensity exercise was explored in a randomized crossover design (study 1). Participants were categorized as MI (n=17) and no movement impairment (NMI) (n=21) on the Bruininks-Oseretsky Test of Motor Proficiency 2 Short Form (BOT-2 SF) and performed an incremental bike test to establish aerobic capacity. Heart rate (HR), rating of perceived exertion (RPE), muscle strength (torque) and fatigue (EMG) was assessed pre-and post-exercise in the following two sessions. Significant differences in maximal oxygen uptake (V̇O2peak) (MI: 31.5±9.2 vs. NMI: 40.0±9.5 ml·kg·min1), PPO (MI: 157±61 vs. NMI: 216±57 watts, p.05) or RPE at either intensity for legs (MI: 8±2 vs. NMI: 7±2, p>.05) and overall (MI: 7±3 vs. NMI: 6±2, p>.05). The results highlighted a reduced exercise capacity in MI compared to NMI and potentially suggest central (i.e., motivation and perceived adequacy) rather than peripheral factors may limit exercise performance in MI. In Chapter 5, the criterion validity of the Åstrand-Rhyming (A-R) cycle test and the Chester Step Test (CST) for assessment of V̇O2peak in field settings was conducted (study 2). The first part of this study established the criterion validation (n=18) and reliability (n=8) of the Åstrand cycle test to measure and estimate aerobic capacity in children and adolescents. The second part consisted of validating the CST for mass screening purposes (n=20) utilised in Chapter 6. The A-R cycle test overestimated V̇O2peak by 10-15% and demonstrated a moderate reliability (R=0.84) when repeated. Similarly, the CST overestimated V̇O2peak by 10% confirming that submaximal data should be interpreted with caution but are a feasible option for measuring aerobic fitness across varying levels of MI. To further build upon the findings in study 1 and 2 (Chapter 4 and 5), the final study aimed to provide a pathway for identifying adolescents (13-14 year olds) with MI and lower fitness levels based on an adapted screening process within Year 9 students (n=522). Individuals performing in the <25th percentile of their class were invited to join the EPIC (Engagement, Participation, Inclusion and Confidence in sport and play) feasibility study, a 6-week gym intervention (EPIC Club) offered twice weekly consisting of cardiovascular and strength training elements. Out of the 155 adolescents identified and recruited to join EPIC, 31 participants enrolled in the study. Pre- and post-intervention assessments were performed to monitor changes in fitness outcomes. The intervention pilot period had a high attendance rate (~90%) with participants reaching target exercise intensities between 65-95% HRmax during the sessions. However, no significant changes were observed pre- and post-intervention. Collectively, these studies provide novel insight on the physiological underpinnings and perceptual factors contributing to exercise tolerance in MI. Furthermore, the screening process and targeted recruitment approach for the EPIC study intervention served as a feasible pathway for identifying adolescents with MI and lower fitness levels in school settings. Strategies that increase fitness parameters and development of movement skills in childhood may be a vital target for improving PA and play in youth with MI. Keywords: Movement impairment, movement difficulties, motor coordination, developmental coordination disorder, fitness, physical activity, randomised controlled trial, feasibility, exercise, intensit

Patterns and Pattern Languages for Mobile Augmented Reality

Mixed Reality is a relatively new field in computer science which uses technology as a medium to provide modified or enhanced views of reality or to virtually generate a new reality. Augmented Reality is a branch of Mixed Reality which blends the real-world as viewed through a computer interface with virtual objects generated by a computer. The 21st century commodification of mobile devices with multi-core Central Processing Units, Graphics Processing Units, high definition displays and multiple sensors controlled by capable Operating Systems such as Android and iOS means that Mobile Augmented Reality applications have become increasingly feasible. Mobile Augmented Reality is a multi-disciplinary field requiring a synthesis of many technologies such as computer graphics, computer vision, machine learning and mobile device programming while also requiring theoretical knowledge of diverse fields such as Linear Algebra, Projective and Differential Geometry, Probability and Optimisation. This multi-disciplinary nature has led to a fragmentation of knowledge into various specialisations, making it difficult to integrate different solution components into a coherent architecture. Software design patterns provide a solution space of tried and tested best practices for a specified problem within a given context. The solution space is non-prescriptive and is described in terms of relationships between roles that can be assigned to software components. Architectural patterns are used to specify high level designs of complete systems, as opposed to domain or tactical level patterns that address specific lower level problem areas. Pattern Languages comprise multiple software patterns combining in multiple possible sequences to form a language with the individual patterns forming the language vocabulary while the valid sequences through the patterns define the grammar. Pattern Languages provide flexible generalised solutions within a particular domain that can be customised to solve problems of differing characteristics and levels of iii complexity within the domain. The specification of one or more Pattern Languages tailored to the Mobile Augmented Reality domain can therefore provide a generalised guide for the design and architecture of Mobile Augmented Reality applications from an architectural level down to the ”nuts-and-bolts” implementation level. While there is a large body of research into the technical specialisations pertaining to Mobile Augmented Reality, there is a dearth of up-to-date literature covering Mobile Augmented Reality design. This thesis fills this vacuum by: 1. Providing architectural patterns that provide the spine on which the design of Mobile Augmented Reality artefacts can be based; 2. Documenting existing patterns within the context of Mobile Augmented Reality; 3. Identifying new patterns specific to Mobile Augmented Reality; and 4. Combining the patterns into Pattern Languages for Detection & Tracking, Rendering & Interaction and Data Access for Mobile Augmented Reality. The resulting Pattern Languages support design at multiple levels of complexity from an object-oriented framework down to specific one-off Augmented Reality applications. The practical contribution of this thesis is the specification of architectural patterns and Pattern Language that provide a unified design approach for both the overall architecture and the detailed design of Mobile Augmented Reality artefacts. The theoretical contribution is a design theory for Mobile Augmented Reality gleaned from the extraction of patterns and creation of a pattern language or languages