Task analysis of discrete and continuous skills: a dual methodology approach to human skills capture for automation

There is a growing requirement within the field of intelligent automation for a formal methodology to capture and classify explicit and tacit skills deployed by operators during complex task performance. This paper describes the development of a dual methodology approach which recognises the inherent differences between continuous tasks and discrete tasks and which proposes separate methodologies for each. Both methodologies emphasise capturing operators’ physical, perceptual, and cognitive skills, however, they fundamentally differ in their approach. The continuous task analysis recognises the non-arbitrary nature of operation ordering and that identifying suitable cues for subtask is a vital component of the skill. Discrete task analysis is a more traditional, chronologically ordered methodology and is intended to increase the resolution of skill classification and be practical for assessing complex tasks involving multiple unique subtasks through the use of taxonomy of generic actions for physical, perceptual, and cognitive actions

Representation of Samba dance gestures, using a multi-modal analysis approach

In this paper we propose an approach for the representation of dance gestures in Samba dance. This representation is based on a video analysis of body movements, carried out from the viewpoint of the musical meter. Our method provides the periods, a measure of energy and a visual representation of periodic movement in dance. The method is applied to a limited universe of Samba dances and music, which is used to illustrate the usefulness of the approach

Wireless Sensing of Lower Lip and Thumb-Index Finger ‘Ramp-and-Hold’ Isometric Force Dynamics in a Small Cohort of Unilateral MCA Stroke: Discussion of Preliminary Findings

Automated wireless sensing of force dynamics during a visuomotor control task was used to rapidly assess residual motor function during finger pinch (right and left hand) and lower lip compression in a cohort of seven adult males with chronic, unilateral middle cerebral artery (MCA) stroke with infarct confirmed by anatomic magnetic resonance imaging (MRI). A matched cohort of 25 neurotypical adult males served as controls. Dependent variables were extracted from digitized records of ‘ramp-and-hold’ isometric contractions to target levels (0.25, 0.5, 1, and 2 Newtons) presented in a randomized block design; and included force reaction time, peak force, and dF/dtmax associated with force recruitment, and end-point accuracy and variability metrics during the contraction hold-phase (mean, SD, criterion percentage ‘on-target’). Maximum voluntary contraction force (MVCF) was also assessed to establish the force operating range. Results based on linear mixed modeling (LMM, adjusted for age and handedness) revealed significant patterns of dissolution in fine force regulation among MCA stroke participants, especially for the contralesional thumb-index finger followed by the ipsilesional digits, and the lower lip. For example, the contralesional thumb-index finger manifest increased reaction time, and greater overshoot in peak force during recruitment compared to controls. Impaired force regulation among MCA stroke participants during the contraction hold-phase was associated with significant increases in force SD, and dramatic reduction in the ability to regulate force output within prescribed target force window (±5% of target). Impaired force regulation during contraction hold-phase was greatest in the contralesional hand muscle group, followed by significant dissolution in ipsilateral digits, with smaller effects found for lower lip. These changes in fine force dynamics were accompanied by large reductions in the MVCF with the LMM marginal means for contralesional and ipsilesional pinch forces at just 34.77% (15.93 N vs. 45.82 N) and 66.45% (27.23 N vs. 40.98 N) of control performance, respectively. Biomechanical measures of fine force and MVCF performance in adult stroke survivors provide valuable information on the profile of residual motor function which can help inform clinical treatment strategies and quantitatively monitor the efficacy of rehabilitation or neuroprotection strategies

Prop-Based Haptic Interaction with Co-location and Immersion: an Automotive Application

Most research on 3D user interfaces aims at providing only a single sensory modality. One challenge is to integrate several sensory modalities into a seamless system while preserving each modality's immersion and performance factors. This paper concerns manipulation tasks and proposes a visuo-haptic system integrating immersive visualization, tactile force and tactile feedback with co-location. An industrial application is presented

A Developmental Organization for Robot Behavior

This paper focuses on exploring how learning and development can be structured in synthetic (robot) systems. We present a developmental assembler for constructing reusable and temporally extended actions in a sequence. The discussion adopts the traditions of dynamic pattern theory in which behavior is an artifact of coupled dynamical systems with a number of controllable degrees of freedom. In our model, the events that delineate control decisions are derived from the pattern of (dis)equilibria on a working subset of sensorimotor policies. We show how this architecture can be used to accomplish sequential knowledge gathering and representation tasks and provide examples of the kind of developmental milestones that this approach has already produced in our lab