Structural Descriptions in Human-Assisted Robot Visual Learning

The paper presents an approach to using structural descriptions, obtained through a human-robot tutoring dialogue, as labels for the visual object models a robot learns. The paper shows how structural descriptions enable relating models for different aspects of one and the same object, and how being able to relate descriptions for visual models and discourse referents enables incremental updating of model descriptions through dialogue (either robot- or human-initiated). The approach has been implemented in an integrated architecture for human-assisted robot visual learning

Dealing with abstraction: Case study generalisation as a method for eliciting design patterns

Developing a pattern language is a non-trivial problem. A critical requirement is a method to support pattern writers with abstraction, so as they can produce generalised patterns. In this paper, we address this issue by developing a structured process of generalisation. It is important that this process is initiated through engaging participants in identifying initial patterns, i.e. directly dealing with the 'cold-start' problem. We have found that short case study descriptions provide a productive 'way into' the process for participants. We reflect on a 1-year interdisciplinary pan-European research project involving the development of almost 30 cases and over 150 patterns. We provide example cases, detailing the process by which their associated patterns emerged. This was based on a foundation for generalisation from cases with common attributes. We discuss the merits of this approach and its implications for pattern development

INSPIRE Newsletter Spring 2022

https://scholarsmine.mst.edu/inspire-newsletters/1010/thumbnail.jp

Designing a programming-based approach for modelling scientific phenomena

We describe an iteratively designed sequence of activities involving the modelling of 1- dimensional collisions between moving objects based on programming in ToonTalk. Students aged 13-14 in two settings (London and Cyprus) investigated a number of collision situations, classified into six classes based on the relative velocities and masses of the colliding objects. We describe iterations of the system in which students engaged in a repeating cycle of activity for each collision class: prediction of object behaviour from given collision conditions, observation of a relevant video clip, building a model to represent the phenomena, testing, validating and refining their model, and publishing it – together with comments – on our web-based collaboration system, WebReports. Students were encouraged to consider the limitations of their current model, with the aim that they would eventually appreciate the benefit of constructing a general model that would work for all collision classes, rather than a different model for each class. We describe how our intention to engage students with the underlying concepts of conservation, closed systems and system states was instantiated in the activity design, and how the modelling activities afforded an alternative representational framework to traditional algebraic description

Inter-Joint Coordination Deficits Revealed in the Decomposition of Endpoint Jerk During Goal-Directed Arm Movement After Stroke

It is well documented that neurological deficits after stroke can disrupt motor control processes that affect the smoothness of reaching movements. The smoothness of hand trajectories during multi-joint reaching depends on shoulder and elbow joint angular velocities and their successive derivatives as well as on the instantaneous arm configuration and its rate of change. Right-handed survivors of unilateral hemiparetic stroke and neurologically-intact control participants held the handle of a two-joint robot and made horizontal planar reaching movements. We decomposed endpoint jerk into components related to shoulder and elbow joint angular velocity, acceleration, and jerk. We observed an abnormal decomposition pattern in the most severely impaired stroke survivors consistent with deficits of inter-joint coordination. We then used numerical simulations of reaching movements to test whether the specific pattern of inter-joint coordination deficits observed experimentally could be explained by either a general increase in motor noise related to weakness or by an impaired ability to compensate for multi-joint interaction torque. Simulation results suggest that observed deficits in movement smoothness after stroke more likely reflect an impaired ability to compensate for multi-joint interaction torques rather than the mere presence of elevated motor noise

The Role of Perception in Situated Spatial Reference

This position paper set out the argument that an interesting avenue of exploration and study of universals and variation in spatial reference is to address this topic in termsa of the universals in human perception and attention and to explore how these universals impact on spatial reference across cultures and languages