Object-Oriented Dynamics Learning through Multi-Level Abstraction

Object-based approaches for learning action-conditioned dynamics has demonstrated promise for generalization and interpretability. However, existing approaches suffer from structural limitations and optimization difficulties for common environments with multiple dynamic objects. In this paper, we present a novel self-supervised learning framework, called Multi-level Abstraction Object-oriented Predictor (MAOP), which employs a three-level learning architecture that enables efficient object-based dynamics learning from raw visual observations. We also design a spatial-temporal relational reasoning mechanism for MAOP to support instance-level dynamics learning and handle partial observability. Our results show that MAOP significantly outperforms previous methods in terms of sample efficiency and generalization over novel environments for learning environment models. We also demonstrate that learned dynamics models enable efficient planning in unseen environments, comparable to true environment models. In addition, MAOP learns semantically and visually interpretable disentangled representations.Comment: Accepted to the Thirthy-Fourth AAAI Conference On Artificial Intelligence (AAAI), 202

Multiple roles of motor imagery during action observation

Over the last 20 years, the topics of action observation (AO) and motor imagery (MI) have been largely studied in isolation from each other, despite the early integrative account by Jeannerod (1994, 2001). Recent neuroimaging studies demonstrate enhanced cortical activity when AO and MI are performed concurrently (“AO+MI”), compared to either AO or MI performed in isolation. These results indicate the potentially beneficial effects of AO+MI, and they also demonstrate that the underlying neurocognitive processes are partly shared. We separately review the evidence for MI and AO as forms of motor simulation, and present two quantitative literature analyses that indeed indicate rather little overlap between the two bodies of research. We then propose a spectrum of concurrent AO+MI states, from congruent AO+MI where the contents of AO and MI widely overlap, over coordinative AO+MI, where observed and imagined action are different but can be coordinated with each other, to cases of conflicting AO+MI. We believe that an integrative account of AO and MI is theoretically attractive, that it should generate novel experimental approaches, and that it can also stimulate a wide range of applications in sport, occupational therapy, and neurorehabilitation

Nature as a Network of Morphological Infocomputational Processes for Cognitive Agents

This paper presents a view of nature as a network of infocomputational agents organized in a dynamical hierarchy of levels. It provides a framework for unification of currently disparate understandings of natural, formal, technical, behavioral and social phenomena based on information as a structure, differences in one system that cause the differences in another system, and computation as its dynamics, i.e. physical process of morphological change in the informational structure. We address some of the frequent misunderstandings regarding the natural/morphological computational models and their relationships to physical systems, especially cognitive systems such as living beings. Natural morphological infocomputation as a conceptual framework necessitates generalization of models of computation beyond the traditional Turing machine model presenting symbol manipulation, and requires agent-based concurrent resource-sensitive models of computation in order to be able to cover the whole range of phenomena from physics to cognition. The central role of agency, particularly material vs. cognitive agency is highlighted

Measurements, Models, Systems and Design

531 s.

Unattended network operations technology assessment study. Technical support for defining advanced satellite systems concepts

The results are summarized of an unattended network operations technology assessment study for the Space Exploration Initiative (SEI). The scope of the work included: (1) identified possible enhancements due to the proposed Mars communications network; (2) identified network operations on Mars; (3) performed a technology assessment of possible supporting technologies based on current and future approaches to network operations; and (4) developed a plan for the testing and development of these technologies. The most important results obtained are as follows: (1) addition of a third Mars Relay Satellite (MRS) and MRS cross link capabilities will enhance the network's fault tolerance capabilities through improved connectivity; (2) network functions can be divided into the six basic ISO network functional groups; (3) distributed artificial intelligence technologies will augment more traditional network management technologies to form the technological infrastructure of a virtually unattended network; and (4) a great effort is required to bring the current network technology levels for manned space communications up to the level needed for an automated fault tolerance Mars communications network