On Neuromechanical Approaches for the Study of Biological Grasp and Manipulation

Biological and robotic grasp and manipulation are undeniably similar at the level of mechanical task performance. However, their underlying fundamental biological vs. engineering mechanisms are, by definition, dramatically different and can even be antithetical. Even our approach to each is diametrically opposite: inductive science for the study of biological systems vs. engineering synthesis for the design and construction of robotic systems. The past 20 years have seen several conceptual advances in both fields and the quest to unify them. Chief among them is the reluctant recognition that their underlying fundamental mechanisms may actually share limited common ground, while exhibiting many fundamental differences. This recognition is particularly liberating because it allows us to resolve and move beyond multiple paradoxes and contradictions that arose from the initial reasonable assumption of a large common ground. Here, we begin by introducing the perspective of neuromechanics, which emphasizes that real-world behavior emerges from the intimate interactions among the physical structure of the system, the mechanical requirements of a task, the feasible neural control actions to produce it, and the ability of the neuromuscular system to adapt through interactions with the environment. This allows us to articulate a succinct overview of a few salient conceptual paradoxes and contradictions regarding under-determined vs. over-determined mechanics, under- vs. over-actuated control, prescribed vs. emergent function, learning vs. implementation vs. adaptation, prescriptive vs. descriptive synergies, and optimal vs. habitual performance. We conclude by presenting open questions and suggesting directions for future research. We hope this frank assessment of the state-of-the-art will encourage and guide these communities to continue to interact and make progress in these important areas

A cost-effective intelligent robotic system with dual-arm dexterous coordination and real-time vision

Dexterous coordination of manipulators based on the use of redundant degrees of freedom, multiple sensors, and built-in robot intelligence represents a critical breakthrough in development of advanced manufacturing technology. A cost-effective approach for achieving this new generation of robotics has been made possible by the unprecedented growth of the latest microcomputer and network systems. The resulting flexible automation offers the opportunity to improve the product quality, increase the reliability of the manufacturing process, and augment the production procedures for optimizing the utilization of the robotic system. Moreover, the Advanced Robotic System (ARS) is modular in design and can be upgraded by closely following technological advancements as they occur in various fields. This approach to manufacturing automation enhances the financial justification and ensures the long-term profitability and most efficient implementation of robotic technology. The new system also addresses a broad spectrum of manufacturing demand and has the potential to address both complex jobs as well as highly labor-intensive tasks. The ARS prototype employs the decomposed optimization technique in spatial planning. This technique is implemented to the framework of the sensor-actuator network to establish the general-purpose geometric reasoning system. The development computer system is a multiple microcomputer network system, which provides the architecture for executing the modular network computing algorithms. The knowledge-based approach used in both the robot vision subsystem and the manipulation control subsystems results in the real-time image processing vision-based capability. The vision-based task environment analysis capability and the responsive motion capability are under the command of the local intelligence centers. An array of ultrasonic, proximity, and optoelectronic sensors is used for path planning. The ARS currently has 18 degrees of freedom made up by two articulated arms, one movable robot head, and two charged coupled device (CCD) cameras for producing the stereoscopic views, and articulated cylindrical-type lower body, and an optional mobile base. A functional prototype is demonstrated

Recurrent Neural Networks-Based Collision-Free Motion Planning for Dual Manipulators Under Multiple Constraints

Dual robotic manipulators are robotic systems that are developed to imitate human arms, which shows great potential in performing complex tasks. Collision-free motion planning in real time is still a challenging problem for controlling a dual robotic manipulator because of the overlap workspace. In this paper, a novel planning strategy under physical constraints of dual manipulators using dynamic neural networks is proposed, which can satisfy the collision avoidance and trajectory tracking. Particularly, the problem of collision avoidance is first formulated into a set of inequality formulas, whereas the robotic trajectory is then transformed into an equality constraint by introducing negative feedback in outer loop. The planning problem subsequently becomes a Quadratic Programming (QP) problem by considering the redundancy, the boundaries of joint angles and velocities of the system. The QP is solved using a convergent provable recurrent neural network that without calculating the pseudo-inversion of the Jacobian. Consequently, numerical experiments on 8-DoF modular robot and 14-DoF Baxter robot are conducted to show the superiority of the proposed strategy

Cooperative Kinematic Control for Multiple Redundant Manipulators Under Partially Known Information Using Recurrent Neural Network

In this study, we investigate the problem of cooperative kinematic control for multiple redundant manipulators under partially known information using recurrent neural network (RNN). The communication among manipulators is modeled as a graph topology network with the information exchange that only occurs at the neighbouring robot nodes. Under partially known information, four objectives are simultaneously achieved, i.e, global cooperation and synchronization among manipulators, joint physical limits compliance, neighbor-to-neighbor communication among robots, and optimality of cost function. We develop a velocity observer for each individual manipulator to help them to obtain the desired motion velocity information. Moreover, a negative feedback term is introduced with a higher tracking precision. Minimizing the joint velocity norm as cost function, the considered cooperative kinematic control is built as a quadratic programming (QP) optimization problem integrating with both joint angle and joint speed limitations, and is solved online by constructing a dynamic RNN. Moreover, global convergence of the developed velocity observer, RNN controller and cooperative tracking error are theoretically derived. Finally, under a fixed and variable communication topology, respectively, application in using a group of iiwa R800 redundant manipulators to transport a payload and comparison with the existing method are conducted. Among the simulative results, the robot group synchronously achieves the desired circle and rhodonea trajectory tracking, with higher tracking precision reaching to zero. When joint angles and joint velocities tend to exceed the setting constraints, respectively, they are constrained into the upper and lower bounds owing to the designed RNN controller

Muscleless Motor synergies and actions without movements : From Motor neuroscience to cognitive robotics

Emerging trends in neurosciences are providing converging evidence that cortical networks in predominantly motor areas are activated in several contexts related to ‘action’ that do not cause any overt movement. Indeed for any complex body, human or embodied robot inhabiting unstructured environments, the dual processes of shaping motor output during action execution and providing the self with information related to feasibility, consequence and understanding of potential actions (of oneself/others) must seamlessly alternate during goal-oriented behaviors, social interactions. While prominent approaches like Optimal Control, Active Inference converge on the role of forward models, they diverge on the underlying computational basis. In this context, revisiting older ideas from motor control like the Equilibrium Point Hypothesis and synergy formation, this article offers an alternative perspective emphasizing the functional role of a ‘plastic, configurable’ internal representation of the body (body-schema) as a critical link enabling the seamless continuum between motor control and imagery. With the central proposition that both “real and imagined” actions are consequences of an internal simulation process achieved though passive goal-oriented animation of the body schema, the computational/neural basis of muscleless motor synergies (and ensuing simulated actions without movements) is explored. The rationale behind this perspective is articulated in the context of several interdisciplinary studies in motor neurosciences (for example, intracranial depth recordings from the parietal cortex, FMRI studies highlighting a shared cortical basis for action ‘execution, imagination and understanding’), animal cognition (in particular, tool-use and neuro-rehabilitation experiments, revealing how coordinated tools are incorporated as an extension to the body schema) and pertinent challenges towards building cognitive robots that can seamlessly “act, interact, anticipate and understand” in unstructured natural living spaces