73 research outputs found

    Unsupervised Sim-to-Real Adaptation of Soft Robot Proprioception using a Dual Cross-modal Autoencoder

    Full text link
    Soft robotics is a modern robotic paradigm for performing dexterous interactions with the surroundings via morphological flexibility. The desire for autonomous operation requires soft robots to be capable of proprioception and makes it necessary to devise a calibration process. These requirements can be greatly benefited by adopting numerical simulation for computational efficiency. However, the gap between the simulated and real domains limits the accurate, generalized application of the approach. Herein, we propose an unsupervised domain adaptation framework as a data-efficient, generalized alignment of these heterogeneous sensor domains. A dual cross-modal autoencoder was designed to match the sensor domains at a feature level without any extensive labeling process, facilitating the computationally efficient transferability to various tasks. As a proof-of-concept, the methodology was adopted to the famous soft robot design, a multigait soft robot, and two fundamental perception tasks for autonomous robot operation, involving high-fidelity shape estimation and collision detection. The resulting perception demonstrates the digital-twinned calibration process in both the simulated and real domains. The proposed design outperforms the existing prevalent benchmarks for both perception tasks. This unsupervised framework envisions a new approach to imparting embodied intelligence to soft robotic systems via blending simulation.Comment: 13 pages, 12 figure

    Review of machine learning methods in soft robotics

    Get PDF
    Soft robots have been extensively researched due to their flexible, deformable, and adaptive characteristics. However, compared to rigid robots, soft robots have issues in modeling, calibration, and control in that the innate characteristics of the soft materials can cause complex behaviors due to non-linearity and hysteresis. To overcome these limitations, recent studies have applied various approaches based on machine learning. This paper presents existing machine learning techniques in the soft robotic fields and categorizes the implementation of machine learning approaches in different soft robotic applications, which include soft sensors, soft actuators, and applications such as soft wearable robots. An analysis of the trends of different machine learning approaches with respect to different types of soft robot applications is presented; in addition to the current limitations in the research field, followed by a summary of the existing machine learning methods for soft robots

    A Perspective on Cephalopods Mimicry and Bioinspired Technologies toward Proprioceptive Autonomous Soft Robots

    Get PDF
    Octopus skin is an amazing source of inspiration for bioinspired sensors, actuators and control solutions in soft robotics. Soft organic materials, biomacromolecules and protein ingredients in octopus skin combined with a distributed intelligence, result in adaptive displays that can control emerging optical behavior, and 3D surface textures with rough geometries, with a remarkably high control speed (≈ms). To be able to replicate deformable and compliant materials capable of translating mechanical perturbations in molecular and structural chromogenic outputs, could be a glorious achievement in materials science and in the technological field. Soft robots are suitable platforms for soft multi-responsive materials, which can provide them with improved mechanical proprioception and related smarter behaviors. Indeed, a system provided with a “learning and recognition” functions, and a constitutive “mechanical” and “material intelligence” can result in an improved morphological adaptation in multi-variate environments responding to external and internal stimuli. This review aims to explore challenges and opportunities related to smart and chromogenic responsive materials for adaptive displays, reconfigurable and programmable soft skin, proprioceptive sensing system, and synthetic nervous control units for data processing, toward autonomous soft robots able to communicate and interact with users in open-world scenarios
    corecore