Recovering 6D Object Pose: A Review and Multi-modal Analysis

A large number of studies analyse object detection and pose estimation at visual level in 2D, discussing the effects of challenges such as occlusion, clutter, texture, etc., on the performances of the methods, which work in the context of RGB modality. Interpreting the depth data, the study in this paper presents thorough multi-modal analyses. It discusses the above-mentioned challenges for full 6D object pose estimation in RGB-D images comparing the performances of several 6D detectors in order to answer the following questions: What is the current position of the computer vision community for maintaining "automation" in robotic manipulation? What next steps should the community take for improving "autonomy" in robotics while handling objects? Our findings include: (i) reasonably accurate results are obtained on textured-objects at varying viewpoints with cluttered backgrounds. (ii) Heavy existence of occlusion and clutter severely affects the detectors, and similar-looking distractors is the biggest challenge in recovering instances' 6D. (iii) Template-based methods and random forest-based learning algorithms underlie object detection and 6D pose estimation. Recent paradigm is to learn deep discriminative feature representations and to adopt CNNs taking RGB images as input. (iv) Depending on the availability of large-scale 6D annotated depth datasets, feature representations can be learnt on these datasets, and then the learnt representations can be customized for the 6D problem

Soft manipulators and grippers: A review

Soft robotics is a growing area of research which utilizes the compliance and adaptability of soft structures to develop highly adaptive robotics for soft interactions. One area in which soft robotics has the ability to make significant impact is in the development of soft grippers and manipulators. With an increased requirement for automation, robotics systems are required to perform task in unstructured and not well defined environments; conditions which conventional rigid robotics are not best suited. This requires a paradigm shift in the methods and materials used to develop robots such that they can adapt to and work safely in human environments. One solution to this is soft robotics, which enables soft interactions with the surroundings while maintaining the ability to apply significant force. This review paper assesses the current materials and methods, actuation methods and sensors which are used in the development of soft manipulators. The achievements and shortcomings of recent technology in these key areas are evaluated, and this paper concludes with a discussion on the potential impacts of soft manipulators on industry and society

Multi-Robot Object Transport Motion Planning with a Deformable Sheet

Using a deformable sheet to handle objects is convenient and found in many practical applications. For object manipulation through a deformable sheet that is held by multiple mobile robots, it is a challenging task to model the object-sheet interactions. We present a computational model and algorithm to capture the object position on the deformable sheet with changing robotic team formations. A virtual variable cables model (VVCM) is proposed to simplify the modeling of the robot-sheet-object system. With the VVCM, we further present a motion planner for the robotic team to transport the object in a three-dimensional (3D) cluttered environment. Simulation and experimental results with different robot team sizes show the effectiveness and versatility of the proposed VVCM. We also compare and demonstrate the planning results to avoid the obstacle in 3D space with the other benchmark planner.Comment: 8 pages, 10 figures, accepted by RAL&CASE 2022 in June 24, 202

Manipulating Highly Deformable Materials Using a Visual Feedback Dictionary

The complex physical properties of highly deformable materials such as clothes pose significant challenges fanipulation systems. We present a novel visual feedback dictionary-based method for manipulating defoor autonomous robotic mrmable objects towards a desired configuration. Our approach is based on visual servoing and we use an efficient technique to extract key features from the RGB sensor stream in the form of a histogram of deformable model features. These histogram features serve as high-level representations of the state of the deformable material. Next, we collect manipulation data and use a visual feedback dictionary that maps the velocity in the high-dimensional feature space to the velocity of the robotic end-effectors for manipulation. We have evaluated our approach on a set of complex manipulation tasks and human-robot manipulation tasks on different cloth pieces with varying material characteristics.Comment: The video is available at goo.gl/mDSC4

Perception of Deformable Objects and Compliant Manipulation for Service Robots

Abstract We identified softness in robot control as well as robot perception as key enabling technologies for future service robots. Compliance in motion control compensates for small errors in model acquisition and estimation and enables safe physical interaction with humans. The perception of shape similarities and defor-mations allows a robot to adapt its skills to the object at hand, given a description of the skill that generalizes between different objects. In this paper, we present our approaches to compliant control and object manipulation skill transfer for service robots. We report on evaluation results and public demonstrations of our ap-proaches. 1

Desenvolvimento de equipamento de manipulação de objectos deformáveis e a sua interacção com uma máquina de injecção de plásticos

In this project, our objective was to thoroughly investigate the feasibility of automating a process at Ficocables by integrating a robotic arm. Specifically, we focused on automating the joining of two separate processes while eliminating the need for manual intervention in the second operation. The equipment involved in the process includes a Roboco Zamak injection machine and a Babyplast polymer injection machine. With well-defined project requirements, we explored various solutions and sought guidance from Fluidotronica, a renowned expert in this domain. With their support, we identified the collaborative robot JAKA Zu 3s, equipped with a long-finger gripper, as the optimal solution for our needs. To assess the financial viability, we conducted a meticulous financial analysis using methods like NPV and payback period, both of which demonstrated promising results. Although the implementation of the robotic arm is still pending, the outcomes of our study highlight its remarkable versatility for future applications within Ficocables. This project exemplifies the potential advantages of automation and offers valuable insights for forthcoming initiatives in this field.Neste projeto, o objetivo era investigar exaustivamente a viabilidade de automatizar um processo na Ficocables através da integração de um braço robótico. Especificamente, concentrámo-nos em automatizar a junção de dois processos separados, eliminando a necessidade de intervenção manual na segunda operação. O equipamento envolvido no processo inclui uma máquina de injeção de Zamak, denominada Robocop e uma máquina de injeção de polímero denominada Babyplast. Com os requisitos de projeto bem definidos, explorámos várias soluções e procurámos orientação junto da Fluidotronica, um especialista de renome neste domínio. Com o seu apoio, identificámos o robô colaborativo JAKA Zu 3s, equipado com uma pinça de dedos longos como a solução ideal para as necessidades deste projeto. Para avaliar a viabilidade financeira, efetuou-se uma análise financeira meticulosa utilizando métodos como o NPV e o período de retorno do investimento, tendo ambos demonstrado resultados promissores. Embora a implementação do braço robótico ainda esteja pendente, os resultados do nosso estudo destacam a sua notável versatilidade para futuras aplicações na Ficocables. Este projeto exemplifica as vantagens potenciais da automatização e oferece uma visão valiosa para iniciativas futuras neste domínio