Dexterous Grasping by Manipulability Selection for Mobile Manipulator with Visual Guidance

Industry 4.0 demands the heavy usage of robotic mobile manipulators with high autonomy and intelligence. The goal is to accomplish dexterous manipulation tasks without prior knowledge of the object status in unstructured environments. It is important for the mobile manipulator to recognize and detect the objects, determine manipulation pose, and adjust its pose in the workspace fast and accurately. In this research, we developed a stereo vision algorithm for the object pose estimation using point cloud data from multiple stereo vision systems. An improved iterative closest point algorithm method is developed for the pose estimation. With the pose input, algorithms and several criteria are studied for the robot to select and adjust its pose by maximizing its manipulability on a given manipulation task. The performance of each technical module and the complete robotic system is finally shown by the virtual robot in the simulator and real robot in experiments. This study demonstrates a setup of autonomous mobile manipulator for various flexible manufacturing and logistical scenarios

Towards a self-collision aware teleoperation framework for compound robots

This work lays the foundations of a self-collision aware teleoperation framework for compound robots. The need of an haptic enabled system which guarantees self-collision and joint limits avoidance for complex robots is the main motivation behind this paper. The objective of the proposed system is to constrain the user to teleoperate a slave robot inside its safe workspace region through the application of force cues on the master side of the bilateral teleoperation system. A series of simulated experiments have been performed on the Kuka KMRiiwa mobile robot; however, due to its generality, the framework is prone to be easily extended to other robots. The experiments have shown the applicability of the proposed approach to ordinary teleoperation systems without altering their stability properties. The benefits introduced by this framework enable the user to safely teleoperate whichever complex robotic system without worrying about self-collision and joint limitations

Enhancing airplane boarding procedure using vision based passenger classification

This paper presents the implementation of a new boarding strategy that exploits passenger and hand-luggage detection and classification to reduce the boarding time onto an airplane. A vision system has the main purpose of providing passengers data, in terms of agility coefficient and hand-luggage size to a seat assignment algorithm. The software is able to dynamically generate the passenger seat that reduces the overall boarding time while taking into account the current airplane boarding state. The motivation behind this work is to speed up of the passenger boarding using the proposed online procedure of seat assignment based on passenger and luggage classification. This method results in an enhancement of the boarding phase, in terms of both time and passenger experience. The main goal of this work is to demonstrate the usability of the proposed system in real conditions proving its performances in terms of reliability. Using a simple hardware and software setup, we performed several experiments recreating a gate entrance mock up and comparing the measurements with ground truth data to assess the reliability of the system

A fast airplane boarding strategy using online seat assignment based on passenger classification

The minimization of the turnaround time, the duration which an aircraft must remain parked at the gate, is an important goal of airlines to increase their profitability. This work introduces a procedure to minimize of the turnaround time by speeding up the boarding time in passenger aircrafts. This is realized by allocating the seat numbers adaptively to passengers when they pass the boarding gate and not before. Using optical sensors, an agility measure is assigned to each person and also a measure to characterize the size of her/his hand-luggage. Based on these two values per passenger and taking into account additional constraints, like reserved seats and the belonging to a group, a novel seat allocation algorithm is introduced to minimize the boarding time. Extensive simulations show that a mean reduction of the boarding time with approximately 15% is achieved compared to existing boarding strategies. The costs of introducing the proposed procedure are negligible, while the savings of reducing the turnaround time are enormous, considering that the costs generated by inactive planes on an airport are estimated to be about 30 $ per minute

Vision based virtual fixture generation for teleoperated robotic manipulation

In this paper we present a vision-based system for online virtual fixture generation suitable for manipulation tasks using remote controlled robots. This system makes use of a stereo camera system which provides accurate pose estimation of parts within the surrounding environment of the robot using features detection algorithms. The proposed approach is suitable for fast adaptation of the teleoperation system to different manipulation tasks without the need of tedious reimplementation of virtual constraints. Our main goal is to improve the efficiency of bilateral teleoperation systems by reducing the human operator effort in programming the system. In fact, using this method virtual guidances do not need to be programmed a priori but they can be instead dynamically generated on-the-fly and updated at any time making, in the end, the system suitable for any unstructured environment. In addition, this methodology is easily adaptable to any kind of teleoperation system since it is independent from the used master/slave robots. In order to validate our approach we performed a series of experiments in an emulated industrial scenario. We show how through the use of our approach a generic telemanipulation task can be easily accomplished without influencing the transparency of the system

Enhancing bilateral teleoperation using camera-based online virtual fixtures generation

In this paper we present an interactive system to enhance bilateral teleoperation through online virtual fixtures generation and task switching. This is achieved using a stereo camera system which provides accurate information of the surrounding environment of the robot and of the tasks that have to be performed in it. The use of the proposed approach aims at improving the performances of bilateral teleoperation systems by reducing the human operator workload and increasing both the implementation and the execution efficiency. In fact, using our method virtual guidances do not need to be programmed a priori but they can be instead automatically generated and updated making the system suitable for unstructured environments. We strengthen the proposed method using passivity control in order to safely switch between different tasks while teleoperating under active constraints. A series of experiments emulating real industrial scenarios are used to show that the switch between multiple tasks can be passively and safely achieved and handled by the system

Ligation of the intersphincteric fistula tract (LIFT) to treat anal fistula: early results from a prospective observational study

Ligation of the intersphincteric tract (LIFT), a novel sphincter-saving technique, has been recently described with promising results. Literature data are still scant. In this prospective observational study, we present our experience with this technique

Bioptic prostatic inflammation correlates with false positive rates of multiparametric magnetic resonance imaging in detecting clinically significant prostate cancer

ntroduction: The aim of this article was to determine the impact of bioptic prostatic inflammation (PI) on the false positive rate of multiparametric magnetic resonance imaging (mp-MRI) in detecting clinically significant prostate ancer (csPCa). Material and methods: Our prostate biopsy database was queried to identify patients who underwent mp-MRI before PB at our institution. A dedicated uropathologist prospectively assessed bioptic PI using the Irani scores. We evaluated the association between mp-MRI findings, bioptic Gleason grade (GG) and aggressiveness of PI, and PCa detection. Results: In total, 366 men were included. In patients with Prostate Imaging Reporting and Data System (PIRADS) 4-5 lesions, the csPCa (GG ≥2) rate was significantly higher in those with low-grade than in those with high-grade PI (36% vs 29.7%; p = 0.002), and in those with low-aggressive than in those with high-aggressive PI (37.7% vs 30.1%; p = 0.0003). The false positive rates of PIRADS 4-5 lesions for any PCa were 34.2% and 57.8% for low- and high-grade PI, respectively (p = 0.002); similarly, they were 29.5% and 59.4% for mildly and highly-aggressive PI (p = 0.0003). Potential study limitations include its retrospective analysis and single-center study and lack of assessment of the type of PI. Conclusions: Bioptic PI directly correlates with false positive rates of mp-MRI in detecting csPCa. Clinicians should be aware that PI remains the most common pitfall of mp-MRI