Real-time 3D Tracking of Articulated Tools for Robotic Surgery

In robotic surgery, tool tracking is important for providing safe tool-tissue interaction and facilitating surgical skills assessment. Despite recent advances in tool tracking, existing approaches are faced with major difficulties in real-time tracking of articulated tools. Most algorithms are tailored for offline processing with pre-recorded videos. In this paper, we propose a real-time 3D tracking method for articulated tools in robotic surgery. The proposed method is based on the CAD model of the tools as well as robot kinematics to generate online part-based templates for efficient 2D matching and 3D pose estimation. A robust verification approach is incorporated to reject outliers in 2D detections, which is then followed by fusing inliers with robot kinematic readings for 3D pose estimation of the tool. The proposed method has been validated with phantom data, as well as ex vivo and in vivo experiments. The results derived clearly demonstrate the performance advantage of the proposed method when compared to the state-of-the-art.Comment: This paper was presented in MICCAI 2016 conference, and a DOI was linked to the publisher's versio

IK-FA, a new heuristic inverse kinematics solver using firefly algorithm

In this paper, a heuristic method based on Firefly Algorithm is proposed for inverse kinematics problems in articulated robotics. The proposal is called, IK-FA. Solving inverse kinematics, IK, consists in finding a set of joint-positions allowing a specific point of the system to achieve a target position. In IK-FA, the Fireflies positions are assumed to be a possible solution for joints elementary motions. For a robotic system with a known forward kinematic model, IK-Fireflies, is used to generate iteratively a set of joint motions, then the forward kinematic model of the system is used to compute the relative Cartesian positions of a specific end-segment, and to compare it to the needed target position. This is a heuristic approach for solving inverse kinematics without computing the inverse model. IK-FA tends to minimize the distance to a target position, the fitness function could be established as the distance between the obtained forward positions and the desired one, it is subject to minimization. In this paper IK-FA is tested over a 3 links articulated planar system, the evaluation is based on statistical analysis of the convergence and the solution quality for 100 tests. The impact of key FA parameters is also investigated with a focus on the impact of the number of fireflies, the impact of the maximum iteration number and also the impact of (a, ß, ¿, d) parameters. For a given set of valuable parameters, the heuristic converges to a static fitness value within a fix maximum number of iterations. IK-FA has a fair convergence time, for the tested configuration, the average was about 2.3394 × 10-3 seconds with a position error fitness around 3.116 × 10-8 for 100 tests. The algorithm showed also evidence of robustness over the target position, since for all conducted tests with a random target position IK-FA achieved a solution with a position error lower or equal to 5.4722 × 10-9.Peer ReviewedPostprint (author's final draft

A modal approach to hyper-redundant manipulator kinematics

This paper presents novel and efficient kinematic modeling techniques for “hyper-redundant” robots. This approach is based on a “backbone curve” that captures the robot's macroscopic geometric features. The inverse kinematic, or “hyper-redundancy resolution,” problem reduces to determining the time varying backbone curve behavior. To efficiently solve the inverse kinematics problem, the authors introduce a “modal” approach, in which a set of intrinsic backbone curve shape functions are restricted to a modal form. The singularities of the modal approach, modal non-degeneracy conditions, and modal switching are considered. For discretely segmented morphologies, the authors introduce “fitting” algorithms that determine the actuator displacements that cause the discrete manipulator to adhere to the backbone curve. These techniques are demonstrated with planar and spatial mechanism examples. They have also been implemented on a 30 degree-of-freedom robot prototype

Software systems for modeling articulated figures

Research in computer animation and simulation of human task performance requires sophisticated geometric modeling and user interface tools. The software for a research environment should present the programmer with a powerful but flexible substrate of facilities for displaying and manipulating geometric objects, yet insure that future tools have a consistent and friendly user interface. Jack is a system which provides a flexible and extensible programmer and user interface for displaying and manipulating complex geometric figures, particularly human figures in a 3D working environment. It is a basic software framework for high-performance Silicon Graphics IRIS workstations for modeling and manipulating geometric objects in a general but powerful way. It provides a consistent and user-friendly interface across various applications in computer animation and simulation of human task performance. Currently, Jack provides input and control for applications including lighting specification and image rendering, anthropometric modeling, figure positioning, inverse kinematics, dynamic simulation, and keyframe animation

A new approach to the kinematic modeling of a three-dimensional car-like robot with differential drive using computational mechanics

[EN] This article presents a kinematic analysis of a four-wheeled mobile robot in three-dimensions, introducing computational mechanics. The novelty lies in (1) the type of robot that is analyzed, which has been scarcely dealt with in the literature, and (2) the methodology used which enables the systematic implementation of kinematic algorithms using the computer. The mobile robot has four wheels, four rockers (like an All-Terrain Mobile Robot), and a main body. It also has two actuators and uses a drive mechanism known as differential drive (like those of a slip/skid mobile robot). We characterize the mobile robot as a set of kinematic closed chains with rotational pairs between links and a higher contact pair between the wheels and the terrain. Then, a set of generalized coordinates are chosen and the constraint equations are established. A new concept named ¿driving modes¿ has been introduced because some of the constraint equations are derived from these. The kinematics is the first step in solving the dynamics of this robot in order to set a control algorithm for an autonomous car-like robot. This methodology has been successfully applied to a real mobile robot, ¿Robotnik,¿ and the results are analyzed.Rubio Montoya, FJ.; Llopis Albert, C.; Valero Chuliá, FJ.; Besa Gonzálvez, AJ. (2019). A new approach to the kinematic modeling of a three-dimensional car-like robot with differential drive using computational mechanics. Advances in Mechanical Engineering. 11(3):1-14. https://doi.org/10.1177/1687814019825907S114113Campion, G., Bastin, G., & Dandrea-Novel, B. (1996). Structural properties and classification of kinematic and dynamic models of wheeled mobile robots. IEEE Transactions on Robotics and Automation, 12(1), 47-62. doi:10.1109/70.481750Bajracharya, M., Maimone, M. W., & Helmick, D. (2008). Autonomy for Mars Rovers: Past, Present, and Future. Computer, 41(12), 44-50. doi:10.1109/mc.2008.479Poczter, S. L., & Jankovic, L. M. (2013). The Google Car: Driving Toward A Better Future? Journal of Business Case Studies (JBCS), 10(1), 7. doi:10.19030/jbcs.v10i1.8324Wang, T., Wu, Y., Liang, J., Han, C., Chen, J., & Zhao, Q. (2015). Analysis and Experimental Kinematics of a Skid-Steering Wheeled Robot Based on a Laser Scanner Sensor. Sensors, 15(5), 9681-9702. doi:10.3390/s150509681Alexander, J. C., & Maddocks, J. H. (1989). On the Kinematics of Wheeled Mobile Robots. The International Journal of Robotics Research, 8(5), 15-27. doi:10.1177/027836498900800502Muir, P. F., & Neuman, C. P. (1987). Kinematic modeling of wheeled mobile robots. Journal of Robotic Systems, 4(2), 281-340. doi:10.1002/rob.4620040209Tarokh, M., & McDermott, G. J. (2005). Kinematics modeling and analyses of articulated rovers. IEEE Transactions on Robotics, 21(4), 539-553. doi:10.1109/tro.2005.847602Zhang, N., Zhao, Y., Wei, H., & Chen, G. (2016). Experimental study on the influence of air injection on unsteady cloud cavitating flow dynamics. Advances in Mechanical Engineering, 8(11), 168781401667667. doi:10.1177/168781401667667

Compliance error compensation technique for parallel robots composed of non-perfect serial chains

The paper presents the compliance errors compensation technique for over-constrained parallel manipulators under external and internal loadings. This technique is based on the non-linear stiffness modeling which is able to take into account the influence of non-perfect geometry of serial chains caused by manufacturing errors. Within the developed technique, the deviation compensation reduces to an adjustment of a target trajectory that is modified in the off-line mode. The advantages and practical significance of the proposed technique are illustrated by an example that deals with groove milling by the Orthoglide manipulator that considers different locations of the workpiece. It is also demonstrated that the impact of the compliance errors and the errors caused by inaccuracy in serial chains cannot be taken into account using the superposition principle.Comment: arXiv admin note: text overlap with arXiv:1204.175

Collision-free inverse kinematics of the redundant seven-link manipulator used in a cucumber picking robot

The paper presents results of research on an inverse kinematics algorithm that has been used in a functional model of a cucumber-harvesting robot consisting of a redundant P6R manipulator. Within a first generic approach, the inverse kinematics problem was reformulated as a non-linear programming problem and solved with a Genetic Algorithm (GA). Although solutions were easily obtained, the considerable calculation time needed to solve the problem prevented on-line implementation. To circumvent this problem, a second, less generic, approach was developed which consisted of a mixed numerical-analytic solution of the inverse kinematics problem exploiting the particular structure of the P6R manipulator. Using the latter approach, calculation time was considerably reduced. During the early stages of the cucumber-harvesting project, this inverse kinematics algorithm was used off-line to evaluate the ability of the robot to harvest cucumbers using 3D-information obtained from a cucumber crop in a real greenhouse. Thereafter, the algorithm was employed successfully in a functional model of the cucumber harvester to determine if cucumbers were hanging within the reachable workspace of the robot and to determine a collision-free harvest posture to be used for motion control of the manipulator during harvesting. The inverse kinematics algorithm is presented and demonstrated with some illustrative examples of cucumber harvesting, both off-line during the design phase as well as on-line during a field test