Moving object tracking in clinical scenarios: application to cardiac surgery and cerebral aneurysm clipping.

BACKGROUND AND OBJECTIVES: Surgical procedures such as laparoscopic and robotic surgeries are popular since they are invasive in nature and use miniaturized surgical instruments for small incisions. Tracking of the instruments (graspers, needle drivers) and field of view from the stereoscopic camera during surgery could further help the surgeons to remain focussed and reduce the probability of committing any mistakes. Tracking is usually preferred in computerized video surveillance, traffic monitoring, military surveillance system, and vehicle navigation. Despite the numerous efforts over the last few years, object tracking still remains an open research problem, mainly due to motion blur, image noise, lack of image texture, and occlusion. Most of the existing object tracking methods are time-consuming and less accurate when the input video contains high volume of information and more number of instruments. METHODS:This paper presents a variational framework to track the motion of moving objects in surgery videos. The key contributions are as follows: (1) A denoising method using stochastic resonance in maximal overlap discrete wavelet transform is proposed and (2) a robust energy functional based on Bhattacharyya coefficient to match the target region in the first frame of the input sequence with the subsequent frames using a similarity metric is developed. A modified affine transformation-based registration is used to estimate the motion of the features following an active contour-based segmentation method to converge the contour resulted from the registration process. RESULTS AND CONCLUSION:The proposed method has been implemented on publicly available databases; the results are found satisfactory. Overlap index (OI) is used to evaluate the tracking performance, and the maximum OI is found to be 76% and 88% on private data and public data sequences

A lightweight neural network with multiscale feature enhancement for liver CT segmentation

Segmentation of abdominal Computed Tomography (CT) scan is essential for analyzing, diagnosing, and treating visceral organ diseases (e.g., hepatocellular carcinoma). This paper proposes a novel neural network (Res-PAC-UNet) that employs a fixed-width residual UNet backbone and Pyramid Atrous Convolutions, providing a low disk utilization method for precise liver CT segmentation. The proposed network is trained on medical segmentation decathlon dataset using a modified surface loss function. Additionally, we evaluate its quantitative and qualitative performance; the Res16-PAC-UNet achieves a Dice coefficient of 0.950 ± 0.019 with less than half a million parameters. Alternatively, the Res32-PAC-UNet obtains a Dice coefficient of 0.958 ± 0.015 with an acceptable parameter count of approximately 1.2 million.This publication was made possible by NPRP-11S-1219-170106 from the Qatar National Research Fund (a member of Qatar Foundation). The findings herein reflect the work, and are solely the responsibility of the authors

Validating Anti-Infective Activity of Pleurotus Opuntiae via Standardization of Its Bioactive Mycoconstituents through Multimodal Biochemical Approach

Mushrooms produce a variety of bioactive compounds that are known to have anti-pathogenic properties with safer and effective therapeutic effects in human disease prognosis. The antibacterial activity of ethanol and methanol extracts of Pleurotus opuntiae were checked against pathogenic microorganisms viz. Pseudomonas aeruginosa ATCC 27853, Proteus mirabilis NCIM 2300, Proteus vulgaris NCIM 5266, Serratia marcescens NCIM 2078, Shigella flexeneri NCIM 5265, Moraxella sp. NCIM 2795, Staphylococcus aureus ATCC 25923 by agar well diffusion method at different concentrations of the extracts. Minimum Inhibitory Concentration (MIC) and Minimum Bactericidal Concentration (MBC) of the extracts was determined by INT (Iodonitrotetrazolium chloride) colorimetric assay. Extracts were standardized by thin layer chromatography (TLC) in different solvent systems. The Retention factors (Rf) of different compounds were calculated by high performance TLC (HPTLC) fingerprinting at UV 254, 366, and 540 nm before and after derivatization. The ethanol and methanol extracts of P. opuntiae showed bactericidal activity against all the test pathogens at MIC values of 15.6 to 52.08 mg/mL and 20.81 to 52.08 mg/mL respectively. Whereas the MBC values for ethanol and methanol extract of P. opuntiae against all pathogens were recorded as 26.03 to 62.5 mg/mL and 125 mg/mL respectively. Preliminary mycochemical screening of both the extracts revealed high contents of bioactive compounds. Amongst all the solvent systems used in TLC, the best result was given by chloroform + hexane (8:2) which eluted out 5 different compounds (spots). HPTLC results revealed spots with different Rf values for all the 24 compounds present. Thus, it can be inferred from the present investigation that the mycoconstituents could be an alternative medication regimen and could play a role in new drug discoveries against different infections. Further, the antimicrobial components of these mushrooms can be transformed to bioengineered antimicrobial coatings for surfaces, drug and other hybrid systems for public health implications in combating persistent infections

Preliminary design of an actuated imaging probe for generation of additional visual cues in a robotic surgery

Background The aim of this study was to enhance the visual feedback of surgeons, during robotic surgeries, by designing and developing an actuated 2D imaging probe, which is used in conjunction with the traditional stereoscopic camera of the da Vinci surgical system. The probe provides the surgeon with additional visual cues, overcoming visualization constraints encountered during certain scenarios of robot-assisted minimally invasive surgery. Methods The actuated imaging probe is implemented as a master–slave tele-manipulated system, and it is designed to be compatible with the da Vinci surgical system. The detachable probe design enables it to be mounted on any of the EndoWrist® instruments of the robot and is controlled by the surgeon using a custom-made pedal system. The image from the 2D probe is rendered along with the stereoscopic view on the surgeon’s console. Results The experimental results demonstrate the effectiveness of the proposed actuated imaging probe when used as an additional visualization channel and in surgical scenarios presenting visual problems due to tissue occlusion. Conclusion The study shows the potential benefits of an additional actuated imaging probe when used in conjunction with traditional surgical instruments to perform surgical tasks requiring visualization from multiple orientations and workspaces.Acknowledgments This work was partially supported by the National Priorities Research Program (NPRP) under Grant NPRP 09-776-2-298 from the Qatar National Research Fund (a member of Qatar Foundation). The statements made herein are solely the responsibility of the authors. We would like to thank Dr. Jean-Marc Peyrat for his assistance in the experiments.Scopu

Evaluation of how users interface with holographic augmented reality surgical scenes: Interactive planning MR-Guided prostate biopsies

Background User interfaces play a vital role in the planning and execution of an interventional procedure. The objective of this study is to investigate the effect of using different user interfaces for planning transrectal robot-assisted MR-guided prostate biopsy (MRgPBx) in an augmented reality (AR) environment. Method End-user studies were conducted by simulating an MRgPBx system with end- and side-firing modes. The information from the system to the operator was rendered on HoloLens as an output interface. Joystick, mouse/keyboard, and holographic menus were used as input interfaces to the system. Results The studies indicated that using a joystick improved the interactive capacity and enabled operator to plan MRgPBx in less time. It efficiently captures the operator's commands to manipulate the augmented environment representing the state of MRgPBx system. Conclusions The study demonstrates an alternative to conventional input interfaces to interact and manipulate an AR environment within the context of MRgPBx planning

Moving object tracking in clinical scenarios: application to cardiac surgery and cerebral aneurysm clipping

Surgical procedures such as laparoscopic and robotic surgeries are popular since they are invasive in nature and use miniaturized surgical instruments for small incisions. Tracking of the instruments (graspers, needle drivers) and field of view from the stereoscopic camera during surgery could further help the surgeons to remain focussed and reduce the probability of committing any mistakes. Tracking is usually preferred in computerized video surveillance, traffic monitoring, military surveillance system, and vehicle navigation. Despite the numerous efforts over the last few years, object tracking still remains an open research problem, mainly due to motion blur, image noise, lack of image texture, and occlusion. Most of the existing object tracking methods are time-consuming and less accurate when the input video contains high volume of information and more number of instruments. This paper presents a variational framework to track the motion of moving objects in surgery videos. The key contributions are as follows: (1) A denoising method using stochastic resonance in maximal overlap discrete wavelet transform is proposed and (2) a robust energy functional based on Bhattacharyya coefficient to match the target region in the first frame of the input sequence with the subsequent frames using a similarity metric is developed. A modified affine transformation-based registration is used to estimate the motion of the features following an active contour-based segmentation method to converge the contour resulted from the registration process. The proposed method has been implemented on publicly available databases; the results are found satisfactory. Overlap index (OI) is used to evaluate the tracking performance, and the maximum OI is found to be 76% and 88% on private data and public data sequences.Other Information Published in: International Journal of Computer Assisted Radiology and Surgery License: https://creativecommons.org/licenses/by/4.0See article on publisher's website: http://dx.doi.org/10.1007/s11548-019-02030-z</p

Preliminary design and evaluation of a remote tele-mentoring system for minimally invasive surgery

Background Tele-mentoring during surgery facilitates the transfer of surgical knowledge from a mentor (specialist surgeon) to a mentee (operating surgeon). The aim of this work is to develop a tele-mentoring system tailored for minimally invasive surgery (MIS) where the mentor can remotely demonstrate to the mentee the required motion of the surgical instruments. Methods A remote tele-mentoring system is implemented that generates visual cues in the form of virtual surgical instrument motion overlaid onto the live view of the operative field. The technical performance of the system is evaluated in a simulated environment, where the operating room and the central location of the mentor were physically located in different countries and connected over the internet. In addition, a user study was performed to assess the system as a mentoring tool. Results On average, it took 260 ms to send a view of the operative field of 1920 × 1080 resolution from the operating room to the central location of the mentor and an average of 132 ms to receive the motion of virtual surgical instruments from the central location to the operating room. The user study showed that it is feasible for the mentor to demonstrate and for the mentee to understand and replicate the motion of surgical instruments. Conclusion The work demonstrates the feasibility of transferring information over the internet from a mentor to a mentee in the form of virtual surgical instruments. Their motion is overlaid onto the live view of the operative field enabling real-time interactions between both the surgeons.Other Information Published in: Surgical Endoscopy License: https://creativecommons.org/licenses/by/4.0See article on publisher's website: http://dx.doi.org/10.1007/s00464-022-09164-3</p