Semantic segmentation of surgical hyperspectral images under geometric domain shifts

Robust semantic segmentation of intraoperative image data could pave the way for automatic surgical scene understanding and autonomous robotic surgery. Geometric domain shifts, however, although common in real-world open surgeries due to variations in surgical procedures or situs occlusions, remain a topic largely unaddressed in the field. To address this gap in the literature, we (1) present the first analysis of state-of-the-art (SOA) semantic segmentation networks in the presence of geometric out-of-distribution (OOD) data, and (2) address generalizability with a dedicated augmentation technique termed "Organ Transplantation" that we adapted from the general computer vision community. According to a comprehensive validation on six different OOD data sets comprising 600 RGB and hyperspectral imaging (HSI) cubes from 33 pigs semantically annotated with 19 classes, we demonstrate a large performance drop of SOA organ segmentation networks applied to geometric OOD data. Surprisingly, this holds true not only for conventional RGB data (drop of Dice similarity coefficient (DSC) by 46 %) but also for HSI data (drop by 45 %), despite the latter's rich information content per pixel. Using our augmentation scheme improves on the SOA DSC by up to 67 % (RGB) and 90 % (HSI) and renders performance on par with in-distribution performance on real OOD test data. The simplicity and effectiveness of our augmentation scheme makes it a valuable network-independent tool for addressing geometric domain shifts in semantic scene segmentation of intraoperative data. Our code and pre-trained models are available at https://github.com/IMSY-DKFZ/htc.Comment: The first two authors (Jan Sellner and Silvia Seidlitz) contributed equally to this pape

Minimally Invasive Versus open AbdominoThoracic Esophagectomy for esophageal carcinoma (MIVATE) — study protocol for a randomized controlled trial DRKS00016773

Background!#!The only curative treatment for most esophageal cancers is radical esophagectomy. Minimally invasive esophagectomy (MIE) aims to reduce postoperative morbidity, but is not yet widely established. Linear stapled anastomosis is a promising technique for MIE because it is quite feasible even without robotic assistance. The aim of the present study is to compare total MIE with linear stapled anastomosis to open esophagectomy (OE) with circular stapled anastomosis with special regard to postoperative morbidity in an expertise-based randomized controlled trial (RCT).!##!Methods/design!#!This superiority RCT compares MIE with linear stapled anastomosis (intervention) to OE with circular stapled anastomosis (control) for Ivor-Lewis esophagectomy. It was initiated in February 2019, and recruitment is expected to last for 3 years. For inclusion, patients must be 18 years of age or more with a resectable primary malignancy in the distal esophagus. Participants with tumor localizations above the azygos vein, metastasis, or infiltration into adjacent tissue will be excluded. In an expertise-based approach, the allocated treatment will only be carried out by the single most experienced surgeon of the surgical center for each respective technique. The sample size was calculated with 20 participants per group for the primary endpoint postoperative morbidity according to comprehensive complication index (CCI) within 30 postoperative days. Secondary endpoints include anastomotic insufficiency, pulmonary complications, other intra- and postoperative outcome parameters such as estimated blood loss, operative time, length of stay, short-term oncologic endpoints, adherence to a standardized fast-track protocol, postoperative pain, and postoperative recovery (QoR-15). Quality of life (SF-36, CAT EORTC QLQ-C30, CAT EORTC QLQ-OES18) and oncological outcomes are evaluated with 60 months follow-up.!##!Discussion!#!MIVATE is the first RCT to compare OE with circular stapled anastomosis to total MIE with linear stapled anastomosis exclusively for intrathoracic anastomosis. The expertise-based approach limits bias due to heterogeneity of surgical expertise. The use of a dedicated fast-track protocol in both OE and MIE will shed light on the role of the access strategy alone in this setting. The findings of this study will serve to define which approach has the best perioperative outcome for patients requiring esophagectomy.!##!Trial registration!#!German Clinical Trials Register DRKS00016773 . Registered on 18 February 2019

Hyperspectral imaging for perioperative monitoring of microcirculatory tissue oxygenation and tissue water content in pancreatic surgery — an observational clinical pilot study

Background!#!Hyperspectral imaging (HSI) could provide extended haemodynamic monitoring of perioperative tissue oxygenation and tissue water content to visualize effects of haemodynamic therapy and surgical trauma. The objective of this study was to assess the capacity of HSI to monitor skin microcirculation and possible relations to perioperative organ dysfunction in patients undergoing pancreatic surgery.!##!Methods!#!The hyperspectral imaging TIVITA® Tissue System was used to evaluate superficial tissue oxygenation (StO2), deeper layer tissue oxygenation (near-infrared perfusion index (NPI)), haemoglobin distribution (tissue haemoglobin index (THI)) and tissue water content (tissue water index (TWI)) in 25 patients undergoing pancreatic surgery. HSI parameters were measured before induction of anaesthesia (t1), after induction of anaesthesia (t2), postoperatively before anaesthesia emergence (t3), 6 h after emergence of anaesthesia (t4) and three times daily (08:00, 14:00, 20:00 ± 1 h) at the palm and the fingertips until the second postoperative day (t5-t10). Primary outcome was the correlation of HSI with perioperative organ dysfunction assessed with the perioperative change of SOFA score.!##!Results!#!Two hundred and fifty HSI measurements were performed in 25 patients. Anaesthetic induction led to a significant increase of tissue oxygenation parameters StO2 and NPI (t1-t2). StO2 and NPI decreased significantly from t2 until the end of surgery (t3). THI of the palm showed a strong correlation with haemoglobin levels preoperatively (t2: r = 0.83, p < 0.001) and 6 h postoperatively (t4: r = 0.71, p = 0.001) but not before anaesthesia emergence (t3: r = 0.35, p = 0.10). TWI of the palm and the fingertip rose significantly between pre- and postoperative measurements (t2-t3). Higher blood loss, syndecan level and duration of surgery were associated with a higher increase of TWI. The perioperative change of HSI parameters (∆t1-t3) did not correlate with the perioperative change of the SOFA score.!##!Conclusion!#!This is the first study using HSI skin measurements to visualize tissue oxygenation and tissue water content in patients undergoing pancreatic surgery. HSI was able to measure short-term changes of tissue oxygenation during anaesthetic induction and pre- to postoperatively. TWI indicated a perioperative increase of tissue water content. Perioperative use of HSI could be a useful extension of haemodynamic monitoring to assess the microcirculatory response during haemodynamic therapy and major surgery.!##!Trial registration!#!German Clinical Trial Register, DRKS00017313 on 5 June 2019

Hyperspectral Imaging for the Evaluation of Microcirculatory Tissue Oxygenation and Perfusion Quality in Haemorrhagic Shock: A Porcine Study

Background: The ultimate goal of haemodynamic therapy is to improve microcirculatory tissue and organ perfusion. Hyperspectral imaging (HSI) has the potential to enable noninvasive microcirculatory monitoring at bedside. Methods: HSI (Tivita® Tissue System) measurements of tissue oxygenation, haemoglobin, and water content in the skin (ear) and kidney were evaluated in a double-hit porcine model of major abdominal surgery and haemorrhagic shock. Animals of the control group (n = 7) did not receive any resuscitation regime. The interventional groups were treated exclusively with either crystalloid (n = 8) or continuous norepinephrine infusion (n = 7). Results: Haemorrhagic shock led to a drop in tissue oxygenation parameters in all groups. These correlated with established indirect markers of tissue oxygenation. Fluid therapy restored tissue oxygenation parameters. Skin and kidney measurements correlated well. High dose norepinephrine therapy deteriorated tissue oxygenation. Tissue water content increased both in the skin and the kidney in response to fluid therapy. Conclusions: HSI detected dynamic changes in tissue oxygenation and perfusion quality during shock and was able to indicate resuscitation effectivity. The observed correlation between HSI skin and kidney measurements may offer an estimation of organ oxygenation impairment from skin monitoring. HSI microcirculatory monitoring could open up new opportunities for the guidance of haemodynamic management

HeiPorSPECTRAL - the Heidelberg Porcine HyperSPECTRAL Imaging Dataset of 20 Physiological Organs

Abstract Hyperspectral Imaging (HSI) is a relatively new medical imaging modality that exploits an area of diagnostic potential formerly untouched. Although exploratory translational and clinical studies exist, no surgical HSI datasets are openly accessible to the general scientific community. To address this bottleneck, this publication releases HeiPorSPECTRAL ( https://www.heiporspectral.org ; https://doi.org/10.5281/zenodo.7737674 ), the first annotated high-quality standardized surgical HSI dataset. It comprises 5,758 spectral images acquired with the TIVITA® Tissue and annotated with 20 physiological porcine organs from 8 pigs per organ distributed over a total number of 11 pigs. Each HSI image features a resolution of 480 × 640 pixels acquired over the 500–1000 nm wavelength range. The acquisition protocol has been designed such that the variability of organ spectra as a function of several parameters including the camera angle and the individual can be assessed. A comprehensive technical validation confirmed both the quality of the raw data and the annotations. We envision potential reuse within this dataset, but also its reuse as baseline data for future research questions outside this dataset. Measurement(s) Spectral Reflectance Technology Type(s) Hyperspectral Imaging Sample Characteristic - Organism Sus scrof

Minimally invasivE versus open total GAstrectomy (MEGA): study protocol for a multicentre randomised controlled trial (DRKS00025765)

Introduction The only curative treatment for most gastric cancer is radical gastrectomy with D2 lymphadenectomy (LAD). Minimally invasive total gastrectomy (MIG) aims to reduce postoperative morbidity, but its use has not yet been widely established in Western countries. Minimally invasivE versus open total GAstrectomy is the first Western multicentre randomised controlled trial (RCT) to compare postoperative morbidity following MIG vs open total gastrectomy (OG). Methods and analysis This superiority multicentre RCT compares MIG (intervention) to OG (control) for oncological total gastrectomy with D2 or D2+LAD. Recruitment is expected to last for 2 years. Inclusion criteria comprise age between 18 and 84 years and planned total gastrectomy after initial diagnosis of gastric carcinoma. Exclusion criteria include Eastern Co-operative Oncology Group (ECOG) performance status >2, tumours requiring extended gastrectomy or less than total gastrectomy, previous abdominal surgery or extensive adhesions seriously complicating MIG, other active oncological disease, advanced stages (T4 or M1), emergency setting and pregnancy. The sample size was calculated at 80 participants per group. The primary endpoint is 30-day postoperative morbidity as measured by the Comprehensive Complications Index. Secondary endpoints include postoperative morbidity and mortality, adherence to a fast-track protocol and patient-reported quality of life (QoL) scores (QoR-15, EUROQOL EuroQol-5 Dimensions-5 Levels (EQ-5D), EORTC QLQ-C30, EORTC QLQ-STO22, activities of daily living and Body Image Scale). Oncological endpoints include rate of R0 resection, lymph node yield, disease-free survival and overall survival at 60-month follow-up. Ethics and dissemination Ethical approval has been received by the independent Ethics Committee of the Medical Faculty, University of Heidelberg (S-816/2021) and will be received from each responsible ethics committee for each individual participating centre prior to recruitment. Results will be published open access

Glutamatergic synaptic input to glioma cells drives brain tumour progression

A network of communicating tumour cells that is connected by tumour microtubes mediates the progression of incurable gliomas. Moreover, neuronal activity can foster malignant behaviour of glioma cells by non-synaptic paracrine and autocrine mechanisms. Here we report a direct communication channel between neurons and glioma cells in different disease models and human tumours: functional bona fide chemical synapses between presynaptic neurons and postsynaptic glioma cells. These neurogliomal synapses show a typical synaptic ultrastructure, are located on tumour microtubes, and produce postsynaptic currents that are mediated by glutamate receptors of the AMPA subtype. Neuronal activity including epileptic conditions generates synchronised calcium transients in tumour-microtube-connected glioma networks. Glioma-cell-specific genetic perturbation of AMPA receptors reduces calcium-related invasiveness of tumour-microtube-positive tumour cells and glioma growth. Invasion and growth are also reduced by anaesthesia and the AMPA receptor antagonist perampanel, respectively. These findings reveal a biologically relevant direct synaptic communication between neurons and glioma cells with potential clinical implications

Improvement of downstream processing of recombinant proteins by means of genetic engineering

Flaschel E, Friehs K. Improvement of downstream processing of recombinant proteins by means of genetic engineering. Biotechnology Advances. 1993;11(1):31-77.The rapid advancement of genetic engineering has allowed to produce an impressive number of proteins on a scale which would not have been achieved by classical biotechnology. At the beginning of this development research was focussed on elucidating the mechanisms of protein overexpression. The appearance of inclusion bodies may illustrate the success. In the meantime, genetic engineering is not only expected to achieve overexpression, but to improve the whole process of protein production. For downstream processing of recombinant proteins, the synthesis of fusion proteins is of primary importance. Fusion with certain proteins or peptides may protect the target protein from proteolytic degradation and may alter its solubility. Intracellular proteins may be translocated by means of fusions with signal peptides. Affinity tags as fusion complements may render protein separation and purification highly selective. These methods as well as similar ones for improving the downstream processing of proteins will be discussed on the basis of recent literature