Kinematic Data-Based Action Segmentation for Surgical Applications

Action segmentation is a challenging task in high-level process analysis, typically performed on video or kinematic data obtained from various sensors. In the context of surgical procedures, action segmentation is critical for workflow analysis algorithms. This work presents two contributions related to action segmentation on kinematic data. Firstly, we introduce two multi-stage architectures, MS-TCN-BiLSTM and MS-TCN-BiGRU, specifically designed for kinematic data. The architectures consist of a prediction generator with intra-stage regularization and Bidirectional LSTM or GRU-based refinement stages. Secondly, we propose two new data augmentation techniques, World Frame Rotation and Horizontal-Flip, which utilize the strong geometric structure of kinematic data to improve algorithm performance and robustness. We evaluate our models on three datasets of surgical suturing tasks: the Variable Tissue Simulation (VTS) Dataset and the newly introduced Bowel Repair Simulation (BRS) Dataset, both of which are open surgery simulation datasets collected by us, as well as the JHU-ISI Gesture and Skill Assessment Working Set (JIGSAWS), a well-known benchmark in robotic surgery. Our methods achieve state-of-the-art performance on all benchmark datasets and establish a strong baseline for the BRS dataset.Comment: 15 pages, 8 figure

SAGES consensus recommendations on surgical video data use, structure, and exploration (for research in artificial intelligence, clinical quality improvement, and surgical education)

BACKGROUND: Surgery generates a vast amount of data from each procedure. Particularly video data provides significant value for surgical research, clinical outcome assessment, quality control, and education. The data lifecycle is influenced by various factors, including data structure, acquisition, storage, and sharing; data use and exploration, and finally data governance, which encompasses all ethical and legal regulations associated with the data. There is a universal need among stakeholders in surgical data science to establish standardized frameworks that address all aspects of this lifecycle to ensure data quality and purpose. METHODS: Working groups were formed, among 48 representatives from academia and industry, including clinicians, computer scientists and industry representatives. These working groups focused on: Data Use, Data Structure, Data Exploration, and Data Governance. After working group and panel discussions, a modified Delphi process was conducted. RESULTS: The resulting Delphi consensus provides conceptualized and structured recommendations for each domain related to surgical video data. We identified the key stakeholders within the data lifecycle and formulated comprehensive, easily understandable, and widely applicable guidelines for data utilization. Standardization of data structure should encompass format and quality, data sources, documentation, metadata, and account for biases within the data. To foster scientific data exploration, datasets should reflect diversity and remain adaptable to future applications. Data governance must be transparent to all stakeholders, addressing legal and ethical considerations surrounding the data. CONCLUSION: This consensus presents essential recommendations around the generation of standardized and diverse surgical video databanks, accounting for multiple stakeholders involved in data generation and use throughout its lifecycle. Following the SAGES annotation framework, we lay the foundation for standardization of data use, structure, and exploration. A detailed exploration of requirements for adequate data governance will follow

Abiraterone acetate plus prednisolone for metastatic patients starting hormone therapy: 5-year follow-up results from the STAMPEDE randomised trial (NCT00268476)

Abiraterone acetate plus prednisolone (AAP) previously demonstrated improved survival in STAMPEDE, a multiarm, multistage platform trial in men starting long-term hormone therapy for prostate cancer. This long-term analysis in metastatic patients was planned for 3 years after the first results. Standard-of-care (SOC) was androgen deprivation therapy. The comparison randomised patients 1:1 to SOC-alone with or without daily abiraterone acetate 1000 mg + prednisolone 5 mg (SOC + AAP), continued until disease progression. The primary outcome measure was overall survival. Metastatic disease risk group was classified retrospectively using baseline CT and bone scans by central radiological review and pathology reports. Analyses used Cox proportional hazards and flexible parametric models, accounting for baseline stratification factors. One thousand and three patients were contemporaneously randomised (November 2011 to January 2014): median age 67 years; 94% newly-diagnosed; metastatic disease risk group: 48% high, 44% low, 8% unassessable; median PSA 97 ng/mL. At 6.1 years median follow-up, 329 SOC-alone deaths (118 low-risk, 178 high-risk) and 244 SOC + AAP deaths (75 low-risk, 145 high-risk) were reported. Adjusted HR = 0.60 (95% CI: 0.50-0.71; P = 0.31 × 10−9) favoured SOC + AAP, with 5-years survival improved from 41% SOC-alone to 60% SOC + AAP. This was similar in low-risk (HR = 0.55; 95% CI: 0.41-0.76) and high-risk (HR = 0.54; 95% CI: 0.43-0.69) patients. Median and current maximum time on SOC + AAP was 2.4 and 8.1 years. Toxicity at 4 years postrandomisation was similar, with 16% patients in each group reporting grade 3 or higher toxicity. A sustained and substantial improvement in overall survival of all metastatic prostate cancer patients was achieved with SOC + abiraterone acetate + prednisolone, irrespective of metastatic disease risk group

Antibody Repertoires in Humanized NOD-scid-IL2Rγnull Mice and Human B Cells Reveals Human-Like Diversification and Tolerance Checkpoints in the Mouse

Immunodeficient mice reconstituted with human hematopoietic stem cells enable the in vivo study of human hematopoiesis. In particular, NOD-scid-IL2Rγnull engrafted mice have been shown to have reasonable levels of T and B cell repopulation and can mount T-cell dependent responses; however, antigen-specific B-cell responses in this model are generally poor. We explored whether developmental defects in the immunoglobulin gene repertoire might be partly responsible for the low level of antibody responses in this model. Roche 454 sequencing was used to obtain over 685,000 reads from cDNA encoding immunoglobulin heavy (IGH) and light (IGK and IGL) genes isolated from immature, naïve, or total splenic B cells in engrafted NOD-scid-IL2Rγnull mice, and compared with over 940,000 reads from peripheral B cells of two healthy volunteers. We find that while naïve B-cell repertoires in humanized mice are chiefly indistinguishable from those in human blood B cells, and display highly correlated patterns of immunoglobulin gene segment use, the complementarity-determining region H3 (CDR-H3) repertoires are nevertheless extremely diverse and are specific for each individual. Despite this diversity, preferential DH-JH pairings repeatedly occur within the CDR-H3 interval that are strikingly similar across all repertoires examined, implying a genetic constraint imposed on repertoire generation. Moreover, CDR-H3 length, charged amino-acid content, and hydropathy are indistinguishable between humans and humanized mice, with no evidence of global autoimmune signatures. Importantly, however, a statistically greater usage of the inherently autoreactive IGHV4-34 and IGKV4-1 genes was observed in the newly formed immature B cells relative to naïve B or total splenic B cells in the humanized mice, a finding consistent with the deletion of autoreactive B cells in humans. Overall, our results provide evidence that key features of the primary repertoire are shaped by genetic factors intrinsic to human B cells and are principally unaltered by differences between mouse and human stromal microenvironments

Abiraterone acetate plus prednisolone for metastatic patients starting hormone therapy: 5‐year follow‐up results from the STAMPEDE randomised trial (NCT00268476)

This is an accepted manuscript of a paper published by Wiley in International Journal of Cancer on 12/04/2022, available online: https://doi.org/10.1002/ijc.34018 The accepted manuscript of the publication may differ from the final published versionAbiraterone acetate plus prednisolone (AAP) previously demonstrated improved survival in STAMPEDE, a multi-arm, multi-stage platform trial in men starting long-term hormone therapy for prostate cancer. This long-term analysis in metastatic patients was planned for 3 yrs after the first results. Standard-of-care (SOC) was androgen deprivation therapy. The comparison randomized patients 1:1 to SOC-alone with or without daily abiraterone acetate 1000 mg + prednisolone 5 mg (SOC + AAP), continued until disease progression. The primary outcome measure was overall survival. Metastatic disease risk group was classified retrospectively using baseline CT and bone scans by central radiological review and pathology reports. Analyses used Cox proportional hazards & flexible parametric models, adjusted for baseline stratification factors. 1003 patients were contemporaneously randomized (Nov-2011--Jan-2014): median age 67 yr; 94% newly-diagnosed; metastatic disease risk group: 48% high, 44% low, 8% un-assessable; median PSA 97 ng/mL. At 6.1 yr median follow-up, 329 SOC-alone deaths (118 low-risk, 178 high-risk) and 244 SOC + AAP deaths (75 low-risk, 145 high-risk) were reported. Adjusted HR = 0·60 (95%CI:0·50—0·71; P = 0.31x10−9) favoured SOC + AAP, with 5-yr survival improved from 41% SOC-alone to 60% SOC + AAP. This was similar in low-risk (HR = 0·55; 95%CI:0·41—0·76) and high-risk (HR = 0·54; 95%CI:0·43—0·69) patients. Median and current maximum time on SOC + AAP was 2.4 yr and 8.1 yr. Toxicity at 4 yr post-randomisation was similar, with 16% patients in each group reporting grade 3 or higher toxicity. A sustained and substantial improvement in overall survival of all metastatic prostate cancer patients was achieved with SOC + abiraterone acetate + prednisolone, irrespective of metastatic disease risk group.Cancer Research UK, (CRUK_A12459), Medical Research Council (MRC_MC_UU_12023/25, MC_UU_00004/01), UK Clinical Research Network, and the Swiss Group for Cancer Clinical Research (SAKK).Published onlin

Abiraterone acetate plus prednisolone with or without enzalutamide for patients with metastatic prostate cancer starting androgen deprivation therapy: final results from two randomised phase 3 trials of the STAMPEDE platform protocol

Background: Abiraterone acetate plus prednisolone (herein referred to as abiraterone) or enzalutamide added at the start of androgen deprivation therapy improves outcomes for patients with metastatic prostate cancer. Here, we aimed to evaluate long-term outcomes and test whether combining enzalutamide with abiraterone and androgen deprivation therapy improves survival. Methods: We analysed two open-label, randomised, controlled, phase 3 trials of the STAMPEDE platform protocol, with no overlapping controls, conducted at 117 sites in the UK and Switzerland. Eligible patients (no age restriction) had metastatic, histologically-confirmed prostate adenocarcinoma; a WHO performance status of 0–2; and adequate haematological, renal, and liver function. Patients were randomly assigned (1:1) using a computerised algorithm and a minimisation technique to either standard of care (androgen deprivation therapy; docetaxel 75 mg/m2 intravenously for six cycles with prednisolone 10 mg orally once per day allowed from Dec 17, 2015) or standard of care plus abiraterone acetate 1000 mg and prednisolone 5 mg (in the abiraterone trial) orally or abiraterone acetate and prednisolone plus enzalutamide 160 mg orally once a day (in the abiraterone and enzalutamide trial). Patients were stratified by centre, age, WHO performance status, type of androgen deprivation therapy, use of aspirin or non-steroidal anti-inflammatory drugs, pelvic nodal status, planned radiotherapy, and planned docetaxel use. The primary outcome was overall survival assessed in the intention-to-treat population. Safety was assessed in all patients who started treatment. A fixed-effects meta-analysis of individual patient data was used to compare differences in survival between the two trials. STAMPEDE is registered with ClinicalTrials.gov (NCT00268476) and ISRCTN (ISRCTN78818544). Findings: Between Nov 15, 2011, and Jan 17, 2014, 1003 patients were randomly assigned to standard of care (n=502) or standard of care plus abiraterone (n=501) in the abiraterone trial. Between July 29, 2014, and March 31, 2016, 916 patients were randomly assigned to standard of care (n=454) or standard of care plus abiraterone and enzalutamide (n=462) in the abiraterone and enzalutamide trial. Median follow-up was 96 months (IQR 86–107) in the abiraterone trial and 72 months (61–74) in the abiraterone and enzalutamide trial. In the abiraterone trial, median overall survival was 76·6 months (95% CI 67·8–86·9) in the abiraterone group versus 45·7 months (41·6–52·0) in the standard of care group (hazard ratio [HR] 0·62 [95% CI 0·53–0·73]; p<0·0001). In the abiraterone and enzalutamide trial, median overall survival was 73·1 months (61·9–81·3) in the abiraterone and enzalutamide group versus 51·8 months (45·3–59·0) in the standard of care group (HR 0·65 [0·55–0·77]; p<0·0001). We found no difference in the treatment effect between these two trials (interaction HR 1·05 [0·83–1·32]; pinteraction=0·71) or between-trial heterogeneity (I2 p=0·70). In the first 5 years of treatment, grade 3–5 toxic effects were higher when abiraterone was added to standard of care (271 [54%] of 498 vs 192 [38%] of 502 with standard of care) and the highest toxic effects were seen when abiraterone and enzalutamide were added to standard of care (302 [68%] of 445 vs 204 [45%] of 454 with standard of care). Cardiac causes were the most common cause of death due to adverse events (five [1%] with standard of care plus abiraterone and enzalutamide [two attributed to treatment] and one (<1%) with standard of care in the abiraterone trial). Interpretation: Enzalutamide and abiraterone should not be combined for patients with prostate cancer starting long-term androgen deprivation therapy. Clinically important improvements in survival from addition of abiraterone to androgen deprivation therapy are maintained for longer than 7 years. Funding: Cancer Research UK, UK Medical Research Council, Swiss Group for Clinical Cancer Research, Janssen, and Astellas

What can Sensors and Motion Tracking Technology Tell us About Technical Skills Performance?

Agenda: Background and Motivation Performance Signatures Sensor Technology Motion Tracking Technology Presentation: 47:2