Bridging the Gap: Differentially Private Equivariant Deep Learning for Medical Image Analysis

Machine learning with formal privacy-preserving techniques like Differential Privacy (DP) allows one to derive valuable insights from sensitive medical imaging data while promising to protect patient privacy, but it usually comes at a sharp privacy-utility trade-off. In this work, we propose to use steerable equivariant convolutional networks for medical image analysis with DP. Their improved feature quality and parameter efficiency yield remarkable accuracy gains, narrowing the privacy-utility gap.Comment: Accepted as extended abstract at GeoMedIA Workshop 2022 (https://openreview.net/forum?id=rGYfMrMxI17

MAD: Modality Agnostic Distance Measure for Image Registration

Multi-modal image registration is a crucial pre-processing step in many medical applications. However, it is a challenging task due to the complex intensity relationships between different imaging modalities, which can result in large discrepancy in image appearance. The success of multi-modal image registration, whether it is conventional or learning based, is predicated upon the choice of an appropriate distance (or similarity) measure. Particularly, deep learning registration algorithms lack in accuracy or even fail completely when attempting to register data from an "unseen" modality. In this work, we present Modality Agnostic Distance (MAD), a deep image distance}] measure that utilises random convolutions to learn the inherent geometry of the images while being robust to large appearance changes. Random convolutions are geometry-preserving modules which we use to simulate an infinite number of synthetic modalities alleviating the need for aligned paired data during training. We can therefore train MAD on a mono-modal dataset and successfully apply it to a multi-modal dataset. We demonstrate that not only can MAD affinely register multi-modal images successfully, but it has also a larger capture range than traditional measures such as Mutual Information and Normalised Gradient Fields

AI reflections in 2020

We invited authors of selected Comments and Perspectives published in Nature Machine Intelligence in the latter half of 2019 and first half of 2020 to describe how their topic has developed, what their thoughts are about the challenges of 2020, and what they look forward to in 2021.Postprint (author's final draft

Future-ai:International consensus guideline for trustworthy and deployable artificial intelligence in healthcare

Despite major advances in artificial intelligence (AI) for medicine and healthcare, the deployment and adoption of AI technologies remain limited in real-world clinical practice. In recent years, concerns have been raised about the technical, clinical, ethical and legal risks associated with medical AI. To increase real world adoption, it is essential that medical AI tools are trusted and accepted by patients, clinicians, health organisations and authorities. This work describes the FUTURE-AI guideline as the first international consensus framework for guiding the development and deployment of trustworthy AI tools in healthcare. The FUTURE-AI consortium was founded in 2021 and currently comprises 118 inter-disciplinary experts from 51 countries representing all continents, including AI scientists, clinicians, ethicists, and social scientists. Over a two-year period, the consortium defined guiding principles and best practices for trustworthy AI through an iterative process comprising an in-depth literature review, a modified Delphi survey, and online consensus meetings. The FUTURE-AI framework was established based on 6 guiding principles for trustworthy AI in healthcare, i.e. Fairness, Universality, Traceability, Usability, Robustness and Explainability. Through consensus, a set of 28 best practices were defined, addressing technical, clinical, legal and socio-ethical dimensions. The recommendations cover the entire lifecycle of medical AI, from design, development and validation to regulation, deployment, and monitoring. FUTURE-AI is a risk-informed, assumption-free guideline which provides a structured approach for constructing medical AI tools that will be trusted, deployed and adopted in real-world practice. Researchers are encouraged to take the recommendations into account in proof-of-concept stages to facilitate future translation towards clinical practice of medical AI

FUTURE-AI: International consensus guideline for trustworthy and deployable artificial intelligence in healthcare

Despite major advances in artificial intelligence (AI) for medicine and healthcare, the deployment and adoption of AI technologies remain limited in real-world clinical practice. In recent years, concerns have been raised about the technical, clinical, ethical and legal risks associated with medical AI. To increase real world adoption, it is essential that medical AI tools are trusted and accepted by patients, clinicians, health organisations and authorities. This work describes the FUTURE-AI guideline as the first international consensus framework for guiding the development and deployment of trustworthy AI tools in healthcare. The FUTURE-AI consortium was founded in 2021 and currently comprises 118 inter-disciplinary experts from 51 countries representing all continents, including AI scientists, clinicians, ethicists, and social scientists. Over a two-year period, the consortium defined guiding principles and best practices for trustworthy AI through an iterative process comprising an in-depth literature review, a modified Delphi survey, and online consensus meetings. The FUTURE-AI framework was established based on 6 guiding principles for trustworthy AI in healthcare, i.e. Fairness, Universality, Traceability, Usability, Robustness and Explainability. Through consensus, a set of 28 best practices were defined, addressing technical, clinical, legal and socio-ethical dimensions. The recommendations cover the entire lifecycle of medical AI, from design, development and validation to regulation, deployment, and monitoring. FUTURE-AI is a risk-informed, assumption-free guideline which provides a structured approach for constructing medical AI tools that will be trusted, deployed and adopted in real-world practice. Researchers are encouraged to take the recommendations into account in proof-of-concept stages to facilitate future translation towards clinical practice of medical AI

Acceleration of chemical shift encoding-based water fat MRI for liver proton density fat fraction and T2* mapping using compressed sensing.

ObjectivesTo evaluate proton density fat fraction (PDFF) and T2* measurements of the liver with combined parallel imaging (sensitivity encoding, SENSE) and compressed sensing (CS) accelerated chemical shift encoding-based water-fat separation.MethodsSix-echo Dixon imaging was performed in the liver of 89 subjects. The first acquisition variant used acceleration based on SENSE with a total acceleration factor equal to 2.64 (acquisition labeled as SENSE). The second acquisition variant used acceleration based on a combination of CS with SENSE with a total acceleration factor equal to 4 (acquisition labeled as CS+SENSE). Acquisition times were compared between acquisitions and proton density fat fraction (PDFF) and T2*-values were measured and compared separately for each liver segment.ResultsTotal scan duration was 14.5 sec for the SENSE accelerated image acquisition and 9.3 sec for the CS+SENSE accelerated image acquisition. PDFF and T2* values did not differ significantly between the two acquisitions (paired Mann-Whitney and paired t-test P>0.05 in all cases). CS+SENSE accelerated acquisition showed reduced motion artifacts (1.1%) compared to SENSE acquisition (12.3%).ConclusionCS+SENSE accelerates liver PDFF and T2*mapping while retaining the same quantitative values as an acquisition using only SENSE and reduces motion artifacts

Mass Spectrometry Imaging of atherosclerosis-affine Gadofluorine following Magnetic Resonance Imaging

Molecular imaging of atherosclerosis by Magnetic Resonance Imaging (MRI) has been impaired by a lack of validation of the specific substrate responsible for the molecular imaging signal. We therefore aimed to investigate the additive value of mass spectrometry imaging (MSI) of atherosclerosis-affine Gadofluorine P for molecular MRI of atherosclerotic plaques. Atherosclerotic Ldlr(-/-) mice were investigated by high-field MRI (7T) at different time points following injection of atherosclerosis-affine Gadofluorine P as well as at different stages of atherosclerosis formation (4, 8, 16 and 20 weeks of HFD). At each imaging time point mice were immediately sacrificed after imaging and aortas were excised for mass spectrometry imaging: Matrix Assisted Laser Desorption Ionization (MALDI) Imaging and Laser Ablation - Inductively Coupled Plasma - Mass Spectrometry (LA-ICP-MS) imaging. Mass spectrometry imaging allowed to visualize the localization and measure the concentration of the MR imaging probe Gadofluorine P in plaque tissue ex vivo with high spatial resolution and thus adds novel and more target specific information to molecular MR imaging of atherosclerosis

Borderline-resectable pancreatic adenocarcinoma: Contour irregularity of the venous confluence in pre-operative computed tomography predicts histopathological infiltration.

PurposeThe purpose of the current study was to compare CT-signs of portal venous confluence infiltration for actual histopathological infiltration of the vein or the tumor/vein interface (TVI) in borderline resectable pancreatic ductal adenocarcinoma (PDAC).Methods and materials101 patients with therapy-naïve, primarily resected PDAC of the pancreatic head without arterial involvement were evaluated. The portal venous confluence was assessed for contour irregularity (defined as infiltration) and degree of contact. The sensitivity and specificity of contour irregularity versus tumor to vein contact >180° as well as the combination of the signs for tumor cell infiltration of the vessel wall or TVI was calculated. Overall survival (OS) was compared between groups.ResultsSensitivity and specificity of contour irregularity for identification of tumor infiltration of the portal venous confluence or the TVI was higher compared to tumor to vessel contact >180° for tumor cell infiltration (96%/79% vs. 91%/38% respectively, p180°/ both signs had significantly worse overall survival (16.2 vs. 26.5 months/ 17.9 vs. 37.4 months/ 18.5 vs. 26.5 months respectively, all pConclusionPortal venous confluence contour irregularity is a strong predictor of actual tumor cell infiltration of the vessel wall or the TVI and should be noted as such in radiological reports

Intensive Care Risk Estimation in COVID-19 Pneumonia Based on Clinical and Imaging Parameters: Experiences from the Munich Cohort

The evolving dynamics of coronavirus disease 2019 (COVID-19) and the increasing infection numbers require diagnostic tools to identify patients at high risk for a severe disease course. Here we evaluate clinical and imaging parameters for estimating the need of intensive care unit (ICU) treatment. We collected clinical, laboratory and imaging data from 65 patients with confirmed COVID-19 infection based on polymerase chain reaction (PCR) testing. Two radiologists evaluated the severity of findings in computed tomography (CT) images on a scale from 1 (no characteristic signs of COVID-19) to 5 (confluent ground glass opacities in over 50% of the lung parenchyma). The volume of affected lung was quantified using commercially available software. Machine learning modelling was performed to estimate the risk for ICU treatment. Patients with a severe course of COVID-19 had significantly increased interleukin (IL)-6, C-reactive protein (CRP), and leukocyte counts and significantly decreased lymphocyte counts. The radiological severity grading was significantly increased in ICU patients. Multivariate random forest modelling showed a mean ± standard deviation sensitivity, specificity and accuracy of 0.72 ± 0.1, 0.86 ± 0.16 and 0.80 ± 0.1 and a receiver operating characteristic-area under curve (ROC-AUC) of 0.79 ± 0.1. The need for ICU treatment is independently associated with affected lung volume, radiological severity score, CRP, and IL-6