Groupwise Multimodal Image Registration using Joint Total Variation

In medical imaging it is common practice to acquire a wide range of modalities (MRI, CT, PET, etc.), to highlight different structures or pathologies. As patient movement between scans or scanning session is unavoidable, registration is often an essential step before any subsequent image analysis. In this paper, we introduce a cost function based on joint total variation for such multimodal image registration. This cost function has the advantage of enabling principled, groupwise alignment of multiple images, whilst being insensitive to strong intensity non-uniformities. We evaluate our algorithm on rigidly aligning both simulated and real 3D brain scans. This validation shows robustness to strong intensity non-uniformities and low registration errors for CT/PET to MRI alignment. Our implementation is publicly available at https://github.com/brudfors/coregistration-njtv

A review of artificial intelligence in prostate cancer detection on imaging

A multitude of studies have explored the role of artificial intelligence (AI) in providing diagnostic support to radiologists, pathologists, and urologists in prostate cancer detection, risk-stratification, and management. This review provides a comprehensive overview of relevant literature regarding the use of AI models in (1) detecting prostate cancer on radiology images (magnetic resonance and ultrasound imaging), (2) detecting prostate cancer on histopathology images of prostate biopsy tissue, and (3) assisting in supporting tasks for prostate cancer detection (prostate gland segmentation, MRI-histopathology registration, MRI-ultrasound registration). We discuss both the potential of these AI models to assist in the clinical workflow of prostate cancer diagnosis, as well as the current limitations including variability in training data sets, algorithms, and evaluation criteria. We also discuss ongoing challenges and what is needed to bridge the gap between academic research on AI for prostate cancer and commercial solutions that improve routine clinical care

Motion Compensation for Free-Breathing Abdominal Diffusion-Weighted Imaging (MoCo DWI)

Diffusion-weighted imaging (DWI) is a common technique in medical diagnostics. One challenge of thoracic and abdominal DWI is respiratory motion which can result in motion artifacts. To eliminate these artifacts, a new kind of retrospective, respiratory motion compensation for DWI was developed and tested. This new technique — MoCo DWI — is the first in DWI which provides fully-deformable motion compensation. To enable this, despite the low image quality of DWI, two free-breathing sequences were used: (1) a gradient echo sequence (GRE) with a configuration for optimal respiratory motion estimation and (2) a DWI in a configuration of clinical interest. The DWI acquisition was gated into 10 motion phases. Each motion phase was then co-aligned with the motion estimation. The implementation was tested with eleven volunteers. The results showed that MoCo DWI can reduce motion blurring in single b-value images, especially at the liver-lung interface. The improvement of ADC-maps was even more prominent. Individual slices showed motion induced artifacts which could be reduced or even eliminated by MoCo DWI. This was also reflected by expected more homogeneous ADC values in the liver in all data sets. These results promise to reduce measurements with limited diagnostic value while keeping or increasing patient comfort

Fully automated convolutional neural network-based affine algorithm improves liver registration and lesion co-localization on hepatobiliary phase T1-weighted MR images.

BackgroundLiver alignment between series/exams is challenged by dynamic morphology or variability in patient positioning or motion. Image registration can improve image interpretation and lesion co-localization. We assessed the performance of a convolutional neural network algorithm to register cross-sectional liver imaging series and compared its performance to manual image registration.MethodsThree hundred fourteen patients, including internal and external datasets, who underwent gadoxetate disodium-enhanced magnetic resonance imaging for clinical care from 2011 to 2018, were retrospectively selected. Automated registration was applied to all 2,663 within-patient series pairs derived from these datasets. Additionally, 100 within-patient series pairs from the internal dataset were independently manually registered by expert readers. Liver overlap, image correlation, and intra-observation distances for manual versus automated registrations were compared using paired t tests. Influence of patient demographics, imaging characteristics, and liver uptake function was evaluated using univariate and multivariate mixed models.ResultsCompared to the manual, automated registration produced significantly lower intra-observation distance (p < 0.001) and higher liver overlap and image correlation (p < 0.001). Intra-exam automated registration achieved 0.88 mean liver overlap and 0.44 mean image correlation for the internal dataset and 0.91 and 0.41, respectively, for the external dataset. For inter-exam registration, mean overlap was 0.81 and image correlation 0.41. Older age, female sex, greater inter-series time interval, differing uptake, and greater voxel size differences independently reduced automated registration performance (p ≤ 0.020).ConclusionA fully automated algorithm accurately registered the liver within and between examinations, yielding better liver and focal observation co-localization compared to manual registration

PET/MRI of Hepatic 90Y Microsphere Deposition Determines Individual Tumor Response.

PurposeThe purpose of our study is to determine if there is a relationship between dose deposition measured by PET/MRI and individual lesion response to yttrium-90 ((90)Y) microsphere radioembolization.Materials and methods26 patients undergoing lobar treatment with (90)Y microspheres underwent PET/MRI within 66 h of treatment and had follow-up imaging available. Adequate visualization of tumor was available in 24 patients, and contours were drawn on simultaneously acquired PET/MRI data. Dose volume histograms (DVHs) were extracted from dose maps, which were generated using a voxelized dose kernel. Similar contours to capture dimensional and volumetric change of tumors were drawn on follow-up imaging. Response was analyzed using both RECIST and volumetric RECIST (vRECIST) criteria.ResultsA total of 8 hepatocellular carcinoma (HCC), 4 neuroendocrine tumor (NET), 9 colorectal metastases (CRC) patients, and 3 patients with other metastatic disease met inclusion criteria. Average dose was useful in predicting response between responders and non-responders for all lesion types and for CRC lesions alone using both response criteria (p < 0.05). D70 (minimum dose to 70 % of volume) was also useful in predicting response when using vRECIST. No significant trend was seen in the other tumor types. For CRC lesions, an average dose of 29.8 Gy offered 76.9 % sensitivity and 75.9 % specificity for response.ConclusionsPET/MRI of (90)Y microsphere distribution showed significantly higher DVH values for responders than non-responders in patients with CRC. DVH analysis of (90)Y microsphere distribution following treatment may be an important predictor of response and could be used to guide future adaptive therapy trials

Improvements in the registration of multimodal medical imaging : application to intensity inhomogeneity and partial volume corrections

Alignment or registration of medical images has a relevant role on clinical diagnostic and treatment decisions as well as in research settings. With the advent of new technologies for multimodal imaging, robust registration of functional and anatomical information is still a challenge, particular in small-animal imaging given the lesser structural content of certain anatomical parts, such as the brain, than in humans. Besides, patient-dependent and acquisition artefacts affecting the images information content further complicate registration, as is the case of intensity inhomogeneities (IIH) showing in MRI and the partial volume effect (PVE) attached to PET imaging. Reference methods exist for accurate image registration but their performance is severely deteriorated in situations involving little images Overlap. While several approaches to IIH and PVE correction exist these methods still do not guarantee or rely on robust registration. This Thesis focuses on overcoming current limitations af registration to enable novel IIH and PVE correction methods.El registre d'imatges mèdiques té un paper rellevant en les decisions de diagnòstic i tractament clíniques així com en la recerca. Amb el desenvolupament de noves tecnologies d'imatge multimodal, el registre robust d'informació funcional i anatòmica és encara avui un repte, en particular, en imatge de petit animal amb un menor contingut estructural que en humans de certes parts anatòmiques com el cervell. A més, els artefactes induïts pel propi pacient i per la tècnica d'adquisició que afecten el contingut d'informació de les imatges complica encara més el procés de registre. És el cas de les inhomogeneïtats d'intensitat (IIH) que apareixen a les RM i de l'efecte de volum parcial (PVE) característic en PET. Tot i que existeixen mètodes de referència pel registre acurat d'imatges la seva eficàcia es veu greument minvada en casos de poc solapament entre les imatges. De la mateixa manera, també existeixen mètodes per la correcció d'IIH i de PVE però que no garanteixen o que requereixen un registre robust. Aquesta tesi es centra en superar aquestes limitacions sobre el registre per habilitar nous mètodes per la correcció d'IIH i de PVE