Variational image registration by a total fractional-order variation model

In this paper, a new framework of nonlocal deformation in non-rigid image registration is presented. It is well known that many non-rigid image registration techniques may lead to unsteady deformation (e.g. not one to one) if the dissimilarity between the reference and template images is too large. We present a novel variational framework of the total fractional-order variation to derive the underlying fractional Euler-Lagrange equations and a numerical implementation combining the semi-implicit update and conjugate gradients (CG) solution to solve the nonlinear systems. Numerical experiments show that the new registration not only produces accurate and smooth solutions but also allows for a large rigid alignment, the evaluations of the new model demonstrate substantial improvements in accuracy and robustness over the conventional image registration approaches

Deformable MRI to Transrectal Ultrasound Registration for Prostate Interventions Using Deep Learning

RÉSUMÉ: Le cancer de la prostate est l’un des principaux problèmes de santé publique dans le monde. Un diagnostic précoce du cancer de la prostate pourrait jouer un rôle vital dans le traitement des patients. Les procédures de biopsie sont utilisées à des fins de diagnostic. À cet égard, l’échographie transrectale (TRUS) est considérée comme un standard pour l’imagerie de la prostate lors d’une biopsie ou d’une curiethérapie. Cette technique d’imagerie est relativement peu coûteuse, peut scanner l’organe en temps réel et est sans radiation. Ainsi, les scans TRUS sont utilisés pour guider les cliniciens sur l’emplacement d’une tumeur à l’intérieur de la prostate. Le défi majeur réside dans le fait que les images TRUS ont une faible résolution et qualité d’image. Il est difficile de distinguer l’emplacement exact de la tumeur et l’étendue de la maladie. De plus, l’organe de la prostate subit d’importantes variations de forme au cours d’une intervention de la prostate, ce qui rend l’identification de la tumeur encore plus difficile.----------ABSTRACT: Prostate cancer is one of the major public health issues in the world. An accurate and early diagnosis of prostate cancer could play a vital role in the treatment of patients. Biopsy procedures are used for diagnosis purposes. In this regard, Transrectal Ultrasound (TRUS) is considered a standard for imaging the prostate during a biopsy or brachytherapy procedure. This imaging technique is comparatively low-cost, can scan the organ in real-time, and is radiation free. Thus, TRUS scans are used to guide the clinicians about the location of a tumor inside the prostate organ. The major challenge lies in the fact that TRUS images have low resolution and quality. This makes it difficult to distinguish the exact tumor location and the extent of the disease. In addition, the prostate organ undergoes important shape variations during a prostate intervention procedure, which makes the tumor identification even harder

Artificial Intelligence and Machine Learning in Prostate Cancer Patient Management-Current Trends and Future Perspectives

Artificial intelligence (AI) is the field of computer science that aims to build smart devices performing tasks that currently require human intelligence. Through machine learning (ML), the deep learning (DL) model is teaching computers to learn by example, something that human beings are doing naturally. AI is revolutionizing healthcare. Digital pathology is becoming highly assisted by AI to help researchers in analyzing larger data sets and providing faster and more accurate diagnoses of prostate cancer lesions. When applied to diagnostic imaging, AI has shown excellent accuracy in the detection of prostate lesions as well as in the prediction of patient outcomes in terms of survival and treatment response. The enormous quantity of data coming from the prostate tumor genome requires fast, reliable and accurate computing power provided by machine learning algorithms. Radiotherapy is an essential part of the treatment of prostate cancer and it is often difficult to predict its toxicity for the patients. Artificial intelligence could have a future potential role in predicting how a patient will react to the therapy side effects. These technologies could provide doctors with better insights on how to plan radiotherapy treatment. The extension of the capabilities of surgical robots for more autonomous tasks will allow them to use information from the surgical field, recognize issues and implement the proper actions without the need for human intervention

Real-time Biomechanical Modeling for Intraoperative Soft Tissue Registration

Computer assisted surgery systems intraoperatively support the surgeon by providing information on the location of hidden risk and target structures during surgery. However, soft tissue deformations make intraoperative registration (and thus intraoperative navigation) difficult. In this work, a novel, biomechanics based approach for real-time soft tissue registration from sparse intraoperative sensor data such as stereo endoscopic images is presented to overcome this problem

Compressed Sensing Based Reconstruction Algorithm for X-ray Dose Reduction in Synchrotron Source Micro Computed Tomography

Synchrotron computed tomography requires a large number of angular projections to reconstruct tomographic images with high resolution for detailed and accurate diagnosis. However, this exposes the specimen to a large amount of x-ray radiation. Furthermore, this increases scan time and, consequently, the likelihood of involuntary specimen movements. One approach for decreasing the total scan time and radiation dose is to reduce the number of projection views needed to reconstruct the images. However, the aliasing artifacts appearing in the image due to the reduced number of projection data, visibly degrade the image quality. According to the compressed sensing theory, a signal can be accurately reconstructed from highly undersampled data by solving an optimization problem, provided that the signal can be sparsely represented in a predefined transform domain. Therefore, this thesis is mainly concerned with designing compressed sensing-based reconstruction algorithms to suppress aliasing artifacts while preserving spatial resolution in the resulting reconstructed image. First, the reduced-view synchrotron computed tomography reconstruction is formulated as a total variation regularized compressed sensing problem. The Douglas-Rachford Splitting and the randomized Kaczmarz methods are utilized to solve the optimization problem of the compressed sensing formulation. In contrast with the first part, where consistent simulated projection data are generated for image reconstruction, the reduced-view inconsistent real ex-vivo synchrotron absorption contrast micro computed tomography bone data are used in the second part. A gradient regularized compressed sensing problem is formulated, and the Douglas-Rachford Splitting and the preconditioned conjugate gradient methods are utilized to solve the optimization problem of the compressed sensing formulation. The wavelet image denoising algorithm is used as the post-processing algorithm to attenuate the unwanted staircase artifact generated by the reconstruction algorithm. Finally, a noisy and highly reduced-view inconsistent real in-vivo synchrotron phase-contrast computed tomography bone data are used for image reconstruction. A combination of prior image constrained compressed sensing framework, and the wavelet regularization is formulated, and the Douglas-Rachford Splitting and the preconditioned conjugate gradient methods are utilized to solve the optimization problem of the compressed sensing formulation. The prior image constrained compressed sensing framework takes advantage of the prior image to promote the sparsity of the target image. It may lead to an unwanted staircase artifact when applied to noisy and texture images, so the wavelet regularization is used to attenuate the unwanted staircase artifact generated by the prior image constrained compressed sensing reconstruction algorithm. The visual and quantitative performance assessments with the reduced-view simulated and real computed tomography data from canine prostate tissue, rat forelimb, and femoral cortical bone samples, show that the proposed algorithms have fewer artifacts and reconstruction errors than other conventional reconstruction algorithms at the same x-ray dose

MR-based pseudo-CT generation using water-fat decomposition and Gaussian mixture regression

Tese de mestrado integrado em Engenharia Biomédica e Biofísica, apresentada à Universidade de Lisboa, através da Faculdade de Ciências, 2017O uso de tomografia computorizada (CT) é considerado como a prática clínica adequada para aplicações clínicas onde a simulação da atenuação de radiação pelos tecidos corporais é necessária, tais como a correcção de atenuação dos fotões em Tomografia de Emissão de Positrões (PET) e no cálculo da dosagem a ser administrada durante o planeamento de radioterapia (RTP). Imagens de ressonância magnética (MRI) têm vindo a substituir o uso de TC em algumas aplicações, sobretudo devido ao seu superior contraste entre tecidos moles e ao facto de não usar radiação ionizante. Desta forma, técnicas como PET-MRI e o planeamento de radioterapia apenas com recurso a imagens de ressonância magnética são alvo de uma crescente atenção. No entanto, estas técnicas estão limitadas pelo facto de imagens de ressonância magnética não fornecerem informação acerca da atenuação e absorção de radiação pelos tecidos. Normalmente, de forma a solucionar este problema, uma imagem de tomografia computorizada é adquirida de forma a realizar a correcção da atenuação dos fotões, assim como a dose a ser entregue em radioterapia. No entanto, esta prática introduz erros aquando do alinhamento entre as imagens de MRI e CT, que serão propagados durante todo o procedimento. Por outro lado, o uso de radiação ionizante e os custos adicionais e tempo de aquisição associado à obtenção de múltiplas modalidades de imagem limitam a aplicação clínica destas práticas. Assim, o seguimento natural prende-se com a completa substituição do uso de CT por MRI. Desta forma, o desenvolvimento de um método para a obtenção de uma imagem equivalente a CT usando MRI é necessário, sendo a imagem resultante designada de pseudo-CT. Vários métodos foram desenvolvidos de forma a construir pseudo-CT, usando métodos baseados na anatomia do paciente ou em métodos de regressão entre CT e MRI. No entanto, no primeiro caso, erros significativos são frequentes devido ao difícil alinhamento entre as imagens em casos em que a geometria do paciente é muito diferente da presente no atlas. No segundo caso, a ausência de sinal no osso cortical em MRI, torna-o indistinguível do ar. Sequências que usam um tempo de eco muito curto são normalmente utilizadas para distinguir osso cortical de ar. No entanto, para áreas com maior dimensão, como a área pélvica, dificuldades relacionadas com o equipamento e com o ruído limitam a sua aplicação nestas áreas. Por outro lado, estes métodos utilizam frequentemente diferentes imagens de MRI de forma a obter diferentes contrastes, aumentando assim o tempo de aquisição das imagens. Nesta dissertação, é proposto um método para a obtenção de um pseudo-CT baseado na combinação de um algoritmo de decomposição de água e gordura e um modelo de regressão de mistura gaussiana para a região pélvica através da aquisição de sequências de MRI convencionais. Desta forma, a aquisição de diferentes contrastes é obtida por pós-processamento das imagens originais. Desta forma, uma imagem ponderada em T1 foi adquirida com 3 tempos de eco. Um algoritmo de decomposição do sinal de ressonância magnética em sinal proveniente de água e gordura foi utilizado, permitindo a obtenção de duas imagens, cada uma representando apenas o sinal da água e gordura, respectivamente. Usando estas duas imagens, uma imagem da fracção de gordura em cada voxel foi também calculada. Por outro lado, usando o primeiro e o terceiro eco foi possível calcular o decaimento de sinal devido a efeitos relacionados com o decaimento T2*. O método para gerar o pseudo-CT baseia- se num modelo de regressão duplo entre as variáveis relacionadas com MRI e CT. Assim, o primeiro modelo aplica-se aos tecidos moles, enquanto que o segundo modelo se aplica aos tecidos ósseos. A segmentação entre estes tecidos foi realizada através da delineação manual dos tecidos ósseos. No caso do modelo de regressão para os tecidos moles, o modelo consiste numa regressão polinomial entre as imagens da fracção de gordura e os valores de CT. A ordem do polinómio usada foi obtida pela minimização do erro absoluto médio. No caso do modelo de regressão para os tecidos ósseos, um modelo de regressão de mistura gaussiana foi aplicado usando as imagens de gordura, água, de fracção de gordura e de R2*. Estas variáveis foram selecionadas, uma vez que estudos prévios correlacionam esta com a densidade mineral óssea, que por sua vez está relacionada com as intensidades em CT. A influência de incluir no modelo de regressão informação acerca da vizinhança foi estudada através da inclusão de imagens do desvio padrão nos 27 voxéis na vizinhança das variáveis previamente incluídas no modelo. O número de componentes a usar no modelo de regressão de mistura gaussiana foi obtido através da minimização do critério de Akaike. O pseudo-CT final foi obtido pela sobreposição das imagens obtidas através do duplo modelo de regressão, seguido da aplicação de um filtro gaussiano com desvio padrão de 0.5 de forma a mitigar os erros na segmentação dos tecidos ósseos. Este método foi validado usando imagens da zona pélvica de 6 pacientes usando um procedimento leave-one-out-cross-validation (LOOCV). Durante este procedimento, o modelo foi estimado através das variáveis de 5 pacientes (imagens de treino) e aplicado às variáveis relacionadas com MRI do paciente restante (imagem de validação), de forma a gerar o pseudo-CT. Este procedimento foi repetido para todas as seis combinações de imagens de treino e de validação e os pseudo-CT obtidos foram comparados com a imagem TC correspondente. No caso do modelo para os tecidos moles, verificou-se que a utilização de um polinómio de segundo grau permitia a obtenção de melhores resultados. Da mesma forma, verificou-se que a inclusão de informação acerca da vizinhança permitia uma melhor estimativa dos valores de pseudo-CT no caso dos tecidos ósseos. A segmentação dos tecidos ósseos foi considerada adequada uma vez que o valor médio do coeficiente de Dice entre estes tecidos e o osso em CT foi de 0.91 ±0.02. O valor médio do erro absoluto entre o pseudo-CT e a correspondente CT para todos os pacientes foi de 37.76±3.11 HU, enquanto que no caso dos tecidos ósseos o valor foi de 96.61±10.49 HU. Um erro médio de -2.68 ± 6.32 HU foi obtido, denotando a presença de bias no processo. Por outro lado, valores médios de peak-to-signal-noise-ratio (PSNR) e strucutre similarity índex (SSIM) de 23.92±1.62 dB e 0.91±0.01 foram obtidos, respectivamente. Os maiores erros foram encontrados no recto, uma vez que o ar não foi considerado neste método, nas interfaces entre diferentes tecidos, devido a erros no alinhamento das imagens, e nos tecidos ósseos. Desta forma, o método de obtenção de um pseudo-CT proposto nesta dissertação demonstrou ter potencial para permitir uma correcta estimativa da intensidade em CT. Os resultados obtidos demonstram uma melhoria significativa quando comparados com outros métodos encontrados na literatura que se baseiam num método relacionado com a intensidade, enquanto que se encontram na mesma ordem de magnitude de métodos baseados na anatomia do paciente. Para além disso, quando comparados com os primeiros, este método tem a vantagem de apenas uma sequência MRI ser utilizada, levando a uma redução no tempo de aquisição e nos custos associados. Por outro lado, a principal limitação deste método prende-se com a segmentação manual dos tecidos ósseos, o que dificulta a sua implementação clínica. Desta forma, o desenvolvimento de técnicas de segmentação automáticas dos tecidos ósseos torna-se necessária, sendo exemplos destas técnicas a criação de um shape model ou através da segmentação baseada num atlas. A combinação destes métodos com o método descrito nesta dissertação pode permitir a obtenção de uma alternativa às imagens de CT para o cálculo das doses em radioterapia e correcção de atenuação em PET-MRI.Purpose: Methods for deriving computed tomography (CT) equivalent information from MRI are needed for attenuation correction in PET-MRI applications, as well as for dose planning in MRI based radiation therapy workflows, due to the lack of correlation between the MR signal and the electron density of different tissues. This dissertation presents a method to generate a pseudo-CT from MR images acquired with a conventional MR pulse sequence. Methods: A T1-weighted Fast Field Echo sequence with 3 echo times was used. A 3-point water-fat decomposition algorithm was applied to the original MR images to obtain water and fat-only images as well as a quantitative fat fraction image. A R2* image was calculated using a mono-exponential fit between the first and third echo of the original MR images. The method for generating the pseudo-CT includes a dual-model regression between the MR features and a matched CT image. The first model was applied to soft tissues, while the second-model was applied to the bone anatomy that were previously segmented. The soft-tissue regression model consists of a second-order polynomial regression between the fat fraction values in soft tissue and the HU values in the CT image, while the bone regression model consists of a Gaussian mixture regression including the water, fat, fat fraction and R2* values in bone tissues. Neighbourhood information was also included in the bone regression model by calculating an image of the standard deviation of 27-neighbourhood of each voxel in each MR related feature. The final pseudo-CT was generated by combining the pseudo-CTs from both models followed by the application of a Gaussian filter for additional smoothing. This method was validated using datasets covering the pelvic area of six patients and applying a leave-one-out-cross-validation (LOOCV) procedure. During LOOCV, the model was estimated from the MR related features and the CT data of 5 patients (training set) and applied to the MR features of the remaining patient (validation set) to generate a pseudo-CT image. This procedure was repeated for the all six training and validation data combinations and the pseudo-CTs were compared to the corresponding CT image. Results: The average mean absolute error for the HU values in the body for all patients was 37.76±3.11 HU, while the average mean absolute error in the bone anatomy was 96.61±10.49 HU. No large differences in method accuracy were noted for the different patients, except for the air in the rectum which was classified as soft tissue. The largest errors were found in the rectum and in the interfaces between different tissue types. Conclusions: The pseudo-CT generation method here proposed has the potential to provide an accurate estimation of HU values. The results here reported are substantially better than other voxel-based methods proposed. However, they are in the same range as the results presented in anatomy-based methods. Further investigation in automatic MRI bone segmentation methods is necessary to allow the automatic application of this method into clinical practice. The combination of these automatic bone segmentation methods with the model here reported is expected to provide an alternative to CT images for dose planning in radiotherapy and attenuation correction in PET-MRI

The relationship between radiomics and pathomics in Glioblastoma patients: Preliminary results from a cross-scale association study

: Glioblastoma multiforme (GBM) typically exhibits substantial intratumoral heterogeneity at both microscopic and radiological resolution scales. Diffusion Weighted Imaging (DWI) and dynamic contrast-enhanced (DCE) magnetic resonance imaging (MRI) are two functional MRI techniques that are commonly employed in clinic for the assessment of GBM tumor characteristics. This work presents initial results aiming at determining if radiomics features extracted from preoperative ADC maps and post-contrast T1 (T1C) images are associated with pathomic features arising from H&E digitized pathology images. 48 patients from the public available CPTAC-GBM database, for which both radiology and pathology images were available, were involved in the study. 91 radiomics features were extracted from ADC maps and post-contrast T1 images using PyRadiomics. 65 pathomic features were extracted from cell detection measurements from H&E images. Moreover, 91 features were extracted from cell density maps of H&E images at four different resolutions. Radiopathomic associations were evaluated by means of Spearman's correlation (ρ) and factor analysis. p values were adjusted for multiple correlations by using a false discovery rate adjustment. Significant cross-scale associations were identified between pathomics and ADC, both considering features (n = 186, 0.45 < ρ < 0.74 in absolute value) and factors (n = 5, 0.48 < ρ < 0.54 in absolute value). Significant but fewer ρ values were found concerning the association between pathomics and radiomics features (n = 53, 0.5 < ρ < 0.65 in absolute value) and factors (n = 2, ρ = 0.63 and ρ = 0.53 in absolute value). The results of this study suggest that cross-scale associations may exist between digital pathology and ADC and T1C imaging. This can be useful not only to improve the knowledge concerning GBM intratumoral heterogeneity, but also to strengthen the role of radiomics approach and its validation in clinical practice as "virtual biopsy", introducing new insights for omics integration toward a personalized medicine approach