A generalized framework unifying image registration and respiratory motion models and incorporating image reconstruction, for partial image data or full images

Surrogate-driven respiratory motion models relate the motion of the internal anatomy to easily acquired respiratory surrogate signals, such as the motion of the skin surface. They are usually built by first using image registration to determine the motion from a number of dynamic images, and then fitting a correspondence model relating the motion to the surrogate signals. In this paper we present a generalized framework that unifies the image registration and correspondence model fitting into a single optimization. This allows the use of 'partial' imaging data, such as individual slices, projections, or k-space data, where it would not be possible to determine the motion from an individual frame of data. Motion compensated image reconstruction can also be incorporated using an iterative approach, so that both the motion and a motion-free image can be estimated from the partial image data. The framework has been applied to real 4DCT, Cine CT, multi-slice CT, and multi-slice MR data, as well as simulated datasets from a computer phantom. This includes the use of a super-resolution reconstruction method for the multi-slice MR data. Good results were obtained for all datasets, including quantitative results for the 4DCT and phantom datasets where the ground truth motion was known or could be estimated

Feasibility of 3D tracking and adaptation of VMAT based on VMAT-CT

Background: Local computed tomography (CT) reconstruction is achievable with portal images acquired during volumetric-modulated arc therapy (VMAT) delivery and was named as VMAT-CT. However, the application of VMAT-CT is limited because it has limited field of view and no density information. In addition, the new generation of multi-leaf collimator with faster speed and various collimator angles used in patients’ plans could cause more artifacts in VMAT-CT. The goal of this study was to extend VMAT-CT concept, generate complete three-dimensional (3D) CT images, calculate new 3D dose, track and adapt VMAT plan based on updated images and dose. Materials and methods: VMAT-CT and planning CT of phantoms were fused by rigid or deformable registration to create VMAT-CT+ images. Trackings based on planning CT, VMAT-CT+, and cone beam CT (CBCT) were compared. When prescription dose was not met for planning target volume (PTV), re-planning was demonstrated on an in-house deformable phantom. Possible uncertainties were also evaluated. Results: Tracking based on VMAT-CT+ was accurate and superior to those based on planning CT and CBCT since VMAT-CT+ can detect changes during treatment. PTV coverage in the deformable phantom decreased after deformations but went up and met the prescription goal after re-planning. The impact of uncertainties on dose was minimal. Conclusion: 3D tracking and adaptation of VMAT based on VMAT-CT are feasible. Our study has the potential to increase the confidence of beam delivery, catch and remedy errors during VMAT

Iterative Sorting for 4DCT Images Based ON Internal Anatomy Motion

Geometric uncertainties caused by respiratory motion complicate radiotherapy treatment planning. Therefore 4D CT imaging is important in characterizing anatomy motion during breathing. Current 4D CT imaging techniques using multislice CT scanners involve multiple scans at several axial positions and retrospective sorting processes. Most sorting methods are based on externally monitored signals recorded by external monitoring instruments, which may not always accurately catch the actual breathing status and may lead to severe discontinuity artifacts in the sorted CT volumes. We propose a method to reconstruct time-resolved CT volumes based on internal motion to avoid the inaccuracies caused by external breathing signals. In our method, we iteratively sort the 4D CT slices using internal motion based breathing indices. In each iteration, respiratory motion is estimated by updating a motion model to best match a deformed reference volume to each moving multi-slice sub-volumes. The breathing indices as well as the reference volumes are refined for each iteration based on the currently estimated respiratory motion. An example is presented to illustrate the feasibility of our 4D CT sorting method without using any external motion monitoring systems.Peer Reviewedhttp://deepblue.lib.umich.edu/bitstream/2027.42/85803/1/Fessler229.pd

Dynamic Cone-beam CT Reconstruction using Spatial and Temporal Implicit Neural Representation Learning (STINR)

Objective: Dynamic cone-beam CT (CBCT) imaging is highly desired in image-guided radiation therapy to provide volumetric images with high spatial and temporal resolutions to enable applications including tumor motion tracking/prediction and intra-delivery dose calculation/accumulation. However, the dynamic CBCT reconstruction is a substantially challenging spatiotemporal inverse problem, due to the extremely limited projection sample available for each CBCT reconstruction (one projection for one CBCT volume). Approach: We developed a simultaneous spatial and temporal implicit neural representation (STINR) method for dynamic CBCT reconstruction. STINR mapped the unknown image and the evolution of its motion into spatial and temporal multi-layer perceptrons (MLPs), and iteratively optimized the neuron weighting of the MLPs via acquired projections to represent the dynamic CBCT series. In addition to the MLPs, we also introduced prior knowledge, in form of principal component analysis (PCA)-based patient-specific motion models, to reduce the complexity of the temporal INRs to address the ill-conditioned dynamic CBCT reconstruction problem. We used the extended cardiac torso (XCAT) phantom to simulate different lung motion/anatomy scenarios to evaluate STINR. The scenarios contain motion variations including motion baseline shifts, motion amplitude/frequency variations, and motion non-periodicity. The scenarios also contain inter-scan anatomical variations including tumor shrinkage and tumor position change. Main results: STINR shows consistently higher image reconstruction and motion tracking accuracy than a traditional PCA-based method and a polynomial-fitting based neural representation method. STINR tracks the lung tumor to an averaged center-of-mass error of <2 mm, with corresponding relative errors of reconstructed dynamic CBCTs <10%

In-house Implementation and Validation of the Mid-Position CT approach for the Treatment Planning of Respiration-induced Moving Tumours in Radiotherapy for Lung and Upper abdomen cancer

Tese mestrado integrado, Engenharia Biomédica e Biofísica (Engenharia Clínica e Instrumentação Médica) Universidade de Lisboa, Faculdade de Ciências, 2022A Radioterapia é uma das modalidades principais para tratamentos de foro oncológico que visa destruir a ação proliferativa das células cancerígenas e reduzir o volume tumoral. A sua ação terapêutica através do uso de radiação ionizante tem, subjacente, a máxima de irradiar o tumor com uma elevada dose, ao mesmo tempo que os órgãos de risco (OARs) adjacentes, são tanto quanto possível protegidos. Quando um tumor se localiza no pulmão ou abdómen superior, como no fígado ou pâncreas, o seu movimento devido à respiração pode alcançar até 4 cm, especialmente na direção crânio-caudal, aumentando as incertezas relativas à posição do tumor. No Centro Clínico Champalimaud (CCC), o planeamento convencional dos tratamentos de radioterapia faz uso de uma tomografia computadorizada (CT) que é adquirida aquando da respiração livre do doente e que, por isso, apresenta geralmente artefactos que podem ser uma fonte de erro durante o planeamento. Nos casos em que o movimento do tumor é considerável, é ainda adquirida uma tomografia computadorizada quadrimensional (4DCT) que consiste entre 8 e 10 CTs que representam fases do ciclo respiratório. Posteriormente, a 4DCT é utilizada para delinear o volume interno do alvo (ITV) que engloba toda a extensão do movimento do tumor. Apesar da estratégia do ITV garantir uma adequada cobertura do volume-alvo, os OARs ficam expostos a doses de radiação desnecessárias e a um maior risco de toxicidade. Este efeito é ainda mais preocupante em tratamentos hipofracionados, onde doses mais elevadas são administradas num número reduzido de frações. Nos últimos anos têm sido desenvolvidas estratégias que visam tornar os tratamentos de radioterapia mais eficazes. Uma delas é a reconstrução de uma CT que representa a posição média do doente ao longo do ciclo respiratório (Mid-P CT). Esta estratégia resulta em volumes de tratamento menores do que a estratégia do ITV, possibilitando o aumento da dose e maior controlo tumoral local. O primeiro passo para a reconstrução do Mid-P CT é o registo deformável de imagens (DIR) entre uma das fases da respiração (uma CT da 4DCT), definida como a fase de referência, e as restantes fases. Deste processo resultam campos vetoriais deformáveis (DVF) que contém informação do deslocamento dos tecidos. Os DVFs são subsequentemente utilizados para transformar cada uma das fases da respiração para a posição média. O método do Mid-P foi implementado com sucesso no Instituto do Cancro Holandês (NKI) em 2008. Apesar dos bons resultados clínicos, o número de centros de radioterapia que utiliza esta técnica é muito reduzido. Tal deve-se, por um lado, à inexistência de soluções comerciais com esta funcionalidade e, por outro, ao esforço necessário alocar para implementar e validar soluções desenvolvidas internamente. O presente projeto teve como principal objetivo implementar a estratégia do Mid-P no CCC (Portugal). Para tal, foi otimizado um módulo – RunMidP – desenvolvido para o software 3D Slicer, que calcula o Mid-P CT e estima a amplitude do movimento do tumor e OARs com base nos DVFs. Considerando que a precisão do módulo e a qualidade de imagem do Mid-P CT devem atender os requisitos para o planeamento em radioterapia, foram realizados testes para validar o módulo. Sempre que possível, a sua performance foi comparada com outras aplicações desenvolvidas para a implementação da técnica do Mid-P, nomeadamente com um protótipo desenvolvido pela empresa Mirada Medical Ltd. (Reino Unido) – Mirada – e com o software desenvolvido no NKI (Holanda) – Wimp. Os testes foram divididos em três estudos diferentes, cada um com um conjunto de dados diferente. No primeiro estudo (estudo A), foram utilizadas 4DCT de 2 fantomas digitais, cuja função respiratória e cardíaca foi modelada de forma simplificada, e de 18 doentes com tumores localizados no pulmão (N = 8), no fígado (N = 6) e no pâncreas (N = 4). Neste estudo, foram comparados dois algoritmos DIR disponíveis no software 3D Slicer, o Plastimatch e o Elastix, em termos da precisão do registo e da qualidade de imagem do Mid-P CT reconstruído. Foi ainda avaliado a capacidade dos softwares RunMidP e Mirada representarem corretamente a posição média do doente e as diferenças das amplitudes do movimento do tumor estimadas pelos dois softwares. No estudo B, foram realizados testes de verificação semelhantes aos supre mencionados, em imagens sintéticas provenientes de 16 doentes, desta vez com a vantagem de se conhecer o “verdadeiro” Mid-P CT e as “verdadeiras” amplitudes do movimento do tumor. Estes foram comparados com os resultados obtidos com os softwares RunMidP e Mirada. Ainda, as unidades de Hounsfield (HU) no Mid-P CT reconstruído por RunMidP e Mirada foram comparadas com as HU na fase de referência, de modo a verificar se os Mid P CTs produziriam diferenças dosimétricas relevantes. No último estudo (estudo C), a qualidade de imagem do Mid-P CT foi avaliada quantitativamente e qualitativamente. Durante a análise qualitativa, foi pedido a dois médicos especialistas que avaliassem a viabilidade dos Mid-P CTs, reconstruídos pelos três softwares (RunMidP, Mirada e Wimp), para o planeamento dos tratamentos. O tempo da reconstrução do Mid-P CT a partir da 4DCT foi de cerca de 1h. Ambos os algoritmos, Plastimach e Elastix, demonstraram ser adequados para DIR de imagens do pulmão e abdómen superior, com diferenças estatisticamente não significativas (p > 0.05) em termos da precisão do registo. Contudo, o Mid-P CT reconstruído com Elastix apresentou uma melhoria na qualidade de imagem, sendo assim o algoritmo DIR escolhido para ser implementado no RunMidP. Em termos de métricas aplicadas a contornos definidos manualmente, tais como a distância de Hausdorf (HD) e coeficiente de Dice (DSC), o erro do registo de imagem foi menor que 1 mm, dentro do contorno do tumor, e 2 mm no pulmão. Os Mid-P CTs reconstruídos com o RunMidP e Mirada apresentaram maiores diferenças, relativamente ao “verdadeiro” Mid-P CT, na região do diafragma e zonas de maior homogeneidade como, por exemplo, no ar presente no intestino. Contudo, para a maioria dos doentes do estudo B, o Mid-P CT reconstruído com o software Mirada apresentou maior índice de similaridade estrutural (SSIM) relativamente ao “verdadeiro” Mid-P CT. Estes resultados podem estar na origem do uso de diferentes algoritmos DIR, mas deveram-se principalmente a uma falha na aplicação das transformações deformáveis pelo módulo RunMiP que foi corrigida posteriormente. Ainda, as diferenças entre as amplitudes estimadas e previstas foram menores que 1 mm para 37 tumores (78,9%), que resultam em diferenças menores que 0.3mm quando convertidas em margens de planeamento. Para além disso, as diferenças nos valores de HU dos Mid-P CTs comparativamente à fase de referência foram, em média, de 1 HU no tumor e OARs. Foram também observadas melhorias na qualidade de imagem do Mid-P CT, nomeadamente um aumento da relação sinal-ruído (SNR) e diminuição dos artefactos. Estes resultados estão de acordo com a avaliação dos médicos que, em geral, consideraram que os Mid-P CTs reconstruídos pelos três softwares são adequados para o planeamento dos tratamentos. No entanto, os Mid-P CTs reconstruídos com dados 4DCT provenientes do CCC apresentaram classificações inferiores aos reconstruídos com dados 4DCT do NKI. Em suma, as modificações do algoritmo DIR Plastimach para Elastix e a correção do método para aplicar as transformações deformáveis, permitiram uma melhoria na qualidade de imagem do Mid P CT e melhor performance do algoritmo, respetivamente. O módulo RunMidP, neste projeto otimizado e validado, apresenta um forte potencial para a reconstrução e implementação da estratégia do Mid-P na clínica, com performance comparável a outras aplicações existentes (Mirada e Wimp). Atenção especial deve ser dada aos dados 4DCT de input que parecem afetar a qualidade de imagem final do Mid-P CT. No futuro, valerá a pena otimizar os parâmetros de aquisição e reconstrução da 4DCT de modo a melhorar a qualidade de imagem e, ainda, o módulo RunMidP pode potencialmente ser otimizado no que respeita ao tempo de reconstrução do Mid-P CT e à precisão do DIR.Radiotherapy for tumours in the thorax and upper abdomen is challenging since they move notably with breathing. To cover the whole extent of tumour motion, relatively large margins are added to treatment volumes, posing a higher risk of toxicity for surrounding organs-at-risk (OARs). The Mid Position (Mid-P) method accounts for breathing motion by using deformable image registration (DIR) to transform all phases of a 4DCT scan to a time-weighted average 3DCT scan (Mid-P CT). The Mid-P strategy results in smaller treatment volumes, potentially boosting the delivery of hypofractionated treatments. To bring the Mid-P approach to the Champalimaud Clinical Centre (CCC), an in-house Mid position software module – RunMidP – was optimized. The module reconstructs the Mid-P CT and estimates breathing motion amplitudes of tumours and relevant OARs. In addition, this project presents a set of experiments to evaluate the performance of the Mid-P method and its feasibility for clinical implementation. The experiments were conducted throughout three different studies using 4DCT data from 18 phantoms and 23 patients. In Study A, the accuracy and image quality of two DIR algorithms (Plastimatch and Elastix) were assessed using quantitative metrics applied on either warped images or manually delineated contours. The reproduction of the patient’s mean position by the Mid-P CT and the estimation of motion amplitudes were compared to a soon-to-be Mid-P commercial software developed by Mirada Medical Ltd. In Study B,similar experiments were performed, this time using a more rigorous reference – “true” Mid-P CT scans and “true” motion estimations. In Study C, the image quality of Mid P CT scans was assessed quantitatively and qualitatively. Both Plastimatch and Elastix registration showed comparable registration accuracy, although Elastix showed superior image quality of reconstructed Mid-P CTs. Based on contour metrics, the registration error was less than 2 mm. In-house Mid-P CTs showed a slightly lower match to ground truth Mid-P CTs than the ones reconstructed by the Mirada prototype due to differences in DIR methods and small shifts to the original image geometry. Higher image differences were found in the diaphragm lung interface, where the patient's anatomy moves faster due to breathing, and in homogeneous regions such as the air regions in the bowel. On the other hand, differences (estimated-predicted) in motion amplitudes smaller than 1 mm were observed in 37 moving tumours (78.7%), showing a good performance of the Mid-P algorithm. Regarding the image quality, improvements in the signal-to-noise ratio and removal of image artefacts in Mid-P CTs are great advantages for using them as the planning CT. Clinicians also gave a good assessment of the suitability of Mid-P CT scans for treatment planning. No significant differences were found in the performance of the RunMidP compared to other Mid-Position packages, although worse scores were given to the CCC dataset than the dataset from another hospital. The in-house Mid-position algorithm shows promising results regarding the use of the software module in radiotherapy for lung and upper abdomen cancer. Further exploration must be given to improve the registration accuracy, image quality of the input data, and speed up the reconstruction of the Mid-P CT scan

Technical note: Towards more realistic 4DCT(MRI) numerical lung phantoms.

BACKGROUND Numerical 4D phantoms, together with associated ground truth motion, offer a flexible and comprehensive data set for realistic simulations in radiotherapy and radiology in target sites affected by respiratory motion. PURPOSE We present an openly available upgrade to previously reported methods for generating realistic 4DCT lung numerical phantoms, which now incorporate respiratory ribcage motion and improved lung density representation throughout the breathing cycle. METHODS Density information of reference CTs, toget her with motion from multiple breathing cycle 4DMRIs have been combined to generate synthetic 4DCTs (4DCT(MRI)s). Inter-subject correspondence between the CT and MRI anatomy was first established via deformable image registration (DIR) of binary masks of the lungs and ribcage. Ribcage and lung motions were extracted independently from the 4DMRIs using DIR and applied to the corresponding locations in the CT after post-processing to preserve sliding organ motion. In addition, based on the Jacobian determinant of the resulting deformation vector fields, lung densities were scaled on a voxel-wise basis to more accurately represent changes in local lung density. For validating this process, synthetic 4DCTs, referred to as 4DCT(CT)s, were compared to the originating 4DCTs using motion extracted from the latter, and the dosimetric impact of the new features of ribcage motion and density correction were analyzed using pencil beam scanned proton 4D dose calculations. RESULTS Lung density scaling led to a reduction of maximum mean lung Hounsfield units (HU) differences from 45 to 12 HU when comparing simulated 4DCT(CT)s to their originating 4DCTs. Comparing 4D dose distributions calculated on the enhanced 4DCT(CT)s to those on the original 4DCTs yielded 2%/2 mm gamma pass rates above 97% with an average improvement of 1.4% compared to previously reported phantoms. CONCLUSIONS A previously reported 4DCT(MRI) workflow has been successfully improved and the resulting numerical phantoms exhibit more accurate lung density representations and realistic ribcage motion