Multi-Modality Generative Adversarial Networks with Tumor Consistency Loss for Brain MR Image Synthesis

Magnetic Resonance (MR) images of different modalities can provide complementary information for clinical diagnosis, but whole modalities are often costly to access. Most existing methods only focus on synthesizing missing images between two modalities, which limits their robustness and efficiency when multiple modalities are missing. To address this problem, we propose a multi-modality generative adversarial network (MGAN) to synthesize three high-quality MR modalities (FLAIR, T1 and T1ce) from one MR modality T2 simultaneously. The experimental results show that the quality of the synthesized images by our proposed methods is better than the one synthesized by the baseline model, pix2pix. Besides, for MR brain image synthesis, it is important to preserve the critical tumor information in the generated modalities, so we further introduce a multi-modality tumor consistency loss to MGAN, called TC-MGAN. We use the synthesized modalities by TC-MGAN to boost the tumor segmentation accuracy, and the results demonstrate its effectiveness.Comment: 5 pages, 3 figures, accepted to IEEE ISBI 202

Novel and Simple Ultrasonographic Methods for Estimating the Abdominal Visceral Fat Area

Objectives. To evaluate the abdominal visceral fat area (VFA), we developed novel ultrasonographic (US) methods for estimating. Methods. 100 male volunteers were recruited, and their VFA was calculated by two novel US methods, the triangle method and the ellipse method. The VFA calculated by these methods was compared with the VFA calculated by CT. Results. Both the VFA calculated by the triangle method (r=0.766, p<0.001) and the ellipse method (r=0.781, p<0.001) showed a high correlation coefficient with the VFA calculated by CT. Also, the VFA calculated by our novel methods were significantly increased in subjects with one or more metabolic risk factors than in those without any risk factors. Furthermore, the correlation coefficients obtained using the two methods were enhanced by the addition of multiple regression analysis (with the triangle method, r=0.8586, p<0.001; with the ellipse method, r=0.8642, p<0.001). Conclusions. The VFA calculated by the triangle or ellipse method showed a high correlation coefficient with the VFA calculated by CT. These US methods are easy to use, they involve no radiation exposure, and the measurements can be conducted frequently. We hope that our simple methods would be widely adopted for the evaluation of VFA

Roadmap on 3D integral imaging: Sensing, processing, and display

This Roadmap article on three-dimensional integral imaging provides an overview of some of the research activities in the field of integral imaging. The article discusses various aspects of the field including sensing of 3D scenes, processing of captured information, and 3D display and visualization of information. The paper consists of a series of 15 sections from the experts presenting various aspects of the field on sensing, processing, displays, augmented reality, microscopy, object recognition, and other applications. Each section represents the vision of its author to describe the progress, potential, vision, and challenging issues in this field

Ultrasound Navigation for Transcatheter Aortic Stent Deployment Using Global and Local Information

An ultrasound (US) navigation system using global and local information is presented for transcatheter aortic stent deployment. The system avoids the use of contrast agents and radiation required in traditional fluoroscopically-guided procedures and helps surgeons precisely visualize the surgical site. To obtain a global 3D (three-dimensional) navigation map, we use magnetic resonance (MR) to provide a 3D context to enhance 2D (two-dimensional) US images through image registration. The US images are further processed to obtain the trajectory of interventional catheter. A high-resolution aortic model is constructed by using trajectory and segmented intravascular ultrasound (IVUS) images. The constructed model reflects morphological characteristics of the aorta to provide local navigation information. Our navigation system was validated using in vitro phantom of heart and aorta. The mean target registration error is 2.70 mm and the average tracking error of the multi-feature particle filter is 0.87 mm. These results confirm that key parts of our navigation system are effective. In the catheter intervention experiment, the vessel reconstruction error of local navigation is reduced by 80% compared to global navigation. Moreover, the targeting error of the navigation combining global and local information is reduced compared to global navigation alone (1.72 mm versus 2.87 mm). Thus, the US navigation system which integrates the large view of global navigation and high accuracy of local navigation can facilitate transcatheter stent deployment

Computer Aided Surgery7th Asian Conference on Computer Aided Surgery, Bangkok, Thailand, August 2011, Proceedings /

XII, 155p. 121 illus.online resource