A novel WebVR-Based lightweight framework for virtual visualization of blood vasculum

With the arrival of the Web 2.0 era and the rapid development of virtual reality (VR) technology in recent years, WebVR technology has emerged as the combination of Web 2.0 and VR. Moreover, the concept of “WebVR + medical science”is also proposed to advance medical applications. However, due to the limited storage space and low computing capability of Web browsers, it is difficult to achieve real-time rendering of large-scale medical vascular models on the Web, let alone large-scale vascular animation simulations. The framework proposed in this paper can achieve virtual display of the medical blood vasculum, including lightweight processing of the vasculum and virtual realization of blood flow. This innovative framework presents a simulation algorithm for the virtual blood path based on the Catmull-Rom spline. The mechanisms of progressive compression and online recovery of the lightweight vascular structure are further proposed. The experimental results show that our framework has a shorter browser-side response time than existing methods and achieves efficient real-time simulation

A new framework for the integrative analytics of intravascular ultrasound and optical coherence tomography images

Abstract:The integrative analysis of multimodal medical images plays an important role in the diagnosis of coronary artery disease by providing additional comprehensive information that cannot be found in an individual source image. Intravascular ultrasound (IVUS) and optical coherence tomography (IV-OCT) are two imaging modalities that have been widely used in the medical practice for the assessment of arterial health and the detection of vascular lumen lesions. IV-OCT has a high resolution and poor penetration, while IVUS has a low resolution and high detection depth. This paper proposes a new approach for the fusion of intravascular ultrasound and optical coherence tomography pullbacks to significantly improve the use of those two types of medical images. It also presents a new two-phase multimodal fusion framework using a coarse-to-fine registration and a wavelet fusion method. In the coarse-registration process, we define a set of new feature points to match the IVUS image and IV-OCT image. Then, the improved quality image is obtained based on the integration of the mutual information of two types of images. Finally, the matched registered images are fused with an approach based on the new proposed wavelet algorithm. The experimental results demonstrate the performance of the proposed new approach for significantly enhancing both the precision and computational stability. The proposed approach is shown to be promising for providing additional information to enhance the diagnosis and enable a deeper understanding of atherosclerosis

A hybrid active contour segmentation method for myocardial D-SPECT images

Ischaemic heart disease has become one of the leading causes of mortality worldwide. Dynamic single-photon emission computed tomography (D-SPECT) is an advanced routine diagnostic tool commonly used to validate myocardial function in patients suffering from various heart diseases. Accurate automatic localization and segmentation of myocardial regions is helpful in creating a three-dimensional myocardial model and assisting clinicians to perform assessments of myocardial function. Thus, image segmentation is a key technology in preclinical cardiac studies. Intensity inhomogeneity is one of the common challenges in image segmentation and is caused by image artefacts and instrument inaccuracy. In this paper, a novel region-based active contour model that can segment the myocardial D-SPECT image accurately is presented. First, a local region-based fitting image is defined based on information related to the intensity. Second, a likelihood fitting image energy function is built in a local region around each point in a given vector-valued image. Next, the level set method is used to present a global energy function with respect to the neighbourhood centre. The proposed approach guarantees precision and computational efficiency by combining the region-scalable fitting energy (RSF) model and local image fitting energy (LIF) model, and it can solve the issue of high sensitivity to initialization for myocardial D-SPECT segmentation

A New Dynamic Path Planning Approach for Unmanned Aerial Vehicles

Dynamic path planning is one of the key procedures for unmanned aerial vehicles (UAV) to successfully fulfill the diversified missions. In this paper, we propose a new algorithm for path planning based on ant colony optimization (ACO) and artificial potential field. In the proposed algorithm, both dynamic threats and static obstacles are taken into account to generate an artificial field representing the environment for collision free path planning. To enhance the path searching efficiency, a coordinate transformation is applied to move the origin of the map to the starting point of the path and in line with the source-destination direction. Cost functions are established to represent the dynamically changing threats, and the cost value is considered as a scalar value of mobile threats which are vectors actually. In the process of searching for an optimal moving direction for UAV, the cost values of path, mobile threats, and total cost are optimized using ant optimization algorithm. The experimental results demonstrated the performance of the new proposed algorithm, which showed that a smoother planning path with the lowest cost for UAVs can be obtained through our algorithm. (PDF) A New Dynamic Path Planning Approach for Unmanned Aerial Vehicles. Available from: https://www.researchgate.net/publication/328765418_A_New_Dynamic_Path_Planning_Approach_for_Unmanned_Aerial_Vehicles [accessed Nov 20 2018]

A new pulse coupled neural network (PCNN) for brain medical image fusion empowered by shuffled frog leaping algorithm

Recent research has reported the application of image fusion technologies in medical images in a wide range of aspects, such as in the diagnosis of brain diseases, the detection of glioma and the diagnosis of Alzheimer’s disease. In our study, a new fusion method based on the combination of the shuffled frog leaping algorithm (SFLA) and the pulse coupled neural network (PCNN) is proposed for the fusion of SPECT and CT images to improve the quality of fused brain images. First, the intensity-hue-saturation (IHS) of a SPECT and CT image are decomposed using a non-subsampled contourlet transform (NSCT) independently, where both low-frequency and high-frequency images, using NSCT, are obtained. We then used the combined SFLA and PCNN to fuse the high-frequency sub-band images and low-frequency images. The SFLA is considered to optimize the PCNN network parameters. Finally, the fused image was produced from the reversed NSCT and reversed IHS transforms. We evaluated our algorithms against standard deviation (SD), mean gradient (Ḡ), spatial frequency (SF) and information entropy (E) using three different sets of brain images. The experimental results demonstrated the superior performance of the proposed fusion method to enhance both precision and spatial resolution significantly

Lumen contour segmentation in ivoct based on n-type cnn

Automatic segmentation of lumen contour plays an important role in medical imaging and diagnosis, which is the first step towards the evaluation of morphology of vessels under analysis and the identification of possible atherosclerotic lesions. Meanwhile, quantitative information can only be obtained with segmentation, contributing to the appearance of novel methods which can be successfully applied to intravascular optical coherence tomography (IVOCT) images. This paper proposed a new end-to-end neural network (N-Net) for the automatic lumen segmentation, using multi-scale features based deep neural network, for IVOCT images. The architecture of the N-Net contains a multi-scale input layer, a N-type convolution network layer and a cross-entropy loss function. The multi-scale input layer in the proposed N-Net is designed to avoid the loss of information caused by pooling in traditional U-Net and also enriches the detailed information in each layer. The N-type convolutional network is proposed as the framework in the whole deep architecture. Finally, the loss function guarantees the degree of fidelity between the output of proposed method and the manually labeled output. In order to enlarge the training set, data augmentation is also introduced. We evaluated our method against loss, accuracy, recall, dice similarity coefficient, jaccard similarity coefficient and specificity. The experimental results presented in this paper demonstrate the superior performance of the proposed N-Net architecture, comparing to some existing networks, for enhancing the precision of automatic lumen segmentation and increasing the detailed information of edges of the vascular lumen

An IoT-Based Framework of Webvr Visualization for Medical Big Data in Connected Health

Recently, telemedicine has been widely applied in remote diagnosis, treatment and counseling, where the Internet of Things (IoT) technology plays an important role. In the process of telemedicine, data are collected from remote medical equipment, such as CT machine and MRI machine, and then transmitted and reconstructed locally in three-dimensions. Due to the large amount of data to be transmitted in the reconstructed model and the small storage capacity, data need to be compressed progressively before transmission. On this basis, we proposed a lightweight progressive transmission algorithm based on large data visualization in telemedicine to improve transmission efficiency and achieve lossless transmission of original data. Moreover, a novel four-layer system architecture based on IoT has been introduced, including the sensing layer, analysis layer, network layer and application layer. In this way, the three-dimensional reconstructed data at the local end is compressed and transmitted to the remote end, and then visualized at the remote end to show reconstructed 3D models. Thus, it is conducive to doctors in remote real-time diagnosis and treatment, and then realize the data processing and transmission between doctors, patients and medical equipment

A nine months follow-up study of hemodynamic effect on bioabsorbable coronary stent implantation

Coronary artery disease has emerged as one of the major diseases causing death worldwide. Coronary stent has great effect to improve blood flow to the myocardium subtended by that artery, in which bioresorbable vascular scaffolds are new-generation stents used by people. However, Coronary stents implantation has a risk of restenosis, which is relative to hemodynamic parameters. Most of existing literatures studied in this issue have not taken into account such important factors as the strut thickness and lumen profile, and has yet to analyze the time effects among hemodynamic parameters over a certain period of time based on individual models. In this research, we proposed a framework to assess the chronic impact of hemodynamic on coronary stent implantation. In the framework, the optical coherence tomography (OCT) is combined with angiography to reconstruct patient-specific models of bioresorbable vascular scaffolds. Then, the hemodynamics parameters are extracted through the simulated 3D models, obtaining the distribution of wall shear stress (WSS), relative residence time (RRT) and oscillatory shear index (OSI). Finally, the changes of these parameters representing the effectiveness of hemodynamics exerted on the implanted stent can be assessed to estimate the chronic impacts. By a 9-month follow-up case study, it is observed that the difference of hemodynamic parameters are not significance. Both at baseline and 9-month follow-up experiments show that the hemodynamic parameters remain normal and similar, proving that the coronary stent implantation nowadays appears to have a robust and everlasting curative effect

A clustering based transfer function for volume rendering using gray-gradient mode histogram

Volume rendering is an emerging technique widely used in the medical field to visualize human organs using tomography image slices. In volume rendering, sliced medical images are transformed into attributes, such as color and opacity through transfer function. Thus, the design of the transfer function directly affects the result of medical images visualization. A well-designed transfer function can improve both the image quality and visualization speed. In one of our previous paper, we designed a multi-dimensional transfer function based on region growth to determine the transparency of a voxel, where both gray threshold and gray change threshold are used to calculate the transparency. In this paper, a new approach of the transfer function is proposed based on clustering analysis of gray-gradient mode histogram, where volume data is represented in a two-dimensional histogram. Clustering analysis is carried out based on the spatial information of volume data in the histogram, and the transfer function is automatically generated by means of clustering analysis of the spatial information. The dataset of human thoracic is used in our experiment to evaluate the performance of volume rendering using the proposed transfer function. By comparing with the original transfer function implemented in two popularly used volume rendering systems, visualization toolkit (VTK) and RadiAnt DICOM Viewer, the effectiveness and performance of the proposed transfer function are demonstrated in terms of the rendering efficiency and image quality, where more accurate and clearer features are presented rather than a blur red area. Furthermore, the complex operations on the two-dimensional histogram are avoided in our proposed approach and more detailed information can be seen from our final visualized image

Patient-Specific Coronary Artery 3D Printing Based on Intravascular Optical Coherence Tomography and Coronary Angiography

Despite the new ideas were inspired in medical treatment by the rapid advancement of three-dimensional (3D) printing technology, there is still rare research work reported on 3D printing of coronary arteries being documented in the literature. In this work, the application value of 3D printing technology in the treatment of cardiovascular diseases has been explored via comparison study between the 3D printed vascular solid model and the computer aided design (CAD) model. In this paper, a new framework is proposed to achieve a 3D printing vascular model with high simulation. The patient-specific 3D reconstruction of the coronary arteries is performed by the detailed morphological information abstracted from the contour of the vessel lumen. In the process of reconstruction which has 5 steps, the morphological details of the contour view of the vessel lumen are merged along with the curvature and length information provided by the coronary angiography. After comparing with the diameter of the narrow section and the diameter of the normal section in CAD models and 3D printing model, it can be concluded that there is a high correlation between the diameter of vascular stenosis measured in 3D printing models and computer aided design models. The 3D printing model has high-modeling ability and high precision, which can represent the original coronary artery appearance accurately. It can be adapted for prevascularization planning to support doctors in determining the surgical procedures