An automated framework of inner segment/outer segment defect detection for retinal SD-OCT images

The integrity of inner segment/outer segment (IS/OS) has high correlation with lower visual acuity in patients suffering from blunt trauma. An automated 3D IS/OS defect detection method based on the SD-OCT images was proposed. First, 11 surfaces were automatically segmented using the multiscale 3D graph-search approach. Second, the sub-volumes between surface 7 and 8 containing IS/OS region around the fovea (diameter of mm) were extracted and flattened based on the segmented retinal pigment epithelium layer. Third, 5 kinds of texture based features were extracted for each voxel. A KNN classifier was trained and each voxel was classified as disrupted or nondisrupted and the responding defect volume was calculated. The proposed method was trained and tested on 9 eyes from 9 trauma subjects using the leave-one-out cross validation method. The preliminary results demonstrated the feasibility and efficiency of the proposed method

SYENet: A Simple Yet Effective Network for Multiple Low-Level Vision Tasks with Real-time Performance on Mobile Device

With the rapid development of AI hardware accelerators, applying deep learning-based algorithms to solve various low-level vision tasks on mobile devices has gradually become possible. However, two main problems still need to be solved: task-specific algorithms make it difficult to integrate them into a single neural network architecture, and large amounts of parameters make it difficult to achieve real-time inference. To tackle these problems, we propose a novel network, SYENet, with only $~$6K parameters, to handle multiple low-level vision tasks on mobile devices in a real-time manner. The SYENet consists of two asymmetrical branches with simple building blocks. To effectively connect the results by asymmetrical branches, a Quadratic Connection Unit(QCU) is proposed. Furthermore, to improve performance, a new Outlier-Aware Loss is proposed to process the image. The proposed method proves its superior performance with the best PSNR as compared with other networks in real-time applications such as Image Signal Processing(ISP), Low-Light Enhancement(LLE), and Super-Resolution(SR) with 2K60FPS throughput on Qualcomm 8 Gen 1 mobile SoC(System-on-Chip). Particularly, for ISP task, SYENet got the highest score in MAI 2022 Learned Smartphone ISP challenge

Learned Smartphone ISP on Mobile GPUs with Deep Learning, Mobile AI & AIM 2022 Challenge: Report

The role of mobile cameras increased dramatically over the past few years, leading to more and more research in automatic image quality enhancement and RAW photo processing. In this Mobile AI challenge, the target was to develop an efficient end-to-end AI-based image signal processing (ISP) pipeline replacing the standard mobile ISPs that can run on modern smartphone GPUs using TensorFlow Lite. The participants were provided with a large-scale Fujifilm UltraISP dataset consisting of thousands of paired photos captured with a normal mobile camera sensor and a professional 102MP medium-format FujiFilm GFX100 camera. The runtime of the resulting models was evaluated on the Snapdragon's 8 Gen 1 GPU that provides excellent acceleration results for the majority of common deep learning ops. The proposed solutions are compatible with all recent mobile GPUs, being able to process Full HD photos in less than 20-50 milliseconds while achieving high fidelity results. A detailed description of all models developed in this challenge is provided in this paper

A flattest constrained envelope approach for empirical mode decomposition.

Empirical mode decomposition (EMD) is an adaptive method for nonlinear, non-stationary signal analysis. However, the upper and lower envelopes fitted by cubic spline interpolation (CSI) may often occur overshoots. In this paper, a new envelope fitting method based on the flattest constrained interpolation is proposed. The proposed method effectively integrates the difference between extremes into the cost function, and applies a chaos particle swarm optimization method to optimize the derivatives of the interpolation nodes. The proposed method was tested on three different types of data: ascertain signal, random signals and real electrocardiogram signals. The experimental results show that: (1) The proposed flattest envelope effectively solves the overshoots caused by CSI method and the artificial bends caused by piecewise parabola interpolation (PPI) method. (2) The index of orthogonality of the intrinsic mode functions (IMFs) based on the proposed method is 0.04054, 0.02222 ± 0.01468 and 0.04013 ± 0.03953 for the ascertain signal, random signals and electrocardiogram signals, respectively, which is lower than the CSI method and the PPI method, and means the IMFs are more orthogonal. (3) The index of energy conversation of the IMFs based on the proposed method is 0.96193, 0.93501 ± 0.03290 and 0.93041 ± 0.00429 for the ascertain signal, random signals and electrocardiogram signals, respectively, which is closer to 1 than the other two methods and indicates the total energy deviation amongst the components is smaller. (4) The comparisons of the Hilbert spectrums show that the proposed method overcomes the mode mixing problems very well, and make the instantaneous frequency more physically meaningful

Single-Channel Sparse Non-Negative Blind Source Separation Method For Automatic 3-D Delineation Of Lung Tumor In Pet Images

In this paper, we propose a novel method for single-channel blind separation of nonoverlapped sources and, to the best of our knowledge, apply it for the first time to automatic segmentation of lung tumors in positron emission tomography (PET) images. Our approach first converts a 3-D PET image into a pseudo-multichannel image. Afterward, regularization free sparseness constrained non-negative matrix factorization is used to separate tumor from other tissues. By using complexity based criterion, we select tumor component as the one with minimal complexity. We have compared the proposed method with threshold based on 40% and 50% maximum standardized uptake value (SUV), graph cuts (GC), random walks (RW), and affinity propagation (AP) algorithms on 18 nonsmall cell lung cancer datasets with respect to ground truth (GT) provided by two radiologists. Dice similarity coefficient averaged with respect to two GTs is: 0.78 ± 0.12 by the proposed algorithm, 0.78 ± 0.1 by GC, 0.77 ± 0.13 by AP, 0.77 ± 0.07 by RW, and 0.75 ± 0.13 by 50% maximum SUV threshold. Since the proposed method achieved performance comparable with interactive methods, considering the unique challenges of lung tumor segmentation from PET images, our findings support possibility of using our fully automated method in routine clinics. The source codes will be available at www.mipav.net/English/research/research.html

Temperature Uncertainty Analysis of Injection Mechanism Based on Kriging Modeling

A kriging modeling method is proposed to conduct the temperature uncertainty analysis of an injection mechanism in squeeze casting. A mathematical model of temperature prediction with multi input and single output is employed to estimate the temperature spatiotemporal distributions of the injection mechanism. The kriging model applies different weights to the independent variables according to spatial location of sample points and their correlation, thus reducing the estimation variance. The predicted value of the kriging model is compared with the sample data at the corresponding position to investigate the influence of the temperature uncertainty of the injection mechanism on the injection process including friction. The results indicate that the significant error is observed at a few sample points in the early injection due to the impact of the uncertainty facts. The variance mean and standard deviation obtained by the model calibrated by experimental samples reduce largely in comparison to those obtained from the initial kriging model. This study indicates that model calibration produces more accurate prediction

Cortexpert: A Model-Based Method For Automatic Renal Cortex Segmentation

This paper introduces a model-based approach for a fully automatic delineation of kidney and cortex tissue from contrast-enhanced abdominal CT scans. The proposed framework, named CorteXpert, consists of two new strategies for kidney tissue delineation: cortex model adaptation and non-uniform graph search. CorteXpert was validated on a clinical data set of 58 CT scans using the cross-validation evaluation strategy. The experimental results indicated the state-of-the-art segmentation accuracies (as dice coefficient): 97.86% ± 2.41% and 97.48% ± 3.18% for kidney and renal cortex delineations, respectively