RoboCoDraw: Robotic Avatar Drawing with GAN-based Style Transfer and Time-efficient Path Optimization

Robotic drawing has become increasingly popular as an entertainment and interactive tool. In this paper we present RoboCoDraw, a real-time collaborative robot-based drawing system that draws stylized human face sketches interactively in front of human users, by using the Generative Adversarial Network (GAN)-based style transfer and a Random-Key Genetic Algorithm (RKGA)-based path optimization. The proposed RoboCoDraw system takes a real human face image as input, converts it to a stylized avatar, then draws it with a robotic arm. A core component in this system is the Avatar-GAN proposed by us, which generates a cartoon avatar face image from a real human face. AvatarGAN is trained with unpaired face and avatar images only and can generate avatar images of much better likeness with human face images in comparison with the vanilla CycleGAN. After the avatar image is generated, it is fed to a line extraction algorithm and converted to sketches. An RKGA-based path optimization algorithm is applied to find a time-efficient robotic drawing path to be executed by the robotic arm. We demonstrate the capability of RoboCoDraw on various face images using a lightweight, safe collaborative robot UR5.Comment: Accepted by AAAI202

The effects of object size on spatial orientation: an eye movement study

IntroductionThe processing of visual information in the human brain is divided into two streams, namely, the dorsal and ventral streams, object identification is related to the ventral stream and motion processing is related to the dorsal stream. Object identification is interconnected with motion processing, object size was found to affect the information processing of motion characteristics in uniform linear motion. However, whether the object size affects the spatial orientation is still unknown.MethodsThirty-eight college students were recruited to participate in an experiment based on the spatial visualization dynamic test. Eyelink 1,000 Plus was used to collect eye movement data. The final direction difference (the difference between the final moving direction of the target and the final direction of the moving target pointing to the destination point), rotation angle (the rotation angle of the knob from the start of the target movement to the moment of key pressing) and eye movement indices under conditions of different object sizes and motion velocities were compared.ResultsThe final direction difference and rotation angle under the condition of a 2.29°-diameter moving target and a 0.76°-diameter destination point were significantly smaller than those under the other conditions (a 0.76°-diameter moving target and a 0.76°-diameter destination point; a 0.76°-diameter moving target and a 2.29°-diameter destination point). The average pupil size under the condition of a 2.29°-diameter moving target and a 0.76°-diameter destination point was significantly larger than the average pupil size under other conditions (a 0.76°-diameter moving target and a 0.76°-diameter destination point; a 0.76°-diameter moving target and a 2.29°-diameter destination point).DiscussionA relatively large moving target can resist the landmark attraction effect in spatial orientation, and the influence of object size on spatial orientation may originate from differences in cognitive resource consumption. The present study enriches the interaction theory of the processing of object characteristics and motion characteristics and provides new ideas for the application of eye movement technology in the examination of spatial orientation ability

Encoding Enhanced Complex CNN for Accurate and Highly Accelerated MRI

Magnetic resonance imaging (MRI) using hyperpolarized noble gases provides a way to visualize the structure and function of human lung, but the long imaging time limits its broad research and clinical applications. Deep learning has demonstrated great potential for accelerating MRI by reconstructing images from undersampled data. However, most existing deep conventional neural networks (CNN) directly apply square convolution to k-space data without considering the inherent properties of k-space sampling, limiting k-space learning efficiency and image reconstruction quality. In this work, we propose an encoding enhanced (EN2) complex CNN for highly undersampled pulmonary MRI reconstruction. EN2 employs convolution along either the frequency or phase-encoding direction, resembling the mechanisms of k-space sampling, to maximize the utilization of the encoding correlation and integrity within a row or column of k-space. We also employ complex convolution to learn rich representations from the complex k-space data. In addition, we develop a feature-strengthened modularized unit to further boost the reconstruction performance. Experiments demonstrate that our approach can accurately reconstruct hyperpolarized 129Xe and 1H lung MRI from 6-fold undersampled k-space data and provide lung function measurements with minimal biases compared with fully-sampled image. These results demonstrate the effectiveness of the proposed algorithmic components and indicate that the proposed approach could be used for accelerated pulmonary MRI in research and clinical lung disease patient care

The Mitochondrial Deoxyguanosine Kinase is Required for Cancer Cell Stemness in Lung Adenocarcinoma

The mitochondrial deoxynucleotide triphosphate (dNTP) is maintained by the mitochondrial deoxynucleoside salvage pathway and dedicated for the mtDNA homeostasis, and the mitochondrial deoxyguanosine kinase (DGUOK) is a rate-limiting enzyme in this pathway. Here, we investigated the role of the DGUOK in the self-renewal of lung cancer stem-like cells (CSC). Our data support that DGUOK overexpression strongly correlates with cancer progression and patient survival. The depletion of DGUOK robustly inhibited lung adenocarcinoma tumor growth, metastasis, and CSC self-renewal. Mechanistically, DGUOK is required for the biogenesis of respiratory complex I and mitochondrial OXPHOS, which in turn regulates CSC self-renewal through AMPK-YAP1 signaling. The restoration of mitochondrial OXPHOS in DGUOK KO lung cancer cells using NDI1 was able to prevent AMPK-mediated phosphorylation of YAP and to rescue CSC stemness. Genetic targeting of DGUOK using doxycycline-inducible CRISPR/Cas9 was able to markedly induce tumor regression. Our findings reveal a novel role for mitochondrial dNTP metabolism in lung cancer tumor growth and progression, and implicate that the mitochondrial deoxynucleotide salvage pathway could be potentially targeted to prevent CSC-mediated therapy resistance and metastatic recurrence

Leukocyte recognition algorithm in leucorrhea microscopic images based on ResNet-34 neural network

Automatic leucocyte recognition for leukorrhea microscopic images is a digital image processing technology in the field of machine learning. The existence and quantity of leukocytes in leucorrhea microscopic image is an important sign and basis to judge the inflammation of vagina or cervix. Therefore, the recognition and count of leucocyte is an effective means to evaluate the condition of the disease. To solve the problem of low efficiency of leucocyte recognition in traditional artificial microscopy, this paper proposes an automatic recognition algorithm based on ResNet-34 neural network. Firstly, Canny edge detection algorithm based on genetic algorithm is used to extract the foreground target in the leucorrhea microscopic image. Secondly, the leucocyte target is selected according to the connected region and boundary rectangle parameters of the foreground target. Finally, ResNet-34 neural network is applied for the classification of leukocytes. Experiments show that the recognition accuracy of leukocytes in leucorrhea microscopic image is 92.8%, and the recall is 97.1%, which is higher and better than other methods

Clinicopathological features of pancreatic mucinous cystic neoplasm and influencing factors for its malignancy

ObjectiveTo investigate the clinicopathological features of pancreatic mucinous cystic neoplasm (MCN) and influencing factors for benign and malignant MCN. MethodsA retrospective analysis was performed for the clinical data of 43 patients with pathologically confirmed pancreatic MCN who were treated from January 2013 to December 2015, and according to the results of pathological diagnosis, the patients were divided into benign group (mucinous cystadenoma and pancreatic MCN with low/middle-grade dysplasia) and malignant group (MCN with high-grade dysplasia and MCN with invasive carcinoma). The clinicopathological features and radiological features were summarized, and the risk factors for malignant transformation of pancreatic MCN were analyzed. The independent samples t-test was used for comparison of continuous data between groups, the chi-square test or Fisher's exact test was used for comparison of categorical data between groups, and a multivariate logistic regression analysis was used to identify risk factors. ResultsThere were 14 male and 29 female patients aged 22-81 years (median 58.53 years). Of all patients, 30 (69.8%) had clinical symptoms. The maximum tumor diameter was 4.8 cm (range 1.2-16 cm). Of all patients, 18 (41.9%) had MCN in the head of the pancreas, 3 (7.0%) had MCN in the neck of the pancreas, 20 (46.5%) had MCN in the body and tail of the pancreas, and 2 (4.6%) had multiple MCNs. There were significant differences between the two groups in age, tumor nature, tumor location, texture, tumor markers, heterogeneous enhancement of the cyst wall, heterogeneous enhancement of solid components, and cyst wall thickness ＞0.2 cm. The multivariate logistic regression analysis showed that age and increased tumor markers were independent predictive factors for malignant pancreatic MCN (P ＜0.05). ConclusionAge, tumor nature, tumor location, texture, increased tumor markers, heterogeneous enhancement of the cyst wall, heterogeneous enhancement of solid components, and cyst wall thickness ＞0.2 cm are important features of malignant pancreatic MCN, and age and increased tumor markers are risk factors for malignant pancreatic MCN

A Sensor Bias Correction Method for Reducing the Uncertainty in the Spatiotemporal Fusion of Remote Sensing Images

With the development of multisource satellite platforms and the deepening of remote sensing applications, the growing demand for high-spatial resolution and high-temporal resolution remote sensing images has aroused extensive interest in spatiotemporal fusion research. However, reducing the uncertainty of fusion results caused by sensor inconsistencies and input data preprocessing is one of the challenges in spatiotemporal fusion algorithms. Here, we propose a novel sensor bias correction method to correct the input data of the spatiotemporal fusion model through a machine learning technique learning the bias between different sensors. Taking the normalized difference vegetation index (NDVI) images with low-spatial resolution (MODIS) and high-spatial resolution (Landsat) as the basic data, we generated the neighborhood gray matrices from the MODIS image and established the image bias pairs of MODIS and Landsat. The light gradient boosting machine (LGBM) regression model was used for the nonlinear fitting of the bias pairs to correct MODIS NDVI images. For three different landscape areas with various spatial heterogeneities, the fusion of the bias-corrected MODIS NDVI and Landsat NDVI was conducted by using the spatiotemporal adaptive reflection fusion model (STARFM) and the flexible spatiotemporal data fusion method (FSDAF), respectively. The results show that the sensor bias correction method can enhance the spatially detailed information in the input data, significantly improve the accuracy and robustness of the spatiotemporal fusion technology, and extend the applicability of the spatiotemporal fusion models

Evaluating Satellite-Observed Ecosystem Function Changes and the Interaction with Drought in Songnen Plain, Northeast China

Drought is considered one of the devastating natural disasters worldwide. In the context of global climate change, the frequency and intensity of drought have increased, thereby affecting terrestrial ecosystems. To date, the interactions between ecosystem change and drought, especially their mutual lag and cumulative effects is unclear. The Songnen Plain in northeastern China is one of the three major black soil areas in the world and is highly sensitive to global change. Herein, to quantify the interaction between drought and ecosystem function changes in the Songnen Plain, integrating with time-series moderate resolution imaging spectroradiometer (MODIS), leaf area Index (LAI), evapotranspiration (ET), and gross primary productivity (GPP) data, we calculated the standardized precipitation and evapotranspiration index (SPEI) based on the meteorological data, diagnosed the causal relationship between SPEI and the ecosystem function indicators i.e., LAI, ET, and GPP, and analyzed the time-lag and cumulative effects between the degree of drought and three ecosystem function indicators using impulse response analysis. The results showed that the trend of SPEI (2000–2020) was positive in the Songnen Plain, indicating that the drought extent had eased towards wetness. LAI showed insignificant changes (taking up 88.34% of the total area), except for the decrease in LAI found in some forestland and grassland, accounting for 9.43%. The pixels showing a positive trend of ET and GPP occupied 24.86% and 54.94%, respectively. The numbers of pixels with Granger causality between LAI and SPEI (32.31%), SPEI and GPP (52.8%) were greater at the significance 0.05 level. Impulse responses between each variable pair were stronger mainly between the 6th and 8th months, but differed significantly between vegetation types. Grassland and cropland were more susceptible to drought than forest. The cumulative impulse response coefficients values indicated that the mutual impacts between all variables were mainly positive. The increased wetness positively contributed to ecosystem function, and in turn enhanced ecosystem function improved regional drought conditions to some extent. However, in the northeastern forest areas, the SPEI showed a significant negative response to increased ET and GPP, suggesting that the improved physiological functions of forest might lead to regional drought. There were regional differences in the interaction between drought conditions and ecosystem function in the Songnen Plain over the past 21 years

Characterizing the Turning Points in Ecosystem Functioning and Their Linkages to Drought and Human Activities over the Arid and Semi-Arid Regions of Northern China

Identifying the changes in dryland functioning and the drivers of those changes are critical for global ecosystem conservation and sustainability. The arid and semi-arid regions of northern China (ASARNC) are located in a key area of the generally temperate desert of the Eurasian continent, where the ecological conditions have experienced noticeable changes in recent decades. However, it is unclear whether the ecosystem functioning (EF) in this region changed abruptly and how that change was affected by natural and anthropogenic factors. Here, we estimated monthly rain use efficiency (RUE) from MODIS NDVI time series data and investigated the timing and types of turning points (TPs) in EF by the Breaks For Additive Season and Trend (BFAST) family algorithms during 2000–2019. The linkages between the TPs, drought, the frequency of land cover change, and socioeconomic development were examined. The results show that 63.2% of the pixels in the ASARNC region underwent sudden EF changes, of which 26.64% were induced by drought events, while 55.67% were firmly associated with the wetting climate. Wet and dry events were not detected in 17.69% of the TPs, which might have been caused by human activities. TP types and occurrences correlate differently with land cover change frequency, population density, and GDP. The improved EF TP type was correlated with the continuous humid climate and a reduced population density, while the deteriorated EF type coincided with persistent drought and increasing population density. Our research furthers the understanding of how and why TPs of EF occur and provides fundamental data for the conservation, management, and better decision-making concerning dryland ecosystems in China

Automatic segmentation and recognition of red and white cells in stool microscopic images of human

Aiming to solve the problem of low efficiency in manually recognizing the red and white cells in stool microscopic images, we propose an automatic segmentation method based on iterative corrosion with marker-controlled watershed segmentation and an automatic recognition method based on support vector machine (SVM) classification. The method first obtains saliency map of the images in HSI and Lab color spaces through saliency detection algorithm, then fuses the salient images to complete the initial segmentation. Next, we segment the red and white cells completely based on the initial segmentation images using marker-controlled watershed algorithm and other complementary methods. According to the differences in geometrical and texture features of red and white cells such as area, perimeter, circularity, energy, entropy, correlation and contrast, we extract them as feature vectors to train SVM and finally complete the classification and recognition of red and white cells. The experimental results indicate that our proposed marker-controlled watershed method can help increase the segmentation and recognition accuracy. Moreover, since it is also less susceptible to the heteromorphic red and white cells, our method is effective and robust