Geometry-Aware Face Completion and Editing

Face completion is a challenging generation task because it requires generating visually pleasing new pixels that are semantically consistent with the unmasked face region. This paper proposes a geometry-aware Face Completion and Editing NETwork (FCENet) by systematically studying facial geometry from the unmasked region. Firstly, a facial geometry estimator is learned to estimate facial landmark heatmaps and parsing maps from the unmasked face image. Then, an encoder-decoder structure generator serves to complete a face image and disentangle its mask areas conditioned on both the masked face image and the estimated facial geometry images. Besides, since low-rank property exists in manually labeled masks, a low-rank regularization term is imposed on the disentangled masks, enforcing our completion network to manage occlusion area with various shape and size. Furthermore, our network can generate diverse results from the same masked input by modifying estimated facial geometry, which provides a flexible mean to edit the completed face appearance. Extensive experimental results qualitatively and quantitatively demonstrate that our network is able to generate visually pleasing face completion results and edit face attributes as well

Proteomic characterization of an isolated fraction of synthetic proteasome inhibitor (PSI)-induced inclusions in PC12 cells might offer clues to aggresomes as a cellular defensive response against proteasome inhibition by PSI

<p>Abstract</p> <p>Background</p> <p>Cooperation of constituents of the ubiquitin proteasome system (UPS) with chaperone proteins in degrading proteins mediate a wide range of cellular processes, such as synaptic function and neurotransmission, gene transcription, protein trafficking, mitochondrial function and metabolism, antioxidant defence mechanisms, and apoptotic signal transduction. It is supposed that constituents of the UPS and chaperone proteins are recruited into aggresomes where aberrant and potentially cytotoxic proteins may be sequestered in an inactive form.</p> <p>Results</p> <p>To determinate the proteomic pattern of synthetic proteasome inhibitor (PSI)-induced inclusions in PC12 cells after proteasome inhibition by PSI, we analyzed a fraction of PSI-induced inclusions. A proteomic feature of the isolated fraction was characterized by identification of fifty six proteins including twenty previously reported protein components of Lewy bodies, twenty eight newly identified proteins and eight unknown proteins. These proteins, most of which were recognized as a profile of proteins within cellular processes mediated by the UPS, a profile of constituents of the UPS and a profile of chaperone proteins, are classed into at least nine accepted categories. In addition, prolyl-4-hydroxylase beta polypeptide, an endoplasmic reticulum member of the protein disulfide isomerase family, was validated in the developmental process of PSI-induced inclusions in the cells.</p> <p>Conclusions</p> <p>It is speculated that proteomic characterization of an isolated fraction of PSI-induced inclusions in PC12 cells might offer clues to appearance of aggresomes serving as a cellular defensive response against proteasome inhibition.</p

A genetic study of the NOS3 gene for ischemic stroke in a Chinese population

We recruited 560 unrelated patients with ischemic stroke and 153 unrelated controls to undertake a genetic analysis for association between the NOS3 gene and ischemic stroke. All the subjects were Chinese of Han descent. Because the NOS3 gene spans about 21 kb of DNA and contains 26 exons, we selected a single nucleotide polymorphism (SNP) rs3918181, an A to G base change located in intron 14 of the gene, as a DNA marker. PCR-based restriction fragment length polymorphism analysis was applied to genotype rs3918181 (RsaI site). The chi-square (χ2) goodness-of-fit test showed that the genotypic distributions of the marker were not deviated from Hardy-Weinberg equilibrium in both the patient group (χ2 = 0.166, p = 0.684) and the control group (χ2 = 0.421, p = 0.517). The cocaphase analysis showed allelic association of rs3918181 with ischemic stroke in males (χ2 = 4.04, p = 0.044, OR = 1.43, 95% CI 1.01∼2.02) and frequency of allele A was significantly higher in male patients than male control subjects. The χ2 test revealed genotypic association between rs3918181 and ischemic stroke in males (χ2 = 4.26, df = 1, p = 0.039, OR = 1.61, 95% CI 1.02∼2.53) but not in females. The present work suggests that rs3918181 is associated with ischemic stroke in male patients. This finding gives further evidence in support of the eNOS association with ischemic stroke in the Chinese population

Torque Characteristics Analysis of a Magnetorheological Brake with Double Brake Disc

Magnetorheological (MR) brake is a sort of electromagnetic brake that uses the controllable output characteristics of MR fluid for braking. In this paper, an MR brake with a double brake disc was developed to improve the braking performance of conventional MR brakes. The effective damping gaps were increased from the traditional two sections to four sections by increasing the single brake disc of the conventional MR brake to a double brake disc. By reasonably arranging the non-magnetic sleeve inside the MR brake, the magnetic flux lines were better guided to the effective damping gaps, which increased the utilization rate of the magnetic field, effectively enhanced the braking performance, and also reduced the braking power consumption. The structure and working principle of the MR brake with double brake disc were discussed. The magnetic field of the proposed MR brake was analyzed by ANSYS software, and the theoretical result of braking performance was obtained by combining the established mechanical model. The braking performance test rig was setup to investigate the torque performance of the MR brake. The experimental results show that the maximum braking torque is 18.01 N·m at the applied current of 2.0 A and the rotational speed of 400 r·min−1, and the simulation values are basically verified. In addition, the results indicate that the constant torque characteristic of the MR brake is relatively stable, and the torque is almost unaffected by the changes of rotational speed. The results can provide some guidance for the structural design and optimization of the MR actuators

DeepQoE : a multimodal learning framework for video quality of experience (QoE) prediction

Recently, many models have been developed to predict video Quality of Experience (QoE), yet the applicability of these models still faces significant challenges. Firstly, many models rely on features that are unique to a specific dataset and thus lack the capability to generalize. Due to the intricate interactions among these features, a unified representation that is independent of datasets with different modalities is needed. Secondly, existing models often lack the configurability to perform both classification and regression tasks. Thirdly, the sample size of the available datasets to develop these models is often very small, and the impact of limited data on the performance of QoE models has not been adequately addressed. To address these issues, in this work we develop a novel and end-to-end framework termed as DeepQoE. The proposed framework first uses a combination of deep learning techniques, such as word embedding and 3D convolutional neural network (C3D), to extract generalized features. Next, these features are combined and fed into a neural network for representation learning. A learned representation will then serve as input for classification or regression tasks. We evaluate the performance of DeepQoE with three datasets. The results show that for small datasets (e.g., WHU-MVQoE2016 and Live-Netflix Video Database), the performance of state-of-the-art machine learning algorithms is greatly improved by using the QoE representation from DeepQoE (e.g., 35.71% to 44.82%); while for the large dataset (e.g., VideoSet), our DeepQoE framework achieves significant performance improvement in comparison to the best baseline method (90.94% vs. 82.84%). In addition to the much improved performance, DeepQoE has the flexibility to fit different datasets, to learn QoE representation, and to perform both classification and regression problems. We also develop a DeepQoE based adaptive bitrate streaming (ABR) system to verify that our framework can be easily applied to multimedia communication service. The software package of the DeepQoE framework has been released to facilitate the current research on QoE.National Research Foundation (NRF)This work was supported in part and jointly by a gift fund from Microsoft Research Asia (Ref. FY18-Research-Theme-051), a project fund from DSAIR@NTU, and a BSEWWT project fund from Singapore National Research Foundation, administrated through the BSEWWT program office (Ref. BSEWWT2017_2_06), and in part by National Natural Science Foundation of China (NSFC) under Grant 61971457

Prototype Optical Bionic Microphone with a Dual-Channel Mach–Zehnder Interferometric Transducer

A prototype optical bionic microphone with a dual-channel Mach–Zehnder interferometric (MZI) transducer was designed and prepared for the first time using a silicon diaphragm made by microelectromechanical system (MEMS) technology. The MEMS diaphragm mimicked the structure of the fly Ormia Ochracea’s coupling eardrum, consisting of two square wings connected through a neck that is anchored via the two torsional beams to the silicon pedestal. The vibrational displacement of each wing at its distal edge relative to the silicon pedestal is detected with one channel of the dual-channel MZI transducer. The diaphragm at rest is coplanar with the silicon pedestal, resulting in an initial phase difference of zero for each channel of the dual-channel MZI transducer and consequently offering the microphone strong temperature robustness. The two channels of the prototype microphone show good consistency in their responses to incident sound signals; they have the rocking and bending resonance frequencies of 482 Hz and 1911 Hz, and their pressure sensitivities at a lower frequency exhibit an “8”-shaped directional dependence. The comparison indicates that the dual-channel MZI transducer-based bionic microphone proposed in this work is advantageous over the Fabry–Perot interferometric transducer-based counterparts extensively reported

Media 2: Realization of Glass patterns by a microlens array

Originally published in Optics Letters on 15 October 2012 (ol-37-20-4248

Media 4: Realization of Glass patterns by a microlens array

Originally published in Optics Letters on 15 October 2012 (ol-37-20-4248