Bivariate Beta-LSTM

Long Short-Term Memory (LSTM) infers the long term dependency through a cell state maintained by the input and the forget gate structures, which models a gate output as a value in [0,1] through a sigmoid function. However, due to the graduality of the sigmoid function, the sigmoid gate is not flexible in representing multi-modality or skewness. Besides, the previous models lack modeling on the correlation between the gates, which would be a new method to adopt inductive bias for a relationship between previous and current input. This paper proposes a new gate structure with the bivariate Beta distribution. The proposed gate structure enables probabilistic modeling on the gates within the LSTM cell so that the modelers can customize the cell state flow with priors and distributions. Moreover, we theoretically show the higher upper bound of the gradient compared to the sigmoid function, and we empirically observed that the bivariate Beta distribution gate structure provides higher gradient values in training. We demonstrate the effectiveness of bivariate Beta gate structure on the sentence classification, image classification, polyphonic music modeling, and image caption generation.Comment: AAAI 202

Counterfactual Fairness with Disentangled Causal Effect Variational Autoencoder

The problem of fair classification can be mollified if we develop a method to remove the embedded sensitive information from the classification features. This line of separating the sensitive information is developed through the causal inference, and the causal inference enables the counterfactual generations to contrast the what-if case of the opposite sensitive attribute. Along with this separation with the causality, a frequent assumption in the deep latent causal model defines a single latent variable to absorb the entire exogenous uncertainty of the causal graph. However, we claim that such structure cannot distinguish the 1) information caused by the intervention (i.e., sensitive variable) and 2) information correlated with the intervention from the data. Therefore, this paper proposes Disentangled Causal Effect Variational Autoencoder (DCEVAE) to resolve this limitation by disentangling the exogenous uncertainty into two latent variables: either 1) independent to interventions or 2) correlated to interventions without causality. Particularly, our disentangling approach preserves the latent variable correlated to interventions in generating counterfactual examples. We show that our method estimates the total effect and the counterfactual effect without a complete causal graph. By adding a fairness regularization, DCEVAE generates a counterfactual fair dataset while losing less original information. Also, DCEVAE generates natural counterfactual images by only flipping sensitive information. Additionally, we theoretically show the differences in the covariance structures of DCEVAE and prior works from the perspective of the latent disentanglement

Full momentum- and energy-resolved spectral function of a 2D electronic system

The single-particle spectral function measures the density of electronic states in a material as a function of both momentum and energy, providing central insights into strongly correlated electron phenomena. Here we demonstrate a high-resolution method for measuring the full momentum- and energy-resolved electronic spectral function of a two-dimensional (2D) electronic system embedded in a semiconductor. The technique remains operational in the presence of large externally applied magnetic fields and functions even for electronic systems with zero electrical conductivity or with zero electron density. Using the technique on a prototypical 2D system, a GaAs quantum well, we uncover signatures of many-body effects involving electron-phonon interactions, plasmons, polarons, and a phonon analog of the vacuum Rabi splitting in atomic systems

DsRed gene expression by doxycycline in porcine fibroblasts and cloned embryos using transposon

To develop a transgenic pig, introduction of foreign genes into fibroblasts is required. In this study, Piggybac transposition was used to produce tetracycline dependent gene expressing cloned embryos. Red fluorescence proteins (DsRed) combined with tetracycline promoter flanked transposon sequences were transfected into fetal fibroblasts, and the transfected cells were used as the donor for somatic cell nuclear transfer. Induction of DsRed expression was successfully controlled by doxycycline treatment in donor fibroblasts and early stage embryos. In conclusion, this study suggested that Piggybac transposition could deliver genes into cells or embryos for developing transgenic pig.Keywords: Miniature pigs, transfection, Piggybac, somatic cell nuclear transfer (SCNT), RFPAfrican Journal of Biotechnology Vol. 12(21), pp. 3188-319

Production of CMAH Knockout Preimplantation Embryos Derived From Immortalized Porcine Cells Via TALE Nucleases

Although noncancerous immortalized cell lines have been developed by introducing genes into human and murine somatic cells, such cell lines have not been available in large domesticated animals like pigs. For immortalizing porcine cells, primary porcine fetal fibroblasts were isolated and cultured using the human telomerase reverse transcriptase (hTERT) gene. After selecting cells with neomycin for 2 weeks, outgrowing colonized cells were picked up and subcultured for expansion. Immortalized cells were cultured for more than 9 months without changing their doubling time (similar to 24 hours) or their diameter (< 20 mu m) while control cells became replicatively senescent during the same period. Even a single cell expanded to confluence in 100 mm dishes. Furthermore, to knockout the CMAH gene, designed plasmids encoding a transcription activator-like effector nuclease (TALENs) pairs were transfected into the immortalized cells. Each single colony was analyzed by the mutation-sensitive T7 endonuclease I assay, fluorescent PCR, and dideoxy sequencing to obtain three independent clonal populations of cells that contained biallelic modifications. One CMAH knockout clone was chosen and used for somatic cell nuclear transfer. Cloned embryos developed to the blastocyst stage. In conclusion, we demonstrated that immortalized porcine fibroblasts were successfully established using the human hTERT gene, and the TALENs enabled biallelic gene disruptions in these immortalized cells.

Lomerizine inhibits LPS-mediated neuroinflammation and tau hyperphosphorylation by modulating NLRP3, DYRK1A, and GSK3α/β

IntroductionLomerizine is a calcium channel blocker that crosses the blood–brain barrier and is used clinically in the treatment of migraines. However, whether lomerizine is beneficial in modulating neuroinflammatory responses has not been tested yet.MethodsTo assess the potential of lomerizine for repurposing as a treatment for neuroinflammation, we investigated the effects of lomerizine on LPS-induced proinflammatory responses in BV2 microglial cells, Alzheimer’s disease (AD) excitatory neurons differentiated from induced pluripotent stem cells (iPSCs), and in LPS-treated wild type mice.ResultsIn BV2 microglial cells, lomerizine pretreatment significantly reduced LPS-evoked proinflammatory cytokine and NLRP3 mRNA levels. Similarly, lomerizine pretreatment significantly suppressed the increases in Iba-1, GFAP, proinflammatory cytokine and NLRP3 expression induced by LPS in wild-type mice. In addition, lomerizine posttreatment significantly decreased LPS-stimulated proinflammatory cytokine and SOD2 mRNA levels in BV2 microglial cells and/or wild-type mice. In LPS-treated wild-type mice and AD excitatory neurons differentiated from iPSCs, lomerizine pretreatment ameliorated tau hyperphosphorylation. Finally, lomerizine abolished the LPS-mediated activation of GSK3α/β and upregulation of DYRK1A, which is responsible for tau hyperphosphorylation, in wild-type mice.DiscussionThese data suggest that lomerizine attenuates LPS-mediated neuroinflammatory responses and tau hyperphosphorylation and is a potential drug for neuroinflammation- or tauopathy-associated diseases

Widely Tunable Coupling between a Mechanical Mode and Cavity Photons via a Superconductor

© 2020, The Korean Physical Society. Inducing strong coupling between a mechanical degree of freedom and optical modes has been of great scientific interest itself, but also important for the applications to the quantum information technology. However, photons and mechanical modes usually are weakly interacting due to very small momentum exerted by photons. Here, we demonstrate a scheme for coupling a resonance mode of a mechanical oscillator with an optical cavity, by utilizing the magneto-optical effect of a mesoscopic superconductor attached to the mechanical oscillator. The absorption of cavity photons by the superconductor in external magnetic fields gives rise to a retarded force that modifies the damping and frequency of the oscillator. Measurements using NbSe2 achieved approximately a factor of 17 reduction in the mode temperature from 5.0 K to 260 mK11sciescopuskc