Bivariate Beta-LSTM

Long Short-Term Memory (LSTM) infers the long term dependency through a cell state maintained by the input and the forget gate structures, which models a gate output as a value in [0,1] through a sigmoid function. However, due to the graduality of the sigmoid function, the sigmoid gate is not flexible in representing multi-modality or skewness. Besides, the previous models lack modeling on the correlation between the gates, which would be a new method to adopt inductive bias for a relationship between previous and current input. This paper proposes a new gate structure with the bivariate Beta distribution. The proposed gate structure enables probabilistic modeling on the gates within the LSTM cell so that the modelers can customize the cell state flow with priors and distributions. Moreover, we theoretically show the higher upper bound of the gradient compared to the sigmoid function, and we empirically observed that the bivariate Beta distribution gate structure provides higher gradient values in training. We demonstrate the effectiveness of bivariate Beta gate structure on the sentence classification, image classification, polyphonic music modeling, and image caption generation.Comment: AAAI 202

Electrical Investigation of the Oblique Hanle Effect in Ferromagnet/Oxide/Semiconductor Contacts

We have investigated the electrical Hanle effect with magnetic fields applied at an oblique angle ({\theta}) to the spin direction (the oblique Hanle effect, OHE) in CoFe/MgO/semiconductor (SC) contacts by employing a three-terminal measurement scheme. The electrical oblique Hanle signals obtained in CoFe/MgO/Si and CoFe/MgO/Ge contacts show clearly different line shapes depending on the spin lifetime of the host SC. Notably, at moderate magnetic fields, the asymptotic values of the oblique Hanle signals (in both contacts) are consistently reduced by a factor of cos^2({\theta}) irrespective of the bias current and temperature. These results are in good agreement with predictions of the spin precession and relaxation model for the electrical oblique Hanle effect. At high magnetic fields where the magnetization of CoFe is significantly tilted from the film plane to the magnetic field direction, we find that the observed angular dependence of voltage signals in the CoFe/MgO/Si and CoFe/MgO/Ge contacts are well explained by the OHE, considering the misalignment angle between the external magnetic field and the magnetization of CoFe.Comment: 19 pages, 8 figure

Electrical spin injection and accumulation in CoFe/MgO/Ge contacts at room temperature

We first report the all-electrical spin injection and detection in CoFe/MgO/moderately doped n-Ge contact at room temperature (RT), employing threeterminal Hanle measurements. A sizable spin signal of ~170 k{\Omega} {\mu}m^2 has been observed at RT, and the analysis using a single-step tunneling model gives a spin lifetime of ~120 ps and a spin diffusion length of ~683 nm in Ge. The observed spin signal shows asymmetric bias and temperature dependences which are strongly related to the asymmetry of the tunneling process.Comment: 28 pages, 5 figure

CSF Otorrhea Resulting from Osteoradionecrosis of the Temporal Bone in a Patient with Recurrent Meningioma

Osteoradionecrosis of the temporal bone is a very rare but potentially lethal complication of radiotherapy for head and neck or skull base tumors. Only two cases of osteoradionecrosis of the temporal bone complicating cerebrospinal fluid (CSF) otorrhea have been reported in the literature. This report describes a case of CSF otorrhea and osteoradionecrosis of the temporal bone in a patient with meningioma who was treated with tympanomastoid surgery and autologous fat obliteration in the mastoid

Early Results from Posterior Cervical Fusion with a Screw-Rod System

PURPOSE: We performed 65 cases of posterior fusion surgery for cervical and/or high thoracic lesions using a polyaxial screw-rod system. PATIENTS AND METHODS: A total of 486 screws were implanted in 65 patients. RESULTS: Fixation of the screws was carried out over an average of 2.9 spinal segments. Upon evaluation by postoperative CT scans, twelve (2.5%) screws had suboptimal trajectories but two of these revealed radiculopathy in one patient and required screw repositioning. No vascular sequelae resulted. There has been no segmental motion in any of the cases to date. As for other complications, there was one case of dural tearing and two cases of lateral mass fractures. There were no infections or other wound healing problems or hardware failures. No patients had neurological deterioration after surgery. There were statistically significant improvements in the mean Neck Disability Index (NDI) scores and Visual Analogue Scale (VAS) scores in the preoperative and late postoperative follow-up evaluations. Although further studies are required to establish the long-term results of fusion rates and clinical outcomes. CONCLUSION: We cautiously suggest that the posterior polyaxial screw-rod system can be safely used as a primary or additional fusion method in this risky region. The successful and safe use of this method is dependent on a precise preoperative surgical plan and tactics for ensuring safe screw fixation.ope