Asynchronous Training of Word Embeddings for Large Text Corpora

Word embeddings are a powerful approach for analyzing language and have been widely popular in numerous tasks in information retrieval and text mining. Training embeddings over huge corpora is computationally expensive because the input is typically sequentially processed and parameters are synchronously updated. Distributed architectures for asynchronous training that have been proposed either focus on scaling vocabulary sizes and dimensionality or suffer from expensive synchronization latencies. In this paper, we propose a scalable approach to train word embeddings by partitioning the input space instead in order to scale to massive text corpora while not sacrificing the performance of the embeddings. Our training procedure does not involve any parameter synchronization except a final sub-model merge phase that typically executes in a few minutes. Our distributed training scales seamlessly to large corpus sizes and we get comparable and sometimes even up to 45% performance improvement in a variety of NLP benchmarks using models trained by our distributed procedure which requires $1/10$ of the time taken by the baseline approach. Finally we also show that we are robust to missing words in sub-models and are able to effectively reconstruct word representations.Comment: This paper contains 9 pages and has been accepted in the WSDM201

Spin dynamics in copper metaborate CuB2O4CuB_2 O_4 studied by muon spin relaxation

Copper metaborate CuB$_2$O$_{4}$ was studied by muon spin relaxation measurements in order to clarify its static and dynamic magnetic properties. The time spectra of muon spin depolarization suggest that the local fields at the muon site contain both static and fluctuating components in all ordered phases down to 0.3 K. In the weak ferromagnetic phase (20 K~$>T>$~9.3 K), the static component is dominant. On the other hand, upon cooling the fluctuating component becomes dominant in the incommensurate helix phase (9.3K > T > 1.4K). The dynamical fluctuations of the local fields persist down to 0.3K, where a new incommensurate phase (T < 1.4K) is expected to appear. This result suggests that spins fluctuate even at T \to 0. We propose two possible origins of the remnant dynamical spin fluctuations: frustration of the exchange interactions and the dynamic behavior of the soliton lattice

Bloch oscillations of magnetic solitons in anisotropic spin-1/2 chains

We study the quantum dynamics of soliton-like domain walls in anisotropic spin-1/2 chains in the presence of magnetic fields. In the absence of fields, domain walls form a Bloch band of delocalized quantum states while a static field applied along the easy axis localizes them into Wannier wave packets and causes them to execute Bloch oscillations, i.e. the domain walls oscillate along the chain with a finite Bloch frequency and amplitude. In the presence of the field, the Bloch band, with a continuum of extended states, breaks up into the Wannier-Zeeman ladder -- a discrete set of equally spaced energy levels. We calculate the dynamical structure factor in the one-soliton sector at finite frequency, wave vector, and temperature, and find sharp peaks at frequencies which are integer multiples of the Bloch frequency. We further calculate the uniform magnetic susceptibility and find that it too exhibits peaks at the Bloch frequency. We identify several candidate materials where these Bloch oscillations should be observable, for example, via neutron scattering measurements. For the particular compound CoCl_2.2H_2O we estimate the Bloch amplitude to be on the order of a few lattice constants, and the Bloch frequency on the order of 100 GHz for magnetic fields in the Tesla range and at temperatures of about 18 Kelvin.Comment: 31 single-spaced REVTeX pages, including 7 figures embedded with eps

Soliton Lattices in the Incommensurate Spin-Peierls Phase: Local Distortions and Magnetizations

It is shown that nonadiabatic fluctuations of the soliton lattice in the spin-Peierls system CuGeO_3 lead to an important reduction of the NMR line widths. These fluctuations are the zero-point motion of the massless phasonic excitations. Furthermore, we show that the discrepancy of X-ray and NMR soliton widths can be understood as the difference between a distortive and a magnetic width. Their ratio is controlled by the frustration of the spin system. By this work, theoretical and experimental results can be reconciled in two important points.Comment: 9 pages, 5 figures included, Revtex submitted to Physical Review

Clinical significance of VEGF-A, -C and -D expression in esophageal malignancies

Vascular endothelial growth factors ( VEGF)- A, - C and - D are members of the proangiogenic VEGF family of glycoproteins. VEGF-A is known to be the most important angiogenic factor under physiological and pathological conditions, while VEGF-C and VEGF-D are implicated in the development and sprouting of lymphatic vessels, so called lymphangiogenesis. Local tumor progression, lymph node metastases and hematogenous tumor spread are important prognostic factors for esophageal carcinoma ( EC), one of the most lethal malignancies throughout the world. We found solid evidence in the literature that VEGF expression contributes to tumor angiogenesis, tumor progression and lymph node metastasis in esophageal squamous cell carcinoma ( SCC), and many authors could show a prognostic value for VEGF-assessment. In adenocarcinoma (AC) of the esophagus angiogenic properties are acquired in early stages, particularly in precancerous lesions like Barrett's dysplasia. However, VEGF expression fails to give prognostic information in AC of the esophagus. VEGF-C and VEGF-D were detected in SCC and dysplastic lesions, but not in normal mucosa of the esophagus. VEGF-C expression might be associated with lymphatic tumor invasion, lymph node metastases and advanced disease in esophageal SCC and AC. Therapeutic interference with VEGF signaling may prove to be a promising way of anti-angiogenic co-treatment in esophageal carcinoma. However, concrete clinical data are still pending

Field-induced structural evolution in the spin-Peierls compound CuGeO3_3: high-field ESR study

The dimerized-incommensurate phase transition in the spin-Peierls compound CuGeO$_3$ is probed using multifrequency high-resolution electron spin resonance (ESR) technique, in magnetic fields up to 17 T. A field-induced development of the soliton-like incommensurate superstructure is clearly indicated as a pronounced increase of the ESR linewidth $\Delta B$ (magnon excitations), with a $\Delta B_{max}$ at $B_{c}\sim$ 13.8 T. The anomaly is explained in terms of the magnon-soliton scattering, and suggests that the soliton-like phase exists close to the boundary of the dimerized-incommensurate phase transition. In addition, magnetic excitation spectra in 0.8% Si-doped CuGeO$_3$ are studied. Suppression of the $\Delta B$ anomaly observed in the doped samples suggests a collapse of the long-range-ordered soliton states upon doping, that is consistent with high-field neutron scattering experiments.Comment: Accepted to Phys. Rev.

Combinations of β-lactam or aminoglycoside antibiotics with plectasin are synergistic against methicillin-sensitive and methicillin-resistant Staphylococcus aureus.

Bacterial infections remain the leading killer worldwide which is worsened by the continuous emergence of antibiotic resistance. In particular, methicillin-sensitive (MSSA) and methicillin-resistant Staphylococcus aureus (MRSA) are prevalent and the latter can be difficult to treat. The traditional strategy of novel therapeutic drug development inevitably leads to emergence of resistant strains, rendering the new drugs ineffective. Therefore, rejuvenating the therapeutic potentials of existing antibiotics offers an attractive novel strategy. Plectasin, a defensin antimicrobial peptide, potentiates the activities of other antibiotics such as β-lactams, aminoglycosides and glycopeptides against MSSA and MRSA. We performed in vitro and in vivo investigations to test against genetically diverse clinical isolates of MSSA (n = 101) and MRSA (n = 115). Minimum inhibitory concentrations (MIC) were determined by the broth microdilution method. The effects of combining plectasin with β-lactams, aminoglycosides and glycopeptides were examined using the chequerboard method and time kill curves. A murine neutropenic thigh model and a murine peritoneal infection model were used to test the effect of combination in vivo. Determined by factional inhibitory concentration index (FICI), plectasin in combination with aminoglycosides (gentamicin, neomycin or amikacin) displayed synergistic effects in 76-78% of MSSA and MRSA. A similar synergistic response was observed when plectasin was combined with β-lactams (penicillin, amoxicillin or flucloxacillin) in 87-89% of MSSA and MRSA. Interestingly, no such interaction was observed when plectasin was paired with vancomycin. Time kill analysis also demonstrated significant synergistic activities when plectasin was combined with amoxicillin, gentamicin or neomycin. In the murine models, plectasin at doses as low as 8 mg/kg augmented the activities of amoxicillin and gentamicin in successful treatment of MSSA and MRSA infections. We demonstrated that plectasin strongly rejuvenates the therapeutic potencies of existing antibiotics in vitro and in vivo. This is a novel strategy that can have major clinical implications in our fight against bacterial infections

Near-real-time monitoring of global CO₂ emissions reveals the effects of the COVID-19 pandemic

The COVID-19 pandemic is impacting human activities, and in turn energy use and carbon dioxide (CO2) emissions. Here we present daily estimates of country-level CO2 emissions for different sectors based on near-real-time activity data. The key result is an abrupt 8.8% decrease in global CO2 emissions (−1551 Mt CO2) in the first half of 2020 compared to the same period in 2019. The magnitude of this decrease is larger than during previous economic downturns or World War II. The timing of emissions decreases corresponds to lockdown measures in each country. By July 1st, the pandemic’s effects on global emissions diminished as lockdown restrictions relaxed and some economic activities restarted, especially in China and several European countries, but substantial differences persist between countries, with continuing emission declines in the U.S. where coronavirus cases are still increasing substantially

Lessons on Conditional Gene Targeting in Mouse Adipose Tissue

Conditional gene targeting has been extensively used for in vivo analysis of gene function in adipocyte cell biology but often with debate over the tissue specificity and the efficacy of inactivation. To directly compare the specificity and efficacy of different Cre lines in mediating adipocyte specific recombination, transgenic Cre lines driven by the adipocyte protein 2 (aP2) and adiponectin (Adipoq) gene promoters, as well as a tamoxifen-inducible Cre driven by the aP2 gene promoter (iaP2), were bred to the Rosa26R (R26R) reporter. All three Cre lines demonstrated recombination in the brown and white fat pads. Using different floxed loci, the individual Cre lines displayed a range of efficacy to Cre-mediated recombination that ranged from no observable recombination to complete recombination within the fat. The Adipoq-Cre exhibited no observable recombination in any other tissues examined, whereas both aP2-Cre lines resulted in recombination in endothelial cells of the heart and nonendothelial, nonmyocyte cells in the skeletal muscle. In addition, the aP2-Cre line can lead to germline recombination of floxed alleles in ∼2% of spermatozoa. Thus, different “adipocyte-specific” Cre lines display different degrees of efficiency and specificity, illustrating important differences that must be taken into account in their use for studying adipose biology