Distributed Stochastic Optimization of the Regularized Risk

Many machine learning algorithms minimize a regularized risk, and stochastic optimization is widely used for this task. When working with massive data, it is desirable to perform stochastic optimization in parallel. Unfortunately, many existing stochastic optimization algorithms cannot be parallelized efficiently. In this paper we show that one can rewrite the regularized risk minimization problem as an equivalent saddle-point problem, and propose an efficient distributed stochastic optimization (DSO) algorithm. We prove the algorithm's rate of convergence; remarkably, our analysis shows that the algorithm scales almost linearly with the number of processors. We also verify with empirical evaluations that the proposed algorithm is competitive with other parallel, general purpose stochastic and batch optimization algorithms for regularized risk minimization

WordRank: Learning Word Embeddings via Robust Ranking

Embedding words in a vector space has gained a lot of attention in recent years. While state-of-the-art methods provide efficient computation of word similarities via a low-dimensional matrix embedding, their motivation is often left unclear. In this paper, we argue that word embedding can be naturally viewed as a ranking problem due to the ranking nature of the evaluation metrics. Then, based on this insight, we propose a novel framework WordRank that efficiently estimates word representations via robust ranking, in which the attention mechanism and robustness to noise are readily achieved via the DCG-like ranking losses. The performance of WordRank is measured in word similarity and word analogy benchmarks, and the results are compared to the state-of-the-art word embedding techniques. Our algorithm is very competitive to the state-of-the- arts on large corpora, while outperforms them by a significant margin when the training set is limited (i.e., sparse and noisy). With 17 million tokens, WordRank performs almost as well as existing methods using 7.2 billion tokens on a popular word similarity benchmark. Our multi-node distributed implementation of WordRank is publicly available for general usage.Comment: Conference on Empirical Methods in Natural Language Processing (EMNLP), November 1-5, 2016, Austin, Texas, US

Levi problem and semistable quotients

A complex space $X$ is in class ${\mathcal Q}_G$ if it is a semistable quotient of the complement to an analytic subset of a Stein manifold by a holomorphic action of a reductive complex Lie group $G$. It is shown that every pseudoconvex unramified domain over $X$ is also in ${\mathcal Q}_G$.Comment: Version 2 - minor edits; 8 page

Light density and color distribution in the earth's shadow

Light density and color in earth shadow during lunar eclips

On hyperbolicity of SU(2)-equivariant, punctured disc bundles over the complex affine quadric

Given a holomorphic line bundle over the complex affine quadric $Q^2$, we investigate its Stein, SU(2)-equivariant disc bundles. Up to equivariant biholomorphism, these are all contained in a maximal one, say $\Omega_{max}$. By removing the zero section to $\Omega_{max}$ one obtains the unique Stein, SU(2)-equivariant, punctured disc bundle over $Q^2$ which contains entire curves. All other such punctured disc bundles are shown to be Kobayashi hyperbolic.Comment: 15 pages, v2: minor changes, to appear in Transformation Group

Polarised epithelial monolayers of the gastric mucosa reveal insights into mucosal homeostasis and defence against infection

Objective Helicobacter pylori causes life-long colonisation of the gastric mucosa, leading to chronic inflammation with increased risk of gastric cancer. Research on the pathogenesis of this infection would strongly benefit from an authentic human in vitro model. Design Antrum-derived gastric glands from surgery specimens served to establish polarised epithelial monolayers via a transient air–liquid interface culture stage to study cross-talk with H. pylori and the adjacent stroma. Results The resulting ‘mucosoid cultures’, so named because they recapitulate key characteristics of the gastric mucosa, represent normal stem cell-driven cultures that can be passaged for months. These highly polarised columnar epithelial layers encompass the various gastric antral cell types and secrete mucus at the apical surface. By default, they differentiate towards a foveolar, MUC5AC-producing phenotype, whereas Wnt signalling stimulates proliferation of MUC6-producing cells and preserves stemness—reminiscent of the gland base. Stromal cells from the lamina propria secrete Wnt inhibitors, antagonising stem-cell niche signalling and inducing differentiation. On infection with H. pylori, a strong inflammatory response is induced preferentially in the undifferentiated basal cell phenotype. Infection of cultures for several weeks produces foci of viable bacteria and a persistent inflammatory condition, while the secreted mucus establishes a barrier that only few bacteria manage to overcome. Conclusion Gastric mucosoid cultures faithfully reproduce the features of normal human gastric epithelium, enabling new approaches for investigating the interaction of H. pylori with the epithelial surface and the cross-talk with the basolateral stromal compartment. Our observations provide striking insights in the regulatory circuits of inflammation and defence.</p

Cefotaxime for the detection of extended-spectrum β-lactamase or plasmid-mediated AmpC β-lactamase and clinical characteristics of cefotaxime-non-susceptible Escherichia coli and Klebsiella pneumoniae bacteraemia.

We investigated the performance of cefotaxime for the detection of extended-spectrum β-lactamase (ESBL) or plasmid-mediated AmpC β-lactamase (pAmpC) and the clinical characteristics of cefotaxime-non-susceptible Escherichia coli or Klebsiella pneumoniae (CTXNS-EK) bacteraemia. All of the consecutive bloodstream isolates between 2005 and 2010 in a Japanese university hospital were characterised using polymerase chain reaction (PCR). Risk factors and outcomes of CTXNS-EK were analysed by multivariate logistic regression analysis. We identified 58 CTXNS-EK (15.6%) from 249 E. coli and 122 K. pneumoniae. Cefotaxime with a minimum inhibitory concentration (MIC) of >1 μg/mL had a sensitivity of 98.3% and a specificity of 99.7% for the detection of ESBL or pAmpC. CTXNS-EK had increased from 4.5% in 2005 to 23% in 2009. Risk factors for CTXNS-EK were previous isolation of multidrug-resistant bacteria, use of oxyimino-cephalosporins or fluoroquinolones, and high Sequential Organ Failure Assessment (SOFA) score. Patients with CTXNS-EK bacteraemia less frequently received appropriate empirical therapy than patients with cefotaxime-susceptible EK bacteraemia (81% vs. 97%, p<0.001) and died within 30 days (21% vs. 5%, p=0.001). Using the current breakpoints of the Clinical and Laboratory Standards Institute (CLSI) or the European Committee on Antimicrobial Susceptibility Testing (EUCAST), cefotaxime alone can identify ESBL or pAmpC producers. CTXNS-EK is an important and increasingly prevalent bacteraemia pathogen