Variational Deep Semantic Hashing for Text Documents

As the amount of textual data has been rapidly increasing over the past decade, efficient similarity search methods have become a crucial component of large-scale information retrieval systems. A popular strategy is to represent original data samples by compact binary codes through hashing. A spectrum of machine learning methods have been utilized, but they often lack expressiveness and flexibility in modeling to learn effective representations. The recent advances of deep learning in a wide range of applications has demonstrated its capability to learn robust and powerful feature representations for complex data. Especially, deep generative models naturally combine the expressiveness of probabilistic generative models with the high capacity of deep neural networks, which is very suitable for text modeling. However, little work has leveraged the recent progress in deep learning for text hashing. In this paper, we propose a series of novel deep document generative models for text hashing. The first proposed model is unsupervised while the second one is supervised by utilizing document labels/tags for hashing. The third model further considers document-specific factors that affect the generation of words. The probabilistic generative formulation of the proposed models provides a principled framework for model extension, uncertainty estimation, simulation, and interpretability. Based on variational inference and reparameterization, the proposed models can be interpreted as encoder-decoder deep neural networks and thus they are capable of learning complex nonlinear distributed representations of the original documents. We conduct a comprehensive set of experiments on four public testbeds. The experimental results have demonstrated the effectiveness of the proposed supervised learning models for text hashing.Comment: 11 pages, 4 figure

Neural Attentive Session-based Recommendation

Given e-commerce scenarios that user profiles are invisible, session-based recommendation is proposed to generate recommendation results from short sessions. Previous work only considers the user's sequential behavior in the current session, whereas the user's main purpose in the current session is not emphasized. In this paper, we propose a novel neural networks framework, i.e., Neural Attentive Recommendation Machine (NARM), to tackle this problem. Specifically, we explore a hybrid encoder with an attention mechanism to model the user's sequential behavior and capture the user's main purpose in the current session, which are combined as a unified session representation later. We then compute the recommendation scores for each candidate item with a bi-linear matching scheme based on this unified session representation. We train NARM by jointly learning the item and session representations as well as their matchings. We carried out extensive experiments on two benchmark datasets. Our experimental results show that NARM outperforms state-of-the-art baselines on both datasets. Furthermore, we also find that NARM achieves a significant improvement on long sessions, which demonstrates its advantages in modeling the user's sequential behavior and main purpose simultaneously.Comment: Proceedings of the 2017 ACM on Conference on Information and Knowledge Management. arXiv admin note: text overlap with arXiv:1511.06939, arXiv:1606.08117 by other author

Provenance and geochemistry of exotic clasts in conglomerates of the Oligocene Torehina Formation, Coromandel Peninsula, New Zealand

Non-marine pebble to cobble conglomerates of the lower Torehina Formation (Oligocene) crop out along western Coromandel Peninsula and overlie, with strong angular discordance, continental-margin metasedimentary rocks (Manaia Hill Group) of Mesozoic (Late Jurassic to ?Early Cretaceous) age. The conglomerates contain provenance information that identifies a pre-Oligocene depositional history obscured by the unconformable juxtaposition of these Tertiary and Mesozoic strata. Most clasts in the lower Torehina Formation are visually similar to local bedrock lithologies, including metamorphosed sandstones and argillites, but are kaolinitic and contain more detrital and authigenic chert, quartz, and potash feldspar. Local derivation of these clasts seems unlikely. By comparing geochemical ratios with those defined for continental margin sandstones, and well characterised New Zealand tectonic terranes, we interpret the majority of clasts in the lower Torehina Formation to have been derived from a dissected orogen, with mixtures of felsic and volcanogenic-derived sediment. The most likely sources are the Waipapa and Torlesse Terranes. The remaining 20–30% of the clasts in the lower Torehina Formation were originally friable, are coarse grained, and appear to be lithologically exotic relative to known metamorphosed sandstones in basement terrane sources on North Island. Some clasts contain coal laminae and particles, and all contain detrital kaolinite as lithic fragments and matrix. Such characteristics imply a non-marine to marginal-marine source containing sediment derived from strongly weathered granite or granodiorite. Mechanical fragility implies a likely proximal, easily erodible source. We propose that this group of clasts was derived from an Upper Cretaceous sedimentary cover, either part of a locally developed basin fill or part of a once regionally extensive cover on North Island. Either case defines a more widely distributed Cretaceous source than found today

Anharmonic effects in the A15 compounds induced by sublattice distortions

We demonstrate that elastic anomalies and lattice instabilities in the the A15 compounds are describable in terms of first-principles LDA electronic structure calculations. We show that at T=0 V_3Si, V_3Ge, and Nb_3Sn are intrinsically unstable against shears with elastic moduli C_11-C_12 and C_44, and that the zone center phonons, Gamma_2 and Gamma_12, are either unstable or extremely soft. We demonstrate that sublattice relaxation (internal strain) effects are key to understanding the behavior of the A15 materials.Comment: 5 pages, RevTex, 3 postscript figures, Submitted to Phys. Rev. Lett. Apr. 23, 1997 July 7, 1997: minor corrections, final accepted versio

User Intent Prediction in Information-seeking Conversations

Conversational assistants are being progressively adopted by the general population. However, they are not capable of handling complicated information-seeking tasks that involve multiple turns of information exchange. Due to the limited communication bandwidth in conversational search, it is important for conversational assistants to accurately detect and predict user intent in information-seeking conversations. In this paper, we investigate two aspects of user intent prediction in an information-seeking setting. First, we extract features based on the content, structural, and sentiment characteristics of a given utterance, and use classic machine learning methods to perform user intent prediction. We then conduct an in-depth feature importance analysis to identify key features in this prediction task. We find that structural features contribute most to the prediction performance. Given this finding, we construct neural classifiers to incorporate context information and achieve better performance without feature engineering. Our findings can provide insights into the important factors and effective methods of user intent prediction in information-seeking conversations.Comment: Accepted to CHIIR 201

Drivers of diversity in human thermal perception – A review for holistic comfort models

Understanding the drivers leading to individual differences in human thermal perception has become increasingly important, amongst other things due to challenges such as climate change and an ageing society. This review summarizes existing knowledge related to physiological, psychological, and context-related drivers of diversity in thermal perception. Furthermore, the current state of knowledge is discussed in terms of its applicability in thermal comfort models, by combining modelling approaches of the thermoneutral zone (TNZ) and adaptive thermal heat balance model (ATHB). In conclusion, the results of this review show the clear contribution of some physiological and psychological factors, such as body composition, metabolic rate, adaptation to certain thermal environments and perceived control, to differences in thermal perception. However, the role of other potential diversity-causing parameters, such as age and sex, remain uncertain. Further research is suggested, especially regarding the interaction of different diversity-driving factors with each other, both physiological and psychological, to help establishing a holistic picture

Interpretable Subgroup Discovery in Treatment Effect Estimation with Application to Opioid Prescribing Guidelines

The dearth of prescribing guidelines for physicians is one key driver of the current opioid epidemic in the United States. In this work, we analyze medical and pharmaceutical claims data to draw insights on characteristics of patients who are more prone to adverse outcomes after an initial synthetic opioid prescription. Toward this end, we propose a generative model that allows discovery from observational data of subgroups that demonstrate an enhanced or diminished causal effect due to treatment. Our approach models these sub-populations as a mixture distribution, using sparsity to enhance interpretability, while jointly learning nonlinear predictors of the potential outcomes to better adjust for confounding. The approach leads to human-interpretable insights on discovered subgroups, improving the practical utility for decision suppor