Jointly Modeling Embedding and Translation to Bridge Video and Language

Automatically describing video content with natural language is a fundamental challenge of multimedia. Recurrent Neural Networks (RNN), which models sequence dynamics, has attracted increasing attention on visual interpretation. However, most existing approaches generate a word locally with given previous words and the visual content, while the relationship between sentence semantics and visual content is not holistically exploited. As a result, the generated sentences may be contextually correct but the semantics (e.g., subjects, verbs or objects) are not true. This paper presents a novel unified framework, named Long Short-Term Memory with visual-semantic Embedding (LSTM-E), which can simultaneously explore the learning of LSTM and visual-semantic embedding. The former aims to locally maximize the probability of generating the next word given previous words and visual content, while the latter is to create a visual-semantic embedding space for enforcing the relationship between the semantics of the entire sentence and visual content. Our proposed LSTM-E consists of three components: a 2-D and/or 3-D deep convolutional neural networks for learning powerful video representation, a deep RNN for generating sentences, and a joint embedding model for exploring the relationships between visual content and sentence semantics. The experiments on YouTube2Text dataset show that our proposed LSTM-E achieves to-date the best reported performance in generating natural sentences: 45.3% and 31.0% in terms of BLEU@4 and METEOR, respectively. We also demonstrate that LSTM-E is superior in predicting Subject-Verb-Object (SVO) triplets to several state-of-the-art techniques

Simulations on the electromechanical poling of ferroelectric ceramics

Based on the two-step-switching model, the process of electromechanical poling of a ferroelectric ceramics is simulated. A difference of the remnant polarizations between two poling protocols (mechanical stress is applied before and after the application of poling field) is found from our simulations, which is also observed in experiment. An explanation is given to illustrate why the remnant polarization for the case that mechanical stress is loaded after the application of electric field is larger than the case that mechanical stress is loaded before the application of electric field. Our simulation results supply a proof for the validity of the two-step-switching model in the electromechanical poling of polycrystalline ferroelectric ceramics.Comment: 11 pages, 2 figure

4,6-Bis[5-methyl-3-(trifluoro­meth­yl)pyrazol-1-yl]pyrimidine

The complete mol­ecule of the the title compound, C14H10F6N6, is generated by crystallographic twofold symmetry, with two C atoms lying on the roatation axis. The dihedral angle between the central and peripheral rings is 25.97 (8)°

Toward efficient indexing structure for scalable content-based music retrieval

Pretendemos problematizar arte e loucura, inicialmente discutindo a experiência do pesquisador em relação às imagens do mundo, com o testemunho e a figura do louco e, consequentemente, com o fora que ela evoca. Em seguida nos colocamos diante do muro, situação-limite na qual a loucura enquanto catástrofe e a arte enquanto via poética vêm compor um limiar, ausência que Blanchot transpõe à linguagem para dar a ver outras constelações possíveis, tanto de palavras quanto de seus inomináveis. Por fim, com Walter Benjamin, pomos a história da loucura a contrapelo, e, mergulhados no Ateliê de Escrita do Hospital Psiquiátrico São Pedro, desvelamos que a arte pode, na relação com a loucura, tornar-se a linguagem essencial na perigosa travessia em direção à experiência, transpondo a vivência desse estado assustador para trazer ao mundo outro sentido, reconhecendo outros modos de existência que podem vir a ser outras poéticas de vida.We intend to problematize art and madness. We begin by discussing the experience of the researcher in relation to images of the world, to witnessing and to the image of the insane, and then inevitably to the outside they evoke. Subsequently, we stand before a wall, a limit situation in which madness as catastrophe and art as poetics compose a threshold, an absence which Blanchot transposes to language to bring other possible constellations into view, both as words and as their unnamable others. Finally, with Walter Benjamin, we touch upon the grain of the history of madness – immersed in the Writing Workshop at the São Pedro Psychiatric Hospital, in Porto Alegre, Brazil, we reveal that, in relation to madness, art can become the essential language of the perilous passage towards experience, transposing the experience of this horrific state to bring another sense to the world, recognizing other modes of existence which may come to be other poetics of life.Nous désirons problématiser l’art et la folie, initialement en discutant l’expérience du chercheur par rapport aux images du monde, avec le témoignage et l’image du fou, et, par conséquent, l’extérieur qu’elle évoque. Puis, on se pose devant le mur, situation extrême dans laquelle la folie comme catastrophe et l’art comme voie poétique composent un seuil viennent à construire un seuil, absence que Blanchot transpose en langage afin de révéler d’autres constellations possibles tant comme des mots, tant comme ses innombrables. Enfin, avec Walter Benjamin, nous prenons l’histoire de la folie à contre-poil, et plongés dans l’Atelier d’écriture de l’Hôpital psychiatrique de São Pedro, à Porto Alegre au Brésil, nous révélons que l’art, par rapport à la folie, peut devenir le langage essentiel de la traversée dangereuse vers l’expérience, en transposant le vécu de cet état terrifiant, afin de donner un autre sens au monde, tout en reconnaissant d’autres modes d’existence qui pourraient devenir d’autres poétiques de vie.Nuestra intención es de problematizar el arte y la locura, inicialmente discutiendo la experiencia del investigador en relación con las imágenes del mundo, el testimonio y la figura del loco, y por lo tanto con el afuera que ella evoca. Seguidamente, nos ponemos delante de un muro, una situación extrema en la que la locura como catástrofe y el arte como vía poética componen un umbral, una ausencia que Blanchot transpone en lenguaje para revelar las otras constelaciones posibles tanto como palabras, tanto como innombrables otros. Por último, con Walter Benjamin, ponemos la historia de la locura a contra pelo, y sumergidos en el Taller de escritura del Hospital Psiquiátrico São Pedro de Porto Alegre, Brasil, desvelamos que, en relación con la locura, el arte puede convertirse en el lenguaje esencial de ese peligroso pasaje que nos conduce a la experiencia, que transpone lo vivido en este estado aterrador para dar otro sentido al mundo, reconociendo otros modos de existencia que pueden llegar a ser otras poéticas de vida

EMIF: Towards a scalable and effective indexing framework for large scale music retrieval

Microsoft Research Asia Gran

Look, Read and Feel: Benchmarking Ads Understanding with Multimodal Multitask Learning

Given the massive market of advertising and the sharply increasing online multimedia content (such as videos), it is now fashionable to promote advertisements (ads) together with the multimedia content. It is exhausted to find relevant ads to match the provided content manually, and hence, some automatic advertising techniques are developed. Since ads are usually hard to understand only according to its visual appearance due to the contained visual metaphor, some other modalities, such as the contained texts, should be exploited for understanding. To further improve user experience, it is necessary to understand both the topic and sentiment of the ads. This motivates us to develop a novel deep multimodal multitask framework to integrate multiple modalities to achieve effective topic and sentiment prediction simultaneously for ads understanding. In particular, our model first extracts multimodal information from ads and learn high-level and comparable representations. The visual metaphor of the ad is decoded in an unsupervised manner. The obtained representations are then fed into the proposed hierarchical multimodal attention modules to learn task-specific representations for final prediction. A multitask loss function is also designed to train both the topic and sentiment prediction models jointly in an end-to-end manner. We conduct extensive experiments on the latest and large advertisement dataset and achieve state-of-the-art performance for both prediction tasks. The obtained results could be utilized as a benchmark for ads understanding.Comment: 8 pages, 5 figure

Beyond object recognition: Visual sentiment analysis with deep coupled adjective and noun neural networks.

Abstract Visual sentiment analysis aims to automatically recognize positive and negative emotions from images. There are three main challenges, including large intra-class variance, fine-grained image categories, and scalability. Most existing methods predominantly focus on one or two challenges, which has limited their performance. In this paper, we propose a novel visual sentiment analysis approach with deep coupled adjective and noun neural networks. Specifically, to reduce the large intra-class variance, we first learn a shared middle-level sentiment representation by jointly learning an adjective and a noun deep neural network with weak label supervision. Second, based on the learned sentiment representation, a prediction network is further optimized to deal with the subtle differences which often exist in the fine-grained image categories. The three networks are trained in an end-to-end manner, where the middle-level representations learned in previous two networks can guide the sentiment network to achieve high performance and fast convergence. Third, we generalize the training with mutual supervision between the learned adjective and noun networks by a Rectified Kullback-Leibler loss (ReKL), when the adjective and noun labels are not available. Extensive experiments on two widelyused datasets show that our method outperforms the state-of-the-art on SentiBank dataset with 10.2% accuracy gain and surpasses the previous best approach on Twitter dataset with clear margins

Antiatherogenic and Anti-Ischemic Properties of Traditional Chinese Medicine Xinkeshu via Endothelial Protecting Function

Including herbal medicine, complementary and alternative medicine (CAM) is popular worldwide. The traditional Chinese medicine xinkeshu has been widely used to treat coronary heart disease in China. This study was designed to investigate the protective effect and probable mechanism of xinkeshu tablet to atherosclerotic myocardial ischemia rabbit. Rabbits were divided into four groups (n = 12 each) and fed with different diet for 12 weeks: Control (standard diet), Model (high-cholesterol diet), XKS (high-cholesterol diet with 184.8 mg/kg/d xinkeshu), and Atorvastatin (high-cholesterol diet with 5.0 mg/kg/d atorvastatin). Plasma lipoprotein, ECG, endothelium-dependent vessel relaxation, histomorphological study, and expressions of eNOS and VCAM-1 on coronary arteries were assessed. The findings showed that, similar to atorvastatin, xinkeshu presented significant effects on rescuing endothelium-dependent vessel relaxation, inhibiting atherosclerotic progress, preventing myocardial ischemia, and changing eNOS and VCAM-1 expression. However, xinkeshu showed no lipoprotein lowering effect in hypercholesterolemia rabbits. The results of the present study indicated that xinkeshu exerted potent antiatherogenic and anti-ischemic properties on atherosclerotic myocardial ischemia rabbit. An endothelial protecting effect may be involved in the mechanism other than antihyperlipidemic effect

Metronidazolium perchlorate

In the crystal structure of the title compound [systematic name: 1-(2-hy­droxy­eth­yl)-2-methyl-5-nitro-1H-imidazol-3-ium perchlorate], C6H10N3O3 +·ClO4 −, the cations are linked by inter­molecular N—H⋯O hydrogen bonds into zigzag chains along the c axis. The cations and anions are connected by O—H⋯O and C—H⋯O hydrogen bonds. A weak intra­molecular C—H⋯O hydrogen bond is also observed