Visually Grounded Word Embeddings and Richer Visual Features for Improving Multimodal Neural Machine Translation

In Multimodal Neural Machine Translation (MNMT), a neural model generates a translated sentence that describes an image, given the image itself and one source descriptions in English. This is considered as the multimodal image caption translation task. The images are processed with Convolutional Neural Network (CNN) to extract visual features exploitable by the translation model. So far, the CNNs used are pre-trained on object detection and localization task. We hypothesize that richer architecture, such as dense captioning models, may be more suitable for MNMT and could lead to improved translations. We extend this intuition to the word-embeddings, where we compute both linguistic and visual representation for our corpus vocabulary. We combine and compare different confiComment: Accepted to GLU 2017. arXiv admin note: text overlap with arXiv:1707.0099

An empirical study on the effectiveness of images in Multimodal Neural Machine Translation

In state-of-the-art Neural Machine Translation (NMT), an attention mechanism is used during decoding to enhance the translation. At every step, the decoder uses this mechanism to focus on different parts of the source sentence to gather the most useful information before outputting its target word. Recently, the effectiveness of the attention mechanism has also been explored for multimodal tasks, where it becomes possible to focus both on sentence parts and image regions that they describe. In this paper, we compare several attention mechanism on the multimodal translation task (English, image to German) and evaluate the ability of the model to make use of images to improve translation. We surpass state-of-the-art scores on the Multi30k data set, we nevertheless identify and report different misbehavior of the machine while translating.Comment: Accepted to EMNLP 201

Luxación Posterior de Hombro

Se presentan cuatro casos de luxación posterior de hombro , de etiología trau - mática aguda . Se realiza una reseña de las características anatomopatológicas, del estudio clínico y radiográfico así como del tratamiento que fué conservador en todos los casos, utilizándose sólo en dos casos de reducción inestable fijación con agujas de Kirschner. La valoración de los resultados fué uniformemente buenaTh e author s repor t fou r case s o f posterio r shoulde r dislocatio n o f traumati c etiology , emphasizin g th e followin g aspects: Clinica l an d X-ra y traits, the - rapeuti c procedure s an d follow-u p results. Tw o case s wer e treate d withou t surger y a n d anothe r tw o stabilizatio n wit h Kirschne r wire s wa s used . En d results wer e uniformel y good