Image Representations and New Domains in Neural Image Captioning

We examine the possibility that recent promising results in automatic caption generation are due primarily to language models. By varying image representation quality produced by a convolutional neural network, we find that a state-of-the-art neural captioning algorithm is able to produce quality captions even when provided with surprisingly poor image representations. We replicate this result in a new, fine-grained, transfer learned captioning domain, consisting of 66K recipe image/title pairs. We also provide some experiments regarding the appropriateness of datasets for automatic captioning, and find that having multiple captions per image is beneficial, but not an absolute requirement.Comment: 11 Pages, 5 Images, To appear at EMNLP 2015's Vision + Learning worksho

Cost-Effective HITs for Relative Similarity Comparisons

Similarity comparisons of the form "Is object a more similar to b than to c?" are useful for computer vision and machine learning applications. Unfortunately, an embedding of $n$ points is specified by $n^3$ triplets, making collecting every triplet an expensive task. In noticing this difficulty, other researchers have investigated more intelligent triplet sampling techniques, but they do not study their effectiveness or their potential drawbacks. Although it is important to reduce the number of collected triplets, it is also important to understand how best to display a triplet collection task to a user. In this work we explore an alternative display for collecting triplets and analyze the monetary cost and speed of the display. We propose best practices for creating cost effective human intelligence tasks for collecting triplets. We show that rather than changing the sampling algorithm, simple changes to the crowdsourcing UI can lead to much higher quality embeddings. We also provide a dataset as well as the labels collected from crowd workers.Comment: 7 pages, 7 figure

Response of the Guinea Pig Heart to Hypothermia

Author Institution: Colorado State University, Fort Collings, Colorado and University of California, Davis, CaliforniaElectrocardiograms were obtained from guinea pigs acclimatized to 8°C and 22 °C respectively and then observed at 4°-5°C. No differences were recorded in cardiac responses to cold in guinea pigs from the two acclimatization temperatures. Heart rate decreased linearly with body temperature. Various durations on the ECG record varied non-linearly with temperature: y = a+b/(x-c), where y is duration, e.g. T wave, x is colonic temperature in °C, and a and b are constants, giving respectively the value of y when x is 0°C and the slope of the line relating body temperature to y. The Qi0 value of the heart rate varies with temperature