You shall know an object by the company it keeps:An investigation of semantic representations derived from object co-occurrence in visual scenes

AbstractAn influential position in lexical semantics holds that semantic representations for words can be derived through analysis of patterns of lexical co-occurrence in large language corpora. Firth (1957) famously summarised this principle as “you shall know a word by the company it keeps”. We explored whether the same principle could be applied to non-verbal patterns of object co-occurrence in natural scenes. We performed latent semantic analysis (LSA) on a set of photographed scenes in which all of the objects present had been manually labelled. This resulted in a representation of objects in a high-dimensional space in which similarity between two objects indicated the degree to which they appeared in similar scenes. These representations revealed similarities among objects belonging to the same taxonomic category (e.g., items of clothing) as well as cross-category associations (e.g., between fruits and kitchen utensils). We also compared representations generated from this scene dataset with two established methods for elucidating semantic representations: (a) a published database of semantic features generated verbally by participants and (b) LSA applied to a linguistic corpus in the usual fashion. Statistical comparisons of the three methods indicated significant association between the structures revealed by each method, with the scene dataset displaying greater convergence with feature-based representations than did LSA applied to linguistic data. The results indicate that information about the conceptual significance of objects can be extracted from their patterns of co-occurrence in natural environments, opening the possibility for such data to be incorporated into existing models of conceptual representation

23rd Australian Field Company, Royal Australian Engineers

"23 Aust. Field Coy. RAE _________________ Darwin Dec 41 - July 43 _______________ John Berry Aby Fairhall Bill James Bill Hammond".23 Australian Field Company, Royal Australian Engineers _________________ Darwin December 41 - July 43 _______________ John Berry Aby Fairhall Bill James Bill HammondDate:199

Distinct mechanisms mediate visual detection and identification

SummaryA core organizing principle for studies of the brain is that distinct neural pathways mediate distinct behavioral tasks [1, 2]. When two related tasks are mediated by a common pathway, studies of one are likely to generalize to the other. Here, we test whether performance on two laboratory tasks that model object detection and identification are mediated by common mechanisms of visual adaptation. Although both tasks rely on the luminance pattern in images, their demands on visual processing are quite different. Object detection requires discriminating image luminance differences associated with the light reflected from adjacent objects. To encode these differences reliably, neurons adapt their limited dynamic range to prevailing viewing conditions [3–6]. Object identification, on the other hand, demands a fixed response to light reflected from an object independent of illumination [7]. We compared performance in discrimination and identification tasks for simulated surfaces. In striking contrast to studies with less structured contexts, we found clear evidence that distinct processes mediate judgments in the two tasks. These results challenge models that account for perceived lightness entirely through the action of image-encoding mechanisms