Cross-cultural representations of musical shape

In cross-cultural research involving performers from distinct cultural backgrounds (U.K., Japan, Papua New Guinea), we examined 75 musicians' associations between musical sound and shape, and saw pronounced differences between groups. Participants heard short stimuli varying in pitch contour and were asked to represent these visually on paper, with the instruction that if another community member saw the marks they should be able to connect them with the sounds. Participants from the U.K. group produced consistent symbolic representations, which involved depicting the passage of time from left-to-right. Japanese participants unfamiliar with English language and western standard notation provided responses comparable to the U.K. group's. The majority opted to use a horizontal timeline, whilst a minority of traditional Japanese musicians produced unique responses with time represented vertically. The last group, a non-literate Papua New Guinean tribe known as BenaBena, produced a majority of iconic responses which did not follow the time versus pitch contour model, but highlighted musical qualities other than the parameters intentionally varied in the investigation, focusing on hue and loudness. The participants' responses point to profoundly different 'norms' of musical shape association, which may be linked to literacy and to the functional role of music in a community

Visualization in spatial modeling

This chapter deals with issues arising from a central theme in contemporary computer modeling - visualization. We first tie visualization to varieties of modeling along the continuum from iconic to symbolic and then focus on the notion that our models are so intrinsically complex that there are many different types of visualization that might be developed in their understanding and implementation. This focuses the debate on the very way of 'doing science' in that patterns and processes of any complexity can be better understood through visualizing the data, the simulations, and the outcomes that such models generate. As we have grown more sensitive to the problem of complexity in all systems, we are more aware that the twin goals of parsimony and verifiability which have dominated scientific theory since the 'Enlightenment' are up for grabs: good theories and models must 'look right' despite what our statistics and causal logics tell us. Visualization is the cutting edge of this new way of thinking about science but its styles vary enormously with context. Here we define three varieties: visualization of complicated systems to make things simple or at least explicable, which is the role of pedagogy; visualization to explore unanticipated outcomes and to refine processes that interact in unanticipated ways; and visualization to enable end users with no prior understanding of the science but a deep understanding of the problem to engage in using models for prediction, prescription, and control. We illustrate these themes with a model of an agricultural market which is the basis of modern urban economics - the von Thünen model of land rent and density; a model of urban development based on interacting spatial and temporal processes of land development - the DUEM model; and a pedestrian model of human movement at the fine scale where control of such movements to meet standards of public safety is intrinsically part of the model about which the controllers know intimately. © Springer-Verlag Berlin Heidelberg 2006

Departure from the onset-onset rule

Using a signal-detection task, the generality of Turvey's (1973) onset-onset rule was tested in four experiments. After seeing, in succession, (1) one or two letters (target display), (2) a multiletter detection display, and (3) a mask display, subjects decided whether or not the letter or letters in the target display reappeared in the succeeding detection display at different levels of detection-display duration in various situations. The subjects' sensitivity was inconsistent with the onset-onset rule. More specifically, sensitivity increased with increases in display duration within a fixed stimulus onset asynchrony of 150 msec. Display duration, however, had no effect on response bias. Nor was there any interaction between display duration and display size in terms of either sensitivity or response bias. The more complicated relationship between display duration and display size does not invalidate the departure from the onset-onset rule

Efficient video collection association using geometry-aware Bag-of-Iconics representations

Abstract Recent years have witnessed the dramatic evolution in visual data volume and processing capabilities. For example, technical advances have enabled 3D modeling from large-scale crowdsourced photo collections. Compared to static image datasets, exploration and exploitation of Internet video collections are still largely unsolved. To address this challenge, we first propose to represent video contents using a histogram representation of iconic imagery attained from relevant visual datasets. We then develop a data-driven framework for a fully unsupervised extraction of such representations. Our novel Bag-of-Iconics (BoI) representation efficiently analyzes individual videos within a large-scale video collection. We demonstrate our proposed BoI representation with two novel applications: (1) finding video sequences connecting adjacent landmarks and aligning reconstructed 3D models and (2) retrieving geometrically relevant clips from video collections. Results on crowdsourced datasets illustrate the efficiency and effectiveness of our proposed Bag-of-Iconics representation

Iconic memory, location information, and partial report

It has been suggested that the systematic decline of partial report as the delay of the partial-report cue increases is due to a time-related loss of location information. Moreover, the backward masking effect is said to be precipitated by the disruption of location information before and after identification. Results from three experiments do not support these claims when new indices of location information and of item information are used. Instead, it was found that (a) the systematic decline in partial report was due to a time-related loss of item information, and (b) location information was affected neither by the delay of the partial-report cue nor by the delay of backward masking. Subjects adopted the "select-then-identify" mode of processing

Capacity limitations of visual memory in two-interval comparison of Gabor arrays

The capacity of short-term visual memory (VSTM) was assessed in a two-interval spatial frequency (SF) discrimination task. The cued Gabor target in a multi-element array either increased or decreased in SF across a 2s interstimulus interval (ISI). Distracters as well as target were made to change across ISI so that memory of the individual SF of Gabor elements was required to solve the discrimination. The dynamics of the information loss from visual memory were analysed by manipulating the timing of spatial cues and masks. Cueing the target position before the first display gave thresholds comparable with those for a single Gabor patch. Cues placed after the first display gave higher thresholds indicating some loss of information. Within the ISI there was little increase in threshold or set size effect with cue delay. However there was a sharp rise in thresholds for cue positions after the second display. Gabor masks placed before a mid-ISI cue were more effective than noise masks or Gabor masks placed after the cue. With a cue placed late in the ISI, preceded by a Gabor mask, the masking effect decreased with increasing delay of the mask after the first display. This suggests a selective, dynamic but increasingly durable representation of the initial stimulus is built up in memory, and there is a graded form of “overwriting” of this representation by new stimuli

Beyond the icon: Core cognition and the bounds of perception

This paper refines a controversial proposal: that core systems belong to a perceptual kind, marked out by the format of its representational outputs. Following Susan Carey, this proposal has been understood in terms of core representations having an iconic format, like certain paradigmatically perceptual outputs. I argue that they don’t, but suggest that the proposal may be better formulated in terms of a broader analogue format type. Formulated in this way, the proposal accommodates the existence of genuine icons in perception, and avoids otherwise troubling objections