Mixing representation levels: The hybrid approach to automatic text generation

Natural language generation systems (NLG) map non-linguistic representations into strings of words through a number of steps using intermediate representations of various levels of abstraction. Template based systems, by contrast, tend to use only one representation level, i.e. fixed strings, which are combined, possibly in a sophisticated way, to generate the final text. In some circumstances, it may be profitable to combine NLG and template based techniques. The issue of combining generation techniques can be seen in more abstract terms as the issue of mixing levels of representation of different degrees of linguistic abstraction. This paper aims at defining a reference architecture for systems using mixed representations. We argue that mixed representations can be used without abandoning a linguistically grounded approach to language generation.Comment: 6 page

Motion sequence analysis in the presence of figural cues

Published in final edited form as: Neurocomputing. 2015 January 5, 147: 485–491The perception of 3-D structure in dynamic sequences is believed to be subserved primarily through the use of motion cues. However, real-world sequences contain many figural shape cues besides the dynamic ones. We hypothesize that if figural cues are perceptually significant during sequence analysis, then inconsistencies in these cues over time would lead to percepts of non-rigidity in sequences showing physically rigid objects in motion. We develop an experimental paradigm to test this hypothesis and present results with two patients with impairments in motion perception due to focal neurological damage, as well as two control subjects. Consistent with our hypothesis, the data suggest that figural cues strongly influence the perception of structure in motion sequences, even to the extent of inducing non-rigid percepts in sequences where motion information alone would yield rigid structures. Beyond helping to probe the issue of shape perception, our experimental paradigm might also serve as a possible perceptual assessment tool in a clinical setting.The authors wish to thank all observers who participated in the experiments reported here. This research and the preparation of this manuscript was supported by the National Institutes of Health RO1 NS064100 grant to LMV. (RO1 NS064100 - National Institutes of Health)Accepted manuscrip

Dissociation of first- and second-order motion systems by perceptual learning

Published in final edited form as: Atten Percept Psychophys. 2012 July ; 74(5): 1009–1019. doi:10.3758/s13414-012-0290-3.Previous studies investigating transfer of perceptual learning between luminance-defined (LD) motion and texture-contrast-defined (CD) motion tasks have found little or no transfer from LD to CD motion tasks but nearly perfect transfer from CD to LD motion tasks. Here, we introduce a paradigm that yields a clean double dissociation: LD training yields no transfer to the CD task, but more interestingly, CD training yields no transfer to the LD task. Participants were trained in two variants of a global motion task. In one (LD) variant, motion was defined by tokens that differed from the background in mean luminance. In the other (CD) variant, motion was defined by tokens that had mean luminance equal to the background but differed from the background in texture contrast. The task was to judge whether the signal tokens were moving to the right or to the left. Task difficulty was varied by manipulating the proportion of tokens that moved coherently across the four frames of the stimulus display. Performance in each of the LD and CD variants of the task was measured as training proceeded. In each task, training produced substantial improvement in performance in the trained task; however, in neither case did this improvement show any significant transfer to the nontrained task.This work was supported in part by NSF Award BCS-0843897 to Dr. Chubb and in part by Award Number RO1NS064100 from the National Institutes of Health, National Institute of Neurological Disorders and Stroke to Dr. Vaina. (BCS-0843897 - NSF; RO1NS064100 - National Institutes of Health, National Institute of Neurological Disorders and Stroke)Accepted manuscrip

Neuropsychological evidence for three distinct motion mechanisms

Published in final edited form as: Neurosci Lett. 2011 May 16; 495(2): 102–106. doi:10.1016/j.neulet.2011.03.048.We describe psychophysical performance of two stroke patients with lesions in distinct cortical regions in the left hemisphere. Both patients were selectively impaired on direction discrimination in several local and global second-order but not first-order motion tasks. However, only patient FD was impaired on a specific bi-stable motion task where the direction of motion is biased by object similarity. We suggest that this bi-stable motion task may be mediated by a high-level attention or position based mechanism indicating a separate neurological substrate for a high-level attention or position-based mechanism. Therefore, these results provide evidence for the existence of at least three motion mechanisms in the human visual system: a low-level first- and second-order motion mechanism and a high-level attention or position-based mechanism.Accepted manuscrip

The evolution of the colour-magnitude relation and of the star formation activity in galaxy clusters since z~0.8

We present recent results on the evolution of the colour-magnitude relation and of the star formation activity in galaxy clusters since z~0.8. Results are based on the ESO Distant Cluster Survey (EDisCS) - an ESO large programme aimed at the study of cluster structure and cluster galaxy evolution over a significant fraction of cosmic time - and are discussed in the framework of the current standard paradigm of structure formation.Comment: 8 pages, 5 figure, to appear in ASP Conference Series (Proceedings of the 1st Subaru International Conference "Panoramic Views of Galaxy Formation and Evolution", held in Japan, 10-15 December 2007

An Effect of Relative Motion on Trajectory Discrimination

Psychophysical studies point to the existence of specialized mechanisms sensitive to the relative motion between an object and its background. Such mechanisms would seem ideal for the motion-based segmentation of objects; however, their properties and role in processing the visual scene remain unclear. Here we examine the contribution of relative motion mechanisms to the processing of object trajectory. In a series of four psychophysical experiments we examine systematically the effects of relative direction and speed differences on the perceived trajectory of an object against a moving background. We show that background motion systematically influences the discrimination of object direction. Subjects’ ability to discriminate direction was consistently better for objects moving opposite a translating background than for objects moving in the same direction as the background. This effect was limited to the case of a translating background and did not affect perceived trajectory for more complex background motions associated with self-motion. We interpret these differences as providing support for the role of relative motion mechanisms in the segmentation and representation of object motions that do not occlude the path of an observer’s self-motion

Ergodicity and spectral cascades in point vortex flows on the sphere

A.C.P. was supported under DOD (MURI) Grant No. N000141110087 ONR. The computations were supported by the CUNY HPCC under NSF Grants No. CNS-0855217 and No. CNS-0958379.We present results for the equilibrium statistics and dynamic evolution of moderately large [n = O (102 - 103)] numbers of interacting point vortices on the sphere under the constraint of zero mean angular momentum. For systems with equal numbers of positive and negative identical circulations, the density of rescaled energies, p(E), converges rapidly with n to a function with a single maximum with maximum entropy. Ensemble-averaged wave-number spectra of the nonsingular velocity field induced by the vortices exhibit the expected k-1 behavior at small scales for all energies. Spectra at the largest scales vary continuously with the inverse temperature of the system. For positive temperatures, spectra peak at finite intermediate wave numbers; for negative temperatures, spectra decrease everywhere. Comparisons of time and ensemble averages, over a large range of energies, strongly support ergodicity in the dynamics even for highly atypical initial vortex configurations. Crucially, rapid relaxation of spectra toward the microcanonical average implies that the direction of any spectral cascade process depends only on the relative difference between the initial spectrum and the ensemble mean spectrum at that energy, not on the energy, or temperature, of the system.Publisher PDFPeer reviewe

Interaction of cortical networks mediating object motion detection by moving observers

Published in final edited form as: Exp Brain Res. 2012 August ; 221(2): 177–189. doi:10.1007/s00221-012-3159-8.The task of parceling perceived visual motion into self- and object motion components is critical to safe and accurate visually guided navigation. In this paper, we used functional magnetic resonance imaging to determine the cortical areas functionally active in this task and the pattern connectivity among them to investigate the cortical regions of interest and networks that allow subjects to detect object motion separately from induced self-motion. Subjects were presented with nine textured objects during simulated forward self-motion and were asked to identify the target object, which had an additional, independent motion component toward or away from the observer. Cortical activation was distributed among occipital, intra-parietal and fronto-parietal areas. We performed a network analysis of connectivity data derived from partial correlation and multivariate Granger causality analyses among functionally active areas. This revealed four coarsely separated network clusters: bilateral V1 and V2; visually responsive occipito-temporal areas, including bilateral LO, V3A, KO (V3B) and hMT; bilateral VIP, DIPSM and right precuneus; and a cluster of higher, primarily left hemispheric regions, including the central sulcus, post-, pre- and sub-central sulci, pre-central gyrus, and FEF. We suggest that the visually responsive networks are involved in forming the representation of the visual stimulus, while the higher, left hemisphere cluster is involved in mediating the interpretation of the stimulus for action. Our main focus was on the relationships of activations during our task among the visually responsive areas. To determine the properties of the mechanism corresponding to the visual processing networks, we compared subjects’ psychophysical performance to a model of object motion detection based solely on relative motion among objects and found that it was inconsistent with observer performance. Our results support the use of scene context (e.g., eccentricity, depth) in the detection of object motion. We suggest that the cortical activation and visually responsive networks provide a potential substrate for this computation.This work was supported by NIH grant RO1NS064100 to L.M.V. We thank Victor Solo for discussions regarding models of functional connectivity and our subjects for participating in the psychophysical and fMRI experiments. This research was carried out in part at the Athinoula A. Martinos Center for Biomedical Imaging at the Massachusetts General Hospital, using resources provided by the Center for Functional Neuroimaging Technologies, P41RR14075, a P41 Regional Resource supported by the Biomedical Technology Program of the National Center for Research Resources (NCRR), National Institutes of Health. This work also involved the use of instrumentation supported by the NCRR Shared Instrumentation Grant Program and/or High-End Instrumentation Grant Program; specifically, grant number S10RR021110. (RO1NS064100 - NIH; National Center for Research Resources (NCRR), National Institutes of Health; S10RR021110 - NCRR)Accepted manuscrip