Improved Cross-correlation for Template Matching on the Laplacian Pyramid

Template matching via cross-correlation on Laplacian pyramid image architectures has been traditionally performed in a "coarse" to "fine" fashion. In the present paper, we show that by computing cross-correlation within each level of the pyramid independently, and considering the su, across (expanded) levels, a significant improvement in Peak to Correlation Energy (PCE) [9] is obtained. This result is illustrated with a number of numerical examples

Real-Time Restoration of Images Degraded by Uniform Motion Blur in Foveal Active Vision Systems

Foveated, log-polar, or space-variant image architectures provide a high resolution and wide field workspace, while providing a small pixel computation load. These characteristics are ideal for mobile robotic and active vision applications. Recently we have described a generalization of the Fourier Transform (the fast exponential chirp transform) which allows frame-rate computation of full-field 2D frequency transforms on a log-polar image format. In the present work, we use Wiener filtering, performed using the Exponential Chirp Transform, on log-polar (fovcated) image formats to de-blur images which have been degraded by uniform camera motion.Defense Advanced Research Projects Agency and Office of Naval Research (N00014-96-C-0178); Office of Naval Research Multidisciplinary University Research Initiative (N00014-95-1-0409

Computing with the Integrate and Fire Neuron: Weber's Law, Multiplication and Phase Detection

The integrate and fire model (Stein, 1967) provides an analytically tractable formalism of neuronal firing rate in terms of a neuron's membrane time constant, threshold and refractory period. Integrate and fire (IAF) neurons have mainly been used to model physiologically realistic spike trains but little application of the IAF model appears to have been made in an explicitly computational context. In this paper we show that the transfer function of an IAF neuron provides, over a wide parameter range, a compressive nonlinearity sufficiently close to that of the logarithm so that IAF neurons can be used to multiply neural signals by mere addition of their outputs. Thus, although the IAF transfer function is not explicitly logarithmic, its compressive parameter regime supports a simple, single neuron model for multiplication. A simulation of the IAF multiplier shows that under a wide choice of parameters, the IAF neuron can multiply its inputs to within a 5% relative error. We also show that an IAF neuron under a different, yet biologically reasonable, parameter regime can have a quasi-linear transfer function, acting as an adder or a gain node. We then show an application in which the compressive transfer function of the IAF model provides a simple mechanism for phase-detection: multiplication of 40Hz phasic inputs followed by low-pass filtering yields an output that is a quasi-linear function of the relative phase of the inputs. This is a neural version of the heterodyne phase detection principle. Finally, we briefly discuss the precision and dynamic range of an IAF multiplier that is restricted to reasonable firing rates (in the range of 10-300 Hz) and reasonable computation time (in the range of 25-200 milliseconds).National Institute of Mental Health (5R01MH45969-04); Office of Naval Research (N00014-95-1-0409

Topographic Shear and the Relation of Ocular Dominance Columns to Orientation Columns in Prime and Cat Visual Cortex

Shear has been known to exist for many years in the topographic structure of prirnary visual cortex, but has received little attention in the modeling literature. Although the topographic map of V1 is largely conformal (i.e. zero shear), several groups have observed topographic shear in the region of the V1/V2 border. Furthennore, shear has also been revealed by anisotropy of cortical magnification factor within a single ocular dominance colunm. In the present paper, we make a functional hypothesis: the major axis of the topographic shear tensor provides cortical neurons with a preferred direction of orientation tuning. We demonstrate that isotropic neuronal summation of a sheared topographic map, in the presence of additional random shear can provide the major features of corlical functional architecture with the ocular dominance column system acting as the principal source of the shear tensor. The major principal axis of the shear tensor determines the direction and its eigenvalues the relative strength of cortical orientation preference. This hypothesis is then shown to be qualitatively consistent with a variety of experimental results on cat and monkey orientation column properties obtained from optical recording and from other anatomical and physiological techniques. In addition, we show that a recent result of (Das and Gilbert, 1997) is consistent with an infinite set of parameterized solutions for the cortical map. We exploit this freedom to choose a particular instance of the Das-Gilbert solution set which is consistent with the full range of local spatial structure in V1. These results suggest that further relationships between ocular dominance columns, orientation columns, and local topography may be revealed by experimental testing

The Local Structure of Space-Variant Images

Local image structure is widely used in theories of both machine and biological vision. The form of the differential operators describing this structure for space-invariant images has been well documented (e.g. Koenderink, 1984). Although space-variant coordinates are universally used in mammalian visual systems, the form of the operators in the space-variant domain has received little attention. In this report we derive the form of the most common differential operators and surface characteristics in the space-variant domain and show examples of their use. The operators include the Laplacian, the gradient and the divergence, as well as the fundamental forms of the image treated as a surface. We illustrate the use of these results by deriving the space-variant form of corner detection and image enhancement algorithms. The latter is shown to have interesting properties in the complex log domain, implicitly encoding a variable grid-size integration of the underlying PDE, allowing rapid enhancement of large scale peripheral features while preserving high spatial frequencies in the fovea.Office of Naval Research (N00014-95-I-0409

Real-Time Anisotropic Diffusion using Space-Variant Vision

Many computer and robot vision applications require multi-scale image analysis. Classically, this has been accomplished through the use of a linear scale-space, which is constructed by convolution of visual input with Gaussian kernels of varying size (scale). This has been shown to be equivalent to the solution of a linear diffusion equation on an infinite domain, as the Gaussian is the Green's function of such a system (Koenderink, 1984). Recently, much work has been focused on the use of a variable conductance function resulting in anisotropic diffusion described by a nonlinear partial differential equation (PDF). The use of anisotropic diffusion with a conductance coefficient which is a decreasing function of the gradient magnitude has been shown to enhance edges, while decreasing some types of noise (Perona and Malik, 1987). Unfortunately, the solution of the anisotropic diffusion equation requires the numerical integration of a nonlinear PDF which is a costly process when carried out on a fixed mesh such as a typical image. In this paper we show that the complex log transformation, variants of which are universally used in mammalian retino-cortical systems, allows the nonlinear diffusion equation to be integrated at exponentially enhanced rates due to the non-uniform mesh spacing inherent in the log domain. The enhanced integration rates, coupled with the intrinsic compression of the complex log transformation, yields a seed increase of between two and three orders of magnitude, providing a means of performing real-time image enhancement using anisotropic diffusion.Office of Naval Research (N00014-95-I-0409

Exact Geosedics and Shortest Paths on Polyhedral Surface

We present two algorithms for computing distances along a non-convex polyhedral surface. The first algorithm computes exact minimal-geodesic distances and the second algorithm combines these distances to compute exact shortest-path distances along the surface. Both algorithms have been extended to compute the exact minimalgeodesic paths and shortest paths. These algorithms have been implemented and validated on surfaces for which the correct solutions are known, in order to verify the accuracy and to measure the run-time performance, which is cubic or less for each algorithm. The exact-distance computations carried out by these algorithms are feasible for large-scale surfaces containing tens of thousands of vertices, and are a necessary component of near-isometric surface flattening methods that accurately transform curved manifolds into flat representations.National Institute for Biomedical Imaging and Bioengineering (R01 EB001550

Multi-Area Visuotopic Map Complexes in Macaque Striate and Extra-striate Cortex

We propose that a simple, closed-form mathematical expression--the Wedge-Dipole mapping--provides a concise approximation to the full-field, two-dimensional topographic structure of macaque V1, V2, and V3. A single map function, which we term a map complex, acts as a simultaneous descriptor of all three areas. Quantitative estimation of the Wedge-Dipole parameters is provided via 2DG data of central-field V1 topography and a publicly available data set of full-field macaque V1 and V2 topography. Good quantitative agreement is obtained between the data and the model presented here. The increasing importance of fMRI-based brain imaging motivates the development of more sophisticated two-dimensional models of cortical visuotopy, in contrast to the one-dimensional approximations that have been in common use. One reason is that topography has traditionally supplied an important aspect of "ground truth", or validation, for brain imaging, suggesting that further development of high-resolution fMRI will be facilitated by this data analysis. In addition, several important insights into the nature of cortical topography follows from this work. The presence of anisotropy in cortical magnification factor is shown to follow mathematically from the shared boundary conditions at the V1-V2 and V2-V3 borders, and therefore may not causally follow from the existence of columnar systems in these areas, as is widely assumed. An application of the Wedge-Dipole model to localizing aspects of visual processing to specific cortical areas--extending previous work in correlating V1 cortical magnification factor to retinal anatomy or visual psychophysics data--is briefly discussed.National Institute of Health/National Institute of Biomedical Imaging and Bioengineering (R01 EB001550

Intersubject Regularity in the Intrinsic Shape of Human V1

Previous studies have reported considerable intersubject variability in the three-dimensional geometry of the human primary visual cortex (V1). Here we demonstrate that much of this variability is due to extrinsic geometric features of the cortical folds, and that the intrinsic shape of V1 is similar across individuals. V1 was imaged in ten ex vivo human hemispheres using high-resolution (200 μm) structural magnetic resonance imaging at high field strength (7 T). Manual tracings of the stria of Gennari were used to construct a surface representation, which was computationally flattened into the plane with minimal metric distortion. The instrinsic shape of V1 was determined from the boundary of the planar representation of the stria. An ellipse provided a simple parametric shape model that was a good approximation to the boundary of flattened V1. The aspect ration of the best-fitting ellipse was found to be consistent across subject, with a mean of 1.85 and standard deviation of 0.12. Optimal rigid alignment of size-normalized V1 produced greater overlap than that achieved by previous studies using different registration methods. A shape analysis of published macaque data indicated that the intrinsic shape of macaque V1 is also stereotyped, and similar to the human V1 shape. Previoud measurements of the functional boundary of V1 in human and macaque are in close agreement with these results

A survey of X-ray emission from 100 kpc radio jets

We have completed a Chandra snapshot survey of 54 radio jets that are extended on arcsec scales. These are associated with flat spectrum radio quasars spanning a redshift range z=0.3 to 2.1. X-ray emission is detected from the jet of approximately 60% of the sample objects. We assume minimum energy and apply conditions consistent with the original Felten-Morrison calculations in order to estimate the Lorentz factors and the apparent Doppler factors. This allows estimates of the enthalpy fluxes, which turn out to be comparable to the radiative luminosities.Comment: Conference Proceedings IAU Symposium No. 313, Extragalactic jets from every angle, pp. 219-224, 4 figure