Learned-Norm Pooling for Deep Feedforward and Recurrent Neural Networks

In this paper we propose and investigate a novel nonlinear unit, called $L_p$ unit, for deep neural networks. The proposed $L_p$ unit receives signals from several projections of a subset of units in the layer below and computes a normalized $L_p$ norm. We notice two interesting interpretations of the $L_p$ unit. First, the proposed unit can be understood as a generalization of a number of conventional pooling operators such as average, root-mean-square and max pooling widely used in, for instance, convolutional neural networks (CNN), HMAX models and neocognitrons. Furthermore, the $L_p$ unit is, to a certain degree, similar to the recently proposed maxout unit (Goodfellow et al., 2013) which achieved the state-of-the-art object recognition results on a number of benchmark datasets. Secondly, we provide a geometrical interpretation of the activation function based on which we argue that the $L_p$ unit is more efficient at representing complex, nonlinear separating boundaries. Each $L_p$ unit defines a superelliptic boundary, with its exact shape defined by the order $p$. We claim that this makes it possible to model arbitrarily shaped, curved boundaries more efficiently by combining a few $L_p$ units of different orders. This insight justifies the need for learning different orders for each unit in the model. We empirically evaluate the proposed $L_p$ units on a number of datasets and show that multilayer perceptrons (MLP) consisting of the $L_p$ units achieve the state-of-the-art results on a number of benchmark datasets. Furthermore, we evaluate the proposed $L_p$ unit on the recently proposed deep recurrent neural networks (RNN).Comment: ECML/PKDD 201

Movement patterns of cheetahs ( Acinonyx jubatus ) in farmlands in Botswana

Botswana has the second highest population of cheetah (Acinonyx jubatus) with most living outside protected areas. As a result, many cheetahs are found in farming areas which occasionally results in human-wildlife conflict. This study aimed to look at movement patterns of cheetahs in farming environments to determine whether cheetahs have adapted their movements in these human-dominated landscapes. We fitted high-time resolution GPS collars to cheetahs in the Ghanzi farmlands of Botswana. GPS locations were used to calculate home range sizes as well as number and duration of visits to landscape features using a time-based local convex hull method. Cheetahs had medium-sized home ranges compared to previously studied cheetah in similar farming environments. Results showed that cheetahs actively visited scent marking trees and avoided visiting homesteads. A slight preference for visiting game farms over cattle farms was found, but there was no difference in duration of visits between farm types. We conclude that cheetahs selected for areas that are important for their dietary and social needs and prefer to avoid human-occupied areas. Improved knowledge of how cheetahs use farmlands can allow farmers to make informed decisions when developing management practices and can be an important tool for reducing human-wildlife conflict

Resolution of Nested Neuronal Representations Can Be Exponential in the Number of Neurons

Collective computation is typically polynomial in the number of computational elements, such as transistors or neurons, whether one considers the storage capacity of a memory device or the number of floating-point operations per second of a CPU. However, we show here that the capacity of a computational network to resolve real-valued signals of arbitrary dimensions can be exponential in N, even if the individual elements are noisy and unreliable. Nested, modular codes that achieve such high resolutions mirror the properties of grid cells in vertebrates, which underlie spatial navigation

Symmetry considerations and development of pinwheels in visual maps

Neurons in the visual cortex respond best to rod-like stimuli of given orientation. While the preferred orientation varies continuously across most of the cortex, there are prominent pinwheel centers around which all orientations a re present. Oriented segments abound in natural images, and tend to be collinear}; neurons are also more likely to be connected if their preferred orientations are aligned to their topographic separation. These are indications of a reduced symmetry requiring joint rotations of both orientation preference and the underl ying topography. We verify that this requirement extends to cortical maps of mo nkey and cat by direct statistical analysis. Furthermore, analytical arguments and numerical studies indicate that pinwheels are generically stable in evolving field models which couple orientation and topography

Wake structure and kinematics in two insectivorous bats

We compare kinematics and wake structure over a range of flight speeds (4.0–8.2 m s(−1)) for two bats that pursue insect prey aerially, Tadarida brasiliensis and Myotis velifer. Body mass and wingspan are similar in these species, but M. velifer has broader wings and lower wing loading. By using high-speed videography and particle image velocimetry of steady flight in a wind tunnel, we show that three-dimensional kinematics and wake structure are similar in the two species at the higher speeds studied, but differ at lower speeds. At lower speeds, the two species show significant differences in mean angle of attack, body–wingtip distance and sweep angle. The distinct body vortex seen at low speed in T. brasiliensis and other bats studied to date is considerably weaker or absent in M. velifer. We suggest that this could be influenced by morphology: (i) the narrower thorax in this species probably reduces the body-induced discontinuity in circulation between the two wings and (ii) the wing loading is lower, hence the lift coefficient required for weight support is lower. As a result, in M. velifer, there may be a decreased disruption in the lift generation between the body and the wing, and the strength of the characteristic root vortex is greatly diminished, both suggesting increased flight efficiency. This article is part of the themed issue ‘Moving in a moving medium: new perspectives on flight’

Universal properties of correlation transfer in integrate-and-fire neurons

One of the fundamental characteristics of a nonlinear system is how it transfers correlations in its inputs to correlations in its outputs. This is particularly important in the nervous system, where correlations between spiking neurons are prominent. Using linear response and asymptotic methods for pairs of unconnected integrate-and-fire (IF) neurons receiving white noise inputs, we show that this correlation transfer depends on the output spike firing rate in a strong, stereotyped manner, and is, surprisingly, almost independent of the interspike variance. For cells receiving heterogeneous inputs, we further show that correlation increases with the geometric mean spiking rate in the same stereotyped manner, greatly extending the generality of this relationship. We present an immediate consequence of this relationship for population coding via tuning curves

New Treatment Options in Advanced Stage Follicular Lymphoma

Follicular lymphoma is one of the most common non-Hodgkin's lymphomas with an expected survival of more than 20 years for the majority of patients. This impressive outcome has been achieved with the introduction of immunochemotherapy, as first line treatment with remissions lasting over 8 years, followed by other treatment options at first or subsequent relapse. However, certain groups of patients still have a poor prognosis. In recent years the efficacy of chemotherapy regimens has been augmented by new compounds selectively targeting the cell surface, intracellular pathways, and/or the microenvironment. Some of these are beginning to change the therapeutic landscape. This review summarizes prognostic factors in follicular lymphoma in order to identify patients with greatest medical need for these new treatment options and reviews recent data from prospective clinical studies testing new agents in first-line and relapsed follicular lymphoma. Finally, we assess the current role of immunochemotherapy and discuss the requirements for future clinical trials

On Multifractal Structure in Non-Representational Art

Multifractal analysis techniques are applied to patterns in several abstract expressionist artworks, paintined by various artists. The analysis is carried out on two distinct types of structures: the physical patterns formed by a specific color (``blobs''), as well as patterns formed by the luminance gradient between adjacent colors (``edges''). It is found that the analysis method applied to ``blobs'' cannot distinguish between artists of the same movement, yielding a multifractal spectrum of dimensions between about 1.5-1.8. The method can distinguish between different types of images, however, as demonstrated by studying a radically different type of art. The data suggests that the ``edge'' method can distinguish between artists in the same movement, and is proposed to represent a toy model of visual discrimination. A ``fractal reconstruction'' analysis technique is also applied to the images, in order to determine whether or not a specific signature can be extracted which might serve as a type of fingerprint for the movement. However, these results are vague and no direct conclusions may be drawn.Comment: 53 pp LaTeX, 10 figures (ps/eps

Biomechanics of predator–prey arms race in lion, zebra, cheetah and impala

The fastest and most manoeuvrable terrestrial animals are found in savannah habitats, where predators chase and capture running prey. Hunt outcome and success rate are critical to survival, so both predator and prey should evolve to be faster and/or more manoeuvrable. Here we compare locomotor characteristics in two pursuit predator–prey pairs, lion–zebra and cheetah–impala, in their natural savannah habitat in Botswana. We show that although cheetahs and impalas were universally more athletic than lions and zebras in terms of speed, acceleration and turning, within each predator–prey pair, the predators had 20% higher muscle fibre power than prey, 37% greater acceleration and 72% greater deceleration capacity than their prey. We simulated hunt dynamics with these data and showed that hunts at lower speeds enable prey to use their maximum manoeuvring capacity and favour prey survival, and that the predator needs to be more athletic than its prey to sustain a viable success rate

On a common circle: natural scenes and Gestalt rules

To understand how the human visual system analyzes images, it is essential to know the structure of the visual environment. In particular, natural images display consistent statistical properties that distinguish them from random luminance distributions. We have studied the geometric regularities of oriented elements (edges or line segments) present in an ensemble of visual scenes, asking how much information the presence of a segment in a particular location of the visual scene carries about the presence of a second segment at different relative positions and orientations. We observed strong long-range correlations in the distribution of oriented segments that extend over the whole visual field. We further show that a very simple geometric rule, cocircularity, predicts the arrangement of segments in natural scenes, and that different geometrical arrangements show relevant differences in their scaling properties. Our results show similarities to geometric features of previous physiological and psychophysical studies. We discuss the implications of these findings for theories of early vision.Comment: 3 figures, 2 large figures not include