On palimpsests in neural memory: an information theory viewpoint

The finite capacity of neural memory and the reconsolidation phenomenon suggest it is important to be able to update stored information as in a palimpsest, where new information overwrites old information. Moreover, changing information in memory is metabolically costly. In this paper, we suggest that information-theoretic approaches may inform the fundamental limits in constructing such a memory system. In particular, we define malleable coding, that considers not only representation length but also ease of representation update, thereby encouraging some form of recycling to convert an old codeword into a new one. Malleability cost is the difficulty of synchronizing compressed versions, and malleable codes are of particular interest when representing information and modifying the representation are both expensive. We examine the tradeoff between compression efficiency and malleability cost, under a malleability metric defined with respect to a string edit distance. This introduces a metric topology to the compressed domain. We characterize the exact set of achievable rates and malleability as the solution of a subgraph isomorphism problem. This is all done within the optimization approach to biology framework.Accepted manuscrip

Moth olfactory receptor neurons adjust their encoding efficiency to temporal statistics of pheromone fluctuations

The efficient coding hypothesis predicts that sensory neurons adjust their coding resources to optimally represent the stimulus statistics of their environment. To test this prediction in the moth olfactory system, we have developed a stimulation protocol that mimics the natural temporal structure within a turbulent pheromone plume. We report that responses of antennal olfactory receptor neurons to pheromone encounters follow the temporal fluctuations in such a way that the most frequent stimulus timescales are encoded with maximum accuracy. We also observe that the average coding precision of the neurons adjusted to the stimulus-timescale statistics at a given distance from the pheromone source is higher than if the same encoding model is applied at a shorter, non-matching, distance. Finally, the coding accuracy profile and the stimulus-timescale distribution are related in the manner predicted by the information theory for the many-to-one convergence scenario of the moth peripheral sensory system

Variance Predicts Salience in Central Sensory Processing

Information processing in the sensory periphery is shaped by natural stimulus statistics. In the periphery, a transmission bottleneck constrains performance; thus efficient coding implies that natural signal components with a predictably wider range should be compressed. In a different regime—when sampling limitations constrain performance—efficient coding implies that more resources should be allocated to informative features that are more variable. We propose that this regime is relevant for sensory cortex when it extracts complex features from limited numbers of sensory samples. To test this prediction, we use central visual processing as a model: we show that visual sensitivity for local multi-point spatial correlations, described by dozens of independently-measured parameters, can be quantitatively predicted from the structure of natural images. This suggests that efficient coding applies centrally, where it extends to higher-order sensory features and operates in a regime in which sensitivity increases with feature variability

Coding Strategies Underlying Visual Processing

Acquiring and representing knowledge about our environment involves a variety of core neural computations. The coding strategies underlying visual perception highlight many of these processes, and thus reveal general design principles in perception and cognition. I will review three studies where I have used different computational frameworks and analyses to address open questions in visual coding. The first project uses factor analyses of individual differences in perception to demonstrate fundamentally different representational structures for the stimulus features of color and motion. In the second project, I have explored visual adaptation in the context of population coding to address controversies regarding which coding schemes are implicated by different patterns of adaptation aftereffects. In the third, I have explored these adaptation effects in the context of Bayesian inference. This approach accounts for the full gamut of known aftereffects within the context of physiologically plausible models and provides principled quantitative predictions for why and how much the system should adapt. Together, these projects draw on the power of formal computational approaches both for analyzing neural representations and for revealing the computations and coding principles on which they are based