3,679 research outputs found
Coding for Parallel Channels: Gallager Bounds for Binary Linear Codes with Applications to Repeat-Accumulate Codes and Variations
This paper is focused on the performance analysis of binary linear block
codes (or ensembles) whose transmission takes place over independent and
memoryless parallel channels. New upper bounds on the maximum-likelihood (ML)
decoding error probability are derived. These bounds are applied to various
ensembles of turbo-like codes, focusing especially on repeat-accumulate codes
and their recent variations which possess low encoding and decoding complexity
and exhibit remarkable performance under iterative decoding. The framework of
the second version of the Duman and Salehi (DS2) bounds is generalized to the
case of parallel channels, along with the derivation of their optimized tilting
measures. The connection between the generalized DS2 and the 1961 Gallager
bounds, addressed by Divsalar and by Sason and Shamai for a single channel, is
explored in the case of an arbitrary number of independent parallel channels.
The generalization of the DS2 bound for parallel channels enables to re-derive
specific bounds which were originally derived by Liu et al. as special cases of
the Gallager bound. In the asymptotic case where we let the block length tend
to infinity, the new bounds are used to obtain improved inner bounds on the
attainable channel regions under ML decoding. The tightness of the new bounds
for independent parallel channels is exemplified for structured ensembles of
turbo-like codes. The improved bounds with their optimized tilting measures
show, irrespectively of the block length of the codes, an improvement over the
union bound and other previously reported bounds for independent parallel
channels; this improvement is especially pronounced for moderate to large block
lengths.Comment: Submitted to IEEE Trans. on Information Theory, June 2006 (57 pages,
9 figures
Comparing and Combining Lexicase Selection and Novelty Search
Lexicase selection and novelty search, two parent selection methods used in
evolutionary computation, emphasize exploring widely in the search space more
than traditional methods such as tournament selection. However, lexicase
selection is not explicitly driven to select for novelty in the population, and
novelty search suffers from lack of direction toward a goal, especially in
unconstrained, highly-dimensional spaces. We combine the strengths of lexicase
selection and novelty search by creating a novelty score for each test case,
and adding those novelty scores to the normal error values used in lexicase
selection. We use this new novelty-lexicase selection to solve automatic
program synthesis problems, and find it significantly outperforms both novelty
search and lexicase selection. Additionally, we find that novelty search has
very little success in the problem domain of program synthesis. We explore the
effects of each of these methods on population diversity and long-term problem
solving performance, and give evidence to support the hypothesis that
novelty-lexicase selection resists converging to local optima better than
lexicase selection
Satisfiability, sequence niches, and molecular codes in cellular signaling
Biological information processing as implemented by regulatory and signaling
networks in living cells requires sufficient specificity of molecular
interaction to distinguish signals from one another, but much of regulation and
signaling involves somewhat fuzzy and promiscuous recognition of molecular
sequences and structures, which can leave systems vulnerable to crosstalk. This
paper examines a simple computational model of protein-protein interactions
which reveals both a sharp onset of crosstalk and a fragmentation of the
neutral network of viable solutions as more proteins compete for regions of
sequence space, revealing intrinsic limits to reliable signaling in the face of
promiscuity. These results suggest connections to both phase transitions in
constraint satisfaction problems and coding theory bounds on the size of
communication codes
Counterfactual Risk Minimization: Learning from Logged Bandit Feedback
We develop a learning principle and an efficient algorithm for batch learning
from logged bandit feedback. This learning setting is ubiquitous in online
systems (e.g., ad placement, web search, recommendation), where an algorithm
makes a prediction (e.g., ad ranking) for a given input (e.g., query) and
observes bandit feedback (e.g., user clicks on presented ads). We first address
the counterfactual nature of the learning problem through propensity scoring.
Next, we prove generalization error bounds that account for the variance of the
propensity-weighted empirical risk estimator. These constructive bounds give
rise to the Counterfactual Risk Minimization (CRM) principle. We show how CRM
can be used to derive a new learning method -- called Policy Optimizer for
Exponential Models (POEM) -- for learning stochastic linear rules for
structured output prediction. We present a decomposition of the POEM objective
that enables efficient stochastic gradient optimization. POEM is evaluated on
several multi-label classification problems showing substantially improved
robustness and generalization performance compared to the state-of-the-art.Comment: 10 page
Complex networks in climate dynamics - Comparing linear and nonlinear network construction methods
Complex network theory provides a powerful framework to statistically
investigate the topology of local and non-local statistical interrelationships,
i.e. teleconnections, in the climate system. Climate networks constructed from
the same global climatological data set using the linear Pearson correlation
coefficient or the nonlinear mutual information as a measure of dynamical
similarity between regions, are compared systematically on local, mesoscopic
and global topological scales. A high degree of similarity is observed on the
local and mesoscopic topological scales for surface air temperature fields
taken from AOGCM and reanalysis data sets. We find larger differences on the
global scale, particularly in the betweenness centrality field. The global
scale view on climate networks obtained using mutual information offers
promising new perspectives for detecting network structures based on nonlinear
physical processes in the climate system.Comment: 24 pages, 10 figure
- …