113,088 research outputs found
Information Theoretical Estimators Toolbox
We present ITE (information theoretical estimators) a free and open source,
multi-platform, Matlab/Octave toolbox that is capable of estimating many
different variants of entropy, mutual information, divergence, association
measures, cross quantities, and kernels on distributions. Thanks to its highly
modular design, ITE supports additionally (i) the combinations of the
estimation techniques, (ii) the easy construction and embedding of novel
information theoretical estimators, and (iii) their immediate application in
information theoretical optimization problems. ITE also includes a prototype
application in a central problem class of signal processing, independent
subspace analysis and its extensions.Comment: 5 pages; ITE toolbox: https://bitbucket.org/szzoli/ite
Finite-State Channel Models for Signal Transduction in Neural Systems
Information theory provides powerful tools for understanding communication
systems. This analysis can be applied to intercellular signal transduction,
which is a means of chemical communication among cells and microbes. We discuss
how to apply information-theoretic analysis to ligand-receptor systems, which
form the signal carrier and receiver in intercellular signal transduction
channels. We also discuss the applications of these results to neuroscience.Comment: Accepted for publication in 2016 IEEE International Conference on
Acoustics, Speech, and Signal Processing, Shanghai, Chin
A Short Introduction to Model Selection, Kolmogorov Complexity and Minimum Description Length (MDL)
The concept of overfitting in model selection is explained and demonstrated
with an example. After providing some background information on information
theory and Kolmogorov complexity, we provide a short explanation of Minimum
Description Length and error minimization. We conclude with a discussion of the
typical features of overfitting in model selection.Comment: 20 pages, Chapter 1 of The Paradox of Overfitting, Master's thesis,
Rijksuniversiteit Groningen, 200
- …