Hardware-Amenable Structural Learning for Spike-based Pattern Classification using a Simple Model of Active Dendrites

This paper presents a spike-based model which employs neurons with functionally distinct dendritic compartments for classifying high dimensional binary patterns. The synaptic inputs arriving on each dendritic subunit are nonlinearly processed before being linearly integrated at the soma, giving the neuron a capacity to perform a large number of input-output mappings. The model utilizes sparse synaptic connectivity; where each synapse takes a binary value. The optimal connection pattern of a neuron is learned by using a simple hardware-friendly, margin enhancing learning algorithm inspired by the mechanism of structural plasticity in biological neurons. The learning algorithm groups correlated synaptic inputs on the same dendritic branch. Since the learning results in modified connection patterns, it can be incorporated into current event-based neuromorphic systems with little overhead. This work also presents a branch-specific spike-based version of this structural plasticity rule. The proposed model is evaluated on benchmark binary classification problems and its performance is compared against that achieved using Support Vector Machine (SVM) and Extreme Learning Machine (ELM) techniques. Our proposed method attains comparable performance while utilizing 10 to 50% less computational resources than the other reported techniques.Comment: Accepted for publication in Neural Computatio

Random initial conditions for semi-linear PDEs

We analyze the effect of random initial conditions on the local well--posedness of semi--linear PDEs, to investigate to what extent recent ideas on singular stochastic PDEs can prove useful in this framework

A methodology for airplane parameter estimation and confidence interval determination in nonlinear estimation problems

An algorithm for maximum likelihood (ML) estimation is developed with an efficient method for approximating the sensitivities. The ML algorithm relies on a new optimization method referred to as a modified Newton-Raphson with estimated sensitivities (MNRES). MNRES determines sensitivities by using slope information from local surface approximations of each output variable in parameter space. With the fitted surface, sensitivity information can be updated at each iteration with less computational effort than that required by either a finite-difference method or integration of the analytically determined sensitivity equations. MNRES eliminates the need to derive sensitivity equations for each new model, and thus provides flexibility to use model equations in any convenient format. A random search technique for determining the confidence limits of ML parameter estimates is applied to nonlinear estimation problems for airplanes. The confidence intervals obtained by the search are compared with Cramer-Rao (CR) bounds at the same confidence level. The degree of nonlinearity in the estimation problem is an important factor in the relationship between CR bounds and the error bounds determined by the search technique. Beale's measure of nonlinearity is developed in this study for airplane identification problems; it is used to empirically correct confidence levels and to predict the degree of agreement between CR bounds and search estimates

On the Estimation of Euler Equations in the Presence of a Potential Regime Shift

The concept of a peso problem is formalized in terms of a linear Euler equation and a nonlinear marginal model describing the dynamics of the exogenous driving process. It is shown that, using a threshold autoregressive model as a marginal model, it is possible to produce time-varying peso premia. A Monte Carlo method and a method based on the numerical solution of integral equations are considered as tools for computing conditional future expectations in the marginal model. A Monte Carlo study illustrates the poor performance of the generalized method of moment (GMM) estimator in small and even relatively large samples. The poor performance is particularly acute in the presence of a peso problem but is also serious in the simple linear case.peso problem; Euler equations; GMM; threshold autoregressive models

On the Estimation of Euler Equations in the Presence of a Potential Regime Shift

The concept of a peso problem is formalized in terms of a linear Euler equation and a nonlinear marginal model describing the dynamics of the exogenous driving process. It is shown that, using a threshold autoregressive model as a marginal model, it is possible to produce time-varying peso premia. A Monte Carlo method and a method based on the numerical solution of integral equations are considered as tools for computing conditional future expectations in the marginal model. A Monte Carlo study illustrates the poor performance of the generalized method of moment (GMM) estimator in small and even relatively large samples. The poor performance is particularly acute in the presence of a peso problem but is also serious in the simple linear case.peso problem; Euler equations; GMM; threshold autoregressive models