Synaptic Normalisation for On-Chip Learning in Analog CMOS Spiking Neural Networks

Spiking Neural Networks (SNNs) are becoming increasingly popular for their application in Edge Artificial Intelligence (Edge-AI) due to their sparse and low-latency computation. Among these networks, analog hardware SNNs are chosen for their ability to emulate complex dynamics in neurons and synapses, especially in integrated Metal Oxide Semiconductor (MOS) technology. They can form memories of external stimuli by modulating the strength of synaptic weights. In this context, binary weights are a common hardware design choice, due to their ease to program and store. The use of binary weights in SNNs worsens the bias introduced by the coding level of input stimuli (i.e. fraction of active input nodes), where the network activity is highly correlated to the number of excited neurons. In this paper, we present a Complementary Metal Oxide Semiconductor (CMOS) solution for the coding level bias, by proposing a novel circuit that employs synaptic normalisation at the neuron level. This circuit modifies the gain of the neuron depending on its input weights, with a small footprint and therefore high scalability

Robust Spiking Attractor Networks with a Hard Winner-Take-All Neuron Circuit

Attractor networks are widely understood to be a re-occurring primitive that underlies cognitive function. Stabilising activity in spiking attractor networks however remains a difficult task, especially when implemented in analog integrated circuits (aIC). We introduce here a novel circuit implementation of a hard Winner-Take-All (hWTA) mechanism, in which competing neurons' refractory circuits are coupled together, and thus their spiking is forced to be mutually exclusive. We demonstrate stable persistent-firing attractor dynamics in a small on-chip network consisting of hWTA-connected neurons and excitatory recurrent synapses. Its utility within larger networks is demonstrated in simulation, and shown to support overlapping attractors and be robust to synaptic weight mismatch. The realised hWTA mechanism is thus useful for stabilising activity in spiking networks composed of unreliable components, without the need for careful parameter tuning

Nonlinear Waves in Bose-Einstein Condensates: Physical Relevance and Mathematical Techniques

The aim of the present review is to introduce the reader to some of the physical notions and of the mathematical methods that are relevant to the study of nonlinear waves in Bose-Einstein Condensates (BECs). Upon introducing the general framework, we discuss the prototypical models that are relevant to this setting for different dimensions and different potentials confining the atoms. We analyze some of the model properties and explore their typical wave solutions (plane wave solutions, bright, dark, gap solitons, as well as vortices). We then offer a collection of mathematical methods that can be used to understand the existence, stability and dynamics of nonlinear waves in such BECs, either directly or starting from different types of limits (e.g., the linear or the nonlinear limit, or the discrete limit of the corresponding equation). Finally, we consider some special topics involving more recent developments, and experimental setups in which there is still considerable need for developing mathematical as well as computational tools.Comment: 69 pages, 10 figures, to appear in Nonlinearity, 2008. V2: new references added, fixed typo

2017 Research & Innovation Day Program

A one day showcase of applied research, social innovation, scholarship projects and activities.https://first.fanshawec.ca/cri_cripublications/1004/thumbnail.jp

IKKα controls ATG16L1 degradation to prevent ER stress during inflammation

Inhibition of the IκB kinase complex (IKK) has been implicated in the therapy of several chronic inflammatory diseases including inflammatory bowel diseases. In this study, using mice with an inactivatable IKKα kinase (IkkαAA/AA), we show that loss of IKKα function markedly impairs epithelial regeneration in a model of acute colitis. Mechanistically, this is caused by compromised secretion of cytoprotective IL-18 from IKKα-mutant intestinal epithelial cells because of elevated caspase 12 activation during an enhanced unfolded protein response (UPR). Induction of the UPR is linked to decreased ATG16L1 stabilization in IkkαAA/AA mice. We demonstrate that both TNF-R and nucleotide-binding oligomerization domain stimulation promote ATG16L1 stabilization via IKKα-dependent phosphorylation of ATG16L1 at Ser278. Thus, we propose IKKα as a central mediator sensing both cytokine and microbial stimulation to suppress endoplasmic reticulum stress, thereby assuring antiinflammatory function during acute intestinal inflammation

Testing a global standard for quantifying species recovery and assessing conservation impact.

Recognizing the imperative to evaluate species recovery and conservation impact, in 2012 the International Union for Conservation of Nature (IUCN) called for development of a "Green List of Species" (now the IUCN Green Status of Species). A draft Green Status framework for assessing species' progress toward recovery, published in 2018, proposed 2 separate but interlinked components: a standardized method (i.e., measurement against benchmarks of species' viability, functionality, and preimpact distribution) to determine current species recovery status (herein species recovery score) and application of that method to estimate past and potential future impacts of conservation based on 4 metrics (conservation legacy, conservation dependence, conservation gain, and recovery potential). We tested the framework with 181 species representing diverse taxa, life histories, biomes, and IUCN Red List categories (extinction risk). Based on the observed distribution of species' recovery scores, we propose the following species recovery categories: fully recovered, slightly depleted, moderately depleted, largely depleted, critically depleted, extinct in the wild, and indeterminate. Fifty-nine percent of tested species were considered largely or critically depleted. Although there was a negative relationship between extinction risk and species recovery score, variation was considerable. Some species in lower risk categories were assessed as farther from recovery than those at higher risk. This emphasizes that species recovery is conceptually different from extinction risk and reinforces the utility of the IUCN Green Status of Species to more fully understand species conservation status. Although extinction risk did not predict conservation legacy, conservation dependence, or conservation gain, it was positively correlated with recovery potential. Only 1.7% of tested species were categorized as zero across all 4 of these conservation impact metrics, indicating that conservation has, or will, play a role in improving or maintaining species status for the vast majority of these species. Based on our results, we devised an updated assessment framework that introduces the option of using a dynamic baseline to assess future impacts of conservation over the short term to avoid misleading results which were generated in a small number of cases, and redefines short term as 10 years to better align with conservation planning. These changes are reflected in the IUCN Green Status of Species Standard

A Subthreshold Second-Order Integration Circuit for Versatile Synaptic Alpha Kernel and Trace Generation

In neuromorphic hardware the choice of synaptic kernels and trace dynamics are key for the correct system abstraction and representation of information. This paper presents a novel second-order integration circuit for the implementation of traces and kernels, the Second-order Differential Pair Integrator (SoDPI). It provides smooth alpha-kernel shaped responses to spike input in analog subthreshold complementary Metal Oxide Semiconductor (MOS) technology. Our approach utilises two Differential Pair Integrator (DPI) circuits in series to implement an effective current-mode second-order translinear low-pass filter. Theoretical analysis and experimental measurements demonstrate the improved reliability of this design, which offers a promising approach for modelling biological synaptic and neural responses in neuromorphic hardware, as well as improving the stability of integrated on-chip learning systems

Abnormal elastin and collagen deposition is present in extracranial arteriovenous malformations: A comparison to intracranial disease

Background. Vascular malformations are characterized by anomalous vascular channels with fragile walls and a propensity to bleed. Arteriovenous malformations (AVMs) in particular have disorganized vascular spaces with intervening fibrosis. Characterization of the structural abnormalities of these vessels has not been comprehensively evaluated. We hypothesize that AVMs are likely to demonstrate altered elastic and collagen fiber organization and distribution, reflecting their fragility, vascular instability, and abnormal development. Methods. Fifteen AVMs were histologically evaluated by H&E, elastin and trichrome staining. To identify potential differences between extracranial and intracranial AVMs, 5 AVMs were harvested from the brain (n=5) and 10 from extracranial sites involving the skin and deep soft tissue (n=10). Results. The elastin staining demonstrated reduplication, fragmentation and disruption of internal elastic lamina as well as irregular thickness, and inconsistent vascular density of all AVM specimens. Trichrome staining revealed thickening of the intimal layers of AVM arteries and demonstrated an irregular thickness of venous walls within the malformation and some areas of medial degeneration. Intracranial AVMs are characterized by more intramural inflammation with predominant neutrophil and lymphocyte infiltration. In contrast, extracranial AVMs display more extravascular inflammation with mast cell and neutrophil infiltration. Microvascular proliferations intervening between larger blood vessels were also noted in both types of AVMs, but more obvious in extracranial AVMs. Conclusion. These observed histologic anomalies of AVMs demonstrate disorganized deposition of elastin and collagen that point to the clinically observed vascular instability and fragility of these lesion

The Paradox of Isochrony in the Evolution of Human Rhythm

Isochrony is crucial to the rhythm of human music. Some neural, behavioral and anatomical traits underlying rhythm perception and production are shared with a broad range of species. These may either have a common evolutionary origin, or have evolved into similar traits under different evolutionary pressures. Other traits underlying rhythm are rare across species, only found in humans and few other animals. Isochrony, or stable periodicity, is common to most human music, but isochronous behaviors are also found in many species. It appears paradoxical that humans are particularly good at producing and perceiving isochronous patterns, although this ability does not conceivably confer any evolutionary advantage to modern humans. This article will attempt to solve this conundrum. To this end, we define the concept of isochrony from the present functional perspective of physiology, cognitive neuroscience, signal processing, and interactive behavior, and review available evidence on isochrony in the signals of humans and other animals. We then attempt to resolve the paradox of isochrony by expanding an evolutionary hypothesis about the function that isochronous behavior may have had in early hominids. Finally, we propose avenues for empirical research to examine this hypothesis and to understand the evolutionary origin of isochrony in general