Emergence of network motifs in deep neural networks

Network science can offer fundamental insights into the structural and functional properties of complex systems. For example, it is widely known that neuronal circuits tend to organize into basic functional topological modules, called network motifs. In this article, we show that network science tools can be successfully applied also to the study of artificial neural networks operating according to self-organizing (learning) principles. In particular, we study the emergence of network motifs in multi-layer perceptrons, whose initial connectivity is defined as a stack of fully-connected, bipartite graphs. Simulations show that the final network topology is shaped by learning dynamics, but can be strongly biased by choosing appropriate weight initialization schemes. Overall, our results suggest that non-trivial initialization strategies can make learning more effective by promoting the development of useful network motifs, which are often surprisingly consistent with those observed in general transduction networks

Experimental reconstruction of photon statistics without photon counting

Experimental reconstructions of photon number distributions of both continuous-wave and pulsed light beams are reported. Our scheme is based on on/off avalanche photodetection assisted by maximum-likelihood estimation and does not involve photon counting. Reconstructions of the distribution for both semiclassical and quantum states of light are reported for single-mode as well as for multimode beams.Comment: Revised version: in press on PRL. 4 pages, 4 fig

State reconstruction by on/off measurements

We demonstrate a state reconstruction technique which provides either the Wigner function or the density matrix of a field mode and requires only avalanche photodetectors, without any phase or amplitude discrimination power. It represents an alternative, of simpler implementation, to quantum homodyne tomography.Comment: 6 pages, 4 figures, revised and enlarged versio

Evaluation of Tropical and Subtropical Forage Grasses in the Northwest Region of Rio Grande Do Sul, Brazil

A collection of 137 accessions of tropical and subtropical grasses of Pennisetum purpureum (53), Panicum maximum (10), Brachiaria spp. (9), Hemarthria altissima (19), Setaria spp. (11), Digitaria spp. (22), Cynodon spp.(7) and Paspalum spp. (6) was evaluated for frost tolerance (FT), dry matter yield per cut (DMYC), number of cuts (NC) and accumulated dry matter yield per year (ADMY). Crude protein content (CPC), leaf/stem ratio (L/S), pubescence (P) and animal preference under grazing (AP) were also recorded in 20 entries of in P. purpureum. Data exploration involved cluster analysis and ordination, revealing the most promising entries among and within genus. In general ADMY and FT were the most important variables to discriminate entries. Pennisetum, Panicum and Hemarthria were the most productive genus with high FT. Cynodon and Paspalum showed high FT

Measuring the photon distribution by ON/OFF photodectors

Reconstruction of photon statistics of optical states provide fundamental information on the nature of any optical field and find various relevant applications. Nevertheless, no detector that can reliably discriminate the number of incident photons is available. On the other hand the alternative of reconstructing density matrix by quantum tomography leads to various technical difficulties that are particular severe in the pulsed regime (where mode matching between signal an local oscillator is very challenging). Even if on/off detectors, as usual avalanche PhotoDiodes operating in Geiger mode, seem useless as photocounters, recently it was shown how reconstruction of photon statistics is possible by considering a variable quantum efficiency. Here we present experimental reconstructions of photon number distributions of both continuous-wave and pulsed light beams in a scheme based on on/off avalanche photodetection assisted by maximum-likelihood estimation. Reconstructions of the distribution for both semiclassical and quantum states of light (as single photon, coherent, pseudothermal and multithermal states) are reported for single-mode as well as for multimode beams. The stability and good accuracy obtained in the reconstruction of these states clearly demonstrate the interesting potentialities of this simple technique.Comment: 6 pages, 7 figures, to appear on Laser Physic

Reconstruction of photon statistics using low performance photon counters

The output of a photodetector consists of a current pulse whose charge has the statistical distribution of the actual photon numbers convolved with a Bernoulli distribution. Photodetectors are characterized by a nonunit quantum efficiency, i.e. not all the photons lead to a charge, and by a finite resolution, i.e. a different number of detected photons leads to a discriminable values of the charge only up to a maximum value. We present a detailed comparison, based on Monte Carlo simulated experiments and real data, among the performances of detectors with different upper limits of counting capability. In our scheme the inversion of Bernoulli convolution is performed by maximum-likelihood methods assisted by measurements taken at different quantum efficiencies. We show that detectors that are only able to discriminate between zero, one and more than one detected photons are generally enough to provide a reliable reconstruction of the photon statistics for single-peaked distributions, while detectors with higher resolution limits do not lead to further improvements. In addition, we demonstrate that, for semiclassical states, even on/off detectors are enough to provide a good reconstruction. Finally, we show that a reliable reconstruction of multi-peaked distributions requires either higher quantum efficiency or better capability in discriminating high number of detected photons.Comment: 8 pages, 3 figure

A Multi-Channel Low-Power System-on-Chip for in Vivo Recording and Wireless Transmission of Neural Spikes

This paper reports a multi-channel neural spike recording system-on-chip with digital data compression and wireless telemetry. The circuit consists of 16 amplifiers, an analog time-division multiplexer, a single 8 bit analog-to-digital converter, a digital signal compression unit and a wireless transmitter. Although only 16 amplifiers are integrated in our current die version, the whole system is designed to work with 64, demonstrating the feasibility of a digital processing and narrowband wireless transmission of 64 neural recording channels. Compression of the raw data is achieved by detecting the action potentials (APs) and storing 20 samples for each spike waveform. This compression method retains sufficiently high data quality to allow for single neuron identification (spike sorting). The 400 MHz transmitter employs a Manchester-Coded Frequency Shift Keying (MC-FSK) modulator with low modulation index. In this way, a 1.25 Mbit/s data rate is delivered within a limited band of about 3 MHz. The chip is realized in a 0.35 um AMS CMOS process featuring a 3 V power supply with an area of 3.1x 2.7 mm2. The achieved transmission range is over 10 m with an overall power consumption for 64 channels of 17.2 mW. This figure translates into a power budget of 269uW per channel, in line with published results but allowing a larger transmission distance and more efficient bandwidth occupation of the wireless link. The integrated circuit was mounted on a small and light board to be used during neuroscience experiments with freely-behaving rats. Powered by 2 AAA batteries, the system can continuously work for more than 100 hours allowing for long-lasting neural spike recordings

Calculation of kinetic parameters βeff and Λ with modified open source Monte Carlo code OpenMC(TD)

This work presents the methodology used to expand the capabilities of the Monte Carlo code OpenMC for the calculation of reactor kinetic parameters: effective delayed neutron fraction βeff and neutron generation time Λ. The modified code, OpenMC(Time-Dependent) or OpenMC(TD), was then used to calculate the effective delayed neutron fraction by using the prompt method, while the neutron generation time was estimated using the pulsed method, fitting Λ to the decay of the neutron population. OpenMC(TD) is intended to serve as an alternative for the estimation of kinetic parameters when licensed codes are not available. The results obtained are compared to experimental data and MCNP calculated values for 18 benchmark configurations.Fil: Romero Barrientos, J.. Comision Chilena de Energia Nuclear; Chile. Universidad de Chile; ChileFil: Marquez Damian, Jose Ignacio. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - Patagonia Norte; Argentina. European Spallation Source; SueciaFil: Molina, F.. Comision Chilena de Energia Nuclear; Chile. Universidad Andrés Bello; ChileFil: Zambra, M.. Comision Chilena de Energia Nuclear; Chile. Universidad Diego Portales; ChileFil: Aguilera, P.. Comision Chilena de Energia Nuclear; Chile. Universidad de Chile; ChileFil: López Usquiano, F.. Comision Chilena de Energia Nuclear; Chile. Universidad de Chile; ChileFil: Parra, B.. Instituto de Física Corpuscular; EspañaFil: Ruiz, A.. Comision Chilena de Energia Nuclear; Chile. Universidad de Chile; Chil

AGILE detection of a strong gamma-ray flare from the blazar 3C 454.3

We report the first blazar detection by the AGILE satellite. AGILE detected 3C 454.3 during a period of strongly enhanced optical emission in July 2007. AGILE observed the source with a dedicated repointing during the period 2007 July 24-30 with its two co-aligned imagers, the Gamma-Ray Imaging Detector and the hard X-ray imager Super-AGILE sensitive in the 30 MeV-50 GeV and 18-60 keV, respectively. Over the entire period, AGILE detected gamma-ray emission from 3C 454.3 at a significance level of 13.8-$\sigma$ with an average flux (E$>$100 MeV) of $(280 \pm 40) \times 10^{-8}$ photons cm$^{-2}$ s$^{-1}$. The gamma-ray flux appears to be variable towards the end of the observation. No emission was detected by Super-AGILE in the energy range 20-60 keV, with a 3-$\sigma$ upper limit of $2.3 \times 10^{-3}$ photons cm$^{-2}$ s$^{-1}$. The gamma-ray flux level of 3C 454.3 detected by AGILE is the highest ever detected for this quasar and among the most intense gamma-ray fluxes ever detected from Flat Spectrum Radio Quasars.Comment: Accepted by Astrophysical Journal Letters; 14 pages, 3 EPS Figures, 1 Tabl

The flaring blazars of the first 1.5 years of the AGILE mission

We report the AGILE gamma-ray observations and the results of the multiwavelength campaigns on seven flaring blazars detected by the mission: During two multiwavelength campaigns, we observed gamma-ray activity from two Flat Spectrum Radio Quasars of the Virgo region, e.g. 3C 279 and 3C 273 (the latter being the first extragalactic source simultaneously observed with the gamma-ray telescope and the hard X ray imager of the mission). Due to the large FOV of the AGILE/GRID instrument, we achieved an almost continuous coverage of the FSRQ 3C 454.3. The source showed flux above 10E-6 photons/cm2/s (E > 100 MeV) and showed day by day variability during all the AGILE observing periods. In the EGRET era, the source was found in high gamma-ray activity only once. An other blazar, PKS 1510-089 was frequently found in high gamma-ray activity. S5 0716+71, an intermediate BL Lac object, exhibited a very high gamma-ray activity and fast gamma-ray variability during a period of intense optical activity. We observed high gamma-ray activity from W Comae, a BL Lac object, and Mrk 421, an high energy peaked BL Lac object. For this source, a multiwavelength campaign from optical to TeV has been performed