Convolutional Neural Networks Quantization with Attention

It has been proven that, compared to using 32-bit floating-point numbers in the training phase, Deep Convolutional Neural Networks (DCNNs) can operate with low precision during inference, thereby saving memory space and power consumption. However, quantizing networks is always accompanied by an accuracy decrease. Here, we propose a method, double-stage Squeeze-and-Threshold (double-stage ST). It uses the attention mechanism to quantize networks and achieve state-of-art results. Using our method, the 3-bit model can achieve accuracy that exceeds the accuracy of the full-precision baseline model. The proposed double-stage ST activation quantization is easy to apply: inserting it before the convolution.Comment: Preprint of an article published in International Journal of Neural Systems, [10.1142/S0129065722500514] \c{opyright} [copyright World Scientific Publishing Company] [https://www.worldscientific.com/doi/10.1142/S0129065722500514

LC-MS/MS-based proteome profiling in Daphnia pulex and Daphnia longicephala: the Daphnia pulex genome database as a key for high throughput proteomics in Daphnia

<p>Abstract</p> <p>Background</p> <p>Daphniids, commonly known as waterfleas, serve as important model systems for ecology, evolution and the environmental sciences. The sequencing and annotation of the <it>Daphnia pulex </it>genome both open future avenues of research on this model organism. As proteomics is not only essential to our understanding of cell function, and is also a powerful validation tool for predicted genes in genome annotation projects, a first proteomic dataset is presented in this article.</p> <p>Results</p> <p>A comprehensive set of 701,274 peptide tandem-mass-spectra, derived from <it>Daphnia pulex</it>, was generated, which lead to the identification of 531 proteins. To measure the impact of the <it>Daphnia pulex </it>filtered models database for mass spectrometry based <it>Daphnia </it>protein identification, this result was compared with results obtained with the Swiss-Prot and the <it>Drosophila melanogaster </it>database. To further validate the utility of the <it>Daphnia pulex </it>database for research on other <it>Daphnia </it>species, additional 407,778 peptide tandem-mass-spectra, obtained from <it>Daphnia longicephala</it>, were generated and evaluated, leading to the identification of 317 proteins.</p> <p>Conclusion</p> <p>Peptides identified in our approach provide the first experimental evidence for the translation of a broad variety of predicted coding regions within the <it>Daphnia </it>genome. Furthermore it could be demonstrated that identification of <it>Daphnia longicephala </it>proteins using the <it>Daphnia pulex </it>protein database is feasible but shows a slightly reduced identification rate. Data provided in this article clearly demonstrates that the <it>Daphnia </it>genome database is the key for mass spectrometry based high throughput proteomics in <it>Daphnia</it>.</p

Dynamic Power Management for Neuromorphic Many-Core Systems

This work presents a dynamic power management architecture for neuromorphic many core systems such as SpiNNaker. A fast dynamic voltage and frequency scaling (DVFS) technique is presented which allows the processing elements (PE) to change their supply voltage and clock frequency individually and autonomously within less than 100 ns. This is employed by the neuromorphic simulation software flow, which defines the performance level (PL) of the PE based on the actual workload within each simulation cycle. A test chip in 28 nm SLP CMOS technology has been implemented. It includes 4 PEs which can be scaled from 0.7 V to 1.0 V with frequencies from 125 MHz to 500 MHz at three distinct PLs. By measurement of three neuromorphic benchmarks it is shown that the total PE power consumption can be reduced by 75%, with 80% baseline power reduction and a 50% reduction of energy per neuron and synapse computation, all while maintaining temporary peak system performance to achieve biological real-time operation of the system. A numerical model of this power management model is derived which allows DVFS architecture exploration for neuromorphics. The proposed technique is to be used for the second generation SpiNNaker neuromorphic many core system

Alpine dwarf shrubs show high proportions of nonfunctional xylem: Visualization and quantification of species-specific patterns

Xylem conductive capacity is a key determinant of plant hydraulic function and intimately linked to photosynthesis and productivity, but can be impeded by temporary or permanent conduit dysfunctions. Here we show that persistent xylem dysfunctions in unstressed plants are frequent in Alpine dwarf shrubs and occur in various but species-specific cross-sectional patterns. Combined synchrotron micro-computed tomography (micro-CT) imaging, xylem staining, and flow measurements in saturated samples of six widespread Ericaceae species evidence a high proportion (19%-50%) of hydraulically nonfunctional xylem areas in the absence of drought stress, with regular distribution of dysfunctions between or within growth rings. Dysfunctions were only partly reversible and reduced the specific hydraulic conductivity to 1.38 to 3.57 ×10-4 m2 s-1 MPa-1 . Decommission of inner growth rings was clearly related to stem age and a higher vulnerability to cavitation of older rings, while the high proportion of nonfunctional conduits in each annual ring needs further investigations. The lower the xylem fraction contributing to the transport function, the higher was the hydraulic efficiency of conducting xylem areas. Improved understanding of the functional lifespan of xylem elements and the prevalence and nature of dysfunctions is critical to correctly assess structure-function relationships and whole-plant hydraulic strategies

VLSI Implementation of a 2.8 Gevent/s Packet-Based AER Interface with Routing and Event Sorting Functionality

State-of-the-art large-scale neuromorphic systems require sophisticated spike event communication between units of the neural network. We present a high-speed communication infrastructure for a waferscale neuromorphic system, based on application-specific neuromorphic communication ICs in an field programmable gate arrays (FPGA)-maintained environment. The ICs implement configurable axonal delays, as required for certain types of dynamic processing or for emulating spike-based learning among distant cortical areas. Measurements are presented which show the efficacy of these delays in influencing behavior of neuromorphic benchmarks. The specialized, dedicated address-event-representation communication in most current systems requires separate, low-bandwidth configuration channels. In contrast, the configuration of the waferscale neuromorphic system is also handled by the digital packet-based pulse channel, which transmits configuration data at the full bandwidth otherwise used for pulse transmission. The overall so-called pulse communication subgroup (ICs and FPGA) delivers a factor 25–50 more event transmission rate than other current neuromorphic communication infrastructures

ifo Konjunkturprognose 2009/2010: Abschwung setzt sich fort

Die Weltwirtschaft steckt in der tiefsten Rezession seit der großen Depression. Seit diesem Frühjahr dürfte sich das Kontraktionstempo jedoch abgeschwächt haben. Weltweit sind Programme zur Stützung der Konjunktur aufgelegt worden, zudem zeigt die expansive Geldpolitik der Zentralbanken allmählich Wirkung. Auch sind in zahlreichen Ländern Maßnahmen zur Stabilisierung der Finanzmärkte ergriffen worden. Schließlich werden die Realeinkommen durch die starken Rohstoffpreisrückgänge gestützt. Das vom ifo Institut erhobene Weltwirtschaftsklima ist im zweiten Quartal 2009 erstmals seit dem Herbst 2007 wieder gestiegen. Der Anstieg des Indikators resultiert jedoch ausschließlich aus den günstigeren Erwartungen für die nächsten sechs Monate; die Einschätzung der derzeitigen wirtschaftlichen Lage hat sich demgegenüber noch weiter verschlechtert und fiel auf einen neuen historischen Tiefstand. Die deutsche Wirtschaft befindet sich in der schwersten Rezession seit Bestehen der Bundesrepublik. Nach den bisher vorliegenden amtlichen Ergebnissen sank die gesamtwirtschaftliche Produktion im ersten Quartal 2009 saison- und kalenderbereinigt gegenüber dem Jahresendquartal um 3,8%, bereits im vierten Quartal 2008 war die Wirtschaftsleistung um 2,2% geschrumpft. Deutschland verzeichnet damit von allen großen europäischen Volkswirtschaften den schärfsten Wachstumseinbruch. Die gesamtwirtschaftliche Produktion dürfte nach diesem drastischen Rückgang auch im zweiten Quartal gesunken sein, jedoch mit deutlich verringertem Tempo. Für den Beginn einer allmählichen Stabilisierung spricht die aktuelle Entwicklung einer Reihe von gewichtigen Konjunkturindikatoren wie Produktion und Auftragseingang sowie das ifo Geschäftsklima. Zum Rückgang der Wirtschaftsleistung tragen vor allem die Industrie und der Sektor Finanzierung, Vermietung und Unternehmensdienstleistungen bei.Konjunktur, Konjunkturumfrage, Konjunkturprognose, Wirtschaftslage, Geschäftsklima, Weltkonjunktur, Deutschland, Welt

A 16-Channel Fully Configurable Neural SoC With 1.52 μW/Ch Signal Acquisition, 2.79 μW/Ch Real-Time Spike Classifier, and 1.79 TOPS/W Deep Neural Network Accelerator in 22 nm FDSOI

With the advent of high-density micro-electrodes arrays, developing neural probes satisfying the real-time and stringent power-efficiency requirements becomes more challenging. A smart neural probe is an essential device in future neuroscientific research and medical applications. To realize such devices, we present a 22 nm FDSOI SoC with complex on-chip real-time data processing and training for neural signal analysis. It consists of a digitally-assisted 16-channel analog front-end with 1.52 μ W/Ch, dedicated bio-processing accelerators for spike detection and classification with 2.79 μ W/Ch, and a 125 MHz RISC-V CPU, utilizing adaptive body biasing at 0.5 V with a supporting 1.79 TOPS/W MAC array. The proposed SoC shows a proof-of-concept of how to realize a high-level integration of various on-chip accelerators to satisfy the neural probe requirements for modern applications

ifo Konjunkturprognose 2010: Deutsche Wirtschaft ohne Dynamik

Am 15. Dezember 2009 stellte das ifo Institut seine Prognose für die Jahre 2010 und 2011 vor. Zwar steigen seit dem Frühjahr 2009 Produktion und Handel wieder, aber das Wachstumstempo wird niedrig bleiben. Ein Kernproblem ist die Schwächung der internationalen Finanzmärkte, deren Funktionsfähigkeit in wichtigen Segmenten nach wie vor eingeschränkt ist. Zudem musste das Bankensystem gewaltige Eigenkapitalverluste hinnehmen. In wichtigen Industrieländern kommt eine Krise am Immobilienmarkt hinzu, die dort den Abschreibungsbedarf bei Banken erhöht. Die Kreditbedingungen bleiben damit weltweit restriktiv, was die Finanzierung von Investitionen und neuen Arbeitsplätzen massiv beeinträchtigt. Insgesamt wird das Bruttoinlandsprodukt der Welt im Jahr 2010 um 3,1% und im Jahr 2011 um 2,6% steigen, nachdem es im Jahr 2009 um 1,1% zurückgegangen ist. Der Anstieg der Preise wird sich weltweit etwas beschleunigen. In Deutschland hat sich die gesamtwirtschaftliche Produktion im Frühjahr stabilisiert. Im zweiten Quartal expandierte das reale Bruttoinlandsprodukt saison- und kalenderbereinigt um 0,4%, im dritten Quartal sogar um 0,7%. Aufgrund des außerordentlich kräftigen Einbruchs im vorausgegangenen Winterhalbjahr um fast 6% blieb die gesamtwirtschaftliche Produktion, und hier insbesondere die Erzeugung in den exportabhängigen Branchen, aber auf niedrigem Niveau. Der gesamtwirtschaftliche Auslastungsgrad – zieht man die ifo Kapazitätsauslastung im verarbeitenden Gewerbe als Proxy heran – liegt derzeit um etwa 10 Prozentpunkte unter dem langjährigen Durchschnitt. Insgesamt dürfte die gesamtwirtschaftliche Produktion saison- und kalenderbereinigt im Jahresendquartal 2009 weiter zugenommen haben, wenngleich in einem etwas langsameren Tempo (0,5%) als im Vorquartal. Im Gesamtjahr 2009 sinkt das reale Bruttoinlandsprodukt um 4,9%. Im Jahresdurchschnitt 2010 wird das reale Bruttoinlandsprodukt voraussichtlich um 1,7% zunehmen; im Jahresdurchschnitt 2011 um 1,2%.Konjunktur, Konjunkturumfrage, Konjunkturprognose, Wirtschaftslage, Geschäftsklima, Weltkonjunktur, Deutschland, Welt

A database accelerator for energy-efficient query processing and optimization

Data processing on a continuously growing amount of information and the increasing power restrictions have become an ubiquitous challenge in our world today. Besides parallel computing, a promising approach to improve the energy efficiency of current systems is to integrate specialized hardware. This paper presents a Tensilica RISC processor extended with an instruction set to accelerate basic database operators frequently used in modern database systems. The core was taped out in a 28 nm SLP CMOS technology and allows energy-efficient query processing as well as query optimization by applying selectivity estimation techniques. Our chip measurements show an 1000x energy improvement on selected database operators compared to state-of-the-art systems