Extended Bit-Plane Compression for Convolutional Neural Network Accelerators

After the tremendous success of convolutional neural networks in image classification, object detection, speech recognition, etc., there is now rising demand for deployment of these compute-intensive ML models on tightly power constrained embedded and mobile systems at low cost as well as for pushing the throughput in data centers. This has triggered a wave of research towards specialized hardware accelerators. Their performance is often constrained by I/O bandwidth and the energy consumption is dominated by I/O transfers to off-chip memory. We introduce and evaluate a novel, hardware-friendly compression scheme for the feature maps present within convolutional neural networks. We show that an average compression ratio of 4.4 7 relative to uncompressed data and a gain of 60% over existing method can be achieved for ResNet-34 with a compression block requiring <300 bit of sequential cells and minimal combinational logic

EBPC: Extended Bit-Plane Compression for Deep Neural Network Inference and Training Accelerators

In the wake of the success of convolutional neural networks in image classification, object recognition, speech recognition, etc., the demand for deploying these compute-intensive ML models on embedded and mobile systems with tight power and energy constraints at low cost, as well as for boosting throughput in data centers, is growing rapidly. This has sparked a surge of research into specialized hardware accelerators. Their performance is typically limited by I/O bandwidth, power consumption is dominated by I/O transfers to off-chip memory, and on-chip memories occupy a large part of the silicon area. We introduce and evaluate a novel, hardware-friendly, and lossless compression scheme for the feature maps present within convolutional neural networks. We present hardware architectures and synthesis results for the compressor and decompressor in 65 nm. With a throughput of one 8-bit word/cycle at 600 MHz, they fit into 2.8 kGE and 3.0 kGE of silicon area, respectively - together the size of less than seven 8-bit multiply-add units at the same throughput. We show that an average compression ratio of 5.1 7 for AlexNet, 4 for VGG-16, 2.4 7 for ResNet-34 and 2.2 7 for MobileNetV2 can be achieved - a gain of 45-70% over existing methods. Our approach also works effectively for various number formats, has a low frame-to-frame variance on the compression ratio, and achieves compression factors for gradient map compression during training that are even better than for inference

Hyperdrive: A Multi-Chip Systolically Scalable Binary-Weight CNN Inference Engine

Deep neural networks have achieved impressive results in computer vision and machine learning. Unfortunately, state-of-the-art networks are extremely compute and memory intensive, which makes them unsuitable for mW-devices such as loT end-nodes. Aggressive quantization of these networks dramatically reduces the computation and memory footprint. Binary-weight neural networks (BWNs) follow this trend, pushing weight quantization to the limit. Hardware accelerators for BWNs presented up to now have focused on core efficiency, disregarding I/O bandwidth, and system-level efficiency that are crucial for the deployment of accelerators in ultra-low power devices. We present Hyperdrive: a BWN accelerator dramatically reducing the I/O bandwidth exploiting a novel binary-weight streaming approach, which can he used for an arbitrarily sized convolutional neural network architecture and input resolution by exploiting the natural scalability of the compute units both at chip-level and system-level by arranging Hyperdrive chips systolically in a 2D mesh while processing the entire feature map together in parallel. Hyperdrive achieves 4.3 TOp/s/W system-level efficiency (i.e., including I/Os)-3.1 x higher than state-of-the-art BWN accelerators, even if its core uses resource-intensive FP16 arithmetic for increased robustness

Laelaps: An Energy-Efficient Seizure Detection Algorithm from Long-term Human iEEG Recordings without False Alarms

We propose Laelaps, an energy-efficient and fast learning algorithm with no false alarms for epileptic seizure detection from long-term intracranial electroencephalography (iEEG) signals. Laelaps uses end-to-end binary operations by exploiting symbolic dynamics and brain-inspired hyperdimensional computing. Laelaps's results surpass those yielded by state-of-the-art (SoA) methods [1], [2], [3], including deep learning, on a new very large dataset containing 116 seizures of 18 drug-resistant epilepsy patients in 2656 hours of recordings - each patient implanted with 24 to 128 iEEG electrodes. Laelaps trains 18 patient-specific models by using only 24 seizures: 12 models are trained with one seizure per patient, the others with two seizures. The trained models detect 79 out of 92 unseen seizures without any false alarms across all the patients as a big step forward in practical seizure detection. Importantly, a simple implementation of Laelaps on the Nvidia Tegra X2 embedded device achieves 1.7 7-3.9 7 faster execution and 1.4 7-2.9 7 lower energy consumption compared to the best result from the SoA methods. Our source code and anonymized iEEG dataset are freely available at http://ieeg-swez.ethz.ch

Chronic Arsenic Exposure and Oxidative Stress: OGG1 Expression and Arsenic Exposure, Nail Selenium, and Skin Hyperkeratosis in Inner Mongolia

Arsenic, a human carcinogen, is known to induce oxidative damage to DNA. In this study we investigated oxidative stress and As exposure by determining gene expression of OGG1, which codes for an enzyme, 8-oxoguanine DNA glycosylase, involved in removing 8-oxoguanine in As-exposed individuals. Bayingnormen (Ba Men) residents in Inner Mongolia are chronically exposed to As via drinking water. Water, toenail, and blood samples were collected from 299 Ba Men residents exposed to 0.34–826 μg/L As. RNA was isolated from blood, and mRNA levels of OGG1 were determined using real-time polymerase chain reaction. OGG1 expression levels were linked to As concentrations in drinking water and nails, selenium concentrations in nails, and skin hyperkeratosis. OGG1 expression was strongly associated with water As concentrations (p < 0.0001). Addition of the quadratic term significantly improved the fit compared with the linear model (p = 0.05). The maximal OGG1 response was at the water As concentration of 149 μg/L. OGG1 expression was also significantly associated with toenail As concentrations (p = 0.015) but inversely associated with nail Se concentrations (p = 0.0095). We found no significant differences in the As-induced OGG1 expression due to sex, smoking, or age even though the oldest group showed the strongest OGG1 response (p = 0.0001). OGG1 expression showed a dose-dependent increased risk of skin hyperkeratosis in males (trend analysis, p = 0.02), but the trend was not statistically significant in females. The results from this study provide a linkage between oxidative stress and As exposure in humans. OGG1 expression may be useful as a biomarker for assessing oxidative stress from As exposure

Can Agricultural Management Induced Changes in Soil Organic Carbon Be Detected Using Mid-Infrared Spectroscopy?

A major limitation to building credible soil carbon sequestration programs is the cost of measuring soil carbon change. Diffuse reflectance spectroscopy (DRS) is considered a viable low-cost alternative to traditional laboratory analysis of soil organic carbon (SOC). While numerous studies have shown that DRS can produce accurate and precise estimates of SOC across landscapes, whether DRS can detect subtle management induced changes in SOC at a given site has not been resolved. Here, we leverage archived soil samples from seven long-term research trials in the U.S. to test this question using mid infrared (MIR) spectroscopy coupled with the USDA-NRCS Kellogg Soil Survey Laboratory MIR spectral library. Overall, MIR-based estimates of SOC%, with samples scanned on a secondary instrument, were excellent with the root mean square error ranging from 0.10 to 0.33% across the seven sites. In all but two instances, the same statistically significant (p \u3c 0.10) management effect was found using both the lab-based SOC% and MIR estimated SOC% data. Despite some additional uncertainty, primarily in the form of bias, these results suggest that large existing MIR spectral libraries can be operationalized in other laboratories for successful carbon monitoring

Biodiversity Loss and the Taxonomic Bottleneck: Emerging Biodiversity Science

Human domination of the Earth has resulted in dramatic changes to global and local patterns of biodiversity. Biodiversity is critical to human sustainability because it drives the ecosystem services that provide the core of our life-support system. As we, the human species, are the primary factor leading to the decline in biodiversity, we need detailed information about the biodiversity and species composition of specific locations in order to understand how different species contribute to ecosystem services and how humans can sustainably conserve and manage biodiversity. Taxonomy and ecology, two fundamental sciences that generate the knowledge about biodiversity, are associated with a number of limitations that prevent them from providing the information needed to fully understand the relevance of biodiversity in its entirety for human sustainability: (1) biodiversity conservation strategies that tend to be overly focused on research and policy on a global scale with little impact on local biodiversity; (2) the small knowledge base of extant global biodiversity; (3) a lack of much-needed site-specific data on the species composition of communities in human-dominated landscapes, which hinders ecosystem management and biodiversity conservation; (4) biodiversity studies with a lack of taxonomic precision; (5) a lack of taxonomic expertise and trained taxonomists; (6) a taxonomic bottleneck in biodiversity inventory and assessment; and (7) neglect of taxonomic resources and a lack of taxonomic service infrastructure for biodiversity science. These limitations are directly related to contemporary trends in research, conservation strategies, environmental stewardship, environmental education, sustainable development, and local site-specific conservation. Today’s biological knowledge is built on the known global biodiversity, which represents barely 20% of what is currently extant (commonly accepted estimate of 10 million species) on planet Earth. Much remains unexplored and unknown, particularly in hotspots regions of Africa, South Eastern Asia, and South and Central America, including many developing or underdeveloped countries, where localized biodiversity is scarcely studied or described. ‘‘Backyard biodiversity’’, defined as local biodiversity near human habitation, refers to the natural resources and capital for ecosystem services at the grassroots level, which urgently needs to be explored, documented, and conserved as it is the backbone of sustainable economic development in these countries. Beginning with early identification and documentation of local flora and fauna, taxonomy has documented global biodiversity and natural history based on the collection of ‘‘backyard biodiversity’’ specimens worldwide. However, this branch of science suffered a continuous decline in the latter half of the twentieth century, and has now reached a point of potential demise. At present there are very few professional taxonomists and trained local parataxonomists worldwide, while the need for, and demands on, taxonomic services by conservation and resource management communities are rapidly increasing. Systematic collections, the material basis of biodiversity information, have been neglected and abandoned, particularly at institutions of higher learning. Considering the rapid increase in the human population and urbanization, human sustainability requires new conceptual and practical approaches to refocusing and energizing the study of the biodiversity that is the core of natural resources for sustainable development and biotic capital for sustaining our life-support system. In this paper we aim to document and extrapolate the essence of biodiversity, discuss the state and nature of taxonomic demise, the trends of recent biodiversity studies, and suggest reasonable approaches to a biodiversity science to facilitate the expansion of global biodiversity knowledge and to create useful data on backyard biodiversity worldwide towards human sustainability

Female chacma baboons form strong, equitable, and enduring social bonds

Analyses of the pattern of associations, social interactions, coalitions, and aggression among chacma baboons (Papio hamadryas ursinus) in the Okavango Delta of Botswana over a 16-year period indicate that adult females form close, equitable, supportive, and enduring social relationships. They show strong and stable preferences for close kin, particularly their own mothers and daughters. Females also form strong attachments to unrelated females who are close to their own age and who are likely to be paternal half-sisters. Although absolute rates of aggression among kin are as high as rates of aggression among nonkin, females are more tolerant of close relatives than they are of others with whom they have comparable amounts of contact. These findings complement previous work which indicates that the strength of social bonds enhances the fitness of females in this population and support findings about the structure and function of social bonds in other primate groups

Characterization and social correlates of fecal testosterone and cortisol excretion in wild male Saguinus mystax

Reproductive success in male primates can be influenced by testosterone (T) and cortisol (C). We examined them in wild Saguinus mystax via fecal hormone analysis. Firstly, we wanted to characterize male hormonal status over the course of the year. Further we tested the influence of the reproductive status of the breeding female, social instability, and intergroup encounter rates on T levels, comparing the results with predictions of the challenge hypothesis (Wingfield et al., 1990). We also tested for interindividual differences in hormonal levels, possibly related to social or breeding status. We collected data during a 12-mo study on 2 groups of moustached tamarins at the Estación Biológica Quebrada Blanco in northeastern Peru. We found fairly similar T and C levels over the course of the year for all males. Yet an elevation of T shortly after the birth of infants, during the phase of ovarian inactivity of the group’s breeding female, was evident. Hormonal levels were not significantly elevated during a phase of social instability, did not correlate with intergroup encounter rates, and did not differ between breeding and nonbreeding males. Our results confirm the challenge hypothesis (Wingfield et al., 1990). The data suggest that reproductive competition inmoustached tamarins is not based on endocrinological, but instead on behavioral mechanisms, possibly combined with sperm competition.Deutsche Forschungsgemeinschaft (HE 1870/10-1,2