Review on data-centric brain-inspired computing paradigms exploiting emerging memory devices

Biologically-inspired neuromorphic computing paradigms are computational platforms that imitate synaptic and neuronal activities in the human brain to process big data flows in an efficient and cognitive manner. In the past decades, neuromorphic computing has been widely investigated in various application fields such as language translation, image recognition, modeling of phase, and speech recognition, especially in neural networks (NNs) by utilizing emerging nanotechnologies; due to their inherent miniaturization with low power cost, they can alleviate the technical barriers of neuromorphic computing by exploiting traditional silicon technology in practical applications. In this work, we review recent advances in the development of brain-inspired computing (BIC) systems with respect to the perspective of a system designer, from the device technology level and circuit level up to the architecture and system levels. In particular, we sort out the NN architecture determined by the data structures centered on big data flows in application scenarios. Finally, the interactions between the system level with the architecture level and circuit/device level are discussed. Consequently, this review can serve the future development and opportunities of the BIC system design

System-Level Design of Energy-Proportional Many-Core Servers for Exascale Computing

Continuous advances in manufacturing technologies are enabling the development of more powerful and compact high-performance computing (HPC) servers made of many-core processing architectures. However, this soaring demand for computing power in the last years has grown faster than emiconductor technology evolution can sustain, and has produced as collateral undesirable effect a surge in power consumption and heat density in these new HPC servers, which result on significant performance degradation. In this keynote, I advocate to completely revise the current HPC server architectures. In particular, inspired by the mammalian brain, I propose to design a disruptive three-dimensional (3D) computing server architecture that overcomes the prevailing worst-case power and cooling provisioning paradigm for servers. This new 3D server design champions a new system-level thermal modeling, which can be used by novel proactive energy controllers for detailed heat and energy management in many-core HPC servers, thanks to micro-scale liquid cooling. Then, I will show the impact of new near-threshold computing architectures on server design, and how we can integrate new on-chip microfluidic fuel cell networks to enable energy-scalability in future generations of many-core HPC servers targeting Exascale computing.Universidad de Málaga, Campus de Excelencia Internacional Andalucía Tech

Redes Neuronales Artificiales. Un Enfoque Práctico : P. Isasi Viñuela, I. M. Galván. Pearson Educación, 2004. ISBN 84-205-4025-0

Artificial Neural Networks belong to the sub-symbolic branch of Artificial Intelligence since they allow to find the solution of a problem without the need of knowing the algorithm necessary to solve it. This turns them into a tool based on an approach completely different from that used by conventional Computing. Artificial neural networks (ANN) have been inspired in how the brain works and in the way its cells relate to each other. Technological advances provide ever-greater resources to represent really complex structures, perform computations at high speed and in parallel. This has indeed motivated research on this kind of tool.Facultad de Informátic

Brain-Inspired Intelligent Systems for Daily Assistance

The fields of machine learning and cognitive computing have been in the last decade revolutionised with neural-inspired algorithms (e.g., deep ANNs and deep RL) and brain-intelligent systems that assist in many real-world learning tasks from robot monitoring and interaction at home to complex decision-making about emotions and behaviours in humans and animals. While there are remarkable advances in these brain-inspired algorithms and systems, they need to be trained with huge data sets, and their results lack flexibility to adapt to diverse learning tasks and sustainable performance over long periods of time. To address these challenges, it is essential to gain an analytical understanding of the principles that allow biological inspired intelligent systems to leverage knowledge and how they can be translated to hardware for daily assistance and practical applications. This special issue brings researchers from interdesciplinary domains to report their latest research work on algorithms and neural-inspired systems that flexibly adapt to new learning tasks, learn from the environment using multimodal signals (e.g., neural, physiological, and kinematic), and produce autonomous adaptive agencies, which utilise cognitive and affective data, within a social neuroscientific framework. In this special issue, we have selected five papers out of fourteen high-quality papers after a careful reviewing process, which brings the acceptance rate to 35.7 percent. The five papers are representative of the current state-of-the-art in this area

A Marr's Three‐Level Analytical Framework for Neuromorphic Electronic Systems

Neuromorphic electronics, an emerging field that aims for building electronic mimics of the biological brain, holds promise for reshaping the frontiers of information technology and enabling a more intelligent and efficient computing paradigm. As their biological brain counterpart, the neuromorphic electronic systems are complex, having multiple levels of organization. Inspired by David Marr's famous three-level analytical framework developed for neuroscience, the advances in neuromorphic electronic systems are selectively surveyed and given significance to these research endeavors as appropriate from the computational level, algorithmic level, or implementation level. Under this framework, the problem of how to build a neuromorphic electronic system is defined in a tractable way. In conclusion, the development of neuromorphic electronic systems confronts a similar challenge to the one neuroscience confronts, that is, the limited constructability of the low-level knowledge (implementations and algorithms) to achieve high-level brain-like (human-level) computational functions. An opportunity arises from the communication among different levels and their codesign. Neuroscience lab-on-neuromorphic chip platforms offer additional opportunity for mutual benefit between the two disciplines

Memory and information processing in neuromorphic systems

A striking difference between brain-inspired neuromorphic processors and current von Neumann processors architectures is the way in which memory and processing is organized. As Information and Communication Technologies continue to address the need for increased computational power through the increase of cores within a digital processor, neuromorphic engineers and scientists can complement this need by building processor architectures where memory is distributed with the processing. In this paper we present a survey of brain-inspired processor architectures that support models of cortical networks and deep neural networks. These architectures range from serial clocked implementations of multi-neuron systems to massively parallel asynchronous ones and from purely digital systems to mixed analog/digital systems which implement more biological-like models of neurons and synapses together with a suite of adaptation and learning mechanisms analogous to the ones found in biological nervous systems. We describe the advantages of the different approaches being pursued and present the challenges that need to be addressed for building artificial neural processing systems that can display the richness of behaviors seen in biological systems.Comment: Submitted to Proceedings of IEEE, review of recently proposed neuromorphic computing platforms and system