Versatile stochastic dot product circuits based on nonvolatile memories for high performance neurocomputing and neurooptimization.

The key operation in stochastic neural networks, which have become the state-of-the-art approach for solving problems in machine learning, information theory, and statistics, is a stochastic dot-product. While there have been many demonstrations of dot-product circuits and, separately, of stochastic neurons, the efficient hardware implementation combining both functionalities is still missing. Here we report compact, fast, energy-efficient, and scalable stochastic dot-product circuits based on either passively integrated metal-oxide memristors or embedded floating-gate memories. The circuit's high performance is due to mixed-signal implementation, while the efficient stochastic operation is achieved by utilizing circuit's noise, intrinsic and/or extrinsic to the memory cell array. The dynamic scaling of weights, enabled by analog memory devices, allows for efficient realization of different annealing approaches to improve functionality. The proposed approach is experimentally verified for two representative applications, namely by implementing neural network for solving a four-node graph-partitioning problem, and a Boltzmann machine with 10-input and 8-hidden neurons

Asymptotic behavior of memristive circuits

The interest in memristors has risen due to their possible application both as memory units and as computational devices in combination with CMOS. This is in part due to their nonlinear dynamics, and a strong dependence on the circuit topology. We provide evidence that also purely memristive circuits can be employed for computational purposes. In the present paper we show that a polynomial Lyapunov function in the memory parameters exists for the case of DC controlled memristors. Such Lyapunov function can be asymptotically approximated with binary variables, and mapped to quadratic combinatorial optimization problems. This also shows a direct parallel between memristive circuits and the Hopfield-Little model. In the case of Erdos-Renyi random circuits, we show numerically that the distribution of the matrix elements of the projectors can be roughly approximated with a Gaussian distribution, and that it scales with the inverse square root of the number of elements. This provides an approximated but direct connection with the physics of disordered system and, in particular, of mean field spin glasses. Using this and the fact that the interaction is controlled by a projector operator on the loop space of the circuit. We estimate the number of stationary points of the approximate Lyapunov function and provide a scaling formula as an upper bound in terms of the circuit topology only.Comment: 20 pages, 8 figures; proofs corrected, figures changed; results substantially unchanged; to appear in Entrop

A memristive non-smooth dynamical system with coexistence of bimodule periodic oscillation

© 2022 Elsevier GmbH. All rights reserved. This is the accepted manuscript version of an article which has been published in final form at https://doi.org/10.1016/j.aeue.2022.154279In order to explore the bursting oscillations and the formation mechanism of memristive non-smooth systems, a third-order memristor model and an external periodic excitation are introduced into a non-smooth dynamical system, and a novel 4D memristive non-smooth system with two-timescale is established. The system is divided into two different subsystems by a non-smooth interface, which can be used to simulate the scenario where a memristor encounters a non-smooth circuit in practical application circuits. Three different bursting patterns and bifurcation mechanisms are analyzed with the time series, the corresponding phase portraits, the equilibrium bifurcation diagrams, and the transformed phase portraits. It is pointed that not only the stability of the equilibrium trajectory but also the non-smooth interface may influence the bursting phenomenon, resulting in the sudden jumping of the trajectory and non-smooth bifurcation at the non-smooth interface. In particular, the coexistence of bimodule periodic oscillations at the non-smooth interface can be observed in this system. Finally, the correctness of the theoretical analysis is well verified by the numerical simulation and Multisim circuit simulation. This paper is of great significance for the future analysis and engineering application of the memristor in non-smooth circuits.Peer reviewe

Robust Multimode Function Synchronization of Memristive Neural Networks with Parameter Perturbations and Time-Varying Delays

Publisher Copyright: IEEE Copyright: Copyright 2020 Elsevier B.V., All rights reserved.Currently, some works on studying complete synchronization of dynamical systems are usually restricted to its two special cases: 1) power-rate synchronization and 2) exponential synchronization. Therefore, how to give a generalization of these types of complete synchronization by the mathematical expression is an open question that needs to be urgently solved. To begin with, this article proposes multimode function synchronization by the mathematical expression for the first time, which is a generalization of exponential synchronization, power-rate synchronization, logarithmical synchronization, and so on. Moreover, two adaptive controllers are designed to achieve robust multimode function synchronization of memristive neural networks (MNNs) with mismatched parameters and uncertain parameters. Each adaptive controller includes function r(t) and update gain σ. By choosing different types of r(t), multiple types of complete synchronization, including power-rate synchronization and exponential synchronization can be obtained. And update gain σ can be used to adjust the speed of synchronization. Therefore, our results enlarge and strengthen the existing results. Two examples are put forward to verify the validity of our results.Peer reviewedFinal Accepted Versio