464 research outputs found
A study on hardware design for high performance artificial neural network by using FPGA and NoC
制度:新 ; 報告番号:甲3421号 ; 学位の種類:博士(工学) ; 授与年月日:2011/9/15 ; 早大学位記番号:新574
FEEDFORWARD ARTIFICIAL NEURAL NETWORK DESIGN UTILISING SUBTHRESHOLD MODE CMOS DEVICES
This thesis reviews various previously reported techniques for simulating artificial
neural networks and investigates the design of fully-connected feedforward networks
based on MOS transistors operating in the subthreshold mode of conduction as they are
suitable for performing compact, low power, implantable pattern recognition systems.
The principal objective is to demonstrate that the transfer characteristic of the devices
can be fully exploited to design basic processing modules which overcome the linearity
range, weight resolution, processing speed, noise and mismatch of components
problems associated with weak inversion conduction, and so be used to implement
networks which can be trained to perform practical tasks.
A new four-quadrant analogue multiplier, one of the most important cells in the
design of artificial neural networks, is developed. Analytical as well as simulation
results suggest that the new scheme can efficiently be used to emulate both the synaptic
and thresholding functions. To complement this thresholding-synapse, a novel
current-to-voltage converter is also introduced. The characteristics of the well known
sample-and-hold circuit as a weight memory scheme are analytically derived and
simulation results suggest that a dummy compensated technique is required to obtain the
required minimum of 8 bits weight resolution. Performance of the combined load and
thresholding-synapse arrangement as well as an on-chip update/refresh mechanism are
analytically evaluated and simulation studies on the Exclusive OR network as a
benchmark problem are provided and indicate a useful level of functionality.
Experimental results on the Exclusive OR network and a 'QRS' complex detector
based on a 10:6:3 multilayer perceptron are also presented and demonstrate the potential
of the proposed design techniques in emulating feedforward neural networks
Committee machines -- a universal method to deal with non-idealities in memristor-based neural networks
Artificial neural networks are notoriously power- and time-consuming when
implemented on conventional von Neumann computing systems. Consequently, recent
years have seen an emergence of research in machine learning hardware that
strives to bring memory and computing closer together. A popular approach is to
realise artificial neural networks in hardware by implementing their synaptic
weights using memristive devices. However, various device- and system-level
non-idealities usually prevent these physical implementations from achieving
high inference accuracy. We suggest applying a well-known concept in computer
science -- committee machines -- in the context of memristor-based neural
networks. Using simulations and experimental data from three different types of
memristive devices, we show that committee machines employing ensemble
averaging can successfully increase inference accuracy in physically
implemented neural networks that suffer from faulty devices, device-to-device
variability, random telegraph noise and line resistance. Importantly, we
demonstrate that the accuracy can be improved even without increasing the total
number of memristors.Comment: 22 pages, 18 figures, 4 table
- …