41 research outputs found
Interfacing of neuromorphic vision, auditory and olfactory sensors with digital neuromorphic circuits
The conventional Von Neumann architecture imposes strict constraints on the development of intelligent adaptive systems. The requirements of substantial computing power to process and analyse complex data make such an approach impractical to be used in implementing smart systems.
Neuromorphic engineering has produced promising results in applications such as electronic sensing, networking architectures and complex data processing. This interdisciplinary field takes inspiration from neurobiological architecture and emulates these characteristics using analogue Very Large Scale Integration (VLSI). The unconventional approach of exploiting the non-linear current characteristics of transistors has aided in the development of low-power adaptive systems that can be implemented in intelligent systems. The neuromorphic approach is widely applied in electronic sensing, particularly in vision, auditory, tactile and olfactory sensors. While conventional sensors generate a huge amount of redundant output data, neuromorphic sensors implement the biological concept of spike-based output to generate sparse output data that corresponds to a certain sensing event. The operation principle applied in these sensors supports reduced power consumption with operating efficiency comparable to conventional sensors. Although neuromorphic sensors such as Dynamic Vision Sensor (DVS), Dynamic and Active pixel Vision Sensor (DAVIS) and AEREAR2 are steadily expanding their scope of application in real-world systems, the lack of spike-based data processing algorithms and complex interfacing methods restricts its applications in low-cost standalone autonomous systems.
This research addresses the issue of interfacing between neuromorphic sensors and digital neuromorphic circuits. Current interfacing methods of these sensors are dependent on computers for output data processing. This approach restricts the portability of these sensors, limits their application in a standalone system and increases the overall cost of such systems. The proposed methodology simplifies the interfacing of these sensors with digital neuromorphic processors by utilizing AER communication protocols and neuromorphic hardware developed under the Convolution AER Vision Architecture for Real-time (CAVIAR) project. The proposed interface is simulated using a JAVA model that emulates a typical spikebased output of a neuromorphic sensor, in this case an olfactory sensor, and functions that process this data based on supervised learning. The successful implementation of this simulation suggests that the methodology is a practical solution and can be implemented in hardware. The JAVA simulation is compared to a similar model developed in Nengo, a standard large-scale neural simulation tool.
The successful completion of this research contributes towards expanding the scope of application of neuromorphic sensors in standalone intelligent systems. The easy interfacing method proposed in this thesis promotes the portability of these sensors by eliminating the dependency on computers for output data processing. The inclusion of neuromorphic Field Programmable Gate Array (FPGA) board allows reconfiguration and deployment of learning algorithms to implement adaptable systems. These low-power systems can be widely applied in biosecurity and environmental monitoring. With this thesis, we suggest directions for future research in neuromorphic standalone systems based on neuromorphic olfaction
Event Driven Tactile Sensors for Artificial Devices
Present-day robots are, to some extent, able to deal with high complexity and
variability of the real-world environment. Their cognitive capabilities can be further
enhanced, if they physically interact and explore the real-world objects. For this,
the need for efficient tactile sensors is growing day after day in such a way are
becoming more and more part of daily life devices especially in robotic applications
for manipulation and safe interaction with the environment.
In this thesis, we highlight the importance of touch sensing in humans and robots.
Inspired by the biological systems, in the the first part, we merge between neuromorphic
engineering and CMOS technology where the former is a eld of science that
replicates what is biologically (neurons of the nervous system) inside humans into
the circuit level. We explain the operation and then characterize different sensor
circuits through simulation and experiment to propose finally new prototypes
based on the achieved results.
In the second part, we present a machine learning technique for detecting the
direction and orientation of a sliding tip over a complete skin patch of the iCub
robot. Through learning and online testing, the algorithm classies different
trajectories across the skin patch. Through this part, we show the results of the
considered algorithm with a future perspective to extend the work
Biomimetic cochlea filters : from modelling, design to analogue VLSI implementation
This thesis presents a novel biomimetic cochlea filter which closely resembles the biological
cochlea behaviour. The filter is highly feasible for analogue very-large-scale integration
(VLSI) circuits, which leads to a micro-watt-power and millimetre-sized hardware implementation.
By virtue of such features, the presented filter contributes to a solid foundation for future
biologically-inspired audio signal processors.
Unlike existing works, the presented filter is developed by taking direct inspirations from the
physiologically measured results of the biological cochlea. Since the biological cochlea has
prominently different characteristics of frequency response from low to high frequencies, the
biomimetic cochlea filter is built by cascading three sub-filters accordingly: a 2nd-order bandpass
filter for the constant gentle low-frequency response, a 2nd-order tunable low-pass filter
for the variable and selective centre frequency response and a 5th-order elliptic filter for the
ultra-steep roll-off at stop-band. As a proof of concept, a biomimetic cochlea filter bank is built
to process audio signals, which demonstrates the highly discriminative spectral decomposition
and high-resolution time-frequency analysis capabilities similar to the biological cochlea.
The filter has simple representation in the Laplace domain which leads to a convenient analogue
circuit realisation. A floating-active-inductor circuit cell is developed to build the corresponding
RLC ladder for each of the three sub-filters. The circuits are designed based on complementary
metal-oxide-semiconductor (CMOS) transistors for VLSI implementation. Non-ideal factors
of CMOS transistors including parasitics, noise and mismatches are extensively analysed and
consciously considered in the circuit design. An analogue VLSI chip is successfully fabricated
using 0.35μ m CMOS process. The chip measurements demonstrate that the centre frequency
response of the filter has about 20 dB wide gain tuning range and a high quality factor reaching
maximally over 19. The filter has a 20 dB/decade constant gentle low-frequency tail and an
over 300 dB/decade sharp stop-band roll-off slope. The measured results agree with the filter
model expectations and are comparable with the biological cochlea characteristics. Each filter
channel consumes as low as 59.5 ~90μ Wpower and occupies only 0.9 mm2 area. Besides, the
biomimetic cochlea filter chip is characterised from a wide range of angles and the experimental
results cover not only the auditory filter specifications but also the integrated circuit design
considerations.
Furthermore, following the progressive development of the acoustic resonator based on microelectro-
mechanical systems (MEMS) technology, a MEMS-CMOS implementation of the proposed
filter becomes possible in the future. A key challenge for such implementation is the
low sensing capacitance of the MEMS resonator which suffers significantly from sensitivity
degradation due to the parasitic capacitance. A novel MEMS capacitive interface circuit chip
is additionally developed to solve this issue. As shown in the chip results, the interface circuit
is able to cancel the parasitic capacitance and increase the sensitivity of capacitive sensors by
35 dB without consuming any extra power. Besides, the chopper-stabilisation technique is employed
which effectively reduces the circuit flicker noise and offsets. Due to these features, the
interface circuit chip is capable of converting a 7.5 fF capacitance change of a 1-Volt-biased
0.5 pF capacitive sensor pair into a 0.745 V signal-conditioned output while consuming only
165.2μ W power
A Construction Kit for Efficient Low Power Neural Network Accelerator Designs
Implementing embedded neural network processing at the edge requires
efficient hardware acceleration that couples high computational performance
with low power consumption. Driven by the rapid evolution of network
architectures and their algorithmic features, accelerator designs are
constantly updated and improved. To evaluate and compare hardware design
choices, designers can refer to a myriad of accelerator implementations in the
literature. Surveys provide an overview of these works but are often limited to
system-level and benchmark-specific performance metrics, making it difficult to
quantitatively compare the individual effect of each utilized optimization
technique. This complicates the evaluation of optimizations for new accelerator
designs, slowing-down the research progress. This work provides a survey of
neural network accelerator optimization approaches that have been used in
recent works and reports their individual effects on edge processing
performance. It presents the list of optimizations and their quantitative
effects as a construction kit, allowing to assess the design choices for each
building block separately. Reported optimizations range from up to 10'000x
memory savings to 33x energy reductions, providing chip designers an overview
of design choices for implementing efficient low power neural network
accelerators
An Optoelectronic Stimulator for Retinal Prosthesis
Retinal prostheses require the presence of viable population of cells in the inner retina. Evaluations
of retina with Age-Related Macular Degeneration (AMD) and Retinitis Pigmentosa (RP)
have shown a large number of cells remain in the inner retina compared with the outer retina.
Therefore, vision loss caused by AMD and RP is potentially treatable with retinal prostheses.
Photostimulation based retinal prostheses have shown many advantages compared with retinal
implants. In contrary to electrode based stimulation, light does not require mechanical contact.
Therefore, the system can be completely external and not does have the power and degradation
problems of implanted devices. In addition, the stimulating point is
flexible and does not require
a prior decision on the stimulation location. Furthermore, a beam of light can be projected on
tissue with both temporal and spatial precision. This thesis aims at fi nding a feasible solution
to such a system.
Firstly, a prototype of an optoelectronic stimulator was proposed and implemented by using the
Xilinx Virtex-4 FPGA evaluation board. The platform was used to demonstrate the possibility
of photostimulation of the photosensitized neurons. Meanwhile, with the aim of developing
a portable retinal prosthesis, a system on chip (SoC) architecture was proposed and a wide
tuning range sinusoidal voltage-controlled oscillator (VCO) which is the pivotal component of
the system was designed. The VCO is based on a new designed Complementary Metal Oxide
Semiconductor (CMOS) Operational Transconductance Ampli er (OTA) which achieves a good
linearity over a wide tuning range. Both the OTA and the VCO were fabricated in the AMS
0.35 µm CMOS process. Finally a 9X9 CMOS image sensor with spiking pixels was designed.
Each pixel acts as an independent oscillator whose frequency is controlled by the incident light
intensity. The sensor was fabricated in the AMS 0.35 µm CMOS Opto Process. Experimental
validation and measured results are provided
Stochastic Memory Devices for Security and Computing
With the widespread use of mobile computing and internet of things, secured communication and chip authentication have become extremely important. Hardware-based security concepts generally provide the best performance in terms of a good standard of security, low power consumption, and large-area density. In these concepts, the stochastic properties of nanoscale devices, such as the physical and geometrical variations of the process, are harnessed for true random number generators (TRNGs) and physical unclonable functions (PUFs). Emerging memory devices, such as resistive-switching memory (RRAM), phase-change memory (PCM), and spin-transfer torque magnetic memory (STT-MRAM), rely on a unique combination of physical mechanisms for transport and switching, thus appear to be an ideal source of entropy for TRNGs and PUFs. An overview of stochastic phenomena in memory devices and their use for developing security and computing primitives is provided. First, a broad classification of methods to generate true random numbers via the stochastic properties of nanoscale devices is presented. Then, practical implementations of stochastic TRNGs, such as hardware security and stochastic computing, are shown. Finally, future challenges to stochastic memory development are discussed
Neuromorphic nanophotonic systems for artificial intelligence
Over the last decade, we have witnessed an astonishing pace of development in the field of artificial intelligence (AI), followed by proliferation of AI algorithms into virtually every domain of our society. While modern AI models boast impressive performance, they also require massive amounts of energy and resources for operation. This is further fuelling the research into AI-specific, optimised computing hardware. At the same time, the remarkable energy efficiency of the brain brings an interesting question: Can we further borrow from the working principles of biological intelligence to realise a more efficient artificial intelligence? This can be considered as the main research question in the field of neuromorphic engineering. Thanks to the developments in AI and recent advancements in the field of photonics and photonic integration, research into light-powered implementations of neuromorphic hardware has recently experienced a significant uptick of interest. In such hardware, the aim is to seize some of the highly desirable properties of photonics not just for communication, but also to perform computation. Neurons in the brain frequently process information (compute) and communicate using action potentials, which are brief voltage spikes that encode information in the temporal domain. Similar dynamical behaviour can be elicited in some photonic devices, at speeds multiple orders of magnitude higher. Such devices with the capability of neuron-like spiking are of significant research interest for the field of neuromorphic photonics. Two distinct types of such excitable, spiking systems operating with optical signals are studied and investigated in this thesis. First, a vertical cavity surface emitting laser (VCSEL) can be operated under a specific set of conditions to realise a high-speed, all-optical excitable photonic neuron that operates at standard telecom wavelengths. The photonic VCSEL-neuron was dynamically characterised and various information encoding mechanisms were studied in this device. In particular, a spiking rate-coding regime of operation was experimentally demonstrated, and its viability for performing spiking domain conversion of digital images was explored. Furthermore, for the first time, a joint architecture utilising a VCSEL-neuron coupled to a photonic integrated circuit (PIC) silicon microring weight bank was experimentally demonstrated in two different functional layouts. Second, an optoelectronic (O/E/O) circuit based upon a resonant tunnelling diode (RTD) was introduced. Two different types of RTD devices were studied experimentally:
a higher output power, µ-scale RTD that was RF coupled to an active photodetector and a VCSEL (this layout is referred to as a PRL node); and a simplified, photosensitive RTD with nanoscale injector that was RF coupled to a VCSEL (referred to as a nanopRL node). Hallmark excitable behaviours were studied in both devices, including excitability thresholding and refractory periods. Furthermore, a more exotic resonate and-fire dynamical behaviour was also reported in the nano-pRL device. Finally, a modular numerical model of the RTD was introduced, and various information processing methods were demonstrated using both a single RTD spiking node, as well as a perceptron-type spiking neural network with physical models of optoelectronic RTD nodes serving as artificial spiking neurons.Over the last decade, we have witnessed an astonishing pace of development in the field of artificial intelligence (AI), followed by proliferation of AI algorithms into virtually every domain of our society. While modern AI models boast impressive performance, they also require massive amounts of energy and resources for operation. This is further fuelling the research into AI-specific, optimised computing hardware. At the same time, the remarkable energy efficiency of the brain brings an interesting question: Can we further borrow from the working principles of biological intelligence to realise a more efficient artificial intelligence? This can be considered as the main research question in the field of neuromorphic engineering. Thanks to the developments in AI and recent advancements in the field of photonics and photonic integration, research into light-powered implementations of neuromorphic hardware has recently experienced a significant uptick of interest. In such hardware, the aim is to seize some of the highly desirable properties of photonics not just for communication, but also to perform computation. Neurons in the brain frequently process information (compute) and communicate using action potentials, which are brief voltage spikes that encode information in the temporal domain. Similar dynamical behaviour can be elicited in some photonic devices, at speeds multiple orders of magnitude higher. Such devices with the capability of neuron-like spiking are of significant research interest for the field of neuromorphic photonics. Two distinct types of such excitable, spiking systems operating with optical signals are studied and investigated in this thesis. First, a vertical cavity surface emitting laser (VCSEL) can be operated under a specific set of conditions to realise a high-speed, all-optical excitable photonic neuron that operates at standard telecom wavelengths. The photonic VCSEL-neuron was dynamically characterised and various information encoding mechanisms were studied in this device. In particular, a spiking rate-coding regime of operation was experimentally demonstrated, and its viability for performing spiking domain conversion of digital images was explored. Furthermore, for the first time, a joint architecture utilising a VCSEL-neuron coupled to a photonic integrated circuit (PIC) silicon microring weight bank was experimentally demonstrated in two different functional layouts. Second, an optoelectronic (O/E/O) circuit based upon a resonant tunnelling diode (RTD) was introduced. Two different types of RTD devices were studied experimentally:
a higher output power, µ-scale RTD that was RF coupled to an active photodetector and a VCSEL (this layout is referred to as a PRL node); and a simplified, photosensitive RTD with nanoscale injector that was RF coupled to a VCSEL (referred to as a nanopRL node). Hallmark excitable behaviours were studied in both devices, including excitability thresholding and refractory periods. Furthermore, a more exotic resonate and-fire dynamical behaviour was also reported in the nano-pRL device. Finally, a modular numerical model of the RTD was introduced, and various information processing methods were demonstrated using both a single RTD spiking node, as well as a perceptron-type spiking neural network with physical models of optoelectronic RTD nodes serving as artificial spiking neurons
Memristor-based design solutions for mitigating parametric variations in IoT applications
PhD ThesisRapid advancement of the internet of things (IoT) is predicated by two important factors
of the electronic technology, namely device size and energy-efficiency. With smaller
size comes the problem of process, voltage and temperature (PVT) variations of delays
which are the key operational parameters of devices. Parametric variability is also
an obstacle on the way to allowing devices to work in systems with unpredictable
power sources, such as those powered by energy-harvesters. Designers tackle these
problems holistically by developing new techniques such as asynchronous logic, where
mechanisms such as matching delays are widely used to adapt to delay variations. To
mitigate energy efficiency and power interruption issues the matching delays need to
be ideally retained in a non-volatile storage. Meanwhile, a resistive memory called
memristor becomes a promising component for power-restricted applications owing to
its inherent non-volatility. While providing non-volatility, the use of memristor in delay
matching incurs some power overheads. This creates the first challenge on the way of
introducing memristors into IoT devices for the delay matching.
Another important factor affecting the use of memristors in IoT devices is the
dependence of the memristor value on temperature. For example, a memristance
decoder used in the memristor-based components must be able to correct the read data
without incurring significant overheads on the overall system. This creates the second
challenge for overcoming the temperature effect in memristance decoding process.
In this research, we propose methods for improving PVT tolerance and energy
characteristics of IoT devices from the perspective of above two main challenges:
(i) utilising memristor to enhance the energy efficiency of the delay element (DE), and
(ii) improving the temperature awareness and energy robustness of the memristance
decoder.
For memristor-based delay element (MemDE), we applied a memristor between two
inverters to vary the path resistance, which determines the RC delay. This allows power
saving due to the low number of switching components and the absence of external delay
storage. We also investigate a solution for avoiding the unintended tuning (UT) and a
timing model to estimate the proper pulse width for memristance tuning. The simulation
results based on UMC 180nm technology and VTEAM model show the MemDE can
provide the delay between 0.55ns and 1.44ns which is compatible to the 4-bit multiplexerbased
delay element (MuxDE) in the same technology while consuming thirteen times
less power. The key contribution within (i) is the development of low-power MemDE to
mitigate the timing mismatch caused by PVT variations.
To estimate the temperature effect on memristance, we develop an empirical temperature
model which fits both titanium dioxide and silver chalcogenide memristors. The
temperature experiments are conducted using the latter device, and the results confirm
the validity of the proposed model with the accuracy R-squared >88%. The memristance
decoder is designed to deliver two key advantages. Firstly, the temperature model is
integrated into the VTEAM model to enable the temperature compensation. Secondly, it
supports resolution scalability to match the energy budget. The simulation results of the
2-bit decoder based on UMC 65nm technology show the energy can be varied between
49fJ and 98fJ. This is the second major contribution to address the challenge (ii).
This thesis gives future research directions into an in-depth study of the memristive
electronics as a variation-robust energy-efficient design paradigm and its impact on
developing future IoT applications.sponsored by the Royal Thai Governmen
CMOS IMAGE SENSORS FOR LAB-ON-A-CHIP MICROSYSTEM DESIGN
The work described herein serves as a foundation for the development of CMOS imaging in lab-on-a-chip microsystems. Lab-on-a-chip (LOC) systems attempt to emulate the functionality of a cell biology lab by incorporating multiple sensing modalidites into a single microscale system. LOC are applicable to drug development, implantable sensors, cell-based bio-chemical detectors and radiation detectors. The common theme across these systems is achieving performance under severe resource constraints including noise, bandwidth, power and size. The contributions of this work are in the areas of two core lab-on-a-chip imaging functions: object detection and optical measurements