CMOS Vision Sensors: Embedding Computer Vision at Imaging Front-Ends

CMOS Image Sensors (CIS) are key for imaging technol-ogies. These chips are conceived for capturing opticalscenes focused on their surface, and for delivering elec-trical images, commonly in digital format. CISs may incor-porate intelligence; however, their smartness basicallyconcerns calibration, error correction and other similartasks. The term CVISs (CMOS VIsion Sensors) definesother class of sensor front-ends which are aimed at per-forming vision tasks right at the focal plane. They havebeen running under names such as computational imagesensors, vision sensors and silicon retinas, among others. CVIS and CISs are similar regarding physical imple-mentation. However, while inputs of both CIS and CVISare images captured by photo-sensors placed at thefocal-plane, CVISs primary outputs may not be imagesbut either image features or even decisions based on thespatial-temporal analysis of the scenes. We may hencestate that CVISs are more “intelligent” than CISs as theyfocus on information instead of on raw data. Actually,CVIS architectures capable of extracting and interpretingthe information contained in images, and prompting reac-tion commands thereof, have been explored for years inacademia, and industrial applications are recently ramp-ing up.One of the challenges of CVISs architects is incorporat-ing computer vision concepts into the design flow. Theendeavor is ambitious because imaging and computervision communities are rather disjoint groups talking dif-ferent languages. The Cellular Nonlinear Network Univer-sal Machine (CNNUM) paradigm, proposed by Profs.Chua and Roska, defined an adequate framework forsuch conciliation as it is particularly well suited for hard-ware-software co-design [1]-[4]. This paper overviewsCVISs chips that were conceived and prototyped at IMSEVision Lab over the past twenty years. Some of them fitthe CNNUM paradigm while others are tangential to it. Allthem employ per-pixel mixed-signal processing circuitryto achieve sensor-processing concurrency in the quest offast operation with reduced energy budget.Junta de Andalucía TIC 2012-2338Ministerio de Economía y Competitividad TEC 2015-66878-C3-1-R y TEC 2015-66878-C3-3-

Memory and information processing in neuromorphic systems

A striking difference between brain-inspired neuromorphic processors and current von Neumann processors architectures is the way in which memory and processing is organized. As Information and Communication Technologies continue to address the need for increased computational power through the increase of cores within a digital processor, neuromorphic engineers and scientists can complement this need by building processor architectures where memory is distributed with the processing. In this paper we present a survey of brain-inspired processor architectures that support models of cortical networks and deep neural networks. These architectures range from serial clocked implementations of multi-neuron systems to massively parallel asynchronous ones and from purely digital systems to mixed analog/digital systems which implement more biological-like models of neurons and synapses together with a suite of adaptation and learning mechanisms analogous to the ones found in biological nervous systems. We describe the advantages of the different approaches being pursued and present the challenges that need to be addressed for building artificial neural processing systems that can display the richness of behaviors seen in biological systems.Comment: Submitted to Proceedings of IEEE, review of recently proposed neuromorphic computing platforms and system

Dampening Spontaneous Activity Improves the Light Sensitivity and Spatial Acuity of Optogenetic Retinal Prosthetic Responses

Retinitis pigmentosa is a progressive retinal dystrophy that causes irreversible visual impairment and blindness. Retinal prostheses currently represent the only clinically available vision-restoring treatment, but the quality of vision returned remains poor. Recently, it has been suggested that the pathological spontaneous hyperactivity present in dystrophic retinas may contribute to the poor quality of vision returned by retinal prosthetics by reducing the signal-to-noise ratio of prosthetic responses. Here, we investigated to what extent blocking this hyperactivity can improve optogenetic retinal prosthetic responses. We recorded activity from channelrhodopsin-expressing retinal ganglion cells in retinal wholemounts in a mouse model of retinitis pigmentosa. Sophisticated stimuli, inspired by those used in clinical visual assessment, were used to assess light sensitivity, contrast sensitivity and spatial acuity of optogenetic responses; in all cases these were improved after blocking spontaneous hyperactivity using meclofenamic acid, a gap junction blocker. Our results suggest that this approach significantly improves the quality of vision returned by retinal prosthetics, paving the way to novel clinical applications. Moreover, the improvements in sensitivity achieved by blocking spontaneous hyperactivity may extend the dynamic range of optogenetic retinal prostheses, allowing them to be used at lower light intensities such as those encountered in everyday life

An update on retinal prostheses

Retinal prostheses are designed to restore a basic sense of sight to people with profound vision loss. They require a relatively intact posterior visual pathway (optic nerve, lateral geniculate nucleus and visual cortex). Retinal implants are options for people with severe stages of retinal degenerative disease such as retinitis pigmentosa and age-related macular degeneration. There have now been three regulatory-approved retinal prostheses. Over five hundred patients have been implanted globally over the past 15 years. Devices generally provide an improved ability to localize high-contrast objects, navigate, and perform basic orientation tasks. Adverse events have included conjunctival erosion, retinal detachment, loss of light perception, and the need for revision surgery, but are rare. There are also specific device risks, including overstimulation (which could cause damage to the retina) or delamination of implanted components, but these are very unlikely. Current challenges include how to improve visual acuity, enlarge the field-of-view, and reduce a complex visual scene to its most salient components through image processing. This review encompasses the work of over 40 individual research groups who have built devices, developed stimulation strategies, or investigated the basic physiology underpinning retinal prostheses. Current technologies are summarized, along with future challenges that face the field

Review on Photomicrography based Full Blood Count (FBC) Testing and Recent Advancements

With advancements in related sub-fields, research on photomicrography in life science is emerging and this is a review on its application towards human full blood count testing which is a primary test in medical practices. For a prolonged period of time, analysis of blood samples is the basis for bio medical observations of living creatures. Cell size, shape, constituents, count, ratios are few of the features identified using DIP based analysis and these features provide an overview of the state of human body which is important in identifying present medical conditions and indicating possible future complications. In addition, functionality of the immune system is observed using results of blood tests. In FBC tests, identification of different blood cell types and counting the number of cells of each type is required to obtain results. Literature discuss various techniques and methods and this article presents an insightful review on human blood cell morphology, photomicrography, digital image processing of photomicrographs, feature extraction and classification, and recent advances. Integration of emerging technologies such as microfluidics, micro-electromechanical systems, and artificial intelligence based image processing algorithms and classifiers with cell sensing have enabled exploration of novel research directions in blood testing applications.