A Stream Hardware Architecture for Keypoint Matching Based on a Speculative Approach

International audienc

SLIM-Net: Rethinking how neural networks use systolic arrays

International audienc

End-to-end implementation of a convolutional neural network on a 3D-integrated image sensor with macropixel array

International audience3D-integrated focal-plane array image processor chips offer new opportunities to implement computer vision algorithms directly inside the sensor. Neural networks in particular can perform highly complex machine vision tasks, and therefore their efficient implementation in such imagers are of significant interest. However, studies with existing pixel-processor array chips have focused on the implementation of a subset of neural network components - notably convolutional kernels. In this work, we implement a continuous end-to-end pipeline for a convolutional neural network from the digitisation of incoming photons to the output prediction vector on a macropixel-processor (where a single processor acts on set of pixels) array chip. Our implementation performs inference between 265 and 310 frames per second directly inside of the sensor by exploiting the different levels of parallelism available

End-to-End Implementation of a Convolutional Neural Network on a 3D-Integrated Image Sensor with Macropixel Array

Three-dimensional-integrated focal-plane array image processor chips offer new opportunities to implement highly parallelised computer vision algorithms directly inside sensors. Neural networks in particular can perform highly complex machine vision tasks, and therefore their efficient implementation in such imagers are of significant interest. However, studies with existing pixel-processor array chips have focused on the implementation of a subset of neural network components—notably convolutional kernels—on pixel processor arrays. In this work, we implement a continuous end-to-end pipeline for a convolutional neural network from the digitisation of incoming photons to the output prediction vector on a macropixel processor array chip (where a single processor acts on group of pixels). Our implementation performs inference at a rate between 265 and 309 frames per second, directly inside of the sensor, by exploiting the different levels of parallelism available

A 5500-frames/s 85-GOPS/W 3-D Stacked BSI Vision Chip Based on Parallel In-Focal-Plane Acquisition and Processing

International audienceThis paper presents a 3-D stacked vision chip featuring in-focal-plane read-out tightly coupled with flexible computing architecture for configurable high-speed image analysis. The chip architecture is based on a scalable standalone structure integrating image sensor on the top tier and processing elements (PEs) plus memories in the bottom tier. By using 3-D stacking partitioning, our prototype benefits from backside illuminated pixels sensitivity, a fully parallel communication between image sensor and PEs for low-latency performances, while leaving enough room in the bottom tier to embed advanced computing features. One scalable structure embeds a 16x16 pixel array (or 64 x 64 pixels in high-resolution mode), associated with an 8-bit single instruction multiple data (SIMD) processor; fabricated in dual 130-nm 1P6M CMOS process. This paper exhibits a 5500 frames/s and 85 giga operations per second (GOPS)/W in low-resolution mode, with large kernels capabilities through eight directions interpixel communication. Multiflow capability is also demonstrated to execute different programs in different areas of the vision chip

Advanced 3D technologies and architectures for 3D Smart Image Sensors

International audienceImage Sensors will get more and more pervasive into their environment. In the context of Automotive and IoT, low cost image sensors, with high quality pixels, will embed more and more smart functions, such as the regular low level image processing but also object recognition, movement detection, light detection, etc. 3D technology is a key enabler technology to integrate into a single device the pixel layer and associated acquisition layer, but also the smart computing features and the required amount of memory to process all the acquired data. More computing and memory within the 3D Smart Image Sensors will bring new features and reduce the overall system power consumption. Advanced 3D technology with ultra-fine pitch vertical interconnect density will pave the way towards new architectures for 3D Smart Image Sensors, allowing local vertical communication between pixels, and the associated computing and memory structures. The presentation will give an overview of recent 3D technologies solutions, such as Hybrid Bonding technology and the Monolithic 3D CoolCube™ technology, with respective 3D interconnect pitch in the order of 1 μm and l00nm. Recent 3D Image Sensors will be presented, showing the capability of 3D technology to implement fine grain pixel acquisition and processing with ultra-high speed image acquisition and tile-based processing. As further perspectives, multi-layer 3D image sensor based on events and spiking will reduce power consumption with new detection and learning processing capabilities

Incidence and prognosis of ventilator-associated tracheobronchitis (TAVeM): a multicentre, prospective, observational study

International audienceBACKGROUND: Ventilator-associated tracheobronchitis has been suggested as an intermediate process between tracheobronchial colonisation and ventilator-associated pneumonia in patients receiving mechanical ventilation. We aimed to establish the incidence and effect of ventilator-associated tracheobronchitis in a large, international patient cohort. METHODS: We did a multicentre, prospective, observational study in 114 intensive care units (ICU) in Spain, France, Portugal, Brazil, Argentina, Ecuador, Bolivia, and Colombia over a preplanned time of 10 months. All patients older than 18 years admitted to an ICU who received invasive mechanical ventilation for more than 48 h were eligible. We prospectively obtained data for incidence of ventilator-associated lower respiratory tract infections, defined as ventilator-associated tracheobronchitis or ventilator-associated pneumonia. We grouped patients according to the presence or absence of such infections, and obtained data for the effect of appropriate antibiotics on progression of tracheobronchitis to pneumonia. Patients were followed up until death or discharge from hospital. To account for centre effects with a binary outcome, we fitted a generalised estimating equation model with a logit link, exchangeable correlation structure, and non-robust standard errors. This trial is registered with ClinicalTrials.gov, number NCT01791530. FINDINGS: Between Sept 1, 2013, and July 31, 2014, we obtained data for 2960 eligible patients, of whom 689 (23%) developed ventilator-associated lower respiratory tract infections. The incidence of ventilator-associated tracheobronchitis and that of ventilator-associated pneumonia at baseline were similar (320 [11%; 10·2 of 1000 mechanically ventilated days] vs 369 [12%; 8·8 of 1000 mechanically ventilated days], p=0·48). Of the 320 patients with tracheobronchitis, 250 received appropriate antibiotic treatment and 70 received inappropriate antibiotics. 39 patients with tracheobronchitis progressed to pneumonia; however, the use of appropriate antibiotic therapy for tracheobronchitis was associated with significantly lower progression to pneumonia than was inappropriate treatment (19 [8%] of 250 vs 20 [29%] of 70, p\textless0·0001; crude odds ratio 0·21 [95% CI 0·11-0·41]). Significantly more patients with ventilator-associated pneumonia died (146 [40%] of 369) than those with tracheobronchitis (93 [29%] of 320) or absence of ventilator-associated lower respiratory tract infections (673 [30%] of 2271, p\textless0·0001). Median time to discharge from the ICU for survivors was significantly longer in the tracheobronchitis (21 days [IQR 15-34]) and pneumonia (22 [13-36]) groups than in the group with no ventilator-associated lower respiratory tract infections (12 [8-20]; hazard ratio 1·65 [95% CI 1·38-1·97], p\textless0·0001). INTERPRETATION: This large database study emphasises that ventilator-associated tracheobronchitis is a major health problem worldwide, associated with high resources consumption in all countries. Our findings also show improved outcomes with use of appropriate antibiotic treatment for both ventilator-associated tracheobronchitis and ventilator-associated pneumonia, underlining the importance of treating both infections, since inappropriate treatment of tracheobronchitis was associated with a higher risk of progression to pneumonia. FUNDING: Non