12 research outputs found

    Direct Time of Flight Single Photon Imaging

    Get PDF

    FPGA controlled SPAD matrix test environment

    Get PDF
    Abstract. Test environments for two SPAD matrix ICs are designed and implemented in this work. The matrixes are designed as a receiver of a Raman spectrometer. The aim of the work is a computer driven system that can perform SPAD matrix measurements according to the requirements. The background of the test environments describes the function of the SPAD and the quenching circuit. Besides, the structures and functionalities of the related ICs are presented. The work is about building two separate systems including computer software, a USB data converter on a PCB, an FPGA development board and a PCB for the IC. The user controls the measurements setting measurement parameters, monitors the measurements and reads the measurement results via the software. The results can be saved in an appropriate format that can be post-processed in Matlab. The communication between the computer and the measurement tools runs over USB. The USB data converter is an interface between the USB and FPGA. The FPGA is a controller that reads the measurement results from the IC, stores them temporarily and sends them to the computer. Besides, the FPGA holds the measurement settings. The PCB around the IC is a platform that offers connectivity to voltages, control and data. Measurements were performed in order to find out how suitable the SPAD matrixes are acting as a receiver of a Raman spectrometer. It was found that a timing signal of the time gated IC reaches all the elements within 60 ps. The timing homogeneity of the other IC was estimated based on the distributions of the TDC generated time window related code words. The mean parameters from the distributions showed the delay difference between the fastest and the slowest element was 180 ps.FPGA:n ohjaama SPAD-matriisin testausympäristö. Tiivistelmä. Tässä työssä suunnitellaan ja toteutetaan testausympäristö kahdelle IC-piirille rakennetulle SPAD-matriisille. Matriisit on suunniteltu Raman-spektrometrin vastaanottimeksi. Tavoitteena on tietokoneella ohjattava järjestelmä, joka kykenee suorittamaan mittauksia SPAD-matriiseilla niille asetettujen vaatimusten mukaisesti. Testausympäristön taustaosiossa kuvataan SPADin ja sammutuspiirin toiminta. Lisäksi molempien testausympäristöön liittyvien IC-piirien rakenteet ja toiminnallisuudet esitellään. Varsinainessa työosiossa rakennetaan kaksi erillistä järjestelmää, joihin kuuluvat tietokoneen mittausohjelma, piirilevylle toteutettu USB-datamuunnin, FPGA-kehitysalusta sekä IC:n ympärille rakennettu testikortti. Käyttäjä ohjaa mittauksia mittausohjelmalla syöttäen mittausparametreja, kontrolloimalla mittauksia ja lukemalla mittaustulokset. Tulokset voidaan tarvittaessa tallentaa muotoon, jota voidaan jatkokäsitellä esimerkiksi matlabilla. Kommunikaatio mittausjärjestelmän kanssa tapahtuu USB-protokollan yli. USB-datamuunnin toimii rajapintana USB-protokollan ja FPGA:n välillä. FPGA toimii kontrollerina, jonka tehtävinä ovat mittaustulosten lukeminen IC-piiriltä, välivarastointi ja lähettäminen tietokoneelle sekä mittausasetusten asettaminen. IC:n ympärille rakennettu testikortti toimii fyysisenä alustana, joka tarjoaa IC:lle jännite-, ohjaus- ja dataliittimet. Testausympäristössä suoritettiin mittauksia, joilla selvitettiin SPAD-matriisien soveltuvuutta Raman-spektrometrin vastaanottimeksi. Mittauksissa havaittiin, että aikaportitetussa piirissä ajoitusmerkki saapui kaikkiin SPAD elementteihin 60 ps sisällä. Toisen piirin mittauksissa ajoituksen homogeenisyyttä arvioitiin TDC:n generoimien koodisanojen jakauman perusteella. Jakaumista poimittujen keskiarvoparametrin perusteella nopeimman ja hitaimman elementin välinen erotus oli 180 ps

    Spectrally and temporally resolved single photon counting in advanced biophotonics applications

    Get PDF
    Biomedicine requires highly sensitive and efficient light sensors to analyse light-tissue or light-sample interactions. Single-photon avalanche diode (SPAD) sensors implemented with complementary metal-oxide-semiconductor (CMOS) technology have a growing range of applications in this field. Single-photon detection coupled with integrated timing circuits enables us to timestamp each detected photon with high temporal resolution (down to picoseconds). Arrays of SPAD based pixels and CMOS technology offer massively parallel time-resolved single-photon counting for spectrally and temporally resolved analysis of various light phenomena.This thesis examines how time-resolved CMOS SPAD based line sensors with per pixel timing circuits can be utilized to advance biophotonic applications. The study focuses on improving the existing techniques of fluorescence and Raman spectroscopy, and demonstrates for the first time CMOS SPAD based detection in optical coherence tomography (OCT). A novel detection scheme is proposed combining low-coherence interferometry and time-resolved photon counting. In this approach the interferometric information is revealed from spectral intensity measurements, which is supplemented by time-stamping of the photons building up the spectra.Two CMOS SPAD line sensors (Ra-I and its improved version, Ra-II) were characterized and the effect of their parameters on the selected techniques was analysed. The thesis demonstrates the deployment of the Ra-I line sensor in time-resolved fluorescence spectroscopy with indications of the applicability in time-resolved Raman spectroscopy. The work includes integration of the sensor with surrounding electrical and optical systems, and the implementation of firmware and software for controlling the optical setup. As a result, a versatile platform is demonstrated capable of micro- and millisecond sampling of spectral fluorescence lifetime changes in a single transient of fast chemical reactions.OCT operating in the spectral domain traditionally uses CMOS photodiode and charge-coupled device (CCD) based detectors. The applicability of CMOS SPAD sensors is investigated for the first time with focus on the main limitations and related challenges. Finally, a new detection method is proposed relying on both the wave and particle nature of light, recording time-resolved interferometric spectra from a Michelson interferometer. This method offers an alternative approach to analyse luminous effects and improves techniques based on the light’s time of flight. As an example, a proof of concept study is presented for the removal of unwanted reflections from along the sample and the optical path in an OCT setup

    Challenges and Solutions to Next-Generation Single-Photon Imagers

    Get PDF
    Detecting and counting single photons is useful in an increasingly large number of applications. Most applications require large formats, approaching and even far exceeding 1 megapixel. In this thesis, we look at the challenges of massively parallel photon-counting cameras from all performance angles. The thesis deals with a number of performance issues that emerge when the number of pixels exceeds about 1/4 of megapixels, proposing characterization techniques and solutions to mitigate performance degradation and non-uniformity. Two cameras were created to validate the proposed techniques. The first camera, SwissSPAD, comprises an array of 512 x 128 SPAD pixels, each with a one-bit memory and a gating mechanism to achieve 5ns high precision time windows with high uniformity across the array. With a massively parallel readout of over 10 Gigabit/s and positioning of the integration time window accurate to the pico-second range, fluorescence lifetime imaging and fluorescence correlation spectroscopy imaging achieve a speedup of several orders of magnitude while ensuring high precision in the measurements. Other possible applications include wide-field time-of-flight imaging and the generation of quantum random numbers at highest bit-rates. Lately super-resolution microscopy techniques have also used SwissSPAD. The second camera, LinoSPAD, takes the concepts of SwissSPAD one step further by moving even more 'intelligence' to the FPGA and reducing the sensor complexity to the bare minimum. This allows focusing the optimization of the sensor on the most important metrics of photon efficiency and fill factor. As such, the sensor consists of one line of SPADs that have a direct connection each to the FPGA where complex photon processing algorithms can be implemented. As a demonstration of the capabilities of current lowcost FPGAs we implemented an array of time-to-digital converters that can handle up to 8.5 billion photons per second, measuring each one of them and accounting them in high precision histograms. Using simple laser diodes and a circuit to generate light pulses in the picosecond range, we demonstrate a ubiquitous 3D time-of-flight sensor. The thesis intends to be a first step towards achieving the world's first megapixel SPAD camera, which, we believe, is in grasp thanks to the architectural and circuital techniques proposed in this thesis. In addition, we believe that the applications proposed in this thesis offer a wide variety of uses of the sensors presented in this thesis and in future ones to come

    A portable device for time-resolved fluorescence based on an array of CMOS SPADs with integrated microfluidics

    Get PDF
    [eng] Traditionally, molecular analysis is performed in laboratories equipped with desktop instruments operated by specialized technicians. This paradigm has been changing in recent decades, as biosensor technology has become as accurate as desktop instruments, providing results in much shorter periods and miniaturizing the instrumentation, moving the diagnostic tests gradually out of the central laboratory. However, despite the inherent advantages of time-resolved fluorescence spectroscopy applied to molecular diagnosis, it is only in the last decade that POC (Point Of Care) devices have begun to be developed based on the detection of fluorescence, due to the challenge of developing high-performance, portable and low-cost spectroscopic sensors. This thesis presents the development of a compact, robust and low-cost system for molecular diagnosis based on time-resolved fluorescence spectroscopy, which serves as a general-purpose platform for the optical detection of a variety of biomarkers, bridging the gap between the laboratory and the POC of the fluorescence lifetime based bioassays. In particular, two systems with different levels of integration have been developed that combine a one-dimensional array of SPAD (Single-Photon Avalanch Diode) pixels capable of detecting a single photon, with an interchangeable microfluidic cartridge used to insert the sample and a laser diode Pulsed low-cost UV as a source of excitation. The contact-oriented design of the binomial formed by the sensor and the microfluidic, together with the timed operation of the sensors, makes it possible to dispense with the use of lenses and filters. In turn, custom packaging of the sensor chip allows the microfluidic cartridge to be positioned directly on the sensor array without any alignment procedure. Both systems have been validated, determining the decomposition time of quantum dots in 20 nl of solution for different concentrations, emulating a molecular test in a POC device.[cat] Tradicionalment, l'anàlisi molecular es realitza en laboratoris equipats amb instruments de sobretaula operats per tècnics especialitzats. Aquest paradigma ha anat canviant en les últimes dècades, a mesura que la tecnologia de biosensor s'ha tornat tan precisa com els instruments de sobretaula, proporcionant resultats en períodes molt més curts de temps i miniaturitzant la instrumentació, permetent així, traslladar gradualment les proves de diagnòstic fora de laboratori central. No obstant això i malgrat els avantatges inherents de l'espectroscòpia de fluorescència resolta en el temps aplicada a la diagnosi molecular, no ha estat fins a l'última dècada que s'han començat a desenvolupar dispositius POC (Point Of Care) basats en la detecció de la fluorescència, degut al desafiament que suposa el desenvolupament de sensors espectroscòpics d'alt rendiment, portàtils i de baix cost. Aquesta tesi presenta el desenvolupament d'un sistema compacte, robust i de baix cost per al diagnòstic molecular basat en l'espectroscòpia de fluorescència resolta en el temps, que serveixi com a plataforma d'ús general per a la detecció òptica d'una varietat de biomarcadors, tancant la bretxa entre el laboratori i el POC dels bioassaigs basats en l'anàlisi de la pèrdua de la fluorescència. En particular, s'han desenvolupat dos sistemes amb diferents nivells d'integració que combinen una matriu unidimensional de píxels SPAD (Single-Photon Avalanch Diode) capaços de detectar un sol fotó, amb un cartutx microfluídic intercanviable emprat per inserir la mostra, així com un díode làser UV premut de baix cost com a font d'excitació. El disseny orientat a la detecció per contacte de l'binomi format pel sensor i la microfluídica, juntament amb l'operació temporitzada dels sensors, permet prescindir de l'ús de lents i filtres. Al seu torn, l'empaquetat a mida de l'xip sensor permet posicionar el cartutx microfluídic directament sobre la matriu de sensors sense cap procediment d'alineament. Tots dos sistemes han estat validats determinant el temps de descomposició de "quantum dots" en 20 nl de solució per a diferents concentracions, emulant així un assaig molecular en un dispositiu POC

    Miniature high dynamic range time-resolved CMOS SPAD image sensors

    Get PDF
    Since their integration in complementary metal oxide (CMOS) semiconductor technology in 2003, single photon avalanche diodes (SPADs) have inspired a new era of low cost high integration quantum-level image sensors. Their unique feature of discerning single photon detections, their ability to retain temporal information on every collected photon and their amenability to high speed image sensor architectures makes them prime candidates for low light and time-resolved applications. From the biomedical field of fluorescence lifetime imaging microscopy (FLIM) to extreme physical phenomena such as quantum entanglement, all the way to time of flight (ToF) consumer applications such as gesture recognition and more recently automotive light detection and ranging (LIDAR), huge steps in detector and sensor architectures have been made to address the design challenges of pixel sensitivity and functionality trade-off, scalability and handling of large data rates. The goal of this research is to explore the hypothesis that given the state of the art CMOS nodes and fabrication technologies, it is possible to design miniature SPAD image sensors for time-resolved applications with a small pixel pitch while maintaining both sensitivity and built -in functionality. Three key approaches are pursued to that purpose: leveraging the innate area reduction of logic gates and finer design rules of advanced CMOS nodes to balance the pixel’s fill factor and processing capability, smarter pixel designs with configurable functionality and novel system architectures that lift the processing burden off the pixel array and mediate data flow. Two pathfinder SPAD image sensors were designed and fabricated: a 96 × 40 planar front side illuminated (FSI) sensor with 66% fill factor at 8.25μm pixel pitch in an industrialised 40nm process and a 128 × 120 3D-stacked backside illuminated (BSI) sensor with 45% fill factor at 7.83μm pixel pitch. Both designs rely on a digital, configurable, 12-bit ripple counter pixel allowing for time-gated shot noise limited photon counting. The FSI sensor was operated as a quanta image sensor (QIS) achieving an extended dynamic range in excess of 100dB, utilising triple exposure windows and in-pixel data compression which reduces data rates by a factor of 3.75×. The stacked sensor is the first demonstration of a wafer scale SPAD imaging array with a 1-to-1 hybrid bond connection. Characterisation results of the detector and sensor performance are presented. Two other time-resolved 3D-stacked BSI SPAD image sensor architectures are proposed. The first is a fully integrated 5-wire interface system on chip (SoC), with built-in power management and off-focal plane data processing and storage for high dynamic range as well as autonomous video rate operation. Preliminary images and bring-up results of the fabricated 2mm² sensor are shown. The second is a highly configurable design capable of simultaneous multi-bit oversampled imaging and programmable region of interest (ROI) time correlated single photon counting (TCSPC) with on-chip histogram generation. The 6.48μm pitch array has been submitted for fabrication. In-depth design details of both architectures are discussed

    CMOS SPAD-based image sensor for single photon counting and time of flight imaging

    Get PDF
    The facility to capture the arrival of a single photon, is the fundamental limit to the detection of quantised electromagnetic radiation. An image sensor capable of capturing a picture with this ultimate optical and temporal precision is the pinnacle of photo-sensing. The creation of high spatial resolution, single photon sensitive, and time-resolved image sensors in complementary metal oxide semiconductor (CMOS) technology offers numerous benefits in a wide field of applications. These CMOS devices will be suitable to replace high sensitivity charge-coupled device (CCD) technology (electron-multiplied or electron bombarded) with significantly lower cost and comparable performance in low light or high speed scenarios. For example, with temporal resolution in the order of nano and picoseconds, detailed three-dimensional (3D) pictures can be formed by measuring the time of flight (TOF) of a light pulse. High frame rate imaging of single photons can yield new capabilities in super-resolution microscopy. Also, the imaging of quantum effects such as the entanglement of photons may be realised. The goal of this research project is the development of such an image sensor by exploiting single photon avalanche diodes (SPAD) in advanced imaging-specific 130nm front side illuminated (FSI) CMOS technology. SPADs have three key combined advantages over other imaging technologies: single photon sensitivity, picosecond temporal resolution and the facility to be integrated in standard CMOS technology. Analogue techniques are employed to create an efficient and compact imager that is scalable to mega-pixel arrays. A SPAD-based image sensor is described with 320 by 240 pixels at a pitch of 8μm and an optical efficiency or fill-factor of 26.8%. Each pixel comprises a SPAD with a hybrid analogue counting and memory circuit that makes novel use of a low-power charge transfer amplifier. Global shutter single photon counting images are captured. These exhibit photon shot noise limited statistics with unprecedented low input-referred noise at an equivalent of 0.06 electrons. The CMOS image sensor (CIS) trends of shrinking pixels, increasing array sizes, decreasing read noise, fast readout and oversampled image formation are projected towards the formation of binary single photon imagers or quanta image sensors (QIS). In a binary digital image capture mode, the image sensor offers a look-ahead to the properties and performance of future QISs with 20,000 binary frames per second readout with a bit error rate of 1.7 x 10-3. The bit density, or cumulative binary intensity, against exposure performance of this image sensor is in the shape of the famous Hurter and Driffield densitometry curves of photographic film. Oversampled time-gated binary image capture is demonstrated, capturing 3D TOF images with 3.8cm precision in a 60cm range

    Imaging through obscurants using time-correlated single-photon counting in the short-wave infrared

    Get PDF
    Single-photon time-of-flight (ToF) light detection and ranging (LiDAR) systems have emerged in recent years as a candidate technology for high-resolution depth imaging in challenging environments, such as long-range imaging and imaging in scattering media. This Thesis investigates the potential of two ToF single-photon depth imaging systems based on the time-correlated single-photon (TCSPC) technique for imaging targets in highly scattering environments. The high sensitivity and picosecond timing resolution afforded by the TCSPC technique offers high-resolution depth profiling of remote targets while maintaining low optical power levels. Both systems comprised a pulsed picosecond laser source with an operating wavelength of 1550 nm, and employed InGaAs/InP SPAD detectors. The main benefits of operating in the shortwave infrared (SWIR) band include improved atmospheric transmission, reduced solar background, as well as increased laser eye-safety thresholds over visible band sensors. Firstly, a monostatic scanning transceiver unit was used in conjunction with a single-element Peltier-cooled InGaAs/InP SPAD detector to attain sub-centimetre resolution three-dimensional images of long-range targets obscured by camouflage netting or in high levels of scattering media. Secondly, a bistatic system, which employed a 32 × 32 pixel format InGaAs/InP SPAD array was used to obtain rapid depth profiles of targets which were flood-illuminated by a higher power pulsed laser source. The performance of this system was assessed in indoor and outdoor scenarios in the presence of obscurants and high ambient background levels. Bespoke image processing algorithms were developed to reconstruct both the depth and intensity images for data with very low signal returns and short data acquisition times, illustrating the practicality of TCSPC-based LiDAR systems for real-time image acquisition in the SWIR wavelength region - even in the photon-starved regime.The Defence Science and Technology Laboratory ( Dstl) National PhD Schem
    corecore