1,920 research outputs found

    Wide-Field Multi-Parameter FLIM: Long-Term Minimal Invasive Observation of Proteins in Living Cells.

    Get PDF
    Time-domain Fluorescence Lifetime Imaging Microscopy (FLIM) is a remarkable tool to monitor the dynamics of fluorophore-tagged protein domains inside living cells. We propose a Wide-Field Multi-Parameter FLIM method (WFMP-FLIM) aimed to monitor continuously living cells under minimum light intensity at a given illumination energy dose. A powerful data analysis technique applied to the WFMP-FLIM data sets allows to optimize the estimation accuracy of physical parameters at very low fluorescence signal levels approaching the lower bound theoretical limit. We demonstrate the efficiency of WFMP-FLIM by presenting two independent and relevant long-term experiments in cell biology: 1) FRET analysis of simultaneously recorded donor and acceptor fluorescence in living HeLa cells and 2) tracking of mitochondrial transport combined with fluorescence lifetime analysis in neuronal processes

    High-sensitivity spectral fluorescence lifetime imaging for resolving spectroscopically overlapping species

    Get PDF
    The capability to resolve the contributions from spectroscopically overlapping fluorophores has enabled significant breakthroughs in cellular imaging. However, commercial microscopes for this purpose use analog light detection with least squares curve-fitting analysis and improvements in sensitivity are needed. To this end, a microscope has been constructed with high throughput and single-photon detection capability. The fluorescence is separated through use of a prism spectrometer or a series of dichroic mirrors into four spectral bands and detected using four single-photon avalanche diode (SPAD) detectors, which provide high-quantum efficiency in the red spectral region. The detectors are connected to a time-correlated single photon counting module to provide sub-nanosecond temporal resolution for distinguishing fluorophores with different fluorescence lifetimes. Maximum-likelihood (ML) methods have been developed for analyzing the temporally and spectrally resolved photon count data from the SPADs to find the contributions from different fluorescent species and from background. Commercially available SPADs exhibit a count-rate dependent time shift in the impulse response function, and hence the instrument incorporates custom modified SPADs with improved timing stability. Nevertheless, there is still some time shift, and hence the ML-analysis has been extended to include this as an adjustable parameter for each individual SPAD. Monte Carlo simulations have also been developed to enable studies of the number of photons needed to resolve specific fluorophores

    Fast fluorescence lifetime imaging and sensing via deep learning

    Get PDF
    Error on title page – year of award is 2023.Fluorescence lifetime imaging microscopy (FLIM) has become a valuable tool in diverse disciplines. This thesis presents deep learning (DL) approaches to addressing two major challenges in FLIM: slow and complex data analysis and the high photon budget for precisely quantifying the fluorescence lifetimes. DL's ability to extract high-dimensional features from data has revolutionized optical and biomedical imaging analysis. This thesis contributes several novel DL FLIM algorithms that significantly expand FLIM's scope. Firstly, a hardware-friendly pixel-wise DL algorithm is proposed for fast FLIM data analysis. The algorithm has a simple architecture yet can effectively resolve multi-exponential decay models. The calculation speed and accuracy outperform conventional methods significantly. Secondly, a DL algorithm is proposed to improve FLIM image spatial resolution, obtaining high-resolution (HR) fluorescence lifetime images from low-resolution (LR) images. A computational framework is developed to generate large-scale semi-synthetic FLIM datasets to address the challenge of the lack of sufficient high-quality FLIM datasets. This algorithm offers a practical approach to obtaining HR FLIM images quickly for FLIM systems. Thirdly, a DL algorithm is developed to analyze FLIM images with only a few photons per pixel, named Few-Photon Fluorescence Lifetime Imaging (FPFLI) algorithm. FPFLI uses spatial correlation and intensity information to robustly estimate the fluorescence lifetime images, pushing this photon budget to a record-low level of only a few photons per pixel. Finally, a time-resolved flow cytometry (TRFC) system is developed by integrating an advanced CMOS single-photon avalanche diode (SPAD) array and a DL processor. The SPAD array, using a parallel light detection scheme, shows an excellent photon-counting throughput. A quantized convolutional neural network (QCNN) algorithm is designed and implemented on a field-programmable gate array as an embedded processor. The processor resolves fluorescence lifetimes against disturbing noise, showing unparalleled high accuracy, fast analysis speed, and low power consumption.Fluorescence lifetime imaging microscopy (FLIM) has become a valuable tool in diverse disciplines. This thesis presents deep learning (DL) approaches to addressing two major challenges in FLIM: slow and complex data analysis and the high photon budget for precisely quantifying the fluorescence lifetimes. DL's ability to extract high-dimensional features from data has revolutionized optical and biomedical imaging analysis. This thesis contributes several novel DL FLIM algorithms that significantly expand FLIM's scope. Firstly, a hardware-friendly pixel-wise DL algorithm is proposed for fast FLIM data analysis. The algorithm has a simple architecture yet can effectively resolve multi-exponential decay models. The calculation speed and accuracy outperform conventional methods significantly. Secondly, a DL algorithm is proposed to improve FLIM image spatial resolution, obtaining high-resolution (HR) fluorescence lifetime images from low-resolution (LR) images. A computational framework is developed to generate large-scale semi-synthetic FLIM datasets to address the challenge of the lack of sufficient high-quality FLIM datasets. This algorithm offers a practical approach to obtaining HR FLIM images quickly for FLIM systems. Thirdly, a DL algorithm is developed to analyze FLIM images with only a few photons per pixel, named Few-Photon Fluorescence Lifetime Imaging (FPFLI) algorithm. FPFLI uses spatial correlation and intensity information to robustly estimate the fluorescence lifetime images, pushing this photon budget to a record-low level of only a few photons per pixel. Finally, a time-resolved flow cytometry (TRFC) system is developed by integrating an advanced CMOS single-photon avalanche diode (SPAD) array and a DL processor. The SPAD array, using a parallel light detection scheme, shows an excellent photon-counting throughput. A quantized convolutional neural network (QCNN) algorithm is designed and implemented on a field-programmable gate array as an embedded processor. The processor resolves fluorescence lifetimes against disturbing noise, showing unparalleled high accuracy, fast analysis speed, and low power consumption

    GPU acceleration of time-domain fluorescence lifetime imaging

    Get PDF
    Fluorescence lifetime imaging microscopy (FLIM) plays a significant role in biological sciences, chemistry, and medical research. We propose a Graphic Processing Units (GPUs) based FLIM analysis tool suitable for high-speed and flexible time-domain FLIM applications. With a large number of parallel processors, GPUs can significantly speed up lifetime calculations compared to CPU-OpenMP (parallel computing with multiple CPU cores) based analysis. We demonstrate how to implement and optimize FLIM algorithms on GPUs for both iterative and non-iterative FLIM analysis algorithms. The implemented algorithms have been tested on both synthesized and experimental FLIM data. The results show that at the same precision the GPU analysis can be up to 24-fold faster than its CPU-OpenMP counterpart. This means that even for high precision but time-consuming iterative FLIM algorithms, GPUs enable fast or even real-time analysis

    Estimating fluorescence lifetimes using the expectation-maximisation algorithm

    Get PDF
    The expectation-maximisation (EM) algorithm uses incomplete data to get the estimation of the probabilistic model parameter, and it has been widely used in machine learning. EM techniques are applied to estimate fluorescence lifetimes in time-correlated single-photon counting based fluorescence lifetime imaging experiments without measuring the instrument response functions. The results of Monte Carlo simulations indicate that the proposed approach can obtain better or comparable accuracy and precision performances than the previously reported method

    Estimation of fluorescence lifetimes via rotational invariance techniques

    Get PDF
    Estimation of signal parameters via rotational invariance techniques is a classical algorithm widely used in array signal processing for direction-of-arrival estimation of emitters. Inspired by this method, a new signal model and a new fluorescence lifetime estimation via rotational invariance techniques (FLERIT) were developed for multi-exponential fluorescence lifetime imaging (FLIM) experiments. The FLERIT only requires a few time bins of a histogram generated by a time-correlated single photon counting FLIM system, greatly reducing the data throughput from the imager to the signal processing units. As a non-iterative method, the FLERIT does not require initial conditions, prior information nor model selection that are usually required by widely used traditional fitting methods, including nonlinear least square methods or maximum likelihood methods. Moreover, its simplicity means it is suitable for implementations in embedded systems for real-time applications. FLERIT was tested on synthesized and experimental fluorescent cell data showing the potentials to be widely applied in FLIM data analysis
    corecore