19,922 research outputs found

    Deep learning in remote sensing: a review

    Get PDF
    Standing at the paradigm shift towards data-intensive science, machine learning techniques are becoming increasingly important. In particular, as a major breakthrough in the field, deep learning has proven as an extremely powerful tool in many fields. Shall we embrace deep learning as the key to all? Or, should we resist a 'black-box' solution? There are controversial opinions in the remote sensing community. In this article, we analyze the challenges of using deep learning for remote sensing data analysis, review the recent advances, and provide resources to make deep learning in remote sensing ridiculously simple to start with. More importantly, we advocate remote sensing scientists to bring their expertise into deep learning, and use it as an implicit general model to tackle unprecedented large-scale influential challenges, such as climate change and urbanization.Comment: Accepted for publication IEEE Geoscience and Remote Sensing Magazin

    Recent Progress in Image Deblurring

    Full text link
    This paper comprehensively reviews the recent development of image deblurring, including non-blind/blind, spatially invariant/variant deblurring techniques. Indeed, these techniques share the same objective of inferring a latent sharp image from one or several corresponding blurry images, while the blind deblurring techniques are also required to derive an accurate blur kernel. Considering the critical role of image restoration in modern imaging systems to provide high-quality images under complex environments such as motion, undesirable lighting conditions, and imperfect system components, image deblurring has attracted growing attention in recent years. From the viewpoint of how to handle the ill-posedness which is a crucial issue in deblurring tasks, existing methods can be grouped into five categories: Bayesian inference framework, variational methods, sparse representation-based methods, homography-based modeling, and region-based methods. In spite of achieving a certain level of development, image deblurring, especially the blind case, is limited in its success by complex application conditions which make the blur kernel hard to obtain and be spatially variant. We provide a holistic understanding and deep insight into image deblurring in this review. An analysis of the empirical evidence for representative methods, practical issues, as well as a discussion of promising future directions are also presented.Comment: 53 pages, 17 figure

    Video Classification With CNNs: Using The Codec As A Spatio-Temporal Activity Sensor

    Get PDF
    We investigate video classification via a two-stream convolutional neural network (CNN) design that directly ingests information extracted from compressed video bitstreams. Our approach begins with the observation that all modern video codecs divide the input frames into macroblocks (MBs). We demonstrate that selective access to MB motion vector (MV) information within compressed video bitstreams can also provide for selective, motion-adaptive, MB pixel decoding (a.k.a., MB texture decoding). This in turn allows for the derivation of spatio-temporal video activity regions at extremely high speed in comparison to conventional full-frame decoding followed by optical flow estimation. In order to evaluate the accuracy of a video classification framework based on such activity data, we independently train two CNN architectures on MB texture and MV correspondences and then fuse their scores to derive the final classification of each test video. Evaluation on two standard datasets shows that the proposed approach is competitive to the best two-stream video classification approaches found in the literature. At the same time: (i) a CPU-based realization of our MV extraction is over 977 times faster than GPU-based optical flow methods; (ii) selective decoding is up to 12 times faster than full-frame decoding; (iii) our proposed spatial and temporal CNNs perform inference at 5 to 49 times lower cloud computing cost than the fastest methods from the literature.Comment: Accepted in IEEE Transactions on Circuits and Systems for Video Technology. Extension of ICIP 2017 conference pape

    The cellular and synaptic architecture of the mechanosensory dorsal horn

    Get PDF
    The deep dorsal horn is a poorly characterized spinal cord region implicated in processing low-threshold mechanoreceptor (LTMR) information. We report an array of mouse genetic tools for defining neuronal components and functions of the dorsal horn LTMR-recipient zone (LTMR-RZ), a role for LTMR-RZ processing in tactile perception, and the basic logic of LTMR-RZ organization. We found an unexpectedly high degree of neuronal diversity in the LTMR-RZ: seven excitatory and four inhibitory subtypes of interneurons exhibiting unique morphological, physiological, and synaptic properties. Remarkably, LTMRs form synapses on between four and 11 LTMR-RZ interneuron subtypes, while each LTMR-RZ interneuron subtype samples inputs from at least one to three LTMR classes, as well as spinal cord interneurons and corticospinal neurons. Thus, the LTMR-RZ is a somatosensory processing region endowed with a neuronal complexity that rivals the retina and functions to pattern the activity of ascending touch pathways that underlie tactile perception

    Fluorescent labeling of plasmid DNA and mRNA : gains and losses of current labeling strategies

    Get PDF
    Live-cell imaging has provided the life sciences with insights into the cell biology and dynamics. Fluorescent labeling of target molecules proves to be indispensable in this regard. In this Review, we focus on the current fluorescent labeling strategies for nucleic acids, and in particular mRNA (mRNA) and plasmid DNA (pDNA), which are of interest to a broad range of scientific fields. By giving a background of the available techniques and an evaluation of the pros and cons, we try to supply scientists with all the information needed to come to an informed choice of nucleic acid labeling strategy aimed at their particular needs
    • …
    corecore