3 research outputs found

    Dorsal stream : from algorithm to neuroscience

    Get PDF
    Thesis (Ph. D.)--Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, 2011.Cataloged from PDF version of thesis.Includes bibliographical references (p. 173-195).The dorsal stream in the primate visual cortex is involved in the perception of motion and the recognition of actions. The two topics, motion processing in the brain, and action recognition in videos, have been developed independently in the field of neuroscience and computer vision. We present a dorsal stream model that can be used for the recognition of actions as well as explaining neurophysiology in the dorsal stream. The model consists of a spatio-temporal feature detectors of increasing complexity: an input image sequence is first analyzed by an array of motion sensitive units which, through a hierarchy of processing stages, lead to position and scale invariant representation of motion in a video sequence. The model outperforms or on par with the state-of-the-art computer vision algorithms on a range of human action datasets. We then describe the extension of the model into a high-throughput system for the recognition of mouse behaviors in their homecage. We provide software and a very large manually annotated video database used for training and testing the system. Our system outperforms a commercial software and performs on par with human scoring, as measured from the ground-truth manual annotations of more than 10 hours of videos of freely behaving mice. We complete the neurobiological side of the model by showing it could explain the motion processing as well as action selectivity in the dorsal stream, based on comparisons between model outputs and the neuronal responses in the dorsal stream. Specifically, the model could explain pattern and component sensitivity and distribution [161], local motion integration [97], and speed-tuning [144] of MT cells. The model, when combining with the ventral stream model [173], could also explain the action and actor selectivity in the STP area. There exists only a few models for the motion processing in the dorsal stream, and these models were not be applied to the real-world computer vision tasks. Our model is one that agrees with (or processes) data at different levels: from computer vision algorithm, practical software, to neuroscience.by Hueihan Jhuang.Ph.D

    Flow Imaging Using MRI: Quantification and Analysis

    Get PDF
    A complex and challenging problem in flow study is to obtain quantitative flow information in opaque systems, for example, blood flow in biological systems and flow channels in chemical reactors. In this regard, MRI is superior to the conventional optical flow imaging or ultrasonic Doppler imaging. However, for high speed flows, complex flow behaviors and turbulences make it difficult to image and analyze the flows. In MR flow imaging, MR tagging technique has demonstrated its ability to simultaneously visualize motion in a sequence of images. Moreover, a quantification method, namely HARmonic Phase (HARP) analysis, can extract a dense velocity field from tagged MR image sequence with minimal manual intervention. In this work, we developed and validated two new MRI methods for quantification of very rapid flows. First, HARP was integrated with a fast MRI imaging method called SEA (Single Echo Acquisition) to image and analyze high velocity flows. Second, an improved HARP method was developed to deal with tag fading and data noise in the raw MRI data. Specifically, a regularization method that incorporates the law of flow dynamics in the HARP analysis was developed. Finally, the methods were validated using results from the computational fluid dynamics (CFD) and the conventional optimal flow imaging based on particle image velocimetry (PIV). The results demonstrated the improvement from the quantification using solely the conventional HARP method
    corecore