Dynamic Path-Controllable Deep Unfolding Network for Compressive Sensing

Deep unfolding network (DUN) that unfolds the optimization algorithm into a deep neural network has achieved great success in compressive sensing (CS) due to its good interpretability and high performance. Each stage in DUN corresponds to one iteration in optimization. At the test time, all the sampling images generally need to be processed by all stages, which comes at a price of computation burden and is also unnecessary for the images whose contents are easier to restore. In this paper, we focus on CS reconstruction and propose a novel Dynamic Path-Controllable Deep Unfolding Network (DPC-DUN). DPC-DUN with our designed path-controllable selector can dynamically select a rapid and appropriate route for each image and is slimmable by regulating different performance-complexity tradeoffs. Extensive experiments show that our DPC-DUN is highly flexible and can provide excellent performance and dynamic adjustment to get a suitable tradeoff, thus addressing the main requirements to become appealing in practice. Codes are available at https://github.com/songjiechong/DPC-DUN.Comment: TIP, 202

Simultaneous Multispectral Imaging: Using Multiview Computational Compressive Sensing

Multispectral imaging is traditionally performed using a combination of an imaging device with a filter bank such as a filter wheel or a form of tunable filter, or a combination of many imaging devices with various spectral beam splitting optics. The complexity and size of these devices seem to be the limiting factor of their adoption and use in various fields that could potentially benefit from this imaging modality. With the advent of nanophotonics, there has been a surge in single camera, snapshot, multispectral imaging exploiting the capabilities of nanotechnology to devise pixel-based spectral filters. This new form of sensing, which can be classified as compressive sensing, has its limitations. One example is the laborious process of fabricating the filter bank and installing it into a detector since the detector fabrication process is completely removed from the filter fabrication process. The work presented here will describe an optical design that would enable a single-camera, simultaneous multispectral imaging via multiview computational compressive sensing. A number of points-of-view (POVs) of the field-of-view (FOV) of the camera are generated and directed through an assortment of spectral pre-filters en route to the camera. The image of each of the POVs is then captured on a different spatial location on the detector. With the spectral response of the detector pixels well characterized, spatial and spectral compressive sensing is performed as the images are recorded. Various computational techniques are used in this work which would: register the images captured from multiple views resulting in even more sparsely sensed images; perform spatial interpolation of the sparsely sampled spectral images; implement hyper-focusing of the images from all POVs captured as some defocusing will happen as the result of the discrepancy in the optical paths in each view; execute numerical dimensionality reduction analysis to extract information from the multispectral images. The spectral imaging capabilities of the device are tested with a collection of fluorescent microspheres. The spectral sensing capability of the device is examined by measuring the fluorescent spectra of adulterated edible oils and demonstrating the ability of the imaging system to differentiate between various types of oil as well as various levels of contamination. Lastly, the system is used to scrutinize samples of black ink from different pen manufacturers, and is able to discriminate between the different inks

Documenting and predicting topic changes in Computers in Biology and Medicine: A bibliometric keyword analysis from 1990 to 2017

The Computers in Biology and Medicine (CBM) journal promotes the use of com-puting machinery in the fields of bioscience and medicine. Since the first volume in 1970, the importance of computers in these fields has grown dramatically, this is evident in the diversification of topics and an increase in the publication rate. In this study, we quantify both change and diversification of topics covered in CBM. This is done by analysing the author supplied keywords, since they were electronically captured in 1990. The analysis starts by selecting 40 keywords, related to Medical (M) (7), Data (D)(10), Feature (F) (17) and Artificial Intelligence (AI) (6) methods. Automated keyword clustering shows the statistical connection between the selected keywords. We found that the three most popular topics in CBM are: Support Vector Machine (SVM), Elec-troencephalography (EEG) and IMAGE PROCESSING. In a separate analysis step, we bagged the selected keywords into sequential one year time slices and calculated the normalized appearance. The results were visualised with graphs that indicate the CBM topic changes. These graphs show that there was a transition from Artificial Neural Network (ANN) to SVM. In 2006 SVM replaced ANN as the most important AI algo-rithm. Our investigation helps the editorial board to manage and embrace topic change. Furthermore, our analysis is interesting for the general reader, as the results can help them to adjust their research directions

Basketball game analyzing based on computer vision

As tremendous improvement in computer vision technology, various industries start to apply computer vision to analyze huge multimedia content. Sports as one of the biggest resource invested industries also step up to utilize this technology to enhance their sports intelligent products. The thesis is following this development to provide prototype implementations of computer vision algorithms in sports industry. Main objective is to develop initial algorithms to solve play-field detection and player tracking in basketball game video. Play-field detection is an important task in sports video content analysis, as it provides the foundation for further operations such as object detection, object tracking or semantic event highlight and summarization. On the other hand, player tracking highlight player movements in critical events in basketball game. It is also a challenging task to develop effective and efficient player tracking in basketball video, due to factors such as pose variation, illumination change, occlusion, and motion blur. This thesis proposed reliable and efficient prototype algorithms to address play- field detection and single player tracking. SURF algorithm is utilized and modified to offer precise location of play-field and overlay trajectory data to improve viewer’s experience on sports product. And compressive tracking algorithm implemented for the aim of capture and track single player in important events to reveal player’s secret tactics. Prototype implementation to meet the current needs in basketball video content analyzing field

Recent Developments in Video Surveillance

With surveillance cameras installed everywhere and continuously streaming thousands of hours of video, how can that huge amount of data be analyzed or even be useful? Is it possible to search those countless hours of videos for subjects or events of interest? Shouldn’t the presence of a car stopped at a railroad crossing trigger an alarm system to prevent a potential accident? In the chapters selected for this book, experts in video surveillance provide answers to these questions and other interesting problems, skillfully blending research experience with practical real life applications. Academic researchers will find a reliable compilation of relevant literature in addition to pointers to current advances in the field. Industry practitioners will find useful hints about state-of-the-art applications. The book also provides directions for open problems where further advances can be pursued

Frequency Domain Decomposition of Digital Video Containing Multiple Moving Objects

Motion estimation has been dominated by time domain methods such as block matching and optical flow. However, these methods have problems with multiple moving objects in the video scene, moving backgrounds, noise, and fractional pixel/frame motion. This dissertation proposes a frequency domain method (FDM) that solves these problems. The methodology introduced here addresses multiple moving objects, with or without a moving background, 3-D frequency domain decomposition of digital video as the sum of locally translational (or, in the case of background, a globally translational motion), with high noise rejection. Additionally, via a version of the chirp-Z, fractional pixel/frame motion detection and quantification is accomplished. Furthermore, images of particular moving objects can be extracted and reconstructed from the frequency domain. Finally, this method can be integrated into a larger system to support motion analysis. The method presented here has been tested with synthetic data, realistic, high fidelity simulations, and actual data from established video archives to verify the claims made for the method, all presented here. In addition, a convincing comparison with an up-and-coming spatial domain method, incremental principal component pursuit (iPCP), is presented, where the FDM performs markedly better than its competition

TERSSE: Definition of the Total Earth Resources System for the Shuttle Era. Volume 6: An Early Shuttle Pallet Concept for the Earth Resources Program

A space shuttle sortie mission which can be performed inexpensively in the early shuttle era and which, if the necessary intermediate steps are accomplished provides a major technological advance for the user organization-the U.S. Bureau of Census is described. The orbital configuration created for the Urban Land Use/1980 Census mission is illustrated including sensors and ground support equipment along with the information flow for the mission. Factors discussed include: specific Census Bureau functions to be supported by the mission; hardware and flight operations necessary for implementation of the mission; and integration of the TERSSE pallet into a shuttle mission

3D exemplar-based image inpainting in electron microscopy

In electron microscopy (EM) a common problem is the non-availability of data, which causes artefacts in reconstructions. In this thesis the goal is to generate artificial data where missing in EM by using exemplar-based inpainting (EBI). We implement an accelerated 3D version tailored to applications in EM, which reduces reconstruction times from days to minutes. We develop intelligent sampling strategies to find optimal data as input for reconstruction methods. Further, we investigate approaches to reduce electron dose and acquisition time. Sparse sampling followed by inpainting is the most promising approach. As common evaluation measures may lead to misinterpretation of results in EM and falsify a subsequent analysis, we propose to use application driven metrics and demonstrate this in a segmentation task. A further application of our technique is the artificial generation of projections in tiltbased EM. EBI is used to generate missing projections, such that the full angular range is covered. Subsequent reconstructions are significantly enhanced in terms of resolution, which facilitates further analysis of samples. In conclusion, EBI proves promising when used as an additional data generation step to tackle the non-availability of data in EM, which is evaluated in selected applications. Enhancing adaptive sampling methods and refining EBI, especially considering the mutual influence, promotes higher throughput in EM using less electron dose while not lessening quality.Ein häufig vorkommendes Problem in der Elektronenmikroskopie (EM) ist die Nichtverfügbarkeit von Daten, was zu Artefakten in Rekonstruktionen führt. In dieser Arbeit ist es das Ziel fehlende Daten in der EM künstlich zu erzeugen, was durch Exemplar-basiertes Inpainting (EBI) realisiert wird. Wir implementieren eine auf EM zugeschnittene beschleunigte 3D Version, welche es ermöglicht, Rekonstruktionszeiten von Tagen auf Minuten zu reduzieren. Wir entwickeln intelligente Abtaststrategien, um optimale Datenpunkte für die Rekonstruktion zu erhalten. Ansätze zur Reduzierung von Elektronendosis und Aufnahmezeit werden untersucht. Unterabtastung gefolgt von Inpainting führt zu den besten Resultaten. Evaluationsmaße zur Beurteilung der Rekonstruktionsqualität helfen in der EM oft nicht und können zu falschen Schlüssen führen, weswegen anwendungsbasierte Metriken die bessere Wahl darstellen. Dies demonstrieren wir anhand eines Beispiels. Die künstliche Erzeugung von Projektionen in der neigungsbasierten Elektronentomographie ist eine weitere Anwendung. EBI wird verwendet um fehlende Projektionen zu generieren. Daraus resultierende Rekonstruktionen weisen eine deutlich erhöhte Auflösung auf. EBI ist ein vielversprechender Ansatz, um nicht verfügbare Daten in der EM zu generieren. Dies wird auf Basis verschiedener Anwendungen gezeigt und evaluiert. Adaptive Aufnahmestrategien und EBI können also zu einem höheren Durchsatz in der EM führen, ohne die Bildqualität merklich zu verschlechtern