Rethinking the Pipeline of Demosaicing, Denoising and Super-Resolution

Incomplete color sampling, noise degradation, and limited resolution are the three key problems that are unavoidable in modern camera systems. Demosaicing (DM), denoising (DN), and super-resolution (SR) are core components in a digital image processing pipeline to overcome the three problems above, respectively. Although each of these problems has been studied actively, the mixture problem of DM, DN, and SR, which is a higher practical value, lacks enough attention. Such a mixture problem is usually solved by a sequential solution (applying each method independently in a fixed order: DM $\to$ DN $\to$ SR), or is simply tackled by an end-to-end network without enough analysis into interactions among tasks, resulting in an undesired performance drop in the final image quality. In this paper, we rethink the mixture problem from a holistic perspective and propose a new image processing pipeline: DN $\to$ SR $\to$ DM. Extensive experiments show that simply modifying the usual sequential solution by leveraging our proposed pipeline could enhance the image quality by a large margin. We further adopt the proposed pipeline into an end-to-end network, and present Trinity Enhancement Network (TENet). Quantitative and qualitative experiments demonstrate the superiority of our TENet to the state-of-the-art. Besides, we notice the literature lacks a full color sampled dataset. To this end, we contribute a new high-quality full color sampled real-world dataset, namely PixelShift200. Our experiments show the benefit of the proposed PixelShift200 dataset for raw image processing.Comment: Code is available at: https://github.com/guochengqian/TENe

Calibration and data quality of warm IRAC

We present an overview of the calibration and properties of data from the IRAC instrument aboard the Spitzer Space Telescope taken after the depletion of cryogen. The cryogen depleted on 15 May 2009, and shortly afterward a two-month- long calibration and characterization campaign was conducted. The array temperature and bias setpoints were revised on 19 September 2009 to take advantage of lower than expected power dissipation by the instrument and to improve sensitivity. The final operating temperature of the arrays is 28.7 K, the applied bias across each detector is 500 mV and the equilibrium temperature of the instrument chamber is 27.55 K. The final sensitivities are essentially the same as the cryogenic mission with the 3.6 μm array being slightly less sensitive (10%) and the 4.5 μm array within 5% of the cryogenic sensitivity. The current absolute photometric uncertainties are 4% at 3.6 and 4.5 μm, and better than milli-mag photometry is achievable for long-stare photometric observations. With continued analysis, we expect the absolute calibration to improve to the cryogenic value of 3%. Warm IRAC operations fully support all science that was conducted in the cryogenic mission and all currently planned warm science projects (including Exploration Science programs). We expect that IRAC will continue to make ground-breaking discoveries in star formation, the nature of the early universe, and in our understanding of the properties of exoplanets