Rethinking the Pipeline of Demosaicing, Denoising and Super-Resolution

Incomplete color sampling, noise degradation, and limited resolution are the three key problems that are unavoidable in modern camera systems. Demosaicing (DM), denoising (DN), and super-resolution (SR) are core components in a digital image processing pipeline to overcome the three problems above, respectively. Although each of these problems has been studied actively, the mixture problem of DM, DN, and SR, which is a higher practical value, lacks enough attention. Such a mixture problem is usually solved by a sequential solution (applying each method independently in a fixed order: DM $\to$ DN $\to$ SR), or is simply tackled by an end-to-end network without enough analysis into interactions among tasks, resulting in an undesired performance drop in the final image quality. In this paper, we rethink the mixture problem from a holistic perspective and propose a new image processing pipeline: DN $\to$ SR $\to$ DM. Extensive experiments show that simply modifying the usual sequential solution by leveraging our proposed pipeline could enhance the image quality by a large margin. We further adopt the proposed pipeline into an end-to-end network, and present Trinity Enhancement Network (TENet). Quantitative and qualitative experiments demonstrate the superiority of our TENet to the state-of-the-art. Besides, we notice the literature lacks a full color sampled dataset. To this end, we contribute a new high-quality full color sampled real-world dataset, namely PixelShift200. Our experiments show the benefit of the proposed PixelShift200 dataset for raw image processing.Comment: Code is available at: https://github.com/guochengqian/TENe

Self-Supervised Intensity-Event Stereo Matching

Event cameras are novel bio-inspired vision sensors that output pixel-level intensity changes in microsecond accuracy with a high dynamic range and low power consumption. Despite these advantages, event cameras cannot be directly applied to computational imaging tasks due to the inability to obtain high-quality intensity and events simultaneously. This paper aims to connect a standalone event camera and a modern intensity camera so that the applications can take advantage of both two sensors. We establish this connection through a multi-modal stereo matching task. We first convert events to a reconstructed image and extend the existing stereo networks to this multi-modality condition. We propose a self-supervised method to train the multi-modal stereo network without using ground truth disparity data. The structure loss calculated on image gradients is used to enable self-supervised learning on such multi-modal data. Exploiting the internal stereo constraint between views with different modalities, we introduce general stereo loss functions, including disparity cross-consistency loss and internal disparity loss, leading to improved performance and robustness compared to existing approaches. The experiments demonstrate the effectiveness of the proposed method, especially the proposed general stereo loss functions, on both synthetic and real datasets. At last, we shed light on employing the aligned events and intensity images in downstream tasks, e.g., video interpolation application.Comment: This paper has been accepted by the Journal of Imaging Science & Technolog

The accuracy of soluble urokinase-type plasminogen activator receptor for the diagnosis of neonatal sepsis: a meta-analysis

BackgroundNeonatal sepsis is one of the major causes of morbidity and mortality in newborns. However, atypical clinical manifestations and symptoms make the early diagnosis of neonatal sepsis a challenge. Relatively high-serum soluble urokinase-type plasminogen activator receptor (suPAR) has been implicated as a diagnostic biomarker for adult sepsis. Therefore, the meta-analysis is intended to explore the diagnostic value of suPAR for neonatal sepsis.MethodsThe PubMed, Cochrane Library, Embase, Web of Science, China National Knowledge Infrastructure, China Biological Medicine Disk, and Wanfang databases were retrieved from inception to 31 December 2022 to collect diagnostic accuracy studies about suPAR for neonatal sepsis. Two reviewers independently screened the literature, extracted data, and assessed the risk of bias in the included studies using the quality assessment of diagnostic accuracy studies-2 (QUADAS-2) tool. Then, a meta-analysis was performed using Stata 15.0 software.ResultsA total of six articles involving eight studies were included. The results of the meta-analysis showed that the pooled sensitivity, specificity, positive likelihood ratio, negative likelihood ratio, and diagnostic odds ratio were 0.89 [95%CI (0.83–0.93)], 0.94 [95%CI (0.77–0.98)], 14 [95%CI (3.5–55.2)], 0.12 [95%CI (0.08–0.18)], and 117 [95%CI (24–567)], respectively. The area under the curve (AUC) of summary receiver operator characteristic (SROC) curves was 0.92 [95%CI (0.90–0.94)]. Sensitivity analysis confirmed the stability of the results, and publication bias was not observed. Fagan’s nomogram results demonstrated the clinical availability of the findings.ConclusionCurrent evidence suggests that suPAR has potential diagnostic value for neonatal sepsis. Owing to the limited quality of the included studies, more high-quality studies are needed to verify the above conclusion

Induction of RIPK3/MLKL-mediated necroptosis by Erigeron breviscapus injection exhibits potent antitumor effect

Colorectal cancer (CRC) is the second leading cause of tumor-related deaths worldwide. Resistance of tumor cells to drug-induced apoptosis highlights the need for safe and effective antitumor alternatives. Erigeron breviscapus (Dengzhanxixin in China) injection (EBI), extracted from the natural herb Erigeron breviscapus (Vant.) Hand.-Mazz (EHM), has been widely used in clinical practice for cardiovascular diseases. Recent studies have suggested that EBI’s main active ingredients exhibit potential antitumor effects. This study aims to explore the anti-CRC effect of EBI and elucidate the underlying mechanism. The anti-CRC effect of EBI was evaluated in vitro using CCK-8, flow cytometry, and transwell analysis, and in vivo through a xenograft mice model. RNA sequencing was utilized to compare the differentially expressed genes, and the proposed mechanism was verified through in vitro and in vivo experiments. Our study demonstrates that EBI significantly inhibits the proliferation of three human CRC cell lines and effectively suppresses the migration and invasion of SW620 cells. Moreover, in the SW620 xenograft mice model, EBI markedly retards tumor growth and lung metastasis. RNA-seq analysis revealed that EBI might exert antitumor effects by inducing necroptosis of tumor cells. Additionally, EBI activates the RIPK3/MLKL signaling pathway, a classical pathway of necroptosis and greatly promotes the generation of intracellular ROS. Furthermore, the antitumor effect of EBI on SW620 is significantly alleviated after the pretreatment of GW806742X, the MLKL inhibitor. Our findings suggest that EBI is a safe and effective inducer of necroptosis for CRC treatment. Notably, necroptosis is a non-apoptotic programmed cell death pathway that can effectively circumvent resistance to apoptosis, which provides a novel approach for overcoming tumor drug resistance

Transcriptional regulatory control of mammalian nephron progenitors revealed by multi-factor cistromic analysis and genetic studies

Nephron progenitor number determines nephron endowment; a reduced nephron count is linked to the onset of kidney disease. Several transcriptional regulators including Six2, Wt1, Osr1, Sall1, Eya1, Pax2, and Hox11 paralogues are required for specification and/or maintenance of nephron progenitors. However, little is known about the regulatory intersection of these players. Here, we have mapped nephron progenitor-specific transcriptional networks of Six2, Hoxd11, Osr1, and Wt1. We identified 373 multi-factor associated ‘regulatory hotspots’ around genes closely associated with progenitor programs. To examine their functional significance, we deleted ‘hotspot’ enhancer elements for Six2 and Wnt4. Removal of the distal enhancer for Six2 leads to a ~40% reduction in Six2 expression. When combined with a Six2 null allele, progeny display a premature depletion of nephron progenitors. Loss of the Wnt4 enhancer led to a significant reduction of Wnt4 expression in renal vesicles and a mildly hypoplastic kidney, a phenotype also enhanced in combination with a Wnt4 null mutation. To explore the regulatory landscape that supports proper target gene expression, we performed CTCF ChIP-seq to identify insulator-boundary regions. One such putative boundary lies between the Six2 and Six3 loci. Evidence for the functional significance of this boundary was obtained by deep sequencing of the radiation-induced Brachyrrhine (Br) mutant allele. We identified an inversion of the Six2/Six3 locus around the CTCF-bound boundary, removing Six2 from its distal enhancer regulation, but placed next to Six3 enhancer elements which support ectopic Six2 expression in the lens where Six3 is normally expressed. Six3 is now predicted to fall under control of the Six2 distal enhancer. Consistent with this view, we observed ectopic Six3 in nephron progenitors. 4C-seq supports the model for Six2 distal enhancer interactions in wild-type and Br/+ mouse kidneys. Together, these data expand our view of the regulatory genome and regulatory landscape underpinning mammalian nephrogenesis

Transcriptional regulatory control of mammalian nephron progenitors revealed by multi-factor cistromic analysis and genetic studies.

Nephron progenitor number determines nephron endowment; a reduced nephron count is linked to the onset of kidney disease. Several transcriptional regulators including Six2, Wt1, Osr1, Sall1, Eya1, Pax2, and Hox11 paralogues are required for specification and/or maintenance of nephron progenitors. However, little is known about the regulatory intersection of these players. Here, we have mapped nephron progenitor-specific transcriptional networks of Six2, Hoxd11, Osr1, and Wt1. We identified 373 multi-factor associated \u27regulatory hotspots\u27 around genes closely associated with progenitor programs. To examine their functional significance, we deleted \u27hotspot\u27 enhancer elements for Six2 and Wnt4. Removal of the distal enhancer for Six2 leads to a ~40% reduction in Six2 expression. When combined with a Six2 null allele, progeny display a premature depletion of nephron progenitors. Loss of the Wnt4 enhancer led to a significant reduction of Wnt4 expression in renal vesicles and a mildly hypoplastic kidney, a phenotype also enhanced in combination with a Wnt4 null mutation. To explore the regulatory landscape that supports proper target gene expression, we performed CTCF ChIP-seq to identify insulator-boundary regions. One such putative boundary lies between the Six2 and Six3 loci. Evidence for the functional significance of this boundary was obtained by deep sequencing of the radiation-induced Brachyrrhine (Br) mutant allele. We identified an inversion of the Six2/Six3 locus around the CTCF-bound boundary, removing Six2 from its distal enhancer regulation, but placed next to Six3 enhancer elements which support ectopic Six2 expression in the lens where Six3 is normally expressed. Six3 is now predicted to fall under control of the Six2 distal enhancer. Consistent with this view, we observed ectopic Six3 in nephron progenitors. 4C-seq supports the model for Six2 distal enhancer interactions in wild-type and Br/+ mouse kidneys. Together, these data expand our view of the regulatory genome and regulatory landscape underpinning mammalian nephrogenesis