Research on inter prediction algorithms and architectures for high-performance video codec VLSI

制度:新 ; 報告番号:甲3787号 ; 学位の種類:博士(工学) ; 授与年月日:2013/3/15 ; 早大学位記番号:新6163Waseda Universit

Interactive Image Manipulation with Complex Text Instructions

Recently, text-guided image manipulation has received increasing attention in the research field of multimedia processing and computer vision due to its high flexibility and controllability. Its goal is to semantically manipulate parts of an input reference image according to the text descriptions. However, most of the existing works have the following problems: (1) text-irrelevant content cannot always be maintained but randomly changed, (2) the performance of image manipulation still needs to be further improved, (3) only can manipulate descriptive attributes. To solve these problems, we propose a novel image manipulation method that interactively edits an image using complex text instructions. It allows users to not only improve the accuracy of image manipulation but also achieve complex tasks such as enlarging, dwindling, or removing objects and replacing the background with the input image. To make these tasks possible, we apply three strategies. First, the given image is divided into text-relevant content and text-irrelevant content. Only the text-relevant content is manipulated and the text-irrelevant content can be maintained. Second, a super-resolution method is used to enlarge the manipulation region to further improve the operability and to help manipulate the object itself. Third, a user interface is introduced for editing the segmentation map interactively to re-modify the generated image according to the user's desires. Extensive experiments on the Caltech-UCSD Birds-200-2011 (CUB) dataset and Microsoft Common Objects in Context (MS COCO) datasets demonstrate our proposed method can enable interactive, flexible, and accurate image manipulation in real-time. Through qualitative and quantitative evaluations, we show that the proposed model outperforms other state-of-the-art methods.Comment: Accepted to WACV202

Interfacial Interaction Enhanced Rheological Behavior in PAM/CTAC/Salt Aqueous Solution—A Coarse-Grained Molecular Dynamics Study

Interfacial interactions within a multi-phase polymer solution play critical roles in processing control and mass transportation in chemical engineering. However, the understandings of these roles remain unexplored due to the complexity of the system. In this study, we used an efficient analytical method—a nonequilibrium molecular dynamics (NEMD) simulation—to unveil the molecular interactions and rheology of a multiphase solution containing cetyltrimethyl ammonium chloride (CTAC), polyacrylamide (PAM), and sodium salicylate (NaSal). The associated macroscopic rheological characteristics and shear viscosity of the polymer/surfactant solution were investigated, where the computational results agreed well with the experimental data. The relation between the characteristic time and shear rate was consistent with the power law. By simulating the shear viscosity of the polymer/surfactant solution, we found that the phase transition of micelles within the mixture led to a non-monotonic increase in the viscosity of the mixed solution with the increase in concentration of CTAC or PAM. We expect this optimized molecular dynamic approach to advance the current understanding on chemical–physical interactions within polymer/surfactant mixtures at the molecular level and enable emerging engineering solutions

Kinases Mst1 and Mst2 positively regulate phagocytic induction of reactive oxygen species and bactericidal activity

该研究成果揭示了吞噬性细胞内Hippo信号通路关键激酶Mst1和Mst2通过活化Rac家族蛋白来调节线粒体向吞噬小泡募集并释放ROS来清除病原体，这个生物学过程在天然免疫和宿主防御中发挥着重要作用。该成果解析了人的Mst1基因缺失或Rac2基因突变引发免疫缺陷综合症的致病机理，为研究人类感染性疾病提供了全新的视角。 该论文的主要工作由2012级博士生耿晶、2013级博士生孙秀峰以及王平、张世浩和王晓珍等学生共同承担，并与厦门市第一医院、台湾长庚大学、中国科学技术大学等单位合作完成，通讯作者为周大旺教授和陈兰芬教授。该研究工作获得了“青年千人计划”、国家自然科学基金委和科技部的资助。Mitochondria need to be juxtaposed to phagosomes for the synergistic production of ample reactive oxygen species (ROS) in phagocytes to kill pathogens. However, how phagosomes transmit signals to recruit mitochondria has remained unclear. Here we found that the kinases Mst1 and Mst2 functioned to control ROS production by regulating mitochondrial trafficking and mitochondrion-phagosome juxtaposition. Mst1 and Mst2 activated the GTPase Rac to promote Toll-like receptor (TLR)-triggered assembly of the TRAF6-ECSIT complex that is required for the recruitment of mitochondria to phagosomes. Inactive forms of Rac, including the human Rac2D57N mutant, disrupted the TRAF6-ECSIT complex by sequestering TRAF6 and substantially diminished ROS production and enhanced susceptibility to bacterial infection. Our findings demonstrate that the TLR-Mst1-Mst2-Rac signaling axis is critical for effective phagosome-mitochondrion function and bactericidal activity.Supported by the National Basic Research Program (973) of China (2015CB910502 to L.C.), China's 1000 Young Talents Program (D.Z. and L.C.), the 111 Projects (B12001 and B06016), the Fundamental Research Funds for the Central Universities of China-Xiamen University (CXB2014004 to J.Z.; 20720140551 to L.C.; and 2013121034 and 20720140537 to D.Z.), the National Natural Science Foundation of China (31270918, 81222030 and J1310027 to D.Z.; 81372617, 81422018 and U1405225 to L.C.; 81472229 to L.H.; and 81302529 to X.L.), the Natural Science Foundation of Fujian (2013J06011 to D.Z. and 2014D007 to X.L.), the US National Institutes of Health (RO1 CA136567 for J.A.) and institutional funds from Massachusetts General Hospital (for J.A.). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript

Compressive Sensing in Image/Video Compression: Sampling, Coding, Reconstruction, and Codec Optimization

Compressive Sensing (CS) has emerged as a transformative technique in image compression, offering innovative solutions to challenges in efficient signal representation and acquisition. This paper provides a comprehensive exploration of the key components within the domain of CS applied to image and video compression. We delve into the fundamental principles of CS, highlighting its ability to efficiently capture and represent sparse signals. The sampling strategies employed in image compression applications are examined, emphasizing the role of CS in optimizing the acquisition of visual data. The measurement coding techniques leveraging the sparsity of signals are discussed, showcasing their impact on reducing data redundancy and storage requirements. Reconstruction algorithms play a pivotal role in CS, and this article reviews state-of-the-art methods, ensuring a high-fidelity reconstruction of visual information. Additionally, we explore the intricate optimization between the CS encoder and decoder, shedding light on advancements that enhance the efficiency and performance of compression techniques in different scenarios. Through a comprehensive analysis of these components, this review aims to provide a holistic understanding of the applications, challenges, and potential optimizations in employing CS for image and video compression tasks