A Structure-Guided Diffusion Model for Large-Hole Image Completion

Image completion techniques have made significant progress in filling missing regions (i.e., holes) in images. However, large-hole completion remains challenging due to limited structural information. In this paper, we address this problem by integrating explicit structural guidance into diffusion-based image completion, forming our structure-guided diffusion model (SGDM). It consists of two cascaded diffusion probabilistic models: structure and texture generators. The structure generator generates an edge image representing plausible structures within the holes, which is then used for guiding the texture generation process. To train both generators jointly, we devise a novel strategy that leverages optimal Bayesian denoising, which denoises the output of the structure generator in a single step and thus allows backpropagation. Our diffusion-based approach enables a diversity of plausible completions, while the editable edges allow for editing parts of an image. Our experiments on natural scene (Places) and face (CelebA-HQ) datasets demonstrate that our method achieves a superior or comparable visual quality compared to state-of-the-art approaches. The code is available for research purposes at https://github.com/UdonDa/Structure_Guided_Diffusion_Model.Comment: BMVC2023. Code: https://github.com/UdonDa/Structure_Guided_Diffusion_Mode

A Study on Persistence of GAN-Based Vision-Induced Gustatory Manipulation

Vision-induced gustatory manipulation interfaces can help people with dietary restrictions feel as if they are eating what they want by modulating the appearance of the alternative foods they are eating in reality. However, it is still unclear whether vision-induced gustatory change persists beyond a single bite, how the sensation changes over time, and how it varies among individuals from different cultural backgrounds. The present paper reports on a user study conducted to answer these questions using a generative adversarial network (GAN)-based real-time image-to-image translation system. In the user study, 16 participants were presented somen noodles or steamed rice through a video see-through head mounted display (HMD) both in two conditions; without or with visual modulation (somen noodles and steamed rice were translated into ramen noodles and curry and rice, respectively), and brought food to the mouth and tasted it five times with an interval of two minutes. The results of the experiments revealed that vision-induced gustatory manipulation is persistent in many participants. Their persistent gustatory changes are divided into three groups: those in which the intensity of the gustatory change gradually increased, those in which it gradually decreased, and those in which it did not fluctuate, each with about the same number of participants. Although the generalizability is limited due to the small population, it was also found that non-Japanese and male participants tended to perceive stronger gustatory manipulation compared to Japanese and female participants. We believe that our study deepens our understanding and insight into vision-induced gustatory manipulation and encourages further investigation

Wheat Ym2 originated from Aegilops sharonensis and confers resistance to soil-borne Wheat yellow mosaic virus infection to the roots

International audienceWheat yellow mosaic virus (WYMV) is a pathogen transmitted into its host’s roots by the soil-borne vector Polymyxa graminis . Ym1 and Ym2 genes protect the host from the significant yield losses caused by the virus, but the mechanistic basis of these resistance genes remains poorly understood. Here, it has been shown that Ym1 and Ym2 act within the root either by hindering the initial movement of WYMV from the vector into the root and/or by suppressing viral multiplication. A mechanical inoculation experiment on the leaf revealed that the presence of Ym1 reduced viral infection incidence, rather than viral titer, while that of Ym2 was ineffective in the leaf. To understand the basis of the root specificity of the Ym2 product, the gene was isolated from bread wheat using a positional cloning approach. The candidate gene encodes a CC-NBS-LRR protein and it correlated allelic variation with respect to its sequence with the host’s disease response. Ym2 (B37500) and its paralog (B35800) are found in the near-relatives, respectively, Aegilops sharonensi s and Aegilops speltoides (a close relative of the donor of bread wheat’s B genome), while both sequences, in a concatenated state, are present in several accessions of the latter species . Structural diversity in Ym2 has been generated via translocation and recombination between the two genes and enhanced by the formation of a chimeric gene resulting from an intralocus recombination event. The analysis has revealed how the Ym2 region has evolved during the polyploidization events leading to the creation of cultivated wheat