Leveraging Chat-Based Large Vision Language Models for Multimodal Out-Of-Context Detection

Out-of-context (OOC) detection is a challenging task involving identifying images and texts that are irrelevant to the context in which they are presented. Large vision-language models (LVLMs) are effective at various tasks, including image classification and text generation. However, the extent of their proficiency in multimodal OOC detection tasks is unclear. In this paper, we investigate the ability of LVLMs to detect multimodal OOC and show that these models cannot achieve high accuracy on OOC detection tasks without fine-tuning. However, we demonstrate that fine-tuning LVLMs on multimodal OOC datasets can further improve their OOC detection accuracy. To evaluate the performance of LVLMs on OOC detection tasks, we fine-tune MiniGPT-4 on the NewsCLIPpings dataset, a large dataset of multimodal OOC. Our results show that fine-tuning MiniGPT-4 on the NewsCLIPpings dataset significantly improves the OOC detection accuracy in this dataset. This suggests that fine-tuning can significantly improve the performance of LVLMs on OOC detection tasks.Comment: 13 pages, 6 figures , conferenc

Image-Text Out-Of-Context Detection Using Synthetic Multimodal Misinformation

Misinformation has become a major challenge in the era of increasing digital information, requiring the development of effective detection methods. We have investigated a novel approach to Out-Of-Context detection (OOCD) that uses synthetic data generation. We created a dataset specifically designed for OOCD and developed an efficient detector for accurate classification. Our experimental findings validate the use of synthetic data generation and demonstrate its efficacy in addressing the data limitations associated with OOCD. The dataset and detector should serve as valuable resources for future research and the development of robust misinformation detection systems.Comment: 8 pages, 2 figures, conferenc

Differential operators on supercircle: conformally equivariant quantization and symbol calculus

We consider the supercircle $S^{1|1}$ equipped with the standard contact structure. The conformal Lie superalgebra K(1) acts on $S^{1|1}$ as the Lie superalgebra of contact vector fields; it contains the M\"obius superalgebra $osp(1|2)$. We study the space of linear differential operators on weighted densities as a module over $osp(1|2)$. We introduce the canonical isomorphism between this space and the corresponding space of symbols and find interesting resonant cases where such an isomorphism does not exist

In situ observation of stress relaxation in epitaxial graphene

Upon cooling, branched line defects develop in epitaxial graphene grown at high temperature on Pt(111) and Ir(111). Using atomically resolved scanning tunneling microscopy we demonstrate that these defects are wrinkles in the graphene layer, i.e. stripes of partially delaminated graphene. With low energy electron microscopy (LEEM) we investigate the wrinkling phenomenon in situ. Upon temperature cycling we observe hysteresis in the appearance and disappearance of the wrinkles. Simultaneously with wrinkle formation a change in bright field imaging intensity of adjacent areas and a shift in the moire spot positions for micro diffraction of such areas takes place. The stress relieved by wrinkle formation results from the mismatch in thermal expansion coefficients of graphene and the substrate. A simple one-dimensional model taking into account the energies related to strain, delamination and bending of graphene is in qualitative agreement with our observations.Comment: Supplementary information: S1: Photo electron emission microscopy and LEEM measurements of rotational domains, STM data of a delaminated bulge around a dislocation. S2: Movie with increasing brightness upon wrinkle formation as in figure 4. v2: Major revision including new experimental dat

Inhibition of Fungi and Gram-Negative Bacteria by Bacteriocin BacTN635 Produced by Lactobacillus plantarum sp. TN635

The aim of this study was to evaluate 54 lactic acid bacteria (LAB) strains isolated from meat, fermented vegetables and dairy products for their capacity to produce antimicrobial activities against several bacteria and fungi. The strain designed TN635 has been selected for advanced studies. The supernatant culture of this strain inhibits the growth of all tested pathogenic including the four Gram-negative bacteria (Salmonella enterica ATCC43972, Pseudomonas aeruginosa ATCC 49189, Hafnia sp. and Serratia sp.) and the pathogenic fungus Candida tropicalis R2 CIP203. Based on the nucleotide sequence of the 16S rRNA gene of the strain TN635 (1,540 pb accession no FN252881) and the phylogenetic analysis, we propose the assignment of our new isolate bacterium as Lactobacillus plantarum sp. TN635 strain. Its antimicrobial compound was determined as a proteinaceous substance, stable to heat and to treatment with surfactants and organic solvents. Highest antimicrobial activity was found between pH 3 and 11 with an optimum at pH = 7. The BacTN635 was purified to homogeneity by a four-step protocol involving ammonium sulfate precipitation, centrifugal microconcentrators with a 10-kDa membrane cutoff, gel filtration Sephadex G-25, and C18 reverse-phase HPLC. SDS-PAGE analysis of the purified BacTN635, revealed a single band with an estimated molecular mass of approximately 4 kDa. The maximum bacteriocin production (5,000 AU/ml) was recorded after a 16-h incubation in Man, Rogosa, and Sharpe (MRS) medium at 30 °C. The mode of action of the partial purified BacTN635 was identified as bactericidal against Listeria ivanovii BUG 496 and as fungistatic against C. tropicalis R2 CIP203

Positive impacts of important bird and biodiversity areas on wintering waterbirds under changing temperatures throughout Europe and North Africa

Migratory waterbirds require an effectively conserved cohesive network of wetland areas throughout their range and life-cycle. Under rapid climate change, protected area (PA) networks need to be able to accommodate climate-driven range shifts in wildlife if they are to continue to be effective in the future. Thus, we investigated geographical variation in the relationship between local temperature anomaly and the abundance of 61 waterbird species during the wintering season across Europe and North Africa during 1990-2015. We also compared the spatio-temporal effects on abundance of sites designated as PAs, Important Bird and Biodiversity Areas (IBAs), both, or neither designation (Unlisted). Waterbird abundance was positively correlated with temperature anomaly, with this pattern being strongest towards north and east Europe. Waterbird abundance was higher inside IBAs, whether they were legally protected or not. Trends in waterbird abundance were also consistently more positive inside both protected and unprotected IBAs across the whole study region, and were positive in Unlisted wetlands in southwestern Europe and North Africa. These results suggest that IBAs are important sites for wintering waterbirds, but also that populations are shifting to unprotected wetlands (some of which are IBAs). Such IBAs may therefore represent robust candidate sites to expand the network of legally protected wetlands under climate change in north-eastern Europe. These results underscore the need for monitoring to understand how the effectiveness of site networks is changing under climate change.Peer reviewe