mPLUG-Owl2: Revolutionizing Multi-modal Large Language Model with Modality Collaboration

Multi-modal Large Language Models (MLLMs) have demonstrated impressive instruction abilities across various open-ended tasks. However, previous methods primarily focus on enhancing multi-modal capabilities. In this work, we introduce a versatile multi-modal large language model, mPLUG-Owl2, which effectively leverages modality collaboration to improve performance in both text and multi-modal tasks. mPLUG-Owl2 utilizes a modularized network design, with the language decoder acting as a universal interface for managing different modalities. Specifically, mPLUG-Owl2 incorporates shared functional modules to facilitate modality collaboration and introduces a modality-adaptive module that preserves modality-specific features. Extensive experiments reveal that mPLUG-Owl2 is capable of generalizing both text tasks and multi-modal tasks and achieving state-of-the-art performances with a single generic model. Notably, mPLUG-Owl2 is the first MLLM model that demonstrates the modality collaboration phenomenon in both pure-text and multi-modal scenarios, setting a pioneering path in the development of future multi-modal foundation models

EgoObjects: A Large-Scale Egocentric Dataset for Fine-Grained Object Understanding

Object understanding in egocentric visual data is arguably a fundamental research topic in egocentric vision. However, existing object datasets are either non-egocentric or have limitations in object categories, visual content, and annotation granularities. In this work, we introduce EgoObjects, a large-scale egocentric dataset for fine-grained object understanding. Its Pilot version contains over 9K videos collected by 250 participants from 50+ countries using 4 wearable devices, and over 650K object annotations from 368 object categories. Unlike prior datasets containing only object category labels, EgoObjects also annotates each object with an instance-level identifier, and includes over 14K unique object instances. EgoObjects was designed to capture the same object under diverse background complexities, surrounding objects, distance, lighting and camera motion. In parallel to the data collection, we conducted data annotation by developing a multi-stage federated annotation process to accommodate the growing nature of the dataset. To bootstrap the research on EgoObjects, we present a suite of 4 benchmark tasks around the egocentric object understanding, including a novel instance level- and the classical category level object detection. Moreover, we also introduce 2 novel continual learning object detection tasks. The dataset and API are available at https://github.com/facebookresearch/EgoObjects.Comment: ICCV 2023 final version and supplement. See more details in project page: https://github.com/facebookresearch/EgoObject

TELEX HEBDOMADAIRE NR 95 DU 17.09.82 DESTINE A L'ENSEMBLE DES DELEGATIONS EXTERIEURES ET BUREAUX DE PRESS ET D'INFORMATION INDEPENDANTS DANS LES PAYS TIERS = WEEKLY MEMO NO. 95 FOR 17.09.82 TO FOREIGN DELEGATIONS AND PRESS BUREAUS OF THIRD COUNTRIES

<p>High-performance liquid chromatography (HPLC) results of (A) commercial surfactin sample, and (B) our extract surfactin of <i>B</i>. <i>subtilis</i> HH2 in LB medium. There were three main peaks (Peak A-C) of the extract and the surfactin standard in the same location.</p

The Mitochondrial Genome of Baylisascaris procyonis

BACKGROUND: Baylisascaris procyonis (Nematoda: Ascaridida), an intestinal nematode of raccoons, is emerging as an important helminthic zoonosis due to serious or fatal larval migrans in animals and humans. Despite its significant veterinary and public health impact, the epidemiology, molecular ecology and population genetics of this parasite remain largely unexplored. Mitochondrial (mt) genomes can provide a foundation for investigations in these areas and assist in the diagnosis and control of B. procyonis. In this study, the first complete mt genome sequence of B. procyonis was determined using a polymerase chain reaction (PCR)-based primer-walking strategy. METHODOLOGY/PRINCIPAL FINDINGS: The circular mt genome (14781 bp) of B. procyonis contained 12 protein-coding, 22 transfer RNA and 2 ribosomal RNA genes congruent with other chromadorean nematodes. Interestingly, the B. procyonis mtDNA featured an extremely long AT-rich region (1375 bp) and a high number of intergenic spacers (17), making it unique compared with other secernentean nematodes characterized to date. Additionally, the entire genome displayed notable levels of AT skew and GC skew. Based on pairwise comparisons and sliding window analysis of mt genes among the available 11 Ascaridida mtDNAs, new primer pairs were designed to amplify specific short fragments of the genes cytb (548 bp fragment) and rrnL (200 bp fragment) in the B. procyonis mtDNA, and tested as possible alternatives to existing mt molecular beacons for Ascaridida. Finally, phylogenetic analysis of mtDNAs provided novel estimates of the interrelationships of Baylisasaris and Ascaridida. CONCLUSIONS/SIGNIFICANCE: The complete mt genome sequence of B. procyonis sequenced here should contribute to molecular diagnostic methods, epidemiological investigations and ecological studies of B. procyonis and other related ascaridoids. The information will be important in refining the phylogenetic relationships within the order Ascaridida and enriching the resource of markers for systematic, population genetic and evolutionary biological studies of parasitic nematodes of socio-economic importance

Promoter polymorphisms of DNMT3B and the risk of colorectal cancer in Chinese: a case-control study

<p>Abstract</p> <p>Background</p> <p>DNA-methyltransferase-3B (DNMT3B), which plays a role in DNA methylation, is usually aberrant expression involved in carcinogenesis. Polymorphisms of the DNMT3B gene may influence DNMT3B activity on DNA methylation in several cancers, thereby modulating the susceptibility to cancer.</p> <p>Methods</p> <p>DNMT3B -579G>T genotypes and -149C>T were determined by PCR-RFLP and sequencing in 137 colorectal cancer patients and 308 controls matched for age and sex, who did not receive radiotherapy or chemotherapy for newly diagnosed and histopathologically confirmed colorectal cancer. The association between two SNPs of the <it>DNMT3B </it>promoter and the risk of the development of colorectal cancer was analyzed in a population of Chinese.</p> <p>Results</p> <p>The allele frequency of -149C >T among patients and controls was 0.73% versus 0.65%, respectively. The allele frequency of -597G>T for patients and controls was 6.57% versus 11.53%, respectively. Individuals with at least one -149C>T allele were no at a significantly increase risk of colorectal cancer compared with those having a -149TT genotype. However, Individuals with at least one 579G>T allele were decreased risk of colorectal cancer compared with those having a -579TT genotype.</p> <p>Conclusion</p> <p>The relative distribution of -149C>T <it>DNMT3B </it>SNPs among a Chinese population can not be used as a stratification marker to predict an individual's susceptibility to colorectal cancer. However, the DNMT3B -579G>T polymorphism may contribute to the genetic susceptibility to colorectal cancer.</p

Numerical Study of Pore Water Pressure in Frozen Soils during Moisture Migration

Frost heaving in soils is a primary cause of engineering failures in cold regions. Although extensive experimental and numerical research has focused on the deformation caused by frost heaving, there is a notable lack of numerical investigations into the critical underlying factor: pore water pressure. This study aimed to experimentally determine changes in soil water content over time at various depths during unidirectional freezing and to model this process using a coupled hydrothermal approach. The agreement between experimental water content outcomes and numerical predictions validates the numerical method’s applicability. Furthermore, by applying the Gibbs free energy equation, we derived a novel equation for calculating the pore water pressure in saturated frozen soil. Utilizing this equation, we developed a numerical model to simulate pore water pressure and water movement in frozen soil, accounting for scenarios with and without ice lens formation and quantifying unfrozen water migration from unfrozen to frozen zones over time. Our findings reveal that pore water pressure decreases as freezing depth increases, reaching near zero at the freezing front. Notably, the presence of an ice lens significantly amplifies pore water pressure—approximately tenfold—compared to scenarios without an ice lens, aligning with existing experimental data. The model also indicates that the cold-end temperature sets the maximum pore water pressure value in freezing soil, with superior performance to Konrad’s model at lower temperatures in the absence of ice lenses. Additionally, as freezing progresses, the rate of water flow from the unfrozen region to the freezing fringe exhibits a fluctuating decline. This study successfully establishes a numerical model for pore water pressure and water flow in frozen soil, confirms its validity through experimental comparison, and introduces an improved formula for pore water pressure calculation, offering a more accurate reflection of the real-world phenomena than previous formulations

Feature-Distribution Perturbation and Calibration for Generalized Person ReID

Person Re-identification (ReID) has been advanced remarkably over the last 10 years along with the rapid development of deep learning for visual recognition. However, the i.i.d. (independent and identically distributed) assumption commonly held in most deep learning models is somewhat non-applicable to ReID considering its objective to identify images of the same pedestrian across cameras at different locations often of variable and independent domain characteristics that are also subject to view-biased data distribution. In this work, we propose a Feature-Distribution Perturbation and Calibration (PECA) method to derive generic feature representations for person ReID, which is not only discriminative across cameras but also agnostic and deployable to arbitrary unseen target domains. Specifically, we perform per-domain feature-distribution perturbation to refrain the model from overfitting to the domain-biased distribution of each source (seen) domain by enforcing feature invariance to distribution shifts caused by perturbation. Furthermore, we design a global calibration mechanism to align feature distributions across all the source domains to improve the model generalization capacity by eliminating domain bias. These local perturbation and global calibration are conducted simultaneously, which share the same principle to avoid models overfitting by regularization respectively on the perturbed and the original distributions. Extensive experiments were conducted on eight person ReID datasets and the proposed PECA model outperformed the state-of-the-art competitors by significant margins