MAP: Multimodal Uncertainty-Aware Vision-Language Pre-training Model

Multimodal semantic understanding often has to deal with uncertainty, which means the obtained messages tend to refer to multiple targets. Such uncertainty is problematic for our interpretation, including inter- and intra-modal uncertainty. Little effort has studied the modeling of this uncertainty, particularly in pre-training on unlabeled datasets and fine-tuning in task-specific downstream datasets. In this paper, we project the representations of all modalities as probabilistic distributions via a Probability Distribution Encoder (PDE) by utilizing sequence-level interactions. Compared to the existing deterministic methods, such uncertainty modeling can convey richer multimodal semantic information and more complex relationships. Furthermore, we integrate uncertainty modeling with popular pre-training frameworks and propose suitable pre-training tasks: Distribution-based Vision-Language Contrastive learning (D-VLC), Distribution-based Masked Language Modeling (D-MLM), and Distribution-based Image-Text Matching (D-ITM). The fine-tuned models are applied to challenging downstream tasks, including image-text retrieval, visual question answering, visual reasoning, and visual entailment, and achieve state-of-the-art results.Comment: CVPR 2023 accep

Large expert-curated database for benchmarking document similarity detection in biomedical literature search

Document recommendation systems for locating relevant literature have mostly relied on methods developed a decade ago. This is largely due to the lack of a large offline gold-standard benchmark of relevant documents that cover a variety of research fields such that newly developed literature search techniques can be compared, improved and translated into practice. To overcome this bottleneck, we have established the RElevant LIterature SearcH consortium consisting of more than 1500 scientists from 84 countries, who have collectively annotated the relevance of over 180 000 PubMed-listed articles with regard to their respective seed (input) article/s. The majority of annotations were contributed by highly experienced, original authors of the seed articles. The collected data cover 76% of all unique PubMed Medical Subject Headings descriptors. No systematic biases were observed across different experience levels, research fields or time spent on annotations. More importantly, annotations of the same document pairs contributed by different scientists were highly concordant. We further show that the three representative baseline methods used to generate recommended articles for evaluation (Okapi Best Matching 25, Term Frequency-Inverse Document Frequency and PubMed Related Articles) had similar overall performances. Additionally, we found that these methods each tend to produce distinct collections of recommended articles, suggesting that a hybrid method may be required to completely capture all relevant articles. The established database server located at https://relishdb.ict.griffith.edu.au is freely available for the downloading of annotation data and the blind testing of new methods. We expect that this benchmark will be useful for stimulating the development of new powerful techniques for title and title/abstract-based search engines for relevant articles in biomedical research.Peer reviewe

Finishing the euchromatic sequence of the human genome

The sequence of the human genome encodes the genetic instructions for human physiology, as well as rich information about human evolution. In 2001, the International Human Genome Sequencing Consortium reported a draft sequence of the euchromatic portion of the human genome. Since then, the international collaboration has worked to convert this draft into a genome sequence with high accuracy and nearly complete coverage. Here, we report the result of this finishing process. The current genome sequence (Build 35) contains 2.85 billion nucleotides interrupted by only 341 gaps. It covers ∼99% of the euchromatic genome and is accurate to an error rate of ∼1 event per 100,000 bases. Many of the remaining euchromatic gaps are associated with segmental duplications and will require focused work with new methods. The near-complete sequence, the first for a vertebrate, greatly improves the precision of biological analyses of the human genome including studies of gene number, birth and death. Notably, the human enome seems to encode only 20,000-25,000 protein-coding genes. The genome sequence reported here should serve as a firm foundation for biomedical research in the decades ahead

Measurement of forward charged hadron flow harmonics in peripheral PbPb collisions at √sNN = 5.02 TeV with the LHCb detector

Flow harmonic coefficients, v n , which are the key to studying the hydrodynamics of the quark-gluon plasma (QGP) created in heavy-ion collisions, have been measured in various collision systems and kinematic regions and using various particle species. The study of flow harmonics in a wide pseudorapidity range is particularly valuable to understand the temperature dependence of the shear viscosity to entropy density ratio of the QGP. This paper presents the first LHCb results of the second- and the third-order flow harmonic coefficients of charged hadrons as a function of transverse momentum in the forward region, corresponding to pseudorapidities between 2.0 and 4.9, using the data collected from PbPb collisions in 2018 at a center-of-mass energy of 5.02 TeV . The coefficients measured using the two-particle angular correlation analysis method are smaller than the central-pseudorapidity measurements at ALICE and ATLAS from the same collision system but share similar features

Study of CP violation in B0 → DK⋆(892)0 decays with D → Kπ(ππ), ππ(ππ), and KK final states

A measurement of CP-violating observables associated with the interference of B0 → D0K⋆ (892)0 and B0 → D¯ 0K⋆ (892)0 decay amplitudes is performed in the D0 → K∓π ±(π +π −), D0 → π +π −(π +π −), and D0 → K+K− fnal states using data collected by the LHCb experiment corresponding to an integrated luminosity of 9 fb−1 . CP-violating observables related to the interference of B0 s → D0K¯ ⋆ (892)0 and B0 s → D¯ 0K¯ ⋆ (892)0 are also measured, but no evidence for interference is found. The B0 observables are used to constrain the parameter space of the CKM angle γ and the hadronic parameters r DK⋆ B0 and δ DK⋆ B0 with inputs from other measurements. In a combined analysis, these measurements allow for four solutions in the parameter space, only one of which is consistent with the world average

Experimental research on Chinese antique buildings with dual-lintel-column joint of steel and composite structures

In order to study the mechanical behavior of Chinese traditional style architecture dual-lintel-column joint, a typical Chinese traditional style architecture dual-lintel-column joint was selected as the model structure. Two specimens with viscous damper and one specimen without viscous damper were designed and tested under fast harmonic load. On the basis of experimental study, the key indexes of mechanical properties are analyzed, such as the load–displacement hysteretic curve of specimens and viscous damper, skeleton curve, and load-bearing capacity. The results indicate that mechanical properties of antique buildings dual-lintel-column subassemblages with steel and composite structures and viscous damper can significantly increase the mechanical properties. The hysteretic curve of the damping joint is plump. The descending phase of skeleton curves is smoother. The carrying capacity is increased by 13.9%–14.1%, and displacement ductility is increased by 13.0%–18.6%. The viscous damper and the dual-lintel-column subassemblages work together. They significantly improve the deformation performance of structures at the failure stage and enhance the collapse resistance of the structure. The study of traditional architecture can also provide valuable insights into the development of structural engineering and construction technology. Also, people can learn the wisdom and experience of ancestors and apply it to modern engineering practices

Characterization and efficacy of C60 nano-photosensitive drugs in colorectal cancer treatment

Background: Fullerenes C60 shows great potential for drug transport. C60 generates large amounts of singlet oxygen upon photoexcitation, which has a significant inhibitory effect on tumor cells, so the photosensitive properties of C60 were exploited for photodynamic therapy of tumors by laser irradiation. Methods: In this study, C60-NH2 was functionalized by introducing amino acids on the surface of C60, coupled with 5-FU to obtain C60 amino acid-derived drugs (C60AF, C60GF, C60LF), and activated photosensitive drugs (C60AFL, C60GFL, C60LFL) were obtained by laser irradiation. The C60 nano-photosensitive drugs were characterized in various ways, and the efficacy and safety of C60 nano-photosensitive drugs were verified by cellular experiments and animal experiments. Bioinformatics methods and cellular experiments were used to confirm the photosensitive drug targets and verify the therapeutic targets with C60AF. Results: Photosensitised tumor-targeted drug delivery effectively crosses cell membranes, leads to more apoptotic cell death, and provides higher anti-tumor efficacy and safety in vitro and in vivo colorectal cancer pharmacodynamic assays compared to free 5-FU.C60 photosensitized drug promotes tumor killing by inhibiting the colorectal cancer FLOR1 tumor protein target, with no significant toxic effects on normal organs. Conclusion: C60 photosensitized drug delivery systems are expected to improve efficacy and reduce side effects in the future treatment of colorectal cancer. Further and better development and design of drugs and vectors for colorectal cancer therapy

Photo-degradation of cypermethrin in aqueous solution studied by HPLC-DAD

Conference Name:2012 2nd International Conference on Chemical, Material and Metallurgical Engineering, ICCMME 2012. Conference Address: Kunming, China. Time:December 15, 2012 - December 16, 2012.The photo-degradation process of cypermethrin in aqueous solution was studied using the laboratory-built photochemical degradation device and commercial high performance liquid chromatography (HPLC) with ultraviolet-visible absorbance detector and mass spectrometric detector. Spectrometric characteristics of cypermethrin and its main degradation products suggest that cypermethrin could be photo-degradated and converted into smaller molecular under ultraviolet irradiation. The photo-degradation reaction of cypermethrin in aqueous solution is approximately pseudo-first-order reaction. Light strength, pH and salinity have significant effects on the photo-degradaiton reaction of cypermethrin. Mass spectrometric results show that cypermethrin pesticide can be degraded into new and easily photochemical degrading products through the removal of chlorine. ? (2013) Trans Tech Publications, Switzerland

Laboratory simulation study of photo- degradation process of fenvalerate in aqueous solution

Conference Name:International Conference on Electrical Information and Mechatronics, ICEIM 2012. Conference Address: Jiaozuo, China. Time:December 23, 2012 - December 25, 2012.Chinese Academy of Science; Society of Intelligent Aerospace Systems, China; Linear Motor Committees of China Electrotechnical Society; Zhejiang University; Beihang UniversityA laboratory-made the efficient photochemical degradation experimental device, combined with high performance liquid chromatography-tandem diode array detector device (DAD), fluorescence detector (FLD), mass spectrometer detector (MS), research fenvalerate its photo degradation. The structure of the spectral characteristics is the product, photo degradation reaction kinetics of degradation products, suggesting fenvalerate light chemical degradation process in an aqueous solution. The spectral characteristics of fenvalerate under ultraviolet light can be degraded into smaller organic molecules; maternal and main product have strong UV - visible absorption, fenvalerate are weakly fluorescent substance in the aqueous solution. The major products are strong fluorescent substance. Almost no effect The photo degradation kinetic data show fenvalerate photo degradation in an aqueous solution to approximate a reaction of the reaction; pesticide initial concentration, the pH value of the aqueous solution of pesticides photo degradation reaction rate; To accelerate the increase of salinity, light intensity fenvalerate in aqueous photo degradation reaction rate; significant influence of small organic molecules, with the type of small organic molecules. ? (2013) Trans Tech Publications, Switzerland

Optimizing Metallographic Etchants for Ancient Gold and Silver Materials

In recent years, with the excavation of an increasing amount of gold and silver artifacts, there has been an urgent need to optimize the formulations and methods of metallographic etching. Herein, a kinetic control study is performed to investigate the mechanisms leading to poor results when etching ancient gold materials with aqua regia, i.e., when secondary AgCl impurities form during the etching of the sample surface. To this end, a concentrated ammonia and sodium thiosulfate solution is used to dissolve AgCl impurities and obtain high-quality metallographic images of ancient gold materials using a coordination reaction to generate stable free-state coordination ions from Ag+. On this basis, a ferric chloride + sodium thiosulfate method is proposed to optimize the formulation of the etchant for ancient silver materials. The formulation is efficient, safe and easy to handle, and solves the problems of the easy failure of the commonly used etchant of ammonia + hydrogen peroxide and the complicated preparation process of acidified potassium dichromate while maintaining the long-term stability of the etched Ag–Cu alloy samples