48 research outputs found

    What Large Language Models Bring to Text-rich VQA?

    Full text link
    Text-rich VQA, namely Visual Question Answering based on text recognition in the images, is a cross-modal task that requires both image comprehension and text recognition. In this work, we focus on investigating the advantages and bottlenecks of LLM-based approaches in addressing this problem. To address the above concern, we separate the vision and language modules, where we leverage external OCR models to recognize texts in the image and Large Language Models (LLMs) to answer the question given texts. The whole framework is training-free benefiting from the in-context ability of LLMs. This pipeline achieved superior performance compared to the majority of existing Multimodal Large Language Models (MLLM) on four text-rich VQA datasets. Besides, based on the ablation study, we find that LLM brings stronger comprehension ability and may introduce helpful knowledge for the VQA problem. The bottleneck for LLM to address text-rich VQA problems may primarily lie in visual part. We also combine the OCR module with MLLMs and pleasantly find that the combination of OCR module with MLLM also works. It's worth noting that not all MLLMs can comprehend the OCR information, which provides insights into how to train an MLLM that preserves the abilities of LLM

    Accelerated Liâș Desolvation for Diffusion Booster Enabling Low‐Temperature Sulfur Redox Kinetics via Electrocatalytic Carbon‐Grazfted‐CoP Porous Nanosheets

    Get PDF
    Lithium–sulfur (Li–S) batteries are famous for their high energy density and low cost, but prevented by sluggish redox kinetics of sulfur species due to depressive Li ion diffusion kinetics, especially under low-temperature environment. Herein, a combined strategy of electrocatalysis and pore sieving effect is put forward to dissociate the Li+ solvation structure to stimulate the free Li+ diffusion, further improving sulfur redox reaction kinetics. As a protocol, an electrocatalytic porous diffusion-boosted nitrogen-doped carbon-grafted-CoP nanosheet is designed via forming the NCoP active structure to release more free Li+ to react with sulfur species, as fully investigated by electrochemical tests, theoretical simulations and in situ/ex situ characterizations. As a result, the cells with diffusion booster achieve desirable lifespan of 800 cycles at 2 C and excellent rate capability (775 mAh g−1 at 3 C). Impressively, in a condition of high mass loading or low-temperature environment, the cell with 5.7 mg cm−2 stabilizes an areal capacity of 3.2 mAh cm−2 and the charming capacity of 647 mAh g−1 is obtained under 0 °C after 80 cycles, demonstrating a promising route of providing more free Li ions toward practical high-energy Li–S batteries

    The 3rd Anti-UAV Workshop & Challenge: Methods and Results

    Full text link
    The 3rd Anti-UAV Workshop & Challenge aims to encourage research in developing novel and accurate methods for multi-scale object tracking. The Anti-UAV dataset used for the Anti-UAV Challenge has been publicly released. There are two main differences between this year's competition and the previous two. First, we have expanded the existing dataset, and for the first time, released a training set so that participants can focus on improving their models. Second, we set up two tracks for the first time, i.e., Anti-UAV Tracking and Anti-UAV Detection & Tracking. Around 76 participating teams from the globe competed in the 3rd Anti-UAV Challenge. In this paper, we provide a brief summary of the 3rd Anti-UAV Workshop & Challenge including brief introductions to the top three methods in each track. The submission leaderboard will be reopened for researchers that are interested in the Anti-UAV challenge. The benchmark dataset and other information can be found at: https://anti-uav.github.io/.Comment: Technical report for 3rd Anti-UAV Workshop and Challenge. arXiv admin note: text overlap with arXiv:2108.0990

    Chitosan-salvianolic acid B coating on the surface of nickel-titanium alloy inhibits proliferation of smooth muscle cells and promote endothelialization

    Get PDF
    Introduction: Intracranial stents are of paramount importance in managing cerebrovascular disorders. Nevertheless, the currently employed drug-eluting stents, although effective in decreasing in-stent restenosis, might impede the re-endothelialization process within blood vessels, potentially leading to prolonged thrombosis development and restenosis over time.Methods: This study aims to construct a multifunctional bioactive coating to enhance the biocompatibility of the stents. Salvianolic acid B (SALB), a bioactive compound extracted from Salvia miltiorrhiza, exhibits potential for improving cardiovascular health. We utilized dopamine as the base and adhered chitosan-coated SALB microspheres onto nickel-titanium alloy flat plates, resulting in a multifunctional drug coating.Results: By encapsulating SALB within chitosan, the release period of SALB was effectively prolonged, as evidenced by the in vitro drug release curve showing sustained release over 28 days. The interaction between the drug coating and blood was examined through experiments on water contact angle, clotting time, and protein adsorption. Cellular experiments showed that the drug coating stimulates the proliferation, adhesion, and migration of human umbilical vein endothelial cells.Discussion: These findings indicate its potential to promote re-endothelialization. In addition, the bioactive coating effectively suppressed smooth muscle cells proliferation, adhesion, and migration, potentially reducing the occurrence of neointimal hyperplasia and restenosis. These findings emphasize the exceptional biocompatibility of the newly developed bioactive coating and demonstrate its potential clinical application as an innovative strategy to improve stent therapy efficacy. Thus, this coating holds great promise for the treatment of cerebrovascular disease

    Orbital redistribution in molecular nanostructures mediated by metal-organic bonds

    Get PDF
    Dicyanovinyl-quinquethiophene (DCV5T-Me) is a prototype conjugated oligomer for highly efficient organic solar cells. This class of oligothiophenes are built up by an electron-rich donor (D) backbone and terminal electron-deficient acceptor (A) moieties. Here, we investigated its structural and electronic properties when it is adsorbed on a Au(111) surface using low temperature scanning tunneling microscopy/spectroscopy (STM/STS) and atomic force microscopy (AFM). We find that DCV5T-Me self-assembles in extended chains, stabilized by intercalated Au atoms. The effect of metal-ligand hybridization with Au adatoms causes an energetic downshift of the DCV5T-Me lowest unoccupied molecular orbital (LUMO) with respect to the uncoordinated molecules on the surface. The asymmetric coordination of a gold atom to only one molecular end group leads to an asymmetric localization of the LUMO and LUMO+1 states at opposite sides. Using model density functional theory (DFT) calculations, we explain such orbital reshaping as a consequence of linear combinations of the original LUMO and LUMO+1 orbitals, mixed by the attachment of a bridging Au adatom. Our study shows that the alignment of molecular orbitals and their distribution within individual molecules can be modified by contacting them to metal atoms in specific sites

    Lateral Buckling Theory and Experimental Study on Pipe-in-Pipe Structure

    No full text
    With the increasing depth of marine oil and gas exploitation, more requirements have been proposed on the structure of deep-sea oil pipelines. The influencing factors of lateral buckling of a pipe-in-pipe (PIP) structure containing initial imperfections and its critical force were investigated in this study by conducting an experiment, a finite element analysis, and a theoretical derivation. The change laws on the influence of initial imperfections of the PIP structure during thermal loading were revealed through an experimental study by using imperfection amplitude and wavelength as parameters. Appropriate finite element models were established, and the influences of initial imperfections, pipe-soil interaction, and the height and the number of centralizers on the global buckling critical force of the PIP structure were analyzed. The formulas of global buckling critical force of inner and outer pipes and that under pipe-soil interaction was obtained by using a theoretical derivation method. A comparative verification with experimental and finite element (FE) models result was conducted, which provided a corresponding basis for steel pipeline design

    A Rolling Bearing Fault Diagnosis-Optimized Scale-Space Representation for the Empirical Wavelet Transform

    No full text
    Rolling element bearings have been widely used in mechanical systems, such as electric motors, generators, pumps, gearboxes, railway axles, and turbines, etc. Therefore, the detection of rolling bearing faults has been a hot research topic in engineering practices. Envelope demodulation represents a fundamental method for extracting effective fault information from measured vibration signals. However, the performance of envelope demodulation depends heavily on the selection of the filter band and central frequencies. The empirical wavelet transform (EWT), a new signal decomposition method, provides a framework for arbitrarily segmenting the Fourier spectrum of an analysed signal. Scale-space representation (SSR) can adaptively detect the boundaries of the EWT; however, it has two shortcomings: slow calculation speeds and invalid boundary detection results. Accordingly, an EWT method based on optimized scale-space representation (OSSR), namely, the EWTOSSR, is proposed. The effectiveness of the EWTOSSR is verified by comparisons between the simulation and the experimental signals. The results show that the EWTOSSR can automatically and effectively segment the EWT spectrum to extract fault information. Compared with three well-known methods (the traditional EWT, ensemble empirical mode decomposition (EEMD), and the fast kurtogram), the EWTOSSR exhibits a much better fault detection performance

    Multi-objective Informative Frequency Band Selection Based on Negentropy-induced Grey Wolf Optimizer for Fault Diagnosis of Rolling Element Bearings

    No full text
    Informative frequency band (IFB) selection is a challenging task in envelope analysis for the localized fault detection of rolling element bearings. In previous studies, it was often conducted with a single indicator, such as kurtosis, etc., to guide the automatic selection. However, in some cases, it is difficult for that to fully depict and balance the fault characters from impulsiveness and cyclostationarity of the repetitive transients. To solve this problem, a novel negentropy-induced multi-objective optimized wavelet filter is proposed in this paper. The wavelet parameters are determined by a grey wolf optimizer with two independent objective functions i.e., maximizing the negentropy of squared envelope and squared envelope spectrum to capture impulsiveness and cyclostationarity, respectively. Subsequently, the average negentropy is utilized in identifying the IFB from the obtained Pareto set, which are non-dominated by other solutions to balance the impulsive and cyclostationary features and eliminate the background noise. Two cases of real vibration signals with slight bearing faults are applied in order to evaluate the performance of the proposed methodology, and the results demonstrate its effectiveness over some fast and optimal filtering methods. In addition, its stability in tracking the IFB is also tested by a case of condition monitoring data sets
    corecore