52 research outputs found

    CIEM: Contrastive Instruction Evaluation Method for Better Instruction Tuning

    Full text link
    Nowadays, the research on Large Vision-Language Models (LVLMs) has been significantly promoted thanks to the success of Large Language Models (LLM). Nevertheless, these Vision-Language Models (VLMs) are suffering from the drawback of hallucination -- due to insufficient understanding of vision and language modalities, VLMs may generate incorrect perception information when doing downstream applications, for example, captioning a non-existent entity. To address the hallucination phenomenon, on the one hand, we introduce a Contrastive Instruction Evaluation Method (CIEM), which is an automatic pipeline that leverages an annotated image-text dataset coupled with an LLM to generate factual/contrastive question-answer pairs for the evaluation of the hallucination of VLMs. On the other hand, based on CIEM, we further propose a new instruction tuning method called CIT (the abbreviation of Contrastive Instruction Tuning) to alleviate the hallucination of VLMs by automatically producing high-quality factual/contrastive question-answer pairs and corresponding justifications for model tuning. Through extensive experiments on CIEM and CIT, we pinpoint the hallucination issues commonly present in existing VLMs, the disability of the current instruction-tuning dataset to handle the hallucination phenomenon and the superiority of CIT-tuned VLMs over both CIEM and public datasets

    Context-Aware Prompt Tuning for Vision-Language Model with Dual-Alignment

    Full text link
    Large-scale vision-language models (VLMs), e.g., CLIP, learn broad visual concepts from tedious training data, showing superb generalization ability. Amount of prompt learning methods have been proposed to efficiently adapt the VLMs to downstream tasks with only a few training samples. We introduce a novel method to improve the prompt learning of vision-language models by incorporating pre-trained large language models (LLMs), called Dual-Aligned Prompt Tuning (DuAl-PT). Learnable prompts, like CoOp, implicitly model the context through end-to-end training, which are difficult to control and interpret. While explicit context descriptions generated by LLMs, like GPT-3, can be directly used for zero-shot classification, such prompts are overly relying on LLMs and still underexplored in few-shot domains. With DuAl-PT, we propose to learn more context-aware prompts, benefiting from both explicit and implicit context modeling. To achieve this, we introduce a pre-trained LLM to generate context descriptions, and we encourage the prompts to learn from the LLM's knowledge by alignment, as well as the alignment between prompts and local image features. Empirically, DuAl-PT achieves superior performance on 11 downstream datasets on few-shot recognition and base-to-new generalization. Hopefully, DuAl-PT can serve as a strong baseline. Code will be available

    Solar Flare Intensity Prediction With Machine Learning Models

    Full text link
    We develop a mixed long short‐term memory (LSTM) regression model to predict the maximum solar flare intensity within a 24‐hr time window 0–24, 6–30, 12–36, and 24–48 hr ahead of time using 6, 12, 24, and 48 hr of data (predictors) for each Helioseismic and Magnetic Imager (HMI) Active Region Patch (HARP). The model makes use of (1) the Space‐Weather HMI Active Region Patch (SHARP) parameters as predictors and (2) the exact flare intensities instead of class labels recorded in the Geostationary Operational Environmental Satellites (GOES) data set, which serves as the source of the response variables. Compared to solar flare classification, the model offers us more detailed information about the exact maximum flux level, that is, intensity, for each occurrence of a flare. We also consider classification models built on top of the regression model and obtain better results in solar flare classifications as compared to Chen et al. (2019, https://doi.org/10.1029/2019SW002214). Our results suggest that the most efficient time period for predicting the solar activity is within 24 hr before the prediction time using the SHARP parameters and the LSTM model.Key PointsWe develop deep learning models to predict solar flare intensity values instead of flare classes from SHARP parameters in SDO/HMI data set directlyWe use time‐series information from both flaring time and nonflaring time in our modelAs opposed to solar flare classification, directly predicting solar flare intensity gives more detailed information about every occurrence of flares of each classPeer Reviewedhttp://deepblue.lib.umich.edu/bitstream/2027.42/156246/2/swe21001_am.pdfhttp://deepblue.lib.umich.edu/bitstream/2027.42/156246/1/swe21001.pd

    Soybean Breeding on Seed Composition Trait

    Get PDF
    Soybean is a most important crop providing edible oil and plant protein source for human beings, in addition to animal feed because of high protein and oil content. This review summarized the progresses in the QTL mapping, candidate gene cloning and functional analysis and also the regulation of soybean oil and seed storage protein accumulation. Furthermore, as soybean genome has been sequenced and released, prospects of multiple omics and advanced biotechnology should be combined and applied for further refine research and high-quality breeding

    Identification of Major QTLs Associated With First Pod Height and Candidate Gene Mining in Soybean

    Get PDF
    First pod height (FPH) is a quantitative trait in soybean [Glycine max (L.) Merr.] that affects mechanized harvesting. A compatible combination of the FPH and the mechanized harvester is required to ensure that the soybean is efficiently harvested. In this study, 147 recombinant inbred lines, which were derived from a cross between ‘Dongnong594’ and ‘Charleston’ over 8 years, were used to identify the major quantitative trait loci (QTLs) associated with FPH. Using a composite interval mapping method with WinQTLCart (version 2.5), 11 major QTLs were identified. They were distributed on five soybean chromosomes, and 90 pairs of QTLs showed significant epistatic associates with FPH. Of these, 3 were main QTL × main QTL interactions, and 12 were main QTL × non-main QTL interactions. A KEGG gene annotation of the 11 major QTL intervals revealed 8 candidate genes related to plant growth, appearing in the pathways K14486 (auxin response factor 9), K14498 (serine/threonine-protein kinase), and K13946 (transmembrane amino acid transporter family protein), and 7 candidate genes had high expression levels in the soybean stems. These results will aid in building a foundation for the fine mapping of the QTLs related to FPH and marker-assisted selection for breeding in soybean

    Assessing the carcinogenic potential of low-dose exposures to chemical mixtures in the environment: the challenge ahead.

    Get PDF
    Lifestyle factors are responsible for a considerable portion of cancer incidence worldwide, but credible estimates from the World Health Organization and the International Agency for Research on Cancer (IARC) suggest that the fraction of cancers attributable to toxic environmental exposures is between 7% and 19%. To explore the hypothesis that low-dose exposures to mixtures of chemicals in the environment may be combining to contribute to environmental carcinogenesis, we reviewed 11 hallmark phenotypes of cancer, multiple priority target sites for disruption in each area and prototypical chemical disruptors for all targets, this included dose-response characterizations, evidence of low-dose effects and cross-hallmark effects for all targets and chemicals. In total, 85 examples of chemicals were reviewed for actions on key pathways/mechanisms related to carcinogenesis. Only 15% (13/85) were found to have evidence of a dose-response threshold, whereas 59% (50/85) exerted low-dose effects. No dose-response information was found for the remaining 26% (22/85). Our analysis suggests that the cumulative effects of individual (non-carcinogenic) chemicals acting on different pathways, and a variety of related systems, organs, tissues and cells could plausibly conspire to produce carcinogenic synergies. Additional basic research on carcinogenesis and research focused on low-dose effects of chemical mixtures needs to be rigorously pursued before the merits of this hypothesis can be further advanced. However, the structure of the World Health Organization International Programme on Chemical Safety 'Mode of Action' framework should be revisited as it has inherent weaknesses that are not fully aligned with our current understanding of cancer biology

    Assessing the carcinogenic potential of low-dose exposures to chemical mixtures in the environment: the challenge ahead

    Get PDF
    Lifestyle factors are responsible for a considerable portion of cancer incidence worldwide, but credible estimates from the World Health Organization and the International Agency for Research on Cancer (IARC) suggest that the fraction of cancers attributable to toxic environmental exposures is between 7% and 19%. To explore the hypothesis that low-dose exposures to mixtures of chemicals in the environment may be combining to contribute to environmental carcinogenesis, we reviewed 11 hallmark phenotypes of cancer, multiple priority target sites for disruption in each area and prototypical chemical disruptors for all targets, this included dose-response characterizations, evidence of low-dose effects and cross-hallmark effects for all targets and chemicals. In total, 85 examples of chemicals were reviewed for actions on key pathways/mechanisms related to carcinogenesis. Only 15% (13/85) were found to have evidence of a dose-response threshold, whereas 59% (50/85) exerted low-dose effects. No dose-response information was found for the remaining 26% (22/85). Our analysis suggests that the cumulative effects of individual (non-carcinogenic) chemicals acting on different pathways, and a variety of related systems, organs, tissues and cells could plausibly conspire to produce carcinogenic synergies. Additional basic research on carcinogenesis and research focused on low-dose effects of chemical mixtures needs to be rigorously pursued before the merits of this hypothesis can be further advanced. However, the structure of the World Health Organization International Programme on Chemical Safety ‘Mode of Action’ framework should be revisited as it has inherent weaknesses that are not fully aligned with our current understanding of cancer biology

    Investigation on a No Trial Weight Spray Online Dynamic Balancer

    No full text
    In order to suppress the spindle vibration with high efficiency and high precision, a no without trial weight spray online balance method is proposed in this paper. By analyzing the relationship between the unbalanced excitation and the unbalanced response of the spindle, the relationship between the dynamic influence coefficient and the system model is studied. A high-speed spindle finite element analysis model was established, and the dynamic influence coefficient matrix was identified. A no trial weight spray online dynamic balancing system was developed, which has the advantages of without trial weight and high-precision loading. A new type of integrated balancing terminal that was formed using 3D printing technology was first proposed by our research group, and its advantages in various aspects are significantly higher than traditional assembly balanced terminals. The experimental verification of the without trial weight spray online dynamic balancing system was performed on a high-speed spindle test stand. Experiments show that the no trial weight spray online balancing method proposed in this paper can achieve high-efficiency and high-precision vibration suppression, greatly reducing balance time and cost of the spindle. At the same time, the online balance test also verified the reliability of the integrated balanced terminal
    corecore