1,635 research outputs found

    Revisiting the Parameter Efficiency of Adapters from the Perspective of Precision Redundancy

    Full text link
    Current state-of-the-art results in computer vision depend in part on fine-tuning large pre-trained vision models. However, with the exponential growth of model sizes, the conventional full fine-tuning, which needs to store a individual network copy for each tasks, leads to increasingly huge storage and transmission overhead. Adapter-based Parameter-Efficient Tuning (PET) methods address this challenge by tuning lightweight adapters inserted into the frozen pre-trained models. In this paper, we investigate how to make adapters even more efficient, reaching a new minimum size required to store a task-specific fine-tuned network. Inspired by the observation that the parameters of adapters converge at flat local minima, we find that adapters are resistant to noise in parameter space, which means they are also resistant to low numerical precision. To train low-precision adapters, we propose a computational-efficient quantization method which minimizes the quantization error. Through extensive experiments, we find that low-precision adapters exhibit minimal performance degradation, and even 1-bit precision is sufficient for adapters. The experimental results demonstrate that 1-bit adapters outperform all other PET methods on both the VTAB-1K benchmark and few-shot FGVC tasks, while requiring the smallest storage size. Our findings show, for the first time, the significant potential of quantization techniques in PET, providing a general solution to enhance the parameter efficiency of adapter-based PET methods. Code: https://github.com/JieShibo/PETL-ViTComment: Accepted to ICCV 202

    Computed tomography imaging of early coronary artery lesions in stable individuals with multiple cardiovascular risk factors

    Get PDF
    OBJECTIVES: To investigate the prevalence, extent, severity, and features of coronary artery lesions in stable patients with multiple cardiovascular risk factors. METHODS: Seventy-seven patients with more than 3 cardiovascular risk factors were suspected of having coronary artery disease. Patients with high-risk factors and 39 controls with no risk factors were enrolled in the study. The related risk factors included hypertension, impaired glucose tolerance, dyslipidemia, smoking history, and overweight. The characteristics of coronary lesions were identified and evaluated by 64-slice coronary computed tomography angiography. RESULTS: The incidence of coronary atherosclerosis was higher in the high-risk group than in the no-risk group. The involved branches of the coronary artery, the diffusivity of the lesion, the degree of stenosis, and the nature of the plaques were significantly more severe in the high-risk group compared with the no-risk group (all p < 0.05). CONCLUSION: Among stable individuals with high-risk factors, early coronary artery lesions are common and severe. Computed tomography has promising value for the early screening of coronary lesions

    Individual position diversity in dependence socioeconomic networks increases economic output

    Full text link
    The availability of big data recorded from massively multiplayer online role-playing games (MMORPGs) allows us to gain a deeper understanding of the potential connection between individuals' network positions and their economic outputs. We use a statistical filtering method to construct dependence networks from weighted friendship networks of individuals. We investigate the 30 distinct motif positions in the 13 directed triadic motifs which represent microscopic dependences among individuals. Based on the structural similarity of motif positions, we further classify individuals into different groups. The node position diversity of individuals is found to be positively correlated with their economic outputs. We also find that the economic outputs of leaf nodes are significantly lower than that of the other nodes in the same motif. Our findings shed light on understanding the influence of network structure on economic activities and outputs in socioeconomic system.Comment: 19 pages, 5 figure

    Microsatellite and mitochondrial DNA analysis of the genetic structure of Chinese horseshoe crab (Tachypleus tridentatus) in southeast China coast

    Get PDF
    Chinese horseshoe crab (Tachypleus tridentatus) is a Xiphosura animal of significant commercial importance and in danger of extinction in China. To better estimate how genetic structure can be used to obtain a conservation perspective of the species, genetic variation was examined in nine locations covering its distributing range in the coast of Chinese mainland using ten nuclear microsatellite DNA loci and mitochondrial DNA control region (CR) sequences. Moderate levels of genetic diversity were detected (expected heterozygosity from microsatellites was 0.635, haplotype diversity from mitochondrial DNA was 0.800) as a whole. Significant genetic differentiation was detected only by mitochondrial DNA (FST = 0.0693, P &lt; 0.01), while microsatellite markers indicated nuclear genetic homogeneity of these locations. Probably, nuclear genetic homogeneity was caused by outbreeding among different groups due to artificial transporting. Very weak genetic differentiation indicates that reintroduction programs of the movement and mixing of horseshoe crab from different locations will result in minimal negative genetic effects. Upon four management units were inferred from the results of CR analysis, accordingly four or more nature reserves should be established to conserve this endangered animal along the Chinese coast. Haplotype network pattern indicated that T. tridentatus population in Chinese coast has undergone historic population expansion and very recent historic population recession. Mismatch distributions analysis also revealed existence of historic demographic expansion.Keywords: Tachypleus tridentatus, microsatellites, mitochondrial DNA, population structure, genetic diversityAfrican Journal of Biotechnology Vol. 12(16), pp. 2088-209
    corecore