1,635 research outputs found
Revisiting the Parameter Efficiency of Adapters from the Perspective of Precision Redundancy
Current state-of-the-art results in computer vision depend in part on
fine-tuning large pre-trained vision models. However, with the exponential
growth of model sizes, the conventional full fine-tuning, which needs to store
a individual network copy for each tasks, leads to increasingly huge storage
and transmission overhead. Adapter-based Parameter-Efficient Tuning (PET)
methods address this challenge by tuning lightweight adapters inserted into the
frozen pre-trained models. In this paper, we investigate how to make adapters
even more efficient, reaching a new minimum size required to store a
task-specific fine-tuned network. Inspired by the observation that the
parameters of adapters converge at flat local minima, we find that adapters are
resistant to noise in parameter space, which means they are also resistant to
low numerical precision. To train low-precision adapters, we propose a
computational-efficient quantization method which minimizes the quantization
error. Through extensive experiments, we find that low-precision adapters
exhibit minimal performance degradation, and even 1-bit precision is sufficient
for adapters. The experimental results demonstrate that 1-bit adapters
outperform all other PET methods on both the VTAB-1K benchmark and few-shot
FGVC tasks, while requiring the smallest storage size. Our findings show, for
the first time, the significant potential of quantization techniques in PET,
providing a general solution to enhance the parameter efficiency of
adapter-based PET methods. Code: https://github.com/JieShibo/PETL-ViTComment: Accepted to ICCV 202
Computed tomography imaging of early coronary artery lesions in stable individuals with multiple cardiovascular risk factors
OBJECTIVES: To investigate the prevalence, extent, severity, and features of coronary artery lesions in stable patients with multiple cardiovascular risk factors. METHODS: Seventy-seven patients with more than 3 cardiovascular risk factors were suspected of having coronary artery disease. Patients with high-risk factors and 39 controls with no risk factors were enrolled in the study. The related risk factors included hypertension, impaired glucose tolerance, dyslipidemia, smoking history, and overweight. The characteristics of coronary lesions were identified and evaluated by 64-slice coronary computed tomography angiography. RESULTS: The incidence of coronary atherosclerosis was higher in the high-risk group than in the no-risk group. The involved branches of the coronary artery, the diffusivity of the lesion, the degree of stenosis, and the nature of the plaques were significantly more severe in the high-risk group compared with the no-risk group (all p < 0.05). CONCLUSION: Among stable individuals with high-risk factors, early coronary artery lesions are common and severe. Computed tomography has promising value for the early screening of coronary lesions
Individual position diversity in dependence socioeconomic networks increases economic output
The availability of big data recorded from massively multiplayer online
role-playing games (MMORPGs) allows us to gain a deeper understanding of the
potential connection between individuals' network positions and their economic
outputs. We use a statistical filtering method to construct dependence networks
from weighted friendship networks of individuals. We investigate the 30
distinct motif positions in the 13 directed triadic motifs which represent
microscopic dependences among individuals. Based on the structural similarity
of motif positions, we further classify individuals into different groups. The
node position diversity of individuals is found to be positively correlated
with their economic outputs. We also find that the economic outputs of leaf
nodes are significantly lower than that of the other nodes in the same motif.
Our findings shed light on understanding the influence of network structure on
economic activities and outputs in socioeconomic system.Comment: 19 pages, 5 figure
Microsatellite and mitochondrial DNA analysis of the genetic structure of Chinese horseshoe crab (Tachypleus tridentatus) in southeast China coast
Chinese horseshoe crab (Tachypleus tridentatus) is a Xiphosura animal of significant commercial importance and in danger of extinction in China. To better estimate how genetic structure can be used to obtain a conservation perspective of the species, genetic variation was examined in nine locations covering its distributing range in the coast of Chinese mainland using ten nuclear microsatellite DNA loci and mitochondrial DNA control region (CR) sequences. Moderate levels of genetic diversity were detected (expected heterozygosity from microsatellites was 0.635, haplotype diversity from mitochondrial DNA was 0.800) as a whole. Significant genetic differentiation was detected only by mitochondrial DNA (FST = 0.0693, P < 0.01), while microsatellite markers indicated nuclear genetic homogeneity of these locations. Probably, nuclear genetic homogeneity was caused by outbreeding among different groups due to artificial transporting. Very weak genetic differentiation indicates that reintroduction programs of the movement and mixing of horseshoe crab from different locations will result in minimal negative genetic effects. Upon four management units were inferred from the results of CR analysis, accordingly four or more nature reserves should be established to conserve this endangered animal along the Chinese coast. Haplotype network pattern indicated that T. tridentatus population in Chinese coast has undergone historic population expansion and very recent historic population recession. Mismatch distributions analysis also revealed existence of historic demographic expansion.Keywords: Tachypleus tridentatus, microsatellites, mitochondrial DNA, population structure, genetic diversityAfrican Journal of Biotechnology Vol. 12(16), pp. 2088-209
- …