148 research outputs found
Task Residual for Tuning Vision-Language Models
Large-scale vision-language models (VLMs) pre-trained on billion-level data
have learned general visual representations and broad visual concepts. In
principle, the well-learned knowledge structure of the VLMs should be inherited
appropriately when being transferred to downstream tasks with limited data.
However, most existing efficient transfer learning (ETL) approaches for VLMs
either damage or are excessively biased towards the prior knowledge, e.g.,
prompt tuning (PT) discards the pre-trained text-based classifier and builds a
new one while adapter-style tuning (AT) fully relies on the pre-trained
features. To address this, we propose a new efficient tuning approach for VLMs
named Task Residual Tuning (TaskRes), which performs directly on the text-based
classifier and explicitly decouples the prior knowledge of the pre-trained
models and new knowledge regarding a target task. Specifically, TaskRes keeps
the original classifier weights from the VLMs frozen and obtains a new
classifier for the target task by tuning a set of prior-independent parameters
as a residual to the original one, which enables reliable prior knowledge
preservation and flexible task-specific knowledge exploration. The proposed
TaskRes is simple yet effective, which significantly outperforms previous ETL
methods (e.g., PT and AT) on 11 benchmark datasets while requiring minimal
effort for the implementation. Our code is available at
https://github.com/geekyutao/TaskRes.Comment: Accepted to CVPR 202
GraphAdapter: Tuning Vision-Language Models With Dual Knowledge Graph
Adapter-style efficient transfer learning (ETL) has shown excellent
performance in the tuning of vision-language models (VLMs) under the low-data
regime, where only a few additional parameters are introduced to excavate the
task-specific knowledge based on the general and powerful representation of
VLMs. However, most adapter-style works face two limitations: (i) modeling
task-specific knowledge with a single modality only; and (ii) overlooking the
exploitation of the inter-class relationships in downstream tasks, thereby
leading to sub-optimal solutions. To mitigate that, we propose an effective
adapter-style tuning strategy, dubbed GraphAdapter, which performs the textual
adapter by explicitly modeling the dual-modality structure knowledge (i.e., the
correlation of different semantics/classes in textual and visual modalities)
with a dual knowledge graph. In particular, the dual knowledge graph is
established with two sub-graphs, i.e., a textual knowledge sub-graph, and a
visual knowledge sub-graph, where the nodes and edges represent the
semantics/classes and their correlations in two modalities, respectively. This
enables the textual feature of each prompt to leverage the task-specific
structure knowledge from both textual and visual modalities, yielding a more
effective classifier for downstream tasks. Extensive experimental results on 11
benchmark datasets reveal that our GraphAdapter significantly outperforms
previous adapter-based methods. The code will be released at
https://github.com/lixinustc/GraphAdapterComment: Accepted by NeurIPS 2023. The manuscript will be further revised
based on the review
Cosmic Radio Background from Primordial Black Holes at Cosmic Dawn
The presence of an extra radio background besides the cosmic microwave
background has important implications for the observation of the 21-cm signal
during the cosmic Dark Ages, Cosmic Dawn, and epoch of Reionization. The strong
absorption trough found in the 21-cm global spectrum measured by the EDGES
experiment, which has a much greater depth than the standard model prediction,
has drawn great interest to this scenario, but more generally it is still of
great interest to consider such a cosmic radio background (CRB) in the early
Universe. To be effective in affecting the 21-cm signal at early time, such a
radio background must be produced by sources which can emit strong radio
signals but modest amount of X-rays, so that the gas is not heated up too
early. We investigate the scenario that such a radio background is produced by
the primordial black holes (PBHs). For PBH with a single mass, we find that if
the PBHs' abundance (ratio of total PBH mass density to
total matter density) and mass satisfy the relation for , and have jet emission, they can generate
a CRB required for reproducing the 21-cm absorption signal seen by the EDGES.
The accretion rate can be boosted if the PBHs are surrounded by dark matter
halos, which permits lower value to satisfy the EDGES
observation. In the latter scenario, since the accretion rate can evolve
rapidly during the Cosmic Dawn, the frequency (redshift) and depth of the
absorption trough can determine the mass and abundance of the PBHs
simultaneously. For absorption trough redshift 17 and depth
mK, it corresponds to and .Comment: 16 pages, 13 figures, accepted for publication in PR
Potential Application of Copper Aspirinate in Preventing and Treating Thromboembolic Diseases
The efficacy of copper aspirinate against thrombotic diseases has been tested
in animal models. The results show that copper aspirinate, following ig pretreatment
for 7 days at 0.012mmol/kg markedly prolonged the bleeding time and inhibited the
mortality induced by arachidonic acid (AA) in mice. On cereral ischemia model
pretreatment with 0.018mmol/kg copper aspirinate ig significantly increased
survival of animals and the density of intact hippocampal CA1 cells and decreased
brain calcium concentration. Its anticerebral ischemia activity was superior to or
equal to nimodipine. It is, therefore, suggested that copper aspirinate is very promising
in becoming an antithrombotic drug in preventing and treating thrombotic diseases
Cerebroprotective Effects of Dimeric Copper(II) Bis(o-acetoxybenzoate) on Ischemia-reperfusion Injury in Gerbils
The cerebroprotective effects of copper aspirinate [dimeric copper(II) bis(o-acetoxybenzoate)] were
investigated in gerbils subjected to 10-min global cerebral ischemia followed b 60-min reperfusion. The
results showed that intragastric copper aspirinate (7.5, 15.0 and 30.0 mg Kg−1) markedly promoted the
recovery of the electroencephalogram amplitude, attenuated the increase of lipid peroxide content and the
decrease of superoxide dismutase activity in the cortex during ischemia-reperfusion injury. It suggested that
copper aspirinate possesses potential neuroprotective properties, the mechanism of which might be related to
an increase of the activity of endogenous superoxide dismutase
Experimental investigation of the uncertainty principle for radial degrees of freedom
While the uncertainty principle for linear position and linear momentum, and more recently for angular position and angular momentum, is well established, its radial equivalent has so far eluded researchers. Here we exploit the logarithmic radial position, ln r , and hyperbolic momentum, P H , to formulate a rigorous uncertainty principle for the radial degree of freedom of transverse light modes. We show that the product of their uncertainties is bounded by Planck’s constant, Δ ln r · Δ P H ≥ ℏ / 2 , and identify a set of radial intelligent states that satisfy the equality. We illustrate the radial uncertainty principle for a variety of intelligent states, by preparing transverse light modes with suitable radial profiles. We use eigenmode projection to measure the corresponding hyperbolic momenta, confirming the minimum uncertainty bound. Optical systems are most naturally described in terms of cylindrical coordinates, and our radial uncertainty relation provides the missing piece in characterizing optical quantum measurements, providing a new platform for the fundamental tests and applications of quantum optics
Fibromodulin Reduces Scar Size and Increases Scar Tensile Strength in Normal and Excessive-Mechanical-Loading Porcine Cutaneous Wounds
Hypertrophic scarring is a major postoperative complication which leads to severe disfigurement and dysfunction in patients and usually requires multiple surgical revisions due to its high recurrence rates. Excessive-mechanical-loading across wounds is an important initiator of hypertrophic scarring formation. In this study, we demonstrate that intradermal administration of a single extracellular matrix (ECM) molecule—fibromodulin (FMOD) protein—can significantly reduce scar size, increase tensile strength, and improve dermal collagen architecture organization in the normal and even excessive-mechanical-loading red Duroc pig wound models. Since pig skin is recognized by the Food and Drug Administration as the closest animal equivalent to human skin, and because red Duroc pigs show scarring that closely resembles human proliferative scarring and hypertrophic scarring, FMOD-based technologies hold high translational potential and applicability to human patients suffering from scarring—especially hypertrophic scarring. © 2018 The Authors. Journal of Cellular and Molecular Medicine published by John Wiley & Sons Ltd and Foundation for Cellular and Molecular Medicine
Design of Reflective Intensity Modulated Fiber-Optic Sensor Based on TracePro and Taguchi Method
Abstract: Compare with traditional way of numerical simulation by establishing the mathematical model through geometry optic, we design a TracePro model to analyze the sensing process of reflective intensitymodulated fiber optic sensor base on ray tracing. This type of sensor has advantages over other fiber optic sensor, including simple structure, flexible design, reliable perform, low cost etc. In this paper, to design the reflective intensity modulated fiber optic sensor with concave reflected surface, TracePro software is used for modeling, TP modeling results are consistent with the existing conclusions show that the method is reasonably effectively, can improve the design efficiency. Meanwhile the Taguchi method is used to optimize coupling efficiency of receiving fiber in fiber optic displacement sensor design. Through optimizing three controllable factors the optimization configuration of A1B1C1 combinations is gain, presents a viable solution for the design of this sensor type
- …