Task Residual for Tuning Vision-Language Models

Large-scale vision-language models (VLMs) pre-trained on billion-level data have learned general visual representations and broad visual concepts. In principle, the well-learned knowledge structure of the VLMs should be inherited appropriately when being transferred to downstream tasks with limited data. However, most existing efficient transfer learning (ETL) approaches for VLMs either damage or are excessively biased towards the prior knowledge, e.g., prompt tuning (PT) discards the pre-trained text-based classifier and builds a new one while adapter-style tuning (AT) fully relies on the pre-trained features. To address this, we propose a new efficient tuning approach for VLMs named Task Residual Tuning (TaskRes), which performs directly on the text-based classifier and explicitly decouples the prior knowledge of the pre-trained models and new knowledge regarding a target task. Specifically, TaskRes keeps the original classifier weights from the VLMs frozen and obtains a new classifier for the target task by tuning a set of prior-independent parameters as a residual to the original one, which enables reliable prior knowledge preservation and flexible task-specific knowledge exploration. The proposed TaskRes is simple yet effective, which significantly outperforms previous ETL methods (e.g., PT and AT) on 11 benchmark datasets while requiring minimal effort for the implementation. Our code is available at https://github.com/geekyutao/TaskRes.Comment: Accepted to CVPR 202

GraphAdapter: Tuning Vision-Language Models With Dual Knowledge Graph

Adapter-style efficient transfer learning (ETL) has shown excellent performance in the tuning of vision-language models (VLMs) under the low-data regime, where only a few additional parameters are introduced to excavate the task-specific knowledge based on the general and powerful representation of VLMs. However, most adapter-style works face two limitations: (i) modeling task-specific knowledge with a single modality only; and (ii) overlooking the exploitation of the inter-class relationships in downstream tasks, thereby leading to sub-optimal solutions. To mitigate that, we propose an effective adapter-style tuning strategy, dubbed GraphAdapter, which performs the textual adapter by explicitly modeling the dual-modality structure knowledge (i.e., the correlation of different semantics/classes in textual and visual modalities) with a dual knowledge graph. In particular, the dual knowledge graph is established with two sub-graphs, i.e., a textual knowledge sub-graph, and a visual knowledge sub-graph, where the nodes and edges represent the semantics/classes and their correlations in two modalities, respectively. This enables the textual feature of each prompt to leverage the task-specific structure knowledge from both textual and visual modalities, yielding a more effective classifier for downstream tasks. Extensive experimental results on 11 benchmark datasets reveal that our GraphAdapter significantly outperforms previous adapter-based methods. The code will be released at https://github.com/lixinustc/GraphAdapterComment: Accepted by NeurIPS 2023. The manuscript will be further revised based on the review

Cosmic Radio Background from Primordial Black Holes at Cosmic Dawn

The presence of an extra radio background besides the cosmic microwave background has important implications for the observation of the 21-cm signal during the cosmic Dark Ages, Cosmic Dawn, and epoch of Reionization. The strong absorption trough found in the 21-cm global spectrum measured by the EDGES experiment, which has a much greater depth than the standard model prediction, has drawn great interest to this scenario, but more generally it is still of great interest to consider such a cosmic radio background (CRB) in the early Universe. To be effective in affecting the 21-cm signal at early time, such a radio background must be produced by sources which can emit strong radio signals but modest amount of X-rays, so that the gas is not heated up too early. We investigate the scenario that such a radio background is produced by the primordial black holes (PBHs). For PBH with a single mass, we find that if the PBHs' abundance $\log(f_{\rm PBH})$ (ratio of total PBH mass density to total matter density) and mass satisfy the relation $\log(f_{\rm PBH}) \sim -1.8\log(M_\bullet/{\rm M}_{\odot})-3.5$ for $1\,{\rm M}_\odot \lesssim M_\bullet \lesssim 300 {\rm M}_\odot$, and have jet emission, they can generate a CRB required for reproducing the 21-cm absorption signal seen by the EDGES. The accretion rate can be boosted if the PBHs are surrounded by dark matter halos, which permits lower $f_{\rm PBH}$ value to satisfy the EDGES observation. In the latter scenario, since the accretion rate can evolve rapidly during the Cosmic Dawn, the frequency (redshift) and depth of the absorption trough can determine the mass and abundance of the PBHs simultaneously. For absorption trough redshift $\sim$ 17 and depth $\sim -500$ mK, it corresponds to $M_\bullet \sim 1.05\,{\rm M}_{\odot}$ and $f_{\rm PBH}\sim 1.5\times10^{-4}$.Comment: 16 pages, 13 figures, accepted for publication in PR

Potential Application of Copper Aspirinate in Preventing and Treating Thromboembolic Diseases

The efficacy of copper aspirinate against thrombotic diseases has been tested in animal models. The results show that copper aspirinate, following ig pretreatment for 7 days at 0.012mmol/kg markedly prolonged the bleeding time and inhibited the mortality induced by arachidonic acid (AA) in mice. On cereral ischemia model pretreatment with 0.018mmol/kg copper aspirinate ig significantly increased survival of animals and the density of intact hippocampal CA1 cells and decreased brain calcium concentration. Its anticerebral ischemia activity was superior to or equal to nimodipine. It is, therefore, suggested that copper aspirinate is very promising in becoming an antithrombotic drug in preventing and treating thrombotic diseases

Cerebroprotective Effects of Dimeric Copper(II) Bis(o-acetoxybenzoate) on Ischemia-reperfusion Injury in Gerbils

The cerebroprotective effects of copper aspirinate [dimeric copper(II) bis(o-acetoxybenzoate)] were investigated in gerbils subjected to 10-min global cerebral ischemia followed b 60-min reperfusion. The results showed that intragastric copper aspirinate (7.5, 15.0 and 30.0 mg Kg−1) markedly promoted the recovery of the electroencephalogram amplitude, attenuated the increase of lipid peroxide content and the decrease of superoxide dismutase activity in the cortex during ischemia-reperfusion injury. It suggested that copper aspirinate possesses potential neuroprotective properties, the mechanism of which might be related to an increase of the activity of endogenous superoxide dismutase

Experimental investigation of the uncertainty principle for radial degrees of freedom

While the uncertainty principle for linear position and linear momentum, and more recently for angular position and angular momentum, is well established, its radial equivalent has so far eluded researchers. Here we exploit the logarithmic radial position, ln r , and hyperbolic momentum, P H , to formulate a rigorous uncertainty principle for the radial degree of freedom of transverse light modes. We show that the product of their uncertainties is bounded by Planck’s constant, Δ ln r · Δ P H ≥ ℏ / 2 , and identify a set of radial intelligent states that satisfy the equality. We illustrate the radial uncertainty principle for a variety of intelligent states, by preparing transverse light modes with suitable radial profiles. We use eigenmode projection to measure the corresponding hyperbolic momenta, confirming the minimum uncertainty bound. Optical systems are most naturally described in terms of cylindrical coordinates, and our radial uncertainty relation provides the missing piece in characterizing optical quantum measurements, providing a new platform for the fundamental tests and applications of quantum optics

Fibromodulin Reduces Scar Size and Increases Scar Tensile Strength in Normal and Excessive-Mechanical-Loading Porcine Cutaneous Wounds

Hypertrophic scarring is a major postoperative complication which leads to severe disfigurement and dysfunction in patients and usually requires multiple surgical revisions due to its high recurrence rates. Excessive-mechanical-loading across wounds is an important initiator of hypertrophic scarring formation. In this study, we demonstrate that intradermal administration of a single extracellular matrix (ECM) molecule—fibromodulin (FMOD) protein—can significantly reduce scar size, increase tensile strength, and improve dermal collagen architecture organization in the normal and even excessive-mechanical-loading red Duroc pig wound models. Since pig skin is recognized by the Food and Drug Administration as the closest animal equivalent to human skin, and because red Duroc pigs show scarring that closely resembles human proliferative scarring and hypertrophic scarring, FMOD-based technologies hold high translational potential and applicability to human patients suffering from scarring—especially hypertrophic scarring. © 2018 The Authors. Journal of Cellular and Molecular Medicine published by John Wiley & Sons Ltd and Foundation for Cellular and Molecular Medicine

Design of Reflective Intensity Modulated Fiber-Optic Sensor Based on TracePro and Taguchi Method

Abstract: Compare with traditional way of numerical simulation by establishing the mathematical model through geometry optic, we design a TracePro model to analyze the sensing process of reflective intensitymodulated fiber optic sensor base on ray tracing. This type of sensor has advantages over other fiber optic sensor, including simple structure, flexible design, reliable perform, low cost etc. In this paper, to design the reflective intensity modulated fiber optic sensor with concave reflected surface, TracePro software is used for modeling, TP modeling results are consistent with the existing conclusions show that the method is reasonably effectively, can improve the design efficiency. Meanwhile the Taguchi method is used to optimize coupling efficiency of receiving fiber in fiber optic displacement sensor design. Through optimizing three controllable factors the optimization configuration of A1B1C1 combinations is gain, presents a viable solution for the design of this sensor type