One Network, Many Masks: Towards More Parameter-Efficient Transfer Learning

Fine-tuning pre-trained language models for multiple tasks tends to be expensive in terms of storage. To mitigate this, parameter-efficient transfer learning (PETL) methods have been proposed to address this issue, but they still require a significant number of parameters and storage when being applied to broader ranges of tasks. To achieve even greater storage reduction, we propose PROPETL, a novel method that enables efficient sharing of a single PETL module which we call prototype network (e.g., adapter, LoRA, and prefix-tuning) across layers and tasks. We then learn binary masks to select different sub-networks from the shared prototype network and apply them as PETL modules into different layers. We find that the binary masks can determine crucial information from the network, which is often ignored in previous studies. Our work can also be seen as a type of pruning method, where we find that overparameterization also exists in the seemingly small PETL modules. We evaluate PROPETL on various downstream tasks and show that it can outperform other PETL methods with approximately 10% of the parameter storage required by the latter.Comment: Accepted by ACL 202

Meis Cofactors Control HDAC and CBP Accessibility at Hox-Regulated Promoters during Zebrafish Embryogenesis

SummaryHox proteins form complexes with Pbx and Meis cofactors to control gene expression, but the role of Meis is unclear. We demonstrate that Hoxb1-regulated promoters are highly acetylated on histone H4 (AcH4) and occupied by Hoxb1, Pbx, and Meis in zebrafish tissues where these promoters are active. Inhibition of Meis blocks gene expression and reduces AcH4 levels at these promoters, suggesting a role for Meis in maintaining AcH4. Within Hox transcription complexes, Meis binds directly to Pbx and we find that this binding displaces histone deacetylases (HDACs) from Hoxb1-regulated promoters in zebrafish embryos. Accordingly, Pbx mutants that cannot bind Meis act as repressors by recruiting HDACs and reducing AcH4 levels, while Pbx mutants that bind neither HDAC nor Meis are constitutively active and recruit CBP to increase AcH4 levels. We conclude that Meis acts, at least in part, by controlling access of HDAC and CBP to Hox-regulated promoters

Msk is required for nuclear import of TGF-{beta}/BMP-activated Smads

Nuclear translocation of Smad proteins is a critical step in signal transduction of transforming growth factor beta (TGF-beta) and bone morphogenetic proteins (BMPs). Using nuclear accumulation of the Drosophila Smad Mothers against Decapentaplegic (Mad) as the readout, we carried out a whole-genome RNAi screening in Drosophila cells. The screen identified moleskin (msk) as important for the nuclear import of phosphorylated Mad. Genetic evidence in the developing eye imaginal discs also demonstrates the critical functions of msk in regulating phospho-Mad. Moreover, knockdown of importin 7 and 8 (Imp7 and 8), the mammalian orthologues of Msk, markedly impaired nuclear accumulation of Smad1 in response to BMP2 and of Smad2/3 in response to TGF-beta. Biochemical studies further suggest that Smads are novel nuclear import substrates of Imp7 and 8. We have thus identified new evolutionarily conserved proteins that are important in the signal transduction of TGF-beta and BMP into the nucleus

Actividad antioxidante, fenoles totales y flavonoides totales en extractos de tallos de Jasminum nervosum Lour

Guangxi traditional Chinese Medical University Universidad de Medicina Tradicional China de Guangxi This study evaluated the antioxidant activities of the extracts of Jasminum nervosum Lour. stems along with the effects of different extract solvents on total phenolics (TP), total flavonoids (TF), and antioxidant potential. The antioxidant activity of the extracts was assessed using the following methods: DPPH, ABTS+ both free radicals scavenging assays, and reducing assays. TP and TF were detected by spectrophotometric and HPLC methods. In former methods, the highest amount of TP content was ethy lacetate extract (EAE), expressed as gallic acid equivalents. The greatest TF content was in the n-butanol extract (BE), expressed as lutin equivalents. No significant difference was observed in the TP/TF content between these two extracts. The antioxidant activity and TP/TF content of three extracts seemed to follow the same trend. This implied that there is a good correlation between antioxidant activities and TP/TF content. But in HPLC methods, EAE contained the highest content of lutin and gallic acid, which decreased in the same order of EAE > BE > PE, the rank order of TP/TF content of EAE and BE were different according to antioxidant ability. The overall results showed that the EAE and BE were richer in phenolics and flavonoids than petroleum ether extract (PE), and may represent a good source of antioxidants.Este estudio evaluó las actividades antioxidantes de extractos de tallos de Jasminum nervosum Lour., y el efecto de diferentes disolventes de extracción en los fenoles totales (TP) y flavonoides totales (TF), y su potencial antioxidante. La actividad antioxidante de los extractos fue evaluada usando los siguientes métodos: DPPH, ABTS+ y ensayos reductores. TP y TF fueron detectados por métodos espectroscópicos y por HPLC. Con el primer método, el contenido más alto de TP se obtuvo en el extracto con acetato de etilo (EAE), expresado como equivalentes de ácido gálico. Por su parte, el mayor contenido de TF se obtuvo en el extracto con n-butanol (BE), expresado como equivalentes de luteína. No se observaron diferencias significativas en la relación TP/TF entre los dos extractos. La actividad antioxidante y la relación TP/TF de los tres extractos parecen seguir el mismo comportamiento. Esto implica que hay una buena correlación entre las actividades antioxidantes y la relación TP/TF. Con el método de HPLC, el extracto EAE contenía los más altos contenidos de luteína y ácido gálico, que decrecieron en el mismo orden de EAE > BE > PE, el orden de la relación TP/TF de EAE y BE fueron diferentes de acuerdo a su capacidad antioxidante. En conjunto, los resultados muestran que los extractos de EAE y de BE fueron más ricos en compuestos fenólicos y flavonoides que el extracto de éter (PE), y pueden representar una buena fuente de antioxidantes

Msk is required for nuclear import of TGF-β/BMP-activated Smads

Nuclear translocation of Smad proteins is a critical step in signal transduction of transforming growth factor β (TGF-β) and bone morphogenetic proteins (BMPs). Using nuclear accumulation of the Drosophila Smad Mothers against Decapentaplegic (Mad) as the readout, we carried out a whole-genome RNAi screening in Drosophila cells. The screen identified moleskin (msk) as important for the nuclear import of phosphorylated Mad. Genetic evidence in the developing eye imaginal discs also demonstrates the critical functions of msk in regulating phospho-Mad. Moreover, knockdown of importin 7 and 8 (Imp7 and 8), the mammalian orthologues of Msk, markedly impaired nuclear accumulation of Smad1 in response to BMP2 and of Smad2/3 in response to TGF-β. Biochemical studies further suggest that Smads are novel nuclear import substrates of Imp7 and 8. We have thus identified new evolutionarily conserved proteins that are important in the signal transduction of TGF-β and BMP into the nucleus

Polystyrene microplastics alter the trophic transfer and biotoxicity of fluoxetine in an aquatic food chain

Microplastics (MPs) and fluoxetine are ubiquitous emerging pollutants in aquatic environments that may interact with each other due to the carrier effects of MPs, posing unpredictable risks to non-target organisms. However, limited studies have focused on the carrier effects of MPs in the aquatic food chain. This study evaluated the influences of polystyrene MPs on the trophic transfer and biotoxicity of fluoxetine in a simple food chain composed of brine shrimp (Artemia nauplii) and zebrafish (Danio rerio). The finding reveals that carrier effects of MPs enhanced the accumulation of waterborne fluoxetine in brine shrimp, but suppressed that in zebrafish due to the distinct retention times. The accumulated fluoxetine in shrimp was further transferred to fish through the food chain, which was alleviated by MPs due to their cleaning effects. In addition, the specific neurotransmission biotoxicity in fish induced by fluoxetine was mitigated by MPs, whilst the oxidative damage, apoptosis, and immune responses in zebrafish were reversely enhanced by MPs due to the stimulating effect. These findings highlight the alleviating effects of MPs on the trophic transfer and specific biotoxicity of fluoxetine in the food chain, providing new insights into the carrier effects of MPs in aquatic environments in the context of increasing global MP pollution.Peer reviewe

Antioxidant activity, total phenolic, and total flavonoid of extracts from stems of <i>Jasminum nervosum</i> Lour

Guangxi traditional Chinese Medical University Universidad de Medicina Tradicional China de Guangxi This study evaluated the antioxidant activities of the extracts of <i>Jasminum nervosum</i> Lour. stems along with the effects of different extract solvents on total phenolics (TP), total flavonoids (TF), and antioxidant potential. The antioxidant activity of the extracts was assessed using the following methods: DPPH, ABTS+ both free radicals scavenging assays, and reducing assays. TP and TF were detected by spectrophotometric and HPLC methods. In former methods, the highest amount of TP content was ethy lacetate extract (EAE), expressed as gallic acid equivalents. The greatest TF content was in the n-butanol extract (BE), expressed as lutin equivalents. No significant difference was observed in the TP/TF content between these two extracts. The antioxidant activity and TP/TF content of three extracts seemed to follow the same trend. This implied that there is a good correlation between antioxidant activities and TP/TF content. But in HPLC methods, EAE contained the highest content of lutin and gallic acid, which decreased in the same order of EAE > BE > PE, the rank order of TP/TF content of EAE and BE were different according to antioxidant ability. The overall results showed that the EAE and BE were richer in phenolics and flavonoids than petroleum ether extract (PE), and may represent a good source of antioxidants.<br><br>Este estudio evaluó las actividades antioxidantes de extractos de tallos de <i>Jasminum nervosum</i> Lour., y el efecto de diferentes disolventes de extracción en los fenoles totales (TP) y flavonoides totales (TF), y su potencial antioxidante. La actividad antioxidante de los extractos fue evaluada usando los siguientes métodos: DPPH, ABTS+ y ensayos reductores. TP y TF fueron detectados por métodos espectroscópicos y por HPLC. Con el primer método, el contenido más alto de TP se obtuvo en el extracto con acetato de etilo (EAE), expresado como equivalentes de ácido gálico. Por su parte, el mayor contenido de TF se obtuvo en el extracto con n-butanol (BE), expresado como equivalentes de luteína. No se observaron diferencias significativas en la relación TP/TF entre los dos extractos. La actividad antioxidante y la relación TP/TF de los tres extractos parecen seguir el mismo comportamiento. Esto implica que hay una buena correlación entre las actividades antioxidantes y la relación TP/TF. Con el método de HPLC, el extracto EAE contenía los más altos contenidos de luteína y ácido gálico, que decrecieron en el mismo orden de EAE > BE > PE, el orden de la relación TP/TF de EAE y BE fueron diferentes de acuerdo a su capacidad antioxidante. En conjunto, los resultados muestran que los extractos de EAE y de BE fueron más ricos en compuestos fenólicos y flavonoides que el extracto de éter (PE), y pueden representar una buena fuente de antioxidantes