MultiWay-Adapater: Adapting large-scale multi-modal models for scalable image-text retrieval

As the size of Large Multi-Modal Models (LMMs) increases consistently, the adaptation of these pre-trained models to specialized tasks has become a computationally and memory-intensive challenge. Traditional fine-tuning methods require isolated, exhaustive retuning for each new task, limiting the models' versatility. Moreover, current efficient adaptation techniques often overlook modality alignment, focusing only on the knowledge extraction of new tasks. To tackle these issues, we introduce Multiway-Adapter, an innovative framework incorporating an 'Alignment Enhancer' to deepen modality alignment, enabling high transferability without tuning pre-trained parameters. Our method adds fewer than 1.25\% of additional parameters to LMMs, exemplified by the BEiT-3 model in our study. This leads to superior zero-shot image-text retrieval performance compared to fully fine-tuned models, while achieving up to a 57\% reduction in fine-tuning time. Our approach offers a resource-efficient and effective adaptation pathway for LMMs, broadening their applicability. The source code is publicly available at: \url{https://github.com/longkukuhi/MultiWay-Adapter}

When hard negative sampling meets supervised contrastive learning

State-of-the-art image models predominantly follow a two-stage strategy: pre-training on large datasets and fine-tuning with cross-entropy loss. Many studies have shown that using cross-entropy can result in sub-optimal generalisation and stability. While the supervised contrastive loss addresses some limitations of cross-entropy loss by focusing on intra-class similarities and inter-class differences, it neglects the importance of hard negative mining. We propose that models will benefit from performance improvement by weighting negative samples based on their dissimilarity to positive counterparts. In this paper, we introduce a new supervised contrastive learning objective, SCHaNe, which incorporates hard negative sampling during the fine-tuning phase. Without requiring specialized architectures, additional data, or extra computational resources, experimental results indicate that SCHaNe outperforms the strong baseline BEiT-3 in Top-1 accuracy across various benchmarks, with significant gains of up to $3.32\%$ in few-shot learning settings and $3.41\%$ in full dataset fine-tuning. Importantly, our proposed objective sets a new state-of-the-art for base models on ImageNet-1k, achieving an 86.14\% accuracy. Furthermore, we demonstrate that the proposed objective yields better embeddings and explains the improved effectiveness observed in our experiments

Elucidating and Overcoming the Challenges of Label Noise in Supervised Contrastive Learning

Image classification datasets exhibit a non-negligible fraction of mislabeled examples, often due to human error when one class superficially resembles another. This issue poses challenges in supervised contrastive learning (SCL), where the goal is to cluster together data points of the same class in the embedding space while distancing those of disparate classes. While such methods outperform those based on cross-entropy, they are not immune to labeling errors. However, while the detrimental effects of noisy labels in supervised learning are well-researched, their influence on SCL remains largely unexplored. Hence, we analyse the effect of label errors and examine how they disrupt the SCL algorithm's ability to distinguish between positive and negative sample pairs. Our analysis reveals that human labeling errors manifest as easy positive samples in around 99% of cases. We, therefore, propose D-SCL, a novel Debiased Supervised Contrastive Learning objective designed to mitigate the bias introduced by labeling errors. We demonstrate that D-SCL consistently outperforms state-of-the-art techniques for representation learning across diverse vision benchmarks, offering improved robustness to label errors

Humanities and Engineering Perspectives on Music Transcription:

Music transcription is a process of creating a notation of musical sounds. It has been used as a basis for the analysis of music from a wide variety of cultures. Recent decades have seen an increasing amount of engineering research within the field of Music Information Retrieval that aims at automatically obtaining music transcriptions in Western staff notation. However, such approaches are not widely applied in research in ethnomusicology. This article aims to bridge interdisciplinary gaps by identifying aspects of proximity and divergence between the two fields. As part of our study, we collected manual transcriptions of traditional dance tune recordings by eighteen transcribers. Our method employs a combination of expert and computational evaluation of these transcriptions. This enables us to investigate the limitations of automatic music transcription (AMT) methods and computational transcription metrics that have been proposed for their evaluation. Based on these findings, we discuss promising avenues to make AMT more useful for studies in the Humanities. These are, first, assessing the quality of a transcription based on an analytic purpose; secondly, developing AMT approaches that are able to learn conventions concerning the transcription of a specific style; thirdly, a focus on novice transcribers as users of AMT systems; and, finally, considering target notation systems different from Western staff notation

E1A Activates Transcription of p73 and Noxa to Induce Apoptosis

p73, a member of the p53 family of proteins, transcriptionally activates a number of genes involved in the control of cell cycle and apoptosis. Overexpression of p73 was detected in a large number of primary head and neck cancers, and in the established cell lines examined, these all contained inactivating p53 mutations. The significance of p73 overexpression in the pathogenesis of head and neck cancer is currently unclear. We have shown that the expression of adenovirus 5 E1A in a panel of head and neck cancer cell lines induces apoptosis independently of their p53 status. In this study we examined the role of p73 and its transcriptional targets in E1A-mediated induction of apoptosis. E1A expression resulted in significant activation of the TAp73 promoter but had no effect on the alternative, DeltaNp73 promoter. E1A also increased expression of endogenous TAp73 mRNA and protein. E1A mutants lacking the p300- and/or pRB-binding sites showed reduced ability to activate the TAp73 promoter. Additionally, mutations in the E2F1-binding sites in the TAp73 promoter impaired activation by E1A. Importantly, expression of the 13S isoform of E1A substantially induced the p53 apoptotic target Noxa in several p53-deficient cancer cell lines. Our results indicate that E1A activation of p73 and the p53 apoptotic target Noxa can occur in the absence of a functional p53. This activation is likely to play a key role in the mechanism of p53-independent apoptosis induced by E1A in some cancers and may provide an avenue for future cancer therapies

WILL POLITICAL REFORM BRING ABOUT IMPROVED ECONOMIC MANAGEMENT IN SUB?SAHARAN AFRICA?

Summary Unmistakable signs of movement towards political liberalization and more accountable government in sub?Saharan Africa have given rise to expectations that these reforms will result in better economic performance. This article considers the plausibility of such expectations from the point of view of weaknesses in the policy making process and prospects for improvements with political reform in the 1990s. It concludes that while there may be scope for optimism, improved economic management is not a guaranteed outcome of the reform process and it would therefore be unwise to encourage excessive expectations at this stage. Résumé En Afrique sous?saharienne, certains signes manifestes d'un mouvement vers la libéralisation politique et vers des modes de gouvernement plus responsables de leurs actions ont servi à susciter l'espoir que ces réformes mèneront à une performance économique meilleure. Le présent article s'interroge sur la plausibilité de ces espérances eu égard aux faiblesses dans le processus de détermination des politiques; et aussi, sur les possibilités qu'une amélioration pourrait découler des réformes politiques instaurées durant les années 1990. La conclusion des auteurs est que si, de certains points de vue, il y aurait lieu d'être optimiste, le processus de réforme est loin de garantir l'amélioration de la gestion économique et que sous ce jour, il serait imprudent à ce stade d'encourager des espérances excessives. Resumen La inconfundibles señales de movimiento hacia una liberalización política y gobiernos más responsables en el Africa sub?Sahariana han despertado expectativas de que estas reformas resulten en un mejor desempeño económico. Este artículo considera la plausibilidad de esas esperanzas desde el punto de vista de la fragilidad en el proceso de elaboración de pautas, y las perspectivas para las mejoras con las reformas políticas de la década del 90. Llega a la conclusión de que si bien hay lugar para el optimismo, un mejor manejo económico no es necesariamente el resultado garantizado del proceso de reforma, y por esa razón, sería muy aventurado fomentar grandes expectativas por el momento

The Notch intracellular domain represses CRE-dependent transcription

AbstractMembers of the cyclic-AMP response-element binding protein (CREB) transcription factor family regulate the expression of genes needed for long-term memory formation. Loss of Notch impairs long-term, but not short-term, memory in flies and mammals. We investigated if the Notch-1 (N1) exerts an effect on CREB-dependent gene transcription. We observed that N1 inhibits CREB mediated activation of cyclic-AMP response element (CRE) containing promoters in a γ-secretase-dependent manner. We went on to find that the γ-cleaved N1 intracellular domain (N1ICD) sequesters nuclear CREB1α, inhibits cAMP/PKA-mediated neurite outgrowth and represses the expression of specific CREB regulated genes associated with learning and memory in primary cortical neurons. Similar transcriptional effects were observed with the N2ICD, N3ICD and N4ICDs. Together, these observations indicate that the effects of Notch on learning and memory are, at least in part, via an effect on CREB-regulated gene expression

A possible role for Phlebotomus (Anaphlebotomus) rodhaini (Parrot, 1930) in transmission of Leishmania donovani

<p>Abstract</p> <p>Background</p> <p>Visceral leishmaniasis (VL, kala azar), caused by <it>Leishmania donovani </it>is a major health problem in Sudan and other East African countries. In this region the only proven vectors of <it>L. donovani </it>are <it>Phlebotomus orientalis </it>in eastern Sudan, Ethiopia and Upper Nile areas of Southern Sudan and <it>Phlebotomus martini </it>in Ethiopia, Kenya and Southern Sudan. In this report, we present the first evidence that <it>Phlebotomus rodhaini </it>may also play a role in maintaining transmission of <it>L. donovani </it>between animal reservoir hosts in eastern Sudan. The study was conducted in a zoonotic focus of visceral leishmaniasis in Dinder National Park, eastern Sudan, where previous work showed high infection rates of <it>L. donovani </it>in <it>P. orientalis</it>. Sand flies, captured by CDC traps were dissected and examined for infection with <it>Leishmania </it>parasites. Parasite isolates were subjected to <it>L. donovani </it>specific PCR. Field experiments were also carried out to compare efficiency of rodent baited and un-baited CDC traps in collection of <it>P. rodhaini </it>and determine its man-biting rate.</p> <p>Results</p> <p>Three female <it>P. rodhain</it>i were found infected with <it>Leishmania </it>parasites in an astonishingly small number of flies captured in three separate field trips. Two of these isolates were typed by molecular methods as <it>L. donovani</it>, while the third isolate was inoculated into a hamster that was subsequently lost. Although <it>P. rodhaini is </it>generally considered a rare species, results obtained in this study indicate that it can readily be captured by rodent-baited traps. Results of human landing collection showed that it rarely bites humans in the area.</p> <p>Conclusion</p> <p>It is concluded that <it>P. rodhaini </it>is a possible vector of <it>L. donovani </it>between animal reservoir hosts but is not responsible for infecting humans. It is suggested that the role of <it>P</it>. <it>rodhaini </it>in transmission of <it>L. donovani </it>in other zoonotic foci of visceral leishmaniasis in Africa should be re-examined.</p

Magnesium supplementation for the treatment of restless legs syndrome and periodic limb movement disorder : A systematic review

Magnesium supplementation is often suggested for restless legs syndrome (RLS) or period limb movement disorder (PLMD) based on anecdotal evidence that it relieves symptoms and because it is also commonly recommended for leg cramps. We aimed to review all articles reporting the effects of magnesium supplementation on changes in RLS and/or PLMD. We conducted a systematic search looking for all relevant articles and then two reviewers read all article titles and abstracts to identify relevant studies. Eligible studies were scored for their quality as interventional trials. We found 855 abstracts and 16 of these could not be definitively excluded for not addressing all aspects of our research question. Seven full-text articles were unlocatable and one was ineligible which left eight studies with relevant data. One was a randomised placebo-controlled trial, three were case series and four were case studies. The RCT did not find a significant treatment effect of magnesium but may have been underpowered. After quality appraisal and synthesis of the evidence we were unable to make a conclusion as to the effectiveness of magnesium for RLS/PLMD. It is not clear whether magnesium helps relieve RLS or PLMD or in which patient groups any benefit might be seen. (c) 2019 Elsevier Ltd. All rights reserved.Peer reviewe

Risk Factors for Anthroponotic Cutaneous Leishmaniasis at the Household Level in Kabul, Afghanistan

Cutaneous leishmaniasis is a vector-borne protozoan disease that is characterized by cutaneous lesions which develop at the site of the insect bite. Lesions can vary in severity, clinical appearance, and time to cure; in a proportion of patients lesions can become chronic, leading to disfiguring mucosal leishmaniasis or leishmaniasis recidvans. Albeit not fatal, cutaneous leishmaniasis can have a significant social impact as it may lead to severe stigmatisation of affected individuals when lesions or scars occur on the face and exposed extremeties. Over the last 10–20 years there has been an increase in the number of leishmaniasis cases reported in South Asia, particularly in Afghanistan. Little is known about the household-level risk factors for infection and disease. Here we confirm previous reports that had shown the association of cutaneous leishmaniasis with age and clustering of cases at the household-level. Additionally, we show that risk of cutaneous leishmaniasis is associated with household construction (i.e. brick walls) and design (i.e. proportion of windows with screens)