PADA: Pruning Assisted Domain Adaptation for Self-Supervised Speech Representations

While self-supervised speech representation learning (SSL) models serve a variety of downstream tasks, these models have been observed to overfit to the domain from which the unlabelled data originates. To alleviate this issue, we propose PADA (Pruning Assisted Domain Adaptation) and zero out redundant weights from models pre-trained on large amounts of out-of-domain (OOD) data. Intuitively, this helps to make space for the target-domain ASR finetuning. The redundant weights can be identified through various pruning strategies which have been discussed in detail as a part of this work. Specifically, we investigate the effect of the recently discovered Task-Agnostic and Task-Aware pruning on PADA and propose a new pruning paradigm based on the latter, which we call Cross-Domain Task-Aware Pruning (CD-TAW). CD-TAW obtains the initial pruning mask from a well fine-tuned OOD model, which makes it starkly different from the rest of the pruning strategies discussed in the paper. Our proposed CD-TAW methodology achieves up to 20.6% relative WER improvement over our baseline when fine-tuned on a 2-hour subset of Switchboard data without language model (LM) decoding. Furthermore, we conduct a detailed analysis to highlight the key design choices of our proposed method.Comment: Submitted to Interspeech 202

Possible mechanisms of hypotension produced 70% alcoholic extract of Terminalia arjuna (L.) in anaesthetized dogs

BACKGROUND: The bark of Terminalia arjuna L. (Combretaceae) is used in Ayurveda since ancient times for the treatment of cardiac disorders. Previous laboratory investigations have demonstrated the use of the bark in cardiovascular complications. The present study was aimed to find the effect of 70% alcoholic extract of Terminalia arjuna on anaesthetized dog blood pressure and probable site of action. METHODS: Six dogs were anaesthetized with intraperitoneal injection of thiopental sodium and the blood pressure of each dog (n = 6) was measured from the left common carotid artery connected to a mercury manometer on kymograph. The femoral vein was cannulated for administration of drug solutions. The extract of T. arjuna (dissolved in propylene glycol) in the dose range of 5 to 15 mg/kg were administered intravenously in a pilot study and the dose (6 mg/kg) which produced appreciable hypotension was selected for further studies. RESULTS: Intravenous administration of T. arjuna produced dose-dependent hypotension in anaesthetized dogs. The hypotension produced by 6 mg/kg dose of the extract was blocked by propranolol but not by atropine or mepyramine maleate. This indicates that muscarinic or histaminergic mechanisms are not likely to be involved in the hypotension produced by the extract. The blockade by propranolol of the hypotension produced by T. arjuna indicates that the extract might contain active compound(s) possessing adrenergic ß(2)-receptor agonist action and/or that act directly on the heart muscle. CONCLUSION: The results indicated the likely involvement of peripheral mechanism for hypotension produced by the 70% alcoholic extract of Terminalia arjuna and lends support for the claims of its traditional usage in cardiovascular disorders