PEFT for Speech: Unveiling Optimal Placement, Merging Strategies, and Ensemble Techniques

Parameter-Efficient Fine-Tuning (PEFT) is increasingly recognized as an effective method in speech processing. However, the optimal approach and the placement of PEFT methods remain inconclusive. Our study conducts extensive experiments to compare different PEFT methods and their layer-wise placement adapting Differentiable Architecture Search (DARTS). We also explore the use of ensemble learning to leverage diverse PEFT strategies. The results reveal that DARTS does not outperform the baseline approach, which involves inserting the same PEFT method into all layers of a Self-Supervised Learning (SSL) model. In contrast, an ensemble learning approach, particularly one employing majority voting, demonstrates superior performance. Our statistical evidence indicates that different PEFT methods learn in varied ways. This variation might explain why the synergistic integration of various PEFT methods through ensemble learning can harness their unique learning capabilities more effectively compared to individual layer-wise optimization.Comment: Accepted to ICASSP 2024 Self-supervision in Audio, Speech and Beyond (SASB) worksho

The linear and nonlinear Jaynes-Cummings model for the multiphoton transition

With the Jaynes-Cummings model, we have studied the atom and light field quantum entanglement of multiphoton transition, and researched the effect of initial state superposition coefficient $C_{1}$, the transition photon number $N$, the quantum discord $\delta$ and the nonlinear coefficient $\chi$ on the quantum entanglement degrees. We have given the quantum entanglement degrees curves with time evolution, and obtained some results, which should have been used in quantum computing and quantum information.Comment: arXiv admin note: text overlap with arXiv:1404.0821, arXiv:1205.0979 by other author

Gait performance and prefrontal cortex activation during single and dual task walking in older adults with different cognitive levels

BackgroundGrowing evidence shows the cognitive function influences the motor performance. The prefrontal cortex (PFC) as a part of the executive locomotor pathway is also important for cognitive function. This study investigated the differences in motor function and brain activity among older adults with different cognitive levels, and examined the significance of cognition on motor functions.MethodsNormal control (NC), individuals with mild cognitive impairment (MCI) or mild dementia (MD) were enrolled in this study. All participants received a comprehensive assessment including cognitive function, motor function, PFC activity during walking, and fear of fall. The assessment of cognitive function included general cognition, attention, executive function, memory, and visuo-spatial. The assessment of motor function included timed up and go (TUG) test, single walking (SW), and cognitive dual task walking (CDW).ResultsIndividuals with MD had worse SW, CDW and TUG performance as compared to individuals with MCI and NC. These gait and balance performance did not differ significantly between MCI and NC. Motor functions all correlated with general cognition, attention, executive function, memory, and visuo-spatial ability. Attention ability measured by trail making test A (TMT-A) was the best predictor for TUG and gait velocity. There were no significant differences in PFC activity among three groups. Nevertheless, the PFC activated more during CDW as compared with SW in individuals with MCI (p = 0.000), which was not demonstrated in the other two groups.ConclusionMD demonstrated worse motor function as compared to NC and MCI. The greater PFC activity during CDW in MCI may be considered as a compensatory strategy for maintaining the gait performance. Motor function was related to the cognitive function, and the TMT A was the best predictor for the gait related performance in present study among older adults

Dominance of Tau Burden in Cortical Over Subcortical Regions Mediates Glymphatic Activity and Clinical Severity in PSP

Background: Progressive supranuclear palsy (PSP) is a tauopathy that involves subcortical regions but also extends to cortical areas. The clinical impact of different tau protein sites and their influence on glymphatic dysfunction have not been investigated. Patients and Methods: Participants (n = 55; 65.6 ± 7.1 years; 29 women) with PSP (n = 32) and age-matched normal controls (NCs; n = 23) underwent 18F-Florzolotau tau PET, MRI, PSP Rating Scale (PSPRS), and Mini-Mental State Examination. Cerebellar gray matter (GM) and parametric estimation of reference signal intensity were used as references for tau burden measured by SUV ratios. Glymphatic activity was measured by diffusion tensor image analysis along the perivascular space (DTI-ALPS). Results: Parametric estimation of reference signal intensity is a better reference than cerebellar GM to distinguish tau burden between PSP and NCs. PSP patients showed higher cortical and subcortical tau SUV ratios than NCs (P < 0.001 and <0.001). Cortical and subcortical tau deposition correlated with PSPRS, UPDRS, and Mini-Mental State Examination scores (all P’s < 0.05). Cortical tau deposition was further associated with the DTI-ALPS index and frontal-temporal-parietal GM atrophy. The DTI-ALPS indexes showed a significantly negative correlation with the PSPRS total scores (P < 0.01). Finally, parietal and occipital lobe tau depositions showed mediating effects between the DTI-ALPS index and PSPRS score. Conclusions: Cortical tau deposition is associated with glymphatic dysfunction and plays a role in mediating glymphatic dysfunction and clinical severity. Our results provide a possible explanation for the worsening of clinical severity in patients with PSP

Stochastic Heterostructures in B/N-Doped Carbon Nanotubes

Carbon nanotubes are one-dimensional and very narrow. These obvious facts imply that under doping with boron and nitrogen, microscopic doping inhomogeneity is much more important than for bulk semiconductors. We consider the possibility of exploiting such fluctuations to create interesting devices. Using self-consistent tight-binding (SCTB), we study heavily doped highly compensated nanotubes, revealing the spontaneous formation of structures resembling chains of random quantum dots, or nano-scale diode-like elements in series. We also consider truly isolated impurities, revealing simple scaling properties of bound state sizes and energies.Comment: 4 pages RevTeX, 4 PostScript figure

Effect of Te on selective oxidation of propane to acrolein over MoPO/SiO2 catalyst

Effect of To on the catalytic performance of the MOPO/SiO2 catalyst for the selective oxidation of propane to acrolein was investigated. The MoPO/SiO2 catalyst exhibited high selectivity for propene, which was a possible intermediate for the formation of acrolein. The addition of To to the catalyst enhanced the conversion of propene to acrolein. The catalysts MoPO/SiO2 and MoPTeO/SiO2 were comparatively characterized by N-2 adsorption, XRD, Raman spectroscopy, XPS, H-2-TPR, pulse reaction of propane, NH3-TPD and Py-IR. The results showed that the addition of To to the catalyst reduced the surface area, but it enhanced the specific surface acidity and improved the reducibility of the supported catalyst, and the performance of the catalyst for propane conversion was improved at the same time. To might be favorable to alpha-H abstraction of propene and/or oxygen insertion into allylic species

Pairing symmetry and properties of iron-based high temperature superconductors

Pairing symmetry is important to indentify the pairing mechanism. The analysis becomes particularly timely and important for the newly discovered iron-based multi-orbital superconductors. From group theory point of view we classified all pairing matrices (in the orbital space) that carry irreducible representations of the system. The quasiparticle gap falls into three categories: full, nodal and gapless. The nodal-gap states show conventional Volovik effect even for on-site pairing. The gapless states are odd in orbital space, have a negative superfluid density and are therefore unstable. In connection to experiments we proposed possible pairing states and implications for the pairing mechanism.Comment: 4 pages, 1 table, 2 figures, polished versio

The Atacama Large Millimeter/submillimeter Array (ALMA) Band-1 Receiver

The Atacama Large Millimeter/submillimeter Array(ALMA) Band 1 receiver covers the 35-50 GHz frequency band. Development of prototype receivers, including the key components and subsystems has been completed and two sets of prototype receivers were fully tested. We will provide an overview of the ALMA Band 1 science goals, and its requirements and design for use on the ALMA. The receiver development status will also be discussed and the infrastructure, integration, evaluation of fully-assembled band 1 receiver system will be covered. Finally, a discussion of the technical and management challenges encountered will be presented