LLM4TS: Two-Stage Fine-Tuning for Time-Series Forecasting with Pre-Trained LLMs

In this work, we leverage pre-trained Large Language Models (LLMs) to enhance time-series forecasting. Mirroring the growing interest in unifying models for Natural Language Processing and Computer Vision, we envision creating an analogous model for long-term time-series forecasting. Due to limited large-scale time-series data for building robust foundation models, our approach LLM4TS focuses on leveraging the strengths of pre-trained LLMs. By combining time-series patching with temporal encoding, we have enhanced the capability of LLMs to handle time-series data effectively. Inspired by the supervised fine-tuning in chatbot domains, we prioritize a two-stage fine-tuning process: first conducting supervised fine-tuning to orient the LLM towards time-series data, followed by task-specific downstream fine-tuning. Furthermore, to unlock the flexibility of pre-trained LLMs without extensive parameter adjustments, we adopt several Parameter-Efficient Fine-Tuning (PEFT) techniques. Drawing on these innovations, LLM4TS has yielded state-of-the-art results in long-term forecasting. Our model has also shown exceptional capabilities as both a robust representation learner and an effective few-shot learner, thanks to the knowledge transferred from the pre-trained LLM

Regulation of CLC-1 chloride channel biosynthesis by FKBP8 and Hsp90β.

Mutations in human CLC-1 chloride channel are associated with the skeletal muscle disorder myotonia congenita. The disease-causing mutant A531V manifests enhanced proteasomal degradation of CLC-1. We recently found that CLC-1 degradation is mediated by cullin 4 ubiquitin ligase complex. It is currently unclear how quality control and protein degradation systems coordinate with each other to process the biosynthesis of CLC-1. Herein we aim to ascertain the molecular nature of the protein quality control system for CLC-1. We identified three CLC-1-interacting proteins that are well-known heat shock protein 90 (Hsp90)-associated co-chaperones: FK506-binding protein 8 (FKBP8), activator of Hsp90 ATPase homolog 1 (Aha1), and Hsp70/Hsp90 organizing protein (HOP). These co-chaperones promote both the protein level and the functional expression of CLC-1 wild-type and A531V mutant. CLC-1 biosynthesis is also facilitated by the molecular chaperones Hsc70 and Hsp90β. The protein stability of CLC-1 is notably increased by FKBP8 and the Hsp90β inhibitor 17-allylamino-17-demethoxygeldanamycin (17-AAG) that substantially suppresses cullin 4 expression. We further confirmed that cullin 4 may interact with Hsp90β and FKBP8. Our data are consistent with the idea that FKBP8 and Hsp90β play an essential role in the late phase of CLC-1 quality control by dynamically coordinating protein folding and degradation

Prevalent Hallucinations during Medical Internships: Phantom Vibration and Ringing Syndromes

Background: Phantom vibration syndrome is a type of hallucination reported among mobile phone users in the general population. Another similar perception, phantom ringing syndrome, has not been previously described in the medical literature. Methods: A prospective longitudinal study of 74 medical interns (46 males, 28 females; mean age, 24.8±1.2 years) was conducted using repeated investigations of the prevalence and associated factors of phantom vibration and ringing. The accompanying symptoms of anxiety and depression were evaluated with the Beck Anxiety and Depression Inventories before the internship began, and again at the third, sixth, and twelfth internship months, and two weeks after the internship ended. Results: The baseline prevalence of phantom vibration was 78.1%, which increased to 95.9% and 93.2% in the third and sixth internship months. The prevalence returned to 80.8% at the twelfth month and decreased to 50.0% 2 weeks after the internship ended. The baseline prevalence of phantom ringing was 27.4%, which increased to 84.9%, 87.7%, and 86.3% in the third, sixth, and twelfth internship months, respectively. This returned to 54.2% two weeks after the internship ended. The anxiety and depression scores also increased during the internship, and returned to baseline two weeks after the internship. There was no significant correlation between phantom vibration/ringing and symptoms of anxiety or depression. The incidence of both phantom vibration and ringing syndromes significantly increased during the internship, and subsequent recovery. Conclusion: This study suggests that phantom vibration and ringing might be entities that are independent of anxiety or depression during evaluation of stress-associated experiences during medical internships

Strong interfacial exchange field in the graphene/EuS heterostructure

Exploiting 2D materials for spintronic applications can potentially realize next-generation devices featuring low-power consumption and quantum operation capability. The magnetic exchange field (MEF) induced by an adjacent magnetic insulator enables efficient control of local spin generation and spin modulation in 2D devices without compromising the delicate material structures. Using graphene as a prototypical 2D system, we demonstrate that its coupling to the model magnetic insulator (EuS) produces a substantial MEF (> 14 T) with potential to reach hundreds of Tesla, which leads to orders-of-magnitude enhancement in the spin signal originated from Zeeman spin-Hall effect. Furthermore, the new ferromagnetic ground state of Dirac electrons resulting from the strong MEF may give rise to quantized spin-polarized edge transport. The MEF effect shown in our graphene/EuS devices therefore provides a key functionality for future spin logic and memory devices based on emerging 2D materials in classical and quantum information processing

PEFT for Speech: Unveiling Optimal Placement, Merging Strategies, and Ensemble Techniques

Parameter-Efficient Fine-Tuning (PEFT) is increasingly recognized as an effective method in speech processing. However, the optimal approach and the placement of PEFT methods remain inconclusive. Our study conducts extensive experiments to compare different PEFT methods and their layer-wise placement adapting Differentiable Architecture Search (DARTS). We also explore the use of ensemble learning to leverage diverse PEFT strategies. The results reveal that DARTS does not outperform the baseline approach, which involves inserting the same PEFT method into all layers of a Self-Supervised Learning (SSL) model. In contrast, an ensemble learning approach, particularly one employing majority voting, demonstrates superior performance. Our statistical evidence indicates that different PEFT methods learn in varied ways. This variation might explain why the synergistic integration of various PEFT methods through ensemble learning can harness their unique learning capabilities more effectively compared to individual layer-wise optimization.Comment: Accepted to ICASSP 2024 Self-supervision in Audio, Speech and Beyond (SASB) worksho

A 64-week, multicenter, open-label study of aripiprazole effectiveness in the management of patients with schizophrenia or schizoaffective disorder in a general psychiatric outpatient setting

<p>Abstract</p> <p>Objective</p> <p>To evaluate the overall long-term effectiveness of aripiprazole in patients with schizophrenia in a general psychiatric practice setting in Taiwan.</p> <p>Methods</p> <p>This was a prospective, open-label, multicenter, post-market surveillance study in Taiwanese patients with a Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition (DSM-IV) diagnosis of schizophrenia or schizoaffective disorder requiring a switch in antipsychotic medication because current medication was not well tolerated and/or clinical symptoms were not well controlled. Eligible patients were titrated to aripiprazole (5-30 mg/day) over a 12-week switching phase, during which their previous medication was discontinued. Patients could then enter a 52-week, long-term treatment phase. Aripiprazole was flexibly dosed (5-30 mg/day) at the discretion of the treating physicians. Efficacy was assessed using the Clinical Global Impression scale Improvement (CGI-I) score, the Clinical Global Impression scale Severity (CGI-S) score, The Brief Psychiatry Rating Scale (BPRS), and the Quality of Life (QOL) scale, as well as Preference of Medicine (POM) ratings by patients and caregivers. Safety and tolerability were also assessed.</p> <p>Results</p> <p>A total of 245 patients were enrolled and switched from their prior antipsychotic medications, and 153 patients entered the 52-week extension phase. In all, 79 patients (32.2%) completed the study. At week 64, the mean CGI-I score was 3.10 and 64.6% of patients who showed response. Compared to baseline, scores of CGI-S, QOL, and BPRS after 64 weeks of treatment also showed significant improvements. At week 12, 65.4% of subjects and 58.9% of caregivers rated aripiprazole as better than the prestudy medication on the POM. The most frequently reported adverse events (AEs) were headache, auditory hallucinations and insomnia. A total of 13 patients (5.3%) discontinued treatment due to AEs. No statistically significant changes were noted with respect to fasting plasma glucose, lipid profile, body weight, and body mass index after long-term treatment with aripiprazole.</p> <p>Conclusions</p> <p>Although the discontinuation rate was high, aripiprazole was found to be effective, safe and well tolerated in the long-term treatment of Taiwanese patients with schizophrenia who continued to receive treatment for 64 weeks.</p

Printed Modified Bow-Tie Dipole Antenna for DVB/WLAN Applications

A printed modified bow-tie dipole antenna which consists of asymmetric-feed and inserted slots is presented to apply to the DVB and WLAN systems. This antenna combines omnidirectional radiation pattern, broad bandwidth, and band rejection in an easy way to fabricate. Experimental results of the constructed prototype indicate that the VSWR 2.5 : 1 bandwidths achieve 166.7%, 28.57%, and 23.63% at 660 MHz, 2450 MHz, and 5500 MHz, respectively