Large Language Models as Annotators: Enhancing Generalization of NLP Models at Minimal Cost

State-of-the-art supervised NLP models achieve high accuracy but are also susceptible to failures on inputs from low-data regimes, such as domains that are not represented in training data. As an approximation to collecting ground-truth labels for the specific domain, we study the use of large language models (LLMs) for annotating inputs and improving the generalization of NLP models. Specifically, given a budget for LLM annotations, we present an algorithm for sampling the most informative inputs to annotate and retrain the NLP model. We find that popular active learning strategies such as uncertainty-based sampling do not work well. Instead, we propose a sampling strategy based on the difference in prediction scores between the base model and the finetuned NLP model, utilizing the fact that most NLP models are finetuned from a base model. Experiments with classification (semantic similarity) and ranking (semantic search) tasks show that our sampling strategy leads to significant gains in accuracy for both the training and target domains

Model Sparsification Can Simplify Machine Unlearning

Recent data regulations necessitate machine unlearning (MU): The removal of the effect of specific examples from the model. While exact unlearning is possible by conducting a model retraining with the remaining data from scratch, its computational cost has led to the development of approximate but efficient unlearning schemes. Beyond data-centric MU solutions, we advance MU through a novel model-based viewpoint: sparsification via weight pruning. Our results in both theory and practice indicate that model sparsity can boost the multi-criteria unlearning performance of an approximate unlearner, closing the approximation gap, while continuing to be efficient. With this insight, we develop two new sparsity-aware unlearning meta-schemes, termed `prune first, then unlearn' and `sparsity-aware unlearning'. Extensive experiments show that our findings and proposals consistently benefit MU in various scenarios, including class-wise data scrubbing, random data scrubbing, and backdoor data forgetting. One highlight is the 77% unlearning efficacy gain of fine-tuning (one of the simplest approximate unlearning methods) in the proposed sparsity-aware unlearning paradigm. Codes are available at https://github.com/OPTML-Group/Unlearn-Sparse

Biocompatibility of a Magnetic Tunnel Junction Sensor Array for the Detection of Neuronal Signals in Culture

Magnetoencephalography has been established nowadays as a crucial in vivo technique for clinical and diagnostic applications due to its unprecedented spatial and temporal resolution and its non-invasive methods. However, the innate nature of the biomagnetic signals derived from active biological tissue is still largely unknown. One alternative possibility for in vitro analysis is the use of magnetic sensor arrays based on Magnetoresistance. However, these sensors have never been used to perform long-term in vitro studies mainly due to critical biocompatibility issues with neurons in culture. In this study, we present the first biomagnetic chip based on magnetic tunnel junction (MTJ) technology for cell culture studies and show the biocompatibility of these sensors. We obtained a full biocompatibility of the system through the planarization of the sensors and the use of a three-layer capping of SiO2/Si3N4/SiO2. We grew primary neurons up to 20 days on the top of our devices and obtained proper functionality and viability of the overlying neuronal networks. At the same time, MTJ sensors kept their performances unchanged for several weeks in contact with neurons and neuronal medium. These results pave the way to the development of high performing biomagnetic sensing technology for the electrophysiology of in vitro systems, in analogy with Multi Electrode Arrays

On-treatment comparison between corrective His bundle pacing and biventricular pacing for cardiac resynchronization: A secondary analysis of His-SYNC

Background The His-SYNC pilot trial was the first randomized comparison between His bundle pacing in lieu of a left ventricular lead for cardiac resynchronization therapy (His-CRT) and biventricular pacing (BiV-CRT), but was limited by high rates of crossover. Objective To evaluate the results of the His-SYNC pilot trial utilizing treatment-received (TR) and per-protocol (PP) analyses. Methods The His-SYNC pilot was a multicenter, prospective, single-blinded, randomized, controlled trial comparing His-CRT vs BiV-CRT in patients meeting standard indications for CRT (eg, NYHA II–IV patients with QRS >120 ms). Crossovers were required based on prespecified criteria. The primary endpoints analyzed included improvement in QRS duration, left ventricular ejection fraction (LVEF), and freedom from cardiovascular (CV) hospitalization and mortality. Results Among 41 patients enrolled (aged 64 ± 13 years, 38% female, LVEF 28%, QRS 168 ± 18 ms), 21 were randomized to His-CRT and 20 to BiV-CRT. Crossover occurred in 48% of His-CRT and 26% of BiV-CRT. The most common reason for crossover from His-CRT was inability to correct QRS owing to nonspecific intraventricular conduction delay (n = 5). Patients treated with His-CRT demonstrated greater QRS narrowing compared to BiV (125 ± 22 ms vs 164 ± 25 ms [TR], P < .001;124 ± 19 ms vs 162 ± 24 ms [PP], P < .001). A trend toward higher echocardiographic response was also observed (80 vs 57% [TR], P = .14; 91% vs 54% [PP], P = .078). No significant differences in CV hospitalization or mortality were observed. Conclusions Patients receiving His-CRT on-treatment demonstrated superior electrical resynchronization and a trend toward higher echocardiographic response than BiV-CRT. Larger prospective studies may be justifiable with refinements in patient selection and implantation techniques to minimize crossovers

Biocompatibility of a Magnetic Tunnel Junction Sensor Array for the Detection of Neuronal Signals in Culture

Magnetoencephalography has been established nowadays as a crucial in vivo technique for clinical and diagnostic applications due to its unprecedented spatial and temporal resolution and its non-invasive methods. However, the innate nature of the biomagnetic signals derived from active biological tissue is still largely unknown. One alternative possibility for in vitro analysis is the use of magnetic sensor arrays based on Magnetoresistance. However, these sensors have never been used to perform long-term in vitro studies mainly due to critical biocompatibility issues with neurons in culture. In this study, we present the first biomagnetic chip based on magnetic tunnel junction (MTJ) technology for cell culture studies and show the biocompatibility of these sensors. We obtained a full biocompatibility of the system through the planarization of the sensors and the use of a three-layer capping of SiO2/Si3N4/SiO2. We grew primary neurons up to 20 days on the top of our devices and obtained proper functionality and viability of the overlying neuronal networks. At the same time, MTJ sensors kept their performances unchanged for several weeks in contact with neurons and neuronal medium. These results pave the way to the development of high performing biomagnetic sensing technology for the electrophysiology of in vitro systems, in analogy with Multi Electrode Arrays

Integrated platform for detecting pathogenic DNA via magnetic tunneling junction-based biosensors

In recent years, the development of portable platforms for performing fast and point-of-care analyses has drawn considerable attention for their wide variety of applications in life science. In this framework, tools combining magnetoresistive biosensors with magnetic markers have been widely studied in order to detect concentrations of specific molecules, demonstrating high sensitivity and ease of integration with conventional electronics. In this work, first, we develop a protocol for efficient hybridization of natural DNA; then, we show the detection of hybridization events involving natural DNA, namely genomic DNA extracted from the pathogenic bacterium Listeria monocytogenes, via a compact magnetic tunneling junction (MTJ)-based biosensing apparatus. The platform comprises dedicated portable electronic and microfluidic setups, enabling point-of-care biological assays. A sensitivity below the nM range is demonstrated. This work constitutes a step forward towards the development of portable lab-on-chip platforms, for the multiplexed detection of pathogenic health threats in food and food processing environment