NEFTune: Noisy Embeddings Improve Instruction Finetuning

We show that language model finetuning can be improved, sometimes dramatically, with a simple augmentation. NEFTune adds noise to the embedding vectors during training. Standard finetuning of LLaMA-2-7B using Alpaca achieves 29.79% on AlpacaEval, which rises to 64.69% using noisy embeddings. NEFTune also improves over strong baselines on modern instruction datasets. Models trained with Evol-Instruct see a 10% improvement, with ShareGPT an 8% improvement, and with OpenPlatypus an 8% improvement. Even powerful models further refined with RLHF such as LLaMA-2-Chat benefit from additional training with NEFTune.Comment: 25 pages, Code is available on Github: https://github.com/neelsjain/NEFTun

The nucleolar protein NIFK promotes cancer progression via CK1α/β-catenin in metastasis and Ki-67-dependent cell proliferation.

Nucleolar protein interacting with the FHA domain of pKi-67 (NIFK) is a Ki-67-interacting protein. However, its precise function in cancer remains largely uninvestigated. Here we show the clinical significance and metastatic mechanism of NIFK in lung cancer. NIFK expression is clinically associated with poor prognosis and metastasis. Furthermore, NIFK enhances Ki-67-dependent proliferation, and promotes migration, invasion in vitro and metastasis in vivo via downregulation of casein kinase 1α (CK1α), a suppressor of pro-metastatic TCF4/β-catenin signaling. Inversely, CK1α is upregulated upon NIFK knockdown. The silencing of CK1α expression in NIFK-silenced cells restores TCF4/β-catenin transcriptional activity, cell migration, and metastasis. Furthermore, RUNX1 is identified as a transcription factor of CSNK1A1 (CK1α) that is negatively regulated by NIFK. Our results demonstrate the prognostic value of NIFK, and suggest that NIFK is required for lung cancer progression via the RUNX1-dependent CK1α repression, which activates TCF4/β-catenin signaling in metastasis and the Ki-67-dependent regulation in cell proliferation

Disruption of White Matter Integrity in Bipolar Depression as a Possible Structural Marker of Illness

n/

Substrate integrated Bragg waveguide: an octave-bandwidth single-mode hybrid transmission line for millimeter-wave applications

We demonstrate an air-core single-mode hollow hybrid waveguide that uses Bragg reflector structures in place of the vertical metal walls of the standard rectangular waveguide or via holes of the so-called substrate integrated waveguide. The high-order modes in the waveguide are substantially suppressed by a modal-filtering effect, making the waveguide operate in the fundamental mode over more than one octave. Numerical simulations show that the propagation loss of the proposed waveguide can be lower than that of classic hollow metallic rectangular waveguides at terahertz frequencies, benefiting from a significant reduction in Ohmic loss. To facilitate fabrication and characterization, a proof-of-concept 20 to 45 GHz waveguide is demonstrated, which verifies the properties and advantages of the proposed waveguide. A zero group-velocity dispersion point is observed at near the middle of the operating band, which is ideal for reducing signal distortion. This work offers a step towards a hybrid transmission-line medium that can be used in a variety of functional components for multilayer integration and broadband applications